[2023-02-25 12:18:18,811][2408954] Saving configuration to /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/config.json...
[2023-02-25 12:18:18,812][2408954] Rollout worker 0 uses device cpu
[2023-02-25 12:18:18,812][2408954] Rollout worker 1 uses device cpu
[2023-02-25 12:18:18,812][2408954] Rollout worker 2 uses device cpu
[2023-02-25 12:18:18,812][2408954] Rollout worker 3 uses device cpu
[2023-02-25 12:18:18,812][2408954] Rollout worker 4 uses device cpu
[2023-02-25 12:18:18,812][2408954] Rollout worker 5 uses device cpu
[2023-02-25 12:18:18,813][2408954] Rollout worker 6 uses device cpu
[2023-02-25 12:18:18,813][2408954] Rollout worker 7 uses device cpu
[2023-02-25 12:18:18,813][2408954] Rollout worker 8 uses device cpu
[2023-02-25 12:18:18,813][2408954] Rollout worker 9 uses device cpu
[2023-02-25 12:18:18,813][2408954] Rollout worker 10 uses device cpu
[2023-02-25 12:18:18,813][2408954] Rollout worker 11 uses device cpu
[2023-02-25 12:18:18,813][2408954] Rollout worker 12 uses device cpu
[2023-02-25 12:18:18,813][2408954] Rollout worker 13 uses device cpu
[2023-02-25 12:18:18,814][2408954] Rollout worker 14 uses device cpu
[2023-02-25 12:18:18,814][2408954] Rollout worker 15 uses device cpu
[2023-02-25 12:18:18,814][2408954] Rollout worker 16 uses device cpu
[2023-02-25 12:18:18,814][2408954] Rollout worker 17 uses device cpu
[2023-02-25 12:18:18,814][2408954] Rollout worker 18 uses device cpu
[2023-02-25 12:18:18,814][2408954] Rollout worker 19 uses device cpu
[2023-02-25 12:18:18,814][2408954] Rollout worker 20 uses device cpu
[2023-02-25 12:18:18,815][2408954] Rollout worker 21 uses device cpu
[2023-02-25 12:18:18,815][2408954] Rollout worker 22 uses device cpu
[2023-02-25 12:18:18,815][2408954] Rollout worker 23 uses device cpu
[2023-02-25 12:18:18,815][2408954] Rollout worker 24 uses device cpu
[2023-02-25 12:18:18,815][2408954] Rollout worker 25 uses device cpu
[2023-02-25 12:18:18,815][2408954] Rollout worker 26 uses device cpu
[2023-02-25 12:18:18,815][2408954] Rollout worker 27 uses device cpu
[2023-02-25 12:18:18,815][2408954] Rollout worker 28 uses device cpu
[2023-02-25 12:18:18,816][2408954] Rollout worker 29 uses device cpu
[2023-02-25 12:18:18,816][2408954] Rollout worker 30 uses device cpu
[2023-02-25 12:18:18,816][2408954] Rollout worker 31 uses device cpu
[2023-02-25 12:18:19,205][2408954] Using GPUs [0] for process 0 (actually maps to GPUs [0])
[2023-02-25 12:18:19,206][2408954] InferenceWorker_p0-w0: min num requests: 10
[2023-02-25 12:18:19,271][2408954] Starting all processes...
[2023-02-25 12:18:19,272][2408954] Starting process learner_proc0
[2023-02-25 12:18:20,022][2408954] Starting all processes...
[2023-02-25 12:18:20,025][2408954] Starting process inference_proc0-0
[2023-02-25 12:18:20,027][2409033] Using GPUs [0] for process 0 (actually maps to GPUs [0])
[2023-02-25 12:18:20,027][2409033] Set environment var CUDA_VISIBLE_DEVICES to '0' (GPU indices [0]) for learning process 0
[2023-02-25 12:18:20,027][2408954] Starting process rollout_proc0
[2023-02-25 12:18:20,028][2408954] Starting process rollout_proc1
[2023-02-25 12:18:20,028][2408954] Starting process rollout_proc2
[2023-02-25 12:18:20,028][2408954] Starting process rollout_proc3
[2023-02-25 12:18:20,028][2408954] Starting process rollout_proc4
[2023-02-25 12:18:20,028][2408954] Starting process rollout_proc5
[2023-02-25 12:18:20,032][2408954] Starting process rollout_proc6
[2023-02-25 12:18:20,033][2408954] Starting process rollout_proc7
[2023-02-25 12:18:20,044][2409033] Num visible devices: 1
[2023-02-25 12:18:20,033][2408954] Starting process rollout_proc8
[2023-02-25 12:18:20,034][2408954] Starting process rollout_proc9
[2023-02-25 12:18:20,037][2408954] Starting process rollout_proc10
[2023-02-25 12:18:20,037][2408954] Starting process rollout_proc11
[2023-02-25 12:18:20,037][2408954] Starting process rollout_proc12
[2023-02-25 12:18:20,076][2409033] Starting seed is not provided
[2023-02-25 12:18:20,076][2409033] Using GPUs [0] for process 0 (actually maps to GPUs [0])
[2023-02-25 12:18:20,076][2409033] Initializing actor-critic model on device cuda:0
[2023-02-25 12:18:20,077][2409033] RunningMeanStd input shape: (23,)
[2023-02-25 12:18:20,038][2408954] Starting process rollout_proc13
[2023-02-25 12:18:20,077][2409033] RunningMeanStd input shape: (3, 72, 128)
[2023-02-25 12:18:20,078][2409033] RunningMeanStd input shape: (1,)
[2023-02-25 12:18:20,040][2408954] Starting process rollout_proc14
[2023-02-25 12:18:20,092][2409033] ConvEncoder: input_channels=3
[2023-02-25 12:18:20,234][2409033] Conv encoder output size: 512
[2023-02-25 12:18:20,235][2409033] Policy head output size: 512
[2023-02-25 12:18:20,252][2409033] Created Actor Critic model with architecture:
[2023-02-25 12:18:20,252][2409033] ActorCriticSharedWeights(
  (obs_normalizer): ObservationNormalizer(
    (running_mean_std): RunningMeanStdDictInPlace(
      (running_mean_std): ModuleDict(
        (measurements): RunningMeanStdInPlace()
        (obs): RunningMeanStdInPlace()
      )
    )
  )
  (returns_normalizer): RecursiveScriptModule(original_name=RunningMeanStdInPlace)
  (encoder): VizdoomEncoder(
    (basic_encoder): ConvEncoder(
      (enc): RecursiveScriptModule(
        original_name=ConvEncoderImpl
        (conv_head): RecursiveScriptModule(
          original_name=Sequential
          (0): RecursiveScriptModule(original_name=Conv2d)
          (1): RecursiveScriptModule(original_name=ELU)
          (2): RecursiveScriptModule(original_name=Conv2d)
          (3): RecursiveScriptModule(original_name=ELU)
          (4): RecursiveScriptModule(original_name=Conv2d)
          (5): RecursiveScriptModule(original_name=ELU)
        )
        (mlp_layers): RecursiveScriptModule(
          original_name=Sequential
          (0): RecursiveScriptModule(original_name=Linear)
          (1): RecursiveScriptModule(original_name=ELU)
        )
      )
    )
  )
  (core): ModelCoreRNN(
    (core): GRU(512, 512)
  )
  (decoder): MlpDecoder(
    (mlp): Identity()
  )
  (critic_linear): Linear(in_features=512, out_features=1, bias=True)
  (action_parameterization): ActionParameterizationDefault(
    (distribution_linear): Linear(in_features=512, out_features=39, bias=True)
  )
)
[2023-02-25 12:18:21,721][2408954] Starting process rollout_proc15
[2023-02-25 12:18:21,738][2409077] Worker 3 uses CPU cores [3]
[2023-02-25 12:18:21,745][2408954] Starting process rollout_proc16
[2023-02-25 12:18:21,755][2409101] Worker 10 uses CPU cores [10]
[2023-02-25 12:18:21,775][2408954] Starting process rollout_proc17
[2023-02-25 12:18:21,781][2409100] Worker 11 uses CPU cores [11]
[2023-02-25 12:18:21,786][2408954] Starting process rollout_proc18
[2023-02-25 12:18:21,786][2409074] Using GPUs [0] for process 0 (actually maps to GPUs [0])
[2023-02-25 12:18:21,787][2409074] Set environment var CUDA_VISIBLE_DEVICES to '0' (GPU indices [0]) for inference process 0
[2023-02-25 12:18:21,799][2408954] Starting process rollout_proc19
[2023-02-25 12:18:21,807][2408954] Starting process rollout_proc20
[2023-02-25 12:18:21,817][2409076] Worker 0 uses CPU cores [0]
[2023-02-25 12:18:21,822][2409078] Worker 2 uses CPU cores [2]
[2023-02-25 12:18:21,822][2409104] Worker 13 uses CPU cores [13]
[2023-02-25 12:18:21,822][2409074] Num visible devices: 1
[2023-02-25 12:18:21,827][2408954] Starting process rollout_proc21
[2023-02-25 12:18:21,849][2408954] Starting process rollout_proc22
[2023-02-25 12:18:21,858][2409103] Worker 8 uses CPU cores [8]
[2023-02-25 12:18:21,859][2408954] Starting process rollout_proc23
[2023-02-25 12:18:21,859][2408954] Starting process rollout_proc24
[2023-02-25 12:18:21,872][2409105] Worker 14 uses CPU cores [14]
[2023-02-25 12:18:21,874][2409099] Worker 7 uses CPU cores [7]
[2023-02-25 12:18:21,876][2409075] Worker 1 uses CPU cores [1]
[2023-02-25 12:18:21,877][2409096] Worker 6 uses CPU cores [6]
[2023-02-25 12:18:21,885][2408954] Starting process rollout_proc25
[2023-02-25 12:18:21,885][2408954] Starting process rollout_proc26
[2023-02-25 12:18:21,911][2408954] Starting process rollout_proc27
[2023-02-25 12:18:21,912][2408954] Starting process rollout_proc28
[2023-02-25 12:18:21,918][2409079] Worker 4 uses CPU cores [4]
[2023-02-25 12:18:21,926][2409097] Worker 9 uses CPU cores [9]
[2023-02-25 12:18:21,931][2409102] Worker 12 uses CPU cores [12]
[2023-02-25 12:18:21,938][2408954] Starting process rollout_proc29
[2023-02-25 12:18:21,974][2408954] Starting process rollout_proc30
[2023-02-25 12:18:22,002][2409080] Worker 5 uses CPU cores [5]
[2023-02-25 12:18:23,339][2409033] Using optimizer <class 'torch.optim.adam.Adam'>
[2023-02-25 12:18:23,340][2409033] No checkpoints found
[2023-02-25 12:18:23,340][2409033] Did not load from checkpoint, starting from scratch!
[2023-02-25 12:18:23,341][2409033] Initialized policy 0 weights for model version 0
[2023-02-25 12:18:23,358][2409033] LearnerWorker_p0 finished initialization!
[2023-02-25 12:18:23,359][2409033] Using GPUs [0] for process 0 (actually maps to GPUs [0])
[2023-02-25 12:18:23,551][2408954] Starting process rollout_proc31
[2023-02-25 12:18:23,570][2409469] Worker 22 uses CPU cores [6]
[2023-02-25 12:18:23,574][2409389] Worker 17 uses CPU cores [1]
[2023-02-25 12:18:23,636][2409406] Worker 19 uses CPU cores [3]
[2023-02-25 12:18:23,642][2409468] Worker 21 uses CPU cores [5]
[2023-02-25 12:18:23,650][2409486] Worker 23 uses CPU cores [7]
[2023-02-25 12:18:23,674][2409355] Worker 15 uses CPU cores [15]
[2023-02-25 12:18:23,674][2409373] Worker 16 uses CPU cores [0]
[2023-02-25 12:18:23,686][2409405] Worker 18 uses CPU cores [2]
[2023-02-25 12:18:23,694][2409485] Worker 24 uses CPU cores [8]
[2023-02-25 12:18:23,708][2409074] RunningMeanStd input shape: (23,)
[2023-02-25 12:18:23,709][2409074] RunningMeanStd input shape: (3, 72, 128)
[2023-02-25 12:18:23,709][2409074] RunningMeanStd input shape: (1,)
[2023-02-25 12:18:23,718][2409074] ConvEncoder: input_channels=3
[2023-02-25 12:18:23,724][2409597] Worker 30 uses CPU cores [14]
[2023-02-25 12:18:23,734][2409407] Worker 20 uses CPU cores [4]
[2023-02-25 12:18:23,749][2409548] Worker 27 uses CPU cores [11]
[2023-02-25 12:18:23,765][2409565] Worker 28 uses CPU cores [12]
[2023-02-25 12:18:23,765][2409549] Worker 26 uses CPU cores [10]
[2023-02-25 12:18:23,822][2409074] Conv encoder output size: 512
[2023-02-25 12:18:23,823][2409074] Policy head output size: 512
[2023-02-25 12:18:23,830][2409596] Worker 29 uses CPU cores [13]
[2023-02-25 12:18:23,838][2409547] Worker 25 uses CPU cores [9]
[2023-02-25 12:18:24,483][2408954] Fps is (10 sec: nan, 60 sec: nan, 300 sec: nan). Total num frames: 0. Throughput: 0: nan. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0)
[2023-02-25 12:18:24,485][2409866] Worker 31 uses CPU cores [15]
[2023-02-25 12:18:25,182][2408954] Inference worker 0-0 is ready!
[2023-02-25 12:18:25,182][2408954] All inference workers are ready! Signal rollout workers to start!
[2023-02-25 12:18:25,276][2409406] Doom resolution: 160x120, resize resolution: (128, 72)
[2023-02-25 12:18:25,282][2409406] Port 42200 is available
[2023-02-25 12:18:25,285][2409406] Using port 42200
[2023-02-25 12:18:25,293][2409389] Doom resolution: 160x120, resize resolution: (128, 72)
[2023-02-25 12:18:25,293][2409597] Doom resolution: 160x120, resize resolution: (128, 72)
[2023-02-25 12:18:25,294][2409565] Doom resolution: 160x120, resize resolution: (128, 72)
[2023-02-25 12:18:25,295][2409080] Doom resolution: 160x120, resize resolution: (128, 72)
[2023-02-25 12:18:25,296][2409389] Port 42000 is available
[2023-02-25 12:18:25,301][2409075] Doom resolution: 160x120, resize resolution: (128, 72)
[2023-02-25 12:18:25,301][2409389] Using port 42000
[2023-02-25 12:18:25,304][2409547] Doom resolution: 160x120, resize resolution: (128, 72)
[2023-02-25 12:18:25,301][2409080] Port 40800 is available
[2023-02-25 12:18:25,304][2409597] Port 43300 is available
[2023-02-25 12:18:25,311][2409080] Using port 40800
[2023-02-25 12:18:25,301][2409565] Port 43100 is available
[2023-02-25 12:18:25,311][2409597] Using port 43300
[2023-02-25 12:18:25,311][2409565] Using port 43100
[2023-02-25 12:18:25,312][2409547] Port 42800 is available
[2023-02-25 12:18:25,312][2409075] Port 40400 is available
[2023-02-25 12:18:25,313][2409547] Using port 42800
[2023-02-25 12:18:25,313][2409075] Using port 40400
[2023-02-25 12:18:25,314][2409485] Doom resolution: 160x120, resize resolution: (128, 72)
[2023-02-25 12:18:25,314][2409101] Doom resolution: 160x120, resize resolution: (128, 72)
[2023-02-25 12:18:25,314][2409373] Doom resolution: 160x120, resize resolution: (128, 72)
[2023-02-25 12:18:25,315][2409407] Doom resolution: 160x120, resize resolution: (128, 72)
[2023-02-25 12:18:25,302][2409100] Doom resolution: 160x120, resize resolution: (128, 72)
[2023-02-25 12:18:25,307][2409105] Doom resolution: 160x120, resize resolution: (128, 72)
[2023-02-25 12:18:25,308][2409549] Doom resolution: 160x120, resize resolution: (128, 72)
[2023-02-25 12:18:25,308][2409102] Doom resolution: 160x120, resize resolution: (128, 72)
[2023-02-25 12:18:25,318][2409469] Doom resolution: 160x120, resize resolution: (128, 72)
[2023-02-25 12:18:25,318][2409407] Port 42300 is available
[2023-02-25 12:18:25,319][2409407] Using port 42300
[2023-02-25 12:18:25,319][2409100] Port 41400 is available
[2023-02-25 12:18:25,319][2409100] Using port 41400
[2023-02-25 12:18:25,319][2409105] Port 41700 is available
[2023-02-25 12:18:25,319][2409549] Port 42900 is available
[2023-02-25 12:18:25,319][2409105] Using port 41700
[2023-02-25 12:18:25,319][2409549] Using port 42900
[2023-02-25 12:18:25,319][2409078] Doom resolution: 160x120, resize resolution: (128, 72)
[2023-02-25 12:18:25,320][2409104] Doom resolution: 160x120, resize resolution: (128, 72)
[2023-02-25 12:18:25,321][2409076] Doom resolution: 160x120, resize resolution: (128, 72)
[2023-02-25 12:18:25,321][2409355] Doom resolution: 160x120, resize resolution: (128, 72)
[2023-02-25 12:18:25,321][2409099] Doom resolution: 160x120, resize resolution: (128, 72)
[2023-02-25 12:18:25,321][2409469] Port 42500 is available
[2023-02-25 12:18:25,322][2409469] Using port 42500
[2023-02-25 12:18:25,309][2409468] Doom resolution: 160x120, resize resolution: (128, 72)
[2023-02-25 12:18:25,323][2409866] Doom resolution: 160x120, resize resolution: (128, 72)
[2023-02-25 12:18:25,323][2409101] Port 41300 is available
[2023-02-25 12:18:25,324][2409101] Using port 41300
[2023-02-25 12:18:25,323][2409373] Port 41900 is available
[2023-02-25 12:18:25,324][2409099] Port 41000 is available
[2023-02-25 12:18:25,319][2409102] Port 41500 is available
[2023-02-25 12:18:25,324][2409099] Using port 41000
[2023-02-25 12:18:25,324][2409373] Using port 41900
[2023-02-25 12:18:25,325][2409405] Doom resolution: 160x120, resize resolution: (128, 72)
[2023-02-25 12:18:25,325][2409468] Port 42400 is available
[2023-02-25 12:18:25,325][2409468] Using port 42400
[2023-02-25 12:18:25,325][2409097] Doom resolution: 160x120, resize resolution: (128, 72)
[2023-02-25 12:18:25,323][2409078] Port 40500 is available
[2023-02-25 12:18:25,326][2409355] Port 41800 is available
[2023-02-25 12:18:25,326][2409078] Using port 40500
[2023-02-25 12:18:25,310][2409077] Doom resolution: 160x120, resize resolution: (128, 72)
[2023-02-25 12:18:25,310][2409079] Doom resolution: 160x120, resize resolution: (128, 72)
[2023-02-25 12:18:25,314][2409096] Doom resolution: 160x120, resize resolution: (128, 72)
[2023-02-25 12:18:25,326][2409355] Using port 41800
[2023-02-25 12:18:25,323][2409485] Port 42700 is available
[2023-02-25 12:18:25,327][2409548] Doom resolution: 160x120, resize resolution: (128, 72)
[2023-02-25 12:18:25,324][2409102] Using port 41500
[2023-02-25 12:18:25,327][2409485] Using port 42700
[2023-02-25 12:18:25,329][2409077] Port 40600 is available
[2023-02-25 12:18:25,329][2409104] Port 41600 is available
[2023-02-25 12:18:25,330][2409077] Using port 40600
[2023-02-25 12:18:25,329][2409548] Port 43000 is available
[2023-02-25 12:18:25,330][2409096] Port 40900 is available
[2023-02-25 12:18:25,330][2409548] Using port 43000
[2023-02-25 12:18:25,330][2409104] Using port 41600
[2023-02-25 12:18:25,330][2409076] Port 40300 is available
[2023-02-25 12:18:25,331][2409076] Using port 40300
[2023-02-25 12:18:25,331][2409079] Port 40700 is available
[2023-02-25 12:18:25,330][2409096] Using port 40900
[2023-02-25 12:18:25,339][2409079] Using port 40700
[2023-02-25 12:18:25,331][2409866] Port 43400 is available
[2023-02-25 12:18:25,334][2409486] Doom resolution: 160x120, resize resolution: (128, 72)
[2023-02-25 12:18:25,343][2409866] Using port 43400
[2023-02-25 12:18:25,335][2409405] Port 42100 is available
[2023-02-25 12:18:25,341][2409103] Doom resolution: 160x120, resize resolution: (128, 72)
[2023-02-25 12:18:25,343][2409405] Using port 42100
[2023-02-25 12:18:25,338][2409596] Doom resolution: 160x120, resize resolution: (128, 72)
[2023-02-25 12:18:25,346][2409486] Port 42600 is available
[2023-02-25 12:18:25,337][2409097] Port 41200 is available
[2023-02-25 12:18:25,354][2409103] Port 41100 is available
[2023-02-25 12:18:25,355][2409097] Using port 41200
[2023-02-25 12:18:25,355][2409103] Using port 41100
[2023-02-25 12:18:25,356][2409596] Port 43200 is available
[2023-02-25 12:18:25,357][2409596] Using port 43200
[2023-02-25 12:18:25,342][2409406] Port 42201 is available
[2023-02-25 12:18:25,351][2409486] Using port 42600
[2023-02-25 12:18:25,359][2409406] Using port 42201
[2023-02-25 12:18:25,374][2409389] Port 42001 is available
[2023-02-25 12:18:25,374][2409389] Using port 42001
[2023-02-25 12:18:25,377][2409080] Port 40801 is available
[2023-02-25 12:18:25,381][2409547] Port 42801 is available
[2023-02-25 12:18:25,381][2409075] Port 40401 is available
[2023-02-25 12:18:25,381][2409547] Using port 42801
[2023-02-25 12:18:25,385][2409597] Port 43301 is available
[2023-02-25 12:18:25,381][2409075] Using port 40401
[2023-02-25 12:18:25,386][2409100] Port 41401 is available
[2023-02-25 12:18:25,378][2409080] Using port 40801
[2023-02-25 12:18:25,387][2409100] Using port 41401
[2023-02-25 12:18:25,389][2409407] Port 42301 is available
[2023-02-25 12:18:25,390][2409407] Using port 42301
[2023-02-25 12:18:25,390][2409597] Using port 43301
[2023-02-25 12:18:25,397][2409549] Port 42901 is available
[2023-02-25 12:18:25,397][2409549] Using port 42901
[2023-02-25 12:18:25,397][2409468] Port 42401 is available
[2023-02-25 12:18:25,398][2409468] Using port 42401
[2023-02-25 12:18:25,399][2409355] Port 41801 is available
[2023-02-25 12:18:25,399][2409077] Port 40601 is available
[2023-02-25 12:18:25,400][2409355] Using port 41801
[2023-02-25 12:18:25,400][2409077] Using port 40601
[2023-02-25 12:18:25,404][2409101] Port 41301 is available
[2023-02-25 12:18:25,405][2409101] Using port 41301
[2023-02-25 12:18:25,405][2409548] Port 43001 is available
[2023-02-25 12:18:25,406][2409078] Port 40501 is available
[2023-02-25 12:18:25,406][2409078] Using port 40501
[2023-02-25 12:18:25,408][2409469] Port 42501 is available
[2023-02-25 12:18:25,406][2409373] Port 41901 is available
[2023-02-25 12:18:25,409][2409373] Using port 41901
[2023-02-25 12:18:25,406][2409565] Port 43101 is available
[2023-02-25 12:18:25,409][2409469] Using port 42501
[2023-02-25 12:18:25,409][2409565] Using port 43101
[2023-02-25 12:18:25,410][2409866] Port 43401 is available
[2023-02-25 12:18:25,408][2409105] Port 41701 is available
[2023-02-25 12:18:25,412][2409099] Port 41001 is available
[2023-02-25 12:18:25,413][2409105] Using port 41701
[2023-02-25 12:18:25,406][2409548] Using port 43001
[2023-02-25 12:18:25,414][2409076] Port 40301 is available
[2023-02-25 12:18:25,415][2409076] Using port 40301
[2023-02-25 12:18:25,413][2409099] Using port 41001
[2023-02-25 12:18:25,416][2409079] Port 40701 is available
[2023-02-25 12:18:25,417][2409079] Using port 40701
[2023-02-25 12:18:25,417][2409102] Port 41501 is available
[2023-02-25 12:18:25,417][2409102] Using port 41501
[2023-02-25 12:18:25,410][2409866] Using port 43401
[2023-02-25 12:18:25,416][2409104] Port 41601 is available
[2023-02-25 12:18:25,421][2409104] Using port 41601
[2023-02-25 12:18:25,424][2409097] Port 41201 is available
[2023-02-25 12:18:25,431][2409097] Using port 41201
[2023-02-25 12:18:25,424][2409405] Port 42101 is available
[2023-02-25 12:18:25,425][2409096] Port 40901 is available
[2023-02-25 12:18:25,431][2409405] Using port 42101
[2023-02-25 12:18:25,432][2409096] Using port 40901
[2023-02-25 12:18:25,434][2409406] Port 42202 is available
[2023-02-25 12:18:25,435][2409406] Using port 42202
[2023-02-25 12:18:25,445][2409596] Port 43201 is available
[2023-02-25 12:18:25,446][2409596] Using port 43201
[2023-02-25 12:18:25,448][2409389] Port 42002 is available
[2023-02-25 12:18:25,449][2409389] Using port 42002
[2023-02-25 12:18:25,457][2409075] Port 40402 is available
[2023-02-25 12:18:25,459][2409100] Port 41402 is available
[2023-02-25 12:18:25,460][2409100] Using port 41402
[2023-02-25 12:18:25,460][2409080] Port 40802 is available
[2023-02-25 12:18:25,461][2409080] Using port 40802
[2023-02-25 12:18:25,461][2409486] Port 42601 is available
[2023-02-25 12:18:25,462][2409486] Using port 42601
[2023-02-25 12:18:25,465][2409547] Port 42802 is available
[2023-02-25 12:18:25,471][2409547] Using port 42802
[2023-02-25 12:18:25,473][2409101] Port 41302 is available
[2023-02-25 12:18:25,473][2409101] Using port 41302
[2023-02-25 12:18:25,466][2409549] Port 42902 is available
[2023-02-25 12:18:25,475][2409549] Using port 42902
[2023-02-25 12:18:25,478][2409078] Port 40502 is available
[2023-02-25 12:18:25,466][2409075] Using port 40402
[2023-02-25 12:18:25,467][2409485] Port 42701 is available
[2023-02-25 12:18:25,479][2409485] Using port 42701
[2023-02-25 12:18:25,477][2409597] Port 43302 is available
[2023-02-25 12:18:25,480][2409079] Port 40702 is available
[2023-02-25 12:18:25,480][2409079] Using port 40702
[2023-02-25 12:18:25,467][2409407] Port 42302 is available
[2023-02-25 12:18:25,480][2409597] Using port 43302
[2023-02-25 12:18:25,482][2409866] Port 43402 is available
[2023-02-25 12:18:25,483][2409407] Using port 42302
[2023-02-25 12:18:25,483][2409866] Using port 43402
[2023-02-25 12:18:25,478][2409078] Using port 40502
[2023-02-25 12:18:25,483][2409548] Port 43002 is available
[2023-02-25 12:18:25,484][2409548] Using port 43002
[2023-02-25 12:18:25,468][2409077] Port 40602 is available
[2023-02-25 12:18:25,486][2409103] Port 41101 is available
[2023-02-25 12:18:25,487][2409077] Using port 40602
[2023-02-25 12:18:25,488][2409103] Using port 41101
[2023-02-25 12:18:25,468][2409355] Port 41802 is available
[2023-02-25 12:18:25,491][2409355] Using port 41802
[2023-02-25 12:18:25,491][2409076] Port 40302 is available
[2023-02-25 12:18:25,492][2409076] Using port 40302
[2023-02-25 12:18:25,469][2409468] Port 42402 is available
[2023-02-25 12:18:25,492][2409468] Using port 42402
[2023-02-25 12:18:25,488][2409373] Port 41902 is available
[2023-02-25 12:18:25,493][2409373] Using port 41902
[2023-02-25 12:18:25,494][2409565] Port 43102 is available
[2023-02-25 12:18:25,495][2409565] Using port 43102
[2023-02-25 12:18:25,495][2409104] Port 41602 is available
[2023-02-25 12:18:25,496][2409104] Using port 41602
[2023-02-25 12:18:25,497][2409469] Port 42502 is available
[2023-02-25 12:18:25,497][2409406] Port 42203 is available
[2023-02-25 12:18:25,498][2409406] Using port 42203
[2023-02-25 12:18:25,494][2409102] Port 41502 is available
[2023-02-25 12:18:25,497][2409105] Port 41702 is available
[2023-02-25 12:18:25,502][2409102] Using port 41502
[2023-02-25 12:18:25,502][2409105] Using port 41702
[2023-02-25 12:18:25,503][2409469] Using port 42502
[2023-02-25 12:18:25,504][2409097] Port 41202 is available
[2023-02-25 12:18:25,504][2409097] Using port 41202
[2023-02-25 12:18:25,507][2409389] Port 42003 is available
[2023-02-25 12:18:25,507][2409389] Using port 42003
[2023-02-25 12:18:25,509][2409405] Port 42102 is available
[2023-02-25 12:18:25,510][2409405] Using port 42102
[2023-02-25 12:18:25,517][2409096] Port 40902 is available
[2023-02-25 12:18:25,518][2409096] Using port 40902
[2023-02-25 12:18:25,522][2409099] Port 41002 is available
[2023-02-25 12:18:25,529][2409099] Using port 41002
[2023-02-25 12:18:25,523][2409596] Port 43202 is available
[2023-02-25 12:18:25,531][2409596] Using port 43202
[2023-02-25 12:18:25,527][2409080] Port 40803 is available
[2023-02-25 12:18:25,534][2409080] Using port 40803
[2023-02-25 12:18:25,538][2409100] Port 41403 is available
[2023-02-25 12:18:25,539][2409100] Using port 41403
[2023-02-25 12:18:25,545][2409549] Port 42903 is available
[2023-02-25 12:18:25,545][2409549] Using port 42903
[2023-02-25 12:18:25,548][2409075] Port 40403 is available
[2023-02-25 12:18:25,549][2409075] Using port 40403
[2023-02-25 12:18:25,549][2409101] Port 41303 is available
[2023-02-25 12:18:25,549][2409547] Port 42803 is available
[2023-02-25 12:18:25,549][2409866] Port 43403 is available
[2023-02-25 12:18:25,549][2409547] Using port 42803
[2023-02-25 12:18:25,549][2409101] Using port 41303
[2023-02-25 12:18:25,549][2409866] Using port 43403
[2023-02-25 12:18:25,552][2409407] Port 42303 is available
[2023-02-25 12:18:25,553][2409407] Using port 42303
[2023-02-25 12:18:25,556][2409077] Port 40603 is available
[2023-02-25 12:18:25,557][2409077] Using port 40603
[2023-02-25 12:18:25,557][2409079] Port 40703 is available
[2023-02-25 12:18:25,558][2409079] Using port 40703
[2023-02-25 12:18:25,559][2409486] Port 42602 is available
[2023-02-25 12:18:25,560][2409486] Using port 42602
[2023-02-25 12:18:25,561][2409355] Port 41803 is available
[2023-02-25 12:18:25,561][2409355] Using port 41803
[2023-02-25 12:18:25,561][2409548] Port 43003 is available
[2023-02-25 12:18:25,561][2409548] Using port 43003
[2023-02-25 12:18:25,561][2409078] Port 40503 is available
[2023-02-25 12:18:25,565][2409468] Port 42403 is available
[2023-02-25 12:18:25,566][2409468] Using port 42403
[2023-02-25 12:18:25,562][2409078] Using port 40503
[2023-02-25 12:18:25,572][2409076] Port 40303 is available
[2023-02-25 12:18:25,572][2409597] Port 43303 is available
[2023-02-25 12:18:25,573][2409076] Using port 40303
[2023-02-25 12:18:25,576][2409565] Port 43103 is available
[2023-02-25 12:18:25,576][2409565] Using port 43103
[2023-02-25 12:18:25,569][2409104] Port 41603 is available
[2023-02-25 12:18:25,577][2409104] Using port 41603
[2023-02-25 12:18:25,577][2409406] Port 42204 is available
[2023-02-25 12:18:25,573][2409597] Using port 43303
[2023-02-25 12:18:25,578][2409406] Using port 42204
[2023-02-25 12:18:25,578][2409373] Port 41903 is available
[2023-02-25 12:18:25,578][2409373] Using port 41903
[2023-02-25 12:18:25,584][2409102] Port 41503 is available
[2023-02-25 12:18:25,585][2409102] Using port 41503
[2023-02-25 12:18:25,586][2409097] Port 41203 is available
[2023-02-25 12:18:25,586][2409389] Port 42004 is available
[2023-02-25 12:18:25,587][2409389] Using port 42004
[2023-02-25 12:18:25,587][2409097] Using port 41203
[2023-02-25 12:18:25,586][2409105] Port 41703 is available
[2023-02-25 12:18:25,589][2409405] Port 42103 is available
[2023-02-25 12:18:25,588][2409105] Using port 41703
[2023-02-25 12:18:25,589][2409469] Port 42503 is available
[2023-02-25 12:18:25,590][2409469] Using port 42503
[2023-02-25 12:18:25,590][2409405] Using port 42103
[2023-02-25 12:18:25,597][2409096] Port 40903 is available
[2023-02-25 12:18:25,601][2409485] Port 42702 is available
[2023-02-25 12:18:25,602][2409485] Using port 42702
[2023-02-25 12:18:25,602][2409096] Using port 40903
[2023-02-25 12:18:25,603][2409080] Port 40804 is available
[2023-02-25 12:18:25,604][2409080] Using port 40804
[2023-02-25 12:18:25,604][2409596] Port 43203 is available
[2023-02-25 12:18:25,611][2409596] Using port 43203
[2023-02-25 12:18:25,615][2409100] Port 41404 is available
[2023-02-25 12:18:25,616][2409100] Using port 41404
[2023-02-25 12:18:25,615][2409549] Port 42904 is available
[2023-02-25 12:18:25,616][2409549] Using port 42904
[2023-02-25 12:18:25,610][2409103] Port 41102 is available
[2023-02-25 12:18:25,617][2409103] Using port 41102
[2023-02-25 12:18:25,625][2409075] Port 40404 is available
[2023-02-25 12:18:25,625][2409101] Port 41304 is available
[2023-02-25 12:18:25,625][2409079] Port 40704 is available
[2023-02-25 12:18:25,626][2409075] Using port 40404
[2023-02-25 12:18:25,626][2409101] Using port 41304
[2023-02-25 12:18:25,626][2409079] Using port 40704
[2023-02-25 12:18:25,621][2409866] Port 43404 is available
[2023-02-25 12:18:25,627][2409866] Using port 43404
[2023-02-25 12:18:25,629][2409407] Port 42304 is available
[2023-02-25 12:18:25,630][2409407] Using port 42304
[2023-02-25 12:18:25,633][2409077] Port 40604 is available
[2023-02-25 12:18:25,633][2409077] Using port 40604
[2023-02-25 12:18:25,638][2409355] Port 41804 is available
[2023-02-25 12:18:25,638][2409355] Using port 41804
[2023-02-25 12:18:25,633][2409547] Port 42804 is available
[2023-02-25 12:18:25,640][2409548] Port 43004 is available
[2023-02-25 12:18:25,640][2409548] Using port 43004
[2023-02-25 12:18:25,640][2409547] Using port 42804
[2023-02-25 12:18:25,642][2409078] Port 40504 is available
[2023-02-25 12:18:25,639][2409099] Port 41003 is available
[2023-02-25 12:18:25,642][2409078] Using port 40504
[2023-02-25 12:18:25,644][2409468] Port 42404 is available
[2023-02-25 12:18:25,644][2409468] Using port 42404
[2023-02-25 12:18:25,644][2409099] Using port 41003
[2023-02-25 12:18:25,654][2409076] Port 40304 is available
[2023-02-25 12:18:25,655][2409373] Port 41904 is available
[2023-02-25 12:18:25,656][2409373] Using port 41904
[2023-02-25 12:18:25,657][2409406] Port 42205 is available
[2023-02-25 12:18:25,658][2409406] Using port 42205
[2023-02-25 12:18:25,658][2409565] Port 43104 is available
[2023-02-25 12:18:25,654][2409076] Using port 40304
[2023-02-25 12:18:25,659][2409597] Port 43304 is available
[2023-02-25 12:18:25,660][2409597] Using port 43304
[2023-02-25 12:18:25,658][2409565] Using port 43104
[2023-02-25 12:18:25,664][2409104] Port 41604 is available
[2023-02-25 12:18:25,671][2409104] Using port 41604
[2023-02-25 12:18:25,664][2409405] Port 42104 is available
[2023-02-25 12:18:25,671][2409405] Using port 42104
[2023-02-25 12:18:25,673][2409486] Port 42603 is available
[2023-02-25 12:18:25,674][2409486] Using port 42603
[2023-02-25 12:18:25,665][2409389] Port 42005 is available
[2023-02-25 12:18:25,675][2409389] Using port 42005
[2023-02-25 12:18:25,662][2409102] Port 41504 is available
[2023-02-25 12:18:25,674][2409469] Port 42504 is available
[2023-02-25 12:18:25,675][2409105] Port 41704 is available
[2023-02-25 12:18:25,682][2409080] Port 40805 is available
[2023-02-25 12:18:25,677][2409102] Using port 41504
[2023-02-25 12:18:25,677][2409596] Port 43204 is available
[2023-02-25 12:18:25,683][2409080] Using port 40805
[2023-02-25 12:18:25,683][2409105] Using port 41704
[2023-02-25 12:18:25,683][2409469] Using port 42504
[2023-02-25 12:18:25,683][2409596] Using port 43204
[2023-02-25 12:18:25,685][2409075] Port 40405 is available
[2023-02-25 12:18:25,685][2409097] Port 41204 is available
[2023-02-25 12:18:25,685][2409075] Using port 40405
[2023-02-25 12:18:25,685][2409097] Using port 41204
[2023-02-25 12:18:25,685][2409103] Port 41103 is available
[2023-02-25 12:18:25,686][2409103] Using port 41103
[2023-02-25 12:18:25,677][2409096] Port 40904 is available
[2023-02-25 12:18:25,677][2409485] Port 42703 is available
[2023-02-25 12:18:25,687][2409485] Using port 42703
[2023-02-25 12:18:25,687][2409096] Using port 40904
[2023-02-25 12:18:25,689][2409079] Port 40705 is available
[2023-02-25 12:18:25,690][2409079] Using port 40705
[2023-02-25 12:18:25,682][2409549] Port 42905 is available
[2023-02-25 12:18:25,691][2409549] Using port 42905
[2023-02-25 12:18:25,691][2409866] Port 43405 is available
[2023-02-25 12:18:25,691][2409866] Using port 43405
[2023-02-25 12:18:25,692][2409548] Port 43005 is available
[2023-02-25 12:18:25,682][2409100] Port 41405 is available
[2023-02-25 12:18:25,693][2409100] Using port 41405
[2023-02-25 12:18:25,695][2409407] Port 42305 is available
[2023-02-25 12:18:25,696][2409407] Using port 42305
[2023-02-25 12:18:25,699][2409548] Using port 43005
[2023-02-25 12:18:25,702][2409101] Port 41305 is available
[2023-02-25 12:18:25,702][2409077] Port 40605 is available
[2023-02-25 12:18:25,707][2409101] Using port 41305
[2023-02-25 12:18:25,707][2409077] Using port 40605
[2023-02-25 12:18:25,704][2409355] Port 41805 is available
[2023-02-25 12:18:25,711][2409355] Using port 41805
[2023-02-25 12:18:25,713][2409078] Port 40505 is available
[2023-02-25 12:18:25,717][2409468] Port 42405 is available
[2023-02-25 12:18:25,717][2409547] Port 42805 is available
[2023-02-25 12:18:25,718][2409468] Using port 42405
[2023-02-25 12:18:25,718][2409547] Using port 42805
[2023-02-25 12:18:25,713][2409078] Using port 40505
[2023-02-25 12:18:25,729][2409076] Port 40305 is available
[2023-02-25 12:18:25,730][2409076] Using port 40305
[2023-02-25 12:18:25,733][2409597] Port 43305 is available
[2023-02-25 12:18:25,734][2409597] Using port 43305
[2023-02-25 12:18:25,735][2409373] Port 41905 is available
[2023-02-25 12:18:25,736][2409373] Using port 41905
[2023-02-25 12:18:25,741][2409405] Port 42105 is available
[2023-02-25 12:18:25,743][2409406] Port 42206 is available
[2023-02-25 12:18:25,744][2409406] Using port 42206
[2023-02-25 12:18:25,746][2409104] Port 41605 is available
[2023-02-25 12:18:25,741][2409405] Using port 42105
[2023-02-25 12:18:25,751][2409389] Port 42006 is available
[2023-02-25 12:18:25,751][2409105] Port 41705 is available
[2023-02-25 12:18:25,752][2409105] Using port 41705
[2023-02-25 12:18:25,752][2409389] Using port 42006
[2023-02-25 12:18:25,753][2409080] Port 40806 is available
[2023-02-25 12:18:25,753][2409080] Using port 40806
[2023-02-25 12:18:25,754][2409104] Using port 41605
[2023-02-25 12:18:25,757][2409866] Port 43406 is available
[2023-02-25 12:18:25,758][2409866] Using port 43406
[2023-02-25 12:18:25,761][2409565] Port 43105 is available
[2023-02-25 12:18:25,761][2409565] Using port 43105
[2023-02-25 12:18:25,763][2409075] Port 40406 is available
[2023-02-25 12:18:25,763][2409075] Using port 40406
[2023-02-25 12:18:25,762][2409097] Port 41205 is available
[2023-02-25 12:18:25,764][2409549] Port 42906 is available
[2023-02-25 12:18:25,771][2409549] Using port 42906
[2023-02-25 12:18:25,771][2409097] Using port 41205
[2023-02-25 12:18:25,771][2409485] Port 42704 is available
[2023-02-25 12:18:25,772][2409485] Using port 42704
[2023-02-25 12:18:25,762][2409099] Port 41004 is available
[2023-02-25 12:18:25,773][2409099] Using port 41004
[2023-02-25 12:18:25,767][2409100] Port 41406 is available
[2023-02-25 12:18:25,765][2409596] Port 43205 is available
[2023-02-25 12:18:25,767][2409469] Port 42505 is available
[2023-02-25 12:18:25,775][2409596] Using port 43205
[2023-02-25 12:18:25,775][2409100] Using port 41406
[2023-02-25 12:18:25,775][2409469] Using port 42505
[2023-02-25 12:18:25,768][2409103] Port 41104 is available
[2023-02-25 12:18:25,777][2409103] Using port 41104
[2023-02-25 12:18:25,778][2409355] Port 41806 is available
[2023-02-25 12:18:25,779][2409355] Using port 41806
[2023-02-25 12:18:25,779][2409407] Port 42306 is available
[2023-02-25 12:18:25,779][2409407] Using port 42306
[2023-02-25 12:18:25,768][2409079] Port 40706 is available
[2023-02-25 12:18:25,781][2409101] Port 41306 is available
[2023-02-25 12:18:25,782][2409101] Using port 41306
[2023-02-25 12:18:25,769][2409548] Port 43006 is available
[2023-02-25 12:18:25,781][2409079] Using port 40706
[2023-02-25 12:18:25,771][2409096] Port 40905 is available
[2023-02-25 12:18:25,782][2409548] Using port 43006
[2023-02-25 12:18:25,782][2409096] Using port 40905
[2023-02-25 12:18:25,783][2409486] Port 42604 is available
[2023-02-25 12:18:25,791][2409486] Using port 42604
[2023-02-25 12:18:25,791][2409102] Port 41505 is available
[2023-02-25 12:18:25,792][2409102] Using port 41505
[2023-02-25 12:18:25,785][2409077] Port 40606 is available
[2023-02-25 12:18:25,795][2409077] Using port 40606
[2023-02-25 12:18:25,796][2409547] Port 42806 is available
[2023-02-25 12:18:25,796][2409547] Using port 42806
[2023-02-25 12:18:25,788][2409078] Port 40506 is available
[2023-02-25 12:18:25,799][2409078] Using port 40506
[2023-02-25 12:18:25,800][2409373] Port 41906 is available
[2023-02-25 12:18:25,801][2409373] Using port 41906
[2023-02-25 12:18:25,789][2409468] Port 42406 is available
[2023-02-25 12:18:25,803][2409468] Using port 42406
[2023-02-25 12:18:25,804][2409076] Port 40306 is available
[2023-02-25 12:18:25,805][2409076] Using port 40306
[2023-02-25 12:18:25,805][2409406] Port 42207 is available
[2023-02-25 12:18:25,806][2409406] Using port 42207
[2023-02-25 12:18:25,808][2409597] Port 43306 is available
[2023-02-25 12:18:25,816][2409080] Port 40807 is available
[2023-02-25 12:18:25,816][2409080] Using port 40807
[2023-02-25 12:18:25,816][2409597] Using port 43306
[2023-02-25 12:18:25,819][2409104] Port 41606 is available
[2023-02-25 12:18:25,820][2409104] Using port 41606
[2023-02-25 12:18:25,814][2409405] Port 42106 is available
[2023-02-25 12:18:25,823][2409405] Using port 42106
[2023-02-25 12:18:25,823][2409389] Port 42007 is available
[2023-02-25 12:18:25,824][2409389] Using port 42007
[2023-02-25 12:18:25,828][2409075] Port 40407 is available
[2023-02-25 12:18:25,827][2409105] Port 41706 is available
[2023-02-25 12:18:25,829][2409075] Using port 40407
[2023-02-25 12:18:25,830][2409105] Using port 41706
[2023-02-25 12:18:25,832][2409866] Port 43407 is available
[2023-02-25 12:18:25,833][2409866] Using port 43407
[2023-02-25 12:18:25,843][2409549] Port 42907 is available
[2023-02-25 12:18:25,845][2409355] Port 41807 is available
[2023-02-25 12:18:25,846][2409355] Using port 41807
[2023-02-25 12:18:25,846][2409099] Port 41005 is available
[2023-02-25 12:18:25,848][2409485] Port 42705 is available
[2023-02-25 12:18:25,855][2409099] Using port 41005
[2023-02-25 12:18:25,855][2409485] Using port 42705
[2023-02-25 12:18:25,856][2409101] Port 41307 is available
[2023-02-25 12:18:25,856][2409407] Port 42307 is available
[2023-02-25 12:18:25,857][2409407] Using port 42307
[2023-02-25 12:18:25,850][2409549] Using port 42907
[2023-02-25 12:18:25,846][2409103] Port 41105 is available
[2023-02-25 12:18:25,851][2409596] Port 43206 is available
[2023-02-25 12:18:25,852][2409079] Port 40707 is available
[2023-02-25 12:18:25,858][2409103] Using port 41105
[2023-02-25 12:18:25,859][2409596] Using port 43206
[2023-02-25 12:18:25,859][2409079] Using port 40707
[2023-02-25 12:18:25,853][2409097] Port 41206 is available
[2023-02-25 12:18:25,857][2409101] Using port 41307
[2023-02-25 12:18:25,863][2409097] Using port 41206
[2023-02-25 12:18:25,863][2409469] Port 42506 is available
[2023-02-25 12:18:25,863][2409077] Port 40607 is available
[2023-02-25 12:18:25,864][2409077] Using port 40607
[2023-02-25 12:18:25,863][2409469] Using port 42506
[2023-02-25 12:18:25,865][2409486] Port 42605 is available
[2023-02-25 12:18:25,866][2409486] Using port 42605
[2023-02-25 12:18:25,857][2409406] Port 42208 is available
[2023-02-25 12:18:25,867][2409406] Using port 42208
[2023-02-25 12:18:25,862][2409096] Port 40906 is available
[2023-02-25 12:18:25,867][2409096] Using port 40906
[2023-02-25 12:18:25,869][2409076] Port 40307 is available
[2023-02-25 12:18:25,869][2409078] Port 40507 is available
[2023-02-25 12:18:25,870][2409076] Using port 40307
[2023-02-25 12:18:25,872][2409468] Port 42407 is available
[2023-02-25 12:18:25,872][2409468] Using port 42407
[2023-02-25 12:18:25,870][2409078] Using port 40507
[2023-02-25 12:18:25,874][2409547] Port 42807 is available
[2023-02-25 12:18:25,875][2409547] Using port 42807
[2023-02-25 12:18:25,874][2409565] Port 43106 is available
[2023-02-25 12:18:25,876][2409565] Using port 43106
[2023-02-25 12:18:25,876][2409080] Port 40808 is available
[2023-02-25 12:18:25,877][2409080] Using port 40808
[2023-02-25 12:18:25,879][2409373] Port 41907 is available
[2023-02-25 12:18:25,880][2409373] Using port 41907
[2023-02-25 12:18:25,880][2409389] Port 42008 is available
[2023-02-25 12:18:25,880][2409389] Using port 42008
[2023-02-25 12:18:25,891][2409075] Port 40408 is available
[2023-02-25 12:18:25,892][2409075] Using port 40408
[2023-02-25 12:18:25,886][2409866] Port 43408 is available
[2023-02-25 12:18:25,895][2409866] Using port 43408
[2023-02-25 12:18:25,896][2409104] Port 41607 is available
[2023-02-25 12:18:25,895][2409405] Port 42107 is available
[2023-02-25 12:18:25,903][2409105] Port 41707 is available
[2023-02-25 12:18:25,903][2409104] Using port 41607
[2023-02-25 12:18:25,904][2409105] Using port 41707
[2023-02-25 12:18:25,894][2409597] Port 43307 is available
[2023-02-25 12:18:25,904][2409405] Using port 42107
[2023-02-25 12:18:25,904][2409597] Using port 43307
[2023-02-25 12:18:25,907][2409102] Port 41506 is available
[2023-02-25 12:18:25,907][2409102] Using port 41506
[2023-02-25 12:18:25,909][2409100] Port 41407 is available
[2023-02-25 12:18:25,915][2409100] Using port 41407
[2023-02-25 12:18:25,910][2409355] Port 41808 is available
[2023-02-25 12:18:25,919][2409355] Using port 41808
[2023-02-25 12:18:25,920][2409406] Port 42209 is available
[2023-02-25 12:18:25,920][2409406] Using port 42209
[2023-02-25 12:18:25,921][2409549] Port 42908 is available
[2023-02-25 12:18:25,922][2409101] Port 41308 is available
[2023-02-25 12:18:25,914][2409077] Port 40608 is available
[2023-02-25 12:18:25,923][2409101] Using port 41308
[2023-02-25 12:18:25,923][2409077] Using port 40608
[2023-02-25 12:18:25,922][2409548] Port 43007 is available
[2023-02-25 12:18:25,922][2409549] Using port 42908
[2023-02-25 12:18:25,925][2409548] Using port 43007
[2023-02-25 12:18:25,932][2409407] Port 42308 is available
[2023-02-25 12:18:25,933][2409407] Using port 42308
[2023-02-25 12:18:25,935][2409076] Port 40308 is available
[2023-02-25 12:18:25,936][2409076] Using port 40308
[2023-02-25 12:18:25,937][2409547] Port 42808 is available
[2023-02-25 12:18:25,940][2409080] Port 40809 is available
[2023-02-25 12:18:25,941][2409099] Port 41006 is available
[2023-02-25 12:18:25,941][2409099] Using port 41006
[2023-02-25 12:18:25,941][2409080] Using port 40809
[2023-02-25 12:18:25,941][2409547] Using port 42808
[2023-02-25 12:18:25,938][2409468] Port 42408 is available
[2023-02-25 12:18:25,943][2409468] Using port 42408
[2023-02-25 12:18:25,944][2409373] Port 41908 is available
[2023-02-25 12:18:25,945][2409373] Using port 41908
[2023-02-25 12:18:25,944][2409389] Port 42009 is available
[2023-02-25 12:18:25,945][2409389] Using port 42009
[2023-02-25 12:18:25,945][2409866] Port 43409 is available
[2023-02-25 12:18:25,940][2409079] Port 40708 is available
[2023-02-25 12:18:25,947][2409079] Using port 40708
[2023-02-25 12:18:25,941][2409097] Port 41207 is available
[2023-02-25 12:18:25,951][2409097] Using port 41207
[2023-02-25 12:18:25,954][2409078] Port 40508 is available
[2023-02-25 12:18:25,955][2409078] Using port 40508
[2023-02-25 12:18:25,951][2409596] Port 43207 is available
[2023-02-25 12:18:25,954][2409866] Using port 43409
[2023-02-25 12:18:25,955][2409596] Using port 43207
[2023-02-25 12:18:25,957][2409469] Port 42507 is available
[2023-02-25 12:18:25,957][2409469] Using port 42507
[2023-02-25 12:18:25,957][2409075] Port 40409 is available
[2023-02-25 12:18:25,963][2409075] Using port 40409
[2023-02-25 12:18:25,968][2409597] Port 43308 is available
[2023-02-25 12:18:25,970][2409597] Using port 43308
[2023-02-25 12:18:25,970][2409105] Port 41708 is available
[2023-02-25 12:18:25,971][2409105] Using port 41708
[2023-02-25 12:18:25,973][2409103] Port 41106 is available
[2023-02-25 12:18:25,973][2409096] Port 40907 is available
[2023-02-25 12:18:25,973][2409103] Using port 41106
[2023-02-25 12:18:25,973][2409096] Using port 40907
[2023-02-25 12:18:25,977][2409485] Port 42706 is available
[2023-02-25 12:18:25,978][2409485] Using port 42706
[2023-02-25 12:18:25,980][2409355] Port 41809 is available
[2023-02-25 12:18:25,981][2409355] Using port 41809
[2023-02-25 12:18:25,976][2409104] Port 41608 is available
[2023-02-25 12:18:25,982][2409104] Using port 41608
[2023-02-25 12:18:25,985][2409101] Port 41309 is available
[2023-02-25 12:18:25,987][2409549] Port 42909 is available
[2023-02-25 12:18:25,987][2409549] Using port 42909
[2023-02-25 12:18:25,987][2409406] Port 42210 is available
[2023-02-25 12:18:25,988][2409406] Using port 42210
[2023-02-25 12:18:25,991][2409407] Port 42309 is available
[2023-02-25 12:18:25,998][2409076] Port 40309 is available
[2023-02-25 12:18:25,999][2409076] Using port 40309
[2023-02-25 12:18:25,999][2409407] Using port 42309
[2023-02-25 12:18:25,994][2409077] Port 40609 is available
[2023-02-25 12:18:25,994][2409565] Port 43107 is available
[2023-02-25 12:18:26,003][2409077] Using port 40609
[2023-02-25 12:18:26,003][2409565] Using port 43107
[2023-02-25 12:18:26,004][2409373] Port 41909 is available
[2023-02-25 12:18:26,005][2409373] Using port 41909
[2023-02-25 12:18:26,005][2409547] Port 42809 is available
[2023-02-25 12:18:26,004][2409079] Port 40709 is available
[2023-02-25 12:18:26,006][2409547] Using port 42809
[2023-02-25 12:18:26,006][2409079] Using port 40709
[2023-02-25 12:18:25,974][2409405] Port 42108 is available
[2023-02-25 12:18:25,985][2409101] Using port 41309
[2023-02-25 12:18:26,007][2409405] Using port 42108
[2023-02-25 12:18:26,014][2409389] Port 42010 is available
[2023-02-25 12:18:26,015][2409389] Using port 42010
[2023-02-25 12:18:26,015][2409080] Port 40810 is available
[2023-02-25 12:18:26,016][2409080] Using port 40810
[2023-02-25 12:18:26,016][2409486] Port 42606 is available
[2023-02-25 12:18:26,017][2409486] Using port 42606
[2023-02-25 12:18:26,014][2409468] Port 42409 is available
[2023-02-25 12:18:26,019][2409468] Using port 42409
[2023-02-25 12:18:26,022][2409075] Port 40410 is available
[2023-02-25 12:18:26,020][2409100] Port 41408 is available
[2023-02-25 12:18:26,022][2409075] Using port 40410
[2023-02-25 12:18:26,014][2409866] Port 43410 is available
[2023-02-25 12:18:26,023][2409866] Using port 43410
[2023-02-25 12:18:26,023][2409100] Using port 41408
[2023-02-25 12:18:26,027][2409596] Port 43208 is available
[2023-02-25 12:18:26,034][2409355] Port 41810 is available
[2023-02-25 12:18:26,034][2409549] Port 42910 is available
[2023-02-25 12:18:26,031][2409596] Using port 43208
[2023-02-25 12:18:26,035][2409355] Using port 41810
[2023-02-25 12:18:26,035][2409549] Using port 42910
[2023-02-25 12:18:26,036][2409105] Port 41709 is available
[2023-02-25 12:18:26,037][2409105] Using port 41709
[2023-02-25 12:18:26,034][2409469] Port 42508 is available
[2023-02-25 12:18:26,029][2409548] Port 43008 is available
[2023-02-25 12:18:26,037][2409469] Using port 42508
[2023-02-25 12:18:26,038][2409548] Using port 43008
[2023-02-25 12:18:26,034][2409597] Port 43309 is available
[2023-02-25 12:18:26,039][2409597] Using port 43309
[2023-02-25 12:18:26,038][2409078] Port 40509 is available
[2023-02-25 12:18:26,043][2409078] Using port 40509
[2023-02-25 12:18:26,042][2409406] Port 42211 is available
[2023-02-25 12:18:26,051][2409406] Using port 42211
[2023-02-25 12:18:26,052][2409096] Port 40908 is available
[2023-02-25 12:18:26,053][2409096] Using port 40908
[2023-02-25 12:18:26,050][2409097] Port 41208 is available
[2023-02-25 12:18:26,054][2409097] Using port 41208
[2023-02-25 12:18:26,055][2409104] Port 41609 is available
[2023-02-25 12:18:26,056][2409104] Using port 41609
[2023-02-25 12:18:26,056][2409099] Port 41007 is available
[2023-02-25 12:18:26,056][2409099] Using port 41007
[2023-02-25 12:18:26,050][2409077] Port 40610 is available
[2023-02-25 12:18:26,056][2409406] Using port 42200 on host...
[2023-02-25 12:18:26,057][2409077] Using port 40610
[2023-02-25 12:18:26,058][2409076] Port 40310 is available
[2023-02-25 12:18:26,058][2409076] Using port 40310
[2023-02-25 12:18:26,063][2409373] Port 41910 is available
[2023-02-25 12:18:26,064][2409373] Using port 41910
[2023-02-25 12:18:26,066][2409407] Port 42310 is available
[2023-02-25 12:18:26,069][2409101] Port 41310 is available
[2023-02-25 12:18:26,069][2409101] Using port 41310
[2023-02-25 12:18:26,070][2409407] Using port 42310
[2023-02-25 12:18:26,073][2409405] Port 42109 is available
[2023-02-25 12:18:26,074][2409405] Using port 42109
[2023-02-25 12:18:26,075][2409389] Port 42011 is available
[2023-02-25 12:18:26,076][2409389] Using port 42011
[2023-02-25 12:18:26,075][2409102] Port 41507 is available
[2023-02-25 12:18:26,077][2409102] Using port 41507
[2023-02-25 12:18:26,079][2409079] Port 40710 is available
[2023-02-25 12:18:26,083][2409866] Port 43411 is available
[2023-02-25 12:18:26,084][2409866] Using port 43411
[2023-02-25 12:18:26,084][2409079] Using port 40710
[2023-02-25 12:18:26,087][2409075] Port 40411 is available
[2023-02-25 12:18:26,088][2409075] Using port 40411
[2023-02-25 12:18:26,091][2409565] Port 43108 is available
[2023-02-25 12:18:26,091][2409389] Using port 42000 on host...
[2023-02-25 12:18:26,095][2409355] Port 41811 is available
[2023-02-25 12:18:26,095][2409075] Using port 40400 on host...
[2023-02-25 12:18:26,095][2409355] Using port 41811
[2023-02-25 12:18:26,096][2409565] Using port 43108
[2023-02-25 12:18:26,097][2409080] Port 40811 is available
[2023-02-25 12:18:26,094][2409866] Using port 43400 on host...
[2023-02-25 12:18:26,103][2409080] Using port 40811
[2023-02-25 12:18:26,100][2409355] Using port 41800 on host...
[2023-02-25 12:18:26,101][2409547] Port 42810 is available
[2023-02-25 12:18:26,104][2409549] Port 42911 is available
[2023-02-25 12:18:26,105][2409549] Using port 42911
[2023-02-25 12:18:26,103][2409468] Port 42410 is available
[2023-02-25 12:18:26,102][2409469] Port 42509 is available
[2023-02-25 12:18:26,105][2409596] Port 43209 is available
[2023-02-25 12:18:26,105][2409547] Using port 42810
[2023-02-25 12:18:26,106][2409468] Using port 42410
[2023-02-25 12:18:26,106][2409469] Using port 42509
[2023-02-25 12:18:26,106][2409596] Using port 43209
[2023-02-25 12:18:26,109][2409549] Using port 42900 on host...
[2023-02-25 12:18:26,109][2409076] Port 40311 is available
[2023-02-25 12:18:26,109][2409078] Port 40510 is available
[2023-02-25 12:18:26,111][2409097] Port 41209 is available
[2023-02-25 12:18:26,109][2409076] Using port 40311
[2023-02-25 12:18:26,116][2409373] Port 41911 is available
[2023-02-25 12:18:26,109][2409078] Using port 40510
[2023-02-25 12:18:26,109][2409080] Using port 40800 on host...
[2023-02-25 12:18:26,122][2409373] Using port 41911
[2023-02-25 12:18:26,123][2409407] Port 42311 is available
[2023-02-25 12:18:26,124][2409407] Using port 42311
[2023-02-25 12:18:26,110][2409099] Port 41008 is available
[2023-02-25 12:18:26,127][2409099] Using port 41008
[2023-02-25 12:18:26,126][2409373] Using port 41900 on host...
[2023-02-25 12:18:26,111][2409077] Port 40611 is available
[2023-02-25 12:18:26,131][2409077] Using port 40611
[2023-02-25 12:18:26,134][2409102] Port 41508 is available
[2023-02-25 12:18:26,134][2409407] Using port 42300 on host...
[2023-02-25 12:18:26,134][2409105] Port 41710 is available
[2023-02-25 12:18:26,113][2409100] Port 41409 is available
[2023-02-25 12:18:26,113][2409096] Port 40909 is available
[2023-02-25 12:18:26,139][2409105] Using port 41710
[2023-02-25 12:18:26,117][2409097] Using port 41209
[2023-02-25 12:18:26,139][2409596] Port 43210 is available
[2023-02-25 12:18:26,139][2409100] Using port 41409
[2023-02-25 12:18:26,139][2409096] Using port 40909
[2023-02-25 12:18:26,139][2409596] Using port 43210
[2023-02-25 12:18:26,139][2409102] Using port 41508
[2023-02-25 12:18:26,138][2409597] Port 43310 is available
[2023-02-25 12:18:26,143][2409597] Using port 43310
[2023-02-25 12:18:26,144][2409078] Port 40511 is available
[2023-02-25 12:18:26,144][2409078] Using port 40511
[2023-02-25 12:18:26,145][2409468] Port 42411 is available
[2023-02-25 12:18:26,145][2409468] Using port 42411
[2023-02-25 12:18:26,148][2409078] Using port 40500 on host...
[2023-02-25 12:18:26,120][2409101] Port 41311 is available
[2023-02-25 12:18:26,118][2409548] Port 43009 is available
[2023-02-25 12:18:26,149][2409101] Using port 41311
[2023-02-25 12:18:26,150][2409565] Port 43109 is available
[2023-02-25 12:18:26,120][2409405] Port 42110 is available
[2023-02-25 12:18:26,121][2409104] Port 41610 is available
[2023-02-25 12:18:26,150][2409565] Using port 43109
[2023-02-25 12:18:26,151][2409104] Using port 41610
[2023-02-25 12:18:26,153][2409468] Using port 42400 on host...
[2023-02-25 12:18:26,121][2409076] Using port 40300 on host...
[2023-02-25 12:18:26,134][2409469] Port 42510 is available
[2023-02-25 12:18:26,155][2409469] Using port 42510
[2023-02-25 12:18:26,149][2409548] Using port 43009
[2023-02-25 12:18:26,157][2409101] Using port 41300 on host...
[2023-02-25 12:18:26,135][2409077] Using port 40600 on host...
[2023-02-25 12:18:26,135][2409547] Port 42811 is available
[2023-02-25 12:18:26,159][2409547] Using port 42811
[2023-02-25 12:18:26,138][2409079] Port 40711 is available
[2023-02-25 12:18:26,151][2409405] Using port 42110
[2023-02-25 12:18:26,160][2409079] Using port 40711
[2023-02-25 12:18:26,162][2409099] Port 41009 is available
[2023-02-25 12:18:26,163][2409099] Using port 41009
[2023-02-25 12:18:26,165][2409097] Port 41210 is available
[2023-02-25 12:18:26,166][2409097] Using port 41210
[2023-02-25 12:18:26,162][2409547] Using port 42800 on host...
[2023-02-25 12:18:26,169][2409079] Using port 40700 on host...
[2023-02-25 12:18:26,181][2409596] Port 43211 is available
[2023-02-25 12:18:26,181][2409596] Using port 43211
[2023-02-25 12:18:26,183][2409099] Port 41010 is available
[2023-02-25 12:18:26,183][2409099] Using port 41010
[2023-02-25 12:18:26,184][2409596] Using port 43200 on host...
[2023-02-25 12:18:26,183][2409102] Port 41509 is available
[2023-02-25 12:18:26,185][2409102] Using port 41509
[2023-02-25 12:18:26,185][2409597] Port 43311 is available
[2023-02-25 12:18:26,186][2409597] Using port 43311
[2023-02-25 12:18:26,189][2409597] Using port 43300 on host...
[2023-02-25 12:18:26,182][2409105] Port 41711 is available
[2023-02-25 12:18:26,190][2409105] Using port 41711
[2023-02-25 12:18:26,192][2409096] Port 40910 is available
[2023-02-25 12:18:26,192][2409565] Port 43110 is available
[2023-02-25 12:18:26,193][2409105] Using port 41700 on host...
[2023-02-25 12:18:26,193][2409565] Using port 43110
[2023-02-25 12:18:26,192][2409096] Using port 40910
[2023-02-25 12:18:26,194][2409104] Port 41611 is available
[2023-02-25 12:18:26,194][2409104] Using port 41611
[2023-02-25 12:18:26,194][2409097] Port 41211 is available
[2023-02-25 12:18:26,195][2409097] Using port 41211
[2023-02-25 12:18:26,201][2409099] Port 41011 is available
[2023-02-25 12:18:26,202][2409099] Using port 41011
[2023-02-25 12:18:26,202][2409405] Port 42111 is available
[2023-02-25 12:18:26,203][2409405] Using port 42111
[2023-02-25 12:18:26,204][2409097] Using port 41200 on host...
[2023-02-25 12:18:26,204][2409099] Using port 41000 on host...
[2023-02-25 12:18:26,205][2409469] Port 42511 is available
[2023-02-25 12:18:26,205][2409469] Using port 42511
[2023-02-25 12:18:26,208][2409469] Using port 42500 on host...
[2023-02-25 12:18:26,202][2409100] Port 41410 is available
[2023-02-25 12:18:26,221][2409100] Using port 41410
[2023-02-25 12:18:26,203][2409104] Using port 41600 on host...
[2023-02-25 12:18:26,217][2409096] Port 40911 is available
[2023-02-25 12:18:26,208][2409405] Using port 42100 on host...
[2023-02-25 12:18:26,227][2409096] Using port 40911
[2023-02-25 12:18:26,220][2409102] Port 41510 is available
[2023-02-25 12:18:26,227][2409102] Using port 41510
[2023-02-25 12:18:26,220][2409565] Port 43111 is available
[2023-02-25 12:18:26,227][2409485] Port 42707 is available
[2023-02-25 12:18:26,230][2409485] Using port 42707
[2023-02-25 12:18:26,230][2409096] Using port 40900 on host...
[2023-02-25 12:18:26,230][2409565] Using port 43111
[2023-02-25 12:18:26,208][2409548] Port 43010 is available
[2023-02-25 12:18:26,236][2409548] Using port 43010
[2023-02-25 12:18:26,237][2409565] Using port 43100 on host...
[2023-02-25 12:18:26,243][2409102] Port 41511 is available
[2023-02-25 12:18:26,244][2409103] Port 41107 is available
[2023-02-25 12:18:26,244][2409103] Using port 41107
[2023-02-25 12:18:26,245][2409102] Using port 41511
[2023-02-25 12:18:26,248][2409102] Using port 41500 on host...
[2023-02-25 12:18:26,252][2409485] Port 42708 is available
[2023-02-25 12:18:26,253][2409485] Using port 42708
[2023-02-25 12:18:26,265][2409548] Port 43011 is available
[2023-02-25 12:18:26,262][2409103] Port 41108 is available
[2023-02-25 12:18:26,266][2409548] Using port 43011
[2023-02-25 12:18:26,267][2409103] Using port 41108
[2023-02-25 12:18:26,266][2409100] Port 41411 is available
[2023-02-25 12:18:26,268][2409100] Using port 41411
[2023-02-25 12:18:26,270][2409548] Using port 43000 on host...
[2023-02-25 12:18:26,266][2409485] Port 42709 is available
[2023-02-25 12:18:26,270][2409100] Using port 41400 on host...
[2023-02-25 12:18:26,272][2409485] Using port 42709
[2023-02-25 12:18:26,280][2409103] Port 41109 is available
[2023-02-25 12:18:26,285][2409103] Using port 41109
[2023-02-25 12:18:26,285][2409485] Port 42710 is available
[2023-02-25 12:18:26,291][2409485] Using port 42710
[2023-02-25 12:18:26,301][2409103] Port 41110 is available
[2023-02-25 12:18:26,302][2409103] Using port 41110
[2023-02-25 12:18:26,298][2409485] Port 42711 is available
[2023-02-25 12:18:26,304][2409485] Using port 42711
[2023-02-25 12:18:26,306][2409485] Using port 42700 on host...
[2023-02-25 12:18:26,313][2409103] Port 41111 is available
[2023-02-25 12:18:26,313][2409103] Using port 41111
[2023-02-25 12:18:26,315][2409103] Using port 41100 on host...
[2023-02-25 12:18:26,358][2409486] Port 42607 is available
[2023-02-25 12:18:26,359][2409486] Using port 42607
[2023-02-25 12:18:26,372][2409486] Port 42608 is available
[2023-02-25 12:18:26,373][2409486] Using port 42608
[2023-02-25 12:18:26,386][2409486] Port 42609 is available
[2023-02-25 12:18:26,387][2409486] Using port 42609
[2023-02-25 12:18:26,399][2409486] Port 42610 is available
[2023-02-25 12:18:26,399][2409486] Using port 42610
[2023-02-25 12:18:26,411][2409486] Port 42611 is available
[2023-02-25 12:18:26,411][2409486] Using port 42611
[2023-02-25 12:18:26,412][2409486] Using port 42600 on host...
[2023-02-25 12:18:26,800][2409406] Initialized w:19 v:0 player:0
[2023-02-25 12:18:26,802][2409549] Initialized w:26 v:0 player:0
[2023-02-25 12:18:26,801][2409406] Decorrelating experience for 0 frames...
[2023-02-25 12:18:26,803][2409549] Decorrelating experience for 0 frames...
[2023-02-25 12:18:26,803][2409406] Using port 42201 on host...
[2023-02-25 12:18:26,804][2409549] Using port 42901 on host...
[2023-02-25 12:18:26,812][2409866] Initialized w:31 v:0 player:0
[2023-02-25 12:18:26,813][2409866] Decorrelating experience for 0 frames...
[2023-02-25 12:18:26,814][2409866] Using port 43401 on host...
[2023-02-25 12:18:26,831][2409389] Initialized w:17 v:0 player:0
[2023-02-25 12:18:26,832][2409389] Decorrelating experience for 0 frames...
[2023-02-25 12:18:26,834][2409389] Using port 42001 on host...
[2023-02-25 12:18:26,838][2409075] Initialized w:1 v:0 player:0
[2023-02-25 12:18:26,839][2409075] Decorrelating experience for 0 frames...
[2023-02-25 12:18:26,840][2409075] Using port 40401 on host...
[2023-02-25 12:18:26,844][2409407] Initialized w:20 v:0 player:0
[2023-02-25 12:18:26,845][2409407] Decorrelating experience for 0 frames...
[2023-02-25 12:18:26,847][2409407] Using port 42301 on host...
[2023-02-25 12:18:26,845][2409373] Initialized w:16 v:0 player:0
[2023-02-25 12:18:26,849][2409373] Decorrelating experience for 0 frames...
[2023-02-25 12:18:26,850][2409373] Using port 41901 on host...
[2023-02-25 12:18:26,861][2409355] Initialized w:15 v:0 player:0
[2023-02-25 12:18:26,863][2409355] Decorrelating experience for 0 frames...
[2023-02-25 12:18:26,864][2409355] Using port 41801 on host...
[2023-02-25 12:18:26,866][2409596] Initialized w:29 v:0 player:0
[2023-02-25 12:18:26,868][2409596] Decorrelating experience for 0 frames...
[2023-02-25 12:18:26,869][2409596] Using port 43201 on host...
[2023-02-25 12:18:26,874][2409099] Initialized w:7 v:0 player:0
[2023-02-25 12:18:26,875][2409076] Initialized w:0 v:0 player:0
[2023-02-25 12:18:26,876][2409099] Decorrelating experience for 0 frames...
[2023-02-25 12:18:26,877][2409076] Decorrelating experience for 0 frames...
[2023-02-25 12:18:26,878][2409076] Using port 40301 on host...
[2023-02-25 12:18:26,877][2409099] Using port 41001 on host...
[2023-02-25 12:18:26,883][2409105] Initialized w:14 v:0 player:0
[2023-02-25 12:18:26,883][2409080] Initialized w:5 v:0 player:0
[2023-02-25 12:18:26,884][2409080] Decorrelating experience for 0 frames...
[2023-02-25 12:18:26,884][2409105] Decorrelating experience for 0 frames...
[2023-02-25 12:18:26,885][2409101] Initialized w:10 v:0 player:0
[2023-02-25 12:18:26,885][2409080] Using port 40801 on host...
[2023-02-25 12:18:26,886][2409105] Using port 41701 on host...
[2023-02-25 12:18:26,887][2409101] Decorrelating experience for 0 frames...
[2023-02-25 12:18:26,888][2409101] Using port 41301 on host...
[2023-02-25 12:18:26,891][2409547] Initialized w:25 v:0 player:0
[2023-02-25 12:18:26,894][2409097] Initialized w:9 v:0 player:0
[2023-02-25 12:18:26,895][2409468] Initialized w:21 v:0 player:0
[2023-02-25 12:18:26,893][2409547] Decorrelating experience for 0 frames...
[2023-02-25 12:18:26,897][2409468] Decorrelating experience for 0 frames...
[2023-02-25 12:18:26,897][2409097] Decorrelating experience for 0 frames...
[2023-02-25 12:18:26,899][2409547] Using port 42801 on host...
[2023-02-25 12:18:26,900][2409468] Using port 42401 on host...
[2023-02-25 12:18:26,900][2409097] Using port 41201 on host...
[2023-02-25 12:18:26,903][2409079] Initialized w:4 v:0 player:0
[2023-02-25 12:18:26,904][2409079] Decorrelating experience for 0 frames...
[2023-02-25 12:18:26,906][2409079] Using port 40701 on host...
[2023-02-25 12:18:26,911][2409469] Initialized w:22 v:0 player:0
[2023-02-25 12:18:26,913][2409469] Decorrelating experience for 0 frames...
[2023-02-25 12:18:26,914][2409078] Initialized w:2 v:0 player:0
[2023-02-25 12:18:26,915][2409078] Decorrelating experience for 0 frames...
[2023-02-25 12:18:26,915][2409469] Using port 42501 on host...
[2023-02-25 12:18:26,923][2409078] Using port 40501 on host...
[2023-02-25 12:18:26,924][2409405] Initialized w:18 v:0 player:0
[2023-02-25 12:18:26,925][2409597] Initialized w:30 v:0 player:0
[2023-02-25 12:18:26,926][2409405] Decorrelating experience for 0 frames...
[2023-02-25 12:18:26,927][2409597] Decorrelating experience for 0 frames...
[2023-02-25 12:18:26,928][2409597] Using port 43301 on host...
[2023-02-25 12:18:26,927][2409405] Using port 42101 on host...
[2023-02-25 12:18:26,951][2409104] Initialized w:13 v:0 player:0
[2023-02-25 12:18:26,952][2409104] Decorrelating experience for 0 frames...
[2023-02-25 12:18:26,954][2409104] Using port 41601 on host...
[2023-02-25 12:18:26,955][2409077] Initialized w:3 v:0 player:0
[2023-02-25 12:18:26,955][2409096] Initialized w:6 v:0 player:0
[2023-02-25 12:18:26,956][2409077] Decorrelating experience for 0 frames...
[2023-02-25 12:18:26,957][2409077] Using port 40601 on host...
[2023-02-25 12:18:26,958][2409102] Initialized w:12 v:0 player:0
[2023-02-25 12:18:26,960][2409102] Decorrelating experience for 0 frames...
[2023-02-25 12:18:26,962][2409102] Using port 41501 on host...
[2023-02-25 12:18:26,956][2409096] Decorrelating experience for 0 frames...
[2023-02-25 12:18:26,963][2409565] Initialized w:28 v:0 player:0
[2023-02-25 12:18:26,967][2409096] Using port 40901 on host...
[2023-02-25 12:18:26,967][2409565] Decorrelating experience for 0 frames...
[2023-02-25 12:18:26,969][2409565] Using port 43101 on host...
[2023-02-25 12:18:26,973][2409103] Initialized w:8 v:0 player:0
[2023-02-25 12:18:26,974][2409103] Decorrelating experience for 0 frames...
[2023-02-25 12:18:26,976][2409103] Using port 41101 on host...
[2023-02-25 12:18:26,980][2409100] Initialized w:11 v:0 player:0
[2023-02-25 12:18:26,981][2409100] Decorrelating experience for 0 frames...
[2023-02-25 12:18:26,982][2409100] Using port 41401 on host...
[2023-02-25 12:18:26,982][2409485] Initialized w:24 v:0 player:0
[2023-02-25 12:18:26,983][2409548] Initialized w:27 v:0 player:0
[2023-02-25 12:18:26,984][2409485] Decorrelating experience for 0 frames...
[2023-02-25 12:18:26,984][2409485] Using port 42701 on host...
[2023-02-25 12:18:26,984][2409548] Decorrelating experience for 0 frames...
[2023-02-25 12:18:26,985][2409548] Using port 43001 on host...
[2023-02-25 12:18:27,082][2409486] Initialized w:23 v:0 player:0
[2023-02-25 12:18:27,083][2409486] Decorrelating experience for 0 frames...
[2023-02-25 12:18:27,084][2409486] Using port 42601 on host...
[2023-02-25 12:18:27,186][2408954] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0)
[2023-02-25 12:18:27,387][2409406] Initialized w:19 v:1 player:0
[2023-02-25 12:18:27,388][2409406] Decorrelating experience for 32 frames...
[2023-02-25 12:18:27,428][2409549] Initialized w:26 v:1 player:0
[2023-02-25 12:18:27,429][2409549] Decorrelating experience for 32 frames...
[2023-02-25 12:18:27,467][2409407] Initialized w:20 v:1 player:0
[2023-02-25 12:18:27,467][2409866] Initialized w:31 v:1 player:0
[2023-02-25 12:18:27,468][2409866] Decorrelating experience for 32 frames...
[2023-02-25 12:18:27,468][2409407] Decorrelating experience for 32 frames...
[2023-02-25 12:18:27,484][2409406] Using port 42202 on host...
[2023-02-25 12:18:27,491][2409389] Initialized w:17 v:1 player:0
[2023-02-25 12:18:27,492][2409389] Decorrelating experience for 32 frames...
[2023-02-25 12:18:27,496][2409075] Initialized w:1 v:1 player:0
[2023-02-25 12:18:27,497][2409075] Decorrelating experience for 32 frames...
[2023-02-25 12:18:27,507][2409373] Initialized w:16 v:1 player:0
[2023-02-25 12:18:27,508][2409549] Using port 42902 on host...
[2023-02-25 12:18:27,508][2409373] Decorrelating experience for 32 frames...
[2023-02-25 12:18:27,519][2409596] Initialized w:29 v:1 player:0
[2023-02-25 12:18:27,520][2409596] Decorrelating experience for 32 frames...
[2023-02-25 12:18:27,528][2409099] Initialized w:7 v:1 player:0
[2023-02-25 12:18:27,529][2409099] Decorrelating experience for 32 frames...
[2023-02-25 12:18:27,537][2409355] Initialized w:15 v:1 player:0
[2023-02-25 12:18:27,538][2409355] Decorrelating experience for 32 frames...
[2023-02-25 12:18:27,550][2409407] Using port 42302 on host...
[2023-02-25 12:18:27,556][2409097] Initialized w:9 v:1 player:0
[2023-02-25 12:18:27,558][2409097] Decorrelating experience for 32 frames...
[2023-02-25 12:18:27,562][2409547] Initialized w:25 v:1 player:0
[2023-02-25 12:18:27,563][2409547] Decorrelating experience for 32 frames...
[2023-02-25 12:18:27,565][2409080] Initialized w:5 v:1 player:0
[2023-02-25 12:18:27,566][2409080] Decorrelating experience for 32 frames...
[2023-02-25 12:18:27,568][2409078] Initialized w:2 v:1 player:0
[2023-02-25 12:18:27,569][2409078] Decorrelating experience for 32 frames...
[2023-02-25 12:18:27,570][2409373] Using port 41902 on host...
[2023-02-25 12:18:27,574][2409866] Using port 43402 on host...
[2023-02-25 12:18:27,578][2409076] Initialized w:0 v:1 player:0
[2023-02-25 12:18:27,579][2409076] Decorrelating experience for 32 frames...
[2023-02-25 12:18:27,592][2409596] Using port 43202 on host...
[2023-02-25 12:18:27,592][2409105] Initialized w:14 v:1 player:0
[2023-02-25 12:18:27,593][2409105] Decorrelating experience for 32 frames...
[2023-02-25 12:18:27,594][2409389] Using port 42002 on host...
[2023-02-25 12:18:27,604][2409075] Using port 40402 on host...
[2023-02-25 12:18:27,607][2409469] Initialized w:22 v:1 player:0
[2023-02-25 12:18:27,608][2409469] Decorrelating experience for 32 frames...
[2023-02-25 12:18:27,609][2409597] Initialized w:30 v:1 player:0
[2023-02-25 12:18:27,610][2409597] Decorrelating experience for 32 frames...
[2023-02-25 12:18:27,611][2409101] Initialized w:10 v:1 player:0
[2023-02-25 12:18:27,612][2409101] Decorrelating experience for 32 frames...
[2023-02-25 12:18:27,613][2409468] Initialized w:21 v:1 player:0
[2023-02-25 12:18:27,614][2409468] Decorrelating experience for 32 frames...
[2023-02-25 12:18:27,616][2409099] Using port 41002 on host...
[2023-02-25 12:18:27,616][2409405] Initialized w:18 v:1 player:0
[2023-02-25 12:18:27,617][2409405] Decorrelating experience for 32 frames...
[2023-02-25 12:18:27,623][2409079] Initialized w:4 v:1 player:0
[2023-02-25 12:18:27,624][2409079] Decorrelating experience for 32 frames...
[2023-02-25 12:18:27,628][2409355] Using port 41802 on host...
[2023-02-25 12:18:27,630][2409096] Initialized w:6 v:1 player:0
[2023-02-25 12:18:27,631][2409096] Decorrelating experience for 32 frames...
[2023-02-25 12:18:27,637][2409565] Initialized w:28 v:1 player:0
[2023-02-25 12:18:27,638][2409565] Decorrelating experience for 32 frames...
[2023-02-25 12:18:27,648][2409548] Initialized w:27 v:1 player:0
[2023-02-25 12:18:27,649][2409548] Decorrelating experience for 32 frames...
[2023-02-25 12:18:27,651][2409103] Initialized w:8 v:1 player:0
[2023-02-25 12:18:27,652][2409103] Decorrelating experience for 32 frames...
[2023-02-25 12:18:27,654][2409485] Initialized w:24 v:1 player:0
[2023-02-25 12:18:27,655][2409104] Initialized w:13 v:1 player:0
[2023-02-25 12:18:27,656][2409104] Decorrelating experience for 32 frames...
[2023-02-25 12:18:27,657][2409485] Decorrelating experience for 32 frames...
[2023-02-25 12:18:27,660][2409076] Using port 40302 on host...
[2023-02-25 12:18:27,663][2409100] Initialized w:11 v:1 player:0
[2023-02-25 12:18:27,664][2409100] Decorrelating experience for 32 frames...
[2023-02-25 12:18:27,673][2409102] Initialized w:12 v:1 player:0
[2023-02-25 12:18:27,675][2409102] Decorrelating experience for 32 frames...
[2023-02-25 12:18:27,676][2409077] Initialized w:3 v:1 player:0
[2023-02-25 12:18:27,677][2409077] Decorrelating experience for 32 frames...
[2023-02-25 12:18:27,677][2409080] Using port 40802 on host...
[2023-02-25 12:18:27,683][2409097] Using port 41202 on host...
[2023-02-25 12:18:27,687][2409078] Using port 40502 on host...
[2023-02-25 12:18:27,690][2409547] Using port 42802 on host...
[2023-02-25 12:18:27,701][2409101] Using port 41302 on host...
[2023-02-25 12:18:27,703][2409105] Using port 41702 on host...
[2023-02-25 12:18:27,707][2409079] Using port 40702 on host...
[2023-02-25 12:18:27,707][2409469] Using port 42502 on host...
[2023-02-25 12:18:27,713][2409597] Using port 43302 on host...
[2023-02-25 12:18:27,721][2409468] Using port 42402 on host...
[2023-02-25 12:18:27,727][2409096] Using port 40902 on host...
[2023-02-25 12:18:27,739][2409486] Initialized w:23 v:1 player:0
[2023-02-25 12:18:27,740][2409486] Decorrelating experience for 32 frames...
[2023-02-25 12:18:27,747][2409104] Using port 41602 on host...
[2023-02-25 12:18:27,742][2409405] Using port 42102 on host...
[2023-02-25 12:18:27,756][2409077] Using port 40602 on host...
[2023-02-25 12:18:27,756][2409565] Using port 43102 on host...
[2023-02-25 12:18:27,759][2409548] Using port 43002 on host...
[2023-02-25 12:18:27,767][2409100] Using port 41402 on host...
[2023-02-25 12:18:27,779][2409102] Using port 41502 on host...
[2023-02-25 12:18:27,790][2409103] Using port 41102 on host...
[2023-02-25 12:18:27,795][2409485] Using port 42702 on host...
[2023-02-25 12:18:27,829][2409486] Using port 42602 on host...
[2023-02-25 12:18:28,108][2409406] Initialized w:19 v:2 player:0
[2023-02-25 12:18:28,109][2409406] Decorrelating experience for 64 frames...
[2023-02-25 12:18:28,129][2409549] Initialized w:26 v:2 player:0
[2023-02-25 12:18:28,130][2409549] Decorrelating experience for 64 frames...
[2023-02-25 12:18:28,178][2409407] Initialized w:20 v:2 player:0
[2023-02-25 12:18:28,180][2409407] Decorrelating experience for 64 frames...
[2023-02-25 12:18:28,231][2409373] Initialized w:16 v:2 player:0
[2023-02-25 12:18:28,232][2409373] Decorrelating experience for 64 frames...
[2023-02-25 12:18:28,250][2409389] Initialized w:17 v:2 player:0
[2023-02-25 12:18:28,252][2409389] Decorrelating experience for 64 frames...
[2023-02-25 12:18:28,261][2409866] Initialized w:31 v:2 player:0
[2023-02-25 12:18:28,263][2409866] Decorrelating experience for 64 frames...
[2023-02-25 12:18:28,263][2409596] Initialized w:29 v:2 player:0
[2023-02-25 12:18:28,264][2409596] Decorrelating experience for 64 frames...
[2023-02-25 12:18:28,299][2409406] Using port 42203 on host...
[2023-02-25 12:18:28,311][2409549] Using port 42903 on host...
[2023-02-25 12:18:28,315][2409075] Initialized w:1 v:2 player:0
[2023-02-25 12:18:28,315][2409355] Initialized w:15 v:2 player:0
[2023-02-25 12:18:28,316][2409075] Decorrelating experience for 64 frames...
[2023-02-25 12:18:28,317][2409355] Decorrelating experience for 64 frames...
[2023-02-25 12:18:28,339][2409099] Initialized w:7 v:2 player:0
[2023-02-25 12:18:28,340][2409099] Decorrelating experience for 64 frames...
[2023-02-25 12:18:28,364][2409097] Initialized w:9 v:2 player:0
[2023-02-25 12:18:28,367][2409407] Using port 42303 on host...
[2023-02-25 12:18:28,366][2409097] Decorrelating experience for 64 frames...
[2023-02-25 12:18:28,368][2409076] Initialized w:0 v:2 player:0
[2023-02-25 12:18:28,370][2409076] Decorrelating experience for 64 frames...
[2023-02-25 12:18:28,389][2409547] Initialized w:25 v:2 player:0
[2023-02-25 12:18:28,391][2409547] Decorrelating experience for 64 frames...
[2023-02-25 12:18:28,404][2409080] Initialized w:5 v:2 player:0
[2023-02-25 12:18:28,405][2409080] Decorrelating experience for 64 frames...
[2023-02-25 12:18:28,417][2409469] Initialized w:22 v:2 player:0
[2023-02-25 12:18:28,419][2409469] Decorrelating experience for 64 frames...
[2023-02-25 12:18:28,419][2409373] Using port 41903 on host...
[2023-02-25 12:18:28,427][2409105] Initialized w:14 v:2 player:0
[2023-02-25 12:18:28,428][2409105] Decorrelating experience for 64 frames...
[2023-02-25 12:18:28,440][2409596] Using port 43203 on host...
[2023-02-25 12:18:28,445][2409101] Initialized w:10 v:2 player:0
[2023-02-25 12:18:28,445][2409389] Using port 42003 on host...
[2023-02-25 12:18:28,446][2409101] Decorrelating experience for 64 frames...
[2023-02-25 12:18:28,446][2409597] Initialized w:30 v:2 player:0
[2023-02-25 12:18:28,447][2409597] Decorrelating experience for 64 frames...
[2023-02-25 12:18:28,468][2409096] Initialized w:6 v:2 player:0
[2023-02-25 12:18:28,469][2409096] Decorrelating experience for 64 frames...
[2023-02-25 12:18:28,470][2409468] Initialized w:21 v:2 player:0
[2023-02-25 12:18:28,471][2409079] Initialized w:4 v:2 player:0
[2023-02-25 12:18:28,472][2409468] Decorrelating experience for 64 frames...
[2023-02-25 12:18:28,472][2409079] Decorrelating experience for 64 frames...
[2023-02-25 12:18:28,482][2409078] Initialized w:2 v:2 player:0
[2023-02-25 12:18:28,482][2409103] Initialized w:8 v:2 player:0
[2023-02-25 12:18:28,483][2409078] Decorrelating experience for 64 frames...
[2023-02-25 12:18:28,484][2409103] Decorrelating experience for 64 frames...
[2023-02-25 12:18:28,488][2409485] Initialized w:24 v:2 player:0
[2023-02-25 12:18:28,489][2409485] Decorrelating experience for 64 frames...
[2023-02-25 12:18:28,495][2409565] Initialized w:28 v:2 player:0
[2023-02-25 12:18:28,496][2409565] Decorrelating experience for 64 frames...
[2023-02-25 12:18:28,499][2409548] Initialized w:27 v:2 player:0
[2023-02-25 12:18:28,500][2409548] Decorrelating experience for 64 frames...
[2023-02-25 12:18:28,505][2409077] Initialized w:3 v:2 player:0
[2023-02-25 12:18:28,507][2409077] Decorrelating experience for 64 frames...
[2023-02-25 12:18:28,511][2409104] Initialized w:13 v:2 player:0
[2023-02-25 12:18:28,512][2409104] Decorrelating experience for 64 frames...
[2023-02-25 12:18:28,512][2409075] Using port 40403 on host...
[2023-02-25 12:18:28,514][2409100] Initialized w:11 v:2 player:0
[2023-02-25 12:18:28,515][2409100] Decorrelating experience for 64 frames...
[2023-02-25 12:18:28,525][2409099] Using port 41003 on host...
[2023-02-25 12:18:28,525][2409102] Initialized w:12 v:2 player:0
[2023-02-25 12:18:28,527][2409102] Decorrelating experience for 64 frames...
[2023-02-25 12:18:28,550][2409405] Initialized w:18 v:2 player:0
[2023-02-25 12:18:28,551][2409405] Decorrelating experience for 64 frames...
[2023-02-25 12:18:28,573][2409076] Using port 40303 on host...
[2023-02-25 12:18:28,614][2409486] Initialized w:23 v:2 player:0
[2023-02-25 12:18:28,619][2409101] Using port 41303 on host...
[2023-02-25 12:18:28,625][2409486] Decorrelating experience for 64 frames...
[2023-02-25 12:18:28,628][2409080] Using port 40803 on host...
[2023-02-25 12:18:28,630][2409097] Using port 41203 on host...
[2023-02-25 12:18:28,640][2409079] Using port 40703 on host...
[2023-02-25 12:18:28,651][2409547] Using port 42803 on host...
[2023-02-25 12:18:28,658][2409105] Using port 41703 on host...
[2023-02-25 12:18:28,666][2409597] Using port 43303 on host...
[2023-02-25 12:18:28,669][2409469] Using port 42503 on host...
[2023-02-25 12:18:28,688][2409104] Using port 41603 on host...
[2023-02-25 12:18:28,693][2409468] Using port 42403 on host...
[2023-02-25 12:18:28,728][2409565] Using port 43103 on host...
[2023-02-25 12:18:28,739][2409548] Using port 43003 on host...
[2023-02-25 12:18:28,743][2409485] Using port 42703 on host...
[2023-02-25 12:18:28,745][2409077] Using port 40603 on host...
[2023-02-25 12:18:28,747][2409100] Using port 41403 on host...
[2023-02-25 12:18:28,750][2409102] Using port 41503 on host...
[2023-02-25 12:18:28,755][2409103] Using port 41103 on host...
[2023-02-25 12:18:28,759][2409096] Using port 40903 on host...
[2023-02-25 12:18:28,767][2409078] Using port 40503 on host...
[2023-02-25 12:18:28,770][2409866] Using port 43403 on host...
[2023-02-25 12:18:28,804][2409355] Using port 41803 on host...
[2023-02-25 12:18:28,829][2409405] Using port 42103 on host...
[2023-02-25 12:18:28,848][2409486] Using port 42603 on host...
[2023-02-25 12:18:29,059][2409549] Initialized w:26 v:3 player:0
[2023-02-25 12:18:29,060][2409549] Decorrelating experience for 96 frames...
[2023-02-25 12:18:29,096][2409406] Initialized w:19 v:3 player:0
[2023-02-25 12:18:29,097][2409406] Decorrelating experience for 96 frames...
[2023-02-25 12:18:29,112][2409407] Initialized w:20 v:3 player:0
[2023-02-25 12:18:29,113][2409407] Decorrelating experience for 96 frames...
[2023-02-25 12:18:29,176][2409596] Initialized w:29 v:3 player:0
[2023-02-25 12:18:29,177][2409596] Decorrelating experience for 96 frames...
[2023-02-25 12:18:29,185][2409389] Initialized w:17 v:3 player:0
[2023-02-25 12:18:29,187][2409389] Decorrelating experience for 96 frames...
[2023-02-25 12:18:29,208][2409373] Initialized w:16 v:3 player:0
[2023-02-25 12:18:29,210][2409373] Decorrelating experience for 96 frames...
[2023-02-25 12:18:29,246][2409075] Initialized w:1 v:3 player:0
[2023-02-25 12:18:29,248][2409075] Decorrelating experience for 96 frames...
[2023-02-25 12:18:29,302][2409549] Using port 42904 on host...
[2023-02-25 12:18:29,347][2409099] Initialized w:7 v:3 player:0
[2023-02-25 12:18:29,348][2409099] Decorrelating experience for 96 frames...
[2023-02-25 12:18:29,364][2409097] Initialized w:9 v:3 player:0
[2023-02-25 12:18:29,365][2409097] Decorrelating experience for 96 frames...
[2023-02-25 12:18:29,366][2409406] Using port 42204 on host...
[2023-02-25 12:18:29,367][2409407] Using port 42304 on host...
[2023-02-25 12:18:29,367][2409547] Initialized w:25 v:3 player:0
[2023-02-25 12:18:29,368][2409547] Decorrelating experience for 96 frames...
[2023-02-25 12:18:29,392][2409076] Initialized w:0 v:3 player:0
[2023-02-25 12:18:29,393][2409076] Decorrelating experience for 96 frames...
[2023-02-25 12:18:29,400][2409105] Initialized w:14 v:3 player:0
[2023-02-25 12:18:29,402][2409105] Decorrelating experience for 96 frames...
[2023-02-25 12:18:29,405][2409101] Initialized w:10 v:3 player:0
[2023-02-25 12:18:29,406][2409101] Decorrelating experience for 96 frames...
[2023-02-25 12:18:29,411][2409079] Initialized w:4 v:3 player:0
[2023-02-25 12:18:29,412][2409079] Decorrelating experience for 96 frames...
[2023-02-25 12:18:29,437][2409596] Using port 43204 on host...
[2023-02-25 12:18:29,438][2409597] Initialized w:30 v:3 player:0
[2023-02-25 12:18:29,440][2409597] Decorrelating experience for 96 frames...
[2023-02-25 12:18:29,459][2409469] Initialized w:22 v:3 player:0
[2023-02-25 12:18:29,460][2409469] Decorrelating experience for 96 frames...
[2023-02-25 12:18:29,473][2409565] Initialized w:28 v:3 player:0
[2023-02-25 12:18:29,475][2409565] Decorrelating experience for 96 frames...
[2023-02-25 12:18:29,483][2409104] Initialized w:13 v:3 player:0
[2023-02-25 12:18:29,484][2409104] Decorrelating experience for 96 frames...
[2023-02-25 12:18:29,485][2409080] Initialized w:5 v:3 player:0
[2023-02-25 12:18:29,485][2409485] Initialized w:24 v:3 player:0
[2023-02-25 12:18:29,486][2409080] Decorrelating experience for 96 frames...
[2023-02-25 12:18:29,486][2409485] Decorrelating experience for 96 frames...
[2023-02-25 12:18:29,495][2409373] Using port 41904 on host...
[2023-02-25 12:18:29,498][2409389] Using port 42004 on host...
[2023-02-25 12:18:29,500][2409103] Initialized w:8 v:3 player:0
[2023-02-25 12:18:29,502][2409103] Decorrelating experience for 96 frames...
[2023-02-25 12:18:29,508][2409548] Initialized w:27 v:3 player:0
[2023-02-25 12:18:29,509][2409548] Decorrelating experience for 96 frames...
[2023-02-25 12:18:29,512][2409096] Initialized w:6 v:3 player:0
[2023-02-25 12:18:29,513][2409096] Decorrelating experience for 96 frames...
[2023-02-25 12:18:29,535][2409866] Initialized w:31 v:3 player:0
[2023-02-25 12:18:29,535][2409078] Initialized w:2 v:3 player:0
[2023-02-25 12:18:29,536][2409866] Decorrelating experience for 96 frames...
[2023-02-25 12:18:29,537][2409078] Decorrelating experience for 96 frames...
[2023-02-25 12:18:29,541][2409102] Initialized w:12 v:3 player:0
[2023-02-25 12:18:29,543][2409102] Decorrelating experience for 96 frames...
[2023-02-25 12:18:29,544][2409100] Initialized w:11 v:3 player:0
[2023-02-25 12:18:29,545][2409075] Using port 40404 on host...
[2023-02-25 12:18:29,545][2409100] Decorrelating experience for 96 frames...
[2023-02-25 12:18:29,545][2409405] Initialized w:18 v:3 player:0
[2023-02-25 12:18:29,546][2409405] Decorrelating experience for 96 frames...
[2023-02-25 12:18:29,554][2409355] Initialized w:15 v:3 player:0
[2023-02-25 12:18:29,556][2409355] Decorrelating experience for 96 frames...
[2023-02-25 12:18:29,557][2409468] Initialized w:21 v:3 player:0
[2023-02-25 12:18:29,558][2409468] Decorrelating experience for 96 frames...
[2023-02-25 12:18:29,560][2409077] Initialized w:3 v:3 player:0
[2023-02-25 12:18:29,567][2409077] Decorrelating experience for 96 frames...
[2023-02-25 12:18:29,602][2409099] Using port 41004 on host...
[2023-02-25 12:18:29,646][2409101] Using port 41304 on host...
[2023-02-25 12:18:29,659][2409486] Initialized w:23 v:3 player:0
[2023-02-25 12:18:29,660][2409486] Decorrelating experience for 96 frames...
[2023-02-25 12:18:29,666][2409076] Using port 40304 on host...
[2023-02-25 12:18:29,672][2409079] Using port 40704 on host...
[2023-02-25 12:18:29,719][2409105] Using port 41704 on host...
[2023-02-25 12:18:29,733][2409547] Using port 42804 on host...
[2023-02-25 12:18:29,737][2409097] Using port 41204 on host...
[2023-02-25 12:18:29,744][2409104] Using port 41604 on host...
[2023-02-25 12:18:29,777][2409597] Using port 43304 on host...
[2023-02-25 12:18:29,786][2409469] Using port 42504 on host...
[2023-02-25 12:18:29,789][2409565] Using port 43104 on host...
[2023-02-25 12:18:29,810][2409077] Using port 40604 on host...
[2023-02-25 12:18:29,840][2409096] Using port 40904 on host...
[2023-02-25 12:18:29,849][2409548] Using port 43004 on host...
[2023-02-25 12:18:29,851][2409485] Using port 42704 on host...
[2023-02-25 12:18:29,861][2409102] Using port 41504 on host...
[2023-02-25 12:18:29,865][2409080] Using port 40804 on host...
[2023-02-25 12:18:29,869][2409103] Using port 41104 on host...
[2023-02-25 12:18:29,886][2409866] Using port 43404 on host...
[2023-02-25 12:18:29,891][2409100] Using port 41404 on host...
[2023-02-25 12:18:29,894][2409078] Using port 40504 on host...
[2023-02-25 12:18:29,906][2409355] Using port 41804 on host...
[2023-02-25 12:18:29,907][2409468] Using port 42404 on host...
[2023-02-25 12:18:29,910][2409405] Using port 42104 on host...
[2023-02-25 12:18:29,928][2409486] Using port 42604 on host...
[2023-02-25 12:18:30,070][2409549] Initialized w:26 v:4 player:0
[2023-02-25 12:18:30,071][2409549] Decorrelating experience for 128 frames...
[2023-02-25 12:18:30,130][2409406] Initialized w:19 v:4 player:0
[2023-02-25 12:18:30,131][2409406] Decorrelating experience for 128 frames...
[2023-02-25 12:18:30,149][2409407] Initialized w:20 v:4 player:0
[2023-02-25 12:18:30,150][2409407] Decorrelating experience for 128 frames...
[2023-02-25 12:18:30,204][2409389] Initialized w:17 v:4 player:0
[2023-02-25 12:18:30,205][2409389] Decorrelating experience for 128 frames...
[2023-02-25 12:18:30,223][2409596] Initialized w:29 v:4 player:0
[2023-02-25 12:18:30,224][2409596] Decorrelating experience for 128 frames...
[2023-02-25 12:18:30,256][2409373] Initialized w:16 v:4 player:0
[2023-02-25 12:18:30,257][2409373] Decorrelating experience for 128 frames...
[2023-02-25 12:18:30,271][2409075] Initialized w:1 v:4 player:0
[2023-02-25 12:18:30,273][2409075] Decorrelating experience for 128 frames...
[2023-02-25 12:18:30,351][2409099] Initialized w:7 v:4 player:0
[2023-02-25 12:18:30,353][2409099] Decorrelating experience for 128 frames...
[2023-02-25 12:18:30,370][2409549] Using port 42905 on host...
[2023-02-25 12:18:30,394][2409076] Initialized w:0 v:4 player:0
[2023-02-25 12:18:30,396][2409076] Decorrelating experience for 128 frames...
[2023-02-25 12:18:30,437][2409097] Initialized w:9 v:4 player:0
[2023-02-25 12:18:30,438][2409097] Decorrelating experience for 128 frames...
[2023-02-25 12:18:30,439][2409101] Initialized w:10 v:4 player:0
[2023-02-25 12:18:30,440][2409101] Decorrelating experience for 128 frames...
[2023-02-25 12:18:30,441][2409079] Initialized w:4 v:4 player:0
[2023-02-25 12:18:30,442][2409079] Decorrelating experience for 128 frames...
[2023-02-25 12:18:30,446][2409547] Initialized w:25 v:4 player:0
[2023-02-25 12:18:30,447][2409547] Decorrelating experience for 128 frames...
[2023-02-25 12:18:30,463][2409406] Using port 42205 on host...
[2023-02-25 12:18:30,483][2409105] Initialized w:14 v:4 player:0
[2023-02-25 12:18:30,484][2409105] Decorrelating experience for 128 frames...
[2023-02-25 12:18:30,493][2409407] Using port 42305 on host...
[2023-02-25 12:18:30,531][2409565] Initialized w:28 v:4 player:0
[2023-02-25 12:18:30,532][2409565] Decorrelating experience for 128 frames...
[2023-02-25 12:18:30,537][2409469] Initialized w:22 v:4 player:0
[2023-02-25 12:18:30,538][2409469] Decorrelating experience for 128 frames...
[2023-02-25 12:18:30,551][2409104] Initialized w:13 v:4 player:0
[2023-02-25 12:18:30,553][2409104] Decorrelating experience for 128 frames...
[2023-02-25 12:18:30,562][2409596] Using port 43205 on host...
[2023-02-25 12:18:30,564][2409597] Initialized w:30 v:4 player:0
[2023-02-25 12:18:30,565][2409597] Decorrelating experience for 128 frames...
[2023-02-25 12:18:30,566][2409485] Initialized w:24 v:4 player:0
[2023-02-25 12:18:30,570][2409485] Decorrelating experience for 128 frames...
[2023-02-25 12:18:30,593][2409102] Initialized w:12 v:4 player:0
[2023-02-25 12:18:30,594][2409102] Decorrelating experience for 128 frames...
[2023-02-25 12:18:30,604][2409096] Initialized w:6 v:4 player:0
[2023-02-25 12:18:30,606][2409096] Decorrelating experience for 128 frames...
[2023-02-25 12:18:30,610][2409548] Initialized w:27 v:4 player:0
[2023-02-25 12:18:30,611][2409548] Decorrelating experience for 128 frames...
[2023-02-25 12:18:30,613][2409103] Initialized w:8 v:4 player:0
[2023-02-25 12:18:30,614][2409103] Decorrelating experience for 128 frames...
[2023-02-25 12:18:30,633][2409389] Using port 42005 on host...
[2023-02-25 12:18:30,633][2409077] Initialized w:3 v:4 player:0
[2023-02-25 12:18:30,635][2409077] Decorrelating experience for 128 frames...
[2023-02-25 12:18:30,636][2409078] Initialized w:2 v:4 player:0
[2023-02-25 12:18:30,638][2409078] Decorrelating experience for 128 frames...
[2023-02-25 12:18:30,640][2409100] Initialized w:11 v:4 player:0
[2023-02-25 12:18:30,641][2409100] Decorrelating experience for 128 frames...
[2023-02-25 12:18:30,662][2409866] Initialized w:31 v:4 player:0
[2023-02-25 12:18:30,662][2409405] Initialized w:18 v:4 player:0
[2023-02-25 12:18:30,663][2409866] Decorrelating experience for 128 frames...
[2023-02-25 12:18:30,664][2409405] Decorrelating experience for 128 frames...
[2023-02-25 12:18:30,668][2409355] Initialized w:15 v:4 player:0
[2023-02-25 12:18:30,670][2409355] Decorrelating experience for 128 frames...
[2023-02-25 12:18:30,671][2409075] Using port 40405 on host...
[2023-02-25 12:18:30,690][2409373] Using port 41905 on host...
[2023-02-25 12:18:30,699][2409099] Using port 41005 on host...
[2023-02-25 12:18:30,723][2409080] Initialized w:5 v:4 player:0
[2023-02-25 12:18:30,724][2409080] Decorrelating experience for 128 frames...
[2023-02-25 12:18:30,734][2409468] Initialized w:21 v:4 player:0
[2023-02-25 12:18:30,735][2409486] Initialized w:23 v:4 player:0
[2023-02-25 12:18:30,735][2409468] Decorrelating experience for 128 frames...
[2023-02-25 12:18:30,736][2409486] Decorrelating experience for 128 frames...
[2023-02-25 12:18:30,784][2409101] Using port 41305 on host...
[2023-02-25 12:18:30,790][2409076] Using port 40305 on host...
[2023-02-25 12:18:30,805][2409079] Using port 40705 on host...
[2023-02-25 12:18:30,879][2409105] Using port 41705 on host...
[2023-02-25 12:18:30,899][2409097] Using port 41205 on host...
[2023-02-25 12:18:30,900][2409104] Using port 41605 on host...
[2023-02-25 12:18:30,921][2409547] Using port 42805 on host...
[2023-02-25 12:18:30,968][2409597] Using port 43305 on host...
[2023-02-25 12:18:30,969][2409565] Using port 43105 on host...
[2023-02-25 12:18:30,984][2409077] Using port 40605 on host...
[2023-02-25 12:18:30,986][2409469] Using port 42505 on host...
[2023-02-25 12:18:31,035][2409102] Using port 41505 on host...
[2023-02-25 12:18:31,050][2409096] Using port 40905 on host...
[2023-02-25 12:18:31,051][2409485] Using port 42705 on host...
[2023-02-25 12:18:31,074][2409486] Using port 42605 on host...
[2023-02-25 12:18:31,086][2409103] Using port 41105 on host...
[2023-02-25 12:18:31,114][2409078] Using port 40505 on host...
[2023-02-25 12:18:31,126][2409405] Using port 42105 on host...
[2023-02-25 12:18:31,140][2409549] Initialized w:26 v:5 player:0
[2023-02-25 12:18:31,142][2409549] Decorrelating experience for 160 frames...
[2023-02-25 12:18:31,167][2409548] Using port 43005 on host...
[2023-02-25 12:18:31,198][2409100] Using port 41405 on host...
[2023-02-25 12:18:31,230][2409080] Using port 40805 on host...
[2023-02-25 12:18:31,232][2409468] Using port 42405 on host...
[2023-02-25 12:18:31,271][2409406] Initialized w:19 v:5 player:0
[2023-02-25 12:18:31,273][2409406] Decorrelating experience for 160 frames...
[2023-02-25 12:18:31,289][2409407] Initialized w:20 v:5 player:0
[2023-02-25 12:18:31,290][2409407] Decorrelating experience for 160 frames...
[2023-02-25 12:18:31,341][2409389] Initialized w:17 v:5 player:0
[2023-02-25 12:18:31,342][2409389] Decorrelating experience for 160 frames...
[2023-02-25 12:18:31,358][2409866] Using port 43405 on host...
[2023-02-25 12:18:31,363][2409355] Using port 41805 on host...
[2023-02-25 12:18:31,379][2409596] Initialized w:29 v:5 player:0
[2023-02-25 12:18:31,380][2409596] Decorrelating experience for 160 frames...
[2023-02-25 12:18:31,388][2409075] Initialized w:1 v:5 player:0
[2023-02-25 12:18:31,389][2409075] Decorrelating experience for 160 frames...
[2023-02-25 12:18:31,440][2409373] Initialized w:16 v:5 player:0
[2023-02-25 12:18:31,441][2409373] Decorrelating experience for 160 frames...
[2023-02-25 12:18:31,497][2409076] Initialized w:0 v:5 player:0
[2023-02-25 12:18:31,499][2409076] Decorrelating experience for 160 frames...
[2023-02-25 12:18:31,539][2409099] Initialized w:7 v:5 player:0
[2023-02-25 12:18:31,540][2409099] Decorrelating experience for 160 frames...
[2023-02-25 12:18:31,544][2409549] Using port 42906 on host...
[2023-02-25 12:18:31,595][2409101] Initialized w:10 v:5 player:0
[2023-02-25 12:18:31,596][2409079] Initialized w:4 v:5 player:0
[2023-02-25 12:18:31,596][2409101] Decorrelating experience for 160 frames...
[2023-02-25 12:18:31,597][2409079] Decorrelating experience for 160 frames...
[2023-02-25 12:18:31,602][2409097] Initialized w:9 v:5 player:0
[2023-02-25 12:18:31,603][2409097] Decorrelating experience for 160 frames...
[2023-02-25 12:18:31,644][2409105] Initialized w:14 v:5 player:0
[2023-02-25 12:18:31,646][2409105] Decorrelating experience for 160 frames...
[2023-02-25 12:18:31,647][2409406] Using port 42206 on host...
[2023-02-25 12:18:31,650][2409547] Initialized w:25 v:5 player:0
[2023-02-25 12:18:31,651][2409547] Decorrelating experience for 160 frames...
[2023-02-25 12:18:31,703][2409565] Initialized w:28 v:5 player:0
[2023-02-25 12:18:31,703][2409104] Initialized w:13 v:5 player:0
[2023-02-25 12:18:31,704][2409565] Decorrelating experience for 160 frames...
[2023-02-25 12:18:31,704][2409104] Decorrelating experience for 160 frames...
[2023-02-25 12:18:31,720][2409407] Using port 42306 on host...
[2023-02-25 12:18:31,741][2409597] Initialized w:30 v:5 player:0
[2023-02-25 12:18:31,743][2409597] Decorrelating experience for 160 frames...
[2023-02-25 12:18:31,769][2409102] Initialized w:12 v:5 player:0
[2023-02-25 12:18:31,770][2409469] Initialized w:22 v:5 player:0
[2023-02-25 12:18:31,771][2409102] Decorrelating experience for 160 frames...
[2023-02-25 12:18:31,771][2409469] Decorrelating experience for 160 frames...
[2023-02-25 12:18:31,777][2409485] Initialized w:24 v:5 player:0
[2023-02-25 12:18:31,778][2409485] Decorrelating experience for 160 frames...
[2023-02-25 12:18:31,806][2409596] Using port 43206 on host...
[2023-02-25 12:18:31,810][2409103] Initialized w:8 v:5 player:0
[2023-02-25 12:18:31,812][2409103] Decorrelating experience for 160 frames...
[2023-02-25 12:18:31,838][2409096] Initialized w:6 v:5 player:0
[2023-02-25 12:18:31,839][2409096] Decorrelating experience for 160 frames...
[2023-02-25 12:18:31,847][2409077] Initialized w:3 v:5 player:0
[2023-02-25 12:18:31,848][2409077] Decorrelating experience for 160 frames...
[2023-02-25 12:18:31,881][2409389] Using port 42006 on host...
[2023-02-25 12:18:31,900][2409075] Using port 40406 on host...
[2023-02-25 12:18:31,902][2409405] Initialized w:18 v:5 player:0
[2023-02-25 12:18:31,904][2409078] Initialized w:2 v:5 player:0
[2023-02-25 12:18:31,903][2409405] Decorrelating experience for 160 frames...
[2023-02-25 12:18:31,905][2409078] Decorrelating experience for 160 frames...
[2023-02-25 12:18:31,909][2409548] Initialized w:27 v:5 player:0
[2023-02-25 12:18:31,910][2409548] Decorrelating experience for 160 frames...
[2023-02-25 12:18:31,914][2409100] Initialized w:11 v:5 player:0
[2023-02-25 12:18:31,915][2409100] Decorrelating experience for 160 frames...
[2023-02-25 12:18:31,935][2409486] Initialized w:23 v:5 player:0
[2023-02-25 12:18:31,936][2409486] Decorrelating experience for 160 frames...
[2023-02-25 12:18:31,980][2409099] Using port 41006 on host...
[2023-02-25 12:18:31,983][2409373] Using port 41906 on host...
[2023-02-25 12:18:32,014][2409080] Initialized w:5 v:5 player:0
[2023-02-25 12:18:32,016][2409080] Decorrelating experience for 160 frames...
[2023-02-25 12:18:32,021][2409468] Initialized w:21 v:5 player:0
[2023-02-25 12:18:32,022][2409468] Decorrelating experience for 160 frames...
[2023-02-25 12:18:32,034][2409101] Using port 41306 on host...
[2023-02-25 12:18:32,038][2409079] Using port 40706 on host...
[2023-02-25 12:18:32,070][2409076] Using port 40306 on host...
[2023-02-25 12:18:32,087][2409866] Initialized w:31 v:5 player:0
[2023-02-25 12:18:32,089][2409866] Decorrelating experience for 160 frames...
[2023-02-25 12:18:32,093][2409355] Initialized w:15 v:5 player:0
[2023-02-25 12:18:32,095][2409355] Decorrelating experience for 160 frames...
[2023-02-25 12:18:32,137][2409097] Using port 41206 on host...
[2023-02-25 12:18:32,169][2409105] Using port 41706 on host...
[2023-02-25 12:18:32,181][2409104] Using port 41606 on host...
[2023-02-25 12:18:32,186][2408954] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0)
[2023-02-25 12:18:32,188][2409547] Using port 42806 on host...
[2023-02-25 12:18:32,235][2409565] Using port 43106 on host...
[2023-02-25 12:18:32,261][2409597] Using port 43306 on host...
[2023-02-25 12:18:32,276][2409077] Using port 40606 on host...
[2023-02-25 12:18:32,303][2409469] Using port 42506 on host...
[2023-02-25 12:18:32,328][2409485] Using port 42706 on host...
[2023-02-25 12:18:32,350][2409102] Using port 41506 on host...
[2023-02-25 12:18:32,358][2409486] Using port 42606 on host...
[2023-02-25 12:18:32,359][2409549] Initialized w:26 v:6 player:0
[2023-02-25 12:18:32,360][2409549] Decorrelating experience for 192 frames...
[2023-02-25 12:18:32,366][2409103] Using port 41106 on host...
[2023-02-25 12:18:32,388][2409096] Using port 40906 on host...
[2023-02-25 12:18:32,449][2409405] Using port 42106 on host...
[2023-02-25 12:18:32,451][2409406] Initialized w:19 v:6 player:0
[2023-02-25 12:18:32,452][2409406] Decorrelating experience for 192 frames...
[2023-02-25 12:18:32,457][2409548] Using port 43006 on host...
[2023-02-25 12:18:32,459][2409078] Using port 40506 on host...
[2023-02-25 12:18:32,485][2409100] Using port 41406 on host...
[2023-02-25 12:18:32,551][2409407] Initialized w:20 v:6 player:0
[2023-02-25 12:18:32,552][2409407] Decorrelating experience for 192 frames...
[2023-02-25 12:18:32,583][2409389] Initialized w:17 v:6 player:0
[2023-02-25 12:18:32,584][2409389] Decorrelating experience for 192 frames...
[2023-02-25 12:18:32,614][2409075] Initialized w:1 v:6 player:0
[2023-02-25 12:18:32,615][2409075] Decorrelating experience for 192 frames...
[2023-02-25 12:18:32,619][2409596] Initialized w:29 v:6 player:0
[2023-02-25 12:18:32,620][2409596] Decorrelating experience for 192 frames...
[2023-02-25 12:18:32,623][2409468] Using port 42406 on host...
[2023-02-25 12:18:32,628][2409080] Using port 40806 on host...
[2023-02-25 12:18:32,654][2409866] Using port 43406 on host...
[2023-02-25 12:18:32,671][2409355] Using port 41806 on host...
[2023-02-25 12:18:32,733][2409373] Initialized w:16 v:6 player:0
[2023-02-25 12:18:32,735][2409373] Decorrelating experience for 192 frames...
[2023-02-25 12:18:32,763][2409079] Initialized w:4 v:6 player:0
[2023-02-25 12:18:32,765][2409079] Decorrelating experience for 192 frames...
[2023-02-25 12:18:32,785][2409099] Initialized w:7 v:6 player:0
[2023-02-25 12:18:32,787][2409099] Decorrelating experience for 192 frames...
[2023-02-25 12:18:32,804][2409076] Initialized w:0 v:6 player:0
[2023-02-25 12:18:32,805][2409076] Decorrelating experience for 192 frames...
[2023-02-25 12:18:32,825][2409101] Initialized w:10 v:6 player:0
[2023-02-25 12:18:32,826][2409101] Decorrelating experience for 192 frames...
[2023-02-25 12:18:32,869][2409549] Using port 42907 on host...
[2023-02-25 12:18:32,869][2409097] Initialized w:9 v:6 player:0
[2023-02-25 12:18:32,871][2409097] Decorrelating experience for 192 frames...
[2023-02-25 12:18:32,898][2409547] Initialized w:25 v:6 player:0
[2023-02-25 12:18:32,899][2409547] Decorrelating experience for 192 frames...
[2023-02-25 12:18:32,942][2409105] Initialized w:14 v:6 player:0
[2023-02-25 12:18:32,943][2409105] Decorrelating experience for 192 frames...
[2023-02-25 12:18:32,946][2409406] Using port 42207 on host...
[2023-02-25 12:18:32,956][2409104] Initialized w:13 v:6 player:0
[2023-02-25 12:18:32,957][2409104] Decorrelating experience for 192 frames...
[2023-02-25 12:18:32,987][2409565] Initialized w:28 v:6 player:0
[2023-02-25 12:18:32,988][2409565] Decorrelating experience for 192 frames...
[2023-02-25 12:18:33,043][2409597] Initialized w:30 v:6 player:0
[2023-02-25 12:18:33,044][2409597] Decorrelating experience for 192 frames...
[2023-02-25 12:18:33,055][2409469] Initialized w:22 v:6 player:0
[2023-02-25 12:18:33,056][2409469] Decorrelating experience for 192 frames...
[2023-02-25 12:18:33,075][2409485] Initialized w:24 v:6 player:0
[2023-02-25 12:18:33,076][2409485] Decorrelating experience for 192 frames...
[2023-02-25 12:18:33,078][2409102] Initialized w:12 v:6 player:0
[2023-02-25 12:18:33,079][2409102] Decorrelating experience for 192 frames...
[2023-02-25 12:18:33,087][2409103] Initialized w:8 v:6 player:0
[2023-02-25 12:18:33,088][2409103] Decorrelating experience for 192 frames...
[2023-02-25 12:18:33,106][2409077] Initialized w:3 v:6 player:0
[2023-02-25 12:18:33,107][2409077] Decorrelating experience for 192 frames...
[2023-02-25 12:18:33,118][2409096] Initialized w:6 v:6 player:0
[2023-02-25 12:18:33,119][2409096] Decorrelating experience for 192 frames...
[2023-02-25 12:18:33,128][2409407] Using port 42307 on host...
[2023-02-25 12:18:33,163][2409486] Initialized w:23 v:6 player:0
[2023-02-25 12:18:33,164][2409405] Initialized w:18 v:6 player:0
[2023-02-25 12:18:33,165][2409405] Decorrelating experience for 192 frames...
[2023-02-25 12:18:33,166][2409486] Decorrelating experience for 192 frames...
[2023-02-25 12:18:33,174][2409548] Initialized w:27 v:6 player:0
[2023-02-25 12:18:33,175][2409548] Decorrelating experience for 192 frames...
[2023-02-25 12:18:33,202][2409078] Initialized w:2 v:6 player:0
[2023-02-25 12:18:33,203][2409078] Decorrelating experience for 192 frames...
[2023-02-25 12:18:33,205][2409389] Using port 42007 on host...
[2023-02-25 12:18:33,209][2409596] Using port 43207 on host...
[2023-02-25 12:18:33,235][2409100] Initialized w:11 v:6 player:0
[2023-02-25 12:18:33,237][2409100] Decorrelating experience for 192 frames...
[2023-02-25 12:18:33,243][2409075] Using port 40407 on host...
[2023-02-25 12:18:33,328][2409101] Using port 41307 on host...
[2023-02-25 12:18:33,334][2409099] Using port 41007 on host...
[2023-02-25 12:18:33,339][2409079] Using port 40707 on host...
[2023-02-25 12:18:33,362][2409373] Using port 41907 on host...
[2023-02-25 12:18:33,379][2409866] Initialized w:31 v:6 player:0
[2023-02-25 12:18:33,380][2409866] Decorrelating experience for 192 frames...
[2023-02-25 12:18:33,398][2409355] Initialized w:15 v:6 player:0
[2023-02-25 12:18:33,399][2409355] Decorrelating experience for 192 frames...
[2023-02-25 12:18:33,430][2409080] Initialized w:5 v:6 player:0
[2023-02-25 12:18:33,432][2409080] Decorrelating experience for 192 frames...
[2023-02-25 12:18:33,438][2409468] Initialized w:21 v:6 player:0
[2023-02-25 12:18:33,439][2409468] Decorrelating experience for 192 frames...
[2023-02-25 12:18:33,471][2409076] Using port 40307 on host...
[2023-02-25 12:18:33,548][2409104] Using port 41607 on host...
[2023-02-25 12:18:33,561][2409105] Using port 41707 on host...
[2023-02-25 12:18:33,569][2409097] Using port 41207 on host...
[2023-02-25 12:18:33,589][2409547] Using port 42807 on host...
[2023-02-25 12:18:33,666][2409597] Using port 43307 on host...
[2023-02-25 12:18:33,691][2409077] Using port 40607 on host...
[2023-02-25 12:18:33,720][2409565] Using port 43107 on host...
[2023-02-25 12:18:33,744][2409549] Initialized w:26 v:7 player:0
[2023-02-25 12:18:33,745][2409549] Decorrelating experience for 224 frames...
[2023-02-25 12:18:33,752][2409469] Using port 42507 on host...
[2023-02-25 12:18:33,779][2409486] Using port 42607 on host...
[2023-02-25 12:18:33,805][2409548] Using port 43007 on host...
[2023-02-25 12:18:33,807][2409485] Using port 42707 on host...
[2023-02-25 12:18:33,817][2409103] Using port 41107 on host...
[2023-02-25 12:18:33,823][2409096] Using port 40907 on host...
[2023-02-25 12:18:33,847][2409406] Initialized w:19 v:7 player:0
[2023-02-25 12:18:33,848][2409406] Decorrelating experience for 224 frames...
[2023-02-25 12:18:33,877][2409100] Using port 41407 on host...
[2023-02-25 12:18:33,885][2409102] Using port 41507 on host...
[2023-02-25 12:18:33,932][2409389] Initialized w:17 v:7 player:0
[2023-02-25 12:18:33,933][2409389] Decorrelating experience for 224 frames...
[2023-02-25 12:18:33,935][2409407] Initialized w:20 v:7 player:0
[2023-02-25 12:18:33,936][2409407] Decorrelating experience for 224 frames...
[2023-02-25 12:18:33,956][2409075] Initialized w:1 v:7 player:0
[2023-02-25 12:18:33,957][2409075] Decorrelating experience for 224 frames...
[2023-02-25 12:18:34,019][2409596] Initialized w:29 v:7 player:0
[2023-02-25 12:18:34,020][2409596] Decorrelating experience for 224 frames...
[2023-02-25 12:18:34,066][2409405] Using port 42107 on host...
[2023-02-25 12:18:34,073][2409866] Using port 43407 on host...
[2023-02-25 12:18:34,077][2409355] Using port 41807 on host...
[2023-02-25 12:18:34,082][2409078] Using port 40507 on host...
[2023-02-25 12:18:34,085][2409079] Initialized w:4 v:7 player:0
[2023-02-25 12:18:34,087][2409079] Decorrelating experience for 224 frames...
[2023-02-25 12:18:34,124][2409373] Initialized w:16 v:7 player:0
[2023-02-25 12:18:34,126][2409373] Decorrelating experience for 224 frames...
[2023-02-25 12:18:34,142][2409080] Using port 40807 on host...
[2023-02-25 12:18:34,165][2409468] Using port 42407 on host...
[2023-02-25 12:18:34,187][2409076] Initialized w:0 v:7 player:0
[2023-02-25 12:18:34,189][2409076] Decorrelating experience for 224 frames...
[2023-02-25 12:18:34,224][2409101] Initialized w:10 v:7 player:0
[2023-02-25 12:18:34,225][2409101] Decorrelating experience for 224 frames...
[2023-02-25 12:18:34,227][2409099] Initialized w:7 v:7 player:0
[2023-02-25 12:18:34,228][2409099] Decorrelating experience for 224 frames...
[2023-02-25 12:18:34,290][2409097] Initialized w:9 v:7 player:0
[2023-02-25 12:18:34,291][2409097] Decorrelating experience for 224 frames...
[2023-02-25 12:18:34,297][2409104] Initialized w:13 v:7 player:0
[2023-02-25 12:18:34,299][2409104] Decorrelating experience for 224 frames...
[2023-02-25 12:18:34,312][2409547] Initialized w:25 v:7 player:0
[2023-02-25 12:18:34,314][2409547] Decorrelating experience for 224 frames...
[2023-02-25 12:18:34,315][2409105] Initialized w:14 v:7 player:0
[2023-02-25 12:18:34,316][2409105] Decorrelating experience for 224 frames...
[2023-02-25 12:18:34,360][2409549] Using port 42908 on host...
[2023-02-25 12:18:34,426][2409597] Initialized w:30 v:7 player:0
[2023-02-25 12:18:34,428][2409597] Decorrelating experience for 224 frames...
[2023-02-25 12:18:34,448][2409406] Using port 42208 on host...
[2023-02-25 12:18:34,478][2409565] Initialized w:28 v:7 player:0
[2023-02-25 12:18:34,479][2409565] Decorrelating experience for 224 frames...
[2023-02-25 12:18:34,508][2409469] Initialized w:22 v:7 player:0
[2023-02-25 12:18:34,509][2409469] Decorrelating experience for 224 frames...
[2023-02-25 12:18:34,545][2409548] Initialized w:27 v:7 player:0
[2023-02-25 12:18:34,547][2409548] Decorrelating experience for 224 frames...
[2023-02-25 12:18:34,546][2409486] Initialized w:23 v:7 player:0
[2023-02-25 12:18:34,549][2409486] Decorrelating experience for 224 frames...
[2023-02-25 12:18:34,550][2409103] Initialized w:8 v:7 player:0
[2023-02-25 12:18:34,553][2409103] Decorrelating experience for 224 frames...
[2023-02-25 12:18:34,560][2409485] Initialized w:24 v:7 player:0
[2023-02-25 12:18:34,562][2409485] Decorrelating experience for 224 frames...
[2023-02-25 12:18:34,563][2409096] Initialized w:6 v:7 player:0
[2023-02-25 12:18:34,564][2409096] Decorrelating experience for 224 frames...
[2023-02-25 12:18:34,579][2409102] Initialized w:12 v:7 player:0
[2023-02-25 12:18:34,580][2409102] Decorrelating experience for 224 frames...
[2023-02-25 12:18:34,583][2409077] Initialized w:3 v:7 player:0
[2023-02-25 12:18:34,584][2409077] Decorrelating experience for 224 frames...
[2023-02-25 12:18:34,609][2409100] Initialized w:11 v:7 player:0
[2023-02-25 12:18:34,611][2409100] Decorrelating experience for 224 frames...
[2023-02-25 12:18:34,629][2409407] Using port 42308 on host...
[2023-02-25 12:18:34,673][2409389] Using port 42008 on host...
[2023-02-25 12:18:34,710][2409075] Using port 40408 on host...
[2023-02-25 12:18:34,723][2409596] Using port 43208 on host...
[2023-02-25 12:18:34,768][2409079] Using port 40708 on host...
[2023-02-25 12:18:34,782][2409866] Initialized w:31 v:7 player:0
[2023-02-25 12:18:34,783][2409866] Decorrelating experience for 224 frames...
[2023-02-25 12:18:34,788][2409355] Initialized w:15 v:7 player:0
[2023-02-25 12:18:34,789][2409355] Decorrelating experience for 224 frames...
[2023-02-25 12:18:34,790][2409405] Initialized w:18 v:7 player:0
[2023-02-25 12:18:34,791][2409405] Decorrelating experience for 224 frames...
[2023-02-25 12:18:34,797][2409078] Initialized w:2 v:7 player:0
[2023-02-25 12:18:34,799][2409078] Decorrelating experience for 224 frames...
[2023-02-25 12:18:34,841][2409101] Using port 41308 on host...
[2023-02-25 12:18:34,852][2409373] Using port 41908 on host...
[2023-02-25 12:18:34,910][2409099] Using port 41008 on host...
[2023-02-25 12:18:34,923][2409076] Using port 40308 on host...
[2023-02-25 12:18:34,939][2409468] Initialized w:21 v:7 player:0
[2023-02-25 12:18:34,940][2409468] Decorrelating experience for 224 frames...
[2023-02-25 12:18:34,948][2409080] Initialized w:5 v:7 player:0
[2023-02-25 12:18:34,949][2409080] Decorrelating experience for 224 frames...
[2023-02-25 12:18:34,997][2409104] Using port 41608 on host...
[2023-02-25 12:18:35,040][2409097] Using port 41208 on host...
[2023-02-25 12:18:35,072][2409105] Using port 41708 on host...
[2023-02-25 12:18:35,082][2409547] Using port 42808 on host...
[2023-02-25 12:18:35,156][2409077] Using port 40608 on host...
[2023-02-25 12:18:35,163][2409597] Using port 43308 on host...
[2023-02-25 12:18:35,195][2409549] Initialized w:26 v:8 player:0
[2023-02-25 12:18:35,196][2409549] Decorrelating experience for 256 frames...
[2023-02-25 12:18:35,209][2409565] Using port 43108 on host...
[2023-02-25 12:18:35,238][2409486] Using port 42608 on host...
[2023-02-25 12:18:35,239][2409406] Initialized w:19 v:8 player:0
[2023-02-25 12:18:35,240][2409406] Decorrelating experience for 256 frames...
[2023-02-25 12:18:35,260][2409469] Using port 42508 on host...
[2023-02-25 12:18:35,295][2409548] Using port 43008 on host...
[2023-02-25 12:18:35,318][2409096] Using port 40908 on host...
[2023-02-25 12:18:35,327][2409485] Using port 42708 on host...
[2023-02-25 12:18:35,331][2409103] Using port 41108 on host...
[2023-02-25 12:18:35,332][2409102] Using port 41508 on host...
[2023-02-25 12:18:35,370][2409100] Using port 41408 on host...
[2023-02-25 12:18:35,387][2409407] Initialized w:20 v:8 player:0
[2023-02-25 12:18:35,388][2409407] Decorrelating experience for 256 frames...
[2023-02-25 12:18:35,392][2409389] Initialized w:17 v:8 player:0
[2023-02-25 12:18:35,394][2409389] Decorrelating experience for 256 frames...
[2023-02-25 12:18:35,456][2409075] Initialized w:1 v:8 player:0
[2023-02-25 12:18:35,458][2409075] Decorrelating experience for 256 frames...
[2023-02-25 12:18:35,511][2409079] Initialized w:4 v:8 player:0
[2023-02-25 12:18:35,513][2409079] Decorrelating experience for 256 frames...
[2023-02-25 12:18:35,520][2409596] Initialized w:29 v:8 player:0
[2023-02-25 12:18:35,521][2409596] Decorrelating experience for 256 frames...
[2023-02-25 12:18:35,555][2409405] Using port 42108 on host...
[2023-02-25 12:18:35,560][2409866] Using port 43408 on host...
[2023-02-25 12:18:35,572][2409355] Using port 41808 on host...
[2023-02-25 12:18:35,573][2409078] Using port 40508 on host...
[2023-02-25 12:18:35,628][2409101] Initialized w:10 v:8 player:0
[2023-02-25 12:18:35,629][2409101] Decorrelating experience for 256 frames...
[2023-02-25 12:18:35,647][2409373] Initialized w:16 v:8 player:0
[2023-02-25 12:18:35,648][2409373] Decorrelating experience for 256 frames...
[2023-02-25 12:18:35,696][2409076] Initialized w:0 v:8 player:0
[2023-02-25 12:18:35,697][2409076] Decorrelating experience for 256 frames...
[2023-02-25 12:18:35,740][2409104] Initialized w:13 v:8 player:0
[2023-02-25 12:18:35,742][2409104] Decorrelating experience for 256 frames...
[2023-02-25 12:18:35,754][2409099] Initialized w:7 v:8 player:0
[2023-02-25 12:18:35,755][2409099] Decorrelating experience for 256 frames...
[2023-02-25 12:18:35,775][2409080] Using port 40808 on host...
[2023-02-25 12:18:35,777][2409097] Initialized w:9 v:8 player:0
[2023-02-25 12:18:35,778][2409097] Decorrelating experience for 256 frames...
[2023-02-25 12:18:35,796][2409547] Initialized w:25 v:8 player:0
[2023-02-25 12:18:35,797][2409468] Using port 42408 on host...
[2023-02-25 12:18:35,798][2409547] Decorrelating experience for 256 frames...
[2023-02-25 12:18:35,829][2409105] Initialized w:14 v:8 player:0
[2023-02-25 12:18:35,830][2409105] Decorrelating experience for 256 frames...
[2023-02-25 12:18:35,897][2409406] Using port 42209 on host...
[2023-02-25 12:18:35,902][2409549] Using port 42909 on host...
[2023-02-25 12:18:35,930][2409597] Initialized w:30 v:8 player:0
[2023-02-25 12:18:35,932][2409597] Decorrelating experience for 256 frames...
[2023-02-25 12:18:35,975][2409565] Initialized w:28 v:8 player:0
[2023-02-25 12:18:35,976][2409565] Decorrelating experience for 256 frames...
[2023-02-25 12:18:36,005][2409486] Initialized w:23 v:8 player:0
[2023-02-25 12:18:36,006][2409469] Initialized w:22 v:8 player:0
[2023-02-25 12:18:36,007][2409486] Decorrelating experience for 256 frames...
[2023-02-25 12:18:36,007][2409469] Decorrelating experience for 256 frames...
[2023-02-25 12:18:36,038][2409096] Initialized w:6 v:8 player:0
[2023-02-25 12:18:36,040][2409096] Decorrelating experience for 256 frames...
[2023-02-25 12:18:36,056][2409548] Initialized w:27 v:8 player:0
[2023-02-25 12:18:36,057][2409548] Decorrelating experience for 256 frames...
[2023-02-25 12:18:36,057][2409485] Initialized w:24 v:8 player:0
[2023-02-25 12:18:36,059][2409485] Decorrelating experience for 256 frames...
[2023-02-25 12:18:36,060][2409103] Initialized w:8 v:8 player:0
[2023-02-25 12:18:36,061][2409103] Decorrelating experience for 256 frames...
[2023-02-25 12:18:36,064][2409102] Initialized w:12 v:8 player:0
[2023-02-25 12:18:36,065][2409102] Decorrelating experience for 256 frames...
[2023-02-25 12:18:36,069][2409077] Initialized w:3 v:8 player:0
[2023-02-25 12:18:36,071][2409077] Decorrelating experience for 256 frames...
[2023-02-25 12:18:36,076][2409100] Initialized w:11 v:8 player:0
[2023-02-25 12:18:36,077][2409100] Decorrelating experience for 256 frames...
[2023-02-25 12:18:36,269][2409389] Using port 42009 on host...
[2023-02-25 12:18:36,284][2409355] Initialized w:15 v:8 player:0
[2023-02-25 12:18:36,287][2409866] Initialized w:31 v:8 player:0
[2023-02-25 12:18:36,286][2409355] Decorrelating experience for 256 frames...
[2023-02-25 12:18:36,289][2409866] Decorrelating experience for 256 frames...
[2023-02-25 12:18:36,312][2409078] Initialized w:2 v:8 player:0
[2023-02-25 12:18:36,313][2409078] Decorrelating experience for 256 frames...
[2023-02-25 12:18:36,314][2409405] Initialized w:18 v:8 player:0
[2023-02-25 12:18:36,315][2409405] Decorrelating experience for 256 frames...
[2023-02-25 12:18:36,328][2409075] Using port 40409 on host...
[2023-02-25 12:18:36,372][2409407] Using port 42309 on host...
[2023-02-25 12:18:36,377][2409596] Using port 43209 on host...
[2023-02-25 12:18:36,422][2409101] Using port 41309 on host...
[2023-02-25 12:18:36,462][2409079] Using port 40709 on host...
[2023-02-25 12:18:36,489][2409373] Using port 41909 on host...
[2023-02-25 12:18:36,565][2409080] Initialized w:5 v:8 player:0
[2023-02-25 12:18:36,566][2409080] Decorrelating experience for 256 frames...
[2023-02-25 12:18:36,578][2409076] Using port 40309 on host...
[2023-02-25 12:18:36,584][2409104] Using port 41609 on host...
[2023-02-25 12:18:36,584][2409468] Initialized w:21 v:8 player:0
[2023-02-25 12:18:36,585][2409468] Decorrelating experience for 256 frames...
[2023-02-25 12:18:36,640][2409099] Using port 41009 on host...
[2023-02-25 12:18:36,651][2409547] Using port 42809 on host...
[2023-02-25 12:18:36,668][2409097] Using port 41209 on host...
[2023-02-25 12:18:36,726][2409105] Using port 41709 on host...
[2023-02-25 12:18:36,748][2409597] Using port 43309 on host...
[2023-02-25 12:18:36,755][2409549] Initialized w:26 v:9 player:0
[2023-02-25 12:18:36,756][2409549] Decorrelating experience for 288 frames...
[2023-02-25 12:18:36,775][2409406] Initialized w:19 v:9 player:0
[2023-02-25 12:18:36,777][2409406] Decorrelating experience for 288 frames...
[2023-02-25 12:18:36,792][2409077] Using port 40609 on host...
[2023-02-25 12:18:36,793][2409565] Using port 43109 on host...
[2023-02-25 12:18:36,880][2409486] Using port 42609 on host...
[2023-02-25 12:18:36,917][2409102] Using port 41509 on host...
[2023-02-25 12:18:36,934][2409469] Using port 42509 on host...
[2023-02-25 12:18:36,940][2409548] Using port 43009 on host...
[2023-02-25 12:18:36,958][2409100] Using port 41409 on host...
[2023-02-25 12:18:36,975][2409096] Using port 40909 on host...
[2023-02-25 12:18:36,995][2409389] Initialized w:17 v:9 player:0
[2023-02-25 12:18:36,997][2409389] Decorrelating experience for 288 frames...
[2023-02-25 12:18:37,059][2409075] Initialized w:1 v:9 player:0
[2023-02-25 12:18:37,060][2409075] Decorrelating experience for 288 frames...
[2023-02-25 12:18:37,127][2409407] Initialized w:20 v:9 player:0
[2023-02-25 12:18:37,128][2409407] Decorrelating experience for 288 frames...
[2023-02-25 12:18:37,141][2409596] Initialized w:29 v:9 player:0
[2023-02-25 12:18:37,142][2409596] Decorrelating experience for 288 frames...
[2023-02-25 12:18:37,163][2409355] Using port 41809 on host...
[2023-02-25 12:18:37,167][2409485] Using port 42709 on host...
[2023-02-25 12:18:37,175][2409103] Using port 41109 on host...
[2023-02-25 12:18:37,182][2409866] Using port 43409 on host...
[2023-02-25 12:18:37,186][2408954] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0)
[2023-02-25 12:18:37,202][2409079] Initialized w:4 v:9 player:0
[2023-02-25 12:18:37,204][2409079] Decorrelating experience for 288 frames...
[2023-02-25 12:18:37,209][2409101] Initialized w:10 v:9 player:0
[2023-02-25 12:18:37,210][2409101] Decorrelating experience for 288 frames...
[2023-02-25 12:18:37,235][2409373] Initialized w:16 v:9 player:0
[2023-02-25 12:18:37,237][2409373] Decorrelating experience for 288 frames...
[2023-02-25 12:18:37,270][2409078] Using port 40509 on host...
[2023-02-25 12:18:37,276][2409405] Using port 42109 on host...
[2023-02-25 12:18:37,278][2409076] Initialized w:0 v:9 player:0
[2023-02-25 12:18:37,279][2409076] Decorrelating experience for 288 frames...
[2023-02-25 12:18:37,326][2409104] Initialized w:13 v:9 player:0
[2023-02-25 12:18:37,327][2409104] Decorrelating experience for 288 frames...
[2023-02-25 12:18:37,375][2409097] Initialized w:9 v:9 player:0
[2023-02-25 12:18:37,376][2409097] Decorrelating experience for 288 frames...
[2023-02-25 12:18:37,385][2409547] Initialized w:25 v:9 player:0
[2023-02-25 12:18:37,386][2409547] Decorrelating experience for 288 frames...
[2023-02-25 12:18:37,463][2409597] Initialized w:30 v:9 player:0
[2023-02-25 12:18:37,465][2409597] Decorrelating experience for 288 frames...
[2023-02-25 12:18:37,471][2409099] Initialized w:7 v:9 player:0
[2023-02-25 12:18:37,472][2409099] Decorrelating experience for 288 frames...
[2023-02-25 12:18:37,476][2409105] Initialized w:14 v:9 player:0
[2023-02-25 12:18:37,480][2409105] Decorrelating experience for 288 frames...
[2023-02-25 12:18:37,507][2409468] Using port 42409 on host...
[2023-02-25 12:18:37,514][2409080] Using port 40809 on host...
[2023-02-25 12:18:37,527][2409406] Using port 42210 on host...
[2023-02-25 12:18:37,547][2409565] Initialized w:28 v:9 player:0
[2023-02-25 12:18:37,548][2409565] Decorrelating experience for 288 frames...
[2023-02-25 12:18:37,579][2409549] Using port 42910 on host...
[2023-02-25 12:18:37,642][2409486] Initialized w:23 v:9 player:0
[2023-02-25 12:18:37,643][2409486] Decorrelating experience for 288 frames...
[2023-02-25 12:18:37,644][2409102] Initialized w:12 v:9 player:0
[2023-02-25 12:18:37,645][2409102] Decorrelating experience for 288 frames...
[2023-02-25 12:18:37,663][2409548] Initialized w:27 v:9 player:0
[2023-02-25 12:18:37,664][2409548] Decorrelating experience for 288 frames...
[2023-02-25 12:18:37,667][2409469] Initialized w:22 v:9 player:0
[2023-02-25 12:18:37,668][2409469] Decorrelating experience for 288 frames...
[2023-02-25 12:18:37,691][2409100] Initialized w:11 v:9 player:0
[2023-02-25 12:18:37,693][2409100] Decorrelating experience for 288 frames...
[2023-02-25 12:18:37,705][2409096] Initialized w:6 v:9 player:0
[2023-02-25 12:18:37,707][2409096] Decorrelating experience for 288 frames...
[2023-02-25 12:18:37,759][2409077] Initialized w:3 v:9 player:0
[2023-02-25 12:18:37,760][2409077] Decorrelating experience for 288 frames...
[2023-02-25 12:18:37,863][2409103] Initialized w:8 v:9 player:0
[2023-02-25 12:18:37,864][2409103] Decorrelating experience for 288 frames...
[2023-02-25 12:18:37,868][2409485] Initialized w:24 v:9 player:0
[2023-02-25 12:18:37,870][2409485] Decorrelating experience for 288 frames...
[2023-02-25 12:18:37,895][2409355] Initialized w:15 v:9 player:0
[2023-02-25 12:18:37,896][2409355] Decorrelating experience for 288 frames...
[2023-02-25 12:18:37,900][2409866] Initialized w:31 v:9 player:0
[2023-02-25 12:18:37,902][2409866] Decorrelating experience for 288 frames...
[2023-02-25 12:18:37,917][2409389] Using port 42010 on host...
[2023-02-25 12:18:37,973][2409075] Using port 40410 on host...
[2023-02-25 12:18:37,989][2409078] Initialized w:2 v:9 player:0
[2023-02-25 12:18:37,991][2409078] Decorrelating experience for 288 frames...
[2023-02-25 12:18:38,000][2409405] Initialized w:18 v:9 player:0
[2023-02-25 12:18:38,002][2409405] Decorrelating experience for 288 frames...
[2023-02-25 12:18:38,046][2409101] Using port 41310 on host...
[2023-02-25 12:18:38,087][2409596] Using port 43210 on host...
[2023-02-25 12:18:38,096][2409407] Using port 42310 on host...
[2023-02-25 12:18:38,120][2409079] Using port 40710 on host...
[2023-02-25 12:18:38,240][2409373] Using port 41910 on host...
[2023-02-25 12:18:38,262][2409080] Initialized w:5 v:9 player:0
[2023-02-25 12:18:38,263][2409080] Decorrelating experience for 288 frames...
[2023-02-25 12:18:38,263][2409076] Using port 40310 on host...
[2023-02-25 12:18:38,267][2409468] Initialized w:21 v:9 player:0
[2023-02-25 12:18:38,269][2409468] Decorrelating experience for 288 frames...
[2023-02-25 12:18:38,272][2409104] Using port 41610 on host...
[2023-02-25 12:18:38,305][2409406] Initialized w:19 v:10 player:0
[2023-02-25 12:18:38,307][2409406] Decorrelating experience for 320 frames...
[2023-02-25 12:18:38,367][2409547] Using port 42810 on host...
[2023-02-25 12:18:38,371][2409097] Using port 41210 on host...
[2023-02-25 12:18:38,431][2409549] Initialized w:26 v:10 player:0
[2023-02-25 12:18:38,432][2409549] Decorrelating experience for 320 frames...
[2023-02-25 12:18:38,469][2409099] Using port 41010 on host...
[2023-02-25 12:18:38,480][2409597] Using port 43310 on host...
[2023-02-25 12:18:38,488][2409105] Using port 41710 on host...
[2023-02-25 12:18:38,492][2409565] Using port 43110 on host...
[2023-02-25 12:18:38,570][2409077] Using port 40610 on host...
[2023-02-25 12:18:38,622][2409486] Using port 42610 on host...
[2023-02-25 12:18:38,630][2409102] Using port 41510 on host...
[2023-02-25 12:18:38,653][2409469] Using port 42510 on host...
[2023-02-25 12:18:38,667][2409389] Initialized w:17 v:10 player:0
[2023-02-25 12:18:38,668][2409389] Decorrelating experience for 320 frames...
[2023-02-25 12:18:38,680][2409075] Initialized w:1 v:10 player:0
[2023-02-25 12:18:38,682][2409075] Decorrelating experience for 320 frames...
[2023-02-25 12:18:38,687][2409096] Using port 40910 on host...
[2023-02-25 12:18:38,810][2409101] Initialized w:10 v:10 player:0
[2023-02-25 12:18:38,812][2409101] Decorrelating experience for 320 frames...
[2023-02-25 12:18:38,821][2409548] Using port 43010 on host...
[2023-02-25 12:18:38,844][2409100] Using port 41410 on host...
[2023-02-25 12:18:38,851][2409596] Initialized w:29 v:10 player:0
[2023-02-25 12:18:38,852][2409596] Decorrelating experience for 320 frames...
[2023-02-25 12:18:38,913][2409355] Using port 41810 on host...
[2023-02-25 12:18:38,917][2409407] Initialized w:20 v:10 player:0
[2023-02-25 12:18:38,919][2409407] Decorrelating experience for 320 frames...
[2023-02-25 12:18:38,945][2409373] Initialized w:16 v:10 player:0
[2023-02-25 12:18:38,946][2409373] Decorrelating experience for 320 frames...
[2023-02-25 12:18:38,946][2409866] Using port 43410 on host...
[2023-02-25 12:18:38,953][2409079] Initialized w:4 v:10 player:0
[2023-02-25 12:18:38,954][2409079] Decorrelating experience for 320 frames...
[2023-02-25 12:18:38,992][2409076] Initialized w:0 v:10 player:0
[2023-02-25 12:18:38,993][2409076] Decorrelating experience for 320 frames...
[2023-02-25 12:18:38,994][2409104] Initialized w:13 v:10 player:0
[2023-02-25 12:18:38,996][2409104] Decorrelating experience for 320 frames...
[2023-02-25 12:18:39,015][2409405] Using port 42110 on host...
[2023-02-25 12:18:39,030][2409078] Using port 40510 on host...
[2023-02-25 12:18:39,035][2409485] Using port 42710 on host...
[2023-02-25 12:18:39,083][2409097] Initialized w:9 v:10 player:0
[2023-02-25 12:18:39,084][2409103] Using port 41110 on host...
[2023-02-25 12:18:39,085][2409547] Initialized w:25 v:10 player:0
[2023-02-25 12:18:39,085][2409097] Decorrelating experience for 320 frames...
[2023-02-25 12:18:39,087][2409547] Decorrelating experience for 320 frames...
[2023-02-25 12:18:39,201][2408954] Heartbeat connected on Batcher_0
[2023-02-25 12:18:39,203][2408954] Heartbeat connected on LearnerWorker_p0
[2023-02-25 12:18:39,210][2409105] Initialized w:14 v:10 player:0
[2023-02-25 12:18:39,211][2409105] Decorrelating experience for 320 frames...
[2023-02-25 12:18:39,212][2409406] Using port 42211 on host...
[2023-02-25 12:18:39,223][2409597] Initialized w:30 v:10 player:0
[2023-02-25 12:18:39,225][2409597] Decorrelating experience for 320 frames...
[2023-02-25 12:18:39,252][2408954] Heartbeat connected on InferenceWorker_p0-w0
[2023-02-25 12:18:39,263][2409565] Initialized w:28 v:10 player:0
[2023-02-25 12:18:39,264][2409565] Decorrelating experience for 320 frames...
[2023-02-25 12:18:39,318][2409080] Using port 40810 on host...
[2023-02-25 12:18:39,330][2409099] Initialized w:7 v:10 player:0
[2023-02-25 12:18:39,331][2409099] Decorrelating experience for 320 frames...
[2023-02-25 12:18:39,332][2409468] Using port 42410 on host...
[2023-02-25 12:18:39,341][2409549] Using port 42911 on host...
[2023-02-25 12:18:39,363][2409102] Initialized w:12 v:10 player:0
[2023-02-25 12:18:39,364][2409102] Decorrelating experience for 320 frames...
[2023-02-25 12:18:39,431][2409486] Initialized w:23 v:10 player:0
[2023-02-25 12:18:39,434][2409486] Decorrelating experience for 320 frames...
[2023-02-25 12:18:39,450][2409469] Initialized w:22 v:10 player:0
[2023-02-25 12:18:39,451][2409469] Decorrelating experience for 320 frames...
[2023-02-25 12:18:39,476][2409096] Initialized w:6 v:10 player:0
[2023-02-25 12:18:39,478][2409096] Decorrelating experience for 320 frames...
[2023-02-25 12:18:39,491][2409077] Initialized w:3 v:10 player:0
[2023-02-25 12:18:39,492][2409077] Decorrelating experience for 320 frames...
[2023-02-25 12:18:39,559][2409548] Initialized w:27 v:10 player:0
[2023-02-25 12:18:39,560][2409548] Decorrelating experience for 320 frames...
[2023-02-25 12:18:39,572][2409100] Initialized w:11 v:10 player:0
[2023-02-25 12:18:39,573][2409100] Decorrelating experience for 320 frames...
[2023-02-25 12:18:39,659][2409355] Initialized w:15 v:10 player:0
[2023-02-25 12:18:39,660][2409355] Decorrelating experience for 320 frames...
[2023-02-25 12:18:39,675][2409866] Initialized w:31 v:10 player:0
[2023-02-25 12:18:39,676][2409866] Decorrelating experience for 320 frames...
[2023-02-25 12:18:39,733][2409405] Initialized w:18 v:10 player:0
[2023-02-25 12:18:39,735][2409405] Decorrelating experience for 320 frames...
[2023-02-25 12:18:39,746][2409485] Initialized w:24 v:10 player:0
[2023-02-25 12:18:39,748][2409485] Decorrelating experience for 320 frames...
[2023-02-25 12:18:39,781][2409101] Using port 41311 on host...
[2023-02-25 12:18:39,782][2409078] Initialized w:2 v:10 player:0
[2023-02-25 12:18:39,783][2409078] Decorrelating experience for 320 frames...
[2023-02-25 12:18:39,793][2409103] Initialized w:8 v:10 player:0
[2023-02-25 12:18:39,795][2409103] Decorrelating experience for 320 frames...
[2023-02-25 12:18:39,808][2409389] Using port 42011 on host...
[2023-02-25 12:18:39,816][2409075] Using port 40411 on host...
[2023-02-25 12:18:39,899][2409596] Using port 43211 on host...
[2023-02-25 12:18:40,031][2409407] Using port 42311 on host...
[2023-02-25 12:18:40,040][2409373] Using port 41911 on host...
[2023-02-25 12:18:40,049][2409406] Initialized w:19 v:11 player:0
[2023-02-25 12:18:40,051][2409406] Decorrelating experience for 352 frames...
[2023-02-25 12:18:40,064][2409079] Using port 40711 on host...
[2023-02-25 12:18:40,079][2409080] Initialized w:5 v:10 player:0
[2023-02-25 12:18:40,080][2409080] Decorrelating experience for 320 frames...
[2023-02-25 12:18:40,087][2409104] Using port 41611 on host...
[2023-02-25 12:18:40,106][2409468] Initialized w:21 v:10 player:0
[2023-02-25 12:18:40,108][2409468] Decorrelating experience for 320 frames...
[2023-02-25 12:18:40,116][2409076] Using port 40311 on host...
[2023-02-25 12:18:40,174][2409547] Using port 42811 on host...
[2023-02-25 12:18:40,182][2409097] Using port 41211 on host...
[2023-02-25 12:18:40,191][2409549] Initialized w:26 v:11 player:0
[2023-02-25 12:18:40,192][2409549] Decorrelating experience for 352 frames...
[2023-02-25 12:18:40,311][2409105] Using port 41711 on host...
[2023-02-25 12:18:40,318][2409565] Using port 43111 on host...
[2023-02-25 12:18:40,343][2409597] Using port 43311 on host...
[2023-02-25 12:18:40,398][2409077] Using port 40611 on host...
[2023-02-25 12:18:40,430][2409102] Using port 41511 on host...
[2023-02-25 12:18:40,455][2409099] Using port 41011 on host...
[2023-02-25 12:18:40,494][2409486] Using port 42611 on host...
[2023-02-25 12:18:40,531][2409389] Initialized w:17 v:11 player:0
[2023-02-25 12:18:40,531][2409101] Initialized w:10 v:11 player:0
[2023-02-25 12:18:40,532][2409389] Decorrelating experience for 352 frames...
[2023-02-25 12:18:40,532][2409101] Decorrelating experience for 352 frames...
[2023-02-25 12:18:40,547][2409075] Initialized w:1 v:11 player:0
[2023-02-25 12:18:40,548][2409075] Decorrelating experience for 352 frames...
[2023-02-25 12:18:40,561][2409469] Using port 42511 on host...
[2023-02-25 12:18:40,564][2409096] Using port 40911 on host...
[2023-02-25 12:18:40,647][2409100] Using port 41411 on host...
[2023-02-25 12:18:40,655][2409596] Initialized w:29 v:11 player:0
[2023-02-25 12:18:40,656][2409596] Decorrelating experience for 352 frames...
[2023-02-25 12:18:40,669][2409548] Using port 43011 on host...
[2023-02-25 12:18:40,757][2409407] Initialized w:20 v:11 player:0
[2023-02-25 12:18:40,758][2409407] Decorrelating experience for 352 frames...
[2023-02-25 12:18:40,760][2409866] Using port 43411 on host...
[2023-02-25 12:18:40,768][2409373] Initialized w:16 v:11 player:0
[2023-02-25 12:18:40,769][2409373] Decorrelating experience for 352 frames...
[2023-02-25 12:18:40,793][2409355] Using port 41811 on host...
[2023-02-25 12:18:40,817][2409104] Initialized w:13 v:11 player:0
[2023-02-25 12:18:40,818][2409104] Decorrelating experience for 352 frames...
[2023-02-25 12:18:40,819][2409079] Initialized w:4 v:11 player:0
[2023-02-25 12:18:40,821][2409079] Decorrelating experience for 352 frames...
[2023-02-25 12:18:40,841][2409076] Initialized w:0 v:11 player:0
[2023-02-25 12:18:40,842][2409076] Decorrelating experience for 352 frames...
[2023-02-25 12:18:40,863][2409405] Using port 42111 on host...
[2023-02-25 12:18:40,899][2409485] Using port 42711 on host...
[2023-02-25 12:18:40,902][2409103] Using port 41111 on host...
[2023-02-25 12:18:40,914][2409097] Initialized w:9 v:11 player:0
[2023-02-25 12:18:40,915][2409097] Decorrelating experience for 352 frames...
[2023-02-25 12:18:40,921][2409547] Initialized w:25 v:11 player:0
[2023-02-25 12:18:40,922][2409547] Decorrelating experience for 352 frames...
[2023-02-25 12:18:40,941][2409078] Using port 40511 on host...
[2023-02-25 12:18:41,021][2409406] Port 42212 is available
[2023-02-25 12:18:41,021][2409406] Using port 42212
[2023-02-25 12:18:41,037][2409406] Port 42213 is available
[2023-02-25 12:18:41,037][2409406] Using port 42213
[2023-02-25 12:18:41,049][2409105] Initialized w:14 v:11 player:0
[2023-02-25 12:18:41,051][2409105] Decorrelating experience for 352 frames...
[2023-02-25 12:18:41,058][2409406] Port 42214 is available
[2023-02-25 12:18:41,059][2409406] Using port 42214
[2023-02-25 12:18:41,075][2409406] Port 42215 is available
[2023-02-25 12:18:41,075][2409406] Using port 42215
[2023-02-25 12:18:41,078][2409565] Initialized w:28 v:11 player:0
[2023-02-25 12:18:41,080][2409565] Decorrelating experience for 352 frames...
[2023-02-25 12:18:41,090][2409406] Port 42216 is available
[2023-02-25 12:18:41,090][2409406] Using port 42216
[2023-02-25 12:18:41,090][2409597] Initialized w:30 v:11 player:0
[2023-02-25 12:18:41,092][2409597] Decorrelating experience for 352 frames...
[2023-02-25 12:18:41,104][2409406] Port 42217 is available
[2023-02-25 12:18:41,109][2409080] Using port 40811 on host...
[2023-02-25 12:18:41,111][2409406] Using port 42217
[2023-02-25 12:18:41,125][2409406] Port 42218 is available
[2023-02-25 12:18:41,125][2409406] Using port 42218
[2023-02-25 12:18:41,143][2409406] Port 42219 is available
[2023-02-25 12:18:41,145][2409406] Using port 42219
[2023-02-25 12:18:41,166][2409406] Port 42220 is available
[2023-02-25 12:18:41,170][2409406] Using port 42220
[2023-02-25 12:18:41,183][2409102] Initialized w:12 v:11 player:0
[2023-02-25 12:18:41,185][2409102] Decorrelating experience for 352 frames...
[2023-02-25 12:18:41,190][2409406] Port 42221 is available
[2023-02-25 12:18:41,191][2409406] Using port 42221
[2023-02-25 12:18:41,207][2409099] Initialized w:7 v:11 player:0
[2023-02-25 12:18:41,208][2409099] Decorrelating experience for 352 frames...
[2023-02-25 12:18:41,209][2409406] Port 42222 is available
[2023-02-25 12:18:41,209][2409406] Using port 42222
[2023-02-25 12:18:41,212][2409468] Using port 42411 on host...
[2023-02-25 12:18:41,228][2409406] Port 42223 is available
[2023-02-25 12:18:41,228][2409406] Using port 42223
[2023-02-25 12:18:41,230][2409406] Using port 42212 on host...
[2023-02-25 12:18:41,239][2409486] Initialized w:23 v:11 player:0
[2023-02-25 12:18:41,240][2409486] Decorrelating experience for 352 frames...
[2023-02-25 12:18:41,260][2409549] Port 42912 is available
[2023-02-25 12:18:41,261][2409549] Using port 42912
[2023-02-25 12:18:41,277][2409549] Port 42913 is available
[2023-02-25 12:18:41,282][2409549] Using port 42913
[2023-02-25 12:18:41,291][2409096] Initialized w:6 v:11 player:0
[2023-02-25 12:18:41,293][2409096] Decorrelating experience for 352 frames...
[2023-02-25 12:18:41,299][2409549] Port 42914 is available
[2023-02-25 12:18:41,300][2409469] Initialized w:22 v:11 player:0
[2023-02-25 12:18:41,303][2409549] Using port 42914
[2023-02-25 12:18:41,303][2409469] Decorrelating experience for 352 frames...
[2023-02-25 12:18:41,321][2409549] Port 42915 is available
[2023-02-25 12:18:41,324][2409549] Using port 42915
[2023-02-25 12:18:41,323][2409077] Initialized w:3 v:11 player:0
[2023-02-25 12:18:41,327][2409077] Decorrelating experience for 352 frames...
[2023-02-25 12:18:41,338][2409549] Port 42916 is available
[2023-02-25 12:18:41,345][2409549] Using port 42916
[2023-02-25 12:18:41,361][2409549] Port 42917 is available
[2023-02-25 12:18:41,367][2409549] Using port 42917
[2023-02-25 12:18:41,389][2409549] Port 42918 is available
[2023-02-25 12:18:41,397][2409549] Using port 42918
[2023-02-25 12:18:41,415][2409549] Port 42919 is available
[2023-02-25 12:18:41,421][2409549] Using port 42919
[2023-02-25 12:18:41,438][2409549] Port 42920 is available
[2023-02-25 12:18:41,447][2409549] Using port 42920
[2023-02-25 12:18:41,466][2409549] Port 42921 is available
[2023-02-25 12:18:41,469][2409549] Using port 42921
[2023-02-25 12:18:41,486][2409549] Port 42922 is available
[2023-02-25 12:18:41,495][2409549] Using port 42922
[2023-02-25 12:18:41,518][2409866] Initialized w:31 v:11 player:0
[2023-02-25 12:18:41,510][2409549] Port 42923 is available
[2023-02-25 12:18:41,519][2409549] Using port 42923
[2023-02-25 12:18:41,519][2409866] Decorrelating experience for 352 frames...
[2023-02-25 12:18:41,523][2409549] Using port 42912 on host...
[2023-02-25 12:18:41,524][2409355] Initialized w:15 v:11 player:0
[2023-02-25 12:18:41,527][2409355] Decorrelating experience for 352 frames...
[2023-02-25 12:18:41,586][2409100] Initialized w:11 v:11 player:0
[2023-02-25 12:18:41,587][2409100] Decorrelating experience for 352 frames...
[2023-02-25 12:18:41,612][2409405] Initialized w:18 v:11 player:0
[2023-02-25 12:18:41,614][2409405] Decorrelating experience for 352 frames...
[2023-02-25 12:18:41,630][2409101] Port 41312 is available
[2023-02-25 12:18:41,630][2409101] Using port 41312
[2023-02-25 12:18:41,648][2409101] Port 41313 is available
[2023-02-25 12:18:41,653][2409101] Using port 41313
[2023-02-25 12:18:41,655][2409548] Initialized w:27 v:11 player:0
[2023-02-25 12:18:41,656][2409548] Decorrelating experience for 352 frames...
[2023-02-25 12:18:41,671][2409101] Port 41314 is available
[2023-02-25 12:18:41,672][2409101] Using port 41314
[2023-02-25 12:18:41,685][2409078] Initialized w:2 v:11 player:0
[2023-02-25 12:18:41,686][2409078] Decorrelating experience for 352 frames...
[2023-02-25 12:18:41,688][2409101] Port 41315 is available
[2023-02-25 12:18:41,694][2409101] Using port 41315
[2023-02-25 12:18:41,708][2409101] Port 41316 is available
[2023-02-25 12:18:41,714][2409101] Using port 41316
[2023-02-25 12:18:41,724][2409101] Port 41317 is available
[2023-02-25 12:18:41,730][2409101] Using port 41317
[2023-02-25 12:18:41,749][2409101] Port 41318 is available
[2023-02-25 12:18:41,755][2409101] Using port 41318
[2023-02-25 12:18:41,768][2409101] Port 41319 is available
[2023-02-25 12:18:41,775][2409101] Using port 41319
[2023-02-25 12:18:41,789][2409101] Port 41320 is available
[2023-02-25 12:18:41,795][2409101] Using port 41320
[2023-02-25 12:18:41,804][2409485] Initialized w:24 v:11 player:0
[2023-02-25 12:18:41,806][2409485] Decorrelating experience for 352 frames...
[2023-02-25 12:18:41,808][2409103] Initialized w:8 v:11 player:0
[2023-02-25 12:18:41,810][2409103] Decorrelating experience for 352 frames...
[2023-02-25 12:18:41,814][2409101] Port 41321 is available
[2023-02-25 12:18:41,815][2409101] Using port 41321
[2023-02-25 12:18:41,836][2409101] Port 41322 is available
[2023-02-25 12:18:41,836][2409101] Using port 41322
[2023-02-25 12:18:41,850][2409101] Port 41323 is available
[2023-02-25 12:18:41,858][2409389] Port 42012 is available
[2023-02-25 12:18:41,855][2409080] Initialized w:5 v:11 player:0
[2023-02-25 12:18:41,856][2409596] Port 43212 is available
[2023-02-25 12:18:41,859][2409101] Using port 41323
[2023-02-25 12:18:41,863][2409596] Using port 43212
[2023-02-25 12:18:41,863][2409389] Using port 42012
[2023-02-25 12:18:41,864][2409080] Decorrelating experience for 352 frames...
[2023-02-25 12:18:41,865][2409101] Using port 41312 on host...
[2023-02-25 12:18:41,885][2409596] Port 43213 is available
[2023-02-25 12:18:41,885][2409596] Using port 43213
[2023-02-25 12:18:41,889][2409389] Port 42013 is available
[2023-02-25 12:18:41,892][2409389] Using port 42013
[2023-02-25 12:18:41,920][2409389] Port 42014 is available
[2023-02-25 12:18:41,921][2409389] Using port 42014
[2023-02-25 12:18:41,921][2409596] Port 43214 is available
[2023-02-25 12:18:41,922][2409596] Using port 43214
[2023-02-25 12:18:41,936][2409075] Port 40412 is available
[2023-02-25 12:18:41,936][2409075] Using port 40412
[2023-02-25 12:18:41,943][2409389] Port 42015 is available
[2023-02-25 12:18:41,943][2409389] Using port 42015
[2023-02-25 12:18:41,948][2409468] Initialized w:21 v:11 player:0
[2023-02-25 12:18:41,949][2409468] Decorrelating experience for 352 frames...
[2023-02-25 12:18:41,954][2409596] Port 43215 is available
[2023-02-25 12:18:41,956][2409075] Port 40413 is available
[2023-02-25 12:18:41,959][2409075] Using port 40413
[2023-02-25 12:18:41,954][2409596] Using port 43215
[2023-02-25 12:18:41,958][2409389] Port 42016 is available
[2023-02-25 12:18:41,967][2409389] Using port 42016
[2023-02-25 12:18:41,980][2409389] Port 42017 is available
[2023-02-25 12:18:41,982][2409389] Using port 42017
[2023-02-25 12:18:41,982][2409075] Port 40414 is available
[2023-02-25 12:18:41,987][2409075] Using port 40414
[2023-02-25 12:18:41,987][2409596] Port 43216 is available
[2023-02-25 12:18:41,989][2409596] Using port 43216
[2023-02-25 12:18:42,003][2409075] Port 40415 is available
[2023-02-25 12:18:42,005][2409075] Using port 40415
[2023-02-25 12:18:42,004][2409389] Port 42018 is available
[2023-02-25 12:18:42,011][2409389] Using port 42018
[2023-02-25 12:18:42,018][2409596] Port 43217 is available
[2023-02-25 12:18:42,023][2409596] Using port 43217
[2023-02-25 12:18:42,026][2409075] Port 40416 is available
[2023-02-25 12:18:42,029][2409075] Using port 40416
[2023-02-25 12:18:42,028][2409389] Port 42019 is available
[2023-02-25 12:18:42,032][2409389] Using port 42019
[2023-02-25 12:18:42,043][2409407] Port 42312 is available
[2023-02-25 12:18:42,043][2409407] Using port 42312
[2023-02-25 12:18:42,048][2409075] Port 40417 is available
[2023-02-25 12:18:42,054][2409075] Using port 40417
[2023-02-25 12:18:42,057][2409596] Port 43218 is available
[2023-02-25 12:18:42,057][2409389] Port 42020 is available
[2023-02-25 12:18:42,057][2409389] Using port 42020
[2023-02-25 12:18:42,062][2409596] Using port 43218
[2023-02-25 12:18:42,072][2409407] Port 42313 is available
[2023-02-25 12:18:42,072][2409407] Using port 42313
[2023-02-25 12:18:42,076][2409075] Port 40418 is available
[2023-02-25 12:18:42,077][2409104] Port 41612 is available
[2023-02-25 12:18:42,083][2409075] Using port 40418
[2023-02-25 12:18:42,083][2409104] Using port 41612
[2023-02-25 12:18:42,085][2409079] Port 40712 is available
[2023-02-25 12:18:42,085][2409079] Using port 40712
[2023-02-25 12:18:42,087][2409596] Port 43219 is available
[2023-02-25 12:18:42,087][2409596] Using port 43219
[2023-02-25 12:18:42,088][2409389] Port 42021 is available
[2023-02-25 12:18:42,088][2409389] Using port 42021
[2023-02-25 12:18:42,093][2409407] Port 42314 is available
[2023-02-25 12:18:42,093][2409407] Using port 42314
[2023-02-25 12:18:42,099][2409406] Initialized w:19 v:12 player:0
[2023-02-25 12:18:42,101][2409406] Decorrelating experience for 384 frames...
[2023-02-25 12:18:42,099][2409373] Port 41912 is available
[2023-02-25 12:18:42,106][2409373] Using port 41912
[2023-02-25 12:18:42,112][2409104] Port 41613 is available
[2023-02-25 12:18:42,109][2409075] Port 40419 is available
[2023-02-25 12:18:42,113][2409104] Using port 41613
[2023-02-25 12:18:42,113][2409075] Using port 40419
[2023-02-25 12:18:42,115][2409079] Port 40713 is available
[2023-02-25 12:18:42,116][2409079] Using port 40713
[2023-02-25 12:18:42,117][2409389] Port 42022 is available
[2023-02-25 12:18:42,117][2409389] Using port 42022
[2023-02-25 12:18:42,118][2409596] Port 43220 is available
[2023-02-25 12:18:42,122][2409596] Using port 43220
[2023-02-25 12:18:42,123][2409407] Port 42315 is available
[2023-02-25 12:18:42,124][2409407] Using port 42315
[2023-02-25 12:18:42,144][2409596] Port 43221 is available
[2023-02-25 12:18:42,139][2409075] Port 40420 is available
[2023-02-25 12:18:42,144][2409075] Using port 40420
[2023-02-25 12:18:42,145][2409104] Port 41614 is available
[2023-02-25 12:18:42,146][2409079] Port 40714 is available
[2023-02-25 12:18:42,146][2409104] Using port 41614
[2023-02-25 12:18:42,146][2409079] Using port 40714
[2023-02-25 12:18:42,147][2409373] Port 41913 is available
[2023-02-25 12:18:42,148][2409389] Port 42023 is available
[2023-02-25 12:18:42,148][2409373] Using port 41913
[2023-02-25 12:18:42,149][2409389] Using port 42023
[2023-02-25 12:18:42,149][2409596] Using port 43221
[2023-02-25 12:18:42,153][2409407] Port 42316 is available
[2023-02-25 12:18:42,153][2409407] Using port 42316
[2023-02-25 12:18:42,151][2409389] Using port 42012 on host...
[2023-02-25 12:18:42,169][2409075] Port 40421 is available
[2023-02-25 12:18:42,170][2409075] Using port 40421
[2023-02-25 12:18:42,169][2409079] Port 40715 is available
[2023-02-25 12:18:42,173][2409104] Port 41615 is available
[2023-02-25 12:18:42,176][2409079] Using port 40715
[2023-02-25 12:18:42,176][2409104] Using port 41615
[2023-02-25 12:18:42,175][2409407] Port 42317 is available
[2023-02-25 12:18:42,175][2409596] Port 43222 is available
[2023-02-25 12:18:42,179][2409596] Using port 43222
[2023-02-25 12:18:42,179][2409407] Using port 42317
[2023-02-25 12:18:42,181][2409373] Port 41914 is available
[2023-02-25 12:18:42,181][2409373] Using port 41914
[2023-02-25 12:18:42,186][2408954] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0)
[2023-02-25 12:18:42,192][2409075] Port 40422 is available
[2023-02-25 12:18:42,193][2409075] Using port 40422
[2023-02-25 12:18:42,201][2409079] Port 40716 is available
[2023-02-25 12:18:42,202][2409076] Port 40312 is available
[2023-02-25 12:18:42,202][2409076] Using port 40312
[2023-02-25 12:18:42,207][2409596] Port 43223 is available
[2023-02-25 12:18:42,208][2409596] Using port 43223
[2023-02-25 12:18:42,208][2409104] Port 41616 is available
[2023-02-25 12:18:42,208][2409079] Using port 40716
[2023-02-25 12:18:42,211][2409373] Port 41915 is available
[2023-02-25 12:18:42,210][2409104] Using port 41616
[2023-02-25 12:18:42,212][2409596] Using port 43212 on host...
[2023-02-25 12:18:42,215][2409373] Using port 41915
[2023-02-25 12:18:42,217][2409407] Port 42318 is available
[2023-02-25 12:18:42,218][2409407] Using port 42318
[2023-02-25 12:18:42,223][2409075] Port 40423 is available
[2023-02-25 12:18:42,230][2409075] Using port 40423
[2023-02-25 12:18:42,230][2409104] Port 41617 is available
[2023-02-25 12:18:42,229][2409076] Port 40313 is available
[2023-02-25 12:18:42,233][2409075] Using port 40412 on host...
[2023-02-25 12:18:42,233][2409076] Using port 40313
[2023-02-25 12:18:42,237][2409373] Port 41916 is available
[2023-02-25 12:18:42,233][2409104] Using port 41617
[2023-02-25 12:18:42,240][2409079] Port 40717 is available
[2023-02-25 12:18:42,243][2409373] Using port 41916
[2023-02-25 12:18:42,243][2409079] Using port 40717
[2023-02-25 12:18:42,248][2409407] Port 42319 is available
[2023-02-25 12:18:42,249][2409407] Using port 42319
[2023-02-25 12:18:42,259][2409076] Port 40314 is available
[2023-02-25 12:18:42,259][2409076] Using port 40314
[2023-02-25 12:18:42,266][2409079] Port 40718 is available
[2023-02-25 12:18:42,274][2409079] Using port 40718
[2023-02-25 12:18:42,270][2409373] Port 41917 is available
[2023-02-25 12:18:42,274][2409373] Using port 41917
[2023-02-25 12:18:42,275][2409104] Port 41618 is available
[2023-02-25 12:18:42,275][2409104] Using port 41618
[2023-02-25 12:18:42,273][2409407] Port 42320 is available
[2023-02-25 12:18:42,282][2409407] Using port 42320
[2023-02-25 12:18:42,283][2409076] Port 40315 is available
[2023-02-25 12:18:42,284][2409076] Using port 40315
[2023-02-25 12:18:42,294][2409549] Initialized w:26 v:12 player:0
[2023-02-25 12:18:42,296][2409549] Decorrelating experience for 384 frames...
[2023-02-25 12:18:42,297][2409373] Port 41918 is available
[2023-02-25 12:18:42,298][2409079] Port 40719 is available
[2023-02-25 12:18:42,299][2409079] Using port 40719
[2023-02-25 12:18:42,299][2409373] Using port 41918
[2023-02-25 12:18:42,308][2409104] Port 41619 is available
[2023-02-25 12:18:42,308][2409104] Using port 41619
[2023-02-25 12:18:42,309][2409076] Port 40316 is available
[2023-02-25 12:18:42,309][2409076] Using port 40316
[2023-02-25 12:18:42,306][2409407] Port 42321 is available
[2023-02-25 12:18:42,315][2409407] Using port 42321
[2023-02-25 12:18:42,319][2409373] Port 41919 is available
[2023-02-25 12:18:42,326][2409373] Using port 41919
[2023-02-25 12:18:42,330][2409079] Port 40720 is available
[2023-02-25 12:18:42,330][2409079] Using port 40720
[2023-02-25 12:18:42,332][2409104] Port 41620 is available
[2023-02-25 12:18:42,339][2409104] Using port 41620
[2023-02-25 12:18:42,339][2409373] Port 41920 is available
[2023-02-25 12:18:42,334][2409407] Port 42322 is available
[2023-02-25 12:18:42,335][2409076] Port 40317 is available
[2023-02-25 12:18:42,340][2409407] Using port 42322
[2023-02-25 12:18:42,340][2409076] Using port 40317
[2023-02-25 12:18:42,339][2409373] Using port 41920
[2023-02-25 12:18:42,354][2409079] Port 40721 is available
[2023-02-25 12:18:42,355][2409079] Using port 40721
[2023-02-25 12:18:42,361][2409373] Port 41921 is available
[2023-02-25 12:18:42,364][2409104] Port 41621 is available
[2023-02-25 12:18:42,364][2409076] Port 40318 is available
[2023-02-25 12:18:42,365][2409104] Using port 41621
[2023-02-25 12:18:42,365][2409076] Using port 40318
[2023-02-25 12:18:42,365][2409373] Using port 41921
[2023-02-25 12:18:42,368][2409407] Port 42323 is available
[2023-02-25 12:18:42,369][2409407] Using port 42323
[2023-02-25 12:18:42,376][2409407] Using port 42312 on host...
[2023-02-25 12:18:42,380][2409079] Port 40722 is available
[2023-02-25 12:18:42,380][2409079] Using port 40722
[2023-02-25 12:18:42,389][2409076] Port 40319 is available
[2023-02-25 12:18:42,390][2409076] Using port 40319
[2023-02-25 12:18:42,390][2409104] Port 41622 is available
[2023-02-25 12:18:42,390][2409104] Using port 41622
[2023-02-25 12:18:42,395][2409373] Port 41922 is available
[2023-02-25 12:18:42,395][2409373] Using port 41922
[2023-02-25 12:18:42,398][2409079] Port 40723 is available
[2023-02-25 12:18:42,399][2409079] Using port 40723
[2023-02-25 12:18:42,408][2409079] Using port 40712 on host...
[2023-02-25 12:18:42,412][2409373] Port 41923 is available
[2023-02-25 12:18:42,416][2409373] Using port 41923
[2023-02-25 12:18:42,418][2409373] Using port 41912 on host...
[2023-02-25 12:18:42,413][2409104] Port 41623 is available
[2023-02-25 12:18:42,415][2409077] Port 40612 is available
[2023-02-25 12:18:42,415][2409076] Port 40320 is available
[2023-02-25 12:18:42,419][2409076] Using port 40320
[2023-02-25 12:18:42,419][2409104] Using port 41623
[2023-02-25 12:18:42,419][2409077] Using port 40612
[2023-02-25 12:18:42,421][2409104] Using port 41612 on host...
[2023-02-25 12:18:42,434][2409076] Port 40321 is available
[2023-02-25 12:18:42,436][2409076] Using port 40321
[2023-02-25 12:18:42,441][2409105] Port 41712 is available
[2023-02-25 12:18:42,442][2409105] Using port 41712
[2023-02-25 12:18:42,451][2409077] Port 40613 is available
[2023-02-25 12:18:42,453][2409077] Using port 40613
[2023-02-25 12:18:42,459][2409597] Port 43312 is available
[2023-02-25 12:18:42,459][2409597] Using port 43312
[2023-02-25 12:18:42,463][2409076] Port 40322 is available
[2023-02-25 12:18:42,463][2409076] Using port 40322
[2023-02-25 12:18:42,465][2409105] Port 41713 is available
[2023-02-25 12:18:42,470][2409105] Using port 41713
[2023-02-25 12:18:42,471][2409547] Port 42812 is available
[2023-02-25 12:18:42,471][2409547] Using port 42812
[2023-02-25 12:18:42,466][2409097] Port 41212 is available
[2023-02-25 12:18:42,474][2409097] Using port 41212
[2023-02-25 12:18:42,481][2409077] Port 40614 is available
[2023-02-25 12:18:42,482][2409597] Port 43313 is available
[2023-02-25 12:18:42,482][2409597] Using port 43313
[2023-02-25 12:18:42,490][2409077] Using port 40614
[2023-02-25 12:18:42,490][2409547] Port 42813 is available
[2023-02-25 12:18:42,492][2409076] Port 40323 is available
[2023-02-25 12:18:42,493][2409076] Using port 40323
[2023-02-25 12:18:42,494][2409097] Port 41213 is available
[2023-02-25 12:18:42,494][2409097] Using port 41213
[2023-02-25 12:18:42,494][2409105] Port 41714 is available
[2023-02-25 12:18:42,494][2409105] Using port 41714
[2023-02-25 12:18:42,498][2409076] Using port 40312 on host...
[2023-02-25 12:18:42,490][2409547] Using port 42813
[2023-02-25 12:18:42,503][2409597] Port 43314 is available
[2023-02-25 12:18:42,504][2409597] Using port 43314
[2023-02-25 12:18:42,512][2409097] Port 41214 is available
[2023-02-25 12:18:42,513][2409097] Using port 41214
[2023-02-25 12:18:42,514][2409105] Port 41715 is available
[2023-02-25 12:18:42,522][2409105] Using port 41715
[2023-02-25 12:18:42,522][2409547] Port 42814 is available
[2023-02-25 12:18:42,520][2409077] Port 40615 is available
[2023-02-25 12:18:42,527][2409547] Using port 42814
[2023-02-25 12:18:42,527][2409077] Using port 40615
[2023-02-25 12:18:42,531][2409597] Port 43315 is available
[2023-02-25 12:18:42,531][2409597] Using port 43315
[2023-02-25 12:18:42,533][2409097] Port 41215 is available
[2023-02-25 12:18:42,536][2409097] Using port 41215
[2023-02-25 12:18:42,541][2409565] Port 43112 is available
[2023-02-25 12:18:42,542][2409565] Using port 43112
[2023-02-25 12:18:42,542][2409105] Port 41716 is available
[2023-02-25 12:18:42,542][2409105] Using port 41716
[2023-02-25 12:18:42,550][2409597] Port 43316 is available
[2023-02-25 12:18:42,550][2409597] Using port 43316
[2023-02-25 12:18:42,546][2409547] Port 42815 is available
[2023-02-25 12:18:42,550][2409547] Using port 42815
[2023-02-25 12:18:42,556][2409097] Port 41216 is available
[2023-02-25 12:18:42,559][2409097] Using port 41216
[2023-02-25 12:18:42,561][2409105] Port 41717 is available
[2023-02-25 12:18:42,561][2409105] Using port 41717
[2023-02-25 12:18:42,556][2409077] Port 40616 is available
[2023-02-25 12:18:42,562][2409077] Using port 40616
[2023-02-25 12:18:42,569][2409597] Port 43317 is available
[2023-02-25 12:18:42,570][2409597] Using port 43317
[2023-02-25 12:18:42,573][2409547] Port 42816 is available
[2023-02-25 12:18:42,579][2409547] Using port 42816
[2023-02-25 12:18:42,580][2409565] Port 43113 is available
[2023-02-25 12:18:42,585][2409097] Port 41217 is available
[2023-02-25 12:18:42,585][2409097] Using port 41217
[2023-02-25 12:18:42,580][2409565] Using port 43113
[2023-02-25 12:18:42,590][2409105] Port 41718 is available
[2023-02-25 12:18:42,590][2409105] Using port 41718
[2023-02-25 12:18:42,594][2409077] Port 40617 is available
[2023-02-25 12:18:42,596][2409077] Using port 40617
[2023-02-25 12:18:42,596][2409597] Port 43318 is available
[2023-02-25 12:18:42,597][2409597] Using port 43318
[2023-02-25 12:18:42,599][2409547] Port 42817 is available
[2023-02-25 12:18:42,602][2409547] Using port 42817
[2023-02-25 12:18:42,607][2409097] Port 41218 is available
[2023-02-25 12:18:42,610][2409105] Port 41719 is available
[2023-02-25 12:18:42,611][2409097] Using port 41218
[2023-02-25 12:18:42,614][2409105] Using port 41719
[2023-02-25 12:18:42,618][2409565] Port 43114 is available
[2023-02-25 12:18:42,620][2409597] Port 43319 is available
[2023-02-25 12:18:42,621][2409565] Using port 43114
[2023-02-25 12:18:42,626][2409597] Using port 43319
[2023-02-25 12:18:42,625][2409077] Port 40618 is available
[2023-02-25 12:18:42,625][2409547] Port 42818 is available
[2023-02-25 12:18:42,627][2409077] Using port 40618
[2023-02-25 12:18:42,627][2409547] Using port 42818
[2023-02-25 12:18:42,635][2409105] Port 41720 is available
[2023-02-25 12:18:42,633][2409097] Port 41219 is available
[2023-02-25 12:18:42,637][2409097] Using port 41219
[2023-02-25 12:18:42,635][2409105] Using port 41720
[2023-02-25 12:18:42,644][2409597] Port 43320 is available
[2023-02-25 12:18:42,650][2409597] Using port 43320
[2023-02-25 12:18:42,646][2409565] Port 43115 is available
[2023-02-25 12:18:42,654][2409565] Using port 43115
[2023-02-25 12:18:42,655][2409547] Port 42819 is available
[2023-02-25 12:18:42,659][2409547] Using port 42819
[2023-02-25 12:18:42,661][2409105] Port 41721 is available
[2023-02-25 12:18:42,661][2409077] Port 40619 is available
[2023-02-25 12:18:42,661][2409077] Using port 40619
[2023-02-25 12:18:42,661][2409101] Initialized w:10 v:12 player:0
[2023-02-25 12:18:42,662][2409101] Decorrelating experience for 384 frames...
[2023-02-25 12:18:42,664][2409105] Using port 41721
[2023-02-25 12:18:42,658][2409097] Port 41220 is available
[2023-02-25 12:18:42,664][2409097] Using port 41220
[2023-02-25 12:18:42,664][2409597] Port 43321 is available
[2023-02-25 12:18:42,671][2409597] Using port 43321
[2023-02-25 12:18:42,682][2409565] Port 43116 is available
[2023-02-25 12:18:42,682][2409565] Using port 43116
[2023-02-25 12:18:42,683][2409547] Port 42820 is available
[2023-02-25 12:18:42,686][2409547] Using port 42820
[2023-02-25 12:18:42,688][2409105] Port 41722 is available
[2023-02-25 12:18:42,689][2409105] Using port 41722
[2023-02-25 12:18:42,691][2409077] Port 40620 is available
[2023-02-25 12:18:42,692][2409077] Using port 40620
[2023-02-25 12:18:42,686][2409597] Port 43322 is available
[2023-02-25 12:18:42,686][2409097] Port 41221 is available
[2023-02-25 12:18:42,692][2409597] Using port 43322
[2023-02-25 12:18:42,692][2409097] Using port 41221
[2023-02-25 12:18:42,711][2409547] Port 42821 is available
[2023-02-25 12:18:42,717][2409102] Port 41512 is available
[2023-02-25 12:18:42,718][2409102] Using port 41512
[2023-02-25 12:18:42,712][2409547] Using port 42821
[2023-02-25 12:18:42,714][2409105] Port 41723 is available
[2023-02-25 12:18:42,718][2409077] Port 40621 is available
[2023-02-25 12:18:42,714][2409565] Port 43117 is available
[2023-02-25 12:18:42,712][2409597] Port 43323 is available
[2023-02-25 12:18:42,723][2409077] Using port 40621
[2023-02-25 12:18:42,717][2409097] Port 41222 is available
[2023-02-25 12:18:42,723][2409565] Using port 43117
[2023-02-25 12:18:42,723][2409597] Using port 43323
[2023-02-25 12:18:42,718][2409105] Using port 41723
[2023-02-25 12:18:42,723][2409097] Using port 41222
[2023-02-25 12:18:42,733][2409099] Port 41012 is available
[2023-02-25 12:18:42,727][2409597] Using port 43312 on host...
[2023-02-25 12:18:42,742][2409099] Using port 41012
[2023-02-25 12:18:42,736][2409547] Port 42822 is available
[2023-02-25 12:18:42,733][2409105] Using port 41712 on host...
[2023-02-25 12:18:42,737][2409102] Port 41513 is available
[2023-02-25 12:18:42,743][2409547] Using port 42822
[2023-02-25 12:18:42,743][2409102] Using port 41513
[2023-02-25 12:18:42,741][2409565] Port 43118 is available
[2023-02-25 12:18:42,747][2409565] Using port 43118
[2023-02-25 12:18:42,751][2409097] Port 41223 is available
[2023-02-25 12:18:42,751][2409097] Using port 41223
[2023-02-25 12:18:42,751][2409077] Port 40622 is available
[2023-02-25 12:18:42,755][2409077] Using port 40622
[2023-02-25 12:18:42,754][2409097] Using port 41212 on host...
[2023-02-25 12:18:42,767][2409565] Port 43119 is available
[2023-02-25 12:18:42,767][2409565] Using port 43119
[2023-02-25 12:18:42,765][2409547] Port 42823 is available
[2023-02-25 12:18:42,769][2409099] Port 41013 is available
[2023-02-25 12:18:42,770][2409547] Using port 42823
[2023-02-25 12:18:42,770][2409102] Port 41514 is available
[2023-02-25 12:18:42,775][2409102] Using port 41514
[2023-02-25 12:18:42,775][2409099] Using port 41013
[2023-02-25 12:18:42,777][2409547] Using port 42812 on host...
[2023-02-25 12:18:42,777][2409077] Port 40623 is available
[2023-02-25 12:18:42,777][2409077] Using port 40623
[2023-02-25 12:18:42,783][2409565] Port 43120 is available
[2023-02-25 12:18:42,790][2409077] Using port 40612 on host...
[2023-02-25 12:18:42,790][2409565] Using port 43120
[2023-02-25 12:18:42,798][2409099] Port 41014 is available
[2023-02-25 12:18:42,799][2409102] Port 41515 is available
[2023-02-25 12:18:42,806][2409102] Using port 41515
[2023-02-25 12:18:42,802][2409565] Port 43121 is available
[2023-02-25 12:18:42,807][2409099] Using port 41014
[2023-02-25 12:18:42,811][2409565] Using port 43121
[2023-02-25 12:18:42,829][2409102] Port 41516 is available
[2023-02-25 12:18:42,831][2409102] Using port 41516
[2023-02-25 12:18:42,830][2409099] Port 41015 is available
[2023-02-25 12:18:42,833][2409099] Using port 41015
[2023-02-25 12:18:42,833][2409565] Port 43122 is available
[2023-02-25 12:18:42,833][2409486] Port 42612 is available
[2023-02-25 12:18:42,839][2409486] Using port 42612
[2023-02-25 12:18:42,838][2409565] Using port 43122
[2023-02-25 12:18:42,852][2409099] Port 41016 is available
[2023-02-25 12:18:42,856][2409099] Using port 41016
[2023-02-25 12:18:42,857][2409102] Port 41517 is available
[2023-02-25 12:18:42,855][2409486] Port 42613 is available
[2023-02-25 12:18:42,859][2409486] Using port 42613
[2023-02-25 12:18:42,858][2409102] Using port 41517
[2023-02-25 12:18:42,862][2409565] Port 43123 is available
[2023-02-25 12:18:42,865][2409565] Using port 43123
[2023-02-25 12:18:42,869][2409565] Using port 43112 on host...
[2023-02-25 12:18:42,872][2409099] Port 41017 is available
[2023-02-25 12:18:42,876][2409099] Using port 41017
[2023-02-25 12:18:42,878][2409102] Port 41518 is available
[2023-02-25 12:18:42,876][2409486] Port 42614 is available
[2023-02-25 12:18:42,879][2409102] Using port 41518
[2023-02-25 12:18:42,879][2409486] Using port 42614
[2023-02-25 12:18:42,879][2409096] Port 40912 is available
[2023-02-25 12:18:42,884][2409096] Using port 40912
[2023-02-25 12:18:42,892][2409099] Port 41018 is available
[2023-02-25 12:18:42,898][2409099] Using port 41018
[2023-02-25 12:18:42,899][2409102] Port 41519 is available
[2023-02-25 12:18:42,897][2409486] Port 42615 is available
[2023-02-25 12:18:42,900][2409486] Using port 42615
[2023-02-25 12:18:42,901][2409102] Using port 41519
[2023-02-25 12:18:42,915][2409096] Port 40913 is available
[2023-02-25 12:18:42,913][2409099] Port 41019 is available
[2023-02-25 12:18:42,918][2409099] Using port 41019
[2023-02-25 12:18:42,918][2409096] Using port 40913
[2023-02-25 12:18:42,918][2409486] Port 42616 is available
[2023-02-25 12:18:42,914][2409469] Port 42512 is available
[2023-02-25 12:18:42,923][2409486] Using port 42616
[2023-02-25 12:18:42,923][2409469] Using port 42512
[2023-02-25 12:18:42,926][2409102] Port 41520 is available
[2023-02-25 12:18:42,926][2409102] Using port 41520
[2023-02-25 12:18:42,938][2409099] Port 41020 is available
[2023-02-25 12:18:42,939][2409099] Using port 41020
[2023-02-25 12:18:42,944][2409389] Initialized w:17 v:12 player:0
[2023-02-25 12:18:42,945][2409389] Decorrelating experience for 384 frames...
[2023-02-25 12:18:42,946][2409486] Port 42617 is available
[2023-02-25 12:18:42,947][2409486] Using port 42617
[2023-02-25 12:18:42,950][2409096] Port 40914 is available
[2023-02-25 12:18:42,952][2409096] Using port 40914
[2023-02-25 12:18:42,951][2409469] Port 42513 is available
[2023-02-25 12:18:42,954][2409469] Using port 42513
[2023-02-25 12:18:42,956][2409099] Port 41021 is available
[2023-02-25 12:18:42,961][2409099] Using port 41021
[2023-02-25 12:18:42,960][2409102] Port 41521 is available
[2023-02-25 12:18:42,962][2409102] Using port 41521
[2023-02-25 12:18:42,961][2409486] Port 42618 is available
[2023-02-25 12:18:42,967][2409486] Using port 42618
[2023-02-25 12:18:42,972][2409096] Port 40915 is available
[2023-02-25 12:18:42,977][2409469] Port 42514 is available
[2023-02-25 12:18:42,978][2409096] Using port 40915
[2023-02-25 12:18:42,980][2409469] Using port 42514
[2023-02-25 12:18:42,981][2409099] Port 41022 is available
[2023-02-25 12:18:42,985][2409099] Using port 41022
[2023-02-25 12:18:42,984][2409486] Port 42619 is available
[2023-02-25 12:18:42,991][2409486] Using port 42619
[2023-02-25 12:18:42,993][2409102] Port 41522 is available
[2023-02-25 12:18:42,994][2409102] Using port 41522
[2023-02-25 12:18:42,999][2409469] Port 42515 is available
[2023-02-25 12:18:42,999][2409469] Using port 42515
[2023-02-25 12:18:43,002][2409096] Port 40916 is available
[2023-02-25 12:18:43,003][2409096] Using port 40916
[2023-02-25 12:18:43,004][2409099] Port 41023 is available
[2023-02-25 12:18:43,004][2409596] Initialized w:29 v:12 player:0
[2023-02-25 12:18:43,004][2409099] Using port 41023
[2023-02-25 12:18:43,005][2409596] Decorrelating experience for 384 frames...
[2023-02-25 12:18:43,007][2409099] Using port 41012 on host...
[2023-02-25 12:18:43,010][2409486] Port 42620 is available
[2023-02-25 12:18:43,011][2409486] Using port 42620
[2023-02-25 12:18:43,019][2409075] Initialized w:1 v:12 player:0
[2023-02-25 12:18:43,021][2409075] Decorrelating experience for 384 frames...
[2023-02-25 12:18:43,023][2409102] Port 41523 is available
[2023-02-25 12:18:43,025][2409102] Using port 41523
[2023-02-25 12:18:43,026][2409469] Port 42516 is available
[2023-02-25 12:18:43,026][2409469] Using port 42516
[2023-02-25 12:18:43,030][2409096] Port 40917 is available
[2023-02-25 12:18:43,030][2409102] Using port 41512 on host...
[2023-02-25 12:18:43,030][2409096] Using port 40917
[2023-02-25 12:18:43,035][2409486] Port 42621 is available
[2023-02-25 12:18:43,035][2409486] Using port 42621
[2023-02-25 12:18:43,049][2409469] Port 42517 is available
[2023-02-25 12:18:43,050][2409469] Using port 42517
[2023-02-25 12:18:43,049][2409096] Port 40918 is available
[2023-02-25 12:18:43,052][2409096] Using port 40918
[2023-02-25 12:18:43,060][2409486] Port 42622 is available
[2023-02-25 12:18:43,060][2409486] Using port 42622
[2023-02-25 12:18:43,071][2409469] Port 42518 is available
[2023-02-25 12:18:43,071][2409469] Using port 42518
[2023-02-25 12:18:43,070][2409096] Port 40919 is available
[2023-02-25 12:18:43,073][2409096] Using port 40919
[2023-02-25 12:18:43,085][2409486] Port 42623 is available
[2023-02-25 12:18:43,091][2409486] Using port 42623
[2023-02-25 12:18:43,091][2409096] Port 40920 is available
[2023-02-25 12:18:43,092][2409096] Using port 40920
[2023-02-25 12:18:43,092][2409486] Using port 42612 on host...
[2023-02-25 12:18:43,089][2409866] Port 43412 is available
[2023-02-25 12:18:43,092][2409469] Port 42519 is available
[2023-02-25 12:18:43,095][2409469] Using port 42519
[2023-02-25 12:18:43,095][2409866] Using port 43412
[2023-02-25 12:18:43,109][2409096] Port 40921 is available
[2023-02-25 12:18:43,110][2409096] Using port 40921
[2023-02-25 12:18:43,114][2409469] Port 42520 is available
[2023-02-25 12:18:43,117][2409469] Using port 42520
[2023-02-25 12:18:43,122][2409866] Port 43413 is available
[2023-02-25 12:18:43,126][2409866] Using port 43413
[2023-02-25 12:18:43,128][2409405] Port 42112 is available
[2023-02-25 12:18:43,128][2409405] Using port 42112
[2023-02-25 12:18:43,133][2409096] Port 40922 is available
[2023-02-25 12:18:43,134][2409096] Using port 40922
[2023-02-25 12:18:43,138][2409355] Port 41812 is available
[2023-02-25 12:18:43,139][2409355] Using port 41812
[2023-02-25 12:18:43,146][2409469] Port 42521 is available
[2023-02-25 12:18:43,147][2409469] Using port 42521
[2023-02-25 12:18:43,148][2409866] Port 43414 is available
[2023-02-25 12:18:43,148][2409866] Using port 43414
[2023-02-25 12:18:43,154][2409405] Port 42113 is available
[2023-02-25 12:18:43,160][2409548] Port 43012 is available
[2023-02-25 12:18:43,160][2409548] Using port 43012
[2023-02-25 12:18:43,161][2409096] Port 40923 is available
[2023-02-25 12:18:43,161][2409096] Using port 40923
[2023-02-25 12:18:43,154][2409405] Using port 42113
[2023-02-25 12:18:43,162][2409355] Port 41813 is available
[2023-02-25 12:18:43,166][2409373] Initialized w:16 v:12 player:0
[2023-02-25 12:18:43,166][2409355] Using port 41813
[2023-02-25 12:18:43,166][2409469] Port 42522 is available
[2023-02-25 12:18:43,163][2409096] Using port 40912 on host...
[2023-02-25 12:18:43,167][2409469] Using port 42522
[2023-02-25 12:18:43,167][2409373] Decorrelating experience for 384 frames...
[2023-02-25 12:18:43,169][2409100] Port 41412 is available
[2023-02-25 12:18:43,166][2409866] Port 43415 is available
[2023-02-25 12:18:43,174][2409866] Using port 43415
[2023-02-25 12:18:43,175][2409100] Using port 41412
[2023-02-25 12:18:43,182][2409469] Port 42523 is available
[2023-02-25 12:18:43,190][2409407] Initialized w:20 v:12 player:0
[2023-02-25 12:18:43,186][2409469] Using port 42523
[2023-02-25 12:18:43,185][2409548] Port 43013 is available
[2023-02-25 12:18:43,191][2409405] Port 42114 is available
[2023-02-25 12:18:43,191][2409405] Using port 42114
[2023-02-25 12:18:43,191][2409548] Using port 43013
[2023-02-25 12:18:43,192][2409407] Decorrelating experience for 384 frames...
[2023-02-25 12:18:43,193][2409469] Using port 42512 on host...
[2023-02-25 12:18:43,195][2409104] Initialized w:13 v:12 player:0
[2023-02-25 12:18:43,199][2409355] Port 41814 is available
[2023-02-25 12:18:43,199][2409355] Using port 41814
[2023-02-25 12:18:43,200][2409100] Port 41413 is available
[2023-02-25 12:18:43,201][2409104] Decorrelating experience for 384 frames...
[2023-02-25 12:18:43,201][2409100] Using port 41413
[2023-02-25 12:18:43,198][2409078] Port 40512 is available
[2023-02-25 12:18:43,203][2409078] Using port 40512
[2023-02-25 12:18:43,207][2409548] Port 43014 is available
[2023-02-25 12:18:43,207][2409866] Port 43416 is available
[2023-02-25 12:18:43,214][2409548] Using port 43014
[2023-02-25 12:18:43,215][2409866] Using port 43416
[2023-02-25 12:18:43,217][2409078] Port 40513 is available
[2023-02-25 12:18:43,217][2409078] Using port 40513
[2023-02-25 12:18:43,210][2409405] Port 42115 is available
[2023-02-25 12:18:43,211][2409355] Port 41815 is available
[2023-02-25 12:18:43,218][2409405] Using port 42115
[2023-02-25 12:18:43,218][2409355] Using port 41815
[2023-02-25 12:18:43,219][2409100] Port 41414 is available
[2023-02-25 12:18:43,226][2409100] Using port 41414
[2023-02-25 12:18:43,236][2409548] Port 43015 is available
[2023-02-25 12:18:43,238][2409405] Port 42116 is available
[2023-02-25 12:18:43,239][2409405] Using port 42116
[2023-02-25 12:18:43,239][2409548] Using port 43015
[2023-02-25 12:18:43,240][2409076] Initialized w:0 v:12 player:0
[2023-02-25 12:18:43,241][2409076] Decorrelating experience for 384 frames...
[2023-02-25 12:18:43,243][2409100] Port 41415 is available
[2023-02-25 12:18:43,243][2409866] Port 43417 is available
[2023-02-25 12:18:43,244][2409078] Port 40514 is available
[2023-02-25 12:18:43,246][2409078] Using port 40514
[2023-02-25 12:18:43,245][2409100] Using port 41415
[2023-02-25 12:18:43,245][2409866] Using port 43417
[2023-02-25 12:18:43,245][2409355] Port 41816 is available
[2023-02-25 12:18:43,249][2409355] Using port 41816
[2023-02-25 12:18:43,252][2409079] Initialized w:4 v:12 player:0
[2023-02-25 12:18:43,253][2409079] Decorrelating experience for 384 frames...
[2023-02-25 12:18:43,257][2409405] Port 42117 is available
[2023-02-25 12:18:43,260][2409548] Port 43016 is available
[2023-02-25 12:18:43,262][2409405] Using port 42117
[2023-02-25 12:18:43,263][2409548] Using port 43016
[2023-02-25 12:18:43,268][2409100] Port 41416 is available
[2023-02-25 12:18:43,268][2409100] Using port 41416
[2023-02-25 12:18:43,270][2409078] Port 40515 is available
[2023-02-25 12:18:43,270][2409078] Using port 40515
[2023-02-25 12:18:43,274][2409355] Port 41817 is available
[2023-02-25 12:18:43,278][2409355] Using port 41817
[2023-02-25 12:18:43,277][2409866] Port 43418 is available
[2023-02-25 12:18:43,280][2409405] Port 42118 is available
[2023-02-25 12:18:43,280][2409866] Using port 43418
[2023-02-25 12:18:43,282][2409405] Using port 42118
[2023-02-25 12:18:43,284][2409548] Port 43017 is available
[2023-02-25 12:18:43,288][2409100] Port 41417 is available
[2023-02-25 12:18:43,288][2409548] Using port 43017
[2023-02-25 12:18:43,293][2409078] Port 40516 is available
[2023-02-25 12:18:43,294][2409100] Using port 41417
[2023-02-25 12:18:43,294][2409078] Using port 40516
[2023-02-25 12:18:43,306][2409355] Port 41818 is available
[2023-02-25 12:18:43,307][2409405] Port 42119 is available
[2023-02-25 12:18:43,306][2409355] Using port 41818
[2023-02-25 12:18:43,307][2409405] Using port 42119
[2023-02-25 12:18:43,303][2409866] Port 43419 is available
[2023-02-25 12:18:43,308][2409548] Port 43018 is available
[2023-02-25 12:18:43,309][2409866] Using port 43419
[2023-02-25 12:18:43,312][2409548] Using port 43018
[2023-02-25 12:18:43,312][2409100] Port 41418 is available
[2023-02-25 12:18:43,314][2409078] Port 40517 is available
[2023-02-25 12:18:43,319][2409078] Using port 40517
[2023-02-25 12:18:43,319][2409100] Using port 41418
[2023-02-25 12:18:43,329][2409355] Port 41819 is available
[2023-02-25 12:18:43,330][2409355] Using port 41819
[2023-02-25 12:18:43,330][2409405] Port 42120 is available
[2023-02-25 12:18:43,330][2409405] Using port 42120
[2023-02-25 12:18:43,334][2409866] Port 43420 is available
[2023-02-25 12:18:43,335][2409866] Using port 43420
[2023-02-25 12:18:43,336][2409548] Port 43019 is available
[2023-02-25 12:18:43,336][2409548] Using port 43019
[2023-02-25 12:18:43,339][2409078] Port 40518 is available
[2023-02-25 12:18:43,342][2409078] Using port 40518
[2023-02-25 12:18:43,340][2409100] Port 41419 is available
[2023-02-25 12:18:43,343][2409100] Using port 41419
[2023-02-25 12:18:43,343][2409406] Using port 42213 on host...
[2023-02-25 12:18:43,355][2409405] Port 42121 is available
[2023-02-25 12:18:43,355][2409405] Using port 42121
[2023-02-25 12:18:43,357][2409355] Port 41820 is available
[2023-02-25 12:18:43,357][2409355] Using port 41820
[2023-02-25 12:18:43,358][2409548] Port 43020 is available
[2023-02-25 12:18:43,358][2409548] Using port 43020
[2023-02-25 12:18:43,361][2409078] Port 40519 is available
[2023-02-25 12:18:43,361][2409866] Port 43421 is available
[2023-02-25 12:18:43,366][2409100] Port 41420 is available
[2023-02-25 12:18:43,366][2409078] Using port 40519
[2023-02-25 12:18:43,369][2409100] Using port 41420
[2023-02-25 12:18:43,369][2409866] Using port 43421
[2023-02-25 12:18:43,376][2409405] Port 42122 is available
[2023-02-25 12:18:43,376][2409405] Using port 42122
[2023-02-25 12:18:43,381][2409355] Port 41821 is available
[2023-02-25 12:18:43,381][2409355] Using port 41821
[2023-02-25 12:18:43,381][2409548] Port 43021 is available
[2023-02-25 12:18:43,387][2409548] Using port 43021
[2023-02-25 12:18:43,394][2409078] Port 40520 is available
[2023-02-25 12:18:43,394][2409078] Using port 40520
[2023-02-25 12:18:43,396][2409866] Port 43422 is available
[2023-02-25 12:18:43,396][2409866] Using port 43422
[2023-02-25 12:18:43,392][2409405] Port 42123 is available
[2023-02-25 12:18:43,397][2409405] Using port 42123
[2023-02-25 12:18:43,398][2409100] Port 41421 is available
[2023-02-25 12:18:43,399][2409405] Using port 42112 on host...
[2023-02-25 12:18:43,403][2409100] Using port 41421
[2023-02-25 12:18:43,407][2409355] Port 41822 is available
[2023-02-25 12:18:43,407][2409355] Using port 41822
[2023-02-25 12:18:43,415][2409078] Port 40521 is available
[2023-02-25 12:18:43,415][2409078] Using port 40521
[2023-02-25 12:18:43,415][2409548] Port 43022 is available
[2023-02-25 12:18:43,416][2409548] Using port 43022
[2023-02-25 12:18:43,417][2409866] Port 43423 is available
[2023-02-25 12:18:43,418][2409866] Using port 43423
[2023-02-25 12:18:43,421][2409866] Using port 43412 on host...
[2023-02-25 12:18:43,428][2409100] Port 41422 is available
[2023-02-25 12:18:43,428][2409355] Port 41823 is available
[2023-02-25 12:18:43,428][2409355] Using port 41823
[2023-02-25 12:18:43,428][2409100] Using port 41422
[2023-02-25 12:18:43,432][2409355] Using port 41812 on host...
[2023-02-25 12:18:43,435][2409078] Port 40522 is available
[2023-02-25 12:18:43,441][2409548] Port 43023 is available
[2023-02-25 12:18:43,441][2409548] Using port 43023
[2023-02-25 12:18:43,441][2409078] Using port 40522
[2023-02-25 12:18:43,441][2409100] Port 41423 is available
[2023-02-25 12:18:43,445][2409100] Using port 41423
[2023-02-25 12:18:43,444][2409548] Using port 43012 on host...
[2023-02-25 12:18:43,448][2409100] Using port 41412 on host...
[2023-02-25 12:18:43,454][2409078] Port 40523 is available
[2023-02-25 12:18:43,463][2409078] Using port 40523
[2023-02-25 12:18:43,465][2409078] Using port 40512 on host...
[2023-02-25 12:18:43,471][2409485] Port 42712 is available
[2023-02-25 12:18:43,471][2409485] Using port 42712
[2023-02-25 12:18:43,470][2409103] Port 41112 is available
[2023-02-25 12:18:43,477][2409103] Using port 41112
[2023-02-25 12:18:43,485][2409485] Port 42713 is available
[2023-02-25 12:18:43,485][2409485] Using port 42713
[2023-02-25 12:18:43,494][2409103] Port 41113 is available
[2023-02-25 12:18:43,494][2409103] Using port 41113
[2023-02-25 12:18:43,502][2409485] Port 42714 is available
[2023-02-25 12:18:43,506][2409103] Port 41114 is available
[2023-02-25 12:18:43,506][2409485] Using port 42714
[2023-02-25 12:18:43,514][2409103] Using port 41114
[2023-02-25 12:18:43,517][2409080] Port 40812 is available
[2023-02-25 12:18:43,518][2409080] Using port 40812
[2023-02-25 12:18:43,510][2409468] Port 42412 is available
[2023-02-25 12:18:43,520][2409468] Using port 42412
[2023-02-25 12:18:43,521][2409485] Port 42715 is available
[2023-02-25 12:18:43,521][2409485] Using port 42715
[2023-02-25 12:18:43,529][2409103] Port 41115 is available
[2023-02-25 12:18:43,529][2409103] Using port 41115
[2023-02-25 12:18:43,533][2409468] Port 42413 is available
[2023-02-25 12:18:43,537][2409468] Using port 42413
[2023-02-25 12:18:43,539][2409485] Port 42716 is available
[2023-02-25 12:18:43,537][2409080] Port 40813 is available
[2023-02-25 12:18:43,539][2409080] Using port 40813
[2023-02-25 12:18:43,542][2409485] Using port 42716
[2023-02-25 12:18:43,550][2409468] Port 42414 is available
[2023-02-25 12:18:43,551][2409103] Port 41116 is available
[2023-02-25 12:18:43,552][2409103] Using port 41116
[2023-02-25 12:18:43,553][2409105] Initialized w:14 v:12 player:0
[2023-02-25 12:18:43,554][2409105] Decorrelating experience for 384 frames...
[2023-02-25 12:18:43,555][2409080] Port 40814 is available
[2023-02-25 12:18:43,556][2409080] Using port 40814
[2023-02-25 12:18:43,550][2409468] Using port 42414
[2023-02-25 12:18:43,560][2409485] Port 42717 is available
[2023-02-25 12:18:43,560][2409485] Using port 42717
[2023-02-25 12:18:43,569][2409103] Port 41117 is available
[2023-02-25 12:18:43,569][2409103] Using port 41117
[2023-02-25 12:18:43,572][2409080] Port 40815 is available
[2023-02-25 12:18:43,572][2409080] Using port 40815
[2023-02-25 12:18:43,576][2409485] Port 42718 is available
[2023-02-25 12:18:43,582][2409485] Using port 42718
[2023-02-25 12:18:43,583][2409080] Port 40816 is available
[2023-02-25 12:18:43,583][2409080] Using port 40816
[2023-02-25 12:18:43,576][2409468] Port 42415 is available
[2023-02-25 12:18:43,578][2409597] Initialized w:30 v:12 player:0
[2023-02-25 12:18:43,586][2409468] Using port 42415
[2023-02-25 12:18:43,587][2409103] Port 41118 is available
[2023-02-25 12:18:43,587][2409103] Using port 41118
[2023-02-25 12:18:43,587][2409597] Decorrelating experience for 384 frames...
[2023-02-25 12:18:43,600][2409485] Port 42719 is available
[2023-02-25 12:18:43,600][2409485] Using port 42719
[2023-02-25 12:18:43,600][2409080] Port 40817 is available
[2023-02-25 12:18:43,600][2409080] Using port 40817
[2023-02-25 12:18:43,604][2409468] Port 42416 is available
[2023-02-25 12:18:43,604][2409468] Using port 42416
[2023-02-25 12:18:43,607][2409103] Port 41119 is available
[2023-02-25 12:18:43,607][2409103] Using port 41119
[2023-02-25 12:18:43,616][2409547] Initialized w:25 v:12 player:0
[2023-02-25 12:18:43,617][2409080] Port 40818 is available
[2023-02-25 12:18:43,618][2409080] Using port 40818
[2023-02-25 12:18:43,619][2409097] Initialized w:9 v:12 player:0
[2023-02-25 12:18:43,620][2409485] Port 42720 is available
[2023-02-25 12:18:43,621][2409485] Using port 42720
[2023-02-25 12:18:43,621][2409468] Port 42417 is available
[2023-02-25 12:18:43,621][2409468] Using port 42417
[2023-02-25 12:18:43,617][2409547] Decorrelating experience for 384 frames...
[2023-02-25 12:18:43,622][2409097] Decorrelating experience for 384 frames...
[2023-02-25 12:18:43,624][2409103] Port 41120 is available
[2023-02-25 12:18:43,625][2409103] Using port 41120
[2023-02-25 12:18:43,636][2409468] Port 42418 is available
[2023-02-25 12:18:43,637][2409468] Using port 42418
[2023-02-25 12:18:43,643][2409485] Port 42721 is available
[2023-02-25 12:18:43,643][2409485] Using port 42721
[2023-02-25 12:18:43,642][2409080] Port 40819 is available
[2023-02-25 12:18:43,641][2409103] Port 41121 is available
[2023-02-25 12:18:43,647][2409080] Using port 40819
[2023-02-25 12:18:43,647][2409103] Using port 41121
[2023-02-25 12:18:43,660][2409485] Port 42722 is available
[2023-02-25 12:18:43,664][2409485] Using port 42722
[2023-02-25 12:18:43,664][2409468] Port 42419 is available
[2023-02-25 12:18:43,664][2409468] Using port 42419
[2023-02-25 12:18:43,663][2409103] Port 41122 is available
[2023-02-25 12:18:43,666][2409103] Using port 41122
[2023-02-25 12:18:43,666][2409080] Port 40820 is available
[2023-02-25 12:18:43,670][2409080] Using port 40820
[2023-02-25 12:18:43,682][2409485] Port 42723 is available
[2023-02-25 12:18:43,683][2409485] Using port 42723
[2023-02-25 12:18:43,684][2409468] Port 42420 is available
[2023-02-25 12:18:43,684][2409077] Initialized w:3 v:12 player:0
[2023-02-25 12:18:43,686][2409077] Decorrelating experience for 384 frames...
[2023-02-25 12:18:43,684][2409468] Using port 42420
[2023-02-25 12:18:43,686][2409103] Port 41123 is available
[2023-02-25 12:18:43,687][2409103] Using port 41123
[2023-02-25 12:18:43,686][2409080] Port 40821 is available
[2023-02-25 12:18:43,686][2409485] Using port 42712 on host...
[2023-02-25 12:18:43,687][2409549] Using port 42913 on host...
[2023-02-25 12:18:43,687][2409080] Using port 40821
[2023-02-25 12:18:43,689][2409103] Using port 41112 on host...
[2023-02-25 12:18:43,703][2409565] Initialized w:28 v:12 player:0
[2023-02-25 12:18:43,701][2409468] Port 42421 is available
[2023-02-25 12:18:43,704][2409468] Using port 42421
[2023-02-25 12:18:43,704][2409565] Decorrelating experience for 384 frames...
[2023-02-25 12:18:43,703][2409080] Port 40822 is available
[2023-02-25 12:18:43,706][2409080] Using port 40822
[2023-02-25 12:18:43,722][2409468] Port 42422 is available
[2023-02-25 12:18:43,722][2409468] Using port 42422
[2023-02-25 12:18:43,723][2409080] Port 40823 is available
[2023-02-25 12:18:43,727][2409080] Using port 40823
[2023-02-25 12:18:43,729][2409080] Using port 40812 on host...
[2023-02-25 12:18:43,734][2409468] Port 42423 is available
[2023-02-25 12:18:43,734][2409468] Using port 42423
[2023-02-25 12:18:43,736][2409468] Using port 42412 on host...
[2023-02-25 12:18:43,825][2409099] Initialized w:7 v:12 player:0
[2023-02-25 12:18:43,826][2409099] Decorrelating experience for 384 frames...
[2023-02-25 12:18:43,829][2409102] Initialized w:12 v:12 player:0
[2023-02-25 12:18:43,830][2409102] Decorrelating experience for 384 frames...
[2023-02-25 12:18:43,897][2409486] Initialized w:23 v:12 player:0
[2023-02-25 12:18:43,898][2409486] Decorrelating experience for 384 frames...
[2023-02-25 12:18:43,983][2409096] Initialized w:6 v:12 player:0
[2023-02-25 12:18:43,984][2409096] Decorrelating experience for 384 frames...
[2023-02-25 12:18:44,010][2409101] Using port 41313 on host...
[2023-02-25 12:18:44,013][2409469] Initialized w:22 v:12 player:0
[2023-02-25 12:18:44,014][2409469] Decorrelating experience for 384 frames...
[2023-02-25 12:18:44,131][2409405] Initialized w:18 v:12 player:0
[2023-02-25 12:18:44,132][2409405] Decorrelating experience for 384 frames...
[2023-02-25 12:18:44,191][2409866] Initialized w:31 v:12 player:0
[2023-02-25 12:18:44,193][2409866] Decorrelating experience for 384 frames...
[2023-02-25 12:18:44,197][2409355] Initialized w:15 v:12 player:0
[2023-02-25 12:18:44,199][2409355] Decorrelating experience for 384 frames...
[2023-02-25 12:18:44,212][2409078] Initialized w:2 v:12 player:0
[2023-02-25 12:18:44,214][2409078] Decorrelating experience for 384 frames...
[2023-02-25 12:18:44,261][2409406] Initialized w:19 v:13 player:0
[2023-02-25 12:18:44,262][2409406] Decorrelating experience for 416 frames...
[2023-02-25 12:18:44,269][2409100] Initialized w:11 v:12 player:0
[2023-02-25 12:18:44,270][2409100] Decorrelating experience for 384 frames...
[2023-02-25 12:18:44,271][2409548] Initialized w:27 v:12 player:0
[2023-02-25 12:18:44,272][2409548] Decorrelating experience for 384 frames...
[2023-02-25 12:18:44,414][2409485] Initialized w:24 v:12 player:0
[2023-02-25 12:18:44,415][2409485] Decorrelating experience for 384 frames...
[2023-02-25 12:18:44,420][2409596] Using port 43213 on host...
[2023-02-25 12:18:44,422][2409103] Initialized w:8 v:12 player:0
[2023-02-25 12:18:44,423][2409103] Decorrelating experience for 384 frames...
[2023-02-25 12:18:44,465][2409080] Initialized w:5 v:12 player:0
[2023-02-25 12:18:44,468][2409080] Decorrelating experience for 384 frames...
[2023-02-25 12:18:44,475][2409468] Initialized w:21 v:12 player:0
[2023-02-25 12:18:44,478][2409468] Decorrelating experience for 384 frames...
[2023-02-25 12:18:44,531][2409549] Initialized w:26 v:13 player:0
[2023-02-25 12:18:44,532][2409549] Decorrelating experience for 416 frames...
[2023-02-25 12:18:44,589][2409373] Using port 41913 on host...
[2023-02-25 12:18:44,596][2409104] Using port 41613 on host...
[2023-02-25 12:18:44,637][2409076] Using port 40313 on host...
[2023-02-25 12:18:44,647][2409389] Using port 42013 on host...
[2023-02-25 12:18:44,710][2409077] Using port 40613 on host...
[2023-02-25 12:18:44,725][2409101] Initialized w:10 v:13 player:0
[2023-02-25 12:18:44,727][2409101] Decorrelating experience for 416 frames...
[2023-02-25 12:18:44,754][2409075] Using port 40413 on host...
[2023-02-25 12:18:44,840][2409407] Using port 42313 on host...
[2023-02-25 12:18:44,844][2409079] Using port 40713 on host...
[2023-02-25 12:18:44,871][2409105] Using port 41713 on host...
[2023-02-25 12:18:44,925][2409597] Using port 43313 on host...
[2023-02-25 12:18:45,019][2409565] Using port 43113 on host...
[2023-02-25 12:18:45,086][2409547] Using port 42813 on host...
[2023-02-25 12:18:45,103][2409097] Using port 41213 on host...
[2023-02-25 12:18:45,133][2409099] Using port 41013 on host...
[2023-02-25 12:18:45,144][2409102] Using port 41513 on host...
[2023-02-25 12:18:45,195][2409596] Initialized w:29 v:13 player:0
[2023-02-25 12:18:45,196][2409596] Decorrelating experience for 416 frames...
[2023-02-25 12:18:45,302][2409104] Initialized w:13 v:13 player:0
[2023-02-25 12:18:45,303][2409104] Decorrelating experience for 416 frames...
[2023-02-25 12:18:45,307][2409486] Using port 42613 on host...
[2023-02-25 12:18:45,319][2409373] Initialized w:16 v:13 player:0
[2023-02-25 12:18:45,320][2409373] Decorrelating experience for 416 frames...
[2023-02-25 12:18:45,341][2409076] Initialized w:0 v:13 player:0
[2023-02-25 12:18:45,343][2409076] Decorrelating experience for 416 frames...
[2023-02-25 12:18:45,396][2409469] Using port 42513 on host...
[2023-02-25 12:18:45,419][2409405] Using port 42113 on host...
[2023-02-25 12:18:45,439][2409389] Initialized w:17 v:13 player:0
[2023-02-25 12:18:45,441][2409389] Decorrelating experience for 416 frames...
[2023-02-25 12:18:45,441][2409406] Using port 42214 on host...
[2023-02-25 12:18:45,459][2409096] Using port 40913 on host...
[2023-02-25 12:18:45,476][2409075] Initialized w:1 v:13 player:0
[2023-02-25 12:18:45,478][2409075] Decorrelating experience for 416 frames...
[2023-02-25 12:18:45,515][2409078] Using port 40513 on host...
[2023-02-25 12:18:45,537][2409866] Using port 43413 on host...
[2023-02-25 12:18:45,558][2409355] Using port 41813 on host...
[2023-02-25 12:18:45,586][2409079] Initialized w:4 v:13 player:0
[2023-02-25 12:18:45,588][2409079] Decorrelating experience for 416 frames...
[2023-02-25 12:18:45,595][2409407] Initialized w:20 v:13 player:0
[2023-02-25 12:18:45,597][2409407] Decorrelating experience for 416 frames...
[2023-02-25 12:18:45,603][2409077] Initialized w:3 v:13 player:0
[2023-02-25 12:18:45,604][2409077] Decorrelating experience for 416 frames...
[2023-02-25 12:18:45,618][2409105] Initialized w:14 v:13 player:0
[2023-02-25 12:18:45,619][2409105] Decorrelating experience for 416 frames...
[2023-02-25 12:18:45,656][2409100] Using port 41413 on host...
[2023-02-25 12:18:45,681][2409548] Using port 43013 on host...
[2023-02-25 12:18:45,685][2409597] Initialized w:30 v:13 player:0
[2023-02-25 12:18:45,687][2409597] Decorrelating experience for 416 frames...
[2023-02-25 12:18:45,792][2409565] Initialized w:28 v:13 player:0
[2023-02-25 12:18:45,793][2409565] Decorrelating experience for 416 frames...
[2023-02-25 12:18:45,838][2409103] Using port 41113 on host...
[2023-02-25 12:18:45,855][2409485] Using port 42713 on host...
[2023-02-25 12:18:45,861][2409080] Using port 40813 on host...
[2023-02-25 12:18:45,864][2409549] Using port 42914 on host...
[2023-02-25 12:18:45,873][2409468] Using port 42413 on host...
[2023-02-25 12:18:45,888][2409102] Initialized w:12 v:13 player:0
[2023-02-25 12:18:45,889][2409102] Decorrelating experience for 416 frames...
[2023-02-25 12:18:45,919][2409547] Initialized w:25 v:13 player:0
[2023-02-25 12:18:45,921][2409547] Decorrelating experience for 416 frames...
[2023-02-25 12:18:45,923][2409097] Initialized w:9 v:13 player:0
[2023-02-25 12:18:45,925][2409097] Decorrelating experience for 416 frames...
[2023-02-25 12:18:45,931][2409099] Initialized w:7 v:13 player:0
[2023-02-25 12:18:45,932][2409099] Decorrelating experience for 416 frames...
[2023-02-25 12:18:46,037][2409486] Initialized w:23 v:13 player:0
[2023-02-25 12:18:46,039][2409486] Decorrelating experience for 416 frames...
[2023-02-25 12:18:46,085][2409101] Using port 41314 on host...
[2023-02-25 12:18:46,159][2409469] Initialized w:22 v:13 player:0
[2023-02-25 12:18:46,160][2409469] Decorrelating experience for 416 frames...
[2023-02-25 12:18:46,171][2409096] Initialized w:6 v:13 player:0
[2023-02-25 12:18:46,173][2409096] Decorrelating experience for 416 frames...
[2023-02-25 12:18:46,187][2409405] Initialized w:18 v:13 player:0
[2023-02-25 12:18:46,189][2409405] Decorrelating experience for 416 frames...
[2023-02-25 12:18:46,267][2409078] Initialized w:2 v:13 player:0
[2023-02-25 12:18:46,268][2409078] Decorrelating experience for 416 frames...
[2023-02-25 12:18:46,288][2409866] Initialized w:31 v:13 player:0
[2023-02-25 12:18:46,289][2409866] Decorrelating experience for 416 frames...
[2023-02-25 12:18:46,313][2409355] Initialized w:15 v:13 player:0
[2023-02-25 12:18:46,315][2409355] Decorrelating experience for 416 frames...
[2023-02-25 12:18:46,320][2409406] Initialized w:19 v:14 player:0
[2023-02-25 12:18:46,321][2409406] Decorrelating experience for 448 frames...
[2023-02-25 12:18:46,398][2409100] Initialized w:11 v:13 player:0
[2023-02-25 12:18:46,399][2409100] Decorrelating experience for 416 frames...
[2023-02-25 12:18:46,422][2409548] Initialized w:27 v:13 player:0
[2023-02-25 12:18:46,423][2409548] Decorrelating experience for 416 frames...
[2023-02-25 12:18:46,556][2409485] Initialized w:24 v:13 player:0
[2023-02-25 12:18:46,558][2409485] Decorrelating experience for 416 frames...
[2023-02-25 12:18:46,567][2409103] Initialized w:8 v:13 player:0
[2023-02-25 12:18:46,569][2409103] Decorrelating experience for 416 frames...
[2023-02-25 12:18:46,582][2409080] Initialized w:5 v:13 player:0
[2023-02-25 12:18:46,584][2409080] Decorrelating experience for 416 frames...
[2023-02-25 12:18:46,588][2409468] Initialized w:21 v:13 player:0
[2023-02-25 12:18:46,590][2409468] Decorrelating experience for 416 frames...
[2023-02-25 12:18:46,616][2409596] Using port 43214 on host...
[2023-02-25 12:18:46,675][2409549] Initialized w:26 v:14 player:0
[2023-02-25 12:18:46,676][2409549] Decorrelating experience for 448 frames...
[2023-02-25 12:18:46,688][2409373] Using port 41914 on host...
[2023-02-25 12:18:46,716][2409104] Using port 41614 on host...
[2023-02-25 12:18:46,787][2409076] Using port 40314 on host...
[2023-02-25 12:18:46,829][2409077] Using port 40614 on host...
[2023-02-25 12:18:46,844][2409389] Using port 42014 on host...
[2023-02-25 12:18:47,009][2409407] Using port 42314 on host...
[2023-02-25 12:18:47,012][2409105] Using port 41714 on host...
[2023-02-25 12:18:47,026][2409101] Initialized w:10 v:14 player:0
[2023-02-25 12:18:47,027][2409101] Decorrelating experience for 448 frames...
[2023-02-25 12:18:47,028][2409079] Using port 40714 on host...
[2023-02-25 12:18:47,138][2409597] Using port 43314 on host...
[2023-02-25 12:18:47,139][2409075] Using port 40414 on host...
[2023-02-25 12:18:47,186][2408954] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0)
[2023-02-25 12:18:47,223][2409565] Using port 43114 on host...
[2023-02-25 12:18:47,332][2409102] Using port 41514 on host...
[2023-02-25 12:18:47,367][2409099] Using port 41014 on host...
[2023-02-25 12:18:47,468][2409373] Initialized w:16 v:14 player:0
[2023-02-25 12:18:47,469][2409373] Decorrelating experience for 448 frames...
[2023-02-25 12:18:47,492][2409547] Using port 42814 on host...
[2023-02-25 12:18:47,504][2409076] Initialized w:0 v:14 player:0
[2023-02-25 12:18:47,505][2409076] Decorrelating experience for 448 frames...
[2023-02-25 12:18:47,512][2409097] Using port 41214 on host...
[2023-02-25 12:18:47,514][2409486] Using port 42614 on host...
[2023-02-25 12:18:47,571][2409406] Using port 42215 on host...
[2023-02-25 12:18:47,605][2409596] Initialized w:29 v:14 player:0
[2023-02-25 12:18:47,606][2409596] Decorrelating experience for 448 frames...
[2023-02-25 12:18:47,712][2409104] Initialized w:13 v:14 player:0
[2023-02-25 12:18:47,714][2409104] Decorrelating experience for 448 frames...
[2023-02-25 12:18:47,735][2409077] Initialized w:3 v:14 player:0
[2023-02-25 12:18:47,736][2409077] Decorrelating experience for 448 frames...
[2023-02-25 12:18:47,741][2409866] Using port 43414 on host...
[2023-02-25 12:18:47,772][2409355] Using port 41814 on host...
[2023-02-25 12:18:47,793][2409105] Initialized w:14 v:14 player:0
[2023-02-25 12:18:47,794][2409105] Decorrelating experience for 448 frames...
[2023-02-25 12:18:47,839][2409389] Initialized w:17 v:14 player:0
[2023-02-25 12:18:47,840][2409389] Decorrelating experience for 448 frames...
[2023-02-25 12:18:47,857][2409597] Initialized w:30 v:14 player:0
[2023-02-25 12:18:47,858][2409597] Decorrelating experience for 448 frames...
[2023-02-25 12:18:47,910][2409079] Initialized w:4 v:14 player:0
[2023-02-25 12:18:47,911][2409407] Initialized w:20 v:14 player:0
[2023-02-25 12:18:47,911][2409075] Initialized w:1 v:14 player:0
[2023-02-25 12:18:47,916][2409096] Using port 40914 on host...
[2023-02-25 12:18:47,916][2409075] Decorrelating experience for 448 frames...
[2023-02-25 12:18:47,916][2409079] Decorrelating experience for 448 frames...
[2023-02-25 12:18:47,917][2409407] Decorrelating experience for 448 frames...
[2023-02-25 12:18:47,919][2409100] Using port 41414 on host...
[2023-02-25 12:18:47,961][2409469] Using port 42514 on host...
[2023-02-25 12:18:47,989][2409548] Using port 43014 on host...
[2023-02-25 12:18:48,026][2409565] Initialized w:28 v:14 player:0
[2023-02-25 12:18:48,028][2409565] Decorrelating experience for 448 frames...
[2023-02-25 12:18:48,071][2409485] Using port 42714 on host...
[2023-02-25 12:18:48,083][2409103] Using port 41114 on host...
[2023-02-25 12:18:48,108][2409102] Initialized w:12 v:14 player:0
[2023-02-25 12:18:48,109][2409102] Decorrelating experience for 448 frames...
[2023-02-25 12:18:48,119][2409405] Using port 42114 on host...
[2023-02-25 12:18:48,155][2409099] Initialized w:7 v:14 player:0
[2023-02-25 12:18:48,156][2409099] Decorrelating experience for 448 frames...
[2023-02-25 12:18:48,237][2409078] Using port 40514 on host...
[2023-02-25 12:18:48,238][2409486] Initialized w:23 v:14 player:0
[2023-02-25 12:18:48,239][2409486] Decorrelating experience for 448 frames...
[2023-02-25 12:18:48,261][2409468] Using port 42414 on host...
[2023-02-25 12:18:48,267][2409080] Using port 40814 on host...
[2023-02-25 12:18:48,294][2409547] Initialized w:25 v:14 player:0
[2023-02-25 12:18:48,296][2409547] Decorrelating experience for 448 frames...
[2023-02-25 12:18:48,300][2409097] Initialized w:9 v:14 player:0
[2023-02-25 12:18:48,302][2409097] Decorrelating experience for 448 frames...
[2023-02-25 12:18:48,415][2409406] Initialized w:19 v:15 player:0
[2023-02-25 12:18:48,416][2409406] Decorrelating experience for 480 frames...
[2023-02-25 12:18:48,503][2409866] Initialized w:31 v:14 player:0
[2023-02-25 12:18:48,505][2409866] Decorrelating experience for 448 frames...
[2023-02-25 12:18:48,511][2409355] Initialized w:15 v:14 player:0
[2023-02-25 12:18:48,513][2409355] Decorrelating experience for 448 frames...
[2023-02-25 12:18:48,648][2409096] Initialized w:6 v:14 player:0
[2023-02-25 12:18:48,649][2409096] Decorrelating experience for 448 frames...
[2023-02-25 12:18:48,660][2409100] Initialized w:11 v:14 player:0
[2023-02-25 12:18:48,661][2409100] Decorrelating experience for 448 frames...
[2023-02-25 12:18:48,677][2409469] Initialized w:22 v:14 player:0
[2023-02-25 12:18:48,678][2409469] Decorrelating experience for 448 frames...
[2023-02-25 12:18:48,719][2409548] Initialized w:27 v:14 player:0
[2023-02-25 12:18:48,721][2409548] Decorrelating experience for 448 frames...
[2023-02-25 12:18:48,791][2409485] Initialized w:24 v:14 player:0
[2023-02-25 12:18:48,792][2409485] Decorrelating experience for 448 frames...
[2023-02-25 12:18:48,802][2409103] Initialized w:8 v:14 player:0
[2023-02-25 12:18:48,804][2409103] Decorrelating experience for 448 frames...
[2023-02-25 12:18:48,874][2409405] Initialized w:18 v:14 player:0
[2023-02-25 12:18:48,876][2409405] Decorrelating experience for 448 frames...
[2023-02-25 12:18:48,955][2409078] Initialized w:2 v:14 player:0
[2023-02-25 12:18:48,957][2409078] Decorrelating experience for 448 frames...
[2023-02-25 12:18:48,991][2409080] Initialized w:5 v:14 player:0
[2023-02-25 12:18:48,993][2409080] Decorrelating experience for 448 frames...
[2023-02-25 12:18:48,999][2409468] Initialized w:21 v:14 player:0
[2023-02-25 12:18:49,001][2409468] Decorrelating experience for 448 frames...
[2023-02-25 12:18:49,064][2409373] Using port 41915 on host...
[2023-02-25 12:18:49,079][2409077] Using port 40615 on host...
[2023-02-25 12:18:49,143][2409076] Using port 40315 on host...
[2023-02-25 12:18:49,146][2409596] Using port 43215 on host...
[2023-02-25 12:18:49,239][2409549] Using port 42915 on host...
[2023-02-25 12:18:49,250][2409104] Using port 41615 on host...
[2023-02-25 12:18:49,397][2409389] Using port 42015 on host...
[2023-02-25 12:18:49,404][2409101] Using port 41315 on host...
[2023-02-25 12:18:49,453][2409105] Using port 41715 on host...
[2023-02-25 12:18:49,452][2409079] Using port 40715 on host...
[2023-02-25 12:18:49,455][2409407] Using port 42315 on host...
[2023-02-25 12:18:49,489][2409597] Using port 43315 on host...
[2023-02-25 12:18:49,496][2409075] Using port 40415 on host...
[2023-02-25 12:18:49,498][2409565] Using port 43115 on host...
[2023-02-25 12:18:49,631][2409102] Using port 41515 on host...
[2023-02-25 12:18:49,752][2409099] Using port 41015 on host...
[2023-02-25 12:18:49,799][2409373] Initialized w:16 v:15 player:0
[2023-02-25 12:18:49,800][2409373] Decorrelating experience for 480 frames...
[2023-02-25 12:18:49,809][2409486] Using port 42615 on host...
[2023-02-25 12:18:49,860][2409076] Initialized w:0 v:15 player:0
[2023-02-25 12:18:49,861][2409076] Decorrelating experience for 480 frames...
[2023-02-25 12:18:49,862][2409406] Using port 42216 on host...
[2023-02-25 12:18:49,915][2409596] Initialized w:29 v:15 player:0
[2023-02-25 12:18:49,917][2409596] Decorrelating experience for 480 frames...
[2023-02-25 12:18:49,984][2409104] Initialized w:13 v:15 player:0
[2023-02-25 12:18:49,985][2409104] Decorrelating experience for 480 frames...
[2023-02-25 12:18:49,987][2409077] Initialized w:3 v:15 player:0
[2023-02-25 12:18:49,988][2409077] Decorrelating experience for 480 frames...
[2023-02-25 12:18:50,003][2409549] Initialized w:26 v:15 player:0
[2023-02-25 12:18:50,004][2409549] Decorrelating experience for 480 frames...
[2023-02-25 12:18:50,022][2409097] Using port 41215 on host...
[2023-02-25 12:18:50,040][2409547] Using port 42815 on host...
[2023-02-25 12:18:50,115][2409101] Initialized w:10 v:15 player:0
[2023-02-25 12:18:50,117][2409101] Decorrelating experience for 480 frames...
[2023-02-25 12:18:50,179][2409105] Initialized w:14 v:15 player:0
[2023-02-25 12:18:50,180][2409105] Decorrelating experience for 480 frames...
[2023-02-25 12:18:50,193][2409597] Initialized w:30 v:15 player:0
[2023-02-25 12:18:50,194][2409597] Decorrelating experience for 480 frames...
[2023-02-25 12:18:50,296][2409565] Initialized w:28 v:15 player:0
[2023-02-25 12:18:50,298][2409565] Decorrelating experience for 480 frames...
[2023-02-25 12:18:50,298][2409079] Initialized w:4 v:15 player:0
[2023-02-25 12:18:50,299][2409079] Decorrelating experience for 480 frames...
[2023-02-25 12:18:50,300][2409407] Initialized w:20 v:15 player:0
[2023-02-25 12:18:50,302][2409407] Decorrelating experience for 480 frames...
[2023-02-25 12:18:50,332][2409096] Using port 40915 on host...
[2023-02-25 12:18:50,360][2409102] Initialized w:12 v:15 player:0
[2023-02-25 12:18:50,361][2409102] Decorrelating experience for 480 frames...
[2023-02-25 12:18:50,364][2409100] Using port 41415 on host...
[2023-02-25 12:18:50,371][2409866] Using port 43415 on host...
[2023-02-25 12:18:50,418][2409548] Using port 43015 on host...
[2023-02-25 12:18:50,436][2409469] Using port 42515 on host...
[2023-02-25 12:18:50,441][2409355] Using port 41815 on host...
[2023-02-25 12:18:50,450][2409405] Using port 42115 on host...
[2023-02-25 12:18:50,452][2409389] Initialized w:17 v:15 player:0
[2023-02-25 12:18:50,453][2409389] Decorrelating experience for 480 frames...
[2023-02-25 12:18:50,497][2409485] Using port 42715 on host...
[2023-02-25 12:18:50,512][2409103] Using port 41115 on host...
[2023-02-25 12:18:50,515][2409078] Using port 40515 on host...
[2023-02-25 12:18:50,516][2409075] Initialized w:1 v:15 player:0
[2023-02-25 12:18:50,518][2409075] Decorrelating experience for 480 frames...
[2023-02-25 12:18:50,617][2409099] Initialized w:7 v:15 player:0
[2023-02-25 12:18:50,618][2409099] Decorrelating experience for 480 frames...
[2023-02-25 12:18:50,644][2409486] Initialized w:23 v:15 player:0
[2023-02-25 12:18:50,646][2409486] Decorrelating experience for 480 frames...
[2023-02-25 12:18:50,733][2409406] Initialized w:19 v:16 player:0
[2023-02-25 12:18:50,734][2409406] Decorrelating experience for 512 frames...
[2023-02-25 12:18:50,801][2409468] Using port 42415 on host...
[2023-02-25 12:18:50,841][2409080] Using port 40815 on host...
[2023-02-25 12:18:50,858][2409097] Initialized w:9 v:15 player:0
[2023-02-25 12:18:50,861][2409097] Decorrelating experience for 480 frames...
[2023-02-25 12:18:50,869][2409547] Initialized w:25 v:15 player:0
[2023-02-25 12:18:50,871][2409547] Decorrelating experience for 480 frames...
[2023-02-25 12:18:51,082][2409096] Initialized w:6 v:15 player:0
[2023-02-25 12:18:51,084][2409096] Decorrelating experience for 480 frames...
[2023-02-25 12:18:51,101][2409100] Initialized w:11 v:15 player:0
[2023-02-25 12:18:51,108][2409100] Decorrelating experience for 480 frames...
[2023-02-25 12:18:51,117][2409866] Initialized w:31 v:15 player:0
[2023-02-25 12:18:51,118][2409866] Decorrelating experience for 480 frames...
[2023-02-25 12:18:51,147][2409469] Initialized w:22 v:15 player:0
[2023-02-25 12:18:51,147][2409548] Initialized w:27 v:15 player:0
[2023-02-25 12:18:51,148][2409548] Decorrelating experience for 480 frames...
[2023-02-25 12:18:51,148][2409469] Decorrelating experience for 480 frames...
[2023-02-25 12:18:51,165][2409355] Initialized w:15 v:15 player:0
[2023-02-25 12:18:51,166][2409355] Decorrelating experience for 480 frames...
[2023-02-25 12:18:51,207][2409405] Initialized w:18 v:15 player:0
[2023-02-25 12:18:51,208][2409405] Decorrelating experience for 480 frames...
[2023-02-25 12:18:51,227][2409485] Initialized w:24 v:15 player:0
[2023-02-25 12:18:51,229][2409103] Initialized w:8 v:15 player:0
[2023-02-25 12:18:51,231][2409103] Decorrelating experience for 480 frames...
[2023-02-25 12:18:51,232][2409485] Decorrelating experience for 480 frames...
[2023-02-25 12:18:51,245][2409078] Initialized w:2 v:15 player:0
[2023-02-25 12:18:51,246][2409078] Decorrelating experience for 480 frames...
[2023-02-25 12:18:51,413][2409373] Using port 41916 on host...
[2023-02-25 12:18:51,442][2409077] Using port 40616 on host...
[2023-02-25 12:18:51,517][2409076] Using port 40316 on host...
[2023-02-25 12:18:51,545][2409468] Initialized w:21 v:15 player:0
[2023-02-25 12:18:51,546][2409468] Decorrelating experience for 480 frames...
[2023-02-25 12:18:51,556][2409080] Initialized w:5 v:15 player:0
[2023-02-25 12:18:51,558][2409080] Decorrelating experience for 480 frames...
[2023-02-25 12:18:51,587][2409596] Using port 43216 on host...
[2023-02-25 12:18:51,625][2409549] Using port 42916 on host...
[2023-02-25 12:18:51,686][2409104] Using port 41616 on host...
[2023-02-25 12:18:51,741][2409101] Using port 41316 on host...
[2023-02-25 12:18:51,880][2409565] Using port 43116 on host...
[2023-02-25 12:18:51,900][2409105] Using port 41716 on host...
[2023-02-25 12:18:51,925][2409597] Using port 43316 on host...
[2023-02-25 12:18:51,959][2409102] Using port 41516 on host...
[2023-02-25 12:18:51,965][2409407] Using port 42316 on host...
[2023-02-25 12:18:51,974][2409079] Using port 40716 on host...
[2023-02-25 12:18:52,125][2409389] Using port 42016 on host...
[2023-02-25 12:18:52,163][2409373] Initialized w:16 v:16 player:0
[2023-02-25 12:18:52,164][2409075] Using port 40416 on host...
[2023-02-25 12:18:52,165][2409373] Decorrelating experience for 512 frames...
[2023-02-25 12:18:52,186][2408954] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0)
[2023-02-25 12:18:52,216][2409076] Initialized w:0 v:16 player:0
[2023-02-25 12:18:52,216][2409406] Using port 42217 on host...
[2023-02-25 12:18:52,217][2409076] Decorrelating experience for 512 frames...
[2023-02-25 12:18:52,309][2409099] Using port 41016 on host...
[2023-02-25 12:18:52,343][2409486] Using port 42616 on host...
[2023-02-25 12:18:52,343][2409596] Initialized w:29 v:16 player:0
[2023-02-25 12:18:52,344][2409596] Decorrelating experience for 512 frames...
[2023-02-25 12:18:52,380][2409077] Initialized w:3 v:16 player:0
[2023-02-25 12:18:52,381][2409549] Initialized w:26 v:16 player:0
[2023-02-25 12:18:52,382][2409549] Decorrelating experience for 512 frames...
[2023-02-25 12:18:52,382][2409077] Decorrelating experience for 512 frames...
[2023-02-25 12:18:52,411][2409104] Initialized w:13 v:16 player:0
[2023-02-25 12:18:52,413][2409104] Decorrelating experience for 512 frames...
[2023-02-25 12:18:52,451][2409101] Initialized w:10 v:16 player:0
[2023-02-25 12:18:52,452][2409101] Decorrelating experience for 512 frames...
[2023-02-25 12:18:52,627][2409105] Initialized w:14 v:16 player:0
[2023-02-25 12:18:52,628][2409105] Decorrelating experience for 512 frames...
[2023-02-25 12:18:52,661][2409597] Initialized w:30 v:16 player:0
[2023-02-25 12:18:52,663][2409597] Decorrelating experience for 512 frames...
[2023-02-25 12:18:52,693][2409565] Initialized w:28 v:16 player:0
[2023-02-25 12:18:52,695][2409565] Decorrelating experience for 512 frames...
[2023-02-25 12:18:52,713][2409100] Using port 41416 on host...
[2023-02-25 12:18:52,724][2409097] Using port 41216 on host...
[2023-02-25 12:18:52,738][2409407] Initialized w:20 v:16 player:0
[2023-02-25 12:18:52,740][2409407] Decorrelating experience for 512 frames...
[2023-02-25 12:18:52,749][2409102] Initialized w:12 v:16 player:0
[2023-02-25 12:18:52,751][2409102] Decorrelating experience for 512 frames...
[2023-02-25 12:18:52,754][2409866] Using port 43416 on host...
[2023-02-25 12:18:52,766][2409547] Using port 42816 on host...
[2023-02-25 12:18:52,773][2409079] Initialized w:4 v:16 player:0
[2023-02-25 12:18:52,774][2409079] Decorrelating experience for 512 frames...
[2023-02-25 12:18:52,822][2409469] Using port 42516 on host...
[2023-02-25 12:18:52,829][2409096] Using port 40916 on host...
[2023-02-25 12:18:52,831][2409548] Using port 43016 on host...
[2023-02-25 12:18:52,844][2409389] Initialized w:17 v:16 player:0
[2023-02-25 12:18:52,846][2409389] Decorrelating experience for 512 frames...
[2023-02-25 12:18:52,861][2409405] Using port 42116 on host...
[2023-02-25 12:18:52,882][2409355] Using port 41816 on host...
[2023-02-25 12:18:52,898][2409075] Initialized w:1 v:16 player:0
[2023-02-25 12:18:52,899][2409075] Decorrelating experience for 512 frames...
[2023-02-25 12:18:52,914][2409078] Using port 40516 on host...
[2023-02-25 12:18:53,004][2409103] Using port 41116 on host...
[2023-02-25 12:18:53,025][2409485] Using port 42716 on host...
[2023-02-25 12:18:53,082][2409406] Initialized w:19 v:17 player:0
[2023-02-25 12:18:53,084][2409406] Decorrelating experience for 544 frames...
[2023-02-25 12:18:53,125][2409099] Initialized w:7 v:16 player:0
[2023-02-25 12:18:53,127][2409099] Decorrelating experience for 512 frames...
[2023-02-25 12:18:53,214][2409486] Initialized w:23 v:16 player:0
[2023-02-25 12:18:53,216][2409486] Decorrelating experience for 512 frames...
[2023-02-25 12:18:53,370][2409468] Using port 42416 on host...
[2023-02-25 12:18:53,444][2409080] Using port 40816 on host...
[2023-02-25 12:18:53,529][2409866] Initialized w:31 v:16 player:0
[2023-02-25 12:18:53,530][2409866] Decorrelating experience for 512 frames...
[2023-02-25 12:18:53,540][2409097] Initialized w:9 v:16 player:0
[2023-02-25 12:18:53,541][2409097] Decorrelating experience for 512 frames...
[2023-02-25 12:18:53,577][2409100] Initialized w:11 v:16 player:0
[2023-02-25 12:18:53,579][2409100] Decorrelating experience for 512 frames...
[2023-02-25 12:18:53,595][2409547] Initialized w:25 v:16 player:0
[2023-02-25 12:18:53,596][2409355] Initialized w:15 v:16 player:0
[2023-02-25 12:18:53,596][2409547] Decorrelating experience for 512 frames...
[2023-02-25 12:18:53,597][2409355] Decorrelating experience for 512 frames...
[2023-02-25 12:18:53,647][2409548] Initialized w:27 v:16 player:0
[2023-02-25 12:18:53,648][2409548] Decorrelating experience for 512 frames...
[2023-02-25 12:18:53,664][2409096] Initialized w:6 v:16 player:0
[2023-02-25 12:18:53,665][2409096] Decorrelating experience for 512 frames...
[2023-02-25 12:18:53,670][2409469] Initialized w:22 v:16 player:0
[2023-02-25 12:18:53,671][2409469] Decorrelating experience for 512 frames...
[2023-02-25 12:18:53,737][2409103] Initialized w:8 v:16 player:0
[2023-02-25 12:18:53,738][2409103] Decorrelating experience for 512 frames...
[2023-02-25 12:18:53,767][2409405] Initialized w:18 v:16 player:0
[2023-02-25 12:18:53,768][2409405] Decorrelating experience for 512 frames...
[2023-02-25 12:18:53,768][2409485] Initialized w:24 v:16 player:0
[2023-02-25 12:18:53,770][2409485] Decorrelating experience for 512 frames...
[2023-02-25 12:18:53,779][2409078] Initialized w:2 v:16 player:0
[2023-02-25 12:18:53,781][2409078] Decorrelating experience for 512 frames...
[2023-02-25 12:18:54,002][2409077] Using port 40617 on host...
[2023-02-25 12:18:54,010][2409373] Using port 41917 on host...
[2023-02-25 12:18:54,014][2409076] Using port 40317 on host...
[2023-02-25 12:18:54,100][2409549] Using port 42917 on host...
[2023-02-25 12:18:54,179][2409468] Initialized w:21 v:16 player:0
[2023-02-25 12:18:54,180][2409468] Decorrelating experience for 512 frames...
[2023-02-25 12:18:54,219][2409080] Initialized w:5 v:16 player:0
[2023-02-25 12:18:54,221][2409080] Decorrelating experience for 512 frames...
[2023-02-25 12:18:54,254][2409101] Using port 41317 on host...
[2023-02-25 12:18:54,310][2409596] Using port 43217 on host...
[2023-02-25 12:18:54,460][2409565] Using port 43117 on host...
[2023-02-25 12:18:54,484][2409104] Using port 41617 on host...
[2023-02-25 12:18:54,500][2409102] Using port 41517 on host...
[2023-02-25 12:18:54,570][2409407] Using port 42317 on host...
[2023-02-25 12:18:54,609][2409079] Using port 40717 on host...
[2023-02-25 12:18:54,717][2409373] Initialized w:16 v:17 player:0
[2023-02-25 12:18:54,718][2409373] Decorrelating experience for 544 frames...
[2023-02-25 12:18:54,724][2409076] Initialized w:0 v:17 player:0
[2023-02-25 12:18:54,725][2409076] Decorrelating experience for 544 frames...
[2023-02-25 12:18:54,760][2409406] Using port 42218 on host...
[2023-02-25 12:18:54,783][2409389] Using port 42017 on host...
[2023-02-25 12:18:54,798][2409075] Using port 40417 on host...
[2023-02-25 12:18:54,844][2409105] Using port 41717 on host...
[2023-02-25 12:18:54,849][2409597] Using port 43317 on host...
[2023-02-25 12:18:54,925][2409077] Initialized w:3 v:17 player:0
[2023-02-25 12:18:54,926][2409077] Decorrelating experience for 544 frames...
[2023-02-25 12:18:54,950][2409099] Using port 41017 on host...
[2023-02-25 12:18:54,971][2409549] Initialized w:26 v:17 player:0
[2023-02-25 12:18:54,973][2409549] Decorrelating experience for 544 frames...
[2023-02-25 12:18:55,047][2409486] Using port 42617 on host...
[2023-02-25 12:18:55,068][2409101] Initialized w:10 v:17 player:0
[2023-02-25 12:18:55,069][2409101] Decorrelating experience for 544 frames...
[2023-02-25 12:18:55,094][2409596] Initialized w:29 v:17 player:0
[2023-02-25 12:18:55,095][2409596] Decorrelating experience for 544 frames...
[2023-02-25 12:18:55,239][2409565] Initialized w:28 v:17 player:0
[2023-02-25 12:18:55,240][2409565] Decorrelating experience for 544 frames...
[2023-02-25 12:18:55,250][2409104] Initialized w:13 v:17 player:0
[2023-02-25 12:18:55,251][2409104] Decorrelating experience for 544 frames...
[2023-02-25 12:18:55,273][2409102] Initialized w:12 v:17 player:0
[2023-02-25 12:18:55,275][2409102] Decorrelating experience for 544 frames...
[2023-02-25 12:18:55,352][2409407] Initialized w:20 v:17 player:0
[2023-02-25 12:18:55,354][2409407] Decorrelating experience for 544 frames...
[2023-02-25 12:18:55,369][2409100] Using port 41417 on host...
[2023-02-25 12:18:55,393][2409866] Using port 43417 on host...
[2023-02-25 12:18:55,412][2409548] Using port 43017 on host...
[2023-02-25 12:18:55,419][2409079] Initialized w:4 v:17 player:0
[2023-02-25 12:18:55,420][2409079] Decorrelating experience for 544 frames...
[2023-02-25 12:18:55,434][2409355] Using port 41817 on host...
[2023-02-25 12:18:55,495][2409075] Initialized w:1 v:17 player:0
[2023-02-25 12:18:55,496][2409075] Decorrelating experience for 544 frames...
[2023-02-25 12:18:55,497][2409096] Using port 40917 on host...
[2023-02-25 12:18:55,502][2409389] Initialized w:17 v:17 player:0
[2023-02-25 12:18:55,503][2409389] Decorrelating experience for 544 frames...
[2023-02-25 12:18:55,562][2409105] Initialized w:14 v:17 player:0
[2023-02-25 12:18:55,563][2409105] Decorrelating experience for 544 frames...
[2023-02-25 12:18:55,568][2409597] Initialized w:30 v:17 player:0
[2023-02-25 12:18:55,570][2409597] Decorrelating experience for 544 frames...
[2023-02-25 12:18:55,572][2409469] Using port 42517 on host...
[2023-02-25 12:18:55,585][2409103] Using port 41117 on host...
[2023-02-25 12:18:55,601][2409078] Using port 40517 on host...
[2023-02-25 12:18:55,629][2409485] Using port 42717 on host...
[2023-02-25 12:18:55,665][2409097] Using port 41217 on host...
[2023-02-25 12:18:55,682][2409405] Using port 42117 on host...
[2023-02-25 12:18:55,690][2409406] Initialized w:19 v:18 player:0
[2023-02-25 12:18:55,692][2409406] Decorrelating experience for 576 frames...
[2023-02-25 12:18:55,708][2409547] Using port 42817 on host...
[2023-02-25 12:18:55,744][2409099] Initialized w:7 v:17 player:0
[2023-02-25 12:18:55,745][2409099] Decorrelating experience for 544 frames...
[2023-02-25 12:18:55,799][2409486] Initialized w:23 v:17 player:0
[2023-02-25 12:18:55,800][2409486] Decorrelating experience for 544 frames...
[2023-02-25 12:18:56,156][2409866] Initialized w:31 v:17 player:0
[2023-02-25 12:18:56,157][2409866] Decorrelating experience for 544 frames...
[2023-02-25 12:18:56,178][2409355] Initialized w:15 v:17 player:0
[2023-02-25 12:18:56,179][2409355] Decorrelating experience for 544 frames...
[2023-02-25 12:18:56,227][2409468] Using port 42417 on host...
[2023-02-25 12:18:56,241][2409548] Initialized w:27 v:17 player:0
[2023-02-25 12:18:56,242][2409548] Decorrelating experience for 544 frames...
[2023-02-25 12:18:56,246][2409100] Initialized w:11 v:17 player:0
[2023-02-25 12:18:56,248][2409100] Decorrelating experience for 544 frames...
[2023-02-25 12:18:56,262][2409080] Using port 40817 on host...
[2023-02-25 12:18:56,306][2409103] Initialized w:8 v:17 player:0
[2023-02-25 12:18:56,307][2409103] Decorrelating experience for 544 frames...
[2023-02-25 12:18:56,342][2409096] Initialized w:6 v:17 player:0
[2023-02-25 12:18:56,344][2409096] Decorrelating experience for 544 frames...
[2023-02-25 12:18:56,380][2409485] Initialized w:24 v:17 player:0
[2023-02-25 12:18:56,382][2409485] Decorrelating experience for 544 frames...
[2023-02-25 12:18:56,409][2409469] Initialized w:22 v:17 player:0
[2023-02-25 12:18:56,410][2409469] Decorrelating experience for 544 frames...
[2023-02-25 12:18:56,415][2409097] Initialized w:9 v:17 player:0
[2023-02-25 12:18:56,416][2409097] Decorrelating experience for 544 frames...
[2023-02-25 12:18:56,433][2409547] Initialized w:25 v:17 player:0
[2023-02-25 12:18:56,434][2409547] Decorrelating experience for 544 frames...
[2023-02-25 12:18:56,569][2409373] Using port 41918 on host...
[2023-02-25 12:18:56,583][2409077] Using port 40618 on host...
[2023-02-25 12:18:56,602][2409076] Using port 40318 on host...
[2023-02-25 12:18:56,751][2409078] Initialized w:2 v:17 player:0
[2023-02-25 12:18:56,753][2409078] Decorrelating experience for 544 frames...
[2023-02-25 12:18:56,779][2409405] Initialized w:18 v:17 player:0
[2023-02-25 12:18:56,781][2409405] Decorrelating experience for 544 frames...
[2023-02-25 12:18:56,892][2409549] Using port 42918 on host...
[2023-02-25 12:18:56,915][2409596] Using port 43218 on host...
[2023-02-25 12:18:56,983][2409101] Using port 41318 on host...
[2023-02-25 12:18:56,988][2409468] Initialized w:21 v:17 player:0
[2023-02-25 12:18:56,989][2409468] Decorrelating experience for 544 frames...
[2023-02-25 12:18:57,000][2409080] Initialized w:5 v:17 player:0
[2023-02-25 12:18:57,003][2409080] Decorrelating experience for 544 frames...
[2023-02-25 12:18:57,094][2409104] Using port 41618 on host...
[2023-02-25 12:18:57,186][2408954] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0)
[2023-02-25 12:18:57,252][2409407] Using port 42318 on host...
[2023-02-25 12:18:57,288][2409373] Initialized w:16 v:18 player:0
[2023-02-25 12:18:57,290][2409373] Decorrelating experience for 576 frames...
[2023-02-25 12:18:57,290][2409079] Using port 40718 on host...
[2023-02-25 12:18:57,310][2409076] Initialized w:0 v:18 player:0
[2023-02-25 12:18:57,311][2409076] Decorrelating experience for 576 frames...
[2023-02-25 12:18:57,436][2409406] Using port 42219 on host...
[2023-02-25 12:18:57,441][2409565] Using port 43118 on host...
[2023-02-25 12:18:57,458][2409102] Using port 41518 on host...
[2023-02-25 12:18:57,459][2409389] Using port 42018 on host...
[2023-02-25 12:18:57,497][2409077] Initialized w:3 v:18 player:0
[2023-02-25 12:18:57,498][2409077] Decorrelating experience for 576 frames...
[2023-02-25 12:18:57,504][2409597] Using port 43318 on host...
[2023-02-25 12:18:57,522][2409105] Using port 41718 on host...
[2023-02-25 12:18:57,536][2409075] Using port 40418 on host...
[2023-02-25 12:18:57,626][2409549] Initialized w:26 v:18 player:0
[2023-02-25 12:18:57,627][2409549] Decorrelating experience for 576 frames...
[2023-02-25 12:18:57,691][2409101] Initialized w:10 v:18 player:0
[2023-02-25 12:18:57,692][2409101] Decorrelating experience for 576 frames...
[2023-02-25 12:18:57,717][2409596] Initialized w:29 v:18 player:0
[2023-02-25 12:18:57,718][2409596] Decorrelating experience for 576 frames...
[2023-02-25 12:18:57,752][2409099] Using port 41018 on host...
[2023-02-25 12:18:57,805][2409486] Using port 42618 on host...
[2023-02-25 12:18:57,841][2409104] Initialized w:13 v:18 player:0
[2023-02-25 12:18:57,843][2409104] Decorrelating experience for 576 frames...
[2023-02-25 12:18:58,024][2409407] Initialized w:20 v:18 player:0
[2023-02-25 12:18:58,026][2409407] Decorrelating experience for 576 frames...
[2023-02-25 12:18:58,049][2409079] Initialized w:4 v:18 player:0
[2023-02-25 12:18:58,051][2409079] Decorrelating experience for 576 frames...
[2023-02-25 12:18:58,098][2409866] Using port 43418 on host...
[2023-02-25 12:18:58,114][2409548] Using port 43018 on host...
[2023-02-25 12:18:58,141][2409100] Using port 41418 on host...
[2023-02-25 12:18:58,142][2409355] Using port 41818 on host...
[2023-02-25 12:18:58,191][2409103] Using port 41118 on host...
[2023-02-25 12:18:58,191][2409565] Initialized w:28 v:18 player:0
[2023-02-25 12:18:58,192][2409565] Decorrelating experience for 576 frames...
[2023-02-25 12:18:58,201][2409102] Initialized w:12 v:18 player:0
[2023-02-25 12:18:58,203][2409102] Decorrelating experience for 576 frames...
[2023-02-25 12:18:58,228][2409389] Initialized w:17 v:18 player:0
[2023-02-25 12:18:58,230][2409389] Decorrelating experience for 576 frames...
[2023-02-25 12:18:58,231][2409105] Initialized w:14 v:18 player:0
[2023-02-25 12:18:58,232][2409105] Decorrelating experience for 576 frames...
[2023-02-25 12:18:58,236][2409597] Initialized w:30 v:18 player:0
[2023-02-25 12:18:58,237][2409597] Decorrelating experience for 576 frames...
[2023-02-25 12:18:58,248][2409075] Initialized w:1 v:18 player:0
[2023-02-25 12:18:58,250][2409075] Decorrelating experience for 576 frames...
[2023-02-25 12:18:58,250][2409485] Using port 42718 on host...
[2023-02-25 12:18:58,259][2409096] Using port 40918 on host...
[2023-02-25 12:18:58,301][2409469] Using port 42518 on host...
[2023-02-25 12:18:58,374][2409406] Initialized w:19 v:19 player:0
[2023-02-25 12:18:58,375][2409406] Decorrelating experience for 608 frames...
[2023-02-25 12:18:58,563][2409547] Using port 42818 on host...
[2023-02-25 12:18:58,589][2409097] Using port 41218 on host...
[2023-02-25 12:18:58,607][2409099] Initialized w:7 v:18 player:0
[2023-02-25 12:18:58,615][2409099] Decorrelating experience for 576 frames...
[2023-02-25 12:18:58,621][2409078] Using port 40518 on host...
[2023-02-25 12:18:58,659][2409405] Using port 42118 on host...
[2023-02-25 12:18:58,673][2409486] Initialized w:23 v:18 player:0
[2023-02-25 12:18:58,675][2409486] Decorrelating experience for 576 frames...
[2023-02-25 12:18:58,852][2409548] Initialized w:27 v:18 player:0
[2023-02-25 12:18:58,853][2409548] Decorrelating experience for 576 frames...
[2023-02-25 12:18:58,864][2409468] Using port 42418 on host...
[2023-02-25 12:18:58,884][2409866] Initialized w:31 v:18 player:0
[2023-02-25 12:18:58,885][2409866] Decorrelating experience for 576 frames...
[2023-02-25 12:18:58,899][2409355] Initialized w:15 v:18 player:0
[2023-02-25 12:18:58,901][2409355] Decorrelating experience for 576 frames...
[2023-02-25 12:18:58,924][2409103] Initialized w:8 v:18 player:0
[2023-02-25 12:18:58,925][2409103] Decorrelating experience for 576 frames...
[2023-02-25 12:18:58,988][2409080] Using port 40818 on host...
[2023-02-25 12:18:58,989][2409100] Initialized w:11 v:18 player:0
[2023-02-25 12:18:58,990][2409100] Decorrelating experience for 576 frames...
[2023-02-25 12:18:59,001][2409485] Initialized w:24 v:18 player:0
[2023-02-25 12:18:59,002][2409485] Decorrelating experience for 576 frames...
[2023-02-25 12:18:59,086][2409469] Initialized w:22 v:18 player:0
[2023-02-25 12:18:59,089][2409096] Initialized w:6 v:18 player:0
[2023-02-25 12:18:59,088][2409469] Decorrelating experience for 576 frames...
[2023-02-25 12:18:59,091][2409096] Decorrelating experience for 576 frames...
[2023-02-25 12:18:59,282][2409077] Using port 40619 on host...
[2023-02-25 12:18:59,318][2409373] Using port 41919 on host...
[2023-02-25 12:18:59,323][2409076] Using port 40319 on host...
[2023-02-25 12:18:59,378][2409547] Initialized w:25 v:18 player:0
[2023-02-25 12:18:59,381][2409547] Decorrelating experience for 576 frames...
[2023-02-25 12:18:59,386][2409097] Initialized w:9 v:18 player:0
[2023-02-25 12:18:59,387][2409097] Decorrelating experience for 576 frames...
[2023-02-25 12:18:59,632][2409101] Using port 41319 on host...
[2023-02-25 12:18:59,634][2409078] Initialized w:2 v:18 player:0
[2023-02-25 12:18:59,637][2409078] Decorrelating experience for 576 frames...
[2023-02-25 12:18:59,636][2409468] Initialized w:21 v:18 player:0
[2023-02-25 12:18:59,639][2409468] Decorrelating experience for 576 frames...
[2023-02-25 12:18:59,651][2409549] Using port 42919 on host...
[2023-02-25 12:18:59,682][2409596] Using port 43219 on host...
[2023-02-25 12:18:59,700][2409080] Initialized w:5 v:18 player:0
[2023-02-25 12:18:59,701][2409405] Initialized w:18 v:18 player:0
[2023-02-25 12:18:59,703][2409405] Decorrelating experience for 576 frames...
[2023-02-25 12:18:59,702][2409080] Decorrelating experience for 576 frames...
[2023-02-25 12:18:59,826][2409104] Using port 41619 on host...
[2023-02-25 12:19:00,035][2409076] Initialized w:0 v:19 player:0
[2023-02-25 12:19:00,036][2409076] Decorrelating experience for 608 frames...
[2023-02-25 12:19:00,041][2409373] Initialized w:16 v:19 player:0
[2023-02-25 12:19:00,042][2409373] Decorrelating experience for 608 frames...
[2023-02-25 12:19:00,159][2409102] Using port 41519 on host...
[2023-02-25 12:19:00,192][2409077] Initialized w:3 v:19 player:0
[2023-02-25 12:19:00,194][2409077] Decorrelating experience for 608 frames...
[2023-02-25 12:19:00,204][2409565] Using port 43119 on host...
[2023-02-25 12:19:00,223][2409406] Using port 42220 on host...
[2023-02-25 12:19:00,281][2409597] Using port 43319 on host...
[2023-02-25 12:19:00,354][2409101] Initialized w:10 v:19 player:0
[2023-02-25 12:19:00,356][2409101] Decorrelating experience for 608 frames...
[2023-02-25 12:19:00,364][2409549] Initialized w:26 v:19 player:0
[2023-02-25 12:19:00,365][2409549] Decorrelating experience for 608 frames...
[2023-02-25 12:19:00,380][2409407] Using port 42319 on host...
[2023-02-25 12:19:00,382][2409079] Using port 40719 on host...
[2023-02-25 12:19:00,385][2409105] Using port 41719 on host...
[2023-02-25 12:19:00,465][2409596] Initialized w:29 v:19 player:0
[2023-02-25 12:19:00,467][2409596] Decorrelating experience for 608 frames...
[2023-02-25 12:19:00,517][2409389] Using port 42019 on host...
[2023-02-25 12:19:00,551][2409104] Initialized w:13 v:19 player:0
[2023-02-25 12:19:00,553][2409104] Decorrelating experience for 608 frames...
[2023-02-25 12:19:00,557][2409075] Using port 40419 on host...
[2023-02-25 12:19:00,791][2409099] Using port 41019 on host...
[2023-02-25 12:19:00,799][2409486] Using port 42619 on host...
[2023-02-25 12:19:00,917][2409102] Initialized w:12 v:19 player:0
[2023-02-25 12:19:00,919][2409102] Decorrelating experience for 608 frames...
[2023-02-25 12:19:00,923][2409548] Using port 43019 on host...
[2023-02-25 12:19:00,968][2409355] Using port 41819 on host...
[2023-02-25 12:19:00,987][2409565] Initialized w:28 v:19 player:0
[2023-02-25 12:19:00,989][2409565] Decorrelating experience for 608 frames...
[2023-02-25 12:19:01,007][2409866] Using port 43419 on host...
[2023-02-25 12:19:01,017][2409100] Using port 41419 on host...
[2023-02-25 12:19:01,056][2409597] Initialized w:30 v:19 player:0
[2023-02-25 12:19:01,058][2409597] Decorrelating experience for 608 frames...
[2023-02-25 12:19:01,119][2409079] Initialized w:4 v:19 player:0
[2023-02-25 12:19:01,122][2409079] Decorrelating experience for 608 frames...
[2023-02-25 12:19:01,121][2409105] Initialized w:14 v:19 player:0
[2023-02-25 12:19:01,123][2409105] Decorrelating experience for 608 frames...
[2023-02-25 12:19:01,125][2409103] Using port 41119 on host...
[2023-02-25 12:19:01,129][2409485] Using port 42719 on host...
[2023-02-25 12:19:01,140][2409407] Initialized w:20 v:19 player:0
[2023-02-25 12:19:01,141][2409407] Decorrelating experience for 608 frames...
[2023-02-25 12:19:01,184][2409406] Initialized w:19 v:20 player:0
[2023-02-25 12:19:01,185][2409406] Decorrelating experience for 640 frames...
[2023-02-25 12:19:01,244][2409096] Using port 40919 on host...
[2023-02-25 12:19:01,251][2409389] Initialized w:17 v:19 player:0
[2023-02-25 12:19:01,252][2409389] Decorrelating experience for 608 frames...
[2023-02-25 12:19:01,272][2409469] Using port 42519 on host...
[2023-02-25 12:19:01,275][2409075] Initialized w:1 v:19 player:0
[2023-02-25 12:19:01,276][2409075] Decorrelating experience for 608 frames...
[2023-02-25 12:19:01,548][2409099] Initialized w:7 v:19 player:0
[2023-02-25 12:19:01,552][2409486] Initialized w:23 v:19 player:0
[2023-02-25 12:19:01,550][2409099] Decorrelating experience for 608 frames...
[2023-02-25 12:19:01,554][2409486] Decorrelating experience for 608 frames...
[2023-02-25 12:19:01,622][2409547] Using port 42819 on host...
[2023-02-25 12:19:01,655][2409097] Using port 41219 on host...
[2023-02-25 12:19:01,657][2409548] Initialized w:27 v:19 player:0
[2023-02-25 12:19:01,664][2409548] Decorrelating experience for 608 frames...
[2023-02-25 12:19:01,671][2409078] Using port 40519 on host...
[2023-02-25 12:19:01,699][2409468] Using port 42419 on host...
[2023-02-25 12:19:01,724][2409100] Initialized w:11 v:19 player:0
[2023-02-25 12:19:01,726][2409100] Decorrelating experience for 608 frames...
[2023-02-25 12:19:01,739][2409355] Initialized w:15 v:19 player:0
[2023-02-25 12:19:01,740][2409355] Decorrelating experience for 608 frames...
[2023-02-25 12:19:01,755][2409866] Initialized w:31 v:19 player:0
[2023-02-25 12:19:01,756][2409866] Decorrelating experience for 608 frames...
[2023-02-25 12:19:01,783][2409080] Using port 40819 on host...
[2023-02-25 12:19:01,923][2409103] Initialized w:8 v:19 player:0
[2023-02-25 12:19:01,926][2409485] Initialized w:24 v:19 player:0
[2023-02-25 12:19:01,924][2409103] Decorrelating experience for 608 frames...
[2023-02-25 12:19:01,928][2409485] Decorrelating experience for 608 frames...
[2023-02-25 12:19:01,944][2409077] Using port 40620 on host...
[2023-02-25 12:19:02,032][2409405] Using port 42119 on host...
[2023-02-25 12:19:02,079][2409096] Initialized w:6 v:19 player:0
[2023-02-25 12:19:02,080][2409096] Decorrelating experience for 608 frames...
[2023-02-25 12:19:02,103][2409469] Initialized w:22 v:19 player:0
[2023-02-25 12:19:02,104][2409469] Decorrelating experience for 608 frames...
[2023-02-25 12:19:02,176][2409076] Using port 40320 on host...
[2023-02-25 12:19:02,191][2408954] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0)
[2023-02-25 12:19:02,257][2409373] Using port 41920 on host...
[2023-02-25 12:19:02,424][2409547] Initialized w:25 v:19 player:0
[2023-02-25 12:19:02,426][2409547] Decorrelating experience for 608 frames...
[2023-02-25 12:19:02,432][2409097] Initialized w:9 v:19 player:0
[2023-02-25 12:19:02,434][2409097] Decorrelating experience for 608 frames...
[2023-02-25 12:19:02,450][2409468] Initialized w:21 v:19 player:0
[2023-02-25 12:19:02,451][2409468] Decorrelating experience for 608 frames...
[2023-02-25 12:19:02,457][2409101] Using port 41320 on host...
[2023-02-25 12:19:02,508][2409549] Using port 42920 on host...
[2023-02-25 12:19:02,509][2409080] Initialized w:5 v:19 player:0
[2023-02-25 12:19:02,511][2409080] Decorrelating experience for 608 frames...
[2023-02-25 12:19:02,548][2409596] Using port 43220 on host...
[2023-02-25 12:19:02,668][2409104] Using port 41620 on host...
[2023-02-25 12:19:02,859][2409078] Initialized w:2 v:19 player:0
[2023-02-25 12:19:02,861][2409078] Decorrelating experience for 608 frames...
[2023-02-25 12:19:02,882][2409077] Initialized w:3 v:20 player:0
[2023-02-25 12:19:02,884][2409077] Decorrelating experience for 640 frames...
[2023-02-25 12:19:02,935][2409405] Initialized w:18 v:19 player:0
[2023-02-25 12:19:02,937][2409405] Decorrelating experience for 608 frames...
[2023-02-25 12:19:02,967][2409076] Initialized w:0 v:20 player:0
[2023-02-25 12:19:02,968][2409076] Decorrelating experience for 640 frames...
[2023-02-25 12:19:03,007][2409373] Initialized w:16 v:20 player:0
[2023-02-25 12:19:03,008][2409373] Decorrelating experience for 640 frames...
[2023-02-25 12:19:03,038][2409406] Using port 42221 on host...
[2023-02-25 12:19:03,038][2409102] Using port 41520 on host...
[2023-02-25 12:19:03,110][2409565] Using port 43120 on host...
[2023-02-25 12:19:03,211][2409101] Initialized w:10 v:20 player:0
[2023-02-25 12:19:03,212][2409101] Decorrelating experience for 640 frames...
[2023-02-25 12:19:03,242][2409597] Using port 43320 on host...
[2023-02-25 12:19:03,251][2409549] Initialized w:26 v:20 player:0
[2023-02-25 12:19:03,252][2409549] Decorrelating experience for 640 frames...
[2023-02-25 12:19:03,310][2409075] Using port 40420 on host...
[2023-02-25 12:19:03,318][2409596] Initialized w:29 v:20 player:0
[2023-02-25 12:19:03,319][2409596] Decorrelating experience for 640 frames...
[2023-02-25 12:19:03,352][2409105] Using port 41720 on host...
[2023-02-25 12:19:03,377][2409389] Using port 42020 on host...
[2023-02-25 12:19:03,394][2409104] Initialized w:13 v:20 player:0
[2023-02-25 12:19:03,395][2409104] Decorrelating experience for 640 frames...
[2023-02-25 12:19:03,563][2409079] Using port 40720 on host...
[2023-02-25 12:19:03,615][2409407] Using port 42320 on host...
[2023-02-25 12:19:03,790][2409486] Using port 42620 on host...
[2023-02-25 12:19:03,803][2409102] Initialized w:12 v:20 player:0
[2023-02-25 12:19:03,804][2409102] Decorrelating experience for 640 frames...
[2023-02-25 12:19:03,813][2409099] Using port 41020 on host...
[2023-02-25 12:19:03,862][2409565] Initialized w:28 v:20 player:0
[2023-02-25 12:19:03,863][2409565] Decorrelating experience for 640 frames...
[2023-02-25 12:19:03,914][2409548] Using port 43020 on host...
[2023-02-25 12:19:03,976][2409355] Using port 41820 on host...
[2023-02-25 12:19:03,981][2409406] Initialized w:19 v:21 player:0
[2023-02-25 12:19:03,982][2409866] Using port 43420 on host...
[2023-02-25 12:19:03,983][2409406] Decorrelating experience for 672 frames...
[2023-02-25 12:19:04,017][2409100] Using port 41420 on host...
[2023-02-25 12:19:04,019][2409597] Initialized w:30 v:20 player:0
[2023-02-25 12:19:04,021][2409597] Decorrelating experience for 640 frames...
[2023-02-25 12:19:04,071][2409075] Initialized w:1 v:20 player:0
[2023-02-25 12:19:04,072][2409075] Decorrelating experience for 640 frames...
[2023-02-25 12:19:04,082][2409105] Initialized w:14 v:20 player:0
[2023-02-25 12:19:04,083][2409105] Decorrelating experience for 640 frames...
[2023-02-25 12:19:04,104][2409389] Initialized w:17 v:20 player:0
[2023-02-25 12:19:04,106][2409389] Decorrelating experience for 640 frames...
[2023-02-25 12:19:04,297][2409079] Initialized w:4 v:20 player:0
[2023-02-25 12:19:04,299][2409079] Decorrelating experience for 640 frames...
[2023-02-25 12:19:04,302][2409485] Using port 42720 on host...
[2023-02-25 12:19:04,301][2409469] Using port 42520 on host...
[2023-02-25 12:19:04,322][2409103] Using port 41120 on host...
[2023-02-25 12:19:04,351][2409407] Initialized w:20 v:20 player:0
[2023-02-25 12:19:04,352][2409407] Decorrelating experience for 640 frames...
[2023-02-25 12:19:04,384][2409096] Using port 40920 on host...
[2023-02-25 12:19:04,528][2409486] Initialized w:23 v:20 player:0
[2023-02-25 12:19:04,529][2409486] Decorrelating experience for 640 frames...
[2023-02-25 12:19:04,645][2409099] Initialized w:7 v:20 player:0
[2023-02-25 12:19:04,647][2409099] Decorrelating experience for 640 frames...
[2023-02-25 12:19:04,649][2409548] Initialized w:27 v:20 player:0
[2023-02-25 12:19:04,650][2409548] Decorrelating experience for 640 frames...
[2023-02-25 12:19:04,732][2409866] Initialized w:31 v:20 player:0
[2023-02-25 12:19:04,733][2409866] Decorrelating experience for 640 frames...
[2023-02-25 12:19:04,734][2409355] Initialized w:15 v:20 player:0
[2023-02-25 12:19:04,735][2409355] Decorrelating experience for 640 frames...
[2023-02-25 12:19:04,738][2409100] Initialized w:11 v:20 player:0
[2023-02-25 12:19:04,740][2409100] Decorrelating experience for 640 frames...
[2023-02-25 12:19:04,781][2409080] Using port 40820 on host...
[2023-02-25 12:19:04,820][2409468] Using port 42420 on host...
[2023-02-25 12:19:04,821][2409077] Using port 40621 on host...
[2023-02-25 12:19:04,968][2409078] Using port 40520 on host...
[2023-02-25 12:19:05,017][2409547] Using port 42820 on host...
[2023-02-25 12:19:05,022][2409405] Using port 42120 on host...
[2023-02-25 12:19:05,052][2409469] Initialized w:22 v:20 player:0
[2023-02-25 12:19:05,054][2409469] Decorrelating experience for 640 frames...
[2023-02-25 12:19:05,088][2409096] Initialized w:6 v:20 player:0
[2023-02-25 12:19:05,090][2409096] Decorrelating experience for 640 frames...
[2023-02-25 12:19:05,093][2409097] Using port 41220 on host...
[2023-02-25 12:19:05,187][2409485] Initialized w:24 v:20 player:0
[2023-02-25 12:19:05,189][2409485] Decorrelating experience for 640 frames...
[2023-02-25 12:19:05,218][2409103] Initialized w:8 v:20 player:0
[2023-02-25 12:19:05,220][2409103] Decorrelating experience for 640 frames...
[2023-02-25 12:19:05,399][2409101] Using port 41321 on host...
[2023-02-25 12:19:05,492][2409549] Using port 42921 on host...
[2023-02-25 12:19:05,648][2409080] Initialized w:5 v:20 player:0
[2023-02-25 12:19:05,649][2409080] Decorrelating experience for 640 frames...
[2023-02-25 12:19:05,657][2409468] Initialized w:21 v:20 player:0
[2023-02-25 12:19:05,659][2409468] Decorrelating experience for 640 frames...
[2023-02-25 12:19:05,741][2409076] Using port 40321 on host...
[2023-02-25 12:19:05,749][2409077] Initialized w:3 v:21 player:0
[2023-02-25 12:19:05,751][2409077] Decorrelating experience for 672 frames...
[2023-02-25 12:19:05,772][2409373] Using port 41921 on host...
[2023-02-25 12:19:05,780][2409547] Initialized w:25 v:20 player:0
[2023-02-25 12:19:05,782][2409547] Decorrelating experience for 640 frames...
[2023-02-25 12:19:05,792][2409596] Using port 43221 on host...
[2023-02-25 12:19:05,825][2409104] Using port 41621 on host...
[2023-02-25 12:19:05,827][2409078] Initialized w:2 v:20 player:0
[2023-02-25 12:19:05,829][2409078] Decorrelating experience for 640 frames...
[2023-02-25 12:19:05,844][2409097] Initialized w:9 v:20 player:0
[2023-02-25 12:19:05,846][2409097] Decorrelating experience for 640 frames...
[2023-02-25 12:19:05,858][2409405] Initialized w:18 v:20 player:0
[2023-02-25 12:19:05,860][2409405] Decorrelating experience for 640 frames...
[2023-02-25 12:19:05,976][2409406] Using port 42222 on host...
[2023-02-25 12:19:06,033][2409102] Using port 41521 on host...
[2023-02-25 12:19:06,057][2409565] Using port 43121 on host...
[2023-02-25 12:19:06,168][2409101] Initialized w:10 v:21 player:0
[2023-02-25 12:19:06,171][2409101] Decorrelating experience for 672 frames...
[2023-02-25 12:19:06,238][2409549] Initialized w:26 v:21 player:0
[2023-02-25 12:19:06,239][2409549] Decorrelating experience for 672 frames...
[2023-02-25 12:19:06,243][2409075] Using port 40421 on host...
[2023-02-25 12:19:06,260][2409597] Using port 43321 on host...
[2023-02-25 12:19:06,357][2409389] Using port 42021 on host...
[2023-02-25 12:19:06,377][2409105] Using port 41721 on host...
[2023-02-25 12:19:06,463][2409076] Initialized w:0 v:21 player:0
[2023-02-25 12:19:06,465][2409076] Decorrelating experience for 672 frames...
[2023-02-25 12:19:06,477][2409373] Initialized w:16 v:21 player:0
[2023-02-25 12:19:06,478][2409373] Decorrelating experience for 672 frames...
[2023-02-25 12:19:06,537][2409596] Initialized w:29 v:21 player:0
[2023-02-25 12:19:06,539][2409596] Decorrelating experience for 672 frames...
[2023-02-25 12:19:06,548][2409104] Initialized w:13 v:21 player:0
[2023-02-25 12:19:06,549][2409104] Decorrelating experience for 672 frames...
[2023-02-25 12:19:06,570][2409407] Using port 42321 on host...
[2023-02-25 12:19:06,624][2409079] Using port 40721 on host...
[2023-02-25 12:19:06,674][2409486] Using port 42621 on host...
[2023-02-25 12:19:06,777][2409102] Initialized w:12 v:21 player:0
[2023-02-25 12:19:06,778][2409102] Decorrelating experience for 672 frames...
[2023-02-25 12:19:06,799][2409565] Initialized w:28 v:21 player:0
[2023-02-25 12:19:06,801][2409565] Decorrelating experience for 672 frames...
[2023-02-25 12:19:06,816][2409099] Using port 41021 on host...
[2023-02-25 12:19:06,913][2409406] Initialized w:19 v:22 player:0
[2023-02-25 12:19:06,914][2409406] Decorrelating experience for 704 frames...
[2023-02-25 12:19:06,991][2409075] Initialized w:1 v:21 player:0
[2023-02-25 12:19:06,991][2409548] Using port 43021 on host...
[2023-02-25 12:19:06,992][2409075] Decorrelating experience for 672 frames...
[2023-02-25 12:19:07,012][2409597] Initialized w:30 v:21 player:0
[2023-02-25 12:19:07,013][2409597] Decorrelating experience for 672 frames...
[2023-02-25 12:19:07,068][2409389] Initialized w:17 v:21 player:0
[2023-02-25 12:19:07,070][2409389] Decorrelating experience for 672 frames...
[2023-02-25 12:19:07,075][2409866] Using port 43421 on host...
[2023-02-25 12:19:07,077][2409105] Initialized w:14 v:21 player:0
[2023-02-25 12:19:07,079][2409105] Decorrelating experience for 672 frames...
[2023-02-25 12:19:07,084][2409100] Using port 41421 on host...
[2023-02-25 12:19:07,093][2409355] Using port 41821 on host...
[2023-02-25 12:19:07,186][2408954] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0)
[2023-02-25 12:19:07,315][2409407] Initialized w:20 v:21 player:0
[2023-02-25 12:19:07,316][2409407] Decorrelating experience for 672 frames...
[2023-02-25 12:19:07,337][2409079] Initialized w:4 v:21 player:0
[2023-02-25 12:19:07,339][2409079] Decorrelating experience for 672 frames...
[2023-02-25 12:19:07,466][2409103] Using port 41121 on host...
[2023-02-25 12:19:07,470][2409486] Initialized w:23 v:21 player:0
[2023-02-25 12:19:07,472][2409486] Decorrelating experience for 672 frames...
[2023-02-25 12:19:07,541][2409469] Using port 42521 on host...
[2023-02-25 12:19:07,550][2409099] Initialized w:7 v:21 player:0
[2023-02-25 12:19:07,565][2409099] Decorrelating experience for 672 frames...
[2023-02-25 12:19:07,568][2409485] Using port 42721 on host...
[2023-02-25 12:19:07,594][2409096] Using port 40921 on host...
[2023-02-25 12:19:07,734][2409548] Initialized w:27 v:21 player:0
[2023-02-25 12:19:07,736][2409548] Decorrelating experience for 672 frames...
[2023-02-25 12:19:07,821][2409100] Initialized w:11 v:21 player:0
[2023-02-25 12:19:07,823][2409100] Decorrelating experience for 672 frames...
[2023-02-25 12:19:07,834][2409866] Initialized w:31 v:21 player:0
[2023-02-25 12:19:07,837][2409355] Initialized w:15 v:21 player:0
[2023-02-25 12:19:07,836][2409866] Decorrelating experience for 672 frames...
[2023-02-25 12:19:07,839][2409355] Decorrelating experience for 672 frames...
[2023-02-25 12:19:07,844][2409077] Using port 40622 on host...
[2023-02-25 12:19:07,975][2409468] Using port 42421 on host...
[2023-02-25 12:19:07,997][2409080] Using port 40821 on host...
[2023-02-25 12:19:08,039][2409078] Using port 40521 on host...
[2023-02-25 12:19:08,049][2409405] Using port 42121 on host...
[2023-02-25 12:19:08,124][2409547] Using port 42821 on host...
[2023-02-25 12:19:08,195][2409097] Using port 41221 on host...
[2023-02-25 12:19:08,229][2409103] Initialized w:8 v:21 player:0
[2023-02-25 12:19:08,231][2409103] Decorrelating experience for 672 frames...
[2023-02-25 12:19:08,301][2409485] Initialized w:24 v:21 player:0
[2023-02-25 12:19:08,302][2409485] Decorrelating experience for 672 frames...
[2023-02-25 12:19:08,382][2409469] Initialized w:22 v:21 player:0
[2023-02-25 12:19:08,383][2409469] Decorrelating experience for 672 frames...
[2023-02-25 12:19:08,396][2409096] Initialized w:6 v:21 player:0
[2023-02-25 12:19:08,398][2409096] Decorrelating experience for 672 frames...
[2023-02-25 12:19:08,460][2409101] Using port 41322 on host...
[2023-02-25 12:19:08,571][2409549] Using port 42922 on host...
[2023-02-25 12:19:08,724][2409468] Initialized w:21 v:21 player:0
[2023-02-25 12:19:08,726][2409468] Decorrelating experience for 672 frames...
[2023-02-25 12:19:08,732][2409080] Initialized w:5 v:21 player:0
[2023-02-25 12:19:08,733][2409080] Decorrelating experience for 672 frames...
[2023-02-25 12:19:08,796][2409405] Initialized w:18 v:21 player:0
[2023-02-25 12:19:08,797][2409405] Decorrelating experience for 672 frames...
[2023-02-25 12:19:08,798][2409078] Initialized w:2 v:21 player:0
[2023-02-25 12:19:08,800][2409078] Decorrelating experience for 672 frames...
[2023-02-25 12:19:08,887][2409547] Initialized w:25 v:21 player:0
[2023-02-25 12:19:08,888][2409547] Decorrelating experience for 672 frames...
[2023-02-25 12:19:08,890][2409596] Using port 43222 on host...
[2023-02-25 12:19:08,940][2409097] Initialized w:9 v:21 player:0
[2023-02-25 12:19:08,941][2409097] Decorrelating experience for 672 frames...
[2023-02-25 12:19:08,967][2409373] Using port 41922 on host...
[2023-02-25 12:19:08,973][2409104] Using port 41622 on host...
[2023-02-25 12:19:09,000][2409076] Using port 40322 on host...
[2023-02-25 12:19:09,140][2409077] Initialized w:3 v:22 player:0
[2023-02-25 12:19:09,141][2409077] Decorrelating experience for 704 frames...
[2023-02-25 12:19:09,149][2409102] Using port 41522 on host...
[2023-02-25 12:19:09,181][2409565] Using port 43122 on host...
[2023-02-25 12:19:09,255][2409075] Using port 40422 on host...
[2023-02-25 12:19:09,268][2409101] Initialized w:10 v:22 player:0
[2023-02-25 12:19:09,270][2409101] Decorrelating experience for 704 frames...
[2023-02-25 12:19:09,291][2409549] Initialized w:26 v:22 player:0
[2023-02-25 12:19:09,293][2409549] Decorrelating experience for 704 frames...
[2023-02-25 12:19:09,351][2409389] Using port 42022 on host...
[2023-02-25 12:19:09,416][2409105] Using port 41722 on host...
[2023-02-25 12:19:09,425][2409597] Using port 43322 on host...
[2023-02-25 12:19:09,521][2409406] Using port 42223 on host...
[2023-02-25 12:19:09,629][2409596] Initialized w:29 v:22 player:0
[2023-02-25 12:19:09,630][2409596] Decorrelating experience for 704 frames...
[2023-02-25 12:19:09,676][2409076] Initialized w:0 v:22 player:0
[2023-02-25 12:19:09,683][2409076] Decorrelating experience for 704 frames...
[2023-02-25 12:19:09,711][2409104] Initialized w:13 v:22 player:0
[2023-02-25 12:19:09,712][2409104] Decorrelating experience for 704 frames...
[2023-02-25 12:19:09,721][2409373] Initialized w:16 v:22 player:0
[2023-02-25 12:19:09,723][2409373] Decorrelating experience for 704 frames...
[2023-02-25 12:19:09,812][2409486] Using port 42622 on host...
[2023-02-25 12:19:09,873][2409102] Initialized w:12 v:22 player:0
[2023-02-25 12:19:09,874][2409102] Decorrelating experience for 704 frames...
[2023-02-25 12:19:09,883][2409565] Initialized w:28 v:22 player:0
[2023-02-25 12:19:09,885][2409565] Decorrelating experience for 704 frames...
[2023-02-25 12:19:09,943][2409099] Using port 41022 on host...
[2023-02-25 12:19:09,978][2409079] Using port 40722 on host...
[2023-02-25 12:19:09,982][2409407] Using port 42322 on host...
[2023-02-25 12:19:10,007][2409075] Initialized w:1 v:22 player:0
[2023-02-25 12:19:10,008][2409075] Decorrelating experience for 704 frames...
[2023-02-25 12:19:10,045][2409389] Initialized w:17 v:22 player:0
[2023-02-25 12:19:10,047][2409389] Decorrelating experience for 704 frames...
[2023-02-25 12:19:10,139][2409105] Initialized w:14 v:22 player:0
[2023-02-25 12:19:10,140][2409105] Decorrelating experience for 704 frames...
[2023-02-25 12:19:10,144][2409597] Initialized w:30 v:22 player:0
[2023-02-25 12:19:10,146][2409597] Decorrelating experience for 704 frames...
[2023-02-25 12:19:10,271][2409548] Using port 43022 on host...
[2023-02-25 12:19:10,276][2409100] Using port 41422 on host...
[2023-02-25 12:19:10,347][2409866] Using port 43422 on host...
[2023-02-25 12:19:10,421][2409355] Using port 41822 on host...
[2023-02-25 12:19:10,518][2409406] Initialized w:19 v:23 player:0
[2023-02-25 12:19:10,519][2409406] Decorrelating experience for 736 frames...
[2023-02-25 12:19:10,611][2409486] Initialized w:23 v:22 player:0
[2023-02-25 12:19:10,613][2409486] Decorrelating experience for 704 frames...
[2023-02-25 12:19:10,698][2409079] Initialized w:4 v:22 player:0
[2023-02-25 12:19:10,699][2409079] Decorrelating experience for 704 frames...
[2023-02-25 12:19:10,703][2409407] Initialized w:20 v:22 player:0
[2023-02-25 12:19:10,704][2409099] Initialized w:7 v:22 player:0
[2023-02-25 12:19:10,705][2409099] Decorrelating experience for 704 frames...
[2023-02-25 12:19:10,705][2409407] Decorrelating experience for 704 frames...
[2023-02-25 12:19:10,799][2409103] Using port 41122 on host...
[2023-02-25 12:19:10,962][2409469] Using port 42522 on host...
[2023-02-25 12:19:10,965][2409485] Using port 42722 on host...
[2023-02-25 12:19:10,984][2409100] Initialized w:11 v:22 player:0
[2023-02-25 12:19:10,986][2409100] Decorrelating experience for 704 frames...
[2023-02-25 12:19:10,992][2409548] Initialized w:27 v:22 player:0
[2023-02-25 12:19:10,994][2409548] Decorrelating experience for 704 frames...
[2023-02-25 12:19:11,097][2409866] Initialized w:31 v:22 player:0
[2023-02-25 12:19:11,100][2409866] Decorrelating experience for 704 frames...
[2023-02-25 12:19:11,158][2409355] Initialized w:15 v:22 player:0
[2023-02-25 12:19:11,160][2409355] Decorrelating experience for 704 frames...
[2023-02-25 12:19:11,176][2409468] Using port 42422 on host...
[2023-02-25 12:19:11,189][2409096] Using port 40922 on host...
[2023-02-25 12:19:11,200][2409080] Using port 40822 on host...
[2023-02-25 12:19:11,200][2409405] Using port 42122 on host...
[2023-02-25 12:19:11,229][2409078] Using port 40522 on host...
[2023-02-25 12:19:11,525][2409547] Using port 42822 on host...
[2023-02-25 12:19:11,559][2409103] Initialized w:8 v:22 player:0
[2023-02-25 12:19:11,560][2409103] Decorrelating experience for 704 frames...
[2023-02-25 12:19:11,628][2409097] Using port 41222 on host...
[2023-02-25 12:19:11,716][2409077] Using port 40623 on host...
[2023-02-25 12:19:11,794][2409549] Using port 42923 on host...
[2023-02-25 12:19:11,815][2409101] Using port 41323 on host...
[2023-02-25 12:19:11,826][2409485] Initialized w:24 v:22 player:0
[2023-02-25 12:19:11,827][2409485] Decorrelating experience for 704 frames...
[2023-02-25 12:19:11,930][2409405] Initialized w:18 v:22 player:0
[2023-02-25 12:19:11,932][2409405] Decorrelating experience for 704 frames...
[2023-02-25 12:19:11,943][2409080] Initialized w:5 v:22 player:0
[2023-02-25 12:19:11,945][2409080] Decorrelating experience for 704 frames...
[2023-02-25 12:19:11,952][2409468] Initialized w:21 v:22 player:0
[2023-02-25 12:19:11,953][2409469] Initialized w:22 v:22 player:0
[2023-02-25 12:19:11,954][2409468] Decorrelating experience for 704 frames...
[2023-02-25 12:19:11,955][2409469] Decorrelating experience for 704 frames...
[2023-02-25 12:19:11,996][2409078] Initialized w:2 v:22 player:0
[2023-02-25 12:19:11,997][2409078] Decorrelating experience for 704 frames...
[2023-02-25 12:19:12,033][2409096] Initialized w:6 v:22 player:0
[2023-02-25 12:19:12,034][2409096] Decorrelating experience for 704 frames...
[2023-02-25 12:19:12,106][2409596] Using port 43223 on host...
[2023-02-25 12:19:12,186][2408954] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0)
[2023-02-25 12:19:12,224][2409104] Using port 41623 on host...
[2023-02-25 12:19:12,341][2409076] Using port 40323 on host...
[2023-02-25 12:19:12,355][2409547] Initialized w:25 v:22 player:0
[2023-02-25 12:19:12,356][2409547] Decorrelating experience for 704 frames...
[2023-02-25 12:19:12,370][2409373] Using port 41923 on host...
[2023-02-25 12:19:12,397][2409102] Using port 41523 on host...
[2023-02-25 12:19:12,406][2409565] Using port 43123 on host...
[2023-02-25 12:19:12,416][2409075] Using port 40423 on host...
[2023-02-25 12:19:12,420][2409097] Initialized w:9 v:22 player:0
[2023-02-25 12:19:12,421][2409097] Decorrelating experience for 704 frames...
[2023-02-25 12:19:12,500][2409389] Using port 42023 on host...
[2023-02-25 12:19:12,508][2409549] Initialized w:26 v:23 player:0
[2023-02-25 12:19:12,510][2409549] Decorrelating experience for 736 frames...
[2023-02-25 12:19:12,533][2409101] Initialized w:10 v:23 player:0
[2023-02-25 12:19:12,534][2409101] Decorrelating experience for 736 frames...
[2023-02-25 12:19:12,676][2409077] Initialized w:3 v:23 player:0
[2023-02-25 12:19:12,692][2409077] Decorrelating experience for 736 frames...
[2023-02-25 12:19:12,723][2409597] Using port 43323 on host...
[2023-02-25 12:19:12,742][2409105] Using port 41723 on host...
[2023-02-25 12:19:12,864][2409596] Initialized w:29 v:23 player:0
[2023-02-25 12:19:12,865][2409596] Decorrelating experience for 736 frames...
[2023-02-25 12:19:12,941][2409104] Initialized w:13 v:23 player:0
[2023-02-25 12:19:12,942][2409104] Decorrelating experience for 736 frames...
[2023-02-25 12:19:13,059][2409486] Using port 42623 on host...
[2023-02-25 12:19:13,099][2409076] Initialized w:0 v:23 player:0
[2023-02-25 12:19:13,101][2409076] Decorrelating experience for 736 frames...
[2023-02-25 12:19:13,114][2408954] Heartbeat connected on RolloutWorker_w19
[2023-02-25 12:19:13,116][2409373] Initialized w:16 v:23 player:0
[2023-02-25 12:19:13,117][2409373] Decorrelating experience for 736 frames...
[2023-02-25 12:19:13,143][2409565] Initialized w:28 v:23 player:0
[2023-02-25 12:19:13,144][2409565] Decorrelating experience for 736 frames...
[2023-02-25 12:19:13,152][2409102] Initialized w:12 v:23 player:0
[2023-02-25 12:19:13,154][2409102] Decorrelating experience for 736 frames...
[2023-02-25 12:19:13,157][2409075] Initialized w:1 v:23 player:0
[2023-02-25 12:19:13,159][2409075] Decorrelating experience for 736 frames...
[2023-02-25 12:19:13,181][2409079] Using port 40723 on host...
[2023-02-25 12:19:13,193][2409099] Using port 41023 on host...
[2023-02-25 12:19:13,211][2409389] Initialized w:17 v:23 player:0
[2023-02-25 12:19:13,213][2409389] Decorrelating experience for 736 frames...
[2023-02-25 12:19:13,211][2409407] Using port 42323 on host...
[2023-02-25 12:19:13,461][2409105] Initialized w:14 v:23 player:0
[2023-02-25 12:19:13,463][2409105] Decorrelating experience for 736 frames...
[2023-02-25 12:19:13,467][2409597] Initialized w:30 v:23 player:0
[2023-02-25 12:19:13,469][2409597] Decorrelating experience for 736 frames...
[2023-02-25 12:19:13,788][2409866] Using port 43423 on host...
[2023-02-25 12:19:13,822][2409486] Initialized w:23 v:23 player:0
[2023-02-25 12:19:13,823][2409486] Decorrelating experience for 736 frames...
[2023-02-25 12:19:13,840][2409355] Using port 41823 on host...
[2023-02-25 12:19:13,895][2409099] Initialized w:7 v:23 player:0
[2023-02-25 12:19:13,897][2409099] Decorrelating experience for 736 frames...
[2023-02-25 12:19:13,914][2409079] Initialized w:4 v:23 player:0
[2023-02-25 12:19:13,916][2409079] Decorrelating experience for 736 frames...
[2023-02-25 12:19:13,921][2409407] Initialized w:20 v:23 player:0
[2023-02-25 12:19:13,923][2409407] Decorrelating experience for 736 frames...
[2023-02-25 12:19:14,094][2409103] Using port 41123 on host...
[2023-02-25 12:19:14,251][2409100] Using port 41423 on host...
[2023-02-25 12:19:14,362][2409485] Using port 42723 on host...
[2023-02-25 12:19:14,432][2409548] Using port 43023 on host...
[2023-02-25 12:19:14,479][2409469] Using port 42523 on host...
[2023-02-25 12:19:14,510][2409080] Using port 40823 on host...
[2023-02-25 12:19:14,511][2409078] Using port 40523 on host...
[2023-02-25 12:19:14,531][2409405] Using port 42123 on host...
[2023-02-25 12:19:14,544][2409468] Using port 42423 on host...
[2023-02-25 12:19:14,568][2409866] Initialized w:31 v:23 player:0
[2023-02-25 12:19:14,569][2409866] Decorrelating experience for 736 frames...
[2023-02-25 12:19:14,601][2409096] Using port 40923 on host...
[2023-02-25 12:19:14,633][2409355] Initialized w:15 v:23 player:0
[2023-02-25 12:19:14,635][2409355] Decorrelating experience for 736 frames...
[2023-02-25 12:19:14,872][2409103] Initialized w:8 v:23 player:0
[2023-02-25 12:19:14,874][2409103] Decorrelating experience for 736 frames...
[2023-02-25 12:19:14,980][2408954] Heartbeat connected on RolloutWorker_w3
[2023-02-25 12:19:15,077][2408954] Heartbeat connected on RolloutWorker_w10
[2023-02-25 12:19:15,103][2408954] Heartbeat connected on RolloutWorker_w26
[2023-02-25 12:19:15,111][2409485] Initialized w:24 v:23 player:0
[2023-02-25 12:19:15,113][2409485] Decorrelating experience for 736 frames...
[2023-02-25 12:19:15,123][2409100] Initialized w:11 v:23 player:0
[2023-02-25 12:19:15,125][2409100] Decorrelating experience for 736 frames...
[2023-02-25 12:19:15,205][2409548] Initialized w:27 v:23 player:0
[2023-02-25 12:19:15,207][2409548] Decorrelating experience for 736 frames...
[2023-02-25 12:19:15,231][2409547] Using port 42823 on host...
[2023-02-25 12:19:15,236][2409078] Initialized w:2 v:23 player:0
[2023-02-25 12:19:15,237][2409078] Decorrelating experience for 736 frames...
[2023-02-25 12:19:15,233][2409405] Initialized w:18 v:23 player:0
[2023-02-25 12:19:15,239][2409405] Decorrelating experience for 736 frames...
[2023-02-25 12:19:15,248][2409097] Using port 41223 on host...
[2023-02-25 12:19:15,283][2409080] Initialized w:5 v:23 player:0
[2023-02-25 12:19:15,285][2409080] Decorrelating experience for 736 frames...
[2023-02-25 12:19:15,297][2409469] Initialized w:22 v:23 player:0
[2023-02-25 12:19:15,299][2409469] Decorrelating experience for 736 frames...
[2023-02-25 12:19:15,325][2409468] Initialized w:21 v:23 player:0
[2023-02-25 12:19:15,327][2409468] Decorrelating experience for 736 frames...
[2023-02-25 12:19:15,367][2409096] Initialized w:6 v:23 player:0
[2023-02-25 12:19:15,368][2409096] Decorrelating experience for 736 frames...
[2023-02-25 12:19:15,774][2408954] Heartbeat connected on RolloutWorker_w12
[2023-02-25 12:19:15,837][2408954] Heartbeat connected on RolloutWorker_w28
[2023-02-25 12:19:15,862][2408954] Heartbeat connected on RolloutWorker_w29
[2023-02-25 12:19:15,939][2408954] Heartbeat connected on RolloutWorker_w1
[2023-02-25 12:19:15,957][2408954] Heartbeat connected on RolloutWorker_w13
[2023-02-25 12:19:15,973][2409097] Initialized w:9 v:23 player:0
[2023-02-25 12:19:15,974][2409097] Decorrelating experience for 736 frames...
[2023-02-25 12:19:15,993][2409547] Initialized w:25 v:23 player:0
[2023-02-25 12:19:15,995][2409547] Decorrelating experience for 736 frames...
[2023-02-25 12:19:16,085][2408954] Heartbeat connected on RolloutWorker_w17
[2023-02-25 12:19:16,136][2408954] Heartbeat connected on RolloutWorker_w30
[2023-02-25 12:19:16,153][2408954] Heartbeat connected on RolloutWorker_w16
[2023-02-25 12:19:16,284][2408954] Heartbeat connected on RolloutWorker_w14
[2023-02-25 12:19:16,347][2408954] Heartbeat connected on RolloutWorker_w0
[2023-02-25 12:19:16,516][2408954] Heartbeat connected on RolloutWorker_w20
[2023-02-25 12:19:16,565][2408954] Heartbeat connected on RolloutWorker_w7
[2023-02-25 12:19:16,570][2408954] Heartbeat connected on RolloutWorker_w23
[2023-02-25 12:19:16,630][2408954] Heartbeat connected on RolloutWorker_w4
[2023-02-25 12:19:17,186][2408954] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 42.4. Samples: 1908. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0)
[2023-02-25 12:19:17,251][2408954] Heartbeat connected on RolloutWorker_w31
[2023-02-25 12:19:17,401][2408954] Heartbeat connected on RolloutWorker_w8
[2023-02-25 12:19:17,413][2408954] Heartbeat connected on RolloutWorker_w15
[2023-02-25 12:19:17,885][2408954] Heartbeat connected on RolloutWorker_w2
[2023-02-25 12:19:18,036][2408954] Heartbeat connected on RolloutWorker_w18
[2023-02-25 12:19:18,036][2408954] Heartbeat connected on RolloutWorker_w24
[2023-02-25 12:19:18,248][2408954] Heartbeat connected on RolloutWorker_w22
[2023-02-25 12:19:18,261][2408954] Heartbeat connected on RolloutWorker_w6
[2023-02-25 12:19:18,289][2408954] Heartbeat connected on RolloutWorker_w11
[2023-02-25 12:19:18,311][2408954] Heartbeat connected on RolloutWorker_w27
[2023-02-25 12:19:18,424][2409033] Signal inference workers to stop experience collection...
[2023-02-25 12:19:18,453][2409074] InferenceWorker_p0-w0: stopping experience collection
[2023-02-25 12:19:18,456][2408954] Heartbeat connected on RolloutWorker_w21
[2023-02-25 12:19:18,471][2408954] Heartbeat connected on RolloutWorker_w5
[2023-02-25 12:19:18,638][2408954] Heartbeat connected on RolloutWorker_w9
[2023-02-25 12:19:18,663][2408954] Heartbeat connected on RolloutWorker_w25
[2023-02-25 12:19:19,416][2409033] Signal inference workers to resume experience collection...
[2023-02-25 12:19:19,416][2409074] InferenceWorker_p0-w0: resuming experience collection
[2023-02-25 12:19:21,517][2409074] Updated weights for policy 0, policy_version 10 (0.0394)
[2023-02-25 12:19:22,186][2408954] Fps is (10 sec: 4915.2, 60 sec: 851.8, 300 sec: 851.8). Total num frames: 49152. Throughput: 0: 258.9. Samples: 11652. Policy #0 lag: (min: 1.0, avg: 7.7, max: 9.0)
[2023-02-25 12:19:23,394][2409074] Updated weights for policy 0, policy_version 20 (0.0013)
[2023-02-25 12:19:24,769][2409074] Updated weights for policy 0, policy_version 30 (0.0018)
[2023-02-25 12:19:26,799][2409074] Updated weights for policy 0, policy_version 40 (0.0014)
[2023-02-25 12:19:27,186][2408954] Fps is (10 sec: 18841.5, 60 sec: 3140.3, 300 sec: 3004.9). Total num frames: 188416. Throughput: 0: 1028.0. Samples: 46260. Policy #0 lag: (min: 0.0, avg: 12.1, max: 24.0)
[2023-02-25 12:19:27,615][2409074] Updated weights for policy 0, policy_version 50 (0.0013)
[2023-02-25 12:19:29,143][2409074] Updated weights for policy 0, policy_version 60 (0.0012)
[2023-02-25 12:19:30,819][2409074] Updated weights for policy 0, policy_version 70 (0.0013)
[2023-02-25 12:19:32,186][2408954] Fps is (10 sec: 26623.8, 60 sec: 5256.5, 300 sec: 4658.5). Total num frames: 315392. Throughput: 0: 1923.5. Samples: 86556. Policy #0 lag: (min: 1.0, avg: 10.9, max: 25.0)
[2023-02-25 12:19:32,457][2409074] Updated weights for policy 0, policy_version 80 (0.0012)
[2023-02-25 12:19:34,091][2409074] Updated weights for policy 0, policy_version 90 (0.0012)
[2023-02-25 12:19:34,916][2409548] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 12:19:35,712][2409074] Updated weights for policy 0, policy_version 100 (0.0012)
[2023-02-25 12:19:37,143][2409074] Updated weights for policy 0, policy_version 110 (0.0013)
[2023-02-25 12:19:37,186][2408954] Fps is (10 sec: 26214.5, 60 sec: 7509.3, 300 sec: 6197.3). Total num frames: 450560. Throughput: 0: 2370.1. Samples: 106656. Policy #0 lag: (min: 0.0, avg: 11.8, max: 24.0)
[2023-02-25 12:19:38,719][2409074] Updated weights for policy 0, policy_version 120 (0.0013)
[2023-02-25 12:19:39,875][2409074] Updated weights for policy 0, policy_version 130 (0.0012)
[2023-02-25 12:19:41,608][2409074] Updated weights for policy 0, policy_version 140 (0.0012)
[2023-02-25 12:19:42,186][2408954] Fps is (10 sec: 26624.1, 60 sec: 9693.9, 300 sec: 7485.4). Total num frames: 581632. Throughput: 0: 3254.7. Samples: 146460. Policy #0 lag: (min: 1.0, avg: 13.3, max: 27.0)
[2023-02-25 12:19:43,073][2409074] Updated weights for policy 0, policy_version 150 (0.0012)
[2023-02-25 12:19:44,881][2409074] Updated weights for policy 0, policy_version 160 (0.0013)
[2023-02-25 12:19:46,383][2409074] Updated weights for policy 0, policy_version 170 (0.0012)
[2023-02-25 12:19:47,186][2408954] Fps is (10 sec: 27852.6, 60 sec: 12151.4, 300 sec: 8815.8). Total num frames: 729088. Throughput: 0: 4142.1. Samples: 186372. Policy #0 lag: (min: 1.0, avg: 11.2, max: 25.0)
[2023-02-25 12:19:47,478][2409074] Updated weights for policy 0, policy_version 180 (0.0012)
[2023-02-25 12:19:49,455][2409074] Updated weights for policy 0, policy_version 190 (0.0012)
[2023-02-25 12:19:50,669][2409074] Updated weights for policy 0, policy_version 200 (0.0013)
[2023-02-25 12:19:52,186][2408954] Fps is (10 sec: 26623.5, 60 sec: 14131.1, 300 sec: 9667.6). Total num frames: 847872. Throughput: 0: 4582.4. Samples: 206208. Policy #0 lag: (min: 1.0, avg: 10.7, max: 26.0)
[2023-02-25 12:19:52,733][2409074] Updated weights for policy 0, policy_version 210 (0.0012)
[2023-02-25 12:19:54,065][2409074] Updated weights for policy 0, policy_version 220 (0.0012)
[2023-02-25 12:19:55,486][2409074] Updated weights for policy 0, policy_version 230 (0.0012)
[2023-02-25 12:19:57,186][2408954] Fps is (10 sec: 24166.2, 60 sec: 16179.2, 300 sec: 10471.7). Total num frames: 970752. Throughput: 0: 5468.5. Samples: 246084. Policy #0 lag: (min: 0.0, avg: 15.1, max: 28.0)
[2023-02-25 12:19:57,401][2409074] Updated weights for policy 0, policy_version 240 (0.0012)
[2023-02-25 12:19:58,424][2409074] Updated weights for policy 0, policy_version 250 (0.0013)
[2023-02-25 12:20:00,461][2409074] Updated weights for policy 0, policy_version 260 (0.0012)
[2023-02-25 12:20:01,506][2409074] Updated weights for policy 0, policy_version 270 (0.0015)
[2023-02-25 12:20:02,189][2408954] Fps is (10 sec: 27025.2, 60 sec: 18637.5, 300 sec: 11444.7). Total num frames: 1118208. Throughput: 0: 6304.9. Samples: 285648. Policy #0 lag: (min: 0.0, avg: 13.3, max: 26.0)
[2023-02-25 12:20:03,423][2409074] Updated weights for policy 0, policy_version 280 (0.0012)
[2023-02-25 12:20:04,889][2409074] Updated weights for policy 0, policy_version 290 (0.0012)
[2023-02-25 12:20:06,354][2409074] Updated weights for policy 0, policy_version 300 (0.0012)
[2023-02-25 12:20:07,186][2408954] Fps is (10 sec: 27033.9, 60 sec: 20684.8, 300 sec: 12084.3). Total num frames: 1241088. Throughput: 0: 6528.0. Samples: 305412. Policy #0 lag: (min: 0.0, avg: 13.2, max: 25.0)
[2023-02-25 12:20:07,796][2409033] Signal inference workers to stop experience collection... (50 times)
[2023-02-25 12:20:07,805][2409033] Signal inference workers to resume experience collection... (50 times)
[2023-02-25 12:20:07,823][2409074] InferenceWorker_p0-w0: stopping experience collection (50 times)
[2023-02-25 12:20:07,824][2409074] InferenceWorker_p0-w0: resuming experience collection (50 times)
[2023-02-25 12:20:07,952][2409074] Updated weights for policy 0, policy_version 310 (0.0013)
[2023-02-25 12:20:09,289][2409074] Updated weights for policy 0, policy_version 320 (0.0012)
[2023-02-25 12:20:11,367][2409074] Updated weights for policy 0, policy_version 330 (0.0012)
[2023-02-25 12:20:12,186][2408954] Fps is (10 sec: 26223.1, 60 sec: 23005.9, 300 sec: 12816.4). Total num frames: 1380352. Throughput: 0: 6636.8. Samples: 344916. Policy #0 lag: (min: 0.0, avg: 10.2, max: 25.0)
[2023-02-25 12:20:12,505][2409074] Updated weights for policy 0, policy_version 340 (0.0012)
[2023-02-25 12:20:14,114][2409074] Updated weights for policy 0, policy_version 350 (0.0012)
[2023-02-25 12:20:15,618][2409074] Updated weights for policy 0, policy_version 360 (0.0013)
[2023-02-25 12:20:17,186][2408954] Fps is (10 sec: 26623.9, 60 sec: 25122.1, 300 sec: 13374.4). Total num frames: 1507328. Throughput: 0: 6627.7. Samples: 384804. Policy #0 lag: (min: 2.0, avg: 14.4, max: 31.0)
[2023-02-25 12:20:17,189][2409033] Saving /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000000368_1507328.pth...
[2023-02-25 12:20:17,402][2409074] Updated weights for policy 0, policy_version 370 (0.0012)
[2023-02-25 12:20:18,887][2409074] Updated weights for policy 0, policy_version 380 (0.0013)
[2023-02-25 12:20:20,686][2409074] Updated weights for policy 0, policy_version 390 (0.0012)
[2023-02-25 12:20:21,971][2409074] Updated weights for policy 0, policy_version 400 (0.0012)
[2023-02-25 12:20:22,186][2408954] Fps is (10 sec: 26214.4, 60 sec: 26555.7, 300 sec: 13954.7). Total num frames: 1642496. Throughput: 0: 6617.6. Samples: 404448. Policy #0 lag: (min: 0.0, avg: 13.0, max: 25.0)
[2023-02-25 12:20:23,521][2409074] Updated weights for policy 0, policy_version 410 (0.0012)
[2023-02-25 12:20:25,077][2409074] Updated weights for policy 0, policy_version 420 (0.0012)
[2023-02-25 12:20:26,665][2409074] Updated weights for policy 0, policy_version 430 (0.0012)
[2023-02-25 12:20:27,186][2408954] Fps is (10 sec: 26214.6, 60 sec: 26351.0, 300 sec: 14420.9). Total num frames: 1769472. Throughput: 0: 6608.0. Samples: 443820. Policy #0 lag: (min: 1.0, avg: 11.8, max: 24.0)
[2023-02-25 12:20:28,133][2409074] Updated weights for policy 0, policy_version 440 (0.0014)
[2023-02-25 12:20:29,389][2409074] Updated weights for policy 0, policy_version 450 (0.0015)
[2023-02-25 12:20:31,593][2409074] Updated weights for policy 0, policy_version 460 (0.0012)
[2023-02-25 12:20:32,186][2408954] Fps is (10 sec: 27033.4, 60 sec: 26624.0, 300 sec: 14978.8). Total num frames: 1912832. Throughput: 0: 6597.3. Samples: 483252. Policy #0 lag: (min: 1.0, avg: 14.3, max: 30.0)
[2023-02-25 12:20:32,664][2409074] Updated weights for policy 0, policy_version 470 (0.0013)
[2023-02-25 12:20:34,691][2409074] Updated weights for policy 0, policy_version 480 (0.0012)
[2023-02-25 12:20:35,924][2409074] Updated weights for policy 0, policy_version 490 (0.0013)
[2023-02-25 12:20:37,186][2408954] Fps is (10 sec: 27033.5, 60 sec: 26487.5, 300 sec: 15371.3). Total num frames: 2039808. Throughput: 0: 6596.8. Samples: 503064. Policy #0 lag: (min: 0.0, avg: 10.4, max: 27.0)
[2023-02-25 12:20:37,861][2409074] Updated weights for policy 0, policy_version 500 (0.0012)
[2023-02-25 12:20:39,265][2409074] Updated weights for policy 0, policy_version 510 (0.0012)
[2023-02-25 12:20:40,575][2409074] Updated weights for policy 0, policy_version 520 (0.0012)
[2023-02-25 12:20:42,186][2408954] Fps is (10 sec: 24575.8, 60 sec: 26282.6, 300 sec: 15675.8). Total num frames: 2158592. Throughput: 0: 6565.6. Samples: 541536. Policy #0 lag: (min: 0.0, avg: 15.5, max: 29.0)
[2023-02-25 12:20:42,475][2409074] Updated weights for policy 0, policy_version 530 (0.0012)
[2023-02-25 12:20:43,836][2409074] Updated weights for policy 0, policy_version 540 (0.0012)
[2023-02-25 12:20:45,786][2409074] Updated weights for policy 0, policy_version 550 (0.0013)
[2023-02-25 12:20:47,186][2408954] Fps is (10 sec: 24985.6, 60 sec: 26009.6, 300 sec: 16045.0). Total num frames: 2289664. Throughput: 0: 6523.7. Samples: 579192. Policy #0 lag: (min: 0.0, avg: 11.4, max: 25.0)
[2023-02-25 12:20:47,276][2409074] Updated weights for policy 0, policy_version 560 (0.0012)
[2023-02-25 12:20:48,789][2409074] Updated weights for policy 0, policy_version 570 (0.0012)
[2023-02-25 12:20:50,309][2409074] Updated weights for policy 0, policy_version 580 (0.0012)
[2023-02-25 12:20:52,186][2408954] Fps is (10 sec: 25395.6, 60 sec: 26078.0, 300 sec: 16333.8). Total num frames: 2412544. Throughput: 0: 6520.8. Samples: 598848. Policy #0 lag: (min: 1.0, avg: 13.5, max: 25.0)
[2023-02-25 12:20:52,222][2409074] Updated weights for policy 0, policy_version 590 (0.0013)
[2023-02-25 12:20:52,225][2409033] Signal inference workers to stop experience collection... (100 times)
[2023-02-25 12:20:52,225][2409033] Signal inference workers to resume experience collection... (100 times)
[2023-02-25 12:20:52,251][2409074] InferenceWorker_p0-w0: stopping experience collection (100 times)
[2023-02-25 12:20:52,251][2409074] InferenceWorker_p0-w0: resuming experience collection (100 times)
[2023-02-25 12:20:53,653][2409074] Updated weights for policy 0, policy_version 600 (0.0013)
[2023-02-25 12:20:54,955][2409074] Updated weights for policy 0, policy_version 610 (0.0013)
[2023-02-25 12:20:57,077][2409074] Updated weights for policy 0, policy_version 620 (0.0012)
[2023-02-25 12:20:57,186][2408954] Fps is (10 sec: 25395.3, 60 sec: 26214.5, 300 sec: 16657.4). Total num frames: 2543616. Throughput: 0: 6508.3. Samples: 637788. Policy #0 lag: (min: 0.0, avg: 12.3, max: 26.0)
[2023-02-25 12:20:58,246][2409074] Updated weights for policy 0, policy_version 630 (0.0012)
[2023-02-25 12:21:00,252][2409074] Updated weights for policy 0, policy_version 640 (0.0012)
[2023-02-25 12:21:01,566][2409074] Updated weights for policy 0, policy_version 650 (0.0012)
[2023-02-25 12:21:02,186][2408954] Fps is (10 sec: 27033.7, 60 sec: 26079.3, 300 sec: 17012.3). Total num frames: 2682880. Throughput: 0: 6472.5. Samples: 676068. Policy #0 lag: (min: 1.0, avg: 12.3, max: 25.0)
[2023-02-25 12:21:03,093][2409074] Updated weights for policy 0, policy_version 660 (0.0012)
[2023-02-25 12:21:04,838][2409074] Updated weights for policy 0, policy_version 670 (0.0012)
[2023-02-25 12:21:05,904][2409074] Updated weights for policy 0, policy_version 680 (0.0013)
[2023-02-25 12:21:07,186][2408954] Fps is (10 sec: 26214.4, 60 sec: 26077.9, 300 sec: 17244.7). Total num frames: 2805760. Throughput: 0: 6469.3. Samples: 695568. Policy #0 lag: (min: 0.0, avg: 12.4, max: 25.0)
[2023-02-25 12:21:08,247][2409074] Updated weights for policy 0, policy_version 690 (0.0012)
[2023-02-25 12:21:09,202][2409074] Updated weights for policy 0, policy_version 700 (0.0012)
[2023-02-25 12:21:11,278][2409074] Updated weights for policy 0, policy_version 710 (0.0012)
[2023-02-25 12:21:12,186][2408954] Fps is (10 sec: 25395.1, 60 sec: 25941.3, 300 sec: 17512.2). Total num frames: 2936832. Throughput: 0: 6473.9. Samples: 735144. Policy #0 lag: (min: 0.0, avg: 14.2, max: 26.0)
[2023-02-25 12:21:12,574][2409074] Updated weights for policy 0, policy_version 720 (0.0012)
[2023-02-25 12:21:13,889][2409074] Updated weights for policy 0, policy_version 730 (0.0012)
[2023-02-25 12:21:15,806][2409074] Updated weights for policy 0, policy_version 740 (0.0012)
[2023-02-25 12:21:17,092][2409074] Updated weights for policy 0, policy_version 750 (0.0012)
[2023-02-25 12:21:17,186][2408954] Fps is (10 sec: 26623.9, 60 sec: 26077.9, 300 sec: 17787.8). Total num frames: 3072000. Throughput: 0: 6453.1. Samples: 773640. Policy #0 lag: (min: 1.0, avg: 11.0, max: 26.0)
[2023-02-25 12:21:19,089][2409074] Updated weights for policy 0, policy_version 760 (0.0012)
[2023-02-25 12:21:20,418][2409074] Updated weights for policy 0, policy_version 770 (0.0012)
[2023-02-25 12:21:22,099][2409074] Updated weights for policy 0, policy_version 780 (0.0012)
[2023-02-25 12:21:22,186][2408954] Fps is (10 sec: 25804.4, 60 sec: 25873.0, 300 sec: 17978.8). Total num frames: 3194880. Throughput: 0: 6449.3. Samples: 793284. Policy #0 lag: (min: 0.0, avg: 12.4, max: 27.0)
[2023-02-25 12:21:23,358][2409074] Updated weights for policy 0, policy_version 790 (0.0013)
[2023-02-25 12:21:25,492][2409074] Updated weights for policy 0, policy_version 800 (0.0012)
[2023-02-25 12:21:26,616][2409074] Updated weights for policy 0, policy_version 810 (0.0012)
[2023-02-25 12:21:27,186][2408954] Fps is (10 sec: 25804.8, 60 sec: 26009.6, 300 sec: 18226.6). Total num frames: 3330048. Throughput: 0: 6455.2. Samples: 832020. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0)
[2023-02-25 12:21:28,432][2409074] Updated weights for policy 0, policy_version 820 (0.0013)
[2023-02-25 12:21:30,103][2409074] Updated weights for policy 0, policy_version 830 (0.0012)
[2023-02-25 12:21:31,804][2409074] Updated weights for policy 0, policy_version 840 (0.0012)
[2023-02-25 12:21:32,186][2408954] Fps is (10 sec: 25395.6, 60 sec: 25600.0, 300 sec: 18373.9). Total num frames: 3448832. Throughput: 0: 6450.7. Samples: 869472. Policy #0 lag: (min: 0.0, avg: 14.3, max: 27.0)
[2023-02-25 12:21:33,905][2409074] Updated weights for policy 0, policy_version 850 (0.0013)
[2023-02-25 12:21:34,917][2409074] Updated weights for policy 0, policy_version 860 (0.0012)
[2023-02-25 12:21:37,186][2408954] Fps is (10 sec: 22937.7, 60 sec: 25326.9, 300 sec: 18471.1). Total num frames: 3559424. Throughput: 0: 6406.7. Samples: 887148. Policy #0 lag: (min: 0.0, avg: 11.0, max: 27.0)
[2023-02-25 12:21:37,233][2409074] Updated weights for policy 0, policy_version 870 (0.0012)
[2023-02-25 12:21:38,332][2409074] Updated weights for policy 0, policy_version 880 (0.0012)
[2023-02-25 12:21:40,186][2409074] Updated weights for policy 0, policy_version 890 (0.0012)
[2023-02-25 12:21:41,662][2409074] Updated weights for policy 0, policy_version 900 (0.0012)
[2023-02-25 12:21:42,186][2408954] Fps is (10 sec: 25395.2, 60 sec: 25736.6, 300 sec: 18729.1). Total num frames: 3702784. Throughput: 0: 6373.6. Samples: 924600. Policy #0 lag: (min: 0.0, avg: 13.2, max: 28.0)
[2023-02-25 12:21:43,270][2409074] Updated weights for policy 0, policy_version 910 (0.0012)
[2023-02-25 12:21:45,313][2409074] Updated weights for policy 0, policy_version 920 (0.0012)
[2023-02-25 12:21:46,586][2409074] Updated weights for policy 0, policy_version 930 (0.0013)
[2023-02-25 12:21:47,186][2408954] Fps is (10 sec: 26624.1, 60 sec: 25600.0, 300 sec: 18873.3). Total num frames: 3825664. Throughput: 0: 6350.1. Samples: 961824. Policy #0 lag: (min: 0.0, avg: 12.5, max: 29.0)
[2023-02-25 12:21:48,670][2409074] Updated weights for policy 0, policy_version 940 (0.0013)
[2023-02-25 12:21:50,114][2409074] Updated weights for policy 0, policy_version 950 (0.0012)
[2023-02-25 12:21:51,469][2409074] Updated weights for policy 0, policy_version 960 (0.0012)
[2023-02-25 12:21:52,186][2408954] Fps is (10 sec: 24166.4, 60 sec: 25531.7, 300 sec: 18990.9). Total num frames: 3944448. Throughput: 0: 6324.3. Samples: 980160. Policy #0 lag: (min: 0.0, avg: 13.5, max: 27.0)
[2023-02-25 12:21:53,443][2409074] Updated weights for policy 0, policy_version 970 (0.0012)
[2023-02-25 12:21:54,799][2409074] Updated weights for policy 0, policy_version 980 (0.0012)
[2023-02-25 12:21:55,757][2409549] DAMAGECOUNT value on done: 65.0
[2023-02-25 12:21:56,097][2409101] DAMAGECOUNT value on done: 24.0
[2023-02-25 12:21:56,246][2409102] DAMAGECOUNT value on done: 74.0
[2023-02-25 12:21:56,400][2409406] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:21:56,404][2409406] Sum rewards: -6.419, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.896', 'FRAGCOUNT': '-0.500', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.018', 'weapon5': '0.020', 'HITCOUNT': '0.030', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'weapon4': '0.116', 'DAMAGECOUNT': '0.135', 'WEAPON5': '0.200', 'WEAPON3': '0.600', 'weapon3': '0.688', 'weapon2': '1.104'}
[2023-02-25 12:21:56,661][2409074] Updated weights for policy 0, policy_version 990 (0.0012)
[2023-02-25 12:21:56,808][2409597] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:21:56,917][2409103] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:21:56,989][2409100] DAMAGECOUNT value on done: 40.0
[2023-02-25 12:21:57,000][2409565] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:21:57,005][2409565] Sum rewards: -5.144, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.620', 'WEAPON1': '0.020', 'weapon4': '0.024', 'AMMO2': '0.025', 'HITCOUNT': '0.030', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'DAMAGECOUNT': '0.075', 'AMMO3': '0.125', 'AMMO4': '0.127', 'weapon3': '0.390', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon2': '1.320'}
[2023-02-25 12:21:57,130][2409077] DAMAGECOUNT value on done: 40.0
[2023-02-25 12:21:57,186][2408954] Fps is (10 sec: 24576.0, 60 sec: 25463.5, 300 sec: 19141.4). Total num frames: 4071424. Throughput: 0: 6281.9. Samples: 1017828. Policy #0 lag: (min: 1.0, avg: 12.6, max: 27.0)
[2023-02-25 12:21:57,186][2408954] Avg episode reward: [(0, '-3.510')]
[2023-02-25 12:21:57,189][2409033] Saving new best policy, reward=-3.510!
[2023-02-25 12:21:57,556][2409105] DAMAGECOUNT value on done: 5.0
[2023-02-25 12:21:58,237][2409074] Updated weights for policy 0, policy_version 1000 (0.0012)
[2023-02-25 12:21:58,426][2409485] DAMAGECOUNT value on done: 5.0
[2023-02-25 12:21:58,529][2409389] DAMAGECOUNT value on done: 285.0
[2023-02-25 12:21:58,534][2409389] Sum rewards: -4.592, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.454', 'AMMO2': '0.007', 'ARMOR': '0.036', 'AMMO4': '0.037', 'weapon4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'HITCOUNT': '0.170', 'WEAPON3': '0.650', 'weapon3': '0.776', 'DAMAGECOUNT': '0.855', 'weapon2': '1.024', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:21:58,747][2409405] DAMAGECOUNT value on done: 20.0
[2023-02-25 12:21:58,748][2409405] Sum rewards: -5.591, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.567', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'HITCOUNT': '0.020', 'DAMAGECOUNT': '0.060', 'weapon4': '0.070', 'AMMO4': '0.077', 'ARMOR': '0.092', 'AMMO3': '0.140', 'WEAPON4': '0.250', 'weapon3': '0.588', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.404'}
[2023-02-25 12:21:58,811][2409548] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:21:58,880][2409407] DAMAGECOUNT value on done: 74.0
[2023-02-25 12:21:58,883][2409407] Sum rewards: -3.964, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.465', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'HITCOUNT': '0.070', 'weapon4': '0.092', 'AMMO3': '0.104', 'DAMAGECOUNT': '0.222', 'WEAPON3': '0.550', 'weapon3': '0.842', 'FRAGCOUNT': '1.000', 'weapon2': '1.030'}
[2023-02-25 12:21:59,004][2409075] DAMAGECOUNT value on done: 75.0
[2023-02-25 12:21:59,005][2409075] Sum rewards: -6.141, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.041', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.028', 'ARMOR': '0.068', 'HITCOUNT': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.211', 'DAMAGECOUNT': '0.225', 'weapon3': '0.832', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '1.100'}
[2023-02-25 12:21:59,052][2409078] DAMAGECOUNT value on done: 55.0
[2023-02-25 12:21:59,279][2409549] DAMAGECOUNT value on done: 5.0
[2023-02-25 12:21:59,448][2409469] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:21:59,472][2409097] DAMAGECOUNT value on done: 72.0
[2023-02-25 12:21:59,884][2409074] Updated weights for policy 0, policy_version 1010 (0.0012)
[2023-02-25 12:21:59,900][2409373] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:21:59,907][2409101] DAMAGECOUNT value on done: 40.0
[2023-02-25 12:22:00,091][2409102] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:22:00,216][2409596] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:22:00,300][2409096] DAMAGECOUNT value on done: 55.0
[2023-02-25 12:22:00,303][2409096] Sum rewards: -10.010, reward structure: {'DEATHCOUNT': '-10.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.270', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.035', 'WEAPON5': '0.050', 'HITCOUNT': '0.050', 'weapon5': '0.058', 'weapon4': '0.070', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.165', 'WEAPON3': '0.350', 'weapon3': '0.410', 'ARMOR': '0.458', 'weapon2': '1.428'}
[2023-02-25 12:22:00,423][2409103] DAMAGECOUNT value on done: 35.0
[2023-02-25 12:22:00,525][2409597] DAMAGECOUNT value on done: 80.0
[2023-02-25 12:22:00,526][2409597] Sum rewards: -6.782, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.642', 'AMMO2': '0.009', 'AMMO4': '0.045', 'HITCOUNT': '0.070', 'AMMO3': '0.109', 'weapon4': '0.120', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.240', 'ARMOR': '0.467', 'WEAPON3': '0.600', 'weapon3': '0.720', 'FRAGCOUNT': '1.000', 'weapon2': '1.080'}
[2023-02-25 12:22:00,600][2409104] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:22:00,601][2409104] Sum rewards: -5.298, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.640', 'AMMO2': '0.007', 'HITCOUNT': '0.010', 'DAMAGECOUNT': '0.030', 'AMMO4': '0.034', 'ARMOR': '0.068', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'WEAPON3': '0.650', 'weapon3': '0.698', 'FRAGCOUNT': '1.000', 'weapon2': '1.058'}
[2023-02-25 12:22:00,639][2409100] DAMAGECOUNT value on done: 85.0
[2023-02-25 12:22:00,684][2409079] DAMAGECOUNT value on done: 20.0
[2023-02-25 12:22:00,870][2409406] DAMAGECOUNT value on done: 180.0
[2023-02-25 12:22:00,873][2409406] Sum rewards: -4.635, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.258', 'AMMO2': '0.011', 'ARMOR': '0.044', 'AMMO4': '0.054', 'weapon4': '0.076', 'WEAPON4': '0.100', 'HITCOUNT': '0.130', 'AMMO3': '0.134', 'DAMAGECOUNT': '0.540', 'WEAPON3': '0.700', 'weapon3': '0.754', 'FRAGCOUNT': '1.000', 'weapon2': '1.080'}
[2023-02-25 12:22:01,009][2409076] DAMAGECOUNT value on done: 65.0
[2023-02-25 12:22:01,258][2409105] DAMAGECOUNT value on done: 24.0
[2023-02-25 12:22:01,276][2409565] DAMAGECOUNT value on done: 20.0
[2023-02-25 12:22:01,341][2409074] Updated weights for policy 0, policy_version 1020 (0.0012)
[2023-02-25 12:22:01,554][2409077] DAMAGECOUNT value on done: 104.0
[2023-02-25 12:22:01,555][2409077] Sum rewards: -6.831, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.284', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.025', 'ARMOR': '0.028', 'HITCOUNT': '0.080', 'WEAPON5': '0.100', 'weapon4': '0.114', 'AMMO4': '0.127', 'AMMO3': '0.174', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.312', 'weapon3': '0.750', 'WEAPON3': '0.950', 'weapon2': '0.976', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:22:01,939][2409485] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:22:02,143][2409389] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:22:02,186][2408954] Fps is (10 sec: 26214.4, 60 sec: 25395.2, 300 sec: 19322.7). Total num frames: 4206592. Throughput: 0: 6287.5. Samples: 1056576. Policy #0 lag: (min: 0.0, avg: 11.9, max: 25.0)
[2023-02-25 12:22:02,187][2408954] Avg episode reward: [(0, '-4.285')]
[2023-02-25 12:22:02,505][2409405] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:22:02,526][2409407] DAMAGECOUNT value on done: 35.0
[2023-02-25 12:22:02,553][2409548] DAMAGECOUNT value on done: 160.0
[2023-02-25 12:22:02,554][2409548] Sum rewards: -6.544, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.357', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.008', 'AMMO4': '0.039', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.150', 'weapon4': '0.166', 'DAMAGECOUNT': '0.480', 'weapon3': '0.480', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.218'}
[2023-02-25 12:22:02,681][2409075] DAMAGECOUNT value on done: 55.0
[2023-02-25 12:22:02,702][2409074] Updated weights for policy 0, policy_version 1030 (0.0012)
[2023-02-25 12:22:02,756][2409547] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:22:02,814][2409078] DAMAGECOUNT value on done: 120.0
[2023-02-25 12:22:02,819][2409078] Sum rewards: -4.518, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.106', 'AMMO5': '0.003', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'weapon4': '0.026', 'ARMOR': '0.028', 'AMMO4': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.084', 'weapon5': '0.088', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.450', 'weapon3': '0.470', 'FRAGCOUNT': '1.000', 'weapon2': '1.276'}
[2023-02-25 12:22:03,136][2409355] DAMAGECOUNT value on done: 20.0
[2023-02-25 12:22:03,175][2409486] DAMAGECOUNT value on done: 60.0
[2023-02-25 12:22:03,228][2409469] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:22:03,398][2409549] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:22:03,515][2409866] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:22:03,519][2409866] Sum rewards: -6.479, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.536', 'AMMO2': '0.003', 'AMMO4': '0.016', 'ARMOR': '0.016', 'HITCOUNT': '0.040', 'WEAPON4': '0.050', 'DAMAGECOUNT': '0.075', 'AMMO3': '0.159', 'WEAPON3': '0.850', 'weapon3': '0.852', 'weapon2': '0.996', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:22:03,611][2409097] DAMAGECOUNT value on done: 4.0
[2023-02-25 12:22:03,616][2409373] DAMAGECOUNT value on done: 74.0
[2023-02-25 12:22:03,902][2409101] DAMAGECOUNT value on done: 115.0
[2023-02-25 12:22:03,904][2409101] Sum rewards: -6.459, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.572', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.007', 'AMMO2': '0.008', 'weapon4': '0.028', 'HITCOUNT': '0.030', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'ARMOR': '0.081', 'weapon5': '0.084', 'AMMO3': '0.093', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.500', 'weapon3': '0.650', 'weapon2': '1.048'}
[2023-02-25 12:22:03,906][2409596] DAMAGECOUNT value on done: 195.0
[2023-02-25 12:22:03,910][2409596] Sum rewards: -5.075, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.740', 'AMMO2': '0.002', 'AMMO4': '0.012', 'AMMO3': '0.102', 'HITCOUNT': '0.140', 'WEAPON3': '0.400', 'weapon3': '0.452', 'ARMOR': '0.488', 'DAMAGECOUNT': '0.585', 'FRAGCOUNT': '1.000', 'weapon2': '1.484'}
[2023-02-25 12:22:03,991][2409103] DAMAGECOUNT value on done: 65.0
[2023-02-25 12:22:03,991][2409096] DAMAGECOUNT value on done: 85.0
[2023-02-25 12:22:03,992][2409096] Sum rewards: -4.455, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.516', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon4': '0.030', 'AMMO3': '0.078', 'HITCOUNT': '0.080', 'AMMO4': '0.109', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.255', 'WEAPON3': '0.400', 'ARMOR': '0.491', 'weapon3': '0.780', 'FRAGCOUNT': '1.000', 'weapon2': '1.106'}
[2023-02-25 12:22:04,087][2409597] DAMAGECOUNT value on done: 170.0
[2023-02-25 12:22:04,090][2409597] Sum rewards: -6.105, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.934', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.016', 'WEAPON5': '0.100', 'HITCOUNT': '0.140', 'AMMO3': '0.187', 'DAMAGECOUNT': '0.510', 'weapon3': '0.918', 'weapon2': '0.972', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:22:04,302][2409102] DAMAGECOUNT value on done: 46.0
[2023-02-25 12:22:04,306][2409104] DAMAGECOUNT value on done: 20.0
[2023-02-25 12:22:04,435][2409079] DAMAGECOUNT value on done: 137.0
[2023-02-25 12:22:04,456][2409100] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:22:04,702][2409074] Updated weights for policy 0, policy_version 1040 (0.0012)
[2023-02-25 12:22:04,764][2409076] DAMAGECOUNT value on done: 130.0
[2023-02-25 12:22:04,850][2409105] DAMAGECOUNT value on done: 84.0
[2023-02-25 12:22:04,921][2409406] DAMAGECOUNT value on done: 20.0
[2023-02-25 12:22:05,026][2409565] DAMAGECOUNT value on done: 30.0
[2023-02-25 12:22:05,507][2409099] DAMAGECOUNT value on done: 30.0
[2023-02-25 12:22:05,514][2409485] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:22:05,514][2409485] Sum rewards: -11.913, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.870', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.029', 'weapon5': '0.032', 'WEAPON5': '0.050', 'weapon4': '0.062', 'AMMO3': '0.097', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'weapon3': '0.352', 'WEAPON3': '0.450', 'weapon2': '1.278'}
[2023-02-25 12:22:05,761][2409077] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:22:05,801][2409389] DAMAGECOUNT value on done: 80.0
[2023-02-25 12:22:05,811][2409074] Updated weights for policy 0, policy_version 1050 (0.0012)
[2023-02-25 12:22:06,184][2409548] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:22:06,203][2409407] DAMAGECOUNT value on done: 85.0
[2023-02-25 12:22:06,356][2409075] DAMAGECOUNT value on done: 7.0
[2023-02-25 12:22:06,379][2409547] DAMAGECOUNT value on done: 205.0
[2023-02-25 12:22:06,380][2409547] Sum rewards: -5.441, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.444', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.026', 'weapon5': '0.032', 'AMMO4': '0.072', 'HITCOUNT': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'ARMOR': '0.114', 'AMMO3': '0.141', 'weapon3': '0.604', 'DAMAGECOUNT': '0.615', 'WEAPON3': '0.750', 'weapon2': '1.100', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:22:06,516][2409405] DAMAGECOUNT value on done: 30.0
[2023-02-25 12:22:06,821][2409486] DAMAGECOUNT value on done: 17.0
[2023-02-25 12:22:06,826][2409469] DAMAGECOUNT value on done: 60.0
[2023-02-25 12:22:06,827][2409469] Sum rewards: -7.810, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.400', 'AMMO2': '0.016', 'weapon4': '0.074', 'AMMO4': '0.081', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.154', 'DAMAGECOUNT': '0.180', 'weapon2': '0.848', 'WEAPON3': '0.850', 'weapon3': '0.946', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:22:06,841][2409078] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:22:07,121][2409097] DAMAGECOUNT value on done: 60.0
[2023-02-25 12:22:07,135][2409549] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:22:07,186][2408954] Fps is (10 sec: 25395.1, 60 sec: 25326.9, 300 sec: 19422.2). Total num frames: 4325376. Throughput: 0: 6272.8. Samples: 1075560. Policy #0 lag: (min: 1.0, avg: 12.2, max: 28.0)
[2023-02-25 12:22:07,186][2408954] Avg episode reward: [(0, '-4.270')]
[2023-02-25 12:22:07,447][2409596] DAMAGECOUNT value on done: 115.0
[2023-02-25 12:22:07,449][2409596] Sum rewards: -2.949, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.023', 'HITCOUNT': '0.080', 'HEALTH': '0.086', 'AMMO3': '0.098', 'AMMO4': '0.116', 'ARMOR': '0.136', 'weapon4': '0.150', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.500', 'weapon3': '0.792', 'weapon2': '0.974', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:22:07,535][2409101] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:22:07,567][2409597] DAMAGECOUNT value on done: 14.0
[2023-02-25 12:22:07,575][2409355] DAMAGECOUNT value on done: 50.0
[2023-02-25 12:22:07,578][2409355] Sum rewards: -8.636, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.786', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.020', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'HITCOUNT': '0.060', 'AMMO4': '0.068', 'weapon4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.133', 'DAMAGECOUNT': '0.150', 'WEAPON3': '0.700', 'weapon3': '0.824', 'weapon2': '1.116'}
[2023-02-25 12:22:07,610][2409096] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:22:07,729][2409373] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:22:07,773][2409102] DAMAGECOUNT value on done: 115.0
[2023-02-25 12:22:07,777][2409102] Sum rewards: -6.980, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.378', 'AMMO2': '0.001', 'AMMO4': '0.002', 'HITCOUNT': '0.070', 'AMMO3': '0.161', 'DAMAGECOUNT': '0.345', 'ARMOR': '0.477', 'weapon3': '0.802', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.190'}
[2023-02-25 12:22:07,792][2409074] Updated weights for policy 0, policy_version 1060 (0.0012)
[2023-02-25 12:22:07,840][2409866] DAMAGECOUNT value on done: 55.0
[2023-02-25 12:22:07,930][2409100] DAMAGECOUNT value on done: 110.0
[2023-02-25 12:22:07,931][2409100] Sum rewards: -8.097, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.770', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'ARMOR': '0.052', 'HITCOUNT': '0.100', 'AMMO3': '0.120', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.650', 'weapon3': '0.690', 'FRAGCOUNT': '1.000', 'weapon2': '1.250'}
[2023-02-25 12:22:08,019][2409103] DAMAGECOUNT value on done: 26.0
[2023-02-25 12:22:08,087][2409104] DAMAGECOUNT value on done: 35.0
[2023-02-25 12:22:08,088][2409104] Sum rewards: -9.459, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.720', 'AMMO5': '0.005', 'AMMO2': '0.011', 'ARMOR': '0.016', 'weapon5': '0.018', 'HITCOUNT': '0.040', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.105', 'weapon4': '0.128', 'AMMO3': '0.142', 'weapon3': '0.524', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.270'}
[2023-02-25 12:22:08,141][2409079] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:22:08,440][2409105] DAMAGECOUNT value on done: 172.0
[2023-02-25 12:22:08,550][2409565] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:22:08,655][2409080] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:22:08,826][2409076] DAMAGECOUNT value on done: 110.0
[2023-02-25 12:22:09,279][2409074] Updated weights for policy 0, policy_version 1070 (0.0013)
[2023-02-25 12:22:09,396][2409389] DAMAGECOUNT value on done: 22.0
[2023-02-25 12:22:09,443][2409099] DAMAGECOUNT value on done: 20.0
[2023-02-25 12:22:09,490][2409406] DAMAGECOUNT value on done: 130.0
[2023-02-25 12:22:09,692][2409485] DAMAGECOUNT value on done: 35.0
[2023-02-25 12:22:09,856][2409548] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:22:09,975][2409075] DAMAGECOUNT value on done: 50.0
[2023-02-25 12:22:09,975][2409407] DAMAGECOUNT value on done: 11.0
[2023-02-25 12:22:09,976][2409075] Sum rewards: -7.772, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.052', 'AMMO5': '0.010', 'AMMO2': '0.021', 'HITCOUNT': '0.040', 'weapon5': '0.044', 'weapon4': '0.048', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'DAMAGECOUNT': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.450', 'ARMOR': '0.456', 'weapon3': '0.734', 'weapon2': '1.332'}
[2023-02-25 12:22:10,088][2409547] DAMAGECOUNT value on done: 20.0
[2023-02-25 12:22:10,151][2409077] DAMAGECOUNT value on done: 35.0
[2023-02-25 12:22:10,277][2409468] DAMAGECOUNT value on done: 74.0
[2023-02-25 12:22:10,563][2409469] DAMAGECOUNT value on done: 170.0
[2023-02-25 12:22:10,564][2409469] Sum rewards: -3.386, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.122', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.014', 'AMMO2': '0.019', 'ARMOR': '0.037', 'AMMO3': '0.093', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'HITCOUNT': '0.130', 'weapon4': '0.158', 'WEAPON4': '0.200', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.510', 'weapon3': '0.518', 'weapon2': '1.446', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:22:10,726][2409405] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:22:10,930][2409097] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:22:11,239][2409486] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:22:11,240][2409074] Updated weights for policy 0, policy_version 1080 (0.0012)
[2023-02-25 12:22:11,241][2409096] DAMAGECOUNT value on done: 35.0
[2023-02-25 12:22:11,244][2409096] Sum rewards: -7.198, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.769', 'AMMO2': '0.011', 'weapon4': '0.032', 'HITCOUNT': '0.050', 'AMMO4': '0.056', 'ARMOR': '0.064', 'DAMAGECOUNT': '0.105', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'WEAPON3': '0.750', 'weapon3': '0.934', 'FRAGCOUNT': '1.000', 'weapon2': '1.030'}
[2023-02-25 12:22:11,264][2409078] DAMAGECOUNT value on done: 75.0
[2023-02-25 12:22:11,306][2409597] DAMAGECOUNT value on done: 115.0
[2023-02-25 12:22:11,307][2409597] Sum rewards: -7.069, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.356', 'AMMO5': '0.003', 'weapon5': '0.028', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'ARMOR': '0.052', 'HITCOUNT': '0.100', 'weapon4': '0.108', 'AMMO3': '0.110', 'AMMO4': '0.173', 'DAMAGECOUNT': '0.345', 'WEAPON4': '0.350', 'WEAPON3': '0.550', 'weapon3': '0.636', 'FRAGCOUNT': '1.000', 'weapon2': '1.248'}
[2023-02-25 12:22:11,311][2409549] DAMAGECOUNT value on done: 135.0
[2023-02-25 12:22:11,312][2409549] Sum rewards: -3.742, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.760', 'AMMO2': '0.002', 'ARMOR': '0.004', 'AMMO4': '0.012', 'HITCOUNT': '0.090', 'AMMO3': '0.121', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.106', 'weapon2': '1.128'}
[2023-02-25 12:22:11,505][2409596] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:22:11,544][2409355] DAMAGECOUNT value on done: 5.0
[2023-02-25 12:22:11,551][2409100] DAMAGECOUNT value on done: 60.0
[2023-02-25 12:22:11,654][2409373] DAMAGECOUNT value on done: 140.0
[2023-02-25 12:22:11,657][2409373] Sum rewards: -5.955, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.910', 'AMMO2': '0.004', 'AMMO4': '0.021', 'ARMOR': '0.028', 'weapon4': '0.040', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.162', 'DAMAGECOUNT': '0.420', 'weapon3': '0.746', 'WEAPON3': '0.850', 'weapon2': '1.214', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:22:11,696][2409102] DAMAGECOUNT value on done: 51.0
[2023-02-25 12:22:11,699][2409102] Sum rewards: -1.383, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.564', 'AMMO2': '0.007', 'AMMO4': '0.036', 'HITCOUNT': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'weapon4': '0.118', 'DAMAGECOUNT': '0.153', 'weapon3': '0.394', 'WEAPON3': '0.450', 'ARMOR': '0.480', 'weapon2': '1.288', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:22:11,749][2409103] DAMAGECOUNT value on done: 105.0
[2023-02-25 12:22:11,750][2409103] Sum rewards: -2.904, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.017', 'ARMOR': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'HITCOUNT': '0.060', 'weapon4': '0.074', 'AMMO4': '0.084', 'HEALTH': '0.088', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.315', 'weapon3': '0.484', 'FRAGCOUNT': '1.000', 'weapon2': '1.266'}
[2023-02-25 12:22:11,781][2409866] DAMAGECOUNT value on done: 5.0
[2023-02-25 12:22:11,814][2409101] DAMAGECOUNT value on done: 50.0
[2023-02-25 12:22:11,814][2409101] Sum rewards: -10.958, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.842', 'AMMO2': '0.033', 'ARMOR': '0.048', 'HITCOUNT': '0.070', 'weapon4': '0.112', 'DAMAGECOUNT': '0.150', 'AMMO3': '0.166', 'AMMO4': '0.167', 'WEAPON4': '0.300', 'weapon3': '0.566', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.222'}
[2023-02-25 12:22:11,889][2409104] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:22:11,892][2409104] Sum rewards: -6.306, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.183', 'AMMO2': '0.026', 'HITCOUNT': '0.030', 'DAMAGECOUNT': '0.075', 'AMMO4': '0.127', 'AMMO3': '0.132', 'weapon4': '0.328', 'WEAPON4': '0.350', 'weapon3': '0.500', 'ARMOR': '0.553', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.056'}
[2023-02-25 12:22:11,969][2409079] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:22:11,972][2409079] Sum rewards: -4.525, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.065', 'ARMOR': '0.004', 'weapon5': '0.006', 'AMMO2': '0.009', 'AMMO5': '0.010', 'HITCOUNT': '0.020', 'DAMAGECOUNT': '0.030', 'AMMO4': '0.044', 'weapon4': '0.064', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.133', 'WEAPON3': '0.650', 'weapon2': '0.910', 'weapon3': '0.960', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:22:12,084][2409105] DAMAGECOUNT value on done: 85.0
[2023-02-25 12:22:12,186][2408954] Fps is (10 sec: 24166.2, 60 sec: 25190.4, 300 sec: 19535.4). Total num frames: 4448256. Throughput: 0: 6264.3. Samples: 1113912. Policy #0 lag: (min: 0.0, avg: 13.5, max: 26.0)
[2023-02-25 12:22:12,186][2408954] Avg episode reward: [(0, '-4.426')]
[2023-02-25 12:22:12,558][2409080] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:22:12,862][2409076] DAMAGECOUNT value on done: 35.0
[2023-02-25 12:22:12,883][2409074] Updated weights for policy 0, policy_version 1090 (0.0012)
[2023-02-25 12:22:12,991][2409565] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:22:13,220][2409406] DAMAGECOUNT value on done: 100.0
[2023-02-25 12:22:13,224][2409406] Sum rewards: -5.944, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.968', 'AMMO2': '0.013', 'AMMO3': '0.054', 'AMMO4': '0.066', 'HITCOUNT': '0.070', 'ARMOR': '0.088', 'weapon4': '0.096', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.300', 'weapon3': '0.474', 'FRAGCOUNT': '1.000', 'weapon2': '1.412'}
[2023-02-25 12:22:13,447][2409389] DAMAGECOUNT value on done: 95.0
[2023-02-25 12:22:13,448][2409389] Sum rewards: -5.932, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.640', 'AMMO2': '0.013', 'weapon4': '0.034', 'ARMOR': '0.040', 'HITCOUNT': '0.060', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'DAMAGECOUNT': '0.285', 'WEAPON3': '0.600', 'weapon3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.108'}
[2023-02-25 12:22:13,452][2409485] DAMAGECOUNT value on done: 30.0
[2023-02-25 12:22:13,501][2409548] DAMAGECOUNT value on done: 32.0
[2023-02-25 12:22:13,517][2409099] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:22:13,756][2409407] DAMAGECOUNT value on done: 35.0
[2023-02-25 12:22:13,816][2409077] DAMAGECOUNT value on done: 120.0
[2023-02-25 12:22:13,817][2409077] Sum rewards: -7.877, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.960', 'AMMO2': '0.027', 'HITCOUNT': '0.080', 'weapon4': '0.094', 'AMMO3': '0.128', 'AMMO4': '0.135', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.360', 'ARMOR': '0.495', 'WEAPON3': '0.550', 'weapon3': '0.552', 'FRAGCOUNT': '1.000', 'weapon2': '1.362'}
[2023-02-25 12:22:13,903][2409547] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:22:14,022][2409468] DAMAGECOUNT value on done: 27.0
[2023-02-25 12:22:14,038][2409074] Updated weights for policy 0, policy_version 1100 (0.0012)
[2023-02-25 12:22:14,162][2409075] DAMAGECOUNT value on done: 55.0
[2023-02-25 12:22:14,556][2409469] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:22:14,558][2409097] DAMAGECOUNT value on done: 29.0
[2023-02-25 12:22:14,728][2409405] DAMAGECOUNT value on done: 30.0
[2023-02-25 12:22:14,793][2409486] DAMAGECOUNT value on done: 50.0
[2023-02-25 12:22:14,794][2409486] Sum rewards: -6.098, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.124', 'AMMO5': '0.007', 'weapon4': '0.018', 'AMMO2': '0.023', 'ARMOR': '0.024', 'weapon5': '0.038', 'HITCOUNT': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.115', 'DAMAGECOUNT': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'WEAPON3': '0.850', 'weapon3': '0.886', 'FRAGCOUNT': '1.000', 'weapon2': '1.200'}
[2023-02-25 12:22:15,075][2409549] DAMAGECOUNT value on done: 70.0
[2023-02-25 12:22:15,122][2409100] DAMAGECOUNT value on done: 20.0
[2023-02-25 12:22:15,151][2409597] DAMAGECOUNT value on done: 275.0
[2023-02-25 12:22:15,154][2409597] Sum rewards: -0.780, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.710', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'AMMO4': '0.129', 'HITCOUNT': '0.170', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.825', 'weapon2': '0.920', 'weapon3': '1.126', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:22:15,154][2409355] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:22:15,180][2409596] DAMAGECOUNT value on done: 125.0
[2023-02-25 12:22:15,184][2409596] Sum rewards: -1.816, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.880', 'AMMO2': '0.007', 'AMMO5': '0.010', 'weapon4': '0.014', 'AMMO4': '0.036', 'ARMOR': '0.070', 'HITCOUNT': '0.080', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.450', 'weapon3': '0.626', 'FRAGCOUNT': '1.000', 'weapon2': '1.246'}
[2023-02-25 12:22:15,217][2409078] DAMAGECOUNT value on done: 110.0
[2023-02-25 12:22:15,220][2409078] Sum rewards: -6.637, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.670', 'AMMO5': '0.007', 'weapon5': '0.016', 'AMMO2': '0.025', 'ARMOR': '0.040', 'HITCOUNT': '0.060', 'weapon4': '0.092', 'AMMO3': '0.116', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.700', 'weapon3': '0.970', 'FRAGCOUNT': '1.000', 'weapon2': '1.100'}
[2023-02-25 12:22:15,234][2409096] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:22:15,422][2409101] DAMAGECOUNT value on done: 85.0
[2023-02-25 12:22:15,425][2409866] DAMAGECOUNT value on done: 124.0
[2023-02-25 12:22:15,429][2409866] Sum rewards: -3.793, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.580', 'AMMO2': '0.012', 'AMMO4': '0.057', 'AMMO3': '0.094', 'weapon4': '0.106', 'HITCOUNT': '0.120', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.372', 'WEAPON3': '0.550', 'weapon3': '0.986', 'FRAGCOUNT': '1.000', 'weapon2': '1.090'}
[2023-02-25 12:22:15,570][2409104] DAMAGECOUNT value on done: 113.0
[2023-02-25 12:22:15,571][2409104] Sum rewards: -4.591, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.689', 'AMMO2': '0.006', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'weapon4': '0.078', 'AMMO3': '0.104', 'HITCOUNT': '0.120', 'DAMAGECOUNT': '0.339', 'WEAPON3': '0.600', 'weapon3': '0.892', 'weapon2': '1.132', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:22:15,605][2409373] DAMAGECOUNT value on done: 90.0
[2023-02-25 12:22:15,605][2409373] Sum rewards: -7.033, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.815', 'AMMO2': '0.019', 'ARMOR': '0.024', 'HITCOUNT': '0.080', 'AMMO4': '0.097', 'AMMO3': '0.108', 'weapon4': '0.112', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.270', 'WEAPON3': '0.550', 'weapon3': '0.674', 'FRAGCOUNT': '1.000', 'weapon2': '1.148'}
[2023-02-25 12:22:15,770][2409079] DAMAGECOUNT value on done: 28.0
[2023-02-25 12:22:15,782][2409103] DAMAGECOUNT value on done: 5.0
[2023-02-25 12:22:15,931][2409074] Updated weights for policy 0, policy_version 1110 (0.0012)
[2023-02-25 12:22:15,939][2409105] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:22:16,152][2409102] DAMAGECOUNT value on done: 35.0
[2023-02-25 12:22:16,242][2409080] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:22:16,595][2409033] Signal inference workers to stop experience collection... (150 times)
[2023-02-25 12:22:16,612][2409074] InferenceWorker_p0-w0: stopping experience collection (150 times)
[2023-02-25 12:22:16,619][2409033] Signal inference workers to resume experience collection... (150 times)
[2023-02-25 12:22:16,640][2409074] InferenceWorker_p0-w0: resuming experience collection (150 times)
[2023-02-25 12:22:16,792][2409076] DAMAGECOUNT value on done: 43.0
[2023-02-25 12:22:16,918][2409565] DAMAGECOUNT value on done: 110.0
[2023-02-25 12:22:16,920][2409565] Sum rewards: -4.272, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.298', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.013', 'HITCOUNT': '0.100', 'AMMO3': '0.161', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.900', 'weapon2': '0.910', 'FRAGCOUNT': '1.000', 'weapon3': '1.104'}
[2023-02-25 12:22:17,074][2409074] Updated weights for policy 0, policy_version 1120 (0.0013)
[2023-02-25 12:22:17,098][2409406] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:22:17,105][2409548] DAMAGECOUNT value on done: 115.0
[2023-02-25 12:22:17,110][2409548] Sum rewards: -5.761, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.208', 'AMMO2': '0.011', 'ARMOR': '0.040', 'AMMO4': '0.057', 'HITCOUNT': '0.080', 'weapon4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.154', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.700', 'weapon3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.018'}
[2023-02-25 12:22:17,186][2408954] Fps is (10 sec: 26624.0, 60 sec: 25326.9, 300 sec: 19731.7). Total num frames: 4591616. Throughput: 0: 6280.0. Samples: 1152072. Policy #0 lag: (min: 1.0, avg: 10.3, max: 25.0)
[2023-02-25 12:22:17,186][2408954] Avg episode reward: [(0, '-4.361')]
[2023-02-25 12:22:17,191][2409033] Saving /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000001121_4591616.pth...
[2023-02-25 12:22:17,500][2409407] DAMAGECOUNT value on done: 65.0
[2023-02-25 12:22:17,565][2409099] DAMAGECOUNT value on done: 35.0
[2023-02-25 12:22:17,599][2409547] DAMAGECOUNT value on done: 115.0
[2023-02-25 12:22:17,697][2409077] DAMAGECOUNT value on done: 168.0
[2023-02-25 12:22:17,701][2409077] Sum rewards: -9.430, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.727', 'weapon4': '0.006', 'AMMO2': '0.007', 'ARMOR': '0.016', 'AMMO4': '0.037', 'WEAPON4': '0.100', 'HITCOUNT': '0.170', 'AMMO3': '0.240', 'DAMAGECOUNT': '0.504', 'weapon3': '0.870', 'FRAGCOUNT': '1.000', 'weapon2': '1.146', 'WEAPON3': '1.200'}
[2023-02-25 12:22:17,807][2409468] DAMAGECOUNT value on done: 5.0
[2023-02-25 12:22:17,919][2409485] DAMAGECOUNT value on done: 145.0
[2023-02-25 12:22:17,923][2409485] Sum rewards: -3.420, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.568', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'weapon4': '0.108', 'HITCOUNT': '0.110', 'AMMO3': '0.151', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.800', 'weapon3': '0.804', 'weapon2': '1.138', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:22:17,929][2409389] DAMAGECOUNT value on done: 65.0
[2023-02-25 12:22:17,932][2409389] Sum rewards: -5.347, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.962', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.022', 'AMMO4': '0.024', 'WEAPON5': '0.050', 'HITCOUNT': '0.060', 'AMMO3': '0.091', 'weapon4': '0.096', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.195', 'weapon3': '0.434', 'WEAPON3': '0.500', 'ARMOR': '0.982', 'weapon2': '1.304'}
[2023-02-25 12:22:18,231][2409097] DAMAGECOUNT value on done: 92.0
[2023-02-25 12:22:18,234][2409097] Sum rewards: -5.337, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.986', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'weapon5': '0.048', 'WEAPON5': '0.050', 'HITCOUNT': '0.110', 'AMMO3': '0.114', 'DAMAGECOUNT': '0.276', 'WEAPON3': '0.600', 'weapon2': '0.964', 'weapon3': '0.972', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:22:18,242][2409469] DAMAGECOUNT value on done: 75.0
[2023-02-25 12:22:18,286][2409405] DAMAGECOUNT value on done: 100.0
[2023-02-25 12:22:18,290][2409405] Sum rewards: -5.785, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.545', 'AMMO2': '0.011', 'ARMOR': '0.024', 'AMMO4': '0.055', 'HITCOUNT': '0.100', 'AMMO3': '0.159', 'weapon4': '0.190', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.300', 'weapon3': '0.600', 'WEAPON3': '0.750', 'weapon2': '0.870', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:22:18,590][2409549] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:22:18,611][2409549] Sum rewards: -6.737, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.160', 'AMMO5': '0.003', 'HITCOUNT': '0.010', 'weapon5': '0.012', 'AMMO2': '0.020', 'DAMAGECOUNT': '0.030', 'weapon4': '0.046', 'WEAPON5': '0.050', 'ARMOR': '0.094', 'AMMO4': '0.100', 'AMMO3': '0.125', 'WEAPON4': '0.200', 'WEAPON3': '0.700', 'weapon3': '0.818', 'weapon2': '1.216'}
[2023-02-25 12:22:18,669][2409597] DAMAGECOUNT value on done: 255.0
[2023-02-25 12:22:18,672][2409597] Sum rewards: -5.125, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.260', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON5': '0.050', 'weapon4': '0.050', 'ARMOR': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.126', 'HITCOUNT': '0.160', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.765', 'FRAGCOUNT': '1.000', 'weapon3': '1.008', 'weapon2': '1.130'}
[2023-02-25 12:22:18,673][2409075] DAMAGECOUNT value on done: 50.0
[2023-02-25 12:22:18,752][2409486] DAMAGECOUNT value on done: 55.0
[2023-02-25 12:22:18,833][2409078] DAMAGECOUNT value on done: 5.0
[2023-02-25 12:22:18,833][2409078] Sum rewards: -5.064, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.890', 'AMMO5': '0.003', 'AMMO2': '0.006', 'HITCOUNT': '0.010', 'DAMAGECOUNT': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.029', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.113', 'ARMOR': '0.456', 'WEAPON3': '0.650', 'weapon3': '0.714', 'FRAGCOUNT': '1.000', 'weapon2': '1.150'}
[2023-02-25 12:22:18,937][2409355] DAMAGECOUNT value on done: 50.0
[2023-02-25 12:22:18,965][2409096] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:22:18,984][2409101] DAMAGECOUNT value on done: 100.0
[2023-02-25 12:22:18,987][2409101] Sum rewards: -11.128, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.188', 'AMMO5': '0.010', 'AMMO2': '0.015', 'HITCOUNT': '0.050', 'AMMO4': '0.076', 'ARMOR': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.164', 'AMMO3': '0.171', 'DAMAGECOUNT': '0.300', 'weapon3': '0.588', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.006'}
[2023-02-25 12:22:19,044][2409100] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:22:19,179][2409866] DAMAGECOUNT value on done: 125.0
[2023-02-25 12:22:19,182][2409866] Sum rewards: -8.867, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.320', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon5': '0.016', 'WEAPON5': '0.050', 'HITCOUNT': '0.070', 'AMMO3': '0.213', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon3': '1.000', 'weapon2': '1.038'}
[2023-02-25 12:22:19,244][2409373] DAMAGECOUNT value on done: 125.0
[2023-02-25 12:22:19,245][2409373] Sum rewards: -5.787, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.065', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.009', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'HITCOUNT': '0.070', 'weapon4': '0.082', 'weapon5': '0.094', 'AMMO3': '0.135', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.750', 'weapon3': '0.796', 'weapon2': '0.916'}
[2023-02-25 12:22:19,350][2409079] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:22:19,358][2409596] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:22:19,434][2409074] Updated weights for policy 0, policy_version 1130 (0.0013)
[2023-02-25 12:22:19,463][2409105] DAMAGECOUNT value on done: 110.0
[2023-02-25 12:22:19,464][2409105] Sum rewards: -6.518, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.640', 'AMMO2': '0.027', 'ARMOR': '0.048', 'HITCOUNT': '0.080', 'AMMO4': '0.132', 'AMMO3': '0.143', 'weapon4': '0.254', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.330', 'weapon3': '0.470', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.088'}
[2023-02-25 12:22:19,739][2409104] DAMAGECOUNT value on done: 50.0
[2023-02-25 12:22:19,773][2409102] DAMAGECOUNT value on done: 110.0
[2023-02-25 12:22:19,777][2409102] Sum rewards: -2.976, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.330', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'HITCOUNT': '0.060', 'AMMO3': '0.075', 'AMMO4': '0.080', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.152', 'DAMAGECOUNT': '0.330', 'weapon3': '0.360', 'WEAPON3': '0.400', 'FRAGCOUNT': '1.000', 'weapon2': '1.222'}
[2023-02-25 12:22:19,897][2409103] DAMAGECOUNT value on done: 60.0
[2023-02-25 12:22:19,900][2409103] Sum rewards: -4.903, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.310', 'AMMO2': '0.022', 'HITCOUNT': '0.070', 'AMMO3': '0.078', 'weapon4': '0.102', 'AMMO4': '0.110', 'DAMAGECOUNT': '0.180', 'WEAPON4': '0.300', 'ARMOR': '0.460', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon2': '1.026', 'weapon3': '1.058'}
[2023-02-25 12:22:20,336][2409080] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:22:20,341][2409080] Sum rewards: -4.871, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.200', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.012', 'weapon5': '0.020', 'AMMO4': '0.023', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'HITCOUNT': '0.050', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.135', 'WEAPON3': '0.400', 'weapon3': '0.500', 'weapon2': '1.404'}
[2023-02-25 12:22:20,380][2409076] DAMAGECOUNT value on done: 55.0
[2023-02-25 12:22:20,383][2409076] Sum rewards: -6.723, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.764', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.028', 'HITCOUNT': '0.050', 'AMMO4': '0.052', 'ARMOR': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'weapon4': '0.112', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.165', 'WEAPON3': '0.650', 'weapon3': '0.860', 'weapon2': '0.916'}
[2023-02-25 12:22:20,522][2409074] Updated weights for policy 0, policy_version 1140 (0.0013)
[2023-02-25 12:22:20,565][2409565] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:22:21,062][2409407] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:22:21,216][2409099] DAMAGECOUNT value on done: 170.0
[2023-02-25 12:22:21,217][2409099] Sum rewards: -6.925, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.430', 'AMMO2': '0.015', 'ARMOR': '0.067', 'AMMO4': '0.074', 'HITCOUNT': '0.100', 'AMMO3': '0.121', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.650', 'weapon3': '0.726', 'weapon2': '1.492', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:22:21,306][2409548] DAMAGECOUNT value on done: 9.0
[2023-02-25 12:22:21,361][2409406] DAMAGECOUNT value on done: 295.0
[2023-02-25 12:22:21,364][2409406] Sum rewards: -5.014, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.922', 'AMMO2': '0.029', 'ARMOR': '0.094', 'weapon4': '0.112', 'AMMO4': '0.143', 'AMMO3': '0.159', 'HITCOUNT': '0.160', 'WEAPON4': '0.300', 'weapon3': '0.584', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.885', 'weapon2': '1.142', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:22:21,373][2409547] DAMAGECOUNT value on done: 115.0
[2023-02-25 12:22:21,374][2409547] Sum rewards: -4.526, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.214', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'HITCOUNT': '0.060', 'AMMO4': '0.093', 'AMMO3': '0.143', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.034', 'weapon2': '1.160'}
[2023-02-25 12:22:21,535][2409485] DAMAGECOUNT value on done: 109.0
[2023-02-25 12:22:21,536][2409485] Sum rewards: -4.371, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.590', 'AMMO5': '0.005', 'AMMO2': '0.015', 'ARMOR': '0.068', 'HITCOUNT': '0.070', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.126', 'weapon4': '0.156', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.327', 'WEAPON3': '0.700', 'weapon3': '0.904', 'weapon2': '0.974', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:22:21,868][2409405] DAMAGECOUNT value on done: 85.0
[2023-02-25 12:22:21,911][2409389] DAMAGECOUNT value on done: 338.0
[2023-02-25 12:22:21,914][2409389] Sum rewards: -8.004, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.918', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon4': '0.068', 'weapon5': '0.078', 'AMMO4': '0.087', 'HITCOUNT': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'ARMOR': '0.470', 'weapon3': '0.844', 'WEAPON3': '0.900', 'DAMAGECOUNT': '0.990', 'weapon2': '0.992', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:22:21,938][2409097] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:22:22,028][2409077] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:22:22,031][2409468] DAMAGECOUNT value on done: 145.0
[2023-02-25 12:22:22,032][2409468] Sum rewards: -5.435, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.791', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.010', 'weapon4': '0.036', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.158', 'DAMAGECOUNT': '0.435', 'ARMOR': '0.497', 'weapon3': '0.682', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.184'}
[2023-02-25 12:22:22,186][2408954] Fps is (10 sec: 25805.0, 60 sec: 25190.5, 300 sec: 19799.2). Total num frames: 4706304. Throughput: 0: 6311.5. Samples: 1171164. Policy #0 lag: (min: 0.0, avg: 11.5, max: 28.0)
[2023-02-25 12:22:22,186][2408954] Avg episode reward: [(0, '-4.318')]
[2023-02-25 12:22:22,253][2409549] DAMAGECOUNT value on done: 65.0
[2023-02-25 12:22:22,416][2409074] Updated weights for policy 0, policy_version 1150 (0.0012)
[2023-02-25 12:22:22,536][2409597] DAMAGECOUNT value on done: 37.0
[2023-02-25 12:22:22,607][2409486] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:22:22,608][2409078] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:22:22,642][2409101] DAMAGECOUNT value on done: 125.0
[2023-02-25 12:22:22,647][2409101] Sum rewards: -3.715, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.020', 'weapon4': '0.056', 'ARMOR': '0.064', 'HITCOUNT': '0.090', 'AMMO3': '0.097', 'AMMO4': '0.099', 'HEALTH': '0.154', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.500', 'weapon3': '0.710', 'FRAGCOUNT': '1.000', 'weapon2': '1.170'}
[2023-02-25 12:22:22,654][2409469] DAMAGECOUNT value on done: 5.0
[2023-02-25 12:22:22,737][2409075] DAMAGECOUNT value on done: 70.0
[2023-02-25 12:22:22,781][2409355] DAMAGECOUNT value on done: 30.0
[2023-02-25 12:22:22,782][2409355] Sum rewards: -2.096, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.046', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'weapon5': '0.028', 'HITCOUNT': '0.030', 'weapon4': '0.040', 'ARMOR': '0.047', 'AMMO4': '0.063', 'AMMO3': '0.090', 'DAMAGECOUNT': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.400', 'weapon3': '0.724', 'FRAGCOUNT': '1.000', 'weapon2': '1.210'}
[2023-02-25 12:22:22,794][2409079] DAMAGECOUNT value on done: 30.0
[2023-02-25 12:22:22,836][2409373] DAMAGECOUNT value on done: 30.0
[2023-02-25 12:22:22,839][2409373] Sum rewards: -4.688, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.856', 'AMMO2': '0.026', 'HITCOUNT': '0.030', 'ARMOR': '0.036', 'DAMAGECOUNT': '0.090', 'AMMO4': '0.132', 'AMMO3': '0.142', 'weapon4': '0.200', 'WEAPON4': '0.300', 'weapon3': '0.664', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.048'}
[2023-02-25 12:22:22,909][2409100] DAMAGECOUNT value on done: 190.0
[2023-02-25 12:22:22,910][2409100] Sum rewards: -4.832, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.016', 'weapon4': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'AMMO3': '0.135', 'HITCOUNT': '0.160', 'HEALTH': '0.284', 'weapon3': '0.542', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.344'}
[2023-02-25 12:22:23,003][2409866] DAMAGECOUNT value on done: 49.0
[2023-02-25 12:22:23,102][2409596] DAMAGECOUNT value on done: 65.0
[2023-02-25 12:22:23,348][2409103] DAMAGECOUNT value on done: 23.0
[2023-02-25 12:22:23,349][2409103] Sum rewards: -4.641, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.262', 'AMMO5': '0.003', 'AMMO2': '0.004', 'HITCOUNT': '0.020', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'DAMAGECOUNT': '0.069', 'weapon7': '0.076', 'ARMOR': '0.112', 'weapon4': '0.126', 'AMMO3': '0.157', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON3': '0.850', 'weapon3': '0.914', 'weapon2': '0.948', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:22:23,400][2409096] DAMAGECOUNT value on done: 60.0
[2023-02-25 12:22:23,404][2409096] Sum rewards: -3.288, reward structure: {'DEATHCOUNT': '-7.500', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'ARMOR': '0.020', 'HITCOUNT': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.089', 'DAMAGECOUNT': '0.180', 'HEALTH': '0.332', 'WEAPON3': '0.400', 'weapon3': '0.954', 'FRAGCOUNT': '1.000', 'weapon2': '1.044'}
[2023-02-25 12:22:23,470][2409105] DAMAGECOUNT value on done: 40.0
[2023-02-25 12:22:23,475][2409104] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:22:23,553][2409102] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:22:23,975][2409076] DAMAGECOUNT value on done: 7.0
[2023-02-25 12:22:24,077][2409074] Updated weights for policy 0, policy_version 1160 (0.0013)
[2023-02-25 12:22:24,559][2409565] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:22:24,616][2409080] DAMAGECOUNT value on done: 50.0
[2023-02-25 12:22:24,840][2409407] DAMAGECOUNT value on done: 110.0
[2023-02-25 12:22:24,841][2409407] Sum rewards: -4.101, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.443', 'AMMO5': '0.003', 'AMMO2': '0.007', 'HITCOUNT': '0.010', 'weapon4': '0.018', 'weapon5': '0.020', 'AMMO4': '0.033', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.084', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.450', 'ARMOR': '0.464', 'weapon3': '0.778', 'FRAGCOUNT': '1.000', 'weapon2': '1.296'}
[2023-02-25 12:22:24,881][2409074] Updated weights for policy 0, policy_version 1170 (0.0012)
[2023-02-25 12:22:25,011][2409548] DAMAGECOUNT value on done: 115.0
[2023-02-25 12:22:25,013][2409548] Sum rewards: -5.188, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.588', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.032', 'weapon4': '0.042', 'WEAPON4': '0.050', 'ARMOR': '0.064', 'HITCOUNT': '0.070', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.500', 'weapon3': '0.630', 'FRAGCOUNT': '1.000', 'weapon2': '1.422'}
[2023-02-25 12:22:25,060][2409485] DAMAGECOUNT value on done: 28.0
[2023-02-25 12:22:25,167][2409099] DAMAGECOUNT value on done: 95.0
[2023-02-25 12:22:25,283][2409547] DAMAGECOUNT value on done: 79.0
[2023-02-25 12:22:25,327][2409406] DAMAGECOUNT value on done: 104.0
[2023-02-25 12:22:25,815][2409097] DAMAGECOUNT value on done: 306.0
[2023-02-25 12:22:25,818][2409097] Sum rewards: -7.587, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.950', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.028', 'weapon4': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'HITCOUNT': '0.130', 'AMMO3': '0.152', 'ARMOR': '0.440', 'weapon3': '0.540', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.918', 'weapon2': '1.154', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:22:25,855][2409405] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:22:25,895][2409389] DAMAGECOUNT value on done: 80.0
[2023-02-25 12:22:25,898][2409389] Sum rewards: -4.402, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.262', 'AMMO4': '-0.018', 'AMMO2': '-0.003', 'WEAPON1': '0.020', 'ARMOR': '0.052', 'HITCOUNT': '0.070', 'AMMO3': '0.109', 'DAMAGECOUNT': '0.240', 'WEAPON3': '0.650', 'weapon3': '0.968', 'FRAGCOUNT': '1.000', 'weapon2': '1.272'}
[2023-02-25 12:22:25,903][2409549] DAMAGECOUNT value on done: 76.0
[2023-02-25 12:22:25,905][2409549] Sum rewards: -4.589, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.115', 'AMMO2': '0.019', 'weapon4': '0.076', 'HITCOUNT': '0.090', 'AMMO4': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.100', 'AMMO3': '0.130', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.228', 'WEAPON3': '0.700', 'weapon3': '0.832', 'FRAGCOUNT': '1.000', 'weapon2': '1.058'}
[2023-02-25 12:22:25,908][2409077] DAMAGECOUNT value on done: 120.0
[2023-02-25 12:22:25,911][2409077] Sum rewards: -4.734, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.564', 'AMMO2': '0.004', 'AMMO4': '0.019', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'HITCOUNT': '0.070', 'AMMO3': '0.097', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.500', 'weapon3': '0.740', 'weapon2': '1.238', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:22:26,184][2409101] DAMAGECOUNT value on done: 19.0
[2023-02-25 12:22:26,312][2409373] DAMAGECOUNT value on done: 35.0
[2023-02-25 12:22:26,315][2409373] Sum rewards: -5.858, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.106', 'weapon5': '0.002', 'AMMO2': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'HITCOUNT': '0.030', 'AMMO4': '0.033', 'weapon4': '0.038', 'ARMOR': '0.048', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.105', 'AMMO3': '0.109', 'WEAPON5': '0.200', 'WEAPON3': '0.550', 'weapon3': '0.840', 'FRAGCOUNT': '1.000', 'weapon2': '1.156'}
[2023-02-25 12:22:26,324][2409486] DAMAGECOUNT value on done: 44.0
[2023-02-25 12:22:26,351][2409355] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:22:26,351][2409355] Sum rewards: -11.370, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.076', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.003', 'HITCOUNT': '0.010', 'AMMO2': '0.014', 'weapon5': '0.016', 'ARMOR': '0.036', 'DAMAGECOUNT': '0.045', 'WEAPON5': '0.050', 'AMMO4': '0.070', 'WEAPON4': '0.150', 'weapon4': '0.158', 'AMMO3': '0.202', 'weapon3': '0.684', 'WEAPON3': '0.950', 'weapon2': '1.068'}
[2023-02-25 12:22:26,380][2409597] DAMAGECOUNT value on done: 50.0
[2023-02-25 12:22:26,382][2409469] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:22:26,385][2409469] Sum rewards: -5.637, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.170', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'ARMOR': '0.024', 'HITCOUNT': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.056', 'DAMAGECOUNT': '0.075', 'AMMO3': '0.091', 'WEAPON3': '0.400', 'weapon3': '0.570', 'FRAGCOUNT': '1.000', 'weapon2': '1.474'}
[2023-02-25 12:22:26,408][2409468] DAMAGECOUNT value on done: 30.0
[2023-02-25 12:22:26,489][2409078] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:22:26,565][2409100] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:22:26,577][2409075] DAMAGECOUNT value on done: 124.0
[2023-02-25 12:22:26,578][2409866] DAMAGECOUNT value on done: 90.0
[2023-02-25 12:22:26,580][2409075] Sum rewards: -7.726, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.014', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.062', 'WEAPON5': '0.100', 'HITCOUNT': '0.120', 'AMMO4': '0.122', 'AMMO3': '0.133', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.372', 'weapon3': '0.434', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.316'}
[2023-02-25 12:22:26,764][2409596] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:22:26,828][2409103] DAMAGECOUNT value on done: 72.0
[2023-02-25 12:22:26,855][2409079] DAMAGECOUNT value on done: 145.0
[2023-02-25 12:22:26,856][2409079] Sum rewards: -6.289, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.390', 'AMMO2': '0.019', 'ARMOR': '0.068', 'AMMO4': '0.094', 'HITCOUNT': '0.110', 'AMMO3': '0.133', 'weapon4': '0.134', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.435', 'weapon3': '0.620', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.288'}
[2023-02-25 12:22:27,066][2409096] DAMAGECOUNT value on done: 14.0
[2023-02-25 12:22:27,166][2409104] DAMAGECOUNT value on done: 37.0
[2023-02-25 12:22:27,186][2408954] Fps is (10 sec: 23347.2, 60 sec: 24917.3, 300 sec: 19880.7). Total num frames: 4825088. Throughput: 0: 6333.9. Samples: 1209624. Policy #0 lag: (min: 0.0, avg: 15.9, max: 26.0)
[2023-02-25 12:22:27,186][2408954] Avg episode reward: [(0, '-4.724')]
[2023-02-25 12:22:27,195][2409105] DAMAGECOUNT value on done: 67.0
[2023-02-25 12:22:27,284][2409074] Updated weights for policy 0, policy_version 1180 (0.0012)
[2023-02-25 12:22:27,416][2409076] DAMAGECOUNT value on done: 169.0
[2023-02-25 12:22:27,419][2409076] Sum rewards: -6.780, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.980', 'ARMOR': '0.016', 'AMMO2': '0.024', 'weapon4': '0.052', 'AMMO4': '0.120', 'HITCOUNT': '0.120', 'AMMO3': '0.123', 'WEAPON4': '0.200', 'weapon3': '0.478', 'DAMAGECOUNT': '0.507', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.410'}
[2023-02-25 12:22:28,238][2409074] Updated weights for policy 0, policy_version 1190 (0.0013)
[2023-02-25 12:22:28,342][2409102] DAMAGECOUNT value on done: 165.0
[2023-02-25 12:22:28,344][2409102] Sum rewards: -0.555, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.184', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.038', 'AMMO3': '0.072', 'WEAPON5': '0.100', 'HITCOUNT': '0.150', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.495', 'weapon2': '0.814', 'weapon3': '1.292', 'FRAGCOUNT': '1.500'}
[2023-02-25 12:22:28,571][2409485] DAMAGECOUNT value on done: 190.0
[2023-02-25 12:22:28,573][2409485] Sum rewards: -5.827, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.074', 'AMMO2': '0.004', 'AMMO4': '0.018', 'WEAPON4': '0.050', 'weapon4': '0.124', 'HITCOUNT': '0.140', 'AMMO3': '0.169', 'DAMAGECOUNT': '0.570', 'weapon3': '0.844', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.178'}
[2023-02-25 12:22:28,686][2409407] DAMAGECOUNT value on done: 35.0
[2023-02-25 12:22:28,823][2409406] DAMAGECOUNT value on done: 24.0
[2023-02-25 12:22:28,857][2409547] DAMAGECOUNT value on done: 40.0
[2023-02-25 12:22:28,949][2409080] DAMAGECOUNT value on done: 122.0
[2023-02-25 12:22:29,109][2409548] DAMAGECOUNT value on done: 50.0
[2023-02-25 12:22:29,167][2409099] DAMAGECOUNT value on done: 75.0
[2023-02-25 12:22:29,180][2409565] DAMAGECOUNT value on done: 90.0
[2023-02-25 12:22:29,321][2409389] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:22:29,329][2409097] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:22:29,330][2409097] Sum rewards: -5.152, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.835', 'HITCOUNT': '0.010', 'DAMAGECOUNT': '0.030', 'AMMO2': '0.037', 'ARMOR': '0.044', 'AMMO3': '0.067', 'weapon4': '0.134', 'AMMO4': '0.186', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'weapon3': '0.486', 'FRAGCOUNT': '1.000', 'weapon2': '1.338'}
[2023-02-25 12:22:29,401][2409077] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:22:29,642][2409080] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 12:22:29,688][2409549] DAMAGECOUNT value on done: 28.0
[2023-02-25 12:22:29,689][2409549] Sum rewards: -13.974, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.290', 'FRAGCOUNT': '-0.500', 'weapon7': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.024', 'HITCOUNT': '0.030', 'ARMOR': '0.036', 'weapon4': '0.066', 'DAMAGECOUNT': '0.084', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon3': '0.602', 'weapon2': '1.076', 'WEAPON3': '1.100'}
[2023-02-25 12:22:29,832][2409373] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:22:29,874][2409405] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:22:29,877][2409405] Sum rewards: -10.992, reward structure: {'DEATHCOUNT': '-11.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.424', 'AMMO5': '0.004', 'HITCOUNT': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.017', 'DAMAGECOUNT': '0.030', 'weapon4': '0.048', 'WEAPON4': '0.050', 'weapon5': '0.054', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'weapon3': '0.804', 'WEAPON3': '0.850', 'weapon2': '0.944'}
[2023-02-25 12:22:29,956][2409355] DAMAGECOUNT value on done: 130.0
[2023-02-25 12:22:29,996][2409101] DAMAGECOUNT value on done: 49.0
[2023-02-25 12:22:29,997][2409101] Sum rewards: -4.263, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.350', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.024', 'WEAPON4': '0.050', 'HITCOUNT': '0.070', 'AMMO3': '0.079', 'AMMO4': '0.081', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.147', 'WEAPON3': '0.300', 'weapon3': '0.634', 'weapon2': '1.570', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:22:30,050][2409075] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:22:30,054][2409469] DAMAGECOUNT value on done: 95.0
[2023-02-25 12:22:30,104][2409866] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:22:30,165][2409597] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:22:30,315][2409103] DAMAGECOUNT value on done: 100.0
[2023-02-25 12:22:30,316][2409103] Sum rewards: -2.781, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.165', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'weapon5': '0.036', 'WEAPON5': '0.050', 'HITCOUNT': '0.050', 'weapon4': '0.054', 'ARMOR': '0.080', 'AMMO4': '0.100', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.300', 'weapon3': '0.482', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.398'}
[2023-02-25 12:22:30,317][2409486] DAMAGECOUNT value on done: 14.0
[2023-02-25 12:22:30,492][2409596] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:22:30,585][2409074] Updated weights for policy 0, policy_version 1200 (0.0013)
[2023-02-25 12:22:30,622][2409078] DAMAGECOUNT value on done: 133.0
[2023-02-25 12:22:30,690][2409079] DAMAGECOUNT value on done: 58.0
[2023-02-25 12:22:30,700][2409100] DAMAGECOUNT value on done: 50.0
[2023-02-25 12:22:30,744][2409096] DAMAGECOUNT value on done: 29.0
[2023-02-25 12:22:30,747][2409096] Sum rewards: -9.392, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.088', 'AMMO5': '0.005', 'ARMOR': '0.008', 'weapon5': '0.010', 'AMMO2': '0.015', 'HITCOUNT': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.072', 'AMMO4': '0.073', 'DAMAGECOUNT': '0.087', 'weapon4': '0.130', 'WEAPON4': '0.150', 'WEAPON3': '0.400', 'weapon3': '0.478', 'weapon2': '1.438'}
[2023-02-25 12:22:30,948][2409104] DAMAGECOUNT value on done: 20.0
[2023-02-25 12:22:30,951][2409076] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:22:30,956][2409468] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:22:30,987][2409105] DAMAGECOUNT value on done: 49.0
[2023-02-25 12:22:31,609][2409074] Updated weights for policy 0, policy_version 1210 (0.0012)
[2023-02-25 12:22:31,960][2409102] DAMAGECOUNT value on done: 85.0
[2023-02-25 12:22:32,141][2409485] DAMAGECOUNT value on done: 60.0
[2023-02-25 12:22:32,144][2409485] Sum rewards: -6.227, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.332', 'AMMO5': '0.003', 'AMMO2': '0.017', 'HITCOUNT': '0.050', 'ARMOR': '0.083', 'AMMO4': '0.085', 'AMMO3': '0.087', 'weapon4': '0.170', 'DAMAGECOUNT': '0.180', 'WEAPON4': '0.200', 'weapon3': '0.408', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon2': '1.372'}
[2023-02-25 12:22:32,186][2408954] Fps is (10 sec: 27033.6, 60 sec: 25463.5, 300 sec: 20091.2). Total num frames: 4976640. Throughput: 0: 6373.1. Samples: 1248612. Policy #0 lag: (min: 2.0, avg: 12.2, max: 31.0)
[2023-02-25 12:22:32,186][2408954] Avg episode reward: [(0, '-4.647')]
[2023-02-25 12:22:32,299][2409407] DAMAGECOUNT value on done: 5.0
[2023-02-25 12:22:32,511][2409547] DAMAGECOUNT value on done: 49.0
[2023-02-25 12:22:32,633][2409406] DAMAGECOUNT value on done: 175.0
[2023-02-25 12:22:32,634][2409406] Sum rewards: -7.427, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.710', 'AMMO2': '0.001', 'AMMO4': '0.005', 'ARMOR': '0.061', 'HITCOUNT': '0.140', 'AMMO3': '0.199', 'DAMAGECOUNT': '0.525', 'weapon3': '0.598', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.304'}
[2023-02-25 12:22:32,771][2409548] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:22:32,771][2409548] Sum rewards: -7.682, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.940', 'AMMO5': '0.003', 'AMMO2': '0.018', 'HITCOUNT': '0.020', 'weapon5': '0.024', 'DAMAGECOUNT': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.090', 'AMMO3': '0.117', 'weapon4': '0.198', 'WEAPON4': '0.200', 'WEAPON3': '0.450', 'weapon3': '0.660', 'weapon2': '1.148'}
[2023-02-25 12:22:32,785][2409565] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:22:32,941][2409099] DAMAGECOUNT value on done: 30.0
[2023-02-25 12:22:32,942][2409099] Sum rewards: -4.099, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.530', 'AMMO2': '0.013', 'HITCOUNT': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'DAMAGECOUNT': '0.090', 'AMMO3': '0.102', 'weapon4': '0.136', 'WEAPON3': '0.550', 'weapon2': '0.944', 'weapon3': '0.948', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:22:32,948][2409097] DAMAGECOUNT value on done: 65.0
[2023-02-25 12:22:33,006][2409080] DAMAGECOUNT value on done: 135.0
[2023-02-25 12:22:33,081][2409389] DAMAGECOUNT value on done: 76.0
[2023-02-25 12:22:33,190][2409077] DAMAGECOUNT value on done: 5.0
[2023-02-25 12:22:33,270][2409549] DAMAGECOUNT value on done: 100.0
[2023-02-25 12:22:33,365][2409074] Updated weights for policy 0, policy_version 1220 (0.0012)
[2023-02-25 12:22:33,589][2409355] DAMAGECOUNT value on done: 40.0
[2023-02-25 12:22:33,590][2409355] Sum rewards: -9.193, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.358', 'AMMO5': '0.005', 'AMMO2': '0.043', 'ARMOR': '0.049', 'HITCOUNT': '0.050', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.120', 'AMMO3': '0.145', 'weapon4': '0.190', 'AMMO4': '0.213', 'WEAPON4': '0.450', 'weapon3': '0.486', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.464'}
[2023-02-25 12:22:33,637][2409101] DAMAGECOUNT value on done: 50.0
[2023-02-25 12:22:33,700][2409866] DAMAGECOUNT value on done: 66.0
[2023-02-25 12:22:33,701][2409866] Sum rewards: -6.522, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.096', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'HITCOUNT': '0.030', 'ARMOR': '0.044', 'weapon4': '0.068', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.120', 'DAMAGECOUNT': '0.198', 'WEAPON4': '0.250', 'WEAPON3': '0.650', 'weapon3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.240'}
[2023-02-25 12:22:33,703][2409373] DAMAGECOUNT value on done: 49.0
[2023-02-25 12:22:33,797][2409469] DAMAGECOUNT value on done: 140.0
[2023-02-25 12:22:33,798][2409469] Sum rewards: -8.318, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.029', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'HITCOUNT': '0.120', 'AMMO3': '0.228', 'DAMAGECOUNT': '0.420', 'weapon3': '0.986', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.250', 'weapon2': '1.254'}
[2023-02-25 12:22:33,812][2409075] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:22:33,841][2409405] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:22:33,842][2409405] Sum rewards: -5.434, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.235', 'AMMO2': '0.007', 'HITCOUNT': '0.010', 'weapon4': '0.026', 'AMMO4': '0.033', 'DAMAGECOUNT': '0.045', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.006', 'weapon3': '1.102'}
[2023-02-25 12:22:33,980][2409597] DAMAGECOUNT value on done: 28.0
[2023-02-25 12:22:34,074][2409596] DAMAGECOUNT value on done: 50.0
[2023-02-25 12:22:34,075][2409596] Sum rewards: -3.340, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.030', 'AMMO5': '0.014', 'AMMO2': '0.015', 'weapon5': '0.038', 'HITCOUNT': '0.050', 'AMMO4': '0.077', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'DAMAGECOUNT': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.650', 'weapon2': '0.934', 'FRAGCOUNT': '1.000', 'weapon3': '1.012'}
[2023-02-25 12:22:34,101][2409103] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:22:34,165][2409100] DAMAGECOUNT value on done: 65.0
[2023-02-25 12:22:34,300][2409486] DAMAGECOUNT value on done: 62.0
[2023-02-25 12:22:34,322][2409079] DAMAGECOUNT value on done: 60.0
[2023-02-25 12:22:34,325][2409079] Sum rewards: -5.739, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.922', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'ARMOR': '0.028', 'HITCOUNT': '0.060', 'AMMO3': '0.172', 'DAMAGECOUNT': '0.180', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon3': '1.010', 'weapon2': '1.066'}
[2023-02-25 12:22:34,481][2409096] DAMAGECOUNT value on done: 41.0
[2023-02-25 12:22:34,481][2409078] DAMAGECOUNT value on done: 112.0
[2023-02-25 12:22:34,482][2409078] Sum rewards: -3.883, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.379', 'AMMO2': '0.020', 'AMMO3': '0.091', 'AMMO4': '0.099', 'HITCOUNT': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.204', 'DAMAGECOUNT': '0.336', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'weapon3': '0.608', 'FRAGCOUNT': '1.000', 'weapon2': '1.188'}
[2023-02-25 12:22:34,745][2409104] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:22:34,810][2409105] DAMAGECOUNT value on done: 40.0
[2023-02-25 12:22:34,811][2409105] Sum rewards: -7.463, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.265', 'AMMO5': '0.003', 'AMMO2': '0.020', 'HITCOUNT': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.102', 'DAMAGECOUNT': '0.120', 'AMMO3': '0.149', 'weapon4': '0.242', 'WEAPON4': '0.250', 'weapon3': '0.710', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.076'}
[2023-02-25 12:22:34,847][2409076] DAMAGECOUNT value on done: 22.0
[2023-02-25 12:22:34,917][2409468] DAMAGECOUNT value on done: 20.0
[2023-02-25 12:22:35,110][2409074] Updated weights for policy 0, policy_version 1230 (0.0012)
[2023-02-25 12:22:35,388][2409102] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:22:35,391][2409102] Sum rewards: -6.285, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.920', 'AMMO5': '0.003', 'AMMO2': '0.009', 'HITCOUNT': '0.010', 'DAMAGECOUNT': '0.030', 'AMMO4': '0.042', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'WEAPON3': '0.450', 'weapon3': '0.848', 'weapon2': '1.218'}
[2023-02-25 12:22:35,920][2409485] DAMAGECOUNT value on done: 50.0
[2023-02-25 12:22:35,952][2409074] Updated weights for policy 0, policy_version 1240 (0.0013)
[2023-02-25 12:22:36,088][2409407] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:22:36,263][2409565] DAMAGECOUNT value on done: 65.0
[2023-02-25 12:22:36,484][2409547] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:22:36,513][2409406] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:22:36,515][2409548] DAMAGECOUNT value on done: 5.0
[2023-02-25 12:22:36,882][2409549] DAMAGECOUNT value on done: 9.0
[2023-02-25 12:22:36,898][2409097] DAMAGECOUNT value on done: 17.0
[2023-02-25 12:22:36,902][2409389] DAMAGECOUNT value on done: 75.0
[2023-02-25 12:22:36,901][2409097] Sum rewards: -6.853, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.510', 'AMMO2': '0.015', 'HITCOUNT': '0.030', 'DAMAGECOUNT': '0.051', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'weapon4': '0.158', 'WEAPON3': '0.750', 'weapon3': '0.954', 'FRAGCOUNT': '1.000', 'weapon2': '1.138'}
[2023-02-25 12:22:36,909][2409099] DAMAGECOUNT value on done: 57.0
[2023-02-25 12:22:36,912][2409099] Sum rewards: -7.179, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.764', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'weapon5': '0.018', 'AMMO4': '0.053', 'HITCOUNT': '0.060', 'AMMO3': '0.086', 'weapon4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.171', 'weapon3': '0.362', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon2': '1.510'}
[2023-02-25 12:22:37,114][2409077] DAMAGECOUNT value on done: 110.0
[2023-02-25 12:22:37,128][2409077] Sum rewards: -4.962, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.886', 'AMMO2': '0.010', 'weapon4': '0.026', 'AMMO4': '0.048', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.144', 'DAMAGECOUNT': '0.330', 'weapon3': '0.658', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.068'}
[2023-02-25 12:22:37,179][2409080] DAMAGECOUNT value on done: 150.0
[2023-02-25 12:22:37,180][2409080] Sum rewards: -9.054, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.430', 'AMMO2': '0.014', 'ARMOR': '0.056', 'AMMO4': '0.070', 'HITCOUNT': '0.120', 'AMMO3': '0.154', 'weapon4': '0.158', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.450', 'weapon3': '0.846', 'WEAPON3': '0.850', 'weapon2': '0.958', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:22:37,186][2408954] Fps is (10 sec: 27033.0, 60 sec: 25599.9, 300 sec: 20163.7). Total num frames: 5095424. Throughput: 0: 6405.0. Samples: 1268388. Policy #0 lag: (min: 0.0, avg: 16.0, max: 26.0)
[2023-02-25 12:22:37,186][2408954] Avg episode reward: [(0, '-5.028')]
[2023-02-25 12:22:37,196][2409373] DAMAGECOUNT value on done: 30.0
[2023-02-25 12:22:37,196][2409355] DAMAGECOUNT value on done: 48.0
[2023-02-25 12:22:37,242][2409101] DAMAGECOUNT value on done: 30.0
[2023-02-25 12:22:37,245][2409101] Sum rewards: -5.844, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.298', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.010', 'AMMO4': '0.029', 'HITCOUNT': '0.030', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.056', 'DAMAGECOUNT': '0.090', 'AMMO3': '0.148', 'WEAPON3': '0.800', 'weapon3': '0.908', 'FRAGCOUNT': '1.000', 'weapon2': '1.240'}
[2023-02-25 12:22:37,267][2409469] DAMAGECOUNT value on done: 5.0
[2023-02-25 12:22:37,308][2409866] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:22:37,489][2409405] DAMAGECOUNT value on done: 385.0
[2023-02-25 12:22:37,493][2409405] Sum rewards: -0.207, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.771', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'weapon4': '0.122', 'AMMO4': '0.122', 'AMMO3': '0.126', 'WEAPON4': '0.200', 'HITCOUNT': '0.220', 'WEAPON3': '0.550', 'weapon3': '1.000', 'weapon2': '1.034', 'DAMAGECOUNT': '1.155', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:22:37,650][2409075] DAMAGECOUNT value on done: 5.0
[2023-02-25 12:22:37,765][2409597] DAMAGECOUNT value on done: 50.0
[2023-02-25 12:22:37,849][2409103] DAMAGECOUNT value on done: 33.0
[2023-02-25 12:22:37,940][2409486] DAMAGECOUNT value on done: 35.0
[2023-02-25 12:22:37,941][2409486] Sum rewards: -7.925, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.852', 'AMMO2': '0.000', 'AMMO4': '0.001', 'HITCOUNT': '0.060', 'DAMAGECOUNT': '0.105', 'AMMO3': '0.177', 'WEAPON3': '0.950', 'weapon2': '0.986', 'FRAGCOUNT': '1.000', 'weapon3': '1.148'}
[2023-02-25 12:22:37,991][2409100] DAMAGECOUNT value on done: 70.0
[2023-02-25 12:22:38,012][2409596] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:22:38,134][2409078] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:22:38,222][2409079] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:22:38,344][2409074] Updated weights for policy 0, policy_version 1250 (0.0012)
[2023-02-25 12:22:38,382][2409104] DAMAGECOUNT value on done: 29.0
[2023-02-25 12:22:38,383][2409104] Sum rewards: -7.476, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.090', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon5': '0.006', 'AMMO4': '0.018', 'WEAPON1': '0.020', 'HITCOUNT': '0.040', 'WEAPON5': '0.050', 'weapon4': '0.066', 'DAMAGECOUNT': '0.087', 'WEAPON4': '0.100', 'AMMO3': '0.139', 'WEAPON3': '0.750', 'weapon3': '1.010', 'weapon2': '1.072'}
[2023-02-25 12:22:38,383][2409096] DAMAGECOUNT value on done: 64.0
[2023-02-25 12:22:38,543][2409076] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:22:38,544][2409076] Sum rewards: -5.096, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.361', 'AMMO5': '0.005', 'AMMO2': '0.033', 'HITCOUNT': '0.040', 'ARMOR': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'DAMAGECOUNT': '0.135', 'AMMO4': '0.164', 'weapon4': '0.204', 'WEAPON4': '0.400', 'weapon3': '0.488', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.218'}
[2023-02-25 12:22:38,836][2409102] DAMAGECOUNT value on done: 103.0
[2023-02-25 12:22:38,837][2409468] DAMAGECOUNT value on done: 5.0
[2023-02-25 12:22:38,905][2409105] DAMAGECOUNT value on done: 68.0
[2023-02-25 12:22:39,423][2409074] Updated weights for policy 0, policy_version 1260 (0.0012)
[2023-02-25 12:22:39,689][2409485] DAMAGECOUNT value on done: 4.0
[2023-02-25 12:22:39,714][2409565] DAMAGECOUNT value on done: 40.0
[2023-02-25 12:22:40,208][2409407] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:22:40,302][2409406] DAMAGECOUNT value on done: 31.0
[2023-02-25 12:22:40,315][2409547] DAMAGECOUNT value on done: 43.0
[2023-02-25 12:22:40,357][2409389] DAMAGECOUNT value on done: 105.0
[2023-02-25 12:22:40,546][2409549] DAMAGECOUNT value on done: 180.0
[2023-02-25 12:22:40,546][2409549] Sum rewards: -3.233, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.018', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.059', 'weapon4': '0.068', 'ARMOR': '0.088', 'HITCOUNT': '0.110', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.540', 'WEAPON3': '0.800', 'weapon3': '0.990', 'FRAGCOUNT': '1.000', 'weapon2': '1.082'}
[2023-02-25 12:22:40,585][2409099] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:22:40,665][2409097] DAMAGECOUNT value on done: 29.0
[2023-02-25 12:22:40,759][2409080] DAMAGECOUNT value on done: 5.0
[2023-02-25 12:22:40,764][2409355] DAMAGECOUNT value on done: 180.0
[2023-02-25 12:22:40,765][2409355] Sum rewards: -8.151, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.992', 'AMMO5': '0.003', 'weapon4': '0.010', 'WEAPON1': '0.010', 'weapon5': '0.010', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'ARMOR': '0.052', 'AMMO4': '0.093', 'AMMO3': '0.125', 'HITCOUNT': '0.150', 'DAMAGECOUNT': '0.540', 'WEAPON3': '0.700', 'weapon3': '0.702', 'FRAGCOUNT': '1.000', 'weapon2': '1.328'}
[2023-02-25 12:22:40,844][2409548] DAMAGECOUNT value on done: 20.0
[2023-02-25 12:22:40,906][2409866] DAMAGECOUNT value on done: 77.0
[2023-02-25 12:22:40,907][2409866] Sum rewards: -7.517, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.237', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.014', 'AMMO2': '0.014', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'HITCOUNT': '0.060', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'weapon4': '0.110', 'AMMO3': '0.157', 'DAMAGECOUNT': '0.231', 'weapon3': '0.604', 'WEAPON3': '0.750', 'weapon2': '1.256'}
[2023-02-25 12:22:40,965][2409077] DAMAGECOUNT value on done: 62.0
[2023-02-25 12:22:41,061][2409373] DAMAGECOUNT value on done: 35.0
[2023-02-25 12:22:41,144][2409101] DAMAGECOUNT value on done: 100.0
[2023-02-25 12:22:41,148][2409101] Sum rewards: -5.318, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.102', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'HITCOUNT': '0.070', 'ARMOR': '0.079', 'AMMO3': '0.136', 'WEAPON4': '0.200', 'weapon4': '0.280', 'DAMAGECOUNT': '0.300', 'weapon3': '0.664', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.166'}
[2023-02-25 12:22:41,195][2409075] DAMAGECOUNT value on done: 70.0
[2023-02-25 12:22:41,230][2409405] DAMAGECOUNT value on done: 65.0
[2023-02-25 12:22:41,231][2409469] DAMAGECOUNT value on done: 55.0
[2023-02-25 12:22:41,337][2409103] DAMAGECOUNT value on done: 60.0
[2023-02-25 12:22:41,341][2409103] Sum rewards: -3.260, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.094', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'HITCOUNT': '0.060', 'weapon4': '0.082', 'ARMOR': '0.101', 'AMMO3': '0.124', 'DAMAGECOUNT': '0.180', 'WEAPON3': '0.650', 'weapon3': '0.926', 'FRAGCOUNT': '1.000', 'weapon2': '1.108'}
[2023-02-25 12:22:41,572][2409596] DAMAGECOUNT value on done: 195.0
[2023-02-25 12:22:41,573][2409596] Sum rewards: -6.190, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.790', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'weapon4': '0.032', 'AMMO4': '0.086', 'AMMO3': '0.106', 'HITCOUNT': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.585', 'FRAGCOUNT': '1.000', 'weapon2': '1.128', 'weapon3': '1.236'}
[2023-02-25 12:22:41,613][2409486] DAMAGECOUNT value on done: 98.0
[2023-02-25 12:22:41,627][2409074] Updated weights for policy 0, policy_version 1270 (0.0012)
[2023-02-25 12:22:41,633][2409597] DAMAGECOUNT value on done: 24.0
[2023-02-25 12:22:41,901][2409078] DAMAGECOUNT value on done: 7.0
[2023-02-25 12:22:41,963][2409096] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:22:41,981][2409104] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:22:42,129][2409100] DAMAGECOUNT value on done: 110.0
[2023-02-25 12:22:42,175][2409076] DAMAGECOUNT value on done: 33.0
[2023-02-25 12:22:42,176][2409076] Sum rewards: -0.211, reward structure: {'DEATHCOUNT': '-5.250', 'weapon7': '0.026', 'AMMO3': '0.029', 'AMMO2': '0.031', 'HITCOUNT': '0.040', 'weapon3': '0.048', 'ARMOR': '0.097', 'DAMAGECOUNT': '0.099', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'HEALTH': '0.104', 'WEAPON3': '0.150', 'AMMO4': '0.156', 'weapon4': '0.290', 'WEAPON4': '0.350', 'weapon2': '1.318', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:22:42,186][2408954] Fps is (10 sec: 23756.7, 60 sec: 25190.4, 300 sec: 20233.5). Total num frames: 5214208. Throughput: 0: 6434.4. Samples: 1307376. Policy #0 lag: (min: 1.0, avg: 13.3, max: 26.0)
[2023-02-25 12:22:42,186][2408954] Avg episode reward: [(0, '-5.183')]
[2023-02-25 12:22:42,223][2409102] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:22:42,683][2409074] Updated weights for policy 0, policy_version 1280 (0.0012)
[2023-02-25 12:22:42,781][2409079] DAMAGECOUNT value on done: 70.0
[2023-02-25 12:22:42,815][2409468] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:22:42,860][2409105] DAMAGECOUNT value on done: 27.0
[2023-02-25 12:22:43,112][2409565] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:22:43,112][2409565] Sum rewards: -9.658, reward structure: {'DEATHCOUNT': '-10.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.444', 'AMMO5': '0.005', 'weapon5': '0.006', 'HITCOUNT': '0.010', 'AMMO2': '0.018', 'ARMOR': '0.028', 'DAMAGECOUNT': '0.030', 'weapon4': '0.090', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.198', 'weapon2': '0.880', 'WEAPON3': '1.050', 'weapon3': '1.180'}
[2023-02-25 12:22:43,157][2409485] DAMAGECOUNT value on done: 140.0
[2023-02-25 12:22:43,892][2409074] Updated weights for policy 0, policy_version 1290 (0.0012)
[2023-02-25 12:22:44,092][2409406] DAMAGECOUNT value on done: 5.0
[2023-02-25 12:22:44,233][2409407] DAMAGECOUNT value on done: 9.0
[2023-02-25 12:22:44,258][2409099] DAMAGECOUNT value on done: 155.0
[2023-02-25 12:22:44,261][2409099] Sum rewards: -1.955, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.306', 'AMMO2': '0.010', 'ARMOR': '0.040', 'AMMO4': '0.049', 'AMMO3': '0.069', 'HITCOUNT': '0.100', 'weapon7': '0.104', 'weapon4': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.465', 'weapon3': '0.796', 'weapon2': '0.864', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:22:44,306][2409548] DAMAGECOUNT value on done: 30.0
[2023-02-25 12:22:44,307][2409548] Sum rewards: -5.135, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.570', 'AMMO5': '0.007', 'AMMO2': '0.014', 'HITCOUNT': '0.040', 'weapon4': '0.044', 'ARMOR': '0.048', 'weapon5': '0.064', 'AMMO4': '0.068', 'DAMAGECOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'WEAPON5': '0.150', 'WEAPON3': '0.700', 'weapon3': '0.980', 'FRAGCOUNT': '1.000', 'weapon2': '1.006'}
[2023-02-25 12:22:44,311][2409389] DAMAGECOUNT value on done: 5.0
[2023-02-25 12:22:44,380][2409355] DAMAGECOUNT value on done: 111.0
[2023-02-25 12:22:44,461][2409547] DAMAGECOUNT value on done: 40.0
[2023-02-25 12:22:44,529][2409866] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:22:44,581][2409549] DAMAGECOUNT value on done: 4.0
[2023-02-25 12:22:44,611][2409373] DAMAGECOUNT value on done: 44.0
[2023-02-25 12:22:44,700][2409080] DAMAGECOUNT value on done: 137.0
[2023-02-25 12:22:44,703][2409080] Sum rewards: -8.652, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.760', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.054', 'AMMO4': '0.059', 'ARMOR': '0.080', 'AMMO3': '0.136', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.411', 'WEAPON3': '0.500', 'weapon3': '0.564', 'FRAGCOUNT': '1.000', 'weapon2': '1.750'}
[2023-02-25 12:22:44,771][2409097] DAMAGECOUNT value on done: 85.0
[2023-02-25 12:22:44,791][2409077] DAMAGECOUNT value on done: 4.0
[2023-02-25 12:22:44,794][2409103] DAMAGECOUNT value on done: 20.0
[2023-02-25 12:22:44,914][2409101] DAMAGECOUNT value on done: 65.0
[2023-02-25 12:22:45,130][2409075] DAMAGECOUNT value on done: 145.0
[2023-02-25 12:22:45,133][2409075] Sum rewards: -3.273, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.380', 'AMMO2': '0.014', 'ARMOR': '0.040', 'AMMO4': '0.070', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'weapon4': '0.270', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.650', 'weapon3': '0.822', 'weapon2': '0.988', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:22:45,212][2409405] DAMAGECOUNT value on done: 75.0
[2023-02-25 12:22:45,228][2409596] DAMAGECOUNT value on done: 81.0
[2023-02-25 12:22:45,229][2409596] Sum rewards: -8.821, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.572', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon5': '0.020', 'weapon4': '0.054', 'AMMO4': '0.063', 'HITCOUNT': '0.090', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.243', 'weapon3': '0.754', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.386'}
[2023-02-25 12:22:45,325][2409469] DAMAGECOUNT value on done: 20.0
[2023-02-25 12:22:45,447][2409486] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:22:45,622][2409104] DAMAGECOUNT value on done: 14.0
[2023-02-25 12:22:45,628][2409102] DAMAGECOUNT value on done: 135.0
[2023-02-25 12:22:45,633][2409100] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:22:45,726][2409597] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:22:45,937][2409076] DAMAGECOUNT value on done: 115.0
[2023-02-25 12:22:45,940][2409076] Sum rewards: -6.103, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.764', 'ARMOR': '0.004', 'AMMO2': '0.014', 'HITCOUNT': '0.060', 'weapon4': '0.066', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.550', 'weapon3': '0.926', 'FRAGCOUNT': '1.000', 'weapon2': '1.150'}
[2023-02-25 12:22:45,980][2409078] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:22:46,192][2409074] Updated weights for policy 0, policy_version 1300 (0.0015)
[2023-02-25 12:22:46,362][2409096] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:22:46,363][2409096] Sum rewards: -6.888, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.192', 'weapon4': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'HITCOUNT': '0.020', 'weapon5': '0.028', 'AMMO3': '0.047', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'DAMAGECOUNT': '0.075', 'WEAPON4': '0.100', 'WEAPON3': '0.250', 'weapon3': '0.288', 'ARMOR': '0.460', 'FRAGCOUNT': '1.000', 'weapon2': '1.658'}
[2023-02-25 12:22:46,432][2409468] DAMAGECOUNT value on done: 89.0
[2023-02-25 12:22:46,436][2409468] Sum rewards: -5.363, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.313', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.014', 'AMMO4': '0.038', 'HITCOUNT': '0.070', 'ARMOR': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'weapon4': '0.192', 'DAMAGECOUNT': '0.267', 'WEAPON3': '0.600', 'weapon3': '0.624', 'weapon2': '1.412', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:22:46,524][2409565] DAMAGECOUNT value on done: 59.0
[2023-02-25 12:22:46,606][2409105] DAMAGECOUNT value on done: 29.0
[2023-02-25 12:22:46,607][2409105] Sum rewards: -8.313, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.634', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.028', 'HITCOUNT': '0.030', 'weapon4': '0.080', 'DAMAGECOUNT': '0.087', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'AMMO4': '0.141', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon3': '0.578', 'WEAPON3': '0.600', 'weapon2': '1.348'}
[2023-02-25 12:22:46,626][2409485] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:22:46,630][2409485] Sum rewards: -4.233, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.170', 'AMMO2': '0.015', 'ARMOR': '0.036', 'HITCOUNT': '0.040', 'AMMO4': '0.075', 'weapon4': '0.110', 'AMMO3': '0.116', 'DAMAGECOUNT': '0.135', 'WEAPON4': '0.150', 'WEAPON3': '0.550', 'weapon3': '0.888', 'weapon2': '1.072', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:22:46,932][2409079] DAMAGECOUNT value on done: 5.0
[2023-02-25 12:22:47,090][2409074] Updated weights for policy 0, policy_version 1310 (0.0013)
[2023-02-25 12:22:47,186][2408954] Fps is (10 sec: 27443.7, 60 sec: 25736.5, 300 sec: 20440.8). Total num frames: 5369856. Throughput: 0: 6433.9. Samples: 1346100. Policy #0 lag: (min: 0.0, avg: 12.2, max: 25.0)
[2023-02-25 12:22:47,186][2408954] Avg episode reward: [(0, '-5.339')]
[2023-02-25 12:22:47,941][2409548] DAMAGECOUNT value on done: 160.0
[2023-02-25 12:22:47,941][2409548] Sum rewards: -5.315, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.209', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.016', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon4': '0.094', 'AMMO4': '0.107', 'AMMO3': '0.109', 'HITCOUNT': '0.120', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.480', 'weapon3': '0.578', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.558'}
[2023-02-25 12:22:47,994][2409547] DAMAGECOUNT value on done: 20.0
[2023-02-25 12:22:48,001][2409406] DAMAGECOUNT value on done: 120.0
[2023-02-25 12:22:48,098][2409549] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:22:48,101][2409549] Sum rewards: -7.186, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.730', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.017', 'HITCOUNT': '0.040', 'DAMAGECOUNT': '0.075', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'WEAPON4': '0.150', 'weapon4': '0.154', 'WEAPON3': '0.550', 'weapon3': '0.938', 'weapon2': '1.054'}
[2023-02-25 12:22:48,162][2409389] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:22:48,198][2409103] DAMAGECOUNT value on done: 245.0
[2023-02-25 12:22:48,200][2409103] Sum rewards: -3.683, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.202', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.009', 'WEAPON4': '0.050', 'ARMOR': '0.071', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'HITCOUNT': '0.180', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.735', 'weapon3': '0.882', 'weapon2': '1.516', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:22:48,269][2409407] DAMAGECOUNT value on done: 5.0
[2023-02-25 12:22:48,276][2409097] DAMAGECOUNT value on done: 42.0
[2023-02-25 12:22:48,351][2409080] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:22:48,441][2409101] DAMAGECOUNT value on done: 115.0
[2023-02-25 12:22:48,442][2409101] Sum rewards: -2.824, reward structure: {'DEATHCOUNT': '-7.500', 'ARMOR': '0.004', 'AMMO2': '0.023', 'HITCOUNT': '0.060', 'AMMO3': '0.068', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'weapon4': '0.222', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.350', 'HEALTH': '0.558', 'weapon3': '0.578', 'FRAGCOUNT': '1.000', 'weapon2': '1.154'}
[2023-02-25 12:22:48,670][2409373] DAMAGECOUNT value on done: 32.0
[2023-02-25 12:22:48,680][2409405] DAMAGECOUNT value on done: 30.0
[2023-02-25 12:22:48,720][2409099] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:22:48,738][2409596] DAMAGECOUNT value on done: 140.0
[2023-02-25 12:22:48,798][2409355] DAMAGECOUNT value on done: 19.0
[2023-02-25 12:22:48,807][2409077] DAMAGECOUNT value on done: 30.0
[2023-02-25 12:22:48,929][2409866] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:22:49,050][2409075] DAMAGECOUNT value on done: 30.0
[2023-02-25 12:22:49,107][2409469] DAMAGECOUNT value on done: 52.0
[2023-02-25 12:22:49,108][2409469] Sum rewards: -7.730, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.686', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'HITCOUNT': '0.050', 'weapon4': '0.060', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'AMMO3': '0.147', 'DAMAGECOUNT': '0.156', 'ARMOR': '0.416', 'weapon3': '0.700', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.388'}
[2023-02-25 12:22:49,147][2409104] DAMAGECOUNT value on done: 35.0
[2023-02-25 12:22:49,190][2409102] DAMAGECOUNT value on done: 85.0
[2023-02-25 12:22:49,201][2409100] DAMAGECOUNT value on done: 5.0
[2023-02-25 12:22:49,206][2409597] DAMAGECOUNT value on done: 120.0
[2023-02-25 12:22:49,209][2409597] Sum rewards: -5.913, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.825', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'ARMOR': '0.068', 'HITCOUNT': '0.070', 'AMMO4': '0.081', 'weapon4': '0.090', 'AMMO3': '0.116', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.500', 'weapon3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.508'}
[2023-02-25 12:22:49,422][2409078] DAMAGECOUNT value on done: 50.0
[2023-02-25 12:22:49,496][2409074] Updated weights for policy 0, policy_version 1320 (0.0012)
[2023-02-25 12:22:49,900][2409096] DAMAGECOUNT value on done: 70.0
[2023-02-25 12:22:49,901][2409096] Sum rewards: -5.868, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.860', 'AMMO2': '0.010', 'AMMO4': '0.048', 'ARMOR': '0.048', 'HITCOUNT': '0.060', 'AMMO3': '0.098', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.210', 'weapon4': '0.234', 'weapon3': '0.448', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon2': '1.436'}
[2023-02-25 12:22:50,039][2409076] DAMAGECOUNT value on done: 100.0
[2023-02-25 12:22:50,040][2409076] Sum rewards: -4.512, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.205', 'AMMO2': '0.022', 'HITCOUNT': '0.050', 'weapon4': '0.094', 'ARMOR': '0.096', 'AMMO4': '0.108', 'AMMO3': '0.135', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.004', 'weapon3': '1.184'}
[2023-02-25 12:22:50,074][2409486] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:22:50,097][2409485] DAMAGECOUNT value on done: 20.0
[2023-02-25 12:22:50,124][2409105] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:22:50,227][2409565] DAMAGECOUNT value on done: 30.0
[2023-02-25 12:22:50,327][2409468] DAMAGECOUNT value on done: 100.0
[2023-02-25 12:22:50,330][2409468] Sum rewards: -7.882, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.402', 'AMMO2': '0.026', 'ARMOR': '0.048', 'HITCOUNT': '0.050', 'weapon4': '0.108', 'AMMO4': '0.131', 'AMMO3': '0.131', 'DAMAGECOUNT': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '0.650', 'weapon3': '0.772', 'FRAGCOUNT': '1.000', 'weapon2': '1.254'}
[2023-02-25 12:22:50,581][2409074] Updated weights for policy 0, policy_version 1330 (0.0012)
[2023-02-25 12:22:50,671][2409079] DAMAGECOUNT value on done: 5.0
[2023-02-25 12:22:51,485][2409549] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:22:51,628][2409103] DAMAGECOUNT value on done: 122.0
[2023-02-25 12:22:51,629][2409103] Sum rewards: -4.592, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.910', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'HITCOUNT': '0.070', 'WEAPON5': '0.100', 'weapon4': '0.136', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.366', 'weapon3': '0.706', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.346'}
[2023-02-25 12:22:51,633][2409548] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:22:51,646][2409406] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:22:51,799][2409074] Updated weights for policy 0, policy_version 1340 (0.0012)
[2023-02-25 12:22:51,812][2409547] DAMAGECOUNT value on done: 35.0
[2023-02-25 12:22:51,845][2409101] DAMAGECOUNT value on done: 50.0
[2023-02-25 12:22:51,846][2409101] Sum rewards: -5.967, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.532', 'AMMO2': '0.019', 'weapon4': '0.032', 'ARMOR': '0.040', 'HITCOUNT': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.095', 'DAMAGECOUNT': '0.150', 'AMMO3': '0.187', 'weapon3': '0.802', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '1.150'}
[2023-02-25 12:22:51,970][2409407] DAMAGECOUNT value on done: 250.0
[2023-02-25 12:22:51,971][2409407] Sum rewards: -0.804, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.692', 'AMMO2': '0.022', 'weapon4': '0.092', 'HITCOUNT': '0.100', 'AMMO4': '0.109', 'ARMOR': '0.116', 'AMMO3': '0.117', 'WEAPON4': '0.250', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.750', 'weapon3': '0.922', 'weapon2': '1.260', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:22:51,999][2409389] DAMAGECOUNT value on done: 65.0
[2023-02-25 12:22:52,002][2409389] Sum rewards: -2.908, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.024', 'HITCOUNT': '0.050', 'HEALTH': '0.082', 'AMMO3': '0.113', 'AMMO4': '0.121', 'ARMOR': '0.160', 'DAMAGECOUNT': '0.195', 'weapon4': '0.196', 'WEAPON4': '0.250', 'WEAPON3': '0.600', 'weapon3': '0.830', 'weapon2': '0.970', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:22:52,029][2409097] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:22:52,183][2409080] DAMAGECOUNT value on done: 35.0
[2023-02-25 12:22:52,186][2408954] Fps is (10 sec: 27851.9, 60 sec: 25804.6, 300 sec: 20518.0). Total num frames: 5492736. Throughput: 0: 6454.6. Samples: 1366020. Policy #0 lag: (min: 0.0, avg: 12.2, max: 27.0)
[2023-02-25 12:22:52,187][2408954] Avg episode reward: [(0, '-5.393')]
[2023-02-25 12:22:52,377][2409077] DAMAGECOUNT value on done: 35.0
[2023-02-25 12:22:52,384][2409355] DAMAGECOUNT value on done: 50.0
[2023-02-25 12:22:52,514][2409866] DAMAGECOUNT value on done: 55.0
[2023-02-25 12:22:52,619][2409596] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:22:52,697][2409405] DAMAGECOUNT value on done: 40.0
[2023-02-25 12:22:52,699][2409099] DAMAGECOUNT value on done: 176.0
[2023-02-25 12:22:52,700][2409099] Sum rewards: -1.133, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.005', 'AMMO4': '0.024', 'ARMOR': '0.024', 'WEAPON4': '0.050', 'AMMO3': '0.099', 'weapon4': '0.104', 'HITCOUNT': '0.120', 'WEAPON6': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'HEALTH': '0.499', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.528', 'weapon2': '0.920', 'FRAGCOUNT': '1.000', 'weapon3': '1.144'}
[2023-02-25 12:22:52,721][2409102] DAMAGECOUNT value on done: 120.0
[2023-02-25 12:22:52,724][2409102] Sum rewards: -3.615, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.440', 'AMMO2': '0.022', 'AMMO3': '0.054', 'ARMOR': '0.064', 'weapon4': '0.076', 'HITCOUNT': '0.110', 'AMMO4': '0.111', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.360', 'weapon3': '0.992', 'FRAGCOUNT': '1.000', 'weapon2': '1.186'}
[2023-02-25 12:22:52,731][2409373] DAMAGECOUNT value on done: 17.0
[2023-02-25 12:22:52,750][2409597] DAMAGECOUNT value on done: 5.0
[2023-02-25 12:22:52,881][2409075] DAMAGECOUNT value on done: 155.0
[2023-02-25 12:22:52,898][2409469] DAMAGECOUNT value on done: 85.0
[2023-02-25 12:22:52,990][2409100] DAMAGECOUNT value on done: 44.0
[2023-02-25 12:22:53,035][2409104] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:22:53,535][2409078] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:22:53,569][2409486] DAMAGECOUNT value on done: 40.0
[2023-02-25 12:22:53,662][2409105] DAMAGECOUNT value on done: 64.0
[2023-02-25 12:22:53,664][2409105] Sum rewards: -4.131, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.772', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.022', 'AMMO2': '0.039', 'HITCOUNT': '0.060', 'weapon4': '0.066', 'ARMOR': '0.077', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.192', 'AMMO4': '0.196', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'weapon3': '0.816', 'FRAGCOUNT': '1.000', 'weapon2': '1.468'}
[2023-02-25 12:22:53,673][2409485] DAMAGECOUNT value on done: 50.0
[2023-02-25 12:22:53,717][2409096] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:22:53,798][2409565] DAMAGECOUNT value on done: 69.0
[2023-02-25 12:22:53,953][2409074] Updated weights for policy 0, policy_version 1350 (0.0013)
[2023-02-25 12:22:53,967][2409468] DAMAGECOUNT value on done: 20.0
[2023-02-25 12:22:54,126][2409079] DAMAGECOUNT value on done: 75.0
[2023-02-25 12:22:54,126][2409079] Sum rewards: -6.573, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.600', 'AMMO2': '0.014', 'ARMOR': '0.044', 'HITCOUNT': '0.050', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'DAMAGECOUNT': '0.225', 'WEAPON3': '0.600', 'weapon3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.412'}
[2023-02-25 12:22:54,247][2409076] DAMAGECOUNT value on done: 90.0
[2023-02-25 12:22:54,247][2409076] Sum rewards: -4.699, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.550', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'ARMOR': '0.032', 'weapon7': '0.040', 'HITCOUNT': '0.050', 'AMMO3': '0.147', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'DAMAGECOUNT': '0.270', 'WEAPON3': '0.850', 'weapon3': '0.952', 'FRAGCOUNT': '1.000', 'weapon2': '1.176'}
[2023-02-25 12:22:55,077][2409074] Updated weights for policy 0, policy_version 1360 (0.0012)
[2023-02-25 12:22:55,324][2409103] DAMAGECOUNT value on done: 117.0
[2023-02-25 12:22:55,324][2409103] Sum rewards: -1.214, reward structure: {'DEATHCOUNT': '-5.250', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.038', 'HEALTH': '0.053', 'AMMO3': '0.067', 'weapon4': '0.082', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.351', 'weapon3': '0.802', 'FRAGCOUNT': '1.000', 'weapon2': '1.126'}
[2023-02-25 12:22:55,389][2409407] DAMAGECOUNT value on done: 80.0
[2023-02-25 12:22:55,428][2409547] DAMAGECOUNT value on done: 104.0
[2023-02-25 12:22:55,428][2409547] Sum rewards: -4.128, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.870', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO4': '0.018', 'HITCOUNT': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'weapon4': '0.292', 'DAMAGECOUNT': '0.312', 'weapon3': '0.564', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.144'}
[2023-02-25 12:22:55,483][2409548] DAMAGECOUNT value on done: 20.0
[2023-02-25 12:22:55,584][2409389] DAMAGECOUNT value on done: 35.0
[2023-02-25 12:22:55,585][2409389] Sum rewards: -8.225, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.778', 'AMMO5': '0.009', 'HITCOUNT': '0.030', 'AMMO2': '0.039', 'weapon5': '0.074', 'AMMO3': '0.097', 'DAMAGECOUNT': '0.105', 'ARMOR': '0.120', 'AMMO4': '0.193', 'WEAPON5': '0.200', 'weapon4': '0.324', 'weapon3': '0.470', 'WEAPON4': '0.500', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon2': '1.142'}
[2023-02-25 12:22:55,617][2409097] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:22:55,691][2409406] DAMAGECOUNT value on done: 20.0
[2023-02-25 12:22:55,970][2409080] DAMAGECOUNT value on done: 65.0
[2023-02-25 12:22:55,971][2409080] Sum rewards: -3.514, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.137', 'AMMO2': '0.003', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon4': '0.010', 'AMMO4': '0.015', 'WEAPON4': '0.050', 'HITCOUNT': '0.060', 'AMMO3': '0.114', 'DAMAGECOUNT': '0.195', 'WEAPON3': '0.650', 'weapon3': '0.896', 'FRAGCOUNT': '1.000', 'weapon2': '1.370'}
[2023-02-25 12:22:55,984][2409549] DAMAGECOUNT value on done: 144.0
[2023-02-25 12:22:56,114][2409355] DAMAGECOUNT value on done: 35.0
[2023-02-25 12:22:56,240][2409866] DAMAGECOUNT value on done: 90.0
[2023-02-25 12:22:56,243][2409866] Sum rewards: -5.917, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.290', 'AMMO2': '0.001', 'AMMO4': '0.006', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'weapon4': '0.076', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.135', 'DAMAGECOUNT': '0.270', 'WEAPON3': '0.800', 'weapon3': '0.984', 'FRAGCOUNT': '1.000', 'weapon2': '1.128'}
[2023-02-25 12:22:56,348][2409101] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:22:56,374][2409102] DAMAGECOUNT value on done: 93.0
[2023-02-25 12:22:56,377][2409102] Sum rewards: -6.246, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.168', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'ARMOR': '0.037', 'HITCOUNT': '0.070', 'AMMO3': '0.100', 'AMMO4': '0.131', 'weapon4': '0.172', 'DAMAGECOUNT': '0.279', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'weapon3': '0.662', 'FRAGCOUNT': '1.000', 'weapon2': '1.584'}
[2023-02-25 12:22:56,481][2409099] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:22:56,504][2409596] DAMAGECOUNT value on done: 30.0
[2023-02-25 12:22:56,547][2409597] DAMAGECOUNT value on done: 60.0
[2023-02-25 12:22:56,551][2409469] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:22:56,557][2409077] DAMAGECOUNT value on done: 5.0
[2023-02-25 12:22:56,682][2409100] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:22:56,683][2409100] Sum rewards: -1.980, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.012', 'AMMO2': '0.019', 'HITCOUNT': '0.020', 'AMMO3': '0.069', 'DAMAGECOUNT': '0.075', 'AMMO4': '0.095', 'WEAPON4': '0.250', 'weapon4': '0.256', 'WEAPON3': '0.400', 'weapon3': '0.456', 'ARMOR': '0.507', 'FRAGCOUNT': '1.000', 'weapon2': '1.134'}
[2023-02-25 12:22:56,693][2409405] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:22:56,694][2409405] Sum rewards: -5.365, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.565', 'AMMO2': '0.002', 'AMMO5': '0.007', 'weapon5': '0.010', 'HITCOUNT': '0.010', 'AMMO4': '0.011', 'WEAPON1': '0.020', 'DAMAGECOUNT': '0.030', 'AMMO3': '0.111', 'WEAPON5': '0.150', 'ARMOR': '0.498', 'WEAPON3': '0.600', 'weapon3': '0.934', 'weapon2': '1.066'}
[2023-02-25 12:22:56,744][2409075] DAMAGECOUNT value on done: 164.0
[2023-02-25 12:22:56,745][2409075] Sum rewards: -4.773, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.375', 'AMMO2': '0.013', 'ARMOR': '0.036', 'weapon4': '0.048', 'AMMO4': '0.067', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.176', 'DAMAGECOUNT': '0.492', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.044', 'weapon2': '1.126'}
[2023-02-25 12:22:56,750][2409373] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:22:56,893][2409104] DAMAGECOUNT value on done: 80.0
[2023-02-25 12:22:57,186][2408954] Fps is (10 sec: 23346.9, 60 sec: 25531.6, 300 sec: 20547.4). Total num frames: 5603328. Throughput: 0: 6472.3. Samples: 1405164. Policy #0 lag: (min: 0.0, avg: 13.3, max: 26.0)
[2023-02-25 12:22:57,186][2408954] Avg episode reward: [(0, '-5.270')]
[2023-02-25 12:22:57,223][2409486] DAMAGECOUNT value on done: 80.0
[2023-02-25 12:22:57,224][2409486] Sum rewards: -3.905, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.616', 'AMMO2': '0.008', 'AMMO4': '0.037', 'weapon4': '0.068', 'HITCOUNT': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'DAMAGECOUNT': '0.240', 'WEAPON3': '0.450', 'weapon3': '0.618', 'FRAGCOUNT': '1.000', 'weapon2': '1.506'}
[2023-02-25 12:22:57,287][2409096] DAMAGECOUNT value on done: 35.0
[2023-02-25 12:22:57,326][2409074] Updated weights for policy 0, policy_version 1370 (0.0012)
[2023-02-25 12:22:57,452][2409105] DAMAGECOUNT value on done: 52.0
[2023-02-25 12:22:57,455][2409105] Sum rewards: -8.438, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.479', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon4': '0.014', 'weapon5': '0.018', 'ARMOR': '0.024', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'HITCOUNT': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'DAMAGECOUNT': '0.156', 'WEAPON3': '0.550', 'weapon2': '1.046', 'weapon3': '1.120'}
[2023-02-25 12:22:57,634][2409565] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:22:57,749][2409485] DAMAGECOUNT value on done: 131.0
[2023-02-25 12:22:57,757][2409468] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:22:57,929][2409078] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:22:58,077][2409076] DAMAGECOUNT value on done: 65.0
[2023-02-25 12:22:58,078][2409076] Sum rewards: -6.806, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.290', 'AMMO5': '0.005', 'AMMO2': '0.022', 'HITCOUNT': '0.060', 'weapon4': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.162', 'DAMAGECOUNT': '0.195', 'WEAPON4': '0.250', 'ARMOR': '0.456', 'weapon3': '0.810', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.088'}
[2023-02-25 12:22:58,255][2409074] Updated weights for policy 0, policy_version 1380 (0.0012)
[2023-02-25 12:22:58,615][2409079] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:22:59,102][2409548] DAMAGECOUNT value on done: 70.0
[2023-02-25 12:22:59,238][2409103] DAMAGECOUNT value on done: 70.0
[2023-02-25 12:22:59,246][2409389] DAMAGECOUNT value on done: 90.0
[2023-02-25 12:22:59,247][2409389] Sum rewards: -3.055, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.559', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'HITCOUNT': '0.100', 'AMMO3': '0.115', 'DAMAGECOUNT': '0.270', 'WEAPON3': '0.650', 'weapon2': '0.970', 'weapon3': '1.148', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:22:59,466][2409547] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:22:59,467][2409547] Sum rewards: -7.438, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.397', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'HITCOUNT': '0.010', 'AMMO2': '0.015', 'weapon5': '0.016', 'ARMOR': '0.042', 'DAMAGECOUNT': '0.045', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.110', 'weapon4': '0.234', 'WEAPON4': '0.250', 'weapon3': '0.370', 'WEAPON3': '0.500', 'weapon2': '1.242'}
[2023-02-25 12:22:59,577][2409097] DAMAGECOUNT value on done: 65.0
[2023-02-25 12:22:59,680][2409355] DAMAGECOUNT value on done: 50.0
[2023-02-25 12:22:59,681][2409355] Sum rewards: -3.870, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.086', 'weapon4': '0.004', 'AMMO2': '0.013', 'HITCOUNT': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.098', 'DAMAGECOUNT': '0.150', 'WEAPON3': '0.500', 'ARMOR': '0.508', 'weapon3': '0.854', 'FRAGCOUNT': '1.000', 'weapon2': '1.182'}
[2023-02-25 12:22:59,734][2409549] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:22:59,826][2409866] DAMAGECOUNT value on done: 5.0
[2023-02-25 12:22:59,866][2409406] DAMAGECOUNT value on done: 90.0
[2023-02-25 12:22:59,965][2409407] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:22:59,976][2409080] DAMAGECOUNT value on done: 53.0
[2023-02-25 12:22:59,979][2409080] Sum rewards: -7.942, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.830', 'FRAGCOUNT': '-1.500', 'HITCOUNT': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon5': '0.052', 'AMMO4': '0.095', 'AMMO3': '0.116', 'weapon4': '0.124', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.159', 'WEAPON4': '0.200', 'weapon3': '0.432', 'ARMOR': '0.464', 'WEAPON3': '0.600', 'weapon2': '1.204'}
[2023-02-25 12:23:00,006][2409099] DAMAGECOUNT value on done: 305.0
[2023-02-25 12:23:00,011][2409099] Sum rewards: 1.927, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.351', 'AMMO2': '0.003', 'weapon4': '0.004', 'AMMO4': '0.016', 'WEAPON4': '0.050', 'ARMOR': '0.056', 'AMMO3': '0.078', 'HITCOUNT': '0.200', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.915', 'weapon3': '0.972', 'weapon2': '1.134', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:23:00,122][2409101] DAMAGECOUNT value on done: 130.0
[2023-02-25 12:23:00,185][2409469] DAMAGECOUNT value on done: 210.0
[2023-02-25 12:23:00,188][2409469] Sum rewards: -7.293, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.440', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'ARMOR': '0.028', 'AMMO4': '0.032', 'HITCOUNT': '0.140', 'AMMO3': '0.167', 'DAMAGECOUNT': '0.630', 'weapon3': '0.828', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.406'}
[2023-02-25 12:23:00,189][2409597] DAMAGECOUNT value on done: 20.0
[2023-02-25 12:23:00,256][2409100] DAMAGECOUNT value on done: 71.0
[2023-02-25 12:23:00,256][2409100] Sum rewards: -7.042, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.296', 'AMMO2': '0.011', 'ARMOR': '0.052', 'AMMO4': '0.053', 'HITCOUNT': '0.100', 'AMMO3': '0.147', 'DAMAGECOUNT': '0.213', 'WEAPON3': '0.800', 'weapon3': '0.836', 'FRAGCOUNT': '1.000', 'weapon2': '1.542'}
[2023-02-25 12:23:00,284][2409596] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:23:00,287][2409596] Sum rewards: -9.679, reward structure: {'DEATHCOUNT': '-10.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.290', 'AMMO5': '0.005', 'weapon4': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'AMMO3': '0.153', 'ARMOR': '0.533', 'WEAPON3': '0.650', 'weapon3': '0.684', 'weapon2': '1.302'}
[2023-02-25 12:23:00,376][2409102] DAMAGECOUNT value on done: 80.0
[2023-02-25 12:23:00,377][2409102] Sum rewards: -5.958, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.200', 'AMMO2': '0.009', 'ARMOR': '0.032', 'weapon4': '0.034', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.072', 'HITCOUNT': '0.080', 'DAMAGECOUNT': '0.240', 'WEAPON3': '0.350', 'weapon3': '0.786', 'FRAGCOUNT': '1.000', 'weapon2': '1.292'}
[2023-02-25 12:23:00,452][2409373] DAMAGECOUNT value on done: 72.0
[2023-02-25 12:23:00,496][2409074] Updated weights for policy 0, policy_version 1390 (0.0013)
[2023-02-25 12:23:00,664][2409104] DAMAGECOUNT value on done: 7.0
[2023-02-25 12:23:00,665][2409104] Sum rewards: -7.918, reward structure: {'DEATHCOUNT': '-10.500', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.005', 'HITCOUNT': '0.010', 'ARMOR': '0.016', 'DAMAGECOUNT': '0.021', 'weapon5': '0.024', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'AMMO4': '0.162', 'weapon4': '0.214', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'weapon3': '0.694', 'HEALTH': '0.821', 'weapon2': '1.028'}
[2023-02-25 12:23:00,671][2409077] DAMAGECOUNT value on done: 201.0
[2023-02-25 12:23:00,675][2409486] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:23:00,679][2409075] DAMAGECOUNT value on done: 75.0
[2023-02-25 12:23:00,886][2409096] DAMAGECOUNT value on done: 85.0
[2023-02-25 12:23:00,887][2409096] Sum rewards: -0.974, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.780', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon4': '0.012', 'HITCOUNT': '0.020', 'AMMO3': '0.028', 'AMMO4': '0.031', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.106', 'WEAPON3': '0.150', 'weapon3': '0.212', 'DAMAGECOUNT': '0.255', 'ARMOR': '0.571', 'FRAGCOUNT': '1.000', 'weapon2': '1.710'}
[2023-02-25 12:23:00,945][2409405] DAMAGECOUNT value on done: 50.0
[2023-02-25 12:23:00,946][2409405] Sum rewards: -6.542, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.981', 'AMMO2': '0.016', 'HITCOUNT': '0.050', 'ARMOR': '0.060', 'AMMO4': '0.078', 'AMMO3': '0.107', 'weapon4': '0.144', 'DAMAGECOUNT': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.550', 'weapon3': '0.672', 'FRAGCOUNT': '1.000', 'weapon2': '1.162'}
[2023-02-25 12:23:01,109][2409105] DAMAGECOUNT value on done: 65.0
[2023-02-25 12:23:01,110][2409105] Sum rewards: -2.231, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.321', 'AMMO2': '0.009', 'AMMO4': '0.043', 'HITCOUNT': '0.050', 'ARMOR': '0.052', 'AMMO3': '0.091', 'WEAPON4': '0.150', 'weapon4': '0.188', 'DAMAGECOUNT': '0.195', 'WEAPON3': '0.500', 'weapon3': '0.722', 'weapon2': '1.090', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:23:01,396][2409485] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:23:01,400][2409485] Sum rewards: -11.895, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.800', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'HITCOUNT': '0.020', 'DAMAGECOUNT': '0.075', 'AMMO3': '0.221', 'weapon3': '0.576', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.100', 'weapon2': '1.436'}
[2023-02-25 12:23:01,457][2409565] DAMAGECOUNT value on done: 38.0
[2023-02-25 12:23:01,458][2409565] Sum rewards: -5.429, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.160', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'weapon5': '0.014', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'HITCOUNT': '0.050', 'WEAPON5': '0.050', 'DAMAGECOUNT': '0.114', 'AMMO3': '0.137', 'WEAPON3': '0.800', 'weapon2': '0.956', 'FRAGCOUNT': '1.000', 'weapon3': '1.088'}
[2023-02-25 12:23:01,739][2409074] Updated weights for policy 0, policy_version 1400 (0.0013)
[2023-02-25 12:23:01,813][2409078] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:23:01,917][2409076] DAMAGECOUNT value on done: 75.0
[2023-02-25 12:23:02,186][2408954] Fps is (10 sec: 25805.8, 60 sec: 25736.5, 300 sec: 20708.5). Total num frames: 5750784. Throughput: 0: 6471.5. Samples: 1443288. Policy #0 lag: (min: 2.0, avg: 15.3, max: 25.0)
[2023-02-25 12:23:02,186][2408954] Avg episode reward: [(0, '-5.378')]
[2023-02-25 12:23:02,443][2409079] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:23:02,709][2409468] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:23:02,793][2409548] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:23:02,932][2409074] Updated weights for policy 0, policy_version 1410 (0.0014)
[2023-02-25 12:23:02,952][2409103] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:23:03,440][2409406] DAMAGECOUNT value on done: 20.0
[2023-02-25 12:23:03,467][2409549] DAMAGECOUNT value on done: 150.0
[2023-02-25 12:23:03,470][2409549] Sum rewards: -9.541, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.992', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'weapon5': '0.012', 'WEAPON5': '0.050', 'HITCOUNT': '0.090', 'AMMO3': '0.166', 'ARMOR': '0.436', 'DAMAGECOUNT': '0.450', 'weapon3': '0.826', 'WEAPON3': '0.900', 'weapon2': '1.270'}
[2023-02-25 12:23:03,541][2409389] DAMAGECOUNT value on done: 105.0
[2023-02-25 12:23:03,542][2409389] Sum rewards: -1.960, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.838', 'weapon4': '0.012', 'AMMO2': '0.014', 'AMMO5': '0.014', 'weapon5': '0.016', 'ARMOR': '0.043', 'AMMO4': '0.070', 'AMMO3': '0.071', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.315', 'WEAPON3': '0.450', 'FRAGCOUNT': '0.500', 'weapon2': '1.102', 'weapon3': '1.120'}
[2023-02-25 12:23:03,607][2409547] DAMAGECOUNT value on done: 37.0
[2023-02-25 12:23:03,684][2409097] DAMAGECOUNT value on done: 115.0
[2023-02-25 12:23:03,699][2409407] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:23:03,700][2409407] Sum rewards: -10.574, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.360', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.003', 'HITCOUNT': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.027', 'weapon5': '0.028', 'DAMAGECOUNT': '0.045', 'WEAPON5': '0.050', 'AMMO4': '0.134', 'AMMO3': '0.171', 'weapon4': '0.224', 'WEAPON4': '0.350', 'weapon3': '0.484', 'WEAPON3': '0.900', 'weapon2': '1.344'}
[2023-02-25 12:23:03,752][2409597] DAMAGECOUNT value on done: 164.0
[2023-02-25 12:23:03,753][2409597] Sum rewards: -2.802, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.360', 'AMMO2': '0.003', 'AMMO4': '0.012', 'ARMOR': '0.032', 'AMMO3': '0.071', 'HITCOUNT': '0.120', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.492', 'weapon3': '0.940', 'FRAGCOUNT': '1.000', 'weapon2': '1.438'}
[2023-02-25 12:23:03,791][2409469] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:23:03,808][2409355] DAMAGECOUNT value on done: 120.0
[2023-02-25 12:23:03,816][2409355] Sum rewards: -7.984, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.796', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.058', 'HITCOUNT': '0.070', 'AMMO4': '0.129', 'weapon4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.209', 'DAMAGECOUNT': '0.360', 'ARMOR': '0.460', 'weapon3': '0.608', 'WEAPON3': '0.950', 'weapon2': '1.350'}
[2023-02-25 12:23:03,844][2409099] DAMAGECOUNT value on done: 130.0
[2023-02-25 12:23:03,845][2409099] Sum rewards: -9.480, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.276', 'AMMO2': '0.025', 'ARMOR': '0.040', 'HITCOUNT': '0.080', 'AMMO4': '0.127', 'weapon4': '0.160', 'AMMO3': '0.174', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.390', 'weapon3': '0.774', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.326'}
[2023-02-25 12:23:03,864][2409101] DAMAGECOUNT value on done: 5.0
[2023-02-25 12:23:03,905][2409100] DAMAGECOUNT value on done: 130.0
[2023-02-25 12:23:03,906][2409100] Sum rewards: -6.098, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.225', 'AMMO5': '0.005', 'weapon5': '0.022', 'AMMO2': '0.024', 'HITCOUNT': '0.070', 'ARMOR': '0.080', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO4': '0.118', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.500', 'weapon3': '0.582', 'FRAGCOUNT': '1.000', 'weapon2': '1.488'}
[2023-02-25 12:23:03,919][2409596] DAMAGECOUNT value on done: 20.0
[2023-02-25 12:23:03,981][2409102] DAMAGECOUNT value on done: 40.0
[2023-02-25 12:23:04,070][2409866] DAMAGECOUNT value on done: 111.0
[2023-02-25 12:23:04,070][2409866] Sum rewards: -4.021, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.000', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.037', 'HITCOUNT': '0.090', 'AMMO3': '0.092', 'DAMAGECOUNT': '0.333', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.170', 'weapon3': '1.190'}
[2023-02-25 12:23:04,195][2409077] DAMAGECOUNT value on done: 65.0
[2023-02-25 12:23:04,195][2409077] Sum rewards: -7.710, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.824', 'AMMO2': '0.006', 'weapon4': '0.020', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'HITCOUNT': '0.070', 'AMMO3': '0.170', 'DAMAGECOUNT': '0.195', 'weapon3': '0.920', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.204'}
[2023-02-25 12:23:04,312][2409104] DAMAGECOUNT value on done: 125.0
[2023-02-25 12:23:04,313][2409104] Sum rewards: -4.481, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.190', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'HITCOUNT': '0.080', 'AMMO4': '0.096', 'AMMO3': '0.148', 'WEAPON4': '0.200', 'weapon4': '0.244', 'DAMAGECOUNT': '0.375', 'ARMOR': '0.478', 'WEAPON3': '0.650', 'weapon3': '0.778', 'FRAGCOUNT': '1.000', 'weapon2': '1.130'}
[2023-02-25 12:23:04,349][2409373] DAMAGECOUNT value on done: 141.0
[2023-02-25 12:23:04,463][2409486] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:23:04,501][2409096] DAMAGECOUNT value on done: 69.0
[2023-02-25 12:23:04,501][2409096] Sum rewards: -5.963, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.442', 'AMMO2': '0.005', 'AMMO5': '0.010', 'weapon5': '0.018', 'AMMO4': '0.025', 'weapon4': '0.046', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.207', 'WEAPON3': '0.650', 'weapon3': '0.738', 'FRAGCOUNT': '1.000', 'weapon2': '1.274'}
[2023-02-25 12:23:04,516][2409405] DAMAGECOUNT value on done: 272.0
[2023-02-25 12:23:04,519][2409405] Sum rewards: -4.382, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.955', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon4': '0.038', 'weapon5': '0.062', 'ARMOR': '0.064', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.139', 'WEAPON5': '0.150', 'HITCOUNT': '0.160', 'weapon3': '0.686', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.816', 'FRAGCOUNT': '1.000', 'weapon2': '1.500'}
[2023-02-25 12:23:04,538][2409075] DAMAGECOUNT value on done: 20.0
[2023-02-25 12:23:04,549][2409080] DAMAGECOUNT value on done: 190.0
[2023-02-25 12:23:04,552][2409080] Sum rewards: -5.501, reward structure: {'DEATHCOUNT': '-10.500', 'weapon4': '0.006', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'ARMOR': '0.060', 'AMMO4': '0.066', 'HITCOUNT': '0.120', 'AMMO3': '0.135', 'HEALTH': '0.220', 'DAMAGECOUNT': '0.570', 'weapon3': '0.614', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.494'}
[2023-02-25 12:23:04,697][2409105] DAMAGECOUNT value on done: 59.0
[2023-02-25 12:23:04,701][2409105] Sum rewards: -6.874, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-3.002', 'AMMO2': '0.008', 'AMMO5': '0.009', 'weapon5': '0.024', 'AMMO4': '0.038', 'ARMOR': '0.040', 'HITCOUNT': '0.080', 'AMMO3': '0.120', 'weapon4': '0.124', 'DAMAGECOUNT': '0.177', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.700', 'weapon3': '0.732', 'weapon2': '1.426'}
[2023-02-25 12:23:04,941][2409565] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:23:05,017][2409485] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:23:05,285][2409074] Updated weights for policy 0, policy_version 1420 (0.0013)
[2023-02-25 12:23:05,584][2409078] DAMAGECOUNT value on done: 30.0
[2023-02-25 12:23:05,669][2409076] DAMAGECOUNT value on done: 30.0
[2023-02-25 12:23:06,203][2409074] Updated weights for policy 0, policy_version 1430 (0.0013)
[2023-02-25 12:23:06,379][2409548] DAMAGECOUNT value on done: 85.0
[2023-02-25 12:23:06,382][2409548] Sum rewards: -7.843, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-3.000', 'HEALTH': '-1.120', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'ARMOR': '0.028', 'AMMO4': '0.034', 'weapon5': '0.072', 'HITCOUNT': '0.110', 'AMMO3': '0.147', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.255', 'WEAPON3': '0.750', 'weapon2': '0.926', 'weapon3': '1.276'}
[2023-02-25 12:23:06,425][2409468] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:23:06,443][2409079] DAMAGECOUNT value on done: 110.0
[2023-02-25 12:23:06,446][2409079] Sum rewards: -7.366, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.106', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.005', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'HITCOUNT': '0.060', 'AMMO3': '0.134', 'weapon4': '0.150', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.600', 'weapon3': '0.920', 'FRAGCOUNT': '1.000', 'weapon2': '1.204'}
[2023-02-25 12:23:06,654][2409103] DAMAGECOUNT value on done: 84.0
[2023-02-25 12:23:07,119][2409549] DAMAGECOUNT value on done: 159.0
[2023-02-25 12:23:07,123][2409549] Sum rewards: -2.564, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.590', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.016', 'ARMOR': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.121', 'HITCOUNT': '0.130', 'DAMAGECOUNT': '0.477', 'WEAPON3': '0.750', 'weapon2': '0.784', 'weapon3': '1.424', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:23:07,166][2409406] DAMAGECOUNT value on done: 60.0
[2023-02-25 12:23:07,186][2408954] Fps is (10 sec: 27443.7, 60 sec: 25873.1, 300 sec: 20791.3). Total num frames: 5877760. Throughput: 0: 6480.0. Samples: 1462764. Policy #0 lag: (min: 2.0, avg: 11.7, max: 27.0)
[2023-02-25 12:23:07,186][2408954] Avg episode reward: [(0, '-5.343')]
[2023-02-25 12:23:07,341][2409597] DAMAGECOUNT value on done: 175.0
[2023-02-25 12:23:07,345][2409597] Sum rewards: -7.487, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.621', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon4': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.141', 'ARMOR': '0.436', 'DAMAGECOUNT': '0.525', 'WEAPON3': '0.800', 'weapon3': '0.998', 'FRAGCOUNT': '1.000', 'weapon2': '1.310'}
[2023-02-25 12:23:07,459][2409469] DAMAGECOUNT value on done: 20.0
[2023-02-25 12:23:07,515][2409547] DAMAGECOUNT value on done: 30.0
[2023-02-25 12:23:07,527][2409100] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:23:07,540][2409101] DAMAGECOUNT value on done: 145.0
[2023-02-25 12:23:07,541][2409097] DAMAGECOUNT value on done: 64.0
[2023-02-25 12:23:07,542][2409097] Sum rewards: -5.150, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.610', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.013', 'weapon5': '0.046', 'weapon4': '0.052', 'HITCOUNT': '0.060', 'AMMO4': '0.065', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.192', 'WEAPON3': '0.500', 'weapon3': '0.840', 'weapon2': '1.334'}
[2023-02-25 12:23:07,543][2409101] Sum rewards: -10.525, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.791', 'AMMO2': '0.025', 'ARMOR': '0.040', 'HITCOUNT': '0.090', 'AMMO4': '0.125', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.900', 'weapon3': '0.928', 'FRAGCOUNT': '1.000', 'weapon2': '1.358'}
[2023-02-25 12:23:07,544][2409407] DAMAGECOUNT value on done: 92.0
[2023-02-25 12:23:07,630][2409389] DAMAGECOUNT value on done: 142.0
[2023-02-25 12:23:07,631][2409389] Sum rewards: -1.578, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.900', 'AMMO2': '0.017', 'ARMOR': '0.048', 'AMMO4': '0.084', 'AMMO3': '0.101', 'weapon4': '0.116', 'HITCOUNT': '0.120', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.426', 'WEAPON3': '0.600', 'weapon3': '0.756', 'weapon2': '1.054', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:23:07,685][2409102] DAMAGECOUNT value on done: 105.0
[2023-02-25 12:23:07,702][2409099] DAMAGECOUNT value on done: 70.0
[2023-02-25 12:23:07,705][2409099] Sum rewards: -5.961, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.666', 'ARMOR': '0.004', 'AMMO5': '0.004', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'weapon5': '0.030', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'HITCOUNT': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'DAMAGECOUNT': '0.210', 'WEAPON3': '0.700', 'weapon3': '0.986', 'FRAGCOUNT': '1.000', 'weapon2': '1.120'}
[2023-02-25 12:23:07,943][2409077] DAMAGECOUNT value on done: 27.0
[2023-02-25 12:23:08,026][2409596] DAMAGECOUNT value on done: 35.0
[2023-02-25 12:23:08,027][2409596] Sum rewards: -8.010, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.934', 'HITCOUNT': '0.030', 'AMMO2': '0.036', 'weapon4': '0.068', 'AMMO3': '0.100', 'DAMAGECOUNT': '0.105', 'AMMO4': '0.180', 'WEAPON4': '0.350', 'WEAPON3': '0.550', 'weapon3': '0.738', 'FRAGCOUNT': '1.000', 'weapon2': '1.266'}
[2023-02-25 12:23:08,172][2409080] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:23:08,175][2409080] Sum rewards: -3.184, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.314', 'AMMO2': '0.004', 'AMMO4': '0.019', 'HITCOUNT': '0.030', 'WEAPON1': '0.030', 'DAMAGECOUNT': '0.045', 'AMMO3': '0.090', 'WEAPON3': '0.500', 'weapon3': '0.866', 'FRAGCOUNT': '1.000', 'weapon2': '1.296'}
[2023-02-25 12:23:08,240][2409096] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:23:08,269][2409105] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:23:08,280][2409405] DAMAGECOUNT value on done: 20.0
[2023-02-25 12:23:08,285][2409486] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:23:08,394][2409104] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:23:08,551][2409074] Updated weights for policy 0, policy_version 1440 (0.0013)
[2023-02-25 12:23:08,651][2409565] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:23:08,652][2409565] Sum rewards: -5.546, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.117', 'AMMO2': '0.003', 'AMMO5': '0.010', 'weapon5': '0.012', 'AMMO4': '0.016', 'WEAPON1': '0.020', 'weapon4': '0.030', 'HITCOUNT': '0.050', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.135', 'AMMO3': '0.141', 'WEAPON3': '0.750', 'weapon3': '0.910', 'FRAGCOUNT': '1.000', 'weapon2': '1.544'}
[2023-02-25 12:23:08,729][2409355] DAMAGECOUNT value on done: 90.0
[2023-02-25 12:23:08,734][2409355] Sum rewards: -4.947, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.392', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.010', 'weapon5': '0.018', 'AMMO4': '0.036', 'HITCOUNT': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.101', 'DAMAGECOUNT': '0.270', 'ARMOR': '0.460', 'WEAPON3': '0.500', 'weapon3': '0.912', 'weapon2': '1.236'}
[2023-02-25 12:23:08,806][2409866] DAMAGECOUNT value on done: 120.0
[2023-02-25 12:23:08,808][2409866] Sum rewards: -7.201, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.638', 'AMMO2': '0.001', 'weapon5': '0.002', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.006', 'WEAPON1': '0.020', 'weapon4': '0.044', 'HITCOUNT': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.126', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.650', 'weapon3': '0.746', 'FRAGCOUNT': '1.000', 'weapon2': '1.462'}
[2023-02-25 12:23:08,852][2409373] DAMAGECOUNT value on done: 80.0
[2023-02-25 12:23:08,852][2409373] Sum rewards: -5.288, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.694', 'AMMO2': '0.013', 'AMMO4': '0.063', 'HITCOUNT': '0.070', 'weapon4': '0.082', 'AMMO3': '0.128', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.240', 'WEAPON3': '0.650', 'weapon3': '0.976', 'FRAGCOUNT': '1.000', 'weapon2': '1.234'}
[2023-02-25 12:23:09,093][2409075] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:23:09,096][2409075] Sum rewards: -8.567, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.080', 'AMMO5': '0.003', 'AMMO2': '0.009', 'HITCOUNT': '0.010', 'DAMAGECOUNT': '0.045', 'AMMO4': '0.045', 'WEAPON5': '0.050', 'ARMOR': '0.052', 'weapon5': '0.094', 'AMMO3': '0.095', 'WEAPON3': '0.500', 'weapon3': '0.998', 'weapon2': '1.112'}
[2023-02-25 12:23:09,149][2409485] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:23:09,217][2409078] DAMAGECOUNT value on done: 60.0
[2023-02-25 12:23:09,649][2409074] Updated weights for policy 0, policy_version 1450 (0.0012)
[2023-02-25 12:23:09,703][2409033] Signal inference workers to stop experience collection... (200 times)
[2023-02-25 12:23:09,714][2409033] Signal inference workers to resume experience collection... (200 times)
[2023-02-25 12:23:09,739][2409074] InferenceWorker_p0-w0: stopping experience collection (200 times)
[2023-02-25 12:23:09,740][2409074] InferenceWorker_p0-w0: resuming experience collection (200 times)
[2023-02-25 12:23:10,049][2409548] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:23:10,106][2409076] DAMAGECOUNT value on done: 186.0
[2023-02-25 12:23:10,107][2409468] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:23:10,110][2409076] Sum rewards: -4.270, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.120', 'AMMO5': '0.015', 'AMMO2': '0.021', 'weapon5': '0.078', 'weapon4': '0.102', 'AMMO4': '0.106', 'HITCOUNT': '0.150', 'AMMO3': '0.161', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.514', 'DAMAGECOUNT': '0.558', 'WEAPON3': '0.800', 'weapon3': '0.858', 'FRAGCOUNT': '1.000', 'weapon2': '1.186'}
[2023-02-25 12:23:10,340][2409079] DAMAGECOUNT value on done: 145.0
[2023-02-25 12:23:10,535][2409549] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:23:10,733][2409406] DAMAGECOUNT value on done: 124.0
[2023-02-25 12:23:10,734][2409406] Sum rewards: -6.376, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.069', 'AMMO4': '0.076', 'HITCOUNT': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.248', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.372', 'HEALTH': '0.395', 'weapon3': '0.400', 'ARMOR': '0.477', 'weapon2': '1.376'}
[2023-02-25 12:23:10,763][2409103] DAMAGECOUNT value on done: 60.0
[2023-02-25 12:23:10,766][2409103] Sum rewards: -3.576, reward structure: {'DEATHCOUNT': '-5.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.180', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'weapon5': '0.008', 'HITCOUNT': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'DAMAGECOUNT': '0.180', 'WEAPON3': '0.550', 'weapon2': '0.634', 'weapon3': '1.712'}
[2023-02-25 12:23:10,872][2409597] DAMAGECOUNT value on done: 54.0
[2023-02-25 12:23:10,955][2409101] DAMAGECOUNT value on done: 125.0
[2023-02-25 12:23:11,112][2409100] DAMAGECOUNT value on done: 50.0
[2023-02-25 12:23:11,344][2409099] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:23:11,352][2409097] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:23:11,365][2409407] DAMAGECOUNT value on done: 55.0
[2023-02-25 12:23:11,391][2409547] DAMAGECOUNT value on done: 77.0
[2023-02-25 12:23:11,392][2409102] DAMAGECOUNT value on done: 115.0
[2023-02-25 12:23:11,395][2409102] Sum rewards: -5.380, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.830', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.018', 'WEAPON5': '0.050', 'HITCOUNT': '0.070', 'AMMO3': '0.177', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.008', 'weapon2': '1.326'}
[2023-02-25 12:23:11,533][2409074] Updated weights for policy 0, policy_version 1460 (0.0012)
[2023-02-25 12:23:11,648][2409596] DAMAGECOUNT value on done: 119.0
[2023-02-25 12:23:11,649][2409596] Sum rewards: -5.474, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.282', 'AMMO2': '0.010', 'weapon4': '0.034', 'AMMO4': '0.048', 'AMMO3': '0.110', 'HITCOUNT': '0.120', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.357', 'weapon3': '0.510', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'ARMOR': '1.057', 'weapon2': '1.812'}
[2023-02-25 12:23:11,663][2409469] DAMAGECOUNT value on done: 20.0
[2023-02-25 12:23:11,665][2409389] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:23:11,665][2409389] Sum rewards: -8.704, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.292', 'AMMO2': '0.008', 'AMMO5': '0.010', 'ARMOR': '0.036', 'AMMO4': '0.040', 'weapon4': '0.060', 'HITCOUNT': '0.070', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.135', 'WEAPON4': '0.150', 'AMMO3': '0.177', 'weapon3': '0.784', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.418'}
[2023-02-25 12:23:11,790][2409080] DAMAGECOUNT value on done: 20.0
[2023-02-25 12:23:11,797][2409105] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:23:11,880][2409486] DAMAGECOUNT value on done: 109.0
[2023-02-25 12:23:11,953][2409077] DAMAGECOUNT value on done: 38.0
[2023-02-25 12:23:11,974][2409104] DAMAGECOUNT value on done: 125.0
[2023-02-25 12:23:11,975][2409104] Sum rewards: -7.682, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.013', 'AMMO2': '0.007', 'AMMO5': '0.015', 'weapon5': '0.026', 'AMMO4': '0.037', 'weapon4': '0.056', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.375', 'ARMOR': '0.459', 'WEAPON3': '0.800', 'weapon3': '0.992', 'FRAGCOUNT': '1.000', 'weapon2': '1.226'}
[2023-02-25 12:23:12,125][2409405] DAMAGECOUNT value on done: 64.0
[2023-02-25 12:23:12,125][2409405] Sum rewards: -5.846, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'ARMOR': '0.056', 'HITCOUNT': '0.060', 'AMMO4': '0.065', 'HEALTH': '0.098', 'AMMO3': '0.105', 'WEAPON4': '0.150', 'weapon4': '0.176', 'DAMAGECOUNT': '0.192', 'WEAPON3': '0.550', 'weapon3': '0.688', 'FRAGCOUNT': '1.000', 'weapon2': '1.444'}
[2023-02-25 12:23:12,187][2408954] Fps is (10 sec: 24163.3, 60 sec: 25736.0, 300 sec: 20828.6). Total num frames: 5992448. Throughput: 0: 6464.4. Samples: 1500528. Policy #0 lag: (min: 0.0, avg: 13.0, max: 25.0)
[2023-02-25 12:23:12,188][2408954] Avg episode reward: [(0, '-5.823')]
[2023-02-25 12:23:12,210][2409355] DAMAGECOUNT value on done: 65.0
[2023-02-25 12:23:12,284][2409866] DAMAGECOUNT value on done: 29.0
[2023-02-25 12:23:12,443][2409565] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:23:12,489][2409373] DAMAGECOUNT value on done: 75.0
[2023-02-25 12:23:12,534][2409096] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:23:12,725][2409075] DAMAGECOUNT value on done: 74.0
[2023-02-25 12:23:12,727][2409075] Sum rewards: -4.164, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.576', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.021', 'HITCOUNT': '0.080', 'weapon4': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'ARMOR': '0.112', 'AMMO3': '0.135', 'DAMAGECOUNT': '0.222', 'WEAPON4': '0.250', 'WEAPON3': '0.750', 'weapon3': '0.756', 'FRAGCOUNT': '1.000', 'weapon2': '1.278'}
[2023-02-25 12:23:12,933][2409485] DAMAGECOUNT value on done: 125.0
[2023-02-25 12:23:12,934][2409485] Sum rewards: -7.245, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.970', 'AMMO2': '0.002', 'AMMO5': '0.004', 'AMMO4': '0.011', 'weapon5': '0.046', 'ARMOR': '0.068', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.173', 'DAMAGECOUNT': '0.375', 'weapon3': '0.740', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.456'}
[2023-02-25 12:23:13,016][2409074] Updated weights for policy 0, policy_version 1470 (0.0012)
[2023-02-25 12:23:13,071][2409078] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:23:13,547][2409076] DAMAGECOUNT value on done: 49.0
[2023-02-25 12:23:13,690][2409548] DAMAGECOUNT value on done: 20.0
[2023-02-25 12:23:13,994][2409074] Updated weights for policy 0, policy_version 1480 (0.0012)
[2023-02-25 12:23:14,024][2409079] DAMAGECOUNT value on done: 49.0
[2023-02-25 12:23:14,144][2409468] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:23:14,148][2409468] Sum rewards: -3.375, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.190', 'AMMO5': '0.003', 'HITCOUNT': '0.020', 'AMMO2': '0.030', 'weapon5': '0.032', 'WEAPON5': '0.050', 'ARMOR': '0.072', 'AMMO3': '0.075', 'DAMAGECOUNT': '0.075', 'weapon4': '0.114', 'AMMO4': '0.148', 'WEAPON4': '0.200', 'WEAPON3': '0.400', 'weapon3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.296'}
[2023-02-25 12:23:14,157][2409103] DAMAGECOUNT value on done: 14.0
[2023-02-25 12:23:14,191][2409549] DAMAGECOUNT value on done: 80.0
[2023-02-25 12:23:14,628][2409101] DAMAGECOUNT value on done: 60.0
[2023-02-25 12:23:14,629][2409597] DAMAGECOUNT value on done: 76.0
[2023-02-25 12:23:14,630][2409597] Sum rewards: -6.658, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.130', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.028', 'HITCOUNT': '0.050', 'WEAPON5': '0.050', 'ARMOR': '0.056', 'weapon5': '0.074', 'AMMO4': '0.093', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.228', 'WEAPON3': '0.500', 'weapon3': '0.818', 'weapon2': '1.278'}
[2023-02-25 12:23:14,723][2409100] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:23:14,881][2409099] DAMAGECOUNT value on done: 70.0
[2023-02-25 12:23:14,882][2409099] Sum rewards: -4.023, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.842', 'AMMO2': '0.003', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO4': '0.016', 'ARMOR': '0.032', 'HITCOUNT': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.168', 'DAMAGECOUNT': '0.210', 'weapon4': '0.224', 'weapon3': '0.760', 'WEAPON3': '0.900', 'weapon2': '1.214', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:23:14,977][2409102] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:23:15,033][2409407] DAMAGECOUNT value on done: 62.0
[2023-02-25 12:23:15,036][2409407] Sum rewards: -4.201, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.060', 'AMMO5': '0.005', 'weapon5': '0.012', 'ARMOR': '0.012', 'AMMO2': '0.025', 'HITCOUNT': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.064', 'AMMO3': '0.091', 'AMMO4': '0.126', 'DAMAGECOUNT': '0.186', 'WEAPON4': '0.200', 'WEAPON3': '0.500', 'weapon3': '0.796', 'FRAGCOUNT': '1.000', 'weapon2': '1.242'}
[2023-02-25 12:23:15,176][2409406] DAMAGECOUNT value on done: 30.0
[2023-02-25 12:23:15,514][2409486] DAMAGECOUNT value on done: 75.0
[2023-02-25 12:23:15,543][2409097] DAMAGECOUNT value on done: 125.0
[2023-02-25 12:23:15,544][2409097] Sum rewards: -6.258, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.450', 'AMMO5': '0.004', 'AMMO2': '0.014', 'weapon5': '0.044', 'ARMOR': '0.064', 'AMMO4': '0.069', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.154', 'weapon4': '0.240', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.600', 'weapon3': '0.648', 'FRAGCOUNT': '1.000', 'weapon2': '1.290'}
[2023-02-25 12:23:15,620][2409389] DAMAGECOUNT value on done: 37.0
[2023-02-25 12:23:15,624][2409405] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:23:15,625][2409547] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:23:15,638][2409596] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:23:15,720][2409469] DAMAGECOUNT value on done: 55.0
[2023-02-25 12:23:15,776][2409105] DAMAGECOUNT value on done: 40.0
[2023-02-25 12:23:15,796][2409080] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:23:15,888][2409355] DAMAGECOUNT value on done: 140.0
[2023-02-25 12:23:15,890][2409355] Sum rewards: -3.900, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.038', 'AMMO2': '0.005', 'AMMO4': '0.023', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'HITCOUNT': '0.110', 'AMMO3': '0.118', 'weapon4': '0.122', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.650', 'weapon3': '0.656', 'weapon2': '1.198', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:23:15,923][2409077] DAMAGECOUNT value on done: 135.0
[2023-02-25 12:23:15,926][2409077] Sum rewards: -8.610, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.890', 'AMMO4': '-0.023', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'weapon5': '0.014', 'WEAPON5': '0.050', 'HITCOUNT': '0.090', 'AMMO3': '0.188', 'DAMAGECOUNT': '0.405', 'ARMOR': '0.440', 'weapon3': '0.832', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.386'}
[2023-02-25 12:23:15,937][2409373] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:23:15,939][2409373] Sum rewards: -4.240, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.462', 'AMMO2': '0.006', 'AMMO4': '0.028', 'HITCOUNT': '0.030', 'ARMOR': '0.060', 'weapon7': '0.076', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'DAMAGECOUNT': '0.135', 'AMMO3': '0.139', 'WEAPON7': '0.200', 'weapon3': '0.724', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.146'}
[2023-02-25 12:23:15,947][2409104] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:23:15,948][2409104] Sum rewards: -5.334, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.678', 'AMMO2': '0.016', 'ARMOR': '0.032', 'HITCOUNT': '0.050', 'AMMO4': '0.081', 'DAMAGECOUNT': '0.135', 'AMMO3': '0.179', 'WEAPON3': '0.850', 'weapon3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.350'}
[2023-02-25 12:23:16,017][2409866] DAMAGECOUNT value on done: 55.0
[2023-02-25 12:23:16,052][2409565] DAMAGECOUNT value on done: 39.0
[2023-02-25 12:23:16,366][2409485] DAMAGECOUNT value on done: 200.0
[2023-02-25 12:23:16,369][2409485] Sum rewards: -9.161, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.778', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.058', 'WEAPON5': '0.100', 'HITCOUNT': '0.140', 'AMMO3': '0.178', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.600', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '1.004', 'weapon3': '1.120'}
[2023-02-25 12:23:16,397][2409074] Updated weights for policy 0, policy_version 1490 (0.0012)
[2023-02-25 12:23:16,526][2409096] DAMAGECOUNT value on done: 125.0
[2023-02-25 12:23:16,576][2409078] DAMAGECOUNT value on done: 20.0
[2023-02-25 12:23:16,724][2409075] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:23:16,982][2409076] DAMAGECOUNT value on done: 230.0
[2023-02-25 12:23:16,984][2409076] Sum rewards: -2.978, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.780', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.040', 'AMMO4': '0.080', 'AMMO3': '0.114', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.690', 'weapon3': '0.708', 'ARMOR': '0.959', 'weapon2': '1.410', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:23:17,186][2408954] Fps is (10 sec: 24985.5, 60 sec: 25600.0, 300 sec: 20934.6). Total num frames: 6127616. Throughput: 0: 6476.5. Samples: 1540056. Policy #0 lag: (min: 0.0, avg: 16.1, max: 29.0)
[2023-02-25 12:23:17,187][2408954] Avg episode reward: [(0, '-5.999')]
[2023-02-25 12:23:17,511][2409074] Updated weights for policy 0, policy_version 1500 (0.0012)
[2023-02-25 12:23:17,553][2409103] DAMAGECOUNT value on done: 20.0
[2023-02-25 12:23:17,590][2409079] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:23:17,594][2409079] Sum rewards: -5.732, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.200', 'AMMO5': '0.005', 'AMMO2': '0.009', 'HITCOUNT': '0.010', 'weapon4': '0.016', 'weapon5': '0.038', 'DAMAGECOUNT': '0.045', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'ARMOR': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.141', 'WEAPON3': '0.650', 'weapon3': '0.978', 'weapon2': '1.068'}
[2023-02-25 12:23:17,680][2409548] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:23:17,784][2409549] DAMAGECOUNT value on done: 60.0
[2023-02-25 12:23:17,784][2409549] Sum rewards: -9.952, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.440', 'AMMO2': '0.020', 'HITCOUNT': '0.060', 'AMMO4': '0.099', 'weapon4': '0.126', 'AMMO3': '0.163', 'DAMAGECOUNT': '0.180', 'WEAPON4': '0.200', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.088', 'weapon3': '1.202'}
[2023-02-25 12:23:18,014][2409468] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:23:18,018][2409468] Sum rewards: -7.325, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.290', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'HITCOUNT': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'DAMAGECOUNT': '0.045', 'AMMO3': '0.177', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '1.200', 'weapon3': '1.230'}
[2023-02-25 12:23:18,200][2409101] DAMAGECOUNT value on done: 55.0
[2023-02-25 12:23:18,201][2409101] Sum rewards: -4.437, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.180', 'AMMO2': '0.008', 'weapon4': '0.032', 'AMMO4': '0.038', 'HITCOUNT': '0.060', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.165', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.078', 'weapon2': '1.174'}
[2023-02-25 12:23:18,404][2409102] DAMAGECOUNT value on done: 35.0
[2023-02-25 12:23:18,632][2409407] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:23:18,698][2409100] DAMAGECOUNT value on done: 22.0
[2023-02-25 12:23:18,781][2409597] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:23:18,825][2409406] DAMAGECOUNT value on done: 30.0
[2023-02-25 12:23:19,122][2409074] Updated weights for policy 0, policy_version 1510 (0.0012)
[2023-02-25 12:23:19,130][2409097] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:23:19,131][2409097] Sum rewards: -5.862, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.216', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'weapon5': '0.016', 'ARMOR': '0.036', 'weapon4': '0.038', 'HITCOUNT': '0.040', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'DAMAGECOUNT': '0.075', 'AMMO3': '0.111', 'WEAPON3': '0.600', 'weapon3': '0.868', 'weapon2': '1.380'}
[2023-02-25 12:23:19,201][2409099] DAMAGECOUNT value on done: 238.0
[2023-02-25 12:23:19,205][2409099] Sum rewards: -1.189, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.781', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'AMMO4': '0.112', 'AMMO3': '0.124', 'weapon4': '0.140', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.714', 'weapon3': '0.830', 'weapon2': '1.332', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:23:19,289][2409596] DAMAGECOUNT value on done: 70.0
[2023-02-25 12:23:19,295][2409547] DAMAGECOUNT value on done: 105.0
[2023-02-25 12:23:19,298][2409547] Sum rewards: -5.739, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.450', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.038', 'weapon5': '0.046', 'ARMOR': '0.056', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'AMMO4': '0.110', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.315', 'WEAPON3': '0.750', 'weapon3': '0.946', 'FRAGCOUNT': '1.000', 'weapon2': '1.418'}
[2023-02-25 12:23:19,433][2409389] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:23:19,471][2409469] DAMAGECOUNT value on done: 72.0
[2023-02-25 12:23:19,484][2409373] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:23:19,514][2409405] DAMAGECOUNT value on done: 175.0
[2023-02-25 12:23:19,515][2409405] Sum rewards: -1.895, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.019', 'AMMO3': '0.084', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'HITCOUNT': '0.140', 'weapon4': '0.186', 'HEALTH': '0.326', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.525', 'weapon3': '0.714', 'FRAGCOUNT': '1.000', 'weapon2': '1.268'}
[2023-02-25 12:23:19,526][2409565] DAMAGECOUNT value on done: 195.0
[2023-02-25 12:23:19,529][2409565] Sum rewards: -1.699, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.870', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.023', 'AMMO3': '0.114', 'AMMO4': '0.114', 'weapon4': '0.126', 'HITCOUNT': '0.150', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.585', 'WEAPON3': '0.600', 'weapon3': '0.740', 'weapon2': '1.158', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:23:19,583][2409104] DAMAGECOUNT value on done: 60.0
[2023-02-25 12:23:19,591][2409077] DAMAGECOUNT value on done: 125.0
[2023-02-25 12:23:19,592][2409077] Sum rewards: -8.815, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.172', 'AMMO2': '0.004', 'AMMO4': '0.019', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'HITCOUNT': '0.070', 'AMMO3': '0.135', 'weapon4': '0.176', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.650', 'weapon3': '0.686', 'FRAGCOUNT': '1.000', 'weapon2': '1.402'}
[2023-02-25 12:23:19,633][2409486] DAMAGECOUNT value on done: 91.0
[2023-02-25 12:23:19,636][2409486] Sum rewards: -4.103, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.700', 'ARMOR': '0.016', 'AMMO2': '0.019', 'weapon4': '0.028', 'AMMO4': '0.094', 'HITCOUNT': '0.100', 'AMMO3': '0.143', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.273', 'WEAPON3': '0.550', 'weapon3': '0.838', 'FRAGCOUNT': '1.000', 'weapon2': '1.536'}
[2023-02-25 12:23:19,726][2409080] DAMAGECOUNT value on done: 55.0
[2023-02-25 12:23:19,731][2409105] DAMAGECOUNT value on done: 40.0
[2023-02-25 12:23:19,849][2409485] DAMAGECOUNT value on done: 5.0
[2023-02-25 12:23:19,977][2409355] DAMAGECOUNT value on done: 120.0
[2023-02-25 12:23:19,981][2409355] Sum rewards: -5.776, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.619', 'ARMOR': '0.004', 'weapon4': '0.014', 'AMMO2': '0.015', 'AMMO4': '0.073', 'HITCOUNT': '0.100', 'AMMO3': '0.115', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.500', 'weapon3': '0.780', 'FRAGCOUNT': '1.000', 'weapon2': '1.682'}
[2023-02-25 12:23:20,081][2409866] DAMAGECOUNT value on done: 95.0
[2023-02-25 12:23:20,084][2409866] Sum rewards: -5.897, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.620', 'AMMO2': '0.011', 'AMMO4': '0.057', 'HITCOUNT': '0.070', 'ARMOR': '0.076', 'AMMO3': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.272', 'DAMAGECOUNT': '0.285', 'weapon3': '0.548', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.424'}
[2023-02-25 12:23:20,274][2409096] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:23:20,585][2409078] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:23:20,619][2409076] DAMAGECOUNT value on done: 80.0
[2023-02-25 12:23:20,983][2409074] Updated weights for policy 0, policy_version 1520 (0.0012)
[2023-02-25 12:23:21,030][2409103] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:23:21,039][2409075] DAMAGECOUNT value on done: 55.0
[2023-02-25 12:23:21,041][2409075] Sum rewards: -5.809, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.266', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'HITCOUNT': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.144', 'DAMAGECOUNT': '0.165', 'WEAPON3': '0.750', 'weapon3': '0.792', 'FRAGCOUNT': '1.000', 'weapon2': '1.462'}
[2023-02-25 12:23:21,263][2409548] DAMAGECOUNT value on done: 30.0
[2023-02-25 12:23:21,653][2409549] DAMAGECOUNT value on done: 5.0
[2023-02-25 12:23:21,743][2409074] Updated weights for policy 0, policy_version 1530 (0.0011)
[2023-02-25 12:23:21,761][2409468] DAMAGECOUNT value on done: 5.0
[2023-02-25 12:23:21,778][2409079] DAMAGECOUNT value on done: 55.0
[2023-02-25 12:23:21,882][2409102] DAMAGECOUNT value on done: 68.0
[2023-02-25 12:23:21,883][2409102] Sum rewards: -8.752, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.284', 'ARMOR': '0.016', 'AMMO2': '0.022', 'HITCOUNT': '0.080', 'AMMO3': '0.097', 'AMMO4': '0.111', 'weapon4': '0.112', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.204', 'WEAPON3': '0.550', 'weapon3': '0.604', 'FRAGCOUNT': '1.000', 'weapon2': '1.786'}
[2023-02-25 12:23:22,075][2409101] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:23:22,186][2408954] Fps is (10 sec: 27446.6, 60 sec: 26009.6, 300 sec: 21243.7). Total num frames: 6266880. Throughput: 0: 6468.6. Samples: 1559472. Policy #0 lag: (min: 0.0, avg: 10.3, max: 25.0)
[2023-02-25 12:23:22,186][2408954] Avg episode reward: [(0, '-5.957')]
[2023-02-25 12:23:22,370][2409597] DAMAGECOUNT value on done: 4.0
[2023-02-25 12:23:22,412][2409100] DAMAGECOUNT value on done: 195.0
[2023-02-25 12:23:22,417][2409100] Sum rewards: -2.506, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.529', 'AMMO2': '0.019', 'AMMO4': '0.092', 'HITCOUNT': '0.100', 'AMMO3': '0.111', 'WEAPON4': '0.150', 'weapon4': '0.180', 'ARMOR': '0.476', 'WEAPON3': '0.550', 'weapon3': '0.584', 'DAMAGECOUNT': '0.585', 'weapon2': '1.426', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:23:22,570][2409406] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:23:22,789][2409407] DAMAGECOUNT value on done: 90.0
[2023-02-25 12:23:22,790][2409407] Sum rewards: -5.758, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.808', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.024', 'ARMOR': '0.036', 'AMMO4': '0.038', 'WEAPON5': '0.050', 'weapon4': '0.078', 'HITCOUNT': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.128', 'DAMAGECOUNT': '0.270', 'WEAPON3': '0.700', 'weapon3': '0.914', 'FRAGCOUNT': '1.000', 'weapon2': '1.372'}
[2023-02-25 12:23:22,936][2409469] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:23:22,984][2409099] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:23:23,031][2409596] DAMAGECOUNT value on done: 135.0
[2023-02-25 12:23:23,166][2409405] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:23:23,167][2409405] Sum rewards: -6.114, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.056', 'AMMO2': '0.026', 'HITCOUNT': '0.050', 'ARMOR': '0.068', 'AMMO4': '0.130', 'DAMAGECOUNT': '0.135', 'AMMO3': '0.154', 'WEAPON4': '0.250', 'weapon4': '0.342', 'weapon3': '0.504', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.382'}
[2023-02-25 12:23:23,232][2409097] DAMAGECOUNT value on done: 70.0
[2023-02-25 12:23:23,312][2409104] DAMAGECOUNT value on done: 50.0
[2023-02-25 12:23:23,317][2409077] DAMAGECOUNT value on done: 72.0
[2023-02-25 12:23:23,354][2409080] DAMAGECOUNT value on done: 195.0
[2023-02-25 12:23:23,357][2409080] Sum rewards: -0.326, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.200', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.008', 'WEAPON4': '0.050', 'AMMO3': '0.096', 'weapon4': '0.098', 'HITCOUNT': '0.110', 'ARMOR': '0.516', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.585', 'FRAGCOUNT': '1.000', 'weapon2': '1.008', 'weapon3': '1.096'}
[2023-02-25 12:23:23,359][2409105] DAMAGECOUNT value on done: 16.0
[2023-02-25 12:23:23,373][2409486] DAMAGECOUNT value on done: 35.0
[2023-02-25 12:23:23,385][2409485] DAMAGECOUNT value on done: 160.0
[2023-02-25 12:23:23,389][2409485] Sum rewards: -5.002, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.040', 'weapon4': '0.020', 'AMMO2': '0.036', 'ARMOR': '0.046', 'HITCOUNT': '0.100', 'AMMO3': '0.106', 'AMMO4': '0.178', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.500', 'weapon3': '0.744', 'FRAGCOUNT': '1.000', 'weapon2': '1.628'}
[2023-02-25 12:23:23,413][2409547] DAMAGECOUNT value on done: 60.0
[2023-02-25 12:23:23,414][2409547] Sum rewards: -7.701, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.329', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'weapon5': '0.014', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'HITCOUNT': '0.060', 'AMMO4': '0.064', 'DAMAGECOUNT': '0.180', 'AMMO3': '0.194', 'WEAPON3': '0.950', 'weapon3': '0.972', 'FRAGCOUNT': '1.000', 'weapon2': '1.278'}
[2023-02-25 12:23:23,543][2409565] DAMAGECOUNT value on done: 35.0
[2023-02-25 12:23:23,642][2409373] DAMAGECOUNT value on done: 12.0
[2023-02-25 12:23:23,644][2409389] DAMAGECOUNT value on done: 130.0
[2023-02-25 12:23:23,647][2409389] Sum rewards: -6.948, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.480', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon4': '0.054', 'HITCOUNT': '0.070', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.014', 'weapon2': '1.334'}
[2023-02-25 12:23:23,646][2409373] Sum rewards: -7.259, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.032', 'AMMO5': '0.005', 'weapon5': '0.006', 'HITCOUNT': '0.020', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO2': '0.028', 'DAMAGECOUNT': '0.036', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'AMMO4': '0.137', 'weapon4': '0.182', 'WEAPON4': '0.200', 'weapon3': '0.514', 'WEAPON3': '0.550', 'weapon2': '1.590'}
[2023-02-25 12:23:23,846][2409096] DAMAGECOUNT value on done: 115.0
[2023-02-25 12:23:23,849][2409096] Sum rewards: -3.695, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.836', 'AMMO2': '0.010', 'weapon4': '0.036', 'ARMOR': '0.041', 'AMMO4': '0.050', 'HITCOUNT': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.149', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.650', 'weapon3': '0.684', 'FRAGCOUNT': '1.000', 'weapon2': '1.496'}
[2023-02-25 12:23:23,975][2409355] DAMAGECOUNT value on done: 70.0
[2023-02-25 12:23:24,121][2409866] DAMAGECOUNT value on done: 105.0
[2023-02-25 12:23:24,124][2409866] Sum rewards: -4.873, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.502', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'ARMOR': '0.036', 'HITCOUNT': '0.050', 'AMMO4': '0.073', 'AMMO3': '0.134', 'weapon4': '0.144', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.315', 'WEAPON3': '0.650', 'weapon3': '0.804', 'FRAGCOUNT': '1.000', 'weapon2': '1.438'}
[2023-02-25 12:23:24,156][2409078] DAMAGECOUNT value on done: 54.0
[2023-02-25 12:23:24,188][2409074] Updated weights for policy 0, policy_version 1540 (0.0012)
[2023-02-25 12:23:24,890][2409548] DAMAGECOUNT value on done: 140.0
[2023-02-25 12:23:24,909][2409076] DAMAGECOUNT value on done: 4.0
[2023-02-25 12:23:24,954][2409075] DAMAGECOUNT value on done: 215.0
[2023-02-25 12:23:24,957][2409075] Sum rewards: -7.495, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.709', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'ARMOR': '0.056', 'AMMO4': '0.069', 'AMMO3': '0.078', 'weapon4': '0.102', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'WEAPON3': '0.200', 'weapon3': '0.376', 'DAMAGECOUNT': '0.645', 'FRAGCOUNT': '1.000', 'weapon2': '1.802'}
[2023-02-25 12:23:25,320][2409074] Updated weights for policy 0, policy_version 1550 (0.0012)
[2023-02-25 12:23:25,434][2409079] DAMAGECOUNT value on done: 70.0
[2023-02-25 12:23:25,435][2409079] Sum rewards: -6.131, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.557', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'HITCOUNT': '0.080', 'AMMO3': '0.145', 'DAMAGECOUNT': '0.210', 'ARMOR': '0.454', 'WEAPON3': '0.600', 'weapon3': '0.736', 'FRAGCOUNT': '1.000', 'weapon2': '1.486'}
[2023-02-25 12:23:25,649][2409468] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:23:25,650][2409468] Sum rewards: -5.824, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.958', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'ARMOR': '0.032', 'HITCOUNT': '0.050', 'weapon4': '0.054', 'AMMO4': '0.058', 'AMMO3': '0.095', 'DAMAGECOUNT': '0.135', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.500', 'weapon3': '0.642', 'weapon2': '1.294'}
[2023-02-25 12:23:25,996][2409406] DAMAGECOUNT value on done: 49.0
[2023-02-25 12:23:26,285][2409407] DAMAGECOUNT value on done: 55.0
[2023-02-25 12:23:26,690][2409596] DAMAGECOUNT value on done: 42.0
[2023-02-25 12:23:26,723][2409099] DAMAGECOUNT value on done: 90.0
[2023-02-25 12:23:26,742][2409077] DAMAGECOUNT value on done: 5.0
[2023-02-25 12:23:26,788][2409405] DAMAGECOUNT value on done: 123.0
[2023-02-25 12:23:26,792][2409405] Sum rewards: -9.452, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.258', 'AMMO2': '0.008', 'AMMO4': '0.040', 'HITCOUNT': '0.070', 'weapon4': '0.098', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'DAMAGECOUNT': '0.369', 'ARMOR': '0.470', 'weapon3': '0.718', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.502'}
[2023-02-25 12:23:26,944][2409104] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:23:27,048][2409486] DAMAGECOUNT value on done: 115.0
[2023-02-25 12:23:27,095][2409469] DAMAGECOUNT value on done: 65.0
[2023-02-25 12:23:27,135][2409074] Updated weights for policy 0, policy_version 1560 (0.0012)
[2023-02-25 12:23:27,186][2408954] Fps is (10 sec: 26214.3, 60 sec: 26077.8, 300 sec: 21660.2). Total num frames: 6389760. Throughput: 0: 6456.5. Samples: 1597920. Policy #0 lag: (min: 0.0, avg: 12.5, max: 25.0)
[2023-02-25 12:23:27,186][2408954] Avg episode reward: [(0, '-5.970')]
[2023-02-25 12:23:27,252][2409080] DAMAGECOUNT value on done: 225.0
[2023-02-25 12:23:27,310][2409389] DAMAGECOUNT value on done: 125.0
[2023-02-25 12:23:27,311][2409389] Sum rewards: -3.953, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.966', 'AMMO2': '0.006', 'AMMO4': '0.029', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'HITCOUNT': '0.080', 'AMMO3': '0.135', 'weapon4': '0.152', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.650', 'weapon3': '0.944', 'FRAGCOUNT': '1.000', 'weapon2': '1.056'}
[2023-02-25 12:23:27,376][2409373] DAMAGECOUNT value on done: 35.0
[2023-02-25 12:23:27,377][2409373] Sum rewards: -3.832, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.140', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'HITCOUNT': '0.030', 'ARMOR': '0.048', 'AMMO3': '0.067', 'DAMAGECOUNT': '0.105', 'WEAPON3': '0.350', 'weapon3': '0.958', 'FRAGCOUNT': '1.000', 'weapon2': '1.528'}
[2023-02-25 12:23:27,424][2409097] DAMAGECOUNT value on done: 75.0
[2023-02-25 12:23:27,427][2409097] Sum rewards: -5.954, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.968', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'AMMO5': '0.003', 'ARMOR': '0.016', 'WEAPON5': '0.050', 'HITCOUNT': '0.080', 'AMMO3': '0.112', 'DAMAGECOUNT': '0.225', 'WEAPON3': '0.650', 'weapon3': '0.898', 'FRAGCOUNT': '1.000', 'weapon2': '1.286'}
[2023-02-25 12:23:27,670][2409547] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:23:27,671][2409547] Sum rewards: -3.520, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.003', 'AMMO2': '0.021', 'AMMO3': '0.049', 'HITCOUNT': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.106', 'ARMOR': '0.112', 'DAMAGECOUNT': '0.135', 'WEAPON4': '0.150', 'weapon4': '0.160', 'WEAPON3': '0.250', 'weapon3': '0.430', 'HEALTH': '1.056', 'weapon2': '1.348'}
[2023-02-25 12:23:27,783][2409078] DAMAGECOUNT value on done: 47.0
[2023-02-25 12:23:27,856][2409355] DAMAGECOUNT value on done: 265.0
[2023-02-25 12:23:27,860][2409355] Sum rewards: -4.813, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.128', 'weapon4': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.010', 'ARMOR': '0.024', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO3': '0.130', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.795', 'weapon3': '0.928', 'FRAGCOUNT': '1.000', 'weapon2': '1.226'}
[2023-02-25 12:23:27,955][2409096] DAMAGECOUNT value on done: 85.0
[2023-02-25 12:23:27,958][2409096] Sum rewards: -5.530, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.854', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.007', 'WEAPON4': '0.050', 'HITCOUNT': '0.060', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'weapon4': '0.162', 'DAMAGECOUNT': '0.255', 'WEAPON3': '0.550', 'weapon3': '0.704', 'weapon2': '1.262'}
[2023-02-25 12:23:27,979][2409866] DAMAGECOUNT value on done: 5.0
[2023-02-25 12:23:28,429][2409076] DAMAGECOUNT value on done: 65.0
[2023-02-25 12:23:28,430][2409076] Sum rewards: -4.381, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.566', 'weapon4': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.019', 'HITCOUNT': '0.060', 'AMMO4': '0.093', 'AMMO3': '0.098', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.195', 'WEAPON3': '0.500', 'weapon3': '0.908', 'FRAGCOUNT': '1.000', 'weapon2': '1.386'}
[2023-02-25 12:23:28,554][2409075] DAMAGECOUNT value on done: 60.0
[2023-02-25 12:23:28,555][2409075] Sum rewards: -4.941, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.320', 'AMMO2': '0.012', 'ARMOR': '0.040', 'HITCOUNT': '0.050', 'AMMO4': '0.061', 'weapon4': '0.086', 'AMMO3': '0.148', 'DAMAGECOUNT': '0.180', 'WEAPON4': '0.200', 'WEAPON3': '0.750', 'weapon3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.452'}
[2023-02-25 12:23:28,729][2409074] Updated weights for policy 0, policy_version 1570 (0.0012)
[2023-02-25 12:23:29,148][2409079] DAMAGECOUNT value on done: 19.0
[2023-02-25 12:23:29,290][2409468] DAMAGECOUNT value on done: 65.0
[2023-02-25 12:23:29,291][2409468] Sum rewards: -3.997, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.892', 'AMMO5': '0.003', 'AMMO2': '0.019', 'ARMOR': '0.040', 'HITCOUNT': '0.050', 'AMMO4': '0.092', 'AMMO3': '0.124', 'weapon4': '0.188', 'DAMAGECOUNT': '0.195', 'WEAPON4': '0.200', 'weapon3': '0.360', 'WEAPON3': '0.500', 'weapon2': '1.874', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:23:29,982][2409074] Updated weights for policy 0, policy_version 1580 (0.0012)
[2023-02-25 12:23:30,260][2409099] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:23:30,262][2409099] Sum rewards: -7.624, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.494', 'AMMO5': '0.005', 'HITCOUNT': '0.010', 'AMMO2': '0.013', 'weapon4': '0.024', 'weapon5': '0.026', 'DAMAGECOUNT': '0.030', 'AMMO3': '0.048', 'AMMO4': '0.063', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'WEAPON3': '0.250', 'ARMOR': '0.500', 'weapon3': '0.570', 'weapon2': '1.632'}
[2023-02-25 12:23:30,705][2409486] DAMAGECOUNT value on done: 35.0
[2023-02-25 12:23:30,828][2409080] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:23:30,832][2409080] Sum rewards: -6.932, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.240', 'AMMO5': '0.009', 'AMMO2': '0.017', 'weapon5': '0.052', 'weapon4': '0.056', 'AMMO4': '0.086', 'AMMO3': '0.129', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.700', 'weapon2': '0.908', 'weapon3': '0.950'}
[2023-02-25 12:23:31,354][2409355] DAMAGECOUNT value on done: 30.0
[2023-02-25 12:23:31,480][2409866] DAMAGECOUNT value on done: 40.0
[2023-02-25 12:23:31,487][2409866] Sum rewards: -7.729, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.571', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.030', 'HITCOUNT': '0.040', 'WEAPON5': '0.050', 'weapon4': '0.066', 'AMMO3': '0.099', 'DAMAGECOUNT': '0.120', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'WEAPON3': '0.550', 'weapon3': '0.810', 'weapon2': '1.466'}
[2023-02-25 12:23:31,631][2409547] DAMAGECOUNT value on done: 59.0
[2023-02-25 12:23:31,918][2409074] Updated weights for policy 0, policy_version 1590 (0.0012)
[2023-02-25 12:23:32,186][2408954] Fps is (10 sec: 25803.0, 60 sec: 25804.5, 300 sec: 22118.3). Total num frames: 6524928. Throughput: 0: 6482.6. Samples: 1637820. Policy #0 lag: (min: 0.0, avg: 12.4, max: 24.0)
[2023-02-25 12:23:32,187][2408954] Avg episode reward: [(0, '-5.957')]
[2023-02-25 12:23:32,866][2409468] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:23:32,867][2409468] Sum rewards: -3.088, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.566', 'AMMO5': '0.003', 'HITCOUNT': '0.010', 'AMMO2': '0.020', 'weapon4': '0.042', 'DAMAGECOUNT': '0.045', 'ARMOR': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.101', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'WEAPON3': '0.500', 'weapon3': '0.692', 'FRAGCOUNT': '1.000', 'weapon2': '1.460'}
[2023-02-25 12:23:33,364][2409074] Updated weights for policy 0, policy_version 1600 (0.0012)
[2023-02-25 12:23:33,935][2409099] DAMAGECOUNT value on done: 40.0
[2023-02-25 12:23:34,401][2409080] DAMAGECOUNT value on done: 5.0
[2023-02-25 12:23:34,402][2409080] Sum rewards: -11.483, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.541', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.003', 'weapon5': '0.010', 'HITCOUNT': '0.010', 'DAMAGECOUNT': '0.015', 'weapon4': '0.018', 'AMMO2': '0.019', 'ARMOR': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.092', 'AMMO3': '0.121', 'WEAPON4': '0.200', 'WEAPON3': '0.650', 'weapon3': '0.760', 'weapon2': '1.586'}
[2023-02-25 12:23:34,811][2409074] Updated weights for policy 0, policy_version 1610 (0.0014)
[2023-02-25 12:23:36,353][2409074] Updated weights for policy 0, policy_version 1620 (0.0012)
[2023-02-25 12:23:36,477][2409468] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:23:37,186][2408954] Fps is (10 sec: 26624.0, 60 sec: 26009.7, 300 sec: 22562.7). Total num frames: 6656000. Throughput: 0: 6473.6. Samples: 1657332. Policy #0 lag: (min: 0.0, avg: 11.5, max: 25.0)
[2023-02-25 12:23:37,200][2408954] Avg episode reward: [(0, '-5.914')]
[2023-02-25 12:23:37,863][2409074] Updated weights for policy 0, policy_version 1630 (0.0013)
[2023-02-25 12:23:37,967][2409080] DAMAGECOUNT value on done: 79.0
[2023-02-25 12:23:37,971][2409080] Sum rewards: -3.221, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.070', 'AMMO5': '0.004', 'AMMO2': '0.016', 'ARMOR': '0.052', 'weapon5': '0.052', 'HITCOUNT': '0.070', 'AMMO4': '0.082', 'AMMO3': '0.082', 'WEAPON5': '0.100', 'weapon4': '0.154', 'DAMAGECOUNT': '0.237', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'weapon3': '0.634', 'FRAGCOUNT': '1.000', 'weapon2': '1.416'}
[2023-02-25 12:23:39,553][2409074] Updated weights for policy 0, policy_version 1640 (0.0012)
[2023-02-25 12:23:40,084][2409468] DAMAGECOUNT value on done: 37.0
[2023-02-25 12:23:40,772][2409074] Updated weights for policy 0, policy_version 1650 (0.0013)
[2023-02-25 12:23:42,186][2408954] Fps is (10 sec: 26216.3, 60 sec: 26214.4, 300 sec: 23007.0). Total num frames: 6787072. Throughput: 0: 6491.2. Samples: 1697268. Policy #0 lag: (min: 0.0, avg: 14.0, max: 27.0)
[2023-02-25 12:23:42,187][2408954] Avg episode reward: [(0, '-5.911')]
[2023-02-25 12:23:42,851][2409074] Updated weights for policy 0, policy_version 1660 (0.0012)
[2023-02-25 12:23:44,014][2409074] Updated weights for policy 0, policy_version 1670 (0.0012)
[2023-02-25 12:23:45,827][2409074] Updated weights for policy 0, policy_version 1680 (0.0012)
[2023-02-25 12:23:47,186][2408954] Fps is (10 sec: 24985.5, 60 sec: 25600.0, 300 sec: 23409.7). Total num frames: 6905856. Throughput: 0: 6524.2. Samples: 1736880. Policy #0 lag: (min: 0.0, avg: 14.1, max: 27.0)
[2023-02-25 12:23:47,186][2408954] Avg episode reward: [(0, '-5.911')]
[2023-02-25 12:23:47,354][2409074] Updated weights for policy 0, policy_version 1690 (0.0013)
[2023-02-25 12:23:48,421][2409074] Updated weights for policy 0, policy_version 1700 (0.0012)
[2023-02-25 12:23:50,438][2409074] Updated weights for policy 0, policy_version 1710 (0.0012)
[2023-02-25 12:23:51,871][2409074] Updated weights for policy 0, policy_version 1720 (0.0012)
[2023-02-25 12:23:52,186][2408954] Fps is (10 sec: 27033.4, 60 sec: 26078.0, 300 sec: 23923.4). Total num frames: 7057408. Throughput: 0: 6526.4. Samples: 1756452. Policy #0 lag: (min: 0.0, avg: 13.3, max: 28.0)
[2023-02-25 12:23:52,186][2408954] Avg episode reward: [(0, '-5.911')]
[2023-02-25 12:23:53,994][2409074] Updated weights for policy 0, policy_version 1730 (0.0012)
[2023-02-25 12:23:54,973][2409074] Updated weights for policy 0, policy_version 1740 (0.0020)
[2023-02-25 12:23:56,398][2409074] Updated weights for policy 0, policy_version 1750 (0.0012)
[2023-02-25 12:23:57,186][2408954] Fps is (10 sec: 27033.9, 60 sec: 26214.5, 300 sec: 24326.5). Total num frames: 7176192. Throughput: 0: 6551.7. Samples: 1795344. Policy #0 lag: (min: 0.0, avg: 11.4, max: 29.0)
[2023-02-25 12:23:57,186][2408954] Avg episode reward: [(0, '-5.911')]
[2023-02-25 12:23:58,255][2409074] Updated weights for policy 0, policy_version 1760 (0.0013)
[2023-02-25 12:23:59,541][2409074] Updated weights for policy 0, policy_version 1770 (0.0013)
[2023-02-25 12:24:01,467][2409074] Updated weights for policy 0, policy_version 1780 (0.0012)
[2023-02-25 12:24:02,186][2408954] Fps is (10 sec: 25394.2, 60 sec: 26009.4, 300 sec: 24784.2). Total num frames: 7311360. Throughput: 0: 6547.1. Samples: 1834680. Policy #0 lag: (min: 0.0, avg: 13.5, max: 27.0)
[2023-02-25 12:24:02,187][2408954] Avg episode reward: [(0, '-5.911')]
[2023-02-25 12:24:02,960][2409074] Updated weights for policy 0, policy_version 1790 (0.0013)
[2023-02-25 12:24:03,792][2409033] Signal inference workers to stop experience collection... (250 times)
[2023-02-25 12:24:03,803][2409033] Signal inference workers to resume experience collection... (250 times)
[2023-02-25 12:24:03,834][2409074] InferenceWorker_p0-w0: stopping experience collection (250 times)
[2023-02-25 12:24:03,835][2409074] InferenceWorker_p0-w0: resuming experience collection (250 times)
[2023-02-25 12:24:04,645][2409074] Updated weights for policy 0, policy_version 1800 (0.0012)
[2023-02-25 12:24:06,474][2409074] Updated weights for policy 0, policy_version 1810 (0.0013)
[2023-02-25 12:24:07,186][2408954] Fps is (10 sec: 26623.9, 60 sec: 26077.9, 300 sec: 25228.6). Total num frames: 7442432. Throughput: 0: 6545.1. Samples: 1854000. Policy #0 lag: (min: 2.0, avg: 13.2, max: 29.0)
[2023-02-25 12:24:07,186][2408954] Avg episode reward: [(0, '-5.911')]
[2023-02-25 12:24:07,596][2409074] Updated weights for policy 0, policy_version 1820 (0.0013)
[2023-02-25 12:24:09,543][2409074] Updated weights for policy 0, policy_version 1830 (0.0012)
[2023-02-25 12:24:10,999][2409074] Updated weights for policy 0, policy_version 1840 (0.0012)
[2023-02-25 12:24:12,186][2408954] Fps is (10 sec: 24986.6, 60 sec: 26146.7, 300 sec: 25631.2). Total num frames: 7561216. Throughput: 0: 6512.3. Samples: 1890972. Policy #0 lag: (min: 0.0, avg: 9.8, max: 24.0)
[2023-02-25 12:24:12,186][2408954] Avg episode reward: [(0, '-5.911')]
[2023-02-25 12:24:12,843][2409074] Updated weights for policy 0, policy_version 1850 (0.0012)
[2023-02-25 12:24:14,445][2409074] Updated weights for policy 0, policy_version 1860 (0.0012)
[2023-02-25 12:24:15,927][2409074] Updated weights for policy 0, policy_version 1870 (0.0013)
[2023-02-25 12:24:17,186][2408954] Fps is (10 sec: 25395.2, 60 sec: 26146.1, 300 sec: 25922.8). Total num frames: 7696384. Throughput: 0: 6505.4. Samples: 1930560. Policy #0 lag: (min: 0.0, avg: 10.6, max: 24.0)
[2023-02-25 12:24:17,186][2408954] Avg episode reward: [(0, '-5.911')]
[2023-02-25 12:24:17,191][2409033] Saving /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000001879_7696384.pth...
[2023-02-25 12:24:17,284][2409033] Removing /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000000368_1507328.pth
[2023-02-25 12:24:17,650][2409074] Updated weights for policy 0, policy_version 1880 (0.0013)
[2023-02-25 12:24:18,148][2409077] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 12:24:18,724][2409074] Updated weights for policy 0, policy_version 1890 (0.0014)
[2023-02-25 12:24:20,383][2409074] Updated weights for policy 0, policy_version 1900 (0.0013)
[2023-02-25 12:24:22,186][2408954] Fps is (10 sec: 25804.9, 60 sec: 25873.1, 300 sec: 25867.3). Total num frames: 7819264. Throughput: 0: 6500.8. Samples: 1949868. Policy #0 lag: (min: 0.0, avg: 12.9, max: 25.0)
[2023-02-25 12:24:22,186][2408954] Avg episode reward: [(0, '-5.911')]
[2023-02-25 12:24:22,272][2409074] Updated weights for policy 0, policy_version 1910 (0.0013)
[2023-02-25 12:24:23,716][2409074] Updated weights for policy 0, policy_version 1920 (0.0013)
[2023-02-25 12:24:25,829][2409074] Updated weights for policy 0, policy_version 1930 (0.0012)
[2023-02-25 12:24:27,064][2409074] Updated weights for policy 0, policy_version 1940 (0.0013)
[2023-02-25 12:24:27,186][2408954] Fps is (10 sec: 24985.1, 60 sec: 25941.3, 300 sec: 25867.3). Total num frames: 7946240. Throughput: 0: 6464.2. Samples: 1988160. Policy #0 lag: (min: 1.0, avg: 12.8, max: 25.0)
[2023-02-25 12:24:27,187][2408954] Avg episode reward: [(0, '-5.911')]
[2023-02-25 12:24:28,715][2409074] Updated weights for policy 0, policy_version 1950 (0.0013)
[2023-02-25 12:24:29,969][2409074] Updated weights for policy 0, policy_version 1960 (0.0012)
[2023-02-25 12:24:31,750][2409074] Updated weights for policy 0, policy_version 1970 (0.0012)
[2023-02-25 12:24:32,186][2408954] Fps is (10 sec: 25804.6, 60 sec: 25873.4, 300 sec: 25853.4). Total num frames: 8077312. Throughput: 0: 6446.9. Samples: 2026992. Policy #0 lag: (min: 0.0, avg: 13.9, max: 26.0)
[2023-02-25 12:24:32,186][2408954] Avg episode reward: [(0, '-5.911')]
[2023-02-25 12:24:33,255][2409074] Updated weights for policy 0, policy_version 1980 (0.0012)
[2023-02-25 12:24:34,739][2409074] Updated weights for policy 0, policy_version 1990 (0.0012)
[2023-02-25 12:24:36,679][2409074] Updated weights for policy 0, policy_version 2000 (0.0014)
[2023-02-25 12:24:37,187][2408954] Fps is (10 sec: 25801.5, 60 sec: 25804.2, 300 sec: 25839.4). Total num frames: 8204288. Throughput: 0: 6441.4. Samples: 2046324. Policy #0 lag: (min: 0.0, avg: 13.2, max: 27.0)
[2023-02-25 12:24:37,188][2408954] Avg episode reward: [(0, '-5.911')]
[2023-02-25 12:24:37,949][2409074] Updated weights for policy 0, policy_version 2010 (0.0013)
[2023-02-25 12:24:39,760][2409074] Updated weights for policy 0, policy_version 2020 (0.0012)
[2023-02-25 12:24:41,460][2409074] Updated weights for policy 0, policy_version 2030 (0.0013)
[2023-02-25 12:24:42,186][2408954] Fps is (10 sec: 26214.5, 60 sec: 25873.1, 300 sec: 25797.9). Total num frames: 8339456. Throughput: 0: 6418.9. Samples: 2084196. Policy #0 lag: (min: 0.0, avg: 10.5, max: 25.0)
[2023-02-25 12:24:42,186][2408954] Avg episode reward: [(0, '-5.911')]
[2023-02-25 12:24:42,954][2409074] Updated weights for policy 0, policy_version 2040 (0.0012)
[2023-02-25 12:24:44,549][2409074] Updated weights for policy 0, policy_version 2050 (0.0013)
[2023-02-25 12:24:46,194][2409074] Updated weights for policy 0, policy_version 2060 (0.0012)
[2023-02-25 12:24:47,186][2408954] Fps is (10 sec: 26218.3, 60 sec: 26009.6, 300 sec: 25825.6). Total num frames: 8466432. Throughput: 0: 6414.5. Samples: 2123328. Policy #0 lag: (min: 0.0, avg: 12.7, max: 25.0)
[2023-02-25 12:24:47,186][2408954] Avg episode reward: [(0, '-5.911')]
[2023-02-25 12:24:47,685][2409074] Updated weights for policy 0, policy_version 2070 (0.0012)
[2023-02-25 12:24:49,452][2409074] Updated weights for policy 0, policy_version 2080 (0.0012)
[2023-02-25 12:24:50,716][2409074] Updated weights for policy 0, policy_version 2090 (0.0013)
[2023-02-25 12:24:52,186][2408954] Fps is (10 sec: 25804.7, 60 sec: 25668.3, 300 sec: 25853.4). Total num frames: 8597504. Throughput: 0: 6421.9. Samples: 2142984. Policy #0 lag: (min: 0.0, avg: 12.7, max: 26.0)
[2023-02-25 12:24:52,186][2408954] Avg episode reward: [(0, '-5.911')]
[2023-02-25 12:24:52,318][2409074] Updated weights for policy 0, policy_version 2100 (0.0012)
[2023-02-25 12:24:53,886][2409074] Updated weights for policy 0, policy_version 2110 (0.0015)
[2023-02-25 12:24:55,439][2409074] Updated weights for policy 0, policy_version 2120 (0.0012)
[2023-02-25 12:24:57,186][2408954] Fps is (10 sec: 25395.2, 60 sec: 25736.5, 300 sec: 25770.4). Total num frames: 8720384. Throughput: 0: 6464.3. Samples: 2181864. Policy #0 lag: (min: 2.0, avg: 13.3, max: 30.0)
[2023-02-25 12:24:57,186][2408954] Avg episode reward: [(0, '-5.911')]
[2023-02-25 12:24:57,239][2409074] Updated weights for policy 0, policy_version 2130 (0.0012)
[2023-02-25 12:24:58,669][2409074] Updated weights for policy 0, policy_version 2140 (0.0012)
[2023-02-25 12:24:59,476][2409078] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 12:25:00,355][2409074] Updated weights for policy 0, policy_version 2150 (0.0013)
[2023-02-25 12:25:01,589][2409074] Updated weights for policy 0, policy_version 2160 (0.0012)
[2023-02-25 12:25:02,186][2408954] Fps is (10 sec: 26214.5, 60 sec: 25805.0, 300 sec: 25825.6). Total num frames: 8859648. Throughput: 0: 6461.6. Samples: 2221332. Policy #0 lag: (min: 0.0, avg: 11.1, max: 25.0)
[2023-02-25 12:25:02,187][2408954] Avg episode reward: [(0, '-5.911')]
[2023-02-25 12:25:03,143][2409074] Updated weights for policy 0, policy_version 2170 (0.0012)
[2023-02-25 12:25:05,083][2409074] Updated weights for policy 0, policy_version 2180 (0.0013)
[2023-02-25 12:25:06,314][2409074] Updated weights for policy 0, policy_version 2190 (0.0012)
[2023-02-25 12:25:07,186][2408954] Fps is (10 sec: 26623.1, 60 sec: 25736.4, 300 sec: 25783.9). Total num frames: 8986624. Throughput: 0: 6463.9. Samples: 2240748. Policy #0 lag: (min: 0.0, avg: 12.2, max: 25.0)
[2023-02-25 12:25:07,186][2408954] Avg episode reward: [(0, '-5.911')]
[2023-02-25 12:25:08,074][2409074] Updated weights for policy 0, policy_version 2200 (0.0012)
[2023-02-25 12:25:09,566][2409074] Updated weights for policy 0, policy_version 2210 (0.0012)
[2023-02-25 12:25:11,254][2409074] Updated weights for policy 0, policy_version 2220 (0.0012)
[2023-02-25 12:25:12,186][2408954] Fps is (10 sec: 26213.8, 60 sec: 26009.5, 300 sec: 25811.7). Total num frames: 9121792. Throughput: 0: 6488.3. Samples: 2280132. Policy #0 lag: (min: 0.0, avg: 13.6, max: 27.0)
[2023-02-25 12:25:12,187][2408954] Avg episode reward: [(0, '-5.911')]
[2023-02-25 12:25:12,618][2409074] Updated weights for policy 0, policy_version 2230 (0.0012)
[2023-02-25 12:25:14,186][2409074] Updated weights for policy 0, policy_version 2240 (0.0012)
[2023-02-25 12:25:15,923][2409074] Updated weights for policy 0, policy_version 2250 (0.0012)
[2023-02-25 12:25:17,186][2408954] Fps is (10 sec: 26215.3, 60 sec: 25873.1, 300 sec: 25784.0). Total num frames: 9248768. Throughput: 0: 6482.1. Samples: 2318688. Policy #0 lag: (min: 0.0, avg: 11.4, max: 24.0)
[2023-02-25 12:25:17,186][2408954] Avg episode reward: [(0, '-5.911')]
[2023-02-25 12:25:17,569][2409074] Updated weights for policy 0, policy_version 2260 (0.0013)
[2023-02-25 12:25:19,121][2409074] Updated weights for policy 0, policy_version 2270 (0.0013)
[2023-02-25 12:25:20,691][2409074] Updated weights for policy 0, policy_version 2280 (0.0012)
[2023-02-25 12:25:22,186][2408954] Fps is (10 sec: 24575.9, 60 sec: 25804.7, 300 sec: 25756.2). Total num frames: 9367552. Throughput: 0: 6493.5. Samples: 2338524. Policy #0 lag: (min: 0.0, avg: 12.6, max: 26.0)
[2023-02-25 12:25:22,187][2408954] Avg episode reward: [(0, '-5.911')]
[2023-02-25 12:25:22,387][2409074] Updated weights for policy 0, policy_version 2290 (0.0012)
[2023-02-25 12:25:23,488][2409486] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)]
[2023-02-25 12:25:23,505][2409074] Updated weights for policy 0, policy_version 2300 (0.0012)
[2023-02-25 12:25:25,561][2409074] Updated weights for policy 0, policy_version 2310 (0.0012)
[2023-02-25 12:25:25,950][2409033] Signal inference workers to stop experience collection... (300 times)
[2023-02-25 12:25:25,951][2409033] Signal inference workers to resume experience collection... (300 times)
[2023-02-25 12:25:25,977][2409074] InferenceWorker_p0-w0: stopping experience collection (300 times)
[2023-02-25 12:25:25,978][2409074] InferenceWorker_p0-w0: resuming experience collection (300 times)
[2023-02-25 12:25:26,837][2409074] Updated weights for policy 0, policy_version 2320 (0.0013)
[2023-02-25 12:25:27,186][2408954] Fps is (10 sec: 26214.3, 60 sec: 26078.0, 300 sec: 25756.2). Total num frames: 9510912. Throughput: 0: 6514.1. Samples: 2377332. Policy #0 lag: (min: 0.0, avg: 13.1, max: 25.0)
[2023-02-25 12:25:27,186][2408954] Avg episode reward: [(0, '-5.911')]
[2023-02-25 12:25:28,191][2409074] Updated weights for policy 0, policy_version 2330 (0.0012)
[2023-02-25 12:25:30,096][2409074] Updated weights for policy 0, policy_version 2340 (0.0012)
[2023-02-25 12:25:31,531][2409074] Updated weights for policy 0, policy_version 2350 (0.0012)
[2023-02-25 12:25:32,186][2408954] Fps is (10 sec: 27443.5, 60 sec: 26077.8, 300 sec: 25770.1). Total num frames: 9641984. Throughput: 0: 6518.6. Samples: 2416668. Policy #0 lag: (min: 0.0, avg: 11.1, max: 24.0)
[2023-02-25 12:25:32,186][2408954] Avg episode reward: [(0, '-5.911')]
[2023-02-25 12:25:33,502][2409074] Updated weights for policy 0, policy_version 2360 (0.0012)
[2023-02-25 12:25:34,685][2409074] Updated weights for policy 0, policy_version 2370 (0.0012)
[2023-02-25 12:25:36,463][2409074] Updated weights for policy 0, policy_version 2380 (0.0012)
[2023-02-25 12:25:37,186][2408954] Fps is (10 sec: 24985.7, 60 sec: 25942.0, 300 sec: 25770.1). Total num frames: 9760768. Throughput: 0: 6514.4. Samples: 2436132. Policy #0 lag: (min: 0.0, avg: 11.7, max: 25.0)
[2023-02-25 12:25:37,186][2408954] Avg episode reward: [(0, '-5.911')]
[2023-02-25 12:25:37,833][2409074] Updated weights for policy 0, policy_version 2390 (0.0012)
[2023-02-25 12:25:39,282][2409074] Updated weights for policy 0, policy_version 2400 (0.0012)
[2023-02-25 12:25:41,149][2409074] Updated weights for policy 0, policy_version 2410 (0.0012)
[2023-02-25 12:25:42,186][2408954] Fps is (10 sec: 25395.6, 60 sec: 25941.3, 300 sec: 25784.0). Total num frames: 9895936. Throughput: 0: 6518.7. Samples: 2475204. Policy #0 lag: (min: 0.0, avg: 12.6, max: 26.0)
[2023-02-25 12:25:42,186][2408954] Avg episode reward: [(0, '-5.911')]
[2023-02-25 12:25:42,593][2409074] Updated weights for policy 0, policy_version 2420 (0.0012)
[2023-02-25 12:25:44,453][2409074] Updated weights for policy 0, policy_version 2430 (0.0014)
[2023-02-25 12:25:45,782][2409074] Updated weights for policy 0, policy_version 2440 (0.0012)
[2023-02-25 12:25:47,128][2409074] Updated weights for policy 0, policy_version 2450 (0.0013)
[2023-02-25 12:25:47,186][2408954] Fps is (10 sec: 27443.2, 60 sec: 26146.1, 300 sec: 25839.5). Total num frames: 10035200. Throughput: 0: 6500.5. Samples: 2513856. Policy #0 lag: (min: 0.0, avg: 12.6, max: 28.0)
[2023-02-25 12:25:47,186][2408954] Avg episode reward: [(0, '-5.911')]
[2023-02-25 12:25:48,871][2409074] Updated weights for policy 0, policy_version 2460 (0.0012)
[2023-02-25 12:25:50,607][2409074] Updated weights for policy 0, policy_version 2470 (0.0015)
[2023-02-25 12:25:52,186][2408954] Fps is (10 sec: 25395.2, 60 sec: 25873.1, 300 sec: 25784.0). Total num frames: 10149888. Throughput: 0: 6494.2. Samples: 2532984. Policy #0 lag: (min: 0.0, avg: 11.3, max: 26.0)
[2023-02-25 12:25:52,186][2408954] Avg episode reward: [(0, '-5.911')]
[2023-02-25 12:25:52,404][2409074] Updated weights for policy 0, policy_version 2480 (0.0013)
[2023-02-25 12:25:53,792][2409074] Updated weights for policy 0, policy_version 2490 (0.0012)
[2023-02-25 12:25:55,560][2409074] Updated weights for policy 0, policy_version 2500 (0.0012)
[2023-02-25 12:25:55,790][2409078] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 12:25:57,074][2409074] Updated weights for policy 0, policy_version 2510 (0.0013)
[2023-02-25 12:25:57,186][2408954] Fps is (10 sec: 24985.5, 60 sec: 26077.9, 300 sec: 25770.1). Total num frames: 10285056. Throughput: 0: 6466.4. Samples: 2571120. Policy #0 lag: (min: 0.0, avg: 13.3, max: 26.0)
[2023-02-25 12:25:57,186][2408954] Avg episode reward: [(0, '-5.911')]
[2023-02-25 12:25:58,713][2409074] Updated weights for policy 0, policy_version 2520 (0.0012)
[2023-02-25 12:25:59,072][2409103] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:25:59,075][2409103] Sum rewards: -1.555, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.358', 'AMMO2': '0.019', 'HITCOUNT': '0.020', 'ARMOR': '0.084', 'DAMAGECOUNT': '0.090', 'AMMO4': '0.092', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'weapon4': '0.330', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.044', 'weapon2': '1.378'}
[2023-02-25 12:26:00,524][2409102] DAMAGECOUNT value on done: 225.0
[2023-02-25 12:26:00,525][2409102] Sum rewards: -1.524, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.400', 'AMMO5': '0.003', 'AMMO2': '0.003', 'ARMOR': '0.008', 'AMMO4': '0.013', 'WEAPON5': '0.050', 'AMMO3': '0.091', 'weapon4': '0.108', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.453', 'WEAPON3': '0.550', 'weapon3': '1.068', 'weapon2': '1.740', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:00,666][2409074] Updated weights for policy 0, policy_version 2530 (0.0012)
[2023-02-25 12:26:01,697][2409549] DAMAGECOUNT value on done: 69.0
[2023-02-25 12:26:02,186][2408954] Fps is (10 sec: 24985.4, 60 sec: 25668.2, 300 sec: 25742.3). Total num frames: 10399744. Throughput: 0: 6417.3. Samples: 2607468. Policy #0 lag: (min: 0.0, avg: 13.6, max: 25.0)
[2023-02-25 12:26:02,186][2408954] Avg episode reward: [(0, '-5.813')]
[2023-02-25 12:26:02,234][2409074] Updated weights for policy 0, policy_version 2540 (0.0012)
[2023-02-25 12:26:02,591][2409485] DAMAGECOUNT value on done: 165.0
[2023-02-25 12:26:02,595][2409485] Sum rewards: -1.126, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.568', 'AMMO2': '0.003', 'AMMO4': '0.013', 'ARMOR': '0.020', 'AMMO3': '0.138', 'HITCOUNT': '0.140', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.750', 'weapon2': '1.192', 'weapon3': '1.456', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:02,656][2409103] DAMAGECOUNT value on done: 165.0
[2023-02-25 12:26:02,658][2409103] Sum rewards: -2.269, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.315', 'AMMO2': '0.007', 'ARMOR': '0.008', 'AMMO4': '0.037', 'HITCOUNT': '0.080', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.148', 'weapon3': '1.436'}
[2023-02-25 12:26:02,802][2409100] DAMAGECOUNT value on done: 190.0
[2023-02-25 12:26:02,956][2409101] DAMAGECOUNT value on done: 119.0
[2023-02-25 12:26:03,155][2409565] DAMAGECOUNT value on done: 168.0
[2023-02-25 12:26:03,156][2409565] Sum rewards: -4.681, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.468', 'AMMO2': '0.018', 'weapon4': '0.072', 'ARMOR': '0.076', 'AMMO4': '0.090', 'AMMO3': '0.109', 'HITCOUNT': '0.120', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.429', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.068', 'weapon2': '1.804'}
[2023-02-25 12:26:03,475][2409407] DAMAGECOUNT value on done: 94.0
[2023-02-25 12:26:04,140][2409074] Updated weights for policy 0, policy_version 2550 (0.0013)
[2023-02-25 12:26:04,298][2409102] DAMAGECOUNT value on done: 105.0
[2023-02-25 12:26:04,302][2409102] Sum rewards: -6.777, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.540', 'AMMO2': '0.022', 'ARMOR': '0.036', 'HITCOUNT': '0.060', 'AMMO4': '0.110', 'AMMO3': '0.194', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'DAMAGECOUNT': '0.315', 'weapon4': '0.354', 'WEAPON4': '0.400', 'WEAPON3': '0.950', 'weapon3': '1.072', 'weapon2': '1.150', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:05,018][2409596] DAMAGECOUNT value on done: 23.0
[2023-02-25 12:26:05,530][2409549] DAMAGECOUNT value on done: 60.0
[2023-02-25 12:26:05,533][2409549] Sum rewards: -8.745, reward structure: {'DEATHCOUNT': '-10.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.960', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'HITCOUNT': '0.050', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.142', 'DAMAGECOUNT': '0.165', 'WEAPON3': '0.650', 'weapon3': '0.998', 'weapon2': '2.048'}
[2023-02-25 12:26:05,563][2409104] DAMAGECOUNT value on done: 187.0
[2023-02-25 12:26:05,564][2409104] Sum rewards: -4.532, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.820', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.013', 'weapon5': '0.022', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.130', 'AMMO3': '0.133', 'HITCOUNT': '0.140', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.531', 'WEAPON3': '0.700', 'weapon2': '1.084', 'weapon3': '1.430'}
[2023-02-25 12:26:05,587][2409597] DAMAGECOUNT value on done: 70.0
[2023-02-25 12:26:05,588][2409597] Sum rewards: -2.274, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.368', 'AMMO2': '0.008', 'AMMO4': '0.042', 'HITCOUNT': '0.060', 'AMMO3': '0.114', 'DAMAGECOUNT': '0.210', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.218', 'weapon3': '1.542'}
[2023-02-25 12:26:05,618][2409074] Updated weights for policy 0, policy_version 2560 (0.0012)
[2023-02-25 12:26:06,196][2409485] DAMAGECOUNT value on done: 257.0
[2023-02-25 12:26:06,200][2409485] Sum rewards: -1.272, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.558', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO3': '0.063', 'AMMO4': '0.088', 'weapon4': '0.100', 'HITCOUNT': '0.180', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'ARMOR': '0.493', 'DAMAGECOUNT': '0.696', 'weapon3': '1.072', 'weapon2': '1.616', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:06,239][2409103] DAMAGECOUNT value on done: 185.0
[2023-02-25 12:26:06,240][2409103] Sum rewards: -3.656, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.686', 'AMMO2': '0.013', 'AMMO4': '0.062', 'ARMOR': '0.075', 'AMMO3': '0.096', 'HITCOUNT': '0.110', 'weapon4': '0.190', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.070', 'weapon2': '1.554'}
[2023-02-25 12:26:06,633][2409101] DAMAGECOUNT value on done: 80.0
[2023-02-25 12:26:06,649][2409074] Updated weights for policy 0, policy_version 2570 (0.0013)
[2023-02-25 12:26:06,831][2409565] DAMAGECOUNT value on done: 195.0
[2023-02-25 12:26:06,832][2409565] Sum rewards: -4.968, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.539', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon4': '0.078', 'HITCOUNT': '0.110', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'ARMOR': '0.440', 'DAMAGECOUNT': '0.525', 'weapon3': '0.582', 'WEAPON3': '0.700', 'FRAGCOUNT': '2.000', 'weapon2': '2.294'}
[2023-02-25 12:26:06,834][2409100] DAMAGECOUNT value on done: 135.0
[2023-02-25 12:26:06,927][2409405] DAMAGECOUNT value on done: 156.0
[2023-02-25 12:26:07,120][2409105] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:26:07,186][2408954] Fps is (10 sec: 24575.7, 60 sec: 25736.6, 300 sec: 25742.3). Total num frames: 10530816. Throughput: 0: 6391.2. Samples: 2626128. Policy #0 lag: (min: 1.0, avg: 15.6, max: 33.0)
[2023-02-25 12:26:07,186][2408954] Avg episode reward: [(0, '-5.665')]
[2023-02-25 12:26:07,438][2409407] DAMAGECOUNT value on done: 40.0
[2023-02-25 12:26:07,475][2409548] DAMAGECOUNT value on done: 75.0
[2023-02-25 12:26:07,479][2409548] Sum rewards: -5.541, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.180', 'AMMO2': '0.022', 'ARMOR': '0.028', 'HITCOUNT': '0.080', 'AMMO4': '0.109', 'weapon4': '0.148', 'AMMO3': '0.174', 'DAMAGECOUNT': '0.180', 'WEAPON4': '0.300', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.124', 'weapon2': '1.674'}
[2023-02-25 12:26:07,881][2409102] DAMAGECOUNT value on done: 61.0
[2023-02-25 12:26:08,571][2409074] Updated weights for policy 0, policy_version 2580 (0.0013)
[2023-02-25 12:26:08,692][2409079] DAMAGECOUNT value on done: 60.0
[2023-02-25 12:26:08,750][2409406] DAMAGECOUNT value on done: 95.0
[2023-02-25 12:26:08,835][2409373] DAMAGECOUNT value on done: 50.0
[2023-02-25 12:26:08,844][2409596] DAMAGECOUNT value on done: 245.0
[2023-02-25 12:26:08,845][2409469] DAMAGECOUNT value on done: 40.0
[2023-02-25 12:26:08,911][2409078] DAMAGECOUNT value on done: 167.0
[2023-02-25 12:26:08,911][2409078] Sum rewards: -3.421, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.318', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.017', 'weapon4': '0.038', 'WEAPON4': '0.050', 'HITCOUNT': '0.060', 'AMMO3': '0.169', 'DAMAGECOUNT': '0.336', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.340', 'weapon3': '1.524'}
[2023-02-25 12:26:09,261][2409549] DAMAGECOUNT value on done: 124.0
[2023-02-25 12:26:09,261][2409549] Sum rewards: -3.577, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.608', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'weapon5': '0.026', 'AMMO2': '0.030', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'HITCOUNT': '0.130', 'AMMO4': '0.152', 'weapon4': '0.162', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.372', 'WEAPON3': '0.450', 'weapon2': '1.248', 'weapon3': '1.292'}
[2023-02-25 12:26:09,424][2409104] DAMAGECOUNT value on done: 147.0
[2023-02-25 12:26:09,425][2409104] Sum rewards: -7.217, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.267', 'AMMO2': '0.012', 'ARMOR': '0.032', 'AMMO4': '0.057', 'HITCOUNT': '0.090', 'weapon4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.180', 'DAMAGECOUNT': '0.381', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon3': '1.178', 'weapon2': '1.428'}
[2023-02-25 12:26:09,439][2409597] DAMAGECOUNT value on done: 140.0
[2023-02-25 12:26:09,652][2409077] DAMAGECOUNT value on done: 169.0
[2023-02-25 12:26:09,653][2409077] Sum rewards: -0.597, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.990', 'AMMO4': '-0.048', 'AMMO2': '-0.009', 'WEAPON1': '0.020', 'ARMOR': '0.046', 'HITCOUNT': '0.080', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'weapon4': '0.220', 'DAMAGECOUNT': '0.387', 'WEAPON3': '0.400', 'weapon3': '0.916', 'FRAGCOUNT': '1.000', 'weapon2': '1.700'}
[2023-02-25 12:26:10,052][2409074] Updated weights for policy 0, policy_version 2590 (0.0014)
[2023-02-25 12:26:10,298][2409103] DAMAGECOUNT value on done: 136.0
[2023-02-25 12:26:10,299][2409485] DAMAGECOUNT value on done: 35.0
[2023-02-25 12:26:10,300][2409103] Sum rewards: -2.716, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.420', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'HITCOUNT': '0.060', 'AMMO3': '0.135', 'DAMAGECOUNT': '0.330', 'ARMOR': '0.484', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.254', 'weapon2': '1.650'}
[2023-02-25 12:26:10,403][2409101] DAMAGECOUNT value on done: 232.0
[2023-02-25 12:26:10,413][2409565] DAMAGECOUNT value on done: 74.0
[2023-02-25 12:26:10,414][2409565] Sum rewards: -4.211, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.892', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'HITCOUNT': '0.050', 'DAMAGECOUNT': '0.132', 'AMMO3': '0.169', 'ARMOR': '0.440', 'WEAPON3': '0.850', 'weapon3': '1.166', 'weapon2': '1.902', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:10,535][2409405] DAMAGECOUNT value on done: 190.0
[2023-02-25 12:26:10,536][2409405] Sum rewards: -4.257, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.880', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon4': '0.046', 'WEAPON4': '0.050', 'HITCOUNT': '0.110', 'AMMO3': '0.130', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.248', 'weapon2': '1.452'}
[2023-02-25 12:26:10,548][2409076] DAMAGECOUNT value on done: 180.0
[2023-02-25 12:26:10,549][2409076] Sum rewards: -4.772, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.094', 'ARMOR': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.042', 'HITCOUNT': '0.060', 'AMMO3': '0.120', 'weapon4': '0.130', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.208', 'weapon2': '1.654'}
[2023-02-25 12:26:10,622][2409100] DAMAGECOUNT value on done: 153.0
[2023-02-25 12:26:10,625][2409100] Sum rewards: -9.228, reward structure: {'DEATHCOUNT': '-12.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.026', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.026', 'AMMO4': '0.059', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'weapon4': '0.122', 'AMMO3': '0.138', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.384', 'WEAPON3': '0.600', 'weapon3': '0.640', 'ARMOR': '0.840', 'weapon2': '2.082'}
[2023-02-25 12:26:10,691][2409389] DAMAGECOUNT value on done: 395.0
[2023-02-25 12:26:10,691][2409389] Sum rewards: -6.100, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.040', 'AMMO2': '0.007', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'weapon4': '0.072', 'HITCOUNT': '0.110', 'AMMO3': '0.180', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon3': '1.228', 'weapon2': '1.476'}
[2023-02-25 12:26:10,877][2409096] DAMAGECOUNT value on done: 55.0
[2023-02-25 12:26:11,069][2409548] DAMAGECOUNT value on done: 250.0
[2023-02-25 12:26:11,109][2409407] DAMAGECOUNT value on done: 1030.0
[2023-02-25 12:26:11,110][2409407] Sum rewards: -6.188, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.180', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.032', 'weapon7': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.154', 'weapon4': '0.206', 'WEAPON4': '0.250', 'ARMOR': '0.490', 'WEAPON3': '0.700', 'weapon3': '0.816', 'DAMAGECOUNT': '1.035', 'weapon2': '1.724', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:11,391][2409102] DAMAGECOUNT value on done: 125.0
[2023-02-25 12:26:11,411][2409105] DAMAGECOUNT value on done: 154.0
[2023-02-25 12:26:11,414][2409105] Sum rewards: -5.713, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.745', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.019', 'ARMOR': '0.040', 'AMMO4': '0.095', 'AMMO3': '0.118', 'HITCOUNT': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.238', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.098', 'weapon2': '1.394'}
[2023-02-25 12:26:11,917][2409074] Updated weights for policy 0, policy_version 2600 (0.0012)
[2023-02-25 12:26:12,186][2408954] Fps is (10 sec: 24985.7, 60 sec: 25463.5, 300 sec: 25686.8). Total num frames: 10649600. Throughput: 0: 6396.0. Samples: 2665152. Policy #0 lag: (min: 2.0, avg: 13.5, max: 27.0)
[2023-02-25 12:26:12,186][2408954] Avg episode reward: [(0, '-5.307')]
[2023-02-25 12:26:12,285][2409406] DAMAGECOUNT value on done: 195.0
[2023-02-25 12:26:12,300][2409079] DAMAGECOUNT value on done: 262.0
[2023-02-25 12:26:12,301][2409079] Sum rewards: -5.854, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.702', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.030', 'ARMOR': '0.060', 'WEAPON5': '0.100', 'weapon4': '0.102', 'HITCOUNT': '0.120', 'AMMO3': '0.137', 'AMMO4': '0.151', 'WEAPON4': '0.350', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.600', 'weapon3': '0.818', 'FRAGCOUNT': '1.000', 'weapon2': '1.736'}
[2023-02-25 12:26:12,321][2409097] DAMAGECOUNT value on done: 107.0
[2023-02-25 12:26:12,443][2409373] DAMAGECOUNT value on done: 184.0
[2023-02-25 12:26:12,584][2409596] DAMAGECOUNT value on done: 130.0
[2023-02-25 12:26:12,601][2409469] DAMAGECOUNT value on done: 105.0
[2023-02-25 12:26:12,716][2409078] DAMAGECOUNT value on done: 210.0
[2023-02-25 12:26:12,720][2409078] Sum rewards: -4.413, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.010', 'AMMO5': '0.008', 'AMMO2': '0.008', 'weapon5': '0.020', 'ARMOR': '0.036', 'AMMO4': '0.037', 'WEAPON5': '0.050', 'HITCOUNT': '0.080', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.270', 'weapon4': '0.272', 'WEAPON3': '0.700', 'weapon3': '0.760', 'FRAGCOUNT': '1.000', 'weapon2': '1.566'}
[2023-02-25 12:26:13,148][2409549] DAMAGECOUNT value on done: 135.0
[2023-02-25 12:26:13,161][2409077] DAMAGECOUNT value on done: 247.0
[2023-02-25 12:26:13,183][2409104] DAMAGECOUNT value on done: 65.0
[2023-02-25 12:26:13,284][2409074] Updated weights for policy 0, policy_version 2610 (0.0013)
[2023-02-25 12:26:13,505][2409075] DAMAGECOUNT value on done: 150.0
[2023-02-25 12:26:13,570][2409597] DAMAGECOUNT value on done: 295.0
[2023-02-25 12:26:13,573][2409597] Sum rewards: -3.889, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.745', 'AMMO2': '0.015', 'ARMOR': '0.040', 'weapon4': '0.054', 'AMMO4': '0.073', 'HITCOUNT': '0.110', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.224', 'weapon3': '1.532'}
[2023-02-25 12:26:13,960][2409565] DAMAGECOUNT value on done: 30.0
[2023-02-25 12:26:13,964][2409103] DAMAGECOUNT value on done: 112.0
[2023-02-25 12:26:13,991][2409485] DAMAGECOUNT value on done: 49.0
[2023-02-25 12:26:14,071][2409076] DAMAGECOUNT value on done: 170.0
[2023-02-25 12:26:14,125][2409100] DAMAGECOUNT value on done: 315.0
[2023-02-25 12:26:14,126][2409100] Sum rewards: -0.443, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.074', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'weapon4': '0.070', 'AMMO3': '0.091', 'HITCOUNT': '0.160', 'WEAPON5': '0.200', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.615', 'weapon3': '1.372', 'weapon2': '1.392', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:14,206][2409101] DAMAGECOUNT value on done: 110.0
[2023-02-25 12:26:14,381][2409405] DAMAGECOUNT value on done: 160.0
[2023-02-25 12:26:14,382][2409405] Sum rewards: -7.011, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.065', 'AMMO2': '0.006', 'AMMO4': '0.031', 'HITCOUNT': '0.090', 'ARMOR': '0.092', 'WEAPON4': '0.100', 'weapon4': '0.100', 'AMMO3': '0.177', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.178', 'weapon2': '1.490'}
[2023-02-25 12:26:14,471][2409096] DAMAGECOUNT value on done: 130.0
[2023-02-25 12:26:14,602][2409548] DAMAGECOUNT value on done: 70.0
[2023-02-25 12:26:14,620][2409389] DAMAGECOUNT value on done: 80.0
[2023-02-25 12:26:14,656][2409407] DAMAGECOUNT value on done: 54.0
[2023-02-25 12:26:14,914][2409102] DAMAGECOUNT value on done: 106.0
[2023-02-25 12:26:14,992][2409866] DAMAGECOUNT value on done: 110.0
[2023-02-25 12:26:15,023][2409355] DAMAGECOUNT value on done: 65.0
[2023-02-25 12:26:15,023][2409355] Sum rewards: -5.056, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.130', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.014', 'HITCOUNT': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.081', 'DAMAGECOUNT': '0.135', 'weapon4': '0.152', 'WEAPON3': '0.400', 'weapon3': '0.686', 'weapon2': '1.896'}
[2023-02-25 12:26:15,128][2409074] Updated weights for policy 0, policy_version 2620 (0.0012)
[2023-02-25 12:26:15,135][2409105] DAMAGECOUNT value on done: 214.0
[2023-02-25 12:26:15,138][2409105] Sum rewards: -2.707, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.019', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.103', 'HITCOUNT': '0.110', 'weapon4': '0.140', 'DAMAGECOUNT': '0.390', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'weapon3': '0.972', 'FRAGCOUNT': '1.000', 'weapon2': '1.770'}
[2023-02-25 12:26:15,912][2409079] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:26:15,974][2409373] DAMAGECOUNT value on done: 40.0
[2023-02-25 12:26:16,349][2409078] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:26:16,451][2409406] DAMAGECOUNT value on done: 163.0
[2023-02-25 12:26:16,452][2409406] Sum rewards: 0.813, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.046', 'AMMO5': '0.003', 'AMMO2': '0.012', 'ARMOR': '0.037', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.080', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.138', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.429', 'weapon3': '0.774', 'weapon2': '1.896', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:16,458][2409469] DAMAGECOUNT value on done: 134.0
[2023-02-25 12:26:16,459][2409469] Sum rewards: -3.976, reward structure: {'DEATHCOUNT': '-5.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.280', 'AMMO4': '-0.084', 'AMMO2': '-0.017', 'AMMO5': '0.008', 'weapon5': '0.014', 'HITCOUNT': '0.080', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.222', 'WEAPON3': '0.350', 'ARMOR': '0.466', 'weapon3': '1.146', 'weapon2': '1.682'}
[2023-02-25 12:26:16,474][2409097] DAMAGECOUNT value on done: 52.0
[2023-02-25 12:26:16,476][2409097] Sum rewards: -4.285, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.210', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'HITCOUNT': '0.060', 'AMMO4': '0.105', 'AMMO3': '0.132', 'DAMAGECOUNT': '0.144', 'WEAPON4': '0.200', 'weapon4': '0.222', 'WEAPON3': '0.550', 'weapon3': '0.930', 'FRAGCOUNT': '1.000', 'weapon2': '1.758'}
[2023-02-25 12:26:16,615][2409074] Updated weights for policy 0, policy_version 2630 (0.0012)
[2023-02-25 12:26:16,616][2409596] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:26:16,994][2409486] DAMAGECOUNT value on done: 210.0
[2023-02-25 12:26:17,054][2409075] DAMAGECOUNT value on done: 189.0
[2023-02-25 12:26:17,055][2409075] Sum rewards: -6.816, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.530', 'AMMO2': '0.002', 'AMMO4': '0.009', 'ARMOR': '0.028', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'weapon4': '0.138', 'AMMO3': '0.191', 'DAMAGECOUNT': '0.402', 'weapon3': '1.002', 'WEAPON3': '1.050', 'weapon2': '1.932', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:17,186][2408954] Fps is (10 sec: 25805.1, 60 sec: 25668.2, 300 sec: 25742.3). Total num frames: 10788864. Throughput: 0: 6383.2. Samples: 2703912. Policy #0 lag: (min: 0.0, avg: 10.9, max: 29.0)
[2023-02-25 12:26:17,186][2408954] Avg episode reward: [(0, '-4.930')]
[2023-02-25 12:26:17,191][2409033] Saving /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000002634_10788864.pth...
[2023-02-25 12:26:17,264][2409549] DAMAGECOUNT value on done: 170.0
[2023-02-25 12:26:17,273][2409104] DAMAGECOUNT value on done: 150.0
[2023-02-25 12:26:17,285][2409033] Removing /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000001121_4591616.pth
[2023-02-25 12:26:17,328][2409077] DAMAGECOUNT value on done: 42.0
[2023-02-25 12:26:17,434][2409565] DAMAGECOUNT value on done: 64.0
[2023-02-25 12:26:17,459][2409103] DAMAGECOUNT value on done: 120.0
[2023-02-25 12:26:17,461][2409103] Sum rewards: -7.326, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.454', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.024', 'weapon4': '0.036', 'ARMOR': '0.044', 'AMMO4': '0.044', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.155', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.116', 'weapon2': '1.740'}
[2023-02-25 12:26:17,509][2409485] DAMAGECOUNT value on done: 55.0
[2023-02-25 12:26:17,512][2409485] Sum rewards: -7.837, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.594', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.003', 'AMMO2': '0.005', 'HITCOUNT': '0.020', 'AMMO4': '0.027', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'DAMAGECOUNT': '0.075', 'weapon4': '0.128', 'AMMO3': '0.179', 'WEAPON3': '0.800', 'weapon3': '0.918', 'weapon2': '1.958'}
[2023-02-25 12:26:17,524][2409597] DAMAGECOUNT value on done: 53.0
[2023-02-25 12:26:17,607][2409076] DAMAGECOUNT value on done: 145.0
[2023-02-25 12:26:17,820][2409074] Updated weights for policy 0, policy_version 2640 (0.0013)
[2023-02-25 12:26:17,869][2409405] DAMAGECOUNT value on done: 55.0
[2023-02-25 12:26:17,870][2409405] Sum rewards: -7.988, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-3.000', 'HEALTH': '-0.770', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.007', 'ARMOR': '0.024', 'weapon5': '0.024', 'HITCOUNT': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.165', 'weapon4': '0.272', 'WEAPON3': '0.650', 'weapon3': '0.906', 'weapon2': '1.564'}
[2023-02-25 12:26:18,153][2409100] DAMAGECOUNT value on done: 165.0
[2023-02-25 12:26:18,154][2409100] Sum rewards: -8.487, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.310', 'FRAGCOUNT': '-1.500', 'AMMO2': '0.001', 'AMMO4': '0.006', 'weapon5': '0.012', 'AMMO5': '0.013', 'HITCOUNT': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'DAMAGECOUNT': '0.315', 'ARMOR': '0.500', 'WEAPON3': '0.850', 'weapon3': '0.942', 'weapon2': '1.972'}
[2023-02-25 12:26:18,284][2409407] DAMAGECOUNT value on done: 130.0
[2023-02-25 12:26:18,288][2409407] Sum rewards: -6.485, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.970', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'ARMOR': '0.016', 'weapon4': '0.028', 'WEAPON4': '0.050', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.169', 'DAMAGECOUNT': '0.285', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.210', 'weapon2': '1.638'}
[2023-02-25 12:26:18,316][2409096] DAMAGECOUNT value on done: 101.0
[2023-02-25 12:26:18,317][2409096] Sum rewards: -1.017, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.541', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.008', 'HITCOUNT': '0.030', 'AMMO4': '0.038', 'AMMO3': '0.043', 'weapon4': '0.066', 'WEAPON5': '0.100', 'weapon7': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'DAMAGECOUNT': '0.258', 'weapon3': '0.604', 'ARMOR': '0.880', 'FRAGCOUNT': '1.000', 'weapon2': '1.536'}
[2023-02-25 12:26:18,351][2409389] DAMAGECOUNT value on done: 175.0
[2023-02-25 12:26:18,354][2409389] Sum rewards: -2.424, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.178', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.027', 'ARMOR': '0.076', 'AMMO3': '0.081', 'WEAPON5': '0.100', 'HITCOUNT': '0.120', 'AMMO4': '0.132', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.285', 'weapon4': '0.350', 'WEAPON3': '0.400', 'weapon3': '0.748', 'weapon2': '1.724'}
[2023-02-25 12:26:18,370][2409101] DAMAGECOUNT value on done: 303.0
[2023-02-25 12:26:18,371][2409101] Sum rewards: -2.160, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.014', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon4': '0.058', 'ARMOR': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'HITCOUNT': '0.210', 'DAMAGECOUNT': '0.759', 'WEAPON3': '0.800', 'weapon3': '1.362', 'weapon2': '1.542', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:18,405][2409102] DAMAGECOUNT value on done: 70.0
[2023-02-25 12:26:18,696][2409866] DAMAGECOUNT value on done: 70.0
[2023-02-25 12:26:18,707][2409548] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:26:18,723][2409355] DAMAGECOUNT value on done: 220.0
[2023-02-25 12:26:18,724][2409355] Sum rewards: -2.715, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.599', 'AMMO5': '0.005', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'AMMO4': '0.034', 'weapon5': '0.040', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'HITCOUNT': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.278', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.510', 'weapon3': '0.870', 'FRAGCOUNT': '1.000', 'weapon2': '1.746'}
[2023-02-25 12:26:19,551][2409547] DAMAGECOUNT value on done: 98.0
[2023-02-25 12:26:19,561][2409105] DAMAGECOUNT value on done: 212.0
[2023-02-25 12:26:19,689][2409079] DAMAGECOUNT value on done: 102.0
[2023-02-25 12:26:19,694][2409079] Sum rewards: -3.592, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.450', 'AMMO2': '0.021', 'ARMOR': '0.036', 'HITCOUNT': '0.080', 'AMMO4': '0.105', 'AMMO3': '0.127', 'weapon4': '0.176', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.276', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.260', 'weapon2': '1.326'}
[2023-02-25 12:26:19,853][2409373] DAMAGECOUNT value on done: 182.0
[2023-02-25 12:26:19,977][2409406] DAMAGECOUNT value on done: 259.0
[2023-02-25 12:26:19,994][2409074] Updated weights for policy 0, policy_version 2650 (0.0012)
[2023-02-25 12:26:20,036][2409097] DAMAGECOUNT value on done: 85.0
[2023-02-25 12:26:20,169][2409078] DAMAGECOUNT value on done: 105.0
[2023-02-25 12:26:20,169][2409078] Sum rewards: -6.147, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.504', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'HITCOUNT': '0.020', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.074', 'DAMAGECOUNT': '0.090', 'AMMO3': '0.164', 'WEAPON3': '0.800', 'weapon3': '0.902', 'FRAGCOUNT': '1.000', 'weapon2': '1.980'}
[2023-02-25 12:26:20,310][2409596] DAMAGECOUNT value on done: 190.0
[2023-02-25 12:26:20,687][2409486] DAMAGECOUNT value on done: 208.0
[2023-02-25 12:26:20,687][2409469] DAMAGECOUNT value on done: 650.0
[2023-02-25 12:26:20,688][2409486] Sum rewards: -4.388, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.282', 'AMMO2': '0.018', 'ARMOR': '0.049', 'AMMO4': '0.092', 'AMMO3': '0.108', 'HITCOUNT': '0.180', 'weapon4': '0.216', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.573', 'WEAPON3': '0.650', 'weapon3': '1.278', 'weapon2': '1.430', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:20,688][2409469] Sum rewards: -4.829, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.846', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.100', 'AMMO3': '0.166', 'weapon4': '0.188', 'WEAPON4': '0.200', 'HITCOUNT': '0.330', 'WEAPON3': '0.850', 'weapon3': '1.222', 'DAMAGECOUNT': '1.440', 'weapon2': '1.440', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:26:20,757][2409075] DAMAGECOUNT value on done: 67.0
[2023-02-25 12:26:20,810][2409077] DAMAGECOUNT value on done: 76.0
[2023-02-25 12:26:20,811][2409077] Sum rewards: -5.061, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-2.225', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.005', 'weapon5': '0.008', 'HITCOUNT': '0.030', 'AMMO2': '0.030', 'ARMOR': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'DAMAGECOUNT': '0.123', 'AMMO4': '0.151', 'weapon4': '0.206', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'weapon3': '0.684', 'weapon2': '1.610'}
[2023-02-25 12:26:20,958][2409565] DAMAGECOUNT value on done: 148.0
[2023-02-25 12:26:20,958][2409565] Sum rewards: -3.781, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.552', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'HITCOUNT': '0.040', 'ARMOR': '0.048', 'AMMO4': '0.082', 'AMMO3': '0.109', 'DAMAGECOUNT': '0.114', 'weapon4': '0.142', 'WEAPON4': '0.200', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.110', 'weapon2': '1.540'}
[2023-02-25 12:26:20,964][2409104] DAMAGECOUNT value on done: 178.0
[2023-02-25 12:26:20,967][2409104] Sum rewards: -0.866, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.002', 'AMMO4': '-0.056', 'AMMO2': '-0.011', 'AMMO5': '0.005', 'ARMOR': '0.036', 'weapon5': '0.048', 'HITCOUNT': '0.060', 'AMMO3': '0.061', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.195', 'WEAPON3': '0.400', 'FRAGCOUNT': '1.000', 'weapon3': '1.090', 'weapon2': '1.708'}
[2023-02-25 12:26:21,039][2409103] DAMAGECOUNT value on done: 158.0
[2023-02-25 12:26:21,040][2409103] Sum rewards: -5.179, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.656', 'AMMO2': '0.024', 'weapon4': '0.070', 'AMMO3': '0.112', 'HITCOUNT': '0.120', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.294', 'WEAPON3': '0.650', 'weapon3': '0.686', 'FRAGCOUNT': '1.000', 'weapon2': '2.250'}
[2023-02-25 12:26:21,116][2409485] DAMAGECOUNT value on done: 345.0
[2023-02-25 12:26:21,119][2409485] Sum rewards: -4.318, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.861', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'ARMOR': '0.056', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'AMMO3': '0.163', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.800', 'weapon2': '1.348', 'weapon3': '1.558', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:26:21,124][2409074] Updated weights for policy 0, policy_version 2660 (0.0013)
[2023-02-25 12:26:21,473][2409076] DAMAGECOUNT value on done: 140.0
[2023-02-25 12:26:21,474][2409076] Sum rewards: -9.179, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.340', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.031', 'ARMOR': '0.032', 'weapon5': '0.036', 'WEAPON5': '0.050', 'HITCOUNT': '0.060', 'AMMO3': '0.151', 'weapon4': '0.154', 'AMMO4': '0.155', 'DAMAGECOUNT': '0.315', 'WEAPON4': '0.400', 'WEAPON3': '0.850', 'weapon3': '0.996', 'weapon2': '1.678'}
[2023-02-25 12:26:21,561][2409549] DAMAGECOUNT value on done: 197.0
[2023-02-25 12:26:21,762][2409100] DAMAGECOUNT value on done: 72.0
[2023-02-25 12:26:21,765][2409100] Sum rewards: -5.790, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.664', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.034', 'HITCOUNT': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.134', 'weapon4': '0.150', 'DAMAGECOUNT': '0.156', 'WEAPON4': '0.250', 'ARMOR': '0.440', 'WEAPON3': '0.700', 'weapon3': '0.890', 'weapon2': '1.544'}
[2023-02-25 12:26:21,781][2409405] DAMAGECOUNT value on done: 85.0
[2023-02-25 12:26:21,808][2409389] DAMAGECOUNT value on done: 37.0
[2023-02-25 12:26:21,812][2409389] Sum rewards: 0.195, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.200', 'weapon5': '0.004', 'AMMO5': '0.005', 'HITCOUNT': '0.010', 'AMMO2': '0.012', 'DAMAGECOUNT': '0.045', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'weapon4': '0.058', 'AMMO3': '0.072', 'weapon7': '0.088', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon2': '1.020', 'weapon3': '1.484'}
[2023-02-25 12:26:21,961][2409099] DAMAGECOUNT value on done: 178.0
[2023-02-25 12:26:21,962][2409099] Sum rewards: -6.197, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.914', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.020', 'ARMOR': '0.030', 'weapon7': '0.058', 'AMMO4': '0.059', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.137', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.222', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.444', 'WEAPON3': '0.750', 'weapon3': '0.814', 'weapon2': '1.686', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:21,969][2409597] DAMAGECOUNT value on done: 160.0
[2023-02-25 12:26:21,970][2409597] Sum rewards: -9.674, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-3.000', 'HEALTH': '-2.210', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon5': '0.022', 'HITCOUNT': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'weapon4': '0.110', 'DAMAGECOUNT': '0.135', 'WEAPON5': '0.150', 'ARMOR': '0.431', 'weapon3': '0.506', 'WEAPON3': '0.600', 'weapon2': '2.342'}
[2023-02-25 12:26:21,974][2409102] DAMAGECOUNT value on done: 170.0
[2023-02-25 12:26:21,975][2409102] Sum rewards: -2.974, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.104', 'AMMO2': '0.012', 'AMMO4': '0.060', 'HITCOUNT': '0.070', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.180', 'weapon4': '0.326', 'ARMOR': '0.462', 'WEAPON3': '0.600', 'weapon3': '1.170', 'weapon2': '1.254', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:22,186][2408954] Fps is (10 sec: 26624.1, 60 sec: 25804.9, 300 sec: 25714.6). Total num frames: 10915840. Throughput: 0: 6383.2. Samples: 2723376. Policy #0 lag: (min: 0.0, avg: 11.0, max: 25.0)
[2023-02-25 12:26:22,186][2408954] Avg episode reward: [(0, '-4.940')]
[2023-02-25 12:26:22,436][2409407] DAMAGECOUNT value on done: 338.0
[2023-02-25 12:26:22,437][2409407] Sum rewards: -2.402, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.702', 'AMMO2': '0.013', 'ARMOR': '0.032', 'AMMO4': '0.063', 'AMMO3': '0.149', 'HITCOUNT': '0.210', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.819', 'FRAGCOUNT': '1.000', 'weapon2': '1.360', 'weapon3': '1.404'}
[2023-02-25 12:26:22,521][2409548] DAMAGECOUNT value on done: 228.0
[2023-02-25 12:26:22,580][2409866] DAMAGECOUNT value on done: 141.0
[2023-02-25 12:26:22,581][2409866] Sum rewards: -3.493, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.663', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.016', 'weapon5': '0.028', 'AMMO4': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.092', 'HITCOUNT': '0.120', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.408', 'ARMOR': '0.465', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.168', 'weapon2': '1.534'}
[2023-02-25 12:26:22,582][2409355] DAMAGECOUNT value on done: 120.0
[2023-02-25 12:26:22,602][2409101] DAMAGECOUNT value on done: 170.0
[2023-02-25 12:26:22,603][2409101] Sum rewards: -7.159, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.866', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon4': '0.064', 'ARMOR': '0.075', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.189', 'DAMAGECOUNT': '0.255', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon3': '1.262', 'weapon2': '1.602'}
[2023-02-25 12:26:22,627][2409096] DAMAGECOUNT value on done: 55.0
[2023-02-25 12:26:22,958][2409074] Updated weights for policy 0, policy_version 2670 (0.0013)
[2023-02-25 12:26:23,198][2409547] DAMAGECOUNT value on done: 215.0
[2023-02-25 12:26:23,488][2409033] Signal inference workers to stop experience collection... (350 times)
[2023-02-25 12:26:23,502][2409033] Signal inference workers to resume experience collection... (350 times)
[2023-02-25 12:26:23,526][2409074] InferenceWorker_p0-w0: stopping experience collection (350 times)
[2023-02-25 12:26:23,527][2409105] DAMAGECOUNT value on done: 110.0
[2023-02-25 12:26:23,530][2409074] InferenceWorker_p0-w0: resuming experience collection (350 times)
[2023-02-25 12:26:23,550][2409406] DAMAGECOUNT value on done: 281.0
[2023-02-25 12:26:23,638][2409097] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:26:23,787][2409373] DAMAGECOUNT value on done: 165.0
[2023-02-25 12:26:23,791][2409373] Sum rewards: -5.520, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.928', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.003', 'weapon4': '0.030', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'ARMOR': '0.064', 'HITCOUNT': '0.070', 'AMMO3': '0.142', 'DAMAGECOUNT': '0.225', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.258', 'weapon2': '1.514'}
[2023-02-25 12:26:23,826][2409078] DAMAGECOUNT value on done: 125.0
[2023-02-25 12:26:24,185][2409079] DAMAGECOUNT value on done: 139.0
[2023-02-25 12:26:24,188][2409079] Sum rewards: -4.670, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.193', 'AMMO2': '0.019', 'ARMOR': '0.044', 'AMMO4': '0.094', 'AMMO3': '0.109', 'HITCOUNT': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.292', 'DAMAGECOUNT': '0.333', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.080', 'weapon2': '1.572'}
[2023-02-25 12:26:24,279][2409469] DAMAGECOUNT value on done: 280.0
[2023-02-25 12:26:24,280][2409469] Sum rewards: 0.747, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.669', 'AMMO5': '0.003', 'weapon5': '0.026', 'AMMO2': '0.029', 'weapon4': '0.034', 'WEAPON5': '0.050', 'AMMO3': '0.120', 'AMMO4': '0.145', 'HITCOUNT': '0.190', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.432', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.705', 'weapon3': '1.074', 'weapon2': '1.408', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:26:24,376][2409077] DAMAGECOUNT value on done: 145.0
[2023-02-25 12:26:24,377][2409077] Sum rewards: -8.025, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.400', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'HITCOUNT': '0.030', 'AMMO4': '0.049', 'DAMAGECOUNT': '0.075', 'weapon4': '0.162', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'ARMOR': '0.526', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon3': '1.014', 'weapon2': '1.606'}
[2023-02-25 12:26:24,455][2409596] DAMAGECOUNT value on done: 189.0
[2023-02-25 12:26:24,456][2409596] Sum rewards: -3.846, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.178', 'AMMO2': '0.015', 'ARMOR': '0.016', 'AMMO4': '0.073', 'HITCOUNT': '0.130', 'AMMO3': '0.134', 'weapon4': '0.140', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.492', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.214', 'weapon3': '1.318'}
[2023-02-25 12:26:24,486][2409075] DAMAGECOUNT value on done: 165.0
[2023-02-25 12:26:24,487][2409075] Sum rewards: -3.673, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.757', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'HITCOUNT': '0.060', 'ARMOR': '0.064', 'AMMO4': '0.065', 'AMMO3': '0.128', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.345', 'weapon4': '0.396', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.058', 'weapon2': '1.350'}
[2023-02-25 12:26:24,629][2409074] Updated weights for policy 0, policy_version 2680 (0.0012)
[2023-02-25 12:26:24,653][2409565] DAMAGECOUNT value on done: 131.0
[2023-02-25 12:26:24,696][2409103] DAMAGECOUNT value on done: 23.0
[2023-02-25 12:26:24,769][2409486] DAMAGECOUNT value on done: 175.0
[2023-02-25 12:26:24,772][2409486] Sum rewards: -3.522, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.380', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.028', 'ARMOR': '0.048', 'WEAPON5': '0.050', 'HITCOUNT': '0.130', 'AMMO3': '0.132', 'AMMO4': '0.137', 'weapon4': '0.194', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.550', 'weapon3': '1.118', 'weapon2': '1.682', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:24,786][2409485] DAMAGECOUNT value on done: 269.0
[2023-02-25 12:26:24,789][2409485] Sum rewards: -6.085, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.486', 'ARMOR': '0.016', 'AMMO2': '0.023', 'AMMO3': '0.101', 'AMMO4': '0.113', 'HITCOUNT': '0.120', 'weapon4': '0.192', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.550', 'weapon3': '1.162', 'weapon2': '1.644', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:25,125][2409104] DAMAGECOUNT value on done: 286.0
[2023-02-25 12:26:25,140][2409104] Sum rewards: -6.467, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.680', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.015', 'ARMOR': '0.025', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.122', 'weapon4': '0.156', 'WEAPON4': '0.200', 'HITCOUNT': '0.200', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.708', 'weapon3': '1.200', 'weapon2': '1.500'}
[2023-02-25 12:26:25,280][2409549] DAMAGECOUNT value on done: 155.0
[2023-02-25 12:26:25,283][2409549] Sum rewards: -2.708, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.430', 'AMMO5': '0.003', 'AMMO2': '0.004', 'ARMOR': '0.008', 'AMMO4': '0.018', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'weapon4': '0.130', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.196', 'weapon2': '1.518'}
[2023-02-25 12:26:25,309][2409405] DAMAGECOUNT value on done: 105.0
[2023-02-25 12:26:25,415][2409100] DAMAGECOUNT value on done: 42.0
[2023-02-25 12:26:25,419][2409076] DAMAGECOUNT value on done: 43.0
[2023-02-25 12:26:25,422][2409076] Sum rewards: -6.777, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.900', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.016', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.069', 'AMMO4': '0.139', 'weapon4': '0.188', 'WEAPON4': '0.200', 'WEAPON3': '0.400', 'weapon3': '1.012', 'weapon2': '1.758'}
[2023-02-25 12:26:25,599][2409102] DAMAGECOUNT value on done: 130.0
[2023-02-25 12:26:25,912][2409597] DAMAGECOUNT value on done: 370.0
[2023-02-25 12:26:25,915][2409597] Sum rewards: -4.913, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.085', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.024', 'HITCOUNT': '0.050', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'weapon4': '0.254', 'DAMAGECOUNT': '0.285', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'weapon3': '0.716', 'FRAGCOUNT': '1.000', 'weapon2': '1.702'}
[2023-02-25 12:26:25,951][2409389] DAMAGECOUNT value on done: 257.0
[2023-02-25 12:26:25,952][2409389] Sum rewards: -7.646, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.774', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon5': '0.016', 'AMMO2': '0.037', 'ARMOR': '0.040', 'HITCOUNT': '0.130', 'weapon4': '0.132', 'AMMO3': '0.137', 'AMMO4': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.486', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.024', 'weapon2': '1.722'}
[2023-02-25 12:26:25,958][2409080] DAMAGECOUNT value on done: 105.0
[2023-02-25 12:26:25,959][2409080] Sum rewards: -3.391, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.562', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.034', 'HITCOUNT': '0.060', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.150', 'DAMAGECOUNT': '0.315', 'WEAPON3': '0.700', 'ARMOR': '0.955', 'FRAGCOUNT': '1.000', 'weapon3': '1.130', 'weapon2': '1.624'}
[2023-02-25 12:26:26,020][2409548] DAMAGECOUNT value on done: 183.0
[2023-02-25 12:26:26,021][2409548] Sum rewards: -7.517, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.634', 'AMMO2': '0.009', 'ARMOR': '0.016', 'AMMO4': '0.044', 'HITCOUNT': '0.070', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.204', 'weapon4': '0.268', 'weapon3': '0.494', 'WEAPON3': '0.550', 'FRAGCOUNT': '2.000', 'weapon2': '2.176'}
[2023-02-25 12:26:26,199][2409074] Updated weights for policy 0, policy_version 2690 (0.0013)
[2023-02-25 12:26:26,241][2409101] DAMAGECOUNT value on done: 180.0
[2023-02-25 12:26:26,368][2409096] DAMAGECOUNT value on done: 49.0
[2023-02-25 12:26:26,369][2409096] Sum rewards: -3.720, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.072', 'AMMO2': '0.005', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO4': '0.023', 'HITCOUNT': '0.030', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.102', 'weapon4': '0.102', 'WEAPON4': '0.150', 'WEAPON3': '0.500', 'weapon3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.786'}
[2023-02-25 12:26:26,435][2409355] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:26:26,455][2409866] DAMAGECOUNT value on done: 226.0
[2023-02-25 12:26:26,471][2409407] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:26:26,684][2409099] DAMAGECOUNT value on done: 90.0
[2023-02-25 12:26:27,106][2409547] DAMAGECOUNT value on done: 89.0
[2023-02-25 12:26:27,131][2409406] DAMAGECOUNT value on done: 80.0
[2023-02-25 12:26:27,132][2409406] Sum rewards: -7.490, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.565', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.028', 'ARMOR': '0.040', 'HITCOUNT': '0.050', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'DAMAGECOUNT': '0.165', 'weapon4': '0.172', 'WEAPON4': '0.200', 'WEAPON3': '0.500', 'weapon3': '0.534', 'weapon2': '2.520'}
[2023-02-25 12:26:27,186][2408954] Fps is (10 sec: 25395.2, 60 sec: 25531.7, 300 sec: 25742.3). Total num frames: 11042816. Throughput: 0: 6358.4. Samples: 2761332. Policy #0 lag: (min: 0.0, avg: 11.1, max: 25.0)
[2023-02-25 12:26:27,186][2408954] Avg episode reward: [(0, '-4.913')]
[2023-02-25 12:26:27,278][2409373] DAMAGECOUNT value on done: 155.0
[2023-02-25 12:26:27,340][2409105] DAMAGECOUNT value on done: 200.0
[2023-02-25 12:26:27,341][2409105] Sum rewards: -5.144, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.973', 'AMMO2': '0.013', 'ARMOR': '0.024', 'weapon4': '0.036', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'HITCOUNT': '0.130', 'AMMO3': '0.152', 'DAMAGECOUNT': '0.555', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.306', 'weapon2': '1.650'}
[2023-02-25 12:26:27,373][2409078] DAMAGECOUNT value on done: 85.0
[2023-02-25 12:26:27,454][2409097] DAMAGECOUNT value on done: 184.0
[2023-02-25 12:26:27,455][2409097] Sum rewards: -4.877, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.520', 'AMMO2': '0.007', 'AMMO4': '0.034', 'HITCOUNT': '0.090', 'weapon4': '0.104', 'AMMO3': '0.115', 'WEAPON4': '0.200', 'ARMOR': '0.462', 'DAMAGECOUNT': '0.465', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.058', 'weapon2': '1.658'}
[2023-02-25 12:26:27,809][2409079] DAMAGECOUNT value on done: 200.0
[2023-02-25 12:26:27,811][2409079] Sum rewards: -6.525, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.556', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.003', 'WEAPON1': '0.020', 'weapon5': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.052', 'ARMOR': '0.064', 'HITCOUNT': '0.140', 'AMMO3': '0.177', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.950', 'weapon3': '1.322', 'weapon2': '1.606'}
[2023-02-25 12:26:27,857][2409074] Updated weights for policy 0, policy_version 2700 (0.0012)
[2023-02-25 12:26:27,930][2409469] DAMAGECOUNT value on done: 195.0
[2023-02-25 12:26:27,931][2409469] Sum rewards: -2.811, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.654', 'AMMO2': '0.018', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.066', 'AMMO4': '0.091', 'HITCOUNT': '0.120', 'AMMO3': '0.138', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.170', 'weapon2': '1.590'}
[2023-02-25 12:26:27,963][2409077] DAMAGECOUNT value on done: 297.0
[2023-02-25 12:26:27,966][2409077] Sum rewards: -4.594, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.405', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'WEAPON4': '0.050', 'weapon4': '0.096', 'HITCOUNT': '0.120', 'AMMO3': '0.140', 'DAMAGECOUNT': '0.387', 'ARMOR': '0.547', 'WEAPON3': '0.650', 'weapon3': '0.932', 'weapon2': '1.648', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:28,186][2409103] DAMAGECOUNT value on done: 207.0
[2023-02-25 12:26:28,286][2409485] DAMAGECOUNT value on done: 48.0
[2023-02-25 12:26:28,329][2409565] DAMAGECOUNT value on done: 99.0
[2023-02-25 12:26:28,332][2409565] Sum rewards: -4.132, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.800', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'ARMOR': '0.028', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.116', 'weapon4': '0.158', 'DAMAGECOUNT': '0.297', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.190', 'weapon2': '1.536'}
[2023-02-25 12:26:28,451][2409596] DAMAGECOUNT value on done: 80.0
[2023-02-25 12:26:28,798][2409549] DAMAGECOUNT value on done: 212.0
[2023-02-25 12:26:28,801][2409549] Sum rewards: -0.078, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.416', 'AMMO2': '0.014', 'ARMOR': '0.067', 'AMMO4': '0.069', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'weapon4': '0.140', 'DAMAGECOUNT': '0.441', 'WEAPON3': '0.550', 'weapon3': '1.298', 'weapon2': '1.442', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:28,805][2409405] DAMAGECOUNT value on done: 169.0
[2023-02-25 12:26:28,924][2409075] DAMAGECOUNT value on done: 107.0
[2023-02-25 12:26:28,925][2409075] Sum rewards: -4.791, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.890', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.025', 'HITCOUNT': '0.070', 'ARMOR': '0.087', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'DAMAGECOUNT': '0.156', 'weapon4': '0.182', 'WEAPON4': '0.250', 'WEAPON3': '0.550', 'weapon3': '0.858', 'FRAGCOUNT': '1.000', 'weapon2': '1.584'}
[2023-02-25 12:26:28,961][2409100] DAMAGECOUNT value on done: 299.0
[2023-02-25 12:26:28,962][2409100] Sum rewards: -2.593, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.540', 'AMMO2': '0.004', 'AMMO4': '0.020', 'HITCOUNT': '0.060', 'AMMO3': '0.070', 'weapon7': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.290', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.327', 'weapon3': '0.370', 'ARMOR': '0.456', 'FRAGCOUNT': '1.000', 'weapon2': '2.090'}
[2023-02-25 12:26:29,140][2409076] DAMAGECOUNT value on done: 203.0
[2023-02-25 12:26:29,141][2409076] Sum rewards: -1.421, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.015', 'weapon5': '0.020', 'ARMOR': '0.045', 'WEAPON5': '0.050', 'AMMO3': '0.090', 'HITCOUNT': '0.130', 'HEALTH': '0.250', 'DAMAGECOUNT': '0.444', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon2': '1.294', 'weapon3': '1.482'}
[2023-02-25 12:26:29,148][2409104] DAMAGECOUNT value on done: 29.0
[2023-02-25 12:26:29,390][2409074] Updated weights for policy 0, policy_version 2710 (0.0012)
[2023-02-25 12:26:29,396][2409486] DAMAGECOUNT value on done: 50.0
[2023-02-25 12:26:29,411][2409102] DAMAGECOUNT value on done: 175.0
[2023-02-25 12:26:29,440][2409597] DAMAGECOUNT value on done: 265.0
[2023-02-25 12:26:29,441][2409597] Sum rewards: -9.106, reward structure: {'DEATHCOUNT': '-10.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.141', 'AMMO5': '0.003', 'weapon5': '0.006', 'HITCOUNT': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'DAMAGECOUNT': '0.030', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.107', 'AMMO4': '0.135', 'weapon4': '0.214', 'WEAPON4': '0.250', 'WEAPON3': '0.500', 'weapon3': '0.550', 'weapon2': '2.104'}
[2023-02-25 12:26:29,661][2409548] DAMAGECOUNT value on done: 84.0
[2023-02-25 12:26:29,657][2409468] DAMAGECOUNT value on done: 89.0
[2023-02-25 12:26:29,809][2409080] DAMAGECOUNT value on done: 230.0
[2023-02-25 12:26:29,977][2409101] DAMAGECOUNT value on done: 240.0
[2023-02-25 12:26:29,980][2409101] Sum rewards: -2.311, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.661', 'AMMO2': '0.011', 'AMMO4': '0.054', 'ARMOR': '0.056', 'HITCOUNT': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'weapon4': '0.272', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.206', 'weapon2': '1.260'}
[2023-02-25 12:26:30,255][2409389] DAMAGECOUNT value on done: 144.0
[2023-02-25 12:26:30,273][2409389] Sum rewards: -7.210, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.424', 'AMMO5': '0.003', 'AMMO2': '0.012', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.061', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.136', 'AMMO3': '0.137', 'DAMAGECOUNT': '0.237', 'weapon3': '0.672', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '2.104'}
[2023-02-25 12:26:30,306][2409407] DAMAGECOUNT value on done: 114.0
[2023-02-25 12:26:30,419][2409096] DAMAGECOUNT value on done: 165.0
[2023-02-25 12:26:30,420][2409096] Sum rewards: -2.491, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.005', 'HEALTH': '0.010', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'HITCOUNT': '0.100', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'weapon4': '0.214', 'ARMOR': '0.436', 'DAMAGECOUNT': '0.465', 'WEAPON3': '0.600', 'weapon3': '0.892', 'FRAGCOUNT': '1.000', 'weapon2': '1.634'}
[2023-02-25 12:26:30,446][2409866] DAMAGECOUNT value on done: 197.0
[2023-02-25 12:26:30,475][2409355] DAMAGECOUNT value on done: 204.0
[2023-02-25 12:26:30,476][2409355] Sum rewards: -4.593, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.087', 'ARMOR': '0.008', 'AMMO2': '0.009', 'AMMO4': '0.045', 'HITCOUNT': '0.100', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'weapon4': '0.232', 'DAMAGECOUNT': '0.462', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.118', 'weapon2': '1.578'}
[2023-02-25 12:26:30,759][2409099] DAMAGECOUNT value on done: 102.0
[2023-02-25 12:26:30,763][2409099] Sum rewards: -1.454, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.152', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.068', 'HITCOUNT': '0.080', 'AMMO3': '0.084', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.200', 'DAMAGECOUNT': '0.261', 'WEAPON3': '0.450', 'weapon3': '0.934', 'weapon2': '1.706', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:30,781][2409547] DAMAGECOUNT value on done: 95.0
[2023-02-25 12:26:30,855][2409078] DAMAGECOUNT value on done: 232.0
[2023-02-25 12:26:30,856][2409078] Sum rewards: -6.301, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-2.000', 'HEALTH': '-1.270', 'AMMO5': '0.013', 'AMMO2': '0.013', 'ARMOR': '0.024', 'HITCOUNT': '0.060', 'AMMO4': '0.066', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'weapon5': '0.184', 'weapon4': '0.248', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'weapon3': '0.638', 'DAMAGECOUNT': '0.696', 'weapon2': '1.402'}
[2023-02-25 12:26:30,963][2409105] DAMAGECOUNT value on done: 145.0
[2023-02-25 12:26:30,964][2409105] Sum rewards: -4.533, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.268', 'AMMO2': '0.032', 'HITCOUNT': '0.040', 'ARMOR': '0.048', 'AMMO3': '0.083', 'DAMAGECOUNT': '0.105', 'AMMO4': '0.159', 'WEAPON4': '0.400', 'WEAPON3': '0.400', 'weapon3': '0.448', 'weapon4': '0.660', 'FRAGCOUNT': '1.000', 'weapon2': '1.610'}
[2023-02-25 12:26:30,984][2409373] DAMAGECOUNT value on done: 179.0
[2023-02-25 12:26:30,990][2409373] Sum rewards: -7.153, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.224', 'AMMO2': '0.005', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.022', 'weapon5': '0.046', 'ARMOR': '0.048', 'WEAPON5': '0.100', 'weapon4': '0.108', 'HITCOUNT': '0.110', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.447', 'WEAPON3': '0.800', 'weapon3': '0.922', 'weapon2': '1.638'}
[2023-02-25 12:26:31,070][2409074] Updated weights for policy 0, policy_version 2720 (0.0012)
[2023-02-25 12:26:31,106][2409097] DAMAGECOUNT value on done: 232.0
[2023-02-25 12:26:31,110][2409097] Sum rewards: -6.372, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.485', 'AMMO2': '0.008', 'ARMOR': '0.024', 'AMMO4': '0.039', 'weapon4': '0.070', 'HITCOUNT': '0.150', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.750', 'weapon3': '0.936', 'FRAGCOUNT': '1.000', 'weapon2': '2.108'}
[2023-02-25 12:26:31,701][2409406] DAMAGECOUNT value on done: 355.0
[2023-02-25 12:26:31,738][2409079] DAMAGECOUNT value on done: 100.0
[2023-02-25 12:26:31,761][2409103] DAMAGECOUNT value on done: 124.0
[2023-02-25 12:26:31,907][2409485] DAMAGECOUNT value on done: 289.0
[2023-02-25 12:26:31,908][2409485] Sum rewards: -4.047, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.348', 'AMMO2': '0.023', 'AMMO3': '0.106', 'AMMO4': '0.115', 'HITCOUNT': '0.130', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.297', 'weapon4': '0.310', 'WEAPON3': '0.600', 'weapon3': '0.740', 'ARMOR': '0.904', 'FRAGCOUNT': '1.000', 'weapon2': '1.826'}
[2023-02-25 12:26:31,919][2409469] DAMAGECOUNT value on done: 115.0
[2023-02-25 12:26:31,922][2409469] Sum rewards: -0.004, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.835', 'ARMOR': '0.004', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.047', 'HITCOUNT': '0.050', 'AMMO3': '0.067', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.322', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.400', 'weapon3': '0.960', 'weapon2': '1.372', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:32,094][2409565] DAMAGECOUNT value on done: 257.0
[2023-02-25 12:26:32,186][2408954] Fps is (10 sec: 25395.3, 60 sec: 25463.5, 300 sec: 25797.9). Total num frames: 11169792. Throughput: 0: 6350.7. Samples: 2799636. Policy #0 lag: (min: 0.0, avg: 13.0, max: 27.0)
[2023-02-25 12:26:32,186][2408954] Avg episode reward: [(0, '-4.914')]
[2023-02-25 12:26:32,380][2409074] Updated weights for policy 0, policy_version 2730 (0.0014)
[2023-02-25 12:26:32,405][2409596] DAMAGECOUNT value on done: 306.0
[2023-02-25 12:26:32,406][2409596] Sum rewards: -2.907, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.545', 'AMMO2': '0.005', 'weapon7': '0.012', 'AMMO4': '0.026', 'ARMOR': '0.032', 'AMMO3': '0.105', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'weapon4': '0.196', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.783', 'FRAGCOUNT': '1.000', 'weapon2': '1.262', 'weapon3': '1.346'}
[2023-02-25 12:26:32,506][2409549] DAMAGECOUNT value on done: 246.0
[2023-02-25 12:26:32,506][2409405] DAMAGECOUNT value on done: 60.0
[2023-02-25 12:26:32,507][2409549] Sum rewards: -3.602, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.468', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'weapon4': '0.092', 'AMMO3': '0.109', 'HITCOUNT': '0.130', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.026', 'weapon2': '1.774'}
[2023-02-25 12:26:32,722][2409077] DAMAGECOUNT value on done: 120.0
[2023-02-25 12:26:32,723][2409077] Sum rewards: -4.928, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.760', 'AMMO2': '0.018', 'weapon4': '0.022', 'AMMO4': '0.087', 'AMMO3': '0.106', 'HITCOUNT': '0.110', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.360', 'ARMOR': '0.461', 'WEAPON3': '0.600', 'weapon3': '0.936', 'FRAGCOUNT': '1.000', 'weapon2': '1.982'}
[2023-02-25 12:26:32,842][2409075] DAMAGECOUNT value on done: 50.0
[2023-02-25 12:26:32,894][2409076] DAMAGECOUNT value on done: 67.0
[2023-02-25 12:26:32,973][2409102] DAMAGECOUNT value on done: 145.0
[2023-02-25 12:26:32,983][2409597] DAMAGECOUNT value on done: 269.0
[2023-02-25 12:26:32,984][2409597] Sum rewards: -4.897, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.490', 'AMMO5': '0.003', 'ARMOR': '0.028', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'AMMO3': '0.138', 'weapon4': '0.138', 'AMMO4': '0.177', 'HITCOUNT': '0.190', 'WEAPON4': '0.350', 'DAMAGECOUNT': '0.696', 'WEAPON3': '0.750', 'weapon3': '0.994', 'weapon2': '1.544', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:33,036][2409104] DAMAGECOUNT value on done: 212.0
[2023-02-25 12:26:33,037][2409104] Sum rewards: -2.489, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.712', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.114', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'weapon4': '0.194', 'ARMOR': '0.412', 'DAMAGECOUNT': '0.525', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.092', 'weapon2': '1.270'}
[2023-02-25 12:26:33,193][2409486] DAMAGECOUNT value on done: 303.0
[2023-02-25 12:26:33,197][2409486] Sum rewards: -2.258, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.595', 'AMMO5': '0.005', 'AMMO2': '0.014', 'ARMOR': '0.064', 'AMMO4': '0.072', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.168', 'HITCOUNT': '0.180', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.744', 'FRAGCOUNT': '1.000', 'weapon3': '1.188', 'weapon2': '1.614'}
[2023-02-25 12:26:33,217][2409100] DAMAGECOUNT value on done: 155.0
[2023-02-25 12:26:33,218][2409100] Sum rewards: -5.135, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.556', 'AMMO2': '0.005', 'AMMO5': '0.007', 'weapon5': '0.008', 'ARMOR': '0.012', 'AMMO4': '0.024', 'WEAPON5': '0.050', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.100', 'AMMO3': '0.161', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.700', 'weapon3': '0.912', 'weapon2': '1.566', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:33,578][2409468] DAMAGECOUNT value on done: 52.0
[2023-02-25 12:26:33,704][2409101] DAMAGECOUNT value on done: 24.0
[2023-02-25 12:26:33,705][2409101] Sum rewards: -1.532, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.383', 'HITCOUNT': '0.010', 'DAMAGECOUNT': '0.015', 'AMMO2': '0.021', 'ARMOR': '0.056', 'weapon4': '0.066', 'AMMO3': '0.102', 'AMMO4': '0.103', 'WEAPON4': '0.200', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.254', 'weapon2': '1.624'}
[2023-02-25 12:26:33,709][2409080] DAMAGECOUNT value on done: 227.0
[2023-02-25 12:26:33,721][2409080] Sum rewards: 0.024, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.600', 'AMMO2': '0.009', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'AMMO3': '0.104', 'weapon4': '0.112', 'HITCOUNT': '0.150', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.606', 'WEAPON3': '0.650', 'weapon2': '0.970', 'weapon3': '1.706', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:34,005][2409407] DAMAGECOUNT value on done: 65.0
[2023-02-25 12:26:34,116][2409866] DAMAGECOUNT value on done: 127.0
[2023-02-25 12:26:34,137][2409355] DAMAGECOUNT value on done: 114.0
[2023-02-25 12:26:34,155][2409389] DAMAGECOUNT value on done: 503.0
[2023-02-25 12:26:34,158][2409389] Sum rewards: -4.877, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.320', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.083', 'HITCOUNT': '0.110', 'AMMO3': '0.128', 'weapon4': '0.190', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.326', 'weapon2': '1.374'}
[2023-02-25 12:26:34,175][2409096] DAMAGECOUNT value on done: 120.0
[2023-02-25 12:26:34,203][2409548] DAMAGECOUNT value on done: 284.0
[2023-02-25 12:26:34,204][2409548] Sum rewards: -1.346, reward structure: {'DEATHCOUNT': '-8.250', 'ARMOR': '0.016', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.086', 'HITCOUNT': '0.100', 'AMMO3': '0.106', 'weapon4': '0.112', 'DAMAGECOUNT': '0.507', 'HEALTH': '0.542', 'WEAPON3': '0.550', 'weapon3': '1.070', 'weapon2': '1.748', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:34,522][2409074] Updated weights for policy 0, policy_version 2740 (0.0012)
[2023-02-25 12:26:34,526][2409105] DAMAGECOUNT value on done: 130.0
[2023-02-25 12:26:34,529][2409105] Sum rewards: -11.161, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.627', 'FRAGCOUNT': '-1.500', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO5': '0.014', 'weapon4': '0.026', 'weapon5': '0.098', 'AMMO3': '0.099', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.270', 'ARMOR': '0.428', 'WEAPON3': '0.550', 'weapon3': '0.572', 'weapon2': '2.494'}
[2023-02-25 12:26:34,549][2409099] DAMAGECOUNT value on done: 165.0
[2023-02-25 12:26:34,549][2409099] Sum rewards: -3.710, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.834', 'weapon7': '0.004', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.027', 'AMMO3': '0.039', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'HITCOUNT': '0.110', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'WEAPON3': '0.250', 'weapon4': '0.334', 'DAMAGECOUNT': '0.390', 'WEAPON4': '0.400', 'weapon3': '0.608', 'FRAGCOUNT': '1.000', 'weapon2': '1.852'}
[2023-02-25 12:26:34,927][2409373] DAMAGECOUNT value on done: 100.0
[2023-02-25 12:26:35,031][2409078] DAMAGECOUNT value on done: 140.0
[2023-02-25 12:26:35,051][2409078] Sum rewards: -1.567, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.904', 'AMMO2': '0.005', 'AMMO4': '0.024', 'ARMOR': '0.028', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'HITCOUNT': '0.120', 'weapon4': '0.152', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.308', 'weapon2': '1.512'}
[2023-02-25 12:26:35,509][2409103] DAMAGECOUNT value on done: 20.0
[2023-02-25 12:26:35,513][2409079] DAMAGECOUNT value on done: 260.0
[2023-02-25 12:26:35,514][2409079] Sum rewards: -2.996, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.301', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.005', 'weapon5': '0.008', 'HITCOUNT': '0.060', 'weapon4': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'DAMAGECOUNT': '0.345', 'ARMOR': '0.517', 'WEAPON3': '0.700', 'weapon3': '0.936', 'FRAGCOUNT': '1.000', 'weapon2': '1.846'}
[2023-02-25 12:26:35,665][2409565] DAMAGECOUNT value on done: 175.0
[2023-02-25 12:26:35,666][2409565] Sum rewards: -1.244, reward structure: {'DEATHCOUNT': '-6.750', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'ARMOR': '0.068', 'HITCOUNT': '0.080', 'AMMO4': '0.085', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'HEALTH': '0.112', 'weapon4': '0.122', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.450', 'weapon3': '0.698', 'FRAGCOUNT': '1.000', 'weapon2': '2.286'}
[2023-02-25 12:26:35,688][2409485] DAMAGECOUNT value on done: 280.0
[2023-02-25 12:26:35,689][2409469] DAMAGECOUNT value on done: 105.0
[2023-02-25 12:26:35,689][2409485] Sum rewards: -6.323, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.362', 'AMMO2': '0.037', 'AMMO3': '0.117', 'HITCOUNT': '0.170', 'AMMO4': '0.183', 'weapon4': '0.350', 'WEAPON4': '0.500', 'ARMOR': '0.514', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.660', 'weapon3': '0.670', 'FRAGCOUNT': '1.000', 'weapon2': '1.788'}
[2023-02-25 12:26:35,760][2409547] DAMAGECOUNT value on done: 324.0
[2023-02-25 12:26:35,761][2409547] Sum rewards: -3.611, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.752', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'weapon4': '0.070', 'AMMO4': '0.092', 'AMMO3': '0.116', 'HITCOUNT': '0.120', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.627', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.326', 'weapon2': '1.412'}
[2023-02-25 12:26:35,795][2409074] Updated weights for policy 0, policy_version 2750 (0.0014)
[2023-02-25 12:26:35,899][2409596] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:26:35,995][2409406] DAMAGECOUNT value on done: 149.0
[2023-02-25 12:26:35,996][2409406] Sum rewards: -7.952, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.318', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.032', 'HITCOUNT': '0.040', 'ARMOR': '0.071', 'AMMO3': '0.123', 'weapon4': '0.132', 'DAMAGECOUNT': '0.135', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'WEAPON4': '0.250', 'WEAPON3': '0.700', 'weapon3': '0.920', 'weapon2': '1.866'}
[2023-02-25 12:26:36,220][2409097] DAMAGECOUNT value on done: 150.0
[2023-02-25 12:26:36,221][2409097] Sum rewards: -7.163, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.442', 'AMMO2': '0.002', 'AMMO4': '0.010', 'ARMOR': '0.029', 'HITCOUNT': '0.100', 'AMMO3': '0.123', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.600', 'weapon3': '0.824', 'FRAGCOUNT': '1.000', 'weapon2': '2.436'}
[2023-02-25 12:26:36,488][2409597] DAMAGECOUNT value on done: 60.0
[2023-02-25 12:26:36,509][2409549] DAMAGECOUNT value on done: 82.0
[2023-02-25 12:26:36,512][2409549] Sum rewards: -5.044, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.850', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.017', 'ARMOR': '0.036', 'HITCOUNT': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.083', 'AMMO3': '0.085', 'DAMAGECOUNT': '0.162', 'weapon4': '0.220', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'weapon3': '1.074', 'weapon2': '1.520'}
[2023-02-25 12:26:36,549][2409076] DAMAGECOUNT value on done: 294.0
[2023-02-25 12:26:36,552][2409076] Sum rewards: -3.606, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.998', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon4': '0.020', 'WEAPON4': '0.050', 'HITCOUNT': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.135', 'DAMAGECOUNT': '0.375', 'ARMOR': '0.456', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.152', 'weapon2': '1.524'}
[2023-02-25 12:26:36,558][2409102] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:26:36,570][2409104] DAMAGECOUNT value on done: 77.0
[2023-02-25 12:26:36,574][2409104] Sum rewards: -3.862, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.566', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'HITCOUNT': '0.050', 'AMMO4': '0.083', 'AMMO3': '0.089', 'weapon4': '0.148', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.171', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'weapon3': '0.868', 'FRAGCOUNT': '2.000', 'weapon2': '2.058'}
[2023-02-25 12:26:36,637][2409405] DAMAGECOUNT value on done: 110.0
[2023-02-25 12:26:36,640][2409405] Sum rewards: -3.056, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.206', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'AMMO3': '0.061', 'HITCOUNT': '0.090', 'AMMO4': '0.099', 'weapon4': '0.190', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.400', 'ARMOR': '0.488', 'weapon3': '0.958', 'FRAGCOUNT': '1.000', 'weapon2': '1.824'}
[2023-02-25 12:26:36,749][2409486] DAMAGECOUNT value on done: 115.0
[2023-02-25 12:26:36,853][2409077] DAMAGECOUNT value on done: 265.0
[2023-02-25 12:26:36,854][2409077] Sum rewards: -3.291, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.714', 'weapon5': '0.006', 'AMMO2': '0.007', 'AMMO5': '0.007', 'ARMOR': '0.028', 'AMMO4': '0.037', 'weapon4': '0.038', 'WEAPON4': '0.100', 'AMMO3': '0.132', 'WEAPON5': '0.150', 'HITCOUNT': '0.160', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.136', 'weapon3': '1.636'}
[2023-02-25 12:26:37,029][2409074] Updated weights for policy 0, policy_version 2760 (0.0013)
[2023-02-25 12:26:37,031][2409075] DAMAGECOUNT value on done: 125.0
[2023-02-25 12:26:37,112][2409100] DAMAGECOUNT value on done: 160.0
[2023-02-25 12:26:37,122][2409100] Sum rewards: -6.272, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.935', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.017', 'weapon5': '0.022', 'HITCOUNT': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'weapon4': '0.178', 'DAMAGECOUNT': '0.330', 'ARMOR': '0.452', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.082', 'weapon2': '1.704'}
[2023-02-25 12:26:37,186][2408954] Fps is (10 sec: 26213.7, 60 sec: 25736.4, 300 sec: 25770.1). Total num frames: 11304960. Throughput: 0: 6341.6. Samples: 2818356. Policy #0 lag: (min: 0.0, avg: 13.2, max: 27.0)
[2023-02-25 12:26:37,186][2408954] Avg episode reward: [(0, '-4.716')]
[2023-02-25 12:26:37,304][2409468] DAMAGECOUNT value on done: 180.0
[2023-02-25 12:26:37,307][2409468] Sum rewards: -5.801, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.008', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.098', 'HITCOUNT': '0.100', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.525', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.284', 'weapon3': '1.350'}
[2023-02-25 12:26:37,396][2409080] DAMAGECOUNT value on done: 117.0
[2023-02-25 12:26:37,740][2409101] DAMAGECOUNT value on done: 49.0
[2023-02-25 12:26:37,784][2409355] DAMAGECOUNT value on done: 70.0
[2023-02-25 12:26:37,787][2409355] Sum rewards: -2.306, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.676', 'AMMO5': '0.012', 'AMMO2': '0.015', 'HITCOUNT': '0.050', 'ARMOR': '0.068', 'AMMO4': '0.076', 'AMMO3': '0.089', 'WEAPON5': '0.150', 'weapon4': '0.164', 'DAMAGECOUNT': '0.165', 'WEAPON4': '0.200', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.138', 'weapon2': '1.492'}
[2023-02-25 12:26:37,790][2409866] DAMAGECOUNT value on done: 130.0
[2023-02-25 12:26:37,881][2409548] DAMAGECOUNT value on done: 82.0
[2023-02-25 12:26:37,978][2409407] DAMAGECOUNT value on done: 135.0
[2023-02-25 12:26:37,981][2409407] Sum rewards: -1.533, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.550', 'AMMO5': '0.005', 'AMMO2': '0.010', 'ARMOR': '0.012', 'AMMO4': '0.049', 'HITCOUNT': '0.090', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.300', 'weapon4': '0.388', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.500', 'weapon3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.424'}
[2023-02-25 12:26:38,033][2409096] DAMAGECOUNT value on done: 89.0
[2023-02-25 12:26:38,101][2409099] DAMAGECOUNT value on done: 432.0
[2023-02-25 12:26:38,107][2409099] Sum rewards: -2.391, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.640', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'HITCOUNT': '0.050', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'weapon4': '0.120', 'AMMO3': '0.123', 'weapon5': '0.172', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.786', 'weapon3': '0.844', 'weapon2': '1.834', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:38,119][2409389] DAMAGECOUNT value on done: 210.0
[2023-02-25 12:26:38,121][2409389] Sum rewards: -6.026, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.538', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'ARMOR': '0.008', 'weapon4': '0.016', 'WEAPON4': '0.050', 'HITCOUNT': '0.120', 'AMMO3': '0.126', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.380', 'weapon3': '1.528'}
[2023-02-25 12:26:38,227][2409105] DAMAGECOUNT value on done: 332.0
[2023-02-25 12:26:38,230][2409105] Sum rewards: -9.438, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.254', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'ARMOR': '0.012', 'HITCOUNT': '0.230', 'AMMO3': '0.235', 'DAMAGECOUNT': '0.795', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.100', 'weapon3': '1.372', 'weapon2': '1.576'}
[2023-02-25 12:26:38,566][2409373] DAMAGECOUNT value on done: 59.0
[2023-02-25 12:26:39,058][2409103] DAMAGECOUNT value on done: 139.0
[2023-02-25 12:26:39,059][2409103] Sum rewards: -7.846, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.828', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.016', 'HITCOUNT': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.079', 'ARMOR': '0.092', 'AMMO3': '0.110', 'WEAPON4': '0.200', 'weapon4': '0.258', 'DAMAGECOUNT': '0.318', 'WEAPON3': '0.600', 'weapon3': '0.788', 'weapon2': '1.658'}
[2023-02-25 12:26:39,249][2409485] DAMAGECOUNT value on done: 135.0
[2023-02-25 12:26:39,298][2409078] DAMAGECOUNT value on done: 158.0
[2023-02-25 12:26:39,301][2409078] Sum rewards: -2.683, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.990', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.010', 'HITCOUNT': '0.020', 'weapon5': '0.048', 'DAMAGECOUNT': '0.075', 'AMMO3': '0.088', 'WEAPON5': '0.150', 'WEAPON3': '0.450', 'ARMOR': '0.490', 'weapon3': '0.802', 'FRAGCOUNT': '1.000', 'weapon2': '1.944'}
[2023-02-25 12:26:39,310][2409074] Updated weights for policy 0, policy_version 2770 (0.0012)
[2023-02-25 12:26:39,368][2409565] DAMAGECOUNT value on done: 198.0
[2023-02-25 12:26:39,443][2409596] DAMAGECOUNT value on done: 70.0
[2023-02-25 12:26:39,567][2409469] DAMAGECOUNT value on done: 280.0
[2023-02-25 12:26:39,570][2409469] Sum rewards: -2.029, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.800', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.017', 'weapon5': '0.032', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'weapon4': '0.204', 'ARMOR': '0.472', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.555', 'FRAGCOUNT': '1.000', 'weapon3': '1.092', 'weapon2': '1.330'}
[2023-02-25 12:26:39,723][2409079] DAMAGECOUNT value on done: 67.0
[2023-02-25 12:26:40,073][2409547] DAMAGECOUNT value on done: 138.0
[2023-02-25 12:26:40,076][2409547] Sum rewards: -5.681, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.370', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.030', 'HITCOUNT': '0.040', 'ARMOR': '0.045', 'DAMAGECOUNT': '0.069', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'AMMO3': '0.156', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.484', 'weapon3': '1.524'}
[2023-02-25 12:26:40,147][2409406] DAMAGECOUNT value on done: 193.0
[2023-02-25 12:26:40,149][2409104] DAMAGECOUNT value on done: 140.0
[2023-02-25 12:26:40,150][2409406] Sum rewards: -2.787, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.013', 'AMMO4': '0.063', 'ARMOR': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'HITCOUNT': '0.150', 'HEALTH': '0.152', 'weapon4': '0.158', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.507', 'FRAGCOUNT': '1.000', 'weapon3': '1.022', 'weapon2': '1.678'}
[2023-02-25 12:26:40,204][2409597] DAMAGECOUNT value on done: 210.0
[2023-02-25 12:26:40,205][2409597] Sum rewards: -3.970, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.860', 'AMMO5': '0.005', 'AMMO2': '0.017', 'ARMOR': '0.072', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'HITCOUNT': '0.170', 'WEAPON4': '0.350', 'weapon4': '0.366', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.585', 'weapon3': '0.682', 'weapon2': '1.904', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:40,273][2409076] DAMAGECOUNT value on done: 144.0
[2023-02-25 12:26:40,276][2409097] DAMAGECOUNT value on done: 431.0
[2023-02-25 12:26:40,279][2409097] Sum rewards: -5.995, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.538', 'AMMO2': '0.018', 'AMMO4': '0.091', 'HITCOUNT': '0.110', 'weapon4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.330', 'weapon3': '1.532'}
[2023-02-25 12:26:40,279][2409076] Sum rewards: -4.793, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.848', 'AMMO2': '0.020', 'ARMOR': '0.064', 'AMMO4': '0.097', 'HITCOUNT': '0.130', 'AMMO3': '0.142', 'WEAPON4': '0.300', 'weapon4': '0.346', 'DAMAGECOUNT': '0.432', 'WEAPON3': '0.700', 'weapon3': '0.814', 'weapon2': '1.760', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:40,403][2409102] DAMAGECOUNT value on done: 203.0
[2023-02-25 12:26:40,403][2409102] Sum rewards: -3.569, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.040', 'AMMO2': '0.003', 'AMMO5': '0.006', 'AMMO4': '0.015', 'weapon4': '0.028', 'weapon5': '0.088', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'DAMAGECOUNT': '0.300', 'ARMOR': '0.469', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.262', 'weapon3': '1.450'}
[2023-02-25 12:26:40,524][2409549] DAMAGECOUNT value on done: 330.0
[2023-02-25 12:26:40,524][2409549] Sum rewards: -3.628, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.343', 'AMMO2': '0.008', 'ARMOR': '0.012', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'weapon4': '0.064', 'AMMO3': '0.132', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.690', 'WEAPON3': '0.750', 'weapon3': '1.214', 'weapon2': '1.578', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:40,573][2409075] DAMAGECOUNT value on done: 173.0
[2023-02-25 12:26:40,659][2409074] Updated weights for policy 0, policy_version 2780 (0.0013)
[2023-02-25 12:26:40,680][2409486] DAMAGECOUNT value on done: 48.0
[2023-02-25 12:26:40,695][2409405] DAMAGECOUNT value on done: 276.0
[2023-02-25 12:26:40,698][2409405] Sum rewards: 0.602, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.729', 'AMMO5': '0.004', 'AMMO2': '0.027', 'weapon5': '0.070', 'AMMO3': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'HITCOUNT': '0.210', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'ARMOR': '0.408', 'weapon3': '0.518', 'weapon4': '0.524', 'DAMAGECOUNT': '0.783', 'weapon2': '1.568', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:26:41,088][2409468] DAMAGECOUNT value on done: 380.0
[2023-02-25 12:26:41,120][2409100] DAMAGECOUNT value on done: 197.0
[2023-02-25 12:26:41,120][2409100] Sum rewards: -3.995, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.258', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon5': '0.078', 'AMMO4': '0.078', 'AMMO3': '0.084', 'HITCOUNT': '0.090', 'weapon4': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.396', 'WEAPON3': '0.450', 'FRAGCOUNT': '0.500', 'ARMOR': '0.524', 'weapon3': '0.730', 'weapon2': '1.918'}
[2023-02-25 12:26:41,159][2409080] DAMAGECOUNT value on done: 72.0
[2023-02-25 12:26:41,163][2409080] Sum rewards: -5.018, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.990', 'AMMO2': '0.019', 'ARMOR': '0.020', 'HITCOUNT': '0.030', 'DAMAGECOUNT': '0.066', 'AMMO4': '0.093', 'AMMO3': '0.124', 'WEAPON4': '0.250', 'weapon4': '0.262', 'WEAPON3': '0.650', 'weapon3': '0.868', 'FRAGCOUNT': '1.000', 'weapon2': '1.590'}
[2023-02-25 12:26:41,406][2409077] DAMAGECOUNT value on done: 255.0
[2023-02-25 12:26:41,410][2409077] Sum rewards: -3.514, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.227', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon4': '0.102', 'AMMO3': '0.126', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'ARMOR': '0.448', 'DAMAGECOUNT': '0.630', 'WEAPON3': '0.800', 'weapon3': '1.390', 'weapon2': '1.464', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:26:41,546][2409866] DAMAGECOUNT value on done: 140.0
[2023-02-25 12:26:41,550][2409866] Sum rewards: -0.278, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.222', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'weapon4': '0.034', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'DAMAGECOUNT': '0.285', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'weapon3': '1.050', 'weapon2': '2.026', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:26:41,561][2409355] DAMAGECOUNT value on done: 220.0
[2023-02-25 12:26:41,568][2409101] DAMAGECOUNT value on done: 240.0
[2023-02-25 12:26:41,571][2409101] Sum rewards: -5.498, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.732', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.022', 'AMMO2': '0.026', 'ARMOR': '0.037', 'WEAPON5': '0.050', 'AMMO4': '0.128', 'HITCOUNT': '0.130', 'AMMO3': '0.155', 'weapon4': '0.256', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.850', 'weapon3': '0.930', 'FRAGCOUNT': '1.000', 'weapon2': '1.518'}
[2023-02-25 12:26:41,633][2409389] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:26:41,714][2409096] DAMAGECOUNT value on done: 134.0
[2023-02-25 12:26:41,773][2409548] DAMAGECOUNT value on done: 221.0
[2023-02-25 12:26:41,774][2409548] Sum rewards: -4.138, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.668', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.008', 'AMMO4': '0.039', 'WEAPON5': '0.100', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'weapon4': '0.280', 'ARMOR': '0.432', 'DAMAGECOUNT': '0.633', 'WEAPON3': '0.700', 'weapon3': '1.020', 'weapon2': '1.608', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:41,790][2409105] DAMAGECOUNT value on done: 139.0
[2023-02-25 12:26:41,793][2409105] Sum rewards: -4.258, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.880', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'ARMOR': '0.050', 'weapon4': '0.078', 'HITCOUNT': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'DAMAGECOUNT': '0.270', 'WEAPON3': '0.450', 'weapon3': '0.754', 'FRAGCOUNT': '1.000', 'weapon2': '2.290'}
[2023-02-25 12:26:41,896][2409407] DAMAGECOUNT value on done: 90.0
[2023-02-25 12:26:41,900][2409407] Sum rewards: -8.143, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.236', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'ARMOR': '0.061', 'HITCOUNT': '0.070', 'AMMO4': '0.112', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'weapon4': '0.206', 'DAMAGECOUNT': '0.225', 'WEAPON3': '0.600', 'weapon3': '0.652', 'weapon2': '1.994'}
[2023-02-25 12:26:42,174][2409099] DAMAGECOUNT value on done: 220.0
[2023-02-25 12:26:42,175][2409099] Sum rewards: -5.733, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.795', 'AMMO2': '0.017', 'ARMOR': '0.064', 'AMMO4': '0.085', 'weapon4': '0.118', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.850', 'weapon3': '1.002', 'weapon2': '1.620', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:42,186][2408954] Fps is (10 sec: 25395.1, 60 sec: 25463.4, 300 sec: 25756.2). Total num frames: 11423744. Throughput: 0: 6353.3. Samples: 2857020. Policy #0 lag: (min: 0.0, avg: 11.3, max: 24.0)
[2023-02-25 12:26:42,186][2408954] Avg episode reward: [(0, '-4.564')]
[2023-02-25 12:26:42,223][2409074] Updated weights for policy 0, policy_version 2790 (0.0012)
[2023-02-25 12:26:42,430][2409373] DAMAGECOUNT value on done: 122.0
[2023-02-25 12:26:42,624][2409103] DAMAGECOUNT value on done: 77.0
[2023-02-25 12:26:42,836][2409485] DAMAGECOUNT value on done: 39.0
[2023-02-25 12:26:42,837][2409485] Sum rewards: -6.152, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.404', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'WEAPON1': '0.020', 'HITCOUNT': '0.040', 'DAMAGECOUNT': '0.105', 'AMMO3': '0.153', 'ARMOR': '0.425', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.316', 'weapon2': '1.446'}
[2023-02-25 12:26:42,900][2409078] DAMAGECOUNT value on done: 152.0
[2023-02-25 12:26:42,900][2409078] Sum rewards: -6.388, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.134', 'FRAGCOUNT': '-1.500', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'weapon5': '0.014', 'HITCOUNT': '0.040', 'WEAPON1': '0.040', 'weapon4': '0.048', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.120', 'WEAPON3': '0.650', 'weapon3': '1.344', 'weapon2': '1.464'}
[2023-02-25 12:26:43,031][2409596] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:26:43,273][2409565] DAMAGECOUNT value on done: 100.0
[2023-02-25 12:26:43,548][2409074] Updated weights for policy 0, policy_version 2800 (0.0012)
[2023-02-25 12:26:43,658][2409469] DAMAGECOUNT value on done: 289.0
[2023-02-25 12:26:43,659][2409469] Sum rewards: -0.504, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.830', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.012', 'ARMOR': '0.016', 'weapon4': '0.098', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'DAMAGECOUNT': '0.447', 'WEAPON3': '0.500', 'weapon3': '1.288', 'weapon2': '1.628', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:43,842][2409079] DAMAGECOUNT value on done: 160.0
[2023-02-25 12:26:43,917][2409104] DAMAGECOUNT value on done: 114.0
[2023-02-25 12:26:43,961][2409547] DAMAGECOUNT value on done: 301.0
[2023-02-25 12:26:43,963][2409547] Sum rewards: -1.972, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.233', 'AMMO2': '0.024', 'ARMOR': '0.072', 'AMMO3': '0.087', 'AMMO4': '0.122', 'HITCOUNT': '0.150', 'weapon4': '0.286', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.666', 'weapon3': '1.068', 'weapon2': '1.436', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:44,046][2409075] DAMAGECOUNT value on done: 35.0
[2023-02-25 12:26:44,078][2409097] DAMAGECOUNT value on done: 80.0
[2023-02-25 12:26:44,079][2409097] Sum rewards: -8.807, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-3.000', 'HEALTH': '-1.046', 'ARMOR': '0.004', 'weapon4': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.050', 'HITCOUNT': '0.090', 'AMMO3': '0.124', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.210', 'WEAPON3': '0.700', 'weapon3': '1.180', 'weapon2': '1.512'}
[2023-02-25 12:26:44,107][2409102] DAMAGECOUNT value on done: 207.0
[2023-02-25 12:26:44,107][2409102] Sum rewards: -1.088, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.904', 'AMMO5': '0.003', 'AMMO2': '0.023', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.087', 'AMMO4': '0.112', 'HITCOUNT': '0.180', 'WEAPON4': '0.300', 'weapon4': '0.368', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.621', 'FRAGCOUNT': '1.000', 'weapon3': '1.022', 'weapon2': '1.464'}
[2023-02-25 12:26:44,110][2409406] DAMAGECOUNT value on done: 210.0
[2023-02-25 12:26:44,111][2409406] Sum rewards: -5.439, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.435', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.018', 'HITCOUNT': '0.040', 'AMMO4': '0.090', 'DAMAGECOUNT': '0.105', 'weapon4': '0.116', 'AMMO3': '0.136', 'WEAPON4': '0.200', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.306', 'weapon3': '1.418'}
[2023-02-25 12:26:44,137][2409076] DAMAGECOUNT value on done: 152.0
[2023-02-25 12:26:44,138][2409076] Sum rewards: -1.873, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.595', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon5': '0.018', 'AMMO4': '0.026', 'ARMOR': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'HITCOUNT': '0.110', 'weapon4': '0.126', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.650', 'weapon3': '1.268', 'weapon2': '1.452', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:44,155][2409549] DAMAGECOUNT value on done: 89.0
[2023-02-25 12:26:44,156][2409549] Sum rewards: -5.455, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.964', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.020', 'ARMOR': '0.021', 'AMMO2': '0.021', 'HITCOUNT': '0.090', 'weapon4': '0.092', 'AMMO4': '0.106', 'AMMO3': '0.141', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.240', 'WEAPON3': '0.650', 'weapon3': '1.218', 'weapon2': '1.592'}
[2023-02-25 12:26:44,308][2409597] DAMAGECOUNT value on done: 33.0
[2023-02-25 12:26:44,383][2409486] DAMAGECOUNT value on done: 157.0
[2023-02-25 12:26:44,386][2409486] Sum rewards: -3.000, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.640', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.011', 'weapon6': '0.022', 'AMMO4': '0.053', 'ARMOR': '0.080', 'HITCOUNT': '0.090', 'WEAPON6': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'weapon4': '0.148', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.429', 'WEAPON3': '0.600', 'weapon3': '1.128', 'weapon2': '1.608', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:44,482][2409405] DAMAGECOUNT value on done: 390.0
[2023-02-25 12:26:44,555][2409100] DAMAGECOUNT value on done: 150.0
[2023-02-25 12:26:44,913][2409077] DAMAGECOUNT value on done: 120.0
[2023-02-25 12:26:44,913][2409077] Sum rewards: -5.824, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.981', 'AMMO5': '0.003', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'weapon5': '0.050', 'ARMOR': '0.056', 'HITCOUNT': '0.140', 'AMMO3': '0.160', 'AMMO4': '0.184', 'DAMAGECOUNT': '0.345', 'WEAPON4': '0.350', 'weapon4': '0.476', 'weapon3': '0.784', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.472'}
[2023-02-25 12:26:45,068][2409389] DAMAGECOUNT value on done: 151.0
[2023-02-25 12:26:45,071][2409389] Sum rewards: -2.558, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.766', 'AMMO2': '0.004', 'AMMO4': '0.018', 'HITCOUNT': '0.080', 'AMMO3': '0.143', 'DAMAGECOUNT': '0.225', 'ARMOR': '0.428', 'WEAPON3': '0.750', 'weapon3': '1.464', 'weapon2': '1.596', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:45,084][2409101] DAMAGECOUNT value on done: 216.0
[2023-02-25 12:26:45,085][2409101] Sum rewards: -4.791, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.493', 'AMMO5': '0.007', 'weapon5': '0.014', 'AMMO2': '0.023', 'ARMOR': '0.036', 'AMMO4': '0.116', 'AMMO3': '0.136', 'HITCOUNT': '0.140', 'WEAPON5': '0.150', 'weapon4': '0.206', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.558', 'WEAPON3': '0.750', 'weapon3': '1.002', 'weapon2': '1.814', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:45,161][2409074] Updated weights for policy 0, policy_version 2810 (0.0012)
[2023-02-25 12:26:45,190][2409866] DAMAGECOUNT value on done: 108.0
[2023-02-25 12:26:45,198][2409355] DAMAGECOUNT value on done: 40.0
[2023-02-25 12:26:45,199][2409355] Sum rewards: -1.605, reward structure: {'DEATHCOUNT': '-3.750', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.075', 'ARMOR': '0.084', 'weapon5': '0.084', 'WEAPON5': '0.150', 'weapon4': '0.260', 'HEALTH': '0.268', 'WEAPON3': '0.400', 'weapon2': '1.002', 'weapon3': '1.182'}
[2023-02-25 12:26:45,275][2409548] DAMAGECOUNT value on done: 165.0
[2023-02-25 12:26:45,279][2409548] Sum rewards: -3.161, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.392', 'AMMO2': '0.018', 'AMMO3': '0.063', 'AMMO4': '0.091', 'HITCOUNT': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.274', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.480', 'weapon3': '0.882', 'FRAGCOUNT': '1.000', 'weapon2': '1.372'}
[2023-02-25 12:26:45,769][2409468] DAMAGECOUNT value on done: 214.0
[2023-02-25 12:26:45,773][2409468] Sum rewards: -2.958, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.318', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'weapon4': '0.050', 'ARMOR': '0.083', 'AMMO3': '0.129', 'HITCOUNT': '0.130', 'DAMAGECOUNT': '0.552', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.238', 'weapon2': '1.638'}
[2023-02-25 12:26:45,820][2409080] DAMAGECOUNT value on done: 237.0
[2023-02-25 12:26:45,823][2409080] Sum rewards: -0.374, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.555', 'AMMO2': '0.026', 'weapon4': '0.044', 'AMMO3': '0.057', 'HITCOUNT': '0.070', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.345', 'ARMOR': '0.464', 'weapon3': '0.912', 'FRAGCOUNT': '1.000', 'weapon2': '1.882'}
[2023-02-25 12:26:45,847][2409096] DAMAGECOUNT value on done: 76.0
[2023-02-25 12:26:45,891][2409099] DAMAGECOUNT value on done: 293.0
[2023-02-25 12:26:45,892][2409099] Sum rewards: -3.044, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.034', 'AMMO2': '0.023', 'AMMO3': '0.071', 'AMMO4': '0.114', 'HITCOUNT': '0.160', 'weapon4': '0.188', 'WEAPON4': '0.200', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.654', 'FRAGCOUNT': '1.000', 'weapon3': '1.170', 'weapon2': '1.510'}
[2023-02-25 12:26:45,912][2409407] DAMAGECOUNT value on done: 108.0
[2023-02-25 12:26:46,089][2409103] DAMAGECOUNT value on done: 60.0
[2023-02-25 12:26:46,091][2409105] DAMAGECOUNT value on done: 85.0
[2023-02-25 12:26:46,093][2409103] Sum rewards: -6.011, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.440', 'AMMO2': '0.006', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO4': '0.031', 'HITCOUNT': '0.060', 'DAMAGECOUNT': '0.120', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'ARMOR': '0.500', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.332', 'weapon3': '1.522'}
[2023-02-25 12:26:46,286][2409373] DAMAGECOUNT value on done: 245.0
[2023-02-25 12:26:46,287][2409373] Sum rewards: -2.845, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.554', 'AMMO2': '0.014', 'AMMO4': '0.070', 'ARMOR': '0.080', 'AMMO3': '0.095', 'weapon4': '0.106', 'HITCOUNT': '0.180', 'WEAPON4': '0.250', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.645', 'weapon3': '1.070', 'weapon2': '1.848', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:46,333][2409485] DAMAGECOUNT value on done: 270.0
[2023-02-25 12:26:46,336][2409485] Sum rewards: -5.648, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.554', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.005', 'AMMO2': '0.019', 'ARMOR': '0.020', 'weapon5': '0.034', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'HITCOUNT': '0.120', 'weapon4': '0.124', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.650', 'weapon3': '1.068', 'weapon2': '1.494'}
[2023-02-25 12:26:46,853][2409596] DAMAGECOUNT value on done: 273.0
[2023-02-25 12:26:46,874][2409596] Sum rewards: -2.698, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.200', 'AMMO5': '0.005', 'AMMO2': '0.010', 'ARMOR': '0.028', 'AMMO4': '0.051', 'weapon5': '0.072', 'AMMO3': '0.086', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.234', 'weapon4': '0.244', 'WEAPON3': '0.500', 'weapon3': '0.802', 'FRAGCOUNT': '1.000', 'weapon2': '1.830'}
[2023-02-25 12:26:46,882][2409565] DAMAGECOUNT value on done: 35.0
[2023-02-25 12:26:46,935][2409074] Updated weights for policy 0, policy_version 2820 (0.0013)
[2023-02-25 12:26:47,153][2409078] DAMAGECOUNT value on done: 76.0
[2023-02-25 12:26:47,186][2408954] Fps is (10 sec: 24986.3, 60 sec: 25326.9, 300 sec: 25797.9). Total num frames: 11554816. Throughput: 0: 6413.1. Samples: 2896056. Policy #0 lag: (min: 0.0, avg: 12.3, max: 25.0)
[2023-02-25 12:26:47,186][2408954] Avg episode reward: [(0, '-4.610')]
[2023-02-25 12:26:47,511][2409079] DAMAGECOUNT value on done: 155.0
[2023-02-25 12:26:47,515][2409079] Sum rewards: -5.916, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.322', 'AMMO2': '0.009', 'AMMO4': '0.045', 'HITCOUNT': '0.080', 'AMMO3': '0.164', 'DAMAGECOUNT': '0.330', 'ARMOR': '0.472', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.160', 'weapon2': '1.796'}
[2023-02-25 12:26:47,666][2409549] DAMAGECOUNT value on done: 242.0
[2023-02-25 12:26:47,668][2409469] DAMAGECOUNT value on done: 54.0
[2023-02-25 12:26:47,669][2409549] Sum rewards: -2.560, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.083', 'AMMO5': '0.003', 'AMMO2': '0.016', 'ARMOR': '0.043', 'WEAPON5': '0.050', 'HITCOUNT': '0.070', 'AMMO4': '0.079', 'AMMO3': '0.099', 'WEAPON4': '0.150', 'weapon4': '0.158', 'DAMAGECOUNT': '0.186', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.244', 'weapon2': '1.376'}
[2023-02-25 12:26:47,672][2409075] DAMAGECOUNT value on done: 195.0
[2023-02-25 12:26:47,670][2409469] Sum rewards: -6.092, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.084', 'AMMO5': '0.006', 'HITCOUNT': '0.020', 'AMMO2': '0.036', 'weapon5': '0.042', 'AMMO3': '0.088', 'DAMAGECOUNT': '0.147', 'WEAPON5': '0.150', 'AMMO4': '0.182', 'weapon3': '0.286', 'WEAPON4': '0.400', 'WEAPON3': '0.400', 'weapon4': '0.492', 'ARMOR': '1.017', 'weapon2': '1.976'}
[2023-02-25 12:26:47,672][2409075] Sum rewards: -4.139, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.940', 'AMMO5': '0.005', 'AMMO2': '0.012', 'ARMOR': '0.040', 'AMMO4': '0.059', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'HITCOUNT': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.266', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.700', 'weapon3': '1.144', 'weapon2': '1.326', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:47,690][2409102] DAMAGECOUNT value on done: 192.0
[2023-02-25 12:26:47,690][2409102] Sum rewards: -4.778, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.906', 'AMMO5': '0.005', 'AMMO2': '0.015', 'HITCOUNT': '0.070', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'weapon4': '0.122', 'AMMO3': '0.125', 'DAMAGECOUNT': '0.171', 'ARMOR': '0.489', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.086', 'weapon2': '2.072'}
[2023-02-25 12:26:47,750][2409547] DAMAGECOUNT value on done: 386.0
[2023-02-25 12:26:47,750][2409547] Sum rewards: 4.497, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.008', 'AMMO4': '0.038', 'AMMO3': '0.040', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.104', 'HITCOUNT': '0.150', 'WEAPON3': '0.200', 'HEALTH': '0.471', 'weapon3': '0.920', 'DAMAGECOUNT': '1.038', 'weapon2': '1.228', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:26:47,772][2409406] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:26:47,794][2409097] DAMAGECOUNT value on done: 425.0
[2023-02-25 12:26:47,794][2409097] Sum rewards: -1.673, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.914', 'AMMO2': '0.005', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO4': '0.024', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.136', 'weapon4': '0.172', 'HITCOUNT': '0.220', 'WEAPON3': '0.750', 'weapon2': '1.056', 'DAMAGECOUNT': '1.080', 'weapon3': '1.570', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:26:47,846][2409104] DAMAGECOUNT value on done: 80.0
[2023-02-25 12:26:47,847][2409104] Sum rewards: -6.896, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.480', 'AMMO5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.019', 'weapon5': '0.052', 'HITCOUNT': '0.070', 'AMMO4': '0.093', 'AMMO3': '0.112', 'weapon4': '0.118', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.240', 'WEAPON4': '0.250', 'WEAPON3': '0.650', 'weapon3': '0.980', 'weapon2': '1.582'}
[2023-02-25 12:26:48,126][2409597] DAMAGECOUNT value on done: 190.0
[2023-02-25 12:26:48,131][2409597] Sum rewards: -6.005, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.710', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon5': '0.020', 'AMMO4': '0.033', 'ARMOR': '0.040', 'WEAPON4': '0.100', 'weapon4': '0.114', 'HITCOUNT': '0.130', 'AMMO3': '0.138', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.750', 'weapon3': '1.030', 'weapon2': '1.996', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:48,144][2409486] DAMAGECOUNT value on done: 62.0
[2023-02-25 12:26:48,155][2409076] DAMAGECOUNT value on done: 130.0
[2023-02-25 12:26:48,241][2409100] DAMAGECOUNT value on done: 310.0
[2023-02-25 12:26:48,244][2409100] Sum rewards: -1.947, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.176', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO4': '0.046', 'AMMO3': '0.115', 'HITCOUNT': '0.150', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.650', 'weapon2': '1.248', 'weapon3': '1.656', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:48,480][2409405] DAMAGECOUNT value on done: 237.0
[2023-02-25 12:26:48,483][2409405] Sum rewards: -2.344, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.964', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.078', 'WEAPON4': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.128', 'HITCOUNT': '0.150', 'DAMAGECOUNT': '0.516', 'WEAPON3': '0.700', 'ARMOR': '0.900', 'weapon3': '1.106', 'weapon2': '1.722', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:48,563][2409074] Updated weights for policy 0, policy_version 2830 (0.0012)
[2023-02-25 12:26:48,580][2409077] DAMAGECOUNT value on done: 127.0
[2023-02-25 12:26:48,678][2409389] DAMAGECOUNT value on done: 82.0
[2023-02-25 12:26:48,977][2409355] DAMAGECOUNT value on done: 143.0
[2023-02-25 12:26:48,978][2409355] Sum rewards: -5.456, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.456', 'AMMO4': '-0.053', 'AMMO2': '-0.010', 'ARMOR': '0.008', 'HITCOUNT': '0.100', 'AMMO3': '0.114', 'DAMAGECOUNT': '0.285', 'WEAPON3': '0.650', 'weapon3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.956'}
[2023-02-25 12:26:48,988][2409866] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:26:49,044][2409548] DAMAGECOUNT value on done: 100.0
[2023-02-25 12:26:49,048][2409548] Sum rewards: -4.750, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.695', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'HITCOUNT': '0.070', 'AMMO3': '0.151', 'DAMAGECOUNT': '0.240', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.368', 'weapon2': '1.536'}
[2023-02-25 12:26:49,261][2409101] DAMAGECOUNT value on done: 222.0
[2023-02-25 12:26:49,261][2409101] Sum rewards: -4.567, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.730', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.008', 'HITCOUNT': '0.130', 'AMMO3': '0.139', 'WEAPON4': '0.200', 'weapon4': '0.250', 'DAMAGECOUNT': '0.366', 'ARMOR': '0.545', 'weapon3': '0.642', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '2.226'}
[2023-02-25 12:26:49,404][2409407] DAMAGECOUNT value on done: 179.0
[2023-02-25 12:26:49,405][2409407] Sum rewards: -5.571, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.633', 'AMMO2': '0.008', 'ARMOR': '0.016', 'AMMO4': '0.042', 'weapon4': '0.096', 'WEAPON4': '0.100', 'HITCOUNT': '0.150', 'AMMO3': '0.158', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.238', 'weapon2': '1.594'}
[2023-02-25 12:26:49,539][2409103] DAMAGECOUNT value on done: 307.0
[2023-02-25 12:26:49,541][2409468] DAMAGECOUNT value on done: 115.0
[2023-02-25 12:26:49,542][2409468] Sum rewards: -2.095, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.270', 'AMMO2': '0.026', 'weapon4': '0.046', 'HITCOUNT': '0.080', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'AMMO4': '0.127', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.304', 'weapon2': '1.500'}
[2023-02-25 12:26:49,586][2409080] DAMAGECOUNT value on done: 319.0
[2023-02-25 12:26:49,587][2409080] Sum rewards: -5.226, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.613', 'AMMO5': '0.009', 'ARMOR': '0.012', 'weapon5': '0.024', 'AMMO2': '0.028', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'weapon4': '0.112', 'HITCOUNT': '0.140', 'AMMO4': '0.140', 'WEAPON4': '0.250', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.552', 'weapon3': '0.674', 'FRAGCOUNT': '1.000', 'weapon2': '2.246'}
[2023-02-25 12:26:49,629][2409099] DAMAGECOUNT value on done: 155.0
[2023-02-25 12:26:49,633][2409099] Sum rewards: -5.075, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.178', 'AMMO2': '0.010', 'weapon4': '0.030', 'ARMOR': '0.036', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.161', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.750', 'weapon3': '1.200', 'weapon2': '1.774', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:49,670][2409096] DAMAGECOUNT value on done: 595.0
[2023-02-25 12:26:49,670][2409096] Sum rewards: 0.169, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.364', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'ARMOR': '0.072', 'weapon4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'HITCOUNT': '0.250', 'WEAPON3': '0.750', 'weapon3': '1.398', 'weapon2': '1.508', 'DAMAGECOUNT': '1.593', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:26:49,780][2409105] DAMAGECOUNT value on done: 253.0
[2023-02-25 12:26:49,780][2409105] Sum rewards: -2.444, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.488', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'ARMOR': '0.032', 'weapon4': '0.070', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.137', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.555', 'FRAGCOUNT': '1.000', 'weapon3': '1.190', 'weapon2': '1.688'}
[2023-02-25 12:26:49,801][2409485] DAMAGECOUNT value on done: 55.0
[2023-02-25 12:26:49,802][2409485] Sum rewards: -2.685, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.794', 'AMMO2': '0.010', 'HITCOUNT': '0.010', 'DAMAGECOUNT': '0.030', 'AMMO4': '0.049', 'ARMOR': '0.060', 'AMMO3': '0.106', 'WEAPON4': '0.150', 'weapon4': '0.150', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.360', 'weapon3': '1.384'}
[2023-02-25 12:26:49,936][2409373] DAMAGECOUNT value on done: 205.0
[2023-02-25 12:26:50,345][2409074] Updated weights for policy 0, policy_version 2840 (0.0012)
[2023-02-25 12:26:50,662][2409078] DAMAGECOUNT value on done: 257.0
[2023-02-25 12:26:50,664][2409078] Sum rewards: -3.143, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.755', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.009', 'weapon5': '0.038', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'HITCOUNT': '0.160', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.750', 'weapon2': '1.340', 'weapon3': '1.374', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:26:51,007][2409596] DAMAGECOUNT value on done: 111.0
[2023-02-25 12:26:51,007][2409596] Sum rewards: -9.498, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.694', 'ARMOR': '0.016', 'AMMO2': '0.017', 'HITCOUNT': '0.050', 'AMMO4': '0.087', 'DAMAGECOUNT': '0.090', 'weapon4': '0.220', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon3': '0.966', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.150', 'weapon2': '1.622'}
[2023-02-25 12:26:51,131][2409075] DAMAGECOUNT value on done: 120.0
[2023-02-25 12:26:51,134][2409565] DAMAGECOUNT value on done: 96.0
[2023-02-25 12:26:51,169][2409079] DAMAGECOUNT value on done: 122.0
[2023-02-25 12:26:51,307][2409074] Updated weights for policy 0, policy_version 2850 (0.0012)
[2023-02-25 12:26:51,319][2409406] DAMAGECOUNT value on done: 131.0
[2023-02-25 12:26:51,366][2409469] DAMAGECOUNT value on done: 89.0
[2023-02-25 12:26:51,367][2409469] Sum rewards: -5.955, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.463', 'ARMOR': '0.012', 'AMMO2': '0.024', 'HITCOUNT': '0.030', 'DAMAGECOUNT': '0.102', 'AMMO4': '0.120', 'AMMO3': '0.121', 'weapon4': '0.214', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'weapon3': '0.874', 'FRAGCOUNT': '1.000', 'weapon2': '1.960'}
[2023-02-25 12:26:51,378][2409547] DAMAGECOUNT value on done: 129.0
[2023-02-25 12:26:51,382][2409097] DAMAGECOUNT value on done: 56.0
[2023-02-25 12:26:51,384][2409097] Sum rewards: -5.107, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.770', 'AMMO5': '0.009', 'AMMO2': '0.020', 'HITCOUNT': '0.030', 'weapon5': '0.038', 'ARMOR': '0.048', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.117', 'AMMO3': '0.124', 'WEAPON3': '0.600', 'weapon3': '1.326', 'weapon2': '1.404'}
[2023-02-25 12:26:51,872][2409549] DAMAGECOUNT value on done: 49.0
[2023-02-25 12:26:51,877][2409104] DAMAGECOUNT value on done: 104.0
[2023-02-25 12:26:51,883][2409486] DAMAGECOUNT value on done: 119.0
[2023-02-25 12:26:51,887][2409104] Sum rewards: -2.843, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.668', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'HITCOUNT': '0.060', 'ARMOR': '0.088', 'AMMO3': '0.096', 'AMMO4': '0.108', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.270', 'weapon4': '0.286', 'WEAPON3': '0.550', 'weapon3': '0.910', 'FRAGCOUNT': '1.000', 'weapon2': '1.616'}
[2023-02-25 12:26:51,887][2409486] Sum rewards: -4.292, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.604', 'AMMO2': '0.028', 'ARMOR': '0.068', 'HITCOUNT': '0.070', 'AMMO3': '0.093', 'AMMO4': '0.140', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.252', 'weapon4': '0.328', 'WEAPON3': '0.450', 'weapon3': '0.730', 'FRAGCOUNT': '1.000', 'weapon2': '1.902'}
[2023-02-25 12:26:51,896][2409076] DAMAGECOUNT value on done: 53.0
[2023-02-25 12:26:51,896][2409076] Sum rewards: -3.132, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.994', 'AMMO2': '0.017', 'HITCOUNT': '0.020', 'ARMOR': '0.048', 'AMMO3': '0.056', 'DAMAGECOUNT': '0.060', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'weapon4': '0.272', 'WEAPON3': '0.300', 'weapon3': '0.576', 'FRAGCOUNT': '1.000', 'weapon2': '2.028'}
[2023-02-25 12:26:51,916][2409597] DAMAGECOUNT value on done: 29.0
[2023-02-25 12:26:51,920][2409100] DAMAGECOUNT value on done: 215.0
[2023-02-25 12:26:51,921][2409100] Sum rewards: -3.171, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.720', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.017', 'weapon4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'HITCOUNT': '0.170', 'DAMAGECOUNT': '0.615', 'WEAPON3': '0.700', 'weapon3': '1.284', 'weapon2': '1.598', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:52,001][2409405] DAMAGECOUNT value on done: 348.0
[2023-02-25 12:26:52,003][2409405] Sum rewards: -4.938, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.965', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.142', 'HITCOUNT': '0.190', 'DAMAGECOUNT': '0.819', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.426', 'weapon3': '1.462'}
[2023-02-25 12:26:52,116][2409077] DAMAGECOUNT value on done: 167.0
[2023-02-25 12:26:52,122][2409389] DAMAGECOUNT value on done: 275.0
[2023-02-25 12:26:52,123][2409389] Sum rewards: -0.993, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.143', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.030', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.053', 'HITCOUNT': '0.100', 'AMMO4': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.312', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.510', 'weapon3': '0.924', 'FRAGCOUNT': '1.000', 'weapon2': '1.380'}
[2023-02-25 12:26:52,135][2409102] DAMAGECOUNT value on done: 137.0
[2023-02-25 12:26:52,186][2408954] Fps is (10 sec: 26214.4, 60 sec: 25600.0, 300 sec: 25811.7). Total num frames: 11685888. Throughput: 0: 6426.4. Samples: 2915316. Policy #0 lag: (min: 0.0, avg: 12.5, max: 25.0)
[2023-02-25 12:26:52,186][2408954] Avg episode reward: [(0, '-4.366')]
[2023-02-25 12:26:52,731][2409548] DAMAGECOUNT value on done: 65.0
[2023-02-25 12:26:52,734][2409548] Sum rewards: -4.625, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.220', 'weapon5': '0.006', 'AMMO5': '0.014', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'HITCOUNT': '0.030', 'ARMOR': '0.040', 'AMMO3': '0.079', 'AMMO4': '0.090', 'DAMAGECOUNT': '0.105', 'WEAPON4': '0.150', 'weapon4': '0.236', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'weapon3': '0.932', 'weapon2': '1.624'}
[2023-02-25 12:26:52,769][2409355] DAMAGECOUNT value on done: 260.0
[2023-02-25 12:26:52,781][2409101] DAMAGECOUNT value on done: 254.0
[2023-02-25 12:26:52,785][2409101] Sum rewards: -7.922, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.020', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.005', 'AMMO2': '0.016', 'ARMOR': '0.036', 'weapon5': '0.042', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'weapon4': '0.110', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'DAMAGECOUNT': '0.567', 'WEAPON3': '0.850', 'weapon3': '1.412', 'weapon2': '1.424'}
[2023-02-25 12:26:52,807][2409866] DAMAGECOUNT value on done: 107.0
[2023-02-25 12:26:52,962][2409074] Updated weights for policy 0, policy_version 2860 (0.0012)
[2023-02-25 12:26:53,234][2409103] DAMAGECOUNT value on done: 204.0
[2023-02-25 12:26:53,237][2409103] Sum rewards: -3.118, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.230', 'AMMO2': '0.020', 'AMMO3': '0.091', 'AMMO4': '0.100', 'HITCOUNT': '0.110', 'DAMAGECOUNT': '0.246', 'WEAPON4': '0.250', 'weapon4': '0.288', 'WEAPON3': '0.500', 'weapon3': '1.168', 'weapon2': '1.338', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:53,306][2409099] DAMAGECOUNT value on done: 116.0
[2023-02-25 12:26:53,395][2409096] DAMAGECOUNT value on done: 40.0
[2023-02-25 12:26:53,528][2409485] DAMAGECOUNT value on done: 60.0
[2023-02-25 12:26:53,529][2409485] Sum rewards: -3.432, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.473', 'AMMO5': '0.004', 'AMMO2': '0.013', 'ARMOR': '0.020', 'weapon5': '0.046', 'HITCOUNT': '0.050', 'weapon7': '0.052', 'AMMO4': '0.065', 'AMMO3': '0.081', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.336', 'WEAPON3': '0.450', 'weapon3': '0.836', 'FRAGCOUNT': '1.000', 'weapon2': '1.678'}
[2023-02-25 12:26:53,619][2409105] DAMAGECOUNT value on done: 177.0
[2023-02-25 12:26:53,622][2409105] Sum rewards: -4.573, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.984', 'AMMO2': '0.018', 'ARMOR': '0.056', 'AMMO4': '0.090', 'HITCOUNT': '0.100', 'weapon4': '0.110', 'AMMO3': '0.129', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.118', 'weapon2': '1.440'}
[2023-02-25 12:26:53,689][2409373] DAMAGECOUNT value on done: 269.0
[2023-02-25 12:26:53,690][2409373] Sum rewards: -5.753, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.532', 'AMMO2': '0.021', 'AMMO4': '0.104', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'weapon4': '0.170', 'DAMAGECOUNT': '0.675', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.102', 'weapon2': '1.756'}
[2023-02-25 12:26:53,849][2409468] DAMAGECOUNT value on done: 114.0
[2023-02-25 12:26:53,850][2409468] Sum rewards: -6.645, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.246', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'WEAPON1': '0.020', 'weapon4': '0.042', 'ARMOR': '0.044', 'WEAPON4': '0.050', 'HITCOUNT': '0.090', 'AMMO3': '0.147', 'DAMAGECOUNT': '0.282', 'WEAPON3': '0.800', 'weapon3': '0.996', 'FRAGCOUNT': '1.000', 'weapon2': '1.880'}
[2023-02-25 12:26:53,853][2409407] DAMAGECOUNT value on done: 122.0
[2023-02-25 12:26:53,857][2409407] Sum rewards: -3.736, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.430', 'AMMO2': '0.004', 'AMMO4': '0.022', 'HITCOUNT': '0.080', 'AMMO3': '0.120', 'DAMAGECOUNT': '0.351', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.160', 'weapon2': '1.506'}
[2023-02-25 12:26:53,912][2409080] DAMAGECOUNT value on done: 415.0
[2023-02-25 12:26:53,913][2409080] Sum rewards: -1.634, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.478', 'AMMO2': '0.009', 'ARMOR': '0.036', 'AMMO4': '0.043', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'HITCOUNT': '0.190', 'weapon4': '0.228', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.795', 'FRAGCOUNT': '1.000', 'weapon2': '1.186', 'weapon3': '1.442'}
[2023-02-25 12:26:54,473][2409078] DAMAGECOUNT value on done: 179.0
[2023-02-25 12:26:54,476][2409078] Sum rewards: -6.943, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.352', 'AMMO5': '0.003', 'weapon5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'HITCOUNT': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.120', 'weapon4': '0.136', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.507', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.348', 'weapon3': '1.352'}
[2023-02-25 12:26:54,698][2409596] DAMAGECOUNT value on done: 170.0
[2023-02-25 12:26:54,769][2409074] Updated weights for policy 0, policy_version 2870 (0.0012)
[2023-02-25 12:26:54,774][2409406] DAMAGECOUNT value on done: 129.0
[2023-02-25 12:26:54,775][2409406] Sum rewards: -2.584, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.590', 'AMMO2': '0.010', 'AMMO4': '0.051', 'HITCOUNT': '0.080', 'AMMO3': '0.087', 'DAMAGECOUNT': '0.372', 'ARMOR': '0.465', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.216', 'weapon2': '1.724'}
[2023-02-25 12:26:54,835][2409075] DAMAGECOUNT value on done: 120.0
[2023-02-25 12:26:54,881][2409565] DAMAGECOUNT value on done: 128.0
[2023-02-25 12:26:54,993][2409097] DAMAGECOUNT value on done: 69.0
[2023-02-25 12:26:55,022][2409469] DAMAGECOUNT value on done: 164.0
[2023-02-25 12:26:55,024][2409469] Sum rewards: -5.385, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.080', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.033', 'ARMOR': '0.048', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'HITCOUNT': '0.120', 'AMMO4': '0.163', 'weapon4': '0.298', 'WEAPON4': '0.400', 'DAMAGECOUNT': '0.432', 'WEAPON3': '0.500', 'weapon3': '0.946', 'FRAGCOUNT': '1.000', 'weapon2': '1.568'}
[2023-02-25 12:26:55,074][2409547] DAMAGECOUNT value on done: 185.0
[2023-02-25 12:26:55,080][2409547] Sum rewards: -3.622, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.504', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'AMMO5': '0.010', 'ARMOR': '0.028', 'WEAPON1': '0.040', 'weapon5': '0.046', 'AMMO3': '0.118', 'HITCOUNT': '0.120', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.298', 'weapon2': '1.458'}
[2023-02-25 12:26:55,319][2409549] DAMAGECOUNT value on done: 228.0
[2023-02-25 12:26:55,320][2409549] Sum rewards: -2.995, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.470', 'AMMO2': '0.038', 'weapon4': '0.064', 'AMMO3': '0.117', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'AMMO4': '0.191', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.609', 'WEAPON3': '0.650', 'weapon3': '1.170', 'weapon2': '1.706', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:55,388][2409076] DAMAGECOUNT value on done: 230.0
[2023-02-25 12:26:55,389][2409076] Sum rewards: -9.178, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-3.000', 'HEALTH': '-1.320', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'weapon5': '0.024', 'ARMOR': '0.052', 'AMMO4': '0.092', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.135', 'weapon4': '0.226', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.750', 'weapon3': '1.268', 'weapon2': '1.516'}
[2023-02-25 12:26:55,518][2409100] DAMAGECOUNT value on done: 170.0
[2023-02-25 12:26:55,522][2409100] Sum rewards: -2.807, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.540', 'AMMO4': '-0.059', 'AMMO2': '-0.012', 'AMMO5': '0.010', 'weapon5': '0.012', 'HITCOUNT': '0.120', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.178', 'weapon2': '1.688'}
[2023-02-25 12:26:55,604][2409102] DAMAGECOUNT value on done: 162.0
[2023-02-25 12:26:55,616][2409104] DAMAGECOUNT value on done: 95.0
[2023-02-25 12:26:55,714][2409597] DAMAGECOUNT value on done: 97.0
[2023-02-25 12:26:55,749][2409079] DAMAGECOUNT value on done: 108.0
[2023-02-25 12:26:55,750][2409079] Sum rewards: -3.523, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.929', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.014', 'weapon4': '0.032', 'HITCOUNT': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'DAMAGECOUNT': '0.309', 'ARMOR': '0.489', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.262', 'weapon2': '1.438'}
[2023-02-25 12:26:55,765][2409077] DAMAGECOUNT value on done: 64.0
[2023-02-25 12:26:55,766][2409077] Sum rewards: -4.698, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.108', 'AMMO2': '0.009', 'ARMOR': '0.040', 'AMMO4': '0.045', 'HITCOUNT': '0.070', 'AMMO3': '0.158', 'DAMAGECOUNT': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.282', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.016', 'weapon2': '1.560'}
[2023-02-25 12:26:55,804][2409389] DAMAGECOUNT value on done: 10.0
[2023-02-25 12:26:55,834][2409486] DAMAGECOUNT value on done: 268.0
[2023-02-25 12:26:55,837][2409486] Sum rewards: -2.347, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.268', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.009', 'weapon5': '0.034', 'AMMO4': '0.045', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.052', 'HITCOUNT': '0.100', 'AMMO3': '0.108', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.096', 'weapon3': '1.710'}
[2023-02-25 12:26:55,899][2409405] DAMAGECOUNT value on done: 150.0
[2023-02-25 12:26:55,900][2409405] Sum rewards: -1.637, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.394', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.121', 'weapon4': '0.128', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.600', 'weapon3': '1.146', 'weapon2': '1.622', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:56,288][2409101] DAMAGECOUNT value on done: 182.0
[2023-02-25 12:26:56,404][2409355] DAMAGECOUNT value on done: 165.0
[2023-02-25 12:26:56,430][2409866] DAMAGECOUNT value on done: 160.0
[2023-02-25 12:26:56,431][2409866] Sum rewards: -5.163, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.009', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.014', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'AMMO3': '0.130', 'HITCOUNT': '0.150', 'ARMOR': '0.440', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.700', 'weapon3': '1.338', 'weapon2': '1.826'}
[2023-02-25 12:26:56,438][2409074] Updated weights for policy 0, policy_version 2880 (0.0012)
[2023-02-25 12:26:56,620][2409548] DAMAGECOUNT value on done: 255.0
[2023-02-25 12:26:56,620][2409548] Sum rewards: -0.640, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.190', 'AMMO2': '0.007', 'ARMOR': '0.016', 'AMMO4': '0.034', 'AMMO3': '0.042', 'HITCOUNT': '0.060', 'weapon7': '0.074', 'weapon4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.285', 'WEAPON3': '0.300', 'weapon3': '0.680', 'FRAGCOUNT': '1.000', 'weapon2': '1.812'}
[2023-02-25 12:26:56,905][2409103] DAMAGECOUNT value on done: 380.0
[2023-02-25 12:26:56,919][2409103] Sum rewards: -5.333, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.360', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'weapon4': '0.140', 'HITCOUNT': '0.210', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.789', 'weapon3': '0.964', 'weapon2': '1.852', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:26:57,136][2409373] DAMAGECOUNT value on done: 117.0
[2023-02-25 12:26:57,137][2409373] Sum rewards: -3.838, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.370', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'HITCOUNT': '0.060', 'ARMOR': '0.072', 'AMMO3': '0.115', 'DAMAGECOUNT': '0.255', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.310', 'weapon2': '1.492'}
[2023-02-25 12:26:57,186][2408954] Fps is (10 sec: 25395.3, 60 sec: 25395.2, 300 sec: 25770.1). Total num frames: 11808768. Throughput: 0: 6428.3. Samples: 2954424. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0)
[2023-02-25 12:26:57,186][2408954] Avg episode reward: [(0, '-4.357')]
[2023-02-25 12:26:57,226][2409485] DAMAGECOUNT value on done: 120.0
[2023-02-25 12:26:57,267][2409099] DAMAGECOUNT value on done: 112.0
[2023-02-25 12:26:57,387][2409105] DAMAGECOUNT value on done: 59.0
[2023-02-25 12:26:57,485][2409407] DAMAGECOUNT value on done: 345.0
[2023-02-25 12:26:57,489][2409407] Sum rewards: -5.020, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.332', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon4': '0.068', 'AMMO4': '0.079', 'HITCOUNT': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.130', 'DAMAGECOUNT': '0.285', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.108', 'weapon2': '1.494'}
[2023-02-25 12:26:57,490][2409096] DAMAGECOUNT value on done: 249.0
[2023-02-25 12:26:57,494][2409096] Sum rewards: -2.788, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.280', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.112', 'HITCOUNT': '0.180', 'ARMOR': '0.475', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.672', 'weapon3': '0.938', 'weapon2': '1.938', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:26:58,057][2409074] Updated weights for policy 0, policy_version 2890 (0.0012)
[2023-02-25 12:26:58,219][2409468] DAMAGECOUNT value on done: 90.0
[2023-02-25 12:26:58,222][2409468] Sum rewards: -2.120, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.960', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.033', 'HITCOUNT': '0.090', 'weapon4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.152', 'DAMAGECOUNT': '0.255', 'ARMOR': '0.480', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.072', 'weapon2': '1.552'}
[2023-02-25 12:26:58,259][2409080] DAMAGECOUNT value on done: 39.0
[2023-02-25 12:26:58,260][2409080] Sum rewards: -6.152, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.150', 'AMMO2': '0.033', 'HITCOUNT': '0.050', 'weapon4': '0.096', 'DAMAGECOUNT': '0.102', 'AMMO3': '0.133', 'AMMO4': '0.165', 'WEAPON4': '0.250', 'ARMOR': '0.416', 'WEAPON3': '0.750', 'weapon3': '0.796', 'FRAGCOUNT': '1.000', 'weapon2': '1.956'}
[2023-02-25 12:26:58,310][2409078] DAMAGECOUNT value on done: 157.0
[2023-02-25 12:26:58,405][2409596] DAMAGECOUNT value on done: 170.0
[2023-02-25 12:26:58,406][2409596] Sum rewards: -6.329, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.457', 'AMMO2': '0.013', 'AMMO4': '0.067', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.142', 'ARMOR': '0.440', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.800', 'weapon3': '0.978', 'FRAGCOUNT': '1.000', 'weapon2': '1.508'}
[2023-02-25 12:26:58,443][2409565] DAMAGECOUNT value on done: 189.0
[2023-02-25 12:26:58,444][2409565] Sum rewards: -7.627, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.266', 'ARMOR': '0.016', 'AMMO2': '0.023', 'HITCOUNT': '0.100', 'weapon4': '0.114', 'AMMO4': '0.117', 'AMMO3': '0.163', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.106', 'weapon2': '1.640'}
[2023-02-25 12:26:58,582][2409406] DAMAGECOUNT value on done: 120.0
[2023-02-25 12:26:58,608][2409075] DAMAGECOUNT value on done: 373.0
[2023-02-25 12:26:58,609][2409075] Sum rewards: -2.495, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.563', 'AMMO2': '0.029', 'ARMOR': '0.088', 'AMMO4': '0.146', 'HITCOUNT': '0.150', 'AMMO3': '0.171', 'weapon4': '0.234', 'WEAPON4': '0.400', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.684', 'weapon3': '0.844', 'weapon2': '1.922', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:58,660][2409097] DAMAGECOUNT value on done: 213.0
[2023-02-25 12:26:58,662][2409097] Sum rewards: -3.716, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.315', 'AMMO2': '0.018', 'HITCOUNT': '0.080', 'AMMO4': '0.090', 'AMMO3': '0.137', 'weapon4': '0.180', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.384', 'ARMOR': '0.420', 'WEAPON3': '0.650', 'weapon3': '0.924', 'FRAGCOUNT': '1.000', 'weapon2': '1.716'}
[2023-02-25 12:26:58,822][2409547] DAMAGECOUNT value on done: 98.0
[2023-02-25 12:26:58,958][2409076] DAMAGECOUNT value on done: 140.0
[2023-02-25 12:26:58,980][2409469] DAMAGECOUNT value on done: 264.0
[2023-02-25 12:26:58,980][2409469] Sum rewards: -2.029, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.948', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'ARMOR': '0.048', 'weapon4': '0.068', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.126', 'HITCOUNT': '0.150', 'DAMAGECOUNT': '0.636', 'WEAPON3': '0.700', 'weapon3': '1.180', 'weapon2': '1.790', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:26:59,062][2409549] DAMAGECOUNT value on done: 260.0
[2023-02-25 12:26:59,063][2409549] Sum rewards: -4.093, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.714', 'AMMO5': '0.003', 'AMMO2': '0.015', 'ARMOR': '0.024', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'weapon4': '0.142', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.158', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.705', 'WEAPON3': '0.850', 'weapon2': '1.142', 'weapon3': '1.634'}
[2023-02-25 12:26:59,155][2409102] DAMAGECOUNT value on done: 128.0
[2023-02-25 12:26:59,180][2409597] DAMAGECOUNT value on done: 366.0
[2023-02-25 12:26:59,181][2409597] Sum rewards: -6.848, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.870', 'AMMO2': '0.001', 'AMMO4': '0.005', 'weapon4': '0.048', 'WEAPON4': '0.050', 'HITCOUNT': '0.150', 'AMMO3': '0.221', 'DAMAGECOUNT': '0.738', 'weapon2': '1.074', 'WEAPON3': '1.300', 'weapon3': '1.684', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:59,251][2409074] Updated weights for policy 0, policy_version 2900 (0.0012)
[2023-02-25 12:26:59,336][2409100] DAMAGECOUNT value on done: 119.0
[2023-02-25 12:26:59,379][2409077] DAMAGECOUNT value on done: 55.0
[2023-02-25 12:26:59,387][2409104] DAMAGECOUNT value on done: 139.0
[2023-02-25 12:26:59,391][2409104] Sum rewards: -7.101, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.182', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.078', 'AMMO4': '0.092', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.342', 'ARMOR': '0.432', 'WEAPON3': '0.850', 'weapon3': '0.956', 'weapon2': '1.720', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:26:59,491][2409486] DAMAGECOUNT value on done: 90.0
[2023-02-25 12:26:59,566][2409389] DAMAGECOUNT value on done: 95.0
[2023-02-25 12:26:59,605][2409079] DAMAGECOUNT value on done: 200.0
[2023-02-25 12:26:59,623][2409079] Sum rewards: -2.791, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.421', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.018', 'ARMOR': '0.088', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'HITCOUNT': '0.140', 'weapon4': '0.142', 'DAMAGECOUNT': '0.585', 'WEAPON3': '0.600', 'weapon3': '0.748', 'FRAGCOUNT': '1.000', 'weapon2': '2.140'}
[2023-02-25 12:26:59,626][2409405] DAMAGECOUNT value on done: 90.0
[2023-02-25 12:27:00,009][2409101] DAMAGECOUNT value on done: 210.0
[2023-02-25 12:27:00,012][2409101] Sum rewards: -3.145, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.680', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'ARMOR': '0.040', 'weapon4': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.130', 'HITCOUNT': '0.150', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.850', 'weapon2': '1.394', 'weapon3': '1.566', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:27:00,204][2409355] DAMAGECOUNT value on done: 54.0
[2023-02-25 12:27:00,211][2409866] DAMAGECOUNT value on done: 117.0
[2023-02-25 12:27:00,312][2409548] DAMAGECOUNT value on done: 139.0
[2023-02-25 12:27:00,315][2409548] Sum rewards: -3.879, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.209', 'AMMO5': '0.010', 'ARMOR': '0.020', 'weapon7': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.070', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'HITCOUNT': '0.150', 'WEAPON4': '0.350', 'DAMAGECOUNT': '0.417', 'WEAPON3': '0.450', 'weapon4': '0.596', 'weapon3': '0.858', 'FRAGCOUNT': '1.000', 'weapon2': '1.354'}
[2023-02-25 12:27:00,645][2409103] DAMAGECOUNT value on done: 209.0
[2023-02-25 12:27:00,649][2409103] Sum rewards: -2.885, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.833', 'AMMO2': '0.020', 'ARMOR': '0.036', 'weapon4': '0.064', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.108', 'DAMAGECOUNT': '0.417', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.408', 'weapon2': '1.494'}
[2023-02-25 12:27:00,704][2409373] DAMAGECOUNT value on done: 165.0
[2023-02-25 12:27:00,706][2409373] Sum rewards: -3.064, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.473', 'AMMO2': '0.015', 'ARMOR': '0.064', 'AMMO4': '0.075', 'weapon4': '0.080', 'WEAPON4': '0.100', 'HITCOUNT': '0.140', 'AMMO3': '0.156', 'DAMAGECOUNT': '0.444', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.394', 'weapon3': '1.440'}
[2023-02-25 12:27:00,952][2409105] DAMAGECOUNT value on done: 145.0
[2023-02-25 12:27:00,953][2409105] Sum rewards: -1.982, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.130', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO3': '0.103', 'HITCOUNT': '0.110', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.390', 'ARMOR': '0.908', 'FRAGCOUNT': '1.000', 'weapon3': '1.158', 'weapon2': '1.932'}
[2023-02-25 12:27:00,970][2409485] DAMAGECOUNT value on done: 186.0
[2023-02-25 12:27:01,076][2409099] DAMAGECOUNT value on done: 310.0
[2023-02-25 12:27:01,077][2409099] Sum rewards: -2.813, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.018', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.122', 'HITCOUNT': '0.130', 'DAMAGECOUNT': '0.465', 'WEAPON3': '0.700', 'weapon2': '1.392', 'weapon3': '1.538', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:27:01,393][2409074] Updated weights for policy 0, policy_version 2910 (0.0012)
[2023-02-25 12:27:01,567][2409096] DAMAGECOUNT value on done: 99.0
[2023-02-25 12:27:01,762][2409407] DAMAGECOUNT value on done: 98.0
[2023-02-25 12:27:01,881][2409565] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:27:02,075][2409075] DAMAGECOUNT value on done: 70.0
[2023-02-25 12:27:02,186][2408954] Fps is (10 sec: 26214.4, 60 sec: 25804.8, 300 sec: 25839.5). Total num frames: 11948032. Throughput: 0: 6438.9. Samples: 2993664. Policy #0 lag: (min: 2.0, avg: 10.2, max: 26.0)
[2023-02-25 12:27:02,186][2408954] Avg episode reward: [(0, '-4.446')]
[2023-02-25 12:27:02,246][2409097] DAMAGECOUNT value on done: 247.0
[2023-02-25 12:27:02,249][2409097] Sum rewards: -1.013, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.010', 'ARMOR': '0.020', 'weapon4': '0.046', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'HITCOUNT': '0.100', 'HEALTH': '0.344', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.615', 'weapon3': '1.028', 'weapon2': '1.634', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:27:02,277][2409406] DAMAGECOUNT value on done: 49.0
[2023-02-25 12:27:02,318][2409074] Updated weights for policy 0, policy_version 2920 (0.0012)
[2023-02-25 12:27:02,361][2409078] DAMAGECOUNT value on done: 214.0
[2023-02-25 12:27:02,361][2409078] Sum rewards: -5.008, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.462', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.028', 'WEAPON5': '0.050', 'ARMOR': '0.052', 'AMMO3': '0.096', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'weapon4': '0.244', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.612', 'weapon3': '1.220', 'weapon2': '1.586', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:27:02,415][2409468] DAMAGECOUNT value on done: 120.0
[2023-02-25 12:27:02,434][2409080] DAMAGECOUNT value on done: 357.0
[2023-02-25 12:27:02,435][2409080] Sum rewards: -6.237, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.869', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.020', 'weapon4': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.097', 'AMMO3': '0.108', 'WEAPON4': '0.150', 'HITCOUNT': '0.230', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.660', 'weapon3': '1.160', 'weapon2': '1.952'}
[2023-02-25 12:27:02,480][2409547] DAMAGECOUNT value on done: 58.0
[2023-02-25 12:27:02,529][2409076] DAMAGECOUNT value on done: 120.0
[2023-02-25 12:27:02,530][2409076] Sum rewards: -5.242, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.750', 'FRAGCOUNT': '-1.500', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.009', 'HITCOUNT': '0.020', 'WEAPON1': '0.020', 'weapon5': '0.056', 'AMMO3': '0.081', 'DAMAGECOUNT': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.104', 'WEAPON5': '0.200', 'WEAPON3': '0.500', 'ARMOR': '0.915', 'weapon3': '0.934', 'weapon2': '1.754'}
[2023-02-25 12:27:02,567][2409596] DAMAGECOUNT value on done: 154.0
[2023-02-25 12:27:02,571][2409596] Sum rewards: -2.134, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.014', 'ARMOR': '0.068', 'AMMO4': '0.071', 'AMMO3': '0.087', 'HITCOUNT': '0.090', 'HEALTH': '0.168', 'DAMAGECOUNT': '0.372', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.144', 'weapon2': '1.852'}
[2023-02-25 12:27:02,580][2409102] DAMAGECOUNT value on done: 145.0
[2023-02-25 12:27:02,591][2409549] DAMAGECOUNT value on done: 159.0
[2023-02-25 12:27:02,736][2409597] DAMAGECOUNT value on done: 65.0
[2023-02-25 12:27:02,739][2409597] Sum rewards: -3.919, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.385', 'AMMO2': '0.013', 'ARMOR': '0.028', 'AMMO3': '0.042', 'HITCOUNT': '0.050', 'AMMO4': '0.063', 'DAMAGECOUNT': '0.180', 'WEAPON3': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.272', 'weapon3': '0.606', 'FRAGCOUNT': '1.000', 'weapon2': '2.262'}
[2023-02-25 12:27:03,012][2409100] DAMAGECOUNT value on done: 82.0
[2023-02-25 12:27:03,041][2409077] DAMAGECOUNT value on done: 261.0
[2023-02-25 12:27:03,041][2409077] Sum rewards: -3.142, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.595', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.021', 'weapon5': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'HITCOUNT': '0.180', 'WEAPON5': '0.200', 'weapon4': '0.216', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.678', 'weapon3': '1.040', 'weapon2': '1.472', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:27:03,050][2409469] DAMAGECOUNT value on done: 167.0
[2023-02-25 12:27:03,053][2409469] Sum rewards: -1.622, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.026', 'ARMOR': '0.028', 'HEALTH': '0.036', 'AMMO3': '0.078', 'HITCOUNT': '0.090', 'AMMO4': '0.132', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.246', 'weapon4': '0.404', 'WEAPON3': '0.450', 'weapon3': '0.884', 'FRAGCOUNT': '1.000', 'weapon2': '1.554'}
[2023-02-25 12:27:03,080][2409389] DAMAGECOUNT value on done: 150.0
[2023-02-25 12:27:03,210][2409486] DAMAGECOUNT value on done: 55.0
[2023-02-25 12:27:03,214][2409486] Sum rewards: -4.728, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.160', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'HITCOUNT': '0.030', 'weapon4': '0.068', 'AMMO4': '0.083', 'DAMAGECOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.147', 'ARMOR': '0.459', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.022', 'weapon2': '1.746'}
[2023-02-25 12:27:03,529][2409101] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:27:03,532][2409101] Sum rewards: -2.043, reward structure: {'DEATHCOUNT': '-3.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.290', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.016', 'weapon5': '0.052', 'AMMO3': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.108', 'WEAPON5': '0.150', 'WEAPON3': '0.350', 'weapon2': '1.116', 'weapon3': '1.334'}
[2023-02-25 12:27:03,683][2409104] DAMAGECOUNT value on done: 120.0
[2023-02-25 12:27:03,696][2409355] DAMAGECOUNT value on done: 140.0
[2023-02-25 12:27:03,699][2409355] Sum rewards: -4.094, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.234', 'AMMO2': '0.026', 'ARMOR': '0.040', 'AMMO3': '0.086', 'HITCOUNT': '0.100', 'weapon4': '0.126', 'AMMO4': '0.128', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.270', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.290', 'weapon2': '1.574'}
[2023-02-25 12:27:03,717][2409866] DAMAGECOUNT value on done: 95.0
[2023-02-25 12:27:03,804][2409405] DAMAGECOUNT value on done: 193.0
[2023-02-25 12:27:03,807][2409405] Sum rewards: 0.361, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.063', 'AMMO5': '0.003', 'weapon5': '0.026', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'AMMO3': '0.109', 'HITCOUNT': '0.130', 'AMMO4': '0.132', 'weapon4': '0.142', 'WEAPON4': '0.250', 'WEAPON3': '0.500', 'ARMOR': '0.549', 'DAMAGECOUNT': '0.549', 'weapon3': '1.166', 'weapon2': '1.542', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:27:03,943][2409548] DAMAGECOUNT value on done: 95.0
[2023-02-25 12:27:03,944][2409548] Sum rewards: -8.090, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.024', 'AMMO2': '0.014', 'AMMO4': '0.068', 'HITCOUNT': '0.070', 'weapon4': '0.118', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'DAMAGECOUNT': '0.225', 'WEAPON3': '0.900', 'weapon3': '1.046', 'weapon2': '1.822', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:27:04,203][2409103] DAMAGECOUNT value on done: 115.0
[2023-02-25 12:27:04,208][2409103] Sum rewards: -5.813, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.476', 'AMMO2': '0.016', 'ARMOR': '0.024', 'AMMO4': '0.078', 'HITCOUNT': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.124', 'AMMO3': '0.173', 'DAMAGECOUNT': '0.210', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.050', 'weapon3': '1.376', 'weapon2': '1.432'}
[2023-02-25 12:27:04,259][2409373] DAMAGECOUNT value on done: 262.0
[2023-02-25 12:27:04,262][2409373] Sum rewards: -0.112, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.029', 'HEALTH': '0.035', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.065', 'HITCOUNT': '0.100', 'AMMO4': '0.146', 'weapon4': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.250', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.756', 'weapon3': '0.756', 'ARMOR': '0.848', 'weapon2': '1.854'}
[2023-02-25 12:27:04,331][2409079] DAMAGECOUNT value on done: 174.0
[2023-02-25 12:27:04,331][2409079] Sum rewards: -8.629, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.758', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.030', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.060', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.199', 'DAMAGECOUNT': '0.297', 'WEAPON3': '1.100', 'weapon2': '1.440', 'weapon3': '1.452'}
[2023-02-25 12:27:04,464][2409074] Updated weights for policy 0, policy_version 2930 (0.0012)
[2023-02-25 12:27:04,605][2409485] DAMAGECOUNT value on done: 70.0
[2023-02-25 12:27:04,643][2409105] DAMAGECOUNT value on done: 303.0
[2023-02-25 12:27:04,647][2409105] Sum rewards: -4.877, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.316', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.030', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'AMMO3': '0.110', 'HITCOUNT': '0.110', 'AMMO4': '0.185', 'weapon4': '0.292', 'WEAPON4': '0.350', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.717', 'weapon3': '0.974', 'FRAGCOUNT': '1.000', 'weapon2': '1.724'}
[2023-02-25 12:27:04,840][2409099] DAMAGECOUNT value on done: 286.0
[2023-02-25 12:27:04,841][2409099] Sum rewards: -2.743, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.600', 'AMMO5': '0.015', 'weapon5': '0.042', 'AMMO2': '0.044', 'ARMOR': '0.074', 'AMMO3': '0.093', 'WEAPON5': '0.200', 'HITCOUNT': '0.210', 'AMMO4': '0.218', 'WEAPON3': '0.400', 'weapon4': '0.430', 'WEAPON4': '0.450', 'DAMAGECOUNT': '0.858', 'weapon3': '0.892', 'weapon2': '1.682', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:27:05,300][2409033] Signal inference workers to stop experience collection... (400 times)
[2023-02-25 12:27:05,317][2409033] Signal inference workers to resume experience collection... (400 times)
[2023-02-25 12:27:05,319][2409096] DAMAGECOUNT value on done: 135.0
[2023-02-25 12:27:05,339][2409074] InferenceWorker_p0-w0: stopping experience collection (400 times)
[2023-02-25 12:27:05,346][2409074] InferenceWorker_p0-w0: resuming experience collection (400 times)
[2023-02-25 12:27:05,748][2409074] Updated weights for policy 0, policy_version 2940 (0.0012)
[2023-02-25 12:27:05,800][2409406] DAMAGECOUNT value on done: 265.0
[2023-02-25 12:27:05,802][2409406] Sum rewards: -3.962, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.900', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'ARMOR': '0.032', 'AMMO3': '0.116', 'HITCOUNT': '0.200', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.735', 'weapon3': '1.398', 'weapon2': '1.714', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:27:05,873][2409565] DAMAGECOUNT value on done: 153.0
[2023-02-25 12:27:05,874][2409565] Sum rewards: -5.072, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.349', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'AMMO4': '0.121', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'weapon3': '0.616', 'FRAGCOUNT': '1.000', 'weapon2': '2.556'}
[2023-02-25 12:27:06,007][2409407] DAMAGECOUNT value on done: 29.0
[2023-02-25 12:27:06,042][2409468] DAMAGECOUNT value on done: 319.0
[2023-02-25 12:27:06,047][2409468] Sum rewards: -5.040, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.314', 'AMMO5': '0.003', 'AMMO2': '0.011', 'ARMOR': '0.024', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'HITCOUNT': '0.170', 'AMMO3': '0.226', 'DAMAGECOUNT': '0.690', 'WEAPON3': '1.050', 'weapon2': '1.344', 'weapon3': '1.614', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:27:06,054][2409080] DAMAGECOUNT value on done: 60.0
[2023-02-25 12:27:06,066][2409076] DAMAGECOUNT value on done: 139.0
[2023-02-25 12:27:06,095][2409097] DAMAGECOUNT value on done: 152.0
[2023-02-25 12:27:06,097][2409097] Sum rewards: -6.871, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.460', 'AMMO2': '0.002', 'AMMO4': '0.012', 'weapon4': '0.090', 'AMMO3': '0.139', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.456', 'ARMOR': '0.487', 'weapon3': '0.706', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '2.156'}
[2023-02-25 12:27:06,164][2409549] DAMAGECOUNT value on done: 50.0
[2023-02-25 12:27:06,178][2409075] DAMAGECOUNT value on done: 220.0
[2023-02-25 12:27:06,179][2409075] Sum rewards: -5.416, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.191', 'AMMO2': '0.027', 'HITCOUNT': '0.070', 'ARMOR': '0.096', 'weapon4': '0.114', 'AMMO3': '0.133', 'AMMO4': '0.135', 'DAMAGECOUNT': '0.195', 'WEAPON4': '0.350', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.052', 'weapon2': '1.902'}
[2023-02-25 12:27:06,284][2409078] DAMAGECOUNT value on done: 225.0
[2023-02-25 12:27:06,287][2409078] Sum rewards: -3.619, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.754', 'AMMO5': '0.003', 'AMMO2': '0.014', 'ARMOR': '0.021', 'WEAPON5': '0.050', 'weapon4': '0.054', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'HITCOUNT': '0.140', 'AMMO3': '0.144', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.750', 'weapon3': '1.428', 'weapon2': '1.468', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:27:06,366][2409547] DAMAGECOUNT value on done: 75.0
[2023-02-25 12:27:06,377][2409596] DAMAGECOUNT value on done: 100.0
[2023-02-25 12:27:06,380][2409596] Sum rewards: -6.772, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.660', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'ARMOR': '0.020', 'AMMO4': '0.078', 'HITCOUNT': '0.110', 'AMMO3': '0.158', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.372', 'weapon2': '1.574'}
[2023-02-25 12:27:06,534][2409597] DAMAGECOUNT value on done: 154.0
[2023-02-25 12:27:06,536][2409597] Sum rewards: -3.318, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.312', 'AMMO2': '0.020', 'ARMOR': '0.088', 'AMMO4': '0.101', 'HITCOUNT': '0.110', 'AMMO3': '0.139', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.282', 'weapon4': '0.442', 'WEAPON3': '0.700', 'weapon3': '0.758', 'FRAGCOUNT': '1.000', 'weapon2': '1.704'}
[2023-02-25 12:27:06,643][2409102] DAMAGECOUNT value on done: 129.0
[2023-02-25 12:27:06,646][2409102] Sum rewards: -0.856, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.572', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.009', 'weapon5': '0.028', 'HITCOUNT': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.108', 'AMMO3': '0.109', 'DAMAGECOUNT': '0.267', 'ARMOR': '0.496', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.380', 'weapon3': '1.432'}
[2023-02-25 12:27:06,655][2409077] DAMAGECOUNT value on done: 175.0
[2023-02-25 12:27:06,826][2409486] DAMAGECOUNT value on done: 175.0
[2023-02-25 12:27:06,827][2409486] Sum rewards: -3.610, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.902', 'AMMO2': '0.004', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'weapon4': '0.070', 'HITCOUNT': '0.110', 'AMMO3': '0.111', 'DAMAGECOUNT': '0.405', 'ARMOR': '0.424', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.290', 'weapon2': '1.456'}
[2023-02-25 12:27:06,830][2409100] DAMAGECOUNT value on done: 138.0
[2023-02-25 12:27:06,830][2409100] Sum rewards: -5.265, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.020', 'HITCOUNT': '0.080', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.125', 'weapon5': '0.126', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.201', 'HEALTH': '0.280', 'WEAPON3': '0.550', 'weapon3': '0.956', 'weapon2': '1.768'}
[2023-02-25 12:27:07,027][2409074] Updated weights for policy 0, policy_version 2950 (0.0012)
[2023-02-25 12:27:07,169][2409389] DAMAGECOUNT value on done: 100.0
[2023-02-25 12:27:07,186][2408954] Fps is (10 sec: 27442.3, 60 sec: 25873.0, 300 sec: 25881.1). Total num frames: 12083200. Throughput: 0: 6437.3. Samples: 3013056. Policy #0 lag: (min: 0.0, avg: 8.3, max: 24.0)
[2023-02-25 12:27:07,187][2408954] Avg episode reward: [(0, '-4.339')]
[2023-02-25 12:27:07,238][2409101] DAMAGECOUNT value on done: 215.0
[2023-02-25 12:27:07,238][2409101] Sum rewards: -6.291, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.040', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'weapon4': '0.062', 'AMMO4': '0.066', 'HITCOUNT': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.168', 'DAMAGECOUNT': '0.255', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.046', 'weapon2': '1.808'}
[2023-02-25 12:27:07,252][2409469] DAMAGECOUNT value on done: 30.0
[2023-02-25 12:27:07,272][2409104] DAMAGECOUNT value on done: 122.0
[2023-02-25 12:27:07,275][2409104] Sum rewards: -4.229, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.934', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'AMMO3': '0.079', 'ARMOR': '0.116', 'HITCOUNT': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.274', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.450', 'weapon3': '1.222', 'weapon2': '1.266'}
[2023-02-25 12:27:07,334][2409355] DAMAGECOUNT value on done: 110.0
[2023-02-25 12:27:07,356][2409866] DAMAGECOUNT value on done: 200.0
[2023-02-25 12:27:07,357][2409866] Sum rewards: -1.334, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.360', 'AMMO2': '0.004', 'WEAPON1': '0.020', 'AMMO4': '0.022', 'weapon4': '0.062', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.054', 'weapon3': '1.686'}
[2023-02-25 12:27:07,515][2409405] DAMAGECOUNT value on done: 240.0
[2023-02-25 12:27:07,517][2409405] Sum rewards: -2.509, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.020', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.018', 'ARMOR': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.111', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.218', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.600', 'weapon3': '0.856', 'weapon2': '1.956'}
[2023-02-25 12:27:07,750][2409373] DAMAGECOUNT value on done: 112.0
[2023-02-25 12:27:07,761][2409103] DAMAGECOUNT value on done: 359.0
[2023-02-25 12:27:07,764][2409103] Sum rewards: -3.891, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.768', 'AMMO2': '0.014', 'weapon4': '0.068', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'HITCOUNT': '0.170', 'AMMO3': '0.178', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.825', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.396', 'weapon3': '1.504'}
[2023-02-25 12:27:07,768][2409548] DAMAGECOUNT value on done: 140.0
[2023-02-25 12:27:08,030][2409079] DAMAGECOUNT value on done: 105.0
[2023-02-25 12:27:08,030][2409079] Sum rewards: -4.203, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO2': '0.028', 'HITCOUNT': '0.070', 'ARMOR': '0.092', 'HEALTH': '0.104', 'AMMO3': '0.113', 'AMMO4': '0.141', 'DAMAGECOUNT': '0.285', 'WEAPON4': '0.300', 'weapon4': '0.456', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.138', 'weapon3': '1.220'}
[2023-02-25 12:27:08,132][2409485] DAMAGECOUNT value on done: 110.0
[2023-02-25 12:27:08,135][2409485] Sum rewards: -5.792, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.502', 'AMMO2': '0.004', 'ARMOR': '0.005', 'AMMO4': '0.021', 'weapon4': '0.026', 'HITCOUNT': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.173', 'DAMAGECOUNT': '0.285', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.318', 'weapon3': '1.498'}
[2023-02-25 12:27:08,419][2409105] DAMAGECOUNT value on done: 137.0
[2023-02-25 12:27:08,561][2409099] DAMAGECOUNT value on done: 214.0
[2023-02-25 12:27:08,562][2409099] Sum rewards: -1.164, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.450', 'AMMO2': '0.003', 'AMMO4': '0.012', 'HITCOUNT': '0.050', 'ARMOR': '0.068', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.114', 'weapon4': '0.240', 'WEAPON3': '0.450', 'weapon3': '0.936', 'FRAGCOUNT': '1.000', 'weapon2': '1.484'}
[2023-02-25 12:27:09,182][2409074] Updated weights for policy 0, policy_version 2960 (0.0012)
[2023-02-25 12:27:09,504][2409096] DAMAGECOUNT value on done: 80.0
[2023-02-25 12:27:09,504][2409096] Sum rewards: -1.884, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.990', 'AMMO2': '0.020', 'HITCOUNT': '0.050', 'AMMO3': '0.093', 'AMMO4': '0.101', 'DAMAGECOUNT': '0.135', 'weapon4': '0.198', 'WEAPON4': '0.250', 'ARMOR': '0.450', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.212', 'weapon2': '1.746'}
[2023-02-25 12:27:09,544][2409565] DAMAGECOUNT value on done: 55.0
[2023-02-25 12:27:09,574][2409076] DAMAGECOUNT value on done: 106.0
[2023-02-25 12:27:09,591][2409406] DAMAGECOUNT value on done: 103.0
[2023-02-25 12:27:09,733][2409407] DAMAGECOUNT value on done: 135.0
[2023-02-25 12:27:09,734][2409407] Sum rewards: -2.917, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.106', 'AMMO2': '0.018', 'ARMOR': '0.024', 'HITCOUNT': '0.070', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'AMMO3': '0.126', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.402', 'weapon3': '1.552'}
[2023-02-25 12:27:09,896][2409075] DAMAGECOUNT value on done: 410.0
[2023-02-25 12:27:09,900][2409075] Sum rewards: -0.710, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'ARMOR': '0.028', 'AMMO3': '0.057', 'weapon5': '0.064', 'AMMO4': '0.077', 'weapon4': '0.096', 'HITCOUNT': '0.100', 'WEAPON4': '0.150', 'HEALTH': '0.152', 'WEAPON5': '0.200', 'WEAPON3': '0.300', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.738', 'weapon3': '1.242', 'weapon2': '1.550'}
[2023-02-25 12:27:09,925][2409078] DAMAGECOUNT value on done: 100.0
[2023-02-25 12:27:09,929][2409468] DAMAGECOUNT value on done: 154.0
[2023-02-25 12:27:09,931][2409080] DAMAGECOUNT value on done: 44.0
[2023-02-25 12:27:10,065][2409097] DAMAGECOUNT value on done: 205.0
[2023-02-25 12:27:10,068][2409097] Sum rewards: -0.975, reward structure: {'DEATHCOUNT': '-3.750', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.420', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.008', 'HITCOUNT': '0.030', 'AMMO4': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.066', 'weapon7': '0.092', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.278', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.480', 'weapon3': '0.598', 'weapon2': '1.154'}
[2023-02-25 12:27:10,082][2409596] DAMAGECOUNT value on done: 152.0
[2023-02-25 12:27:10,083][2409596] Sum rewards: -2.773, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.241', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.046', 'HITCOUNT': '0.050', 'AMMO4': '0.059', 'AMMO3': '0.076', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.212', 'DAMAGECOUNT': '0.396', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.204', 'weapon2': '1.306'}
[2023-02-25 12:27:10,128][2409597] DAMAGECOUNT value on done: 27.0
[2023-02-25 12:27:10,149][2409549] DAMAGECOUNT value on done: 175.0
[2023-02-25 12:27:10,217][2409102] DAMAGECOUNT value on done: 218.0
[2023-02-25 12:27:10,217][2409102] Sum rewards: 0.514, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'AMMO3': '0.051', 'HITCOUNT': '0.090', 'ARMOR': '0.116', 'AMMO4': '0.166', 'WEAPON4': '0.200', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.339', 'weapon4': '0.486', 'HEALTH': '0.664', 'FRAGCOUNT': '1.000', 'weapon3': '1.032', 'weapon2': '1.220'}
[2023-02-25 12:27:10,388][2409547] DAMAGECOUNT value on done: 95.0
[2023-02-25 12:27:10,391][2409547] Sum rewards: -8.151, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.956', 'FRAGCOUNT': '-1.500', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.014', 'ARMOR': '0.040', 'weapon5': '0.044', 'HITCOUNT': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'WEAPON4': '0.150', 'weapon4': '0.178', 'DAMAGECOUNT': '0.180', 'WEAPON3': '0.700', 'weapon3': '1.072', 'weapon2': '1.642'}
[2023-02-25 12:27:10,394][2409074] Updated weights for policy 0, policy_version 2970 (0.0012)
[2023-02-25 12:27:10,440][2409077] DAMAGECOUNT value on done: 313.0
[2023-02-25 12:27:10,441][2409077] Sum rewards: -3.623, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.690', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'HITCOUNT': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'weapon4': '0.126', 'DAMAGECOUNT': '0.336', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.386', 'weapon3': '1.464'}
[2023-02-25 12:27:10,492][2409100] DAMAGECOUNT value on done: 355.0
[2023-02-25 12:27:10,493][2409100] Sum rewards: -1.875, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.410', 'AMMO2': '0.033', 'AMMO3': '0.093', 'AMMO4': '0.165', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.264', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.675', 'weapon3': '1.094', 'weapon2': '1.640', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:27:10,623][2409486] DAMAGECOUNT value on done: 135.0
[2023-02-25 12:27:10,889][2409389] DAMAGECOUNT value on done: 294.0
[2023-02-25 12:27:10,892][2409389] Sum rewards: -5.995, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.572', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.005', 'ARMOR': '0.020', 'weapon5': '0.020', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'AMMO3': '0.103', 'AMMO4': '0.142', 'HITCOUNT': '0.170', 'weapon4': '0.192', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.612', 'weapon2': '1.140', 'weapon3': '1.494'}
[2023-02-25 12:27:10,968][2409469] DAMAGECOUNT value on done: 270.0
[2023-02-25 12:27:10,969][2409469] Sum rewards: -4.491, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.390', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.014', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'HITCOUNT': '0.060', 'AMMO4': '0.071', 'AMMO3': '0.089', 'weapon4': '0.126', 'DAMAGECOUNT': '0.180', 'WEAPON4': '0.200', 'WEAPON3': '0.500', 'weapon3': '1.220', 'weapon2': '1.614'}
[2023-02-25 12:27:10,981][2409104] DAMAGECOUNT value on done: 250.0
[2023-02-25 12:27:10,982][2409104] Sum rewards: -2.666, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.653', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'ARMOR': '0.036', 'weapon4': '0.078', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'HITCOUNT': '0.110', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.264', 'weapon3': '1.590'}
[2023-02-25 12:27:11,109][2409405] DAMAGECOUNT value on done: 545.0
[2023-02-25 12:27:11,112][2409405] Sum rewards: -2.049, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.012', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.074', 'AMMO3': '0.138', 'HITCOUNT': '0.190', 'HEALTH': '0.424', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.819', 'FRAGCOUNT': '1.000', 'weapon2': '1.112', 'weapon3': '1.532'}
[2023-02-25 12:27:11,298][2409373] DAMAGECOUNT value on done: 166.0
[2023-02-25 12:27:11,390][2409103] DAMAGECOUNT value on done: 170.0
[2023-02-25 12:27:11,391][2409103] Sum rewards: -3.097, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.835', 'AMMO2': '0.001', 'AMMO4': '0.006', 'HITCOUNT': '0.110', 'AMMO3': '0.127', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.482', 'weapon3': '1.582'}
[2023-02-25 12:27:11,455][2409355] DAMAGECOUNT value on done: 242.0
[2023-02-25 12:27:11,456][2409355] Sum rewards: -1.447, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.322', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'WEAPON5': '0.050', 'AMMO3': '0.071', 'AMMO4': '0.093', 'weapon4': '0.096', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.576', 'FRAGCOUNT': '1.000', 'weapon3': '1.268', 'weapon2': '1.694'}
[2023-02-25 12:27:11,476][2409866] DAMAGECOUNT value on done: 163.0
[2023-02-25 12:27:11,477][2409866] Sum rewards: -3.164, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.159', 'weapon4': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.026', 'WEAPON4': '0.050', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'HITCOUNT': '0.140', 'AMMO3': '0.146', 'ARMOR': '0.432', 'DAMAGECOUNT': '0.474', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.276', 'weapon2': '1.668'}
[2023-02-25 12:27:11,569][2409548] DAMAGECOUNT value on done: 43.0
[2023-02-25 12:27:11,674][2409079] DAMAGECOUNT value on done: 90.0
[2023-02-25 12:27:11,777][2409485] DAMAGECOUNT value on done: 90.0
[2023-02-25 12:27:11,780][2409485] Sum rewards: 1.487, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.007', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.058', 'HITCOUNT': '0.090', 'weapon4': '0.090', 'HEALTH': '0.160', 'DAMAGECOUNT': '0.240', 'WEAPON3': '0.350', 'ARMOR': '0.404', 'FRAGCOUNT': '1.000', 'weapon3': '1.230', 'weapon2': '1.522'}
[2023-02-25 12:27:11,832][2409101] DAMAGECOUNT value on done: 30.0
[2023-02-25 12:27:11,915][2409105] DAMAGECOUNT value on done: 180.0
[2023-02-25 12:27:12,186][2408954] Fps is (10 sec: 24576.1, 60 sec: 25736.5, 300 sec: 25770.1). Total num frames: 12193792. Throughput: 0: 6460.3. Samples: 3052044. Policy #0 lag: (min: 0.0, avg: 9.0, max: 25.0)
[2023-02-25 12:27:12,186][2408954] Avg episode reward: [(0, '-4.131')]
[2023-02-25 12:27:12,223][2409099] DAMAGECOUNT value on done: 302.0
[2023-02-25 12:27:12,226][2409099] Sum rewards: -3.094, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.210', 'weapon4': '0.006', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'HITCOUNT': '0.200', 'ARMOR': '0.461', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.831', 'FRAGCOUNT': '1.000', 'weapon2': '1.364', 'weapon3': '1.594'}
[2023-02-25 12:27:12,454][2409074] Updated weights for policy 0, policy_version 2980 (0.0012)
[2023-02-25 12:27:13,102][2409565] DAMAGECOUNT value on done: 94.0
[2023-02-25 12:27:13,122][2409076] DAMAGECOUNT value on done: 135.0
[2023-02-25 12:27:13,123][2409076] Sum rewards: -5.889, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.300', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.004', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.060', 'AMMO4': '0.065', 'WEAPON5': '0.100', 'HITCOUNT': '0.120', 'weapon4': '0.148', 'AMMO3': '0.149', 'DAMAGECOUNT': '0.315', 'WEAPON3': '0.800', 'weapon3': '1.148', 'weapon2': '1.168'}
[2023-02-25 12:27:13,200][2409096] DAMAGECOUNT value on done: 195.0
[2023-02-25 12:27:13,333][2409407] DAMAGECOUNT value on done: 142.0
[2023-02-25 12:27:13,403][2409406] DAMAGECOUNT value on done: 366.0
[2023-02-25 12:27:13,406][2409406] Sum rewards: -1.691, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.342', 'AMMO5': '0.004', 'AMMO2': '0.016', 'weapon5': '0.050', 'ARMOR': '0.076', 'AMMO4': '0.077', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'weapon4': '0.182', 'WEAPON4': '0.200', 'WEAPON3': '0.600', 'weapon3': '1.022', 'DAMAGECOUNT': '1.038', 'weapon2': '1.576', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:27:13,533][2409080] DAMAGECOUNT value on done: 246.0
[2023-02-25 12:27:13,538][2409468] DAMAGECOUNT value on done: 140.0
[2023-02-25 12:27:13,539][2409468] Sum rewards: -4.358, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.316', 'AMMO2': '0.013', 'weapon7': '0.058', 'HITCOUNT': '0.060', 'AMMO4': '0.066', 'AMMO3': '0.115', 'weapon4': '0.148', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.324', 'weapon2': '1.364'}
[2023-02-25 12:27:13,544][2409596] DAMAGECOUNT value on done: 160.0
[2023-02-25 12:27:13,555][2409074] Updated weights for policy 0, policy_version 2990 (0.0012)
[2023-02-25 12:27:13,729][2409102] DAMAGECOUNT value on done: 210.0
[2023-02-25 12:27:13,926][2409075] DAMAGECOUNT value on done: 185.0
[2023-02-25 12:27:13,945][2409597] DAMAGECOUNT value on done: 264.0
[2023-02-25 12:27:13,966][2409097] DAMAGECOUNT value on done: 230.0
[2023-02-25 12:27:13,967][2409097] Sum rewards: -4.219, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.135', 'AMMO2': '0.031', 'weapon4': '0.112', 'AMMO3': '0.131', 'HITCOUNT': '0.150', 'AMMO4': '0.153', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.495', 'ARMOR': '0.500', 'WEAPON3': '0.750', 'weapon3': '1.166', 'weapon2': '1.678', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:27:14,152][2409100] DAMAGECOUNT value on done: 240.0
[2023-02-25 12:27:14,153][2409100] Sum rewards: -3.741, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.092', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'weapon5': '0.004', 'weapon4': '0.012', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.103', 'HITCOUNT': '0.150', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.675', 'weapon3': '1.366', 'weapon2': '1.566'}
[2023-02-25 12:27:14,198][2409077] DAMAGECOUNT value on done: 182.0
[2023-02-25 12:27:14,303][2409486] DAMAGECOUNT value on done: 151.0
[2023-02-25 12:27:14,304][2409486] Sum rewards: -6.069, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.424', 'AMMO2': '0.003', 'AMMO5': '0.013', 'AMMO4': '0.014', 'weapon4': '0.026', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'HITCOUNT': '0.110', 'weapon5': '0.126', 'AMMO3': '0.150', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.378', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.800', 'weapon3': '1.180', 'weapon2': '1.464'}
[2023-02-25 12:27:14,329][2409547] DAMAGECOUNT value on done: 221.0
[2023-02-25 12:27:14,333][2409547] Sum rewards: -4.349, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.116', 'AMMO5': '0.003', 'AMMO2': '0.034', 'HITCOUNT': '0.090', 'ARMOR': '0.092', 'AMMO3': '0.127', 'AMMO4': '0.172', 'WEAPON4': '0.350', 'DAMAGECOUNT': '0.351', 'weapon4': '0.412', 'weapon3': '0.564', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.922'}
[2023-02-25 12:27:14,333][2409078] DAMAGECOUNT value on done: 200.0
[2023-02-25 12:27:14,334][2409078] Sum rewards: -2.197, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.448', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.073', 'ARMOR': '0.076', 'WEAPON5': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'weapon4': '0.194', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.700', 'weapon2': '1.202', 'weapon3': '1.466', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:27:14,444][2409549] DAMAGECOUNT value on done: 242.0
[2023-02-25 12:27:14,471][2409104] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:27:14,621][2409469] DAMAGECOUNT value on done: 15.0
[2023-02-25 12:27:14,622][2409469] Sum rewards: -8.144, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.222', 'AMMO5': '0.003', 'weapon5': '0.004', 'HITCOUNT': '0.010', 'AMMO2': '0.014', 'DAMAGECOUNT': '0.015', 'WEAPON5': '0.050', 'ARMOR': '0.062', 'AMMO4': '0.068', 'AMMO3': '0.144', 'weapon4': '0.182', 'WEAPON4': '0.200', 'WEAPON3': '0.800', 'weapon3': '1.250', 'weapon2': '1.526'}
[2023-02-25 12:27:14,770][2409373] DAMAGECOUNT value on done: 155.0
[2023-02-25 12:27:14,826][2409074] Updated weights for policy 0, policy_version 3000 (0.0013)
[2023-02-25 12:27:14,906][2409389] DAMAGECOUNT value on done: 203.0
[2023-02-25 12:27:15,045][2409103] DAMAGECOUNT value on done: 89.0
[2023-02-25 12:27:15,166][2409548] DAMAGECOUNT value on done: 200.0
[2023-02-25 12:27:15,167][2409548] Sum rewards: -4.296, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.555', 'AMMO2': '0.012', 'ARMOR': '0.020', 'AMMO4': '0.059', 'HITCOUNT': '0.070', 'weapon4': '0.102', 'AMMO3': '0.117', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.072', 'weapon2': '1.862'}
[2023-02-25 12:27:15,289][2409355] DAMAGECOUNT value on done: 325.0
[2023-02-25 12:27:15,292][2409355] Sum rewards: -2.515, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.190', 'AMMO2': '0.024', 'weapon4': '0.086', 'HITCOUNT': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.615', 'WEAPON3': '0.750', 'weapon2': '1.452', 'weapon3': '1.488', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:27:15,313][2409866] DAMAGECOUNT value on done: 238.0
[2023-02-25 12:27:15,314][2409866] Sum rewards: 0.315, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.725', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'HITCOUNT': '0.080', 'AMMO3': '0.086', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.381', 'FRAGCOUNT': '1.000', 'weapon3': '1.436', 'weapon2': '1.474'}
[2023-02-25 12:27:15,332][2409079] DAMAGECOUNT value on done: 160.0
[2023-02-25 12:27:15,408][2409101] DAMAGECOUNT value on done: 219.0
[2023-02-25 12:27:15,409][2409101] Sum rewards: -5.516, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.070', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO3': '0.080', 'HITCOUNT': '0.080', 'DAMAGECOUNT': '0.222', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon3': '1.286', 'weapon2': '1.728'}
[2023-02-25 12:27:15,452][2409485] DAMAGECOUNT value on done: 145.0
[2023-02-25 12:27:15,556][2409405] DAMAGECOUNT value on done: 323.0
[2023-02-25 12:27:15,560][2409405] Sum rewards: -3.121, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.254', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.007', 'AMMO3': '0.184', 'HITCOUNT': '0.320', 'ARMOR': '0.465', 'DAMAGECOUNT': '0.909', 'WEAPON3': '0.950', 'weapon3': '1.360', 'weapon2': '1.682', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:27:15,929][2409099] DAMAGECOUNT value on done: 534.0
[2023-02-25 12:27:15,930][2409099] Sum rewards: -3.689, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.770', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.012', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'HITCOUNT': '0.180', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.687', 'weapon3': '1.244', 'weapon2': '1.480', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:27:16,066][2409105] DAMAGECOUNT value on done: 249.0
[2023-02-25 12:27:16,069][2409105] Sum rewards: -1.261, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.060', 'AMMO2': '0.016', 'ARMOR': '0.032', 'weapon4': '0.072', 'AMMO3': '0.077', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'HITCOUNT': '0.140', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.570', 'FRAGCOUNT': '1.000', 'weapon2': '1.408', 'weapon3': '1.602'}
[2023-02-25 12:27:16,565][2409565] DAMAGECOUNT value on done: 210.0
[2023-02-25 12:27:16,568][2409565] Sum rewards: -1.911, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.380', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.022', 'weapon5': '0.028', 'WEAPON5': '0.050', 'weapon4': '0.064', 'AMMO3': '0.101', 'AMMO4': '0.108', 'HITCOUNT': '0.140', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.585', 'WEAPON3': '0.600', 'weapon2': '1.158', 'weapon3': '1.650', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:27:16,667][2409076] DAMAGECOUNT value on done: 361.0
[2023-02-25 12:27:16,668][2409076] Sum rewards: -7.122, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.995', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.003', 'weapon5': '0.018', 'ARMOR': '0.020', 'WEAPON5': '0.050', 'HITCOUNT': '0.070', 'AMMO3': '0.126', 'WEAPON4': '0.150', 'weapon4': '0.152', 'DAMAGECOUNT': '0.525', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.032', 'weapon2': '1.726'}
[2023-02-25 12:27:16,688][2409096] DAMAGECOUNT value on done: 298.0
[2023-02-25 12:27:16,691][2409096] Sum rewards: -1.065, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.142', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.006', 'ARMOR': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.114', 'AMMO3': '0.128', 'HITCOUNT': '0.230', 'DAMAGECOUNT': '0.687', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.302', 'weapon3': '1.512'}
[2023-02-25 12:27:16,810][2409407] DAMAGECOUNT value on done: 75.0
[2023-02-25 12:27:16,948][2409074] Updated weights for policy 0, policy_version 3010 (0.0012)
[2023-02-25 12:27:17,186][2408954] Fps is (10 sec: 25396.1, 60 sec: 25804.8, 300 sec: 25867.3). Total num frames: 12337152. Throughput: 0: 6487.7. Samples: 3091584. Policy #0 lag: (min: 1.0, avg: 10.0, max: 26.0)
[2023-02-25 12:27:17,186][2408954] Avg episode reward: [(0, '-4.147')]
[2023-02-25 12:27:17,212][2409102] DAMAGECOUNT value on done: 210.0
[2023-02-25 12:27:17,258][2409596] DAMAGECOUNT value on done: 209.0
[2023-02-25 12:27:17,261][2409596] Sum rewards: -7.604, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.428', 'AMMO2': '0.008', 'ARMOR': '0.028', 'AMMO4': '0.038', 'HITCOUNT': '0.110', 'AMMO3': '0.196', 'DAMAGECOUNT': '0.270', 'weapon3': '0.964', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.050', 'weapon2': '2.160'}
[2023-02-25 12:27:17,352][2409406] DAMAGECOUNT value on done: 85.0
[2023-02-25 12:27:17,579][2409080] DAMAGECOUNT value on done: 168.0
[2023-02-25 12:27:17,579][2409080] Sum rewards: -1.744, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.830', 'AMMO2': '0.010', 'AMMO5': '0.010', 'weapon5': '0.030', 'AMMO4': '0.048', 'AMMO3': '0.055', 'weapon4': '0.060', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.345', 'weapon3': '0.864', 'FRAGCOUNT': '1.000', 'weapon2': '2.014'}
[2023-02-25 12:27:17,599][2409468] DAMAGECOUNT value on done: 185.0
[2023-02-25 12:27:17,600][2409468] Sum rewards: -8.470, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.158', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.012', 'weapon4': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'HITCOUNT': '0.160', 'AMMO3': '0.182', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.525', 'WEAPON3': '1.000', 'weapon3': '1.152', 'weapon2': '1.966'}
[2023-02-25 12:27:17,723][2409597] DAMAGECOUNT value on done: 345.0
[2023-02-25 12:27:17,726][2409597] Sum rewards: -0.885, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.249', 'AMMO2': '0.026', 'ARMOR': '0.040', 'weapon4': '0.078', 'HITCOUNT': '0.110', 'AMMO3': '0.118', 'AMMO4': '0.128', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.292', 'weapon3': '1.412'}
[2023-02-25 12:27:17,845][2409100] DAMAGECOUNT value on done: 115.0
[2023-02-25 12:27:17,951][2409097] DAMAGECOUNT value on done: 144.0
[2023-02-25 12:27:18,027][2409486] DAMAGECOUNT value on done: 215.0
[2023-02-25 12:27:18,028][2409486] Sum rewards: 1.317, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.432', 'AMMO2': '0.005', 'AMMO4': '0.024', 'AMMO3': '0.101', 'HITCOUNT': '0.170', 'ARMOR': '0.436', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.645', 'weapon3': '1.518', 'weapon2': '1.550', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:27:18,033][2409075] DAMAGECOUNT value on done: 45.0
[2023-02-25 12:27:18,037][2409075] Sum rewards: -2.821, reward structure: {'DEATHCOUNT': '-4.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.460', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.021', 'HITCOUNT': '0.030', 'WEAPON5': '0.050', 'DAMAGECOUNT': '0.075', 'ARMOR': '0.080', 'AMMO3': '0.082', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'weapon4': '0.364', 'WEAPON3': '0.500', 'weapon2': '0.756', 'weapon3': '1.364'}
[2023-02-25 12:27:18,100][2409469] DAMAGECOUNT value on done: 40.0
[2023-02-25 12:27:18,137][2409074] Updated weights for policy 0, policy_version 3020 (0.0012)
[2023-02-25 12:27:18,189][2409078] DAMAGECOUNT value on done: 140.0
[2023-02-25 12:27:18,192][2409078] Sum rewards: -3.847, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.540', 'ARMOR': '0.008', 'AMMO2': '0.009', 'AMMO4': '0.045', 'HITCOUNT': '0.090', 'AMMO3': '0.114', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.240', 'weapon4': '0.262', 'WEAPON3': '0.700', 'weapon3': '1.010', 'weapon2': '1.514', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:27:18,218][2409077] DAMAGECOUNT value on done: 92.0
[2023-02-25 12:27:18,219][2409077] Sum rewards: -8.983, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-3.000', 'HEALTH': '-2.100', 'AMMO2': '0.007', 'AMMO5': '0.016', 'AMMO4': '0.037', 'HITCOUNT': '0.060', 'weapon5': '0.102', 'AMMO3': '0.160', 'DAMAGECOUNT': '0.195', 'WEAPON5': '0.350', 'WEAPON3': '0.850', 'weapon2': '1.042', 'weapon3': '1.548'}
[2023-02-25 12:27:18,263][2409104] DAMAGECOUNT value on done: 245.0
[2023-02-25 12:27:18,265][2409104] Sum rewards: -6.240, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.985', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon5': '0.024', 'AMMO4': '0.044', 'ARMOR': '0.076', 'HITCOUNT': '0.080', 'AMMO3': '0.123', 'WEAPON5': '0.150', 'weapon4': '0.160', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.750', 'weapon2': '1.154', 'weapon3': '1.358'}
[2023-02-25 12:27:18,273][2409373] DAMAGECOUNT value on done: 214.0
[2023-02-25 12:27:18,274][2409373] Sum rewards: -2.422, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.818', 'AMMO2': '0.009', 'AMMO5': '0.015', 'weapon5': '0.028', 'AMMO4': '0.042', 'AMMO3': '0.074', 'HITCOUNT': '0.090', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.417', 'weapon4': '0.422', 'WEAPON3': '0.450', 'ARMOR': '0.457', 'weapon3': '0.832', 'weapon2': '1.460', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:27:18,295][2409549] DAMAGECOUNT value on done: 110.0
[2023-02-25 12:27:18,411][2409547] DAMAGECOUNT value on done: 125.0
[2023-02-25 12:27:18,412][2409547] Sum rewards: -3.270, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.226', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.034', 'WEAPON5': '0.050', 'HITCOUNT': '0.070', 'AMMO4': '0.075', 'ARMOR': '0.084', 'AMMO3': '0.105', 'WEAPON4': '0.250', 'weapon4': '0.326', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.550', 'weapon3': '0.768', 'FRAGCOUNT': '1.000', 'weapon2': '1.796'}
[2023-02-25 12:27:18,762][2409103] DAMAGECOUNT value on done: 180.0
[2023-02-25 12:27:18,801][2409355] DAMAGECOUNT value on done: 155.0
[2023-02-25 12:27:18,802][2409355] Sum rewards: -4.258, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.424', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon7': '0.032', 'HITCOUNT': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.104', 'DAMAGECOUNT': '0.195', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.410', 'WEAPON3': '0.450', 'weapon3': '0.936', 'FRAGCOUNT': '1.000', 'weapon2': '1.334'}
[2023-02-25 12:27:18,824][2409866] DAMAGECOUNT value on done: 130.0
[2023-02-25 12:27:19,013][2409389] DAMAGECOUNT value on done: 243.0
[2023-02-25 12:27:19,038][2409079] DAMAGECOUNT value on done: 170.0
[2023-02-25 12:27:19,163][2409485] DAMAGECOUNT value on done: 312.0
[2023-02-25 12:27:19,166][2409485] Sum rewards: 1.677, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'AMMO4': '0.054', 'HITCOUNT': '0.090', 'HEALTH': '0.138', 'WEAPON3': '0.250', 'DAMAGECOUNT': '0.336', 'ARMOR': '0.400', 'FRAGCOUNT': '1.000', 'weapon3': '1.052', 'weapon2': '2.036'}
[2023-02-25 12:27:19,199][2409548] DAMAGECOUNT value on done: 85.0
[2023-02-25 12:27:19,260][2409101] DAMAGECOUNT value on done: 140.0
[2023-02-25 12:27:19,261][2409101] Sum rewards: 0.880, reward structure: {'DEATHCOUNT': '-0.750', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.222', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.007', 'weapon5': '0.010', 'HITCOUNT': '0.020', 'ARMOR': '0.040', 'DAMAGECOUNT': '0.045', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'WEAPON3': '0.150', 'weapon2': '0.690', 'weapon3': '1.312'}
[2023-02-25 12:27:19,292][2409405] DAMAGECOUNT value on done: 131.0
[2023-02-25 12:27:19,294][2409405] Sum rewards: -7.344, reward structure: {'DEATHCOUNT': '-10.500', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.007', 'AMMO2': '0.028', 'HITCOUNT': '0.070', 'weapon5': '0.072', 'ARMOR': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.129', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'weapon4': '0.198', 'DAMAGECOUNT': '0.201', 'HEALTH': '0.228', 'WEAPON3': '0.700', 'weapon3': '0.858', 'weapon2': '1.698'}
[2023-02-25 12:27:19,604][2409105] DAMAGECOUNT value on done: 205.0
[2023-02-25 12:27:19,605][2409105] Sum rewards: -0.499, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.880', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO3': '0.084', 'HITCOUNT': '0.130', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.615', 'weapon2': '1.388', 'weapon3': '1.554', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:27:19,964][2409099] DAMAGECOUNT value on done: 469.0
[2023-02-25 12:27:19,967][2409099] Sum rewards: -0.811, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.830', 'AMMO2': '0.019', 'AMMO4': '0.096', 'AMMO3': '0.140', 'WEAPON4': '0.200', 'weapon4': '0.214', 'HITCOUNT': '0.260', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.017', 'weapon2': '1.204', 'weapon3': '1.518', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:27:20,199][2409076] DAMAGECOUNT value on done: 167.0
[2023-02-25 12:27:20,222][2409096] DAMAGECOUNT value on done: 135.0
[2023-02-25 12:27:20,225][2409096] Sum rewards: -5.441, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.832', 'AMMO2': '0.007', 'AMMO4': '0.037', 'HITCOUNT': '0.070', 'AMMO3': '0.195', 'DAMAGECOUNT': '0.330', 'ARMOR': '0.412', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.050', 'weapon2': '1.068', 'weapon3': '1.722'}
[2023-02-25 12:27:20,348][2409074] Updated weights for policy 0, policy_version 3030 (0.0012)
[2023-02-25 12:27:20,469][2409565] DAMAGECOUNT value on done: 234.0
[2023-02-25 12:27:20,473][2409565] Sum rewards: -0.263, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.880', 'AMMO2': '0.006', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.029', 'weapon5': '0.048', 'AMMO3': '0.132', 'HITCOUNT': '0.140', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.585', 'WEAPON3': '0.700', 'weapon3': '1.268', 'weapon2': '1.780', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:27:20,546][2409407] DAMAGECOUNT value on done: 128.0
[2023-02-25 12:27:20,971][2409596] DAMAGECOUNT value on done: 155.0
[2023-02-25 12:27:20,973][2409596] Sum rewards: -1.380, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.268', 'AMMO2': '0.004', 'AMMO4': '0.020', 'HITCOUNT': '0.090', 'weapon7': '0.094', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.260', 'ARMOR': '0.416', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.600', 'weapon3': '0.908', 'FRAGCOUNT': '1.000', 'weapon2': '1.436'}
[2023-02-25 12:27:21,086][2409102] DAMAGECOUNT value on done: 74.0
[2023-02-25 12:27:21,241][2409597] DAMAGECOUNT value on done: 69.0
[2023-02-25 12:27:21,242][2409597] Sum rewards: -7.570, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.358', 'AMMO5': '0.005', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.018', 'HITCOUNT': '0.020', 'AMMO4': '0.035', 'DAMAGECOUNT': '0.045', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'WEAPON3': '0.850', 'weapon2': '1.388', 'weapon3': '1.616'}
[2023-02-25 12:27:21,241][2409406] DAMAGECOUNT value on done: 211.0
[2023-02-25 12:27:21,246][2409406] Sum rewards: 1.859, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.910', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.023', 'weapon5': '0.068', 'HITCOUNT': '0.090', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.261', 'WEAPON3': '0.450', 'weapon2': '1.158', 'weapon3': '1.512', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:27:21,249][2409074] Updated weights for policy 0, policy_version 3040 (0.0013)
[2023-02-25 12:27:21,317][2409080] DAMAGECOUNT value on done: 390.0
[2023-02-25 12:27:21,450][2409468] DAMAGECOUNT value on done: 104.0
[2023-02-25 12:27:21,618][2409097] DAMAGECOUNT value on done: 114.0
[2023-02-25 12:27:21,619][2409075] DAMAGECOUNT value on done: 135.0
[2023-02-25 12:27:21,622][2409075] Sum rewards: -3.059, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.127', 'AMMO5': '0.005', 'weapon5': '0.020', 'AMMO2': '0.024', 'ARMOR': '0.048', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.115', 'AMMO4': '0.120', 'WEAPON4': '0.250', 'weapon4': '0.292', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.092', 'weapon3': '1.332'}
[2023-02-25 12:27:21,785][2409100] DAMAGECOUNT value on done: 30.0
[2023-02-25 12:27:21,819][2409549] DAMAGECOUNT value on done: 250.0
[2023-02-25 12:27:21,822][2409549] Sum rewards: -5.744, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.132', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'weapon4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'HITCOUNT': '0.170', 'ARMOR': '0.457', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.032', 'weapon2': '2.148'}
[2023-02-25 12:27:21,851][2409486] DAMAGECOUNT value on done: 85.0
[2023-02-25 12:27:21,854][2409486] Sum rewards: -2.335, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.177', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'ARMOR': '0.008', 'AMMO3': '0.069', 'HITCOUNT': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.174', 'DAMAGECOUNT': '0.225', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon3': '1.340', 'weapon2': '1.428'}
[2023-02-25 12:27:21,884][2409469] DAMAGECOUNT value on done: 200.0
[2023-02-25 12:27:21,886][2409104] DAMAGECOUNT value on done: 85.0
[2023-02-25 12:27:21,887][2409469] Sum rewards: -7.108, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.381', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.021', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.148', 'HITCOUNT': '0.170', 'DAMAGECOUNT': '0.540', 'WEAPON3': '0.750', 'weapon3': '1.330', 'weapon2': '1.352'}
[2023-02-25 12:27:21,886][2409077] DAMAGECOUNT value on done: 158.0
[2023-02-25 12:27:21,890][2409077] Sum rewards: -2.312, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.003', 'AMMO2': '0.020', 'HEALTH': '0.022', 'ARMOR': '0.024', 'HITCOUNT': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.066', 'weapon4': '0.070', 'AMMO4': '0.097', 'AMMO3': '0.112', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.266', 'weapon3': '1.358'}
[2023-02-25 12:27:21,903][2409373] DAMAGECOUNT value on done: 80.0
[2023-02-25 12:27:22,176][2409078] DAMAGECOUNT value on done: 60.0
[2023-02-25 12:27:22,186][2408954] Fps is (10 sec: 27852.8, 60 sec: 25941.3, 300 sec: 25922.8). Total num frames: 12472320. Throughput: 0: 6501.1. Samples: 3110904. Policy #0 lag: (min: 1.0, avg: 9.8, max: 26.0)
[2023-02-25 12:27:22,186][2408954] Avg episode reward: [(0, '-3.891')]
[2023-02-25 12:27:22,437][2409103] DAMAGECOUNT value on done: 164.0
[2023-02-25 12:27:22,441][2409103] Sum rewards: -1.736, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.872', 'AMMO2': '0.021', 'ARMOR': '0.052', 'HITCOUNT': '0.070', 'AMMO3': '0.090', 'AMMO4': '0.104', 'weapon4': '0.196', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.357', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.002', 'weapon2': '1.394'}
[2023-02-25 12:27:22,573][2409547] DAMAGECOUNT value on done: 96.0
[2023-02-25 12:27:22,663][2409355] DAMAGECOUNT value on done: 265.0
[2023-02-25 12:27:22,664][2409355] Sum rewards: 0.378, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.376', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon4': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.134', 'HITCOUNT': '0.180', 'ARMOR': '0.408', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.750', 'weapon3': '1.446', 'weapon2': '1.598', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:27:22,698][2409866] DAMAGECOUNT value on done: 54.0
[2023-02-25 12:27:22,780][2409101] DAMAGECOUNT value on done: 348.0
[2023-02-25 12:27:22,783][2409101] Sum rewards: -2.868, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.444', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.146', 'HITCOUNT': '0.200', 'ARMOR': '0.440', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.864', 'weapon2': '1.422', 'weapon3': '1.442', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:27:22,868][2409485] DAMAGECOUNT value on done: 80.0
[2023-02-25 12:27:22,869][2409485] Sum rewards: -6.165, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.928', 'AMMO2': '0.009', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'HITCOUNT': '0.080', 'AMMO3': '0.156', 'DAMAGECOUNT': '0.225', 'weapon4': '0.302', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.132', 'weapon3': '1.362'}
[2023-02-25 12:27:22,983][2409389] DAMAGECOUNT value on done: 85.0
[2023-02-25 12:27:23,013][2409074] Updated weights for policy 0, policy_version 3050 (0.0013)
[2023-02-25 12:27:23,051][2409548] DAMAGECOUNT value on done: 80.0
[2023-02-25 12:27:23,054][2409548] Sum rewards: -6.762, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.218', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.011', 'weapon4': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'HITCOUNT': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.149', 'DAMAGECOUNT': '0.180', 'ARMOR': '0.400', 'WEAPON3': '0.850', 'weapon3': '1.412', 'weapon2': '1.418'}
[2023-02-25 12:27:23,074][2409079] DAMAGECOUNT value on done: 167.0
[2023-02-25 12:27:23,075][2409079] Sum rewards: -2.541, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.496', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'weapon4': '0.022', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'HITCOUNT': '0.090', 'weapon5': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.354', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.190', 'weapon2': '1.612'}
[2023-02-25 12:27:23,260][2409405] DAMAGECOUNT value on done: 50.0
[2023-02-25 12:27:23,558][2409105] DAMAGECOUNT value on done: 140.0
[2023-02-25 12:27:23,559][2409105] Sum rewards: -3.747, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.690', 'AMMO2': '0.004', 'weapon5': '0.010', 'AMMO5': '0.015', 'ARMOR': '0.020', 'AMMO4': '0.020', 'HITCOUNT': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.136', 'weapon4': '0.144', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.285', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.028', 'weapon3': '1.530'}
[2023-02-25 12:27:23,666][2409099] DAMAGECOUNT value on done: 315.0
[2023-02-25 12:27:23,667][2409099] Sum rewards: -4.695, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.868', 'AMMO2': '0.006', 'weapon4': '0.016', 'AMMO4': '0.031', 'ARMOR': '0.037', 'WEAPON4': '0.100', 'AMMO3': '0.146', 'HITCOUNT': '0.190', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.735', 'weapon3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.462'}
[2023-02-25 12:27:23,754][2409076] DAMAGECOUNT value on done: 321.0
[2023-02-25 12:27:23,757][2409076] Sum rewards: -4.106, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.820', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.012', 'ARMOR': '0.024', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'HITCOUNT': '0.080', 'weapon4': '0.118', 'AMMO3': '0.124', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.273', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.600', 'weapon3': '1.324', 'weapon2': '1.466'}
[2023-02-25 12:27:24,006][2409096] DAMAGECOUNT value on done: 19.0
[2023-02-25 12:27:24,231][2409565] DAMAGECOUNT value on done: 301.0
[2023-02-25 12:27:24,489][2409596] DAMAGECOUNT value on done: 79.0
[2023-02-25 12:27:24,525][2409407] DAMAGECOUNT value on done: 70.0
[2023-02-25 12:27:24,720][2409074] Updated weights for policy 0, policy_version 3060 (0.0013)
[2023-02-25 12:27:24,905][2409102] DAMAGECOUNT value on done: 248.0
[2023-02-25 12:27:24,909][2409102] Sum rewards: -2.028, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.839', 'AMMO2': '0.022', 'weapon4': '0.064', 'AMMO4': '0.109', 'AMMO3': '0.136', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'ARMOR': '0.420', 'DAMAGECOUNT': '0.540', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.400', 'weapon3': '1.520'}
[2023-02-25 12:27:25,205][2409597] DAMAGECOUNT value on done: 226.0
[2023-02-25 12:27:25,208][2409597] Sum rewards: -2.531, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.141', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.020', 'HITCOUNT': '0.020', 'AMMO3': '0.075', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'weapon5': '0.114', 'weapon4': '0.218', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon3': '1.044', 'weapon2': '1.502'}
[2023-02-25 12:27:25,238][2409080] DAMAGECOUNT value on done: 85.0
[2023-02-25 12:27:25,239][2409080] Sum rewards: -0.309, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.298', 'AMMO2': '0.016', 'HITCOUNT': '0.060', 'AMMO3': '0.069', 'ARMOR': '0.076', 'AMMO4': '0.081', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'DAMAGECOUNT': '0.210', 'WEAPON4': '0.300', 'weapon4': '0.350', 'WEAPON3': '0.450', 'weapon3': '0.988', 'weapon2': '1.538', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:27:25,277][2409549] DAMAGECOUNT value on done: 125.0
[2023-02-25 12:27:25,277][2409549] Sum rewards: -3.090, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.070', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'HITCOUNT': '0.060', 'ARMOR': '0.084', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'weapon4': '0.156', 'DAMAGECOUNT': '0.195', 'WEAPON3': '0.450', 'weapon3': '1.198', 'weapon2': '1.712'}
[2023-02-25 12:27:25,294][2409406] DAMAGECOUNT value on done: 155.0
[2023-02-25 12:27:25,297][2409406] Sum rewards: -4.462, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.356', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.020', 'HITCOUNT': '0.080', 'AMMO4': '0.092', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'weapon4': '0.174', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.500', 'weapon3': '1.266', 'weapon2': '1.716'}
[2023-02-25 12:27:25,335][2409468] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:27:25,366][2409373] DAMAGECOUNT value on done: 75.0
[2023-02-25 12:27:25,413][2409104] DAMAGECOUNT value on done: 291.0
[2023-02-25 12:27:25,413][2409104] Sum rewards: 0.775, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.488', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.045', 'WEAPON4': '0.050', 'ARMOR': '0.100', 'HITCOUNT': '0.160', 'WEAPON3': '0.300', 'weapon4': '0.322', 'DAMAGECOUNT': '0.693', 'FRAGCOUNT': '1.000', 'weapon3': '1.012', 'weapon2': '1.320'}
[2023-02-25 12:27:25,417][2409469] DAMAGECOUNT value on done: 140.0
[2023-02-25 12:27:25,514][2409075] DAMAGECOUNT value on done: 89.0
[2023-02-25 12:27:25,519][2409486] DAMAGECOUNT value on done: 168.0
[2023-02-25 12:27:25,601][2409097] DAMAGECOUNT value on done: 198.0
[2023-02-25 12:27:25,602][2409097] Sum rewards: -7.282, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.729', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.013', 'AMMO2': '0.014', 'AMMO4': '0.070', 'HITCOUNT': '0.090', 'weapon4': '0.104', 'weapon5': '0.104', 'AMMO3': '0.132', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.466', 'DAMAGECOUNT': '0.594', 'weapon3': '0.682', 'weapon2': '2.178'}
[2023-02-25 12:27:25,694][2409100] DAMAGECOUNT value on done: 97.0
[2023-02-25 12:27:25,695][2409100] Sum rewards: -3.760, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.710', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.018', 'ARMOR': '0.029', 'HITCOUNT': '0.070', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'DAMAGECOUNT': '0.225', 'WEAPON4': '0.300', 'weapon4': '0.418', 'WEAPON3': '0.650', 'weapon3': '0.888', 'FRAGCOUNT': '1.000', 'weapon2': '1.544'}
[2023-02-25 12:27:25,784][2409078] DAMAGECOUNT value on done: 80.0
[2023-02-25 12:27:25,876][2409077] DAMAGECOUNT value on done: 145.0
[2023-02-25 12:27:26,043][2409074] Updated weights for policy 0, policy_version 3070 (0.0012)
[2023-02-25 12:27:26,253][2409101] DAMAGECOUNT value on done: 290.0
[2023-02-25 12:27:26,254][2409101] Sum rewards: -3.663, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.780', 'weapon4': '0.016', 'AMMO2': '0.020', 'ARMOR': '0.044', 'WEAPON4': '0.050', 'AMMO4': '0.097', 'AMMO3': '0.143', 'HITCOUNT': '0.220', 'DAMAGECOUNT': '0.705', 'WEAPON3': '0.800', 'weapon3': '1.352', 'weapon2': '1.670', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:27:26,341][2409547] DAMAGECOUNT value on done: 112.0
[2023-02-25 12:27:26,345][2409547] Sum rewards: -3.956, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.960', 'AMMO2': '0.007', 'AMMO4': '0.036', 'HITCOUNT': '0.110', 'AMMO3': '0.141', 'DAMAGECOUNT': '0.246', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.432', 'weapon2': '1.482'}
[2023-02-25 12:27:26,535][2409389] DAMAGECOUNT value on done: 107.0
[2023-02-25 12:27:26,536][2409389] Sum rewards: -1.982, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.922', 'ARMOR': '0.004', 'AMMO2': '0.024', 'HITCOUNT': '0.070', 'AMMO3': '0.105', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.210', 'weapon4': '0.292', 'WEAPON3': '0.450', 'weapon3': '0.604', 'FRAGCOUNT': '1.000', 'weapon2': '1.912'}
[2023-02-25 12:27:26,802][2409405] DAMAGECOUNT value on done: 395.0
[2023-02-25 12:27:26,803][2409405] Sum rewards: -0.789, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.919', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.010', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon4': '0.122', 'HITCOUNT': '0.180', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.660', 'weapon3': '1.110', 'weapon2': '1.698', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:27:26,866][2409485] DAMAGECOUNT value on done: 245.0
[2023-02-25 12:27:26,934][2409355] DAMAGECOUNT value on done: 208.0
[2023-02-25 12:27:26,937][2409355] Sum rewards: -9.234, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.945', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.009', 'weapon5': '0.036', 'WEAPON4': '0.050', 'HITCOUNT': '0.080', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.204', 'WEAPON3': '0.750', 'weapon3': '1.260', 'weapon2': '1.700'}
[2023-02-25 12:27:26,966][2409548] DAMAGECOUNT value on done: 115.0
[2023-02-25 12:27:26,966][2409548] Sum rewards: -4.500, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.937', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'weapon5': '0.022', 'AMMO2': '0.023', 'ARMOR': '0.045', 'WEAPON5': '0.050', 'HITCOUNT': '0.080', 'AMMO3': '0.089', 'weapon4': '0.090', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.210', 'WEAPON3': '0.550', 'weapon3': '1.322', 'weapon2': '1.690'}
[2023-02-25 12:27:26,980][2409866] DAMAGECOUNT value on done: 205.0
[2023-02-25 12:27:26,984][2409866] Sum rewards: -4.164, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.570', 'weapon4': '0.016', 'AMMO2': '0.019', 'ARMOR': '0.026', 'HITCOUNT': '0.080', 'AMMO4': '0.094', 'AMMO3': '0.139', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.188', 'weapon3': '1.644'}
[2023-02-25 12:27:27,116][2409105] DAMAGECOUNT value on done: 170.0
[2023-02-25 12:27:27,117][2409105] Sum rewards: -5.292, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.202', 'AMMO5': '0.005', 'weapon5': '0.006', 'ARMOR': '0.016', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'AMMO4': '0.112', 'AMMO3': '0.126', 'HITCOUNT': '0.130', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.084', 'weapon2': '2.018'}
[2023-02-25 12:27:27,186][2408954] Fps is (10 sec: 25804.7, 60 sec: 25873.1, 300 sec: 25825.6). Total num frames: 12595200. Throughput: 0: 6509.6. Samples: 3149952. Policy #0 lag: (min: 0.0, avg: 9.7, max: 24.0)
[2023-02-25 12:27:27,186][2408954] Avg episode reward: [(0, '-3.728')]
[2023-02-25 12:27:27,312][2409099] DAMAGECOUNT value on done: 214.0
[2023-02-25 12:27:27,313][2409099] Sum rewards: -0.571, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.864', 'AMMO4': '-0.084', 'AMMO2': '-0.017', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'AMMO3': '0.127', 'HITCOUNT': '0.170', 'DAMAGECOUNT': '0.612', 'WEAPON3': '0.800', 'weapon3': '1.292', 'weapon2': '1.864', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:27:27,335][2409079] DAMAGECOUNT value on done: 90.0
[2023-02-25 12:27:27,505][2409076] DAMAGECOUNT value on done: 115.0
[2023-02-25 12:27:27,651][2409096] DAMAGECOUNT value on done: 367.0
[2023-02-25 12:27:27,656][2409096] Sum rewards: -3.758, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.867', 'AMMO2': '0.009', 'AMMO4': '0.043', 'ARMOR': '0.084', 'AMMO3': '0.139', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.252', 'DAMAGECOUNT': '0.726', 'WEAPON3': '0.800', 'weapon2': '1.242', 'weapon3': '1.264', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:27:27,999][2409596] DAMAGECOUNT value on done: 320.0
[2023-02-25 12:27:28,003][2409596] Sum rewards: -6.746, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.954', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'ARMOR': '0.052', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.136', 'weapon4': '0.136', 'DAMAGECOUNT': '0.555', 'WEAPON3': '0.650', 'weapon3': '1.172', 'weapon2': '1.794', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:27:28,100][2409074] Updated weights for policy 0, policy_version 3080 (0.0012)
[2023-02-25 12:27:28,109][2409565] DAMAGECOUNT value on done: 134.0
[2023-02-25 12:27:28,110][2409565] Sum rewards: -4.837, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.000', 'AMMO2': '0.007', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO4': '0.034', 'weapon5': '0.066', 'HITCOUNT': '0.100', 'AMMO3': '0.103', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.286', 'DAMAGECOUNT': '0.297', 'WEAPON3': '0.600', 'weapon3': '0.822', 'weapon2': '1.682'}
[2023-02-25 12:27:28,681][2409549] DAMAGECOUNT value on done: 320.0
[2023-02-25 12:27:28,682][2409549] Sum rewards: 3.665, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.325', 'AMMO2': '0.022', 'AMMO3': '0.085', 'AMMO4': '0.108', 'weapon4': '0.160', 'HITCOUNT': '0.170', 'WEAPON4': '0.250', 'ARMOR': '0.432', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.945', 'weapon3': '1.426', 'weapon2': '1.442', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:27:28,713][2409406] DAMAGECOUNT value on done: 369.0
[2023-02-25 12:27:28,714][2409406] Sum rewards: -1.549, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.928', 'ARMOR': '0.020', 'AMMO2': '0.025', 'weapon4': '0.062', 'AMMO4': '0.124', 'AMMO3': '0.127', 'WEAPON4': '0.250', 'HITCOUNT': '0.290', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.017', 'weapon3': '1.056', 'weapon2': '1.908', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:27:28,847][2409407] DAMAGECOUNT value on done: 260.0
[2023-02-25 12:27:28,848][2409407] Sum rewards: 1.933, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.765', 'AMMO2': '0.008', 'AMMO4': '0.039', 'AMMO3': '0.059', 'ARMOR': '0.086', 'HITCOUNT': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.294', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.510', 'weapon3': '0.954', 'weapon2': '1.578', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:27:28,861][2409080] DAMAGECOUNT value on done: 100.0
[2023-02-25 12:27:28,922][2409104] DAMAGECOUNT value on done: 65.0
[2023-02-25 12:27:28,947][2409468] DAMAGECOUNT value on done: 140.0
[2023-02-25 12:27:28,948][2409468] Sum rewards: -4.824, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.538', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.029', 'ARMOR': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'HITCOUNT': '0.130', 'weapon4': '0.136', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.348', 'weapon2': '1.506'}
[2023-02-25 12:27:29,080][2409075] DAMAGECOUNT value on done: 120.0
[2023-02-25 12:27:29,083][2409075] Sum rewards: -5.151, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.170', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'HITCOUNT': '0.060', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'DAMAGECOUNT': '0.315', 'ARMOR': '0.500', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.120', 'weapon2': '1.742'}
[2023-02-25 12:27:29,082][2409373] DAMAGECOUNT value on done: 32.0
[2023-02-25 12:27:29,196][2409486] DAMAGECOUNT value on done: 343.0
[2023-02-25 12:27:29,237][2409074] Updated weights for policy 0, policy_version 3090 (0.0013)
[2023-02-25 12:27:29,255][2409469] DAMAGECOUNT value on done: 117.0
[2023-02-25 12:27:29,256][2409469] Sum rewards: -6.275, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.466', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.011', 'weapon4': '0.014', 'WEAPON5': '0.050', 'ARMOR': '0.056', 'AMMO4': '0.057', 'HITCOUNT': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'DAMAGECOUNT': '0.135', 'WEAPON3': '0.550', 'weapon3': '1.114', 'weapon2': '1.920'}
[2023-02-25 12:27:29,285][2409100] DAMAGECOUNT value on done: 314.0
[2023-02-25 12:27:29,288][2409100] Sum rewards: -1.504, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.760', 'AMMO2': '0.006', 'ARMOR': '0.020', 'weapon4': '0.024', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.097', 'HITCOUNT': '0.130', 'DAMAGECOUNT': '0.357', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.338', 'weapon2': '1.702'}
[2023-02-25 12:27:29,299][2409077] DAMAGECOUNT value on done: 255.0
[2023-02-25 12:27:29,301][2409077] Sum rewards: -3.958, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.426', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'ARMOR': '0.057', 'AMMO3': '0.099', 'HITCOUNT': '0.100', 'weapon4': '0.102', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.600', 'weapon3': '1.182', 'weapon2': '1.666'}
[2023-02-25 12:27:29,306][2409597] DAMAGECOUNT value on done: 184.0
[2023-02-25 12:27:29,479][2409097] DAMAGECOUNT value on done: 240.0
[2023-02-25 12:27:29,479][2409097] Sum rewards: -3.069, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.759', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.018', 'AMMO4': '0.052', 'HITCOUNT': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.450', 'weapon3': '0.732', 'weapon2': '1.934', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:27:29,523][2409078] DAMAGECOUNT value on done: 90.0
[2023-02-25 12:27:29,524][2409078] Sum rewards: -2.211, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '0.006', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'weapon4': '0.042', 'AMMO4': '0.049', 'HITCOUNT': '0.050', 'ARMOR': '0.073', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'DAMAGECOUNT': '0.240', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.420', 'weapon2': '1.576'}
[2023-02-25 12:27:29,772][2409101] DAMAGECOUNT value on done: 185.0
[2023-02-25 12:27:29,775][2409101] Sum rewards: 0.590, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.219', 'AMMO2': '0.011', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'HITCOUNT': '0.110', 'weapon4': '0.176', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.500', 'ARMOR': '0.728', 'FRAGCOUNT': '1.000', 'weapon3': '1.262', 'weapon2': '1.536'}
[2023-02-25 12:27:29,995][2409389] DAMAGECOUNT value on done: 180.0
[2023-02-25 12:27:29,998][2409389] Sum rewards: -3.437, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.236', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.028', 'WEAPON4': '0.050', 'ARMOR': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.129', 'HITCOUNT': '0.130', 'weapon4': '0.148', 'DAMAGECOUNT': '0.465', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.186', 'weapon2': '1.548'}
[2023-02-25 12:27:30,098][2409547] DAMAGECOUNT value on done: 154.0
[2023-02-25 12:27:30,564][2409548] DAMAGECOUNT value on done: 236.0
[2023-02-25 12:27:30,568][2409548] Sum rewards: -3.101, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.070', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'weapon5': '0.014', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon4': '0.138', 'WEAPON5': '0.150', 'HITCOUNT': '0.190', 'DAMAGECOUNT': '0.618', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.178', 'weapon2': '1.320'}
[2023-02-25 12:27:30,629][2409405] DAMAGECOUNT value on done: 385.0
[2023-02-25 12:27:30,630][2409405] Sum rewards: -3.871, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.487', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.020', 'weapon4': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.140', 'HITCOUNT': '0.240', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.020', 'weapon3': '1.214', 'weapon2': '1.710'}
[2023-02-25 12:27:30,759][2409355] DAMAGECOUNT value on done: 380.0
[2023-02-25 12:27:30,760][2409355] Sum rewards: -7.056, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.986', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.015', 'AMMO2': '0.016', 'weapon5': '0.066', 'AMMO4': '0.079', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'weapon4': '0.304', 'ARMOR': '0.452', 'DAMAGECOUNT': '0.780', 'WEAPON3': '0.800', 'weapon3': '0.956', 'weapon2': '1.710'}
[2023-02-25 12:27:30,809][2409866] DAMAGECOUNT value on done: 133.0
[2023-02-25 12:27:30,869][2409099] DAMAGECOUNT value on done: 196.0
[2023-02-25 12:27:30,928][2409079] DAMAGECOUNT value on done: 172.0
[2023-02-25 12:27:30,931][2409079] Sum rewards: 0.174, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.107', 'HITCOUNT': '0.130', 'DAMAGECOUNT': '0.351', 'ARMOR': '0.424', 'WEAPON3': '0.500', 'HEALTH': '0.916', 'weapon3': '1.370', 'weapon2': '1.790', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:27:31,228][2409076] DAMAGECOUNT value on done: 47.0
[2023-02-25 12:27:31,329][2409074] Updated weights for policy 0, policy_version 3100 (0.0012)
[2023-02-25 12:27:31,354][2409105] DAMAGECOUNT value on done: 150.0
[2023-02-25 12:27:31,355][2409105] Sum rewards: -6.329, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.941', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.036', 'weapon4': '0.046', 'WEAPON5': '0.050', 'ARMOR': '0.052', 'AMMO4': '0.053', 'AMMO3': '0.109', 'HITCOUNT': '0.110', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.700', 'weapon3': '1.294', 'weapon2': '1.618'}
[2023-02-25 12:27:31,456][2409596] DAMAGECOUNT value on done: 132.0
[2023-02-25 12:27:31,460][2409596] Sum rewards: -8.600, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.618', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'weapon4': '0.044', 'WEAPON4': '0.050', 'AMMO4': '0.060', 'HITCOUNT': '0.100', 'AMMO3': '0.213', 'DAMAGECOUNT': '0.270', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.100', 'weapon3': '1.344', 'weapon2': '1.514'}
[2023-02-25 12:27:32,186][2408954] Fps is (10 sec: 25394.6, 60 sec: 25941.2, 300 sec: 25867.3). Total num frames: 12726272. Throughput: 0: 6510.9. Samples: 3189048. Policy #0 lag: (min: 2.0, avg: 12.4, max: 29.0)
[2023-02-25 12:27:32,186][2408954] Avg episode reward: [(0, '-3.736')]
[2023-02-25 12:27:32,201][2409096] DAMAGECOUNT value on done: 83.0
[2023-02-25 12:27:32,202][2409096] Sum rewards: -5.939, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.463', 'AMMO2': '0.016', 'ARMOR': '0.072', 'AMMO4': '0.077', 'HITCOUNT': '0.080', 'AMMO3': '0.170', 'DAMAGECOUNT': '0.249', 'WEAPON4': '0.250', 'weapon4': '0.574', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.058', 'weapon2': '1.128'}
[2023-02-25 12:27:32,351][2409074] Updated weights for policy 0, policy_version 3110 (0.0012)
[2023-02-25 12:27:32,422][2409104] DAMAGECOUNT value on done: 54.0
[2023-02-25 12:27:32,444][2409406] DAMAGECOUNT value on done: 230.0
[2023-02-25 12:27:32,446][2409406] Sum rewards: -5.833, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.548', 'AMMO5': '0.008', 'AMMO2': '0.024', 'ARMOR': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'weapon4': '0.186', 'DAMAGECOUNT': '0.660', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.286', 'weapon2': '1.544'}
[2023-02-25 12:27:32,484][2409080] DAMAGECOUNT value on done: 180.0
[2023-02-25 12:27:32,487][2409080] Sum rewards: -2.797, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.717', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.015', 'ARMOR': '0.040', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.148', 'weapon4': '0.296', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.700', 'weapon2': '1.134', 'weapon3': '1.182', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:27:32,542][2409407] DAMAGECOUNT value on done: 115.0
[2023-02-25 12:27:32,543][2409407] Sum rewards: -6.835, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.567', 'AMMO2': '0.016', 'HITCOUNT': '0.070', 'AMMO4': '0.080', 'DAMAGECOUNT': '0.180', 'AMMO3': '0.208', 'weapon4': '0.240', 'WEAPON4': '0.250', 'ARMOR': '0.476', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.050', 'weapon3': '1.144', 'weapon2': '1.518'}
[2023-02-25 12:27:32,593][2409075] DAMAGECOUNT value on done: 103.0
[2023-02-25 12:27:32,594][2409075] Sum rewards: -9.542, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.240', 'FRAGCOUNT': '-1.500', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'HITCOUNT': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.058', 'weapon5': '0.072', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.144', 'AMMO3': '0.151', 'ARMOR': '0.432', 'WEAPON3': '0.850', 'weapon3': '1.212', 'weapon2': '1.598'}
[2023-02-25 12:27:32,625][2409468] DAMAGECOUNT value on done: 135.0
[2023-02-25 12:27:32,630][2409468] Sum rewards: -8.790, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.822', 'AMMO2': '0.008', 'weapon4': '0.030', 'ARMOR': '0.036', 'AMMO4': '0.039', 'HITCOUNT': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.219', 'DAMAGECOUNT': '0.330', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.200', 'weapon2': '1.376', 'weapon3': '1.384'}
[2023-02-25 12:27:32,955][2409373] DAMAGECOUNT value on done: 115.0
[2023-02-25 12:27:32,956][2409373] Sum rewards: -5.535, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.277', 'AMMO2': '0.021', 'ARMOR': '0.060', 'HITCOUNT': '0.060', 'AMMO4': '0.102', 'weapon4': '0.120', 'AMMO3': '0.133', 'DAMAGECOUNT': '0.240', 'WEAPON4': '0.250', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.314', 'weapon2': '1.442'}
[2023-02-25 12:27:32,992][2409077] DAMAGECOUNT value on done: 422.0
[2023-02-25 12:27:32,993][2409077] Sum rewards: -3.651, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.860', 'AMMO4': '-0.076', 'AMMO2': '-0.015', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.203', 'HITCOUNT': '0.300', 'ARMOR': '0.500', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.050', 'weapon3': '1.148', 'weapon2': '1.846', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:27:33,039][2409097] DAMAGECOUNT value on done: 29.0
[2023-02-25 12:27:33,079][2409597] DAMAGECOUNT value on done: 189.0
[2023-02-25 12:27:33,081][2409597] Sum rewards: -1.226, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.005', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'AMMO5': '0.015', 'weapon5': '0.038', 'AMMO3': '0.150', 'HITCOUNT': '0.180', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.555', 'WEAPON3': '0.850', 'weapon2': '1.102', 'weapon3': '1.740', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:27:33,105][2409078] DAMAGECOUNT value on done: 79.0
[2023-02-25 12:27:33,205][2409486] DAMAGECOUNT value on done: 642.0
[2023-02-25 12:27:33,209][2409486] Sum rewards: 5.824, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.894', 'weapon4': '0.014', 'AMMO2': '0.022', 'ARMOR': '0.028', 'weapon7': '0.074', 'AMMO3': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.109', 'HITCOUNT': '0.270', 'WEAPON3': '0.400', 'weapon3': '1.132', 'DAMAGECOUNT': '1.545', 'weapon2': '1.632', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:27:33,478][2409389] DAMAGECOUNT value on done: 165.0
[2023-02-25 12:27:33,573][2409469] DAMAGECOUNT value on done: 134.0
[2023-02-25 12:27:33,755][2409547] DAMAGECOUNT value on done: 90.0
[2023-02-25 12:27:34,036][2409074] Updated weights for policy 0, policy_version 3120 (0.0013)
[2023-02-25 12:27:34,099][2409405] DAMAGECOUNT value on done: 138.0
[2023-02-25 12:27:34,255][2409548] DAMAGECOUNT value on done: 279.0
[2023-02-25 12:27:34,256][2409548] Sum rewards: -2.917, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.756', 'AMMO5': '0.005', 'weapon5': '0.020', 'AMMO2': '0.021', 'weapon4': '0.028', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.105', 'HITCOUNT': '0.150', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.417', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.650', 'weapon3': '1.350', 'weapon2': '1.640'}
[2023-02-25 12:27:34,664][2409079] DAMAGECOUNT value on done: 155.0
[2023-02-25 12:27:34,665][2409079] Sum rewards: -11.654, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.692', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.018', 'weapon5': '0.020', 'HITCOUNT': '0.090', 'AMMO4': '0.091', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon4': '0.252', 'DAMAGECOUNT': '0.255', 'weapon3': '1.118', 'WEAPON3': '1.200', 'weapon2': '1.386'}
[2023-02-25 12:27:34,721][2409355] DAMAGECOUNT value on done: 125.0
[2023-02-25 12:27:34,726][2409355] Sum rewards: -1.762, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.225', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'weapon4': '0.012', 'HITCOUNT': '0.070', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.165', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.170', 'weapon2': '1.626'}
[2023-02-25 12:27:34,786][2409866] DAMAGECOUNT value on done: 135.0
[2023-02-25 12:27:35,001][2409105] DAMAGECOUNT value on done: 126.0
[2023-02-25 12:27:35,312][2409099] DAMAGECOUNT value on done: 258.0
[2023-02-25 12:27:35,313][2409099] Sum rewards: -5.574, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.360', 'AMMO5': '0.007', 'HITCOUNT': '0.020', 'AMMO2': '0.027', 'weapon5': '0.052', 'DAMAGECOUNT': '0.060', 'AMMO3': '0.100', 'weapon4': '0.124', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'weapon3': '1.178', 'weapon2': '1.684'}
[2023-02-25 12:27:35,454][2409076] DAMAGECOUNT value on done: 120.0
[2023-02-25 12:27:35,457][2409076] Sum rewards: -2.255, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.470', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.019', 'HITCOUNT': '0.060', 'AMMO3': '0.102', 'DAMAGECOUNT': '0.165', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'weapon3': '0.444', 'ARMOR': '0.526', 'weapon4': '0.598', 'FRAGCOUNT': '1.000', 'weapon2': '1.642'}
[2023-02-25 12:27:35,610][2409074] Updated weights for policy 0, policy_version 3130 (0.0012)
[2023-02-25 12:27:35,894][2409096] DAMAGECOUNT value on done: 190.0
[2023-02-25 12:27:35,903][2409406] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 12:27:36,057][2409075] DAMAGECOUNT value on done: 323.0
[2023-02-25 12:27:36,060][2409075] Sum rewards: -4.889, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.110', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'HITCOUNT': '0.130', 'weapon4': '0.150', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.324', 'ARMOR': '0.492', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.040', 'weapon2': '1.688'}
[2023-02-25 12:27:36,125][2409406] DAMAGECOUNT value on done: 143.0
[2023-02-25 12:27:36,125][2409406] Sum rewards: -2.224, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.606', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'ARMOR': '0.028', 'AMMO3': '0.066', 'HITCOUNT': '0.100', 'AMMO4': '0.128', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.282', 'WEAPON3': '0.400', 'weapon4': '0.486', 'weapon3': '0.748', 'FRAGCOUNT': '1.000', 'weapon2': '1.608'}
[2023-02-25 12:27:36,282][2409080] DAMAGECOUNT value on done: 90.0
[2023-02-25 12:27:36,451][2409468] DAMAGECOUNT value on done: 110.0
[2023-02-25 12:27:36,642][2409097] DAMAGECOUNT value on done: 184.0
[2023-02-25 12:27:36,645][2409097] Sum rewards: -3.584, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.550', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'HITCOUNT': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.282', 'DAMAGECOUNT': '0.342', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.014', 'weapon2': '1.812'}
[2023-02-25 12:27:36,672][2409077] DAMAGECOUNT value on done: 35.0
[2023-02-25 12:27:36,804][2409078] DAMAGECOUNT value on done: 182.0
[2023-02-25 12:27:36,807][2409078] Sum rewards: -6.700, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.306', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'weapon5': '0.058', 'AMMO4': '0.059', 'weapon4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'HITCOUNT': '0.140', 'DAMAGECOUNT': '0.405', 'ARMOR': '0.444', 'WEAPON3': '0.600', 'weapon3': '0.724', 'weapon2': '2.254'}
[2023-02-25 12:27:36,908][2409389] DAMAGECOUNT value on done: 210.0
[2023-02-25 12:27:36,909][2409389] Sum rewards: -3.748, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.976', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.026', 'ARMOR': '0.084', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.255', 'weapon4': '0.474', 'WEAPON3': '0.700', 'weapon3': '0.938', 'FRAGCOUNT': '1.000', 'weapon2': '1.312'}
[2023-02-25 12:27:37,186][2408954] Fps is (10 sec: 26214.0, 60 sec: 25873.1, 300 sec: 25908.9). Total num frames: 12857344. Throughput: 0: 6522.9. Samples: 3208848. Policy #0 lag: (min: 0.0, avg: 13.4, max: 25.0)
[2023-02-25 12:27:37,187][2408954] Avg episode reward: [(0, '-4.200')]
[2023-02-25 12:27:37,252][2409469] DAMAGECOUNT value on done: 70.0
[2023-02-25 12:27:37,388][2409547] DAMAGECOUNT value on done: 157.0
[2023-02-25 12:27:37,442][2409074] Updated weights for policy 0, policy_version 3140 (0.0015)
[2023-02-25 12:27:37,833][2409486] DAMAGECOUNT value on done: 55.0
[2023-02-25 12:27:38,195][2409079] DAMAGECOUNT value on done: 139.0
[2023-02-25 12:27:38,195][2409079] Sum rewards: -2.511, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.514', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.011', 'weapon5': '0.024', 'WEAPON4': '0.050', 'AMMO3': '0.068', 'HITCOUNT': '0.100', 'weapon4': '0.106', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.400', 'ARMOR': '0.424', 'FRAGCOUNT': '1.000', 'weapon3': '1.068', 'weapon2': '1.732'}
[2023-02-25 12:27:38,867][2409074] Updated weights for policy 0, policy_version 3150 (0.0012)
[2023-02-25 12:27:39,533][2409355] DAMAGECOUNT value on done: 296.0
[2023-02-25 12:27:39,543][2409099] DAMAGECOUNT value on done: 0.0
[2023-02-25 12:27:39,552][2409075] DAMAGECOUNT value on done: 180.0
[2023-02-25 12:27:39,555][2409075] Sum rewards: -3.075, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.912', 'AMMO2': '0.013', 'ARMOR': '0.036', 'AMMO4': '0.064', 'HITCOUNT': '0.070', 'weapon4': '0.094', 'AMMO3': '0.098', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.324', 'weapon3': '1.478'}
[2023-02-25 12:27:39,568][2409096] DAMAGECOUNT value on done: 115.0
[2023-02-25 12:27:39,640][2409866] DAMAGECOUNT value on done: 170.0
[2023-02-25 12:27:39,650][2409866] Sum rewards: -5.105, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.224', 'AMMO5': '0.005', 'AMMO2': '0.009', 'ARMOR': '0.016', 'AMMO4': '0.042', 'weapon5': '0.064', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'weapon4': '0.150', 'DAMAGECOUNT': '0.495', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.700', 'weapon3': '1.172', 'weapon2': '1.470'}
[2023-02-25 12:27:39,944][2409080] DAMAGECOUNT value on done: 315.0
[2023-02-25 12:27:39,945][2409080] Sum rewards: -4.654, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.346', 'AMMO2': '0.010', 'AMMO4': '0.052', 'HITCOUNT': '0.070', 'AMMO3': '0.152', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.120', 'weapon2': '1.678'}
[2023-02-25 12:27:40,066][2409074] Updated weights for policy 0, policy_version 3160 (0.0012)
[2023-02-25 12:27:40,218][2409097] DAMAGECOUNT value on done: 90.0
[2023-02-25 12:27:40,351][2409468] DAMAGECOUNT value on done: 54.0
[2023-02-25 12:27:40,352][2409468] Sum rewards: -3.433, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.884', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.004', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.036', 'WEAPON4': '0.050', 'HITCOUNT': '0.070', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.147', 'weapon4': '0.148', 'WEAPON3': '0.400', 'ARMOR': '0.500', 'weapon3': '0.806', 'weapon2': '1.564'}
[2023-02-25 12:27:41,017][2409547] DAMAGECOUNT value on done: 150.0
[2023-02-25 12:27:41,327][2409486] DAMAGECOUNT value on done: 242.0
[2023-02-25 12:27:41,341][2409486] Sum rewards: -6.187, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.780', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon4': '0.092', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.215', 'DAMAGECOUNT': '0.381', 'WEAPON3': '1.150', 'weapon2': '1.236', 'weapon3': '1.508', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:27:42,186][2408954] Fps is (10 sec: 24986.3, 60 sec: 25873.1, 300 sec: 25784.0). Total num frames: 12976128. Throughput: 0: 6498.9. Samples: 3246876. Policy #0 lag: (min: 1.0, avg: 14.9, max: 29.0)
[2023-02-25 12:27:42,186][2408954] Avg episode reward: [(0, '-4.300')]
[2023-02-25 12:27:42,306][2409074] Updated weights for policy 0, policy_version 3170 (0.0012)
[2023-02-25 12:27:43,037][2409099] DAMAGECOUNT value on done: 105.0
[2023-02-25 12:27:43,218][2409074] Updated weights for policy 0, policy_version 3180 (0.0012)
[2023-02-25 12:27:43,487][2409355] DAMAGECOUNT value on done: 185.0
[2023-02-25 12:27:43,491][2409355] Sum rewards: -4.510, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.840', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.012', 'weapon4': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'HITCOUNT': '0.130', 'AMMO3': '0.163', 'ARMOR': '0.460', 'DAMAGECOUNT': '0.465', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.374', 'weapon3': '1.634'}
[2023-02-25 12:27:43,555][2409866] DAMAGECOUNT value on done: 100.0
[2023-02-25 12:27:43,562][2409866] Sum rewards: -1.766, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.486', 'AMMO2': '0.012', 'ARMOR': '0.052', 'weapon4': '0.058', 'AMMO4': '0.060', 'HITCOUNT': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'DAMAGECOUNT': '0.180', 'WEAPON3': '0.650', 'weapon2': '1.260', 'weapon3': '1.672', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:27:43,911][2409080] DAMAGECOUNT value on done: 260.0
[2023-02-25 12:27:44,258][2409468] DAMAGECOUNT value on done: 346.0
[2023-02-25 12:27:44,261][2409468] Sum rewards: -6.457, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.080', 'AMMO2': '0.007', 'AMMO4': '0.036', 'ARMOR': '0.064', 'WEAPON4': '0.100', 'weapon4': '0.144', 'AMMO3': '0.193', 'HITCOUNT': '0.220', 'DAMAGECOUNT': '0.903', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.050', 'weapon3': '1.390', 'weapon2': '1.516'}
[2023-02-25 12:27:44,633][2409547] DAMAGECOUNT value on done: 170.0
[2023-02-25 12:27:44,634][2409547] Sum rewards: -4.208, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.430', 'AMMO2': '0.019', 'ARMOR': '0.024', 'HITCOUNT': '0.090', 'AMMO4': '0.093', 'AMMO3': '0.099', 'weapon4': '0.134', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.436', 'weapon2': '1.452'}
[2023-02-25 12:27:44,864][2409486] DAMAGECOUNT value on done: 135.0
[2023-02-25 12:27:44,867][2409486] Sum rewards: -4.420, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.742', 'AMMO2': '0.020', 'HITCOUNT': '0.090', 'AMMO3': '0.096', 'AMMO4': '0.097', 'weapon4': '0.104', 'DAMAGECOUNT': '0.300', 'WEAPON4': '0.300', 'ARMOR': '0.459', 'WEAPON3': '0.550', 'weapon3': '0.798', 'FRAGCOUNT': '1.000', 'weapon2': '1.758'}
[2023-02-25 12:27:45,718][2409074] Updated weights for policy 0, policy_version 3190 (0.0013)
[2023-02-25 12:27:46,633][2409099] DAMAGECOUNT value on done: 302.0
[2023-02-25 12:27:46,691][2409074] Updated weights for policy 0, policy_version 3200 (0.0012)
[2023-02-25 12:27:47,186][2408954] Fps is (10 sec: 26624.5, 60 sec: 26146.2, 300 sec: 25867.3). Total num frames: 13123584. Throughput: 0: 6505.3. Samples: 3286404. Policy #0 lag: (min: 1.0, avg: 16.1, max: 28.0)
[2023-02-25 12:27:47,187][2408954] Avg episode reward: [(0, '-4.232')]
[2023-02-25 12:27:47,956][2409080] DAMAGECOUNT value on done: 147.0
[2023-02-25 12:27:47,960][2409080] Sum rewards: -4.648, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.840', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'ARMOR': '0.012', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'HITCOUNT': '0.140', 'weapon4': '0.216', 'DAMAGECOUNT': '0.441', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.152', 'weapon2': '1.646'}
[2023-02-25 12:27:48,006][2409074] Updated weights for policy 0, policy_version 3210 (0.0013)
[2023-02-25 12:27:48,130][2409468] DAMAGECOUNT value on done: 205.0
[2023-02-25 12:27:48,133][2409468] Sum rewards: -3.035, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.150', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.036', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'HITCOUNT': '0.090', 'AMMO3': '0.149', 'WEAPON4': '0.200', 'weapon4': '0.250', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.334', 'weapon3': '1.366'}
[2023-02-25 12:27:49,136][2409547] DAMAGECOUNT value on done: 132.0
[2023-02-25 12:27:49,979][2409074] Updated weights for policy 0, policy_version 3220 (0.0012)
[2023-02-25 12:27:50,900][2409099] DAMAGECOUNT value on done: 175.0
[2023-02-25 12:27:51,008][2409074] Updated weights for policy 0, policy_version 3230 (0.0013)
[2023-02-25 12:27:51,581][2409080] DAMAGECOUNT value on done: 410.0
[2023-02-25 12:27:51,582][2409080] Sum rewards: -3.462, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.646', 'ARMOR': '0.004', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon4': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.166', 'HITCOUNT': '0.310', 'WEAPON3': '0.900', 'weapon2': '1.176', 'DAMAGECOUNT': '1.215', 'weapon3': '1.726', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:27:51,759][2409468] DAMAGECOUNT value on done: 25.0
[2023-02-25 12:27:52,186][2408954] Fps is (10 sec: 27033.6, 60 sec: 26009.6, 300 sec: 25909.0). Total num frames: 13246464. Throughput: 0: 6513.6. Samples: 3306168. Policy #0 lag: (min: 0.0, avg: 13.3, max: 25.0)
[2023-02-25 12:27:52,186][2408954] Avg episode reward: [(0, '-4.293')]
[2023-02-25 12:27:53,248][2409074] Updated weights for policy 0, policy_version 3240 (0.0012)
[2023-02-25 12:27:54,399][2409074] Updated weights for policy 0, policy_version 3250 (0.0013)
[2023-02-25 12:27:55,374][2409080] DAMAGECOUNT value on done: 293.0
[2023-02-25 12:27:55,377][2409080] Sum rewards: -2.323, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.164', 'AMMO2': '0.013', 'ARMOR': '0.032', 'AMMO4': '0.064', 'weapon4': '0.092', 'AMMO3': '0.112', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.642', 'weapon3': '1.018', 'weapon2': '1.938', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:27:55,590][2409468] DAMAGECOUNT value on done: 85.0
[2023-02-25 12:27:55,591][2409468] Sum rewards: -5.580, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.670', 'AMMO2': '0.013', 'ARMOR': '0.024', 'AMMO4': '0.066', 'HITCOUNT': '0.080', 'AMMO3': '0.148', 'DAMAGECOUNT': '0.180', 'weapon4': '0.180', 'WEAPON4': '0.200', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.076', 'weapon2': '1.672'}
[2023-02-25 12:27:56,063][2409074] Updated weights for policy 0, policy_version 3260 (0.0015)
[2023-02-25 12:27:57,186][2408954] Fps is (10 sec: 25395.0, 60 sec: 26146.1, 300 sec: 25853.4). Total num frames: 13377536. Throughput: 0: 6519.5. Samples: 3345420. Policy #0 lag: (min: 0.0, avg: 12.9, max: 24.0)
[2023-02-25 12:27:57,187][2408954] Avg episode reward: [(0, '-4.272')]
[2023-02-25 12:27:57,670][2409074] Updated weights for policy 0, policy_version 3270 (0.0012)
[2023-02-25 12:27:59,161][2409074] Updated weights for policy 0, policy_version 3280 (0.0012)
[2023-02-25 12:27:59,634][2409468] DAMAGECOUNT value on done: 92.0
[2023-02-25 12:27:59,635][2409468] Sum rewards: -1.396, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.378', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'HITCOUNT': '0.060', 'AMMO3': '0.067', 'weapon4': '0.082', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.165', 'WEAPON3': '0.400', 'ARMOR': '0.466', 'weapon3': '0.922', 'FRAGCOUNT': '1.000', 'weapon2': '1.722'}
[2023-02-25 12:28:00,800][2409074] Updated weights for policy 0, policy_version 3290 (0.0012)
[2023-02-25 12:28:02,186][2408954] Fps is (10 sec: 26624.0, 60 sec: 26077.9, 300 sec: 25881.2). Total num frames: 13512704. Throughput: 0: 6522.9. Samples: 3385116. Policy #0 lag: (min: 0.0, avg: 12.2, max: 25.0)
[2023-02-25 12:28:02,186][2408954] Avg episode reward: [(0, '-4.241')]
[2023-02-25 12:28:02,285][2409074] Updated weights for policy 0, policy_version 3300 (0.0013)
[2023-02-25 12:28:02,598][2409033] Signal inference workers to stop experience collection... (450 times)
[2023-02-25 12:28:02,616][2409033] Signal inference workers to resume experience collection... (450 times)
[2023-02-25 12:28:02,636][2409074] InferenceWorker_p0-w0: stopping experience collection (450 times)
[2023-02-25 12:28:02,655][2409074] InferenceWorker_p0-w0: resuming experience collection (450 times)
[2023-02-25 12:28:04,020][2409074] Updated weights for policy 0, policy_version 3310 (0.0013)
[2023-02-25 12:28:05,441][2409074] Updated weights for policy 0, policy_version 3320 (0.0012)
[2023-02-25 12:28:06,877][2409074] Updated weights for policy 0, policy_version 3330 (0.0012)
[2023-02-25 12:28:07,186][2408954] Fps is (10 sec: 26623.7, 60 sec: 26009.7, 300 sec: 25936.8). Total num frames: 13643776. Throughput: 0: 6520.0. Samples: 3404304. Policy #0 lag: (min: 1.0, avg: 11.8, max: 28.0)
[2023-02-25 12:28:07,186][2408954] Avg episode reward: [(0, '-4.241')]
[2023-02-25 12:28:07,603][2409405] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 12:28:08,806][2409074] Updated weights for policy 0, policy_version 3340 (0.0013)
[2023-02-25 12:28:10,271][2409074] Updated weights for policy 0, policy_version 3350 (0.0012)
[2023-02-25 12:28:12,186][2408954] Fps is (10 sec: 24166.4, 60 sec: 26009.6, 300 sec: 25853.4). Total num frames: 13754368. Throughput: 0: 6516.5. Samples: 3443196. Policy #0 lag: (min: 0.0, avg: 12.1, max: 27.0)
[2023-02-25 12:28:12,186][2408954] Avg episode reward: [(0, '-4.241')]
[2023-02-25 12:28:12,247][2409074] Updated weights for policy 0, policy_version 3360 (0.0012)
[2023-02-25 12:28:13,240][2409074] Updated weights for policy 0, policy_version 3370 (0.0013)
[2023-02-25 12:28:14,709][2409074] Updated weights for policy 0, policy_version 3380 (0.0013)
[2023-02-25 12:28:16,360][2409074] Updated weights for policy 0, policy_version 3390 (0.0012)
[2023-02-25 12:28:17,186][2408954] Fps is (10 sec: 26214.6, 60 sec: 26146.1, 300 sec: 25895.0). Total num frames: 13905920. Throughput: 0: 6523.2. Samples: 3482592. Policy #0 lag: (min: 0.0, avg: 12.7, max: 29.0)
[2023-02-25 12:28:17,186][2408954] Avg episode reward: [(0, '-4.241')]
[2023-02-25 12:28:17,193][2409033] Saving /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000003395_13905920.pth...
[2023-02-25 12:28:17,288][2409033] Removing /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000001879_7696384.pth
[2023-02-25 12:28:18,033][2409074] Updated weights for policy 0, policy_version 3400 (0.0012)
[2023-02-25 12:28:19,825][2409074] Updated weights for policy 0, policy_version 3410 (0.0012)
[2023-02-25 12:28:20,893][2409074] Updated weights for policy 0, policy_version 3420 (0.0012)
[2023-02-25 12:28:22,186][2408954] Fps is (10 sec: 27442.2, 60 sec: 25941.2, 300 sec: 25895.0). Total num frames: 14028800. Throughput: 0: 6518.1. Samples: 3502164. Policy #0 lag: (min: 1.0, avg: 13.1, max: 28.0)
[2023-02-25 12:28:22,186][2408954] Avg episode reward: [(0, '-4.241')]
[2023-02-25 12:28:23,142][2409074] Updated weights for policy 0, policy_version 3430 (0.0012)
[2023-02-25 12:28:24,172][2409074] Updated weights for policy 0, policy_version 3440 (0.0012)
[2023-02-25 12:28:25,967][2409074] Updated weights for policy 0, policy_version 3450 (0.0012)
[2023-02-25 12:28:27,186][2408954] Fps is (10 sec: 25803.9, 60 sec: 26146.0, 300 sec: 25895.1). Total num frames: 14163968. Throughput: 0: 6546.6. Samples: 3541476. Policy #0 lag: (min: 1.0, avg: 14.2, max: 34.0)
[2023-02-25 12:28:27,187][2408954] Avg episode reward: [(0, '-4.241')]
[2023-02-25 12:28:27,392][2409074] Updated weights for policy 0, policy_version 3460 (0.0013)
[2023-02-25 12:28:28,814][2409074] Updated weights for policy 0, policy_version 3470 (0.0013)
[2023-02-25 12:28:30,724][2409074] Updated weights for policy 0, policy_version 3480 (0.0013)
[2023-02-25 12:28:32,019][2409074] Updated weights for policy 0, policy_version 3490 (0.0012)
[2023-02-25 12:28:32,186][2408954] Fps is (10 sec: 27034.4, 60 sec: 26214.5, 300 sec: 25908.9). Total num frames: 14299136. Throughput: 0: 6537.3. Samples: 3580584. Policy #0 lag: (min: 0.0, avg: 13.1, max: 26.0)
[2023-02-25 12:28:32,186][2408954] Avg episode reward: [(0, '-4.241')]
[2023-02-25 12:28:33,744][2409074] Updated weights for policy 0, policy_version 3500 (0.0012)
[2023-02-25 12:28:35,279][2409074] Updated weights for policy 0, policy_version 3510 (0.0012)
[2023-02-25 12:28:37,151][2409074] Updated weights for policy 0, policy_version 3520 (0.0013)
[2023-02-25 12:28:37,186][2408954] Fps is (10 sec: 25394.9, 60 sec: 26009.4, 300 sec: 25867.2). Total num frames: 14417920. Throughput: 0: 6530.1. Samples: 3600024. Policy #0 lag: (min: 0.0, avg: 12.6, max: 25.0)
[2023-02-25 12:28:37,187][2408954] Avg episode reward: [(0, '-4.241')]
[2023-02-25 12:28:38,733][2409074] Updated weights for policy 0, policy_version 3530 (0.0014)
[2023-02-25 12:28:39,794][2409074] Updated weights for policy 0, policy_version 3540 (0.0012)
[2023-02-25 12:28:42,000][2409074] Updated weights for policy 0, policy_version 3550 (0.0015)
[2023-02-25 12:28:42,186][2408954] Fps is (10 sec: 24576.0, 60 sec: 26146.1, 300 sec: 25895.1). Total num frames: 14544896. Throughput: 0: 6518.4. Samples: 3638748. Policy #0 lag: (min: 0.0, avg: 12.8, max: 24.0)
[2023-02-25 12:28:42,186][2408954] Avg episode reward: [(0, '-4.241')]
[2023-02-25 12:28:42,967][2409074] Updated weights for policy 0, policy_version 3560 (0.0013)
[2023-02-25 12:28:44,596][2409074] Updated weights for policy 0, policy_version 3570 (0.0013)
[2023-02-25 12:28:46,376][2409074] Updated weights for policy 0, policy_version 3580 (0.0012)
[2023-02-25 12:28:46,557][2409597] Large shaping reward 2.640 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200)]
[2023-02-25 12:28:47,186][2408954] Fps is (10 sec: 26625.5, 60 sec: 26009.6, 300 sec: 25853.4). Total num frames: 14684160. Throughput: 0: 6513.3. Samples: 3678216. Policy #0 lag: (min: 1.0, avg: 13.9, max: 26.0)
[2023-02-25 12:28:47,186][2408954] Avg episode reward: [(0, '-4.241')]
[2023-02-25 12:28:47,766][2409074] Updated weights for policy 0, policy_version 3590 (0.0012)
[2023-02-25 12:28:49,676][2409074] Updated weights for policy 0, policy_version 3600 (0.0012)
[2023-02-25 12:28:50,920][2409074] Updated weights for policy 0, policy_version 3610 (0.0012)
[2023-02-25 12:28:52,186][2408954] Fps is (10 sec: 27852.9, 60 sec: 26282.7, 300 sec: 25922.8). Total num frames: 14823424. Throughput: 0: 6518.2. Samples: 3697620. Policy #0 lag: (min: 0.0, avg: 10.3, max: 24.0)
[2023-02-25 12:28:52,186][2408954] Avg episode reward: [(0, '-4.241')]
[2023-02-25 12:28:52,328][2409074] Updated weights for policy 0, policy_version 3620 (0.0012)
[2023-02-25 12:28:54,195][2409074] Updated weights for policy 0, policy_version 3630 (0.0012)
[2023-02-25 12:28:55,602][2409074] Updated weights for policy 0, policy_version 3640 (0.0012)
[2023-02-25 12:28:57,186][2408954] Fps is (10 sec: 25395.2, 60 sec: 26009.6, 300 sec: 25853.4). Total num frames: 14938112. Throughput: 0: 6525.3. Samples: 3736836. Policy #0 lag: (min: 0.0, avg: 9.6, max: 24.0)
[2023-02-25 12:28:57,186][2408954] Avg episode reward: [(0, '-4.241')]
[2023-02-25 12:28:57,429][2409074] Updated weights for policy 0, policy_version 3650 (0.0012)
[2023-02-25 12:28:58,966][2409074] Updated weights for policy 0, policy_version 3660 (0.0012)
[2023-02-25 12:29:00,066][2409033] Signal inference workers to stop experience collection... (500 times)
[2023-02-25 12:29:00,080][2409033] Signal inference workers to resume experience collection... (500 times)
[2023-02-25 12:29:00,099][2409074] InferenceWorker_p0-w0: stopping experience collection (500 times)
[2023-02-25 12:29:00,120][2409074] InferenceWorker_p0-w0: resuming experience collection (500 times)
[2023-02-25 12:29:00,145][2409074] Updated weights for policy 0, policy_version 3670 (0.0012)
[2023-02-25 12:29:02,098][2409074] Updated weights for policy 0, policy_version 3680 (0.0012)
[2023-02-25 12:29:02,186][2408954] Fps is (10 sec: 25395.2, 60 sec: 26077.9, 300 sec: 25881.2). Total num frames: 15077376. Throughput: 0: 6521.6. Samples: 3776064. Policy #0 lag: (min: 0.0, avg: 12.4, max: 24.0)
[2023-02-25 12:29:02,186][2408954] Avg episode reward: [(0, '-4.241')]
[2023-02-25 12:29:03,514][2409074] Updated weights for policy 0, policy_version 3690 (0.0012)
[2023-02-25 12:29:05,049][2409074] Updated weights for policy 0, policy_version 3700 (0.0013)
[2023-02-25 12:29:06,657][2409074] Updated weights for policy 0, policy_version 3710 (0.0012)
[2023-02-25 12:29:07,186][2408954] Fps is (10 sec: 27443.1, 60 sec: 26146.2, 300 sec: 25936.7). Total num frames: 15212544. Throughput: 0: 6516.0. Samples: 3795384. Policy #0 lag: (min: 1.0, avg: 13.6, max: 25.0)
[2023-02-25 12:29:07,186][2408954] Avg episode reward: [(0, '-4.241')]
[2023-02-25 12:29:07,663][2409080] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)]
[2023-02-25 12:29:08,386][2409074] Updated weights for policy 0, policy_version 3720 (0.0012)
[2023-02-25 12:29:10,114][2409074] Updated weights for policy 0, policy_version 3730 (0.0012)
[2023-02-25 12:29:11,004][2409074] Updated weights for policy 0, policy_version 3740 (0.0013)
[2023-02-25 12:29:12,186][2408954] Fps is (10 sec: 26214.5, 60 sec: 26419.2, 300 sec: 25908.9). Total num frames: 15339520. Throughput: 0: 6515.8. Samples: 3834684. Policy #0 lag: (min: 0.0, avg: 13.9, max: 24.0)
[2023-02-25 12:29:12,186][2408954] Avg episode reward: [(0, '-4.241')]
[2023-02-25 12:29:13,192][2409074] Updated weights for policy 0, policy_version 3750 (0.0012)
[2023-02-25 12:29:14,254][2409096] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 12:29:14,427][2409074] Updated weights for policy 0, policy_version 3760 (0.0012)
[2023-02-25 12:29:16,107][2409074] Updated weights for policy 0, policy_version 3770 (0.0012)
[2023-02-25 12:29:17,186][2408954] Fps is (10 sec: 24575.7, 60 sec: 25873.0, 300 sec: 25895.0). Total num frames: 15458304. Throughput: 0: 6515.2. Samples: 3873768. Policy #0 lag: (min: 1.0, avg: 13.8, max: 27.0)
[2023-02-25 12:29:17,186][2408954] Avg episode reward: [(0, '-4.241')]
[2023-02-25 12:29:17,866][2409074] Updated weights for policy 0, policy_version 3780 (0.0012)
[2023-02-25 12:29:19,190][2409074] Updated weights for policy 0, policy_version 3790 (0.0012)
[2023-02-25 12:29:21,161][2409074] Updated weights for policy 0, policy_version 3800 (0.0012)
[2023-02-25 12:29:22,186][2408954] Fps is (10 sec: 26214.3, 60 sec: 26214.6, 300 sec: 25950.6). Total num frames: 15601664. Throughput: 0: 6512.1. Samples: 3893064. Policy #0 lag: (min: 0.0, avg: 11.5, max: 25.0)
[2023-02-25 12:29:22,186][2408954] Avg episode reward: [(0, '-4.241')]
[2023-02-25 12:29:22,192][2409074] Updated weights for policy 0, policy_version 3810 (0.0012)
[2023-02-25 12:29:24,425][2409074] Updated weights for policy 0, policy_version 3820 (0.0013)
[2023-02-25 12:29:25,750][2409074] Updated weights for policy 0, policy_version 3830 (0.0012)
[2023-02-25 12:29:26,912][2409074] Updated weights for policy 0, policy_version 3840 (0.0012)
[2023-02-25 12:29:27,186][2408954] Fps is (10 sec: 27443.7, 60 sec: 26146.3, 300 sec: 25950.6). Total num frames: 15732736. Throughput: 0: 6524.0. Samples: 3932328. Policy #0 lag: (min: 1.0, avg: 9.4, max: 25.0)
[2023-02-25 12:29:27,186][2408954] Avg episode reward: [(0, '-4.241')]
[2023-02-25 12:29:28,760][2409074] Updated weights for policy 0, policy_version 3850 (0.0012)
[2023-02-25 12:29:30,200][2409074] Updated weights for policy 0, policy_version 3860 (0.0012)
[2023-02-25 12:29:32,115][2409074] Updated weights for policy 0, policy_version 3870 (0.0012)
[2023-02-25 12:29:32,186][2408954] Fps is (10 sec: 24985.6, 60 sec: 25873.1, 300 sec: 25923.0). Total num frames: 15851520. Throughput: 0: 6502.7. Samples: 3970836. Policy #0 lag: (min: 0.0, avg: 11.8, max: 24.0)
[2023-02-25 12:29:32,186][2408954] Avg episode reward: [(0, '-4.241')]
[2023-02-25 12:29:33,619][2409074] Updated weights for policy 0, policy_version 3880 (0.0012)
[2023-02-25 12:29:35,095][2409074] Updated weights for policy 0, policy_version 3890 (0.0012)
[2023-02-25 12:29:37,160][2409074] Updated weights for policy 0, policy_version 3900 (0.0012)
[2023-02-25 12:29:37,186][2408954] Fps is (10 sec: 24166.1, 60 sec: 25941.5, 300 sec: 25881.2). Total num frames: 15974400. Throughput: 0: 6499.2. Samples: 3990084. Policy #0 lag: (min: 0.0, avg: 13.1, max: 29.0)
[2023-02-25 12:29:37,186][2408954] Avg episode reward: [(0, '-4.241')]
[2023-02-25 12:29:38,036][2409074] Updated weights for policy 0, policy_version 3910 (0.0013)
[2023-02-25 12:29:39,957][2409074] Updated weights for policy 0, policy_version 3920 (0.0013)
[2023-02-25 12:29:41,340][2409074] Updated weights for policy 0, policy_version 3930 (0.0013)
[2023-02-25 12:29:42,186][2408954] Fps is (10 sec: 25804.1, 60 sec: 26077.8, 300 sec: 25908.9). Total num frames: 16109568. Throughput: 0: 6487.2. Samples: 4028760. Policy #0 lag: (min: 1.0, avg: 12.9, max: 24.0)
[2023-02-25 12:29:42,187][2408954] Avg episode reward: [(0, '-4.241')]
[2023-02-25 12:29:42,997][2409074] Updated weights for policy 0, policy_version 3940 (0.0013)
[2023-02-25 12:29:44,762][2409074] Updated weights for policy 0, policy_version 3950 (0.0013)
[2023-02-25 12:29:46,323][2409074] Updated weights for policy 0, policy_version 3960 (0.0012)
[2023-02-25 12:29:47,186][2408954] Fps is (10 sec: 27033.4, 60 sec: 26009.5, 300 sec: 25922.8). Total num frames: 16244736. Throughput: 0: 6476.5. Samples: 4067508. Policy #0 lag: (min: 1.0, avg: 13.5, max: 26.0)
[2023-02-25 12:29:47,186][2408954] Avg episode reward: [(0, '-4.241')]
[2023-02-25 12:29:48,062][2409074] Updated weights for policy 0, policy_version 3970 (0.0012)
[2023-02-25 12:29:49,636][2409074] Updated weights for policy 0, policy_version 3980 (0.0014)
[2023-02-25 12:29:49,946][2409033] Signal inference workers to stop experience collection... (550 times)
[2023-02-25 12:29:49,946][2409033] Signal inference workers to resume experience collection... (550 times)
[2023-02-25 12:29:49,979][2409074] InferenceWorker_p0-w0: stopping experience collection (550 times)
[2023-02-25 12:29:49,979][2409074] InferenceWorker_p0-w0: resuming experience collection (550 times)
[2023-02-25 12:29:50,866][2409074] Updated weights for policy 0, policy_version 3990 (0.0013)
[2023-02-25 12:29:52,186][2408954] Fps is (10 sec: 27034.1, 60 sec: 25941.3, 300 sec: 25964.5). Total num frames: 16379904. Throughput: 0: 6480.0. Samples: 4086984. Policy #0 lag: (min: 0.0, avg: 13.1, max: 25.0)
[2023-02-25 12:29:52,186][2408954] Avg episode reward: [(0, '-4.241')]
[2023-02-25 12:29:52,235][2409074] Updated weights for policy 0, policy_version 4000 (0.0013)
[2023-02-25 12:29:54,496][2409074] Updated weights for policy 0, policy_version 4010 (0.0012)
[2023-02-25 12:29:55,916][2409074] Updated weights for policy 0, policy_version 4020 (0.0013)
[2023-02-25 12:29:57,186][2408954] Fps is (10 sec: 24576.4, 60 sec: 25873.1, 300 sec: 25867.3). Total num frames: 16490496. Throughput: 0: 6451.5. Samples: 4125000. Policy #0 lag: (min: 0.0, avg: 13.3, max: 27.0)
[2023-02-25 12:29:57,186][2408954] Avg episode reward: [(0, '-4.241')]
[2023-02-25 12:29:57,701][2409074] Updated weights for policy 0, policy_version 4030 (0.0012)
[2023-02-25 12:29:59,449][2409074] Updated weights for policy 0, policy_version 4040 (0.0012)
[2023-02-25 12:30:00,610][2409074] Updated weights for policy 0, policy_version 4050 (0.0012)
[2023-02-25 12:30:01,306][2409103] DAMAGECOUNT value on done: 110.0
[2023-02-25 12:30:02,186][2408954] Fps is (10 sec: 24166.3, 60 sec: 25736.5, 300 sec: 25881.2). Total num frames: 16621568. Throughput: 0: 6422.9. Samples: 4162800. Policy #0 lag: (min: 1.0, avg: 13.5, max: 28.0)
[2023-02-25 12:30:02,186][2408954] Avg episode reward: [(0, '-4.254')]
[2023-02-25 12:30:02,411][2409074] Updated weights for policy 0, policy_version 4060 (0.0012)
[2023-02-25 12:30:03,491][2409074] Updated weights for policy 0, policy_version 4070 (0.0013)
[2023-02-25 12:30:04,950][2409103] DAMAGECOUNT value on done: 210.0
[2023-02-25 12:30:04,951][2409103] Sum rewards: -4.287, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.065', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.030', 'HITCOUNT': '0.050', 'weapon5': '0.068', 'AMMO4': '0.070', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.135', 'ARMOR': '0.472', 'WEAPON3': '0.550', 'weapon3': '1.244', 'weapon2': '1.848'}
[2023-02-25 12:30:05,624][2409074] Updated weights for policy 0, policy_version 4080 (0.0013)
[2023-02-25 12:30:06,323][2409485] DAMAGECOUNT value on done: 207.0
[2023-02-25 12:30:06,872][2409074] Updated weights for policy 0, policy_version 4090 (0.0013)
[2023-02-25 12:30:07,186][2408954] Fps is (10 sec: 27033.5, 60 sec: 25804.8, 300 sec: 25895.1). Total num frames: 16760832. Throughput: 0: 6431.7. Samples: 4182492. Policy #0 lag: (min: 0.0, avg: 12.1, max: 25.0)
[2023-02-25 12:30:07,186][2408954] Avg episode reward: [(0, '-4.272')]
[2023-02-25 12:30:08,418][2409549] DAMAGECOUNT value on done: 93.0
[2023-02-25 12:30:08,419][2409549] Sum rewards: -2.537, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.878', 'AMMO2': '0.016', 'HITCOUNT': '0.040', 'weapon4': '0.054', 'DAMAGECOUNT': '0.072', 'AMMO4': '0.080', 'AMMO3': '0.101', 'WEAPON4': '0.200', 'ARMOR': '0.492', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.476', 'weapon2': '1.760'}
[2023-02-25 12:30:08,493][2409103] DAMAGECOUNT value on done: 520.0
[2023-02-25 12:30:08,496][2409103] Sum rewards: -3.054, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.444', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.022', 'weapon5': '0.072', 'AMMO3': '0.086', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'HITCOUNT': '0.260', 'weapon4': '0.314', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.005', 'weapon3': '1.282', 'weapon2': '1.372'}
[2023-02-25 12:30:08,814][2409102] DAMAGECOUNT value on done: 335.0
[2023-02-25 12:30:08,852][2409074] Updated weights for policy 0, policy_version 4100 (0.0012)
[2023-02-25 12:30:09,704][2409100] DAMAGECOUNT value on done: 338.0
[2023-02-25 12:30:09,705][2409100] Sum rewards: -5.889, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.444', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO4': '0.049', 'HITCOUNT': '0.130', 'weapon4': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'DAMAGECOUNT': '0.444', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.192', 'weapon3': '1.804'}
[2023-02-25 12:30:10,006][2409485] DAMAGECOUNT value on done: 445.0
[2023-02-25 12:30:10,007][2409485] Sum rewards: -2.285, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.066', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.027', 'ARMOR': '0.048', 'WEAPON4': '0.050', 'weapon4': '0.100', 'AMMO3': '0.137', 'HITCOUNT': '0.140', 'DAMAGECOUNT': '0.564', 'WEAPON3': '0.800', 'weapon2': '1.514', 'weapon3': '1.626', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:30:10,104][2409101] DAMAGECOUNT value on done: 191.0
[2023-02-25 12:30:10,495][2409074] Updated weights for policy 0, policy_version 4110 (0.0012)
[2023-02-25 12:30:10,503][2409596] DAMAGECOUNT value on done: 343.0
[2023-02-25 12:30:10,506][2409596] Sum rewards: 1.311, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.130', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'WEAPON4': '0.050', 'AMMO3': '0.094', 'weapon4': '0.150', 'HITCOUNT': '0.200', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.960', 'weapon2': '1.444', 'weapon3': '1.658', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:30:11,537][2409597] DAMAGECOUNT value on done: 140.0
[2023-02-25 12:30:12,096][2409074] Updated weights for policy 0, policy_version 4120 (0.0012)
[2023-02-25 12:30:12,155][2409103] DAMAGECOUNT value on done: 271.0
[2023-02-25 12:30:12,186][2408954] Fps is (10 sec: 25394.3, 60 sec: 25599.8, 300 sec: 25853.4). Total num frames: 16875520. Throughput: 0: 6395.7. Samples: 4220136. Policy #0 lag: (min: 1.0, avg: 11.9, max: 26.0)
[2023-02-25 12:30:12,187][2408954] Avg episode reward: [(0, '-4.348')]
[2023-02-25 12:30:12,476][2409104] DAMAGECOUNT value on done: 362.0
[2023-02-25 12:30:12,574][2409549] DAMAGECOUNT value on done: 160.0
[2023-02-25 12:30:12,577][2409549] Sum rewards: -5.024, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.982', 'AMMO2': '0.021', 'ARMOR': '0.060', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'weapon4': '0.128', 'AMMO3': '0.145', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.304', 'weapon3': '1.856'}
[2023-02-25 12:30:13,068][2409102] DAMAGECOUNT value on done: 314.0
[2023-02-25 12:30:13,072][2409102] Sum rewards: -1.050, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.680', 'AMMO2': '0.013', 'ARMOR': '0.024', 'AMMO4': '0.064', 'weapon7': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.124', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.274', 'DAMAGECOUNT': '0.627', 'WEAPON3': '0.800', 'weapon2': '1.090', 'weapon3': '1.534', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:13,514][2409100] DAMAGECOUNT value on done: 498.0
[2023-02-25 12:30:13,514][2409100] Sum rewards: -5.580, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.486', 'AMMO2': '0.008', 'AMMO4': '0.037', 'ARMOR': '0.060', 'AMMO3': '0.104', 'weapon4': '0.274', 'WEAPON4': '0.300', 'HITCOUNT': '0.310', 'WEAPON3': '0.650', 'weapon3': '0.906', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.089', 'weapon2': '1.918'}
[2023-02-25 12:30:13,532][2409485] DAMAGECOUNT value on done: 74.0
[2023-02-25 12:30:13,650][2409565] DAMAGECOUNT value on done: 393.0
[2023-02-25 12:30:13,652][2409565] Sum rewards: -4.342, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.096', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON5': '0.050', 'AMMO3': '0.163', 'HITCOUNT': '0.170', 'DAMAGECOUNT': '0.675', 'WEAPON3': '0.950', 'weapon2': '1.144', 'FRAGCOUNT': '2.000', 'weapon3': '2.042'}
[2023-02-25 12:30:13,863][2409074] Updated weights for policy 0, policy_version 4130 (0.0013)
[2023-02-25 12:30:14,097][2409105] DAMAGECOUNT value on done: 210.0
[2023-02-25 12:30:14,099][2409105] Sum rewards: -0.372, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.740', 'AMMO2': '0.004', 'AMMO4': '0.019', 'AMMO3': '0.060', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'WEAPON3': '0.350', 'weapon4': '0.374', 'DAMAGECOUNT': '0.495', 'ARMOR': '0.948', 'FRAGCOUNT': '1.000', 'weapon3': '1.338', 'weapon2': '1.460'}
[2023-02-25 12:30:14,350][2409101] DAMAGECOUNT value on done: 313.0
[2023-02-25 12:30:14,379][2409101] Sum rewards: -2.990, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.246', 'AMMO5': '0.003', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.066', 'HITCOUNT': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.114', 'AMMO3': '0.128', 'ARMOR': '0.416', 'DAMAGECOUNT': '0.699', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.470', 'weapon2': '1.554'}
[2023-02-25 12:30:15,094][2409597] DAMAGECOUNT value on done: 200.0
[2023-02-25 12:30:15,104][2409596] DAMAGECOUNT value on done: 675.0
[2023-02-25 12:30:15,107][2409596] Sum rewards: -2.952, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.212', 'AMMO2': '0.002', 'AMMO4': '0.009', 'ARMOR': '0.068', 'AMMO3': '0.153', 'HITCOUNT': '0.310', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.290', 'weapon3': '1.426', 'weapon2': '1.802', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:30:15,177][2409074] Updated weights for policy 0, policy_version 4140 (0.0013)
[2023-02-25 12:30:15,367][2409469] DAMAGECOUNT value on done: 88.0
[2023-02-25 12:30:15,858][2409103] DAMAGECOUNT value on done: 197.0
[2023-02-25 12:30:15,862][2409103] Sum rewards: -3.625, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.752', 'AMMO2': '0.009', 'AMMO4': '0.046', 'HITCOUNT': '0.080', 'AMMO3': '0.109', 'DAMAGECOUNT': '0.255', 'ARMOR': '0.420', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.230', 'weapon2': '1.628'}
[2023-02-25 12:30:15,933][2409373] DAMAGECOUNT value on done: 55.0
[2023-02-25 12:30:16,300][2409549] DAMAGECOUNT value on done: 316.0
[2023-02-25 12:30:16,301][2409549] Sum rewards: -1.954, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.918', 'AMMO2': '0.010', 'weapon4': '0.038', 'AMMO4': '0.048', 'AMMO3': '0.100', 'HITCOUNT': '0.140', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.576', 'WEAPON3': '0.600', 'weapon2': '1.474', 'weapon3': '1.778', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:30:16,460][2409548] DAMAGECOUNT value on done: 316.0
[2023-02-25 12:30:16,463][2409548] Sum rewards: -0.414, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.860', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.115', 'HITCOUNT': '0.170', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.723', 'FRAGCOUNT': '1.000', 'weapon2': '1.500', 'weapon3': '1.502'}
[2023-02-25 12:30:16,686][2409405] DAMAGECOUNT value on done: 455.0
[2023-02-25 12:30:16,687][2409405] Sum rewards: 0.810, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.459', 'AMMO5': '0.005', 'ARMOR': '0.028', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'weapon4': '0.184', 'HITCOUNT': '0.190', 'WEAPON3': '0.650', 'weapon2': '0.890', 'DAMAGECOUNT': '0.897', 'weapon3': '1.890', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:30:16,823][2409102] DAMAGECOUNT value on done: 185.0
[2023-02-25 12:30:16,824][2409102] Sum rewards: -5.760, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-2.000', 'HEALTH': '-0.612', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.076', 'ARMOR': '0.080', 'HITCOUNT': '0.090', 'AMMO3': '0.112', 'weapon4': '0.156', 'AMMO4': '0.159', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.372', 'WEAPON3': '0.700', 'weapon2': '1.414', 'weapon3': '1.452'}
[2023-02-25 12:30:16,921][2409104] DAMAGECOUNT value on done: 268.0
[2023-02-25 12:30:16,922][2409104] Sum rewards: -1.035, reward structure: {'DEATHCOUNT': '-3.750', 'FRAGCOUNT': '-2.000', 'AMMO5': '0.005', 'AMMO2': '0.023', 'AMMO3': '0.040', 'HITCOUNT': '0.040', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'WEAPON3': '0.150', 'weapon4': '0.346', 'DAMAGECOUNT': '0.363', 'HEALTH': '0.530', 'weapon3': '0.648', 'ARMOR': '0.872', 'weapon2': '1.238'}
[2023-02-25 12:30:17,016][2409074] Updated weights for policy 0, policy_version 4150 (0.0012)
[2023-02-25 12:30:17,055][2409389] DAMAGECOUNT value on done: 470.0
[2023-02-25 12:30:17,138][2409100] DAMAGECOUNT value on done: 373.0
[2023-02-25 12:30:17,139][2409100] Sum rewards: -1.793, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.500', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.008', 'weapon5': '0.030', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.120', 'WEAPON3': '0.450', 'ARMOR': '0.455', 'DAMAGECOUNT': '0.660', 'weapon3': '1.346', 'weapon2': '1.846', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:17,186][2408954] Fps is (10 sec: 23757.0, 60 sec: 25668.3, 300 sec: 25867.3). Total num frames: 16998400. Throughput: 0: 6377.1. Samples: 4257804. Policy #0 lag: (min: 1.0, avg: 12.1, max: 26.0)
[2023-02-25 12:30:17,186][2408954] Avg episode reward: [(0, '-4.059')]
[2023-02-25 12:30:17,212][2409033] Saving /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000004151_17002496.pth...
[2023-02-25 12:30:17,317][2409033] Removing /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000002634_10788864.pth
[2023-02-25 12:30:17,374][2409565] DAMAGECOUNT value on done: 504.0
[2023-02-25 12:30:17,378][2409565] Sum rewards: 1.161, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.300', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'ARMOR': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'weapon5': '0.072', 'weapon4': '0.094', 'AMMO3': '0.106', 'HITCOUNT': '0.260', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.927', 'weapon2': '1.302', 'weapon3': '1.580', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:30:17,429][2409485] DAMAGECOUNT value on done: 229.0
[2023-02-25 12:30:17,430][2409485] Sum rewards: -2.179, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.488', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'weapon5': '0.024', 'WEAPON5': '0.050', 'HITCOUNT': '0.140', 'AMMO3': '0.142', 'DAMAGECOUNT': '0.540', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.250', 'weapon3': '1.860'}
[2023-02-25 12:30:17,710][2409105] DAMAGECOUNT value on done: 249.0
[2023-02-25 12:30:17,714][2409105] Sum rewards: -7.833, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.168', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.016', 'weapon4': '0.040', 'ARMOR': '0.041', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'HITCOUNT': '0.080', 'AMMO4': '0.080', 'AMMO3': '0.152', 'DAMAGECOUNT': '0.285', 'WEAPON3': '0.950', 'weapon3': '1.530', 'weapon2': '1.542'}
[2023-02-25 12:30:17,735][2409406] DAMAGECOUNT value on done: 129.0
[2023-02-25 12:30:17,910][2409101] DAMAGECOUNT value on done: 465.0
[2023-02-25 12:30:17,911][2409101] Sum rewards: -1.262, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.735', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.067', 'ARMOR': '0.084', 'AMMO3': '0.114', 'weapon4': '0.140', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.699', 'weapon3': '1.356', 'weapon2': '1.520', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:18,238][2409074] Updated weights for policy 0, policy_version 4160 (0.0012)
[2023-02-25 12:30:18,264][2409077] DAMAGECOUNT value on done: 403.0
[2023-02-25 12:30:18,265][2409077] Sum rewards: -2.732, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.516', 'FRAGCOUNT': '0.000', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'weapon5': '0.060', 'AMMO4': '0.068', 'weapon4': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'HITCOUNT': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.702', 'weapon2': '1.438', 'weapon3': '1.454'}
[2023-02-25 12:30:18,881][2409076] DAMAGECOUNT value on done: 510.0
[2023-02-25 12:30:18,884][2409076] Sum rewards: 2.917, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.012', 'weapon4': '0.024', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.097', 'HITCOUNT': '0.210', 'HEALTH': '0.238', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.990', 'weapon2': '1.040', 'weapon3': '1.600', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:30:18,954][2409597] DAMAGECOUNT value on done: 435.0
[2023-02-25 12:30:18,956][2409597] Sum rewards: -5.080, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.354', 'AMMO2': '0.007', 'weapon4': '0.022', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.138', 'HITCOUNT': '0.140', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.850', 'weapon3': '1.538', 'weapon2': '1.822', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:19,381][2409596] DAMAGECOUNT value on done: 210.0
[2023-02-25 12:30:19,483][2409373] DAMAGECOUNT value on done: 234.0
[2023-02-25 12:30:19,488][2409407] DAMAGECOUNT value on done: 139.0
[2023-02-25 12:30:19,748][2409103] DAMAGECOUNT value on done: 200.0
[2023-02-25 12:30:19,810][2409096] DAMAGECOUNT value on done: 335.0
[2023-02-25 12:30:19,810][2409096] Sum rewards: 1.450, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.980', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.004', 'ARMOR': '0.036', 'weapon5': '0.042', 'AMMO3': '0.081', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.184', 'HITCOUNT': '0.240', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.840', 'weapon3': '1.308', 'weapon2': '1.492', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:19,925][2409549] DAMAGECOUNT value on done: 220.0
[2023-02-25 12:30:19,926][2409549] Sum rewards: -4.078, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.585', 'AMMO5': '0.004', 'AMMO2': '0.019', 'weapon5': '0.042', 'ARMOR': '0.044', 'WEAPON4': '0.050', 'HITCOUNT': '0.060', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'weapon4': '0.104', 'AMMO3': '0.111', 'DAMAGECOUNT': '0.255', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.494', 'weapon2': '1.678'}
[2023-02-25 12:30:20,027][2409469] DAMAGECOUNT value on done: 160.0
[2023-02-25 12:30:20,175][2409078] DAMAGECOUNT value on done: 387.0
[2023-02-25 12:30:20,178][2409078] Sum rewards: -1.144, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.970', 'AMMO2': '0.008', 'weapon4': '0.014', 'AMMO4': '0.039', 'WEAPON4': '0.100', 'HITCOUNT': '0.160', 'AMMO3': '0.167', 'ARMOR': '0.432', 'DAMAGECOUNT': '0.660', 'WEAPON3': '0.850', 'weapon2': '1.028', 'FRAGCOUNT': '2.000', 'weapon3': '2.118'}
[2023-02-25 12:30:20,275][2409405] DAMAGECOUNT value on done: 340.0
[2023-02-25 12:30:20,309][2409074] Updated weights for policy 0, policy_version 4170 (0.0012)
[2023-02-25 12:30:20,342][2409102] DAMAGECOUNT value on done: 335.0
[2023-02-25 12:30:20,347][2409102] Sum rewards: -3.178, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.396', 'AMMO5': '0.012', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.061', 'weapon4': '0.064', 'weapon5': '0.078', 'AMMO3': '0.138', 'HITCOUNT': '0.150', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.630', 'WEAPON3': '0.750', 'ARMOR': '0.930', 'weapon3': '1.410', 'weapon2': '1.482'}
[2023-02-25 12:30:20,358][2409548] DAMAGECOUNT value on done: 380.0
[2023-02-25 12:30:20,361][2409548] Sum rewards: -3.977, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.625', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'weapon5': '0.062', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'HITCOUNT': '0.140', 'WEAPON5': '0.150', 'weapon4': '0.218', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.550', 'weapon3': '1.294', 'weapon2': '1.566'}
[2023-02-25 12:30:20,451][2409075] DAMAGECOUNT value on done: 241.0
[2023-02-25 12:30:20,564][2409389] DAMAGECOUNT value on done: 180.0
[2023-02-25 12:30:20,566][2409389] Sum rewards: -1.247, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.681', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.029', 'ARMOR': '0.064', 'weapon4': '0.088', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.600', 'weapon2': '1.218', 'weapon3': '1.572', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:20,925][2409565] DAMAGECOUNT value on done: 164.0
[2023-02-25 12:30:20,944][2409565] Sum rewards: -3.947, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.007', 'AMMO2': '0.032', 'HEALTH': '0.040', 'ARMOR': '0.040', 'HITCOUNT': '0.080', 'weapon5': '0.082', 'AMMO3': '0.107', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO4': '0.158', 'weapon4': '0.230', 'DAMAGECOUNT': '0.270', 'WEAPON3': '0.600', 'weapon3': '1.358', 'weapon2': '1.498'}
[2023-02-25 12:30:20,975][2409100] DAMAGECOUNT value on done: 440.0
[2023-02-25 12:30:21,142][2409485] DAMAGECOUNT value on done: 364.0
[2023-02-25 12:30:21,145][2409485] Sum rewards: -5.630, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.439', 'AMMO2': '0.001', 'AMMO4': '0.004', 'WEAPON1': '0.010', 'ARMOR': '0.040', 'weapon4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.139', 'HITCOUNT': '0.240', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.927', 'FRAGCOUNT': '1.000', 'weapon3': '1.386', 'weapon2': '1.828'}
[2023-02-25 12:30:21,204][2409866] DAMAGECOUNT value on done: 170.0
[2023-02-25 12:30:21,207][2409866] Sum rewards: -5.461, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.222', 'AMMO2': '0.011', 'ARMOR': '0.044', 'AMMO4': '0.055', 'HITCOUNT': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.156', 'DAMAGECOUNT': '0.180', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.214', 'weapon2': '1.928'}
[2023-02-25 12:30:21,223][2409355] DAMAGECOUNT value on done: 282.0
[2023-02-25 12:30:21,224][2409355] Sum rewards: -1.307, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.028', 'AMMO3': '0.074', 'weapon5': '0.098', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'weapon4': '0.176', 'WEAPON5': '0.200', 'WEAPON3': '0.450', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.651', 'HEALTH': '0.700', 'weapon2': '1.300', 'weapon3': '1.540'}
[2023-02-25 12:30:21,341][2409104] DAMAGECOUNT value on done: 195.0
[2023-02-25 12:30:21,341][2409104] Sum rewards: -4.569, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.116', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'weapon5': '0.034', 'HITCOUNT': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.750', 'weapon2': '1.158', 'weapon3': '1.930'}
[2023-02-25 12:30:21,568][2409101] DAMAGECOUNT value on done: 282.0
[2023-02-25 12:30:21,569][2409101] Sum rewards: -2.787, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.684', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'weapon4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.126', 'HITCOUNT': '0.150', 'ARMOR': '0.464', 'DAMAGECOUNT': '0.516', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.454', 'weapon3': '1.620'}
[2023-02-25 12:30:21,578][2409074] Updated weights for policy 0, policy_version 4180 (0.0012)
[2023-02-25 12:30:21,661][2409105] DAMAGECOUNT value on done: 324.0
[2023-02-25 12:30:21,663][2409105] Sum rewards: -8.834, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.514', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.058', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO3': '0.142', 'DAMAGECOUNT': '0.330', 'ARMOR': '0.510', 'WEAPON3': '0.800', 'weapon3': '1.042', 'weapon2': '2.108'}
[2023-02-25 12:30:21,975][2409406] DAMAGECOUNT value on done: 230.0
[2023-02-25 12:30:21,976][2409406] Sum rewards: -8.125, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-3.000', 'HEALTH': '-1.890', 'AMMO2': '0.001', 'AMMO5': '0.006', 'AMMO4': '0.007', 'HITCOUNT': '0.030', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.105', 'AMMO3': '0.122', 'weapon5': '0.126', 'weapon4': '0.132', 'WEAPON5': '0.200', 'ARMOR': '0.453', 'WEAPON3': '0.800', 'weapon3': '1.380', 'weapon2': '1.512'}
[2023-02-25 12:30:22,186][2408954] Fps is (10 sec: 26215.4, 60 sec: 25600.0, 300 sec: 25853.4). Total num frames: 17137664. Throughput: 0: 6374.4. Samples: 4276932. Policy #0 lag: (min: 2.0, avg: 13.2, max: 24.0)
[2023-02-25 12:30:22,186][2408954] Avg episode reward: [(0, '-3.760')]
[2023-02-25 12:30:22,480][2409077] DAMAGECOUNT value on done: 547.0
[2023-02-25 12:30:22,483][2409077] Sum rewards: -1.124, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.222', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.030', 'AMMO3': '0.080', 'weapon5': '0.142', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'weapon4': '0.220', 'HITCOUNT': '0.280', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.900', 'weapon2': '1.298', 'weapon3': '1.316', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:22,645][2409597] DAMAGECOUNT value on done: 100.0
[2023-02-25 12:30:23,362][2409407] DAMAGECOUNT value on done: 85.0
[2023-02-25 12:30:23,365][2409407] Sum rewards: -4.600, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.701', 'AMMO5': '0.007', 'AMMO2': '0.008', 'weapon5': '0.014', 'AMMO4': '0.037', 'HITCOUNT': '0.040', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.135', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'weapon4': '0.190', 'ARMOR': '0.527', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.490', 'weapon3': '1.494'}
[2023-02-25 12:30:23,479][2409076] DAMAGECOUNT value on done: 350.0
[2023-02-25 12:30:23,482][2409076] Sum rewards: -0.031, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.346', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.027', 'ARMOR': '0.040', 'AMMO3': '0.105', 'HITCOUNT': '0.190', 'DAMAGECOUNT': '0.540', 'WEAPON3': '0.700', 'weapon2': '1.704', 'weapon3': '1.734', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:23,509][2409097] DAMAGECOUNT value on done: 203.0
[2023-02-25 12:30:23,510][2409097] Sum rewards: -4.193, reward structure: {'DEATHCOUNT': '-10.500', 'ARMOR': '0.004', 'AMMO2': '0.032', 'weapon4': '0.114', 'HITCOUNT': '0.120', 'AMMO3': '0.140', 'AMMO4': '0.158', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.288', 'HEALTH': '0.299', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.338', 'weapon2': '1.914'}
[2023-02-25 12:30:23,526][2409096] DAMAGECOUNT value on done: 189.0
[2023-02-25 12:30:23,610][2409596] DAMAGECOUNT value on done: 165.0
[2023-02-25 12:30:23,610][2409596] Sum rewards: -0.798, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.180', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.069', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'HITCOUNT': '0.140', 'weapon4': '0.238', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.465', 'FRAGCOUNT': '0.500', 'weapon3': '1.230', 'weapon2': '1.270'}
[2023-02-25 12:30:23,612][2409103] DAMAGECOUNT value on done: 313.0
[2023-02-25 12:30:23,613][2409103] Sum rewards: -0.117, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.444', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.014', 'ARMOR': '0.028', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.063', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'HITCOUNT': '0.120', 'DAMAGECOUNT': '0.465', 'WEAPON3': '0.650', 'weapon3': '1.502', 'weapon2': '1.660', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:30:23,645][2409549] DAMAGECOUNT value on done: 254.0
[2023-02-25 12:30:23,757][2409469] DAMAGECOUNT value on done: 149.0
[2023-02-25 12:30:23,992][2409075] DAMAGECOUNT value on done: 278.0
[2023-02-25 12:30:24,010][2409074] Updated weights for policy 0, policy_version 4190 (0.0013)
[2023-02-25 12:30:24,077][2409389] DAMAGECOUNT value on done: 229.0
[2023-02-25 12:30:24,115][2409078] DAMAGECOUNT value on done: 287.0
[2023-02-25 12:30:24,116][2409078] Sum rewards: -3.846, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.503', 'AMMO5': '0.003', 'weapon5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'DAMAGECOUNT': '0.231', 'weapon4': '0.262', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.482', 'weapon2': '1.556'}
[2023-02-25 12:30:24,179][2409102] DAMAGECOUNT value on done: 311.0
[2023-02-25 12:30:24,180][2409102] Sum rewards: -0.948, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.750', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'WEAPON1': '0.010', 'weapon7': '0.054', 'AMMO3': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.130', 'WEAPON7': '0.200', 'ARMOR': '0.500', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.615', 'weapon2': '0.934', 'FRAGCOUNT': '1.000', 'weapon3': '1.456'}
[2023-02-25 12:30:24,206][2409405] DAMAGECOUNT value on done: 465.0
[2023-02-25 12:30:24,207][2409405] Sum rewards: 0.181, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.082', 'AMMO2': '0.003', 'AMMO4': '0.016', 'weapon4': '0.064', 'AMMO3': '0.066', 'WEAPON4': '0.100', 'HITCOUNT': '0.270', 'WEAPON3': '0.500', 'ARMOR': '0.500', 'DAMAGECOUNT': '0.915', 'FRAGCOUNT': '1.000', 'weapon2': '1.454', 'weapon3': '1.624'}
[2023-02-25 12:30:24,218][2409373] DAMAGECOUNT value on done: 335.0
[2023-02-25 12:30:24,221][2409373] Sum rewards: -4.016, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.585', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.030', 'AMMO4': '0.051', 'ARMOR': '0.084', 'WEAPON5': '0.100', 'weapon4': '0.120', 'AMMO3': '0.128', 'HITCOUNT': '0.220', 'WEAPON4': '0.300', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.885', 'FRAGCOUNT': '1.000', 'weapon3': '1.450', 'weapon2': '1.636'}
[2023-02-25 12:30:24,243][2409548] DAMAGECOUNT value on done: 302.0
[2023-02-25 12:30:24,244][2409548] Sum rewards: -0.555, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.948', 'AMMO2': '0.006', 'ARMOR': '0.008', 'weapon4': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.029', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'HITCOUNT': '0.190', 'DAMAGECOUNT': '0.696', 'WEAPON3': '0.700', 'weapon3': '1.578', 'weapon2': '1.694', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:24,903][2409074] Updated weights for policy 0, policy_version 4200 (0.0013)
[2023-02-25 12:30:24,992][2409100] DAMAGECOUNT value on done: 365.0
[2023-02-25 12:30:24,996][2409100] Sum rewards: -4.761, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.910', 'AMMO2': '0.008', 'AMMO4': '0.040', 'ARMOR': '0.048', 'AMMO3': '0.151', 'HITCOUNT': '0.160', 'weapon4': '0.172', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.432', 'weapon2': '1.438'}
[2023-02-25 12:30:25,032][2409565] DAMAGECOUNT value on done: 177.0
[2023-02-25 12:30:25,037][2409565] Sum rewards: -4.300, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.736', 'AMMO5': '0.003', 'AMMO2': '0.024', 'ARMOR': '0.048', 'WEAPON5': '0.050', 'weapon5': '0.056', 'HITCOUNT': '0.110', 'AMMO4': '0.120', 'AMMO3': '0.126', 'WEAPON4': '0.200', 'weapon4': '0.262', 'DAMAGECOUNT': '0.441', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.650', 'weapon2': '1.212', 'weapon3': '1.634'}
[2023-02-25 12:30:25,151][2409485] DAMAGECOUNT value on done: 447.0
[2023-02-25 12:30:25,156][2409485] Sum rewards: -0.460, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.351', 'AMMO2': '0.014', 'AMMO5': '0.025', 'weapon5': '0.044', 'HITCOUNT': '0.070', 'AMMO4': '0.072', 'AMMO3': '0.080', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.306', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'weapon4': '0.462', 'ARMOR': '0.518', 'FRAGCOUNT': '1.000', 'weapon3': '1.194', 'weapon2': '1.306'}
[2023-02-25 12:30:25,307][2409866] DAMAGECOUNT value on done: 490.0
[2023-02-25 12:30:25,308][2409866] Sum rewards: -0.551, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.308', 'AMMO2': '0.003', 'ARMOR': '0.016', 'AMMO4': '0.016', 'weapon4': '0.018', 'WEAPON1': '0.020', 'WEAPON4': '0.100', 'AMMO3': '0.135', 'HITCOUNT': '0.330', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.260', 'weapon2': '1.562', 'weapon3': '1.796', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:30:25,345][2409355] DAMAGECOUNT value on done: 235.0
[2023-02-25 12:30:25,507][2409104] DAMAGECOUNT value on done: 382.0
[2023-02-25 12:30:25,513][2409104] Sum rewards: 0.822, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.552', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.082', 'AMMO3': '0.118', 'WEAPON4': '0.150', 'HITCOUNT': '0.190', 'weapon4': '0.348', 'ARMOR': '0.442', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.696', 'weapon3': '1.320', 'weapon2': '1.556', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:30:25,601][2409101] DAMAGECOUNT value on done: 498.0
[2023-02-25 12:30:25,602][2409101] Sum rewards: -1.245, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.880', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'weapon4': '0.138', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'HITCOUNT': '0.220', 'DAMAGECOUNT': '0.585', 'WEAPON3': '0.700', 'weapon3': '1.496', 'weapon2': '1.562', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:25,631][2409105] DAMAGECOUNT value on done: 472.0
[2023-02-25 12:30:25,631][2409105] Sum rewards: -1.301, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.258', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'weapon4': '0.074', 'AMMO3': '0.092', 'ARMOR': '0.096', 'HITCOUNT': '0.190', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.780', 'weapon2': '1.330', 'weapon3': '1.930', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:26,196][2409406] DAMAGECOUNT value on done: 246.0
[2023-02-25 12:30:26,549][2409486] DAMAGECOUNT value on done: 555.0
[2023-02-25 12:30:26,553][2409486] Sum rewards: 0.153, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.036', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'HEALTH': '0.076', 'AMMO3': '0.085', 'AMMO4': '0.090', 'WEAPON4': '0.200', 'weapon4': '0.216', 'HITCOUNT': '0.260', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.035', 'weapon2': '1.352', 'weapon3': '1.492', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:30:26,661][2409079] DAMAGECOUNT value on done: 207.0
[2023-02-25 12:30:26,662][2409079] Sum rewards: 1.370, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.666', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'ARMOR': '0.068', 'AMMO4': '0.070', 'AMMO3': '0.071', 'HITCOUNT': '0.120', 'weapon4': '0.158', 'DAMAGECOUNT': '0.441', 'WEAPON3': '0.500', 'weapon3': '1.396', 'weapon2': '1.648', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:26,684][2409077] DAMAGECOUNT value on done: 197.0
[2023-02-25 12:30:26,685][2409077] Sum rewards: 1.360, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.055', 'AMMO2': '0.039', 'AMMO3': '0.078', 'ARMOR': '0.088', 'HITCOUNT': '0.130', 'AMMO4': '0.195', 'WEAPON4': '0.250', 'weapon4': '0.344', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.465', 'weapon3': '0.930', 'weapon2': '1.696', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:26,745][2409074] Updated weights for policy 0, policy_version 4210 (0.0013)
[2023-02-25 12:30:27,026][2409597] DAMAGECOUNT value on done: 290.0
[2023-02-25 12:30:27,031][2409597] Sum rewards: -4.611, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.308', 'AMMO5': '0.003', 'weapon5': '0.008', 'ARMOR': '0.016', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'HITCOUNT': '0.080', 'AMMO4': '0.134', 'AMMO3': '0.136', 'WEAPON4': '0.200', 'weapon4': '0.310', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.268', 'weapon3': '1.376'}
[2023-02-25 12:30:27,126][2409407] DAMAGECOUNT value on done: 1092.0
[2023-02-25 12:30:27,186][2408954] Fps is (10 sec: 25394.5, 60 sec: 25326.8, 300 sec: 25797.8). Total num frames: 17252352. Throughput: 0: 6344.3. Samples: 4314252. Policy #0 lag: (min: 0.0, avg: 13.6, max: 26.0)
[2023-02-25 12:30:27,187][2408954] Avg episode reward: [(0, '-3.243')]
[2023-02-25 12:30:27,192][2409033] Saving new best policy, reward=-3.243!
[2023-02-25 12:30:27,233][2409103] DAMAGECOUNT value on done: 203.0
[2023-02-25 12:30:27,235][2409103] Sum rewards: -2.211, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.090', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'ARMOR': '0.035', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'weapon5': '0.100', 'HITCOUNT': '0.140', 'WEAPON5': '0.150', 'weapon4': '0.212', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.540', 'FRAGCOUNT': '1.000', 'weapon3': '1.308', 'weapon2': '1.456'}
[2023-02-25 12:30:27,358][2409097] DAMAGECOUNT value on done: 191.0
[2023-02-25 12:30:27,359][2409097] Sum rewards: -4.949, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.277', 'weapon5': '0.002', 'AMMO5': '0.007', 'ARMOR': '0.024', 'AMMO2': '0.025', 'AMMO3': '0.108', 'AMMO4': '0.126', 'HITCOUNT': '0.150', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.417', 'weapon4': '0.548', 'WEAPON3': '0.550', 'weapon3': '0.814', 'FRAGCOUNT': '1.000', 'weapon2': '1.856'}
[2023-02-25 12:30:27,511][2409096] DAMAGECOUNT value on done: 197.0
[2023-02-25 12:30:27,511][2409096] Sum rewards: -0.786, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.019', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO3': '0.072', 'AMMO4': '0.090', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.186', 'DAMAGECOUNT': '0.288', 'WEAPON3': '0.450', 'ARMOR': '0.460', 'weapon3': '1.250', 'weapon2': '1.624', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:27,524][2409075] DAMAGECOUNT value on done: 97.0
[2023-02-25 12:30:27,607][2409389] DAMAGECOUNT value on done: 209.0
[2023-02-25 12:30:27,608][2409389] Sum rewards: -2.849, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.498', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.018', 'ARMOR': '0.084', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'HITCOUNT': '0.120', 'WEAPON4': '0.200', 'weapon4': '0.214', 'DAMAGECOUNT': '0.516', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.470', 'weapon2': '1.508'}
[2023-02-25 12:30:27,693][2409469] DAMAGECOUNT value on done: 795.0
[2023-02-25 12:30:27,697][2409469] Sum rewards: -8.194, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.330', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.005', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.022', 'AMMO4': '0.023', 'ARMOR': '0.060', 'AMMO3': '0.148', 'HITCOUNT': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.152', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.850', 'weapon3': '1.374', 'weapon2': '1.528'}
[2023-02-25 12:30:27,710][2409549] DAMAGECOUNT value on done: 284.0
[2023-02-25 12:30:27,713][2409549] Sum rewards: -1.984, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.640', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.040', 'ARMOR': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.084', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.250', 'DAMAGECOUNT': '0.261', 'WEAPON3': '0.500', 'weapon2': '1.190', 'weapon3': '1.724'}
[2023-02-25 12:30:27,717][2409596] DAMAGECOUNT value on done: 279.0
[2023-02-25 12:30:27,938][2409076] DAMAGECOUNT value on done: 377.0
[2023-02-25 12:30:27,939][2409076] Sum rewards: -1.783, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.978', 'AMMO5': '0.003', 'weapon5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'AMMO3': '0.076', 'HITCOUNT': '0.190', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'weapon4': '0.480', 'DAMAGECOUNT': '0.696', 'weapon3': '0.830', 'weapon2': '2.044', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:30:28,017][2409548] DAMAGECOUNT value on done: 100.0
[2023-02-25 12:30:28,252][2409074] Updated weights for policy 0, policy_version 4220 (0.0012)
[2023-02-25 12:30:28,295][2409078] DAMAGECOUNT value on done: 238.0
[2023-02-25 12:30:28,296][2409078] Sum rewards: -2.541, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.838', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.071', 'ARMOR': '0.084', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.312', 'WEAPON3': '0.450', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.639', 'weapon3': '1.110', 'weapon2': '1.376'}
[2023-02-25 12:30:28,355][2409405] DAMAGECOUNT value on done: 232.0
[2023-02-25 12:30:28,358][2409405] Sum rewards: -8.130, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.688', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.024', 'ARMOR': '0.036', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'HITCOUNT': '0.130', 'AMMO3': '0.181', 'DAMAGECOUNT': '0.531', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon3': '1.562', 'weapon2': '1.726'}
[2023-02-25 12:30:28,403][2409102] DAMAGECOUNT value on done: 131.0
[2023-02-25 12:30:28,503][2409100] DAMAGECOUNT value on done: 247.0
[2023-02-25 12:30:28,503][2409100] Sum rewards: -1.249, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.824', 'weapon4': '0.006', 'AMMO2': '0.012', 'weapon7': '0.044', 'WEAPON4': '0.050', 'AMMO4': '0.061', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.119', 'HITCOUNT': '0.150', 'ARMOR': '0.420', 'DAMAGECOUNT': '0.525', 'WEAPON3': '0.750', 'weapon2': '1.234', 'weapon3': '1.904', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:30:28,528][2409373] DAMAGECOUNT value on done: 362.0
[2023-02-25 12:30:28,528][2409373] Sum rewards: -0.980, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.120', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.029', 'weapon7': '0.048', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'weapon5': '0.118', 'weapon4': '0.124', 'AMMO6': '0.160', 'AMMO7': '0.160', 'HITCOUNT': '0.160', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.540', 'weapon2': '1.132', 'weapon3': '1.316'}
[2023-02-25 12:30:28,957][2409485] DAMAGECOUNT value on done: 419.0
[2023-02-25 12:30:28,958][2409485] Sum rewards: -4.007, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.580', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO3': '0.092', 'HITCOUNT': '0.100', 'AMMO4': '0.106', 'weapon4': '0.210', 'WEAPON4': '0.250', 'ARMOR': '0.449', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.378', 'weapon2': '1.714'}
[2023-02-25 12:30:29,047][2409866] DAMAGECOUNT value on done: 381.0
[2023-02-25 12:30:29,047][2409866] Sum rewards: -5.502, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.286', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'HITCOUNT': '0.200', 'weapon4': '0.282', 'DAMAGECOUNT': '0.720', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon3': '1.406', 'weapon2': '1.536'}
[2023-02-25 12:30:29,067][2409355] DAMAGECOUNT value on done: 139.0
[2023-02-25 12:30:29,103][2409565] DAMAGECOUNT value on done: 229.0
[2023-02-25 12:30:29,104][2409565] Sum rewards: -6.251, reward structure: {'DEATHCOUNT': '-10.500', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.058', 'ARMOR': '0.060', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'AMMO4': '0.113', 'HITCOUNT': '0.120', 'weapon4': '0.386', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.500', 'HEALTH': '0.988', 'weapon3': '1.370', 'weapon2': '1.388'}
[2023-02-25 12:30:29,536][2409101] DAMAGECOUNT value on done: 367.0
[2023-02-25 12:30:29,537][2409101] Sum rewards: 0.891, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-1.090', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO3': '0.020', 'weapon7': '0.048', 'HITCOUNT': '0.060', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.126', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.591', 'weapon3': '0.626', 'FRAGCOUNT': '1.000', 'weapon2': '1.058'}
[2023-02-25 12:30:29,698][2409074] Updated weights for policy 0, policy_version 4230 (0.0012)
[2023-02-25 12:30:29,736][2409104] DAMAGECOUNT value on done: 230.0
[2023-02-25 12:30:29,853][2409406] DAMAGECOUNT value on done: 634.0
[2023-02-25 12:30:29,855][2409406] Sum rewards: 3.030, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.788', 'AMMO2': '0.012', 'AMMO4': '0.058', 'ARMOR': '0.064', 'AMMO3': '0.093', 'WEAPON4': '0.200', 'weapon4': '0.244', 'HITCOUNT': '0.270', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.125', 'weapon2': '1.406', 'weapon3': '1.546', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:30:29,925][2409105] DAMAGECOUNT value on done: 250.0
[2023-02-25 12:30:29,928][2409105] Sum rewards: -4.353, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.040', 'AMMO2': '0.008', 'AMMO4': '0.042', 'HITCOUNT': '0.080', 'AMMO3': '0.167', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.080', 'weapon3': '2.090'}
[2023-02-25 12:30:30,334][2409077] DAMAGECOUNT value on done: 181.0
[2023-02-25 12:30:30,351][2409077] Sum rewards: -4.951, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.452', 'AMMO5': '0.010', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.069', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.138', 'AMMO3': '0.157', 'DAMAGECOUNT': '0.315', 'ARMOR': '0.480', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.400', 'weapon3': '1.568'}
[2023-02-25 12:30:30,369][2409486] DAMAGECOUNT value on done: 588.0
[2023-02-25 12:30:30,370][2409486] Sum rewards: -2.305, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.167', 'AMMO2': '0.002', 'AMMO4': '0.010', 'WEAPON4': '0.050', 'weapon4': '0.070', 'AMMO3': '0.117', 'HITCOUNT': '0.240', 'ARMOR': '0.496', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.140', 'weapon2': '1.226', 'weapon3': '1.960', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:30,411][2409079] DAMAGECOUNT value on done: 397.0
[2023-02-25 12:30:30,412][2409079] Sum rewards: -1.928, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.780', 'AMMO2': '0.024', 'weapon4': '0.040', 'HITCOUNT': '0.080', 'AMMO3': '0.093', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.405', 'ARMOR': '0.492', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.490', 'weapon2': '1.860'}
[2023-02-25 12:30:30,871][2409407] DAMAGECOUNT value on done: 335.0
[2023-02-25 12:30:30,874][2409407] Sum rewards: 0.985, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.330', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'weapon4': '0.056', 'weapon5': '0.060', 'AMMO3': '0.088', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'HITCOUNT': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.843', 'FRAGCOUNT': '1.000', 'weapon2': '1.600', 'weapon3': '1.602'}
[2023-02-25 12:30:30,890][2409597] DAMAGECOUNT value on done: 546.0
[2023-02-25 12:30:30,893][2409597] Sum rewards: -4.030, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.236', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.032', 'weapon5': '0.056', 'AMMO3': '0.082', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'weapon4': '0.404', 'DAMAGECOUNT': '0.528', 'WEAPON3': '0.550', 'weapon2': '1.338', 'weapon3': '1.378'}
[2023-02-25 12:30:30,949][2409097] DAMAGECOUNT value on done: 425.0
[2023-02-25 12:30:30,950][2409097] Sum rewards: 3.081, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.670', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.003', 'weapon5': '0.008', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.054', 'weapon7': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.230', 'WEAPON3': '0.400', 'DAMAGECOUNT': '1.020', 'weapon3': '1.398', 'weapon2': '1.594', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:30:31,094][2409075] DAMAGECOUNT value on done: 455.0
[2023-02-25 12:30:31,095][2409075] Sum rewards: -2.989, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.444', 'weapon5': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.010', 'ARMOR': '0.024', 'WEAPON1': '0.040', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'HITCOUNT': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.222', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.870', 'weapon2': '1.334', 'weapon3': '1.518'}
[2023-02-25 12:30:31,169][2409389] DAMAGECOUNT value on done: 367.0
[2023-02-25 12:30:31,171][2409389] Sum rewards: -1.727, reward structure: {'DEATHCOUNT': '-8.250', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'ARMOR': '0.120', 'AMMO3': '0.124', 'weapon4': '0.224', 'DAMAGECOUNT': '0.330', 'HEALTH': '0.631', 'WEAPON3': '0.700', 'weapon2': '0.962', 'FRAGCOUNT': '1.000', 'weapon3': '2.062'}
[2023-02-25 12:30:31,385][2409549] DAMAGECOUNT value on done: 240.0
[2023-02-25 12:30:31,460][2409096] DAMAGECOUNT value on done: 122.0
[2023-02-25 12:30:31,463][2409096] Sum rewards: -5.639, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.700', 'AMMO2': '0.007', 'AMMO4': '0.036', 'HITCOUNT': '0.070', 'AMMO3': '0.134', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.201', 'weapon4': '0.294', 'ARMOR': '0.450', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.396', 'weapon2': '1.422'}
[2023-02-25 12:30:31,567][2409103] DAMAGECOUNT value on done: 256.0
[2023-02-25 12:30:31,620][2409548] DAMAGECOUNT value on done: 362.0
[2023-02-25 12:30:31,622][2409548] Sum rewards: 1.057, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.281', 'AMMO2': '0.020', 'AMMO3': '0.042', 'ARMOR': '0.064', 'AMMO4': '0.101', 'HITCOUNT': '0.120', 'WEAPON4': '0.200', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.402', 'weapon4': '0.448', 'FRAGCOUNT': '1.000', 'weapon3': '1.150', 'weapon2': '1.240'}
[2023-02-25 12:30:31,635][2409469] DAMAGECOUNT value on done: 407.0
[2023-02-25 12:30:31,635][2409469] Sum rewards: -0.417, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.322', 'AMMO2': '0.029', 'ARMOR': '0.052', 'AMMO3': '0.122', 'AMMO4': '0.146', 'HITCOUNT': '0.170', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.381', 'WEAPON3': '0.650', 'weapon4': '0.730', 'weapon2': '0.992', 'weapon3': '1.082', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:30:31,671][2409596] DAMAGECOUNT value on done: 274.0
[2023-02-25 12:30:31,672][2409596] Sum rewards: -2.487, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.092', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'HITCOUNT': '0.080', 'ARMOR': '0.080', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'weapon4': '0.142', 'DAMAGECOUNT': '0.255', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.366', 'weapon2': '1.640'}
[2023-02-25 12:30:31,810][2409074] Updated weights for policy 0, policy_version 4240 (0.0012)
[2023-02-25 12:30:31,871][2409078] DAMAGECOUNT value on done: 275.0
[2023-02-25 12:30:31,874][2409078] Sum rewards: -4.736, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.105', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.006', 'AMMO4': '0.029', 'WEAPON5': '0.050', 'HITCOUNT': '0.170', 'AMMO3': '0.186', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.140', 'weapon3': '2.070'}
[2023-02-25 12:30:31,929][2409405] DAMAGECOUNT value on done: 329.0
[2023-02-25 12:30:31,930][2409405] Sum rewards: -4.121, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.754', 'AMMO5': '0.007', 'AMMO2': '0.021', 'ARMOR': '0.024', 'WEAPON4': '0.050', 'HITCOUNT': '0.080', 'weapon5': '0.090', 'AMMO4': '0.104', 'weapon4': '0.124', 'AMMO3': '0.128', 'WEAPON5': '0.150', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.732', 'weapon2': '1.408', 'weapon3': '1.514'}
[2023-02-25 12:30:32,016][2409102] DAMAGECOUNT value on done: 387.0
[2023-02-25 12:30:32,017][2409102] Sum rewards: -0.405, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'ARMOR': '0.032', 'AMMO4': '0.038', 'weapon4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.087', 'HITCOUNT': '0.200', 'HEALTH': '0.316', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.651', 'FRAGCOUNT': '1.000', 'weapon3': '1.666', 'weapon2': '1.686'}
[2023-02-25 12:30:32,080][2409100] DAMAGECOUNT value on done: 253.0
[2023-02-25 12:30:32,081][2409100] Sum rewards: -2.653, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.580', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.009', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.054', 'ARMOR': '0.056', 'AMMO3': '0.127', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.633', 'WEAPON3': '0.700', 'weapon2': '1.542', 'weapon3': '1.718', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:32,134][2409076] DAMAGECOUNT value on done: 215.0
[2023-02-25 12:30:32,137][2409076] Sum rewards: -4.472, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.602', 'AMMO2': '0.010', 'AMMO4': '0.051', 'HITCOUNT': '0.060', 'ARMOR': '0.064', 'AMMO3': '0.099', 'DAMAGECOUNT': '0.225', 'WEAPON4': '0.300', 'weapon4': '0.310', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.156', 'weapon2': '1.604'}
[2023-02-25 12:30:32,186][2408954] Fps is (10 sec: 24576.1, 60 sec: 25531.7, 300 sec: 25839.5). Total num frames: 17383424. Throughput: 0: 6336.3. Samples: 4352640. Policy #0 lag: (min: 1.0, avg: 13.3, max: 28.0)
[2023-02-25 12:30:32,186][2408954] Avg episode reward: [(0, '-3.071')]
[2023-02-25 12:30:32,187][2409033] Saving new best policy, reward=-3.071!
[2023-02-25 12:30:32,674][2409373] DAMAGECOUNT value on done: 351.0
[2023-02-25 12:30:32,675][2409373] Sum rewards: -3.263, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.610', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'ARMOR': '0.004', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'HITCOUNT': '0.140', 'weapon4': '0.186', 'DAMAGECOUNT': '0.558', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.562', 'weapon3': '1.584'}
[2023-02-25 12:30:32,679][2409866] DAMAGECOUNT value on done: 311.0
[2023-02-25 12:30:32,694][2409565] DAMAGECOUNT value on done: 231.0
[2023-02-25 12:30:32,691][2409355] DAMAGECOUNT value on done: 135.0
[2023-02-25 12:30:32,698][2409565] Sum rewards: -4.661, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.560', 'AMMO2': '0.012', 'weapon4': '0.026', 'ARMOR': '0.040', 'AMMO4': '0.058', 'HITCOUNT': '0.080', 'AMMO3': '0.134', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.249', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.646', 'weapon2': '1.654'}
[2023-02-25 12:30:32,698][2409355] Sum rewards: -3.245, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.170', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'HITCOUNT': '0.060', 'weapon4': '0.076', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.270', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.412', 'weapon3': '1.712'}
[2023-02-25 12:30:33,055][2409485] DAMAGECOUNT value on done: 223.0
[2023-02-25 12:30:33,058][2409485] Sum rewards: -6.099, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.644', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.022', 'AMMO2': '0.028', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.095', 'AMMO4': '0.139', 'HITCOUNT': '0.160', 'weapon4': '0.198', 'WEAPON4': '0.350', 'DAMAGECOUNT': '0.525', 'WEAPON3': '0.600', 'weapon2': '1.342', 'weapon3': '1.488'}
[2023-02-25 12:30:33,169][2409074] Updated weights for policy 0, policy_version 4250 (0.0012)
[2023-02-25 12:30:33,197][2409101] DAMAGECOUNT value on done: 300.0
[2023-02-25 12:30:33,200][2409101] Sum rewards: -3.163, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.390', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'ARMOR': '0.036', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.125', 'weapon4': '0.248', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.200', 'weapon3': '1.672'}
[2023-02-25 12:30:33,281][2409104] DAMAGECOUNT value on done: 436.0
[2023-02-25 12:30:33,281][2409104] Sum rewards: -2.390, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.248', 'AMMO2': '0.021', 'AMMO3': '0.087', 'AMMO4': '0.105', 'HITCOUNT': '0.120', 'weapon4': '0.128', 'WEAPON4': '0.150', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.412', 'weapon2': '1.734'}
[2023-02-25 12:30:33,534][2409406] DAMAGECOUNT value on done: 416.0
[2023-02-25 12:30:33,534][2409406] Sum rewards: -2.474, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.491', 'AMMO2': '0.016', 'ARMOR': '0.028', 'WEAPON4': '0.050', 'AMMO4': '0.081', 'HITCOUNT': '0.120', 'AMMO3': '0.131', 'weapon4': '0.272', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.750', 'weapon2': '0.928', 'FRAGCOUNT': '1.000', 'weapon3': '1.736'}
[2023-02-25 12:30:33,726][2409099] DAMAGECOUNT value on done: 239.0
[2023-02-25 12:30:33,727][2409099] Sum rewards: -8.134, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.490', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO4': '0.055', 'ARMOR': '0.064', 'HITCOUNT': '0.090', 'AMMO3': '0.182', 'DAMAGECOUNT': '0.183', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon3': '1.716', 'weapon2': '1.802'}
[2023-02-25 12:30:33,862][2409105] DAMAGECOUNT value on done: 340.0
[2023-02-25 12:30:33,865][2409105] Sum rewards: 1.092, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.070', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.028', 'weapon5': '0.046', 'AMMO3': '0.082', 'WEAPON5': '0.100', 'HITCOUNT': '0.150', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.500', 'weapon2': '1.140', 'weapon3': '1.926', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:33,998][2409486] DAMAGECOUNT value on done: 360.0
[2023-02-25 12:30:33,999][2409486] Sum rewards: 0.657, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.765', 'AMMO4': '-0.059', 'AMMO2': '-0.012', 'AMMO3': '0.090', 'HITCOUNT': '0.180', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.555', 'FRAGCOUNT': '1.000', 'weapon2': '1.166', 'weapon3': '1.752'}
[2023-02-25 12:30:34,036][2409077] DAMAGECOUNT value on done: 376.0
[2023-02-25 12:30:34,037][2409077] Sum rewards: -0.969, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.276', 'AMMO2': '0.018', 'ARMOR': '0.084', 'AMMO4': '0.090', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'HITCOUNT': '0.200', 'weapon4': '0.228', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.693', 'FRAGCOUNT': '1.000', 'weapon2': '1.288', 'weapon3': '1.546'}
[2023-02-25 12:30:34,233][2409079] DAMAGECOUNT value on done: 195.0
[2023-02-25 12:30:34,237][2409079] Sum rewards: -0.880, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.108', 'AMMO2': '0.028', 'weapon4': '0.036', 'ARMOR': '0.056', 'AMMO3': '0.090', 'HITCOUNT': '0.090', 'AMMO4': '0.138', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon2': '1.638', 'weapon3': '1.752'}
[2023-02-25 12:30:34,609][2409074] Updated weights for policy 0, policy_version 4260 (0.0013)
[2023-02-25 12:30:34,674][2409407] DAMAGECOUNT value on done: 230.0
[2023-02-25 12:30:34,675][2409407] Sum rewards: -6.963, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.038', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.058', 'weapon5': '0.062', 'HITCOUNT': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.126', 'weapon4': '0.204', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.700', 'weapon2': '1.262', 'weapon3': '1.526'}
[2023-02-25 12:30:34,708][2409097] DAMAGECOUNT value on done: 133.0
[2023-02-25 12:30:34,883][2409597] DAMAGECOUNT value on done: 505.0
[2023-02-25 12:30:34,886][2409597] Sum rewards: -4.148, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.320', 'AMMO4': '-0.008', 'AMMO2': '-0.001', 'WEAPON4': '0.050', 'AMMO3': '0.097', 'weapon4': '0.108', 'HITCOUNT': '0.200', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.720', 'weapon3': '1.072', 'FRAGCOUNT': '2.000', 'weapon2': '2.334'}
[2023-02-25 12:30:34,956][2409075] DAMAGECOUNT value on done: 154.0
[2023-02-25 12:30:34,958][2409075] Sum rewards: -5.976, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.398', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'ARMOR': '0.056', 'HITCOUNT': '0.060', 'AMMO3': '0.074', 'AMMO4': '0.092', 'DAMAGECOUNT': '0.141', 'WEAPON4': '0.250', 'weapon4': '0.340', 'WEAPON3': '0.450', 'weapon2': '0.968', 'weapon3': '1.650'}
[2023-02-25 12:30:35,040][2409389] DAMAGECOUNT value on done: 403.0
[2023-02-25 12:30:35,041][2409389] Sum rewards: -2.091, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.420', 'AMMO5': '0.004', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'weapon4': '0.042', 'AMMO4': '0.053', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.122', 'HITCOUNT': '0.130', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.777', 'weapon2': '1.324', 'weapon3': '1.848', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:35,081][2409547] DAMAGECOUNT value on done: 228.0
[2023-02-25 12:30:35,125][2409103] DAMAGECOUNT value on done: 345.0
[2023-02-25 12:30:35,126][2409103] Sum rewards: -2.516, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.505', 'AMMO2': '0.003', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.017', 'weapon5': '0.022', 'weapon4': '0.032', 'HITCOUNT': '0.070', 'ARMOR': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.363', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.750', 'weapon2': '0.864', 'weapon3': '1.898'}
[2023-02-25 12:30:35,168][2409548] DAMAGECOUNT value on done: 440.0
[2023-02-25 12:30:35,171][2409548] Sum rewards: -3.034, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.867', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.038', 'ARMOR': '0.044', 'AMMO3': '0.080', 'weapon5': '0.114', 'WEAPON5': '0.200', 'HITCOUNT': '0.250', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.771', 'weapon2': '1.396', 'weapon3': '1.622'}
[2023-02-25 12:30:35,177][2409549] DAMAGECOUNT value on done: 247.0
[2023-02-25 12:30:35,498][2409596] DAMAGECOUNT value on done: 229.0
[2023-02-25 12:30:35,500][2409596] Sum rewards: -1.618, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.640', 'AMMO5': '0.003', 'weapon5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'AMMO3': '0.070', 'AMMO4': '0.108', 'HITCOUNT': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.230', 'DAMAGECOUNT': '0.447', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.256', 'weapon2': '1.668'}
[2023-02-25 12:30:35,604][2409100] DAMAGECOUNT value on done: 456.0
[2023-02-25 12:30:35,607][2409100] Sum rewards: 2.242, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.374', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'WEAPON1': '0.010', 'AMMO3': '0.045', 'HITCOUNT': '0.130', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.471', 'ARMOR': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.060', 'weapon2': '1.354'}
[2023-02-25 12:30:35,644][2409078] DAMAGECOUNT value on done: 190.0
[2023-02-25 12:30:35,670][2409405] DAMAGECOUNT value on done: 195.0
[2023-02-25 12:30:35,671][2409405] Sum rewards: -2.909, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.600', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.021', 'weapon4': '0.042', 'HITCOUNT': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.270', 'WEAPON3': '0.500', 'ARMOR': '0.506', 'weapon3': '1.324', 'weapon2': '1.910'}
[2023-02-25 12:30:35,841][2409102] DAMAGECOUNT value on done: 245.0
[2023-02-25 12:30:35,841][2409102] Sum rewards: -4.235, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.140', 'AMMO2': '0.000', 'AMMO4': '0.000', 'weapon4': '0.024', 'weapon7': '0.078', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.136', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.345', 'ARMOR': '0.523', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.084', 'weapon2': '2.124'}
[2023-02-25 12:30:35,977][2409076] DAMAGECOUNT value on done: 234.0
[2023-02-25 12:30:35,978][2409076] Sum rewards: -3.099, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.125', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.015', 'weapon4': '0.016', 'ARMOR': '0.020', 'HITCOUNT': '0.060', 'weapon5': '0.080', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.573', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.208', 'weapon3': '1.718'}
[2023-02-25 12:30:35,988][2409096] DAMAGECOUNT value on done: 214.0
[2023-02-25 12:30:35,989][2409096] Sum rewards: 0.015, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.642', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.059', 'ARMOR': '0.064', 'AMMO3': '0.089', 'HITCOUNT': '0.130', 'weapon4': '0.132', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon2': '1.608', 'weapon3': '1.658'}
[2023-02-25 12:30:36,181][2409469] DAMAGECOUNT value on done: 380.0
[2023-02-25 12:30:36,184][2409469] Sum rewards: -1.557, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.612', 'AMMO2': '0.003', 'AMMO4': '0.012', 'WEAPON4': '0.050', 'AMMO3': '0.121', 'HITCOUNT': '0.140', 'weapon4': '0.246', 'DAMAGECOUNT': '0.555', 'WEAPON3': '0.700', 'weapon2': '0.994', 'weapon3': '1.734', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:36,219][2409074] Updated weights for policy 0, policy_version 4270 (0.0012)
[2023-02-25 12:30:36,652][2409485] DAMAGECOUNT value on done: 314.0
[2023-02-25 12:30:36,660][2409565] DAMAGECOUNT value on done: 255.0
[2023-02-25 12:30:36,661][2409565] Sum rewards: -2.378, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.660', 'AMMO2': '0.014', 'AMMO4': '0.067', 'HITCOUNT': '0.100', 'AMMO3': '0.137', 'WEAPON4': '0.200', 'weapon4': '0.264', 'DAMAGECOUNT': '0.372', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.378', 'weapon3': '1.600'}
[2023-02-25 12:30:36,685][2409373] DAMAGECOUNT value on done: 430.0
[2023-02-25 12:30:36,686][2409373] Sum rewards: -1.132, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.454', 'AMMO2': '0.024', 'weapon4': '0.110', 'AMMO4': '0.120', 'AMMO3': '0.128', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.825', 'weapon2': '1.550', 'weapon3': '1.554', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:36,750][2409866] DAMAGECOUNT value on done: 456.0
[2023-02-25 12:30:36,751][2409866] Sum rewards: -1.936, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.734', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.010', 'ARMOR': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'HITCOUNT': '0.170', 'weapon4': '0.188', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.777', 'weapon3': '1.432', 'weapon2': '1.650', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:36,776][2409355] DAMAGECOUNT value on done: 261.0
[2023-02-25 12:30:36,777][2409355] Sum rewards: 0.078, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.185', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon7': '0.056', 'HITCOUNT': '0.060', 'AMMO3': '0.091', 'ARMOR': '0.096', 'WEAPON4': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'DAMAGECOUNT': '0.171', 'WEAPON7': '0.200', 'weapon4': '0.298', 'WEAPON3': '0.600', 'weapon2': '0.984', 'FRAGCOUNT': '1.000', 'weapon3': '1.700'}
[2023-02-25 12:30:36,914][2409101] DAMAGECOUNT value on done: 470.0
[2023-02-25 12:30:36,917][2409101] Sum rewards: -3.784, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.230', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'ARMOR': '0.032', 'weapon5': '0.040', 'AMMO3': '0.075', 'AMMO4': '0.111', 'weapon4': '0.126', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.690', 'weapon3': '1.172', 'weapon2': '2.080'}
[2023-02-25 12:30:37,186][2408954] Fps is (10 sec: 25805.0, 60 sec: 25600.0, 300 sec: 25811.7). Total num frames: 17510400. Throughput: 0: 6326.4. Samples: 4371672. Policy #0 lag: (min: 1.0, avg: 13.6, max: 30.0)
[2023-02-25 12:30:37,186][2408954] Avg episode reward: [(0, '-2.785')]
[2023-02-25 12:30:37,234][2409033] Saving new best policy, reward=-2.785!
[2023-02-25 12:30:37,346][2409099] DAMAGECOUNT value on done: 265.0
[2023-02-25 12:30:37,349][2409099] Sum rewards: -1.298, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.738', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.034', 'AMMO4': '0.036', 'AMMO3': '0.109', 'WEAPON5': '0.150', 'HITCOUNT': '0.160', 'ARMOR': '0.515', 'DAMAGECOUNT': '0.525', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.290', 'weapon3': '1.746'}
[2023-02-25 12:30:37,492][2409105] DAMAGECOUNT value on done: 614.0
[2023-02-25 12:30:37,492][2409105] Sum rewards: -1.311, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.986', 'AMMO2': '0.005', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.012', 'ARMOR': '0.012', 'AMMO4': '0.023', 'WEAPON5': '0.050', 'AMMO3': '0.165', 'HITCOUNT': '0.360', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.407', 'weapon2': '1.486', 'weapon3': '1.740', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:30:37,568][2409104] DAMAGECOUNT value on done: 111.0
[2023-02-25 12:30:37,571][2409104] Sum rewards: -1.234, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.412', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.008', 'AMMO4': '0.034', 'WEAPON1': '0.040', 'AMMO3': '0.071', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.246', 'WEAPON4': '0.250', 'weapon4': '0.338', 'WEAPON3': '0.350', 'FRAGCOUNT': '0.500', 'ARMOR': '0.510', 'weapon3': '0.844', 'weapon2': '2.026'}
[2023-02-25 12:30:37,579][2409486] DAMAGECOUNT value on done: 185.0
[2023-02-25 12:30:37,579][2409486] Sum rewards: -1.706, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.910', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'HITCOUNT': '0.120', 'AMMO3': '0.121', 'DAMAGECOUNT': '0.405', 'ARMOR': '0.455', 'WEAPON3': '0.700', 'weapon2': '1.534', 'weapon3': '1.620', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:37,735][2409406] DAMAGECOUNT value on done: 309.0
[2023-02-25 12:30:37,736][2409406] Sum rewards: -0.680, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.545', 'AMMO2': '0.003', 'AMMO5': '0.005', 'weapon5': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.016', 'weapon4': '0.026', 'WEAPON4': '0.050', 'ARMOR': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.153', 'HITCOUNT': '0.170', 'DAMAGECOUNT': '0.687', 'WEAPON3': '0.750', 'weapon2': '1.106', 'weapon3': '1.968', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:30:37,895][2409074] Updated weights for policy 0, policy_version 4280 (0.0012)
[2023-02-25 12:30:38,050][2409079] DAMAGECOUNT value on done: 147.0
[2023-02-25 12:30:38,239][2409077] DAMAGECOUNT value on done: 504.0
[2023-02-25 12:30:38,240][2409077] Sum rewards: -3.830, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.390', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'ARMOR': '0.016', 'weapon7': '0.072', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.166', 'AMMO3': '0.170', 'HITCOUNT': '0.190', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.621', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.100', 'weapon2': '1.150', 'weapon3': '1.790'}
[2023-02-25 12:30:38,447][2409407] DAMAGECOUNT value on done: 503.0
[2023-02-25 12:30:38,450][2409407] Sum rewards: -3.758, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.336', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.010', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.079', 'weapon4': '0.156', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.495', 'FRAGCOUNT': '0.500', 'ARMOR': '0.530', 'WEAPON3': '0.550', 'weapon3': '1.414', 'weapon2': '1.828'}
[2023-02-25 12:30:38,491][2409075] DAMAGECOUNT value on done: 165.0
[2023-02-25 12:30:38,491][2409097] DAMAGECOUNT value on done: 304.0
[2023-02-25 12:30:38,491][2409097] Sum rewards: -4.791, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.518', 'weapon4': '0.002', 'AMMO5': '0.004', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'weapon5': '0.052', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'DAMAGECOUNT': '0.360', 'ARMOR': '0.440', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.604', 'weapon3': '1.676'}
[2023-02-25 12:30:38,540][2409389] DAMAGECOUNT value on done: 617.0
[2023-02-25 12:30:38,940][2409103] DAMAGECOUNT value on done: 250.0
[2023-02-25 12:30:38,943][2409103] Sum rewards: -1.581, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.770', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'weapon4': '0.048', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO3': '0.090', 'AMMO4': '0.135', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.690', 'FRAGCOUNT': '1.000', 'weapon3': '1.112', 'weapon2': '1.848'}
[2023-02-25 12:30:38,961][2409549] DAMAGECOUNT value on done: 467.0
[2023-02-25 12:30:38,963][2409549] Sum rewards: -0.728, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.506', 'AMMO5': '0.004', 'AMMO2': '0.022', 'weapon5': '0.040', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'ARMOR': '0.100', 'AMMO4': '0.110', 'HITCOUNT': '0.170', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'weapon4': '0.488', 'DAMAGECOUNT': '0.663', 'weapon3': '1.158', 'weapon2': '1.586', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:39,054][2409547] DAMAGECOUNT value on done: 527.0
[2023-02-25 12:30:39,055][2409547] Sum rewards: 1.630, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.022', 'HEALTH': '0.024', 'ARMOR': '0.036', 'weapon4': '0.040', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.066', 'AMMO3': '0.077', 'AMMO4': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.250', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.936', 'weapon3': '1.370', 'weapon2': '1.610', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:30:39,090][2409597] DAMAGECOUNT value on done: 413.0
[2023-02-25 12:30:39,094][2409597] Sum rewards: -5.918, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.510', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'ARMOR': '0.064', 'AMMO4': '0.095', 'HITCOUNT': '0.150', 'AMMO3': '0.154', 'weapon4': '0.244', 'WEAPON4': '0.350', 'DAMAGECOUNT': '0.432', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.472', 'weapon2': '1.492'}
[2023-02-25 12:30:39,469][2409102] DAMAGECOUNT value on done: 240.0
[2023-02-25 12:30:39,493][2409078] DAMAGECOUNT value on done: 167.0
[2023-02-25 12:30:39,494][2409078] Sum rewards: -1.607, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.346', 'AMMO2': '0.030', 'ARMOR': '0.060', 'AMMO3': '0.090', 'HITCOUNT': '0.090', 'AMMO4': '0.150', 'weapon4': '0.174', 'DAMAGECOUNT': '0.246', 'WEAPON4': '0.350', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.216', 'weapon3': '1.782'}
[2023-02-25 12:30:39,504][2409405] DAMAGECOUNT value on done: 331.0
[2023-02-25 12:30:39,505][2409405] Sum rewards: -1.115, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.705', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'ARMOR': '0.052', 'AMMO3': '0.094', 'weapon5': '0.098', 'AMMO4': '0.101', 'HITCOUNT': '0.120', 'WEAPON4': '0.300', 'weapon4': '0.346', 'DAMAGECOUNT': '0.486', 'WEAPON3': '0.550', 'weapon2': '1.064', 'weapon3': '1.306'}
[2023-02-25 12:30:39,632][2409074] Updated weights for policy 0, policy_version 4290 (0.0012)
[2023-02-25 12:30:39,725][2409548] DAMAGECOUNT value on done: 134.0
[2023-02-25 12:30:39,727][2409548] Sum rewards: -2.671, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.245', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.027', 'HITCOUNT': '0.060', 'AMMO3': '0.080', 'weapon5': '0.118', 'AMMO4': '0.134', 'DAMAGECOUNT': '0.150', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.242', 'WEAPON3': '0.450', 'ARMOR': '0.472', 'weapon2': '1.222', 'weapon3': '1.496'}
[2023-02-25 12:30:39,874][2409596] DAMAGECOUNT value on done: 456.0
[2023-02-25 12:30:39,878][2409596] Sum rewards: -1.929, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.772', 'AMMO2': '0.001', 'AMMO4': '0.006', 'ARMOR': '0.060', 'AMMO3': '0.098', 'HITCOUNT': '0.120', 'weapon4': '0.128', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.600', 'weapon2': '1.416', 'weapon3': '1.514', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:39,999][2409096] DAMAGECOUNT value on done: 325.0
[2023-02-25 12:30:40,148][2409100] DAMAGECOUNT value on done: 220.0
[2023-02-25 12:30:40,149][2409100] Sum rewards: -3.423, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.793', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'ARMOR': '0.004', 'weapon4': '0.026', 'HITCOUNT': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.128', 'DAMAGECOUNT': '0.195', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.366', 'weapon3': '1.496'}
[2023-02-25 12:30:40,180][2409565] DAMAGECOUNT value on done: 159.0
[2023-02-25 12:30:40,182][2409469] DAMAGECOUNT value on done: 855.0
[2023-02-25 12:30:40,184][2409565] Sum rewards: -4.259, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.088', 'AMMO5': '0.005', 'AMMO2': '0.015', 'HITCOUNT': '0.070', 'AMMO4': '0.073', 'AMMO3': '0.089', 'weapon5': '0.092', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.180', 'WEAPON4': '0.250', 'weapon4': '0.298', 'ARMOR': '0.471', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.206', 'weapon2': '1.580'}
[2023-02-25 12:30:40,184][2409469] Sum rewards: -0.403, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.890', 'AMMO2': '0.005', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.027', 'weapon4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'weapon5': '0.154', 'HITCOUNT': '0.190', 'WEAPON3': '0.750', 'weapon2': '1.446', 'weapon3': '1.538', 'DAMAGECOUNT': '2.220', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:30:40,297][2409866] DAMAGECOUNT value on done: 137.0
[2023-02-25 12:30:40,324][2409355] DAMAGECOUNT value on done: 273.0
[2023-02-25 12:30:40,326][2409355] Sum rewards: -4.753, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.120', 'AMMO2': '0.004', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.020', 'HITCOUNT': '0.060', 'weapon5': '0.092', 'AMMO3': '0.130', 'WEAPON5': '0.200', 'ARMOR': '0.423', 'DAMAGECOUNT': '0.477', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.158', 'weapon2': '1.274'}
[2023-02-25 12:30:40,426][2409076] DAMAGECOUNT value on done: 259.0
[2023-02-25 12:30:40,427][2409080] DAMAGECOUNT value on done: 262.0
[2023-02-25 12:30:40,428][2409080] Sum rewards: -3.193, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.800', 'AMMO2': '0.006', 'AMMO5': '0.009', 'AMMO4': '0.032', 'weapon4': '0.036', 'WEAPON1': '0.040', 'weapon5': '0.044', 'ARMOR': '0.076', 'HITCOUNT': '0.090', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.471', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.600', 'weapon2': '1.188', 'weapon3': '1.624'}
[2023-02-25 12:30:40,428][2409076] Sum rewards: -3.546, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.810', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO4': '0.028', 'HITCOUNT': '0.080', 'AMMO3': '0.094', 'weapon4': '0.146', 'DAMAGECOUNT': '0.168', 'WEAPON4': '0.200', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.306', 'weapon2': '1.382'}
[2023-02-25 12:30:40,544][2409485] DAMAGECOUNT value on done: 420.0
[2023-02-25 12:30:40,547][2409485] Sum rewards: -1.101, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.884', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'ARMOR': '0.012', 'AMMO4': '0.051', 'weapon4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'HITCOUNT': '0.110', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.550', 'weapon3': '1.266', 'weapon2': '1.828', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:40,712][2409101] DAMAGECOUNT value on done: 239.0
[2023-02-25 12:30:40,716][2409101] Sum rewards: -0.217, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.479', 'AMMO5': '0.010', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'weapon5': '0.066', 'AMMO3': '0.070', 'AMMO4': '0.070', 'HITCOUNT': '0.140', 'WEAPON5': '0.150', 'weapon4': '0.264', 'WEAPON3': '0.450', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.645', 'ARMOR': '0.962', 'weapon3': '1.396', 'weapon2': '1.474'}
[2023-02-25 12:30:41,002][2409099] DAMAGECOUNT value on done: 305.0
[2023-02-25 12:30:41,006][2409099] Sum rewards: -4.198, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.210', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'ARMOR': '0.064', 'AMMO3': '0.124', 'WEAPON4': '0.200', 'HITCOUNT': '0.220', 'weapon4': '0.228', 'DAMAGECOUNT': '0.609', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.200', 'weapon2': '1.872'}
[2023-02-25 12:30:41,065][2409074] Updated weights for policy 0, policy_version 4300 (0.0012)
[2023-02-25 12:30:41,135][2409373] DAMAGECOUNT value on done: 445.0
[2023-02-25 12:30:41,203][2409486] DAMAGECOUNT value on done: 408.0
[2023-02-25 12:30:41,207][2409486] Sum rewards: -2.460, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.034', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.018', 'weapon5': '0.044', 'WEAPON5': '0.050', 'HITCOUNT': '0.060', 'AMMO4': '0.090', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.315', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.462', 'weapon2': '1.524'}
[2023-02-25 12:30:41,403][2409406] DAMAGECOUNT value on done: 426.0
[2023-02-25 12:30:41,879][2409079] DAMAGECOUNT value on done: 259.0
[2023-02-25 12:30:41,883][2409079] Sum rewards: -3.726, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.970', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.030', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.088', 'AMMO4': '0.117', 'HITCOUNT': '0.140', 'weapon4': '0.198', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.600', 'ARMOR': '0.851', 'weapon3': '1.482', 'weapon2': '1.496'}
[2023-02-25 12:30:41,949][2409077] DAMAGECOUNT value on done: 381.0
[2023-02-25 12:30:41,952][2409077] Sum rewards: -3.414, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.397', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.018', 'AMMO4': '0.067', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'weapon4': '0.298', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.783', 'FRAGCOUNT': '1.000', 'weapon3': '1.336', 'weapon2': '1.596'}
[2023-02-25 12:30:42,032][2409104] DAMAGECOUNT value on done: 252.0
[2023-02-25 12:30:42,075][2409105] DAMAGECOUNT value on done: 260.0
[2023-02-25 12:30:42,078][2409105] Sum rewards: -4.754, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.972', 'AMMO5': '0.005', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'weapon5': '0.032', 'AMMO4': '0.037', 'WEAPON5': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.156', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.606', 'weapon2': '1.620'}
[2023-02-25 12:30:42,140][2409075] DAMAGECOUNT value on done: 220.0
[2023-02-25 12:30:42,152][2409389] DAMAGECOUNT value on done: 285.0
[2023-02-25 12:30:42,152][2409389] Sum rewards: 1.876, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.015', 'AMMO4': '0.075', 'HITCOUNT': '0.080', 'AMMO3': '0.081', 'weapon4': '0.086', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.225', 'WEAPON3': '0.400', 'ARMOR': '0.484', 'HEALTH': '0.730', 'FRAGCOUNT': '1.000', 'weapon2': '1.166', 'weapon3': '1.934'}
[2023-02-25 12:30:42,186][2408954] Fps is (10 sec: 24985.2, 60 sec: 25395.2, 300 sec: 25756.2). Total num frames: 17633280. Throughput: 0: 6327.4. Samples: 4409736. Policy #0 lag: (min: 0.0, avg: 15.1, max: 28.0)
[2023-02-25 12:30:42,186][2408954] Avg episode reward: [(0, '-2.772')]
[2023-02-25 12:30:42,187][2409033] Saving new best policy, reward=-2.772!
[2023-02-25 12:30:42,213][2409407] DAMAGECOUNT value on done: 134.0
[2023-02-25 12:30:42,502][2409097] DAMAGECOUNT value on done: 297.0
[2023-02-25 12:30:42,513][2409549] DAMAGECOUNT value on done: 319.0
[2023-02-25 12:30:42,514][2409549] Sum rewards: 2.209, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.073', 'ARMOR': '0.080', 'weapon4': '0.186', 'HITCOUNT': '0.190', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.711', 'HEALTH': '0.742', 'weapon2': '1.354', 'weapon3': '1.638', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:42,753][2409074] Updated weights for policy 0, policy_version 4310 (0.0012)
[2023-02-25 12:30:43,029][2409547] DAMAGECOUNT value on done: 330.0
[2023-02-25 12:30:43,030][2409547] Sum rewards: -1.168, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.838', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'ARMOR': '0.040', 'weapon4': '0.062', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'HITCOUNT': '0.190', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.723', 'weapon2': '1.380', 'weapon3': '1.750', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:43,044][2409102] DAMAGECOUNT value on done: 305.0
[2023-02-25 12:30:43,099][2409597] DAMAGECOUNT value on done: 84.0
[2023-02-25 12:30:43,100][2409078] DAMAGECOUNT value on done: 327.0
[2023-02-25 12:30:43,103][2409405] DAMAGECOUNT value on done: 615.0
[2023-02-25 12:30:43,107][2409405] Sum rewards: 2.600, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.380', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'weapon4': '0.162', 'HITCOUNT': '0.370', 'ARMOR': '0.469', 'WEAPON3': '0.600', 'weapon2': '1.396', 'DAMAGECOUNT': '1.665', 'weapon3': '1.750', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:30:43,225][2409103] DAMAGECOUNT value on done: 279.0
[2023-02-25 12:30:43,226][2409103] Sum rewards: -2.798, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.321', 'AMMO2': '0.003', 'AMMO4': '0.015', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.152', 'weapon4': '0.254', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'ARMOR': '1.037', 'weapon3': '1.364', 'weapon2': '1.438'}
[2023-02-25 12:30:43,314][2409548] DAMAGECOUNT value on done: 604.0
[2023-02-25 12:30:43,315][2409548] Sum rewards: 1.531, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.910', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.029', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.098', 'weapon4': '0.142', 'HITCOUNT': '0.250', 'WEAPON4': '0.250', 'ARMOR': '0.493', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.960', 'weapon2': '1.564', 'weapon3': '1.630', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:30:43,622][2409100] DAMAGECOUNT value on done: 235.0
[2023-02-25 12:30:43,623][2409100] Sum rewards: -8.561, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.190', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.007', 'AMMO2': '0.017', 'ARMOR': '0.044', 'weapon5': '0.062', 'AMMO4': '0.084', 'HITCOUNT': '0.090', 'weapon4': '0.096', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.225', 'WEAPON3': '0.850', 'weapon3': '1.346', 'weapon2': '1.620'}
[2023-02-25 12:30:43,760][2409565] DAMAGECOUNT value on done: 357.0
[2023-02-25 12:30:44,027][2409596] DAMAGECOUNT value on done: 321.0
[2023-02-25 12:30:44,028][2409596] Sum rewards: -5.638, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.242', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'weapon5': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.182', 'HITCOUNT': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.828', 'weapon2': '1.312', 'weapon3': '1.432'}
[2023-02-25 12:30:44,116][2409096] DAMAGECOUNT value on done: 219.0
[2023-02-25 12:30:44,119][2409096] Sum rewards: -2.193, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.368', 'AMMO2': '0.013', 'AMMO4': '0.064', 'HITCOUNT': '0.120', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.297', 'weapon4': '0.416', 'ARMOR': '0.455', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.242', 'weapon2': '1.274'}
[2023-02-25 12:30:44,140][2409866] DAMAGECOUNT value on done: 140.0
[2023-02-25 12:30:44,161][2409355] DAMAGECOUNT value on done: 155.0
[2023-02-25 12:30:44,280][2409469] DAMAGECOUNT value on done: 370.0
[2023-02-25 12:30:44,281][2409469] Sum rewards: -4.926, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.808', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.007', 'ARMOR': '0.012', 'weapon5': '0.026', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'weapon4': '0.226', 'HITCOUNT': '0.240', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.795', 'weapon3': '1.014', 'FRAGCOUNT': '2.000', 'weapon2': '2.120'}
[2023-02-25 12:30:44,657][2409080] DAMAGECOUNT value on done: 350.0
[2023-02-25 12:30:44,661][2409074] Updated weights for policy 0, policy_version 4320 (0.0016)
[2023-02-25 12:30:44,761][2409101] DAMAGECOUNT value on done: 164.0
[2023-02-25 12:30:44,765][2409101] Sum rewards: -3.578, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.200', 'AMMO2': '0.019', 'ARMOR': '0.040', 'AMMO4': '0.096', 'HITCOUNT': '0.110', 'AMMO3': '0.112', 'WEAPON4': '0.250', 'weapon4': '0.340', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.182', 'weapon3': '1.678'}
[2023-02-25 12:30:44,765][2409485] DAMAGECOUNT value on done: 360.0
[2023-02-25 12:30:44,766][2409485] Sum rewards: -6.430, reward structure: {'DEATHCOUNT': '-12.000', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'HITCOUNT': '0.210', 'ARMOR': '0.468', 'HEALTH': '0.490', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.675', 'weapon2': '1.476', 'weapon3': '1.750'}
[2023-02-25 12:30:44,870][2409076] DAMAGECOUNT value on done: 212.0
[2023-02-25 12:30:44,875][2409076] Sum rewards: -4.057, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.218', 'ARMOR': '0.016', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO4': '0.083', 'weapon5': '0.094', 'AMMO3': '0.126', 'HITCOUNT': '0.150', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.414', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.012', 'weapon3': '1.520'}
[2023-02-25 12:30:44,967][2409099] DAMAGECOUNT value on done: 324.0
[2023-02-25 12:30:44,971][2409099] Sum rewards: -0.937, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.484', 'weapon4': '0.002', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.103', 'ARMOR': '0.104', 'HITCOUNT': '0.150', 'DAMAGECOUNT': '0.477', 'WEAPON3': '0.600', 'weapon3': '1.402', 'weapon2': '1.816', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:30:45,008][2409406] DAMAGECOUNT value on done: 325.0
[2023-02-25 12:30:45,012][2409406] Sum rewards: -5.075, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.610', 'AMMO2': '0.027', 'AMMO3': '0.076', 'HITCOUNT': '0.130', 'AMMO4': '0.134', 'WEAPON4': '0.350', 'weapon4': '0.360', 'ARMOR': '0.420', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.528', 'FRAGCOUNT': '1.000', 'weapon3': '1.184', 'weapon2': '1.576'}
[2023-02-25 12:30:45,140][2409486] DAMAGECOUNT value on done: 347.0
[2023-02-25 12:30:45,141][2409486] Sum rewards: -4.748, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-2.000', 'HEALTH': '-0.064', 'AMMO5': '0.012', 'AMMO2': '0.016', 'weapon5': '0.064', 'ARMOR': '0.068', 'AMMO4': '0.081', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'HITCOUNT': '0.140', 'WEAPON5': '0.200', 'weapon4': '0.340', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.696', 'weapon2': '0.826', 'weapon3': '1.626'}
[2023-02-25 12:30:45,164][2409468] DAMAGECOUNT value on done: 528.0
[2023-02-25 12:30:45,165][2409468] Sum rewards: 2.594, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.341', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'ARMOR': '0.052', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.102', 'HITCOUNT': '0.210', 'weapon4': '0.300', 'WEAPON3': '0.550', 'weapon2': '1.306', 'DAMAGECOUNT': '1.317', 'weapon3': '1.364', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:30:45,333][2409373] DAMAGECOUNT value on done: 285.0
[2023-02-25 12:30:45,340][2409373] Sum rewards: -0.113, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.740', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO3': '0.057', 'AMMO4': '0.067', 'ARMOR': '0.094', 'weapon4': '0.126', 'HITCOUNT': '0.150', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.555', 'weapon3': '1.188', 'weapon2': '1.916', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:45,626][2409077] DAMAGECOUNT value on done: 425.0
[2023-02-25 12:30:45,627][2409077] Sum rewards: -8.212, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.531', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'weapon5': '0.032', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.164', 'HITCOUNT': '0.170', 'weapon4': '0.214', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.440', 'weapon2': '1.584'}
[2023-02-25 12:30:45,714][2409075] DAMAGECOUNT value on done: 253.0
[2023-02-25 12:30:45,717][2409075] Sum rewards: -3.525, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.796', 'AMMO2': '0.021', 'ARMOR': '0.036', 'HITCOUNT': '0.090', 'AMMO3': '0.099', 'AMMO4': '0.105', 'weapon4': '0.168', 'DAMAGECOUNT': '0.240', 'WEAPON4': '0.250', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.448', 'weapon3': '1.514'}
[2023-02-25 12:30:45,740][2409389] DAMAGECOUNT value on done: 285.0
[2023-02-25 12:30:45,741][2409389] Sum rewards: -2.897, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.900', 'AMMO2': '0.008', 'AMMO4': '0.039', 'AMMO3': '0.160', 'HITCOUNT': '0.230', 'DAMAGECOUNT': '0.780', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.130', 'weapon3': '2.106'}
[2023-02-25 12:30:45,778][2409079] DAMAGECOUNT value on done: 370.0
[2023-02-25 12:30:45,783][2409079] Sum rewards: -5.427, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.528', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.038', 'AMMO4': '0.092', 'AMMO3': '0.124', 'weapon4': '0.134', 'WEAPON5': '0.150', 'HITCOUNT': '0.180', 'WEAPON4': '0.300', 'ARMOR': '0.484', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.750', 'weapon2': '1.090', 'weapon3': '1.724'}
[2023-02-25 12:30:45,866][2409105] DAMAGECOUNT value on done: 575.0
[2023-02-25 12:30:45,870][2409105] Sum rewards: -1.455, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.833', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'ARMOR': '0.096', 'AMMO3': '0.113', 'AMMO4': '0.162', 'HITCOUNT': '0.240', 'weapon4': '0.302', 'WEAPON4': '0.450', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.729', 'weapon2': '1.484', 'weapon3': '1.550', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:46,038][2409104] DAMAGECOUNT value on done: 236.0
[2023-02-25 12:30:46,038][2409104] Sum rewards: -1.278, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.120', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'ARMOR': '0.032', 'HITCOUNT': '0.050', 'AMMO3': '0.068', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'weapon4': '0.216', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.477', 'WEAPON3': '0.550', 'weapon2': '1.204', 'weapon3': '1.596', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:46,059][2409407] DAMAGECOUNT value on done: 304.0
[2023-02-25 12:30:46,060][2409407] Sum rewards: -0.746, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.612', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.074', 'ARMOR': '0.076', 'weapon4': '0.106', 'HITCOUNT': '0.120', 'WEAPON4': '0.200', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.570', 'FRAGCOUNT': '1.000', 'weapon2': '1.364', 'weapon3': '1.772'}
[2023-02-25 12:30:46,162][2409074] Updated weights for policy 0, policy_version 4330 (0.0012)
[2023-02-25 12:30:46,242][2409033] Signal inference workers to stop experience collection... (600 times)
[2023-02-25 12:30:46,249][2409033] Signal inference workers to resume experience collection... (600 times)
[2023-02-25 12:30:46,270][2409097] DAMAGECOUNT value on done: 570.0
[2023-02-25 12:30:46,273][2409097] Sum rewards: -0.561, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.727', 'AMMO5': '0.005', 'AMMO2': '0.020', 'ARMOR': '0.044', 'AMMO4': '0.098', 'AMMO3': '0.139', 'weapon4': '0.268', 'HITCOUNT': '0.270', 'WEAPON4': '0.300', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.260', 'weapon2': '1.436', 'weapon3': '1.476', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:30:46,285][2409074] InferenceWorker_p0-w0: stopping experience collection (600 times)
[2023-02-25 12:30:46,285][2409074] InferenceWorker_p0-w0: resuming experience collection (600 times)
[2023-02-25 12:30:46,714][2409405] DAMAGECOUNT value on done: 295.0
[2023-02-25 12:30:46,715][2409405] Sum rewards: 0.702, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.320', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.004', 'AMMO4': '0.022', 'weapon7': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'weapon5': '0.064', 'HITCOUNT': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'weapon4': '0.354', 'DAMAGECOUNT': '0.555', 'weapon3': '0.984', 'FRAGCOUNT': '1.000', 'weapon2': '1.334'}
[2023-02-25 12:30:46,733][2409078] DAMAGECOUNT value on done: 240.0
[2023-02-25 12:30:46,734][2409078] Sum rewards: -4.320, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.130', 'AMMO5': '0.009', 'AMMO2': '0.013', 'weapon5': '0.032', 'WEAPON4': '0.050', 'AMMO4': '0.065', 'HITCOUNT': '0.090', 'AMMO3': '0.128', 'weapon4': '0.176', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.300', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.650', 'weapon2': '1.064', 'weapon3': '1.782'}
[2023-02-25 12:30:46,803][2409103] DAMAGECOUNT value on done: 416.0
[2023-02-25 12:30:46,807][2409103] Sum rewards: 1.445, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.070', 'AMMO4': '-0.055', 'AMMO2': '-0.011', 'WEAPON4': '0.050', 'weapon7': '0.066', 'AMMO3': '0.078', 'weapon4': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.160', 'WEAPON7': '0.200', 'WEAPON3': '0.450', 'ARMOR': '0.872', 'weapon3': '0.990', 'DAMAGECOUNT': '1.017', 'weapon2': '2.100', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:30:46,845][2409547] DAMAGECOUNT value on done: 178.0
[2023-02-25 12:30:46,853][2409549] DAMAGECOUNT value on done: 390.0
[2023-02-25 12:30:46,854][2409549] Sum rewards: -1.392, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.952', 'weapon5': '0.010', 'AMMO2': '0.014', 'AMMO5': '0.015', 'HITCOUNT': '0.050', 'ARMOR': '0.052', 'AMMO4': '0.072', 'AMMO3': '0.095', 'weapon4': '0.172', 'DAMAGECOUNT': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.412', 'weapon3': '1.438'}
[2023-02-25 12:30:46,867][2409597] DAMAGECOUNT value on done: 582.0
[2023-02-25 12:30:46,868][2409597] Sum rewards: 4.299, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.380', 'AMMO2': '0.032', 'AMMO3': '0.041', 'ARMOR': '0.128', 'HITCOUNT': '0.150', 'weapon7': '0.158', 'AMMO4': '0.161', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'WEAPON4': '0.250', 'weapon3': '0.660', 'weapon4': '0.710', 'DAMAGECOUNT': '0.888', 'weapon2': '1.400', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:30:46,883][2409548] DAMAGECOUNT value on done: 117.0
[2023-02-25 12:30:46,884][2409548] Sum rewards: -3.813, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.880', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.013', 'WEAPON1': '0.020', 'HITCOUNT': '0.040', 'WEAPON5': '0.050', 'ARMOR': '0.072', 'weapon4': '0.076', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.105', 'AMMO3': '0.113', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.110', 'weapon3': '2.010'}
[2023-02-25 12:30:47,014][2409565] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 12:30:47,133][2409100] DAMAGECOUNT value on done: 417.0
[2023-02-25 12:30:47,135][2409100] Sum rewards: -3.535, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.429', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon4': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.157', 'HITCOUNT': '0.210', 'DAMAGECOUNT': '0.660', 'WEAPON3': '0.850', 'ARMOR': '0.919', 'FRAGCOUNT': '1.000', 'weapon3': '1.534', 'weapon2': '1.676'}
[2023-02-25 12:30:47,186][2408954] Fps is (10 sec: 24576.3, 60 sec: 25190.5, 300 sec: 25784.0). Total num frames: 17756160. Throughput: 0: 6336.5. Samples: 4447944. Policy #0 lag: (min: 0.0, avg: 12.8, max: 25.0)
[2023-02-25 12:30:47,186][2408954] Avg episode reward: [(0, '-2.529')]
[2023-02-25 12:30:47,195][2409033] Saving new best policy, reward=-2.529!
[2023-02-25 12:30:47,222][2409102] DAMAGECOUNT value on done: 135.0
[2023-02-25 12:30:47,485][2409074] Updated weights for policy 0, policy_version 4340 (0.0013)
[2023-02-25 12:30:47,721][2409866] DAMAGECOUNT value on done: 315.0
[2023-02-25 12:30:47,725][2409866] Sum rewards: 0.598, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.620', 'ARMOR': '0.008', 'AMMO2': '0.008', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'weapon5': '0.032', 'AMMO4': '0.041', 'AMMO3': '0.050', 'weapon4': '0.082', 'WEAPON4': '0.100', 'HITCOUNT': '0.100', 'WEAPON5': '0.200', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.525', 'FRAGCOUNT': '1.000', 'weapon2': '1.182', 'weapon3': '1.260'}
[2023-02-25 12:30:47,733][2409096] DAMAGECOUNT value on done: 325.0
[2023-02-25 12:30:47,734][2409096] Sum rewards: -1.733, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.717', 'AMMO5': '0.004', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.052', 'AMMO3': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'weapon4': '0.372', 'WEAPON3': '0.450', 'ARMOR': '0.456', 'DAMAGECOUNT': '0.708', 'FRAGCOUNT': '1.000', 'weapon3': '1.364', 'weapon2': '1.478'}
[2023-02-25 12:30:47,744][2409355] DAMAGECOUNT value on done: 520.0
[2023-02-25 12:30:47,745][2409355] Sum rewards: -0.374, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.429', 'AMMO5': '0.003', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'weapon5': '0.020', 'AMMO4': '0.030', 'WEAPON5': '0.050', 'ARMOR': '0.112', 'AMMO3': '0.120', 'WEAPON4': '0.200', 'HITCOUNT': '0.220', 'weapon4': '0.236', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.900', 'weapon2': '1.274', 'weapon3': '1.624', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:30:47,898][2409469] DAMAGECOUNT value on done: 603.0
[2023-02-25 12:30:47,899][2409469] Sum rewards: -2.825, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.807', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.101', 'AMMO3': '0.169', 'weapon4': '0.218', 'HITCOUNT': '0.250', 'WEAPON4': '0.250', 'ARMOR': '0.492', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.969', 'weapon3': '1.342', 'weapon2': '1.508', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:30:48,101][2409596] DAMAGECOUNT value on done: 87.0
[2023-02-25 12:30:48,103][2409596] Sum rewards: -6.849, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.080', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.018', 'HITCOUNT': '0.020', 'weapon5': '0.034', 'WEAPON1': '0.040', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'DAMAGECOUNT': '0.051', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'AMMO3': '0.158', 'weapon4': '0.194', 'WEAPON3': '0.900', 'weapon2': '1.162', 'weapon3': '1.622'}
[2023-02-25 12:30:48,114][2409565] DAMAGECOUNT value on done: 606.0
[2023-02-25 12:30:48,115][2409565] Sum rewards: -3.396, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.027', 'FRAGCOUNT': '0.000', 'AMMO5': '0.005', 'AMMO2': '0.015', 'ARMOR': '0.044', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO3': '0.115', 'WEAPON4': '0.200', 'weapon4': '0.288', 'HITCOUNT': '0.320', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.293', 'weapon3': '1.390', 'weapon2': '1.428'}
[2023-02-25 12:30:48,640][2409076] DAMAGECOUNT value on done: 371.0
[2023-02-25 12:30:48,749][2409485] DAMAGECOUNT value on done: 119.0
[2023-02-25 12:30:48,750][2409485] Sum rewards: -0.805, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.007', 'weapon7': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.039', 'AMMO3': '0.076', 'weapon5': '0.084', 'HITCOUNT': '0.090', 'weapon4': '0.094', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.193', 'DAMAGECOUNT': '0.240', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'HEALTH': '0.466', 'ARMOR': '0.814', 'FRAGCOUNT': '1.000', 'weapon3': '1.400', 'weapon2': '1.822'}
[2023-02-25 12:30:48,785][2409406] DAMAGECOUNT value on done: 342.0
[2023-02-25 12:30:48,789][2409406] Sum rewards: -3.541, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.084', 'weapon7': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'ARMOR': '0.108', 'HITCOUNT': '0.120', 'AMMO4': '0.138', 'WEAPON4': '0.200', 'weapon4': '0.226', 'HEALTH': '0.438', 'DAMAGECOUNT': '0.447', 'WEAPON3': '0.450', 'weapon2': '1.314', 'weapon3': '1.452'}
[2023-02-25 12:30:48,921][2409101] DAMAGECOUNT value on done: 327.0
[2023-02-25 12:30:48,968][2409099] DAMAGECOUNT value on done: 531.0
[2023-02-25 12:30:48,972][2409099] Sum rewards: -3.820, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.626', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.012', 'ARMOR': '0.012', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.086', 'HITCOUNT': '0.090', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.297', 'weapon4': '0.428', 'WEAPON3': '0.600', 'weapon3': '1.050', 'weapon2': '1.444'}
[2023-02-25 12:30:49,064][2409373] DAMAGECOUNT value on done: 188.0
[2023-02-25 12:30:49,105][2409486] DAMAGECOUNT value on done: 398.0
[2023-02-25 12:30:49,106][2409486] Sum rewards: -0.446, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.832', 'AMMO2': '0.027', 'AMMO3': '0.105', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'HITCOUNT': '0.270', 'weapon4': '0.272', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.050', 'weapon2': '1.348', 'weapon3': '1.578', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:49,211][2409080] DAMAGECOUNT value on done: 367.0
[2023-02-25 12:30:49,214][2409080] Sum rewards: -2.660, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.320', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'HITCOUNT': '0.010', 'AMMO2': '0.027', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.092', 'AMMO4': '0.132', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.420', 'ARMOR': '0.486', 'weapon4': '0.492', 'WEAPON3': '0.500', 'weapon3': '0.750', 'weapon2': '1.642'}
[2023-02-25 12:30:49,274][2409075] DAMAGECOUNT value on done: 240.0
[2023-02-25 12:30:49,275][2409075] Sum rewards: -2.434, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.364', 'AMMO2': '0.039', 'ARMOR': '0.056', 'AMMO3': '0.089', 'WEAPON4': '0.150', 'HITCOUNT': '0.150', 'AMMO4': '0.197', 'weapon4': '0.408', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.615', 'FRAGCOUNT': '1.000', 'weapon3': '1.148', 'weapon2': '1.778'}
[2023-02-25 12:30:49,276][2409389] DAMAGECOUNT value on done: 388.0
[2023-02-25 12:30:49,278][2409389] Sum rewards: -2.195, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.230', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.026', 'ARMOR': '0.032', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.133', 'weapon4': '0.138', 'HITCOUNT': '0.140', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.711', 'weapon2': '1.342', 'weapon3': '1.664', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:49,345][2409077] DAMAGECOUNT value on done: 325.0
[2023-02-25 12:30:49,456][2409074] Updated weights for policy 0, policy_version 4350 (0.0012)
[2023-02-25 12:30:49,638][2409105] DAMAGECOUNT value on done: 287.0
[2023-02-25 12:30:49,641][2409105] Sum rewards: -5.116, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.922', 'ARMOR': '0.004', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'weapon5': '0.034', 'AMMO4': '0.059', 'AMMO3': '0.138', 'HITCOUNT': '0.150', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.444', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.800', 'weapon2': '1.496', 'weapon3': '1.750'}
[2023-02-25 12:30:49,753][2409468] DAMAGECOUNT value on done: 52.0
[2023-02-25 12:30:49,774][2409079] DAMAGECOUNT value on done: 345.0
[2023-02-25 12:30:49,777][2409079] Sum rewards: -0.819, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.330', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'AMMO3': '0.054', 'weapon5': '0.088', 'HITCOUNT': '0.090', 'AMMO4': '0.092', 'weapon4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'FRAGCOUNT': '0.500', 'ARMOR': '0.506', 'DAMAGECOUNT': '0.735', 'weapon3': '0.904', 'weapon2': '2.368'}
[2023-02-25 12:30:49,825][2409097] DAMAGECOUNT value on done: 631.0
[2023-02-25 12:30:49,828][2409097] Sum rewards: -3.465, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.848', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.071', 'HITCOUNT': '0.210', 'WEAPON4': '0.250', 'weapon4': '0.318', 'ARMOR': '0.492', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.600', 'weapon3': '1.182', 'weapon2': '1.676', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:30:49,950][2409104] DAMAGECOUNT value on done: 190.0
[2023-02-25 12:30:50,003][2409407] DAMAGECOUNT value on done: 128.0
[2023-02-25 12:30:50,427][2409548] DAMAGECOUNT value on done: 366.0
[2023-02-25 12:30:50,428][2409548] Sum rewards: 0.165, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.490', 'AMMO2': '0.001', 'AMMO4': '0.005', 'ARMOR': '0.040', 'AMMO3': '0.092', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.170', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.600', 'weapon3': '1.460', 'weapon2': '1.572', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:30:50,446][2409547] DAMAGECOUNT value on done: 609.0
[2023-02-25 12:30:50,447][2409547] Sum rewards: -3.083, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.915', 'AMMO2': '0.004', 'AMMO4': '0.022', 'ARMOR': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'weapon4': '0.168', 'HITCOUNT': '0.220', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.855', 'FRAGCOUNT': '1.000', 'weapon2': '1.470', 'weapon3': '1.614'}
[2023-02-25 12:30:50,635][2409100] DAMAGECOUNT value on done: 205.0
[2023-02-25 12:30:50,636][2409100] Sum rewards: -7.135, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.482', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'HITCOUNT': '0.060', 'ARMOR': '0.064', 'weapon5': '0.066', 'AMMO4': '0.121', 'AMMO3': '0.152', 'DAMAGECOUNT': '0.165', 'WEAPON3': '0.700', 'weapon3': '1.576', 'weapon2': '1.614'}
[2023-02-25 12:30:50,641][2409549] DAMAGECOUNT value on done: 383.0
[2023-02-25 12:30:50,642][2409549] Sum rewards: -0.615, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.459', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.082', 'weapon4': '0.086', 'AMMO4': '0.105', 'HITCOUNT': '0.220', 'WEAPON4': '0.250', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.882', 'weapon2': '1.448', 'weapon3': '1.630', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:30:50,687][2409597] DAMAGECOUNT value on done: 68.0
[2023-02-25 12:30:50,690][2409597] Sum rewards: -1.220, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.723', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'weapon5': '0.028', 'HITCOUNT': '0.030', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'ARMOR': '0.076', 'AMMO4': '0.083', 'AMMO3': '0.102', 'DAMAGECOUNT': '0.105', 'weapon4': '0.132', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.550', 'weapon2': '1.284', 'weapon3': '1.734'}
[2023-02-25 12:30:50,826][2409405] DAMAGECOUNT value on done: 336.0
[2023-02-25 12:30:50,870][2409078] DAMAGECOUNT value on done: 480.0
[2023-02-25 12:30:50,873][2409078] Sum rewards: -0.317, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.735', 'AMMO2': '0.009', 'AMMO5': '0.010', 'weapon5': '0.034', 'ARMOR': '0.040', 'AMMO4': '0.047', 'weapon4': '0.050', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.280', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.966', 'FRAGCOUNT': '1.000', 'weapon2': '1.410', 'weapon3': '1.742'}
[2023-02-25 12:30:50,941][2409103] DAMAGECOUNT value on done: 140.0
[2023-02-25 12:30:50,942][2409103] Sum rewards: -4.227, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.573', 'AMMO5': '0.006', 'AMMO2': '0.009', 'weapon4': '0.032', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'weapon5': '0.050', 'HITCOUNT': '0.070', 'ARMOR': '0.072', 'AMMO3': '0.077', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.240', 'WEAPON3': '0.500', 'weapon2': '1.520', 'weapon3': '1.776'}
[2023-02-25 12:30:50,954][2409074] Updated weights for policy 0, policy_version 4360 (0.0012)
[2023-02-25 12:30:51,352][2409102] DAMAGECOUNT value on done: 386.0
[2023-02-25 12:30:51,353][2409102] Sum rewards: -1.087, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.254', 'AMMO4': '-0.055', 'AMMO2': '-0.011', 'AMMO5': '0.003', 'weapon5': '0.008', 'WEAPON1': '0.020', 'ARMOR': '0.045', 'WEAPON5': '0.050', 'AMMO3': '0.120', 'HITCOUNT': '0.150', 'DAMAGECOUNT': '0.549', 'WEAPON3': '0.650', 'weapon2': '1.316', 'FRAGCOUNT': '1.500', 'weapon3': '1.822'}
[2023-02-25 12:30:51,448][2409866] DAMAGECOUNT value on done: 317.0
[2023-02-25 12:30:51,451][2409866] Sum rewards: -3.546, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.172', 'AMMO2': '0.003', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO4': '0.014', 'WEAPON1': '0.020', 'weapon4': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.160', 'AMMO3': '0.161', 'ARMOR': '0.498', 'DAMAGECOUNT': '0.627', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.388', 'weapon3': '1.606'}
[2023-02-25 12:30:51,460][2409355] DAMAGECOUNT value on done: 192.0
[2023-02-25 12:30:51,461][2409355] Sum rewards: -7.261, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.607', 'FRAGCOUNT': '-1.500', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO5': '0.008', 'weapon5': '0.030', 'ARMOR': '0.032', 'weapon4': '0.038', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.101', 'HITCOUNT': '0.160', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.456', 'WEAPON3': '0.650', 'weapon3': '1.512', 'weapon2': '1.610'}
[2023-02-25 12:30:51,519][2409096] DAMAGECOUNT value on done: 491.0
[2023-02-25 12:30:51,520][2409096] Sum rewards: -1.547, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.415', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'weapon5': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'HITCOUNT': '0.170', 'weapon4': '0.318', 'ARMOR': '0.492', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.071', 'weapon2': '1.362', 'weapon3': '1.594', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:51,682][2409469] DAMAGECOUNT value on done: 463.0
[2023-02-25 12:30:51,686][2409469] Sum rewards: -0.216, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.750', 'AMMO2': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.086', 'weapon4': '0.116', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.522', 'WEAPON3': '0.650', 'weapon3': '1.422', 'weapon2': '1.544', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:51,895][2409596] DAMAGECOUNT value on done: 234.0
[2023-02-25 12:30:51,896][2409596] Sum rewards: -1.949, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.700', 'ARMOR': '0.012', 'AMMO2': '0.025', 'weapon4': '0.080', 'WEAPON4': '0.100', 'AMMO4': '0.125', 'AMMO3': '0.126', 'HITCOUNT': '0.160', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.627', 'weapon2': '1.414', 'weapon3': '1.732', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:52,126][2409565] DAMAGECOUNT value on done: 232.0
[2023-02-25 12:30:52,186][2408954] Fps is (10 sec: 25805.5, 60 sec: 25190.4, 300 sec: 25784.0). Total num frames: 17891328. Throughput: 0: 6316.8. Samples: 4466748. Policy #0 lag: (min: 0.0, avg: 13.2, max: 26.0)
[2023-02-25 12:30:52,186][2408954] Avg episode reward: [(0, '-2.765')]
[2023-02-25 12:30:52,373][2409406] DAMAGECOUNT value on done: 275.0
[2023-02-25 12:30:52,373][2409406] Sum rewards: -5.644, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.531', 'AMMO2': '0.014', 'HITCOUNT': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.174', 'DAMAGECOUNT': '0.195', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.230', 'weapon3': '1.856'}
[2023-02-25 12:30:52,413][2409101] DAMAGECOUNT value on done: 281.0
[2023-02-25 12:30:52,414][2409101] Sum rewards: -2.816, reward structure: {'DEATHCOUNT': '-8.250', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'ARMOR': '0.028', 'HITCOUNT': '0.060', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'HEALTH': '0.160', 'DAMAGECOUNT': '0.195', 'weapon4': '0.218', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.152', 'weapon2': '1.762'}
[2023-02-25 12:30:52,508][2409074] Updated weights for policy 0, policy_version 4370 (0.0012)
[2023-02-25 12:30:52,540][2409099] DAMAGECOUNT value on done: 500.0
[2023-02-25 12:30:52,543][2409099] Sum rewards: -0.811, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.590', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO4': '0.022', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.107', 'HITCOUNT': '0.190', 'ARMOR': '0.457', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.840', 'weapon3': '1.620', 'weapon2': '1.878', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:52,559][2409485] DAMAGECOUNT value on done: 270.0
[2023-02-25 12:30:52,639][2409486] DAMAGECOUNT value on done: 432.0
[2023-02-25 12:30:52,643][2409486] Sum rewards: -1.338, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.082', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.099', 'AMMO3': '0.151', 'HITCOUNT': '0.210', 'weapon4': '0.238', 'weapon2': '0.824', 'DAMAGECOUNT': '0.825', 'WEAPON3': '0.900', 'weapon3': '1.882', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:52,778][2409389] DAMAGECOUNT value on done: 324.0
[2023-02-25 12:30:52,783][2409389] Sum rewards: -1.705, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'AMMO4': '0.131', 'HITCOUNT': '0.190', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'FRAGCOUNT': '0.500', 'weapon4': '0.516', 'HEALTH': '0.626', 'DAMAGECOUNT': '0.726', 'weapon3': '1.144', 'weapon2': '1.642'}
[2023-02-25 12:30:52,792][2409075] DAMAGECOUNT value on done: 285.0
[2023-02-25 12:30:52,798][2409075] Sum rewards: -2.472, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.670', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'HITCOUNT': '0.080', 'AMMO4': '0.110', 'AMMO3': '0.129', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.270', 'ARMOR': '0.432', 'weapon4': '0.440', 'WEAPON3': '0.650', 'weapon3': '1.252', 'weapon2': '1.560', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:52,875][2409080] DAMAGECOUNT value on done: 258.0
[2023-02-25 12:30:52,878][2409080] Sum rewards: 1.741, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.422', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon7': '0.066', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.310', 'DAMAGECOUNT': '0.423', 'WEAPON3': '0.550', 'weapon2': '1.024', 'weapon3': '1.450', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:53,181][2409076] DAMAGECOUNT value on done: 333.0
[2023-02-25 12:30:53,181][2409076] Sum rewards: -3.502, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.072', 'AMMO2': '0.007', 'ARMOR': '0.012', 'AMMO4': '0.036', 'AMMO3': '0.140', 'HITCOUNT': '0.170', 'weapon4': '0.246', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.567', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.466', 'weapon3': '1.476'}
[2023-02-25 12:30:53,188][2409077] DAMAGECOUNT value on done: 255.0
[2023-02-25 12:30:53,191][2409077] Sum rewards: -5.015, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.056', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.028', 'AMMO4': '0.115', 'AMMO3': '0.127', 'HITCOUNT': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.210', 'DAMAGECOUNT': '0.405', 'ARMOR': '0.532', 'WEAPON3': '0.750', 'weapon2': '1.370', 'weapon3': '1.490'}
[2023-02-25 12:30:53,383][2409097] DAMAGECOUNT value on done: 179.0
[2023-02-25 12:30:53,445][2409468] DAMAGECOUNT value on done: 349.0
[2023-02-25 12:30:53,449][2409468] Sum rewards: -3.961, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.566', 'AMMO2': '0.025', 'weapon4': '0.074', 'HITCOUNT': '0.120', 'AMMO4': '0.126', 'AMMO3': '0.141', 'WEAPON4': '0.200', 'ARMOR': '0.452', 'DAMAGECOUNT': '0.507', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.398', 'weapon2': '1.762'}
[2023-02-25 12:30:53,523][2409105] DAMAGECOUNT value on done: 215.0
[2023-02-25 12:30:53,527][2409105] Sum rewards: -4.635, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.324', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'weapon5': '0.036', 'WEAPON5': '0.050', 'weapon7': '0.064', 'HITCOUNT': '0.070', 'AMMO4': '0.081', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.390', 'weapon4': '0.392', 'ARMOR': '0.503', 'WEAPON3': '0.700', 'weapon3': '0.992', 'weapon2': '1.310', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:30:53,565][2409373] DAMAGECOUNT value on done: 272.0
[2023-02-25 12:30:53,566][2409373] Sum rewards: -7.056, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.994', 'AMMO4': '-0.013', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.018', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'WEAPON5': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.174', 'DAMAGECOUNT': '0.450', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '1.306', 'weapon3': '1.970'}
[2023-02-25 12:30:53,602][2409079] DAMAGECOUNT value on done: 315.0
[2023-02-25 12:30:53,755][2409104] DAMAGECOUNT value on done: 338.0
[2023-02-25 12:30:53,756][2409104] Sum rewards: -2.331, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.680', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'ARMOR': '0.054', 'weapon5': '0.056', 'AMMO3': '0.082', 'WEAPON5': '0.100', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.230', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.672', 'weapon2': '1.108', 'weapon3': '1.720'}
[2023-02-25 12:30:53,914][2409407] DAMAGECOUNT value on done: 272.0
[2023-02-25 12:30:53,915][2409407] Sum rewards: -1.939, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.040', 'WEAPON1': '0.020', 'AMMO2': '0.037', 'ARMOR': '0.076', 'HITCOUNT': '0.080', 'AMMO3': '0.115', 'weapon4': '0.178', 'AMMO4': '0.184', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.411', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.394', 'weapon3': '1.406'}
[2023-02-25 12:30:54,077][2409074] Updated weights for policy 0, policy_version 4380 (0.0012)
[2023-02-25 12:30:54,233][2409549] DAMAGECOUNT value on done: 394.0
[2023-02-25 12:30:54,236][2409549] Sum rewards: 0.004, reward structure: {'DEATHCOUNT': '-3.750', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.271', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon5': '0.030', 'AMMO4': '0.035', 'ARMOR': '0.037', 'WEAPON5': '0.050', 'AMMO3': '0.063', 'WEAPON4': '0.100', 'weapon4': '0.122', 'HITCOUNT': '0.140', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.456', 'weapon2': '1.328', 'weapon3': '1.804'}
[2023-02-25 12:30:54,233][2409547] DAMAGECOUNT value on done: 458.0
[2023-02-25 12:30:54,239][2409547] Sum rewards: -1.032, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.443', 'AMMO2': '0.005', 'AMMO5': '0.005', 'weapon5': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.024', 'ARMOR': '0.040', 'weapon4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.135', 'HITCOUNT': '0.240', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.960', 'weapon2': '1.384', 'weapon3': '1.760', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:30:54,319][2409548] DAMAGECOUNT value on done: 190.0
[2023-02-25 12:30:54,435][2409103] DAMAGECOUNT value on done: 387.0
[2023-02-25 12:30:54,437][2409103] Sum rewards: -6.280, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.736', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'ARMOR': '0.032', 'weapon5': '0.080', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.106', 'WEAPON4': '0.150', 'weapon4': '0.174', 'DAMAGECOUNT': '0.240', 'WEAPON3': '0.600', 'weapon3': '1.354', 'weapon2': '1.622'}
[2023-02-25 12:30:54,457][2409866] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 12:30:54,464][2409100] DAMAGECOUNT value on done: 330.0
[2023-02-25 12:30:54,487][2409597] DAMAGECOUNT value on done: 240.0
[2023-02-25 12:30:54,491][2409597] Sum rewards: -1.673, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.566', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'HITCOUNT': '0.050', 'ARMOR': '0.088', 'AMMO3': '0.093', 'AMMO4': '0.126', 'DAMAGECOUNT': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.350', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.324', 'weapon3': '1.532'}
[2023-02-25 12:30:54,495][2409565] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 12:30:54,867][2409405] DAMAGECOUNT value on done: 629.0
[2023-02-25 12:30:54,970][2409078] DAMAGECOUNT value on done: 220.0
[2023-02-25 12:30:55,059][2409102] DAMAGECOUNT value on done: 345.0
[2023-02-25 12:30:55,116][2409355] DAMAGECOUNT value on done: 310.0
[2023-02-25 12:30:55,117][2409355] Sum rewards: 0.294, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.588', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.043', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'weapon4': '0.128', 'HITCOUNT': '0.140', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.501', 'weapon3': '1.470', 'weapon2': '1.498', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:55,118][2409866] DAMAGECOUNT value on done: 325.0
[2023-02-25 12:30:55,125][2409866] Sum rewards: -6.740, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.912', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'weapon4': '0.194', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'HITCOUNT': '0.220', 'DAMAGECOUNT': '0.840', 'weapon2': '0.970', 'WEAPON3': '1.150', 'weapon3': '1.914', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:55,581][2409074] Updated weights for policy 0, policy_version 4390 (0.0012)
[2023-02-25 12:30:55,684][2409596] DAMAGECOUNT value on done: 378.0
[2023-02-25 12:30:55,703][2409096] DAMAGECOUNT value on done: 126.0
[2023-02-25 12:30:55,704][2409096] Sum rewards: -8.830, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-3.000', 'HEALTH': '-2.050', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.008', 'ARMOR': '0.020', 'WEAPON1': '0.020', 'weapon5': '0.030', 'HITCOUNT': '0.050', 'AMMO3': '0.095', 'DAMAGECOUNT': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.600', 'weapon3': '1.594', 'weapon2': '1.744'}
[2023-02-25 12:30:55,810][2409565] DAMAGECOUNT value on done: 183.0
[2023-02-25 12:30:55,811][2409565] Sum rewards: -1.546, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.188', 'AMMO5': '0.003', 'AMMO2': '0.019', 'ARMOR': '0.076', 'HITCOUNT': '0.090', 'AMMO4': '0.094', 'AMMO3': '0.099', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.249', 'weapon4': '0.434', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.210', 'weapon2': '1.418'}
[2023-02-25 12:30:55,846][2409469] DAMAGECOUNT value on done: 406.0
[2023-02-25 12:30:55,847][2409469] Sum rewards: -1.644, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.646', 'AMMO2': '0.014', 'ARMOR': '0.036', 'AMMO4': '0.069', 'AMMO3': '0.071', 'WEAPON4': '0.300', 'HITCOUNT': '0.340', 'weapon4': '0.386', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.056', 'weapon2': '1.322', 'weapon3': '1.458', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:56,111][2409485] DAMAGECOUNT value on done: 104.0
[2023-02-25 12:30:56,261][2409406] DAMAGECOUNT value on done: 299.0
[2023-02-25 12:30:56,355][2409389] DAMAGECOUNT value on done: 335.0
[2023-02-25 12:30:56,356][2409389] Sum rewards: -4.555, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.724', 'FRAGCOUNT': '-1.500', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'HITCOUNT': '0.050', 'weapon5': '0.066', 'AMMO3': '0.078', 'DAMAGECOUNT': '0.180', 'WEAPON4': '0.200', 'ARMOR': '0.404', 'weapon4': '0.410', 'WEAPON3': '0.550', 'weapon3': '1.202', 'weapon2': '1.480'}
[2023-02-25 12:30:56,363][2409101] DAMAGECOUNT value on done: 307.0
[2023-02-25 12:30:56,366][2409101] Sum rewards: -1.496, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.014', 'AMMO2': '0.001', 'AMMO4': '0.007', 'WEAPON1': '0.020', 'HITCOUNT': '0.070', 'AMMO3': '0.114', 'DAMAGECOUNT': '0.255', 'ARMOR': '0.513', 'WEAPON3': '0.600', 'weapon3': '1.622', 'weapon2': '1.816', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:56,376][2409075] DAMAGECOUNT value on done: 275.0
[2023-02-25 12:30:56,377][2409075] Sum rewards: -2.194, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.198', 'AMMO5': '0.010', 'AMMO2': '0.023', 'HITCOUNT': '0.030', 'weapon5': '0.060', 'AMMO3': '0.061', 'weapon4': '0.098', 'AMMO4': '0.116', 'ARMOR': '0.128', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.465', 'FRAGCOUNT': '1.000', 'weapon3': '1.156', 'weapon2': '1.906'}
[2023-02-25 12:30:56,570][2409099] DAMAGECOUNT value on done: 571.0
[2023-02-25 12:30:56,581][2409080] DAMAGECOUNT value on done: 127.0
[2023-02-25 12:30:56,582][2409080] Sum rewards: -5.805, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.980', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.011', 'HITCOUNT': '0.040', 'AMMO4': '0.053', 'ARMOR': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.137', 'weapon4': '0.146', 'DAMAGECOUNT': '0.165', 'WEAPON4': '0.200', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.250', 'weapon3': '1.900'}
[2023-02-25 12:30:56,723][2409486] DAMAGECOUNT value on done: 186.0
[2023-02-25 12:30:56,724][2409486] Sum rewards: -2.787, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.810', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.134', 'weapon4': '0.264', 'DAMAGECOUNT': '0.372', 'WEAPON3': '0.650', 'weapon2': '1.154', 'weapon3': '1.778', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:56,805][2409077] DAMAGECOUNT value on done: 177.0
[2023-02-25 12:30:56,935][2409076] DAMAGECOUNT value on done: 287.0
[2023-02-25 12:30:56,935][2409076] Sum rewards: -5.226, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.430', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.086', 'HITCOUNT': '0.130', 'AMMO3': '0.180', 'WEAPON4': '0.300', 'weapon4': '0.348', 'DAMAGECOUNT': '0.405', 'ARMOR': '0.517', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '1.434', 'weapon3': '1.516'}
[2023-02-25 12:30:57,186][2408954] Fps is (10 sec: 26213.9, 60 sec: 25463.4, 300 sec: 25825.6). Total num frames: 18018304. Throughput: 0: 6343.2. Samples: 4505580. Policy #0 lag: (min: 0.0, avg: 12.7, max: 26.0)
[2023-02-25 12:30:57,186][2408954] Avg episode reward: [(0, '-2.824')]
[2023-02-25 12:30:57,215][2409097] DAMAGECOUNT value on done: 547.0
[2023-02-25 12:30:57,218][2409097] Sum rewards: -3.099, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.722', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.017', 'ARMOR': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.059', 'HITCOUNT': '0.070', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'weapon4': '0.248', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.366', 'weapon3': '1.132', 'weapon2': '1.614'}
[2023-02-25 12:30:57,225][2409468] DAMAGECOUNT value on done: 510.0
[2023-02-25 12:30:57,242][2409074] Updated weights for policy 0, policy_version 4400 (0.0013)
[2023-02-25 12:30:57,345][2409373] DAMAGECOUNT value on done: 532.0
[2023-02-25 12:30:57,346][2409373] Sum rewards: -0.408, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.150', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'weapon4': '0.002', 'WEAPON4': '0.050', 'weapon7': '0.090', 'HITCOUNT': '0.100', 'AMMO3': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.825', 'weapon3': '1.462', 'weapon2': '1.722', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:57,382][2409104] DAMAGECOUNT value on done: 215.0
[2023-02-25 12:30:57,383][2409104] Sum rewards: -3.546, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.313', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'weapon5': '0.038', 'AMMO4': '0.039', 'ARMOR': '0.040', 'WEAPON5': '0.100', 'HITCOUNT': '0.150', 'AMMO3': '0.171', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.398', 'weapon3': '1.740'}
[2023-02-25 12:30:57,527][2409105] DAMAGECOUNT value on done: 593.0
[2023-02-25 12:30:57,528][2409105] Sum rewards: 2.695, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.214', 'AMMO5': '0.005', 'weapon4': '0.006', 'AMMO2': '0.019', 'weapon5': '0.082', 'AMMO3': '0.084', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.250', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.020', 'weapon2': '1.176', 'weapon3': '1.970', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:30:57,727][2409079] DAMAGECOUNT value on done: 276.0
[2023-02-25 12:30:57,738][2409079] Sum rewards: -1.823, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.244', 'AMMO5': '0.003', 'weapon5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'weapon4': '0.050', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'AMMO4': '0.176', 'HITCOUNT': '0.190', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.627', 'weapon2': '1.402', 'weapon3': '1.624', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:57,908][2409548] DAMAGECOUNT value on done: 195.0
[2023-02-25 12:30:57,960][2409547] DAMAGECOUNT value on done: 546.0
[2023-02-25 12:30:57,960][2409547] Sum rewards: -8.030, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-3.300', 'FRAGCOUNT': '-1.500', 'ARMOR': '0.004', 'AMMO5': '0.004', 'weapon5': '0.024', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO3': '0.126', 'AMMO4': '0.141', 'HITCOUNT': '0.180', 'weapon4': '0.196', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.735', 'WEAPON3': '0.900', 'weapon2': '1.374', 'weapon3': '1.758'}
[2023-02-25 12:30:57,998][2409407] DAMAGECOUNT value on done: 267.0
[2023-02-25 12:30:58,021][2409100] DAMAGECOUNT value on done: 383.0
[2023-02-25 12:30:58,024][2409100] Sum rewards: -2.409, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.070', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'ARMOR': '0.068', 'AMMO4': '0.079', 'AMMO3': '0.094', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'weapon4': '0.320', 'DAMAGECOUNT': '0.504', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.078', 'weapon2': '1.352'}
[2023-02-25 12:30:58,139][2409549] DAMAGECOUNT value on done: 194.0
[2023-02-25 12:30:58,139][2409549] Sum rewards: -2.730, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.066', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.011', 'weapon5': '0.014', 'WEAPON5': '0.050', 'AMMO3': '0.109', 'HITCOUNT': '0.150', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.550', 'weapon2': '1.526', 'weapon3': '1.734'}
[2023-02-25 12:30:58,488][2409405] DAMAGECOUNT value on done: 386.0
[2023-02-25 12:30:58,489][2409405] Sum rewards: -6.461, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.610', 'AMMO5': '0.009', 'AMMO2': '0.018', 'weapon5': '0.024', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.143', 'HITCOUNT': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.254', 'DAMAGECOUNT': '0.447', 'ARMOR': '0.449', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.110', 'weapon3': '1.754'}
[2023-02-25 12:30:58,508][2409102] DAMAGECOUNT value on done: 297.0
[2023-02-25 12:30:58,577][2409103] DAMAGECOUNT value on done: 369.0
[2023-02-25 12:30:58,578][2409103] Sum rewards: 1.977, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.310', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'ARMOR': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.078', 'HITCOUNT': '0.080', 'AMMO3': '0.096', 'AMMO4': '0.098', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.600', 'weapon2': '1.302', 'weapon3': '1.678', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:30:58,588][2409597] DAMAGECOUNT value on done: 179.0
[2023-02-25 12:30:58,591][2409597] Sum rewards: -0.342, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.644', 'AMMO2': '0.001', 'AMMO4': '0.004', 'ARMOR': '0.028', 'WEAPON4': '0.050', 'AMMO3': '0.111', 'HITCOUNT': '0.140', 'weapon4': '0.254', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.068', 'weapon3': '1.796'}
[2023-02-25 12:30:58,623][2409078] DAMAGECOUNT value on done: 126.0
[2023-02-25 12:30:58,625][2409078] Sum rewards: -3.909, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.878', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'HITCOUNT': '0.050', 'weapon5': '0.076', 'AMMO3': '0.082', 'ARMOR': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.150', 'weapon4': '0.176', 'WEAPON3': '0.550', 'weapon2': '1.472', 'weapon3': '1.620'}
[2023-02-25 12:30:58,740][2409074] Updated weights for policy 0, policy_version 4410 (0.0012)
[2023-02-25 12:30:58,779][2409355] DAMAGECOUNT value on done: 563.0
[2023-02-25 12:30:58,780][2409355] Sum rewards: -2.958, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.158', 'AMMO2': '0.004', 'AMMO4': '0.020', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.112', 'HITCOUNT': '0.240', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.909', 'FRAGCOUNT': '1.000', 'weapon3': '1.418', 'weapon2': '1.960'}
[2023-02-25 12:30:58,787][2409866] DAMAGECOUNT value on done: 397.0
[2023-02-25 12:30:58,787][2409866] Sum rewards: -1.042, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.461', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.167', 'HITCOUNT': '0.170', 'ARMOR': '0.414', 'DAMAGECOUNT': '0.870', 'WEAPON3': '0.900', 'weapon2': '1.492', 'weapon3': '1.850', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:59,401][2409565] DAMAGECOUNT value on done: 63.0
[2023-02-25 12:30:59,511][2409096] DAMAGECOUNT value on done: 828.0
[2023-02-25 12:30:59,512][2409096] Sum rewards: -2.242, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.790', 'AMMO2': '0.007', 'AMMO4': '0.034', 'ARMOR': '0.040', 'weapon7': '0.050', 'weapon4': '0.098', 'HITCOUNT': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.116', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.699', 'weapon3': '1.254', 'weapon2': '1.650', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:30:59,617][2409596] DAMAGECOUNT value on done: 561.0
[2023-02-25 12:30:59,618][2409596] Sum rewards: 1.612, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.711', 'AMMO5': '0.003', 'AMMO2': '0.025', 'AMMO3': '0.053', 'AMMO4': '0.124', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.350', 'ARMOR': '0.432', 'weapon4': '0.632', 'weapon3': '1.288', 'DAMAGECOUNT': '1.350', 'weapon2': '1.416', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:30:59,649][2409469] DAMAGECOUNT value on done: 283.0
[2023-02-25 12:30:59,651][2409469] Sum rewards: -4.812, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.602', 'AMMO5': '0.007', 'AMMO2': '0.019', 'ARMOR': '0.044', 'WEAPON4': '0.050', 'weapon5': '0.084', 'AMMO4': '0.096', 'HITCOUNT': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'weapon4': '0.220', 'DAMAGECOUNT': '0.582', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '1.128', 'weapon3': '1.842'}
[2023-02-25 12:30:59,945][2409101] DAMAGECOUNT value on done: 309.0
[2023-02-25 12:30:59,948][2409101] Sum rewards: -5.594, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.588', 'AMMO4': '-0.058', 'AMMO2': '-0.011', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'HITCOUNT': '0.050', 'AMMO3': '0.150', 'DAMAGECOUNT': '0.165', 'WEAPON3': '0.900', 'weapon2': '1.600', 'weapon3': '1.916', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:00,305][2409099] DAMAGECOUNT value on done: 260.0
[2023-02-25 12:31:00,317][2409406] DAMAGECOUNT value on done: 378.0
[2023-02-25 12:31:00,318][2409406] Sum rewards: 1.404, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.397', 'AMMO5': '0.009', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.052', 'ARMOR': '0.064', 'AMMO3': '0.070', 'AMMO4': '0.072', 'HITCOUNT': '0.130', 'WEAPON5': '0.200', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.741', 'weapon2': '1.586', 'weapon3': '1.592', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:00,361][2409486] DAMAGECOUNT value on done: 452.0
[2023-02-25 12:31:00,362][2409486] Sum rewards: -2.539, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.423', 'AMMO5': '0.005', 'AMMO2': '0.009', 'ARMOR': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.143', 'weapon4': '0.156', 'HITCOUNT': '0.250', 'WEAPON3': '0.900', 'DAMAGECOUNT': '0.999', 'weapon2': '1.138', 'FRAGCOUNT': '2.000', 'weapon3': '2.052'}
[2023-02-25 12:31:00,414][2409080] DAMAGECOUNT value on done: 457.0
[2023-02-25 12:31:00,419][2409080] Sum rewards: 0.184, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.088', 'weapon5': '0.008', 'AMMO2': '0.012', 'AMMO5': '0.015', 'ARMOR': '0.044', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'weapon4': '0.158', 'HITCOUNT': '0.160', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.660', 'WEAPON3': '0.700', 'weapon3': '1.468', 'weapon2': '1.584', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:00,504][2409485] DAMAGECOUNT value on done: 257.0
[2023-02-25 12:31:00,505][2409485] Sum rewards: -4.542, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.851', 'AMMO2': '0.019', 'AMMO4': '0.094', 'AMMO3': '0.095', 'HITCOUNT': '0.150', 'weapon4': '0.324', 'WEAPON4': '0.400', 'ARMOR': '0.460', 'DAMAGECOUNT': '0.591', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.400', 'weapon2': '1.426'}
[2023-02-25 12:31:00,570][2409389] DAMAGECOUNT value on done: 380.0
[2023-02-25 12:31:00,571][2409389] Sum rewards: -2.557, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.870', 'AMMO5': '0.005', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon5': '0.024', 'WEAPON4': '0.050', 'weapon4': '0.078', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.150', 'HITCOUNT': '0.240', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.110', 'weapon2': '1.172', 'weapon3': '1.868'}
[2023-02-25 12:31:00,609][2409075] DAMAGECOUNT value on done: 350.0
[2023-02-25 12:31:00,610][2409075] Sum rewards: -3.367, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.526', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO3': '0.077', 'HITCOUNT': '0.200', 'ARMOR': '0.482', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.690', 'FRAGCOUNT': '1.000', 'weapon3': '1.436', 'weapon2': '1.992'}
[2023-02-25 12:31:00,720][2409097] DAMAGECOUNT value on done: 130.0
[2023-02-25 12:31:00,721][2409097] Sum rewards: -4.061, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.960', 'AMMO2': '0.022', 'ARMOR': '0.036', 'WEAPON1': '0.040', 'HITCOUNT': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.135', 'WEAPON4': '0.150', 'weapon4': '0.158', 'DAMAGECOUNT': '0.222', 'WEAPON3': '0.900', 'weapon2': '1.430', 'weapon3': '1.598', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:00,824][2409074] Updated weights for policy 0, policy_version 4420 (0.0013)
[2023-02-25 12:31:01,074][2409468] DAMAGECOUNT value on done: 239.0
[2023-02-25 12:31:01,077][2409468] Sum rewards: -1.002, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.276', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'HITCOUNT': '0.040', 'DAMAGECOUNT': '0.075', 'ARMOR': '0.104', 'AMMO3': '0.112', 'AMMO4': '0.154', 'WEAPON4': '0.250', 'weapon4': '0.372', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.198', 'weapon3': '1.318'}
[2023-02-25 12:31:01,197][2409105] DAMAGECOUNT value on done: 430.0
[2023-02-25 12:31:01,198][2409105] Sum rewards: -0.276, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.070', 'AMMO5': '0.011', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.120', 'AMMO3': '0.130', 'HITCOUNT': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.370', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.759', 'weapon2': '1.034', 'weapon3': '1.518', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:01,232][2409077] DAMAGECOUNT value on done: 232.0
[2023-02-25 12:31:01,294][2409104] DAMAGECOUNT value on done: 259.0
[2023-02-25 12:31:01,357][2409076] DAMAGECOUNT value on done: 285.0
[2023-02-25 12:31:01,362][2409076] Sum rewards: 0.337, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.132', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.016', 'weapon4': '0.016', 'AMMO4': '0.032', 'ARMOR': '0.032', 'HITCOUNT': '0.090', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.465', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.434', 'weapon3': '1.982'}
[2023-02-25 12:31:01,554][2409547] DAMAGECOUNT value on done: 431.0
[2023-02-25 12:31:01,600][2409548] DAMAGECOUNT value on done: 195.0
[2023-02-25 12:31:01,601][2409548] Sum rewards: -1.600, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.412', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.048', 'WEAPON5': '0.050', 'ARMOR': '0.058', 'AMMO4': '0.063', 'HITCOUNT': '0.070', 'AMMO3': '0.085', 'WEAPON4': '0.200', 'weapon4': '0.326', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon3': '1.294', 'weapon2': '1.510'}
[2023-02-25 12:31:01,647][2409079] DAMAGECOUNT value on done: 233.0
[2023-02-25 12:31:01,650][2409079] Sum rewards: -5.285, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.442', 'AMMO5': '0.004', 'WEAPON1': '0.010', 'weapon5': '0.026', 'AMMO2': '0.039', 'ARMOR': '0.064', 'HITCOUNT': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'AMMO4': '0.193', 'DAMAGECOUNT': '0.219', 'weapon4': '0.412', 'WEAPON4': '0.450', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.256', 'weapon3': '1.344'}
[2023-02-25 12:31:01,661][2409549] DAMAGECOUNT value on done: 418.0
[2023-02-25 12:31:01,662][2409549] Sum rewards: -4.031, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.751', 'AMMO2': '0.001', 'weapon5': '0.006', 'AMMO4': '0.006', 'AMMO5': '0.010', 'HITCOUNT': '0.150', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'ARMOR': '0.469', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.166', 'weapon3': '2.012'}
[2023-02-25 12:31:01,688][2409100] DAMAGECOUNT value on done: 285.0
[2023-02-25 12:31:01,688][2409100] Sum rewards: -2.813, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.606', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.059', 'weapon5': '0.072', 'ARMOR': '0.092', 'HITCOUNT': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.200', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.450', 'weapon3': '1.362', 'weapon2': '1.616'}
[2023-02-25 12:31:01,717][2409373] DAMAGECOUNT value on done: 279.0
[2023-02-25 12:31:01,720][2409373] Sum rewards: -5.193, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.244', 'AMMO2': '0.014', 'ARMOR': '0.036', 'AMMO4': '0.067', 'HITCOUNT': '0.080', 'AMMO3': '0.134', 'DAMAGECOUNT': '0.222', 'WEAPON4': '0.300', 'weapon4': '0.452', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.216', 'weapon3': '1.580'}
[2023-02-25 12:31:01,790][2409407] DAMAGECOUNT value on done: 228.0
[2023-02-25 12:31:02,103][2409102] DAMAGECOUNT value on done: 217.0
[2023-02-25 12:31:02,166][2409597] DAMAGECOUNT value on done: 228.0
[2023-02-25 12:31:02,167][2409597] Sum rewards: -6.514, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.152', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.029', 'ARMOR': '0.068', 'HITCOUNT': '0.130', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'weapon4': '0.174', 'DAMAGECOUNT': '0.393', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.494', 'weapon2': '1.680'}
[2023-02-25 12:31:02,186][2408954] Fps is (10 sec: 24985.6, 60 sec: 25327.0, 300 sec: 25797.9). Total num frames: 18141184. Throughput: 0: 6358.7. Samples: 4543944. Policy #0 lag: (min: 0.0, avg: 12.0, max: 25.0)
[2023-02-25 12:31:02,186][2408954] Avg episode reward: [(0, '-2.948')]
[2023-02-25 12:31:02,209][2409074] Updated weights for policy 0, policy_version 4430 (0.0012)
[2023-02-25 12:31:02,276][2409405] DAMAGECOUNT value on done: 597.0
[2023-02-25 12:31:02,277][2409405] Sum rewards: -2.116, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.276', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.004', 'weapon5': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'ARMOR': '0.080', 'weapon4': '0.088', 'AMMO3': '0.132', 'HITCOUNT': '0.240', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.747', 'weapon3': '1.408', 'weapon2': '1.876', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:02,334][2409103] DAMAGECOUNT value on done: 736.0
[2023-02-25 12:31:02,338][2409103] Sum rewards: 1.955, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.564', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.052', 'AMMO3': '0.056', 'HITCOUNT': '0.160', 'WEAPON5': '0.200', 'weapon4': '0.244', 'WEAPON3': '0.400', 'ARMOR': '0.400', 'weapon3': '1.008', 'DAMAGECOUNT': '1.068', 'weapon2': '1.350', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:02,429][2409866] DAMAGECOUNT value on done: 382.0
[2023-02-25 12:31:02,433][2409866] Sum rewards: -1.572, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.184', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'ARMOR': '0.040', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'WEAPON4': '0.150', 'AMMO4': '0.165', 'HITCOUNT': '0.170', 'weapon4': '0.294', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.666', 'FRAGCOUNT': '1.000', 'weapon2': '1.128', 'weapon3': '1.522'}
[2023-02-25 12:31:02,447][2409078] DAMAGECOUNT value on done: 359.0
[2023-02-25 12:31:02,454][2409355] DAMAGECOUNT value on done: 283.0
[2023-02-25 12:31:02,455][2409355] Sum rewards: -1.246, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.718', 'AMMO2': '0.034', 'ARMOR': '0.096', 'AMMO3': '0.112', 'HITCOUNT': '0.150', 'AMMO4': '0.170', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.354', 'weapon4': '0.426', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.376', 'weapon2': '1.504'}
[2023-02-25 12:31:02,938][2409565] DAMAGECOUNT value on done: 331.0
[2023-02-25 12:31:02,941][2409565] Sum rewards: -6.285, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.456', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'AMMO5': '0.004', 'weapon5': '0.046', 'ARMOR': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'HITCOUNT': '0.140', 'weapon4': '0.244', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.705', 'weapon2': '1.338', 'weapon3': '1.424'}
[2023-02-25 12:31:03,091][2409096] DAMAGECOUNT value on done: 240.0
[2023-02-25 12:31:03,094][2409096] Sum rewards: -0.852, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.018', 'weapon4': '0.026', 'HEALTH': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.119', 'HITCOUNT': '0.140', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.600', 'weapon2': '1.008', 'FRAGCOUNT': '1.500', 'weapon3': '1.664'}
[2023-02-25 12:31:03,180][2409074] Updated weights for policy 0, policy_version 4440 (0.0012)
[2023-02-25 12:31:03,235][2409469] DAMAGECOUNT value on done: 244.0
[2023-02-25 12:31:03,236][2409469] Sum rewards: -3.138, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.018', 'AMMO2': '0.012', 'AMMO4': '0.057', 'HITCOUNT': '0.070', 'AMMO3': '0.096', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.240', 'weapon4': '0.264', 'WEAPON3': '0.650', 'ARMOR': '0.919', 'FRAGCOUNT': '1.000', 'weapon3': '1.392', 'weapon2': '1.480'}
[2023-02-25 12:31:03,307][2409596] DAMAGECOUNT value on done: 510.0
[2023-02-25 12:31:03,308][2409596] Sum rewards: -2.734, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.948', 'AMMO2': '0.034', 'WEAPON1': '0.040', 'AMMO3': '0.060', 'weapon4': '0.098', 'AMMO4': '0.168', 'WEAPON4': '0.250', 'HITCOUNT': '0.260', 'WEAPON3': '0.350', 'ARMOR': '0.412', 'weapon3': '0.986', 'DAMAGECOUNT': '1.020', 'FRAGCOUNT': '2.000', 'weapon2': '2.286'}
[2023-02-25 12:31:03,664][2409101] DAMAGECOUNT value on done: 396.0
[2023-02-25 12:31:03,667][2409101] Sum rewards: -1.854, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.805', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'weapon4': '0.284', 'ARMOR': '0.412', 'DAMAGECOUNT': '0.642', 'WEAPON3': '0.800', 'weapon2': '1.046', 'weapon3': '1.898', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:31:04,383][2409080] DAMAGECOUNT value on done: 386.0
[2023-02-25 12:31:04,384][2409080] Sum rewards: -5.664, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.042', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'HITCOUNT': '0.070', 'AMMO4': '0.094', 'AMMO3': '0.157', 'weapon4': '0.180', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.201', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.312', 'weapon3': '1.742'}
[2023-02-25 12:31:04,438][2409485] DAMAGECOUNT value on done: 380.0
[2023-02-25 12:31:04,439][2409485] Sum rewards: -5.283, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.222', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.031', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.102', 'AMMO3': '0.112', 'AMMO4': '0.153', 'HITCOUNT': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.780', 'weapon3': '1.448', 'weapon2': '1.702'}
[2023-02-25 12:31:04,446][2409389] DAMAGECOUNT value on done: 427.0
[2023-02-25 12:31:04,449][2409389] Sum rewards: 2.984, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.417', 'AMMO2': '0.004', 'AMMO4': '0.022', 'AMMO3': '0.078', 'WEAPON4': '0.150', 'weapon4': '0.156', 'HITCOUNT': '0.290', 'ARMOR': '0.436', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.996', 'weapon3': '1.388', 'weapon2': '1.630', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:31:04,457][2409075] DAMAGECOUNT value on done: 582.0
[2023-02-25 12:31:04,458][2409075] Sum rewards: -1.738, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.992', 'AMMO2': '0.049', 'ARMOR': '0.060', 'AMMO3': '0.085', 'HITCOUNT': '0.200', 'AMMO4': '0.243', 'weapon4': '0.254', 'WEAPON4': '0.350', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.627', 'FRAGCOUNT': '1.000', 'weapon2': '1.116', 'weapon3': '1.520'}
[2023-02-25 12:31:04,529][2409099] DAMAGECOUNT value on done: 277.0
[2023-02-25 12:31:04,532][2409099] Sum rewards: -1.608, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.010', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'HITCOUNT': '0.060', 'AMMO4': '0.078', 'weapon4': '0.082', 'AMMO3': '0.111', 'weapon5': '0.132', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.483', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.272', 'weapon2': '1.748'}
[2023-02-25 12:31:04,553][2409486] DAMAGECOUNT value on done: 373.0
[2023-02-25 12:31:04,554][2409486] Sum rewards: -5.374, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.639', 'AMMO2': '0.004', 'AMMO4': '0.022', 'weapon4': '0.070', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.140', 'DAMAGECOUNT': '0.315', 'ARMOR': '0.436', 'WEAPON3': '0.900', 'weapon2': '0.998', 'FRAGCOUNT': '1.000', 'weapon3': '2.180'}
[2023-02-25 12:31:04,557][2409406] DAMAGECOUNT value on done: 399.0
[2023-02-25 12:31:04,558][2409406] Sum rewards: -0.193, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.192', 'AMMO5': '0.003', 'weapon4': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO4': '0.075', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.810', 'weapon2': '1.454', 'weapon3': '1.472', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:04,742][2409097] DAMAGECOUNT value on done: 109.0
[2023-02-25 12:31:04,790][2409105] DAMAGECOUNT value on done: 136.0
[2023-02-25 12:31:05,084][2409077] DAMAGECOUNT value on done: 104.0
[2023-02-25 12:31:05,087][2409077] Sum rewards: -1.935, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.708', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'HITCOUNT': '0.040', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.120', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.340', 'weapon3': '1.534'}
[2023-02-25 12:31:05,137][2409076] DAMAGECOUNT value on done: 65.0
[2023-02-25 12:31:05,153][2409468] DAMAGECOUNT value on done: 152.0
[2023-02-25 12:31:05,157][2409468] Sum rewards: -2.823, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.308', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.033', 'HITCOUNT': '0.040', 'weapon5': '0.060', 'ARMOR': '0.064', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.111', 'weapon4': '0.134', 'WEAPON5': '0.150', 'WEAPON3': '0.550', 'weapon2': '1.072', 'weapon3': '1.560'}
[2023-02-25 12:31:05,284][2409104] DAMAGECOUNT value on done: 165.0
[2023-02-25 12:31:05,325][2409549] DAMAGECOUNT value on done: 365.0
[2023-02-25 12:31:05,326][2409549] Sum rewards: 1.607, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'weapon5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.054', 'HITCOUNT': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'HEALTH': '0.252', 'weapon4': '0.288', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.315', 'ARMOR': '0.400', 'weapon3': '1.174', 'weapon2': '1.586', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:05,355][2409079] DAMAGECOUNT value on done: 388.0
[2023-02-25 12:31:05,424][2409548] DAMAGECOUNT value on done: 445.0
[2023-02-25 12:31:05,427][2409548] Sum rewards: -3.068, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.646', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'WEAPON4': '0.050', 'ARMOR': '0.068', 'AMMO3': '0.105', 'HITCOUNT': '0.160', 'weapon4': '0.166', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.600', 'weapon2': '1.414', 'weapon3': '1.450', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:05,434][2409407] DAMAGECOUNT value on done: 417.0
[2023-02-25 12:31:05,435][2409407] Sum rewards: -5.909, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.408', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.001', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO4': '0.004', 'WEAPON5': '0.050', 'weapon4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'HITCOUNT': '0.260', 'ARMOR': '0.474', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.714', 'weapon3': '1.186', 'weapon2': '2.236'}
[2023-02-25 12:31:05,465][2409074] Updated weights for policy 0, policy_version 4450 (0.0013)
[2023-02-25 12:31:05,466][2409373] DAMAGECOUNT value on done: 769.0
[2023-02-25 12:31:05,469][2409373] Sum rewards: -2.207, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.796', 'AMMO2': '0.011', 'AMMO5': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'weapon4': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon5': '0.218', 'HITCOUNT': '0.320', 'weapon2': '1.046', 'WEAPON3': '1.100', 'DAMAGECOUNT': '1.500', 'weapon3': '1.852', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:31:05,470][2409100] DAMAGECOUNT value on done: 249.0
[2023-02-25 12:31:05,472][2409100] Sum rewards: -1.080, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.860', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.026', 'weapon5': '0.032', 'WEAPON1': '0.040', 'HITCOUNT': '0.070', 'AMMO3': '0.097', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.400', 'ARMOR': '0.415', 'weapon3': '1.114', 'weapon2': '2.034'}
[2023-02-25 12:31:05,750][2409597] DAMAGECOUNT value on done: 530.0
[2023-02-25 12:31:05,751][2409597] Sum rewards: -3.452, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.475', 'AMMO2': '0.004', 'AMMO4': '0.018', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'weapon4': '0.196', 'DAMAGECOUNT': '0.492', 'WEAPON3': '0.500', 'ARMOR': '0.570', 'FRAGCOUNT': '1.000', 'weapon3': '1.358', 'weapon2': '1.836'}
[2023-02-25 12:31:05,788][2409102] DAMAGECOUNT value on done: 507.0
[2023-02-25 12:31:05,789][2409102] Sum rewards: -0.485, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.666', 'AMMO2': '0.005', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.023', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.133', 'HITCOUNT': '0.330', 'ARMOR': '0.400', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.035', 'weapon2': '1.272', 'FRAGCOUNT': '1.500', 'weapon3': '1.966'}
[2023-02-25 12:31:05,900][2409405] DAMAGECOUNT value on done: 235.0
[2023-02-25 12:31:06,032][2409547] DAMAGECOUNT value on done: 174.0
[2023-02-25 12:31:06,101][2409078] DAMAGECOUNT value on done: 274.0
[2023-02-25 12:31:06,104][2409866] DAMAGECOUNT value on done: 237.0
[2023-02-25 12:31:06,107][2409866] Sum rewards: -3.051, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.166', 'AMMO2': '0.024', 'HITCOUNT': '0.060', 'AMMO4': '0.120', 'AMMO3': '0.129', 'weapon4': '0.260', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.360', 'ARMOR': '0.468', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.462', 'weapon3': '1.482'}
[2023-02-25 12:31:06,126][2409355] DAMAGECOUNT value on done: 108.0
[2023-02-25 12:31:06,127][2409355] Sum rewards: -2.200, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.910', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.059', 'HITCOUNT': '0.060', 'ARMOR': '0.064', 'AMMO4': '0.074', 'DAMAGECOUNT': '0.162', 'weapon4': '0.202', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon3': '1.264', 'weapon2': '1.780'}
[2023-02-25 12:31:06,306][2409103] DAMAGECOUNT value on done: 606.0
[2023-02-25 12:31:06,309][2409103] Sum rewards: -0.396, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.092', 'AMMO2': '0.003', 'AMMO5': '0.015', 'AMMO4': '0.015', 'weapon5': '0.018', 'WEAPON4': '0.050', 'weapon4': '0.054', 'AMMO3': '0.129', 'HITCOUNT': '0.290', 'WEAPON5': '0.300', 'WEAPON3': '0.800', 'weapon2': '1.146', 'DAMAGECOUNT': '1.191', 'weapon3': '1.934', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:31:06,667][2409096] DAMAGECOUNT value on done: 599.0
[2023-02-25 12:31:06,670][2409074] Updated weights for policy 0, policy_version 4460 (0.0013)
[2023-02-25 12:31:06,668][2409096] Sum rewards: 2.737, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.025', 'HEALTH': '0.036', 'ARMOR': '0.062', 'AMMO3': '0.091', 'AMMO4': '0.126', 'weapon4': '0.138', 'WEAPON4': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.050', 'weapon3': '1.430', 'weapon2': '1.788', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:31:06,799][2409469] DAMAGECOUNT value on done: 339.0
[2023-02-25 12:31:06,800][2409469] Sum rewards: -6.124, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.856', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.013', 'weapon5': '0.024', 'weapon4': '0.030', 'HITCOUNT': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.225', 'ARMOR': '0.470', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.572', 'weapon2': '1.578'}
[2023-02-25 12:31:07,186][2408954] Fps is (10 sec: 26624.4, 60 sec: 25395.2, 300 sec: 25881.2). Total num frames: 18284544. Throughput: 0: 6359.5. Samples: 4563108. Policy #0 lag: (min: 0.0, avg: 10.9, max: 24.0)
[2023-02-25 12:31:07,186][2408954] Avg episode reward: [(0, '-2.739')]
[2023-02-25 12:31:07,189][2409565] DAMAGECOUNT value on done: 248.0
[2023-02-25 12:31:07,192][2409565] Sum rewards: -3.817, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.056', 'AMMO2': '0.014', 'ARMOR': '0.034', 'WEAPON4': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.085', 'HITCOUNT': '0.090', 'weapon4': '0.096', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.338', 'weapon2': '1.800'}
[2023-02-25 12:31:07,194][2409101] DAMAGECOUNT value on done: 376.0
[2023-02-25 12:31:07,197][2409101] Sum rewards: -2.686, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.055', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.013', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'ARMOR': '0.044', 'weapon5': '0.044', 'AMMO3': '0.062', 'HITCOUNT': '0.110', 'AMMO4': '0.114', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.338', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.498', 'weapon3': '1.180', 'weapon2': '1.464'}
[2023-02-25 12:31:07,724][2409596] DAMAGECOUNT value on done: 430.0
[2023-02-25 12:31:07,726][2409596] Sum rewards: -5.289, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.462', 'AMMO2': '0.011', 'ARMOR': '0.048', 'AMMO4': '0.056', 'AMMO3': '0.169', 'HITCOUNT': '0.220', 'WEAPON4': '0.250', 'weapon4': '0.388', 'DAMAGECOUNT': '0.780', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '1.498', 'weapon3': '1.502'}
[2023-02-25 12:31:07,975][2409485] DAMAGECOUNT value on done: 276.0
[2023-02-25 12:31:08,181][2409406] DAMAGECOUNT value on done: 160.0
[2023-02-25 12:31:08,182][2409406] Sum rewards: -0.423, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.700', 'AMMO5': '0.003', 'AMMO2': '0.013', 'ARMOR': '0.036', 'HITCOUNT': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.091', 'DAMAGECOUNT': '0.120', 'WEAPON4': '0.300', 'weapon4': '0.440', 'WEAPON3': '0.550', 'weapon3': '1.230', 'weapon2': '1.342', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:08,404][2409080] DAMAGECOUNT value on done: 770.0
[2023-02-25 12:31:08,408][2409080] Sum rewards: -1.131, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.294', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'weapon5': '0.024', 'AMMO4': '0.050', 'ARMOR': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.125', 'WEAPON4': '0.250', 'HITCOUNT': '0.260', 'weapon4': '0.416', 'WEAPON3': '0.750', 'weapon2': '0.980', 'DAMAGECOUNT': '1.065', 'weapon3': '1.532', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:08,573][2409099] DAMAGECOUNT value on done: 194.0
[2023-02-25 12:31:08,575][2409486] DAMAGECOUNT value on done: 185.0
[2023-02-25 12:31:08,579][2409486] Sum rewards: -3.309, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.400', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'ARMOR': '0.052', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.216', 'DAMAGECOUNT': '0.285', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon3': '1.118', 'weapon2': '2.068'}
[2023-02-25 12:31:08,627][2409105] DAMAGECOUNT value on done: 245.0
[2023-02-25 12:31:08,631][2409105] Sum rewards: -3.303, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.472', 'AMMO2': '0.018', 'AMMO4': '0.092', 'AMMO3': '0.107', 'ARMOR': '0.112', 'HITCOUNT': '0.120', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.300', 'weapon3': '0.548', 'WEAPON3': '0.600', 'weapon4': '0.654', 'FRAGCOUNT': '1.000', 'weapon2': '1.168'}
[2023-02-25 12:31:08,704][2409077] DAMAGECOUNT value on done: 238.0
[2023-02-25 12:31:08,707][2409077] Sum rewards: 0.376, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'HITCOUNT': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.073', 'weapon4': '0.084', 'weapon5': '0.088', 'HEALTH': '0.160', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.549', 'FRAGCOUNT': '1.000', 'weapon2': '1.402', 'weapon3': '1.710'}
[2023-02-25 12:31:08,788][2409389] DAMAGECOUNT value on done: 256.0
[2023-02-25 12:31:08,792][2409075] DAMAGECOUNT value on done: 163.0
[2023-02-25 12:31:08,797][2409075] Sum rewards: -1.475, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.710', 'AMMO5': '0.005', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon5': '0.032', 'WEAPON5': '0.050', 'HITCOUNT': '0.080', 'AMMO3': '0.105', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.279', 'weapon4': '0.304', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.056', 'weapon3': '1.422'}
[2023-02-25 12:31:08,937][2409548] DAMAGECOUNT value on done: 300.0
[2023-02-25 12:31:08,963][2409100] DAMAGECOUNT value on done: 169.0
[2023-02-25 12:31:08,994][2409074] Updated weights for policy 0, policy_version 4470 (0.0012)
[2023-02-25 12:31:09,038][2409079] DAMAGECOUNT value on done: 207.0
[2023-02-25 12:31:09,096][2409407] DAMAGECOUNT value on done: 460.0
[2023-02-25 12:31:09,097][2409407] Sum rewards: -3.624, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.930', 'AMMO5': '0.004', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'weapon5': '0.046', 'ARMOR': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.190', 'HITCOUNT': '0.220', 'WEAPON4': '0.350', 'weapon4': '0.350', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.014', 'weapon3': '1.084', 'weapon2': '1.774', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:09,098][2409468] DAMAGECOUNT value on done: 204.0
[2023-02-25 12:31:09,102][2409468] Sum rewards: -4.359, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.162', 'AMMO5': '0.004', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon5': '0.060', 'AMMO3': '0.087', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.128', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.270', 'WEAPON3': '0.500', 'ARMOR': '0.860', 'FRAGCOUNT': '1.000', 'weapon3': '1.500', 'weapon2': '1.568'}
[2023-02-25 12:31:09,158][2409097] DAMAGECOUNT value on done: 383.0
[2023-02-25 12:31:09,159][2409097] Sum rewards: -4.625, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.552', 'AMMO5': '0.007', 'AMMO2': '0.008', 'weapon5': '0.024', 'AMMO4': '0.041', 'ARMOR': '0.072', 'AMMO3': '0.106', 'HITCOUNT': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.510', 'weapon4': '0.534', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.088', 'weapon2': '1.356'}
[2023-02-25 12:31:09,167][2409076] DAMAGECOUNT value on done: 535.0
[2023-02-25 12:31:09,169][2409076] Sum rewards: -7.758, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.189', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.015', 'ARMOR': '0.050', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.192', 'AMMO3': '0.199', 'HITCOUNT': '0.220', 'DAMAGECOUNT': '0.915', 'WEAPON3': '1.200', 'weapon3': '1.502', 'weapon2': '1.550', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:09,406][2409549] DAMAGECOUNT value on done: 319.0
[2023-02-25 12:31:09,409][2409549] Sum rewards: -3.016, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.676', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.048', 'AMMO4': '0.051', 'WEAPON5': '0.100', 'AMMO3': '0.124', 'HITCOUNT': '0.140', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.700', 'weapon2': '1.156', 'weapon3': '2.096'}
[2023-02-25 12:31:09,509][2409373] DAMAGECOUNT value on done: 218.0
[2023-02-25 12:31:09,517][2409104] DAMAGECOUNT value on done: 232.0
[2023-02-25 12:31:09,576][2409597] DAMAGECOUNT value on done: 298.0
[2023-02-25 12:31:09,577][2409597] Sum rewards: -0.324, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.860', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.053', 'AMMO4': '0.078', 'weapon4': '0.106', 'HITCOUNT': '0.210', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.699', 'FRAGCOUNT': '1.000', 'weapon3': '1.090', 'weapon2': '2.082'}
[2023-02-25 12:31:09,880][2409866] DAMAGECOUNT value on done: 315.0
[2023-02-25 12:31:09,885][2409102] DAMAGECOUNT value on done: 145.0
[2023-02-25 12:31:09,884][2409866] Sum rewards: -4.716, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.199', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.038', 'weapon5': '0.064', 'ARMOR': '0.068', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'weapon4': '0.256', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.660', 'weapon3': '1.044', 'weapon2': '1.504'}
[2023-02-25 12:31:09,895][2409355] DAMAGECOUNT value on done: 305.0
[2023-02-25 12:31:10,031][2409405] DAMAGECOUNT value on done: 225.0
[2023-02-25 12:31:10,032][2409405] Sum rewards: -2.583, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.486', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.010', 'weapon4': '0.014', 'AMMO4': '0.046', 'AMMO3': '0.090', 'ARMOR': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.120', 'DAMAGECOUNT': '0.405', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.600', 'weapon2': '1.562', 'weapon3': '1.742'}
[2023-02-25 12:31:10,057][2409074] Updated weights for policy 0, policy_version 4480 (0.0012)
[2023-02-25 12:31:10,118][2409103] DAMAGECOUNT value on done: 344.0
[2023-02-25 12:31:10,119][2409103] Sum rewards: -3.101, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.136', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'WEAPON1': '0.010', 'AMMO3': '0.115', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'weapon4': '0.284', 'ARMOR': '0.494', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.687', 'FRAGCOUNT': '1.000', 'weapon3': '1.204', 'weapon2': '1.744'}
[2023-02-25 12:31:10,174][2409547] DAMAGECOUNT value on done: 520.0
[2023-02-25 12:31:10,177][2409547] Sum rewards: -3.227, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.644', 'AMMO2': '0.004', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.020', 'ARMOR': '0.038', 'weapon5': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.152', 'WEAPON5': '0.200', 'HITCOUNT': '0.210', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.005', 'weapon2': '1.320', 'FRAGCOUNT': '1.500', 'weapon3': '1.792'}
[2023-02-25 12:31:10,230][2409078] DAMAGECOUNT value on done: 257.0
[2023-02-25 12:31:10,234][2409078] Sum rewards: 0.332, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.196', 'AMMO5': '0.005', 'AMMO2': '0.022', 'ARMOR': '0.028', 'HITCOUNT': '0.040', 'weapon5': '0.046', 'AMMO3': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'WEAPON4': '0.250', 'weapon4': '0.258', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.550', 'weapon3': '1.482', 'weapon2': '1.522', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:10,383][2409096] DAMAGECOUNT value on done: 266.0
[2023-02-25 12:31:10,387][2409096] Sum rewards: -1.536, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.416', 'AMMO5': '0.005', 'AMMO2': '0.009', 'ARMOR': '0.024', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'weapon4': '0.066', 'WEAPON5': '0.100', 'weapon5': '0.102', 'HITCOUNT': '0.130', 'AMMO3': '0.146', 'DAMAGECOUNT': '0.501', 'WEAPON3': '0.800', 'weapon2': '0.882', 'FRAGCOUNT': '1.500', 'weapon3': '2.018'}
[2023-02-25 12:31:10,503][2409469] DAMAGECOUNT value on done: 392.0
[2023-02-25 12:31:10,504][2409469] Sum rewards: -1.973, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.543', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO3': '0.099', 'weapon4': '0.178', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'ARMOR': '0.489', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.675', 'weapon2': '1.306', 'weapon3': '1.772', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:31:10,849][2409565] DAMAGECOUNT value on done: 394.0
[2023-02-25 12:31:10,852][2409565] Sum rewards: -0.954, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.788', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.004', 'WEAPON1': '0.020', 'weapon5': '0.046', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.109', 'HITCOUNT': '0.160', 'ARMOR': '0.412', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.615', 'FRAGCOUNT': '1.000', 'weapon3': '1.052', 'weapon2': '1.408'}
[2023-02-25 12:31:11,460][2409596] DAMAGECOUNT value on done: 379.0
[2023-02-25 12:31:11,461][2409596] Sum rewards: -4.146, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.428', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.100', 'HITCOUNT': '0.110', 'weapon4': '0.112', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'ARMOR': '0.464', 'DAMAGECOUNT': '0.675', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '1.190', 'weapon3': '1.894'}
[2023-02-25 12:31:11,465][2409074] Updated weights for policy 0, policy_version 4490 (0.0013)
[2023-02-25 12:31:11,472][2409101] DAMAGECOUNT value on done: 65.0
[2023-02-25 12:31:11,476][2409101] Sum rewards: -5.721, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.637', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.012', 'AMMO2': '0.020', 'HITCOUNT': '0.070', 'weapon5': '0.070', 'AMMO4': '0.102', 'AMMO3': '0.120', 'DAMAGECOUNT': '0.195', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.446', 'ARMOR': '0.453', 'WEAPON3': '0.750', 'weapon2': '1.140', 'weapon3': '1.438'}
[2023-02-25 12:31:11,953][2409485] DAMAGECOUNT value on done: 230.0
[2023-02-25 12:31:11,956][2409485] Sum rewards: 0.180, reward structure: {'DEATHCOUNT': '-6.000', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.022', 'ARMOR': '0.088', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'HITCOUNT': '0.120', 'WEAPON4': '0.200', 'HEALTH': '0.204', 'weapon4': '0.294', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.026', 'weapon3': '1.828'}
[2023-02-25 12:31:12,156][2409486] DAMAGECOUNT value on done: 150.0
[2023-02-25 12:31:12,186][2408954] Fps is (10 sec: 25395.2, 60 sec: 25327.1, 300 sec: 25784.0). Total num frames: 18395136. Throughput: 0: 6373.9. Samples: 4601076. Policy #0 lag: (min: 1.0, avg: 11.9, max: 26.0)
[2023-02-25 12:31:12,186][2408954] Avg episode reward: [(0, '-2.704')]
[2023-02-25 12:31:12,189][2409099] DAMAGECOUNT value on done: 524.0
[2023-02-25 12:31:12,189][2409099] Sum rewards: -2.805, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.490', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.039', 'AMMO3': '0.118', 'HITCOUNT': '0.230', 'DAMAGECOUNT': '0.642', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.342', 'weapon2': '1.386'}
[2023-02-25 12:31:12,253][2409389] DAMAGECOUNT value on done: 175.0
[2023-02-25 12:31:12,278][2409105] DAMAGECOUNT value on done: 423.0
[2023-02-25 12:31:12,279][2409105] Sum rewards: -2.129, reward structure: {'DEATHCOUNT': '-5.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.015', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.088', 'HITCOUNT': '0.130', 'weapon4': '0.180', 'DAMAGECOUNT': '0.360', 'ARMOR': '0.424', 'WEAPON3': '0.450', 'weapon3': '1.370', 'weapon2': '1.430'}
[2023-02-25 12:31:12,311][2409075] DAMAGECOUNT value on done: 560.0
[2023-02-25 12:31:12,312][2409075] Sum rewards: -0.226, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.630', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'WEAPON1': '0.010', 'ARMOR': '0.029', 'weapon4': '0.044', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'HITCOUNT': '0.200', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.020', 'weapon2': '1.254', 'weapon3': '1.802', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:12,406][2409406] DAMAGECOUNT value on done: 194.0
[2023-02-25 12:31:12,469][2409080] DAMAGECOUNT value on done: 164.0
[2023-02-25 12:31:12,470][2409080] Sum rewards: -1.835, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.390', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO2': '0.019', 'ARMOR': '0.055', 'AMMO3': '0.070', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.500', 'FRAGCOUNT': '0.500', 'weapon2': '1.594', 'weapon3': '1.712'}
[2023-02-25 12:31:12,638][2409100] DAMAGECOUNT value on done: 423.0
[2023-02-25 12:31:12,639][2409100] Sum rewards: -2.791, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.560', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.016', 'weapon7': '0.030', 'AMMO4': '0.077', 'weapon4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.154', 'HITCOUNT': '0.240', 'DAMAGECOUNT': '0.855', 'WEAPON3': '0.950', 'ARMOR': '0.980', 'weapon2': '1.430', 'weapon3': '1.442', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:12,640][2409548] DAMAGECOUNT value on done: 163.0
[2023-02-25 12:31:12,917][2409077] DAMAGECOUNT value on done: 330.0
[2023-02-25 12:31:12,920][2409077] Sum rewards: -6.276, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.112', 'AMMO5': '0.003', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'ARMOR': '0.016', 'AMMO4': '0.024', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.076', 'HITCOUNT': '0.090', 'AMMO3': '0.139', 'weapon4': '0.190', 'DAMAGECOUNT': '0.207', 'WEAPON3': '0.550', 'weapon3': '0.964', 'weapon2': '2.212'}
[2023-02-25 12:31:12,930][2409076] DAMAGECOUNT value on done: 274.0
[2023-02-25 12:31:13,002][2409097] DAMAGECOUNT value on done: 457.0
[2023-02-25 12:31:13,003][2409097] Sum rewards: -5.074, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.223', 'AMMO5': '0.003', 'AMMO2': '0.013', 'AMMO4': '0.065', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'weapon4': '0.236', 'ARMOR': '0.483', 'DAMAGECOUNT': '0.630', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.122', 'weapon3': '1.630'}
[2023-02-25 12:31:13,182][2409079] DAMAGECOUNT value on done: 218.0
[2023-02-25 12:31:13,186][2409079] Sum rewards: -2.599, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.840', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.090', 'AMMO3': '0.110', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.278', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.230', 'weapon3': '1.696'}
[2023-02-25 12:31:13,205][2409468] DAMAGECOUNT value on done: 440.0
[2023-02-25 12:31:13,208][2409468] Sum rewards: 1.983, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.013', 'ARMOR': '0.047', 'AMMO4': '0.062', 'AMMO3': '0.117', 'HITCOUNT': '0.260', 'WEAPON3': '0.500', 'HEALTH': '0.532', 'DAMAGECOUNT': '1.050', 'weapon2': '1.432', 'weapon3': '1.720', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:31:13,211][2409407] DAMAGECOUNT value on done: 484.0
[2023-02-25 12:31:13,214][2409407] Sum rewards: 2.559, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.930', 'AMMO4': '-0.055', 'AMMO2': '-0.011', 'AMMO3': '0.061', 'WEAPON4': '0.100', 'HITCOUNT': '0.150', 'weapon4': '0.210', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.417', 'weapon2': '1.322', 'weapon3': '1.644', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:31:13,253][2409549] DAMAGECOUNT value on done: 392.0
[2023-02-25 12:31:13,258][2409373] DAMAGECOUNT value on done: 325.0
[2023-02-25 12:31:13,255][2409549] Sum rewards: 4.012, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.714', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO3': '0.068', 'AMMO4': '0.086', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'weapon4': '0.260', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.026', 'weapon2': '1.158', 'weapon3': '1.578', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:31:13,259][2409373] Sum rewards: -2.061, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.480', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'ARMOR': '0.028', 'AMMO4': '0.098', 'weapon4': '0.106', 'AMMO3': '0.109', 'HITCOUNT': '0.110', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.650', 'weapon3': '1.426', 'weapon2': '1.682', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:13,259][2409104] DAMAGECOUNT value on done: 165.0
[2023-02-25 12:31:13,453][2409102] DAMAGECOUNT value on done: 380.0
[2023-02-25 12:31:13,457][2409102] Sum rewards: -1.533, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.156', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.136', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.372', 'ARMOR': '0.500', 'DAMAGECOUNT': '0.705', 'WEAPON3': '0.750', 'weapon3': '1.346', 'weapon2': '1.520', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:13,496][2409074] Updated weights for policy 0, policy_version 4500 (0.0012)
[2023-02-25 12:31:13,549][2409597] DAMAGECOUNT value on done: 303.0
[2023-02-25 12:31:13,688][2409866] DAMAGECOUNT value on done: 325.0
[2023-02-25 12:31:13,692][2409866] Sum rewards: -3.366, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.677', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'AMMO3': '0.083', 'WEAPON5': '0.100', 'HITCOUNT': '0.130', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon2': '1.482', 'weapon3': '1.782'}
[2023-02-25 12:31:13,710][2409355] DAMAGECOUNT value on done: 207.0
[2023-02-25 12:31:13,711][2409355] Sum rewards: -2.896, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.518', 'AMMO2': '0.018', 'AMMO4': '0.088', 'HITCOUNT': '0.090', 'AMMO3': '0.112', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.291', 'weapon4': '0.414', 'ARMOR': '0.469', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.064', 'weapon3': '1.626'}
[2023-02-25 12:31:13,852][2409405] DAMAGECOUNT value on done: 345.0
[2023-02-25 12:31:13,853][2409405] Sum rewards: -6.741, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.901', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.028', 'ARMOR': '0.080', 'AMMO3': '0.100', 'AMMO4': '0.140', 'HITCOUNT': '0.150', 'weapon4': '0.162', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.456', 'WEAPON3': '0.650', 'weapon2': '1.444', 'weapon3': '1.730'}
[2023-02-25 12:31:14,097][2409078] DAMAGECOUNT value on done: 329.0
[2023-02-25 12:31:14,104][2409103] DAMAGECOUNT value on done: 584.0
[2023-02-25 12:31:14,104][2409103] Sum rewards: -4.153, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.828', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.079', 'weapon5': '0.080', 'HITCOUNT': '0.100', 'AMMO3': '0.131', 'WEAPON4': '0.200', 'weapon4': '0.284', 'DAMAGECOUNT': '0.675', 'WEAPON3': '0.800', 'weapon2': '1.202', 'FRAGCOUNT': '1.500', 'weapon3': '1.546'}
[2023-02-25 12:31:14,309][2409547] DAMAGECOUNT value on done: 150.0
[2023-02-25 12:31:14,329][2409547] Sum rewards: -6.711, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.672', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.033', 'HITCOUNT': '0.050', 'weapon5': '0.090', 'weapon4': '0.112', 'AMMO3': '0.113', 'DAMAGECOUNT': '0.156', 'AMMO4': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.451', 'WEAPON3': '0.650', 'weapon3': '1.366', 'weapon2': '1.554'}
[2023-02-25 12:31:14,355][2409565] DAMAGECOUNT value on done: 466.0
[2023-02-25 12:31:14,356][2409565] Sum rewards: 2.179, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.620', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.026', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.080', 'weapon7': '0.080', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.208', 'HITCOUNT': '0.210', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.080', 'weapon2': '1.202', 'weapon3': '1.664', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:31:14,466][2409096] DAMAGECOUNT value on done: 227.0
[2023-02-25 12:31:14,469][2409096] Sum rewards: -3.718, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.580', 'AMMO2': '0.022', 'ARMOR': '0.060', 'weapon7': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'AMMO4': '0.109', 'HITCOUNT': '0.120', 'weapon4': '0.190', 'DAMAGECOUNT': '0.276', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.532', 'weapon2': '1.550'}
[2023-02-25 12:31:14,561][2409469] DAMAGECOUNT value on done: 115.0
[2023-02-25 12:31:14,566][2409469] Sum rewards: -3.487, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.820', 'AMMO5': '0.007', 'AMMO2': '0.013', 'HITCOUNT': '0.030', 'AMMO4': '0.063', 'weapon5': '0.072', 'AMMO3': '0.083', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.255', 'weapon4': '0.276', 'WEAPON3': '0.450', 'ARMOR': '0.854', 'FRAGCOUNT': '1.000', 'weapon3': '1.146', 'weapon2': '1.684'}
[2023-02-25 12:31:14,733][2409074] Updated weights for policy 0, policy_version 4510 (0.0012)
[2023-02-25 12:31:15,276][2409596] DAMAGECOUNT value on done: 335.0
[2023-02-25 12:31:15,840][2409101] DAMAGECOUNT value on done: 351.0
[2023-02-25 12:31:15,841][2409101] Sum rewards: -1.756, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.256', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO3': '0.139', 'HITCOUNT': '0.190', 'DAMAGECOUNT': '0.408', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.458', 'weapon3': '1.702'}
[2023-02-25 12:31:15,947][2409485] DAMAGECOUNT value on done: 245.0
[2023-02-25 12:31:15,948][2409485] Sum rewards: -2.104, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.520', 'AMMO2': '0.016', 'weapon4': '0.044', 'AMMO4': '0.080', 'AMMO3': '0.083', 'HITCOUNT': '0.110', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.405', 'ARMOR': '0.471', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.242', 'weapon2': '2.064'}
[2023-02-25 12:31:16,052][2409389] DAMAGECOUNT value on done: 354.0
[2023-02-25 12:31:16,067][2409406] DAMAGECOUNT value on done: 347.0
[2023-02-25 12:31:16,072][2409406] Sum rewards: 0.121, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.340', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO3': '0.061', 'AMMO4': '0.080', 'HITCOUNT': '0.090', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.246', 'WEAPON3': '0.450', 'weapon3': '1.634', 'weapon2': '1.702', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:16,106][2409100] DAMAGECOUNT value on done: 433.0
[2023-02-25 12:31:16,127][2409075] DAMAGECOUNT value on done: 605.0
[2023-02-25 12:31:16,128][2409075] Sum rewards: -0.533, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.610', 'AMMO5': '0.003', 'AMMO2': '0.018', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.091', 'AMMO3': '0.114', 'HITCOUNT': '0.120', 'WEAPON4': '0.200', 'weapon4': '0.308', 'DAMAGECOUNT': '0.585', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.000', 'weapon3': '1.898'}
[2023-02-25 12:31:16,136][2409548] DAMAGECOUNT value on done: 397.0
[2023-02-25 12:31:16,136][2409548] Sum rewards: -1.502, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.339', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon5': '0.042', 'AMMO3': '0.070', 'weapon7': '0.074', 'AMMO4': '0.089', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.206', 'WEAPON3': '0.500', 'ARMOR': '0.507', 'DAMAGECOUNT': '0.771', 'weapon2': '1.216', 'weapon3': '1.246'}
[2023-02-25 12:31:16,171][2409486] DAMAGECOUNT value on done: 432.0
[2023-02-25 12:31:16,172][2409486] Sum rewards: -4.901, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.956', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON4': '0.100', 'weapon4': '0.124', 'AMMO3': '0.149', 'HITCOUNT': '0.260', 'DAMAGECOUNT': '0.771', 'WEAPON3': '0.800', 'ARMOR': '0.923', 'FRAGCOUNT': '1.000', 'weapon3': '1.084', 'weapon2': '2.306'}
[2023-02-25 12:31:16,219][2409099] DAMAGECOUNT value on done: 470.0
[2023-02-25 12:31:16,220][2409099] Sum rewards: -2.884, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.082', 'AMMO2': '0.025', 'ARMOR': '0.036', 'AMMO3': '0.076', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'HITCOUNT': '0.150', 'WEAPON3': '0.450', 'weapon4': '0.508', 'DAMAGECOUNT': '0.552', 'weapon3': '0.692', 'FRAGCOUNT': '1.000', 'weapon2': '1.682'}
[2023-02-25 12:31:16,253][2409080] DAMAGECOUNT value on done: 482.0
[2023-02-25 12:31:16,254][2409080] Sum rewards: 0.964, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.110', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'ARMOR': '0.020', 'AMMO4': '0.027', 'AMMO3': '0.063', 'HITCOUNT': '0.100', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.400', 'FRAGCOUNT': '1.000', 'weapon3': '1.302', 'weapon2': '1.522'}
[2023-02-25 12:31:16,305][2409105] DAMAGECOUNT value on done: 332.0
[2023-02-25 12:31:16,580][2409077] DAMAGECOUNT value on done: 454.0
[2023-02-25 12:31:16,585][2409077] Sum rewards: 1.648, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.300', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'HITCOUNT': '0.200', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.837', 'weapon2': '0.896', 'weapon3': '2.328', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:31:16,660][2409076] DAMAGECOUNT value on done: 346.0
[2023-02-25 12:31:16,775][2409074] Updated weights for policy 0, policy_version 4520 (0.0013)
[2023-02-25 12:31:16,952][2409373] DAMAGECOUNT value on done: 395.0
[2023-02-25 12:31:16,996][2409104] DAMAGECOUNT value on done: 437.0
[2023-02-25 12:31:16,997][2409104] Sum rewards: -5.685, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.420', 'FRAGCOUNT': '-1.000', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.008', 'weapon5': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.139', 'HITCOUNT': '0.160', 'weapon4': '0.198', 'ARMOR': '0.410', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.945', 'weapon2': '1.072', 'weapon3': '1.772'}
[2023-02-25 12:31:17,093][2409468] DAMAGECOUNT value on done: 206.0
[2023-02-25 12:31:17,099][2409468] Sum rewards: -2.328, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.919', 'AMMO2': '0.012', 'AMMO4': '0.062', 'ARMOR': '0.064', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'weapon4': '0.178', 'DAMAGECOUNT': '0.258', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.168', 'weapon3': '1.648'}
[2023-02-25 12:31:17,110][2409102] DAMAGECOUNT value on done: 277.0
[2023-02-25 12:31:17,115][2409097] DAMAGECOUNT value on done: 294.0
[2023-02-25 12:31:17,115][2409097] Sum rewards: 0.556, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.992', 'AMMO2': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'AMMO3': '0.069', 'HITCOUNT': '0.130', 'weapon5': '0.132', 'weapon4': '0.206', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.426', 'WEAPON3': '0.500', 'ARMOR': '0.506', 'FRAGCOUNT': '1.000', 'weapon3': '1.222', 'weapon2': '1.438'}
[2023-02-25 12:31:17,186][2408954] Fps is (10 sec: 24576.2, 60 sec: 25531.7, 300 sec: 25811.7). Total num frames: 18530304. Throughput: 0: 6373.1. Samples: 4639428. Policy #0 lag: (min: 2.0, avg: 15.8, max: 28.0)
[2023-02-25 12:31:17,186][2408954] Avg episode reward: [(0, '-2.515')]
[2023-02-25 12:31:17,191][2409033] Saving new best policy, reward=-2.515!
[2023-02-25 12:31:17,246][2409597] DAMAGECOUNT value on done: 362.0
[2023-02-25 12:31:17,246][2409597] Sum rewards: -3.237, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.297', 'weapon4': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.012', 'ARMOR': '0.040', 'AMMO4': '0.058', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.165', 'HITCOUNT': '0.250', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.005', 'weapon2': '1.154', 'FRAGCOUNT': '2.000', 'weapon3': '2.060'}
[2023-02-25 12:31:17,255][2409079] DAMAGECOUNT value on done: 515.0
[2023-02-25 12:31:17,257][2409079] Sum rewards: -2.457, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.165', 'AMMO2': '0.023', 'AMMO3': '0.075', 'ARMOR': '0.090', 'AMMO4': '0.117', 'HITCOUNT': '0.210', 'WEAPON4': '0.250', 'weapon4': '0.488', 'WEAPON3': '0.500', 'weapon3': '0.926', 'DAMAGECOUNT': '0.945', 'weapon2': '1.334', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:17,259][2409407] DAMAGECOUNT value on done: 215.0
[2023-02-25 12:31:17,409][2409549] DAMAGECOUNT value on done: 391.0
[2023-02-25 12:31:17,410][2409549] Sum rewards: -2.522, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.619', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'weapon4': '0.022', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'AMMO3': '0.143', 'HITCOUNT': '0.210', 'DAMAGECOUNT': '0.648', 'WEAPON3': '0.850', 'weapon2': '1.086', 'FRAGCOUNT': '2.000', 'weapon3': '2.040'}
[2023-02-25 12:31:17,627][2409866] DAMAGECOUNT value on done: 417.0
[2023-02-25 12:31:17,631][2409866] Sum rewards: -5.248, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.564', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'ARMOR': '0.052', 'weapon4': '0.088', 'AMMO4': '0.098', 'AMMO3': '0.122', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.762', 'weapon2': '1.682', 'weapon3': '1.692', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:17,650][2409355] DAMAGECOUNT value on done: 429.0
[2023-02-25 12:31:17,653][2409355] Sum rewards: -0.212, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.860', 'AMMO2': '0.008', 'ARMOR': '0.032', 'AMMO4': '0.042', 'weapon7': '0.072', 'AMMO3': '0.075', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.236', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.561', 'FRAGCOUNT': '1.000', 'weapon3': '1.174', 'weapon2': '1.478'}
[2023-02-25 12:31:17,977][2409074] Updated weights for policy 0, policy_version 4530 (0.0012)
[2023-02-25 12:31:18,017][2409565] DAMAGECOUNT value on done: 192.0
[2023-02-25 12:31:18,018][2409565] Sum rewards: -3.820, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.463', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'HITCOUNT': '0.030', 'AMMO4': '0.035', 'AMMO3': '0.106', 'DAMAGECOUNT': '0.117', 'ARMOR': '0.432', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.706', 'weapon3': '1.750'}
[2023-02-25 12:31:18,076][2409096] DAMAGECOUNT value on done: 200.0
[2023-02-25 12:31:18,077][2409096] Sum rewards: -2.524, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.111', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO3': '0.083', 'AMMO4': '0.086', 'HITCOUNT': '0.090', 'WEAPON4': '0.150', 'weapon4': '0.324', 'DAMAGECOUNT': '0.360', 'ARMOR': '0.436', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon2': '1.518', 'weapon3': '1.518'}
[2023-02-25 12:31:18,078][2409405] DAMAGECOUNT value on done: 431.0
[2023-02-25 12:31:18,078][2409405] Sum rewards: -4.809, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.591', 'AMMO5': '0.006', 'AMMO2': '0.016', 'ARMOR': '0.028', 'weapon4': '0.032', 'weapon5': '0.052', 'AMMO4': '0.079', 'AMMO3': '0.084', 'WEAPON5': '0.150', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.573', 'weapon2': '1.296', 'weapon3': '1.586'}
[2023-02-25 12:31:18,152][2409469] DAMAGECOUNT value on done: 375.0
[2023-02-25 12:31:18,168][2409103] DAMAGECOUNT value on done: 400.0
[2023-02-25 12:31:18,173][2409103] Sum rewards: -1.428, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.338', 'AMMO2': '0.036', 'ARMOR': '0.068', 'AMMO3': '0.104', 'AMMO4': '0.178', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'WEAPON3': '0.600', 'weapon4': '0.622', 'DAMAGECOUNT': '0.690', 'FRAGCOUNT': '1.000', 'weapon3': '1.150', 'weapon2': '1.552'}
[2023-02-25 12:31:18,326][2409078] DAMAGECOUNT value on done: 305.0
[2023-02-25 12:31:18,329][2409078] Sum rewards: -3.714, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.750', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.007', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'ARMOR': '0.020', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'HITCOUNT': '0.060', 'AMMO3': '0.116', 'weapon5': '0.138', 'WEAPON5': '0.200', 'weapon4': '0.202', 'DAMAGECOUNT': '0.240', 'WEAPON3': '0.650', 'weapon2': '1.228', 'weapon3': '1.322'}
[2023-02-25 12:31:18,460][2409547] DAMAGECOUNT value on done: 180.0
[2023-02-25 12:31:18,461][2409547] Sum rewards: -3.102, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.101', 'weapon5': '0.002', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.011', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'weapon4': '0.164', 'DAMAGECOUNT': '0.366', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.294', 'weapon3': '1.654'}
[2023-02-25 12:31:18,857][2409596] DAMAGECOUNT value on done: 444.0
[2023-02-25 12:31:19,297][2409101] DAMAGECOUNT value on done: 265.0
[2023-02-25 12:31:19,298][2409101] Sum rewards: -3.756, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.218', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.010', 'AMMO4': '0.045', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'ARMOR': '0.084', 'HITCOUNT': '0.210', 'WEAPON4': '0.250', 'weapon4': '0.334', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.705', 'weapon3': '1.356', 'weapon2': '1.576', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:19,662][2409389] DAMAGECOUNT value on done: 558.0
[2023-02-25 12:31:19,666][2409389] Sum rewards: -1.288, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.138', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'AMMO3': '0.100', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'HITCOUNT': '0.240', 'weapon4': '0.378', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.065', 'weapon2': '1.176', 'weapon3': '1.546'}
[2023-02-25 12:31:19,764][2409075] DAMAGECOUNT value on done: 260.0
[2023-02-25 12:31:19,928][2409485] DAMAGECOUNT value on done: 190.0
[2023-02-25 12:31:19,929][2409485] Sum rewards: -0.110, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.350', 'AMMO2': '0.006', 'AMMO4': '0.032', 'ARMOR': '0.080', 'AMMO3': '0.084', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.186', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.474', 'weapon2': '1.728'}
[2023-02-25 12:31:19,949][2409100] DAMAGECOUNT value on done: 304.0
[2023-02-25 12:31:19,952][2409100] Sum rewards: -6.787, reward structure: {'DEATHCOUNT': '-11.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.360', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'HITCOUNT': '0.060', 'AMMO4': '0.088', 'AMMO3': '0.098', 'weapon4': '0.132', 'DAMAGECOUNT': '0.192', 'WEAPON3': '0.550', 'weapon3': '1.054', 'ARMOR': '1.729', 'weapon2': '2.294'}
[2023-02-25 12:31:20,010][2409548] DAMAGECOUNT value on done: 412.0
[2023-02-25 12:31:20,013][2409548] Sum rewards: -0.715, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.414', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.030', 'WEAPON5': '0.050', 'weapon7': '0.052', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.104', 'AMMO4': '0.126', 'HITCOUNT': '0.190', 'WEAPON4': '0.300', 'weapon4': '0.468', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.107', 'weapon2': '1.128', 'weapon3': '1.466', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:31:20,050][2409080] DAMAGECOUNT value on done: 385.0
[2023-02-25 12:31:20,052][2409080] Sum rewards: -1.446, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.088', 'AMMO2': '0.011', 'weapon4': '0.028', 'ARMOR': '0.048', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'HITCOUNT': '0.270', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.975', 'weapon3': '1.506', 'weapon2': '1.840', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:31:20,086][2409486] DAMAGECOUNT value on done: 205.0
[2023-02-25 12:31:20,146][2409099] DAMAGECOUNT value on done: 447.0
[2023-02-25 12:31:20,147][2409099] Sum rewards: -0.080, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.695', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'weapon4': '0.270', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.699', 'FRAGCOUNT': '1.000', 'weapon3': '1.504', 'weapon2': '1.590'}
[2023-02-25 12:31:20,153][2409406] DAMAGECOUNT value on done: 318.0
[2023-02-25 12:31:20,156][2409406] Sum rewards: -4.312, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.765', 'AMMO2': '0.005', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'ARMOR': '0.080', 'AMMO3': '0.174', 'weapon4': '0.210', 'HITCOUNT': '0.220', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.950', 'weapon3': '1.210', 'weapon2': '1.872', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:20,211][2409074] Updated weights for policy 0, policy_version 4540 (0.0012)
[2023-02-25 12:31:20,263][2409105] DAMAGECOUNT value on done: 267.0
[2023-02-25 12:31:20,264][2409105] Sum rewards: 0.115, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.442', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'weapon5': '0.022', 'WEAPON5': '0.050', 'AMMO3': '0.055', 'AMMO4': '0.057', 'HITCOUNT': '0.090', 'DAMAGECOUNT': '0.261', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'weapon3': '1.110', 'FRAGCOUNT': '1.500', 'weapon2': '1.926'}
[2023-02-25 12:31:20,581][2409104] DAMAGECOUNT value on done: 550.0
[2023-02-25 12:31:20,582][2409104] Sum rewards: -2.549, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.902', 'AMMO2': '0.012', 'AMMO5': '0.018', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'AMMO4': '0.060', 'weapon5': '0.086', 'weapon4': '0.108', 'AMMO3': '0.147', 'HITCOUNT': '0.170', 'WEAPON5': '0.200', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.900', 'weapon2': '1.078', 'weapon3': '1.438', 'FRAGCOUNT': '1.500'}
[2023-02-25 12:31:20,607][2409076] DAMAGECOUNT value on done: 484.0
[2023-02-25 12:31:20,608][2409076] Sum rewards: -3.849, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.622', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.135', 'AMMO3': '0.162', 'HITCOUNT': '0.210', 'weapon4': '0.240', 'WEAPON4': '0.250', 'WEAPON3': '0.850', 'ARMOR': '0.875', 'DAMAGECOUNT': '1.035', 'weapon2': '1.412', 'weapon3': '1.460', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:31:20,626][2409102] DAMAGECOUNT value on done: 520.0
[2023-02-25 12:31:20,629][2409102] Sum rewards: -7.409, reward structure: {'DEATHCOUNT': '-10.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.090', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.174', 'HITCOUNT': '0.260', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.906', 'weapon3': '1.624', 'weapon2': '1.700'}
[2023-02-25 12:31:20,722][2409077] DAMAGECOUNT value on done: 821.0
[2023-02-25 12:31:20,723][2409077] Sum rewards: -0.107, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.310', 'AMMO2': '0.013', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.048', 'AMMO4': '0.064', 'weapon5': '0.124', 'WEAPON4': '0.150', 'HITCOUNT': '0.200', 'weapon4': '0.222', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'ARMOR': '0.498', 'weapon3': '0.822', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.524', 'weapon2': '1.952'}
[2023-02-25 12:31:20,845][2409468] DAMAGECOUNT value on done: 569.0
[2023-02-25 12:31:20,848][2409468] Sum rewards: -1.558, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.641', 'AMMO2': '0.023', 'ARMOR': '0.079', 'AMMO3': '0.090', 'AMMO4': '0.113', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'weapon4': '0.426', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.750', 'weapon2': '0.994', 'FRAGCOUNT': '1.000', 'weapon3': '1.448'}
[2023-02-25 12:31:20,862][2409373] DAMAGECOUNT value on done: 187.0
[2023-02-25 12:31:20,864][2409373] Sum rewards: -1.897, reward structure: {'DEATHCOUNT': '-4.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.198', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.011', 'AMMO3': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.225', 'WEAPON3': '0.350', 'weapon4': '0.388', 'ARMOR': '0.472', 'weapon3': '1.132', 'weapon2': '1.372'}
[2023-02-25 12:31:20,874][2409407] DAMAGECOUNT value on done: 74.0
[2023-02-25 12:31:20,877][2409407] Sum rewards: -7.210, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.851', 'AMMO2': '0.017', 'HITCOUNT': '0.050', 'AMMO4': '0.083', 'DAMAGECOUNT': '0.135', 'AMMO3': '0.156', 'weapon4': '0.242', 'WEAPON4': '0.350', 'weapon3': '0.718', 'WEAPON3': '0.750', 'ARMOR': '0.986', 'FRAGCOUNT': '1.000', 'weapon2': '2.404'}
[2023-02-25 12:31:20,903][2409079] DAMAGECOUNT value on done: 269.0
[2023-02-25 12:31:20,932][2409097] DAMAGECOUNT value on done: 450.0
[2023-02-25 12:31:20,932][2409097] Sum rewards: -0.207, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.254', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.013', 'weapon5': '0.026', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.170', 'weapon4': '0.262', 'ARMOR': '0.495', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.735', 'weapon2': '1.446', 'FRAGCOUNT': '1.500', 'weapon3': '1.528'}
[2023-02-25 12:31:21,026][2409549] DAMAGECOUNT value on done: 302.0
[2023-02-25 12:31:21,027][2409549] Sum rewards: -6.592, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.620', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'HITCOUNT': '0.090', 'AMMO3': '0.112', 'weapon5': '0.120', 'WEAPON4': '0.150', 'AMMO4': '0.155', 'weapon4': '0.166', 'DAMAGECOUNT': '0.180', 'ARMOR': '0.428', 'WEAPON3': '0.600', 'weapon3': '1.398', 'weapon2': '1.782'}
[2023-02-25 12:31:21,304][2409866] DAMAGECOUNT value on done: 460.0
[2023-02-25 12:31:21,305][2409866] Sum rewards: -1.190, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.620', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'ARMOR': '0.032', 'HITCOUNT': '0.100', 'AMMO3': '0.128', 'weapon5': '0.148', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.666', 'WEAPON3': '0.800', 'weapon2': '1.402', 'weapon3': '1.636', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:21,323][2409355] DAMAGECOUNT value on done: 630.0
[2023-02-25 12:31:21,324][2409355] Sum rewards: -3.493, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.985', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.016', 'ARMOR': '0.044', 'AMMO4': '0.051', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'HITCOUNT': '0.200', 'WEAPON3': '0.900', 'DAMAGECOUNT': '0.915', 'weapon2': '1.566', 'weapon3': '1.666', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:21,344][2409074] Updated weights for policy 0, policy_version 4550 (0.0012)
[2023-02-25 12:31:21,596][2409405] DAMAGECOUNT value on done: 705.0
[2023-02-25 12:31:21,597][2409405] Sum rewards: -1.492, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.330', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'ARMOR': '0.065', 'weapon4': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.115', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.064', 'weapon3': '1.948'}
[2023-02-25 12:31:21,605][2409565] DAMAGECOUNT value on done: 147.0
[2023-02-25 12:31:21,606][2409565] Sum rewards: -3.760, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.450', 'AMMO5': '0.004', 'AMMO2': '0.004', 'weapon5': '0.014', 'AMMO4': '0.021', 'ARMOR': '0.036', 'HITCOUNT': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'DAMAGECOUNT': '0.276', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.600', 'weapon2': '1.684', 'weapon3': '1.798'}
[2023-02-25 12:31:21,608][2409597] DAMAGECOUNT value on done: 394.0
[2023-02-25 12:31:21,741][2409103] DAMAGECOUNT value on done: 157.0
[2023-02-25 12:31:21,889][2409078] DAMAGECOUNT value on done: 249.0
[2023-02-25 12:31:21,892][2409078] Sum rewards: -7.698, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.564', 'AMMO2': '0.002', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.007', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'HITCOUNT': '0.130', 'weapon4': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'DAMAGECOUNT': '0.447', 'ARMOR': '0.474', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.050', 'weapon3': '1.516', 'weapon2': '1.612'}
[2023-02-25 12:31:21,948][2409096] DAMAGECOUNT value on done: 270.0
[2023-02-25 12:31:21,951][2409096] Sum rewards: -3.980, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.174', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'weapon5': '0.020', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon4': '0.064', 'HITCOUNT': '0.070', 'weapon7': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'AMMO4': '0.121', 'DAMAGECOUNT': '0.225', 'ARMOR': '0.436', 'WEAPON3': '0.650', 'weapon3': '1.262', 'weapon2': '1.672'}
[2023-02-25 12:31:22,038][2409469] DAMAGECOUNT value on done: 318.0
[2023-02-25 12:31:22,040][2409469] Sum rewards: 1.953, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'weapon5': '0.062', 'AMMO3': '0.064', 'WEAPON5': '0.100', 'ARMOR': '0.117', 'HITCOUNT': '0.140', 'HEALTH': '0.180', 'weapon4': '0.254', 'WEAPON3': '0.400', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.909', 'weapon2': '1.308', 'weapon3': '1.544'}
[2023-02-25 12:31:22,186][2408954] Fps is (10 sec: 27033.5, 60 sec: 25463.5, 300 sec: 25839.5). Total num frames: 18665472. Throughput: 0: 6372.3. Samples: 4658424. Policy #0 lag: (min: 1.0, avg: 15.7, max: 27.0)
[2023-02-25 12:31:22,186][2408954] Avg episode reward: [(0, '-2.721')]
[2023-02-25 12:31:22,225][2409547] DAMAGECOUNT value on done: 151.0
[2023-02-25 12:31:22,226][2409547] Sum rewards: 1.659, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.156', 'AMMO5': '0.003', 'AMMO2': '0.013', 'AMMO3': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'weapon5': '0.070', 'HITCOUNT': '0.080', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.228', 'WEAPON3': '0.250', 'weapon4': '0.400', 'ARMOR': '0.544', 'weapon3': '0.692', 'FRAGCOUNT': '1.000', 'weapon2': '1.280'}
[2023-02-25 12:31:22,359][2409596] DAMAGECOUNT value on done: 345.0
[2023-02-25 12:31:22,474][2409074] Updated weights for policy 0, policy_version 4560 (0.0014)
[2023-02-25 12:31:22,998][2409101] DAMAGECOUNT value on done: 709.0
[2023-02-25 12:31:22,999][2409101] Sum rewards: 2.642, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'weapon5': '0.072', 'AMMO4': '0.091', 'AMMO3': '0.102', 'WEAPON5': '0.150', 'HITCOUNT': '0.260', 'weapon4': '0.268', 'HEALTH': '0.298', 'WEAPON3': '0.500', 'weapon2': '1.172', 'weapon3': '1.430', 'DAMAGECOUNT': '1.470', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:31:23,413][2409100] DAMAGECOUNT value on done: 240.0
[2023-02-25 12:31:23,414][2409100] Sum rewards: 0.130, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.828', 'AMMO2': '0.009', 'AMMO4': '0.046', 'ARMOR': '0.087', 'AMMO3': '0.092', 'HITCOUNT': '0.110', 'WEAPON4': '0.200', 'weapon4': '0.264', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.550', 'weapon3': '1.130', 'weapon2': '1.344', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:23,474][2409485] DAMAGECOUNT value on done: 435.0
[2023-02-25 12:31:23,475][2409485] Sum rewards: -4.075, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.945', 'AMMO5': '0.003', 'AMMO2': '0.008', 'ARMOR': '0.024', 'WEAPON1': '0.030', 'weapon4': '0.032', 'AMMO4': '0.042', 'WEAPON5': '0.050', 'weapon5': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.163', 'HITCOUNT': '0.250', 'DAMAGECOUNT': '0.870', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '1.470', 'weapon3': '1.756'}
[2023-02-25 12:31:23,510][2409548] DAMAGECOUNT value on done: 536.0
[2023-02-25 12:31:23,511][2409548] Sum rewards: -2.510, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.354', 'AMMO5': '0.006', 'AMMO2': '0.008', 'weapon4': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.038', 'ARMOR': '0.040', 'weapon5': '0.046', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.162', 'HITCOUNT': '0.250', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.008', 'weapon2': '1.072', 'FRAGCOUNT': '2.000', 'weapon3': '2.134'}
[2023-02-25 12:31:23,579][2409389] DAMAGECOUNT value on done: 336.0
[2023-02-25 12:31:23,701][2409075] DAMAGECOUNT value on done: 328.0
[2023-02-25 12:31:23,704][2409075] Sum rewards: 0.664, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.461', 'AMMO2': '0.018', 'weapon4': '0.062', 'AMMO3': '0.081', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'HITCOUNT': '0.200', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.849', 'weapon2': '1.498', 'weapon3': '1.678', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:23,768][2409406] DAMAGECOUNT value on done: 445.0
[2023-02-25 12:31:23,930][2409486] DAMAGECOUNT value on done: 191.0
[2023-02-25 12:31:23,989][2409080] DAMAGECOUNT value on done: 346.0
[2023-02-25 12:31:24,020][2409099] DAMAGECOUNT value on done: 548.0
[2023-02-25 12:31:24,022][2409099] Sum rewards: -0.516, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.812', 'AMMO5': '0.005', 'AMMO2': '0.010', 'ARMOR': '0.044', 'AMMO4': '0.051', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'HITCOUNT': '0.180', 'weapon4': '0.276', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.738', 'weapon3': '1.412', 'weapon2': '1.534', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:24,142][2409102] DAMAGECOUNT value on done: 320.0
[2023-02-25 12:31:24,145][2409102] Sum rewards: -7.288, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.400', 'AMMO2': '0.026', 'HITCOUNT': '0.090', 'AMMO4': '0.131', 'AMMO3': '0.147', 'weapon4': '0.192', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.330', 'ARMOR': '0.436', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.318', 'weapon3': '1.592'}
[2023-02-25 12:31:24,325][2409077] DAMAGECOUNT value on done: 412.0
[2023-02-25 12:31:24,326][2409077] Sum rewards: -3.887, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.710', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'AMMO4': '0.068', 'weapon5': '0.078', 'AMMO3': '0.147', 'HITCOUNT': '0.190', 'DAMAGECOUNT': '0.690', 'WEAPON3': '0.800', 'weapon3': '1.432', 'weapon2': '1.792', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:24,360][2409104] DAMAGECOUNT value on done: 415.0
[2023-02-25 12:31:24,364][2409104] Sum rewards: 0.998, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.287', 'AMMO2': '0.008', 'AMMO4': '0.040', 'ARMOR': '0.052', 'AMMO3': '0.094', 'WEAPON4': '0.150', 'weapon4': '0.156', 'HITCOUNT': '0.300', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.110', 'weapon2': '1.276', 'weapon3': '1.948', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:31:24,366][2409076] DAMAGECOUNT value on done: 292.0
[2023-02-25 12:31:24,370][2409076] Sum rewards: -1.030, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.144', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO3': '0.052', 'AMMO4': '0.068', 'HITCOUNT': '0.190', 'WEAPON4': '0.250', 'weapon4': '0.344', 'WEAPON3': '0.400', 'ARMOR': '0.424', 'DAMAGECOUNT': '0.558', 'FRAGCOUNT': '1.000', 'weapon3': '1.100', 'weapon2': '1.694'}
[2023-02-25 12:31:24,586][2409549] DAMAGECOUNT value on done: 205.0
[2023-02-25 12:31:24,591][2409549] Sum rewards: -1.572, reward structure: {'DEATHCOUNT': '-4.500', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.037', 'WEAPON5': '0.050', 'HITCOUNT': '0.060', 'AMMO3': '0.087', 'ARMOR': '0.087', 'WEAPON4': '0.100', 'weapon4': '0.104', 'HEALTH': '0.260', 'DAMAGECOUNT': '0.285', 'WEAPON3': '0.400', 'weapon3': '1.398', 'weapon2': '1.534'}
[2023-02-25 12:31:24,602][2409105] DAMAGECOUNT value on done: 541.0
[2023-02-25 12:31:24,606][2409105] Sum rewards: 1.761, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.560', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO3': '0.097', 'HITCOUNT': '0.160', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.876', 'weapon2': '0.978', 'FRAGCOUNT': '2.000', 'weapon3': '2.036'}
[2023-02-25 12:31:24,617][2409373] DAMAGECOUNT value on done: 650.0
[2023-02-25 12:31:24,621][2409373] Sum rewards: -2.520, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.810', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.138', 'weapon4': '0.242', 'HITCOUNT': '0.280', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.750', 'weapon2': '1.260', 'DAMAGECOUNT': '1.452', 'weapon3': '1.632'}
[2023-02-25 12:31:24,645][2409074] Updated weights for policy 0, policy_version 4570 (0.0013)
[2023-02-25 12:31:24,696][2409407] DAMAGECOUNT value on done: 366.0
[2023-02-25 12:31:24,757][2409079] DAMAGECOUNT value on done: 351.0
[2023-02-25 12:31:24,758][2409079] Sum rewards: 0.493, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.354', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'AMMO3': '0.100', 'weapon4': '0.108', 'HITCOUNT': '0.230', 'ARMOR': '0.408', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.738', 'weapon2': '1.362', 'weapon3': '1.396', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:31:24,779][2409468] DAMAGECOUNT value on done: 264.0
[2023-02-25 12:31:24,782][2409468] Sum rewards: -1.111, reward structure: {'DEATHCOUNT': '-3.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.103', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.062', 'HITCOUNT': '0.080', 'WEAPON5': '0.100', 'weapon5': '0.120', 'weapon4': '0.224', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.400', 'ARMOR': '0.496', 'weapon2': '1.032', 'weapon3': '1.264'}
[2023-02-25 12:31:24,939][2409097] DAMAGECOUNT value on done: 465.0
[2023-02-25 12:31:24,943][2409097] Sum rewards: -3.233, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.465', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'HITCOUNT': '0.160', 'DAMAGECOUNT': '0.705', 'ARMOR': '0.884', 'WEAPON3': '0.900', 'weapon3': '1.552', 'weapon2': '1.594', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:25,116][2409565] DAMAGECOUNT value on done: 270.0
[2023-02-25 12:31:25,120][2409565] Sum rewards: -4.908, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.900', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'AMMO5': '0.004', 'ARMOR': '0.020', 'WEAPON1': '0.020', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'HITCOUNT': '0.160', 'weapon4': '0.184', 'DAMAGECOUNT': '0.528', 'WEAPON3': '0.700', 'weapon2': '1.496', 'weapon3': '1.584'}
[2023-02-25 12:31:25,220][2409866] DAMAGECOUNT value on done: 295.0
[2023-02-25 12:31:25,221][2409866] Sum rewards: -4.653, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.193', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'WEAPON5': '0.050', 'AMMO3': '0.124', 'HITCOUNT': '0.140', 'ARMOR': '0.478', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.624', 'weapon2': '1.656'}
[2023-02-25 12:31:25,242][2409103] DAMAGECOUNT value on done: 325.0
[2023-02-25 12:31:25,243][2409103] Sum rewards: -3.443, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.276', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'ARMOR': '0.020', 'AMMO4': '0.042', 'weapon4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'HITCOUNT': '0.140', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.252', 'weapon3': '2.016'}
[2023-02-25 12:31:25,249][2409355] DAMAGECOUNT value on done: 335.0
[2023-02-25 12:31:25,250][2409355] Sum rewards: -4.779, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.390', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.031', 'AMMO3': '0.102', 'HITCOUNT': '0.140', 'WEAPON4': '0.300', 'weapon4': '0.382', 'ARMOR': '0.410', 'DAMAGECOUNT': '0.540', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.176', 'weapon3': '1.614'}
[2023-02-25 12:31:25,434][2409597] DAMAGECOUNT value on done: 465.0
[2023-02-25 12:31:25,439][2409597] Sum rewards: -3.721, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.448', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'ARMOR': '0.028', 'AMMO4': '0.075', 'HITCOUNT': '0.110', 'AMMO3': '0.111', 'WEAPON4': '0.250', 'weapon4': '0.304', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.336', 'weapon2': '1.678'}
[2023-02-25 12:31:25,658][2409405] DAMAGECOUNT value on done: 447.0
[2023-02-25 12:31:25,661][2409405] Sum rewards: -0.049, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.436', 'AMMO5': '0.006', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'weapon5': '0.034', 'HITCOUNT': '0.040', 'AMMO4': '0.065', 'ARMOR': '0.072', 'AMMO3': '0.080', 'weapon4': '0.098', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.372', 'WEAPON3': '0.400', 'FRAGCOUNT': '1.000', 'weapon3': '1.484', 'weapon2': '1.602'}
[2023-02-25 12:31:25,800][2409074] Updated weights for policy 0, policy_version 4580 (0.0012)
[2023-02-25 12:31:25,994][2409078] DAMAGECOUNT value on done: 325.0
[2023-02-25 12:31:26,132][2409547] DAMAGECOUNT value on done: 280.0
[2023-02-25 12:31:26,133][2409547] Sum rewards: -1.808, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.305', 'AMMO2': '0.016', 'ARMOR': '0.020', 'AMMO4': '0.079', 'AMMO3': '0.141', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.230', 'DAMAGECOUNT': '0.555', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.210', 'weapon3': '1.826'}
[2023-02-25 12:31:26,150][2409596] DAMAGECOUNT value on done: 268.0
[2023-02-25 12:31:26,151][2409596] Sum rewards: -4.505, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.721', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'HITCOUNT': '0.080', 'AMMO3': '0.114', 'WEAPON4': '0.150', 'weapon4': '0.156', 'DAMAGECOUNT': '0.177', 'WEAPON3': '0.550', 'weapon2': '1.512', 'weapon3': '1.544'}
[2023-02-25 12:31:26,292][2409096] DAMAGECOUNT value on done: 391.0
[2023-02-25 12:31:26,295][2409096] Sum rewards: -6.630, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.080', 'FRAGCOUNT': '-2.000', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.006', 'AMMO3': '0.065', 'weapon5': '0.076', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'weapon4': '0.112', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.279', 'WEAPON3': '0.450', 'ARMOR': '0.513', 'weapon3': '1.232', 'weapon2': '1.892'}
[2023-02-25 12:31:26,360][2409469] DAMAGECOUNT value on done: 183.0
[2023-02-25 12:31:26,361][2409469] Sum rewards: -5.612, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.364', 'AMMO5': '0.003', 'weapon5': '0.022', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'ARMOR': '0.068', 'AMMO3': '0.103', 'HITCOUNT': '0.120', 'AMMO4': '0.137', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.429', 'weapon4': '0.500', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.004', 'weapon2': '1.738'}
[2023-02-25 12:31:27,061][2409101] DAMAGECOUNT value on done: 570.0
[2023-02-25 12:31:27,062][2409101] Sum rewards: -0.077, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.188', 'AMMO5': '0.010', 'weapon5': '0.032', 'AMMO2': '0.033', 'ARMOR': '0.068', 'AMMO3': '0.081', 'AMMO4': '0.165', 'WEAPON5': '0.200', 'HITCOUNT': '0.300', 'weapon4': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.500', 'weapon3': '1.272', 'DAMAGECOUNT': '1.290', 'weapon2': '1.510', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:31:27,097][2409100] DAMAGECOUNT value on done: 394.0
[2023-02-25 12:31:27,100][2409100] Sum rewards: 0.156, reward structure: {'DEATHCOUNT': '-9.000', 'ARMOR': '0.020', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'weapon4': '0.192', 'HEALTH': '0.242', 'HITCOUNT': '0.310', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.092', 'weapon2': '1.252', 'weapon3': '1.882', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:31:27,104][2409389] DAMAGECOUNT value on done: 225.0
[2023-02-25 12:31:27,150][2409485] DAMAGECOUNT value on done: 580.0
[2023-02-25 12:31:27,150][2409485] Sum rewards: -0.186, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.866', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'weapon4': '0.268', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.804', 'weapon2': '1.420', 'weapon3': '1.566', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:31:27,186][2408954] Fps is (10 sec: 25804.7, 60 sec: 25600.1, 300 sec: 25825.6). Total num frames: 18788352. Throughput: 0: 6397.6. Samples: 4697628. Policy #0 lag: (min: 0.0, avg: 10.2, max: 24.0)
[2023-02-25 12:31:27,186][2408954] Avg episode reward: [(0, '-2.782')]
[2023-02-25 12:31:27,244][2409548] DAMAGECOUNT value on done: 220.0
[2023-02-25 12:31:27,249][2409548] Sum rewards: -0.612, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.591', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.032', 'ARMOR': '0.085', 'AMMO3': '0.117', 'HITCOUNT': '0.130', 'weapon4': '0.192', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.650', 'weapon2': '1.224', 'weapon3': '1.678', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:27,268][2409075] DAMAGECOUNT value on done: 220.0
[2023-02-25 12:31:27,377][2409406] DAMAGECOUNT value on done: 260.0
[2023-02-25 12:31:27,543][2409486] DAMAGECOUNT value on done: 361.0
[2023-02-25 12:31:27,618][2409080] DAMAGECOUNT value on done: 336.0
[2023-02-25 12:31:27,688][2409099] DAMAGECOUNT value on done: 691.0
[2023-02-25 12:31:27,691][2409099] Sum rewards: -1.830, reward structure: {'DEATHCOUNT': '-7.500', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'HEALTH': '0.014', 'ARMOR': '0.028', 'WEAPON4': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.103', 'HITCOUNT': '0.110', 'weapon4': '0.114', 'DAMAGECOUNT': '0.471', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.484', 'weapon3': '1.662'}
[2023-02-25 12:31:27,758][2409102] DAMAGECOUNT value on done: 295.0
[2023-02-25 12:31:27,851][2409074] Updated weights for policy 0, policy_version 4590 (0.0012)
[2023-02-25 12:31:27,938][2409077] DAMAGECOUNT value on done: 252.0
[2023-02-25 12:31:27,939][2409077] Sum rewards: -0.724, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'ARMOR': '0.060', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'WEAPON3': '0.300', 'weapon4': '0.314', 'DAMAGECOUNT': '0.480', 'HEALTH': '0.623', 'weapon3': '0.954', 'FRAGCOUNT': '1.000', 'weapon2': '1.896'}
[2023-02-25 12:31:27,942][2409104] DAMAGECOUNT value on done: 345.0
[2023-02-25 12:31:28,267][2409076] DAMAGECOUNT value on done: 377.0
[2023-02-25 12:31:28,268][2409076] Sum rewards: -4.326, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.674', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.011', 'weapon5': '0.058', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'HITCOUNT': '0.220', 'ARMOR': '0.412', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.726', 'WEAPON3': '0.850', 'weapon3': '1.576', 'weapon2': '1.716'}
[2023-02-25 12:31:28,374][2409105] DAMAGECOUNT value on done: 534.0
[2023-02-25 12:31:28,374][2409105] Sum rewards: 4.183, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.008', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'ARMOR': '0.037', 'HEALTH': '0.074', 'AMMO4': '0.076', 'AMMO3': '0.083', 'weapon5': '0.100', 'weapon4': '0.128', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'WEAPON5': '0.200', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.987', 'weapon2': '1.126', 'weapon3': '1.818', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:31:28,426][2409468] DAMAGECOUNT value on done: 497.0
[2023-02-25 12:31:28,430][2409468] Sum rewards: 0.114, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.244', 'AMMO2': '0.011', 'ARMOR': '0.028', 'AMMO4': '0.057', 'AMMO3': '0.073', 'weapon7': '0.078', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon4': '0.180', 'WEAPON4': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.071', 'weapon2': '1.398', 'weapon3': '1.522', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:31:28,498][2409373] DAMAGECOUNT value on done: 386.0
[2023-02-25 12:31:28,501][2409373] Sum rewards: -3.492, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.644', 'AMMO5': '0.003', 'weapon4': '0.004', 'WEAPON1': '0.010', 'weapon5': '0.016', 'AMMO2': '0.022', 'ARMOR': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.113', 'HITCOUNT': '0.270', 'DAMAGECOUNT': '0.693', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.542', 'weapon2': '1.722'}
[2023-02-25 12:31:28,681][2409407] DAMAGECOUNT value on done: 309.0
[2023-02-25 12:31:28,684][2409407] Sum rewards: -0.852, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.328', 'AMMO5': '0.007', 'AMMO2': '0.013', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.063', 'HITCOUNT': '0.100', 'weapon5': '0.100', 'AMMO3': '0.102', 'WEAPON5': '0.150', 'weapon4': '0.276', 'DAMAGECOUNT': '0.501', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.104', 'weapon2': '1.370'}
[2023-02-25 12:31:28,734][2409097] DAMAGECOUNT value on done: 357.0
[2023-02-25 12:31:28,737][2409097] Sum rewards: -4.641, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.307', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'AMMO5': '0.015', 'weapon5': '0.080', 'AMMO3': '0.133', 'HITCOUNT': '0.210', 'WEAPON5': '0.250', 'ARMOR': '0.456', 'DAMAGECOUNT': '0.639', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.222', 'weapon3': '1.814'}
[2023-02-25 12:31:28,739][2409549] DAMAGECOUNT value on done: 503.0
[2023-02-25 12:31:28,739][2409549] Sum rewards: -2.824, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.997', 'weapon5': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.016', 'ARMOR': '0.076', 'AMMO4': '0.080', 'AMMO3': '0.097', 'weapon4': '0.134', 'WEAPON4': '0.150', 'HITCOUNT': '0.190', 'WEAPON5': '0.200', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.759', 'FRAGCOUNT': '1.000', 'weapon2': '1.336', 'weapon3': '1.708'}
[2023-02-25 12:31:28,772][2409866] DAMAGECOUNT value on done: 184.0
[2023-02-25 12:31:28,801][2409079] DAMAGECOUNT value on done: 329.0
[2023-02-25 12:31:28,802][2409079] Sum rewards: -3.175, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.435', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.022', 'weapon4': '0.024', 'ARMOR': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'HITCOUNT': '0.250', 'DAMAGECOUNT': '0.717', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.478', 'weapon3': '1.826'}
[2023-02-25 12:31:28,820][2409355] DAMAGECOUNT value on done: 370.0
[2023-02-25 12:31:28,821][2409355] Sum rewards: -4.329, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.582', 'AMMO5': '0.004', 'AMMO2': '0.014', 'weapon5': '0.034', 'AMMO4': '0.067', 'AMMO3': '0.069', 'WEAPON5': '0.100', 'HITCOUNT': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.292', 'DAMAGECOUNT': '0.315', 'WEAPON3': '0.450', 'weapon2': '1.420', 'weapon3': '1.468'}
[2023-02-25 12:31:28,860][2409565] DAMAGECOUNT value on done: 289.0
[2023-02-25 12:31:28,861][2409565] Sum rewards: -3.483, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.048', 'AMMO2': '0.001', 'AMMO4': '0.005', 'HITCOUNT': '0.090', 'AMMO3': '0.098', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.237', 'weapon4': '0.334', 'ARMOR': '0.473', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.128', 'weapon2': '1.698'}
[2023-02-25 12:31:28,909][2409103] DAMAGECOUNT value on done: 344.0
[2023-02-25 12:31:28,912][2409103] Sum rewards: -0.979, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.356', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.052', 'AMMO3': '0.108', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'weapon4': '0.220', 'DAMAGECOUNT': '0.540', 'WEAPON3': '0.650', 'weapon2': '1.572', 'weapon3': '1.664', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:29,222][2409074] Updated weights for policy 0, policy_version 4600 (0.0013)
[2023-02-25 12:31:29,241][2409597] DAMAGECOUNT value on done: 168.0
[2023-02-25 12:31:29,242][2409597] Sum rewards: -1.971, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.076', 'AMMO4': '-0.048', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.094', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.297', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.438', 'weapon3': '1.558'}
[2023-02-25 12:31:29,479][2409405] DAMAGECOUNT value on done: 456.0
[2023-02-25 12:31:29,482][2409405] Sum rewards: 0.951, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.106', 'AMMO2': '0.006', 'AMMO4': '0.028', 'ARMOR': '0.044', 'WEAPON1': '0.050', 'AMMO3': '0.072', 'WEAPON4': '0.200', 'HITCOUNT': '0.260', 'weapon4': '0.300', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.975', 'weapon3': '1.384', 'weapon2': '1.488', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:29,710][2409596] DAMAGECOUNT value on done: 605.0
[2023-02-25 12:31:29,725][2409596] Sum rewards: -5.778, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.599', 'AMMO5': '0.004', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'weapon4': '0.022', 'AMMO4': '0.034', 'ARMOR': '0.076', 'weapon5': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.170', 'HITCOUNT': '0.310', 'FRAGCOUNT': '0.500', 'WEAPON3': '1.000', 'weapon2': '1.288', 'DAMAGECOUNT': '1.350', 'weapon3': '2.002'}
[2023-02-25 12:31:29,786][2409096] DAMAGECOUNT value on done: 637.0
[2023-02-25 12:31:29,787][2409096] Sum rewards: 0.207, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.430', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.033', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.322', 'ARMOR': '0.408', 'HITCOUNT': '0.410', 'WEAPON3': '0.750', 'weapon2': '1.496', 'DAMAGECOUNT': '1.506', 'weapon3': '1.550', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:31:29,849][2409078] DAMAGECOUNT value on done: 305.0
[2023-02-25 12:31:29,853][2409078] Sum rewards: -1.564, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.351', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.091', 'AMMO3': '0.092', 'weapon4': '0.096', 'HITCOUNT': '0.170', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.338', 'weapon3': '1.626'}
[2023-02-25 12:31:29,857][2409469] DAMAGECOUNT value on done: 400.0
[2023-02-25 12:31:29,858][2409469] Sum rewards: -8.295, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.218', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.061', 'WEAPON5': '0.100', 'HITCOUNT': '0.180', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'weapon4': '0.252', 'ARMOR': '0.469', 'DAMAGECOUNT': '0.600', 'WEAPON3': '1.100', 'weapon3': '1.588', 'weapon2': '1.612', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:29,966][2409547] DAMAGECOUNT value on done: 339.0
[2023-02-25 12:31:29,970][2409547] Sum rewards: -3.931, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.838', 'AMMO5': '0.003', 'AMMO2': '0.020', 'ARMOR': '0.032', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.062', 'HITCOUNT': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.124', 'DAMAGECOUNT': '0.354', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.700', 'weapon2': '1.226', 'weapon3': '1.798'}
[2023-02-25 12:31:30,470][2409074] Updated weights for policy 0, policy_version 4610 (0.0013)
[2023-02-25 12:31:30,675][2409100] DAMAGECOUNT value on done: 252.0
[2023-02-25 12:31:30,676][2409100] Sum rewards: -6.446, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.162', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.113', 'HITCOUNT': '0.120', 'weapon4': '0.176', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.465', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.466', 'weapon3': '1.642'}
[2023-02-25 12:31:30,823][2409485] DAMAGECOUNT value on done: 335.0
[2023-02-25 12:31:30,824][2409485] Sum rewards: -3.385, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.604', 'AMMO5': '0.004', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'weapon5': '0.034', 'ARMOR': '0.050', 'AMMO4': '0.053', 'weapon4': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.146', 'HITCOUNT': '0.200', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.765', 'weapon2': '1.328', 'weapon3': '1.686', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:30,860][2409548] DAMAGECOUNT value on done: 184.0
[2023-02-25 12:31:30,914][2409101] DAMAGECOUNT value on done: 446.0
[2023-02-25 12:31:30,915][2409101] Sum rewards: -6.033, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.250', 'AMMO5': '0.003', 'weapon5': '0.026', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'AMMO3': '0.090', 'HITCOUNT': '0.090', 'WEAPON4': '0.150', 'AMMO4': '0.165', 'DAMAGECOUNT': '0.294', 'weapon4': '0.296', 'WEAPON3': '0.400', 'weapon2': '1.228', 'weapon3': '1.392'}
[2023-02-25 12:31:30,961][2409406] DAMAGECOUNT value on done: 466.0
[2023-02-25 12:31:30,963][2409406] Sum rewards: -3.292, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.916', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.093', 'weapon4': '0.132', 'AMMO3': '0.171', 'HITCOUNT': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'ARMOR': '0.440', 'DAMAGECOUNT': '0.765', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.158', 'weapon3': '1.776'}
[2023-02-25 12:31:31,251][2409486] DAMAGECOUNT value on done: 305.0
[2023-02-25 12:31:31,254][2409486] Sum rewards: -6.287, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.560', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.021', 'weapon5': '0.060', 'AMMO4': '0.106', 'AMMO3': '0.120', 'WEAPON5': '0.150', 'HITCOUNT': '0.160', 'WEAPON4': '0.350', 'weapon4': '0.390', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.660', 'weapon3': '1.280', 'weapon2': '1.586'}
[2023-02-25 12:31:31,347][2409080] DAMAGECOUNT value on done: 308.0
[2023-02-25 12:31:31,352][2409080] Sum rewards: -5.420, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.345', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.014', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'HITCOUNT': '0.120', 'weapon4': '0.144', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.700', 'weapon2': '1.304', 'weapon3': '1.892'}
[2023-02-25 12:31:31,415][2409099] DAMAGECOUNT value on done: 644.0
[2023-02-25 12:31:31,418][2409099] Sum rewards: -2.465, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.016', 'AMMO2': '0.025', 'weapon4': '0.032', 'WEAPON4': '0.050', 'AMMO4': '0.125', 'AMMO3': '0.141', 'HITCOUNT': '0.190', 'ARMOR': '0.420', 'DAMAGECOUNT': '0.525', 'WEAPON3': '0.850', 'weapon3': '1.368', 'weapon2': '1.824', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:31,587][2409104] DAMAGECOUNT value on done: 369.0
[2023-02-25 12:31:31,590][2409104] Sum rewards: 3.290, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.223', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'AMMO3': '0.040', 'weapon7': '0.058', 'HITCOUNT': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'ARMOR': '0.451', 'DAMAGECOUNT': '0.852', 'weapon3': '1.080', 'weapon2': '1.184', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:31,597][2409077] DAMAGECOUNT value on done: 296.0
[2023-02-25 12:31:31,599][2409102] DAMAGECOUNT value on done: 213.0
[2023-02-25 12:31:31,600][2409077] Sum rewards: -3.138, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.160', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'AMMO5': '0.003', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'weapon5': '0.038', 'WEAPON5': '0.050', 'HITCOUNT': '0.100', 'AMMO3': '0.107', 'DAMAGECOUNT': '0.414', 'WEAPON3': '0.550', 'weapon2': '1.622', 'weapon3': '1.676'}
[2023-02-25 12:31:31,600][2409102] Sum rewards: -1.064, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.872', 'AMMO5': '0.003', 'AMMO2': '0.004', 'ARMOR': '0.004', 'weapon4': '0.016', 'AMMO4': '0.020', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.066', 'HITCOUNT': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'DAMAGECOUNT': '0.417', 'WEAPON3': '0.700', 'weapon2': '1.202', 'weapon3': '1.766', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:31,640][2409389] DAMAGECOUNT value on done: 301.0
[2023-02-25 12:31:31,759][2409075] DAMAGECOUNT value on done: 155.0
[2023-02-25 12:31:32,186][2408954] Fps is (10 sec: 24985.7, 60 sec: 25531.8, 300 sec: 25797.9). Total num frames: 18915328. Throughput: 0: 6417.3. Samples: 4736724. Policy #0 lag: (min: 0.0, avg: 12.1, max: 25.0)
[2023-02-25 12:31:32,186][2408954] Avg episode reward: [(0, '-2.835')]
[2023-02-25 12:31:32,258][2409097] DAMAGECOUNT value on done: 221.0
[2023-02-25 12:31:32,258][2409097] Sum rewards: -5.775, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.826', 'FRAGCOUNT': '-1.500', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'HITCOUNT': '0.060', 'weapon5': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'weapon4': '0.172', 'DAMAGECOUNT': '0.321', 'ARMOR': '0.493', 'WEAPON3': '0.750', 'weapon2': '1.200', 'weapon3': '1.672'}
[2023-02-25 12:31:32,274][2409074] Updated weights for policy 0, policy_version 4620 (0.0013)
[2023-02-25 12:31:32,360][2409076] DAMAGECOUNT value on done: 634.0
[2023-02-25 12:31:32,363][2409076] Sum rewards: -2.841, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.859', 'AMMO5': '0.003', 'AMMO2': '0.003', 'ARMOR': '0.008', 'AMMO4': '0.017', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.136', 'weapon4': '0.160', 'HITCOUNT': '0.270', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.819', 'FRAGCOUNT': '1.000', 'weapon3': '1.378', 'weapon2': '1.824'}
[2023-02-25 12:31:32,376][2409468] DAMAGECOUNT value on done: 315.0
[2023-02-25 12:31:32,404][2409105] DAMAGECOUNT value on done: 202.0
[2023-02-25 12:31:32,407][2409407] DAMAGECOUNT value on done: 280.0
[2023-02-25 12:31:32,411][2409407] Sum rewards: 0.843, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.664', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.046', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'HITCOUNT': '0.150', 'weapon4': '0.240', 'WEAPON3': '0.350', 'ARMOR': '0.452', 'DAMAGECOUNT': '0.615', 'weapon3': '0.992', 'FRAGCOUNT': '1.000', 'weapon2': '1.222'}
[2023-02-25 12:31:32,544][2409565] DAMAGECOUNT value on done: 283.0
[2023-02-25 12:31:32,567][2409079] DAMAGECOUNT value on done: 600.0
[2023-02-25 12:31:32,568][2409549] DAMAGECOUNT value on done: 408.0
[2023-02-25 12:31:32,571][2409549] Sum rewards: -1.072, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.416', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon4': '0.016', 'ARMOR': '0.020', 'AMMO2': '0.027', 'HITCOUNT': '0.070', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.138', 'WEAPON4': '0.200', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.849', 'weapon2': '1.452', 'weapon3': '1.676', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:32,571][2409079] Sum rewards: -7.110, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.346', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'WEAPON4': '0.050', 'AMMO3': '0.181', 'HITCOUNT': '0.350', 'ARMOR': '0.500', 'WEAPON3': '1.000', 'weapon2': '1.316', 'DAMAGECOUNT': '1.320', 'FRAGCOUNT': '2.000', 'weapon3': '2.010'}
[2023-02-25 12:31:32,632][2409373] DAMAGECOUNT value on done: 399.0
[2023-02-25 12:31:32,634][2409373] Sum rewards: -1.955, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.180', 'AMMO5': '0.003', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO4': '0.139', 'HITCOUNT': '0.140', 'AMMO3': '0.144', 'ARMOR': '0.453', 'DAMAGECOUNT': '0.555', 'WEAPON3': '0.900', 'weapon2': '1.450', 'weapon3': '1.544', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:32,631][2409866] DAMAGECOUNT value on done: 545.0
[2023-02-25 12:31:32,636][2409866] Sum rewards: -1.766, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.182', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'WEAPON4': '0.100', 'weapon4': '0.102', 'AMMO3': '0.135', 'HITCOUNT': '0.270', 'WEAPON3': '0.750', 'ARMOR': '0.961', 'DAMAGECOUNT': '1.020', 'weapon3': '1.598', 'weapon2': '1.748', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:32,850][2409355] DAMAGECOUNT value on done: 328.0
[2023-02-25 12:31:32,850][2409355] Sum rewards: -5.454, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.825', 'AMMO5': '0.004', 'AMMO2': '0.016', 'weapon5': '0.042', 'AMMO4': '0.080', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.125', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.360', 'weapon4': '0.468', 'WEAPON3': '0.650', 'weapon2': '0.950', 'FRAGCOUNT': '1.000', 'weapon3': '1.726'}
[2023-02-25 12:31:33,191][2409597] DAMAGECOUNT value on done: 568.0
[2023-02-25 12:31:33,192][2409597] Sum rewards: 0.036, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.430', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO4': '0.071', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.152', 'HITCOUNT': '0.240', 'ARMOR': '0.416', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.026', 'weapon3': '1.562', 'weapon2': '1.620', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:33,330][2409405] DAMAGECOUNT value on done: 404.0
[2023-02-25 12:31:33,331][2409405] Sum rewards: -1.522, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.450', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.013', 'ARMOR': '0.069', 'WEAPON4': '0.100', 'weapon4': '0.128', 'AMMO3': '0.157', 'HITCOUNT': '0.280', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.062', 'weapon3': '1.504', 'weapon2': '1.652', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:31:33,365][2409096] DAMAGECOUNT value on done: 306.0
[2023-02-25 12:31:33,365][2409096] Sum rewards: -0.314, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.150', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.010', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.118', 'HITCOUNT': '0.210', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.861', 'weapon2': '1.240', 'FRAGCOUNT': '2.000', 'weapon3': '2.070'}
[2023-02-25 12:31:33,431][2409469] DAMAGECOUNT value on done: 278.0
[2023-02-25 12:31:33,432][2409469] Sum rewards: -4.444, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.928', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.023', 'weapon4': '0.028', 'weapon5': '0.036', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.143', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.414', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.436', 'weapon3': '1.920'}
[2023-02-25 12:31:33,461][2409033] Signal inference workers to stop experience collection... (650 times)
[2023-02-25 12:31:33,463][2409596] DAMAGECOUNT value on done: 425.0
[2023-02-25 12:31:33,464][2409596] Sum rewards: -0.816, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.256', 'AMMO5': '0.005', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.060', 'WEAPON5': '0.100', 'weapon4': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'HITCOUNT': '0.260', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.038', 'weapon2': '1.350', 'weapon3': '1.600', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:31:33,487][2409033] Signal inference workers to resume experience collection... (650 times)
[2023-02-25 12:31:33,503][2409074] InferenceWorker_p0-w0: stopping experience collection (650 times)
[2023-02-25 12:31:33,516][2409074] InferenceWorker_p0-w0: resuming experience collection (650 times)
[2023-02-25 12:31:33,712][2409547] DAMAGECOUNT value on done: 135.0
[2023-02-25 12:31:33,770][2409078] DAMAGECOUNT value on done: 280.0
[2023-02-25 12:31:33,771][2409078] Sum rewards: -1.840, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.080', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'HITCOUNT': '0.160', 'weapon4': '0.246', 'DAMAGECOUNT': '0.660', 'WEAPON3': '0.700', 'weapon2': '1.182', 'weapon3': '1.572', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:33,823][2409074] Updated weights for policy 0, policy_version 4630 (0.0013)
[2023-02-25 12:31:34,630][2409100] DAMAGECOUNT value on done: 475.0
[2023-02-25 12:31:34,631][2409100] Sum rewards: -1.475, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.974', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon4': '0.054', 'AMMO3': '0.088', 'AMMO4': '0.125', 'HITCOUNT': '0.150', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.483', 'WEAPON3': '0.550', 'weapon3': '1.554', 'weapon2': '1.712', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:34,652][2409101] DAMAGECOUNT value on done: 530.0
[2023-02-25 12:31:34,655][2409101] Sum rewards: -0.975, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.044', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'AMMO3': '0.097', 'AMMO4': '0.142', 'WEAPON4': '0.200', 'HITCOUNT': '0.220', 'weapon4': '0.478', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.720', 'ARMOR': '0.844', 'weapon3': '1.232', 'weapon2': '1.486'}
[2023-02-25 12:31:34,713][2409406] DAMAGECOUNT value on done: 227.0
[2023-02-25 12:31:34,728][2409406] Sum rewards: -6.668, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.447', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.036', 'ARMOR': '0.048', 'HITCOUNT': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.113', 'weapon5': '0.172', 'AMMO4': '0.179', 'DAMAGECOUNT': '0.216', 'weapon4': '0.216', 'WEAPON4': '0.350', 'WEAPON3': '0.600', 'weapon3': '1.306', 'weapon2': '1.608'}
[2023-02-25 12:31:34,857][2409548] DAMAGECOUNT value on done: 280.0
[2023-02-25 12:31:34,861][2409548] Sum rewards: -4.927, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.230', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.008', 'AMMO5': '0.014', 'AMMO4': '0.041', 'weapon5': '0.052', 'weapon4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'HITCOUNT': '0.160', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.750', 'weapon2': '1.346', 'weapon3': '1.688'}
[2023-02-25 12:31:34,949][2409486] DAMAGECOUNT value on done: 302.0
[2023-02-25 12:31:35,047][2409485] DAMAGECOUNT value on done: 464.0
[2023-02-25 12:31:35,057][2409485] Sum rewards: -0.510, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.598', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'AMMO3': '0.091', 'weapon4': '0.092', 'HITCOUNT': '0.150', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.657', 'weapon2': '1.188', 'weapon3': '1.990', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:35,077][2409389] DAMAGECOUNT value on done: 412.0
[2023-02-25 12:31:35,078][2409389] Sum rewards: -2.695, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.096', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.068', 'AMMO2': '-0.013', 'AMMO5': '0.008', 'ARMOR': '0.012', 'weapon5': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'HITCOUNT': '0.150', 'DAMAGECOUNT': '0.522', 'WEAPON3': '0.700', 'weapon2': '1.576', 'weapon3': '1.756'}
[2023-02-25 12:31:35,176][2409099] DAMAGECOUNT value on done: 494.0
[2023-02-25 12:31:35,179][2409099] Sum rewards: -5.988, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.615', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'AMMO4': '0.064', 'AMMO3': '0.143', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.300', 'DAMAGECOUNT': '0.537', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.320', 'weapon3': '1.670'}
[2023-02-25 12:31:35,216][2409075] DAMAGECOUNT value on done: 376.0
[2023-02-25 12:31:35,237][2409104] DAMAGECOUNT value on done: 715.0
[2023-02-25 12:31:35,240][2409104] Sum rewards: 4.528, reward structure: {'DEATHCOUNT': '-7.500', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'HEALTH': '0.028', 'ARMOR': '0.044', 'WEAPON4': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.114', 'HITCOUNT': '0.300', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.272', 'weapon2': '1.508', 'weapon3': '1.966', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:31:35,293][2409077] DAMAGECOUNT value on done: 280.0
[2023-02-25 12:31:35,296][2409077] Sum rewards: -1.698, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.960', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.024', 'HITCOUNT': '0.080', 'AMMO3': '0.123', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.192', 'weapon3': '1.730'}
[2023-02-25 12:31:35,505][2409102] DAMAGECOUNT value on done: 438.0
[2023-02-25 12:31:35,508][2409102] Sum rewards: -2.828, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.246', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon5': '0.032', 'weapon4': '0.052', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'ARMOR': '0.436', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.416', 'weapon2': '1.788'}
[2023-02-25 12:31:35,725][2409080] DAMAGECOUNT value on done: 400.0
[2023-02-25 12:31:35,786][2409074] Updated weights for policy 0, policy_version 4640 (0.0012)
[2023-02-25 12:31:35,964][2409105] DAMAGECOUNT value on done: 200.0
[2023-02-25 12:31:35,989][2409097] DAMAGECOUNT value on done: 298.0
[2023-02-25 12:31:35,990][2409097] Sum rewards: -2.235, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.136', 'ARMOR': '0.012', 'AMMO2': '0.031', 'HITCOUNT': '0.070', 'weapon4': '0.108', 'AMMO3': '0.119', 'AMMO4': '0.156', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.268', 'weapon3': '1.736'}
[2023-02-25 12:31:36,199][2409549] DAMAGECOUNT value on done: 355.0
[2023-02-25 12:31:36,200][2409549] Sum rewards: 1.855, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO2': '0.011', 'HITCOUNT': '0.040', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'HEALTH': '0.075', 'DAMAGECOUNT': '0.105', 'weapon4': '0.180', 'WEAPON3': '0.200', 'ARMOR': '0.400', 'weapon2': '0.708', 'FRAGCOUNT': '1.000', 'weapon3': '1.232'}
[2023-02-25 12:31:36,254][2409407] DAMAGECOUNT value on done: 268.0
[2023-02-25 12:31:36,355][2409866] DAMAGECOUNT value on done: 210.0
[2023-02-25 12:31:36,356][2409866] Sum rewards: -6.148, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.566', 'AMMO2': '0.024', 'HITCOUNT': '0.080', 'AMMO3': '0.108', 'AMMO4': '0.118', 'DAMAGECOUNT': '0.231', 'weapon4': '0.270', 'WEAPON4': '0.350', 'ARMOR': '0.549', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.262', 'weapon3': '1.476'}
[2023-02-25 12:31:36,377][2409076] DAMAGECOUNT value on done: 351.0
[2023-02-25 12:31:36,416][2409355] DAMAGECOUNT value on done: 464.0
[2023-02-25 12:31:36,417][2409355] Sum rewards: -1.977, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.480', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'ARMOR': '0.020', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'HITCOUNT': '0.080', 'AMMO3': '0.085', 'AMMO4': '0.086', 'weapon4': '0.102', 'DAMAGECOUNT': '0.252', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.346', 'weapon2': '1.614'}
[2023-02-25 12:31:36,445][2409079] DAMAGECOUNT value on done: 344.0
[2023-02-25 12:31:36,445][2409079] Sum rewards: -2.596, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.204', 'AMMO2': '0.006', 'ARMOR': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.031', 'weapon5': '0.034', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'DAMAGECOUNT': '0.522', 'WEAPON3': '0.900', 'weapon2': '1.340', 'weapon3': '1.916', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:36,466][2409565] DAMAGECOUNT value on done: 558.0
[2023-02-25 12:31:36,467][2409565] Sum rewards: -4.018, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.467', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'ARMOR': '0.044', 'AMMO3': '0.101', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'HITCOUNT': '0.250', 'weapon4': '0.282', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.771', 'FRAGCOUNT': '1.000', 'weapon3': '1.196', 'weapon2': '1.882'}
[2023-02-25 12:31:36,549][2409373] DAMAGECOUNT value on done: 80.0
[2023-02-25 12:31:36,619][2409468] DAMAGECOUNT value on done: 244.0
[2023-02-25 12:31:36,622][2409468] Sum rewards: -4.291, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.086', 'AMMO2': '0.003', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO4': '0.016', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.170', 'weapon4': '0.276', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.600', 'weapon2': '1.114', 'weapon3': '1.396'}
[2023-02-25 12:31:36,772][2409597] DAMAGECOUNT value on done: 438.0
[2023-02-25 12:31:36,776][2409597] Sum rewards: -6.173, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.516', 'AMMO5': '0.003', 'AMMO2': '0.014', 'ARMOR': '0.032', 'AMMO4': '0.070', 'AMMO3': '0.116', 'WEAPON4': '0.200', 'HITCOUNT': '0.260', 'weapon4': '0.270', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.762', 'FRAGCOUNT': '1.000', 'weapon2': '1.392', 'weapon3': '1.774'}
[2023-02-25 12:31:36,903][2409096] DAMAGECOUNT value on done: 447.0
[2023-02-25 12:31:36,904][2409096] Sum rewards: -3.812, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.445', 'AMMO2': '0.017', 'ARMOR': '0.060', 'HITCOUNT': '0.080', 'AMMO4': '0.083', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.240', 'weapon4': '0.418', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.348', 'weapon3': '1.432'}
[2023-02-25 12:31:36,945][2409469] DAMAGECOUNT value on done: 378.0
[2023-02-25 12:31:36,946][2409469] Sum rewards: -3.280, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.358', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.008', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'ARMOR': '0.064', 'AMMO4': '0.068', 'weapon5': '0.100', 'AMMO3': '0.144', 'HITCOUNT': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.384', 'DAMAGECOUNT': '0.783', 'WEAPON3': '0.800', 'weapon2': '0.938', 'weapon3': '1.454'}
[2023-02-25 12:31:37,012][2409405] DAMAGECOUNT value on done: 629.0
[2023-02-25 12:31:37,012][2409405] Sum rewards: -2.406, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.414', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.024', 'ARMOR': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.094', 'AMMO4': '0.106', 'HITCOUNT': '0.190', 'WEAPON4': '0.300', 'weapon4': '0.486', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.702', 'FRAGCOUNT': '1.000', 'weapon2': '1.162', 'weapon3': '1.522'}
[2023-02-25 12:31:37,035][2409074] Updated weights for policy 0, policy_version 4650 (0.0012)
[2023-02-25 12:31:37,186][2408954] Fps is (10 sec: 26623.4, 60 sec: 25736.5, 300 sec: 25867.3). Total num frames: 19054592. Throughput: 0: 6416.2. Samples: 4755480. Policy #0 lag: (min: 4.0, avg: 15.7, max: 26.0)
[2023-02-25 12:31:37,186][2408954] Avg episode reward: [(0, '-2.737')]
[2023-02-25 12:31:37,353][2409547] DAMAGECOUNT value on done: 494.0
[2023-02-25 12:31:37,356][2409547] Sum rewards: -0.072, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.420', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.032', 'AMMO3': '0.081', 'weapon7': '0.084', 'AMMO4': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'HITCOUNT': '0.170', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.334', 'WEAPON3': '0.500', 'ARMOR': '0.507', 'weapon3': '1.136', 'DAMAGECOUNT': '1.194', 'FRAGCOUNT': '1.500', 'weapon2': '1.540'}
[2023-02-25 12:31:37,386][2409596] DAMAGECOUNT value on done: 450.0
[2023-02-25 12:31:37,389][2409596] Sum rewards: 1.631, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.014', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.079', 'AMMO3': '0.097', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.156', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'DAMAGECOUNT': '0.390', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'weapon2': '1.212', 'weapon3': '1.772', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:37,496][2409078] DAMAGECOUNT value on done: 255.0
[2023-02-25 12:31:37,496][2409078] Sum rewards: -3.635, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.256', 'AMMO2': '0.015', 'ARMOR': '0.036', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'weapon4': '0.100', 'AMMO3': '0.111', 'HITCOUNT': '0.120', 'DAMAGECOUNT': '0.525', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.528', 'weapon3': '1.710'}
[2023-02-25 12:31:38,473][2409101] DAMAGECOUNT value on done: 293.0
[2023-02-25 12:31:38,474][2409101] Sum rewards: -2.716, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.404', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.116', 'HITCOUNT': '0.140', 'WEAPON4': '0.200', 'weapon4': '0.234', 'DAMAGECOUNT': '0.324', 'ARMOR': '0.444', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.198', 'weapon3': '1.696'}
[2023-02-25 12:31:38,572][2409486] DAMAGECOUNT value on done: 576.0
[2023-02-25 12:31:38,573][2409486] Sum rewards: -5.624, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.606', 'ARMOR': '0.017', 'AMMO2': '0.024', 'WEAPON4': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.125', 'HITCOUNT': '0.220', 'DAMAGECOUNT': '0.699', 'WEAPON3': '0.800', 'weapon2': '1.556', 'FRAGCOUNT': '2.000', 'weapon3': '2.070'}
[2023-02-25 12:31:38,744][2409389] DAMAGECOUNT value on done: 310.0
[2023-02-25 12:31:38,826][2409406] DAMAGECOUNT value on done: 608.0
[2023-02-25 12:31:38,829][2409406] Sum rewards: -3.000, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.082', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon5': '0.048', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'AMMO3': '0.134', 'HITCOUNT': '0.220', 'DAMAGECOUNT': '0.717', 'WEAPON3': '0.750', 'weapon2': '1.378', 'weapon3': '1.686'}
[2023-02-25 12:31:38,837][2409099] DAMAGECOUNT value on done: 489.0
[2023-02-25 12:31:38,838][2409099] Sum rewards: -2.927, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.213', 'AMMO5': '0.003', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO4': '0.021', 'ARMOR': '0.033', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'weapon4': '0.140', 'HITCOUNT': '0.200', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.825', 'FRAGCOUNT': '1.000', 'weapon2': '1.274', 'weapon3': '1.852'}
[2023-02-25 12:31:38,903][2409075] DAMAGECOUNT value on done: 248.0
[2023-02-25 12:31:38,906][2409075] Sum rewards: -3.726, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.540', 'AMMO2': '0.008', 'AMMO4': '0.042', 'HITCOUNT': '0.150', 'AMMO3': '0.175', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.234', 'weapon3': '2.120'}
[2023-02-25 12:31:39,034][2409548] DAMAGECOUNT value on done: 536.0
[2023-02-25 12:31:39,035][2409548] Sum rewards: 0.252, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-2.080', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'AMMO5': '0.004', 'WEAPON1': '0.020', 'ARMOR': '0.020', 'weapon5': '0.040', 'weapon7': '0.052', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.318', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.900', 'weapon3': '1.116', 'weapon2': '1.582', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:39,165][2409074] Updated weights for policy 0, policy_version 4660 (0.0012)
[2023-02-25 12:31:39,274][2409104] DAMAGECOUNT value on done: 285.0
[2023-02-25 12:31:39,278][2409104] Sum rewards: -0.806, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.524', 'AMMO5': '0.003', 'weapon4': '0.004', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'weapon5': '0.074', 'AMMO3': '0.099', 'HITCOUNT': '0.200', 'ARMOR': '0.436', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.660', 'FRAGCOUNT': '1.000', 'weapon2': '1.398', 'weapon3': '1.776'}
[2023-02-25 12:31:39,634][2409080] DAMAGECOUNT value on done: 205.0
[2023-02-25 12:31:39,650][2409080] Sum rewards: -8.211, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-2.000', 'HEALTH': '-1.826', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'ARMOR': '0.016', 'AMMO2': '0.018', 'weapon4': '0.026', 'weapon5': '0.064', 'AMMO4': '0.088', 'HITCOUNT': '0.130', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.900', 'weapon2': '1.086', 'weapon3': '2.108'}
[2023-02-25 12:31:39,663][2409077] DAMAGECOUNT value on done: 629.0
[2023-02-25 12:31:39,665][2409077] Sum rewards: -2.221, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.350', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'weapon4': '0.034', 'AMMO4': '0.043', 'ARMOR': '0.044', 'WEAPON4': '0.050', 'AMMO3': '0.089', 'HITCOUNT': '0.270', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.122', 'weapon2': '1.564', 'weapon3': '1.734'}
[2023-02-25 12:31:39,710][2409097] DAMAGECOUNT value on done: 352.0
[2023-02-25 12:31:39,725][2409097] Sum rewards: -1.324, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.290', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.031', 'ARMOR': '0.032', 'weapon4': '0.068', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'HITCOUNT': '0.130', 'DAMAGECOUNT': '0.336', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon2': '1.334', 'weapon3': '2.078'}
[2023-02-25 12:31:39,726][2409105] DAMAGECOUNT value on done: 310.0
[2023-02-25 12:31:39,727][2409105] Sum rewards: -2.777, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.596', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'weapon5': '0.032', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.084', 'AMMO3': '0.090', 'HITCOUNT': '0.150', 'AMMO4': '0.185', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.476', 'weapon3': '1.712'}
[2023-02-25 12:31:39,990][2409076] DAMAGECOUNT value on done: 386.0
[2023-02-25 12:31:39,991][2409076] Sum rewards: -4.512, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.846', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'HITCOUNT': '0.070', 'weapon4': '0.142', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.195', 'ARMOR': '0.460', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.360', 'weapon3': '1.772'}
[2023-02-25 12:31:40,134][2409373] DAMAGECOUNT value on done: 222.0
[2023-02-25 12:31:40,135][2409373] Sum rewards: -3.396, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.106', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.050', 'AMMO4': '0.059', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'WEAPON5': '0.150', 'weapon4': '0.238', 'DAMAGECOUNT': '0.441', 'ARMOR': '0.489', 'WEAPON3': '0.600', 'weapon3': '1.502', 'weapon2': '1.620', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:40,217][2409866] DAMAGECOUNT value on done: 360.0
[2023-02-25 12:31:40,223][2409866] Sum rewards: -3.155, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.876', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.028', 'WEAPON4': '0.050', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'AMMO3': '0.143', 'weapon4': '0.168', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.675', 'WEAPON3': '0.850', 'weapon2': '1.510', 'weapon3': '1.642', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:40,286][2409355] DAMAGECOUNT value on done: 277.0
[2023-02-25 12:31:40,403][2409565] DAMAGECOUNT value on done: 480.0
[2023-02-25 12:31:40,407][2409565] Sum rewards: -2.215, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.339', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.014', 'weapon5': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.085', 'WEAPON5': '0.200', 'HITCOUNT': '0.290', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.038', 'weapon2': '1.396', 'weapon3': '1.716'}
[2023-02-25 12:31:40,420][2409074] Updated weights for policy 0, policy_version 4670 (0.0012)
[2023-02-25 12:31:40,482][2409597] DAMAGECOUNT value on done: 317.0
[2023-02-25 12:31:40,484][2409597] Sum rewards: -1.451, reward structure: {'DEATHCOUNT': '-5.250', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.366', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.056', 'HITCOUNT': '0.080', 'weapon5': '0.082', 'AMMO4': '0.095', 'weapon4': '0.144', 'DAMAGECOUNT': '0.384', 'WEAPON3': '0.400', 'ARMOR': '0.408', 'weapon3': '1.336', 'weapon2': '1.548'}
[2023-02-25 12:31:40,502][2409096] DAMAGECOUNT value on done: 229.0
[2023-02-25 12:31:40,504][2409096] Sum rewards: -5.249, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.568', 'AMMO2': '0.003', 'weapon5': '0.012', 'AMMO4': '0.012', 'AMMO5': '0.020', 'HITCOUNT': '0.140', 'AMMO3': '0.162', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.438', 'ARMOR': '0.496', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.420', 'weapon3': '1.966'}
[2023-02-25 12:31:40,525][2409469] DAMAGECOUNT value on done: 314.0
[2023-02-25 12:31:40,526][2409469] Sum rewards: -1.601, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.333', 'AMMO5': '0.003', 'weapon5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO3': '0.084', 'ARMOR': '0.084', 'AMMO4': '0.104', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'weapon4': '0.244', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.540', 'FRAGCOUNT': '1.000', 'weapon3': '1.374', 'weapon2': '1.850'}
[2023-02-25 12:31:40,553][2409407] DAMAGECOUNT value on done: 389.0
[2023-02-25 12:31:40,557][2409407] Sum rewards: -5.802, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.713', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'ARMOR': '0.045', 'weapon5': '0.074', 'AMMO3': '0.093', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'HITCOUNT': '0.200', 'WEAPON4': '0.450', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.600', 'weapon4': '0.644', 'DAMAGECOUNT': '0.957', 'weapon3': '1.078', 'weapon2': '1.464'}
[2023-02-25 12:31:40,699][2409468] DAMAGECOUNT value on done: 230.0
[2023-02-25 12:31:40,700][2409468] Sum rewards: -0.807, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.874', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'weapon4': '0.078', 'ARMOR': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.615', 'WEAPON3': '0.750', 'weapon2': '1.680', 'weapon3': '1.732', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:31:40,708][2409405] DAMAGECOUNT value on done: 690.0
[2023-02-25 12:31:40,709][2409405] Sum rewards: -4.166, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.854', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.009', 'weapon5': '0.010', 'ARMOR': '0.040', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'HITCOUNT': '0.220', 'weapon4': '0.352', 'WEAPON3': '0.900', 'DAMAGECOUNT': '0.915', 'FRAGCOUNT': '1.000', 'weapon2': '1.160', 'weapon3': '1.672'}
[2023-02-25 12:31:40,837][2409079] DAMAGECOUNT value on done: 407.0
[2023-02-25 12:31:40,840][2409079] Sum rewards: -1.150, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.571', 'AMMO2': '0.024', 'ARMOR': '0.064', 'AMMO3': '0.094', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'weapon4': '0.238', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.720', 'FRAGCOUNT': '1.000', 'weapon3': '1.324', 'weapon2': '1.718'}
[2023-02-25 12:31:41,133][2409547] DAMAGECOUNT value on done: 309.0
[2023-02-25 12:31:41,136][2409547] Sum rewards: -2.050, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.484', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'AMMO3': '0.093', 'weapon4': '0.224', 'HITCOUNT': '0.250', 'ARMOR': '0.489', 'DAMAGECOUNT': '0.591', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.364', 'weapon2': '1.464'}
[2023-02-25 12:31:41,155][2409596] DAMAGECOUNT value on done: 190.0
[2023-02-25 12:31:41,155][2409596] Sum rewards: -7.068, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.152', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.032', 'HITCOUNT': '0.070', 'AMMO4': '0.094', 'AMMO3': '0.101', 'weapon4': '0.142', 'DAMAGECOUNT': '0.174', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.504', 'WEAPON3': '0.650', 'weapon2': '1.302', 'weapon3': '1.786'}
[2023-02-25 12:31:41,268][2409078] DAMAGECOUNT value on done: 342.0
[2023-02-25 12:31:41,268][2409078] Sum rewards: -0.906, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.176', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.018', 'ARMOR': '0.020', 'AMMO4': '0.037', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'weapon4': '0.438', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.756', 'FRAGCOUNT': '1.000', 'weapon2': '1.208', 'weapon3': '1.522'}
[2023-02-25 12:31:41,426][2409074] Updated weights for policy 0, policy_version 4680 (0.0012)
[2023-02-25 12:31:42,167][2409486] DAMAGECOUNT value on done: 892.0
[2023-02-25 12:31:42,168][2409486] Sum rewards: -5.240, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.394', 'AMMO2': '0.027', 'WEAPON4': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.134', 'HITCOUNT': '0.200', 'weapon4': '0.228', 'DAMAGECOUNT': '0.750', 'ARMOR': '0.848', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.268', 'weapon2': '1.866'}
[2023-02-25 12:31:42,186][2408954] Fps is (10 sec: 26624.0, 60 sec: 25804.9, 300 sec: 25853.4). Total num frames: 19181568. Throughput: 0: 6413.4. Samples: 4794180. Policy #0 lag: (min: 0.0, avg: 9.4, max: 24.0)
[2023-02-25 12:31:42,186][2408954] Avg episode reward: [(0, '-2.780')]
[2023-02-25 12:31:42,395][2409389] DAMAGECOUNT value on done: 510.0
[2023-02-25 12:31:42,398][2409389] Sum rewards: 0.199, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.710', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'ARMOR': '0.028', 'AMMO4': '0.043', 'AMMO3': '0.071', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'weapon4': '0.418', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.900', 'weapon2': '1.162', 'weapon3': '1.458', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:42,566][2409075] DAMAGECOUNT value on done: 428.0
[2023-02-25 12:31:42,569][2409075] Sum rewards: -4.153, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.459', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.014', 'ARMOR': '0.068', 'AMMO4': '0.072', 'AMMO3': '0.086', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.315', 'weapon4': '0.368', 'WEAPON3': '0.500', 'weapon3': '1.372', 'weapon2': '1.444'}
[2023-02-25 12:31:42,693][2409099] DAMAGECOUNT value on done: 331.0
[2023-02-25 12:31:42,694][2409099] Sum rewards: -6.952, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.265', 'FRAGCOUNT': '-1.500', 'AMMO2': '0.006', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'weapon5': '0.050', 'HITCOUNT': '0.100', 'AMMO3': '0.117', 'WEAPON5': '0.200', 'weapon4': '0.250', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.850', 'weapon2': '1.112', 'weapon3': '1.920'}
[2023-02-25 12:31:42,957][2409104] DAMAGECOUNT value on done: 543.0
[2023-02-25 12:31:42,959][2409104] Sum rewards: -0.635, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.765', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO4': '0.083', 'AMMO3': '0.106', 'weapon4': '0.130', 'HITCOUNT': '0.240', 'WEAPON3': '0.600', 'weapon3': '1.412', 'DAMAGECOUNT': '1.467', 'weapon2': '1.604', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:31:42,959][2409548] DAMAGECOUNT value on done: 619.0
[2023-02-25 12:31:42,962][2409548] Sum rewards: -3.181, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.000', 'AMMO2': '0.033', 'ARMOR': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.158', 'AMMO4': '0.165', 'HITCOUNT': '0.220', 'weapon4': '0.352', 'WEAPON3': '0.900', 'weapon2': '0.930', 'DAMAGECOUNT': '1.020', 'weapon3': '1.630', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:43,019][2409406] DAMAGECOUNT value on done: 380.0
[2023-02-25 12:31:43,020][2409406] Sum rewards: -1.065, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.959', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'HITCOUNT': '0.130', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.598', 'weapon3': '1.740'}
[2023-02-25 12:31:43,380][2409105] DAMAGECOUNT value on done: 376.0
[2023-02-25 12:31:43,384][2409105] Sum rewards: 0.612, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.736', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.032', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.062', 'ARMOR': '0.064', 'weapon7': '0.066', 'HITCOUNT': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'weapon4': '0.400', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.750', 'weapon2': '0.864', 'weapon3': '1.110'}
[2023-02-25 12:31:43,665][2409074] Updated weights for policy 0, policy_version 4690 (0.0012)
[2023-02-25 12:31:43,676][2409077] DAMAGECOUNT value on done: 692.0
[2023-02-25 12:31:43,677][2409077] Sum rewards: -2.215, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.006', 'FRAGCOUNT': '-1.000', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.017', 'WEAPON1': '0.030', 'weapon4': '0.064', 'weapon5': '0.080', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.240', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.810', 'weapon2': '1.038', 'weapon3': '1.804'}
[2023-02-25 12:31:43,678][2409097] DAMAGECOUNT value on done: 89.0
[2023-02-25 12:31:43,798][2409080] DAMAGECOUNT value on done: 179.0
[2023-02-25 12:31:43,803][2409080] Sum rewards: -0.459, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.480', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.057', 'weapon5': '0.070', 'HITCOUNT': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.126', 'DAMAGECOUNT': '0.237', 'WEAPON3': '0.350', 'weapon3': '0.992', 'FRAGCOUNT': '1.000', 'weapon2': '1.444'}
[2023-02-25 12:31:43,814][2409866] DAMAGECOUNT value on done: 412.0
[2023-02-25 12:31:43,815][2409866] Sum rewards: -1.361, reward structure: {'DEATHCOUNT': '-9.000', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'HEALTH': '0.074', 'ARMOR': '0.121', 'AMMO3': '0.128', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'HITCOUNT': '0.220', 'weapon4': '0.284', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.726', 'weapon3': '1.410', 'weapon2': '1.658', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:43,889][2409355] DAMAGECOUNT value on done: 491.0
[2023-02-25 12:31:43,892][2409355] Sum rewards: -1.476, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.577', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.072', 'HITCOUNT': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.334', 'WEAPON3': '0.350', 'ARMOR': '0.428', 'DAMAGECOUNT': '0.585', 'weapon3': '0.768', 'weapon2': '1.516', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:44,219][2409076] DAMAGECOUNT value on done: 365.0
[2023-02-25 12:31:44,302][2409405] DAMAGECOUNT value on done: 434.0
[2023-02-25 12:31:44,303][2409405] Sum rewards: 2.417, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.490', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.088', 'WEAPON4': '0.200', 'HITCOUNT': '0.300', 'WEAPON3': '0.450', 'weapon4': '0.518', 'ARMOR': '0.572', 'DAMAGECOUNT': '0.888', 'weapon2': '1.366', 'weapon3': '1.446', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:31:44,307][2409407] DAMAGECOUNT value on done: 335.0
[2023-02-25 12:31:44,336][2409373] DAMAGECOUNT value on done: 232.0
[2023-02-25 12:31:44,339][2409373] Sum rewards: -1.860, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.217', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon5': '0.020', 'AMMO4': '0.063', 'ARMOR': '0.100', 'HITCOUNT': '0.130', 'AMMO3': '0.141', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.270', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.900', 'weapon2': '1.162', 'weapon3': '1.798', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:44,462][2409096] DAMAGECOUNT value on done: 575.0
[2023-02-25 12:31:44,467][2409096] Sum rewards: -6.207, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.540', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.034', 'ARMOR': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'weapon4': '0.210', 'HITCOUNT': '0.300', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.155', 'weapon2': '1.270', 'weapon3': '1.770', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:44,472][2409469] DAMAGECOUNT value on done: 430.0
[2023-02-25 12:31:44,473][2409469] Sum rewards: 0.444, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.756', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.053', 'weapon5': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.150', 'AMMO3': '0.154', 'WEAPON3': '0.750', 'ARMOR': '0.812', 'DAMAGECOUNT': '1.080', 'weapon3': '1.466', 'weapon2': '1.692', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:31:44,615][2409079] DAMAGECOUNT value on done: 282.0
[2023-02-25 12:31:44,616][2409079] Sum rewards: -0.256, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.230', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.008', 'WEAPON1': '0.040', 'weapon5': '0.048', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'WEAPON3': '0.450', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.576', 'weapon2': '1.162', 'weapon3': '1.384'}
[2023-02-25 12:31:44,678][2409468] DAMAGECOUNT value on done: 264.0
[2023-02-25 12:31:44,679][2409468] Sum rewards: 2.478, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.180', 'AMMO2': '0.011', 'weapon4': '0.040', 'AMMO4': '0.055', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'HITCOUNT': '0.140', 'DAMAGECOUNT': '0.372', 'WEAPON3': '0.450', 'ARMOR': '0.479', 'weapon2': '1.290', 'weapon3': '1.398', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:44,868][2409078] DAMAGECOUNT value on done: 131.0
[2023-02-25 12:31:45,027][2409074] Updated weights for policy 0, policy_version 4700 (0.0012)
[2023-02-25 12:31:45,533][2409547] DAMAGECOUNT value on done: 159.0
[2023-02-25 12:31:46,069][2409486] DAMAGECOUNT value on done: 230.0
[2023-02-25 12:31:46,070][2409486] Sum rewards: -4.374, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.322', 'AMMO2': '0.008', 'ARMOR': '0.008', 'AMMO4': '0.039', 'AMMO3': '0.100', 'HITCOUNT': '0.160', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.525', 'weapon4': '0.584', 'WEAPON3': '0.650', 'weapon3': '1.160', 'weapon2': '1.414', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:46,297][2409075] DAMAGECOUNT value on done: 460.0
[2023-02-25 12:31:46,300][2409075] Sum rewards: -5.252, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.422', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.008', 'AMMO2': '0.019', 'ARMOR': '0.028', 'weapon5': '0.030', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'HITCOUNT': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.308', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.840', 'weapon2': '1.132', 'weapon3': '1.754'}
[2023-02-25 12:31:46,377][2409099] DAMAGECOUNT value on done: 413.0
[2023-02-25 12:31:46,378][2409099] Sum rewards: -6.275, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.194', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.010', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'HITCOUNT': '0.110', 'AMMO4': '0.112', 'AMMO3': '0.135', 'WEAPON4': '0.150', 'weapon4': '0.158', 'DAMAGECOUNT': '0.465', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.214', 'weapon3': '1.936'}
[2023-02-25 12:31:46,609][2409406] DAMAGECOUNT value on done: 316.0
[2023-02-25 12:31:46,898][2409074] Updated weights for policy 0, policy_version 4710 (0.0012)
[2023-02-25 12:31:47,186][2408954] Fps is (10 sec: 24576.6, 60 sec: 25736.5, 300 sec: 25811.7). Total num frames: 19300352. Throughput: 0: 6418.9. Samples: 4832796. Policy #0 lag: (min: 0.0, avg: 11.8, max: 32.0)
[2023-02-25 12:31:47,186][2408954] Avg episode reward: [(0, '-2.613')]
[2023-02-25 12:31:47,228][2409077] DAMAGECOUNT value on done: 299.0
[2023-02-25 12:31:47,231][2409077] Sum rewards: 1.759, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.568', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.004', 'WEAPON1': '0.010', 'weapon5': '0.036', 'AMMO3': '0.063', 'WEAPON5': '0.100', 'HITCOUNT': '0.210', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.792', 'weapon2': '1.578', 'weapon3': '1.582', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:47,522][2409080] DAMAGECOUNT value on done: 310.0
[2023-02-25 12:31:47,717][2409866] DAMAGECOUNT value on done: 295.0
[2023-02-25 12:31:47,781][2409355] DAMAGECOUNT value on done: 397.0
[2023-02-25 12:31:47,782][2409355] Sum rewards: -5.980, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.815', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.010', 'weapon5': '0.036', 'WEAPON4': '0.050', 'ARMOR': '0.072', 'weapon4': '0.102', 'AMMO3': '0.139', 'WEAPON5': '0.200', 'HITCOUNT': '0.220', 'DAMAGECOUNT': '0.636', 'WEAPON3': '0.800', 'weapon2': '1.522', 'weapon3': '1.580', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:48,075][2409097] DAMAGECOUNT value on done: 294.0
[2023-02-25 12:31:48,078][2409097] Sum rewards: -1.070, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.017', 'ARMOR': '0.040', 'AMMO3': '0.070', 'AMMO4': '0.087', 'HITCOUNT': '0.120', 'HEALTH': '0.154', 'WEAPON4': '0.250', 'weapon4': '0.260', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.400', 'FRAGCOUNT': '1.000', 'weapon2': '1.466', 'weapon3': '1.486'}
[2023-02-25 12:31:48,171][2409096] DAMAGECOUNT value on done: 325.0
[2023-02-25 12:31:48,174][2409096] Sum rewards: -6.447, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.386', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon4': '0.054', 'AMMO4': '0.100', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'ARMOR': '0.505', 'DAMAGECOUNT': '0.630', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.480', 'weapon2': '1.934'}
[2023-02-25 12:31:48,178][2409076] DAMAGECOUNT value on done: 72.0
[2023-02-25 12:31:48,250][2409407] DAMAGECOUNT value on done: 405.0
[2023-02-25 12:31:48,251][2409407] Sum rewards: -3.630, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.783', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'WEAPON1': '0.010', 'AMMO3': '0.121', 'HITCOUNT': '0.200', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.870', 'ARMOR': '0.881', 'FRAGCOUNT': '1.000', 'weapon2': '1.634', 'weapon3': '1.770'}
[2023-02-25 12:31:48,284][2409373] DAMAGECOUNT value on done: 278.0
[2023-02-25 12:31:48,288][2409373] Sum rewards: -4.864, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.120', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'ARMOR': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.090', 'AMMO4': '0.093', 'weapon4': '0.192', 'HITCOUNT': '0.200', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.489', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.372', 'weapon2': '1.918'}
[2023-02-25 12:31:48,372][2409078] DAMAGECOUNT value on done: 408.0
[2023-02-25 12:31:48,374][2409078] Sum rewards: -3.198, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.560', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.030', 'AMMO4': '0.061', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.200', 'DAMAGECOUNT': '0.678', 'WEAPON3': '0.750', 'weapon3': '1.458', 'weapon2': '1.568', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:48,395][2409468] DAMAGECOUNT value on done: 312.0
[2023-02-25 12:31:48,398][2409468] Sum rewards: -5.520, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.006', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.008', 'weapon4': '0.066', 'weapon5': '0.074', 'ARMOR': '0.084', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.133', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.531', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.476', 'weapon2': '1.728'}
[2023-02-25 12:31:48,413][2409074] Updated weights for policy 0, policy_version 4720 (0.0012)
[2023-02-25 12:31:48,641][2409079] DAMAGECOUNT value on done: 377.0
[2023-02-25 12:31:48,642][2409079] Sum rewards: -3.731, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-2.000', 'HEALTH': '-0.462', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'weapon4': '0.134', 'HITCOUNT': '0.180', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.615', 'ARMOR': '1.300', 'weapon3': '1.398', 'weapon2': '1.608'}
[2023-02-25 12:31:49,295][2409074] Updated weights for policy 0, policy_version 4730 (0.0012)
[2023-02-25 12:31:49,806][2409547] DAMAGECOUNT value on done: 288.0
[2023-02-25 12:31:49,975][2409486] DAMAGECOUNT value on done: 562.0
[2023-02-25 12:31:49,978][2409486] Sum rewards: -4.578, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.534', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.050', 'ARMOR': '0.052', 'AMMO3': '0.156', 'HITCOUNT': '0.190', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.960', 'weapon3': '1.638', 'weapon2': '1.684'}
[2023-02-25 12:31:50,337][2409099] DAMAGECOUNT value on done: 170.0
[2023-02-25 12:31:50,338][2409099] Sum rewards: -2.239, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.061', 'AMMO5': '0.003', 'weapon5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.083', 'AMMO4': '0.118', 'HITCOUNT': '0.120', 'weapon4': '0.180', 'WEAPON4': '0.250', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.510', 'weapon2': '1.416', 'weapon3': '1.754'}
[2023-02-25 12:31:51,334][2409080] DAMAGECOUNT value on done: 225.0
[2023-02-25 12:31:51,621][2409074] Updated weights for policy 0, policy_version 4740 (0.0012)
[2023-02-25 12:31:52,116][2409076] DAMAGECOUNT value on done: 342.0
[2023-02-25 12:31:52,117][2409076] Sum rewards: -1.493, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.737', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.012', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.086', 'AMMO3': '0.116', 'HITCOUNT': '0.230', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.666', 'WEAPON3': '0.750', 'weapon2': '1.342', 'weapon3': '1.806', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:52,186][2408954] Fps is (10 sec: 24575.1, 60 sec: 25599.8, 300 sec: 25825.6). Total num frames: 19427328. Throughput: 0: 6422.1. Samples: 4852104. Policy #0 lag: (min: 2.0, avg: 13.5, max: 27.0)
[2023-02-25 12:31:52,186][2408954] Avg episode reward: [(0, '-2.923')]
[2023-02-25 12:31:52,250][2409097] DAMAGECOUNT value on done: 367.0
[2023-02-25 12:31:52,251][2409097] Sum rewards: -3.546, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.602', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.052', 'weapon4': '0.068', 'AMMO3': '0.110', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'HITCOUNT': '0.230', 'ARMOR': '0.428', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.831', 'weapon2': '1.408', 'weapon3': '1.688'}
[2023-02-25 12:31:52,284][2409079] DAMAGECOUNT value on done: 345.0
[2023-02-25 12:31:52,285][2409079] Sum rewards: 1.293, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.376', 'AMMO2': '0.016', 'ARMOR': '0.040', 'AMMO4': '0.079', 'AMMO3': '0.118', 'HITCOUNT': '0.180', 'WEAPON4': '0.250', 'weapon4': '0.352', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.700', 'weapon3': '1.298', 'weapon2': '1.566', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:31:52,286][2409468] DAMAGECOUNT value on done: 469.0
[2023-02-25 12:31:52,288][2409468] Sum rewards: -0.781, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.392', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'AMMO4': '0.068', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.150', 'HITCOUNT': '0.280', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.077', 'weapon2': '1.352', 'weapon3': '1.906', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:52,837][2409074] Updated weights for policy 0, policy_version 4750 (0.0012)
[2023-02-25 12:31:53,835][2409486] DAMAGECOUNT value on done: 356.0
[2023-02-25 12:31:53,838][2409486] Sum rewards: 0.202, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.963', 'AMMO2': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.098', 'WEAPON4': '0.150', 'HITCOUNT': '0.200', 'weapon4': '0.386', 'ARMOR': '0.511', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.663', 'weapon2': '1.170', 'weapon3': '1.748', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:31:53,870][2409547] DAMAGECOUNT value on done: 445.0
[2023-02-25 12:31:53,871][2409547] Sum rewards: -5.500, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.190', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'HITCOUNT': '0.210', 'weapon4': '0.232', 'ARMOR': '0.491', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.864', 'FRAGCOUNT': '1.000', 'weapon3': '1.586', 'weapon2': '1.622'}
[2023-02-25 12:31:54,220][2409099] DAMAGECOUNT value on done: 315.0
[2023-02-25 12:31:54,221][2409099] Sum rewards: -0.893, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.116', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.121', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'weapon4': '0.300', 'ARMOR': '0.456', 'DAMAGECOUNT': '0.630', 'WEAPON3': '0.700', 'weapon2': '1.092', 'weapon3': '1.784', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:31:54,687][2409074] Updated weights for policy 0, policy_version 4760 (0.0014)
[2023-02-25 12:31:55,195][2409080] DAMAGECOUNT value on done: 513.0
[2023-02-25 12:31:55,199][2409080] Sum rewards: -8.129, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.967', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.003', 'weapon5': '0.016', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.132', 'HITCOUNT': '0.180', 'weapon4': '0.216', 'ARMOR': '0.525', 'DAMAGECOUNT': '0.594', 'WEAPON3': '0.850', 'weapon2': '1.550', 'weapon3': '1.620'}
[2023-02-25 12:31:56,117][2409468] DAMAGECOUNT value on done: 163.0
[2023-02-25 12:31:56,161][2409074] Updated weights for policy 0, policy_version 4770 (0.0012)
[2023-02-25 12:31:56,647][2409079] DAMAGECOUNT value on done: 175.0
[2023-02-25 12:31:57,186][2408954] Fps is (10 sec: 26624.0, 60 sec: 25804.9, 300 sec: 25825.6). Total num frames: 19566592. Throughput: 0: 6448.3. Samples: 4891248. Policy #0 lag: (min: 0.0, avg: 11.8, max: 28.0)
[2023-02-25 12:31:57,186][2408954] Avg episode reward: [(0, '-2.931')]
[2023-02-25 12:31:57,693][2409547] DAMAGECOUNT value on done: 388.0
[2023-02-25 12:31:58,021][2409074] Updated weights for policy 0, policy_version 4780 (0.0012)
[2023-02-25 12:31:58,033][2409099] DAMAGECOUNT value on done: 427.0
[2023-02-25 12:31:58,036][2409099] Sum rewards: -4.699, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.824', 'AMMO2': '0.013', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.141', 'weapon4': '0.188', 'DAMAGECOUNT': '0.375', 'ARMOR': '0.501', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.366', 'weapon2': '1.404'}
[2023-02-25 12:31:59,208][2409080] DAMAGECOUNT value on done: 665.0
[2023-02-25 12:31:59,213][2409080] Sum rewards: -1.791, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.606', 'AMMO5': '0.005', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO4': '0.095', 'AMMO3': '0.103', 'weapon5': '0.104', 'WEAPON4': '0.150', 'HITCOUNT': '0.200', 'ARMOR': '0.404', 'weapon4': '0.414', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.160', 'DAMAGECOUNT': '1.215', 'weapon3': '1.546'}
[2023-02-25 12:31:59,683][2409074] Updated weights for policy 0, policy_version 4790 (0.0012)
[2023-02-25 12:32:00,334][2409468] DAMAGECOUNT value on done: 486.0
[2023-02-25 12:32:00,342][2409468] Sum rewards: -3.375, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.708', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'ARMOR': '0.036', 'weapon7': '0.058', 'AMMO4': '0.084', 'AMMO3': '0.104', 'HITCOUNT': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.286', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.358', 'weapon2': '1.600'}
[2023-02-25 12:32:00,760][2409074] Updated weights for policy 0, policy_version 4800 (0.0012)
[2023-02-25 12:32:01,436][2409547] DAMAGECOUNT value on done: 380.0
[2023-02-25 12:32:01,438][2409547] Sum rewards: -3.208, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.811', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'WEAPON1': '0.020', 'ARMOR': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'HITCOUNT': '0.180', 'weapon4': '0.220', 'DAMAGECOUNT': '0.630', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.354', 'weapon3': '1.642'}
[2023-02-25 12:32:01,743][2409099] DAMAGECOUNT value on done: 400.0
[2023-02-25 12:32:01,746][2409099] Sum rewards: -2.353, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.120', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.012', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'ARMOR': '0.020', 'weapon5': '0.070', 'AMMO4': '0.072', 'HITCOUNT': '0.090', 'AMMO3': '0.097', 'WEAPON4': '0.200', 'weapon4': '0.220', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.675', 'weapon2': '1.276', 'weapon3': '1.650'}
[2023-02-25 12:32:02,186][2408954] Fps is (10 sec: 25395.7, 60 sec: 25668.2, 300 sec: 25756.2). Total num frames: 19681280. Throughput: 0: 6440.0. Samples: 4929228. Policy #0 lag: (min: 0.0, avg: 12.0, max: 28.0)
[2023-02-25 12:32:02,186][2408954] Avg episode reward: [(0, '-2.998')]
[2023-02-25 12:32:02,584][2409074] Updated weights for policy 0, policy_version 4810 (0.0012)
[2023-02-25 12:32:03,185][2409080] DAMAGECOUNT value on done: 577.0
[2023-02-25 12:32:03,185][2409080] Sum rewards: -1.376, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.109', 'AMMO2': '0.003', 'AMMO4': '0.015', 'ARMOR': '0.052', 'AMMO3': '0.163', 'HITCOUNT': '0.310', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.290', 'weapon2': '1.480', 'weapon3': '2.020', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:32:04,364][2409074] Updated weights for policy 0, policy_version 4820 (0.0013)
[2023-02-25 12:32:04,405][2409468] DAMAGECOUNT value on done: 325.0
[2023-02-25 12:32:04,408][2409468] Sum rewards: -4.664, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-3.000', 'HEALTH': '-0.190', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'ARMOR': '0.020', 'AMMO4': '0.039', 'weapon5': '0.082', 'AMMO3': '0.086', 'HITCOUNT': '0.140', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.550', 'weapon2': '1.214', 'weapon3': '1.806'}
[2023-02-25 12:32:05,499][2409547] DAMAGECOUNT value on done: 217.0
[2023-02-25 12:32:05,502][2409547] Sum rewards: -2.323, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.076', 'AMMO3': '0.078', 'HITCOUNT': '0.080', 'HEALTH': '0.150', 'AMMO4': '0.169', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.255', 'weapon4': '0.340', 'WEAPON3': '0.400', 'ARMOR': '0.408', 'weapon3': '0.562', 'weapon2': '2.362'}
[2023-02-25 12:32:05,965][2409074] Updated weights for policy 0, policy_version 4830 (0.0012)
[2023-02-25 12:32:07,102][2409080] DAMAGECOUNT value on done: 577.0
[2023-02-25 12:32:07,103][2409080] Sum rewards: -1.115, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.820', 'AMMO5': '0.003', 'weapon5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'AMMO3': '0.083', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'weapon4': '0.312', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.501', 'FRAGCOUNT': '1.000', 'weapon3': '1.368', 'weapon2': '1.410'}
[2023-02-25 12:32:07,186][2408954] Fps is (10 sec: 24575.2, 60 sec: 25463.3, 300 sec: 25825.6). Total num frames: 19812352. Throughput: 0: 6432.5. Samples: 4947888. Policy #0 lag: (min: 0.0, avg: 12.7, max: 25.0)
[2023-02-25 12:32:07,188][2408954] Avg episode reward: [(0, '-2.966')]
[2023-02-25 12:32:07,741][2409074] Updated weights for policy 0, policy_version 4840 (0.0012)
[2023-02-25 12:32:08,268][2409468] DAMAGECOUNT value on done: 169.0
[2023-02-25 12:32:08,273][2409468] Sum rewards: -1.157, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.365', 'AMMO2': '0.013', 'ARMOR': '0.040', 'AMMO4': '0.063', 'AMMO3': '0.088', 'HITCOUNT': '0.140', 'WEAPON4': '0.200', 'weapon4': '0.302', 'DAMAGECOUNT': '0.432', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon2': '1.078', 'weapon3': '1.602'}
[2023-02-25 12:32:08,994][2409074] Updated weights for policy 0, policy_version 4850 (0.0012)
[2023-02-25 12:32:10,591][2409074] Updated weights for policy 0, policy_version 4860 (0.0012)
[2023-02-25 12:32:11,033][2409080] DAMAGECOUNT value on done: 489.0
[2023-02-25 12:32:11,035][2409080] Sum rewards: -2.644, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.420', 'AMMO2': '0.017', 'ARMOR': '0.032', 'AMMO4': '0.083', 'AMMO3': '0.096', 'weapon4': '0.194', 'HITCOUNT': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.588', 'FRAGCOUNT': '1.000', 'weapon3': '1.242', 'weapon2': '1.974'}
[2023-02-25 12:32:11,834][2409074] Updated weights for policy 0, policy_version 4870 (0.0012)
[2023-02-25 12:32:12,126][2409105] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 12:32:12,186][2408954] Fps is (10 sec: 27443.7, 60 sec: 26009.6, 300 sec: 25825.6). Total num frames: 19955712. Throughput: 0: 6435.2. Samples: 4987212. Policy #0 lag: (min: 0.0, avg: 14.0, max: 27.0)
[2023-02-25 12:32:12,186][2408954] Avg episode reward: [(0, '-2.933')]
[2023-02-25 12:32:12,224][2409468] DAMAGECOUNT value on done: 160.0
[2023-02-25 12:32:12,225][2409468] Sum rewards: -0.707, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.282', 'AMMO2': '0.010', 'AMMO4': '0.047', 'HITCOUNT': '0.070', 'AMMO3': '0.107', 'DAMAGECOUNT': '0.225', 'ARMOR': '0.444', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.548', 'weapon2': '1.824'}
[2023-02-25 12:32:13,927][2409074] Updated weights for policy 0, policy_version 4880 (0.0012)
[2023-02-25 12:32:15,343][2409074] Updated weights for policy 0, policy_version 4890 (0.0012)
[2023-02-25 12:32:16,013][2409468] DAMAGECOUNT value on done: 222.0
[2023-02-25 12:32:16,016][2409468] Sum rewards: -2.404, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.602', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.122', 'weapon4': '0.196', 'DAMAGECOUNT': '0.390', 'ARMOR': '0.509', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.228', 'weapon3': '1.456'}
[2023-02-25 12:32:17,186][2408954] Fps is (10 sec: 25395.9, 60 sec: 25600.0, 300 sec: 25742.3). Total num frames: 20066304. Throughput: 0: 6425.3. Samples: 5025864. Policy #0 lag: (min: 1.0, avg: 12.3, max: 26.0)
[2023-02-25 12:32:17,186][2408954] Avg episode reward: [(0, '-2.860')]
[2023-02-25 12:32:17,190][2409033] Saving /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000004899_20066304.pth...
[2023-02-25 12:32:17,291][2409033] Removing /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000003395_13905920.pth
[2023-02-25 12:32:17,375][2409074] Updated weights for policy 0, policy_version 4900 (0.0013)
[2023-02-25 12:32:18,810][2409074] Updated weights for policy 0, policy_version 4910 (0.0013)
[2023-02-25 12:32:19,647][2409074] Updated weights for policy 0, policy_version 4920 (0.0014)
[2023-02-25 12:32:21,873][2409074] Updated weights for policy 0, policy_version 4930 (0.0012)
[2023-02-25 12:32:22,186][2408954] Fps is (10 sec: 24165.8, 60 sec: 25531.6, 300 sec: 25770.1). Total num frames: 20197376. Throughput: 0: 6434.1. Samples: 5045016. Policy #0 lag: (min: 1.0, avg: 12.2, max: 28.0)
[2023-02-25 12:32:22,186][2408954] Avg episode reward: [(0, '-2.860')]
[2023-02-25 12:32:23,070][2409074] Updated weights for policy 0, policy_version 4940 (0.0012)
[2023-02-25 12:32:23,104][2409033] Signal inference workers to stop experience collection... (700 times)
[2023-02-25 12:32:23,118][2409033] Signal inference workers to resume experience collection... (700 times)
[2023-02-25 12:32:23,135][2409074] InferenceWorker_p0-w0: stopping experience collection (700 times)
[2023-02-25 12:32:23,154][2409074] InferenceWorker_p0-w0: resuming experience collection (700 times)
[2023-02-25 12:32:24,897][2409074] Updated weights for policy 0, policy_version 4950 (0.0012)
[2023-02-25 12:32:26,512][2409074] Updated weights for policy 0, policy_version 4960 (0.0012)
[2023-02-25 12:32:27,186][2408954] Fps is (10 sec: 28262.5, 60 sec: 26009.6, 300 sec: 25839.5). Total num frames: 20348928. Throughput: 0: 6447.5. Samples: 5084316. Policy #0 lag: (min: 0.0, avg: 13.4, max: 24.0)
[2023-02-25 12:32:27,186][2408954] Avg episode reward: [(0, '-2.860')]
[2023-02-25 12:32:28,137][2409074] Updated weights for policy 0, policy_version 4970 (0.0012)
[2023-02-25 12:32:29,965][2409074] Updated weights for policy 0, policy_version 4980 (0.0012)
[2023-02-25 12:32:30,811][2409074] Updated weights for policy 0, policy_version 4990 (0.0012)
[2023-02-25 12:32:32,186][2408954] Fps is (10 sec: 26215.0, 60 sec: 25736.5, 300 sec: 25770.1). Total num frames: 20459520. Throughput: 0: 6437.6. Samples: 5122488. Policy #0 lag: (min: 0.0, avg: 12.2, max: 26.0)
[2023-02-25 12:32:32,186][2408954] Avg episode reward: [(0, '-2.860')]
[2023-02-25 12:32:33,071][2409074] Updated weights for policy 0, policy_version 5000 (0.0012)
[2023-02-25 12:32:34,306][2409074] Updated weights for policy 0, policy_version 5010 (0.0013)
[2023-02-25 12:32:35,894][2409074] Updated weights for policy 0, policy_version 5020 (0.0013)
[2023-02-25 12:32:37,186][2408954] Fps is (10 sec: 23756.8, 60 sec: 25531.8, 300 sec: 25797.9). Total num frames: 20586496. Throughput: 0: 6440.3. Samples: 5141916. Policy #0 lag: (min: 0.0, avg: 11.0, max: 26.0)
[2023-02-25 12:32:37,186][2408954] Avg episode reward: [(0, '-2.860')]
[2023-02-25 12:32:37,889][2409074] Updated weights for policy 0, policy_version 5030 (0.0013)
[2023-02-25 12:32:38,772][2409074] Updated weights for policy 0, policy_version 5040 (0.0012)
[2023-02-25 12:32:40,813][2409074] Updated weights for policy 0, policy_version 5050 (0.0013)
[2023-02-25 12:32:42,094][2409074] Updated weights for policy 0, policy_version 5060 (0.0012)
[2023-02-25 12:32:42,186][2408954] Fps is (10 sec: 27033.5, 60 sec: 25804.8, 300 sec: 25784.0). Total num frames: 20729856. Throughput: 0: 6436.0. Samples: 5180868. Policy #0 lag: (min: 0.0, avg: 14.3, max: 24.0)
[2023-02-25 12:32:42,186][2408954] Avg episode reward: [(0, '-2.860')]
[2023-02-25 12:32:43,747][2409074] Updated weights for policy 0, policy_version 5070 (0.0013)
[2023-02-25 12:32:45,495][2409074] Updated weights for policy 0, policy_version 5080 (0.0012)
[2023-02-25 12:32:46,455][2409074] Updated weights for policy 0, policy_version 5090 (0.0012)
[2023-02-25 12:32:47,186][2408954] Fps is (10 sec: 26623.1, 60 sec: 25872.9, 300 sec: 25783.9). Total num frames: 20852736. Throughput: 0: 6463.7. Samples: 5220096. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0)
[2023-02-25 12:32:47,186][2408954] Avg episode reward: [(0, '-2.860')]
[2023-02-25 12:32:48,985][2409074] Updated weights for policy 0, policy_version 5100 (0.0012)
[2023-02-25 12:32:49,837][2409074] Updated weights for policy 0, policy_version 5110 (0.0013)
[2023-02-25 12:32:51,761][2409074] Updated weights for policy 0, policy_version 5120 (0.0012)
[2023-02-25 12:32:52,186][2408954] Fps is (10 sec: 24985.3, 60 sec: 25873.2, 300 sec: 25770.1). Total num frames: 20979712. Throughput: 0: 6475.8. Samples: 5239296. Policy #0 lag: (min: 0.0, avg: 12.1, max: 28.0)
[2023-02-25 12:32:52,186][2408954] Avg episode reward: [(0, '-2.860')]
[2023-02-25 12:32:53,398][2409074] Updated weights for policy 0, policy_version 5130 (0.0013)
[2023-02-25 12:32:55,209][2409074] Updated weights for policy 0, policy_version 5140 (0.0012)
[2023-02-25 12:32:56,862][2409074] Updated weights for policy 0, policy_version 5150 (0.0014)
[2023-02-25 12:32:57,186][2408954] Fps is (10 sec: 25395.4, 60 sec: 25668.2, 300 sec: 25742.3). Total num frames: 21106688. Throughput: 0: 6453.8. Samples: 5277636. Policy #0 lag: (min: 0.0, avg: 14.2, max: 27.0)
[2023-02-25 12:32:57,186][2408954] Avg episode reward: [(0, '-2.860')]
[2023-02-25 12:32:57,820][2409074] Updated weights for policy 0, policy_version 5160 (0.0013)
[2023-02-25 12:32:59,742][2409074] Updated weights for policy 0, policy_version 5170 (0.0012)
[2023-02-25 12:33:01,221][2409074] Updated weights for policy 0, policy_version 5180 (0.0012)
[2023-02-25 12:33:02,186][2408954] Fps is (10 sec: 25395.4, 60 sec: 25873.1, 300 sec: 25728.4). Total num frames: 21233664. Throughput: 0: 6448.8. Samples: 5316060. Policy #0 lag: (min: 1.0, avg: 13.9, max: 26.0)
[2023-02-25 12:33:02,186][2408954] Avg episode reward: [(0, '-2.860')]
[2023-02-25 12:33:02,929][2409074] Updated weights for policy 0, policy_version 5190 (0.0012)
[2023-02-25 12:33:04,620][2409074] Updated weights for policy 0, policy_version 5200 (0.0013)
[2023-02-25 12:33:06,145][2409074] Updated weights for policy 0, policy_version 5210 (0.0012)
[2023-02-25 12:33:07,186][2408954] Fps is (10 sec: 26215.1, 60 sec: 25941.5, 300 sec: 25811.7). Total num frames: 21368832. Throughput: 0: 6452.3. Samples: 5335368. Policy #0 lag: (min: 1.0, avg: 12.5, max: 23.0)
[2023-02-25 12:33:07,186][2408954] Avg episode reward: [(0, '-2.860')]
[2023-02-25 12:33:07,948][2409074] Updated weights for policy 0, policy_version 5220 (0.0014)
[2023-02-25 12:33:09,452][2409074] Updated weights for policy 0, policy_version 5230 (0.0012)
[2023-02-25 12:33:10,804][2409074] Updated weights for policy 0, policy_version 5240 (0.0013)
[2023-02-25 12:33:12,186][2408954] Fps is (10 sec: 25804.7, 60 sec: 25599.9, 300 sec: 25714.5). Total num frames: 21491712. Throughput: 0: 6443.7. Samples: 5374284. Policy #0 lag: (min: 0.0, avg: 12.5, max: 24.0)
[2023-02-25 12:33:12,186][2408954] Avg episode reward: [(0, '-2.860')]
[2023-02-25 12:33:12,411][2409074] Updated weights for policy 0, policy_version 5250 (0.0012)
[2023-02-25 12:33:13,921][2409074] Updated weights for policy 0, policy_version 5260 (0.0012)
[2023-02-25 12:33:15,811][2409074] Updated weights for policy 0, policy_version 5270 (0.0012)
[2023-02-25 12:33:17,186][2408954] Fps is (10 sec: 24985.4, 60 sec: 25873.1, 300 sec: 25728.5). Total num frames: 21618688. Throughput: 0: 6443.7. Samples: 5412456. Policy #0 lag: (min: 0.0, avg: 11.6, max: 25.0)
[2023-02-25 12:33:17,186][2408954] Avg episode reward: [(0, '-2.860')]
[2023-02-25 12:33:17,301][2409074] Updated weights for policy 0, policy_version 5280 (0.0012)
[2023-02-25 12:33:18,926][2409074] Updated weights for policy 0, policy_version 5290 (0.0012)
[2023-02-25 12:33:20,750][2409074] Updated weights for policy 0, policy_version 5300 (0.0012)
[2023-02-25 12:33:21,862][2409074] Updated weights for policy 0, policy_version 5310 (0.0012)
[2023-02-25 12:33:22,186][2408954] Fps is (10 sec: 26214.6, 60 sec: 25941.4, 300 sec: 25728.5). Total num frames: 21753856. Throughput: 0: 6434.4. Samples: 5431464. Policy #0 lag: (min: 0.0, avg: 11.5, max: 25.0)
[2023-02-25 12:33:22,186][2408954] Avg episode reward: [(0, '-2.860')]
[2023-02-25 12:33:24,121][2409074] Updated weights for policy 0, policy_version 5320 (0.0012)
[2023-02-25 12:33:25,422][2409074] Updated weights for policy 0, policy_version 5330 (0.0012)
[2023-02-25 12:33:26,730][2409074] Updated weights for policy 0, policy_version 5340 (0.0013)
[2023-02-25 12:33:27,186][2408954] Fps is (10 sec: 25805.0, 60 sec: 25463.5, 300 sec: 25686.8). Total num frames: 21876736. Throughput: 0: 6435.2. Samples: 5470452. Policy #0 lag: (min: 0.0, avg: 14.7, max: 27.0)
[2023-02-25 12:33:27,186][2408954] Avg episode reward: [(0, '-2.860')]
[2023-02-25 12:33:28,345][2409074] Updated weights for policy 0, policy_version 5350 (0.0014)
[2023-02-25 12:33:29,421][2409033] Signal inference workers to stop experience collection... (750 times)
[2023-02-25 12:33:29,423][2409033] Signal inference workers to resume experience collection... (750 times)
[2023-02-25 12:33:29,444][2409074] InferenceWorker_p0-w0: stopping experience collection (750 times)
[2023-02-25 12:33:29,444][2409074] InferenceWorker_p0-w0: resuming experience collection (750 times)
[2023-02-25 12:33:29,953][2409074] Updated weights for policy 0, policy_version 5360 (0.0012)
[2023-02-25 12:33:31,768][2409074] Updated weights for policy 0, policy_version 5370 (0.0012)
[2023-02-25 12:33:32,186][2408954] Fps is (10 sec: 26213.6, 60 sec: 25941.2, 300 sec: 25756.2). Total num frames: 22016000. Throughput: 0: 6427.5. Samples: 5509332. Policy #0 lag: (min: 0.0, avg: 11.8, max: 26.0)
[2023-02-25 12:33:32,186][2408954] Avg episode reward: [(0, '-2.860')]
[2023-02-25 12:33:33,026][2409074] Updated weights for policy 0, policy_version 5380 (0.0012)
[2023-02-25 12:33:35,073][2409074] Updated weights for policy 0, policy_version 5390 (0.0013)
[2023-02-25 12:33:36,358][2409074] Updated weights for policy 0, policy_version 5400 (0.0012)
[2023-02-25 12:33:37,186][2408954] Fps is (10 sec: 26213.5, 60 sec: 25872.9, 300 sec: 25742.3). Total num frames: 22138880. Throughput: 0: 6430.9. Samples: 5528688. Policy #0 lag: (min: 0.0, avg: 12.1, max: 25.0)
[2023-02-25 12:33:37,187][2408954] Avg episode reward: [(0, '-2.860')]
[2023-02-25 12:33:37,764][2409074] Updated weights for policy 0, policy_version 5410 (0.0012)
[2023-02-25 12:33:39,575][2409074] Updated weights for policy 0, policy_version 5420 (0.0012)
[2023-02-25 12:33:41,067][2409074] Updated weights for policy 0, policy_version 5430 (0.0012)
[2023-02-25 12:33:42,186][2408954] Fps is (10 sec: 25395.8, 60 sec: 25668.2, 300 sec: 25714.5). Total num frames: 22269952. Throughput: 0: 6440.8. Samples: 5567472. Policy #0 lag: (min: 0.0, avg: 13.4, max: 28.0)
[2023-02-25 12:33:42,186][2408954] Avg episode reward: [(0, '-2.860')]
[2023-02-25 12:33:42,786][2409074] Updated weights for policy 0, policy_version 5440 (0.0012)
[2023-02-25 12:33:44,097][2409074] Updated weights for policy 0, policy_version 5450 (0.0012)
[2023-02-25 12:33:45,757][2409074] Updated weights for policy 0, policy_version 5460 (0.0012)
[2023-02-25 12:33:47,186][2408954] Fps is (10 sec: 25805.5, 60 sec: 25736.6, 300 sec: 25672.9). Total num frames: 22396928. Throughput: 0: 6453.1. Samples: 5606448. Policy #0 lag: (min: 0.0, avg: 11.0, max: 23.0)
[2023-02-25 12:33:47,187][2408954] Avg episode reward: [(0, '-2.860')]
[2023-02-25 12:33:47,360][2409074] Updated weights for policy 0, policy_version 5470 (0.0013)
[2023-02-25 12:33:49,229][2409074] Updated weights for policy 0, policy_version 5480 (0.0013)
[2023-02-25 12:33:50,606][2409074] Updated weights for policy 0, policy_version 5490 (0.0013)
[2023-02-25 12:33:52,036][2409074] Updated weights for policy 0, policy_version 5500 (0.0013)
[2023-02-25 12:33:52,186][2408954] Fps is (10 sec: 25805.0, 60 sec: 25804.9, 300 sec: 25728.4). Total num frames: 22528000. Throughput: 0: 6459.2. Samples: 5626032. Policy #0 lag: (min: 0.0, avg: 11.0, max: 23.0)
[2023-02-25 12:33:52,186][2408954] Avg episode reward: [(0, '-2.860')]
[2023-02-25 12:33:53,915][2409074] Updated weights for policy 0, policy_version 5510 (0.0013)
[2023-02-25 12:33:55,271][2409074] Updated weights for policy 0, policy_version 5520 (0.0012)
[2023-02-25 12:33:56,962][2409074] Updated weights for policy 0, policy_version 5530 (0.0012)
[2023-02-25 12:33:57,186][2408954] Fps is (10 sec: 26214.6, 60 sec: 25873.2, 300 sec: 25700.7). Total num frames: 22659072. Throughput: 0: 6453.1. Samples: 5664672. Policy #0 lag: (min: 0.0, avg: 13.2, max: 26.0)
[2023-02-25 12:33:57,186][2408954] Avg episode reward: [(0, '-2.860')]
[2023-02-25 12:33:58,504][2409074] Updated weights for policy 0, policy_version 5540 (0.0012)
[2023-02-25 12:34:00,100][2409074] Updated weights for policy 0, policy_version 5550 (0.0014)
[2023-02-25 12:34:00,917][2409547] Large shaping reward -2.506 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HITCOUNT', 0.01, 1.0), ('DAMAGECOUNT', 0.033, 11.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 12:34:01,613][2409074] Updated weights for policy 0, policy_version 5560 (0.0012)
[2023-02-25 12:34:02,186][2408954] Fps is (10 sec: 25804.8, 60 sec: 25873.1, 300 sec: 25672.9). Total num frames: 22786048. Throughput: 0: 6466.7. Samples: 5703456. Policy #0 lag: (min: 0.0, avg: 12.3, max: 28.0)
[2023-02-25 12:34:02,186][2408954] Avg episode reward: [(0, '-2.860')]
[2023-02-25 12:34:03,203][2409074] Updated weights for policy 0, policy_version 5570 (0.0012)
[2023-02-25 12:34:05,021][2409074] Updated weights for policy 0, policy_version 5580 (0.0012)
[2023-02-25 12:34:06,318][2409074] Updated weights for policy 0, policy_version 5590 (0.0012)
[2023-02-25 12:34:07,186][2408954] Fps is (10 sec: 25804.1, 60 sec: 25804.7, 300 sec: 25686.8). Total num frames: 22917120. Throughput: 0: 6481.0. Samples: 5723112. Policy #0 lag: (min: 0.0, avg: 12.0, max: 25.0)
[2023-02-25 12:34:07,187][2408954] Avg episode reward: [(0, '-2.860')]
[2023-02-25 12:34:07,934][2409074] Updated weights for policy 0, policy_version 5600 (0.0013)
[2023-02-25 12:34:09,476][2409074] Updated weights for policy 0, policy_version 5610 (0.0012)
[2023-02-25 12:34:10,354][2409076] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 12:34:10,677][2409103] DAMAGECOUNT value on done: 317.0
[2023-02-25 12:34:10,678][2409103] Sum rewards: -1.042, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.062', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.090', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.104', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.621', 'weapon3': '1.786', 'weapon2': '1.816', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:10,994][2409074] Updated weights for policy 0, policy_version 5620 (0.0012)
[2023-02-25 12:34:12,186][2408954] Fps is (10 sec: 25804.7, 60 sec: 25873.1, 300 sec: 25714.6). Total num frames: 23044096. Throughput: 0: 6476.8. Samples: 5761908. Policy #0 lag: (min: 0.0, avg: 13.6, max: 25.0)
[2023-02-25 12:34:12,186][2408954] Avg episode reward: [(0, '-2.832')]
[2023-02-25 12:34:12,870][2409074] Updated weights for policy 0, policy_version 5630 (0.0012)
[2023-02-25 12:34:13,714][2409100] DAMAGECOUNT value on done: 601.0
[2023-02-25 12:34:13,717][2409100] Sum rewards: -5.189, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.010', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.011', 'AMMO5': '0.011', 'AMMO4': '0.054', 'weapon5': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.139', 'weapon4': '0.198', 'HITCOUNT': '0.220', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.789', 'weapon3': '1.418', 'weapon2': '1.492'}
[2023-02-25 12:34:14,423][2409074] Updated weights for policy 0, policy_version 5640 (0.0013)
[2023-02-25 12:34:14,966][2409103] DAMAGECOUNT value on done: 533.0
[2023-02-25 12:34:14,967][2409103] Sum rewards: -3.155, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.270', 'AMMO5': '0.005', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.077', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.250', 'weapon4': '0.368', 'ARMOR': '0.436', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.969', 'weapon3': '1.338', 'weapon2': '1.442', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:15,046][2409549] DAMAGECOUNT value on done: 333.0
[2023-02-25 12:34:15,047][2409549] Sum rewards: -1.523, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.990', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.016', 'weapon5': '0.040', 'WEAPON5': '0.050', 'HITCOUNT': '0.080', 'AMMO3': '0.119', 'WEAPON4': '0.200', 'weapon4': '0.386', 'ARMOR': '0.460', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.720', 'FRAGCOUNT': '1.000', 'weapon2': '1.174', 'weapon3': '1.616'}
[2023-02-25 12:34:15,623][2409102] DAMAGECOUNT value on done: 563.0
[2023-02-25 12:34:15,642][2409102] Sum rewards: -2.293, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.235', 'AMMO2': '0.006', 'AMMO4': '0.031', 'AMMO3': '0.098', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'weapon4': '0.414', 'DAMAGECOUNT': '0.684', 'WEAPON3': '0.700', 'ARMOR': '0.908', 'FRAGCOUNT': '1.000', 'weapon3': '1.390', 'weapon2': '1.600'}
[2023-02-25 12:34:15,923][2409074] Updated weights for policy 0, policy_version 5650 (0.0012)
[2023-02-25 12:34:17,186][2408954] Fps is (10 sec: 25805.4, 60 sec: 25941.4, 300 sec: 25672.9). Total num frames: 23175168. Throughput: 0: 6454.2. Samples: 5799768. Policy #0 lag: (min: 0.0, avg: 12.2, max: 24.0)
[2023-02-25 12:34:17,186][2408954] Avg episode reward: [(0, '-2.912')]
[2023-02-25 12:34:17,192][2409033] Saving /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000005658_23175168.pth...
[2023-02-25 12:34:17,294][2409033] Removing /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000004151_17002496.pth
[2023-02-25 12:34:17,577][2409074] Updated weights for policy 0, policy_version 5660 (0.0012)
[2023-02-25 12:34:18,092][2409485] DAMAGECOUNT value on done: 427.0
[2023-02-25 12:34:18,093][2409485] Sum rewards: -0.925, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.540', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'ARMOR': '0.040', 'weapon4': '0.044', 'WEAPON4': '0.050', 'weapon7': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.126', 'WEAPON7': '0.200', 'HITCOUNT': '0.210', 'DAMAGECOUNT': '0.660', 'WEAPON3': '0.750', 'weapon2': '1.218', 'weapon3': '1.764', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:18,115][2409100] DAMAGECOUNT value on done: 733.0
[2023-02-25 12:34:18,118][2409100] Sum rewards: -3.019, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.774', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'ARMOR': '0.038', 'weapon5': '0.074', 'weapon4': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'HITCOUNT': '0.150', 'DAMAGECOUNT': '0.705', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.524', 'weapon3': '1.688'}
[2023-02-25 12:34:18,160][2409101] DAMAGECOUNT value on done: 340.0
[2023-02-25 12:34:18,163][2409101] Sum rewards: -2.766, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.658', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.134', 'HITCOUNT': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.204', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.447', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.308', 'weapon3': '1.576'}
[2023-02-25 12:34:18,819][2409549] DAMAGECOUNT value on done: 373.0
[2023-02-25 12:34:18,823][2409549] Sum rewards: -2.035, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.239', 'AMMO5': '0.004', 'AMMO2': '0.013', 'weapon5': '0.060', 'AMMO4': '0.065', 'ARMOR': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.145', 'HITCOUNT': '0.180', 'weapon4': '0.300', 'DAMAGECOUNT': '0.639', 'WEAPON3': '0.700', 'weapon2': '1.194', 'weapon3': '1.886', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:19,073][2409074] Updated weights for policy 0, policy_version 5670 (0.0012)
[2023-02-25 12:34:19,134][2409103] DAMAGECOUNT value on done: 734.0
[2023-02-25 12:34:19,137][2409103] Sum rewards: -1.068, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.005', 'weapon5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'ARMOR': '0.052', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon4': '0.120', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'WEAPON3': '0.500', 'HEALTH': '0.518', 'DAMAGECOUNT': '0.642', 'weapon2': '1.108', 'weapon3': '1.596', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:19,457][2409102] DAMAGECOUNT value on done: 349.0
[2023-02-25 12:34:20,205][2409596] DAMAGECOUNT value on done: 865.0
[2023-02-25 12:34:20,206][2409596] Sum rewards: -0.613, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.970', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.014', 'weapon5': '0.022', 'AMMO4': '0.037', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.176', 'HITCOUNT': '0.400', 'weapon2': '0.912', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.566', 'weapon3': '2.580', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:34:20,693][2409074] Updated weights for policy 0, policy_version 5680 (0.0013)
[2023-02-25 12:34:21,508][2409565] DAMAGECOUNT value on done: 553.0
[2023-02-25 12:34:21,511][2409565] Sum rewards: -0.791, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.990', 'AMMO2': '0.013', 'ARMOR': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.110', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.198', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.700', 'weapon2': '1.496', 'weapon3': '1.538', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:21,850][2409100] DAMAGECOUNT value on done: 458.0
[2023-02-25 12:34:21,853][2409100] Sum rewards: 0.636, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.174', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'weapon5': '0.022', 'ARMOR': '0.046', 'WEAPON5': '0.050', 'HITCOUNT': '0.080', 'AMMO3': '0.081', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.255', 'weapon4': '0.380', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.258', 'weapon2': '1.418'}
[2023-02-25 12:34:21,879][2409485] DAMAGECOUNT value on done: 783.0
[2023-02-25 12:34:21,880][2409485] Sum rewards: -5.490, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.430', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.012', 'weapon5': '0.040', 'WEAPON5': '0.050', 'ARMOR': '0.084', 'AMMO3': '0.157', 'HITCOUNT': '0.340', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.014', 'weapon2': '1.400', 'FRAGCOUNT': '2.000', 'weapon3': '2.136'}
[2023-02-25 12:34:21,890][2409101] DAMAGECOUNT value on done: 388.0
[2023-02-25 12:34:21,894][2409101] Sum rewards: -4.416, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.578', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.038', 'ARMOR': '0.050', 'WEAPON1': '0.050', 'WEAPON5': '0.050', 'HITCOUNT': '0.070', 'AMMO3': '0.104', 'AMMO4': '0.190', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.225', 'weapon4': '0.332', 'WEAPON3': '0.700', 'weapon2': '1.306', 'weapon3': '1.584'}
[2023-02-25 12:34:22,186][2408954] Fps is (10 sec: 25395.1, 60 sec: 25736.5, 300 sec: 25645.1). Total num frames: 23298048. Throughput: 0: 6455.2. Samples: 5819172. Policy #0 lag: (min: 2.0, avg: 12.8, max: 26.0)
[2023-02-25 12:34:22,186][2408954] Avg episode reward: [(0, '-2.792')]
[2023-02-25 12:34:22,303][2409074] Updated weights for policy 0, policy_version 5690 (0.0012)
[2023-02-25 12:34:22,540][2409549] DAMAGECOUNT value on done: 531.0
[2023-02-25 12:34:22,544][2409549] Sum rewards: -5.599, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-2.000', 'HEALTH': '-0.236', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'weapon5': '0.082', 'AMMO3': '0.086', 'weapon4': '0.116', 'WEAPON5': '0.150', 'HITCOUNT': '0.190', 'ARMOR': '0.424', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.645', 'weapon3': '1.542', 'weapon2': '1.776'}
[2023-02-25 12:34:22,856][2409104] DAMAGECOUNT value on done: 517.0
[2023-02-25 12:34:22,857][2409104] Sum rewards: -3.432, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.000', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.035', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'AMMO3': '0.125', 'HITCOUNT': '0.170', 'weapon4': '0.208', 'DAMAGECOUNT': '0.465', 'WEAPON3': '0.800', 'weapon2': '1.452', 'weapon3': '1.884', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:22,916][2409103] DAMAGECOUNT value on done: 420.0
[2023-02-25 12:34:23,453][2409102] DAMAGECOUNT value on done: 709.0
[2023-02-25 12:34:23,454][2409102] Sum rewards: 2.937, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.586', 'AMMO2': '0.016', 'ARMOR': '0.032', 'weapon7': '0.066', 'AMMO4': '0.082', 'AMMO3': '0.087', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.320', 'WEAPON3': '0.550', 'weapon4': '0.568', 'weapon2': '1.058', 'weapon3': '1.482', 'DAMAGECOUNT': '1.572', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:34:23,670][2409597] DAMAGECOUNT value on done: 384.0
[2023-02-25 12:34:23,673][2409597] Sum rewards: -0.454, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.220', 'AMMO2': '0.018', 'ARMOR': '0.024', 'AMMO4': '0.088', 'weapon4': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.126', 'HITCOUNT': '0.250', 'DAMAGECOUNT': '0.732', 'WEAPON3': '0.750', 'weapon2': '1.516', 'weapon3': '1.814', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:23,818][2409074] Updated weights for policy 0, policy_version 5700 (0.0012)
[2023-02-25 12:34:24,028][2409596] DAMAGECOUNT value on done: 861.0
[2023-02-25 12:34:24,078][2409548] DAMAGECOUNT value on done: 460.0
[2023-02-25 12:34:24,078][2409548] Sum rewards: -4.200, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.004', 'AMMO2': '0.000', 'AMMO4': '0.001', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'HITCOUNT': '0.140', 'weapon4': '0.216', 'DAMAGECOUNT': '0.432', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.670', 'weapon3': '1.730'}
[2023-02-25 12:34:24,962][2409405] DAMAGECOUNT value on done: 655.0
[2023-02-25 12:34:24,964][2409405] Sum rewards: -4.820, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO2': '0.003', 'AMMO4': '0.014', 'weapon4': '0.034', 'ARMOR': '0.036', 'HEALTH': '0.044', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'HITCOUNT': '0.200', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.486', 'weapon3': '2.076'}
[2023-02-25 12:34:25,383][2409565] DAMAGECOUNT value on done: 803.0
[2023-02-25 12:34:25,386][2409565] Sum rewards: 1.771, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.433', 'AMMO2': '0.026', 'ARMOR': '0.064', 'AMMO3': '0.098', 'AMMO4': '0.130', 'HITCOUNT': '0.240', 'WEAPON4': '0.250', 'weapon4': '0.288', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.897', 'weapon3': '1.072', 'weapon2': '1.938', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:25,464][2409101] DAMAGECOUNT value on done: 639.0
[2023-02-25 12:34:25,467][2409101] Sum rewards: -2.353, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.012', 'AMMO5': '0.003', 'ARMOR': '0.028', 'AMMO2': '0.043', 'WEAPON5': '0.050', 'AMMO3': '0.094', 'HITCOUNT': '0.140', 'WEAPON4': '0.200', 'AMMO4': '0.215', 'weapon4': '0.262', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.522', 'FRAGCOUNT': '1.000', 'weapon3': '1.116', 'weapon2': '1.736'}
[2023-02-25 12:34:25,520][2409100] DAMAGECOUNT value on done: 790.0
[2023-02-25 12:34:25,523][2409100] Sum rewards: -2.338, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.200', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.034', 'ARMOR': '0.076', 'AMMO3': '0.093', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.172', 'HITCOUNT': '0.310', 'weapon4': '0.502', 'WEAPON3': '0.600', 'weapon2': '0.732', 'DAMAGECOUNT': '1.050', 'weapon3': '1.868'}
[2023-02-25 12:34:25,531][2409485] DAMAGECOUNT value on done: 239.0
[2023-02-25 12:34:25,532][2409485] Sum rewards: -3.299, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.396', 'AMMO5': '0.008', 'AMMO2': '0.015', 'ARMOR': '0.040', 'AMMO4': '0.072', 'AMMO3': '0.096', 'weapon5': '0.130', 'weapon4': '0.134', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.520', 'weapon3': '1.526'}
[2023-02-25 12:34:25,584][2409074] Updated weights for policy 0, policy_version 5710 (0.0013)
[2023-02-25 12:34:26,204][2409549] DAMAGECOUNT value on done: 420.0
[2023-02-25 12:34:26,207][2409549] Sum rewards: -2.518, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.356', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'AMMO4': '0.096', 'AMMO3': '0.121', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.230', 'ARMOR': '0.476', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.750', 'weapon2': '0.846', 'FRAGCOUNT': '2.000', 'weapon3': '2.120'}
[2023-02-25 12:34:26,519][2409103] DAMAGECOUNT value on done: 414.0
[2023-02-25 12:34:26,520][2409103] Sum rewards: -5.088, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.544', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'AMMO3': '0.109', 'weapon4': '0.158', 'HITCOUNT': '0.230', 'ARMOR': '0.494', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.651', 'FRAGCOUNT': '1.000', 'weapon3': '1.366', 'weapon2': '2.226'}
[2023-02-25 12:34:26,637][2409104] DAMAGECOUNT value on done: 310.0
[2023-02-25 12:34:27,186][2408954] Fps is (10 sec: 24985.6, 60 sec: 25804.8, 300 sec: 25672.9). Total num frames: 23425024. Throughput: 0: 6443.5. Samples: 5857428. Policy #0 lag: (min: 0.0, avg: 13.2, max: 29.0)
[2023-02-25 12:34:27,186][2408954] Avg episode reward: [(0, '-2.709')]
[2023-02-25 12:34:27,191][2409105] DAMAGECOUNT value on done: 616.0
[2023-02-25 12:34:27,192][2409105] Sum rewards: -4.796, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.664', 'AMMO5': '0.003', 'AMMO2': '0.013', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'weapon4': '0.154', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'HITCOUNT': '0.350', 'WEAPON3': '1.100', 'DAMAGECOUNT': '1.218', 'weapon2': '1.698', 'weapon3': '1.806', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:34:27,280][2409074] Updated weights for policy 0, policy_version 5720 (0.0012)
[2023-02-25 12:34:27,286][2409597] DAMAGECOUNT value on done: 600.0
[2023-02-25 12:34:27,289][2409597] Sum rewards: 4.874, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.260', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'WEAPON1': '0.020', 'weapon4': '0.024', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'HITCOUNT': '0.330', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.200', 'weapon3': '1.540', 'weapon2': '1.900', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:34:27,728][2409102] DAMAGECOUNT value on done: 650.0
[2023-02-25 12:34:27,729][2409102] Sum rewards: 0.617, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.568', 'AMMO2': '0.017', 'weapon4': '0.028', 'AMMO4': '0.086', 'AMMO3': '0.091', 'WEAPON4': '0.150', 'HITCOUNT': '0.270', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.945', 'FRAGCOUNT': '1.000', 'weapon3': '1.670', 'weapon2': '1.978'}
[2023-02-25 12:34:27,910][2409548] DAMAGECOUNT value on done: 525.0
[2023-02-25 12:34:28,020][2409596] DAMAGECOUNT value on done: 362.0
[2023-02-25 12:34:28,021][2409596] Sum rewards: -6.130, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.058', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'weapon5': '0.028', 'AMMO4': '0.086', 'AMMO3': '0.124', 'HITCOUNT': '0.140', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.292', 'DAMAGECOUNT': '0.456', 'ARMOR': '0.483', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.522', 'weapon3': '1.612'}
[2023-02-25 12:34:28,024][2409469] DAMAGECOUNT value on done: 432.0
[2023-02-25 12:34:28,025][2409469] Sum rewards: -0.226, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.997', 'AMMO5': '0.014', 'AMMO2': '0.016', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'weapon5': '0.042', 'AMMO4': '0.078', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'HITCOUNT': '0.190', 'weapon4': '0.220', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.032', 'weapon2': '1.668', 'weapon3': '1.730', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:28,570][2409373] DAMAGECOUNT value on done: 292.0
[2023-02-25 12:34:28,570][2409373] Sum rewards: -1.341, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.200', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO3': '0.095', 'HITCOUNT': '0.220', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.711', 'weapon2': '1.692', 'weapon3': '1.984', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:28,592][2409406] DAMAGECOUNT value on done: 370.0
[2023-02-25 12:34:28,623][2409389] DAMAGECOUNT value on done: 745.0
[2023-02-25 12:34:28,623][2409389] Sum rewards: -1.629, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.331', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon4': '0.008', 'weapon5': '0.012', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'WEAPON5': '0.100', 'AMMO3': '0.124', 'AMMO4': '0.132', 'WEAPON4': '0.200', 'HITCOUNT': '0.260', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.825', 'weapon2': '1.652', 'weapon3': '1.874', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:28,673][2409405] DAMAGECOUNT value on done: 558.0
[2023-02-25 12:34:28,938][2409407] DAMAGECOUNT value on done: 449.0
[2023-02-25 12:34:28,939][2409407] Sum rewards: -4.056, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-2.000', 'HEALTH': '-0.472', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon5': '0.054', 'AMMO3': '0.056', 'ARMOR': '0.088', 'HITCOUNT': '0.170', 'WEAPON3': '0.250', 'AMMO4': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.550', 'weapon4': '0.714', 'DAMAGECOUNT': '0.930', 'weapon3': '0.940', 'weapon2': '1.534'}
[2023-02-25 12:34:28,955][2409866] DAMAGECOUNT value on done: 334.0
[2023-02-25 12:34:29,044][2409077] DAMAGECOUNT value on done: 663.0
[2023-02-25 12:34:29,045][2409077] Sum rewards: -1.716, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.255', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO3': '0.124', 'weapon4': '0.164', 'HITCOUNT': '0.170', 'WEAPON4': '0.250', 'ARMOR': '0.452', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.780', 'weapon3': '1.646', 'weapon2': '1.698', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:29,097][2409074] Updated weights for policy 0, policy_version 5730 (0.0012)
[2023-02-25 12:34:29,149][2409485] DAMAGECOUNT value on done: 644.0
[2023-02-25 12:34:29,150][2409485] Sum rewards: 4.259, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.022', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'HEALTH': '0.334', 'HITCOUNT': '0.340', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.245', 'weapon2': '1.406', 'weapon3': '2.094', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:34:29,300][2409101] DAMAGECOUNT value on done: 337.0
[2023-02-25 12:34:29,301][2409101] Sum rewards: -2.993, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.960', 'AMMO2': '0.011', 'AMMO4': '0.057', 'HITCOUNT': '0.060', 'AMMO3': '0.096', 'ARMOR': '0.100', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.165', 'weapon4': '0.192', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.450', 'weapon2': '1.636'}
[2023-02-25 12:34:29,534][2409565] DAMAGECOUNT value on done: 344.0
[2023-02-25 12:34:29,537][2409565] Sum rewards: -1.742, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.900', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'weapon5': '0.024', 'AMMO4': '0.063', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'HITCOUNT': '0.150', 'ARMOR': '0.416', 'DAMAGECOUNT': '0.540', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.604', 'weapon3': '2.052'}
[2023-02-25 12:34:29,552][2409355] DAMAGECOUNT value on done: 464.0
[2023-02-25 12:34:29,552][2409355] Sum rewards: 1.083, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'weapon7': '0.012', 'AMMO2': '0.028', 'AMMO3': '0.052', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'HEALTH': '0.246', 'WEAPON3': '0.350', 'weapon4': '0.450', 'ARMOR': '0.456', 'DAMAGECOUNT': '0.546', 'FRAGCOUNT': '1.000', 'weapon2': '1.136', 'weapon3': '1.286'}
[2023-02-25 12:34:29,570][2409100] DAMAGECOUNT value on done: 545.0
[2023-02-25 12:34:29,896][2409549] DAMAGECOUNT value on done: 585.0
[2023-02-25 12:34:29,899][2409549] Sum rewards: -2.303, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.380', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.074', 'AMMO4': '0.075', 'AMMO3': '0.104', 'WEAPON5': '0.150', 'HITCOUNT': '0.260', 'WEAPON4': '0.300', 'weapon4': '0.562', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.993', 'weapon2': '1.206', 'weapon3': '1.682', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:30,135][2409103] DAMAGECOUNT value on done: 242.0
[2023-02-25 12:34:30,326][2409078] DAMAGECOUNT value on done: 637.0
[2023-02-25 12:34:30,329][2409078] Sum rewards: 3.481, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.865', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'weapon4': '0.038', 'WEAPON4': '0.050', 'AMMO3': '0.076', 'HITCOUNT': '0.200', 'ARMOR': '0.486', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.750', 'weapon3': '1.592', 'weapon2': '1.666', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:34:30,526][2409104] DAMAGECOUNT value on done: 731.0
[2023-02-25 12:34:30,527][2409104] Sum rewards: 3.358, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.653', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'ARMOR': '0.056', 'AMMO3': '0.074', 'weapon4': '0.080', 'weapon5': '0.102', 'AMMO4': '0.138', 'WEAPON4': '0.200', 'HITCOUNT': '0.270', 'WEAPON3': '0.500', 'weapon2': '1.524', 'DAMAGECOUNT': '1.605', 'weapon3': '1.872', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:34:30,537][2409074] Updated weights for policy 0, policy_version 5740 (0.0013)
[2023-02-25 12:34:30,894][2409105] DAMAGECOUNT value on done: 321.0
[2023-02-25 12:34:30,894][2409105] Sum rewards: -9.379, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.995', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.013', 'AMMO2': '0.016', 'WEAPON1': '0.040', 'HITCOUNT': '0.070', 'weapon5': '0.074', 'AMMO4': '0.079', 'AMMO3': '0.108', 'WEAPON4': '0.150', 'weapon4': '0.184', 'DAMAGECOUNT': '0.216', 'WEAPON5': '0.250', 'WEAPON3': '0.700', 'weapon3': '1.148', 'weapon2': '1.568'}
[2023-02-25 12:34:31,042][2409597] DAMAGECOUNT value on done: 548.0
[2023-02-25 12:34:31,045][2409597] Sum rewards: -0.683, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.636', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'ARMOR': '0.041', 'WEAPON4': '0.050', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'HITCOUNT': '0.120', 'AMMO4': '0.144', 'weapon4': '0.174', 'DAMAGECOUNT': '0.339', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.602', 'weapon3': '1.690'}
[2023-02-25 12:34:31,285][2409102] DAMAGECOUNT value on done: 522.0
[2023-02-25 12:34:31,286][2409102] Sum rewards: 0.256, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.706', 'weapon4': '0.002', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO4': '0.020', 'WEAPON4': '0.050', 'ARMOR': '0.068', 'AMMO3': '0.088', 'weapon7': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.170', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.633', 'weapon3': '0.934', 'FRAGCOUNT': '2.000', 'weapon2': '2.154'}
[2023-02-25 12:34:31,714][2409596] DAMAGECOUNT value on done: 513.0
[2023-02-25 12:34:31,718][2409596] Sum rewards: -1.184, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.304', 'AMMO2': '0.002', 'AMMO4': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.036', 'weapon4': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.130', 'HITCOUNT': '0.310', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.044', 'weapon2': '1.400', 'weapon3': '2.028', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:34:31,801][2409469] DAMAGECOUNT value on done: 176.0
[2023-02-25 12:34:31,849][2409548] DAMAGECOUNT value on done: 741.0
[2023-02-25 12:34:31,851][2409548] Sum rewards: 3.103, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.686', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'weapon5': '0.050', 'ARMOR': '0.072', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'AMMO4': '0.150', 'HITCOUNT': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '0.600', 'weapon2': '0.744', 'weapon4': '0.754', 'DAMAGECOUNT': '1.317', 'weapon3': '1.506', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:34:31,906][2409074] Updated weights for policy 0, policy_version 5750 (0.0012)
[2023-02-25 12:34:32,186][2408954] Fps is (10 sec: 25805.0, 60 sec: 25668.4, 300 sec: 25700.7). Total num frames: 23556096. Throughput: 0: 6419.7. Samples: 5895336. Policy #0 lag: (min: 0.0, avg: 11.4, max: 25.0)
[2023-02-25 12:34:32,186][2408954] Avg episode reward: [(0, '-2.317')]
[2023-02-25 12:34:32,187][2409033] Saving new best policy, reward=-2.317!
[2023-02-25 12:34:32,359][2409389] DAMAGECOUNT value on done: 514.0
[2023-02-25 12:34:32,359][2409389] Sum rewards: -0.624, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.363', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.134', 'HITCOUNT': '0.300', 'ARMOR': '0.502', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.002', 'weapon2': '1.330', 'FRAGCOUNT': '2.000', 'weapon3': '2.066'}
[2023-02-25 12:34:32,585][2409373] DAMAGECOUNT value on done: 575.0
[2023-02-25 12:34:32,585][2409373] Sum rewards: 1.775, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.287', 'AMMO2': '0.002', 'AMMO4': '0.010', 'WEAPON4': '0.050', 'weapon7': '0.058', 'AMMO3': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.170', 'WEAPON7': '0.200', 'weapon4': '0.210', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.023', 'weapon3': '1.070', 'weapon2': '1.650', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:34:32,602][2409407] DAMAGECOUNT value on done: 570.0
[2023-02-25 12:34:32,605][2409407] Sum rewards: -0.369, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.487', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'weapon5': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.143', 'WEAPON5': '0.150', 'weapon4': '0.224', 'HITCOUNT': '0.330', 'weapon2': '0.798', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.455', 'weapon3': '2.188', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:34:32,616][2409406] DAMAGECOUNT value on done: 587.0
[2023-02-25 12:34:32,618][2409406] Sum rewards: 0.394, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.742', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.013', 'weapon4': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.020', 'ARMOR': '0.024', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.250', 'HITCOUNT': '0.280', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.071', 'weapon2': '1.340', 'weapon3': '1.902', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:34:32,779][2409485] DAMAGECOUNT value on done: 394.0
[2023-02-25 12:34:32,839][2409096] DAMAGECOUNT value on done: 765.0
[2023-02-25 12:34:32,840][2409096] Sum rewards: 2.780, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.868', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'weapon4': '0.024', 'weapon5': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.054', 'WEAPON5': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.450', 'ARMOR': '0.496', 'weapon3': '1.208', 'DAMAGECOUNT': '1.290', 'weapon2': '1.860', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:34:32,980][2409405] DAMAGECOUNT value on done: 624.0
[2023-02-25 12:34:33,057][2409565] DAMAGECOUNT value on done: 442.0
[2023-02-25 12:34:33,057][2409565] Sum rewards: 0.448, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.502', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.133', 'HITCOUNT': '0.200', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.795', 'weapon2': '1.532', 'weapon3': '1.942', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:34:33,127][2409077] DAMAGECOUNT value on done: 663.0
[2023-02-25 12:34:33,128][2409077] Sum rewards: -1.086, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.302', 'AMMO2': '0.028', 'HITCOUNT': '0.060', 'weapon4': '0.070', 'AMMO3': '0.094', 'AMMO4': '0.138', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.348', 'ARMOR': '0.436', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon2': '1.560', 'weapon3': '1.582'}
[2023-02-25 12:34:33,177][2409075] DAMAGECOUNT value on done: 640.0
[2023-02-25 12:34:33,177][2409075] Sum rewards: 1.004, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.220', 'AMMO2': '0.006', 'weapon7': '0.028', 'AMMO4': '0.029', 'weapon4': '0.074', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'HITCOUNT': '0.370', 'ARMOR': '0.415', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.197', 'weapon3': '1.628', 'weapon2': '1.824', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:34:33,205][2409101] DAMAGECOUNT value on done: 826.0
[2023-02-25 12:34:33,208][2409101] Sum rewards: 1.038, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.930', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'WEAPON4': '0.100', 'AMMO3': '0.130', 'weapon4': '0.208', 'HITCOUNT': '0.280', 'WEAPON3': '0.700', 'ARMOR': '0.938', 'DAMAGECOUNT': '0.984', 'weapon3': '1.366', 'weapon2': '1.776', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:34:33,283][2409100] DAMAGECOUNT value on done: 547.0
[2023-02-25 12:34:33,284][2409100] Sum rewards: -5.700, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.095', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'AMMO4': '0.196', 'WEAPON4': '0.250', 'HITCOUNT': '0.290', 'weapon4': '0.390', 'ARMOR': '0.428', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.900', 'WEAPON3': '0.900', 'weapon2': '1.326', 'weapon3': '1.800'}
[2023-02-25 12:34:33,454][2409597] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 12:34:33,503][2409076] DAMAGECOUNT value on done: 952.0
[2023-02-25 12:34:33,503][2409076] Sum rewards: 0.925, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.659', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'ARMOR': '0.032', 'AMMO3': '0.050', 'WEAPON4': '0.150', 'HITCOUNT': '0.390', 'weapon4': '0.444', 'WEAPON3': '0.450', 'weapon3': '1.312', 'DAMAGECOUNT': '1.326', 'weapon2': '1.458', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:34:33,734][2409103] DAMAGECOUNT value on done: 777.0
[2023-02-25 12:34:33,737][2409103] Sum rewards: 1.997, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.098', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.038', 'ARMOR': '0.064', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'AMMO4': '0.189', 'weapon4': '0.216', 'WEAPON4': '0.350', 'HITCOUNT': '0.420', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.392', 'weapon3': '1.632', 'weapon2': '1.836', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:34:33,811][2409866] DAMAGECOUNT value on done: 715.0
[2023-02-25 12:34:33,811][2409866] Sum rewards: -0.122, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.268', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO5': '0.004', 'weapon5': '0.082', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.200', 'weapon4': '0.290', 'ARMOR': '0.539', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.675', 'FRAGCOUNT': '1.000', 'weapon3': '1.314', 'weapon2': '1.350'}
[2023-02-25 12:34:34,067][2409549] DAMAGECOUNT value on done: 574.0
[2023-02-25 12:34:34,069][2409549] Sum rewards: -0.944, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.418', 'WEAPON1': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.120', 'AMMO4': '0.172', 'HITCOUNT': '0.230', 'WEAPON4': '0.300', 'weapon4': '0.338', 'ARMOR': '0.468', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.870', 'weapon2': '1.250', 'weapon3': '1.932', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:34,217][2409074] Updated weights for policy 0, policy_version 5760 (0.0012)
[2023-02-25 12:34:34,560][2409355] DAMAGECOUNT value on done: 269.0
[2023-02-25 12:34:34,824][2409102] DAMAGECOUNT value on done: 283.0
[2023-02-25 12:34:34,827][2409102] Sum rewards: -0.966, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.482', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'ARMOR': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon4': '0.060', 'AMMO3': '0.065', 'WEAPON4': '0.100', 'HITCOUNT': '0.130', 'WEAPON5': '0.150', 'weapon5': '0.204', 'DAMAGECOUNT': '0.456', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.446', 'weapon2': '1.640'}
[2023-02-25 12:34:34,924][2409104] DAMAGECOUNT value on done: 577.0
[2023-02-25 12:34:34,927][2409104] Sum rewards: 0.840, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.859', 'AMMO5': '0.003', 'weapon5': '0.004', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.092', 'AMMO4': '0.101', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.170', 'ARMOR': '0.464', 'DAMAGECOUNT': '0.585', 'WEAPON3': '0.600', 'weapon2': '1.506', 'weapon3': '1.784', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:35,048][2409078] DAMAGECOUNT value on done: 432.0
[2023-02-25 12:34:35,052][2409078] Sum rewards: 3.074, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.060', 'ARMOR': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'HITCOUNT': '0.150', 'weapon5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.240', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.435', 'HEALTH': '0.544', 'weapon2': '1.396', 'weapon3': '1.478', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:34:35,417][2409074] Updated weights for policy 0, policy_version 5770 (0.0012)
[2023-02-25 12:34:35,576][2409548] DAMAGECOUNT value on done: 540.0
[2023-02-25 12:34:35,579][2409548] Sum rewards: 0.447, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.138', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'ARMOR': '0.058', 'AMMO4': '0.068', 'AMMO3': '0.127', 'weapon4': '0.134', 'WEAPON4': '0.150', 'HITCOUNT': '0.400', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.320', 'weapon2': '1.648', 'weapon3': '1.846', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:34:36,329][2409389] DAMAGECOUNT value on done: 379.0
[2023-02-25 12:34:36,332][2409389] Sum rewards: -3.811, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.803', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'ARMOR': '0.044', 'weapon5': '0.052', 'AMMO3': '0.096', 'HITCOUNT': '0.100', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.650', 'weapon2': '1.444', 'weapon3': '2.018'}
[2023-02-25 12:34:36,333][2409485] DAMAGECOUNT value on done: 705.0
[2023-02-25 12:34:36,335][2409485] Sum rewards: 3.462, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO4': '0.018', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'weapon5': '0.124', 'HITCOUNT': '0.260', 'WEAPON3': '0.350', 'HEALTH': '0.382', 'DAMAGECOUNT': '0.774', 'ARMOR': '0.948', 'weapon3': '1.454', 'weapon2': '1.526', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:36,386][2409596] DAMAGECOUNT value on done: 488.0
[2023-02-25 12:34:36,387][2409596] Sum rewards: -1.049, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.722', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'weapon5': '0.032', 'AMMO3': '0.070', 'AMMO4': '0.085', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.190', 'weapon4': '0.318', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.627', 'weapon3': '1.508', 'weapon2': '1.516', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:36,399][2409373] DAMAGECOUNT value on done: 673.0
[2023-02-25 12:34:36,402][2409373] Sum rewards: 0.303, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.699', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.012', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'weapon7': '0.072', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.210', 'HITCOUNT': '0.260', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.014', 'weapon2': '1.194', 'weapon3': '1.416'}
[2023-02-25 12:34:36,449][2409105] DAMAGECOUNT value on done: 594.0
[2023-02-25 12:34:36,450][2409105] Sum rewards: -2.916, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.022', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.032', 'weapon5': '0.058', 'weapon4': '0.062', 'AMMO3': '0.119', 'AMMO4': '0.159', 'HITCOUNT': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.452', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.810', 'weapon3': '1.568', 'weapon2': '1.978', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:36,548][2409597] DAMAGECOUNT value on done: 343.0
[2023-02-25 12:34:36,549][2409597] Sum rewards: -2.214, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.782', 'AMMO5': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'weapon5': '0.038', 'WEAPON4': '0.050', 'weapon4': '0.064', 'AMMO4': '0.067', 'WEAPON5': '0.100', 'AMMO3': '0.145', 'HITCOUNT': '0.210', 'DAMAGECOUNT': '0.729', 'WEAPON3': '0.900', 'ARMOR': '0.953', 'weapon2': '1.608', 'weapon3': '1.676', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:36,620][2409407] DAMAGECOUNT value on done: 1237.0
[2023-02-25 12:34:36,876][2409100] DAMAGECOUNT value on done: 341.0
[2023-02-25 12:34:36,876][2409100] Sum rewards: -2.203, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.102', 'AMMO5': '0.003', 'weapon5': '0.024', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.073', 'HITCOUNT': '0.080', 'ARMOR': '0.088', 'AMMO4': '0.152', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.264', 'WEAPON3': '0.450', 'FRAGCOUNT': '0.500', 'weapon4': '0.722', 'weapon2': '1.356', 'weapon3': '1.356'}
[2023-02-25 12:34:36,998][2409565] DAMAGECOUNT value on done: 746.0
[2023-02-25 12:34:36,999][2409565] Sum rewards: 1.079, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.362', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO2': '0.027', 'AMMO3': '0.082', 'weapon7': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.133', 'WEAPON7': '0.200', 'HITCOUNT': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '0.600', 'weapon4': '0.636', 'weapon2': '1.310', 'weapon3': '1.382', 'DAMAGECOUNT': '1.551', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:34:37,168][2409406] DAMAGECOUNT value on done: 608.0
[2023-02-25 12:34:37,171][2409406] Sum rewards: -0.141, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.159', 'AMMO2': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'weapon4': '0.284', 'HITCOUNT': '0.290', 'ARMOR': '0.452', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.086', 'weapon3': '1.296', 'weapon2': '1.454', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:37,186][2408954] Fps is (10 sec: 24576.1, 60 sec: 25531.9, 300 sec: 25631.3). Total num frames: 23670784. Throughput: 0: 6370.7. Samples: 5912712. Policy #0 lag: (min: 0.0, avg: 12.4, max: 25.0)
[2023-02-25 12:34:37,186][2408954] Avg episode reward: [(0, '-1.424')]
[2023-02-25 12:34:37,188][2409405] DAMAGECOUNT value on done: 664.0
[2023-02-25 12:34:37,191][2409033] Saving new best policy, reward=-1.424!
[2023-02-25 12:34:37,189][2409405] Sum rewards: -1.030, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.786', 'AMMO5': '0.004', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon5': '0.054', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.159', 'HITCOUNT': '0.360', 'WEAPON3': '0.850', 'weapon2': '1.126', 'DAMAGECOUNT': '1.296', 'FRAGCOUNT': '2.000', 'weapon3': '2.192'}
[2023-02-25 12:34:37,304][2409103] DAMAGECOUNT value on done: 312.0
[2023-02-25 12:34:37,305][2409103] Sum rewards: -0.004, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.370', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.096', 'HITCOUNT': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.327', 'WEAPON3': '0.400', 'weapon4': '0.456', 'ARMOR': '0.464', 'FRAGCOUNT': '1.000', 'weapon2': '1.162', 'weapon3': '1.200'}
[2023-02-25 12:34:37,315][2409469] DAMAGECOUNT value on done: 239.0
[2023-02-25 12:34:37,322][2409075] DAMAGECOUNT value on done: 578.0
[2023-02-25 12:34:37,325][2409075] Sum rewards: 2.196, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.014', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon7': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.065', 'weapon5': '0.076', 'ARMOR': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'weapon4': '0.340', 'weapon3': '0.714', 'DAMAGECOUNT': '0.900', 'weapon2': '1.342', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:34:37,346][2409101] DAMAGECOUNT value on done: 821.0
[2023-02-25 12:34:37,348][2409101] Sum rewards: 1.635, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.513', 'AMMO2': '0.024', 'weapon7': '0.056', 'ARMOR': '0.061', 'AMMO3': '0.069', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.118', 'WEAPON4': '0.250', 'HITCOUNT': '0.290', 'weapon4': '0.406', 'WEAPON3': '0.500', 'weapon2': '0.820', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.362', 'weapon3': '1.392'}
[2023-02-25 12:34:37,400][2409074] Updated weights for policy 0, policy_version 5780 (0.0012)
[2023-02-25 12:34:37,611][2409077] DAMAGECOUNT value on done: 496.0
[2023-02-25 12:34:37,615][2409077] Sum rewards: -1.847, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.492', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'weapon4': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.105', 'HITCOUNT': '0.230', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.897', 'weapon2': '1.510', 'FRAGCOUNT': '2.000', 'weapon3': '2.024'}
[2023-02-25 12:34:37,734][2409076] DAMAGECOUNT value on done: 464.0
[2023-02-25 12:34:37,738][2409076] Sum rewards: -0.855, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.115', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'AMMO3': '0.098', 'AMMO4': '0.110', 'HITCOUNT': '0.150', 'weapon4': '0.202', 'DAMAGECOUNT': '0.342', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.244', 'weapon2': '1.542'}
[2023-02-25 12:34:37,838][2409096] DAMAGECOUNT value on done: 324.0
[2023-02-25 12:34:37,839][2409096] Sum rewards: -1.732, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.948', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'HITCOUNT': '0.150', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.405', 'weapon4': '0.450', 'ARMOR': '0.580', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.342', 'weapon2': '1.594'}
[2023-02-25 12:34:37,988][2409549] DAMAGECOUNT value on done: 594.0
[2023-02-25 12:34:37,989][2409549] Sum rewards: -0.866, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.261', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.037', 'ARMOR': '0.048', 'AMMO3': '0.128', 'WEAPON4': '0.200', 'weapon4': '0.234', 'HITCOUNT': '0.300', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.062', 'weapon2': '1.364', 'weapon3': '1.694', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:38,486][2409866] DAMAGECOUNT value on done: 632.0
[2023-02-25 12:34:38,490][2409866] Sum rewards: -2.601, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.620', 'AMMO2': '0.010', 'AMMO4': '0.048', 'ARMOR': '0.068', 'AMMO3': '0.108', 'HITCOUNT': '0.240', 'WEAPON4': '0.250', 'weapon4': '0.364', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.753', 'FRAGCOUNT': '1.000', 'weapon2': '1.422', 'weapon3': '1.556'}
[2023-02-25 12:34:38,733][2409097] DAMAGECOUNT value on done: 473.0
[2023-02-25 12:34:38,734][2409097] Sum rewards: 2.480, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.322', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'WEAPON1': '0.030', 'AMMO3': '0.075', 'HITCOUNT': '0.260', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.810', 'weapon3': '1.222', 'weapon2': '1.536', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:34:39,011][2409355] DAMAGECOUNT value on done: 566.0
[2023-02-25 12:34:39,015][2409355] Sum rewards: 2.871, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.719', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'WEAPON1': '0.010', 'ARMOR': '0.048', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'weapon4': '0.162', 'HITCOUNT': '0.390', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.281', 'weapon3': '1.536', 'weapon2': '1.874', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:34:39,056][2409102] DAMAGECOUNT value on done: 727.0
[2023-02-25 12:34:39,057][2409102] Sum rewards: 0.500, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.920', 'AMMO2': '0.013', 'AMMO3': '0.057', 'AMMO4': '0.063', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.126', 'HITCOUNT': '0.160', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'weapon4': '0.452', 'ARMOR': '0.479', 'weapon3': '0.930', 'DAMAGECOUNT': '1.020', 'weapon2': '1.970', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:39,177][2409104] DAMAGECOUNT value on done: 568.0
[2023-02-25 12:34:39,178][2409104] Sum rewards: -1.993, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.044', 'AMMO2': '0.014', 'weapon7': '0.064', 'AMMO4': '0.069', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.126', 'WEAPON4': '0.200', 'weapon4': '0.220', 'HITCOUNT': '0.290', 'ARMOR': '0.460', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.014', 'weapon3': '1.356', 'weapon2': '1.638'}
[2023-02-25 12:34:39,221][2409074] Updated weights for policy 0, policy_version 5790 (0.0015)
[2023-02-25 12:34:39,226][2409548] DAMAGECOUNT value on done: 582.0
[2023-02-25 12:34:39,230][2409548] Sum rewards: -3.170, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.415', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.128', 'HITCOUNT': '0.140', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.660', 'WEAPON3': '0.850', 'weapon2': '1.546', 'weapon3': '1.836'}
[2023-02-25 12:34:39,250][2409486] DAMAGECOUNT value on done: 743.0
[2023-02-25 12:34:39,250][2409486] Sum rewards: -0.730, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.214', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'ARMOR': '0.028', 'AMMO4': '0.051', 'AMMO3': '0.088', 'HITCOUNT': '0.180', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.564', 'FRAGCOUNT': '1.000', 'weapon2': '1.444', 'weapon3': '1.558'}
[2023-02-25 12:34:39,463][2409078] DAMAGECOUNT value on done: 301.0
[2023-02-25 12:34:39,727][2409079] DAMAGECOUNT value on done: 510.0
[2023-02-25 12:34:39,728][2409079] Sum rewards: -0.535, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.860', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'ARMOR': '0.080', 'weapon5': '0.080', 'AMMO3': '0.089', 'AMMO4': '0.149', 'HITCOUNT': '0.230', 'WEAPON4': '0.300', 'weapon4': '0.382', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.909', 'weapon3': '1.434', 'weapon2': '1.570', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:40,234][2409105] DAMAGECOUNT value on done: 750.0
[2023-02-25 12:34:40,235][2409105] Sum rewards: -0.907, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.275', 'weapon5': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'ARMOR': '0.052', 'weapon7': '0.068', 'AMMO3': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.109', 'HITCOUNT': '0.150', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'weapon4': '0.808', 'DAMAGECOUNT': '0.834', 'weapon3': '0.948', 'FRAGCOUNT': '1.000', 'weapon2': '1.036'}
[2023-02-25 12:34:40,247][2409485] DAMAGECOUNT value on done: 816.0
[2023-02-25 12:34:40,248][2409485] Sum rewards: 2.665, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.356', 'AMMO5': '0.003', 'AMMO2': '0.004', 'ARMOR': '0.012', 'AMMO4': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.044', 'weapon7': '0.048', 'WEAPON5': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.103', 'HITCOUNT': '0.250', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.191', 'weapon2': '1.230', 'weapon3': '1.648', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:34:40,303][2409597] DAMAGECOUNT value on done: 733.0
[2023-02-25 12:34:40,304][2409597] Sum rewards: -0.243, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.242', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'weapon5': '0.092', 'AMMO3': '0.112', 'HITCOUNT': '0.230', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'DAMAGECOUNT': '1.329', 'weapon3': '1.562', 'weapon2': '2.010', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:34:40,311][2409373] DAMAGECOUNT value on done: 798.0
[2023-02-25 12:34:40,312][2409373] Sum rewards: -0.073, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.134', 'AMMO2': '0.002', 'AMMO5': '0.008', 'AMMO4': '0.012', 'ARMOR': '0.020', 'WEAPON1': '0.060', 'AMMO3': '0.109', 'WEAPON5': '0.200', 'HITCOUNT': '0.220', 'weapon5': '0.234', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.308', 'weapon2': '1.592', 'weapon3': '1.594', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:34:40,348][2409596] DAMAGECOUNT value on done: 498.0
[2023-02-25 12:34:40,349][2409596] Sum rewards: -0.228, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.371', 'AMMO2': '0.009', 'AMMO4': '0.042', 'ARMOR': '0.052', 'AMMO3': '0.070', 'weapon7': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.210', 'weapon4': '0.246', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.672', 'FRAGCOUNT': '1.000', 'weapon2': '1.440', 'weapon3': '1.468'}
[2023-02-25 12:34:40,460][2409100] DAMAGECOUNT value on done: 542.0
[2023-02-25 12:34:40,461][2409100] Sum rewards: -2.320, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.799', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon7': '0.008', 'weapon4': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.079', 'HITCOUNT': '0.080', 'weapon5': '0.082', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'DAMAGECOUNT': '0.258', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon3': '1.200', 'weapon2': '1.240'}
[2023-02-25 12:34:40,530][2409389] DAMAGECOUNT value on done: 489.0
[2023-02-25 12:34:40,531][2409389] Sum rewards: 0.057, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.317', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.118', 'WEAPON4': '0.250', 'HITCOUNT': '0.250', 'ARMOR': '0.425', 'WEAPON3': '0.550', 'weapon4': '0.622', 'DAMAGECOUNT': '0.840', 'weapon3': '1.246', 'weapon2': '1.452', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:40,818][2409406] DAMAGECOUNT value on done: 951.0
[2023-02-25 12:34:40,961][2409101] DAMAGECOUNT value on done: 390.0
[2023-02-25 12:34:40,962][2409101] Sum rewards: 0.175, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.759', 'AMMO5': '0.006', 'AMMO2': '0.013', 'ARMOR': '0.040', 'AMMO4': '0.066', 'AMMO3': '0.098', 'weapon5': '0.104', 'HITCOUNT': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.270', 'weapon4': '0.292', 'WEAPON3': '0.650', 'weapon3': '1.442', 'weapon2': '1.532', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:41,105][2409074] Updated weights for policy 0, policy_version 5800 (0.0015)
[2023-02-25 12:34:41,245][2409077] DAMAGECOUNT value on done: 491.0
[2023-02-25 12:34:41,246][2409077] Sum rewards: -2.049, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.875', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon4': '0.118', 'AMMO3': '0.167', 'HITCOUNT': '0.290', 'ARMOR': '0.503', 'DAMAGECOUNT': '0.930', 'WEAPON3': '1.050', 'weapon2': '1.206', 'weapon3': '2.150', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:34:41,269][2409103] DAMAGECOUNT value on done: 534.0
[2023-02-25 12:34:41,272][2409103] Sum rewards: -3.647, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.496', 'AMMO2': '0.014', 'ARMOR': '0.056', 'AMMO4': '0.070', 'weapon4': '0.070', 'WEAPON4': '0.150', 'AMMO3': '0.169', 'HITCOUNT': '0.250', 'DAMAGECOUNT': '0.834', 'WEAPON3': '0.900', 'weapon2': '1.784', 'weapon3': '1.802', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:34:41,298][2409565] DAMAGECOUNT value on done: 475.0
[2023-02-25 12:34:41,301][2409565] Sum rewards: -4.493, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.256', 'AMMO2': '0.008', 'AMMO4': '0.041', 'ARMOR': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.130', 'AMMO3': '0.160', 'HITCOUNT': '0.270', 'DAMAGECOUNT': '0.732', 'WEAPON3': '1.050', 'weapon2': '1.260', 'FRAGCOUNT': '2.000', 'weapon3': '2.166'}
[2023-02-25 12:34:41,298][2409405] DAMAGECOUNT value on done: 419.0
[2023-02-25 12:34:41,370][2409407] DAMAGECOUNT value on done: 443.0
[2023-02-25 12:34:41,370][2409407] Sum rewards: -2.272, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.604', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'AMMO3': '0.105', 'HITCOUNT': '0.110', 'AMMO4': '0.137', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.324', 'weapon4': '0.430', 'ARMOR': '0.520', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.018', 'weapon3': '1.890'}
[2023-02-25 12:34:41,399][2409076] DAMAGECOUNT value on done: 1017.0
[2023-02-25 12:34:41,401][2409076] Sum rewards: 0.134, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.150', 'AMMO2': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon5': '0.026', 'ARMOR': '0.032', 'AMMO4': '0.041', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'HITCOUNT': '0.400', 'WEAPON3': '0.950', 'weapon2': '1.512', 'weapon3': '1.810', 'DAMAGECOUNT': '1.920', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:34:41,501][2409549] DAMAGECOUNT value on done: 389.0
[2023-02-25 12:34:41,502][2409549] Sum rewards: -2.374, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.746', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'WEAPON1': '0.020', 'weapon7': '0.058', 'ARMOR': '0.060', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.224', 'DAMAGECOUNT': '0.426', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.324', 'weapon3': '1.370'}
[2023-02-25 12:34:41,647][2409469] DAMAGECOUNT value on done: 974.0
[2023-02-25 12:34:41,648][2409469] Sum rewards: -4.548, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.131', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.040', 'ARMOR': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.121', 'AMMO4': '0.171', 'HITCOUNT': '0.200', 'WEAPON4': '0.350', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.537', 'weapon4': '0.560', 'WEAPON3': '0.700', 'weapon3': '1.234', 'weapon2': '1.724'}
[2023-02-25 12:34:41,661][2409075] DAMAGECOUNT value on done: 442.0
[2023-02-25 12:34:41,662][2409075] Sum rewards: -0.824, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.608', 'AMMO5': '0.004', 'AMMO2': '0.032', 'weapon5': '0.038', 'ARMOR': '0.056', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.159', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.418', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.035', 'weapon2': '1.472', 'weapon3': '1.592', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:42,186][2408954] Fps is (10 sec: 22118.3, 60 sec: 25122.1, 300 sec: 25534.1). Total num frames: 23777280. Throughput: 0: 6292.8. Samples: 5947848. Policy #0 lag: (min: 0.0, avg: 13.1, max: 28.0)
[2023-02-25 12:34:42,186][2408954] Avg episode reward: [(0, '-0.937')]
[2023-02-25 12:34:42,187][2409033] Saving new best policy, reward=-0.937!
[2023-02-25 12:34:42,234][2409096] DAMAGECOUNT value on done: 475.0
[2023-02-25 12:34:42,235][2409096] Sum rewards: -0.555, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.450', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'ARMOR': '0.028', 'AMMO2': '0.037', 'weapon7': '0.046', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.129', 'WEAPON4': '0.150', 'AMMO4': '0.184', 'HITCOUNT': '0.260', 'WEAPON3': '0.600', 'weapon4': '0.626', 'DAMAGECOUNT': '0.834', 'weapon2': '1.370', 'weapon3': '1.466', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:42,588][2409074] Updated weights for policy 0, policy_version 5810 (0.0014)
[2023-02-25 12:34:42,978][2409866] DAMAGECOUNT value on done: 670.0
[2023-02-25 12:34:42,987][2409866] Sum rewards: 0.145, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.209', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'weapon5': '0.012', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'weapon7': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.170', 'WEAPON7': '0.200', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.077', 'weapon2': '1.368', 'weapon3': '1.572'}
[2023-02-25 12:34:43,110][2409548] DAMAGECOUNT value on done: 913.0
[2023-02-25 12:34:43,112][2409548] Sum rewards: 0.139, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.609', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.030', 'AMMO4': '0.032', 'weapon5': '0.088', 'AMMO3': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.276', 'HITCOUNT': '0.360', 'ARMOR': '0.456', 'WEAPON3': '0.750', 'weapon3': '1.242', 'DAMAGECOUNT': '1.419', 'weapon2': '1.900', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:34:43,147][2409102] DAMAGECOUNT value on done: 641.0
[2023-02-25 12:34:43,148][2409102] Sum rewards: 3.284, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'weapon5': '0.092', 'HITCOUNT': '0.120', 'AMMO4': '0.121', 'weapon4': '0.224', 'WEAPON3': '0.400', 'HEALTH': '0.504', 'ARMOR': '0.940', 'weapon2': '1.032', 'DAMAGECOUNT': '1.188', 'weapon3': '1.706', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:43,267][2409033] Signal inference workers to stop experience collection... (800 times)
[2023-02-25 12:34:43,281][2409033] Signal inference workers to resume experience collection... (800 times)
[2023-02-25 12:34:43,295][2409074] InferenceWorker_p0-w0: stopping experience collection (800 times)
[2023-02-25 12:34:43,315][2409074] InferenceWorker_p0-w0: resuming experience collection (800 times)
[2023-02-25 12:34:43,318][2409078] DAMAGECOUNT value on done: 498.0
[2023-02-25 12:34:43,342][2409104] DAMAGECOUNT value on done: 805.0
[2023-02-25 12:34:43,343][2409104] Sum rewards: -0.789, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.774', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'weapon5': '0.014', 'WEAPON5': '0.100', 'AMMO3': '0.129', 'HITCOUNT': '0.270', 'ARMOR': '0.408', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.107', 'weapon3': '1.646', 'weapon2': '1.988', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:43,361][2409097] DAMAGECOUNT value on done: 306.0
[2023-02-25 12:34:43,361][2409097] Sum rewards: -0.384, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.324', 'AMMO5': '0.003', 'AMMO2': '0.015', 'AMMO3': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'ARMOR': '0.086', 'HITCOUNT': '0.090', 'WEAPON4': '0.250', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.345', 'weapon4': '0.510', 'FRAGCOUNT': '1.000', 'weapon3': '1.038', 'weapon2': '1.390'}
[2023-02-25 12:34:43,411][2409355] DAMAGECOUNT value on done: 301.0
[2023-02-25 12:34:43,411][2409355] Sum rewards: 0.912, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'weapon5': '0.008', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.074', 'HITCOUNT': '0.170', 'HEALTH': '0.186', 'DAMAGECOUNT': '0.498', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon2': '1.312', 'weapon3': '1.610'}
[2023-02-25 12:34:43,651][2409079] DAMAGECOUNT value on done: 543.0
[2023-02-25 12:34:43,651][2409079] Sum rewards: -2.482, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.401', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'ARMOR': '0.062', 'AMMO3': '0.093', 'AMMO4': '0.122', 'HITCOUNT': '0.150', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.438', 'weapon4': '0.506', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.498', 'weapon2': '1.566'}
[2023-02-25 12:34:43,742][2409486] DAMAGECOUNT value on done: 1113.0
[2023-02-25 12:34:43,746][2409486] Sum rewards: 2.429, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.192', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'ARMOR': '0.040', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO3': '0.112', 'WEAPON4': '0.150', 'weapon4': '0.238', 'HITCOUNT': '0.300', 'WEAPON3': '0.650', 'weapon2': '1.386', 'DAMAGECOUNT': '1.575', 'weapon3': '1.842', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:34:43,984][2409074] Updated weights for policy 0, policy_version 5820 (0.0012)
[2023-02-25 12:34:44,056][2409373] DAMAGECOUNT value on done: 771.0
[2023-02-25 12:34:44,059][2409373] Sum rewards: -2.019, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.131', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.142', 'HITCOUNT': '0.370', 'WEAPON3': '0.850', 'weapon2': '1.174', 'DAMAGECOUNT': '1.260', 'FRAGCOUNT': '2.000', 'weapon3': '2.244'}
[2023-02-25 12:34:44,241][2409485] DAMAGECOUNT value on done: 525.0
[2023-02-25 12:34:44,243][2409485] Sum rewards: -1.827, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.664', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.070', 'WEAPON4': '0.150', 'HITCOUNT': '0.260', 'weapon4': '0.316', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.906', 'ARMOR': '0.934', 'FRAGCOUNT': '1.000', 'weapon3': '1.054', 'weapon2': '1.874'}
[2023-02-25 12:34:44,308][2409100] DAMAGECOUNT value on done: 280.0
[2023-02-25 12:34:44,369][2409105] DAMAGECOUNT value on done: 510.0
[2023-02-25 12:34:44,421][2409597] DAMAGECOUNT value on done: 747.0
[2023-02-25 12:34:44,638][2409596] DAMAGECOUNT value on done: 444.0
[2023-02-25 12:34:44,638][2409596] Sum rewards: -0.257, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.017', 'AMMO2': '0.007', 'ARMOR': '0.024', 'AMMO4': '0.033', 'weapon7': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.121', 'WEAPON7': '0.200', 'HITCOUNT': '0.220', 'WEAPON4': '0.250', 'weapon4': '0.508', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.650', 'weapon3': '1.248', 'weapon2': '1.304', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:44,822][2409101] DAMAGECOUNT value on done: 865.0
[2023-02-25 12:34:44,823][2409101] Sum rewards: 1.434, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.780', 'AMMO2': '0.007', 'AMMO5': '0.011', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'weapon5': '0.064', 'AMMO3': '0.073', 'weapon4': '0.104', 'WEAPON5': '0.150', 'HITCOUNT': '0.310', 'WEAPON3': '0.600', 'weapon2': '1.140', 'DAMAGECOUNT': '1.185', 'weapon3': '1.734', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:34:44,872][2409389] DAMAGECOUNT value on done: 642.0
[2023-02-25 12:34:44,873][2409389] Sum rewards: -2.603, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.772', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'HITCOUNT': '0.230', 'weapon4': '0.238', 'ARMOR': '0.436', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.825', 'weapon3': '1.414', 'weapon2': '1.688', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:44,874][2409406] DAMAGECOUNT value on done: 571.0
[2023-02-25 12:34:44,877][2409406] Sum rewards: -0.042, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.245', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.030', 'AMMO4': '0.043', 'AMMO3': '0.095', 'HITCOUNT': '0.140', 'WEAPON4': '0.200', 'weapon4': '0.334', 'DAMAGECOUNT': '0.465', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon2': '1.132', 'weapon3': '1.500'}
[2023-02-25 12:34:44,952][2409407] DAMAGECOUNT value on done: 626.0
[2023-02-25 12:34:44,955][2409407] Sum rewards: -1.181, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.280', 'AMMO4': '-0.061', 'AMMO2': '-0.012', 'AMMO5': '0.007', 'weapon7': '0.052', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.125', 'weapon5': '0.158', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.188', 'weapon3': '1.526', 'weapon2': '1.736', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:34:45,012][2409565] DAMAGECOUNT value on done: 400.0
[2023-02-25 12:34:45,107][2409076] DAMAGECOUNT value on done: 725.0
[2023-02-25 12:34:45,111][2409076] Sum rewards: -2.053, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.528', 'AMMO5': '0.003', 'weapon4': '0.006', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'AMMO3': '0.133', 'HITCOUNT': '0.360', 'ARMOR': '0.456', 'WEAPON3': '0.850', 'weapon2': '1.300', 'DAMAGECOUNT': '1.530', 'FRAGCOUNT': '2.000', 'weapon3': '2.298'}
[2023-02-25 12:34:45,320][2409077] DAMAGECOUNT value on done: 785.0
[2023-02-25 12:34:45,321][2409077] Sum rewards: 0.447, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.636', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'WEAPON1': '0.050', 'AMMO3': '0.088', 'weapon5': '0.102', 'HITCOUNT': '0.280', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.227', 'weapon2': '1.504', 'weapon3': '1.850', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:34:45,351][2409549] DAMAGECOUNT value on done: 660.0
[2023-02-25 12:34:45,354][2409549] Sum rewards: -1.907, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.820', 'AMMO2': '0.002', 'AMMO4': '0.010', 'WEAPON1': '0.010', 'AMMO3': '0.094', 'HITCOUNT': '0.200', 'DAMAGECOUNT': '0.579', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.392', 'weapon2': '1.776'}
[2023-02-25 12:34:45,478][2409405] DAMAGECOUNT value on done: 420.0
[2023-02-25 12:34:45,479][2409405] Sum rewards: -3.600, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.326', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'ARMOR': '0.044', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'weapon4': '0.200', 'DAMAGECOUNT': '0.675', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.594', 'weapon3': '1.752'}
[2023-02-25 12:34:45,530][2409469] DAMAGECOUNT value on done: 594.0
[2023-02-25 12:34:45,535][2409469] Sum rewards: -0.440, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.810', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'WEAPON1': '0.020', 'AMMO3': '0.089', 'HITCOUNT': '0.190', 'DAMAGECOUNT': '0.561', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.520', 'weapon3': '1.646'}
[2023-02-25 12:34:45,588][2409103] DAMAGECOUNT value on done: 557.0
[2023-02-25 12:34:45,588][2409103] Sum rewards: -0.523, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.006', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'ARMOR': '0.048', 'weapon5': '0.054', 'AMMO3': '0.090', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'HEALTH': '0.234', 'weapon4': '0.256', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.636', 'FRAGCOUNT': '1.000', 'weapon2': '1.454', 'weapon3': '1.768'}
[2023-02-25 12:34:45,668][2409075] DAMAGECOUNT value on done: 581.0
[2023-02-25 12:34:45,671][2409075] Sum rewards: -7.214, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-3.500', 'HEALTH': '-1.342', 'AMMO5': '0.012', 'AMMO2': '0.025', 'ARMOR': '0.036', 'weapon5': '0.042', 'WEAPON1': '0.050', 'AMMO3': '0.099', 'HITCOUNT': '0.120', 'AMMO4': '0.125', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.378', 'weapon4': '0.480', 'weapon2': '0.500', 'WEAPON3': '0.700', 'weapon3': '1.410'}
[2023-02-25 12:34:46,258][2409096] DAMAGECOUNT value on done: 345.0
[2023-02-25 12:34:46,262][2409074] Updated weights for policy 0, policy_version 5830 (0.0015)
[2023-02-25 12:34:46,654][2409102] DAMAGECOUNT value on done: 355.0
[2023-02-25 12:34:46,655][2409102] Sum rewards: -0.034, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.308', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'ARMOR': '0.056', 'AMMO3': '0.070', 'AMMO4': '0.090', 'HITCOUNT': '0.110', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.350', 'weapon4': '0.434', 'weapon3': '1.246', 'weapon2': '1.334', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:46,685][2409548] DAMAGECOUNT value on done: 409.0
[2023-02-25 12:34:46,689][2409548] Sum rewards: -0.509, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.931', 'AMMO2': '0.006', 'AMMO4': '0.030', 'AMMO3': '0.103', 'WEAPON4': '0.150', 'HITCOUNT': '0.240', 'weapon4': '0.410', 'ARMOR': '0.535', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.825', 'FRAGCOUNT': '1.000', 'weapon3': '1.196', 'weapon2': '1.326'}
[2023-02-25 12:34:46,883][2409866] DAMAGECOUNT value on done: 657.0
[2023-02-25 12:34:46,886][2409866] Sum rewards: -2.057, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.175', 'AMMO2': '0.002', 'AMMO4': '0.009', 'ARMOR': '0.032', 'AMMO3': '0.086', 'WEAPON4': '0.150', 'HITCOUNT': '0.190', 'weapon4': '0.364', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.603', 'FRAGCOUNT': '1.000', 'weapon3': '1.186', 'weapon2': '1.746'}
[2023-02-25 12:34:47,186][2408954] Fps is (10 sec: 24166.5, 60 sec: 25258.7, 300 sec: 25534.1). Total num frames: 23912448. Throughput: 0: 6244.0. Samples: 5984436. Policy #0 lag: (min: 0.0, avg: 13.1, max: 28.0)
[2023-02-25 12:34:47,186][2408954] Avg episode reward: [(0, '-0.837')]
[2023-02-25 12:34:47,191][2409033] Saving new best policy, reward=-0.837!
[2023-02-25 12:34:47,259][2409079] DAMAGECOUNT value on done: 582.0
[2023-02-25 12:34:47,259][2409079] Sum rewards: 0.654, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.276', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.069', 'weapon5': '0.098', 'ARMOR': '0.099', 'AMMO4': '0.114', 'HITCOUNT': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'weapon4': '0.674', 'weapon2': '1.018', 'DAMAGECOUNT': '1.161', 'weapon3': '1.202', 'FRAGCOUNT': '1.500'}
[2023-02-25 12:34:47,295][2409104] DAMAGECOUNT value on done: 363.0
[2023-02-25 12:34:47,298][2409104] Sum rewards: -4.547, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.882', 'AMMO2': '0.007', 'weapon4': '0.026', 'AMMO4': '0.036', 'WEAPON4': '0.100', 'HITCOUNT': '0.170', 'AMMO3': '0.186', 'ARMOR': '0.517', 'DAMAGECOUNT': '0.756', 'WEAPON3': '1.000', 'weapon2': '1.402', 'weapon3': '2.134', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:34:47,307][2409355] DAMAGECOUNT value on done: 966.0
[2023-02-25 12:34:47,308][2409355] Sum rewards: 1.554, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.360', 'AMMO4': '-0.077', 'AMMO2': '-0.015', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO3': '0.083', 'WEAPON5': '0.150', 'weapon5': '0.174', 'HITCOUNT': '0.460', 'ARMOR': '0.482', 'WEAPON3': '0.650', 'weapon2': '1.504', 'weapon3': '1.860', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:34:47,424][2409097] DAMAGECOUNT value on done: 701.0
[2023-02-25 12:34:47,425][2409097] Sum rewards: 0.323, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.545', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.026', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'weapon5': '0.134', 'WEAPON4': '0.150', 'HITCOUNT': '0.230', 'weapon4': '0.326', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.828', 'weapon2': '1.322', 'FRAGCOUNT': '1.500', 'weapon3': '1.546'}
[2023-02-25 12:34:47,526][2409078] DAMAGECOUNT value on done: 270.0
[2023-02-25 12:34:47,530][2409078] Sum rewards: -4.267, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.392', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.008', 'AMMO4': '0.042', 'WEAPON5': '0.050', 'HITCOUNT': '0.070', 'AMMO3': '0.103', 'WEAPON4': '0.150', 'weapon4': '0.184', 'DAMAGECOUNT': '0.240', 'ARMOR': '0.493', 'WEAPON3': '0.650', 'weapon3': '1.528', 'weapon2': '1.596'}
[2023-02-25 12:34:47,553][2409074] Updated weights for policy 0, policy_version 5840 (0.0013)
[2023-02-25 12:34:48,061][2409486] DAMAGECOUNT value on done: 552.0
[2023-02-25 12:34:48,250][2409100] DAMAGECOUNT value on done: 293.0
[2023-02-25 12:34:48,251][2409100] Sum rewards: 0.828, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.030', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'HITCOUNT': '0.060', 'ARMOR': '0.070', 'AMMO4': '0.071', 'AMMO3': '0.078', 'weapon5': '0.096', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.174', 'weapon4': '0.222', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.500', 'weapon3': '1.620'}
[2023-02-25 12:34:48,378][2409596] DAMAGECOUNT value on done: 871.0
[2023-02-25 12:34:48,380][2409596] Sum rewards: -3.553, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.395', 'AMMO2': '0.003', 'AMMO5': '0.003', 'AMMO4': '0.014', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.102', 'weapon4': '0.126', 'AMMO3': '0.130', 'HITCOUNT': '0.230', 'ARMOR': '0.489', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.245', 'weapon2': '1.250', 'weapon3': '1.950'}
[2023-02-25 12:34:48,443][2409105] DAMAGECOUNT value on done: 730.0
[2023-02-25 12:34:48,469][2409597] DAMAGECOUNT value on done: 710.0
[2023-02-25 12:34:48,470][2409597] Sum rewards: -1.707, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.352', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.007', 'WEAPON5': '0.050', 'ARMOR': '0.072', 'WEAPON4': '0.100', 'HITCOUNT': '0.140', 'AMMO3': '0.152', 'weapon4': '0.208', 'DAMAGECOUNT': '0.615', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.198', 'weapon3': '1.998'}
[2023-02-25 12:34:48,605][2409101] DAMAGECOUNT value on done: 355.0
[2023-02-25 12:34:48,620][2409389] DAMAGECOUNT value on done: 408.0
[2023-02-25 12:34:48,731][2409407] DAMAGECOUNT value on done: 813.0
[2023-02-25 12:34:48,734][2409407] Sum rewards: 1.307, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO4': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.086', 'HEALTH': '0.103', 'HITCOUNT': '0.260', 'ARMOR': '0.492', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.930', 'FRAGCOUNT': '1.000', 'weapon2': '1.232', 'weapon3': '1.812'}
[2023-02-25 12:34:48,847][2409373] DAMAGECOUNT value on done: 755.0
[2023-02-25 12:34:48,847][2409373] Sum rewards: -0.055, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.080', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.056', 'AMMO4': '0.068', 'AMMO3': '0.099', 'weapon4': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.240', 'WEAPON3': '0.700', 'ARMOR': '0.965', 'DAMAGECOUNT': '0.975', 'FRAGCOUNT': '1.000', 'weapon2': '1.540', 'weapon3': '1.666'}
[2023-02-25 12:34:48,897][2409406] DAMAGECOUNT value on done: 512.0
[2023-02-25 12:34:49,000][2409565] DAMAGECOUNT value on done: 343.0
[2023-02-25 12:34:49,001][2409565] Sum rewards: -0.121, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.637', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'weapon5': '0.024', 'ARMOR': '0.040', 'AMMO4': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'weapon4': '0.382', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.552', 'weapon2': '1.514', 'weapon3': '1.594', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:49,109][2409485] DAMAGECOUNT value on done: 421.0
[2023-02-25 12:34:49,172][2409549] DAMAGECOUNT value on done: 579.0
[2023-02-25 12:34:49,172][2409549] Sum rewards: -4.030, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.504', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.008', 'weapon4': '0.026', 'AMMO4': '0.039', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.161', 'HITCOUNT': '0.240', 'ARMOR': '0.420', 'DAMAGECOUNT': '0.735', 'WEAPON3': '0.750', 'weapon3': '1.560', 'weapon2': '1.924'}
[2023-02-25 12:34:49,350][2409077] DAMAGECOUNT value on done: 754.0
[2023-02-25 12:34:49,351][2409077] Sum rewards: -1.966, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.670', 'AMMO2': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.057', 'AMMO3': '0.101', 'WEAPON4': '0.200', 'HITCOUNT': '0.200', 'weapon4': '0.220', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.328', 'weapon3': '1.656'}
[2023-02-25 12:34:49,451][2409075] DAMAGECOUNT value on done: 219.0
[2023-02-25 12:34:49,494][2409469] DAMAGECOUNT value on done: 812.0
[2023-02-25 12:34:49,495][2409469] Sum rewards: 0.586, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.790', 'AMMO2': '0.008', 'AMMO4': '0.037', 'AMMO3': '0.092', 'weapon4': '0.128', 'WEAPON4': '0.150', 'HITCOUNT': '0.370', 'ARMOR': '0.495', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.296', 'weapon3': '1.534', 'weapon2': '1.916', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:34:49,541][2409405] DAMAGECOUNT value on done: 709.0
[2023-02-25 12:34:49,544][2409405] Sum rewards: 0.965, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.154', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.015', 'weapon5': '0.024', 'weapon7': '0.064', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.122', 'weapon4': '0.198', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.200', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.134', 'weapon2': '1.144', 'weapon3': '1.742', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:49,563][2409074] Updated weights for policy 0, policy_version 5850 (0.0012)
[2023-02-25 12:34:49,811][2409099] DAMAGECOUNT value on done: 843.0
[2023-02-25 12:34:49,812][2409099] Sum rewards: 2.098, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.888', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'ARMOR': '0.040', 'weapon5': '0.074', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.290', 'HITCOUNT': '0.460', 'WEAPON3': '0.700', 'weapon2': '1.164', 'weapon3': '1.730', 'DAMAGECOUNT': '1.812', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:34:49,919][2409076] DAMAGECOUNT value on done: 319.0
[2023-02-25 12:34:49,920][2409076] Sum rewards: -6.359, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.240', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon5': '0.024', 'AMMO2': '0.038', 'HITCOUNT': '0.090', 'AMMO3': '0.117', 'WEAPON5': '0.150', 'AMMO4': '0.191', 'DAMAGECOUNT': '0.255', 'WEAPON4': '0.450', 'ARMOR': '0.476', 'weapon4': '0.614', 'WEAPON3': '0.650', 'weapon3': '0.894', 'weapon2': '1.912'}
[2023-02-25 12:34:50,028][2409103] DAMAGECOUNT value on done: 811.0
[2023-02-25 12:34:50,031][2409103] Sum rewards: 3.069, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.256', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'ARMOR': '0.032', 'weapon7': '0.048', 'weapon5': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'WEAPON7': '0.200', 'HITCOUNT': '0.460', 'WEAPON3': '0.800', 'weapon2': '1.386', 'DAMAGECOUNT': '1.683', 'weapon3': '1.890', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:34:50,099][2409096] DAMAGECOUNT value on done: 505.0
[2023-02-25 12:34:50,101][2409096] Sum rewards: -3.634, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.234', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.024', 'ARMOR': '0.052', 'weapon7': '0.054', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.122', 'AMMO3': '0.144', 'HITCOUNT': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.328', 'WEAPON4': '0.400', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.873', 'weapon3': '1.412', 'weapon2': '1.428', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:50,847][2409074] Updated weights for policy 0, policy_version 5860 (0.0013)
[2023-02-25 12:34:50,942][2409548] DAMAGECOUNT value on done: 1175.0
[2023-02-25 12:34:50,943][2409548] Sum rewards: 5.226, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.090', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO3': '0.053', 'weapon5': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.216', 'HITCOUNT': '0.380', 'WEAPON3': '0.400', 'ARMOR': '0.465', 'weapon3': '1.016', 'weapon2': '1.568', 'DAMAGECOUNT': '1.713', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:34:50,958][2409866] DAMAGECOUNT value on done: 592.0
[2023-02-25 12:34:50,959][2409866] Sum rewards: 0.914, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.904', 'AMMO5': '0.010', 'AMMO2': '0.023', 'ARMOR': '0.036', 'weapon5': '0.110', 'AMMO4': '0.115', 'AMMO3': '0.140', 'WEAPON4': '0.200', 'weapon4': '0.216', 'WEAPON5': '0.250', 'HITCOUNT': '0.360', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.365', 'weapon3': '1.620', 'weapon2': '1.622', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:34:51,020][2409102] DAMAGECOUNT value on done: 580.0
[2023-02-25 12:34:51,020][2409102] Sum rewards: 1.479, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.475', 'AMMO4': '-0.058', 'AMMO2': '-0.012', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'HITCOUNT': '0.180', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.825', 'weapon2': '1.598', 'weapon3': '1.856', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:34:51,026][2409079] DAMAGECOUNT value on done: 267.0
[2023-02-25 12:34:51,027][2409079] Sum rewards: -4.061, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.060', 'AMMO2': '0.004', 'AMMO4': '0.022', 'AMMO3': '0.074', 'HITCOUNT': '0.110', 'DAMAGECOUNT': '0.360', 'WEAPON4': '0.400', 'WEAPON3': '0.400', 'ARMOR': '0.457', 'weapon4': '0.688', 'weapon3': '0.990', 'FRAGCOUNT': '1.000', 'weapon2': '1.744'}
[2023-02-25 12:34:51,390][2409355] DAMAGECOUNT value on done: 745.0
[2023-02-25 12:34:51,392][2409355] Sum rewards: -1.306, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.444', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'ARMOR': '0.028', 'AMMO4': '0.115', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'weapon4': '0.348', 'HITCOUNT': '0.350', 'WEAPON3': '0.850', 'weapon2': '1.208', 'DAMAGECOUNT': '1.416', 'weapon3': '1.992', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:34:51,399][2409104] DAMAGECOUNT value on done: 612.0
[2023-02-25 12:34:51,399][2409104] Sum rewards: 0.034, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.306', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'weapon4': '0.154', 'HITCOUNT': '0.290', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.080', 'weapon2': '1.220', 'weapon3': '1.670', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:51,443][2409097] DAMAGECOUNT value on done: 463.0
[2023-02-25 12:34:51,444][2409097] Sum rewards: -0.917, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.077', 'ARMOR': '0.012', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'AMMO3': '0.085', 'AMMO4': '0.099', 'WEAPON4': '0.200', 'HITCOUNT': '0.270', 'WEAPON3': '0.500', 'weapon4': '0.596', 'weapon2': '0.918', 'DAMAGECOUNT': '0.990', 'FRAGCOUNT': '1.000', 'weapon3': '1.950'}
[2023-02-25 12:34:51,798][2409486] DAMAGECOUNT value on done: 230.0
[2023-02-25 12:34:52,046][2409100] DAMAGECOUNT value on done: 749.0
[2023-02-25 12:34:52,061][2409100] Sum rewards: 0.049, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.765', 'AMMO4': '-0.023', 'AMMO2': '-0.004', 'WEAPON1': '0.020', 'AMMO3': '0.127', 'HITCOUNT': '0.310', 'ARMOR': '0.450', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.996', 'weapon2': '1.420', 'weapon3': '2.268', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:34:52,162][2409078] DAMAGECOUNT value on done: 317.0
[2023-02-25 12:34:52,163][2409078] Sum rewards: -2.716, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.422', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'weapon4': '0.002', 'weapon5': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'WEAPON4': '0.050', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'HITCOUNT': '0.150', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.670', 'weapon3': '1.778'}
[2023-02-25 12:34:52,186][2408954] Fps is (10 sec: 25804.9, 60 sec: 25122.1, 300 sec: 25575.7). Total num frames: 24035328. Throughput: 0: 6197.1. Samples: 6001980. Policy #0 lag: (min: 0.0, avg: 12.4, max: 22.0)
[2023-02-25 12:34:52,186][2408954] Avg episode reward: [(0, '-1.125')]
[2023-02-25 12:34:52,274][2409407] DAMAGECOUNT value on done: 426.0
[2023-02-25 12:34:52,275][2409407] Sum rewards: -1.429, reward structure: {'DEATHCOUNT': '-9.000', 'weapon5': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'AMMO3': '0.117', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.204', 'HITCOUNT': '0.260', 'HEALTH': '0.432', 'ARMOR': '0.460', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.876', 'FRAGCOUNT': '1.000', 'weapon2': '1.380', 'weapon3': '1.754'}
[2023-02-25 12:34:52,338][2409105] DAMAGECOUNT value on done: 824.0
[2023-02-25 12:34:52,338][2409105] Sum rewards: -3.597, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.094', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'weapon4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.129', 'HITCOUNT': '0.230', 'ARMOR': '0.528', 'DAMAGECOUNT': '0.630', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.268', 'weapon3': '2.232'}
[2023-02-25 12:34:52,350][2409597] DAMAGECOUNT value on done: 473.0
[2023-02-25 12:34:52,355][2409597] Sum rewards: -1.633, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.286', 'ARMOR': '0.004', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'HITCOUNT': '0.070', 'AMMO3': '0.099', 'DAMAGECOUNT': '0.180', 'weapon4': '0.212', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.466', 'weapon3': '1.652'}
[2023-02-25 12:34:52,480][2409596] DAMAGECOUNT value on done: 346.0
[2023-02-25 12:34:52,520][2409389] DAMAGECOUNT value on done: 706.0
[2023-02-25 12:34:52,524][2409389] Sum rewards: -1.921, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.636', 'AMMO2': '0.002', 'AMMO4': '0.012', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'weapon4': '0.072', 'HITCOUNT': '0.110', 'AMMO3': '0.124', 'DAMAGECOUNT': '0.267', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.356', 'weapon3': '1.940'}
[2023-02-25 12:34:52,531][2409373] DAMAGECOUNT value on done: 760.0
[2023-02-25 12:34:52,532][2409373] Sum rewards: 1.821, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.736', 'AMMO5': '0.003', 'ARMOR': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.032', 'WEAPON1': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.074', 'AMMO3': '0.112', 'HITCOUNT': '0.240', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.945', 'weapon3': '1.548', 'weapon2': '1.652', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:34:52,555][2409406] DAMAGECOUNT value on done: 576.0
[2023-02-25 12:34:52,558][2409406] Sum rewards: -0.447, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.425', 'AMMO5': '0.007', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'AMMO3': '0.076', 'weapon5': '0.086', 'AMMO4': '0.100', 'HITCOUNT': '0.130', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.358', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.228', 'weapon2': '1.590'}
[2023-02-25 12:34:52,773][2409101] DAMAGECOUNT value on done: 483.0
[2023-02-25 12:34:52,774][2409101] Sum rewards: 1.672, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'weapon5': '0.038', 'ARMOR': '0.048', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.112', 'AMMO4': '0.125', 'HITCOUNT': '0.220', 'WEAPON3': '0.450', 'HEALTH': '0.542', 'DAMAGECOUNT': '0.957', 'weapon2': '1.546', 'weapon3': '1.808', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:34:52,818][2409074] Updated weights for policy 0, policy_version 5870 (0.0012)
[2023-02-25 12:34:52,841][2409485] DAMAGECOUNT value on done: 652.0
[2023-02-25 12:34:52,844][2409485] Sum rewards: -3.840, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.344', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'ARMOR': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.054', 'AMMO3': '0.143', 'HITCOUNT': '0.230', 'DAMAGECOUNT': '0.696', 'WEAPON3': '0.800', 'weapon2': '1.528', 'weapon3': '1.676', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:53,061][2409077] DAMAGECOUNT value on done: 566.0
[2023-02-25 12:34:53,062][2409077] Sum rewards: -1.394, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.406', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.020', 'AMMO4': '0.037', 'WEAPON5': '0.050', 'AMMO3': '0.076', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'weapon4': '0.384', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.555', 'FRAGCOUNT': '1.000', 'weapon2': '1.232', 'weapon3': '1.248', 'ARMOR': '1.389'}
[2023-02-25 12:34:53,151][2409469] DAMAGECOUNT value on done: 1260.0
[2023-02-25 12:34:53,151][2409469] Sum rewards: -0.477, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.864', 'ARMOR': '0.004', 'weapon4': '0.004', 'AMMO2': '0.005', 'AMMO4': '0.023', 'WEAPON4': '0.100', 'AMMO3': '0.152', 'HITCOUNT': '0.350', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.215', 'weapon2': '1.864', 'weapon3': '1.870', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:34:53,250][2409565] DAMAGECOUNT value on done: 661.0
[2023-02-25 12:34:53,251][2409565] Sum rewards: 3.094, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.843', 'AMMO5': '0.004', 'AMMO2': '0.017', 'weapon5': '0.032', 'AMMO3': '0.068', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.170', 'weapon4': '0.240', 'ARMOR': '0.432', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.912', 'weapon3': '1.366', 'weapon2': '1.462', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:34:53,411][2409075] DAMAGECOUNT value on done: 252.0
[2023-02-25 12:34:53,414][2409075] Sum rewards: -2.139, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.350', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.005', 'AMMO2': '0.007', 'WEAPON1': '0.030', 'AMMO4': '0.034', 'ARMOR': '0.061', 'HITCOUNT': '0.070', 'weapon5': '0.074', 'AMMO3': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.236', 'DAMAGECOUNT': '0.261', 'WEAPON3': '0.700', 'weapon2': '1.446', 'weapon3': '1.582'}
[2023-02-25 12:34:53,434][2409549] DAMAGECOUNT value on done: 620.0
[2023-02-25 12:34:53,435][2409549] Sum rewards: -5.302, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.615', 'AMMO5': '0.003', 'weapon5': '0.020', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'AMMO3': '0.099', 'AMMO4': '0.143', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.292', 'ARMOR': '0.400', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.690', 'weapon2': '1.410', 'weapon3': '1.898'}
[2023-02-25 12:34:53,490][2409099] DAMAGECOUNT value on done: 458.0
[2023-02-25 12:34:53,494][2409099] Sum rewards: -2.973, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.360', 'AMMO2': '0.004', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.021', 'ARMOR': '0.036', 'weapon5': '0.036', 'AMMO3': '0.190', 'HITCOUNT': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.230', 'DAMAGECOUNT': '0.579', 'WEAPON3': '0.850', 'weapon2': '1.450', 'weapon3': '1.872', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:34:53,748][2409103] DAMAGECOUNT value on done: 544.0
[2023-02-25 12:34:53,751][2409103] Sum rewards: 1.260, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.442', 'AMMO5': '0.006', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'weapon5': '0.124', 'HITCOUNT': '0.170', 'weapon4': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.795', 'ARMOR': '1.000', 'weapon2': '1.318', 'weapon3': '1.346', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:34:53,773][2409076] DAMAGECOUNT value on done: 484.0
[2023-02-25 12:34:53,774][2409076] Sum rewards: -1.135, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.838', 'AMMO2': '0.003', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.016', 'weapon4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'HITCOUNT': '0.170', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.675', 'weapon2': '0.918', 'FRAGCOUNT': '1.000', 'weapon3': '2.014'}
[2023-02-25 12:34:53,834][2409096] DAMAGECOUNT value on done: 532.0
[2023-02-25 12:34:54,368][2409405] DAMAGECOUNT value on done: 1072.0
[2023-02-25 12:34:54,369][2409405] Sum rewards: 0.086, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.491', 'AMMO5': '0.017', 'AMMO2': '0.028', 'weapon5': '0.038', 'WEAPON4': '0.050', 'weapon4': '0.100', 'AMMO3': '0.106', 'AMMO4': '0.137', 'HITCOUNT': '0.340', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.371', 'weapon2': '1.672', 'weapon3': '1.718', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:34:54,620][2409866] DAMAGECOUNT value on done: 267.0
[2023-02-25 12:34:54,621][2409866] Sum rewards: -9.928, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.770', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.031', 'ARMOR': '0.060', 'HITCOUNT': '0.130', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.184', 'weapon4': '0.214', 'DAMAGECOUNT': '0.381', 'WEAPON4': '0.400', 'WEAPON3': '0.950', 'weapon2': '1.516', 'weapon3': '1.650'}
[2023-02-25 12:34:54,626][2409074] Updated weights for policy 0, policy_version 5880 (0.0020)
[2023-02-25 12:34:55,048][2409355] DAMAGECOUNT value on done: 466.0
[2023-02-25 12:34:55,048][2409355] Sum rewards: 2.147, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.505', 'AMMO5': '0.013', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.063', 'AMMO4': '0.073', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'HITCOUNT': '0.260', 'ARMOR': '0.455', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.933', 'weapon3': '1.658', 'weapon2': '1.722', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:55,108][2409548] DAMAGECOUNT value on done: 401.0
[2023-02-25 12:34:55,108][2409548] Sum rewards: 0.488, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.499', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'ARMOR': '0.064', 'weapon5': '0.064', 'weapon7': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'AMMO4': '0.169', 'weapon4': '0.204', 'HITCOUNT': '0.210', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.852', 'weapon2': '1.430', 'weapon3': '1.576', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:34:55,249][2409102] DAMAGECOUNT value on done: 685.0
[2023-02-25 12:34:55,250][2409102] Sum rewards: 1.370, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.749', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO3': '0.103', 'HITCOUNT': '0.440', 'WEAPON3': '0.700', 'weapon2': '1.602', 'DAMAGECOUNT': '1.650', 'weapon3': '2.146', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:34:55,259][2409104] DAMAGECOUNT value on done: 509.0
[2023-02-25 12:34:55,304][2409079] DAMAGECOUNT value on done: 648.0
[2023-02-25 12:34:55,307][2409079] Sum rewards: -3.886, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.290', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'ARMOR': '0.016', 'AMMO4': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.129', 'weapon4': '0.138', 'WEAPON4': '0.200', 'HITCOUNT': '0.310', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.167', 'weapon2': '1.360', 'weapon3': '2.064', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:34:55,607][2409074] Updated weights for policy 0, policy_version 5890 (0.0014)
[2023-02-25 12:34:55,733][2409486] DAMAGECOUNT value on done: 497.0
[2023-02-25 12:34:55,733][2409486] Sum rewards: -5.253, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.216', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.010', 'AMMO2': '0.020', 'HITCOUNT': '0.070', 'weapon5': '0.080', 'AMMO4': '0.099', 'AMMO3': '0.103', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.267', 'weapon4': '0.328', 'ARMOR': '0.476', 'WEAPON3': '0.600', 'weapon3': '1.054', 'weapon2': '1.906'}
[2023-02-25 12:34:55,899][2409105] DAMAGECOUNT value on done: 530.0
[2023-02-25 12:34:55,906][2409597] DAMAGECOUNT value on done: 426.0
[2023-02-25 12:34:55,907][2409597] Sum rewards: -5.088, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.204', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'ARMOR': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.146', 'weapon4': '0.206', 'HITCOUNT': '0.250', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.026', 'weapon2': '1.350', 'weapon3': '1.974'}
[2023-02-25 12:34:56,108][2409078] DAMAGECOUNT value on done: 457.0
[2023-02-25 12:34:56,338][2409596] DAMAGECOUNT value on done: 403.0
[2023-02-25 12:34:56,341][2409596] Sum rewards: -1.168, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.618', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.060', 'ARMOR': '0.068', 'WEAPON4': '0.200', 'HITCOUNT': '0.270', 'weapon4': '0.310', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.948', 'weapon3': '1.342', 'weapon2': '1.394'}
[2023-02-25 12:34:56,379][2409485] DAMAGECOUNT value on done: 509.0
[2023-02-25 12:34:56,384][2409485] Sum rewards: -5.291, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.937', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'AMMO5': '0.003', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.107', 'HITCOUNT': '0.120', 'DAMAGECOUNT': '0.447', 'ARMOR': '0.482', 'WEAPON3': '0.500', 'weapon3': '1.142', 'weapon2': '2.514'}
[2023-02-25 12:34:56,418][2409100] DAMAGECOUNT value on done: 360.0
[2023-02-25 12:34:56,459][2409373] DAMAGECOUNT value on done: 565.0
[2023-02-25 12:34:56,467][2409406] DAMAGECOUNT value on done: 570.0
[2023-02-25 12:34:56,467][2409406] Sum rewards: -2.814, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.580', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'ARMOR': '0.008', 'WEAPON4': '0.100', 'AMMO3': '0.133', 'weapon4': '0.184', 'HITCOUNT': '0.190', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.735', 'FRAGCOUNT': '1.000', 'weapon2': '1.404', 'weapon3': '1.826'}
[2023-02-25 12:34:56,478][2409389] DAMAGECOUNT value on done: 495.0
[2023-02-25 12:34:56,481][2409389] Sum rewards: -1.327, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.938', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'weapon5': '0.020', 'ARMOR': '0.028', 'AMMO3': '0.082', 'WEAPON5': '0.100', 'HITCOUNT': '0.220', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.630', 'FRAGCOUNT': '1.000', 'weapon3': '1.276', 'weapon2': '1.780'}
[2023-02-25 12:34:56,505][2409101] DAMAGECOUNT value on done: 803.0
[2023-02-25 12:34:56,508][2409101] Sum rewards: 1.180, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.956', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.024', 'weapon4': '0.024', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.096', 'HITCOUNT': '0.400', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.428', 'weapon3': '1.528', 'weapon2': '1.610', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:34:56,527][2409097] DAMAGECOUNT value on done: 539.0
[2023-02-25 12:34:56,527][2409097] Sum rewards: -4.243, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.840', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'AMMO5': '0.003', 'ARMOR': '0.030', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.088', 'HITCOUNT': '0.210', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.705', 'weapon2': '1.242', 'weapon3': '1.686'}
[2023-02-25 12:34:56,542][2409407] DAMAGECOUNT value on done: 723.0
[2023-02-25 12:34:56,544][2409407] Sum rewards: -1.320, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.498', 'AMMO2': '0.011', 'AMMO5': '0.014', 'AMMO4': '0.054', 'weapon5': '0.072', 'AMMO3': '0.083', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.280', 'weapon4': '0.406', 'ARMOR': '0.441', 'WEAPON3': '0.500', 'weapon3': '1.006', 'DAMAGECOUNT': '1.257', 'weapon2': '1.804', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:34:56,781][2409469] DAMAGECOUNT value on done: 456.0
[2023-02-25 12:34:56,786][2409469] Sum rewards: -3.251, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.292', 'AMMO2': '0.002', 'AMMO4': '0.008', 'ARMOR': '0.016', 'HITCOUNT': '0.100', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.258', 'weapon4': '0.308', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.556', 'weapon3': '1.906'}
[2023-02-25 12:34:56,918][2409077] DAMAGECOUNT value on done: 690.0
[2023-02-25 12:34:56,919][2409077] Sum rewards: 2.191, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.234', 'AMMO2': '0.010', 'weapon4': '0.010', 'AMMO4': '0.049', 'weapon7': '0.052', 'ARMOR': '0.072', 'AMMO3': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.150', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.795', 'weapon2': '1.474', 'weapon3': '1.516', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:34:57,038][2409549] DAMAGECOUNT value on done: 752.0
[2023-02-25 12:34:57,039][2409549] Sum rewards: -3.315, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.016', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'HITCOUNT': '0.280', 'WEAPON3': '1.050', 'DAMAGECOUNT': '1.107', 'weapon2': '1.400', 'weapon3': '2.118', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:34:57,126][2409547] DAMAGECOUNT value on done: 559.0
[2023-02-25 12:34:57,127][2409547] Sum rewards: 2.692, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.110', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.014', 'ARMOR': '0.072', 'AMMO3': '0.104', 'WEAPON4': '0.150', 'HITCOUNT': '0.250', 'weapon4': '0.282', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.993', 'weapon2': '1.328', 'weapon3': '1.846', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:34:57,186][2408954] Fps is (10 sec: 23347.0, 60 sec: 24780.8, 300 sec: 25506.3). Total num frames: 24145920. Throughput: 0: 6160.0. Samples: 6039108. Policy #0 lag: (min: 0.0, avg: 11.6, max: 25.0)
[2023-02-25 12:34:57,186][2408954] Avg episode reward: [(0, '-1.600')]
[2023-02-25 12:34:57,241][2409565] DAMAGECOUNT value on done: 1025.0
[2023-02-25 12:34:57,242][2409565] Sum rewards: -1.162, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.356', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.050', 'AMMO4': '0.095', 'AMMO3': '0.107', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.300', 'weapon4': '0.456', 'WEAPON3': '0.750', 'weapon2': '0.868', 'DAMAGECOUNT': '1.257', 'FRAGCOUNT': '2.000', 'weapon3': '2.078'}
[2023-02-25 12:34:57,258][2409103] DAMAGECOUNT value on done: 491.0
[2023-02-25 12:34:57,259][2409103] Sum rewards: -4.137, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.500', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'weapon4': '0.034', 'WEAPON4': '0.050', 'HITCOUNT': '0.090', 'AMMO3': '0.093', 'DAMAGECOUNT': '0.225', 'ARMOR': '0.449', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.212', 'weapon2': '1.938'}
[2023-02-25 12:34:57,332][2409075] DAMAGECOUNT value on done: 410.0
[2023-02-25 12:34:57,335][2409075] Sum rewards: -1.684, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO2': '0.009', 'AMMO4': '0.043', 'ARMOR': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.140', 'HITCOUNT': '0.170', 'weapon4': '0.198', 'HEALTH': '0.272', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.750', 'weapon2': '1.382', 'weapon3': '1.634', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:57,430][2409096] DAMAGECOUNT value on done: 438.0
[2023-02-25 12:34:57,432][2409096] Sum rewards: -1.311, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.824', 'AMMO5': '0.005', 'ARMOR': '0.020', 'WEAPON1': '0.030', 'AMMO2': '0.033', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'AMMO4': '0.163', 'HITCOUNT': '0.220', 'weapon4': '0.384', 'DAMAGECOUNT': '0.657', 'WEAPON3': '0.850', 'weapon2': '1.262', 'weapon3': '1.662', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:34:57,752][2409099] DAMAGECOUNT value on done: 816.0
[2023-02-25 12:34:57,755][2409099] Sum rewards: 3.875, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.738', 'AMMO5': '0.004', 'AMMO2': '0.017', 'weapon5': '0.032', 'AMMO4': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON6': '0.100', 'AMMO3': '0.119', 'weapon6': '0.136', 'WEAPON4': '0.150', 'HITCOUNT': '0.250', 'weapon4': '0.272', 'WEAPON3': '0.650', 'weapon2': '1.088', 'DAMAGECOUNT': '1.533', 'weapon3': '1.630', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:34:57,844][2409405] DAMAGECOUNT value on done: 533.0
[2023-02-25 12:34:57,847][2409405] Sum rewards: -2.708, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.950', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.022', 'weapon5': '0.052', 'weapon7': '0.074', 'AMMO3': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.288', 'ARMOR': '0.428', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.714', 'weapon2': '1.100', 'weapon3': '1.138'}
[2023-02-25 12:34:57,915][2409074] Updated weights for policy 0, policy_version 5900 (0.0013)
[2023-02-25 12:34:58,221][2409076] DAMAGECOUNT value on done: 351.0
[2023-02-25 12:34:58,222][2409076] Sum rewards: 0.927, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.670', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.018', 'AMMO4': '0.024', 'WEAPON5': '0.050', 'AMMO3': '0.062', 'WEAPON4': '0.100', 'weapon4': '0.102', 'HITCOUNT': '0.130', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.417', 'ARMOR': '0.474', 'weapon3': '1.106', 'FRAGCOUNT': '2.000', 'weapon2': '2.006'}
[2023-02-25 12:34:58,921][2409102] DAMAGECOUNT value on done: 495.0
[2023-02-25 12:34:58,924][2409102] Sum rewards: -3.321, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.590', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.018', 'WEAPON5': '0.050', 'ARMOR': '0.064', 'AMMO4': '0.088', 'HITCOUNT': '0.110', 'AMMO3': '0.117', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.327', 'FRAGCOUNT': '0.500', 'weapon4': '0.604', 'WEAPON3': '0.700', 'weapon2': '0.824', 'weapon3': '1.344'}
[2023-02-25 12:34:58,926][2409104] DAMAGECOUNT value on done: 461.0
[2023-02-25 12:34:59,230][2409548] DAMAGECOUNT value on done: 747.0
[2023-02-25 12:34:59,231][2409074] Updated weights for policy 0, policy_version 5910 (0.0013)
[2023-02-25 12:34:59,232][2409548] Sum rewards: -1.587, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.674', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'ARMOR': '0.036', 'AMMO4': '0.045', 'WEAPON5': '0.100', 'AMMO3': '0.124', 'weapon5': '0.132', 'WEAPON4': '0.150', 'HITCOUNT': '0.290', 'weapon4': '0.470', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.143', 'weapon3': '1.258', 'weapon2': '1.552', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:34:59,242][2409866] DAMAGECOUNT value on done: 562.0
[2023-02-25 12:34:59,246][2409866] Sum rewards: 1.686, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.419', 'AMMO2': '0.002', 'AMMO4': '0.008', 'WEAPON1': '0.010', 'ARMOR': '0.028', 'WEAPON4': '0.050', 'weapon4': '0.062', 'AMMO3': '0.072', 'HITCOUNT': '0.190', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.741', 'weapon2': '1.276', 'weapon3': '1.466', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:34:59,352][2409079] DAMAGECOUNT value on done: 752.0
[2023-02-25 12:34:59,355][2409079] Sum rewards: -2.334, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.380', 'AMMO2': '0.012', 'ARMOR': '0.032', 'weapon7': '0.050', 'AMMO4': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.102', 'AMMO3': '0.173', 'HITCOUNT': '0.380', 'WEAPON3': '0.950', 'weapon2': '0.964', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.146', 'weapon3': '2.026'}
[2023-02-25 12:34:59,662][2409355] DAMAGECOUNT value on done: 1105.0
[2023-02-25 12:34:59,664][2409597] DAMAGECOUNT value on done: 846.0
[2023-02-25 12:34:59,665][2409597] Sum rewards: -0.799, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.221', 'AMMO2': '0.026', 'AMMO3': '0.126', 'AMMO4': '0.128', 'HITCOUNT': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.322', 'ARMOR': '0.488', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.792', 'weapon3': '1.620', 'weapon2': '1.720', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:34:59,668][2409355] Sum rewards: 0.397, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.741', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.050', 'weapon4': '0.102', 'AMMO3': '0.115', 'WEAPON5': '0.200', 'ARMOR': '0.428', 'HITCOUNT': '0.460', 'WEAPON3': '0.850', 'weapon2': '1.440', 'DAMAGECOUNT': '1.755', 'weapon3': '1.912', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:34:59,674][2409105] DAMAGECOUNT value on done: 660.0
[2023-02-25 12:34:59,793][2409486] DAMAGECOUNT value on done: 511.0
[2023-02-25 12:34:59,797][2409486] Sum rewards: -1.536, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.845', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'weapon4': '0.070', 'AMMO4': '0.078', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.492', 'ARMOR': '0.527', 'weapon3': '1.316', 'FRAGCOUNT': '2.000', 'weapon2': '2.220'}
[2023-02-25 12:35:00,013][2409596] DAMAGECOUNT value on done: 284.0
[2023-02-25 12:35:00,017][2409596] Sum rewards: -4.929, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.162', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.009', 'AMMO2': '0.010', 'weapon5': '0.040', 'HITCOUNT': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.097', 'ARMOR': '0.114', 'DAMAGECOUNT': '0.150', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.246', 'WEAPON3': '0.550', 'weapon3': '1.542', 'weapon2': '1.722'}
[2023-02-25 12:35:00,181][2409080] DAMAGECOUNT value on done: 327.0
[2023-02-25 12:35:00,190][2409078] DAMAGECOUNT value on done: 568.0
[2023-02-25 12:35:00,193][2409078] Sum rewards: 0.343, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.501', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.047', 'ARMOR': '0.048', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.068', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.436', 'WEAPON3': '0.450', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.984', 'weapon3': '1.174', 'weapon2': '1.884'}
[2023-02-25 12:35:00,255][2409389] DAMAGECOUNT value on done: 556.0
[2023-02-25 12:35:00,256][2409485] DAMAGECOUNT value on done: 329.0
[2023-02-25 12:35:00,257][2409485] Sum rewards: -0.501, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.880', 'AMMO5': '0.005', 'ARMOR': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'weapon5': '0.070', 'AMMO4': '0.092', 'AMMO3': '0.096', 'weapon4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.630', 'weapon3': '1.468', 'weapon2': '1.774', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:35:00,260][2409389] Sum rewards: -2.301, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.418', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.012', 'ARMOR': '0.032', 'weapon4': '0.046', 'WEAPON1': '0.050', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.121', 'HITCOUNT': '0.260', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.813', 'FRAGCOUNT': '1.000', 'weapon2': '1.536', 'weapon3': '1.730'}
[2023-02-25 12:35:00,297][2409100] DAMAGECOUNT value on done: 548.0
[2023-02-25 12:35:00,297][2409100] Sum rewards: -1.669, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.620', 'ARMOR': '0.008', 'AMMO5': '0.009', 'weapon4': '0.014', 'AMMO2': '0.024', 'weapon5': '0.024', 'WEAPON1': '0.030', 'AMMO4': '0.118', 'AMMO3': '0.161', 'HITCOUNT': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.654', 'WEAPON3': '0.850', 'weapon2': '1.388', 'weapon3': '1.590', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:00,359][2409097] DAMAGECOUNT value on done: 500.0
[2023-02-25 12:35:00,426][2409406] DAMAGECOUNT value on done: 492.0
[2023-02-25 12:35:00,429][2409406] Sum rewards: -1.153, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'ARMOR': '0.052', 'AMMO4': '0.063', 'AMMO3': '0.110', 'HITCOUNT': '0.120', 'HEALTH': '0.153', 'weapon4': '0.204', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.646', 'weapon3': '1.836'}
[2023-02-25 12:35:00,521][2409101] DAMAGECOUNT value on done: 734.0
[2023-02-25 12:35:00,522][2409101] Sum rewards: 2.022, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.176', 'AMMO2': '0.024', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.094', 'AMMO4': '0.119', 'weapon4': '0.226', 'HITCOUNT': '0.300', 'WEAPON3': '0.650', 'weapon2': '1.102', 'DAMAGECOUNT': '1.359', 'weapon3': '1.992', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:00,859][2409077] DAMAGECOUNT value on done: 565.0
[2023-02-25 12:35:00,860][2409077] Sum rewards: -4.833, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.662', 'AMMO5': '0.003', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.022', 'AMMO4': '0.024', 'WEAPON5': '0.050', 'ARMOR': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.128', 'weapon4': '0.218', 'HITCOUNT': '0.220', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.720', 'WEAPON3': '0.900', 'weapon2': '1.282', 'weapon3': '1.836'}
[2023-02-25 12:35:01,020][2409549] DAMAGECOUNT value on done: 828.0
[2023-02-25 12:35:01,021][2409549] Sum rewards: 3.534, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.280', 'AMMO2': '0.009', 'ARMOR': '0.024', 'AMMO4': '0.044', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'weapon4': '0.214', 'HITCOUNT': '0.360', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.302', 'weapon2': '1.546', 'weapon3': '1.622', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:35:01,095][2409103] DAMAGECOUNT value on done: 297.0
[2023-02-25 12:35:01,097][2409103] Sum rewards: -3.851, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.268', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.011', 'AMMO3': '0.077', 'weapon5': '0.112', 'WEAPON5': '0.150', 'HITCOUNT': '0.160', 'DAMAGECOUNT': '0.471', 'WEAPON3': '0.600', 'ARMOR': '0.873', 'FRAGCOUNT': '1.000', 'weapon3': '1.394', 'weapon2': '1.838'}
[2023-02-25 12:35:01,140][2409074] Updated weights for policy 0, policy_version 5920 (0.0012)
[2023-02-25 12:35:01,147][2409075] DAMAGECOUNT value on done: 328.0
[2023-02-25 12:35:01,148][2409075] Sum rewards: -2.930, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.324', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'HITCOUNT': '0.070', 'ARMOR': '0.076', 'AMMO4': '0.096', 'weapon4': '0.108', 'AMMO3': '0.109', 'DAMAGECOUNT': '0.225', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.338', 'weapon2': '1.848'}
[2023-02-25 12:35:01,203][2409469] DAMAGECOUNT value on done: 827.0
[2023-02-25 12:35:01,204][2409469] Sum rewards: -1.536, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.018', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.008', 'ARMOR': '0.024', 'AMMO4': '0.035', 'AMMO3': '0.053', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'HITCOUNT': '0.250', 'WEAPON3': '0.350', 'weapon4': '0.360', 'DAMAGECOUNT': '0.672', 'weapon3': '1.030', 'weapon2': '1.888', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:01,232][2409373] DAMAGECOUNT value on done: 495.0
[2023-02-25 12:35:01,233][2409373] Sum rewards: 0.968, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.440', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'weapon5': '0.076', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'HITCOUNT': '0.180', 'weapon4': '0.198', 'WEAPON5': '0.200', 'ARMOR': '0.420', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.921', 'weapon3': '0.982', 'weapon2': '1.178', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:01,277][2409407] DAMAGECOUNT value on done: 364.0
[2023-02-25 12:35:01,277][2409407] Sum rewards: -4.090, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.458', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'WEAPON1': '0.020', 'weapon7': '0.068', 'AMMO3': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.260', 'WEAPON4': '0.300', 'weapon4': '0.338', 'ARMOR': '0.424', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.708', 'FRAGCOUNT': '1.000', 'weapon3': '1.140', 'weapon2': '1.920'}
[2023-02-25 12:35:01,344][2409547] DAMAGECOUNT value on done: 749.0
[2023-02-25 12:35:01,349][2409565] DAMAGECOUNT value on done: 419.0
[2023-02-25 12:35:01,347][2409547] Sum rewards: -2.049, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.700', 'AMMO5': '0.005', 'AMMO2': '0.013', 'ARMOR': '0.036', 'weapon7': '0.048', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.065', 'AMMO3': '0.077', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.480', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.666', 'weapon2': '0.678', 'FRAGCOUNT': '1.000', 'weapon3': '1.076'}
[2023-02-25 12:35:01,356][2409565] Sum rewards: -0.934, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.020', 'AMMO4': '0.099', 'AMMO3': '0.124', 'HITCOUNT': '0.140', 'WEAPON4': '0.200', 'weapon4': '0.206', 'HEALTH': '0.300', 'ARMOR': '0.524', 'DAMAGECOUNT': '0.561', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.696', 'weapon3': '1.746'}
[2023-02-25 12:35:01,483][2409099] DAMAGECOUNT value on done: 441.0
[2023-02-25 12:35:01,484][2409099] Sum rewards: 0.730, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.306', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'AMMO3': '0.050', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'AMMO4': '0.127', 'DAMAGECOUNT': '0.351', 'weapon4': '0.402', 'ARMOR': '0.440', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon2': '1.158', 'weapon3': '1.302'}
[2023-02-25 12:35:01,881][2409096] DAMAGECOUNT value on done: 546.0
[2023-02-25 12:35:01,882][2409096] Sum rewards: -6.024, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.925', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.018', 'weapon5': '0.040', 'AMMO4': '0.089', 'AMMO3': '0.115', 'WEAPON5': '0.150', 'HITCOUNT': '0.190', 'WEAPON4': '0.250', 'weapon4': '0.354', 'DAMAGECOUNT': '0.663', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.348', 'weapon2': '1.468'}
[2023-02-25 12:35:01,933][2409405] DAMAGECOUNT value on done: 615.0
[2023-02-25 12:35:01,934][2409405] Sum rewards: -2.549, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.277', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'ARMOR': '0.056', 'AMMO4': '0.082', 'AMMO3': '0.155', 'weapon4': '0.232', 'HITCOUNT': '0.310', 'DAMAGECOUNT': '0.837', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.054', 'weapon3': '2.026'}
[2023-02-25 12:35:02,186][2408954] Fps is (10 sec: 24166.5, 60 sec: 24849.1, 300 sec: 25478.5). Total num frames: 24276992. Throughput: 0: 6144.3. Samples: 6076260. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0)
[2023-02-25 12:35:02,189][2408954] Avg episode reward: [(0, '-1.478')]
[2023-02-25 12:35:02,443][2409076] DAMAGECOUNT value on done: 741.0
[2023-02-25 12:35:02,452][2409076] Sum rewards: 0.240, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.150', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'AMMO4': '0.079', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'WEAPON4': '0.150', 'weapon4': '0.164', 'HITCOUNT': '0.340', 'WEAPON3': '0.650', 'weapon2': '1.074', 'DAMAGECOUNT': '1.110', 'weapon3': '2.220', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:35:02,627][2409104] DAMAGECOUNT value on done: 857.0
[2023-02-25 12:35:02,631][2409104] Sum rewards: -0.037, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.630', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'WEAPON4': '0.100', 'weapon4': '0.106', 'AMMO3': '0.141', 'HITCOUNT': '0.390', 'ARMOR': '0.440', 'WEAPON3': '0.800', 'weapon3': '1.520', 'DAMAGECOUNT': '1.557', 'weapon2': '1.580', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:35:02,644][2409074] Updated weights for policy 0, policy_version 5930 (0.0012)
[2023-02-25 12:35:02,843][2409866] DAMAGECOUNT value on done: 525.0
[2023-02-25 12:35:02,844][2409866] Sum rewards: -2.367, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.506', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.039', 'ARMOR': '0.060', 'AMMO3': '0.083', 'weapon5': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.190', 'weapon4': '0.260', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.624', 'weapon2': '1.508', 'weapon3': '1.648'}
[2023-02-25 12:35:02,872][2409102] DAMAGECOUNT value on done: 400.0
[2023-02-25 12:35:03,270][2409355] DAMAGECOUNT value on done: 365.0
[2023-02-25 12:35:03,273][2409355] Sum rewards: -5.430, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.035', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'ARMOR': '0.076', 'WEAPON4': '0.100', 'weapon4': '0.100', 'AMMO3': '0.140', 'HITCOUNT': '0.150', 'DAMAGECOUNT': '0.519', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.374', 'weapon2': '2.238'}
[2023-02-25 12:35:03,351][2409597] DAMAGECOUNT value on done: 455.0
[2023-02-25 12:35:03,355][2409597] Sum rewards: -3.169, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.233', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.004', 'AMMO2': '0.019', 'weapon5': '0.038', 'ARMOR': '0.040', 'AMMO4': '0.094', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.270', 'weapon4': '0.310', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.161', 'weapon3': '1.474', 'weapon2': '1.756'}
[2023-02-25 12:35:03,380][2409105] DAMAGECOUNT value on done: 382.0
[2023-02-25 12:35:03,379][2409486] DAMAGECOUNT value on done: 553.0
[2023-02-25 12:35:03,383][2409105] Sum rewards: -4.563, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.410', 'AMMO2': '0.006', 'AMMO4': '0.029', 'HITCOUNT': '0.080', 'AMMO3': '0.108', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.285', 'weapon4': '0.338', 'ARMOR': '0.519', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.296', 'weapon2': '2.036'}
[2023-02-25 12:35:03,383][2409486] Sum rewards: 0.143, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.244', 'AMMO2': '0.014', 'AMMO3': '0.062', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'weapon4': '0.290', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.465', 'weapon3': '0.980', 'weapon2': '1.138', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:03,449][2409548] DAMAGECOUNT value on done: 668.0
[2023-02-25 12:35:03,449][2409548] Sum rewards: -2.022, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-3.000', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'weapon4': '0.006', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.380', 'ARMOR': '0.455', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.434', 'weapon3': '1.614', 'weapon2': '1.808', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:35:03,751][2409596] DAMAGECOUNT value on done: 814.0
[2023-02-25 12:35:03,752][2409596] Sum rewards: 2.127, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.198', 'AMMO5': '0.015', 'AMMO2': '0.019', 'AMMO4': '0.097', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'weapon5': '0.116', 'WEAPON5': '0.200', 'weapon4': '0.238', 'HITCOUNT': '0.330', 'WEAPON3': '0.600', 'ARMOR': '0.844', 'weapon2': '1.106', 'DAMAGECOUNT': '1.308', 'weapon3': '1.504', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:35:04,001][2409080] DAMAGECOUNT value on done: 476.0
[2023-02-25 12:35:04,004][2409080] Sum rewards: -4.519, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.458', 'AMMO5': '0.005', 'AMMO2': '0.028', 'HITCOUNT': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'AMMO4': '0.140', 'weapon5': '0.152', 'weapon4': '0.186', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.378', 'ARMOR': '0.476', 'WEAPON3': '0.600', 'weapon2': '1.322', 'weapon3': '1.820'}
[2023-02-25 12:35:04,137][2409485] DAMAGECOUNT value on done: 616.0
[2023-02-25 12:35:04,137][2409485] Sum rewards: -0.020, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.398', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.073', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'HITCOUNT': '0.200', 'weapon4': '0.342', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.038', 'weapon2': '1.190', 'weapon3': '1.576', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:04,220][2409389] DAMAGECOUNT value on done: 633.0
[2023-02-25 12:35:04,220][2409389] Sum rewards: -2.308, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.994', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.016', 'weapon5': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.101', 'HITCOUNT': '0.210', 'weapon4': '0.214', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.735', 'weapon3': '1.250', 'FRAGCOUNT': '1.500', 'weapon2': '2.136'}
[2023-02-25 12:35:04,231][2409074] Updated weights for policy 0, policy_version 5940 (0.0012)
[2023-02-25 12:35:04,275][2409101] DAMAGECOUNT value on done: 502.0
[2023-02-25 12:35:04,276][2409101] Sum rewards: 0.348, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.437', 'AMMO5': '0.008', 'AMMO2': '0.012', 'WEAPON1': '0.040', 'ARMOR': '0.052', 'AMMO4': '0.057', 'weapon7': '0.074', 'AMMO3': '0.087', 'weapon5': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.180', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.394', 'DAMAGECOUNT': '0.585', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.356', 'weapon2': '1.560'}
[2023-02-25 12:35:04,419][2409406] DAMAGECOUNT value on done: 440.0
[2023-02-25 12:35:04,422][2409406] Sum rewards: -2.487, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.173', 'AMMO5': '0.012', 'AMMO2': '0.018', 'ARMOR': '0.036', 'WEAPON1': '0.040', 'AMMO4': '0.090', 'AMMO3': '0.102', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'weapon5': '0.152', 'weapon4': '0.244', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.495', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.600', 'weapon2': '1.238', 'weapon3': '1.878'}
[2023-02-25 12:35:04,541][2409100] DAMAGECOUNT value on done: 777.0
[2023-02-25 12:35:04,543][2409100] Sum rewards: 0.482, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.420', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.034', 'WEAPON5': '0.050', 'AMMO3': '0.078', 'weapon5': '0.088', 'HITCOUNT': '0.200', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.182', 'weapon2': '1.448', 'weapon3': '1.552'}
[2023-02-25 12:35:04,548][2409079] DAMAGECOUNT value on done: 653.0
[2023-02-25 12:35:04,551][2409079] Sum rewards: -0.575, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.731', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon7': '0.066', 'AMMO4': '0.088', 'AMMO3': '0.095', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.124', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.260', 'ARMOR': '0.436', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.924', 'FRAGCOUNT': '1.000', 'weapon2': '1.236', 'weapon3': '2.098'}
[2023-02-25 12:35:04,574][2409078] DAMAGECOUNT value on done: 959.0
[2023-02-25 12:35:04,574][2409078] Sum rewards: 4.222, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.600', 'AMMO2': '0.004', 'AMMO4': '0.018', 'ARMOR': '0.052', 'AMMO3': '0.067', 'WEAPON4': '0.200', 'HITCOUNT': '0.340', 'weapon4': '0.414', 'WEAPON3': '0.500', 'weapon2': '1.238', 'weapon3': '1.302', 'DAMAGECOUNT': '1.437', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:04,606][2409097] DAMAGECOUNT value on done: 799.0
[2023-02-25 12:35:04,608][2409097] Sum rewards: -3.628, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.856', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'weapon4': '0.324', 'ARMOR': '0.533', 'DAMAGECOUNT': '0.687', 'WEAPON3': '0.700', 'weapon3': '1.250', 'weapon2': '1.512', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:04,857][2409077] DAMAGECOUNT value on done: 547.0
[2023-02-25 12:35:04,860][2409077] Sum rewards: -6.384, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.540', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.074', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'weapon4': '0.264', 'HITCOUNT': '0.290', 'ARMOR': '0.408', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.876', 'weapon3': '1.582', 'weapon2': '1.760'}
[2023-02-25 12:35:04,957][2409373] DAMAGECOUNT value on done: 363.0
[2023-02-25 12:35:04,979][2409565] DAMAGECOUNT value on done: 511.0
[2023-02-25 12:35:04,983][2409565] Sum rewards: 0.037, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.861', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.106', 'AMMO3': '0.129', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.300', 'weapon4': '0.372', 'WEAPON3': '0.700', 'ARMOR': '0.875', 'DAMAGECOUNT': '0.984', 'weapon2': '1.302', 'FRAGCOUNT': '1.500', 'weapon3': '1.682'}
[2023-02-25 12:35:05,091][2409099] DAMAGECOUNT value on done: 601.0
[2023-02-25 12:35:05,113][2409075] DAMAGECOUNT value on done: 471.0
[2023-02-25 12:35:05,114][2409075] Sum rewards: -1.003, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.982', 'AMMO2': '0.005', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO4': '0.023', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.158', 'HITCOUNT': '0.160', 'WEAPON5': '0.200', 'ARMOR': '0.466', 'DAMAGECOUNT': '0.693', 'WEAPON3': '0.950', 'weapon3': '1.676', 'weapon2': '1.684', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:05,116][2409549] DAMAGECOUNT value on done: 476.0
[2023-02-25 12:35:05,117][2409103] DAMAGECOUNT value on done: 517.0
[2023-02-25 12:35:05,117][2409549] Sum rewards: -0.923, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.845', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.061', 'ARMOR': '0.072', 'AMMO3': '0.097', 'HITCOUNT': '0.330', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.846', 'FRAGCOUNT': '1.000', 'weapon2': '1.390', 'weapon3': '1.504'}
[2023-02-25 12:35:05,289][2409547] DAMAGECOUNT value on done: 1172.0
[2023-02-25 12:35:05,292][2409547] Sum rewards: 5.025, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.368', 'AMMO5': '0.003', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.041', 'WEAPON5': '0.050', 'AMMO3': '0.103', 'weapon5': '0.106', 'HITCOUNT': '0.630', 'WEAPON3': '0.700', 'weapon2': '1.114', 'weapon3': '2.352', 'DAMAGECOUNT': '2.526', 'FRAGCOUNT': '4.500'}
[2023-02-25 12:35:05,444][2409469] DAMAGECOUNT value on done: 1300.0
[2023-02-25 12:35:05,445][2409469] Sum rewards: 0.525, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.187', 'AMMO5': '0.009', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.050', 'weapon7': '0.080', 'AMMO3': '0.087', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.126', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '0.600', 'weapon4': '0.656', 'weapon2': '1.032', 'weapon3': '1.290', 'DAMAGECOUNT': '1.611', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:35:05,923][2409468] DAMAGECOUNT value on done: 658.0
[2023-02-25 12:35:05,924][2409468] Sum rewards: -0.867, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.130', 'AMMO2': '0.010', 'ARMOR': '0.016', 'AMMO4': '0.050', 'AMMO3': '0.078', 'HITCOUNT': '0.130', 'weapon4': '0.196', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon3': '1.206', 'weapon2': '1.486'}
[2023-02-25 12:35:06,064][2409076] DAMAGECOUNT value on done: 675.0
[2023-02-25 12:35:06,068][2409076] Sum rewards: -3.810, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.894', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon5': '0.028', 'ARMOR': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.090', 'AMMO4': '0.101', 'weapon4': '0.110', 'HITCOUNT': '0.300', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.026', 'weapon3': '1.466', 'weapon2': '2.122'}
[2023-02-25 12:35:06,083][2409407] DAMAGECOUNT value on done: 547.0
[2023-02-25 12:35:06,086][2409407] Sum rewards: 1.044, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.470', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO3': '0.080', 'weapon4': '0.110', 'HITCOUNT': '0.260', 'WEAPON3': '0.450', 'ARMOR': '0.540', 'DAMAGECOUNT': '0.825', 'FRAGCOUNT': '1.000', 'weapon2': '1.142', 'weapon3': '1.426'}
[2023-02-25 12:35:06,123][2409096] DAMAGECOUNT value on done: 793.0
[2023-02-25 12:35:06,124][2409096] Sum rewards: -0.521, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.500', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'HITCOUNT': '0.280', 'weapon4': '0.298', 'ARMOR': '0.482', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.906', 'weapon2': '1.054', 'FRAGCOUNT': '2.000', 'weapon3': '2.206'}
[2023-02-25 12:35:06,235][2409104] DAMAGECOUNT value on done: 702.0
[2023-02-25 12:35:06,236][2409104] Sum rewards: -0.603, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.100', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.006', 'WEAPON1': '0.020', 'weapon5': '0.084', 'AMMO3': '0.127', 'WEAPON5': '0.150', 'HITCOUNT': '0.400', 'WEAPON3': '0.850', 'weapon2': '1.368', 'DAMAGECOUNT': '1.461', 'FRAGCOUNT': '1.500', 'weapon3': '2.062'}
[2023-02-25 12:35:06,262][2409074] Updated weights for policy 0, policy_version 5950 (0.0012)
[2023-02-25 12:35:06,605][2409102] DAMAGECOUNT value on done: 512.0
[2023-02-25 12:35:06,608][2409866] DAMAGECOUNT value on done: 550.0
[2023-02-25 12:35:06,606][2409102] Sum rewards: 1.336, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.544', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'WEAPON1': '0.010', 'weapon7': '0.076', 'AMMO3': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.170', 'WEAPON7': '0.200', 'ARMOR': '0.463', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.650', 'weapon3': '1.526', 'weapon2': '1.816', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:06,609][2409866] Sum rewards: 0.640, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.132', 'weapon4': '0.168', 'HITCOUNT': '0.200', 'HEALTH': '0.364', 'ARMOR': '0.420', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.675', 'weapon2': '1.580', 'weapon3': '1.666', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:06,674][2409405] DAMAGECOUNT value on done: 884.0
[2023-02-25 12:35:06,677][2409405] Sum rewards: 1.874, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.064', 'AMMO4': '0.160', 'HITCOUNT': '0.200', 'weapon4': '0.220', 'HEALTH': '0.340', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.765', 'FRAGCOUNT': '1.000', 'weapon3': '1.408', 'weapon2': '1.734'}
[2023-02-25 12:35:06,968][2409486] DAMAGECOUNT value on done: 1012.0
[2023-02-25 12:35:06,969][2409486] Sum rewards: -0.613, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.518', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'ARMOR': '0.068', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.154', 'HITCOUNT': '0.320', 'WEAPON3': '1.000', 'weapon2': '1.526', 'DAMAGECOUNT': '1.740', 'weapon3': '1.884', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:07,052][2409548] DAMAGECOUNT value on done: 408.0
[2023-02-25 12:35:07,053][2409548] Sum rewards: -1.015, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.075', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.092', 'HITCOUNT': '0.230', 'weapon4': '0.248', 'DAMAGECOUNT': '0.639', 'WEAPON3': '0.750', 'weapon2': '1.346', 'weapon3': '1.700', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:07,186][2408954] Fps is (10 sec: 25804.9, 60 sec: 24780.9, 300 sec: 25520.2). Total num frames: 24403968. Throughput: 0: 6121.6. Samples: 6094644. Policy #0 lag: (min: 0.0, avg: 15.4, max: 31.0)
[2023-02-25 12:35:07,186][2408954] Avg episode reward: [(0, '-1.481')]
[2023-02-25 12:35:07,204][2409355] DAMAGECOUNT value on done: 590.0
[2023-02-25 12:35:07,205][2409355] Sum rewards: 0.067, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.533', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'WEAPON1': '0.010', 'ARMOR': '0.063', 'AMMO3': '0.137', 'HITCOUNT': '0.220', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.840', 'FRAGCOUNT': '1.000', 'weapon2': '1.542', 'weapon3': '2.228'}
[2023-02-25 12:35:07,296][2409596] DAMAGECOUNT value on done: 874.0
[2023-02-25 12:35:07,351][2409597] DAMAGECOUNT value on done: 680.0
[2023-02-25 12:35:07,354][2409597] Sum rewards: -0.087, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.497', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'weapon5': '0.030', 'AMMO4': '0.096', 'AMMO3': '0.110', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.280', 'weapon4': '0.350', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.320', 'weapon3': '1.370', 'weapon2': '1.818', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:35:07,400][2409105] DAMAGECOUNT value on done: 346.0
[2023-02-25 12:35:07,467][2409074] Updated weights for policy 0, policy_version 5960 (0.0012)
[2023-02-25 12:35:07,793][2409080] DAMAGECOUNT value on done: 557.0
[2023-02-25 12:35:07,794][2409080] Sum rewards: 0.247, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.132', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'weapon5': '0.112', 'AMMO3': '0.116', 'HITCOUNT': '0.140', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.700', 'weapon3': '1.648', 'weapon2': '1.778', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:07,852][2409485] DAMAGECOUNT value on done: 514.0
[2023-02-25 12:35:07,853][2409485] Sum rewards: 1.260, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.956', 'AMMO5': '0.013', 'AMMO2': '0.023', 'ARMOR': '0.040', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.087', 'AMMO4': '0.112', 'HITCOUNT': '0.120', 'weapon5': '0.140', 'weapon4': '0.164', 'WEAPON5': '0.250', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.230', 'weapon2': '1.452', 'weapon3': '1.844', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:08,107][2409406] DAMAGECOUNT value on done: 334.0
[2023-02-25 12:35:08,107][2409100] DAMAGECOUNT value on done: 497.0
[2023-02-25 12:35:08,110][2409406] Sum rewards: -2.538, reward structure: {'DEATHCOUNT': '-3.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.536', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon5': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.025', 'ARMOR': '0.032', 'AMMO3': '0.040', 'HITCOUNT': '0.040', 'weapon7': '0.056', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.326', 'weapon3': '0.850', 'weapon2': '0.856'}
[2023-02-25 12:35:08,111][2409100] Sum rewards: 1.339, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.562', 'AMMO5': '0.005', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.037', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'HITCOUNT': '0.210', 'WEAPON3': '0.450', 'ARMOR': '0.483', 'DAMAGECOUNT': '0.636', 'weapon3': '1.004', 'weapon2': '1.878', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:08,500][2409079] DAMAGECOUNT value on done: 401.0
[2023-02-25 12:35:08,501][2409079] Sum rewards: -0.819, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.884', 'AMMO2': '0.029', 'WEAPON1': '0.040', 'HITCOUNT': '0.100', 'AMMO3': '0.103', 'AMMO4': '0.144', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.258', 'ARMOR': '0.457', 'weapon4': '0.538', 'WEAPON3': '0.700', 'weapon2': '1.446', 'weapon3': '1.500', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:08,536][2409077] DAMAGECOUNT value on done: 297.0
[2023-02-25 12:35:08,537][2409077] Sum rewards: 0.346, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.347', 'AMMO2': '0.022', 'HITCOUNT': '0.090', 'AMMO3': '0.093', 'AMMO4': '0.112', 'WEAPON4': '0.200', 'weapon4': '0.202', 'DAMAGECOUNT': '0.360', 'ARMOR': '0.546', 'WEAPON3': '0.550', 'weapon3': '1.508', 'weapon2': '1.760', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:08,588][2409373] DAMAGECOUNT value on done: 735.0
[2023-02-25 12:35:08,592][2409373] Sum rewards: -2.032, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.154', 'AMMO2': '0.021', 'ARMOR': '0.079', 'AMMO4': '0.103', 'AMMO3': '0.124', 'HITCOUNT': '0.190', 'WEAPON4': '0.400', 'DAMAGECOUNT': '0.609', 'weapon3': '0.684', 'WEAPON3': '0.700', 'weapon4': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '2.012'}
[2023-02-25 12:35:08,684][2409565] DAMAGECOUNT value on done: 392.0
[2023-02-25 12:35:08,687][2409565] Sum rewards: 3.607, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.865', 'AMMO2': '0.004', 'AMMO4': '0.020', 'ARMOR': '0.024', 'AMMO3': '0.076', 'weapon7': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.200', 'HITCOUNT': '0.260', 'weapon4': '0.334', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.987', 'weapon3': '1.166', 'weapon2': '1.370', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:08,714][2409099] DAMAGECOUNT value on done: 856.0
[2023-02-25 12:35:08,721][2409103] DAMAGECOUNT value on done: 724.0
[2023-02-25 12:35:08,718][2409099] Sum rewards: 0.320, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.458', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon7': '0.048', 'weapon5': '0.058', 'AMMO3': '0.079', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.356', 'WEAPON3': '0.450', 'ARMOR': '0.513', 'weapon3': '0.828', 'DAMAGECOUNT': '1.059', 'weapon2': '1.842', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:08,722][2409103] Sum rewards: -1.093, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.039', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.062', 'AMMO3': '0.087', 'ARMOR': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'WEAPON4': '0.300', 'weapon4': '0.304', 'HITCOUNT': '0.310', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.065', 'weapon3': '1.322', 'weapon2': '1.662', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:08,811][2409078] DAMAGECOUNT value on done: 475.0
[2023-02-25 12:35:08,812][2409078] Sum rewards: -4.444, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.895', 'AMMO4': '-0.067', 'AMMO2': '-0.013', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.160', 'weapon4': '0.228', 'HITCOUNT': '0.240', 'ARMOR': '0.464', 'DAMAGECOUNT': '0.765', 'WEAPON3': '0.800', 'weapon2': '1.454', 'weapon3': '1.690', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:08,921][2409101] DAMAGECOUNT value on done: 514.0
[2023-02-25 12:35:08,922][2409101] Sum rewards: -5.718, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.760', 'AMMO2': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.059', 'AMMO3': '0.156', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'weapon4': '0.242', 'ARMOR': '0.470', 'DAMAGECOUNT': '0.615', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.050', 'weapon2': '1.700', 'weapon3': '1.838'}
[2023-02-25 12:35:08,963][2409389] DAMAGECOUNT value on done: 564.0
[2023-02-25 12:35:08,965][2409389] Sum rewards: -1.671, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.430', 'AMMO2': '0.002', 'AMMO4': '0.012', 'ARMOR': '0.016', 'weapon4': '0.022', 'AMMO3': '0.118', 'WEAPON4': '0.150', 'HITCOUNT': '0.220', 'DAMAGECOUNT': '0.720', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.596', 'weapon3': '1.852'}
[2023-02-25 12:35:09,050][2409469] DAMAGECOUNT value on done: 777.0
[2023-02-25 12:35:09,053][2409469] Sum rewards: 1.791, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.008', 'AMMO5': '0.009', 'HEALTH': '0.021', 'ARMOR': '0.036', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'AMMO3': '0.069', 'weapon5': '0.098', 'weapon4': '0.168', 'WEAPON5': '0.200', 'HITCOUNT': '0.260', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.113', 'weapon2': '1.368', 'weapon3': '1.402'}
[2023-02-25 12:35:09,228][2409074] Updated weights for policy 0, policy_version 5970 (0.0012)
[2023-02-25 12:35:09,679][2409549] DAMAGECOUNT value on done: 837.0
[2023-02-25 12:35:09,680][2409549] Sum rewards: 2.219, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.744', 'AMMO2': '0.006', 'AMMO4': '0.029', 'AMMO3': '0.113', 'HITCOUNT': '0.340', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.257', 'weapon2': '1.638', 'weapon3': '1.980', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:35:09,722][2409407] DAMAGECOUNT value on done: 818.0
[2023-02-25 12:35:09,723][2409407] Sum rewards: -2.694, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-1.000', 'HEALTH': '-0.375', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.025', 'weapon5': '0.098', 'AMMO3': '0.120', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'weapon4': '0.154', 'WEAPON4': '0.200', 'HITCOUNT': '0.430', 'WEAPON3': '0.700', 'weapon2': '1.020', 'DAMAGECOUNT': '1.653', 'weapon3': '2.222'}
[2023-02-25 12:35:09,751][2409096] DAMAGECOUNT value on done: 277.0
[2023-02-25 12:35:09,752][2409096] Sum rewards: -1.388, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.796', 'ARMOR': '0.028', 'AMMO2': '0.032', 'WEAPON1': '0.050', 'AMMO3': '0.083', 'AMMO4': '0.158', 'HITCOUNT': '0.160', 'WEAPON4': '0.250', 'weapon4': '0.448', 'DAMAGECOUNT': '0.453', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.378', 'weapon2': '1.518'}
[2023-02-25 12:35:09,814][2409468] DAMAGECOUNT value on done: 103.0
[2023-02-25 12:35:09,859][2409104] DAMAGECOUNT value on done: 483.0
[2023-02-25 12:35:09,904][2409076] DAMAGECOUNT value on done: 749.0
[2023-02-25 12:35:09,909][2409076] Sum rewards: -1.860, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.770', 'AMMO4': '-0.061', 'AMMO2': '-0.012', 'AMMO5': '0.014', 'weapon5': '0.018', 'WEAPON1': '0.020', 'weapon7': '0.078', 'weapon4': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.390', 'FRAGCOUNT': '0.500', 'ARMOR': '0.531', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.386', 'weapon3': '1.480', 'weapon2': '1.694'}
[2023-02-25 12:35:10,047][2409097] DAMAGECOUNT value on done: 772.0
[2023-02-25 12:35:10,048][2409097] Sum rewards: -3.509, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.257', 'AMMO2': '0.036', 'AMMO3': '0.085', 'ARMOR': '0.132', 'AMMO4': '0.182', 'HITCOUNT': '0.190', 'DAMAGECOUNT': '0.423', 'WEAPON4': '0.500', 'WEAPON3': '0.500', 'weapon4': '0.514', 'FRAGCOUNT': '1.000', 'weapon3': '1.388', 'weapon2': '1.798'}
[2023-02-25 12:35:10,107][2409102] DAMAGECOUNT value on done: 820.0
[2023-02-25 12:35:10,112][2409102] Sum rewards: -0.474, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.418', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO3': '0.080', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.300', 'weapon4': '0.388', 'ARMOR': '0.440', 'WEAPON3': '0.550', 'weapon3': '1.244', 'weapon2': '1.482', 'DAMAGECOUNT': '1.809', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:35:10,351][2409075] DAMAGECOUNT value on done: 444.0
[2023-02-25 12:35:10,524][2409486] DAMAGECOUNT value on done: 445.0
[2023-02-25 12:35:10,525][2409486] Sum rewards: 3.285, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.026', 'weapon5': '0.034', 'AMMO3': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'HITCOUNT': '0.180', 'WEAPON3': '0.250', 'HEALTH': '0.372', 'ARMOR': '0.516', 'DAMAGECOUNT': '0.777', 'weapon3': '1.144', 'weapon2': '1.424', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:10,574][2409405] DAMAGECOUNT value on done: 621.0
[2023-02-25 12:35:10,575][2409405] Sum rewards: -3.341, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.700', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.059', 'ARMOR': '0.068', 'AMMO3': '0.105', 'HITCOUNT': '0.240', 'WEAPON4': '0.250', 'weapon4': '0.370', 'DAMAGECOUNT': '0.705', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.314', 'weapon3': '1.726'}
[2023-02-25 12:35:10,818][2409074] Updated weights for policy 0, policy_version 5980 (0.0012)
[2023-02-25 12:35:10,829][2409548] DAMAGECOUNT value on done: 443.0
[2023-02-25 12:35:10,830][2409548] Sum rewards: 0.382, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.091', 'AMMO2': '0.000', 'AMMO4': '0.002', 'ARMOR': '0.032', 'weapon7': '0.050', 'AMMO3': '0.067', 'WEAPON4': '0.100', 'AMMO6': '0.160', 'AMMO7': '0.160', 'HITCOUNT': '0.180', 'WEAPON7': '0.200', 'weapon4': '0.248', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.744', 'weapon3': '1.228', 'weapon2': '1.852', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:10,891][2409547] DAMAGECOUNT value on done: 481.0
[2023-02-25 12:35:10,891][2409547] Sum rewards: 0.830, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.230', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.024', 'weapon5': '0.024', 'WEAPON1': '0.030', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.113', 'HITCOUNT': '0.290', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.909', 'weapon2': '1.504', 'weapon3': '1.976', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:35:10,904][2409866] DAMAGECOUNT value on done: 822.0
[2023-02-25 12:35:10,905][2409866] Sum rewards: 1.854, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.560', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'WEAPON1': '0.020', 'AMMO3': '0.088', 'HITCOUNT': '0.380', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.275', 'weapon2': '1.300', 'weapon3': '1.752', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:35:10,926][2409596] DAMAGECOUNT value on done: 997.0
[2023-02-25 12:35:10,927][2409596] Sum rewards: 2.497, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.609', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.007', 'ARMOR': '0.028', 'weapon5': '0.072', 'AMMO3': '0.078', 'WEAPON5': '0.100', 'HITCOUNT': '0.230', 'WEAPON3': '0.500', 'weapon3': '1.266', 'DAMAGECOUNT': '1.461', 'weapon2': '1.658', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:11,404][2409355] DAMAGECOUNT value on done: 578.0
[2023-02-25 12:35:11,415][2409597] DAMAGECOUNT value on done: 363.0
[2023-02-25 12:35:11,416][2409597] Sum rewards: 0.097, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.140', 'AMMO2': '0.027', 'WEAPON1': '0.040', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.135', 'weapon4': '0.154', 'HITCOUNT': '0.190', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.552', 'FRAGCOUNT': '1.000', 'weapon2': '1.688', 'weapon3': '1.710'}
[2023-02-25 12:35:11,514][2409105] DAMAGECOUNT value on done: 913.0
[2023-02-25 12:35:11,517][2409105] Sum rewards: -1.118, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.802', 'AMMO2': '0.010', 'ARMOR': '0.032', 'weapon7': '0.050', 'AMMO4': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon4': '0.230', 'HITCOUNT': '0.310', 'WEAPON3': '0.600', 'weapon2': '0.932', 'DAMAGECOUNT': '0.960', 'weapon3': '1.508', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:11,681][2409485] DAMAGECOUNT value on done: 312.0
[2023-02-25 12:35:11,705][2409080] DAMAGECOUNT value on done: 318.0
[2023-02-25 12:35:11,707][2409080] Sum rewards: -1.217, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.829', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.014', 'ARMOR': '0.032', 'HITCOUNT': '0.050', 'AMMO3': '0.111', 'DAMAGECOUNT': '0.180', 'WEAPON4': '0.300', 'weapon4': '0.568', 'WEAPON3': '0.700', 'weapon2': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.794'}
[2023-02-25 12:35:11,799][2409100] DAMAGECOUNT value on done: 446.0
[2023-02-25 12:35:11,802][2409100] Sum rewards: 0.031, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.260', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'ARMOR': '0.041', 'AMMO3': '0.077', 'AMMO4': '0.118', 'weapon5': '0.124', 'WEAPON5': '0.150', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.278', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.591', 'weapon3': '1.322', 'weapon2': '1.608', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:11,841][2409406] DAMAGECOUNT value on done: 603.0
[2023-02-25 12:35:12,145][2409079] DAMAGECOUNT value on done: 652.0
[2023-02-25 12:35:12,146][2409079] Sum rewards: -3.838, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.208', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon4': '0.018', 'AMMO2': '0.038', 'weapon5': '0.060', 'AMMO3': '0.076', 'WEAPON5': '0.150', 'AMMO4': '0.189', 'WEAPON4': '0.200', 'HITCOUNT': '0.200', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.128', 'weapon3': '1.418', 'weapon2': '1.872'}
[2023-02-25 12:35:12,186][2408954] Fps is (10 sec: 24984.9, 60 sec: 24712.5, 300 sec: 25520.1). Total num frames: 24526848. Throughput: 0: 6094.4. Samples: 6131676. Policy #0 lag: (min: 0.0, avg: 12.4, max: 28.0)
[2023-02-25 12:35:12,186][2408954] Avg episode reward: [(0, '-1.032')]
[2023-02-25 12:35:12,263][2409565] DAMAGECOUNT value on done: 1060.0
[2023-02-25 12:35:12,264][2409565] Sum rewards: 4.695, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.003', 'AMMO2': '0.013', 'AMMO3': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'ARMOR': '0.061', 'AMMO4': '0.063', 'weapon7': '0.072', 'weapon5': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.168', 'WEAPON7': '0.200', 'HITCOUNT': '0.210', 'WEAPON3': '0.250', 'HEALTH': '0.268', 'weapon3': '0.830', 'weapon2': '1.480', 'DAMAGECOUNT': '1.587', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:12,271][2409077] DAMAGECOUNT value on done: 477.0
[2023-02-25 12:35:12,393][2409373] DAMAGECOUNT value on done: 594.0
[2023-02-25 12:35:12,396][2409373] Sum rewards: -2.651, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.248', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.135', 'WEAPON4': '0.200', 'HITCOUNT': '0.280', 'weapon4': '0.308', 'ARMOR': '0.452', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.945', 'FRAGCOUNT': '1.000', 'weapon3': '1.536', 'weapon2': '1.742'}
[2023-02-25 12:35:12,473][2409103] DAMAGECOUNT value on done: 975.0
[2023-02-25 12:35:12,477][2409103] Sum rewards: -1.716, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.178', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'WEAPON1': '0.020', 'AMMO3': '0.083', 'HITCOUNT': '0.220', 'ARMOR': '0.487', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.717', 'FRAGCOUNT': '1.000', 'weapon2': '1.422', 'weapon3': '1.668'}
[2023-02-25 12:35:12,580][2409099] DAMAGECOUNT value on done: 635.0
[2023-02-25 12:35:12,709][2409074] Updated weights for policy 0, policy_version 5990 (0.0012)
[2023-02-25 12:35:12,932][2409078] DAMAGECOUNT value on done: 235.0
[2023-02-25 12:35:12,933][2409078] Sum rewards: -3.210, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.586', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.030', 'AMMO4': '0.040', 'weapon7': '0.068', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.282', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.327', 'ARMOR': '0.510', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.040', 'weapon3': '1.770'}
[2023-02-25 12:35:13,093][2409389] DAMAGECOUNT value on done: 542.0
[2023-02-25 12:35:13,172][2409101] DAMAGECOUNT value on done: 605.0
[2023-02-25 12:35:13,427][2409469] DAMAGECOUNT value on done: 358.0
[2023-02-25 12:35:13,429][2409469] Sum rewards: -5.697, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.428', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.032', 'WEAPON5': '0.050', 'HITCOUNT': '0.070', 'AMMO4': '0.082', 'AMMO3': '0.105', 'WEAPON4': '0.200', 'weapon4': '0.220', 'DAMAGECOUNT': '0.225', 'WEAPON3': '0.600', 'ARMOR': '1.216', 'weapon3': '1.274', 'weapon2': '2.118'}
[2023-02-25 12:35:13,448][2409104] DAMAGECOUNT value on done: 285.0
[2023-02-25 12:35:13,449][2409104] Sum rewards: -4.077, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.916', 'AMMO5': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon5': '0.036', 'HITCOUNT': '0.090', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.450', 'ARMOR': '0.451', 'weapon3': '1.076', 'weapon2': '1.538'}
[2023-02-25 12:35:13,596][2409076] DAMAGECOUNT value on done: 766.0
[2023-02-25 12:35:13,600][2409076] Sum rewards: -0.680, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.124', 'AMMO5': '0.007', 'weapon5': '0.026', 'AMMO2': '0.030', 'ARMOR': '0.084', 'AMMO3': '0.103', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.260', 'HITCOUNT': '0.350', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.214', 'DAMAGECOUNT': '1.443', 'weapon3': '2.028'}
[2023-02-25 12:35:13,626][2409468] DAMAGECOUNT value on done: 687.0
[2023-02-25 12:35:13,626][2409468] Sum rewards: -0.550, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.283', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'weapon5': '0.074', 'AMMO3': '0.132', 'HITCOUNT': '0.310', 'WEAPON3': '0.800', 'ARMOR': '0.857', 'DAMAGECOUNT': '1.014', 'weapon2': '1.460', 'weapon3': '1.938', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:13,658][2409549] DAMAGECOUNT value on done: 635.0
[2023-02-25 12:35:13,660][2409549] Sum rewards: 0.277, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.556', 'AMMO2': '0.025', 'ARMOR': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.123', 'HITCOUNT': '0.170', 'weapon4': '0.210', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.810', 'weapon2': '1.150', 'FRAGCOUNT': '2.000', 'weapon3': '2.110'}
[2023-02-25 12:35:13,685][2409097] DAMAGECOUNT value on done: 309.0
[2023-02-25 12:35:13,686][2409097] Sum rewards: 1.906, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.018', 'AMMO3': '0.040', 'weapon7': '0.054', 'AMMO4': '0.076', 'HITCOUNT': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'WEAPON3': '0.200', 'HEALTH': '0.308', 'DAMAGECOUNT': '0.390', 'weapon4': '0.432', 'weapon3': '0.492', 'weapon2': '1.046', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:14,042][2409407] DAMAGECOUNT value on done: 677.0
[2023-02-25 12:35:14,045][2409407] Sum rewards: 0.640, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.342', 'AMMO2': '0.013', 'ARMOR': '0.032', 'AMMO4': '0.063', 'AMMO3': '0.067', 'WEAPON4': '0.250', 'HITCOUNT': '0.340', 'WEAPON3': '0.500', 'weapon4': '0.562', 'weapon3': '1.156', 'DAMAGECOUNT': '1.347', 'weapon2': '1.902', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:35:14,044][2409075] DAMAGECOUNT value on done: 507.0
[2023-02-25 12:35:14,048][2409075] Sum rewards: 1.215, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.012', 'HEALTH': '0.031', 'AMMO4': '0.061', 'AMMO3': '0.065', 'WEAPON4': '0.100', 'HITCOUNT': '0.240', 'weapon4': '0.316', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.696', 'FRAGCOUNT': '1.000', 'weapon3': '1.356', 'weapon2': '1.388'}
[2023-02-25 12:35:14,117][2409102] DAMAGECOUNT value on done: 621.0
[2023-02-25 12:35:14,299][2409074] Updated weights for policy 0, policy_version 6000 (0.0012)
[2023-02-25 12:35:14,443][2409096] DAMAGECOUNT value on done: 1066.0
[2023-02-25 12:35:14,444][2409096] Sum rewards: -2.244, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.005', 'HEALTH': '0.008', 'weapon4': '0.010', 'AMMO2': '0.022', 'ARMOR': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.145', 'weapon5': '0.160', 'HITCOUNT': '0.190', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.714', 'weapon3': '1.644', 'weapon2': '1.794'}
[2023-02-25 12:35:14,464][2409548] DAMAGECOUNT value on done: 736.0
[2023-02-25 12:35:14,467][2409548] Sum rewards: -2.711, reward structure: {'DEATHCOUNT': '-5.250', 'FRAGCOUNT': '-3.000', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'weapon5': '0.074', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'HEALTH': '0.127', 'HITCOUNT': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.873', 'weapon3': '1.170', 'weapon2': '2.104'}
[2023-02-25 12:35:14,486][2409547] DAMAGECOUNT value on done: 869.0
[2023-02-25 12:35:14,489][2409547] Sum rewards: 0.190, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.622', 'AMMO2': '0.004', 'AMMO4': '0.018', 'ARMOR': '0.028', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'weapon4': '0.202', 'HITCOUNT': '0.250', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.780', 'weapon3': '1.438', 'weapon2': '1.514', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:14,514][2409596] DAMAGECOUNT value on done: 649.0
[2023-02-25 12:35:14,532][2409486] DAMAGECOUNT value on done: 829.0
[2023-02-25 12:35:14,535][2409486] Sum rewards: -1.093, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.810', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'ARMOR': '0.028', 'AMMO4': '0.088', 'AMMO3': '0.136', 'weapon4': '0.278', 'WEAPON4': '0.300', 'HITCOUNT': '0.360', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.131', 'weapon2': '1.158', 'weapon3': '2.060', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:35:14,971][2409405] DAMAGECOUNT value on done: 772.0
[2023-02-25 12:35:14,975][2409405] Sum rewards: -2.049, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.290', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON1': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO3': '0.076', 'HITCOUNT': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.356', 'WEAPON3': '0.450', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.525', 'weapon3': '1.424', 'weapon2': '1.426'}
[2023-02-25 12:35:15,348][2409100] DAMAGECOUNT value on done: 548.0
[2023-02-25 12:35:15,350][2409100] Sum rewards: 2.902, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.036', 'AMMO2': '0.008', 'ARMOR': '0.012', 'AMMO4': '0.037', 'AMMO3': '0.040', 'weapon7': '0.058', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.152', 'WEAPON7': '0.200', 'HITCOUNT': '0.250', 'WEAPON3': '0.400', 'weapon2': '0.978', 'weapon3': '1.026', 'DAMAGECOUNT': '1.137', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:15,457][2409406] DAMAGECOUNT value on done: 895.0
[2023-02-25 12:35:15,460][2409406] Sum rewards: 0.203, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.450', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon7': '0.030', 'AMMO4': '0.081', 'AMMO3': '0.098', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.290', 'HITCOUNT': '0.410', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.488', 'weapon2': '1.592', 'weapon3': '1.728', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:15,497][2409597] DAMAGECOUNT value on done: 753.0
[2023-02-25 12:35:15,500][2409597] Sum rewards: 2.126, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.700', 'AMMO5': '0.004', 'ARMOR': '0.024', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'weapon5': '0.048', 'weapon4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.134', 'AMMO4': '0.141', 'HITCOUNT': '0.370', 'WEAPON3': '0.800', 'weapon2': '1.160', 'DAMAGECOUNT': '1.575', 'weapon3': '2.218', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:35:15,544][2409105] DAMAGECOUNT value on done: 519.0
[2023-02-25 12:35:15,546][2409105] Sum rewards: -4.413, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.632', 'AMMO4': '-0.008', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'HITCOUNT': '0.070', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.267', 'weapon4': '0.370', 'WEAPON3': '0.700', 'ARMOR': '0.926', 'FRAGCOUNT': '1.000', 'weapon3': '1.562', 'weapon2': '1.680'}
[2023-02-25 12:35:15,560][2409485] DAMAGECOUNT value on done: 500.0
[2023-02-25 12:35:15,561][2409485] Sum rewards: 0.298, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.060', 'AMMO2': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.036', 'AMMO3': '0.077', 'weapon5': '0.098', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'weapon4': '0.114', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.360', 'ARMOR': '0.501', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.374', 'weapon2': '2.110'}
[2023-02-25 12:35:15,630][2409080] DAMAGECOUNT value on done: 296.0
[2023-02-25 12:35:15,634][2409080] Sum rewards: -2.156, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.182', 'AMMO5': '0.004', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.122', 'HITCOUNT': '0.150', 'ARMOR': '0.436', 'DAMAGECOUNT': '0.507', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.658', 'weapon2': '1.674'}
[2023-02-25 12:35:15,795][2409074] Updated weights for policy 0, policy_version 6010 (0.0012)
[2023-02-25 12:35:15,993][2409077] DAMAGECOUNT value on done: 432.0
[2023-02-25 12:35:15,997][2409077] Sum rewards: -6.358, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.208', 'AMMO5': '0.017', 'ARMOR': '0.028', 'AMMO2': '0.030', 'WEAPON4': '0.050', 'weapon5': '0.106', 'AMMO3': '0.120', 'AMMO4': '0.147', 'HITCOUNT': '0.190', 'WEAPON5': '0.200', 'weapon4': '0.220', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.984', 'weapon3': '1.228', 'weapon2': '2.080'}
[2023-02-25 12:35:16,163][2409373] DAMAGECOUNT value on done: 1210.0
[2023-02-25 12:35:16,164][2409373] Sum rewards: 1.227, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.700', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.091', 'WEAPON4': '0.200', 'weapon4': '0.324', 'HITCOUNT': '0.420', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.323', 'weapon3': '1.488', 'weapon2': '1.908', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:16,227][2409866] DAMAGECOUNT value on done: 551.0
[2023-02-25 12:35:16,230][2409866] Sum rewards: -0.443, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.300', 'AMMO2': '0.004', 'WEAPON1': '0.020', 'AMMO4': '0.022', 'ARMOR': '0.040', 'AMMO3': '0.096', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'weapon4': '0.330', 'DAMAGECOUNT': '0.507', 'WEAPON3': '0.550', 'weapon2': '1.396', 'weapon3': '1.782', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:16,351][2409565] DAMAGECOUNT value on done: 338.0
[2023-02-25 12:35:16,354][2409103] DAMAGECOUNT value on done: 966.0
[2023-02-25 12:35:16,355][2409103] Sum rewards: 0.186, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.246', 'AMMO2': '0.024', 'weapon7': '0.070', 'AMMO3': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.121', 'weapon4': '0.238', 'HITCOUNT': '0.310', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.080', 'weapon2': '1.100', 'weapon3': '1.756', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:16,590][2409389] DAMAGECOUNT value on done: 664.0
[2023-02-25 12:35:16,593][2409389] Sum rewards: 0.881, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'AMMO3': '0.070', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'HITCOUNT': '0.210', 'WEAPON3': '0.400', 'weapon4': '0.460', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.852', 'weapon2': '0.946', 'HEALTH': '1.263', 'weapon3': '1.722'}
[2023-02-25 12:35:16,660][2409355] DAMAGECOUNT value on done: 470.0
[2023-02-25 12:35:16,661][2409355] Sum rewards: -3.023, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.468', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon5': '0.044', 'AMMO4': '0.082', 'AMMO3': '0.097', 'HITCOUNT': '0.140', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.254', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.561', 'FRAGCOUNT': '1.000', 'weapon3': '1.078', 'weapon2': '1.714'}
[2023-02-25 12:35:16,688][2409101] DAMAGECOUNT value on done: 460.0
[2023-02-25 12:35:16,688][2409101] Sum rewards: -4.750, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.624', 'AMMO5': '0.008', 'AMMO2': '0.009', 'AMMO4': '0.043', 'HITCOUNT': '0.090', 'weapon4': '0.096', 'weapon5': '0.102', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.252', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.800', 'ARMOR': '0.936', 'weapon3': '1.658', 'weapon2': '1.688'}
[2023-02-25 12:35:16,692][2409099] DAMAGECOUNT value on done: 590.0
[2023-02-25 12:35:16,693][2409099] Sum rewards: 1.647, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.560', 'weapon5': '0.002', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.027', 'WEAPON5': '0.050', 'AMMO3': '0.066', 'weapon7': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.224', 'HITCOUNT': '0.300', 'WEAPON3': '0.450', 'weapon2': '0.926', 'weapon3': '0.938', 'DAMAGECOUNT': '0.990', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:16,922][2409078] DAMAGECOUNT value on done: 464.0
[2023-02-25 12:35:17,136][2409549] DAMAGECOUNT value on done: 577.0
[2023-02-25 12:35:17,139][2409549] Sum rewards: -0.580, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.208', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'WEAPON4': '0.050', 'weapon7': '0.060', 'AMMO3': '0.081', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.135', 'weapon4': '0.210', 'HITCOUNT': '0.220', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.774', 'weapon3': '1.002', 'weapon2': '1.208', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:17,186][2408954] Fps is (10 sec: 23756.4, 60 sec: 24439.4, 300 sec: 25436.8). Total num frames: 24641536. Throughput: 0: 6078.1. Samples: 6168852. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0)
[2023-02-25 12:35:17,187][2408954] Avg episode reward: [(0, '-0.995')]
[2023-02-25 12:35:17,226][2409079] DAMAGECOUNT value on done: 443.0
[2023-02-25 12:35:17,229][2409079] Sum rewards: -4.535, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.366', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.009', 'weapon5': '0.088', 'WEAPON4': '0.100', 'weapon4': '0.124', 'AMMO3': '0.145', 'WEAPON5': '0.200', 'HITCOUNT': '0.210', 'ARMOR': '0.527', 'DAMAGECOUNT': '0.630', 'WEAPON3': '0.700', 'weapon3': '1.504', 'weapon2': '1.592'}
[2023-02-25 12:35:17,315][2409097] DAMAGECOUNT value on done: 787.0
[2023-02-25 12:35:17,316][2409097] Sum rewards: -1.718, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.586', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.058', 'AMMO4': '0.084', 'AMMO3': '0.100', 'HITCOUNT': '0.220', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.720', 'FRAGCOUNT': '1.000', 'weapon2': '1.572', 'weapon3': '1.776'}
[2023-02-25 12:35:17,528][2409076] DAMAGECOUNT value on done: 470.0
[2023-02-25 12:35:17,531][2409076] Sum rewards: 1.527, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.360', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.034', 'ARMOR': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.092', 'weapon5': '0.104', 'WEAPON4': '0.200', 'HITCOUNT': '0.320', 'weapon4': '0.348', 'WEAPON3': '0.650', 'weapon2': '0.942', 'DAMAGECOUNT': '1.215', 'weapon3': '1.862', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:17,531][2409469] DAMAGECOUNT value on done: 684.0
[2023-02-25 12:35:17,536][2409469] Sum rewards: 2.152, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon4': '0.022', 'ARMOR': '0.024', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'HEALTH': '0.060', 'weapon5': '0.068', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'HITCOUNT': '0.190', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.320', 'weapon3': '1.430', 'weapon2': '1.852', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:17,545][2409075] DAMAGECOUNT value on done: 601.0
[2023-02-25 12:35:17,547][2409075] Sum rewards: -5.124, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.203', 'AMMO5': '0.010', 'weapon5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.072', 'AMMO3': '0.122', 'WEAPON5': '0.200', 'weapon4': '0.228', 'HITCOUNT': '0.250', 'WEAPON4': '0.250', 'ARMOR': '0.440', 'DAMAGECOUNT': '0.753', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.590', 'weapon2': '1.838'}
[2023-02-25 12:35:17,566][2409074] Updated weights for policy 0, policy_version 6020 (0.0012)
[2023-02-25 12:35:17,753][2409468] DAMAGECOUNT value on done: 620.0
[2023-02-25 12:35:17,753][2409468] Sum rewards: -3.048, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.116', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'ARMOR': '0.062', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.127', 'weapon4': '0.164', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.492', 'weapon2': '1.540'}
[2023-02-25 12:35:17,988][2409104] DAMAGECOUNT value on done: 312.0
[2023-02-25 12:35:18,038][2409102] DAMAGECOUNT value on done: 595.0
[2023-02-25 12:35:18,039][2409102] Sum rewards: 0.455, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.024', 'AMMO4': '0.042', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.062', 'AMMO3': '0.085', 'weapon4': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HEALTH': '0.194', 'WEAPON7': '0.200', 'HITCOUNT': '0.370', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.350', 'weapon2': '1.446', 'weapon3': '1.746', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:18,295][2409407] DAMAGECOUNT value on done: 787.0
[2023-02-25 12:35:18,299][2409407] Sum rewards: -1.591, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.192', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'WEAPON1': '0.020', 'AMMO3': '0.105', 'HITCOUNT': '0.270', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.110', 'weapon2': '1.722', 'weapon3': '1.864', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:18,306][2409547] DAMAGECOUNT value on done: 595.0
[2023-02-25 12:35:18,476][2409548] DAMAGECOUNT value on done: 534.0
[2023-02-25 12:35:18,477][2409548] Sum rewards: 1.609, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon5': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'weapon4': '0.148', 'WEAPON5': '0.150', 'HITCOUNT': '0.180', 'WEAPON3': '0.450', 'ARMOR': '0.481', 'HEALTH': '0.542', 'DAMAGECOUNT': '0.702', 'FRAGCOUNT': '1.000', 'weapon3': '1.388', 'weapon2': '1.618'}
[2023-02-25 12:35:18,512][2409486] DAMAGECOUNT value on done: 578.0
[2023-02-25 12:35:18,515][2409486] Sum rewards: 1.919, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.597', 'AMMO2': '0.009', 'AMMO5': '0.014', 'weapon5': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.044', 'AMMO3': '0.071', 'ARMOR': '0.096', 'WEAPON4': '0.100', 'HITCOUNT': '0.130', 'WEAPON5': '0.200', 'weapon4': '0.390', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.615', 'weapon2': '0.982', 'weapon3': '1.778', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:18,614][2409405] DAMAGECOUNT value on done: 380.0
[2023-02-25 12:35:18,887][2409096] DAMAGECOUNT value on done: 550.0
[2023-02-25 12:35:18,888][2409096] Sum rewards: -0.995, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.226', 'AMMO2': '0.011', 'AMMO4': '0.056', 'AMMO3': '0.061', 'WEAPON4': '0.150', 'weapon4': '0.196', 'HITCOUNT': '0.310', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.930', 'FRAGCOUNT': '1.000', 'weapon3': '1.426', 'weapon2': '1.590'}
[2023-02-25 12:35:19,068][2409074] Updated weights for policy 0, policy_version 6030 (0.0012)
[2023-02-25 12:35:19,074][2409596] DAMAGECOUNT value on done: 474.0
[2023-02-25 12:35:19,077][2409596] Sum rewards: -5.332, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.888', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.108', 'HITCOUNT': '0.110', 'AMMO3': '0.126', 'DAMAGECOUNT': '0.285', 'ARMOR': '0.856', 'WEAPON3': '0.900', 'weapon2': '1.402', 'weapon3': '2.144'}
[2023-02-25 12:35:19,233][2409406] DAMAGECOUNT value on done: 270.0
[2023-02-25 12:35:19,234][2409406] Sum rewards: -0.713, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.326', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.007', 'ARMOR': '0.036', 'weapon5': '0.056', 'AMMO3': '0.073', 'HITCOUNT': '0.140', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.316', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.328', 'weapon2': '1.726'}
[2023-02-25 12:35:19,472][2409485] DAMAGECOUNT value on done: 541.0
[2023-02-25 12:35:19,476][2409485] Sum rewards: -2.525, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.450', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.081', 'ARMOR': '0.092', 'HITCOUNT': '0.230', 'WEAPON4': '0.450', 'WEAPON3': '0.450', 'weapon4': '0.622', 'DAMAGECOUNT': '0.795', 'FRAGCOUNT': '1.000', 'weapon2': '1.312', 'weapon3': '1.332'}
[2023-02-25 12:35:19,476][2409100] DAMAGECOUNT value on done: 468.0
[2023-02-25 12:35:19,480][2409100] Sum rewards: -3.637, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.052', 'HITCOUNT': '0.060', 'AMMO4': '0.076', 'weapon4': '0.126', 'DAMAGECOUNT': '0.135', 'AMMO3': '0.148', 'HEALTH': '0.242', 'ARMOR': '0.456', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.750', 'weapon2': '1.456', 'weapon3': '1.994'}
[2023-02-25 12:35:19,644][2409597] DAMAGECOUNT value on done: 931.0
[2023-02-25 12:35:19,645][2409597] Sum rewards: 0.427, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.648', 'AMMO5': '0.005', 'AMMO2': '0.017', 'ARMOR': '0.041', 'weapon7': '0.048', 'AMMO3': '0.062', 'AMMO4': '0.087', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'weapon4': '0.378', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.203', 'weapon3': '1.442', 'weapon2': '1.492'}
[2023-02-25 12:35:19,652][2409077] DAMAGECOUNT value on done: 604.0
[2023-02-25 12:35:19,655][2409077] Sum rewards: -1.299, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.286', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'ARMOR': '0.079', 'weapon5': '0.088', 'AMMO3': '0.113', 'weapon4': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'HITCOUNT': '0.260', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.098', 'weapon2': '1.292', 'weapon3': '1.904', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:19,675][2409080] DAMAGECOUNT value on done: 732.0
[2023-02-25 12:35:19,676][2409080] Sum rewards: -0.392, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.840', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.004', 'WEAPON1': '0.010', 'weapon4': '0.016', 'WEAPON4': '0.050', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'HITCOUNT': '0.210', 'ARMOR': '0.500', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.825', 'weapon3': '1.232', 'weapon2': '1.386', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:19,727][2409105] DAMAGECOUNT value on done: 541.0
[2023-02-25 12:35:19,730][2409105] Sum rewards: 1.155, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.307', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON1': '0.040', 'AMMO3': '0.096', 'HITCOUNT': '0.320', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.215', 'weapon2': '1.512', 'weapon3': '1.788', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:20,261][2409565] DAMAGECOUNT value on done: 489.0
[2023-02-25 12:35:20,264][2409565] Sum rewards: -4.007, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.690', 'AMMO2': '0.002', 'AMMO5': '0.005', 'weapon5': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.011', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'HITCOUNT': '0.110', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.285', 'weapon4': '0.370', 'FRAGCOUNT': '0.500', 'ARMOR': '0.516', 'WEAPON3': '0.700', 'weapon2': '1.406', 'weapon3': '1.602'}
[2023-02-25 12:35:20,279][2409373] DAMAGECOUNT value on done: 263.0
[2023-02-25 12:35:20,338][2409103] DAMAGECOUNT value on done: 410.0
[2023-02-25 12:35:20,341][2409103] Sum rewards: -7.782, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.998', 'AMMO2': '0.013', 'WEAPON1': '0.040', 'AMMO4': '0.066', 'HITCOUNT': '0.090', 'AMMO3': '0.174', 'DAMAGECOUNT': '0.198', 'WEAPON4': '0.250', 'ARMOR': '0.467', 'weapon4': '0.476', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '1.400', 'weapon3': '1.792'}
[2023-02-25 12:35:20,456][2409101] DAMAGECOUNT value on done: 184.0
[2023-02-25 12:35:20,457][2409101] Sum rewards: -0.105, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.774', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'weapon7': '0.072', 'AMMO3': '0.105', 'HITCOUNT': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.196', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.357', 'ARMOR': '0.485', 'WEAPON3': '0.650', 'weapon3': '0.914', 'weapon2': '1.182', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:20,471][2409866] DAMAGECOUNT value on done: 478.0
[2023-02-25 12:35:20,472][2409866] Sum rewards: -2.128, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.459', 'AMMO5': '0.010', 'AMMO2': '0.033', 'ARMOR': '0.056', 'weapon5': '0.086', 'AMMO3': '0.087', 'HITCOUNT': '0.160', 'AMMO4': '0.167', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.524', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.723', 'FRAGCOUNT': '1.000', 'weapon2': '1.068', 'weapon3': '1.766'}
[2023-02-25 12:35:20,616][2409078] DAMAGECOUNT value on done: 672.0
[2023-02-25 12:35:20,616][2409078] Sum rewards: -1.464, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.615', 'AMMO5': '0.009', 'AMMO2': '0.031', 'AMMO3': '0.060', 'ARMOR': '0.060', 'weapon5': '0.120', 'AMMO4': '0.156', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'HITCOUNT': '0.390', 'WEAPON3': '0.400', 'weapon4': '0.436', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '1.194', 'weapon3': '1.260', 'weapon2': '1.484'}
[2023-02-25 12:35:20,718][2409389] DAMAGECOUNT value on done: 761.0
[2023-02-25 12:35:20,721][2409389] Sum rewards: -2.364, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.716', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.010', 'WEAPON1': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.121', 'HITCOUNT': '0.260', 'ARMOR': '0.436', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.002', 'weapon3': '1.612', 'weapon2': '1.958', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:20,843][2409099] DAMAGECOUNT value on done: 544.0
[2023-02-25 12:35:20,846][2409099] Sum rewards: -4.400, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.040', 'AMMO5': '0.007', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'ARMOR': '0.020', 'AMMO4': '0.099', 'HITCOUNT': '0.130', 'weapon5': '0.138', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.300', 'DAMAGECOUNT': '0.801', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.000', 'weapon2': '1.200', 'weapon3': '1.848'}
[2023-02-25 12:35:20,966][2409074] Updated weights for policy 0, policy_version 6040 (0.0012)
[2023-02-25 12:35:20,998][2409355] DAMAGECOUNT value on done: 853.0
[2023-02-25 12:35:20,998][2409355] Sum rewards: 6.437, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.580', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.034', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.066', 'weapon7': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.123', 'WEAPON4': '0.300', 'HITCOUNT': '0.330', 'WEAPON3': '0.450', 'weapon4': '0.662', 'weapon2': '0.804', 'weapon3': '1.014', 'DAMAGECOUNT': '2.235', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:35:21,027][2409549] DAMAGECOUNT value on done: 741.0
[2023-02-25 12:35:21,030][2409549] Sum rewards: -1.533, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.297', 'AMMO2': '0.009', 'AMMO5': '0.012', 'AMMO4': '0.045', 'weapon5': '0.066', 'weapon4': '0.078', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.260', 'ARMOR': '0.494', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.047', 'weapon3': '1.200', 'FRAGCOUNT': '1.500', 'weapon2': '1.710'}
[2023-02-25 12:35:21,359][2409079] DAMAGECOUNT value on done: 533.0
[2023-02-25 12:35:21,363][2409079] Sum rewards: -1.311, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.160', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'weapon4': '0.026', 'AMMO4': '0.033', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.094', 'HITCOUNT': '0.100', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.312', 'weapon3': '1.434'}
[2023-02-25 12:35:21,555][2409104] DAMAGECOUNT value on done: 310.0
[2023-02-25 12:35:21,558][2409104] Sum rewards: 1.553, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.011', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'ARMOR': '0.056', 'AMMO3': '0.069', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'weapon4': '0.284', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.450', 'weapon3': '1.204', 'weapon2': '1.754', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:21,668][2409102] DAMAGECOUNT value on done: 459.0
[2023-02-25 12:35:21,690][2409075] DAMAGECOUNT value on done: 954.0
[2023-02-25 12:35:21,694][2409075] Sum rewards: -1.120, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.540', 'AMMO5': '0.005', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'AMMO4': '0.176', 'weapon4': '0.224', 'HITCOUNT': '0.310', 'WEAPON4': '0.350', 'ARMOR': '0.517', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.116', 'weapon2': '1.336', 'weapon3': '1.494', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:21,726][2409076] DAMAGECOUNT value on done: 610.0
[2023-02-25 12:35:21,727][2409076] Sum rewards: -0.294, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.446', 'AMMO4': '-0.068', 'AMMO2': '-0.013', 'AMMO5': '0.004', 'weapon5': '0.036', 'HITCOUNT': '0.060', 'weapon7': '0.074', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.225', 'WEAPON3': '0.550', 'ARMOR': '0.899', 'FRAGCOUNT': '1.000', 'weapon3': '1.088', 'weapon2': '1.164'}
[2023-02-25 12:35:21,728][2409468] DAMAGECOUNT value on done: 501.0
[2023-02-25 12:35:21,729][2409468] Sum rewards: -0.619, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.824', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO3': '0.104', 'AMMO4': '0.112', 'HITCOUNT': '0.170', 'WEAPON4': '0.250', 'ARMOR': '0.444', 'weapon4': '0.534', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.786', 'FRAGCOUNT': '1.000', 'weapon2': '1.322', 'weapon3': '1.434'}
[2023-02-25 12:35:21,792][2409097] DAMAGECOUNT value on done: 421.0
[2023-02-25 12:35:22,039][2409469] DAMAGECOUNT value on done: 679.0
[2023-02-25 12:35:22,040][2409469] Sum rewards: -0.166, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.170', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'ARMOR': '0.080', 'AMMO3': '0.089', 'AMMO4': '0.111', 'weapon5': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.240', 'weapon4': '0.320', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.020', 'weapon3': '1.498', 'FRAGCOUNT': '1.500', 'weapon2': '1.602'}
[2023-02-25 12:35:22,186][2408954] Fps is (10 sec: 23757.3, 60 sec: 24439.5, 300 sec: 25464.6). Total num frames: 24764416. Throughput: 0: 6099.5. Samples: 6187188. Policy #0 lag: (min: 1.0, avg: 13.2, max: 27.0)
[2023-02-25 12:35:22,186][2408954] Avg episode reward: [(0, '-1.387')]
[2023-02-25 12:35:22,250][2409405] DAMAGECOUNT value on done: 498.0
[2023-02-25 12:35:22,366][2409548] DAMAGECOUNT value on done: 453.0
[2023-02-25 12:35:22,367][2409548] Sum rewards: -1.821, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.578', 'AMMO5': '0.003', 'weapon5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.134', 'AMMO4': '0.140', 'HITCOUNT': '0.240', 'weapon4': '0.362', 'ARMOR': '0.432', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.870', 'weapon2': '1.494', 'FRAGCOUNT': '1.500', 'weapon3': '1.624'}
[2023-02-25 12:35:22,391][2409407] DAMAGECOUNT value on done: 649.0
[2023-02-25 12:35:22,394][2409407] Sum rewards: 0.976, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.556', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.092', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'HITCOUNT': '0.190', 'WEAPON4': '0.250', 'weapon4': '0.428', 'ARMOR': '0.468', 'DAMAGECOUNT': '0.567', 'WEAPON3': '0.700', 'weapon2': '1.502', 'weapon3': '1.590', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:35:22,684][2409074] Updated weights for policy 0, policy_version 6050 (0.0013)
[2023-02-25 12:35:22,745][2409596] DAMAGECOUNT value on done: 669.0
[2023-02-25 12:35:22,750][2409596] Sum rewards: -1.604, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.456', 'AMMO5': '0.003', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.108', 'AMMO3': '0.117', 'HITCOUNT': '0.260', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.002', 'ARMOR': '1.304', 'weapon3': '1.456', 'weapon2': '1.764'}
[2023-02-25 12:35:22,788][2409547] DAMAGECOUNT value on done: 648.0
[2023-02-25 12:35:22,791][2409547] Sum rewards: 0.411, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.140', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'ARMOR': '0.020', 'weapon5': '0.040', 'WEAPON5': '0.050', 'weapon4': '0.072', 'HITCOUNT': '0.090', 'AMMO4': '0.092', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.306', 'WEAPON3': '0.400', 'FRAGCOUNT': '1.000', 'weapon2': '1.512', 'weapon3': '1.928'}
[2023-02-25 12:35:22,795][2409096] DAMAGECOUNT value on done: 781.0
[2023-02-25 12:35:22,810][2409486] DAMAGECOUNT value on done: 343.0
[2023-02-25 12:35:22,810][2409486] Sum rewards: -2.139, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.865', 'AMMO2': '0.010', 'ARMOR': '0.040', 'AMMO4': '0.047', 'AMMO3': '0.091', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'weapon4': '0.242', 'DAMAGECOUNT': '0.474', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.574', 'weapon2': '1.778'}
[2023-02-25 12:35:23,118][2409406] DAMAGECOUNT value on done: 548.0
[2023-02-25 12:35:23,127][2409406] Sum rewards: 1.684, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.580', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'weapon4': '0.128', 'HITCOUNT': '0.300', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.062', 'weapon2': '1.472', 'weapon3': '2.054', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:23,212][2409100] DAMAGECOUNT value on done: 731.0
[2023-02-25 12:35:23,215][2409100] Sum rewards: -3.777, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.080', 'AMMO5': '0.004', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.071', 'ARMOR': '0.072', 'weapon5': '0.088', 'WEAPON5': '0.100', 'HITCOUNT': '0.160', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'weapon4': '0.536', 'DAMAGECOUNT': '0.894', 'weapon3': '1.018', 'weapon2': '1.600', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:23,377][2409597] DAMAGECOUNT value on done: 493.0
[2023-02-25 12:35:23,393][2409597] Sum rewards: 1.252, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.418', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO3': '0.053', 'HITCOUNT': '0.180', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.585', 'FRAGCOUNT': '1.000', 'weapon3': '1.200', 'weapon2': '1.250'}
[2023-02-25 12:35:23,436][2409105] DAMAGECOUNT value on done: 450.0
[2023-02-25 12:35:23,437][2409105] Sum rewards: 0.535, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.743', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'weapon5': '0.016', 'AMMO3': '0.040', 'AMMO4': '0.069', 'WEAPON5': '0.150', 'HITCOUNT': '0.190', 'WEAPON3': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.404', 'DAMAGECOUNT': '0.615', 'weapon4': '0.756', 'weapon3': '0.958', 'weapon2': '1.348', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:23,517][2409077] DAMAGECOUNT value on done: 490.0
[2023-02-25 12:35:23,586][2409485] DAMAGECOUNT value on done: 336.0
[2023-02-25 12:35:23,761][2409080] DAMAGECOUNT value on done: 582.0
[2023-02-25 12:35:23,763][2409080] Sum rewards: 3.168, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.754', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'WEAPON4': '0.050', 'AMMO3': '0.052', 'HITCOUNT': '0.110', 'weapon7': '0.142', 'weapon4': '0.176', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'ARMOR': '0.525', 'DAMAGECOUNT': '0.588', 'weapon3': '1.040', 'weapon2': '1.626', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:23,971][2409565] DAMAGECOUNT value on done: 880.0
[2023-02-25 12:35:23,973][2409565] Sum rewards: -3.894, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.506', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'AMMO5': '0.003', 'weapon5': '0.008', 'WEAPON1': '0.010', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.166', 'weapon4': '0.232', 'HITCOUNT': '0.280', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.242', 'weapon3': '1.540', 'weapon2': '1.804', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:24,044][2409074] Updated weights for policy 0, policy_version 6060 (0.0012)
[2023-02-25 12:35:24,177][2409101] DAMAGECOUNT value on done: 425.0
[2023-02-25 12:35:24,178][2409101] Sum rewards: -3.390, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.414', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'HITCOUNT': '0.080', 'weapon4': '0.106', 'AMMO3': '0.115', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.222', 'WEAPON3': '0.700', 'ARMOR': '0.915', 'FRAGCOUNT': '1.000', 'weapon3': '1.398', 'weapon2': '1.416'}
[2023-02-25 12:35:24,213][2409078] DAMAGECOUNT value on done: 467.0
[2023-02-25 12:35:24,214][2409078] Sum rewards: 0.043, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.405', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.079', 'WEAPON5': '0.100', 'HITCOUNT': '0.180', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.630', 'FRAGCOUNT': '1.000', 'weapon2': '1.462', 'weapon3': '1.628'}
[2023-02-25 12:35:24,295][2409373] DAMAGECOUNT value on done: 474.0
[2023-02-25 12:35:24,299][2409103] DAMAGECOUNT value on done: 869.0
[2023-02-25 12:35:24,300][2409103] Sum rewards: -3.438, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.681', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.014', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.111', 'HITCOUNT': '0.190', 'weapon4': '0.242', 'WEAPON4': '0.250', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.855', 'weapon3': '1.658', 'weapon2': '1.808', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:24,572][2409549] DAMAGECOUNT value on done: 1041.0
[2023-02-25 12:35:24,573][2409549] Sum rewards: 5.493, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.101', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.014', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'weapon4': '0.242', 'HITCOUNT': '0.470', 'WEAPON3': '0.600', 'weapon2': '1.294', 'weapon3': '1.664', 'DAMAGECOUNT': '1.950', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:35:24,682][2409866] DAMAGECOUNT value on done: 455.0
[2023-02-25 12:35:24,685][2409866] Sum rewards: -3.857, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.270', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.113', 'HITCOUNT': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.232', 'DAMAGECOUNT': '0.420', 'ARMOR': '0.452', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.330', 'weapon2': '1.892'}
[2023-02-25 12:35:24,766][2409389] DAMAGECOUNT value on done: 519.0
[2023-02-25 12:35:24,769][2409389] Sum rewards: 1.062, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.437', 'AMMO2': '0.030', 'ARMOR': '0.036', 'AMMO3': '0.047', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.147', 'HITCOUNT': '0.240', 'WEAPON3': '0.300', 'weapon4': '0.364', 'weapon3': '0.674', 'DAMAGECOUNT': '0.789', 'weapon2': '0.898', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:25,082][2409355] DAMAGECOUNT value on done: 689.0
[2023-02-25 12:35:25,083][2409355] Sum rewards: -0.135, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.422', 'ARMOR': '0.012', 'AMMO2': '0.032', 'AMMO3': '0.113', 'AMMO4': '0.158', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'weapon4': '0.298', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.152', 'weapon2': '1.406', 'weapon3': '1.746', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:35:25,209][2409099] DAMAGECOUNT value on done: 509.0
[2023-02-25 12:35:25,213][2409099] Sum rewards: -0.668, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.731', 'AMMO2': '0.009', 'weapon4': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'AMMO3': '0.148', 'HITCOUNT': '0.290', 'DAMAGECOUNT': '0.945', 'WEAPON3': '0.950', 'weapon2': '0.988', 'weapon3': '2.576', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:25,269][2409079] DAMAGECOUNT value on done: 295.0
[2023-02-25 12:35:25,273][2409079] Sum rewards: -1.198, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.747', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'HITCOUNT': '0.080', 'AMMO3': '0.094', 'AMMO4': '0.122', 'DAMAGECOUNT': '0.264', 'WEAPON4': '0.350', 'weapon4': '0.562', 'WEAPON3': '0.600', 'weapon2': '1.218', 'weapon3': '1.614', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:25,529][2409104] DAMAGECOUNT value on done: 1312.0
[2023-02-25 12:35:25,530][2409104] Sum rewards: 2.338, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.484', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'weapon4': '0.166', 'WEAPON4': '0.200', 'HITCOUNT': '0.390', 'WEAPON3': '0.750', 'weapon3': '1.674', 'weapon2': '1.716', 'DAMAGECOUNT': '2.625', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:35:25,544][2409076] DAMAGECOUNT value on done: 789.0
[2023-02-25 12:35:25,545][2409076] Sum rewards: 4.056, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.244', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.073', 'WEAPON4': '0.200', 'weapon4': '0.304', 'HITCOUNT': '0.450', 'WEAPON3': '0.500', 'ARMOR': '1.025', 'weapon3': '1.532', 'DAMAGECOUNT': '1.545', 'weapon2': '1.598', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:25,781][2409074] Updated weights for policy 0, policy_version 6070 (0.0012)
[2023-02-25 12:35:25,812][2409468] DAMAGECOUNT value on done: 352.0
[2023-02-25 12:35:25,813][2409468] Sum rewards: 0.783, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.374', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.004', 'WEAPON1': '0.020', 'weapon5': '0.046', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.170', 'weapon4': '0.206', 'WEAPON3': '0.500', 'ARMOR': '0.576', 'DAMAGECOUNT': '0.600', 'weapon3': '1.338', 'weapon2': '1.422', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:25,838][2409075] DAMAGECOUNT value on done: 428.0
[2023-02-25 12:35:25,955][2409469] DAMAGECOUNT value on done: 753.0
[2023-02-25 12:35:25,956][2409469] Sum rewards: -1.267, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.780', 'AMMO5': '0.007', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.033', 'weapon5': '0.060', 'ARMOR': '0.068', 'AMMO3': '0.073', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'HITCOUNT': '0.310', 'weapon4': '0.368', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.083', 'weapon3': '1.282', 'weapon2': '1.702', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:25,976][2409548] DAMAGECOUNT value on done: 512.0
[2023-02-25 12:35:25,977][2409548] Sum rewards: -6.040, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.384', 'AMMO5': '0.004', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon4': '0.032', 'weapon5': '0.034', 'ARMOR': '0.036', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.700', 'weapon3': '1.570', 'weapon2': '1.918'}
[2023-02-25 12:35:26,007][2409097] DAMAGECOUNT value on done: 299.0
[2023-02-25 12:35:26,010][2409097] Sum rewards: -4.575, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.790', 'AMMO5': '0.003', 'weapon5': '0.024', 'AMMO2': '0.034', 'WEAPON1': '0.040', 'WEAPON5': '0.050', 'ARMOR': '0.052', 'AMMO3': '0.093', 'HITCOUNT': '0.140', 'AMMO4': '0.170', 'WEAPON4': '0.350', 'DAMAGECOUNT': '0.570', 'weapon4': '0.594', 'WEAPON3': '0.700', 'weapon3': '1.314', 'weapon2': '1.582', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:26,217][2409102] DAMAGECOUNT value on done: 571.0
[2023-02-25 12:35:26,220][2409102] Sum rewards: 0.694, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.456', 'AMMO2': '0.033', 'ARMOR': '0.036', 'weapon7': '0.050', 'AMMO3': '0.057', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.164', 'HITCOUNT': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'weapon4': '0.778', 'DAMAGECOUNT': '0.882', 'weapon3': '0.982', 'weapon2': '1.018', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:26,343][2409405] DAMAGECOUNT value on done: 641.0
[2023-02-25 12:35:26,352][2409405] Sum rewards: -1.106, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.232', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.084', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'ARMOR': '0.484', 'WEAPON3': '0.650', 'weapon4': '0.706', 'DAMAGECOUNT': '0.888', 'weapon3': '1.254', 'weapon2': '1.712', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:26,648][2409596] DAMAGECOUNT value on done: 679.0
[2023-02-25 12:35:26,649][2409596] Sum rewards: -1.367, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.610', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON1': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.082', 'AMMO3': '0.111', 'HITCOUNT': '0.170', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.705', 'FRAGCOUNT': '1.000', 'weapon2': '1.434', 'weapon3': '1.708'}
[2023-02-25 12:35:26,802][2409100] DAMAGECOUNT value on done: 589.0
[2023-02-25 12:35:26,805][2409100] Sum rewards: -1.879, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.390', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'weapon5': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.083', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'weapon4': '0.114', 'HITCOUNT': '0.270', 'ARMOR': '0.500', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.855', 'weapon2': '1.504', 'weapon3': '1.574'}
[2023-02-25 12:35:26,880][2409406] DAMAGECOUNT value on done: 522.0
[2023-02-25 12:35:27,118][2409407] DAMAGECOUNT value on done: 699.0
[2023-02-25 12:35:27,118][2409407] Sum rewards: -2.041, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.422', 'AMMO2': '0.004', 'AMMO4': '0.021', 'AMMO3': '0.103', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.200', 'weapon4': '0.228', 'WEAPON4': '0.250', 'ARMOR': '0.471', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.524', 'weapon3': '1.884'}
[2023-02-25 12:35:27,143][2409486] DAMAGECOUNT value on done: 265.0
[2023-02-25 12:35:27,186][2408954] Fps is (10 sec: 24986.0, 60 sec: 24439.5, 300 sec: 25450.7). Total num frames: 24891392. Throughput: 0: 6144.8. Samples: 6224364. Policy #0 lag: (min: 0.0, avg: 11.9, max: 26.0)
[2023-02-25 12:35:27,186][2408954] Avg episode reward: [(0, '-1.400')]
[2023-02-25 12:35:27,187][2409485] DAMAGECOUNT value on done: 567.0
[2023-02-25 12:35:27,190][2409485] Sum rewards: -0.273, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.018', 'ARMOR': '0.020', 'weapon7': '0.072', 'AMMO4': '0.087', 'HEALTH': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'HITCOUNT': '0.240', 'weapon4': '0.344', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.966', 'weapon2': '1.444', 'weapon3': '1.628', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:27,217][2409547] DAMAGECOUNT value on done: 890.0
[2023-02-25 12:35:27,218][2409547] Sum rewards: 0.725, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.882', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.011', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'weapon5': '0.128', 'weapon4': '0.184', 'WEAPON5': '0.200', 'HITCOUNT': '0.330', 'ARMOR': '0.474', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.377', 'weapon3': '1.380', 'weapon2': '1.784'}
[2023-02-25 12:35:27,279][2409077] DAMAGECOUNT value on done: 982.0
[2023-02-25 12:35:27,282][2409077] Sum rewards: 1.463, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.658', 'AMMO5': '0.004', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.084', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.300', 'weapon4': '0.404', 'HITCOUNT': '0.440', 'ARMOR': '0.444', 'WEAPON3': '0.500', 'weapon3': '1.346', 'weapon2': '1.506', 'DAMAGECOUNT': '1.584', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:27,391][2409096] DAMAGECOUNT value on done: 576.0
[2023-02-25 12:35:27,391][2409096] Sum rewards: -1.142, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.874', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.058', 'weapon4': '0.060', 'AMMO4': '0.066', 'AMMO3': '0.138', 'HITCOUNT': '0.230', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.930', 'weapon3': '1.488', 'FRAGCOUNT': '2.000', 'weapon2': '2.040'}
[2023-02-25 12:35:27,630][2409080] DAMAGECOUNT value on done: 1060.0
[2023-02-25 12:35:27,633][2409080] Sum rewards: -3.259, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.070', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'weapon5': '0.034', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'HITCOUNT': '0.240', 'DAMAGECOUNT': '0.870', 'WEAPON3': '0.900', 'weapon2': '1.602', 'weapon3': '1.854', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:27,902][2409074] Updated weights for policy 0, policy_version 6080 (0.0012)
[2023-02-25 12:35:28,049][2409103] DAMAGECOUNT value on done: 978.0
[2023-02-25 12:35:28,053][2409103] Sum rewards: 4.793, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.403', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.052', 'ARMOR': '0.060', 'weapon7': '0.082', 'AMMO3': '0.087', 'AMMO4': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.294', 'HITCOUNT': '0.450', 'WEAPON3': '0.550', 'weapon3': '1.474', 'weapon2': '1.546', 'DAMAGECOUNT': '1.734', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:35:28,145][2409101] DAMAGECOUNT value on done: 712.0
[2023-02-25 12:35:28,146][2409101] Sum rewards: 2.636, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.833', 'AMMO5': '0.009', 'AMMO2': '0.014', 'weapon5': '0.058', 'AMMO4': '0.069', 'AMMO3': '0.084', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.350', 'weapon4': '0.352', 'WEAPON3': '0.450', 'ARMOR': '0.916', 'weapon3': '1.082', 'DAMAGECOUNT': '1.341', 'weapon2': '1.544', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:35:28,228][2409866] DAMAGECOUNT value on done: 844.0
[2023-02-25 12:35:28,228][2409866] Sum rewards: 2.779, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.213', 'AMMO5': '0.007', 'AMMO2': '0.012', 'ARMOR': '0.040', 'weapon5': '0.042', 'AMMO4': '0.061', 'weapon7': '0.070', 'AMMO3': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.234', 'HITCOUNT': '0.330', 'WEAPON3': '0.700', 'weapon2': '0.820', 'weapon3': '1.468', 'DAMAGECOUNT': '1.557', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:35:28,246][2409597] DAMAGECOUNT value on done: 633.0
[2023-02-25 12:35:28,247][2409597] Sum rewards: -0.198, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.730', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'FRAGCOUNT': '0.000', 'AMMO5': '0.013', 'AMMO3': '0.070', 'weapon5': '0.138', 'WEAPON5': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.990', 'weapon3': '1.300', 'weapon2': '1.774'}
[2023-02-25 12:35:28,286][2409105] DAMAGECOUNT value on done: 622.0
[2023-02-25 12:35:28,287][2409105] Sum rewards: -3.561, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.572', 'AMMO5': '0.007', 'weapon5': '0.030', 'AMMO2': '0.046', 'AMMO3': '0.106', 'WEAPON5': '0.150', 'HITCOUNT': '0.220', 'AMMO4': '0.231', 'weapon4': '0.246', 'WEAPON4': '0.300', 'ARMOR': '0.496', 'DAMAGECOUNT': '0.597', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.662', 'weapon2': '1.770'}
[2023-02-25 12:35:28,480][2409373] DAMAGECOUNT value on done: 741.0
[2023-02-25 12:35:28,480][2409373] Sum rewards: -1.766, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.261', 'AMMO4': '-0.097', 'AMMO2': '-0.019', 'AMMO5': '0.005', 'ARMOR': '0.024', 'weapon5': '0.052', 'weapon7': '0.072', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.370', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.038', 'weapon3': '1.482', 'weapon2': '1.828'}
[2023-02-25 12:35:28,527][2409078] DAMAGECOUNT value on done: 454.0
[2023-02-25 12:35:28,528][2409078] Sum rewards: -2.717, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.294', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'HITCOUNT': '0.100', 'AMMO3': '0.140', 'DAMAGECOUNT': '0.375', 'ARMOR': '0.400', 'WEAPON3': '0.950', 'weapon2': '1.476', 'FRAGCOUNT': '2.000', 'weapon3': '2.168'}
[2023-02-25 12:35:28,534][2409549] DAMAGECOUNT value on done: 622.0
[2023-02-25 12:35:28,535][2409549] Sum rewards: -0.479, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.514', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'weapon5': '0.024', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'ARMOR': '0.067', 'AMMO3': '0.127', 'weapon4': '0.172', 'HITCOUNT': '0.260', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.960', 'weapon2': '1.478', 'weapon3': '1.752', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:28,619][2409355] DAMAGECOUNT value on done: 411.0
[2023-02-25 12:35:28,620][2409355] Sum rewards: 0.227, reward structure: {'DEATHCOUNT': '-5.250', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO3': '0.050', 'ARMOR': '0.052', 'HEALTH': '0.074', 'HITCOUNT': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.128', 'AMMO4': '0.159', 'WEAPON5': '0.250', 'weapon4': '0.252', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.612', 'weapon3': '0.882', 'FRAGCOUNT': '1.000', 'weapon2': '1.434'}
[2023-02-25 12:35:28,631][2409389] DAMAGECOUNT value on done: 387.0
[2023-02-25 12:35:28,632][2409389] Sum rewards: 0.656, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.892', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'weapon7': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.071', 'ARMOR': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.140', 'weapon5': '0.140', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.480', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.636', 'weapon2': '0.924', 'FRAGCOUNT': '1.000', 'weapon3': '1.236'}
[2023-02-25 12:35:29,184][2409099] DAMAGECOUNT value on done: 896.0
[2023-02-25 12:35:29,190][2409099] Sum rewards: -1.373, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.790', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'AMMO3': '0.088', 'WEAPON4': '0.150', 'weapon4': '0.292', 'HITCOUNT': '0.320', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.116', 'weapon3': '1.546', 'weapon2': '1.626'}
[2023-02-25 12:35:29,509][2409074] Updated weights for policy 0, policy_version 6090 (0.0012)
[2023-02-25 12:35:29,569][2409565] DAMAGECOUNT value on done: 572.0
[2023-02-25 12:35:29,570][2409565] Sum rewards: -2.452, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.634', 'AMMO5': '0.005', 'AMMO2': '0.024', 'ARMOR': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.129', 'weapon5': '0.148', 'HITCOUNT': '0.220', 'WEAPON4': '0.250', 'weapon4': '0.590', 'WEAPON3': '0.750', 'weapon2': '0.948', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.140', 'weapon3': '1.692'}
[2023-02-25 12:35:29,700][2409104] DAMAGECOUNT value on done: 879.0
[2023-02-25 12:35:29,700][2409104] Sum rewards: 1.254, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.155', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.015', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.102', 'WEAPON4': '0.150', 'HITCOUNT': '0.260', 'weapon4': '0.352', 'WEAPON3': '0.550', 'weapon2': '0.926', 'DAMAGECOUNT': '0.987', 'FRAGCOUNT': '1.500', 'weapon3': '1.638'}
[2023-02-25 12:35:29,736][2409468] DAMAGECOUNT value on done: 557.0
[2023-02-25 12:35:29,736][2409468] Sum rewards: -2.076, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.545', 'AMMO2': '0.009', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'weapon4': '0.054', 'weapon5': '0.092', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'HITCOUNT': '0.180', 'WEAPON5': '0.200', 'ARMOR': '0.476', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.059', 'weapon3': '1.602', 'weapon2': '1.868'}
[2023-02-25 12:35:30,047][2409075] DAMAGECOUNT value on done: 845.0
[2023-02-25 12:35:30,050][2409075] Sum rewards: -3.205, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.450', 'AMMO2': '0.003', 'AMMO5': '0.005', 'weapon5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.015', 'weapon4': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'HITCOUNT': '0.260', 'ARMOR': '0.465', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.855', 'FRAGCOUNT': '1.000', 'weapon2': '1.724', 'weapon3': '1.806'}
[2023-02-25 12:35:30,048][2409548] DAMAGECOUNT value on done: 626.0
[2023-02-25 12:35:30,053][2409548] Sum rewards: -0.232, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.451', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO3': '0.043', 'WEAPON5': '0.100', 'HITCOUNT': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'ARMOR': '0.519', 'weapon4': '0.536', 'DAMAGECOUNT': '0.642', 'weapon3': '0.678', 'FRAGCOUNT': '1.000', 'weapon2': '1.428'}
[2023-02-25 12:35:30,120][2409076] DAMAGECOUNT value on done: 760.0
[2023-02-25 12:35:30,123][2409076] Sum rewards: -0.983, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.990', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO3': '0.098', 'WEAPON4': '0.150', 'weapon4': '0.250', 'HITCOUNT': '0.350', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.242', 'weapon3': '1.334', 'weapon2': '1.764'}
[2023-02-25 12:35:30,391][2409405] DAMAGECOUNT value on done: 720.0
[2023-02-25 12:35:30,394][2409405] Sum rewards: 1.313, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.690', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.007', 'ARMOR': '0.036', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon7': '0.052', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.150', 'weapon4': '0.184', 'WEAPON7': '0.200', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.867', 'weapon3': '0.942', 'FRAGCOUNT': '1.000', 'weapon2': '1.332'}
[2023-02-25 12:35:30,405][2409097] DAMAGECOUNT value on done: 961.0
[2023-02-25 12:35:30,406][2409097] Sum rewards: 2.484, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.467', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.070', 'AMMO3': '0.116', 'WEAPON5': '0.150', 'HITCOUNT': '0.450', 'WEAPON3': '0.750', 'weapon2': '1.598', 'DAMAGECOUNT': '1.734', 'weapon3': '1.818', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:30,419][2409469] DAMAGECOUNT value on done: 245.0
[2023-02-25 12:35:30,420][2409469] Sum rewards: 1.218, reward structure: {'DEATHCOUNT': '-5.250', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'ARMOR': '0.104', 'AMMO4': '0.107', 'HITCOUNT': '0.120', 'WEAPON3': '0.300', 'weapon4': '0.306', 'DAMAGECOUNT': '0.390', 'HEALTH': '0.523', 'weapon3': '1.036', 'weapon2': '1.390', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:30,514][2409079] DAMAGECOUNT value on done: 423.0
[2023-02-25 12:35:30,890][2409100] DAMAGECOUNT value on done: 627.0
[2023-02-25 12:35:30,891][2409100] Sum rewards: 1.356, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.376', 'AMMO2': '0.010', 'ARMOR': '0.045', 'AMMO4': '0.048', 'weapon7': '0.072', 'AMMO3': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.290', 'weapon4': '0.592', 'WEAPON3': '0.700', 'weapon2': '1.040', 'DAMAGECOUNT': '1.161', 'weapon3': '1.724', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:30,963][2409596] DAMAGECOUNT value on done: 588.0
[2023-02-25 12:35:30,963][2409596] Sum rewards: -1.588, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.080', 'AMMO5': '0.009', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'weapon5': '0.038', 'AMMO4': '0.069', 'ARMOR': '0.071', 'AMMO3': '0.106', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.206', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.729', 'FRAGCOUNT': '1.000', 'weapon3': '1.210', 'weapon2': '1.760'}
[2023-02-25 12:35:31,038][2409486] DAMAGECOUNT value on done: 821.0
[2023-02-25 12:35:31,039][2409486] Sum rewards: -0.847, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.747', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'weapon5': '0.028', 'AMMO3': '0.070', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'WEAPON5': '0.300', 'weapon4': '0.346', 'ARMOR': '0.404', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.167', 'weapon3': '1.432', 'weapon2': '1.492', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:31,124][2409485] DAMAGECOUNT value on done: 375.0
[2023-02-25 12:35:31,167][2409074] Updated weights for policy 0, policy_version 6100 (0.0012)
[2023-02-25 12:35:31,183][2409102] DAMAGECOUNT value on done: 907.0
[2023-02-25 12:35:31,186][2409102] Sum rewards: -5.211, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.480', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'ARMOR': '0.064', 'AMMO4': '0.131', 'AMMO3': '0.158', 'WEAPON4': '0.250', 'weapon4': '0.286', 'HITCOUNT': '0.310', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.161', 'weapon2': '1.226', 'FRAGCOUNT': '1.500', 'weapon3': '2.200'}
[2023-02-25 12:35:31,194][2409406] DAMAGECOUNT value on done: 493.0
[2023-02-25 12:35:31,197][2409406] Sum rewards: -2.619, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.555', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.029', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'AMMO4': '0.143', 'HITCOUNT': '0.160', 'weapon4': '0.170', 'WEAPON4': '0.200', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.525', 'weapon2': '1.620', 'weapon3': '1.632'}
[2023-02-25 12:35:31,407][2409096] DAMAGECOUNT value on done: 485.0
[2023-02-25 12:35:31,410][2409096] Sum rewards: 0.061, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.884', 'AMMO2': '0.004', 'AMMO4': '0.020', 'WEAPON1': '0.040', 'ARMOR': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.130', 'HITCOUNT': '0.230', 'weapon4': '0.292', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.774', 'weapon2': '1.456', 'weapon3': '1.638', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:31,459][2409407] DAMAGECOUNT value on done: 450.0
[2023-02-25 12:35:31,462][2409407] Sum rewards: -1.437, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.287', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.090', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'HITCOUNT': '0.190', 'weapon4': '0.208', 'ARMOR': '0.408', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.705', 'FRAGCOUNT': '1.000', 'weapon3': '1.298', 'weapon2': '1.818'}
[2023-02-25 12:35:31,643][2409547] DAMAGECOUNT value on done: 510.0
[2023-02-25 12:35:31,644][2409547] Sum rewards: -4.131, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.238', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'ARMOR': '0.032', 'weapon5': '0.070', 'AMMO4': '0.081', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'weapon4': '0.174', 'HITCOUNT': '0.280', 'WEAPON4': '0.300', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.008', 'weapon3': '1.618', 'weapon2': '1.762', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:31,772][2409103] DAMAGECOUNT value on done: 313.0
[2023-02-25 12:35:31,866][2409077] DAMAGECOUNT value on done: 1086.0
[2023-02-25 12:35:31,867][2409101] DAMAGECOUNT value on done: 933.0
[2023-02-25 12:35:31,867][2409101] Sum rewards: -0.833, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.962', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.044', 'AMMO3': '0.090', 'HITCOUNT': '0.150', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.672', 'weapon2': '1.010', 'weapon3': '1.534', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:31,869][2409077] Sum rewards: -0.758, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.084', 'ARMOR': '0.016', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.081', 'AMMO3': '0.085', 'HITCOUNT': '0.240', 'WEAPON4': '0.250', 'weapon4': '0.564', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.795', 'weapon3': '1.432', 'weapon2': '1.676', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:32,028][2409080] DAMAGECOUNT value on done: 349.0
[2023-02-25 12:35:32,030][2409866] DAMAGECOUNT value on done: 657.0
[2023-02-25 12:35:32,034][2409866] Sum rewards: 0.353, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.450', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'weapon5': '0.026', 'ARMOR': '0.032', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'weapon4': '0.206', 'HITCOUNT': '0.230', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.720', 'weapon2': '1.414', 'weapon3': '1.928', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:32,168][2409597] DAMAGECOUNT value on done: 557.0
[2023-02-25 12:35:32,171][2409597] Sum rewards: -0.714, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.365', 'AMMO4': '-0.023', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'weapon5': '0.040', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'HITCOUNT': '0.200', 'ARMOR': '0.456', 'DAMAGECOUNT': '0.585', 'WEAPON3': '0.700', 'weapon3': '1.508', 'weapon2': '1.736', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:32,186][2408954] Fps is (10 sec: 23756.7, 60 sec: 24098.1, 300 sec: 25395.2). Total num frames: 25001984. Throughput: 0: 6101.1. Samples: 6258984. Policy #0 lag: (min: 0.0, avg: 11.9, max: 26.0)
[2023-02-25 12:35:32,186][2408954] Avg episode reward: [(0, '-1.173')]
[2023-02-25 12:35:32,232][2409105] DAMAGECOUNT value on done: 397.0
[2023-02-25 12:35:32,235][2409105] Sum rewards: -0.840, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.342', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.010', 'HITCOUNT': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.195', 'weapon4': '0.304', 'WEAPON3': '0.400', 'ARMOR': '0.444', 'weapon3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.798'}
[2023-02-25 12:35:32,269][2409549] DAMAGECOUNT value on done: 505.0
[2023-02-25 12:35:32,270][2409549] Sum rewards: -2.613, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.122', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'ARMOR': '0.072', 'weapon5': '0.088', 'AMMO3': '0.091', 'AMMO4': '0.102', 'HITCOUNT': '0.180', 'WEAPON4': '0.450', 'WEAPON3': '0.600', 'weapon4': '0.706', 'DAMAGECOUNT': '0.900', 'weapon2': '1.186', 'weapon3': '1.310'}
[2023-02-25 12:35:32,302][2409078] DAMAGECOUNT value on done: 603.0
[2023-02-25 12:35:32,306][2409078] Sum rewards: -0.026, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.092', 'AMMO2': '0.001', 'AMMO4': '0.003', 'WEAPON1': '0.010', 'AMMO3': '0.100', 'HITCOUNT': '0.260', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.894', 'weapon2': '1.544', 'FRAGCOUNT': '2.000', 'weapon3': '2.054'}
[2023-02-25 12:35:32,386][2409373] DAMAGECOUNT value on done: 842.0
[2023-02-25 12:35:32,387][2409373] Sum rewards: 2.560, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.017', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.022', 'AMMO3': '0.082', 'weapon5': '0.088', 'WEAPON5': '0.100', 'HITCOUNT': '0.500', 'WEAPON3': '0.550', 'ARMOR': '0.952', 'weapon3': '1.590', 'DAMAGECOUNT': '1.965', 'weapon2': '1.968', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:32,425][2409355] DAMAGECOUNT value on done: 766.0
[2023-02-25 12:35:32,426][2409355] Sum rewards: -0.077, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.070', 'AMMO2': '0.028', 'WEAPON4': '0.050', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.111', 'AMMO4': '0.141', 'weapon4': '0.164', 'HITCOUNT': '0.250', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.011', 'weapon2': '1.302', 'weapon3': '1.584', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:32,925][2409099] DAMAGECOUNT value on done: 670.0
[2023-02-25 12:35:32,926][2409099] Sum rewards: -5.448, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.625', 'AMMO2': '0.004', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.022', 'AMMO3': '0.112', 'WEAPON5': '0.150', 'HITCOUNT': '0.190', 'ARMOR': '0.457', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.700', 'weapon2': '1.356', 'weapon3': '2.072'}
[2023-02-25 12:35:33,005][2409389] DAMAGECOUNT value on done: 805.0
[2023-02-25 12:35:33,008][2409389] Sum rewards: 3.306, reward structure: {'DEATHCOUNT': '-6.750', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon7': '0.066', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.120', 'WEAPON4': '0.150', 'HEALTH': '0.180', 'WEAPON7': '0.200', 'HITCOUNT': '0.280', 'weapon4': '0.386', 'WEAPON3': '0.450', 'weapon2': '0.824', 'DAMAGECOUNT': '1.353', 'weapon3': '1.570', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:35:33,052][2409074] Updated weights for policy 0, policy_version 6110 (0.0012)
[2023-02-25 12:35:33,333][2409565] DAMAGECOUNT value on done: 558.0
[2023-02-25 12:35:33,334][2409565] Sum rewards: -0.747, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.159', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.030', 'AMMO3': '0.129', 'WEAPON4': '0.150', 'weapon4': '0.218', 'HITCOUNT': '0.360', 'ARMOR': '0.436', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.233', 'weapon2': '1.410', 'weapon3': '1.870', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:33,711][2409076] DAMAGECOUNT value on done: 609.0
[2023-02-25 12:35:33,712][2409076] Sum rewards: 0.347, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.040', 'AMMO2': '0.002', 'AMMO4': '0.011', 'WEAPON1': '0.020', 'ARMOR': '0.064', 'AMMO3': '0.074', 'HITCOUNT': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.268', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.186', 'weapon2': '1.256'}
[2023-02-25 12:35:33,845][2409104] DAMAGECOUNT value on done: 630.0
[2023-02-25 12:35:33,846][2409104] Sum rewards: -6.523, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.558', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.088', 'AMMO3': '0.095', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'HITCOUNT': '0.210', 'WEAPON4': '0.400', 'ARMOR': '0.440', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.645', 'weapon4': '0.746', 'weapon2': '0.918', 'weapon3': '1.384'}
[2023-02-25 12:35:34,009][2409405] DAMAGECOUNT value on done: 954.0
[2023-02-25 12:35:34,013][2409405] Sum rewards: -0.029, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.006', 'AMMO2': '0.027', 'ARMOR': '0.028', 'weapon5': '0.078', 'AMMO3': '0.080', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.158', 'HEALTH': '0.236', 'HITCOUNT': '0.240', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.747', 'FRAGCOUNT': '1.000', 'weapon3': '1.586', 'weapon2': '1.700'}
[2023-02-25 12:35:34,019][2409468] DAMAGECOUNT value on done: 670.0
[2023-02-25 12:35:34,021][2409468] Sum rewards: -1.979, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.766', 'FRAGCOUNT': '-0.500', 'weapon5': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.114', 'WEAPON5': '0.150', 'HITCOUNT': '0.220', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.690', 'ARMOR': '0.856', 'weapon3': '1.428', 'weapon2': '1.822'}
[2023-02-25 12:35:34,080][2409079] DAMAGECOUNT value on done: 842.0
[2023-02-25 12:35:34,080][2409079] Sum rewards: 0.722, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.531', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.040', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.200', 'HITCOUNT': '0.230', 'WEAPON4': '0.300', 'WEAPON3': '0.650', 'weapon4': '0.696', 'DAMAGECOUNT': '0.981', 'weapon2': '1.260', 'weapon3': '1.438', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:34,199][2409074] Updated weights for policy 0, policy_version 6120 (0.0012)
[2023-02-25 12:35:34,248][2409075] DAMAGECOUNT value on done: 745.0
[2023-02-25 12:35:34,544][2409097] DAMAGECOUNT value on done: 501.0
[2023-02-25 12:35:34,592][2409548] DAMAGECOUNT value on done: 854.0
[2023-02-25 12:35:34,595][2409548] Sum rewards: 0.891, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.732', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'weapon4': '0.032', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.103', 'HITCOUNT': '0.270', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.954', 'weapon3': '1.334', 'weapon2': '2.004', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:34,731][2409102] DAMAGECOUNT value on done: 650.0
[2023-02-25 12:35:34,732][2409102] Sum rewards: -1.225, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO2': '0.021', 'ARMOR': '0.085', 'AMMO3': '0.097', 'AMMO4': '0.103', 'HEALTH': '0.175', 'WEAPON4': '0.200', 'HITCOUNT': '0.220', 'weapon4': '0.314', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.990', 'weapon3': '1.382', 'weapon2': '1.738', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:34,740][2409486] DAMAGECOUNT value on done: 625.0
[2023-02-25 12:35:34,741][2409486] Sum rewards: -0.142, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.540', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'ARMOR': '0.038', 'weapon5': '0.056', 'AMMO3': '0.084', 'AMMO4': '0.146', 'weapon4': '0.172', 'WEAPON5': '0.200', 'HITCOUNT': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.260', 'weapon2': '1.444', 'weapon3': '1.740', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:35:34,751][2409469] DAMAGECOUNT value on done: 960.0
[2023-02-25 12:35:34,752][2409469] Sum rewards: 3.986, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.820', 'AMMO5': '0.003', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.013', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.070', 'HITCOUNT': '0.350', 'WEAPON3': '0.500', 'weapon3': '1.494', 'DAMAGECOUNT': '1.755', 'weapon2': '1.756', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:35:34,838][2409485] DAMAGECOUNT value on done: 697.0
[2023-02-25 12:35:34,847][2409596] DAMAGECOUNT value on done: 519.0
[2023-02-25 12:35:34,848][2409596] Sum rewards: 0.165, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.985', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.033', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO3': '0.136', 'HITCOUNT': '0.290', 'ARMOR': '0.454', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.753', 'weapon3': '1.634', 'weapon2': '1.762', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:34,977][2409407] DAMAGECOUNT value on done: 561.0
[2023-02-25 12:35:34,978][2409407] Sum rewards: 0.376, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.499', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.052', 'AMMO3': '0.103', 'HITCOUNT': '0.390', 'WEAPON3': '0.700', 'weapon2': '1.098', 'DAMAGECOUNT': '1.461', 'weapon3': '1.790', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:35,064][2409406] DAMAGECOUNT value on done: 628.0
[2023-02-25 12:35:35,065][2409406] Sum rewards: -1.447, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.088', 'AMMO2': '0.030', 'AMMO3': '0.132', 'AMMO4': '0.148', 'WEAPON4': '0.150', 'HITCOUNT': '0.190', 'weapon4': '0.314', 'ARMOR': '0.448', 'DAMAGECOUNT': '0.549', 'WEAPON3': '0.700', 'weapon3': '1.458', 'weapon2': '1.772', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:35,339][2409100] DAMAGECOUNT value on done: 905.0
[2023-02-25 12:35:35,342][2409100] Sum rewards: -1.482, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.351', 'AMMO5': '0.009', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.030', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.135', 'weapon4': '0.204', 'HITCOUNT': '0.400', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.533', 'weapon2': '1.608', 'weapon3': '1.882', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:35,400][2409101] DAMAGECOUNT value on done: 660.0
[2023-02-25 12:35:35,401][2409101] Sum rewards: -2.382, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.169', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.005', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.023', 'HITCOUNT': '0.080', 'AMMO3': '0.084', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.264', 'DAMAGECOUNT': '0.270', 'WEAPON3': '0.400', 'ARMOR': '0.493', 'weapon3': '1.058', 'weapon2': '2.088'}
[2023-02-25 12:35:35,463][2409103] DAMAGECOUNT value on done: 430.0
[2023-02-25 12:35:35,466][2409103] Sum rewards: -3.071, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.472', 'AMMO5': '0.005', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.035', 'ARMOR': '0.048', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'HITCOUNT': '0.110', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.315', 'weapon4': '0.534', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.054', 'weapon2': '1.416'}
[2023-02-25 12:35:35,517][2409077] DAMAGECOUNT value on done: 689.0
[2023-02-25 12:35:35,583][2409096] DAMAGECOUNT value on done: 346.0
[2023-02-25 12:35:35,584][2409096] Sum rewards: 1.276, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.367', 'AMMO4': '-0.033', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'HITCOUNT': '0.140', 'weapon4': '0.150', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.438', 'ARMOR': '0.520', 'weapon2': '1.082', 'weapon3': '1.562', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:35,615][2409866] DAMAGECOUNT value on done: 700.0
[2023-02-25 12:35:35,616][2409866] Sum rewards: -0.805, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.370', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO3': '0.066', 'WEAPON5': '0.100', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.340', 'WEAPON3': '0.450', 'ARMOR': '0.460', 'DAMAGECOUNT': '0.720', 'weapon3': '1.100', 'weapon2': '1.808', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:35,739][2409547] DAMAGECOUNT value on done: 759.0
[2023-02-25 12:35:35,736][2409080] DAMAGECOUNT value on done: 560.0
[2023-02-25 12:35:35,740][2409080] Sum rewards: -1.922, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.110', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'ARMOR': '0.052', 'HITCOUNT': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'DAMAGECOUNT': '0.234', 'weapon4': '0.266', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.002', 'weapon3': '1.592'}
[2023-02-25 12:35:35,740][2409547] Sum rewards: -0.681, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.725', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'ARMOR': '0.088', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'weapon4': '0.302', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.717', 'FRAGCOUNT': '1.000', 'weapon2': '1.188', 'weapon3': '1.748'}
[2023-02-25 12:35:35,791][2409549] DAMAGECOUNT value on done: 666.0
[2023-02-25 12:35:35,792][2409549] Sum rewards: -4.726, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.100', 'weapon5': '0.004', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.094', 'weapon4': '0.130', 'AMMO4': '0.147', 'WEAPON5': '0.200', 'HITCOUNT': '0.220', 'DAMAGECOUNT': '0.489', 'WEAPON3': '0.650', 'weapon3': '1.472', 'weapon2': '1.858'}
[2023-02-25 12:35:35,976][2409373] DAMAGECOUNT value on done: 1062.0
[2023-02-25 12:35:35,979][2409373] Sum rewards: 0.701, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.434', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'WEAPON4': '0.050', 'ARMOR': '0.076', 'AMMO3': '0.132', 'weapon4': '0.190', 'HITCOUNT': '0.410', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.236', 'weapon2': '1.604', 'weapon3': '1.822', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:35:36,013][2409355] DAMAGECOUNT value on done: 864.0
[2023-02-25 12:35:36,014][2409355] Sum rewards: 1.825, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.800', 'AMMO2': '0.007', 'WEAPON1': '0.030', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.076', 'weapon4': '0.146', 'HITCOUNT': '0.160', 'WEAPON3': '0.500', 'ARMOR': '0.520', 'DAMAGECOUNT': '0.702', 'weapon2': '1.302', 'weapon3': '1.346', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:36,441][2409074] Updated weights for policy 0, policy_version 6130 (0.0012)
[2023-02-25 12:35:36,444][2409597] DAMAGECOUNT value on done: 766.0
[2023-02-25 12:35:36,447][2409597] Sum rewards: 1.166, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.604', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'weapon5': '0.004', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'WEAPON4': '0.200', 'HITCOUNT': '0.320', 'weapon4': '0.320', 'ARMOR': '0.430', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.116', 'weapon2': '1.370', 'weapon3': '1.490', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:35:36,570][2409105] DAMAGECOUNT value on done: 766.0
[2023-02-25 12:35:36,571][2409105] Sum rewards: 0.311, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.132', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'ARMOR': '0.024', 'AMMO4': '0.044', 'AMMO3': '0.084', 'weapon4': '0.096', 'WEAPON4': '0.100', 'weapon5': '0.134', 'WEAPON5': '0.150', 'HITCOUNT': '0.210', 'WEAPON3': '0.550', 'weapon3': '1.282', 'DAMAGECOUNT': '1.497', 'weapon2': '1.498', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:35:36,587][2409078] DAMAGECOUNT value on done: 299.0
[2023-02-25 12:35:36,590][2409078] Sum rewards: -6.305, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.019', 'ARMOR': '0.046', 'WEAPON4': '0.050', 'HITCOUNT': '0.070', 'AMMO4': '0.095', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.140', 'DAMAGECOUNT': '0.150', 'HEALTH': '0.438', 'WEAPON3': '0.550', 'weapon3': '1.518', 'weapon2': '1.650'}
[2023-02-25 12:35:36,818][2409099] DAMAGECOUNT value on done: 895.0
[2023-02-25 12:35:36,819][2409099] Sum rewards: 0.266, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.970', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'weapon5': '0.018', 'weapon4': '0.042', 'WEAPON4': '0.050', 'ARMOR': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.143', 'HITCOUNT': '0.330', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.344', 'weapon2': '1.792', 'weapon3': '1.878', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:37,090][2409389] DAMAGECOUNT value on done: 650.0
[2023-02-25 12:35:37,091][2409389] Sum rewards: -2.239, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.862', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon5': '0.026', 'WEAPON1': '0.050', 'WEAPON5': '0.050', 'HITCOUNT': '0.090', 'AMMO3': '0.117', 'DAMAGECOUNT': '0.276', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.424', 'weapon3': '1.652'}
[2023-02-25 12:35:37,186][2408954] Fps is (10 sec: 24166.2, 60 sec: 24371.2, 300 sec: 25423.0). Total num frames: 25133056. Throughput: 0: 6138.7. Samples: 6278220. Policy #0 lag: (min: 1.0, avg: 10.9, max: 26.0)
[2023-02-25 12:35:37,186][2408954] Avg episode reward: [(0, '-0.903')]
[2023-02-25 12:35:37,215][2409565] DAMAGECOUNT value on done: 588.0
[2023-02-25 12:35:37,216][2409565] Sum rewards: -3.621, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.280', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'WEAPON1': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'weapon4': '0.116', 'HITCOUNT': '0.310', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.954', 'FRAGCOUNT': '1.000', 'weapon2': '1.610', 'weapon3': '1.844'}
[2023-02-25 12:35:37,546][2409104] DAMAGECOUNT value on done: 626.0
[2023-02-25 12:35:37,548][2409104] Sum rewards: 1.842, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.424', 'AMMO5': '0.005', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.027', 'weapon5': '0.044', 'ARMOR': '0.048', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'HITCOUNT': '0.270', 'weapon4': '0.276', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.843', 'weapon2': '0.970', 'weapon3': '1.438', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:37,599][2409076] DAMAGECOUNT value on done: 552.0
[2023-02-25 12:35:37,600][2409076] Sum rewards: -4.157, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.726', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.006', 'AMMO4': '0.029', 'WEAPON5': '0.050', 'weapon4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'HITCOUNT': '0.220', 'ARMOR': '0.420', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.780', 'weapon2': '1.762', 'weapon3': '1.774'}
[2023-02-25 12:35:37,649][2409074] Updated weights for policy 0, policy_version 6140 (0.0012)
[2023-02-25 12:35:37,726][2409468] DAMAGECOUNT value on done: 481.0
[2023-02-25 12:35:37,730][2409468] Sum rewards: -1.841, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.052', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.086', 'AMMO3': '0.145', 'HITCOUNT': '0.250', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.825', 'weapon2': '1.598', 'weapon3': '1.610', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:38,113][2409075] DAMAGECOUNT value on done: 539.0
[2023-02-25 12:35:38,115][2409075] Sum rewards: -0.612, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.130', 'AMMO5': '0.005', 'weapon4': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO3': '0.081', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.280', 'ARMOR': '0.408', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.837', 'weapon3': '1.396', 'FRAGCOUNT': '2.000', 'weapon2': '2.234'}
[2023-02-25 12:35:38,159][2409079] DAMAGECOUNT value on done: 458.0
[2023-02-25 12:35:38,160][2409079] Sum rewards: -6.306, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.758', 'FRAGCOUNT': '-0.500', 'weapon5': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'ARMOR': '0.032', 'AMMO4': '0.060', 'AMMO3': '0.147', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'weapon4': '0.372', 'DAMAGECOUNT': '0.567', 'WEAPON3': '0.850', 'weapon2': '0.956', 'weapon3': '1.958'}
[2023-02-25 12:35:38,244][2409405] DAMAGECOUNT value on done: 542.0
[2023-02-25 12:35:38,281][2409097] DAMAGECOUNT value on done: 391.0
[2023-02-25 12:35:38,284][2409097] Sum rewards: -5.766, reward structure: {'DEATHCOUNT': '-5.250', 'FRAGCOUNT': '-3.000', 'HEALTH': '-1.060', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'weapon5': '0.038', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'weapon4': '0.206', 'DAMAGECOUNT': '0.291', 'WEAPON3': '0.500', 'weapon3': '1.008', 'weapon2': '1.080'}
[2023-02-25 12:35:38,541][2409485] DAMAGECOUNT value on done: 665.0
[2023-02-25 12:35:38,570][2409596] DAMAGECOUNT value on done: 840.0
[2023-02-25 12:35:38,571][2409596] Sum rewards: -0.641, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.556', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON1': '0.030', 'weapon5': '0.038', 'ARMOR': '0.042', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'weapon4': '0.176', 'HITCOUNT': '0.230', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.705', 'FRAGCOUNT': '1.500', 'weapon3': '1.558', 'weapon2': '1.896'}
[2023-02-25 12:35:38,622][2409102] DAMAGECOUNT value on done: 545.0
[2023-02-25 12:35:38,624][2409102] Sum rewards: 2.571, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.809', 'AMMO5': '0.004', 'AMMO2': '0.014', 'ARMOR': '0.036', 'weapon7': '0.048', 'AMMO3': '0.060', 'AMMO4': '0.068', 'weapon5': '0.072', 'weapon4': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.210', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.750', 'weapon3': '1.028', 'weapon2': '1.046', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:38,657][2409469] DAMAGECOUNT value on done: 714.0
[2023-02-25 12:35:38,657][2409469] Sum rewards: 0.266, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.130', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'ARMOR': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.122', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'weapon4': '0.270', 'HITCOUNT': '0.330', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.188', 'weapon2': '1.324', 'weapon3': '1.678', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:38,714][2409486] DAMAGECOUNT value on done: 481.0
[2023-02-25 12:35:38,718][2409486] Sum rewards: -0.110, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.246', 'AMMO5': '0.005', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.026', 'weapon7': '0.060', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.121', 'weapon4': '0.134', 'HITCOUNT': '0.140', 'WEAPON7': '0.200', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.870', 'weapon2': '0.936', 'weapon3': '1.244'}
[2023-02-25 12:35:38,799][2409548] DAMAGECOUNT value on done: 645.0
[2023-02-25 12:35:38,803][2409548] Sum rewards: 1.434, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.490', 'AMMO2': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.020', 'weapon5': '0.026', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'HITCOUNT': '0.360', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.275', 'weapon2': '1.544', 'weapon3': '2.150', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:39,040][2409407] DAMAGECOUNT value on done: 618.0
[2023-02-25 12:35:39,041][2409407] Sum rewards: 2.124, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.738', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.020', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'HITCOUNT': '0.240', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.756', 'weapon3': '1.572', 'weapon2': '1.740', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:39,124][2409103] DAMAGECOUNT value on done: 643.0
[2023-02-25 12:35:39,125][2409103] Sum rewards: -0.131, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.260', 'AMMO5': '0.010', 'AMMO2': '0.011', 'weapon5': '0.046', 'AMMO4': '0.056', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.270', 'weapon4': '0.384', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.897', 'weapon2': '1.178', 'weapon3': '1.832', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:39,325][2409074] Updated weights for policy 0, policy_version 6150 (0.0012)
[2023-02-25 12:35:39,333][2409406] DAMAGECOUNT value on done: 470.0
[2023-02-25 12:35:39,415][2409096] DAMAGECOUNT value on done: 484.0
[2023-02-25 12:35:39,419][2409096] Sum rewards: -0.359, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.112', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.026', 'AMMO4': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.163', 'HITCOUNT': '0.190', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.642', 'WEAPON3': '0.950', 'weapon2': '1.566', 'weapon3': '1.968', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:39,468][2409080] DAMAGECOUNT value on done: 964.0
[2023-02-25 12:35:39,469][2409080] Sum rewards: -1.440, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.716', 'AMMO2': '0.007', 'AMMO5': '0.017', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'weapon4': '0.068', 'weapon5': '0.116', 'AMMO3': '0.132', 'WEAPON5': '0.250', 'HITCOUNT': '0.350', 'WEAPON3': '0.850', 'weapon2': '1.376', 'DAMAGECOUNT': '1.737', 'weapon3': '2.040', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:39,480][2409866] DAMAGECOUNT value on done: 461.0
[2023-02-25 12:35:39,484][2409866] Sum rewards: -0.188, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.398', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon5': '0.032', 'AMMO3': '0.076', 'ARMOR': '0.080', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'AMMO4': '0.111', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'weapon4': '0.476', 'DAMAGECOUNT': '0.498', 'FRAGCOUNT': '0.500', 'weapon2': '1.258', 'weapon3': '1.482'}
[2023-02-25 12:35:39,504][2409547] DAMAGECOUNT value on done: 687.0
[2023-02-25 12:35:39,505][2409547] Sum rewards: -1.170, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.360', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'weapon4': '0.016', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'HITCOUNT': '0.450', 'WEAPON3': '0.950', 'weapon2': '1.408', 'DAMAGECOUNT': '1.611', 'weapon3': '2.018', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:39,570][2409100] DAMAGECOUNT value on done: 398.0
[2023-02-25 12:35:39,571][2409100] Sum rewards: -3.482, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.756', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO4': '0.024', 'weapon5': '0.076', 'HITCOUNT': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.157', 'weapon4': '0.166', 'WEAPON5': '0.250', 'ARMOR': '0.432', 'DAMAGECOUNT': '0.438', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.900', 'weapon2': '1.678', 'weapon3': '1.692'}
[2023-02-25 12:35:39,826][2409373] DAMAGECOUNT value on done: 556.0
[2023-02-25 12:35:39,830][2409373] Sum rewards: -0.534, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.060', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON1': '0.030', 'ARMOR': '0.048', 'AMMO4': '0.059', 'AMMO3': '0.084', 'weapon4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.130', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.550', 'weapon3': '1.332', 'weapon2': '1.474', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:39,853][2409101] DAMAGECOUNT value on done: 786.0
[2023-02-25 12:35:39,855][2409101] Sum rewards: -1.932, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.010', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'AMMO4': '0.125', 'weapon4': '0.166', 'HITCOUNT': '0.240', 'WEAPON4': '0.250', 'ARMOR': '0.516', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.020', 'weapon2': '1.466', 'weapon3': '1.488', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:39,951][2409355] DAMAGECOUNT value on done: 519.0
[2023-02-25 12:35:40,007][2409077] DAMAGECOUNT value on done: 622.0
[2023-02-25 12:35:40,008][2409077] Sum rewards: -1.622, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.030', 'ARMOR': '0.004', 'AMMO5': '0.008', 'weapon5': '0.008', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'weapon4': '0.124', 'AMMO3': '0.161', 'HITCOUNT': '0.280', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.110', 'weapon3': '1.776', 'weapon2': '1.812', 'FRAGCOUNT': '4.500'}
[2023-02-25 12:35:40,090][2409597] DAMAGECOUNT value on done: 760.0
[2023-02-25 12:35:40,094][2409597] Sum rewards: 1.359, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.159', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO3': '0.069', 'HITCOUNT': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.478', 'ARMOR': '0.497', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.885', 'weapon3': '1.204', 'weapon2': '1.584', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:40,128][2409105] DAMAGECOUNT value on done: 929.0
[2023-02-25 12:35:40,132][2409105] Sum rewards: 0.520, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.646', 'weapon4': '0.004', 'AMMO2': '0.006', 'AMMO5': '0.009', 'AMMO4': '0.030', 'weapon5': '0.034', 'WEAPON1': '0.040', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.330', 'ARMOR': '0.539', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.164', 'weapon3': '1.632', 'weapon2': '1.928', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:40,335][2409549] DAMAGECOUNT value on done: 651.0
[2023-02-25 12:35:40,599][2409078] DAMAGECOUNT value on done: 454.0
[2023-02-25 12:35:41,043][2409565] DAMAGECOUNT value on done: 503.0
[2023-02-25 12:35:41,048][2409565] Sum rewards: -0.207, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.124', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO4': '0.093', 'AMMO3': '0.099', 'ARMOR': '0.144', 'WEAPON4': '0.150', 'HITCOUNT': '0.190', 'weapon4': '0.192', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.642', 'weapon3': '1.258', 'FRAGCOUNT': '2.000', 'weapon2': '2.014'}
[2023-02-25 12:35:41,103][2409074] Updated weights for policy 0, policy_version 6160 (0.0012)
[2023-02-25 12:35:41,110][2409099] DAMAGECOUNT value on done: 801.0
[2023-02-25 12:35:41,113][2409099] Sum rewards: -2.555, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.651', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.019', 'weapon7': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.222', 'HITCOUNT': '0.260', 'ARMOR': '0.513', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.759', 'FRAGCOUNT': '1.000', 'weapon2': '1.344', 'weapon3': '1.764'}
[2023-02-25 12:35:41,134][2409389] DAMAGECOUNT value on done: 766.0
[2023-02-25 12:35:41,134][2409389] Sum rewards: 5.532, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.972', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.024', 'WEAPON4': '0.050', 'AMMO4': '0.073', 'AMMO3': '0.077', 'weapon7': '0.080', 'WEAPON5': '0.100', 'weapon4': '0.244', 'HITCOUNT': '0.320', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.600', 'ARMOR': '0.944', 'DAMAGECOUNT': '1.290', 'weapon2': '1.338', 'weapon3': '1.552', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:35:41,259][2409104] DAMAGECOUNT value on done: 819.0
[2023-02-25 12:35:41,262][2409104] Sum rewards: 1.792, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.312', 'AMMO4': '-0.074', 'AMMO2': '-0.015', 'WEAPON1': '0.020', 'weapon4': '0.030', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'HITCOUNT': '0.300', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.350', 'weapon3': '1.674', 'weapon2': '1.978', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:35:41,327][2409076] DAMAGECOUNT value on done: 694.0
[2023-02-25 12:35:41,328][2409076] Sum rewards: -2.525, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.394', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon5': '0.036', 'AMMO3': '0.110', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.260', 'weapon4': '0.326', 'ARMOR': '0.488', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.951', 'weapon2': '1.286', 'FRAGCOUNT': '1.500', 'weapon3': '1.678'}
[2023-02-25 12:35:41,493][2409468] DAMAGECOUNT value on done: 788.0
[2023-02-25 12:35:41,494][2409468] Sum rewards: -1.064, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.334', 'AMMO5': '0.003', 'AMMO2': '0.022', 'AMMO3': '0.062', 'WEAPON4': '0.100', 'AMMO4': '0.111', 'HITCOUNT': '0.160', 'weapon4': '0.202', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.657', 'weapon3': '0.826', 'ARMOR': '0.885', 'FRAGCOUNT': '1.000', 'weapon2': '1.642'}
[2023-02-25 12:35:42,110][2409097] DAMAGECOUNT value on done: 699.0
[2023-02-25 12:35:42,114][2409097] Sum rewards: -0.748, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.164', 'weapon4': '0.004', 'AMMO5': '0.007', 'weapon5': '0.024', 'AMMO2': '0.024', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'HITCOUNT': '0.220', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.747', 'weapon2': '1.660', 'weapon3': '1.912', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:42,154][2409075] DAMAGECOUNT value on done: 553.0
[2023-02-25 12:35:42,155][2409075] Sum rewards: -2.601, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.398', 'AMMO5': '0.008', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.050', 'AMMO3': '0.077', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'weapon4': '0.110', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'WEAPON3': '0.500', 'ARMOR': '0.524', 'DAMAGECOUNT': '0.675', 'FRAGCOUNT': '1.000', 'weapon3': '1.196', 'weapon2': '1.626'}
[2023-02-25 12:35:42,173][2409079] DAMAGECOUNT value on done: 480.0
[2023-02-25 12:35:42,176][2409079] Sum rewards: -3.979, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.129', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO3': '0.067', 'HITCOUNT': '0.110', 'weapon4': '0.258', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.387', 'WEAPON3': '0.450', 'ARMOR': '0.536', 'weapon3': '0.890', 'FRAGCOUNT': '1.000', 'weapon2': '2.396'}
[2023-02-25 12:35:42,186][2408954] Fps is (10 sec: 25804.1, 60 sec: 24712.4, 300 sec: 25436.8). Total num frames: 25260032. Throughput: 0: 6145.0. Samples: 6315636. Policy #0 lag: (min: 0.0, avg: 13.8, max: 29.0)
[2023-02-25 12:35:42,186][2408954] Avg episode reward: [(0, '-1.020')]
[2023-02-25 12:35:42,233][2409596] DAMAGECOUNT value on done: 865.0
[2023-02-25 12:35:42,236][2409596] Sum rewards: 0.525, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.052', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'weapon5': '0.054', 'ARMOR': '0.056', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'HITCOUNT': '0.360', 'WEAPON3': '1.000', 'weapon2': '1.062', 'DAMAGECOUNT': '1.320', 'weapon3': '2.390', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:35:42,405][2409405] DAMAGECOUNT value on done: 1031.0
[2023-02-25 12:35:42,406][2409405] Sum rewards: 4.199, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.038', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.113', 'HEALTH': '0.162', 'weapon4': '0.328', 'HITCOUNT': '0.440', 'ARMOR': '0.444', 'WEAPON3': '0.500', 'weapon3': '1.416', 'weapon2': '1.458', 'DAMAGECOUNT': '1.725', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:35:42,549][2409469] DAMAGECOUNT value on done: 512.0
[2023-02-25 12:35:42,551][2409469] Sum rewards: -0.360, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.736', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'ARMOR': '0.064', 'weapon5': '0.072', 'AMMO3': '0.130', 'AMMO4': '0.147', 'weapon4': '0.196', 'HITCOUNT': '0.260', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.987', 'weapon3': '1.220', 'weapon2': '1.808', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:42,590][2409548] DAMAGECOUNT value on done: 475.0
[2023-02-25 12:35:42,594][2409548] Sum rewards: -2.485, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.244', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.033', 'weapon4': '0.062', 'ARMOR': '0.068', 'weapon5': '0.074', 'AMMO3': '0.105', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.250', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.873', 'weapon2': '1.586', 'weapon3': '1.784', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:42,598][2409102] DAMAGECOUNT value on done: 479.0
[2023-02-25 12:35:42,599][2409102] Sum rewards: 0.261, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.560', 'AMMO5': '0.015', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'ARMOR': '0.068', 'weapon5': '0.078', 'AMMO4': '0.110', 'weapon4': '0.126', 'AMMO3': '0.135', 'HITCOUNT': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.798', 'weapon2': '1.392', 'weapon3': '1.836', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:35:42,612][2409074] Updated weights for policy 0, policy_version 6170 (0.0012)
[2023-02-25 12:35:42,670][2409485] DAMAGECOUNT value on done: 850.0
[2023-02-25 12:35:42,671][2409485] Sum rewards: 3.133, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.746', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.069', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'weapon5': '0.102', 'weapon4': '0.206', 'ARMOR': '0.408', 'WEAPON3': '0.450', 'HITCOUNT': '0.470', 'weapon3': '1.368', 'weapon2': '1.490', 'DAMAGECOUNT': '1.545', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:35:42,799][2409486] DAMAGECOUNT value on done: 846.0
[2023-02-25 12:35:42,800][2409486] Sum rewards: -3.282, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.694', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.018', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'weapon4': '0.046', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'HITCOUNT': '0.370', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.455', 'weapon2': '1.578', 'weapon3': '1.766', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:43,030][2409407] DAMAGECOUNT value on done: 554.0
[2023-02-25 12:35:43,166][2409406] DAMAGECOUNT value on done: 533.0
[2023-02-25 12:35:43,166][2409406] Sum rewards: -0.074, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.658', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'HITCOUNT': '0.060', 'AMMO3': '0.066', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.201', 'weapon4': '0.214', 'WEAPON3': '0.350', 'FRAGCOUNT': '1.000', 'weapon2': '1.080', 'weapon3': '1.216'}
[2023-02-25 12:35:43,175][2409080] DAMAGECOUNT value on done: 731.0
[2023-02-25 12:35:43,176][2409080] Sum rewards: 0.208, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.628', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.058', 'AMMO3': '0.112', 'WEAPON4': '0.150', 'weapon4': '0.228', 'HITCOUNT': '0.270', 'WEAPON3': '0.800', 'ARMOR': '0.852', 'DAMAGECOUNT': '1.155', 'weapon2': '1.708', 'weapon3': '1.716', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:43,345][2409096] DAMAGECOUNT value on done: 741.0
[2023-02-25 12:35:43,346][2409096] Sum rewards: -0.448, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.030', 'AMMO2': '0.005', 'AMMO5': '0.008', 'AMMO4': '0.023', 'weapon5': '0.024', 'ARMOR': '0.060', 'AMMO3': '0.073', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'HITCOUNT': '0.260', 'weapon4': '0.418', 'WEAPON3': '0.550', 'weapon3': '1.044', 'DAMAGECOUNT': '1.050', 'weapon2': '1.418', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:43,391][2409547] DAMAGECOUNT value on done: 475.0
[2023-02-25 12:35:43,394][2409547] Sum rewards: 3.688, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.925', 'AMMO4': '-0.054', 'AMMO2': '-0.011', 'weapon7': '0.050', 'AMMO3': '0.055', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.200', 'WEAPON3': '0.300', 'ARMOR': '0.448', 'weapon3': '0.652', 'DAMAGECOUNT': '0.885', 'weapon2': '0.898', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:43,643][2409077] DAMAGECOUNT value on done: 872.0
[2023-02-25 12:35:43,646][2409077] Sum rewards: 2.040, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.586', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.016', 'WEAPON1': '0.040', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.102', 'AMMO3': '0.161', 'ARMOR': '0.458', 'HITCOUNT': '0.470', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.728', 'weapon2': '1.740', 'weapon3': '1.850', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:35:43,689][2409100] DAMAGECOUNT value on done: 720.0
[2023-02-25 12:35:43,690][2409100] Sum rewards: -2.338, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.261', 'AMMO2': '0.004', 'AMMO4': '0.020', 'WEAPON1': '0.050', 'AMMO3': '0.118', 'HITCOUNT': '0.230', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.735', 'WEAPON3': '0.750', 'weapon2': '1.802', 'weapon3': '1.814', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:43,805][2409101] DAMAGECOUNT value on done: 660.0
[2023-02-25 12:35:43,871][2409373] DAMAGECOUNT value on done: 926.0
[2023-02-25 12:35:43,874][2409373] Sum rewards: 2.253, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.695', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'ARMOR': '0.012', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'weapon5': '0.112', 'AMMO3': '0.120', 'WEAPON5': '0.150', 'weapon4': '0.210', 'HITCOUNT': '0.320', 'WEAPON3': '0.600', 'weapon3': '1.536', 'DAMAGECOUNT': '1.581', 'weapon2': '1.620', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:35:43,914][2409866] DAMAGECOUNT value on done: 469.0
[2023-02-25 12:35:43,919][2409866] Sum rewards: 2.313, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.928', 'AMMO4': '-0.064', 'AMMO2': '-0.013', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO3': '0.058', 'weapon5': '0.062', 'weapon7': '0.064', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.140', 'WEAPON7': '0.200', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.855', 'weapon3': '1.012', 'weapon2': '1.114', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:44,176][2409549] DAMAGECOUNT value on done: 664.0
[2023-02-25 12:35:44,177][2409549] Sum rewards: -0.623, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.716', 'AMMO5': '0.008', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.095', 'AMMO4': '0.114', 'weapon5': '0.168', 'weapon4': '0.180', 'HITCOUNT': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.600', 'weapon2': '0.786', 'DAMAGECOUNT': '0.927', 'FRAGCOUNT': '1.000', 'weapon3': '1.680'}
[2023-02-25 12:35:44,237][2409597] DAMAGECOUNT value on done: 454.0
[2023-02-25 12:35:44,238][2409597] Sum rewards: -2.845, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.016', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'ARMOR': '0.072', 'AMMO4': '0.090', 'weapon4': '0.136', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'HITCOUNT': '0.310', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.858', 'weapon2': '1.380', 'weapon3': '1.914', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:44,261][2409105] DAMAGECOUNT value on done: 816.0
[2023-02-25 12:35:44,262][2409105] Sum rewards: -4.683, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.334', 'AMMO5': '0.010', 'weapon5': '0.024', 'ARMOR': '0.028', 'AMMO2': '0.031', 'WEAPON1': '0.050', 'weapon4': '0.130', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'AMMO4': '0.156', 'DAMAGECOUNT': '0.846', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.658', 'weapon2': '1.712'}
[2023-02-25 12:35:44,426][2409074] Updated weights for policy 0, policy_version 6180 (0.0012)
[2023-02-25 12:35:44,435][2409355] DAMAGECOUNT value on done: 470.0
[2023-02-25 12:35:44,436][2409355] Sum rewards: 2.166, reward structure: {'HEALTH': '-0.180', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO3': '0.020', 'HITCOUNT': '0.050', 'WEAPON3': '0.100', 'DAMAGECOUNT': '0.300', 'weapon2': '0.398', 'weapon3': '0.508', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:35:44,450][2409078] DAMAGECOUNT value on done: 435.0
[2023-02-25 12:35:44,454][2409078] Sum rewards: -2.272, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.227', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'weapon4': '0.104', 'HITCOUNT': '0.120', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.390', 'ARMOR': '0.477', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.376', 'weapon2': '1.760'}
[2023-02-25 12:35:44,793][2409099] DAMAGECOUNT value on done: 1084.0
[2023-02-25 12:35:44,794][2409099] Sum rewards: -0.488, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.734', 'AMMO5': '0.011', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'AMMO3': '0.138', 'weapon4': '0.140', 'WEAPON5': '0.150', 'weapon5': '0.158', 'HITCOUNT': '0.230', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.179', 'weapon2': '1.662', 'weapon3': '1.710', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:44,798][2409565] DAMAGECOUNT value on done: 698.0
[2023-02-25 12:35:44,798][2409565] Sum rewards: 0.935, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.290', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.107', 'AMMO3': '0.117', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.164', 'weapon4': '0.342', 'HITCOUNT': '0.390', 'ARMOR': '0.452', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.245', 'weapon3': '1.358', 'weapon2': '1.664', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:44,810][2409389] DAMAGECOUNT value on done: 647.0
[2023-02-25 12:35:44,813][2409389] Sum rewards: 3.625, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.730', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO3': '0.094', 'weapon5': '0.144', 'WEAPON5': '0.200', 'HITCOUNT': '0.320', 'WEAPON3': '0.750', 'weapon2': '1.198', 'DAMAGECOUNT': '1.266', 'weapon3': '1.624', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:35:45,116][2409104] DAMAGECOUNT value on done: 854.0
[2023-02-25 12:35:45,282][2409468] DAMAGECOUNT value on done: 604.0
[2023-02-25 12:35:45,283][2409468] Sum rewards: 0.714, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'AMMO4': '0.037', 'WEAPON5': '0.050', 'AMMO3': '0.088', 'weapon5': '0.108', 'HITCOUNT': '0.220', 'HEALTH': '0.260', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.020', 'weapon2': '1.402', 'weapon3': '1.770', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:45,451][2409076] DAMAGECOUNT value on done: 804.0
[2023-02-25 12:35:45,455][2409076] Sum rewards: -2.553, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.807', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'AMMO5': '0.006', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.066', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.140', 'weapon4': '0.176', 'ARMOR': '0.472', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.700', 'weapon2': '1.390', 'weapon3': '1.820', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:45,732][2409097] DAMAGECOUNT value on done: 580.0
[2023-02-25 12:35:45,735][2409097] Sum rewards: -2.808, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.918', 'AMMO2': '0.002', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO4': '0.012', 'WEAPON5': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.141', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.700', 'weapon3': '1.358', 'weapon2': '1.568', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:45,781][2409079] DAMAGECOUNT value on done: 774.0
[2023-02-25 12:35:45,782][2409079] Sum rewards: 2.844, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.080', 'weapon7': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HEALTH': '0.272', 'HITCOUNT': '0.400', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.335', 'weapon3': '1.530', 'weapon2': '1.952', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:45,855][2409075] DAMAGECOUNT value on done: 547.0
[2023-02-25 12:35:45,856][2409075] Sum rewards: -4.273, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.186', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.014', 'weapon5': '0.054', 'AMMO3': '0.087', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.218', 'HITCOUNT': '0.270', 'ARMOR': '0.490', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.981', 'weapon3': '1.272', 'FRAGCOUNT': '2.000', 'weapon2': '2.214'}
[2023-02-25 12:35:45,956][2409074] Updated weights for policy 0, policy_version 6190 (0.0012)
[2023-02-25 12:35:46,074][2409405] DAMAGECOUNT value on done: 504.0
[2023-02-25 12:35:46,077][2409405] Sum rewards: -1.670, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.194', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'ARMOR': '0.076', 'AMMO3': '0.112', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.250', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.390', 'weapon2': '1.474'}
[2023-02-25 12:35:46,084][2409596] DAMAGECOUNT value on done: 595.0
[2023-02-25 12:35:46,085][2409596] Sum rewards: -0.332, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.586', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO3': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.052', 'ARMOR': '0.072', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'WEAPON3': '0.250', 'weapon4': '0.316', 'DAMAGECOUNT': '0.435', 'weapon3': '0.816', 'weapon2': '1.454'}
[2023-02-25 12:35:46,091][2409469] DAMAGECOUNT value on done: 864.0
[2023-02-25 12:35:46,092][2409469] Sum rewards: 0.907, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.647', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'WEAPON4': '0.100', 'weapon5': '0.100', 'AMMO3': '0.104', 'AMMO4': '0.117', 'weapon4': '0.146', 'WEAPON5': '0.250', 'HITCOUNT': '0.310', 'WEAPON3': '0.700', 'weapon2': '1.228', 'DAMAGECOUNT': '1.392', 'weapon3': '1.800', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:46,276][2409102] DAMAGECOUNT value on done: 654.0
[2023-02-25 12:35:46,277][2409102] Sum rewards: -5.250, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.762', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.112', 'AMMO3': '0.141', 'HITCOUNT': '0.210', 'weapon4': '0.276', 'WEAPON4': '0.300', 'ARMOR': '0.444', 'DAMAGECOUNT': '0.648', 'WEAPON3': '0.800', 'weapon3': '1.398', 'weapon2': '1.580'}
[2023-02-25 12:35:46,385][2409485] DAMAGECOUNT value on done: 720.0
[2023-02-25 12:35:46,386][2409485] Sum rewards: -1.898, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.274', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO4': '0.078', 'AMMO3': '0.112', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'weapon4': '0.248', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.768', 'weapon2': '1.508', 'weapon3': '1.774', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:46,613][2409407] DAMAGECOUNT value on done: 470.0
[2023-02-25 12:35:46,617][2409407] Sum rewards: -5.375, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.040', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'ARMOR': '0.073', 'AMMO3': '0.102', 'AMMO4': '0.115', 'weapon5': '0.140', 'HITCOUNT': '0.220', 'weapon4': '0.244', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.600', 'weapon3': '1.162', 'weapon2': '1.810'}
[2023-02-25 12:35:46,646][2409486] DAMAGECOUNT value on done: 533.0
[2023-02-25 12:35:46,650][2409486] Sum rewards: -2.497, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.144', 'AMMO4': '-0.072', 'AMMO2': '-0.014', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon5': '0.076', 'AMMO3': '0.112', 'HITCOUNT': '0.170', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.684', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.284', 'weapon3': '1.876'}
[2023-02-25 12:35:46,734][2409406] DAMAGECOUNT value on done: 513.0
[2023-02-25 12:35:46,737][2409406] Sum rewards: -1.209, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.914', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'weapon5': '0.032', 'ARMOR': '0.034', 'WEAPON5': '0.050', 'AMMO3': '0.056', 'AMMO4': '0.058', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.364', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.858', 'FRAGCOUNT': '1.000', 'weapon2': '1.172', 'weapon3': '1.234'}
[2023-02-25 12:35:46,766][2409548] DAMAGECOUNT value on done: 440.0
[2023-02-25 12:35:46,770][2409548] Sum rewards: -0.318, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.550', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon5': '0.052', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'HITCOUNT': '0.150', 'weapon4': '0.182', 'ARMOR': '0.454', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.550', 'weapon3': '1.656', 'weapon2': '1.758', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:46,993][2409080] DAMAGECOUNT value on done: 558.0
[2023-02-25 12:35:46,996][2409080] Sum rewards: -3.497, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.946', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon4': '0.062', 'AMMO4': '0.074', 'AMMO3': '0.085', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.666', 'ARMOR': '0.855', 'FRAGCOUNT': '1.000', 'weapon2': '1.644', 'weapon3': '1.686'}
[2023-02-25 12:35:47,048][2409547] DAMAGECOUNT value on done: 457.0
[2023-02-25 12:35:47,049][2409547] Sum rewards: -2.983, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.092', 'weapon5': '0.006', 'AMMO5': '0.009', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'weapon4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'HITCOUNT': '0.240', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.918', 'weapon3': '1.668', 'weapon2': '1.720'}
[2023-02-25 12:35:47,186][2408954] Fps is (10 sec: 25395.5, 60 sec: 24576.0, 300 sec: 25409.1). Total num frames: 25387008. Throughput: 0: 6166.9. Samples: 6353772. Policy #0 lag: (min: 0.0, avg: 11.2, max: 25.0)
[2023-02-25 12:35:47,186][2408954] Avg episode reward: [(0, '-1.014')]
[2023-02-25 12:35:47,221][2409096] DAMAGECOUNT value on done: 1211.0
[2023-02-25 12:35:47,221][2409096] Sum rewards: 2.870, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.945', 'AMMO2': '0.003', 'AMMO5': '0.008', 'AMMO4': '0.014', 'weapon5': '0.018', 'WEAPON1': '0.040', 'AMMO3': '0.134', 'WEAPON5': '0.150', 'HITCOUNT': '0.340', 'WEAPON3': '0.850', 'weapon2': '1.090', 'DAMAGECOUNT': '1.722', 'weapon3': '1.946', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:35:47,348][2409077] DAMAGECOUNT value on done: 320.0
[2023-02-25 12:35:47,351][2409077] Sum rewards: -1.673, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.718', 'AMMO2': '0.015', 'HITCOUNT': '0.040', 'AMMO4': '0.076', 'ARMOR': '0.112', 'AMMO3': '0.114', 'DAMAGECOUNT': '0.120', 'WEAPON4': '0.200', 'weapon4': '0.536', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.418', 'weapon3': '1.514'}
[2023-02-25 12:35:47,368][2409074] Updated weights for policy 0, policy_version 6200 (0.0012)
[2023-02-25 12:35:47,609][2409373] DAMAGECOUNT value on done: 219.0
[2023-02-25 12:35:47,610][2409373] Sum rewards: 2.011, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.886', 'AMMO2': '0.006', 'AMMO4': '0.029', 'AMMO3': '0.029', 'HITCOUNT': '0.060', 'weapon7': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.220', 'WEAPON4': '0.250', 'weapon3': '0.284', 'DAMAGECOUNT': '0.417', 'ARMOR': '0.680', 'weapon2': '1.210', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:47,744][2409101] DAMAGECOUNT value on done: 660.0
[2023-02-25 12:35:47,745][2409101] Sum rewards: -2.943, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.914', 'AMMO2': '0.018', 'ARMOR': '0.070', 'AMMO4': '0.092', 'weapon4': '0.094', 'AMMO3': '0.119', 'HITCOUNT': '0.230', 'WEAPON4': '0.300', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.101', 'weapon3': '1.464', 'weapon2': '1.832', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:48,080][2409597] DAMAGECOUNT value on done: 919.0
[2023-02-25 12:35:48,081][2409597] Sum rewards: 0.399, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.240', 'ARMOR': '0.008', 'AMMO2': '0.011', 'AMMO4': '0.055', 'AMMO3': '0.104', 'HITCOUNT': '0.350', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.053', 'weapon3': '1.828', 'weapon2': '1.980', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:48,112][2409105] DAMAGECOUNT value on done: 729.0
[2023-02-25 12:35:48,117][2409105] Sum rewards: 0.870, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.500', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.037', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'HITCOUNT': '0.440', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.581', 'weapon2': '1.618', 'FRAGCOUNT': '2.000', 'weapon3': '2.172'}
[2023-02-25 12:35:48,232][2409866] DAMAGECOUNT value on done: 883.0
[2023-02-25 12:35:48,235][2409866] Sum rewards: 0.314, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.076', 'AMMO5': '0.008', 'AMMO2': '0.037', 'ARMOR': '0.052', 'weapon5': '0.068', 'weapon7': '0.082', 'AMMO3': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.187', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.294', 'WEAPON3': '0.550', 'weapon2': '1.012', 'DAMAGECOUNT': '1.014', 'weapon3': '1.654', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:48,266][2409078] DAMAGECOUNT value on done: 687.0
[2023-02-25 12:35:48,269][2409078] Sum rewards: 2.078, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.302', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.088', 'AMMO4': '0.094', 'weapon5': '0.102', 'HITCOUNT': '0.400', 'WEAPON3': '0.500', 'ARMOR': '0.800', 'weapon3': '1.128', 'DAMAGECOUNT': '1.221', 'weapon2': '1.656', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:48,452][2409389] DAMAGECOUNT value on done: 751.0
[2023-02-25 12:35:48,452][2409389] Sum rewards: 0.040, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.668', 'AMMO5': '0.005', 'weapon5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'ARMOR': '0.060', 'AMMO4': '0.069', 'AMMO3': '0.072', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.158', 'HITCOUNT': '0.350', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.350', 'weapon3': '1.520', 'weapon2': '1.842', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:48,628][2409099] DAMAGECOUNT value on done: 845.0
[2023-02-25 12:35:48,631][2409099] Sum rewards: -0.149, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.155', 'AMMO2': '0.005', 'AMMO5': '0.015', 'AMMO4': '0.024', 'ARMOR': '0.060', 'HITCOUNT': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.110', 'AMMO3': '0.121', 'weapon5': '0.156', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.603', 'FRAGCOUNT': '1.000', 'weapon2': '1.322', 'weapon3': '1.620'}
[2023-02-25 12:35:48,728][2409355] DAMAGECOUNT value on done: 666.0
[2023-02-25 12:35:48,731][2409355] Sum rewards: -4.883, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.614', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.013', 'AMMO5': '0.014', 'ARMOR': '0.056', 'AMMO3': '0.171', 'weapon5': '0.194', 'WEAPON5': '0.200', 'HITCOUNT': '0.350', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.014', 'weapon3': '1.622', 'weapon2': '1.684'}
[2023-02-25 12:35:48,776][2409104] DAMAGECOUNT value on done: 552.0
[2023-02-25 12:35:48,929][2409565] DAMAGECOUNT value on done: 848.0
[2023-02-25 12:35:48,985][2409076] DAMAGECOUNT value on done: 777.0
[2023-02-25 12:35:48,987][2409076] Sum rewards: -0.827, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.800', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO3': '0.116', 'ARMOR': '0.428', 'HITCOUNT': '0.430', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.278', 'weapon2': '1.594', 'weapon3': '1.870'}
[2023-02-25 12:35:49,013][2409074] Updated weights for policy 0, policy_version 6210 (0.0013)
[2023-02-25 12:35:49,052][2409468] DAMAGECOUNT value on done: 767.0
[2023-02-25 12:35:49,057][2409468] Sum rewards: 0.783, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon7': '0.060', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'HEALTH': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.224', 'HITCOUNT': '0.260', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.810', 'weapon3': '1.410', 'weapon2': '1.604', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:49,484][2409097] DAMAGECOUNT value on done: 504.0
[2023-02-25 12:35:49,692][2409075] DAMAGECOUNT value on done: 452.0
[2023-02-25 12:35:49,695][2409075] Sum rewards: 1.103, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.082', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.012', 'WEAPON5': '0.050', 'weapon7': '0.068', 'AMMO3': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.250', 'weapon4': '0.450', 'WEAPON3': '0.600', 'ARMOR': '0.891', 'DAMAGECOUNT': '0.891', 'weapon3': '1.114', 'weapon2': '1.164', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:49,781][2409596] DAMAGECOUNT value on done: 595.0
[2023-02-25 12:35:49,782][2409596] Sum rewards: 3.091, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.383', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.108', 'AMMO4': '0.111', 'weapon5': '0.118', 'WEAPON5': '0.150', 'weapon4': '0.188', 'HITCOUNT': '0.290', 'WEAPON3': '0.600', 'weapon2': '1.026', 'DAMAGECOUNT': '1.215', 'weapon3': '1.786', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:49,955][2409469] DAMAGECOUNT value on done: 698.0
[2023-02-25 12:35:49,956][2409469] Sum rewards: 0.750, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.210', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'weapon4': '0.094', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'HITCOUNT': '0.380', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'FRAGCOUNT': '0.500', 'weapon3': '1.190', 'DAMAGECOUNT': '1.260', 'weapon2': '1.520'}
[2023-02-25 12:35:50,045][2409405] DAMAGECOUNT value on done: 914.0
[2023-02-25 12:35:50,046][2409405] Sum rewards: -2.689, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.280', 'AMMO2': '0.004', 'AMMO4': '0.021', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'weapon4': '0.192', 'HITCOUNT': '0.220', 'ARMOR': '0.524', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.855', 'FRAGCOUNT': '1.000', 'weapon2': '1.322', 'weapon3': '1.806'}
[2023-02-25 12:35:50,047][2409079] DAMAGECOUNT value on done: 860.0
[2023-02-25 12:35:50,050][2409079] Sum rewards: 0.217, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.226', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.013', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'HITCOUNT': '0.230', 'weapon4': '0.232', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.780', 'weapon2': '0.968', 'FRAGCOUNT': '1.000', 'weapon3': '1.668'}
[2023-02-25 12:35:50,331][2409486] DAMAGECOUNT value on done: 547.0
[2023-02-25 12:35:50,332][2409486] Sum rewards: -5.101, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.022', 'weapon5': '0.002', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.025', 'weapon4': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.152', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.735', 'WEAPON3': '1.000', 'weapon2': '1.630', 'weapon3': '1.960', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:50,459][2409548] DAMAGECOUNT value on done: 905.0
[2023-02-25 12:35:50,461][2409548] Sum rewards: -6.030, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.073', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'weapon5': '0.028', 'WEAPON4': '0.050', 'AMMO4': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'weapon4': '0.276', 'HITCOUNT': '0.290', 'ARMOR': '0.456', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.107', 'weapon3': '1.506', 'weapon2': '1.754', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:50,565][2409406] DAMAGECOUNT value on done: 949.0
[2023-02-25 12:35:50,566][2409406] Sum rewards: -2.360, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.258', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'weapon5': '0.022', 'AMMO4': '0.043', 'weapon7': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.320', 'FRAGCOUNT': '0.500', 'ARMOR': '0.511', 'WEAPON3': '0.600', 'weapon2': '1.012', 'DAMAGECOUNT': '1.023', 'weapon3': '1.256'}
[2023-02-25 12:35:50,577][2409074] Updated weights for policy 0, policy_version 6220 (0.0012)
[2023-02-25 12:35:50,804][2409407] DAMAGECOUNT value on done: 497.0
[2023-02-25 12:35:50,805][2409407] Sum rewards: 0.728, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.406', 'AMMO2': '0.011', 'ARMOR': '0.012', 'weapon7': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'WEAPON7': '0.200', 'weapon4': '0.206', 'DAMAGECOUNT': '0.687', 'WEAPON3': '0.700', 'weapon2': '1.192', 'weapon3': '1.352', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:50,825][2409096] DAMAGECOUNT value on done: 446.0
[2023-02-25 12:35:50,829][2409547] DAMAGECOUNT value on done: 547.0
[2023-02-25 12:35:50,830][2409547] Sum rewards: -4.168, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.298', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'ARMOR': '0.028', 'AMMO4': '0.080', 'AMMO3': '0.166', 'HITCOUNT': '0.240', 'DAMAGECOUNT': '0.801', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.520', 'weapon3': '2.118'}
[2023-02-25 12:35:50,850][2409080] DAMAGECOUNT value on done: 638.0
[2023-02-25 12:35:50,851][2409080] Sum rewards: -0.437, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.650', 'AMMO4': '-0.065', 'AMMO2': '-0.013', 'AMMO3': '0.077', 'HITCOUNT': '0.210', 'ARMOR': '0.439', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.990', 'weapon3': '1.438', 'weapon2': '1.486', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:51,067][2409077] DAMAGECOUNT value on done: 872.0
[2023-02-25 12:35:51,070][2409077] Sum rewards: -0.261, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.920', 'AMMO2': '0.003', 'AMMO5': '0.011', 'AMMO4': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.109', 'weapon5': '0.134', 'HITCOUNT': '0.190', 'WEAPON5': '0.200', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.729', 'FRAGCOUNT': '1.000', 'weapon3': '1.306', 'weapon2': '1.640'}
[2023-02-25 12:35:51,290][2409373] DAMAGECOUNT value on done: 687.0
[2023-02-25 12:35:51,293][2409373] Sum rewards: 3.588, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.846', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.004', 'weapon5': '0.028', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.102', 'weapon4': '0.162', 'HITCOUNT': '0.390', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.395', 'weapon3': '1.752', 'weapon2': '1.766', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:35:52,109][2409078] DAMAGECOUNT value on done: 498.0
[2023-02-25 12:35:52,110][2409078] Sum rewards: 0.130, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.873', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'WEAPON1': '0.030', 'ARMOR': '0.036', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'weapon4': '0.174', 'HITCOUNT': '0.260', 'DAMAGECOUNT': '0.729', 'WEAPON3': '0.850', 'weapon2': '1.530', 'weapon3': '1.698', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:35:52,170][2409389] DAMAGECOUNT value on done: 771.0
[2023-02-25 12:35:52,171][2409389] Sum rewards: -0.409, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.618', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.048', 'AMMO4': '0.081', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.200', 'HITCOUNT': '0.250', 'ARMOR': '0.448', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.077', 'weapon3': '1.182', 'weapon2': '2.006', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:35:52,186][2408954] Fps is (10 sec: 24986.4, 60 sec: 24576.0, 300 sec: 25395.2). Total num frames: 25509888. Throughput: 0: 6181.6. Samples: 6372816. Policy #0 lag: (min: 1.0, avg: 12.7, max: 25.0)
[2023-02-25 12:35:52,186][2408954] Avg episode reward: [(0, '-0.839')]
[2023-02-25 12:35:52,185][2409866] DAMAGECOUNT value on done: 505.0
[2023-02-25 12:35:52,187][2409866] Sum rewards: -0.886, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.664', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'ARMOR': '0.028', 'weapon7': '0.046', 'weapon4': '0.052', 'AMMO3': '0.064', 'AMMO4': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.260', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.885', 'weapon3': '0.972', 'weapon2': '1.224', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:52,287][2409597] DAMAGECOUNT value on done: 618.0
[2023-02-25 12:35:52,346][2409074] Updated weights for policy 0, policy_version 6230 (0.0012)
[2023-02-25 12:35:52,406][2409105] DAMAGECOUNT value on done: 429.0
[2023-02-25 12:35:52,407][2409105] Sum rewards: -2.110, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.974', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'weapon4': '0.014', 'weapon5': '0.030', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'HITCOUNT': '0.190', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.687', 'FRAGCOUNT': '1.000', 'weapon3': '1.618', 'weapon2': '2.060'}
[2023-02-25 12:35:52,500][2409099] DAMAGECOUNT value on done: 563.0
[2023-02-25 12:35:52,616][2409104] DAMAGECOUNT value on done: 1005.0
[2023-02-25 12:35:52,617][2409104] Sum rewards: -0.900, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.765', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.005', 'weapon5': '0.014', 'WEAPON1': '0.020', 'WEAPON5': '0.100', 'AMMO3': '0.124', 'HITCOUNT': '0.350', 'WEAPON3': '0.800', 'ARMOR': '0.906', 'DAMAGECOUNT': '1.386', 'weapon2': '1.494', 'weapon3': '2.162', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:35:52,663][2409076] DAMAGECOUNT value on done: 501.0
[2023-02-25 12:35:52,666][2409076] Sum rewards: 2.908, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.130', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'WEAPON1': '0.020', 'AMMO3': '0.070', 'HITCOUNT': '0.140', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.450', 'ARMOR': '0.532', 'weapon3': '1.296', 'weapon2': '1.960', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:52,757][2409355] DAMAGECOUNT value on done: 578.0
[2023-02-25 12:35:52,760][2409355] Sum rewards: -0.170, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.012', 'AMMO2': '0.026', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.088', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.131', 'weapon4': '0.326', 'DAMAGECOUNT': '0.342', 'WEAPON3': '0.450', 'HEALTH': '0.602', 'weapon3': '1.418', 'weapon2': '1.636', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:52,815][2409565] DAMAGECOUNT value on done: 685.0
[2023-02-25 12:35:52,819][2409565] Sum rewards: -0.062, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.139', 'weapon5': '0.002', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.021', 'ARMOR': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'weapon4': '0.282', 'DAMAGECOUNT': '0.615', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.442', 'weapon3': '1.642'}
[2023-02-25 12:35:52,956][2409468] DAMAGECOUNT value on done: 497.0
[2023-02-25 12:35:52,956][2409468] Sum rewards: -2.283, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.003', 'weapon5': '0.022', 'AMMO2': '0.025', 'ARMOR': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.098', 'AMMO4': '0.126', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'HEALTH': '0.359', 'weapon4': '0.424', 'DAMAGECOUNT': '0.546', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.490', 'weapon3': '1.586'}
[2023-02-25 12:35:53,064][2409097] DAMAGECOUNT value on done: 285.0
[2023-02-25 12:35:53,366][2409075] DAMAGECOUNT value on done: 831.0
[2023-02-25 12:35:53,367][2409075] Sum rewards: 1.738, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.742', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.010', 'ARMOR': '0.028', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.076', 'weapon7': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.134', 'HITCOUNT': '0.380', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.365', 'weapon2': '1.430', 'weapon3': '1.918', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:35:53,633][2409469] DAMAGECOUNT value on done: 608.0
[2023-02-25 12:35:53,634][2409469] Sum rewards: -1.273, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.510', 'AMMO5': '0.004', 'AMMO2': '0.005', 'weapon4': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.025', 'weapon5': '0.028', 'AMMO3': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.230', 'WEAPON3': '0.500', 'ARMOR': '0.508', 'DAMAGECOUNT': '0.690', 'FRAGCOUNT': '1.000', 'weapon3': '1.584', 'weapon2': '2.106'}
[2023-02-25 12:35:53,662][2409405] DAMAGECOUNT value on done: 977.0
[2023-02-25 12:35:53,663][2409405] Sum rewards: 0.474, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.584', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon5': '0.026', 'AMMO4': '0.034', 'WEAPON5': '0.050', 'weapon7': '0.074', 'AMMO3': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.300', 'weapon4': '0.414', 'ARMOR': '0.462', 'WEAPON3': '0.800', 'weapon2': '0.856', 'DAMAGECOUNT': '0.861', 'weapon3': '1.714', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:35:53,685][2409074] Updated weights for policy 0, policy_version 6240 (0.0012)
[2023-02-25 12:35:54,079][2409548] DAMAGECOUNT value on done: 1069.0
[2023-02-25 12:35:54,080][2409548] Sum rewards: 1.763, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.520', 'AMMO5': '0.005', 'weapon5': '0.022', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.119', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'weapon4': '0.240', 'HITCOUNT': '0.390', 'ARMOR': '0.408', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.350', 'weapon2': '1.436', 'weapon3': '1.992', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:35:54,198][2409079] DAMAGECOUNT value on done: 774.0
[2023-02-25 12:35:54,202][2409079] Sum rewards: -1.300, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.990', 'AMMO5': '0.003', 'weapon5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.088', 'AMMO3': '0.108', 'WEAPON4': '0.150', 'weapon4': '0.250', 'HITCOUNT': '0.350', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.290', 'weapon2': '1.584', 'weapon3': '1.832', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:54,320][2409407] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 12:35:54,338][2409406] DAMAGECOUNT value on done: 427.0
[2023-02-25 12:35:54,368][2409486] DAMAGECOUNT value on done: 986.0
[2023-02-25 12:35:54,372][2409486] Sum rewards: -0.898, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.212', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.145', 'HITCOUNT': '0.290', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.230', 'weapon2': '1.594', 'FRAGCOUNT': '2.000', 'weapon3': '2.128'}
[2023-02-25 12:35:54,462][2409096] DAMAGECOUNT value on done: 937.0
[2023-02-25 12:35:54,466][2409096] Sum rewards: 1.005, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.755', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'AMMO3': '0.054', 'weapon5': '0.058', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.376', 'HITCOUNT': '0.380', 'WEAPON3': '0.450', 'ARMOR': '0.582', 'weapon3': '1.144', 'DAMAGECOUNT': '1.470', 'FRAGCOUNT': '1.500', 'weapon2': '1.552'}
[2023-02-25 12:35:54,551][2409547] DAMAGECOUNT value on done: 566.0
[2023-02-25 12:35:54,568][2409547] Sum rewards: -2.247, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.004', 'HEALTH': '0.008', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.065', 'weapon5': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'HITCOUNT': '0.190', 'weapon4': '0.230', 'ARMOR': '0.464', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.681', 'FRAGCOUNT': '1.000', 'weapon3': '1.450', 'weapon2': '1.680'}
[2023-02-25 12:35:54,729][2409080] DAMAGECOUNT value on done: 698.0
[2023-02-25 12:35:54,730][2409080] Sum rewards: -3.851, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.350', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'weapon4': '0.018', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'ARMOR': '0.052', 'AMMO3': '0.130', 'HITCOUNT': '0.290', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.894', 'weapon2': '1.844', 'weapon3': '1.910', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:54,850][2409077] DAMAGECOUNT value on done: 817.0
[2023-02-25 12:35:54,851][2409077] Sum rewards: -0.435, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.918', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon5': '0.040', 'AMMO3': '0.050', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.400', 'ARMOR': '0.487', 'weapon4': '0.640', 'weapon3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.334'}
[2023-02-25 12:35:54,894][2409407] DAMAGECOUNT value on done: 792.0
[2023-02-25 12:35:54,897][2409407] Sum rewards: 1.222, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.058', 'AMMO4': '0.077', 'AMMO3': '0.091', 'weapon4': '0.216', 'HEALTH': '0.270', 'HITCOUNT': '0.310', 'ARMOR': '0.440', 'WEAPON3': '0.550', 'weapon2': '0.894', 'DAMAGECOUNT': '1.209', 'weapon3': '1.718', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:54,971][2409373] DAMAGECOUNT value on done: 321.0
[2023-02-25 12:35:55,431][2409074] Updated weights for policy 0, policy_version 6250 (0.0012)
[2023-02-25 12:35:56,016][2409597] DAMAGECOUNT value on done: 562.0
[2023-02-25 12:35:56,017][2409597] Sum rewards: 2.816, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.309', 'AMMO5': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'weapon4': '0.030', 'weapon5': '0.046', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'HITCOUNT': '0.200', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.735', 'weapon3': '1.570', 'weapon2': '1.850', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:56,031][2409389] DAMAGECOUNT value on done: 910.0
[2023-02-25 12:35:56,036][2409389] Sum rewards: -0.209, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.854', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.037', 'ARMOR': '0.056', 'weapon5': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.159', 'weapon4': '0.198', 'HITCOUNT': '0.480', 'WEAPON3': '1.000', 'weapon2': '1.010', 'DAMAGECOUNT': '1.800', 'weapon3': '1.870', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:56,099][2409105] DAMAGECOUNT value on done: 582.0
[2023-02-25 12:35:56,102][2409105] Sum rewards: 0.369, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.031', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.059', 'weapon7': '0.066', 'weapon5': '0.084', 'AMMO3': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.180', 'weapon4': '0.240', 'ARMOR': '0.509', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.816', 'FRAGCOUNT': '1.000', 'weapon2': '1.244', 'weapon3': '1.848'}
[2023-02-25 12:35:56,210][2409078] DAMAGECOUNT value on done: 672.0
[2023-02-25 12:35:56,214][2409078] Sum rewards: 0.655, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.426', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'AMMO4': '0.117', 'HITCOUNT': '0.280', 'ARMOR': '0.448', 'weapon4': '0.454', 'WEAPON3': '0.550', 'weapon3': '0.942', 'DAMAGECOUNT': '0.990', 'weapon2': '1.710', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:56,234][2409866] DAMAGECOUNT value on done: 565.0
[2023-02-25 12:35:56,235][2409866] Sum rewards: 4.025, reward structure: {'DEATHCOUNT': '-5.250', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'WEAPON3': '0.150', 'weapon4': '0.154', 'HITCOUNT': '0.170', 'HEALTH': '0.386', 'ARMOR': '0.585', 'DAMAGECOUNT': '0.615', 'weapon3': '1.090', 'weapon2': '1.780', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:35:56,343][2409099] DAMAGECOUNT value on done: 911.0
[2023-02-25 12:35:56,344][2409099] Sum rewards: 0.766, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.276', 'AMMO2': '0.017', 'ARMOR': '0.032', 'AMMO3': '0.071', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'HITCOUNT': '0.310', 'weapon4': '0.332', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.266', 'weapon2': '1.396', 'weapon3': '1.432', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:56,374][2409076] DAMAGECOUNT value on done: 545.0
[2023-02-25 12:35:56,657][2409355] DAMAGECOUNT value on done: 710.0
[2023-02-25 12:35:56,658][2409355] Sum rewards: 3.837, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.249', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.060', 'weapon7': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.290', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.299', 'weapon3': '1.344', 'weapon2': '1.632', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:56,707][2409097] DAMAGECOUNT value on done: 433.0
[2023-02-25 12:35:56,708][2409097] Sum rewards: -2.704, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.574', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'weapon5': '0.070', 'HITCOUNT': '0.100', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'weapon4': '0.284', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.474', 'weapon3': '1.730'}
[2023-02-25 12:35:56,745][2409074] Updated weights for policy 0, policy_version 6260 (0.0012)
[2023-02-25 12:35:56,848][2409468] DAMAGECOUNT value on done: 464.0
[2023-02-25 12:35:56,850][2409468] Sum rewards: -4.892, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.733', 'AMMO5': '0.021', 'AMMO2': '0.035', 'weapon5': '0.082', 'AMMO3': '0.165', 'AMMO4': '0.173', 'HITCOUNT': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.404', 'ARMOR': '0.436', 'DAMAGECOUNT': '0.660', 'WEAPON3': '0.900', 'weapon3': '1.450', 'weapon2': '1.554', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:57,170][2409469] DAMAGECOUNT value on done: 594.0
[2023-02-25 12:35:57,173][2409469] Sum rewards: 2.223, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.303', 'AMMO5': '0.009', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.038', 'ARMOR': '0.048', 'AMMO4': '0.087', 'AMMO3': '0.123', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.260', 'weapon4': '0.526', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.840', 'weapon2': '1.402', 'weapon3': '1.656', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:35:57,186][2408954] Fps is (10 sec: 26214.4, 60 sec: 25053.9, 300 sec: 25450.7). Total num frames: 25649152. Throughput: 0: 6225.4. Samples: 6411816. Policy #0 lag: (min: 0.0, avg: 11.6, max: 24.0)
[2023-02-25 12:35:57,186][2408954] Avg episode reward: [(0, '-0.828')]
[2023-02-25 12:35:57,191][2409033] Saving new best policy, reward=-0.828!
[2023-02-25 12:35:57,313][2409075] DAMAGECOUNT value on done: 398.0
[2023-02-25 12:35:57,317][2409075] Sum rewards: 0.956, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.044', 'AMMO2': '0.007', 'ARMOR': '0.016', 'AMMO4': '0.033', 'AMMO3': '0.088', 'HITCOUNT': '0.130', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon2': '1.494', 'weapon3': '1.782'}
[2023-02-25 12:35:57,996][2409096] DAMAGECOUNT value on done: 244.0
[2023-02-25 12:35:57,997][2409096] Sum rewards: -1.827, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.344', 'AMMO2': '0.007', 'weapon5': '0.016', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'HITCOUNT': '0.030', 'AMMO4': '0.037', 'DAMAGECOUNT': '0.045', 'WEAPON4': '0.050', 'AMMO3': '0.100', 'weapon4': '0.162', 'WEAPON5': '0.250', 'ARMOR': '0.458', 'WEAPON3': '0.600', 'weapon2': '1.420', 'weapon3': '1.554', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:58,058][2409405] DAMAGECOUNT value on done: 789.0
[2023-02-25 12:35:58,061][2409405] Sum rewards: 3.964, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.134', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.062', 'AMMO3': '0.070', 'weapon7': '0.070', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.280', 'WEAPON3': '0.450', 'ARMOR': '0.500', 'DAMAGECOUNT': '1.065', 'weapon2': '1.442', 'weapon3': '1.736', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:35:58,097][2409406] DAMAGECOUNT value on done: 943.0
[2023-02-25 12:35:58,097][2409406] Sum rewards: 3.016, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.045', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'ARMOR': '0.064', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'weapon5': '0.130', 'weapon4': '0.208', 'WEAPON4': '0.300', 'HITCOUNT': '0.410', 'WEAPON3': '0.700', 'weapon2': '1.262', 'weapon3': '1.766', 'DAMAGECOUNT': '1.881', 'FRAGCOUNT': '5.500'}
[2023-02-25 12:35:58,122][2409079] DAMAGECOUNT value on done: 787.0
[2023-02-25 12:35:58,125][2409079] Sum rewards: 0.903, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.250', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.057', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'HITCOUNT': '0.330', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.140', 'weapon3': '1.468', 'weapon2': '1.560', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:35:58,141][2409486] DAMAGECOUNT value on done: 1139.0
[2023-02-25 12:35:58,144][2409486] Sum rewards: -1.791, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.362', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'ARMOR': '0.008', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'weapon5': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'WEAPON5': '0.200', 'weapon4': '0.238', 'HITCOUNT': '0.290', 'DAMAGECOUNT': '0.741', 'WEAPON3': '0.750', 'weapon2': '1.210', 'FRAGCOUNT': '2.000', 'weapon3': '2.124'}
[2023-02-25 12:35:58,445][2409080] DAMAGECOUNT value on done: 487.0
[2023-02-25 12:35:58,450][2409080] Sum rewards: -0.130, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.356', 'AMMO2': '0.006', 'AMMO4': '0.030', 'ARMOR': '0.068', 'weapon7': '0.084', 'weapon4': '0.092', 'AMMO3': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.846', 'FRAGCOUNT': '1.000', 'weapon2': '1.306', 'weapon3': '1.996'}
[2023-02-25 12:35:58,538][2409373] DAMAGECOUNT value on done: 785.0
[2023-02-25 12:35:58,541][2409373] Sum rewards: 4.819, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'ARMOR': '0.072', 'weapon4': '0.074', 'AMMO4': '0.094', 'WEAPON5': '0.150', 'weapon5': '0.178', 'HITCOUNT': '0.320', 'WEAPON3': '0.400', 'HEALTH': '0.647', 'weapon2': '1.416', 'DAMAGECOUNT': '1.521', 'weapon3': '1.800', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:35:58,629][2409077] DAMAGECOUNT value on done: 554.0
[2023-02-25 12:35:58,655][2409074] Updated weights for policy 0, policy_version 6270 (0.0012)
[2023-02-25 12:35:58,794][2409407] DAMAGECOUNT value on done: 467.0
[2023-02-25 12:35:58,799][2409407] Sum rewards: -5.526, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.662', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.057', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.102', 'HITCOUNT': '0.120', 'weapon5': '0.136', 'DAMAGECOUNT': '0.396', 'ARMOR': '0.436', 'WEAPON3': '0.550', 'weapon3': '1.284', 'weapon2': '1.976'}
[2023-02-25 12:35:58,807][2409547] DAMAGECOUNT value on done: 430.0
[2023-02-25 12:35:58,811][2409547] Sum rewards: 0.976, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.228', 'AMMO2': '0.004', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.020', 'weapon5': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'HITCOUNT': '0.200', 'weapon4': '0.212', 'WEAPON3': '0.500', 'weapon2': '0.782', 'DAMAGECOUNT': '0.885', 'weapon3': '1.804', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:35:59,927][2409866] DAMAGECOUNT value on done: 577.0
[2023-02-25 12:35:59,929][2409866] Sum rewards: -3.220, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.447', 'AMMO2': '0.007', 'AMMO4': '0.036', 'AMMO3': '0.116', 'HITCOUNT': '0.200', 'ARMOR': '0.440', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.568', 'weapon2': '1.814'}
[2023-02-25 12:36:00,034][2409105] DAMAGECOUNT value on done: 525.0
[2023-02-25 12:36:00,126][2409099] DAMAGECOUNT value on done: 519.0
[2023-02-25 12:36:00,129][2409099] Sum rewards: -0.299, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.380', 'AMMO4': '-0.073', 'AMMO2': '-0.014', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'AMMO3': '0.102', 'HITCOUNT': '0.190', 'DAMAGECOUNT': '0.564', 'WEAPON3': '0.700', 'weapon2': '1.312', 'weapon3': '1.990', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:36:00,223][2409078] DAMAGECOUNT value on done: 230.0
[2023-02-25 12:36:00,226][2409078] Sum rewards: -4.710, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.446', 'AMMO2': '0.014', 'ARMOR': '0.016', 'AMMO4': '0.067', 'weapon4': '0.070', 'HITCOUNT': '0.090', 'AMMO3': '0.128', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.297', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.468', 'weapon3': '1.586'}
[2023-02-25 12:36:00,270][2409389] DAMAGECOUNT value on done: 865.0
[2023-02-25 12:36:00,274][2409389] Sum rewards: 0.919, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.720', 'AMMO5': '0.003', 'weapon4': '0.006', 'AMMO2': '0.017', 'AMMO4': '0.083', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'HITCOUNT': '0.310', 'WEAPON3': '0.600', 'ARMOR': '0.832', 'DAMAGECOUNT': '1.065', 'weapon3': '1.490', 'weapon2': '1.794', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:36:00,291][2409074] Updated weights for policy 0, policy_version 6280 (0.0012)
[2023-02-25 12:36:00,367][2409355] DAMAGECOUNT value on done: 706.0
[2023-02-25 12:36:00,579][2409076] DAMAGECOUNT value on done: 156.0
[2023-02-25 12:36:00,580][2409076] Sum rewards: -4.778, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.525', 'FRAGCOUNT': '-1.500', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO5': '0.011', 'WEAPON1': '0.050', 'HITCOUNT': '0.070', 'weapon5': '0.074', 'AMMO3': '0.117', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.252', 'ARMOR': '0.453', 'WEAPON3': '0.700', 'weapon2': '1.498', 'weapon3': '1.562'}
[2023-02-25 12:36:00,625][2409468] DAMAGECOUNT value on done: 574.0
[2023-02-25 12:36:00,627][2409468] Sum rewards: -0.275, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.178', 'AMMO2': '0.006', 'AMMO4': '0.031', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'HITCOUNT': '0.270', 'weapon4': '0.384', 'ARMOR': '0.452', 'weapon2': '0.666', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.032', 'weapon3': '2.184', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:36:01,167][2409469] DAMAGECOUNT value on done: 685.0
[2023-02-25 12:36:01,170][2409469] Sum rewards: -0.413, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.238', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.028', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'weapon4': '0.384', 'ARMOR': '0.512', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.765', 'weapon2': '1.202', 'weapon3': '1.770', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:36:01,229][2409097] DAMAGECOUNT value on done: 622.0
[2023-02-25 12:36:01,234][2409097] Sum rewards: 2.856, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.027', 'ARMOR': '0.040', 'AMMO3': '0.055', 'weapon7': '0.060', 'HEALTH': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.118', 'AMMO4': '0.135', 'HITCOUNT': '0.190', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.810', 'weapon3': '1.016', 'weapon2': '1.314', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:36:01,673][2409075] DAMAGECOUNT value on done: 576.0
[2023-02-25 12:36:01,855][2409079] DAMAGECOUNT value on done: 484.0
[2023-02-25 12:36:01,856][2409079] Sum rewards: -2.677, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.686', 'AMMO2': '0.007', 'AMMO5': '0.009', 'ARMOR': '0.024', 'AMMO4': '0.033', 'weapon5': '0.060', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'HITCOUNT': '0.180', 'weapon4': '0.346', 'DAMAGECOUNT': '0.606', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.176', 'weapon3': '1.862'}
[2023-02-25 12:36:01,978][2409486] DAMAGECOUNT value on done: 810.0
[2023-02-25 12:36:01,978][2409486] Sum rewards: 4.177, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.630', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.003', 'WEAPON1': '0.020', 'weapon5': '0.030', 'ARMOR': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.088', 'WEAPON4': '0.200', 'weapon4': '0.302', 'HITCOUNT': '0.490', 'WEAPON3': '0.700', 'weapon2': '1.246', 'DAMAGECOUNT': '1.740', 'weapon3': '1.886', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:36:02,013][2409074] Updated weights for policy 0, policy_version 6290 (0.0012)
[2023-02-25 12:36:02,032][2409096] DAMAGECOUNT value on done: 935.0
[2023-02-25 12:36:02,035][2409096] Sum rewards: 0.162, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.801', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon4': '0.032', 'weapon5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.132', 'HITCOUNT': '0.240', 'WEAPON5': '0.350', 'ARMOR': '0.800', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.080', 'weapon2': '1.484', 'weapon3': '1.628', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:36:02,186][2408954] Fps is (10 sec: 25394.9, 60 sec: 24780.7, 300 sec: 25353.5). Total num frames: 25763840. Throughput: 0: 6233.3. Samples: 6449352. Policy #0 lag: (min: 1.0, avg: 15.7, max: 28.0)
[2023-02-25 12:36:02,187][2408954] Avg episode reward: [(0, '-0.835')]
[2023-02-25 12:36:02,262][2409080] DAMAGECOUNT value on done: 338.0
[2023-02-25 12:36:02,265][2409080] Sum rewards: -1.133, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.664', 'AMMO5': '0.003', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO4': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.076', 'ARMOR': '0.116', 'AMMO3': '0.127', 'HITCOUNT': '0.130', 'WEAPON4': '0.300', 'weapon4': '0.316', 'DAMAGECOUNT': '0.477', 'WEAPON3': '0.700', 'weapon3': '1.288', 'weapon2': '1.666', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:36:03,036][2409407] DAMAGECOUNT value on done: 835.0
[2023-02-25 12:36:03,040][2409407] Sum rewards: 3.835, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.006', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'weapon5': '0.050', 'AMMO3': '0.088', 'HEALTH': '0.090', 'WEAPON5': '0.150', 'weapon4': '0.190', 'HITCOUNT': '0.340', 'ARMOR': '0.499', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.290', 'weapon3': '1.306', 'weapon2': '1.976', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:36:03,104][2409547] DAMAGECOUNT value on done: 654.0
[2023-02-25 12:36:03,107][2409547] Sum rewards: -4.261, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.502', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.003', 'weapon5': '0.008', 'WEAPON1': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.096', 'AMMO4': '0.140', 'HITCOUNT': '0.170', 'WEAPON4': '0.250', 'weapon4': '0.426', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.650', 'weapon3': '1.474', 'weapon2': '1.686'}
[2023-02-25 12:36:03,665][2409074] Updated weights for policy 0, policy_version 6300 (0.0013)
[2023-02-25 12:36:03,737][2409866] DAMAGECOUNT value on done: 427.0
[2023-02-25 12:36:04,106][2409076] DAMAGECOUNT value on done: 707.0
[2023-02-25 12:36:04,106][2409076] Sum rewards: -0.301, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.966', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.033', 'ARMOR': '0.072', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'weapon4': '0.266', 'HITCOUNT': '0.350', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.095', 'weapon2': '1.498', 'weapon3': '1.686', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:36:04,172][2409355] DAMAGECOUNT value on done: 610.0
[2023-02-25 12:36:04,175][2409355] Sum rewards: -2.996, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.858', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.018', 'AMMO4': '0.061', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'HITCOUNT': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.444', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.639', 'weapon3': '0.928', 'FRAGCOUNT': '1.000', 'weapon2': '1.836'}
[2023-02-25 12:36:04,202][2409099] DAMAGECOUNT value on done: 563.0
[2023-02-25 12:36:04,203][2409099] Sum rewards: 0.370, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.636', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'WEAPON1': '0.020', 'AMMO3': '0.052', 'ARMOR': '0.057', 'weapon7': '0.068', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.126', 'HITCOUNT': '0.140', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.450', 'weapon3': '1.210', 'FRAGCOUNT': '2.000', 'weapon2': '2.022'}
[2023-02-25 12:36:04,588][2409468] DAMAGECOUNT value on done: 769.0
[2023-02-25 12:36:04,589][2409468] Sum rewards: 2.081, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.410', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'AMMO3': '0.145', 'weapon4': '0.268', 'HITCOUNT': '0.440', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.515', 'weapon2': '1.586', 'weapon3': '1.682', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:36:04,912][2409078] DAMAGECOUNT value on done: 788.0
[2023-02-25 12:36:04,913][2409078] Sum rewards: -1.270, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.770', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.028', 'AMMO3': '0.092', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.280', 'weapon4': '0.452', 'FRAGCOUNT': '0.500', 'weapon2': '0.622', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.140', 'weapon3': '2.024'}
[2023-02-25 12:36:05,106][2409074] Updated weights for policy 0, policy_version 6310 (0.0012)
[2023-02-25 12:36:05,214][2409075] DAMAGECOUNT value on done: 821.0
[2023-02-25 12:36:05,215][2409075] Sum rewards: -1.201, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.076', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.040', 'WEAPON5': '0.050', 'ARMOR': '0.059', 'AMMO3': '0.065', 'AMMO4': '0.148', 'weapon4': '0.212', 'HITCOUNT': '0.260', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '1.083', 'weapon3': '1.300', 'weapon2': '2.026'}
[2023-02-25 12:36:05,240][2409097] DAMAGECOUNT value on done: 424.0
[2023-02-25 12:36:05,241][2409097] Sum rewards: 3.369, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.680', 'AMMO5': '0.009', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.054', 'weapon5': '0.060', 'AMMO3': '0.068', 'WEAPON5': '0.100', 'weapon4': '0.202', 'WEAPON4': '0.250', 'HITCOUNT': '0.350', 'ARMOR': '0.470', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.005', 'weapon3': '1.524', 'weapon2': '1.676', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:36:05,699][2409096] DAMAGECOUNT value on done: 506.0
[2023-02-25 12:36:05,700][2409096] Sum rewards: -0.557, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.470', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.081', 'weapon5': '0.082', 'AMMO4': '0.142', 'HITCOUNT': '0.190', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.543', 'weapon4': '0.652', 'weapon3': '1.248', 'weapon2': '1.590', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:36:05,975][2409486] DAMAGECOUNT value on done: 892.0
[2023-02-25 12:36:05,979][2409486] Sum rewards: -1.816, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.853', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon4': '0.044', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'HITCOUNT': '0.290', 'WEAPON3': '0.450', 'ARMOR': '0.855', 'DAMAGECOUNT': '0.990', 'FRAGCOUNT': '1.000', 'weapon3': '1.028', 'weapon2': '1.914'}
[2023-02-25 12:36:06,342][2409080] DAMAGECOUNT value on done: 699.0
[2023-02-25 12:36:06,343][2409080] Sum rewards: 3.379, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.160', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.030', 'AMMO4': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'weapon4': '0.242', 'HITCOUNT': '0.380', 'ARMOR': '0.468', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.167', 'weapon3': '1.504', 'weapon2': '1.692', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:36:06,861][2409079] DAMAGECOUNT value on done: 532.0
[2023-02-25 12:36:06,863][2409079] Sum rewards: 0.820, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.015', 'ARMOR': '0.032', 'weapon7': '0.064', 'AMMO4': '0.073', 'AMMO3': '0.079', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.318', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.465', 'HEALTH': '0.512', 'FRAGCOUNT': '1.000', 'weapon3': '1.514', 'weapon2': '1.598'}
[2023-02-25 12:36:06,873][2409547] DAMAGECOUNT value on done: 450.0
[2023-02-25 12:36:06,874][2409547] Sum rewards: -1.495, reward structure: {'DEATHCOUNT': '-4.500', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.010', 'AMMO2': '0.018', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'HITCOUNT': '0.160', 'WEAPON3': '0.250', 'weapon4': '0.286', 'HEALTH': '0.290', 'DAMAGECOUNT': '0.423', 'weapon3': '0.754', 'weapon2': '1.966'}
[2023-02-25 12:36:06,987][2409074] Updated weights for policy 0, policy_version 6320 (0.0012)
[2023-02-25 12:36:07,186][2408954] Fps is (10 sec: 24165.8, 60 sec: 24780.7, 300 sec: 25409.1). Total num frames: 25890816. Throughput: 0: 6238.6. Samples: 6467928. Policy #0 lag: (min: 0.0, avg: 11.8, max: 27.0)
[2023-02-25 12:36:07,187][2408954] Avg episode reward: [(0, '-0.692')]
[2023-02-25 12:36:07,192][2409033] Saving new best policy, reward=-0.692!
[2023-02-25 12:36:07,976][2409099] DAMAGECOUNT value on done: 625.0
[2023-02-25 12:36:07,977][2409099] Sum rewards: -1.286, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.425', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.014', 'weapon5': '0.052', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'HITCOUNT': '0.350', 'weapon4': '0.416', 'ARMOR': '0.452', 'WEAPON3': '1.100', 'weapon2': '1.136', 'DAMAGECOUNT': '1.365', 'weapon3': '1.692', 'FRAGCOUNT': '4.500'}
[2023-02-25 12:36:08,305][2409074] Updated weights for policy 0, policy_version 6330 (0.0012)
[2023-02-25 12:36:08,670][2409468] DAMAGECOUNT value on done: 617.0
[2023-02-25 12:36:08,673][2409468] Sum rewards: -1.625, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.486', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.015', 'weapon5': '0.036', 'WEAPON4': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.108', 'WEAPON5': '0.150', 'weapon4': '0.214', 'HITCOUNT': '0.310', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.915', 'weapon2': '1.230', 'weapon3': '1.634'}
[2023-02-25 12:36:09,024][2409097] DAMAGECOUNT value on done: 486.0
[2023-02-25 12:36:09,599][2409486] DAMAGECOUNT value on done: 936.0
[2023-02-25 12:36:09,602][2409486] Sum rewards: -0.865, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.247', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.135', 'weapon4': '0.186', 'HITCOUNT': '0.370', 'ARMOR': '0.508', 'WEAPON3': '0.750', 'weapon2': '1.186', 'DAMAGECOUNT': '1.740', 'weapon3': '2.104', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:36:10,055][2409074] Updated weights for policy 0, policy_version 6340 (0.0012)
[2023-02-25 12:36:10,302][2409080] DAMAGECOUNT value on done: 567.0
[2023-02-25 12:36:10,303][2409080] Sum rewards: 2.981, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.990', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.005', 'AMMO3': '0.060', 'weapon7': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.254', 'HITCOUNT': '0.280', 'WEAPON3': '0.350', 'weapon3': '1.008', 'DAMAGECOUNT': '1.026', 'weapon2': '1.768', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:36:11,438][2409547] DAMAGECOUNT value on done: 381.0
[2023-02-25 12:36:11,441][2409547] Sum rewards: -5.567, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.648', 'AMMO2': '0.002', 'AMMO4': '0.009', 'WEAPON1': '0.020', 'AMMO3': '0.156', 'HITCOUNT': '0.210', 'DAMAGECOUNT': '0.666', 'FRAGCOUNT': '1.000', 'weapon2': '1.102', 'WEAPON3': '1.150', 'weapon3': '2.516'}
[2023-02-25 12:36:11,488][2409079] DAMAGECOUNT value on done: 625.0
[2023-02-25 12:36:11,489][2409079] Sum rewards: -0.508, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.342', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO3': '0.067', 'HITCOUNT': '0.270', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.840', 'weapon3': '1.240', 'FRAGCOUNT': '2.000', 'weapon2': '2.346'}
[2023-02-25 12:36:11,661][2409099] DAMAGECOUNT value on done: 460.0
[2023-02-25 12:36:11,664][2409099] Sum rewards: -2.762, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.636', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.083', 'AMMO3': '0.093', 'HITCOUNT': '0.130', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.450', 'ARMOR': '0.477', 'weapon4': '0.570', 'weapon3': '1.154', 'FRAGCOUNT': '1.500', 'weapon2': '1.670'}
[2023-02-25 12:36:11,733][2409074] Updated weights for policy 0, policy_version 6350 (0.0012)
[2023-02-25 12:36:12,186][2408954] Fps is (10 sec: 26214.0, 60 sec: 24985.6, 300 sec: 25409.1). Total num frames: 26025984. Throughput: 0: 6245.8. Samples: 6505428. Policy #0 lag: (min: 0.0, avg: 11.8, max: 27.0)
[2023-02-25 12:36:12,186][2408954] Avg episode reward: [(0, '-0.730')]
[2023-02-25 12:36:12,540][2409468] DAMAGECOUNT value on done: 618.0
[2023-02-25 12:36:13,490][2409074] Updated weights for policy 0, policy_version 6360 (0.0012)
[2023-02-25 12:36:13,743][2409097] DAMAGECOUNT value on done: 552.0
[2023-02-25 12:36:13,746][2409097] Sum rewards: 2.618, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.460', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.005', 'ARMOR': '0.028', 'AMMO3': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.204', 'HITCOUNT': '0.210', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.555', 'weapon3': '0.988', 'weapon2': '1.294', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:36:14,267][2409080] DAMAGECOUNT value on done: 848.0
[2023-02-25 12:36:14,271][2409080] Sum rewards: 1.619, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.981', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'weapon7': '0.054', 'AMMO4': '0.059', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.284', 'HITCOUNT': '0.340', 'ARMOR': '0.440', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.005', 'weapon3': '1.576', 'weapon2': '1.602', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:36:15,367][2409074] Updated weights for policy 0, policy_version 6370 (0.0012)
[2023-02-25 12:36:15,547][2409099] DAMAGECOUNT value on done: 814.0
[2023-02-25 12:36:15,548][2409099] Sum rewards: 1.472, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.424', 'AMMO5': '0.005', 'AMMO2': '0.029', 'ARMOR': '0.048', 'AMMO3': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'HITCOUNT': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'weapon4': '0.522', 'weapon3': '1.066', 'DAMAGECOUNT': '1.161', 'weapon2': '1.168', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:36:16,224][2409547] DAMAGECOUNT value on done: 583.0
[2023-02-25 12:36:16,225][2409547] Sum rewards: 2.282, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.482', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.004', 'WEAPON1': '0.030', 'AMMO3': '0.040', 'WEAPON4': '0.050', 'weapon5': '0.088', 'WEAPON5': '0.100', 'weapon4': '0.128', 'HITCOUNT': '0.250', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.885', 'weapon3': '1.112', 'weapon2': '1.538', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:36:16,314][2409079] DAMAGECOUNT value on done: 242.0
[2023-02-25 12:36:16,457][2409468] DAMAGECOUNT value on done: 223.0
[2023-02-25 12:36:16,805][2409074] Updated weights for policy 0, policy_version 6380 (0.0012)
[2023-02-25 12:36:17,186][2408954] Fps is (10 sec: 24985.1, 60 sec: 24985.5, 300 sec: 25339.6). Total num frames: 26140672. Throughput: 0: 6289.0. Samples: 6541992. Policy #0 lag: (min: 0.0, avg: 11.6, max: 24.0)
[2023-02-25 12:36:17,187][2408954] Avg episode reward: [(0, '-0.666')]
[2023-02-25 12:36:17,192][2409033] Saving /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000006382_26140672.pth...
[2023-02-25 12:36:17,294][2409033] Removing /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000004899_20066304.pth
[2023-02-25 12:36:17,312][2409033] Saving new best policy, reward=-0.666!
[2023-02-25 12:36:18,019][2409080] DAMAGECOUNT value on done: 772.0
[2023-02-25 12:36:18,020][2409080] Sum rewards: -2.030, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.506', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.068', 'AMMO3': '0.071', 'AMMO4': '0.081', 'WEAPON5': '0.100', 'HITCOUNT': '0.140', 'DAMAGECOUNT': '0.321', 'WEAPON3': '0.350', 'WEAPON4': '0.350', 'ARMOR': '0.491', 'weapon4': '0.584', 'weapon3': '0.710', 'FRAGCOUNT': '1.000', 'weapon2': '1.188'}
[2023-02-25 12:36:18,596][2409033] Signal inference workers to stop experience collection... (850 times)
[2023-02-25 12:36:18,614][2409033] Signal inference workers to resume experience collection... (850 times)
[2023-02-25 12:36:18,631][2409074] InferenceWorker_p0-w0: stopping experience collection (850 times)
[2023-02-25 12:36:18,633][2409074] InferenceWorker_p0-w0: resuming experience collection (850 times)
[2023-02-25 12:36:18,669][2409074] Updated weights for policy 0, policy_version 6390 (0.0012)
[2023-02-25 12:36:19,623][2409099] DAMAGECOUNT value on done: 670.0
[2023-02-25 12:36:19,626][2409099] Sum rewards: -0.903, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.722', 'AMMO2': '0.022', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'AMMO4': '0.110', 'HITCOUNT': '0.260', 'weapon4': '0.306', 'ARMOR': '0.498', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.810', 'FRAGCOUNT': '1.000', 'weapon3': '1.686', 'weapon2': '1.720'}
[2023-02-25 12:36:19,903][2409547] DAMAGECOUNT value on done: 641.0
[2023-02-25 12:36:19,904][2409547] Sum rewards: -5.081, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.925', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.106', 'weapon4': '0.180', 'HITCOUNT': '0.190', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.588', 'WEAPON3': '0.750', 'ARMOR': '0.906', 'FRAGCOUNT': '1.000', 'weapon3': '1.394', 'weapon2': '2.050'}
[2023-02-25 12:36:20,303][2409074] Updated weights for policy 0, policy_version 6400 (0.0012)
[2023-02-25 12:36:20,432][2409468] DAMAGECOUNT value on done: 636.0
[2023-02-25 12:36:20,439][2409468] Sum rewards: -2.823, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.724', 'AMMO5': '0.007', 'AMMO2': '0.023', 'ARMOR': '0.080', 'weapon5': '0.082', 'AMMO3': '0.105', 'HITCOUNT': '0.110', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.444', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.258', 'weapon2': '1.426'}
[2023-02-25 12:36:21,932][2409080] DAMAGECOUNT value on done: 947.0
[2023-02-25 12:36:21,935][2409080] Sum rewards: -0.521, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.236', 'AMMO2': '0.001', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.003', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.121', 'HITCOUNT': '0.230', 'ARMOR': '0.454', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.110', 'weapon3': '1.574', 'weapon2': '1.698', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:36:22,145][2409074] Updated weights for policy 0, policy_version 6410 (0.0012)
[2023-02-25 12:36:22,186][2408954] Fps is (10 sec: 22938.2, 60 sec: 24849.1, 300 sec: 25311.9). Total num frames: 26255360. Throughput: 0: 6271.5. Samples: 6560436. Policy #0 lag: (min: 0.0, avg: 12.9, max: 26.0)
[2023-02-25 12:36:22,187][2408954] Avg episode reward: [(0, '-0.657')]
[2023-02-25 12:36:22,205][2409033] Saving new best policy, reward=-0.657!
[2023-02-25 12:36:23,473][2409074] Updated weights for policy 0, policy_version 6420 (0.0013)
[2023-02-25 12:36:24,106][2409547] DAMAGECOUNT value on done: 779.0
[2023-02-25 12:36:24,108][2409547] Sum rewards: 3.869, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.598', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'ARMOR': '0.064', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.350', 'HITCOUNT': '0.360', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.173', 'weapon2': '1.232', 'weapon3': '1.514', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:36:24,444][2409468] DAMAGECOUNT value on done: 720.0
[2023-02-25 12:36:24,445][2409468] Sum rewards: -0.448, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.076', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'AMMO4': '0.061', 'weapon4': '0.100', 'AMMO3': '0.102', 'WEAPON4': '0.150', 'HITCOUNT': '0.350', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.185', 'weapon2': '1.404', 'weapon3': '1.754', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:36:25,232][2409074] Updated weights for policy 0, policy_version 6430 (0.0013)
[2023-02-25 12:36:25,883][2409080] DAMAGECOUNT value on done: 742.0
[2023-02-25 12:36:25,886][2409080] Sum rewards: 0.740, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'ARMOR': '0.068', 'AMMO3': '0.074', 'weapon5': '0.076', 'WEAPON4': '0.100', 'AMMO4': '0.125', 'HITCOUNT': '0.150', 'WEAPON3': '0.450', 'weapon4': '0.450', 'DAMAGECOUNT': '0.495', 'HEALTH': '0.546', 'FRAGCOUNT': '1.000', 'weapon2': '1.062', 'weapon3': '1.316'}
[2023-02-25 12:36:26,778][2409074] Updated weights for policy 0, policy_version 6440 (0.0013)
[2023-02-25 12:36:27,186][2408954] Fps is (10 sec: 24576.3, 60 sec: 24917.2, 300 sec: 25325.7). Total num frames: 26386432. Throughput: 0: 6266.4. Samples: 6597624. Policy #0 lag: (min: 0.0, avg: 13.3, max: 25.0)
[2023-02-25 12:36:27,187][2408954] Avg episode reward: [(0, '-0.568')]
[2023-02-25 12:36:27,192][2409033] Saving new best policy, reward=-0.568!
[2023-02-25 12:36:27,747][2409547] DAMAGECOUNT value on done: 478.0
[2023-02-25 12:36:28,274][2409074] Updated weights for policy 0, policy_version 6450 (0.0012)
[2023-02-25 12:36:28,899][2409468] DAMAGECOUNT value on done: 476.0
[2023-02-25 12:36:28,902][2409468] Sum rewards: 0.868, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.718', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'WEAPON1': '0.020', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'weapon4': '0.140', 'HITCOUNT': '0.250', 'ARMOR': '0.489', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.921', 'weapon3': '1.468', 'weapon2': '2.030', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:36:30,132][2409074] Updated weights for policy 0, policy_version 6460 (0.0012)
[2023-02-25 12:36:30,992][2409080] DAMAGECOUNT value on done: 519.0
[2023-02-25 12:36:31,320][2409565] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)]
[2023-02-25 12:36:31,579][2409074] Updated weights for policy 0, policy_version 6470 (0.0013)
[2023-02-25 12:36:31,675][2409547] DAMAGECOUNT value on done: 676.0
[2023-02-25 12:36:31,679][2409547] Sum rewards: 5.392, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.576', 'AMMO2': '0.010', 'AMMO4': '0.052', 'AMMO3': '0.079', 'ARMOR': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.380', 'weapon4': '0.430', 'WEAPON3': '0.450', 'weapon2': '1.236', 'DAMAGECOUNT': '1.377', 'weapon3': '1.454', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:36:32,186][2408954] Fps is (10 sec: 25804.5, 60 sec: 25190.4, 300 sec: 25284.1). Total num frames: 26513408. Throughput: 0: 6249.9. Samples: 6635016. Policy #0 lag: (min: 0.0, avg: 13.4, max: 30.0)
[2023-02-25 12:36:32,186][2408954] Avg episode reward: [(0, '-0.480')]
[2023-02-25 12:36:32,187][2409033] Saving new best policy, reward=-0.480!
[2023-02-25 12:36:33,218][2409468] DAMAGECOUNT value on done: 492.0
[2023-02-25 12:36:33,472][2409074] Updated weights for policy 0, policy_version 6480 (0.0012)
[2023-02-25 12:36:34,944][2409074] Updated weights for policy 0, policy_version 6490 (0.0012)
[2023-02-25 12:36:36,715][2409074] Updated weights for policy 0, policy_version 6500 (0.0012)
[2023-02-25 12:36:36,957][2409468] DAMAGECOUNT value on done: 456.0
[2023-02-25 12:36:36,960][2409468] Sum rewards: 1.920, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.025', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.017', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.069', 'HITCOUNT': '0.190', 'WEAPON4': '0.300', 'weapon4': '0.406', 'ARMOR': '0.480', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.702', 'weapon3': '1.152', 'weapon2': '1.222', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:36:37,186][2408954] Fps is (10 sec: 25395.5, 60 sec: 25122.1, 300 sec: 25284.1). Total num frames: 26640384. Throughput: 0: 6246.1. Samples: 6653892. Policy #0 lag: (min: 0.0, avg: 13.3, max: 27.0)
[2023-02-25 12:36:37,187][2408954] Avg episode reward: [(0, '-0.432')]
[2023-02-25 12:36:37,193][2409033] Saving new best policy, reward=-0.432!
[2023-02-25 12:36:38,284][2409074] Updated weights for policy 0, policy_version 6510 (0.0012)
[2023-02-25 12:36:39,936][2409074] Updated weights for policy 0, policy_version 6520 (0.0012)
[2023-02-25 12:36:41,581][2409074] Updated weights for policy 0, policy_version 6530 (0.0012)
[2023-02-25 12:36:42,186][2408954] Fps is (10 sec: 24166.8, 60 sec: 24917.5, 300 sec: 25270.2). Total num frames: 26755072. Throughput: 0: 6213.1. Samples: 6691404. Policy #0 lag: (min: 0.0, avg: 13.3, max: 27.0)
[2023-02-25 12:36:42,186][2408954] Avg episode reward: [(0, '-0.432')]
[2023-02-25 12:36:43,247][2409074] Updated weights for policy 0, policy_version 6540 (0.0012)
[2023-02-25 12:36:44,696][2409074] Updated weights for policy 0, policy_version 6550 (0.0012)
[2023-02-25 12:36:46,800][2409074] Updated weights for policy 0, policy_version 6560 (0.0012)
[2023-02-25 12:36:47,187][2408954] Fps is (10 sec: 24164.4, 60 sec: 24916.9, 300 sec: 25270.2). Total num frames: 26882048. Throughput: 0: 6203.6. Samples: 6728520. Policy #0 lag: (min: 0.0, avg: 10.8, max: 23.0)
[2023-02-25 12:36:47,187][2408954] Avg episode reward: [(0, '-0.432')]
[2023-02-25 12:36:48,240][2409074] Updated weights for policy 0, policy_version 6570 (0.0012)
[2023-02-25 12:36:49,774][2409074] Updated weights for policy 0, policy_version 6580 (0.0013)
[2023-02-25 12:36:51,524][2409074] Updated weights for policy 0, policy_version 6590 (0.0012)
[2023-02-25 12:36:52,186][2408954] Fps is (10 sec: 25804.7, 60 sec: 25053.9, 300 sec: 25242.5). Total num frames: 27013120. Throughput: 0: 6207.8. Samples: 6747276. Policy #0 lag: (min: 1.0, avg: 11.1, max: 25.0)
[2023-02-25 12:36:52,186][2408954] Avg episode reward: [(0, '-0.432')]
[2023-02-25 12:36:52,932][2409074] Updated weights for policy 0, policy_version 6600 (0.0013)
[2023-02-25 12:36:54,779][2409074] Updated weights for policy 0, policy_version 6610 (0.0013)
[2023-02-25 12:36:56,442][2409074] Updated weights for policy 0, policy_version 6620 (0.0012)
[2023-02-25 12:36:57,186][2408954] Fps is (10 sec: 25397.7, 60 sec: 24780.8, 300 sec: 25270.2). Total num frames: 27136000. Throughput: 0: 6209.6. Samples: 6784860. Policy #0 lag: (min: 0.0, avg: 13.5, max: 28.0)
[2023-02-25 12:36:57,186][2408954] Avg episode reward: [(0, '-0.432')]
[2023-02-25 12:36:57,745][2409074] Updated weights for policy 0, policy_version 6630 (0.0012)
[2023-02-25 12:36:59,778][2409074] Updated weights for policy 0, policy_version 6640 (0.0012)
[2023-02-25 12:37:01,165][2409074] Updated weights for policy 0, policy_version 6650 (0.0012)
[2023-02-25 12:37:02,186][2408954] Fps is (10 sec: 24575.9, 60 sec: 24917.4, 300 sec: 25242.5). Total num frames: 27258880. Throughput: 0: 6221.7. Samples: 6821964. Policy #0 lag: (min: 0.0, avg: 10.4, max: 24.0)
[2023-02-25 12:37:02,186][2408954] Avg episode reward: [(0, '-0.432')]
[2023-02-25 12:37:03,211][2409074] Updated weights for policy 0, policy_version 6660 (0.0012)
[2023-02-25 12:37:04,710][2409074] Updated weights for policy 0, policy_version 6670 (0.0012)
[2023-02-25 12:37:06,678][2409074] Updated weights for policy 0, policy_version 6680 (0.0012)
[2023-02-25 12:37:07,186][2408954] Fps is (10 sec: 23347.3, 60 sec: 24644.4, 300 sec: 25131.4). Total num frames: 27369472. Throughput: 0: 6205.3. Samples: 6839676. Policy #0 lag: (min: 0.0, avg: 13.9, max: 24.0)
[2023-02-25 12:37:07,186][2408954] Avg episode reward: [(0, '-0.432')]
[2023-02-25 12:37:08,574][2409074] Updated weights for policy 0, policy_version 6690 (0.0012)
[2023-02-25 12:37:09,950][2409074] Updated weights for policy 0, policy_version 6700 (0.0014)
[2023-02-25 12:37:11,754][2409074] Updated weights for policy 0, policy_version 6710 (0.0012)
[2023-02-25 12:37:12,186][2408954] Fps is (10 sec: 23756.9, 60 sec: 24507.8, 300 sec: 25186.9). Total num frames: 27496448. Throughput: 0: 6154.4. Samples: 6874572. Policy #0 lag: (min: 0.0, avg: 13.9, max: 24.0)
[2023-02-25 12:37:12,186][2408954] Avg episode reward: [(0, '-0.432')]
[2023-02-25 12:37:13,103][2409074] Updated weights for policy 0, policy_version 6720 (0.0014)
[2023-02-25 12:37:15,158][2409074] Updated weights for policy 0, policy_version 6730 (0.0012)
[2023-02-25 12:37:16,635][2409074] Updated weights for policy 0, policy_version 6740 (0.0014)
[2023-02-25 12:37:17,186][2408954] Fps is (10 sec: 24166.2, 60 sec: 24507.9, 300 sec: 25131.4). Total num frames: 27611136. Throughput: 0: 6142.4. Samples: 6911424. Policy #0 lag: (min: 0.0, avg: 11.9, max: 25.0)
[2023-02-25 12:37:17,186][2408954] Avg episode reward: [(0, '-0.432')]
[2023-02-25 12:37:18,260][2409074] Updated weights for policy 0, policy_version 6750 (0.0012)
[2023-02-25 12:37:19,967][2409074] Updated weights for policy 0, policy_version 6760 (0.0013)
[2023-02-25 12:37:21,997][2409074] Updated weights for policy 0, policy_version 6770 (0.0012)
[2023-02-25 12:37:22,186][2408954] Fps is (10 sec: 24165.9, 60 sec: 24712.4, 300 sec: 25048.1). Total num frames: 27738112. Throughput: 0: 6118.4. Samples: 6929220. Policy #0 lag: (min: 0.0, avg: 12.3, max: 25.0)
[2023-02-25 12:37:22,186][2408954] Avg episode reward: [(0, '-0.432')]
[2023-02-25 12:37:23,345][2409074] Updated weights for policy 0, policy_version 6780 (0.0012)
[2023-02-25 12:37:25,340][2409074] Updated weights for policy 0, policy_version 6790 (0.0012)
[2023-02-25 12:37:26,838][2409074] Updated weights for policy 0, policy_version 6800 (0.0012)
[2023-02-25 12:37:27,186][2408954] Fps is (10 sec: 24985.8, 60 sec: 24576.1, 300 sec: 25089.7). Total num frames: 27860992. Throughput: 0: 6100.3. Samples: 6965916. Policy #0 lag: (min: 0.0, avg: 12.7, max: 26.0)
[2023-02-25 12:37:27,186][2408954] Avg episode reward: [(0, '-0.432')]
[2023-02-25 12:37:28,348][2409074] Updated weights for policy 0, policy_version 6810 (0.0013)
[2023-02-25 12:37:30,296][2409074] Updated weights for policy 0, policy_version 6820 (0.0012)
[2023-02-25 12:37:31,891][2409074] Updated weights for policy 0, policy_version 6830 (0.0012)
[2023-02-25 12:37:32,186][2408954] Fps is (10 sec: 24166.7, 60 sec: 24439.5, 300 sec: 25062.0). Total num frames: 27979776. Throughput: 0: 6090.3. Samples: 7002576. Policy #0 lag: (min: 0.0, avg: 10.3, max: 24.0)
[2023-02-25 12:37:32,186][2408954] Avg episode reward: [(0, '-0.432')]
[2023-02-25 12:37:33,249][2409074] Updated weights for policy 0, policy_version 6840 (0.0012)
[2023-02-25 12:37:35,009][2409074] Updated weights for policy 0, policy_version 6850 (0.0012)
[2023-02-25 12:37:37,044][2409074] Updated weights for policy 0, policy_version 6860 (0.0012)
[2023-02-25 12:37:37,186][2408954] Fps is (10 sec: 24166.3, 60 sec: 24371.2, 300 sec: 24992.5). Total num frames: 28102656. Throughput: 0: 6094.9. Samples: 7021548. Policy #0 lag: (min: 0.0, avg: 12.5, max: 24.0)
[2023-02-25 12:37:37,186][2408954] Avg episode reward: [(0, '-0.432')]
[2023-02-25 12:37:38,208][2409074] Updated weights for policy 0, policy_version 6870 (0.0012)
[2023-02-25 12:37:40,013][2409033] Signal inference workers to stop experience collection... (900 times)
[2023-02-25 12:37:40,016][2409033] Signal inference workers to resume experience collection... (900 times)
[2023-02-25 12:37:40,049][2409074] InferenceWorker_p0-w0: stopping experience collection (900 times)
[2023-02-25 12:37:40,050][2409074] InferenceWorker_p0-w0: resuming experience collection (900 times)
[2023-02-25 12:37:40,129][2409074] Updated weights for policy 0, policy_version 6880 (0.0012)
[2023-02-25 12:37:41,814][2409074] Updated weights for policy 0, policy_version 6890 (0.0012)
[2023-02-25 12:37:42,186][2408954] Fps is (10 sec: 24576.1, 60 sec: 24507.7, 300 sec: 24992.6). Total num frames: 28225536. Throughput: 0: 6077.1. Samples: 7058328. Policy #0 lag: (min: 0.0, avg: 12.5, max: 24.0)
[2023-02-25 12:37:42,186][2408954] Avg episode reward: [(0, '-0.432')]
[2023-02-25 12:37:43,793][2409074] Updated weights for policy 0, policy_version 6900 (0.0012)
[2023-02-25 12:37:45,181][2409074] Updated weights for policy 0, policy_version 6910 (0.0013)
[2023-02-25 12:37:47,076][2409074] Updated weights for policy 0, policy_version 6920 (0.0012)
[2023-02-25 12:37:47,186][2408954] Fps is (10 sec: 24576.0, 60 sec: 24439.9, 300 sec: 24978.7). Total num frames: 28348416. Throughput: 0: 6065.9. Samples: 7094928. Policy #0 lag: (min: 1.0, avg: 12.0, max: 28.0)
[2023-02-25 12:37:47,186][2408954] Avg episode reward: [(0, '-0.432')]
[2023-02-25 12:37:48,602][2409074] Updated weights for policy 0, policy_version 6930 (0.0012)
[2023-02-25 12:37:50,427][2409074] Updated weights for policy 0, policy_version 6940 (0.0012)
[2023-02-25 12:37:51,657][2409074] Updated weights for policy 0, policy_version 6950 (0.0012)
[2023-02-25 12:37:52,186][2408954] Fps is (10 sec: 24575.6, 60 sec: 24302.9, 300 sec: 24964.8). Total num frames: 28471296. Throughput: 0: 6068.2. Samples: 7112748. Policy #0 lag: (min: 0.0, avg: 13.8, max: 31.0)
[2023-02-25 12:37:52,186][2408954] Avg episode reward: [(0, '-0.432')]
[2023-02-25 12:37:53,268][2409074] Updated weights for policy 0, policy_version 6960 (0.0013)
[2023-02-25 12:37:55,151][2409074] Updated weights for policy 0, policy_version 6970 (0.0012)
[2023-02-25 12:37:56,100][2409077] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 12:37:56,412][2409074] Updated weights for policy 0, policy_version 6980 (0.0014)
[2023-02-25 12:37:57,186][2408954] Fps is (10 sec: 25804.9, 60 sec: 24507.7, 300 sec: 24992.5). Total num frames: 28606464. Throughput: 0: 6150.1. Samples: 7151328. Policy #0 lag: (min: 0.0, avg: 12.0, max: 27.0)
[2023-02-25 12:37:57,186][2408954] Avg episode reward: [(0, '-0.432')]
[2023-02-25 12:37:58,283][2409074] Updated weights for policy 0, policy_version 6990 (0.0015)
[2023-02-25 12:37:59,757][2409074] Updated weights for policy 0, policy_version 7000 (0.0013)
[2023-02-25 12:38:01,486][2409074] Updated weights for policy 0, policy_version 7010 (0.0012)
[2023-02-25 12:38:02,186][2408954] Fps is (10 sec: 26214.3, 60 sec: 24575.9, 300 sec: 24964.8). Total num frames: 28733440. Throughput: 0: 6189.0. Samples: 7189932. Policy #0 lag: (min: 1.0, avg: 12.3, max: 25.0)
[2023-02-25 12:38:02,187][2408954] Avg episode reward: [(0, '-0.432')]
[2023-02-25 12:38:02,963][2409074] Updated weights for policy 0, policy_version 7020 (0.0012)
[2023-02-25 12:38:04,895][2409074] Updated weights for policy 0, policy_version 7030 (0.0012)
[2023-02-25 12:38:06,152][2409074] Updated weights for policy 0, policy_version 7040 (0.0012)
[2023-02-25 12:38:07,186][2408954] Fps is (10 sec: 25804.7, 60 sec: 24917.3, 300 sec: 24992.5). Total num frames: 28864512. Throughput: 0: 6214.2. Samples: 7208856. Policy #0 lag: (min: 1.0, avg: 12.3, max: 25.0)
[2023-02-25 12:38:07,186][2408954] Avg episode reward: [(0, '-0.432')]
[2023-02-25 12:38:07,797][2409074] Updated weights for policy 0, policy_version 7050 (0.0012)
[2023-02-25 12:38:09,638][2409074] Updated weights for policy 0, policy_version 7060 (0.0012)
[2023-02-25 12:38:10,746][2409074] Updated weights for policy 0, policy_version 7070 (0.0013)
[2023-02-25 12:38:12,186][2408954] Fps is (10 sec: 24985.8, 60 sec: 24780.7, 300 sec: 24964.8). Total num frames: 28983296. Throughput: 0: 6246.9. Samples: 7247028. Policy #0 lag: (min: 0.0, avg: 12.0, max: 28.0)
[2023-02-25 12:38:12,186][2408954] Avg episode reward: [(0, '-0.432')]
[2023-02-25 12:38:12,790][2409074] Updated weights for policy 0, policy_version 7080 (0.0013)
[2023-02-25 12:38:14,285][2409074] Updated weights for policy 0, policy_version 7090 (0.0012)
[2023-02-25 12:38:16,275][2409074] Updated weights for policy 0, policy_version 7100 (0.0012)
[2023-02-25 12:38:17,186][2408954] Fps is (10 sec: 24575.9, 60 sec: 24985.6, 300 sec: 24937.0). Total num frames: 29110272. Throughput: 0: 6256.8. Samples: 7284132. Policy #0 lag: (min: 0.0, avg: 11.1, max: 26.0)
[2023-02-25 12:38:17,186][2408954] Avg episode reward: [(0, '-0.432')]
[2023-02-25 12:38:17,212][2409033] Saving /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000007108_29114368.pth...
[2023-02-25 12:38:17,305][2409033] Removing /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000005658_23175168.pth
[2023-02-25 12:38:17,450][2409074] Updated weights for policy 0, policy_version 7110 (0.0012)
[2023-02-25 12:38:19,454][2409074] Updated weights for policy 0, policy_version 7120 (0.0013)
[2023-02-25 12:38:20,935][2409074] Updated weights for policy 0, policy_version 7130 (0.0012)
[2023-02-25 12:38:22,186][2408954] Fps is (10 sec: 25395.6, 60 sec: 24985.7, 300 sec: 24950.9). Total num frames: 29237248. Throughput: 0: 6256.0. Samples: 7303068. Policy #0 lag: (min: 0.0, avg: 11.2, max: 25.0)
[2023-02-25 12:38:22,186][2408954] Avg episode reward: [(0, '-0.432')]
[2023-02-25 12:38:22,475][2409074] Updated weights for policy 0, policy_version 7140 (0.0014)
[2023-02-25 12:38:24,413][2409074] Updated weights for policy 0, policy_version 7150 (0.0012)
[2023-02-25 12:38:25,919][2409074] Updated weights for policy 0, policy_version 7160 (0.0012)
[2023-02-25 12:38:27,186][2408954] Fps is (10 sec: 24985.7, 60 sec: 24985.6, 300 sec: 24895.4). Total num frames: 29360128. Throughput: 0: 6278.1. Samples: 7340844. Policy #0 lag: (min: 0.0, avg: 13.2, max: 24.0)
[2023-02-25 12:38:27,186][2408954] Avg episode reward: [(0, '-0.432')]
[2023-02-25 12:38:27,792][2409074] Updated weights for policy 0, policy_version 7170 (0.0012)
[2023-02-25 12:38:28,217][2409103] DAMAGECOUNT value on done: 914.0
[2023-02-25 12:38:28,222][2409103] Sum rewards: 2.772, reward structure: {'DEATHCOUNT': '-5.250', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO3': '0.079', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.184', 'HEALTH': '0.200', 'weapon4': '0.360', 'WEAPON3': '0.400', 'ARMOR': '0.448', 'HITCOUNT': '0.500', 'FRAGCOUNT': '1.000', 'weapon2': '1.220', 'weapon3': '1.354', 'DAMAGECOUNT': '1.791'}
[2023-02-25 12:38:28,478][2409100] DAMAGECOUNT value on done: 1169.0
[2023-02-25 12:38:28,479][2409100] Sum rewards: 3.977, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.336', 'AMMO2': '0.031', 'AMMO3': '0.053', 'ARMOR': '0.092', 'AMMO4': '0.155', 'WEAPON3': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.486', 'HITCOUNT': '0.500', 'weapon3': '1.228', 'DAMAGECOUNT': '1.704', 'weapon2': '1.714', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:38:29,079][2409074] Updated weights for policy 0, policy_version 7180 (0.0012)
[2023-02-25 12:38:30,612][2409074] Updated weights for policy 0, policy_version 7190 (0.0012)
[2023-02-25 12:38:31,750][2409549] DAMAGECOUNT value on done: 757.0
[2023-02-25 12:38:31,768][2409549] Sum rewards: 0.256, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.560', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO3': '0.063', 'HITCOUNT': '0.400', 'ARMOR': '0.441', 'WEAPON3': '0.500', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '1.272', 'weapon3': '1.392', 'weapon2': '1.708'}
[2023-02-25 12:38:32,186][2408954] Fps is (10 sec: 23756.8, 60 sec: 24917.4, 300 sec: 24867.6). Total num frames: 29474816. Throughput: 0: 6297.3. Samples: 7378308. Policy #0 lag: (min: 0.0, avg: 13.2, max: 24.0)
[2023-02-25 12:38:32,186][2408954] Avg episode reward: [(0, '-0.380')]
[2023-02-25 12:38:32,187][2409033] Saving new best policy, reward=-0.380!
[2023-02-25 12:38:32,514][2409105] Large shaping reward 2.512 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.12, -40.0), ('weapon5', 0.002)]
[2023-02-25 12:38:32,523][2409103] DAMAGECOUNT value on done: 789.0
[2023-02-25 12:38:32,526][2409103] Sum rewards: -1.363, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.602', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'weapon5': '0.042', 'WEAPON4': '0.050', 'AMMO4': '0.080', 'AMMO3': '0.082', 'WEAPON5': '0.150', 'HITCOUNT': '0.220', 'weapon4': '0.226', 'ARMOR': '0.460', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.768', 'weapon2': '1.224', 'weapon3': '1.654', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:38:32,582][2409074] Updated weights for policy 0, policy_version 7201 (0.0012)
[2023-02-25 12:38:32,580][2409100] DAMAGECOUNT value on done: 1123.0
[2023-02-25 12:38:32,583][2409100] Sum rewards: -3.976, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.992', 'weapon5': '0.006', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'weapon4': '0.114', 'AMMO3': '0.152', 'WEAPON5': '0.200', 'HITCOUNT': '0.370', 'ARMOR': '0.432', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.170', 'weapon2': '1.436', 'weapon3': '2.072'}
[2023-02-25 12:38:33,891][2409074] Updated weights for policy 0, policy_version 7211 (0.0013)
[2023-02-25 12:38:34,191][2409102] DAMAGECOUNT value on done: 958.0
[2023-02-25 12:38:34,192][2409102] Sum rewards: -2.607, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.220', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon5': '0.006', 'weapon4': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.128', 'HITCOUNT': '0.380', 'ARMOR': '0.400', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.185', 'weapon2': '1.288', 'weapon3': '2.462'}
[2023-02-25 12:38:35,449][2409549] DAMAGECOUNT value on done: 624.0
[2023-02-25 12:38:35,452][2409549] Sum rewards: 0.683, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.467', 'AMMO2': '0.012', 'AMMO3': '0.060', 'AMMO4': '0.060', 'WEAPON4': '0.200', 'HITCOUNT': '0.270', 'weapon4': '0.276', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.753', 'weapon3': '1.416', 'weapon2': '1.702', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:38:35,673][2409101] DAMAGECOUNT value on done: 620.0
[2023-02-25 12:38:35,674][2409101] Sum rewards: -6.134, reward structure: {'DEATHCOUNT': '-10.500', 'FRAGCOUNT': '-2.000', 'HEALTH': '-0.286', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO3': '0.132', 'AMMO4': '0.134', 'weapon5': '0.156', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.240', 'weapon4': '0.336', 'ARMOR': '0.530', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.840', 'weapon2': '1.290', 'weapon3': '1.842'}
[2023-02-25 12:38:36,123][2409074] Updated weights for policy 0, policy_version 7221 (0.0012)
[2023-02-25 12:38:36,394][2409100] DAMAGECOUNT value on done: 572.0
[2023-02-25 12:38:36,398][2409100] Sum rewards: -0.028, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.000', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'HITCOUNT': '0.060', 'AMMO3': '0.067', 'AMMO4': '0.089', 'weapon5': '0.142', 'WEAPON4': '0.200', 'weapon4': '0.234', 'DAMAGECOUNT': '0.342', 'WEAPON3': '0.400', 'weapon2': '0.846', 'ARMOR': '0.857', 'weapon3': '0.900', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:38:36,924][2409103] DAMAGECOUNT value on done: 968.0
[2023-02-25 12:38:36,925][2409103] Sum rewards: -0.000, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.780', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.139', 'WEAPON4': '0.150', 'HITCOUNT': '0.230', 'weapon4': '0.364', 'ARMOR': '0.477', 'DAMAGECOUNT': '0.702', 'WEAPON3': '0.750', 'weapon3': '1.418', 'weapon2': '1.946', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:38:37,061][2409485] DAMAGECOUNT value on done: 924.0
[2023-02-25 12:38:37,064][2409485] Sum rewards: 4.917, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.080', 'weapon5': '0.116', 'WEAPON5': '0.150', 'HITCOUNT': '0.420', 'WEAPON3': '0.450', 'HEALTH': '0.698', 'ARMOR': '0.812', 'weapon3': '1.298', 'DAMAGECOUNT': '1.491', 'weapon2': '1.556', 'FRAGCOUNT': '4.500'}
[2023-02-25 12:38:37,186][2408954] Fps is (10 sec: 25395.1, 60 sec: 25190.4, 300 sec: 24895.3). Total num frames: 29614080. Throughput: 0: 6313.1. Samples: 7396836. Policy #0 lag: (min: 0.0, avg: 13.3, max: 28.0)
[2023-02-25 12:38:37,186][2408954] Avg episode reward: [(0, '-0.411')]
[2023-02-25 12:38:37,726][2409074] Updated weights for policy 0, policy_version 7231 (0.0012)
[2023-02-25 12:38:38,268][2409102] DAMAGECOUNT value on done: 659.0
[2023-02-25 12:38:38,269][2409102] Sum rewards: -0.814, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.092', 'AMMO2': '0.002', 'weapon5': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.012', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.079', 'weapon4': '0.184', 'HITCOUNT': '0.250', 'ARMOR': '0.466', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.930', 'FRAGCOUNT': '1.000', 'weapon3': '1.506', 'weapon2': '1.880'}
[2023-02-25 12:38:38,817][2409074] Updated weights for policy 0, policy_version 7241 (0.0012)
[2023-02-25 12:38:38,961][2409549] DAMAGECOUNT value on done: 956.0
[2023-02-25 12:38:38,961][2409549] Sum rewards: -0.457, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.254', 'AMMO4': '-0.055', 'AMMO2': '-0.011', 'AMMO5': '0.003', 'weapon5': '0.054', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.202', 'HITCOUNT': '0.380', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.275', 'weapon3': '1.396', 'weapon2': '1.678'}
[2023-02-25 12:38:39,188][2409101] DAMAGECOUNT value on done: 965.0
[2023-02-25 12:38:39,192][2409101] Sum rewards: 3.846, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.060', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'weapon7': '0.038', 'weapon5': '0.042', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon4': '0.190', 'WEAPON7': '0.200', 'HITCOUNT': '0.370', 'WEAPON3': '0.850', 'weapon2': '1.254', 'DAMAGECOUNT': '1.731', 'weapon3': '2.100', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:38:40,588][2409103] DAMAGECOUNT value on done: 746.0
[2023-02-25 12:38:40,592][2409103] Sum rewards: -2.199, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.362', 'AMMO5': '0.003', 'weapon5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.122', 'WEAPON4': '0.250', 'HITCOUNT': '0.300', 'weapon4': '0.316', 'ARMOR': '0.476', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.978', 'weapon2': '1.316', 'FRAGCOUNT': '2.000', 'weapon3': '2.056'}
[2023-02-25 12:38:40,617][2409074] Updated weights for policy 0, policy_version 7251 (0.0012)
[2023-02-25 12:38:40,657][2409596] DAMAGECOUNT value on done: 1228.0
[2023-02-25 12:38:40,661][2409596] Sum rewards: 2.021, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.702', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO3': '0.069', 'WEAPON4': '0.100', 'weapon5': '0.130', 'WEAPON5': '0.150', 'weapon4': '0.230', 'HITCOUNT': '0.280', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'weapon2': '0.674', 'DAMAGECOUNT': '1.089', 'weapon3': '1.346', 'FRAGCOUNT': '1.500'}
[2023-02-25 12:38:40,671][2409100] DAMAGECOUNT value on done: 1014.0
[2023-02-25 12:38:40,676][2409100] Sum rewards: -2.572, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.380', 'AMMO5': '0.005', 'AMMO2': '0.031', 'ARMOR': '0.040', 'weapon5': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'AMMO4': '0.157', 'HITCOUNT': '0.210', 'WEAPON4': '0.300', 'weapon4': '0.610', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.672', 'FRAGCOUNT': '1.000', 'weapon3': '1.114', 'weapon2': '1.272'}
[2023-02-25 12:38:40,692][2409485] DAMAGECOUNT value on done: 1111.0
[2023-02-25 12:38:40,694][2409485] Sum rewards: 2.194, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'ARMOR': '0.048', 'AMMO4': '0.062', 'AMMO3': '0.074', 'HEALTH': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.256', 'HITCOUNT': '0.310', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.984', 'weapon2': '1.332', 'weapon3': '1.576', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:38:41,328][2409597] DAMAGECOUNT value on done: 796.0
[2023-02-25 12:38:41,330][2409597] Sum rewards: -0.015, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.620', 'AMMO2': '0.021', 'ARMOR': '0.040', 'AMMO3': '0.103', 'AMMO4': '0.107', 'WEAPON4': '0.250', 'HITCOUNT': '0.390', 'weapon4': '0.518', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.236', 'weapon2': '1.326', 'weapon3': '1.814'}
[2023-02-25 12:38:42,000][2409074] Updated weights for policy 0, policy_version 7261 (0.0013)
[2023-02-25 12:38:42,028][2409548] DAMAGECOUNT value on done: 638.0
[2023-02-25 12:38:42,029][2409548] Sum rewards: 0.088, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.277', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO3': '0.080', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'HITCOUNT': '0.200', 'weapon4': '0.246', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.534', 'ARMOR': '0.959', 'FRAGCOUNT': '1.000', 'weapon3': '1.342', 'weapon2': '1.946'}
[2023-02-25 12:38:42,186][2408954] Fps is (10 sec: 26623.7, 60 sec: 25258.6, 300 sec: 24895.3). Total num frames: 29741056. Throughput: 0: 6298.1. Samples: 7434744. Policy #0 lag: (min: 0.0, avg: 13.5, max: 25.0)
[2023-02-25 12:38:42,187][2408954] Avg episode reward: [(0, '-0.306')]
[2023-02-25 12:38:42,206][2409033] Saving new best policy, reward=-0.306!
[2023-02-25 12:38:42,313][2409102] DAMAGECOUNT value on done: 1106.0
[2023-02-25 12:38:42,317][2409102] Sum rewards: 1.163, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.586', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO3': '0.080', 'weapon5': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'HITCOUNT': '0.300', 'weapon4': '0.412', 'ARMOR': '0.444', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.191', 'weapon2': '1.280', 'weapon3': '1.284', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:38:42,318][2409565] DAMAGECOUNT value on done: 646.0
[2023-02-25 12:38:42,321][2409565] Sum rewards: -0.540, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.230', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.057', 'AMMO4': '0.060', 'HITCOUNT': '0.100', 'ARMOR': '0.137', 'DAMAGECOUNT': '0.279', 'WEAPON3': '0.400', 'WEAPON4': '0.450', 'FRAGCOUNT': '1.000', 'weapon4': '1.024', 'weapon3': '1.132', 'weapon2': '1.268'}
[2023-02-25 12:38:42,761][2409549] DAMAGECOUNT value on done: 715.0
[2023-02-25 12:38:42,764][2409549] Sum rewards: 2.639, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.375', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO3': '0.075', 'AMMO4': '0.085', 'HITCOUNT': '0.210', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'weapon4': '0.450', 'ARMOR': '0.484', 'DAMAGECOUNT': '0.885', 'weapon3': '0.988', 'weapon2': '1.360', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:38:43,008][2409101] DAMAGECOUNT value on done: 1209.0
[2023-02-25 12:38:43,012][2409101] Sum rewards: 0.509, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.695', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.114', 'WEAPON4': '0.150', 'HITCOUNT': '0.360', 'weapon4': '0.424', 'ARMOR': '0.528', 'WEAPON3': '0.750', 'weapon2': '1.394', 'weapon3': '1.650', 'DAMAGECOUNT': '1.710', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:38:44,269][2409074] Updated weights for policy 0, policy_version 7271 (0.0013)
[2023-02-25 12:38:44,313][2409033] Signal inference workers to stop experience collection... (950 times)
[2023-02-25 12:38:44,314][2409033] Signal inference workers to resume experience collection... (950 times)
[2023-02-25 12:38:44,343][2409074] InferenceWorker_p0-w0: stopping experience collection (950 times)
[2023-02-25 12:38:44,344][2409074] InferenceWorker_p0-w0: resuming experience collection (950 times)
[2023-02-25 12:38:44,348][2409104] DAMAGECOUNT value on done: 742.0
[2023-02-25 12:38:44,704][2409100] DAMAGECOUNT value on done: 1009.0
[2023-02-25 12:38:44,707][2409100] Sum rewards: 3.931, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.806', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO3': '0.045', 'weapon5': '0.082', 'WEAPON4': '0.100', 'weapon4': '0.236', 'WEAPON5': '0.300', 'HITCOUNT': '0.300', 'WEAPON3': '0.350', 'weapon3': '0.768', 'ARMOR': '1.009', 'DAMAGECOUNT': '1.392', 'weapon2': '1.678', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:38:44,720][2409406] DAMAGECOUNT value on done: 734.0
[2023-02-25 12:38:44,721][2409406] Sum rewards: 1.679, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.780', 'AMMO2': '0.017', 'ARMOR': '0.040', 'AMMO4': '0.084', 'AMMO3': '0.086', 'WEAPON4': '0.200', 'weapon4': '0.246', 'HITCOUNT': '0.290', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.092', 'weapon3': '1.240', 'weapon2': '1.864', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:38:44,765][2409596] DAMAGECOUNT value on done: 1194.0
[2023-02-25 12:38:44,768][2409596] Sum rewards: -0.571, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'weapon4': '0.224', 'HEALTH': '0.296', 'HITCOUNT': '0.320', 'ARMOR': '0.493', 'WEAPON3': '0.600', 'weapon2': '0.962', 'DAMAGECOUNT': '0.999', 'weapon3': '1.654'}
[2023-02-25 12:38:45,163][2409597] DAMAGECOUNT value on done: 885.0
[2023-02-25 12:38:45,166][2409597] Sum rewards: -0.968, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.610', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO3': '0.096', 'ARMOR': '0.187', 'WEAPON4': '0.200', 'HITCOUNT': '0.280', 'weapon4': '0.526', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.855', 'weapon2': '1.246', 'weapon3': '1.348', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:38:45,240][2409103] DAMAGECOUNT value on done: 544.0
[2023-02-25 12:38:45,241][2409103] Sum rewards: -0.188, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.588', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.018', 'weapon5': '0.032', 'AMMO3': '0.041', 'WEAPON4': '0.050', 'ARMOR': '0.056', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'weapon4': '0.134', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.390', 'weapon3': '0.970', 'FRAGCOUNT': '1.000', 'weapon2': '1.710'}
[2023-02-25 12:38:45,374][2409485] DAMAGECOUNT value on done: 479.0
[2023-02-25 12:38:45,377][2409485] Sum rewards: -0.668, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.930', 'AMMO4': '-0.063', 'AMMO2': '-0.013', 'AMMO5': '0.007', 'weapon5': '0.022', 'AMMO3': '0.123', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.240', 'weapon4': '0.458', 'DAMAGECOUNT': '0.720', 'WEAPON3': '0.850', 'weapon2': '1.288', 'weapon3': '1.780', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:38:45,462][2409074] Updated weights for policy 0, policy_version 7281 (0.0012)
[2023-02-25 12:38:45,538][2409373] DAMAGECOUNT value on done: 417.0
[2023-02-25 12:38:45,541][2409373] Sum rewards: 1.625, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.375', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.061', 'HITCOUNT': '0.110', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.375', 'ARMOR': '0.456', 'weapon3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.830'}
[2023-02-25 12:38:45,587][2409077] DAMAGECOUNT value on done: 1223.0
[2023-02-25 12:38:45,590][2409077] Sum rewards: 4.543, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.348', 'weapon5': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.040', 'AMMO3': '0.081', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.201', 'WEAPON4': '0.250', 'weapon4': '0.420', 'WEAPON3': '0.450', 'HITCOUNT': '0.520', 'weapon3': '1.452', 'DAMAGECOUNT': '1.680', 'weapon2': '1.698', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:38:45,759][2409548] DAMAGECOUNT value on done: 780.0
[2023-02-25 12:38:45,762][2409548] Sum rewards: 2.118, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.634', 'AMMO2': '0.003', 'AMMO4': '0.014', 'WEAPON1': '0.020', 'AMMO3': '0.045', 'WEAPON4': '0.150', 'weapon4': '0.190', 'HITCOUNT': '0.210', 'WEAPON3': '0.350', 'ARMOR': '0.471', 'DAMAGECOUNT': '0.765', 'weapon3': '0.880', 'weapon2': '1.404', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:38:45,839][2409105] DAMAGECOUNT value on done: 1068.0
[2023-02-25 12:38:45,842][2409105] Sum rewards: 5.977, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.681', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.060', 'weapon5': '0.060', 'weapon4': '0.156', 'WEAPON4': '0.200', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.400', 'weapon3': '1.002', 'DAMAGECOUNT': '1.356', 'weapon2': '2.060', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:38:46,015][2409102] DAMAGECOUNT value on done: 1037.0
[2023-02-25 12:38:46,019][2409102] Sum rewards: 4.168, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.034', 'AMMO5': '0.003', 'AMMO2': '0.013', 'ARMOR': '0.016', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'weapon5': '0.066', 'AMMO3': '0.086', 'weapon4': '0.090', 'WEAPON4': '0.100', 'HITCOUNT': '0.210', 'WEAPON3': '0.450', 'weapon3': '0.906', 'DAMAGECOUNT': '1.161', 'weapon2': '1.716', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:38:46,031][2409565] DAMAGECOUNT value on done: 1008.0
[2023-02-25 12:38:46,033][2409565] Sum rewards: 0.779, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.366', 'AMMO5': '0.005', 'weapon5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'ARMOR': '0.040', 'AMMO3': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'weapon4': '0.428', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.615', 'FRAGCOUNT': '1.000', 'weapon3': '1.460', 'weapon2': '1.740'}
[2023-02-25 12:38:46,857][2409549] DAMAGECOUNT value on done: 934.0
[2023-02-25 12:38:46,858][2409549] Sum rewards: -1.337, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.270', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'HITCOUNT': '0.320', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.047', 'weapon3': '1.752', 'weapon2': '1.886'}
[2023-02-25 12:38:47,143][2409101] DAMAGECOUNT value on done: 829.0
[2023-02-25 12:38:47,144][2409101] Sum rewards: 1.597, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'ARMOR': '0.044', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'weapon5': '0.108', 'HEALTH': '0.156', 'weapon4': '0.170', 'HITCOUNT': '0.340', 'WEAPON3': '0.600', 'weapon2': '1.364', 'DAMAGECOUNT': '1.476', 'weapon3': '1.752', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:38:47,186][2408954] Fps is (10 sec: 24166.6, 60 sec: 25122.1, 300 sec: 24839.8). Total num frames: 29855744. Throughput: 0: 6268.8. Samples: 7472028. Policy #0 lag: (min: 1.0, avg: 12.9, max: 24.0)
[2023-02-25 12:38:47,186][2408954] Avg episode reward: [(0, '-0.189')]
[2023-02-25 12:38:47,213][2409033] Saving new best policy, reward=-0.189!
[2023-02-25 12:38:47,391][2409074] Updated weights for policy 0, policy_version 7291 (0.0012)
[2023-02-25 12:38:48,384][2409104] DAMAGECOUNT value on done: 555.0
[2023-02-25 12:38:48,385][2409104] Sum rewards: 5.110, reward structure: {'DEATHCOUNT': '-6.000', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.052', 'AMMO3': '0.070', 'HITCOUNT': '0.250', 'WEAPON3': '0.400', 'ARMOR': '0.473', 'HEALTH': '0.480', 'DAMAGECOUNT': '0.735', 'weapon3': '1.588', 'weapon2': '2.042', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:38:48,644][2409100] DAMAGECOUNT value on done: 1049.0
[2023-02-25 12:38:48,645][2409100] Sum rewards: -0.467, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.034', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'ARMOR': '0.020', 'AMMO4': '0.065', 'WEAPON5': '0.100', 'AMMO3': '0.146', 'WEAPON4': '0.250', 'weapon4': '0.492', 'HITCOUNT': '0.500', 'WEAPON3': '0.950', 'weapon2': '1.426', 'DAMAGECOUNT': '1.506', 'weapon3': '1.832', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:38:48,686][2409596] DAMAGECOUNT value on done: 634.0
[2023-02-25 12:38:48,687][2409596] Sum rewards: -1.673, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.142', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.007', 'AMMO4': '0.036', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'HITCOUNT': '0.240', 'WEAPON4': '0.300', 'weapon4': '0.354', 'ARMOR': '0.512', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.816', 'FRAGCOUNT': '1.000', 'weapon3': '1.452', 'weapon2': '1.484'}
[2023-02-25 12:38:48,838][2409406] DAMAGECOUNT value on done: 885.0
[2023-02-25 12:38:48,839][2409406] Sum rewards: 2.186, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'HEALTH': '0.075', 'weapon5': '0.092', 'HITCOUNT': '0.270', 'WEAPON3': '0.300', 'ARMOR': '0.441', 'DAMAGECOUNT': '0.894', 'FRAGCOUNT': '1.000', 'weapon3': '1.224', 'weapon2': '1.538'}
[2023-02-25 12:38:49,004][2409597] DAMAGECOUNT value on done: 729.0
[2023-02-25 12:38:49,008][2409597] Sum rewards: 2.950, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.004', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon5': '0.056', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'ARMOR': '0.108', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.543', 'HEALTH': '0.560', 'weapon4': '0.600', 'weapon2': '0.868', 'weapon3': '1.558', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:38:49,062][2409103] DAMAGECOUNT value on done: 692.0
[2023-02-25 12:38:49,063][2409103] Sum rewards: 0.147, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.108', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.058', 'ARMOR': '0.068', 'AMMO3': '0.121', 'AMMO4': '0.124', 'WEAPON4': '0.250', 'HITCOUNT': '0.340', 'weapon4': '0.594', 'WEAPON3': '0.750', 'weapon3': '1.226', 'weapon2': '1.296', 'DAMAGECOUNT': '1.350', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:38:49,101][2409074] Updated weights for policy 0, policy_version 7301 (0.0012)
[2023-02-25 12:38:49,214][2409485] DAMAGECOUNT value on done: 979.0
[2023-02-25 12:38:49,215][2409485] Sum rewards: 0.335, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.310', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.007', 'weapon5': '0.026', 'WEAPON1': '0.030', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.350', 'weapon4': '0.412', 'ARMOR': '0.524', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.005', 'weapon2': '1.188', 'weapon3': '1.784', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:38:49,501][2409373] DAMAGECOUNT value on done: 799.0
[2023-02-25 12:38:49,502][2409373] Sum rewards: 0.331, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.350', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'weapon4': '0.066', 'AMMO4': '0.078', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'HITCOUNT': '0.170', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.672', 'FRAGCOUNT': '1.000', 'weapon3': '1.346', 'weapon2': '1.926'}
[2023-02-25 12:38:49,558][2409469] DAMAGECOUNT value on done: 709.0
[2023-02-25 12:38:49,627][2409405] DAMAGECOUNT value on done: 1169.0
[2023-02-25 12:38:49,630][2409405] Sum rewards: 3.751, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.653', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.007', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'weapon5': '0.084', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'weapon4': '0.168', 'HITCOUNT': '0.390', 'WEAPON3': '0.600', 'weapon3': '1.508', 'DAMAGECOUNT': '1.542', 'weapon2': '1.822', 'FRAGCOUNT': '5.500'}
[2023-02-25 12:38:49,672][2409102] DAMAGECOUNT value on done: 620.0
[2023-02-25 12:38:49,676][2409077] DAMAGECOUNT value on done: 818.0
[2023-02-25 12:38:49,674][2409102] Sum rewards: -2.403, reward structure: {'DEATHCOUNT': '-4.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.480', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'AMMO3': '0.087', 'HITCOUNT': '0.100', 'weapon5': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.294', 'weapon4': '0.438', 'ARMOR': '0.478', 'WEAPON3': '0.550', 'weapon2': '1.328', 'weapon3': '1.358'}
[2023-02-25 12:38:49,677][2409077] Sum rewards: -2.079, reward structure: {'DEATHCOUNT': '-4.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.180', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.056', 'AMMO3': '0.065', 'WEAPON5': '0.100', 'HITCOUNT': '0.170', 'WEAPON3': '0.400', 'ARMOR': '0.440', 'DAMAGECOUNT': '0.465', 'weapon2': '1.094', 'weapon3': '1.244'}
[2023-02-25 12:38:49,686][2409565] DAMAGECOUNT value on done: 721.0
[2023-02-25 12:38:49,687][2409866] DAMAGECOUNT value on done: 826.0
[2023-02-25 12:38:49,688][2409866] Sum rewards: 1.635, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.003', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon7': '0.054', 'AMMO3': '0.072', 'weapon5': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.145', 'weapon4': '0.300', 'HITCOUNT': '0.320', 'WEAPON3': '0.450', 'HEALTH': '0.606', 'DAMAGECOUNT': '1.476', 'weapon2': '1.518', 'weapon3': '1.640', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:38:49,689][2409565] Sum rewards: -1.418, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.200', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO3': '0.067', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'WEAPON4': '0.300', 'HITCOUNT': '0.370', 'WEAPON3': '0.400', 'weapon4': '0.464', 'ARMOR': '0.500', 'weapon3': '0.836', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.131', 'weapon2': '2.002'}
[2023-02-25 12:38:49,702][2409105] DAMAGECOUNT value on done: 686.0
[2023-02-25 12:38:49,705][2409105] Sum rewards: 1.939, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.296', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.052', 'weapon5': '0.054', 'AMMO3': '0.076', 'WEAPON5': '0.100', 'HITCOUNT': '0.300', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.095', 'ARMOR': '1.257', 'weapon3': '1.450', 'weapon2': '2.266', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:38:49,738][2409548] DAMAGECOUNT value on done: 1418.0
[2023-02-25 12:38:49,739][2409548] Sum rewards: 2.158, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.740', 'AMMO2': '0.003', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.016', 'WEAPON4': '0.050', 'weapon5': '0.086', 'AMMO3': '0.112', 'WEAPON5': '0.200', 'weapon4': '0.232', 'HITCOUNT': '0.580', 'WEAPON3': '0.750', 'weapon2': '1.062', 'weapon3': '2.006', 'DAMAGECOUNT': '2.031', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:38:50,094][2409355] DAMAGECOUNT value on done: 754.0
[2023-02-25 12:38:50,108][2409389] DAMAGECOUNT value on done: 853.0
[2023-02-25 12:38:50,725][2409074] Updated weights for policy 0, policy_version 7311 (0.0015)
[2023-02-25 12:38:51,003][2409549] DAMAGECOUNT value on done: 869.0
[2023-02-25 12:38:51,004][2409549] Sum rewards: -1.885, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.834', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.014', 'weapon4': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.070', 'AMMO3': '0.117', 'WEAPON4': '0.200', 'HITCOUNT': '0.290', 'ARMOR': '0.444', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.885', 'FRAGCOUNT': '1.000', 'weapon2': '1.626', 'weapon3': '1.744'}
[2023-02-25 12:38:51,309][2409101] DAMAGECOUNT value on done: 911.0
[2023-02-25 12:38:51,767][2409076] DAMAGECOUNT value on done: 1220.0
[2023-02-25 12:38:51,768][2409076] Sum rewards: 1.054, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.354', 'AMMO5': '0.003', 'AMMO2': '0.023', 'AMMO3': '0.045', 'WEAPON5': '0.050', 'AMMO4': '0.114', 'WEAPON3': '0.250', 'HITCOUNT': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.384', 'ARMOR': '0.521', 'DAMAGECOUNT': '0.804', 'weapon3': '0.882', 'weapon2': '1.782', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:38:51,822][2409407] DAMAGECOUNT value on done: 829.0
[2023-02-25 12:38:51,823][2409407] Sum rewards: -0.036, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.358', 'AMMO5': '0.004', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'weapon5': '0.028', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.125', 'HITCOUNT': '0.380', 'WEAPON3': '0.800', 'ARMOR': '0.855', 'DAMAGECOUNT': '1.140', 'weapon2': '1.572', 'weapon3': '1.736', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:38:52,186][2408954] Fps is (10 sec: 23757.1, 60 sec: 25122.2, 300 sec: 24812.0). Total num frames: 29978624. Throughput: 0: 6261.9. Samples: 7490640. Policy #0 lag: (min: 0.0, avg: 10.0, max: 23.0)
[2023-02-25 12:38:52,186][2408954] Avg episode reward: [(0, '0.201')]
[2023-02-25 12:38:52,187][2409033] Saving new best policy, reward=0.201!
[2023-02-25 12:38:52,264][2409100] DAMAGECOUNT value on done: 621.0
[2023-02-25 12:38:52,265][2409100] Sum rewards: -0.193, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.980', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO4': '0.034', 'ARMOR': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.144', 'HITCOUNT': '0.240', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.840', 'weapon2': '1.354', 'weapon3': '1.854', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:38:52,444][2409074] Updated weights for policy 0, policy_version 7321 (0.0012)
[2023-02-25 12:38:52,523][2409406] DAMAGECOUNT value on done: 943.0
[2023-02-25 12:38:52,524][2409406] Sum rewards: -4.402, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.993', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon5': '0.032', 'WEAPON1': '0.040', 'ARMOR': '0.056', 'AMMO4': '0.083', 'AMMO3': '0.092', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.280', 'weapon4': '0.454', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.005', 'weapon3': '1.186', 'weapon2': '1.286'}
[2023-02-25 12:38:52,542][2409104] DAMAGECOUNT value on done: 1158.0
[2023-02-25 12:38:52,545][2409104] Sum rewards: -2.469, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.062', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.038', 'WEAPON5': '0.050', 'ARMOR': '0.080', 'AMMO4': '0.159', 'AMMO3': '0.160', 'weapon4': '0.196', 'HITCOUNT': '0.260', 'WEAPON4': '0.300', 'WEAPON3': '0.850', 'weapon2': '1.266', 'DAMAGECOUNT': '1.281', 'weapon3': '1.916', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:38:52,757][2409103] DAMAGECOUNT value on done: 937.0
[2023-02-25 12:38:52,758][2409103] Sum rewards: -0.247, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.438', 'AMMO2': '0.011', 'weapon4': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'HITCOUNT': '0.110', 'AMMO3': '0.130', 'ARMOR': '0.428', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.600', 'weapon2': '1.612', 'FRAGCOUNT': '2.000', 'weapon3': '2.200'}
[2023-02-25 12:38:52,823][2409596] DAMAGECOUNT value on done: 728.0
[2023-02-25 12:38:52,824][2409596] Sum rewards: -0.835, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.800', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.044', 'AMMO3': '0.073', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.112', 'HITCOUNT': '0.200', 'WEAPON3': '0.400', 'ARMOR': '0.460', 'DAMAGECOUNT': '0.645', 'FRAGCOUNT': '1.000', 'weapon3': '1.482', 'weapon2': '2.082'}
[2023-02-25 12:38:52,867][2409597] DAMAGECOUNT value on done: 1031.0
[2023-02-25 12:38:52,870][2409597] Sum rewards: 6.894, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.372', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO4': '0.034', 'AMMO3': '0.053', 'weapon5': '0.064', 'WEAPON5': '0.100', 'weapon4': '0.118', 'WEAPON4': '0.150', 'WEAPON3': '0.300', 'HITCOUNT': '0.350', 'weapon3': '0.948', 'weapon2': '1.572', 'DAMAGECOUNT': '2.064', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:38:52,928][2409485] DAMAGECOUNT value on done: 708.0
[2023-02-25 12:38:52,931][2409485] Sum rewards: -0.583, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.330', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'weapon5': '0.052', 'AMMO3': '0.062', 'WEAPON4': '0.150', 'HITCOUNT': '0.280', 'weapon4': '0.388', 'WEAPON3': '0.400', 'ARMOR': '0.453', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.942', 'weapon2': '1.184', 'weapon3': '1.212'}
[2023-02-25 12:38:53,187][2409373] DAMAGECOUNT value on done: 1118.0
[2023-02-25 12:38:53,190][2409373] Sum rewards: 2.014, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.009', 'AMMO4': '0.043', 'AMMO3': '0.070', 'WEAPON4': '0.150', 'HEALTH': '0.157', 'HITCOUNT': '0.390', 'WEAPON3': '0.400', 'weapon4': '0.416', 'ARMOR': '0.504', 'DAMAGECOUNT': '1.335', 'weapon2': '1.454', 'weapon3': '1.586', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:38:53,259][2409102] DAMAGECOUNT value on done: 603.0
[2023-02-25 12:38:53,260][2409102] Sum rewards: 5.854, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.370', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.046', 'weapon5': '0.082', 'WEAPON5': '0.150', 'HITCOUNT': '0.240', 'WEAPON3': '0.350', 'weapon3': '0.912', 'DAMAGECOUNT': '0.960', 'weapon2': '1.478', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:38:53,285][2409565] DAMAGECOUNT value on done: 989.0
[2023-02-25 12:38:53,288][2409565] Sum rewards: 1.210, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.250', 'AMMO5': '0.004', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.047', 'weapon5': '0.048', 'weapon4': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.133', 'HITCOUNT': '0.450', 'WEAPON3': '0.750', 'ARMOR': '0.838', 'DAMAGECOUNT': '1.641', 'weapon2': '1.668', 'weapon3': '1.810', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:38:53,441][2409074] Updated weights for policy 0, policy_version 7331 (0.0012)
[2023-02-25 12:38:53,478][2409548] DAMAGECOUNT value on done: 955.0
[2023-02-25 12:38:53,481][2409548] Sum rewards: 2.176, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.690', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'weapon5': '0.050', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'weapon4': '0.214', 'HITCOUNT': '0.320', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.245', 'weapon2': '1.490', 'weapon3': '1.502', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:38:53,519][2409469] DAMAGECOUNT value on done: 766.0
[2023-02-25 12:38:53,522][2409469] Sum rewards: 6.079, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.422', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.044', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.286', 'HITCOUNT': '0.470', 'ARMOR': '0.489', 'WEAPON3': '0.650', 'weapon3': '1.542', 'weapon2': '1.588', 'DAMAGECOUNT': '1.770', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:38:53,615][2409105] DAMAGECOUNT value on done: 1014.0
[2023-02-25 12:38:53,617][2409105] Sum rewards: 0.155, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.556', 'AMMO5': '0.003', 'AMMO2': '0.018', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'AMMO3': '0.142', 'weapon4': '0.276', 'HITCOUNT': '0.390', 'ARMOR': '0.918', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.260', 'weapon2': '1.264', 'weapon3': '2.052', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:38:53,637][2409077] DAMAGECOUNT value on done: 973.0
[2023-02-25 12:38:53,638][2409077] Sum rewards: -1.056, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.233', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'weapon5': '0.004', 'AMMO5': '0.005', 'WEAPON5': '0.050', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.180', 'HITCOUNT': '0.400', 'ARMOR': '0.482', 'WEAPON3': '0.500', 'FRAGCOUNT': '0.500', 'weapon3': '1.360', 'DAMAGECOUNT': '1.431', 'weapon2': '1.848'}
[2023-02-25 12:38:53,800][2409866] DAMAGECOUNT value on done: 1070.0
[2023-02-25 12:38:53,801][2409866] Sum rewards: -1.949, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.802', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.098', 'AMMO3': '0.113', 'HITCOUNT': '0.250', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.065', 'ARMOR': '1.266', 'weapon2': '1.648', 'weapon3': '1.988', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:38:53,952][2409389] DAMAGECOUNT value on done: 659.0
[2023-02-25 12:38:53,955][2409389] Sum rewards: 1.240, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.052', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'HITCOUNT': '0.040', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.435', 'FRAGCOUNT': '1.000', 'weapon2': '1.104', 'weapon3': '1.218'}
[2023-02-25 12:38:54,068][2409405] DAMAGECOUNT value on done: 873.0
[2023-02-25 12:38:54,068][2409405] Sum rewards: -0.174, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.240', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.010', 'AMMO4': '0.045', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.113', 'weapon4': '0.158', 'HITCOUNT': '0.290', 'ARMOR': '0.458', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.945', 'weapon2': '1.720', 'weapon3': '1.752', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:38:54,206][2409355] DAMAGECOUNT value on done: 587.0
[2023-02-25 12:38:54,207][2409355] Sum rewards: -5.968, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.482', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.141', 'WEAPON4': '0.250', 'HITCOUNT': '0.340', 'weapon4': '0.384', 'ARMOR': '0.499', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.954', 'weapon2': '1.594', 'weapon3': '1.772', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:38:54,647][2409549] DAMAGECOUNT value on done: 1095.0
[2023-02-25 12:38:54,650][2409549] Sum rewards: 2.966, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.120', 'AMMO5': '0.005', 'AMMO2': '0.013', 'ARMOR': '0.028', 'AMMO4': '0.064', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'weapon5': '0.180', 'WEAPON4': '0.200', 'HITCOUNT': '0.260', 'weapon4': '0.376', 'WEAPON3': '0.400', 'weapon2': '1.120', 'weapon3': '1.250', 'DAMAGECOUNT': '1.503', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:38:54,957][2409101] DAMAGECOUNT value on done: 1476.0
[2023-02-25 12:38:54,958][2409101] Sum rewards: 7.597, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.392', 'AMMO2': '0.002', 'AMMO5': '0.009', 'AMMO4': '0.009', 'WEAPON1': '0.020', 'weapon5': '0.042', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'weapon4': '0.208', 'ARMOR': '0.460', 'WEAPON3': '0.500', 'HITCOUNT': '0.530', 'weapon3': '1.510', 'weapon2': '1.514', 'DAMAGECOUNT': '1.725', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:38:55,477][2409074] Updated weights for policy 0, policy_version 7341 (0.0012)
[2023-02-25 12:38:55,600][2409096] DAMAGECOUNT value on done: 995.0
[2023-02-25 12:38:55,605][2409096] Sum rewards: -1.591, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.496', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.102', 'AMMO3': '0.127', 'HITCOUNT': '0.200', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.690', 'weapon2': '1.406', 'weapon3': '1.414', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:38:55,672][2409076] DAMAGECOUNT value on done: 896.0
[2023-02-25 12:38:55,676][2409076] Sum rewards: -3.871, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.424', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.031', 'ARMOR': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.176', 'weapon4': '0.296', 'WEAPON4': '0.350', 'HITCOUNT': '0.380', 'WEAPON3': '1.000', 'weapon2': '1.224', 'DAMAGECOUNT': '1.296', 'weapon3': '2.140', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:38:55,693][2409407] DAMAGECOUNT value on done: 710.0
[2023-02-25 12:38:55,694][2409407] Sum rewards: -4.865, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.961', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.040', 'WEAPON5': '0.100', 'HITCOUNT': '0.130', 'AMMO3': '0.148', 'DAMAGECOUNT': '0.420', 'ARMOR': '0.428', 'WEAPON3': '0.800', 'weapon2': '1.318', 'weapon3': '2.206'}
[2023-02-25 12:38:55,833][2409075] DAMAGECOUNT value on done: 780.0
[2023-02-25 12:38:55,833][2409075] Sum rewards: -1.542, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.612', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'WEAPON1': '0.030', 'AMMO3': '0.083', 'HITCOUNT': '0.120', 'WEAPON4': '0.200', 'weapon4': '0.340', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.550', 'ARMOR': '0.944', 'FRAGCOUNT': '1.000', 'weapon3': '1.140', 'weapon2': '2.022'}
[2023-02-25 12:38:56,022][2409100] DAMAGECOUNT value on done: 1159.0
[2023-02-25 12:38:56,023][2409100] Sum rewards: 0.867, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.355', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.019', 'ARMOR': '0.020', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.093', 'AMMO3': '0.106', 'WEAPON4': '0.400', 'weapon4': '0.442', 'HITCOUNT': '0.500', 'WEAPON3': '0.800', 'weapon2': '1.340', 'weapon3': '1.816', 'DAMAGECOUNT': '1.851', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:38:56,417][2409406] DAMAGECOUNT value on done: 1151.0
[2023-02-25 12:38:56,418][2409406] Sum rewards: 2.963, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.944', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.078', 'weapon5': '0.080', 'HITCOUNT': '0.180', 'ARMOR': '0.477', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.600', 'weapon3': '1.670', 'weapon2': '1.712', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:38:56,418][2409104] DAMAGECOUNT value on done: 736.0
[2023-02-25 12:38:56,420][2409104] Sum rewards: -0.502, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.175', 'AMMO4': '-0.063', 'AMMO2': '-0.013', 'ARMOR': '0.032', 'AMMO3': '0.042', 'WEAPON4': '0.100', 'weapon4': '0.120', 'HITCOUNT': '0.130', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.477', 'weapon3': '0.892', 'FRAGCOUNT': '1.000', 'weapon2': '1.356'}
[2023-02-25 12:38:56,725][2409103] DAMAGECOUNT value on done: 587.0
[2023-02-25 12:38:56,778][2409596] DAMAGECOUNT value on done: 952.0
[2023-02-25 12:38:56,781][2409596] Sum rewards: -2.104, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.320', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO3': '0.145', 'WEAPON4': '0.200', 'weapon4': '0.392', 'HITCOUNT': '0.430', 'ARMOR': '0.473', 'WEAPON3': '0.950', 'weapon2': '1.368', 'DAMAGECOUNT': '1.392', 'weapon3': '1.894', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:38:56,833][2409074] Updated weights for policy 0, policy_version 7351 (0.0016)
[2023-02-25 12:38:56,929][2409485] DAMAGECOUNT value on done: 1449.0
[2023-02-25 12:38:56,933][2409485] Sum rewards: 2.600, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.096', 'AMMO5': '0.003', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.041', 'WEAPON5': '0.050', 'weapon5': '0.082', 'weapon4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.173', 'HITCOUNT': '0.630', 'WEAPON3': '0.900', 'ARMOR': '0.905', 'weapon2': '1.308', 'weapon3': '2.162', 'DAMAGECOUNT': '2.232', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:38:56,980][2409102] DAMAGECOUNT value on done: 875.0
[2023-02-25 12:38:56,981][2409102] Sum rewards: -2.902, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.332', 'AMMO2': '0.001', 'AMMO4': '0.006', 'WEAPON4': '0.050', 'AMMO3': '0.143', 'HITCOUNT': '0.160', 'weapon4': '0.168', 'ARMOR': '0.416', 'DAMAGECOUNT': '0.444', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.152', 'weapon3': '2.340'}
[2023-02-25 12:38:57,040][2409565] DAMAGECOUNT value on done: 1176.0
[2023-02-25 12:38:57,043][2409565] Sum rewards: 3.546, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.681', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.048', 'ARMOR': '0.068', 'AMMO3': '0.074', 'WEAPON5': '0.150', 'weapon4': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.360', 'WEAPON3': '0.400', 'DAMAGECOUNT': '1.290', 'weapon3': '1.504', 'weapon2': '1.696', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:38:57,084][2409373] DAMAGECOUNT value on done: 1078.0
[2023-02-25 12:38:57,085][2409373] Sum rewards: 3.773, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.032', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.015', 'AMMO3': '0.070', 'weapon5': '0.078', 'HITCOUNT': '0.140', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.396', 'ARMOR': '0.482', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.840', 'weapon2': '1.196', 'weapon3': '1.230', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:38:57,172][2409548] DAMAGECOUNT value on done: 1077.0
[2023-02-25 12:38:57,174][2409548] Sum rewards: 1.238, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.599', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.006', 'weapon5': '0.008', 'WEAPON1': '0.020', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.108', 'HITCOUNT': '0.430', 'ARMOR': '0.456', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.485', 'weapon3': '1.572', 'weapon2': '1.806', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:38:57,186][2408954] Fps is (10 sec: 26214.4, 60 sec: 25190.4, 300 sec: 24853.7). Total num frames: 30117888. Throughput: 0: 6241.9. Samples: 7527912. Policy #0 lag: (min: 0.0, avg: 10.0, max: 23.0)
[2023-02-25 12:38:57,186][2408954] Avg episode reward: [(0, '0.469')]
[2023-02-25 12:38:57,191][2409033] Saving new best policy, reward=0.469!
[2023-02-25 12:38:57,228][2409077] DAMAGECOUNT value on done: 748.0
[2023-02-25 12:38:57,229][2409077] Sum rewards: 2.362, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.848', 'AMMO2': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.021', 'weapon5': '0.038', 'ARMOR': '0.044', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.250', 'weapon4': '0.422', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.771', 'weapon2': '1.350', 'weapon3': '1.546', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:38:57,257][2409597] DAMAGECOUNT value on done: 1053.0
[2023-02-25 12:38:57,260][2409597] Sum rewards: 4.626, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.027', 'AMMO2': '0.000', 'AMMO4': '0.001', 'WEAPON1': '0.010', 'AMMO3': '0.030', 'WEAPON4': '0.050', 'HITCOUNT': '0.210', 'weapon4': '0.232', 'WEAPON3': '0.250', 'ARMOR': '0.479', 'weapon3': '0.784', 'weapon2': '0.896', 'DAMAGECOUNT': '0.960', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:38:57,467][2409866] DAMAGECOUNT value on done: 1136.0
[2023-02-25 12:38:57,468][2409866] Sum rewards: 7.128, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.130', 'AMMO2': '0.004', 'AMMO4': '0.021', 'WEAPON1': '0.030', 'AMMO3': '0.065', 'WEAPON4': '0.100', 'weapon4': '0.242', 'HITCOUNT': '0.390', 'WEAPON3': '0.450', 'ARMOR': '0.482', 'weapon2': '1.290', 'weapon3': '1.422', 'DAMAGECOUNT': '1.512', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:38:57,628][2409389] DAMAGECOUNT value on done: 778.0
[2023-02-25 12:38:57,630][2409389] Sum rewards: 3.960, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.160', 'weapon4': '0.008', 'AMMO2': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.049', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'HITCOUNT': '0.380', 'ARMOR': '0.455', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.197', 'weapon3': '1.814', 'weapon2': '1.940', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:38:57,821][2409078] DAMAGECOUNT value on done: 762.0
[2023-02-25 12:38:57,822][2409078] Sum rewards: 0.424, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.009', 'AMMO3': '0.040', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'HEALTH': '0.105', 'HITCOUNT': '0.110', 'weapon4': '0.226', 'WEAPON3': '0.250', 'DAMAGECOUNT': '0.375', 'ARMOR': '0.532', 'weapon3': '0.662', 'FRAGCOUNT': '1.000', 'weapon2': '1.470'}
[2023-02-25 12:38:57,866][2409355] DAMAGECOUNT value on done: 586.0
[2023-02-25 12:38:57,899][2409469] DAMAGECOUNT value on done: 801.0
[2023-02-25 12:38:57,903][2409469] Sum rewards: 0.962, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.017', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.017', 'weapon5': '0.028', 'AMMO4': '0.083', 'AMMO3': '0.115', 'WEAPON5': '0.200', 'HITCOUNT': '0.450', 'WEAPON3': '0.750', 'weapon2': '1.138', 'DAMAGECOUNT': '1.686', 'weapon3': '1.988', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:38:57,973][2409105] DAMAGECOUNT value on done: 1004.0
[2023-02-25 12:38:57,975][2409105] Sum rewards: -0.515, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.888', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.004', 'AMMO2': '0.010', 'AMMO4': '0.048', 'AMMO3': '0.060', 'weapon5': '0.096', 'WEAPON5': '0.100', 'HITCOUNT': '0.290', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'weapon4': '0.530', 'DAMAGECOUNT': '0.762', 'ARMOR': '0.914', 'weapon3': '0.934', 'weapon2': '1.726'}
[2023-02-25 12:38:58,466][2409405] DAMAGECOUNT value on done: 901.0
[2023-02-25 12:38:58,467][2409405] Sum rewards: 1.319, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.415', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'AMMO3': '0.074', 'AMMO4': '0.085', 'WEAPON4': '0.200', 'HITCOUNT': '0.240', 'weapon4': '0.410', 'ARMOR': '0.432', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.831', 'weapon2': '1.236', 'weapon3': '1.368', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:38:58,734][2409549] DAMAGECOUNT value on done: 719.0
[2023-02-25 12:38:58,737][2409549] Sum rewards: 0.180, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.054', 'AMMO5': '0.009', 'AMMO2': '0.011', 'WEAPON1': '0.040', 'AMMO4': '0.056', 'weapon5': '0.074', 'AMMO3': '0.090', 'WEAPON5': '0.200', 'HITCOUNT': '0.310', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.990', 'weapon2': '1.610', 'weapon3': '1.894', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:38:58,988][2409074] Updated weights for policy 0, policy_version 7361 (0.0012)
[2023-02-25 12:38:59,161][2409101] DAMAGECOUNT value on done: 860.0
[2023-02-25 12:38:59,164][2409101] Sum rewards: 0.481, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.380', 'ARMOR': '0.004', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.073', 'AMMO3': '0.075', 'WEAPON4': '0.250', 'weapon4': '0.318', 'HITCOUNT': '0.400', 'WEAPON3': '0.500', 'weapon2': '1.276', 'DAMAGECOUNT': '1.410', 'weapon3': '1.520', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:38:59,318][2409076] DAMAGECOUNT value on done: 1249.0
[2023-02-25 12:38:59,323][2409076] Sum rewards: -3.260, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.590', 'AMMO2': '0.012', 'AMMO4': '0.062', 'ARMOR': '0.064', 'AMMO3': '0.134', 'WEAPON4': '0.150', 'HITCOUNT': '0.200', 'weapon4': '0.248', 'DAMAGECOUNT': '0.696', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.496', 'weapon2': '1.518'}
[2023-02-25 12:38:59,324][2409097] DAMAGECOUNT value on done: 1113.0
[2023-02-25 12:38:59,325][2409097] Sum rewards: 2.894, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.657', 'AMMO5': '0.005', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.026', 'AMMO4': '0.027', 'WEAPON5': '0.050', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'weapon4': '0.346', 'HITCOUNT': '0.410', 'ARMOR': '0.436', 'WEAPON3': '0.650', 'weapon3': '1.572', 'weapon2': '1.588', 'DAMAGECOUNT': '1.920', 'FRAGCOUNT': '4.500'}
[2023-02-25 12:38:59,453][2409075] DAMAGECOUNT value on done: 1175.0
[2023-02-25 12:38:59,454][2409075] Sum rewards: 2.255, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.721', 'AMMO5': '0.003', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'weapon5': '0.018', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'weapon4': '0.182', 'HITCOUNT': '0.360', 'WEAPON3': '0.500', 'weapon3': '1.496', 'weapon2': '1.776', 'DAMAGECOUNT': '1.791', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:38:59,495][2409486] DAMAGECOUNT value on done: 928.0
[2023-02-25 12:38:59,496][2409486] Sum rewards: -1.366, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.778', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.048', 'weapon7': '0.048', 'AMMO3': '0.085', 'AMMO4': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.346', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.555', 'weapon2': '0.744', 'FRAGCOUNT': '1.000', 'weapon3': '1.308'}
[2023-02-25 12:38:59,567][2409100] DAMAGECOUNT value on done: 623.0
[2023-02-25 12:38:59,568][2409100] Sum rewards: 3.743, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.440', 'WEAPON1': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.020', 'AMMO3': '0.085', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'HITCOUNT': '0.260', 'weapon4': '0.370', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.029', 'weapon3': '1.658', 'weapon2': '1.686', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:38:59,775][2409407] DAMAGECOUNT value on done: 1364.0
[2023-02-25 12:38:59,778][2409407] Sum rewards: 1.111, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.806', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO3': '0.073', 'HITCOUNT': '0.130', 'DAMAGECOUNT': '0.381', 'WEAPON3': '0.400', 'weapon2': '0.472', 'ARMOR': '0.543', 'FRAGCOUNT': '1.000', 'weapon3': '1.200'}
[2023-02-25 12:39:00,018][2409406] DAMAGECOUNT value on done: 1087.0
[2023-02-25 12:39:00,019][2409406] Sum rewards: 1.678, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.165', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.063', 'AMMO3': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.162', 'HITCOUNT': '0.480', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.548', 'weapon3': '1.590', 'weapon2': '1.770', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:00,148][2409096] DAMAGECOUNT value on done: 604.0
[2023-02-25 12:39:00,148][2409096] Sum rewards: 0.731, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.297', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.012', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.122', 'weapon4': '0.138', 'WEAPON4': '0.150', 'HITCOUNT': '0.190', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.840', 'weapon2': '1.196', 'weapon3': '1.474', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:00,383][2409074] Updated weights for policy 0, policy_version 7371 (0.0012)
[2023-02-25 12:39:00,573][2409104] DAMAGECOUNT value on done: 1002.0
[2023-02-25 12:39:00,574][2409104] Sum rewards: 1.735, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.052', 'AMMO2': '0.000', 'AMMO4': '0.001', 'WEAPON1': '0.040', 'ARMOR': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'weapon4': '0.252', 'HITCOUNT': '0.400', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.302', 'weapon3': '1.430', 'weapon2': '1.904', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:00,661][2409102] DAMAGECOUNT value on done: 1046.0
[2023-02-25 12:39:00,662][2409102] Sum rewards: 0.753, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.948', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'weapon5': '0.036', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'WEAPON4': '0.150', 'weapon4': '0.234', 'HITCOUNT': '0.310', 'WEAPON3': '0.700', 'weapon2': '1.170', 'DAMAGECOUNT': '1.215', 'weapon3': '1.994', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:00,706][2409103] DAMAGECOUNT value on done: 822.0
[2023-02-25 12:39:00,709][2409103] Sum rewards: -1.600, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.406', 'WEAPON1': '0.010', 'AMMO2': '0.029', 'weapon7': '0.040', 'AMMO3': '0.060', 'AMMO4': '0.147', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'HITCOUNT': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.300', 'ARMOR': '0.408', 'weapon4': '0.576', 'DAMAGECOUNT': '0.864', 'weapon3': '1.282', 'weapon2': '1.770', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:00,736][2409565] DAMAGECOUNT value on done: 948.0
[2023-02-25 12:39:00,740][2409565] Sum rewards: -3.228, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.630', 'FRAGCOUNT': '0.000', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon5': '0.070', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'weapon4': '0.224', 'WEAPON4': '0.250', 'HITCOUNT': '0.360', 'ARMOR': '0.470', 'WEAPON3': '0.750', 'weapon2': '1.300', 'DAMAGECOUNT': '1.419', 'weapon3': '1.982'}
[2023-02-25 12:39:00,764][2409548] DAMAGECOUNT value on done: 1138.0
[2023-02-25 12:39:00,767][2409548] Sum rewards: -2.551, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.300', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.011', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.070', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'weapon4': '0.228', 'WEAPON3': '0.450', 'ARMOR': '0.512', 'DAMAGECOUNT': '0.675', 'weapon3': '1.288', 'weapon2': '1.546'}
[2023-02-25 12:39:00,856][2409596] DAMAGECOUNT value on done: 732.0
[2023-02-25 12:39:00,859][2409596] Sum rewards: -0.175, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.186', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO5': '0.003', 'weapon5': '0.060', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'weapon4': '0.164', 'HITCOUNT': '0.230', 'ARMOR': '0.468', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.702', 'FRAGCOUNT': '1.000', 'weapon3': '1.250', 'weapon2': '1.480'}
[2023-02-25 12:39:00,872][2409077] DAMAGECOUNT value on done: 1534.0
[2023-02-25 12:39:00,875][2409077] Sum rewards: 9.186, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.578', 'AMMO2': '0.005', 'AMMO5': '0.008', 'AMMO4': '0.023', 'ARMOR': '0.060', 'weapon7': '0.066', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.124', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.208', 'HITCOUNT': '0.470', 'WEAPON3': '0.550', 'weapon2': '1.296', 'weapon3': '1.432', 'DAMAGECOUNT': '2.247', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:39:00,904][2409373] DAMAGECOUNT value on done: 981.0
[2023-02-25 12:39:00,905][2409373] Sum rewards: 0.606, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.679', 'AMMO2': '0.013', 'AMMO3': '0.050', 'AMMO4': '0.066', 'HITCOUNT': '0.110', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'ARMOR': '0.518', 'DAMAGECOUNT': '0.630', 'weapon4': '0.674', 'weapon2': '0.742', 'FRAGCOUNT': '1.000', 'weapon3': '1.282'}
[2023-02-25 12:39:01,066][2409485] DAMAGECOUNT value on done: 1301.0
[2023-02-25 12:39:01,068][2409485] Sum rewards: 4.138, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'HEALTH': '0.030', 'AMMO3': '0.079', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'weapon5': '0.102', 'WEAPON4': '0.150', 'HITCOUNT': '0.390', 'WEAPON3': '0.400', 'weapon4': '0.460', 'ARMOR': '0.900', 'weapon2': '1.288', 'weapon3': '1.414', 'DAMAGECOUNT': '1.455', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:01,205][2409597] DAMAGECOUNT value on done: 1170.0
[2023-02-25 12:39:01,207][2409597] Sum rewards: 3.866, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.312', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.007', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.156', 'HITCOUNT': '0.390', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.269', 'weapon3': '1.660', 'weapon2': '1.824', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:01,315][2409389] DAMAGECOUNT value on done: 908.0
[2023-02-25 12:39:01,316][2409389] Sum rewards: 5.950, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.963', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.018', 'weapon7': '0.048', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'weapon4': '0.228', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.350', 'WEAPON3': '0.400', 'ARMOR': '0.862', 'weapon3': '0.968', 'DAMAGECOUNT': '1.257', 'weapon2': '1.858', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:39:01,515][2409866] DAMAGECOUNT value on done: 898.0
[2023-02-25 12:39:01,516][2409866] Sum rewards: 1.196, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.412', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.093', 'AMMO4': '0.146', 'HITCOUNT': '0.220', 'WEAPON4': '0.350', 'ARMOR': '0.420', 'weapon4': '0.458', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.684', 'weapon2': '1.162', 'weapon3': '1.926', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:01,817][2409078] DAMAGECOUNT value on done: 763.0
[2023-02-25 12:39:01,818][2409078] Sum rewards: 2.433, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.114', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'weapon4': '0.052', 'AMMO4': '0.074', 'AMMO3': '0.095', 'HITCOUNT': '0.320', 'ARMOR': '0.516', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.993', 'weapon3': '1.438', 'weapon2': '1.944', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:39:01,911][2409355] DAMAGECOUNT value on done: 338.0
[2023-02-25 12:39:01,912][2409355] Sum rewards: -3.436, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.200', 'AMMO5': '0.003', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'ARMOR': '0.020', 'AMMO4': '0.039', 'HITCOUNT': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'weapon5': '0.086', 'DAMAGECOUNT': '0.111', 'WEAPON4': '0.200', 'weapon4': '0.252', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.358', 'weapon2': '1.458'}
[2023-02-25 12:39:01,963][2409105] DAMAGECOUNT value on done: 1106.0
[2023-02-25 12:39:01,964][2409105] Sum rewards: 3.547, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.852', 'AMMO5': '0.004', 'AMMO2': '0.005', 'AMMO4': '0.027', 'ARMOR': '0.032', 'weapon5': '0.036', 'weapon4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.128', 'HITCOUNT': '0.350', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.509', 'weapon3': '1.804', 'weapon2': '1.906', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:39:02,186][2408954] Fps is (10 sec: 24985.5, 60 sec: 24917.4, 300 sec: 24784.3). Total num frames: 30228480. Throughput: 0: 6247.2. Samples: 7565256. Policy #0 lag: (min: 0.0, avg: 11.5, max: 25.0)
[2023-02-25 12:39:02,186][2408954] Avg episode reward: [(0, '0.826')]
[2023-02-25 12:39:02,187][2409033] Saving new best policy, reward=0.826!
[2023-02-25 12:39:02,421][2409405] DAMAGECOUNT value on done: 874.0
[2023-02-25 12:39:02,424][2409405] Sum rewards: -2.032, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.020', 'AMMO2': '0.011', 'weapon7': '0.050', 'AMMO4': '0.053', 'ARMOR': '0.056', 'AMMO3': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.190', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon3': '0.448', 'weapon4': '0.486', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.630', 'weapon2': '1.382', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:02,487][2409469] DAMAGECOUNT value on done: 1264.0
[2023-02-25 12:39:02,487][2409469] Sum rewards: 1.215, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.188', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'AMMO3': '0.077', 'AMMO4': '0.085', 'WEAPON4': '0.250', 'HITCOUNT': '0.250', 'weapon4': '0.494', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.870', 'weapon2': '1.344', 'weapon3': '1.468', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:02,496][2409074] Updated weights for policy 0, policy_version 7381 (0.0013)
[2023-02-25 12:39:03,087][2409097] DAMAGECOUNT value on done: 350.0
[2023-02-25 12:39:03,196][2409075] DAMAGECOUNT value on done: 1016.0
[2023-02-25 12:39:03,199][2409075] Sum rewards: 2.736, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'AMMO3': '0.063', 'weapon5': '0.070', 'WEAPON4': '0.100', 'HEALTH': '0.111', 'AMMO4': '0.166', 'weapon4': '0.354', 'WEAPON3': '0.400', 'HITCOUNT': '0.430', 'weapon3': '1.212', 'weapon2': '1.264', 'DAMAGECOUNT': '1.722', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:03,235][2409549] DAMAGECOUNT value on done: 842.0
[2023-02-25 12:39:03,256][2409486] DAMAGECOUNT value on done: 1432.0
[2023-02-25 12:39:03,257][2409486] Sum rewards: -4.058, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.218', 'AMMO4': '-0.054', 'AMMO2': '-0.011', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon5': '0.076', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.210', 'ARMOR': '0.858', 'DAMAGECOUNT': '0.957', 'WEAPON3': '1.050', 'FRAGCOUNT': '1.500', 'weapon2': '1.822', 'weapon3': '1.924'}
[2023-02-25 12:39:03,273][2409076] DAMAGECOUNT value on done: 1027.0
[2023-02-25 12:39:03,278][2409076] Sum rewards: -0.450, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.784', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.090', 'AMMO3': '0.116', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'HITCOUNT': '0.320', 'weapon4': '0.370', 'ARMOR': '0.525', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.906', 'weapon2': '0.974', 'FRAGCOUNT': '1.000', 'weapon3': '1.542'}
[2023-02-25 12:39:03,309][2409100] DAMAGECOUNT value on done: 568.0
[2023-02-25 12:39:03,310][2409100] Sum rewards: 1.698, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.676', 'AMMO5': '0.003', 'AMMO2': '0.024', 'AMMO3': '0.074', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'HITCOUNT': '0.270', 'WEAPON4': '0.350', 'WEAPON3': '0.500', 'ARMOR': '0.555', 'weapon4': '0.658', 'DAMAGECOUNT': '0.825', 'weapon3': '1.100', 'weapon2': '1.456', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:03,600][2409407] DAMAGECOUNT value on done: 598.0
[2023-02-25 12:39:03,603][2409407] Sum rewards: -0.756, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.107', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.024', 'AMMO4': '0.048', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'weapon4': '0.236', 'DAMAGECOUNT': '0.465', 'ARMOR': '0.474', 'WEAPON3': '0.600', 'weapon3': '1.368', 'weapon2': '1.626', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:03,609][2409101] DAMAGECOUNT value on done: 956.0
[2023-02-25 12:39:03,838][2409406] DAMAGECOUNT value on done: 637.0
[2023-02-25 12:39:03,842][2409406] Sum rewards: 2.833, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.204', 'AMMO2': '0.009', 'WEAPON1': '0.030', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'weapon4': '0.058', 'AMMO3': '0.088', 'HITCOUNT': '0.120', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.450', 'ARMOR': '0.482', 'weapon3': '1.238', 'weapon2': '1.840', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:03,918][2409074] Updated weights for policy 0, policy_version 7391 (0.0013)
[2023-02-25 12:39:04,371][2409104] DAMAGECOUNT value on done: 1137.0
[2023-02-25 12:39:04,372][2409104] Sum rewards: -0.142, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.809', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'ARMOR': '0.024', 'WEAPON4': '0.050', 'weapon5': '0.054', 'AMMO3': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'weapon4': '0.164', 'HITCOUNT': '0.320', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.996', 'FRAGCOUNT': '1.000', 'weapon3': '1.188', 'weapon2': '2.000'}
[2023-02-25 12:39:04,528][2409102] DAMAGECOUNT value on done: 777.0
[2023-02-25 12:39:04,544][2409102] Sum rewards: -3.433, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.915', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.008', 'weapon5': '0.020', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.102', 'HITCOUNT': '0.330', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.266', 'weapon2': '1.690', 'weapon3': '1.832'}
[2023-02-25 12:39:04,590][2409096] DAMAGECOUNT value on done: 765.0
[2023-02-25 12:39:04,592][2409096] Sum rewards: -2.009, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.940', 'AMMO2': '0.011', 'AMMO5': '0.012', 'AMMO4': '0.055', 'weapon5': '0.084', 'AMMO3': '0.097', 'WEAPON5': '0.150', 'HITCOUNT': '0.180', 'WEAPON4': '0.250', 'FRAGCOUNT': '0.500', 'ARMOR': '0.503', 'WEAPON3': '0.600', 'weapon4': '0.636', 'DAMAGECOUNT': '0.870', 'weapon2': '1.190', 'weapon3': '1.292'}
[2023-02-25 12:39:04,591][2409548] DAMAGECOUNT value on done: 815.0
[2023-02-25 12:39:04,596][2409548] Sum rewards: 1.925, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.374', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.075', 'weapon4': '0.242', 'HITCOUNT': '0.370', 'WEAPON3': '0.450', 'ARMOR': '0.946', 'FRAGCOUNT': '1.000', 'weapon3': '1.190', 'DAMAGECOUNT': '1.218', 'weapon2': '1.934'}
[2023-02-25 12:39:04,626][2409596] DAMAGECOUNT value on done: 854.0
[2023-02-25 12:39:04,629][2409596] Sum rewards: 3.637, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.430', 'AMMO5': '0.011', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'weapon5': '0.052', 'AMMO3': '0.071', 'AMMO4': '0.084', 'weapon4': '0.214', 'WEAPON5': '0.250', 'HITCOUNT': '0.330', 'WEAPON3': '0.500', 'ARMOR': '0.828', 'weapon2': '0.890', 'weapon3': '1.040', 'DAMAGECOUNT': '1.230', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:04,726][2409077] DAMAGECOUNT value on done: 954.0
[2023-02-25 12:39:04,729][2409077] Sum rewards: -1.261, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.776', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON1': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.061', 'HITCOUNT': '0.190', 'ARMOR': '0.451', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.600', 'weapon3': '1.276', 'weapon2': '2.044'}
[2023-02-25 12:39:04,811][2409565] DAMAGECOUNT value on done: 568.0
[2023-02-25 12:39:04,816][2409565] Sum rewards: -0.691, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.388', 'AMMO5': '0.006', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.038', 'AMMO3': '0.086', 'WEAPON5': '0.150', 'HITCOUNT': '0.160', 'weapon5': '0.170', 'WEAPON4': '0.200', 'ARMOR': '0.448', 'weapon4': '0.450', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.504', 'FRAGCOUNT': '1.000', 'weapon3': '1.332', 'weapon2': '1.374'}
[2023-02-25 12:39:04,822][2409373] DAMAGECOUNT value on done: 1205.0
[2023-02-25 12:39:04,823][2409373] Sum rewards: 4.019, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.414', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.042', 'weapon5': '0.076', 'AMMO3': '0.095', 'WEAPON5': '0.150', 'HITCOUNT': '0.340', 'ARMOR': '0.404', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.350', 'weapon3': '1.626', 'weapon2': '1.886', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:04,959][2409389] DAMAGECOUNT value on done: 902.0
[2023-02-25 12:39:05,191][2409866] DAMAGECOUNT value on done: 774.0
[2023-02-25 12:39:05,267][2409074] Updated weights for policy 0, policy_version 7401 (0.0012)
[2023-02-25 12:39:05,331][2409079] DAMAGECOUNT value on done: 562.0
[2023-02-25 12:39:05,570][2409355] DAMAGECOUNT value on done: 1111.0
[2023-02-25 12:39:05,575][2409355] Sum rewards: -2.750, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.088', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.029', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.056', 'AMMO4': '0.147', 'HITCOUNT': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.386', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.450', 'weapon3': '1.164', 'weapon2': '1.584'}
[2023-02-25 12:39:05,577][2409078] DAMAGECOUNT value on done: 563.0
[2023-02-25 12:39:05,580][2409078] Sum rewards: 3.258, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.290', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'WEAPON4': '0.050', 'AMMO3': '0.057', 'weapon4': '0.116', 'HITCOUNT': '0.290', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.786', 'weapon3': '1.012', 'weapon2': '2.088', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:05,719][2409103] DAMAGECOUNT value on done: 734.0
[2023-02-25 12:39:05,826][2409097] Large shaping reward -2.537 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28800000000000003, -96.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 12:39:05,918][2409597] DAMAGECOUNT value on done: 938.0
[2023-02-25 12:39:05,922][2409597] Sum rewards: -0.866, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.770', 'AMMO2': '0.014', 'AMMO4': '0.069', 'AMMO3': '0.108', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'weapon4': '0.262', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.684', 'ARMOR': '0.887', 'FRAGCOUNT': '1.000', 'weapon3': '1.396', 'weapon2': '2.024'}
[2023-02-25 12:39:05,942][2409485] DAMAGECOUNT value on done: 705.0
[2023-02-25 12:39:05,945][2409485] Sum rewards: 1.539, reward structure: {'DEATHCOUNT': '-4.500', 'WEAPON1': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.022', 'AMMO3': '0.066', 'WEAPON4': '0.100', 'AMMO4': '0.107', 'HITCOUNT': '0.180', 'weapon4': '0.240', 'WEAPON3': '0.350', 'HEALTH': '0.494', 'DAMAGECOUNT': '0.540', 'FRAGCOUNT': '1.000', 'weapon3': '1.304', 'weapon2': '1.610'}
[2023-02-25 12:39:06,414][2409405] DAMAGECOUNT value on done: 715.0
[2023-02-25 12:39:06,415][2409405] Sum rewards: -2.102, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.473', 'AMMO5': '0.006', 'AMMO2': '0.031', 'ARMOR': '0.056', 'weapon5': '0.098', 'weapon7': '0.100', 'AMMO3': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.156', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.230', 'weapon4': '0.496', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.888', 'FRAGCOUNT': '1.000', 'weapon3': '1.384', 'weapon2': '1.428'}
[2023-02-25 12:39:06,702][2409105] DAMAGECOUNT value on done: 1237.0
[2023-02-25 12:39:06,703][2409105] Sum rewards: -0.813, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.652', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'WEAPON4': '0.100', 'AMMO3': '0.155', 'weapon4': '0.166', 'weapon5': '0.178', 'WEAPON5': '0.250', 'HITCOUNT': '0.300', 'ARMOR': '0.885', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.521', 'weapon3': '1.564', 'weapon2': '1.840', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:06,732][2409469] DAMAGECOUNT value on done: 850.0
[2023-02-25 12:39:06,735][2409469] Sum rewards: 1.228, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.502', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO3': '0.063', 'weapon5': '0.064', 'AMMO4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.158', 'WEAPON4': '0.200', 'HITCOUNT': '0.270', 'WEAPON3': '0.450', 'ARMOR': '0.460', 'DAMAGECOUNT': '0.768', 'FRAGCOUNT': '1.000', 'weapon3': '1.474', 'weapon2': '1.710'}
[2023-02-25 12:39:06,987][2409097] DAMAGECOUNT value on done: 961.0
[2023-02-25 12:39:06,990][2409097] Sum rewards: 1.106, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.686', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'ARMOR': '0.012', 'weapon5': '0.028', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'HITCOUNT': '0.190', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.780', 'FRAGCOUNT': '1.000', 'weapon3': '1.334', 'weapon2': '1.578'}
[2023-02-25 12:39:07,023][2409075] DAMAGECOUNT value on done: 886.0
[2023-02-25 12:39:07,024][2409075] Sum rewards: -4.945, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.504', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.010', 'WEAPON1': '0.040', 'AMMO4': '0.049', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'weapon4': '0.186', 'WEAPON4': '0.200', 'HITCOUNT': '0.280', 'ARMOR': '0.428', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.915', 'FRAGCOUNT': '1.000', 'weapon3': '1.020', 'weapon2': '2.500'}
[2023-02-25 12:39:07,047][2409100] DAMAGECOUNT value on done: 920.0
[2023-02-25 12:39:07,051][2409100] Sum rewards: -2.607, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.703', 'ARMOR': '0.008', 'AMMO2': '0.008', 'AMMO4': '0.041', 'AMMO3': '0.097', 'WEAPON4': '0.150', 'HITCOUNT': '0.190', 'weapon4': '0.290', 'DAMAGECOUNT': '0.513', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.266', 'weapon3': '1.382'}
[2023-02-25 12:39:07,093][2409074] Updated weights for policy 0, policy_version 7411 (0.0012)
[2023-02-25 12:39:07,182][2409486] DAMAGECOUNT value on done: 832.0
[2023-02-25 12:39:07,186][2408954] Fps is (10 sec: 24165.6, 60 sec: 24917.2, 300 sec: 24798.1). Total num frames: 30359552. Throughput: 0: 6242.6. Samples: 7583988. Policy #0 lag: (min: 0.0, avg: 12.6, max: 31.0)
[2023-02-25 12:39:07,187][2408954] Avg episode reward: [(0, '0.411')]
[2023-02-25 12:39:07,263][2409549] DAMAGECOUNT value on done: 1121.0
[2023-02-25 12:39:07,267][2409549] Sum rewards: 2.833, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.042', 'AMMO4': '0.074', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'HEALTH': '0.119', 'WEAPON4': '0.150', 'weapon4': '0.354', 'ARMOR': '0.432', 'HITCOUNT': '0.470', 'WEAPON3': '0.600', 'weapon3': '1.548', 'DAMAGECOUNT': '1.626', 'weapon2': '1.702', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:07,286][2409076] DAMAGECOUNT value on done: 805.0
[2023-02-25 12:39:07,286][2409076] Sum rewards: -0.564, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.782', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'weapon5': '0.100', 'weapon4': '0.106', 'AMMO3': '0.116', 'WEAPON5': '0.150', 'HITCOUNT': '0.340', 'FRAGCOUNT': '0.500', 'weapon2': '0.650', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.458', 'weapon3': '2.636'}
[2023-02-25 12:39:07,512][2409407] DAMAGECOUNT value on done: 1210.0
[2023-02-25 12:39:07,514][2409407] Sum rewards: 2.457, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.956', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.016', 'WEAPON1': '0.020', 'weapon5': '0.100', 'AMMO3': '0.126', 'WEAPON5': '0.200', 'HITCOUNT': '0.440', 'WEAPON3': '0.850', 'weapon2': '1.534', 'DAMAGECOUNT': '1.752', 'weapon3': '1.864', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:07,608][2409101] DAMAGECOUNT value on done: 596.0
[2023-02-25 12:39:07,611][2409101] Sum rewards: -2.423, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.910', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'weapon4': '0.002', 'WEAPON4': '0.050', 'AMMO3': '0.118', 'HITCOUNT': '0.250', 'ARMOR': '0.451', 'DAMAGECOUNT': '0.723', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.512', 'weapon3': '2.042'}
[2023-02-25 12:39:07,746][2409406] DAMAGECOUNT value on done: 1154.0
[2023-02-25 12:39:07,746][2409406] Sum rewards: -0.071, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO3': '0.088', 'AMMO4': '0.091', 'weapon5': '0.118', 'WEAPON5': '0.150', 'HEALTH': '0.180', 'HITCOUNT': '0.220', 'ARMOR': '0.464', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.556', 'DAMAGECOUNT': '1.734', 'weapon2': '2.042'}
[2023-02-25 12:39:08,344][2409104] DAMAGECOUNT value on done: 716.0
[2023-02-25 12:39:08,345][2409104] Sum rewards: -0.586, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.511', 'AMMO4': '-0.064', 'AMMO2': '-0.013', 'WEAPON1': '0.020', 'ARMOR': '0.048', 'AMMO3': '0.129', 'HITCOUNT': '0.300', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.059', 'weapon3': '1.796', 'weapon2': '2.100', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:08,370][2409102] DAMAGECOUNT value on done: 1047.0
[2023-02-25 12:39:08,370][2409102] Sum rewards: 3.824, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.280', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO3': '0.095', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'HITCOUNT': '0.400', 'ARMOR': '0.480', 'weapon4': '0.582', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.401', 'weapon2': '1.430', 'weapon3': '1.468', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:08,440][2409548] DAMAGECOUNT value on done: 1494.0
[2023-02-25 12:39:08,443][2409548] Sum rewards: -0.739, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.560', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'weapon5': '0.020', 'ARMOR': '0.035', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.368', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.957', 'weapon2': '1.412', 'weapon3': '1.670', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:08,449][2409074] Updated weights for policy 0, policy_version 7421 (0.0012)
[2023-02-25 12:39:08,472][2409565] DAMAGECOUNT value on done: 725.0
[2023-02-25 12:39:08,473][2409565] Sum rewards: 0.944, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'HEALTH': '0.060', 'weapon5': '0.072', 'AMMO4': '0.113', 'AMMO3': '0.117', 'weapon4': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.250', 'ARMOR': '0.440', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.146', 'weapon2': '1.464', 'weapon3': '1.896', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:08,561][2409596] DAMAGECOUNT value on done: 1105.0
[2023-02-25 12:39:08,561][2409596] Sum rewards: 0.668, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.935', 'AMMO4': '-0.061', 'AMMO2': '-0.012', 'AMMO3': '0.080', 'HITCOUNT': '0.190', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.702', 'FRAGCOUNT': '1.000', 'weapon3': '1.052', 'weapon2': '1.352'}
[2023-02-25 12:39:08,570][2409077] DAMAGECOUNT value on done: 946.0
[2023-02-25 12:39:08,571][2409077] Sum rewards: -0.833, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.764', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.005', 'weapon5': '0.006', 'WEAPON1': '0.010', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.124', 'weapon4': '0.130', 'HITCOUNT': '0.260', 'ARMOR': '0.493', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.140', 'weapon3': '1.376', 'weapon2': '1.730', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:08,612][2409096] DAMAGECOUNT value on done: 590.0
[2023-02-25 12:39:08,613][2409096] Sum rewards: -2.478, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.037', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.099', 'HITCOUNT': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.336', 'ARMOR': '0.468', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.735', 'FRAGCOUNT': '1.000', 'weapon3': '1.398', 'weapon2': '1.674'}
[2023-02-25 12:39:08,775][2409866] DAMAGECOUNT value on done: 1223.0
[2023-02-25 12:39:08,776][2409866] Sum rewards: 3.294, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.494', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.033', 'ARMOR': '0.040', 'weapon5': '0.096', 'AMMO3': '0.118', 'weapon4': '0.136', 'AMMO4': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.510', 'WEAPON3': '0.700', 'weapon2': '1.270', 'weapon3': '1.854', 'DAMAGECOUNT': '1.893', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:39:08,827][2409389] DAMAGECOUNT value on done: 721.0
[2023-02-25 12:39:08,830][2409389] Sum rewards: -0.147, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.888', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.018', 'ARMOR': '0.032', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.104', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'weapon4': '0.220', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.939', 'weapon2': '1.330', 'weapon3': '1.544', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:08,971][2409079] DAMAGECOUNT value on done: 652.0
[2023-02-25 12:39:08,971][2409079] Sum rewards: -1.949, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.874', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON5': '0.050', 'weapon5': '0.078', 'AMMO3': '0.089', 'HITCOUNT': '0.120', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.327', 'weapon4': '0.336', 'WEAPON3': '0.550', 'ARMOR': '0.895', 'weapon3': '1.224', 'weapon2': '1.618'}
[2023-02-25 12:39:09,072][2409373] DAMAGECOUNT value on done: 1168.0
[2023-02-25 12:39:09,073][2409373] Sum rewards: -3.436, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.673', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'weapon4': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'weapon5': '0.084', 'AMMO3': '0.140', 'HITCOUNT': '0.310', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.224', 'weapon3': '1.556', 'weapon2': '1.808'}
[2023-02-25 12:39:09,275][2409355] DAMAGECOUNT value on done: 1216.0
[2023-02-25 12:39:09,277][2409355] Sum rewards: 4.430, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.465', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'AMMO3': '0.074', 'AMMO4': '0.135', 'weapon4': '0.230', 'WEAPON4': '0.300', 'HITCOUNT': '0.380', 'WEAPON3': '0.400', 'ARMOR': '0.937', 'DAMAGECOUNT': '1.413', 'weapon2': '1.734', 'weapon3': '1.754', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:39:09,544][2409078] DAMAGECOUNT value on done: 936.0
[2023-02-25 12:39:09,545][2409078] Sum rewards: 0.450, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.026', 'AMMO2': '0.022', 'ARMOR': '0.028', 'AMMO3': '0.069', 'AMMO4': '0.110', 'WEAPON4': '0.300', 'HITCOUNT': '0.380', 'weapon4': '0.382', 'WEAPON3': '0.400', 'weapon3': '0.984', 'DAMAGECOUNT': '1.314', 'weapon2': '1.986', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:09,566][2409103] DAMAGECOUNT value on done: 963.0
[2023-02-25 12:39:09,567][2409103] Sum rewards: -0.754, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.109', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.068', 'weapon4': '0.104', 'HITCOUNT': '0.120', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.456', 'FRAGCOUNT': '1.000', 'weapon3': '1.168', 'weapon2': '1.490'}
[2023-02-25 12:39:09,943][2409485] DAMAGECOUNT value on done: 869.0
[2023-02-25 12:39:09,946][2409485] Sum rewards: 4.973, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.157', 'AMMO2': '0.009', 'ARMOR': '0.036', 'AMMO4': '0.045', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'weapon4': '0.106', 'HITCOUNT': '0.380', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.344', 'weapon2': '1.584', 'weapon3': '1.740', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:10,039][2409597] DAMAGECOUNT value on done: 913.0
[2023-02-25 12:39:10,040][2409597] Sum rewards: 1.172, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.218', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO5': '0.003', 'AMMO3': '0.119', 'HITCOUNT': '0.380', 'ARMOR': '0.489', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.320', 'weapon2': '1.492', 'weapon3': '1.586', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:10,059][2409405] DAMAGECOUNT value on done: 706.0
[2023-02-25 12:39:10,061][2409405] Sum rewards: 0.478, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.224', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.092', 'AMMO3': '0.097', 'WEAPON4': '0.150', 'HITCOUNT': '0.200', 'weapon4': '0.260', 'ARMOR': '0.518', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.858', 'weapon3': '1.084', 'weapon2': '2.174', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:10,481][2409074] Updated weights for policy 0, policy_version 7431 (0.0012)
[2023-02-25 12:39:10,694][2409469] DAMAGECOUNT value on done: 1058.0
[2023-02-25 12:39:10,699][2409469] Sum rewards: 0.824, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.003', 'weapon7': '0.034', 'AMMO2': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.073', 'HITCOUNT': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'HEALTH': '0.192', 'AMMO4': '0.211', 'WEAPON4': '0.350', 'WEAPON3': '0.350', 'ARMOR': '0.452', 'weapon4': '0.512', 'DAMAGECOUNT': '0.735', 'weapon3': '1.352', 'weapon2': '1.568', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:10,737][2409099] DAMAGECOUNT value on done: 1147.0
[2023-02-25 12:39:10,738][2409099] Sum rewards: 1.208, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.074', 'weapon4': '0.176', 'HEALTH': '0.265', 'HITCOUNT': '0.270', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.912', 'FRAGCOUNT': '1.000', 'weapon3': '1.582', 'weapon2': '1.594'}
[2023-02-25 12:39:10,774][2409105] DAMAGECOUNT value on done: 1092.0
[2023-02-25 12:39:10,777][2409105] Sum rewards: -2.507, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.046', 'AMMO2': '0.003', 'AMMO4': '0.014', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'WEAPON4': '0.100', 'weapon4': '0.126', 'AMMO3': '0.138', 'HITCOUNT': '0.240', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.804', 'weapon3': '1.488', 'weapon2': '1.778', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:10,905][2409100] DAMAGECOUNT value on done: 756.0
[2023-02-25 12:39:10,908][2409100] Sum rewards: 1.517, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.028', 'AMMO4': '0.043', 'ARMOR': '0.052', 'HEALTH': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'HITCOUNT': '0.330', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.188', 'weapon2': '1.756', 'weapon3': '1.938', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:10,973][2409075] DAMAGECOUNT value on done: 625.0
[2023-02-25 12:39:10,976][2409075] Sum rewards: 0.741, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.798', 'AMMO2': '0.007', 'AMMO4': '0.037', 'WEAPON1': '0.050', 'AMMO3': '0.096', 'WEAPON4': '0.200', 'weapon4': '0.202', 'HITCOUNT': '0.300', 'WEAPON3': '0.650', 'ARMOR': '0.899', 'DAMAGECOUNT': '1.218', 'weapon3': '1.638', 'weapon2': '1.742', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:10,998][2409097] DAMAGECOUNT value on done: 736.0
[2023-02-25 12:39:10,999][2409097] Sum rewards: -1.758, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.276', 'AMMO2': '0.005', 'AMMO5': '0.005', 'weapon5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.023', 'ARMOR': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.124', 'HITCOUNT': '0.220', 'WEAPON4': '0.250', 'weapon4': '0.446', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.819', 'weapon2': '1.284', 'weapon3': '1.620', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:11,015][2409486] DAMAGECOUNT value on done: 336.0
[2023-02-25 12:39:11,018][2409486] Sum rewards: -2.825, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.500', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.009', 'weapon5': '0.024', 'ARMOR': '0.036', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'weapon4': '0.250', 'DAMAGECOUNT': '0.318', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.288', 'weapon2': '1.312'}
[2023-02-25 12:39:11,169][2409407] DAMAGECOUNT value on done: 1247.0
[2023-02-25 12:39:11,172][2409407] Sum rewards: 0.527, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.154', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO5': '0.003', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.066', 'weapon4': '0.078', 'AMMO3': '0.083', 'WEAPON5': '0.100', 'HITCOUNT': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.290', 'DAMAGECOUNT': '1.302', 'weapon3': '1.422', 'FRAGCOUNT': '1.500'}
[2023-02-25 12:39:11,476][2409549] DAMAGECOUNT value on done: 964.0
[2023-02-25 12:39:11,477][2409549] Sum rewards: 1.109, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.386', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon4': '0.060', 'weapon7': '0.068', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.230', 'WEAPON3': '0.600', 'ARMOR': '0.800', 'DAMAGECOUNT': '1.032', 'weapon3': '1.328', 'weapon2': '1.356', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:11,484][2409076] DAMAGECOUNT value on done: 832.0
[2023-02-25 12:39:11,485][2409076] Sum rewards: -0.768, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.088', 'weapon4': '0.002', 'AMMO2': '0.007', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.037', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'weapon5': '0.106', 'HITCOUNT': '0.230', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.044', 'weapon3': '1.058', 'ARMOR': '1.389', 'FRAGCOUNT': '2.000', 'weapon2': '2.414'}
[2023-02-25 12:39:11,500][2409406] DAMAGECOUNT value on done: 803.0
[2023-02-25 12:39:11,504][2409406] Sum rewards: -1.698, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.004', 'AMMO2': '0.005', 'AMMO4': '0.024', 'ARMOR': '0.084', 'AMMO3': '0.132', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.418', 'DAMAGECOUNT': '0.699', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.280', 'weapon2': '1.284'}
[2023-02-25 12:39:11,907][2409074] Updated weights for policy 0, policy_version 7441 (0.0012)
[2023-02-25 12:39:12,001][2409101] DAMAGECOUNT value on done: 1004.0
[2023-02-25 12:39:12,002][2409101] Sum rewards: 6.018, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.062', 'weapon5': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.232', 'HEALTH': '0.255', 'HITCOUNT': '0.270', 'WEAPON3': '0.350', 'ARMOR': '0.882', 'weapon3': '0.970', 'weapon2': '1.198', 'DAMAGECOUNT': '1.563', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:12,049][2409102] DAMAGECOUNT value on done: 928.0
[2023-02-25 12:39:12,171][2409565] DAMAGECOUNT value on done: 1167.0
[2023-02-25 12:39:12,174][2409565] Sum rewards: 3.222, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.268', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.030', 'ARMOR': '0.032', 'weapon5': '0.044', 'WEAPON4': '0.050', 'AMMO3': '0.095', 'WEAPON5': '0.150', 'weapon4': '0.284', 'HITCOUNT': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.164', 'DAMAGECOUNT': '1.518', 'weapon3': '1.790', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:12,186][2408954] Fps is (10 sec: 25395.5, 60 sec: 24985.7, 300 sec: 24770.4). Total num frames: 30482432. Throughput: 0: 6232.8. Samples: 7621320. Policy #0 lag: (min: 0.0, avg: 10.3, max: 23.0)
[2023-02-25 12:39:12,186][2408954] Avg episode reward: [(0, '0.223')]
[2023-02-25 12:39:12,279][2409548] DAMAGECOUNT value on done: 866.0
[2023-02-25 12:39:12,279][2409548] Sum rewards: -1.740, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.656', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.022', 'AMMO4': '0.037', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'weapon4': '0.142', 'WEAPON4': '0.150', 'HITCOUNT': '0.440', 'WEAPON3': '0.750', 'ARMOR': '0.872', 'DAMAGECOUNT': '1.395', 'weapon2': '1.718', 'weapon3': '1.898', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:12,335][2409077] DAMAGECOUNT value on done: 1035.0
[2023-02-25 12:39:12,335][2409077] Sum rewards: 0.989, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.052', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.063', 'weapon5': '0.070', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.338', 'HITCOUNT': '0.340', 'ARMOR': '0.498', 'WEAPON3': '0.600', 'weapon3': '1.024', 'DAMAGECOUNT': '1.035', 'weapon2': '1.388', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:12,599][2409096] DAMAGECOUNT value on done: 832.0
[2023-02-25 12:39:12,600][2409096] Sum rewards: 0.596, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.800', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.019', 'WEAPON1': '0.030', 'weapon5': '0.046', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.230', 'weapon4': '0.234', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.981', 'weapon2': '1.522', 'ARMOR': '1.754', 'weapon3': '1.774', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:12,681][2409866] DAMAGECOUNT value on done: 392.0
[2023-02-25 12:39:12,684][2409866] Sum rewards: 0.289, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.026', 'AMMO3': '0.030', 'ARMOR': '0.030', 'WEAPON5': '0.100', 'HITCOUNT': '0.130', 'AMMO4': '0.131', 'WEAPON3': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.276', 'HEALTH': '0.356', 'DAMAGECOUNT': '0.375', 'weapon3': '0.496', 'FRAGCOUNT': '1.000', 'weapon2': '1.528'}
[2023-02-25 12:39:12,785][2409389] DAMAGECOUNT value on done: 1021.0
[2023-02-25 12:39:12,786][2409389] Sum rewards: 2.913, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.753', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'AMMO5': '0.003', 'AMMO3': '0.040', 'WEAPON1': '0.040', 'weapon5': '0.076', 'weapon7': '0.078', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.270', 'WEAPON3': '0.300', 'ARMOR': '0.420', 'weapon3': '0.830', 'DAMAGECOUNT': '0.945', 'weapon2': '2.424', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:12,831][2409373] DAMAGECOUNT value on done: 1139.0
[2023-02-25 12:39:12,834][2409373] Sum rewards: -1.112, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.714', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'ARMOR': '0.008', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.053', 'weapon5': '0.086', 'weapon4': '0.118', 'WEAPON5': '0.150', 'HITCOUNT': '0.340', 'WEAPON3': '0.450', 'weapon3': '1.248', 'FRAGCOUNT': '1.500', 'weapon2': '1.608', 'DAMAGECOUNT': '1.722'}
[2023-02-25 12:39:12,851][2409079] DAMAGECOUNT value on done: 989.0
[2023-02-25 12:39:12,851][2409079] Sum rewards: -3.179, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.670', 'AMMO5': '0.005', 'weapon5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'ARMOR': '0.038', 'WEAPON5': '0.100', 'AMMO3': '0.123', 'AMMO4': '0.157', 'HITCOUNT': '0.380', 'WEAPON4': '0.400', 'WEAPON3': '0.600', 'weapon4': '0.868', 'DAMAGECOUNT': '1.221', 'weapon2': '1.326', 'weapon3': '1.458', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:13,085][2409355] DAMAGECOUNT value on done: 863.0
[2023-02-25 12:39:13,088][2409355] Sum rewards: -1.260, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.660', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO5': '0.018', 'weapon5': '0.068', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'HITCOUNT': '0.190', 'weapon4': '0.226', 'WEAPON5': '0.300', 'ARMOR': '0.456', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.191', 'weapon3': '1.362', 'weapon2': '1.908', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:13,095][2409104] DAMAGECOUNT value on done: 1027.0
[2023-02-25 12:39:13,096][2409104] Sum rewards: -0.543, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.155', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'weapon4': '0.018', 'AMMO4': '0.041', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.152', 'HITCOUNT': '0.380', 'WEAPON3': '0.900', 'weapon2': '1.154', 'DAMAGECOUNT': '1.245', 'weapon3': '2.492', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:13,267][2409078] DAMAGECOUNT value on done: 592.0
[2023-02-25 12:39:13,268][2409078] Sum rewards: -4.039, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.855', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.011', 'weapon4': '0.066', 'ARMOR': '0.092', 'weapon5': '0.098', 'AMMO3': '0.148', 'HITCOUNT': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.966', 'FRAGCOUNT': '1.000', 'weapon3': '1.244', 'weapon2': '2.050'}
[2023-02-25 12:39:13,289][2409596] DAMAGECOUNT value on done: 748.0
[2023-02-25 12:39:13,292][2409596] Sum rewards: -0.272, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.558', 'AMMO5': '0.003', 'AMMO2': '0.015', 'ARMOR': '0.028', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'AMMO3': '0.109', 'HITCOUNT': '0.400', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.206', 'weapon2': '1.658', 'weapon3': '1.764'}
[2023-02-25 12:39:13,491][2409074] Updated weights for policy 0, policy_version 7451 (0.0012)
[2023-02-25 12:39:13,572][2409103] DAMAGECOUNT value on done: 799.0
[2023-02-25 12:39:13,575][2409103] Sum rewards: -1.744, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.724', 'weapon4': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.030', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'HITCOUNT': '0.290', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.765', 'FRAGCOUNT': '1.000', 'weapon2': '1.634', 'weapon3': '1.912'}
[2023-02-25 12:39:13,681][2409597] DAMAGECOUNT value on done: 526.0
[2023-02-25 12:39:13,685][2409597] Sum rewards: -3.248, reward structure: {'DEATHCOUNT': '-5.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.360', 'AMMO4': '-0.065', 'AMMO2': '-0.013', 'AMMO5': '0.003', 'weapon4': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.046', 'WEAPON4': '0.050', 'weapon5': '0.070', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.350', 'ARMOR': '0.437', 'weapon3': '0.874', 'weapon2': '2.564'}
[2023-02-25 12:39:13,838][2409485] DAMAGECOUNT value on done: 1059.0
[2023-02-25 12:39:13,840][2409485] Sum rewards: 2.311, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.359', 'AMMO5': '0.004', 'AMMO2': '0.010', 'ARMOR': '0.012', 'weapon5': '0.038', 'AMMO4': '0.050', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.106', 'HITCOUNT': '0.420', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.221', 'weapon3': '1.352', 'weapon2': '1.572', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:13,872][2409405] DAMAGECOUNT value on done: 828.0
[2023-02-25 12:39:13,875][2409405] Sum rewards: -1.334, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.590', 'AMMO4': '-0.091', 'AMMO2': '-0.018', 'AMMO5': '0.005', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'HITCOUNT': '0.140', 'DAMAGECOUNT': '0.357', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.086', 'weapon2': '1.438'}
[2023-02-25 12:39:14,523][2409105] DAMAGECOUNT value on done: 717.0
[2023-02-25 12:39:14,524][2409105] Sum rewards: 0.534, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.354', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.054', 'AMMO3': '0.056', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'weapon4': '0.274', 'ARMOR': '0.444', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.561', 'FRAGCOUNT': '1.000', 'weapon3': '1.162', 'weapon2': '1.654'}
[2023-02-25 12:39:14,533][2409100] DAMAGECOUNT value on done: 1161.0
[2023-02-25 12:39:14,537][2409100] Sum rewards: 4.111, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.452', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'WEAPON5': '0.100', 'weapon5': '0.110', 'WEAPON4': '0.300', 'HITCOUNT': '0.350', 'WEAPON3': '0.400', 'ARMOR': '0.469', 'weapon4': '0.650', 'weapon2': '0.768', 'weapon3': '1.268', 'DAMAGECOUNT': '1.839', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:14,604][2409469] DAMAGECOUNT value on done: 1508.0
[2023-02-25 12:39:14,608][2409469] Sum rewards: -1.582, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.456', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'HITCOUNT': '0.240', 'weapon4': '0.336', 'ARMOR': '0.444', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.744', 'weapon2': '1.478', 'weapon3': '1.554', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:14,649][2409097] DAMAGECOUNT value on done: 734.0
[2023-02-25 12:39:14,651][2409097] Sum rewards: 0.440, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.945', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.026', 'ARMOR': '0.044', 'AMMO3': '0.064', 'weapon7': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.210', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.585', 'weapon4': '0.608', 'weapon3': '1.000', 'weapon2': '1.100', 'FRAGCOUNT': '1.500'}
[2023-02-25 12:39:14,710][2409075] DAMAGECOUNT value on done: 716.0
[2023-02-25 12:39:14,711][2409075] Sum rewards: 2.291, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.462', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO3': '0.071', 'HITCOUNT': '0.400', 'ARMOR': '0.499', 'WEAPON3': '0.600', 'weapon3': '1.184', 'DAMAGECOUNT': '1.392', 'weapon2': '1.400', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:14,813][2409099] DAMAGECOUNT value on done: 808.0
[2023-02-25 12:39:14,814][2409099] Sum rewards: -0.778, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.152', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.011', 'AMMO4': '0.056', 'AMMO3': '0.075', 'WEAPON5': '0.150', 'HITCOUNT': '0.340', 'WEAPON3': '0.600', 'ARMOR': '0.900', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.050', 'weapon3': '1.308', 'weapon2': '1.618'}
[2023-02-25 12:39:15,099][2409486] DAMAGECOUNT value on done: 742.0
[2023-02-25 12:39:15,102][2409486] Sum rewards: 1.811, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.979', 'AMMO5': '0.003', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.017', 'AMMO3': '0.036', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'HITCOUNT': '0.180', 'weapon4': '0.198', 'WEAPON3': '0.250', 'weapon3': '0.608', 'DAMAGECOUNT': '0.735', 'weapon2': '1.552', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:15,117][2409076] DAMAGECOUNT value on done: 550.0
[2023-02-25 12:39:15,121][2409076] Sum rewards: -0.752, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.185', 'AMMO2': '0.010', 'AMMO4': '0.047', 'ARMOR': '0.048', 'AMMO3': '0.111', 'weapon4': '0.140', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.597', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.478', 'weapon2': '1.892'}
[2023-02-25 12:39:15,137][2409407] DAMAGECOUNT value on done: 1085.0
[2023-02-25 12:39:15,140][2409407] Sum rewards: 7.734, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.041', 'HEALTH': '0.049', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.102', 'weapon4': '0.138', 'WEAPON3': '0.300', 'HITCOUNT': '0.460', 'ARMOR': '0.890', 'weapon3': '0.932', 'weapon2': '1.132', 'DAMAGECOUNT': '1.977', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:39:15,267][2409406] DAMAGECOUNT value on done: 1241.0
[2023-02-25 12:39:15,268][2409406] Sum rewards: -1.479, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.514', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO4': '0.018', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.139', 'ARMOR': '0.412', 'HITCOUNT': '0.530', 'WEAPON3': '1.050', 'weapon2': '1.344', 'DAMAGECOUNT': '2.247', 'weapon3': '2.456', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:15,306][2409074] Updated weights for policy 0, policy_version 7461 (0.0012)
[2023-02-25 12:39:15,417][2409549] DAMAGECOUNT value on done: 997.0
[2023-02-25 12:39:15,418][2409549] Sum rewards: -1.063, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.600', 'AMMO2': '0.009', 'AMMO4': '0.046', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.218', 'HITCOUNT': '0.250', 'ARMOR': '0.500', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.735', 'weapon3': '1.142', 'weapon2': '1.396', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:15,610][2409102] DAMAGECOUNT value on done: 826.0
[2023-02-25 12:39:15,611][2409102] Sum rewards: -4.604, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.276', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon5': '0.048', 'AMMO4': '0.057', 'AMMO3': '0.107', 'weapon4': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.260', 'ARMOR': '0.492', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.993', 'weapon3': '1.786', 'weapon2': '1.794'}
[2023-02-25 12:39:15,748][2409565] DAMAGECOUNT value on done: 1260.0
[2023-02-25 12:39:15,749][2409565] Sum rewards: -5.123, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.413', 'AMMO2': '0.022', 'AMMO4': '0.110', 'AMMO3': '0.138', 'HITCOUNT': '0.180', 'WEAPON4': '0.300', 'ARMOR': '0.491', 'weapon4': '0.564', 'DAMAGECOUNT': '0.705', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.068', 'weapon3': '1.462'}
[2023-02-25 12:39:15,801][2409101] DAMAGECOUNT value on done: 1170.0
[2023-02-25 12:39:15,804][2409101] Sum rewards: 1.952, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.025', 'AMMO4': '-0.073', 'AMMO2': '-0.014', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'weapon4': '0.210', 'HITCOUNT': '0.320', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.101', 'weapon2': '1.550', 'weapon3': '1.876', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:16,070][2409548] DAMAGECOUNT value on done: 1309.0
[2023-02-25 12:39:16,073][2409548] Sum rewards: -1.472, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.312', 'AMMO5': '0.003', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.056', 'weapon7': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.146', 'AMMO4': '0.147', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.350', 'weapon4': '0.476', 'WEAPON3': '0.850', 'ARMOR': '0.869', 'weapon3': '1.240', 'weapon2': '1.628', 'DAMAGECOUNT': '1.686', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:16,309][2409077] DAMAGECOUNT value on done: 1017.0
[2023-02-25 12:39:16,310][2409077] Sum rewards: -0.619, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.550', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'WEAPON5': '0.100', 'AMMO3': '0.157', 'HITCOUNT': '0.380', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.356', 'weapon3': '1.548', 'weapon2': '1.562'}
[2023-02-25 12:39:16,355][2409096] DAMAGECOUNT value on done: 931.0
[2023-02-25 12:39:16,358][2409096] Sum rewards: 0.177, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.334', 'weapon4': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.096', 'weapon5': '0.104', 'AMMO3': '0.111', 'WEAPON5': '0.250', 'HITCOUNT': '0.310', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.197', 'weapon2': '1.496', 'weapon3': '1.822', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:39:16,417][2409373] DAMAGECOUNT value on done: 700.0
[2023-02-25 12:39:16,417][2409373] Sum rewards: 0.500, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.846', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'AMMO3': '0.073', 'ARMOR': '0.082', 'AMMO4': '0.108', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.494', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.615', 'weapon2': '1.392', 'weapon3': '1.590', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:16,532][2409389] DAMAGECOUNT value on done: 763.0
[2023-02-25 12:39:16,534][2409389] Sum rewards: -0.986, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.667', 'AMMO5': '0.003', 'AMMO2': '0.024', 'AMMO3': '0.075', 'AMMO4': '0.117', 'WEAPON4': '0.250', 'HITCOUNT': '0.280', 'weapon4': '0.456', 'ARMOR': '0.484', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.804', 'FRAGCOUNT': '1.000', 'weapon3': '1.220', 'weapon2': '1.918'}
[2023-02-25 12:39:16,734][2409079] DAMAGECOUNT value on done: 464.0
[2023-02-25 12:39:16,735][2409079] Sum rewards: -0.819, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.014', 'weapon4': '0.022', 'AMMO2': '0.023', 'WEAPON4': '0.050', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'HITCOUNT': '0.180', 'HEALTH': '0.410', 'DAMAGECOUNT': '0.591', 'WEAPON3': '0.600', 'ARMOR': '0.822', 'weapon2': '1.510', 'weapon3': '1.632', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:16,893][2409074] Updated weights for policy 0, policy_version 7471 (0.0013)
[2023-02-25 12:39:17,097][2409103] DAMAGECOUNT value on done: 1094.0
[2023-02-25 12:39:17,098][2409103] Sum rewards: 3.217, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'weapon4': '0.038', 'WEAPON4': '0.050', 'AMMO3': '0.073', 'AMMO4': '0.075', 'weapon5': '0.132', 'WEAPON5': '0.150', 'HEALTH': '0.376', 'WEAPON3': '0.400', 'HITCOUNT': '0.490', 'ARMOR': '0.855', 'weapon3': '1.258', 'weapon2': '1.458', 'DAMAGECOUNT': '1.809', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:17,186][2408954] Fps is (10 sec: 24986.4, 60 sec: 24985.6, 300 sec: 24784.3). Total num frames: 30609408. Throughput: 0: 6234.4. Samples: 7658856. Policy #0 lag: (min: 0.0, avg: 10.3, max: 23.0)
[2023-02-25 12:39:17,186][2408954] Avg episode reward: [(0, '-0.099')]
[2023-02-25 12:39:17,187][2409104] DAMAGECOUNT value on done: 620.0
[2023-02-25 12:39:17,201][2409866] DAMAGECOUNT value on done: 919.0
[2023-02-25 12:39:17,202][2409866] Sum rewards: -0.122, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.515', 'AMMO4': '-0.103', 'AMMO2': '-0.021', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.020', 'AMMO3': '0.069', 'WEAPON5': '0.100', 'HITCOUNT': '0.310', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.071', 'weapon3': '1.110', 'weapon2': '1.762'}
[2023-02-25 12:39:17,341][2409596] DAMAGECOUNT value on done: 690.0
[2023-02-25 12:39:17,343][2409596] Sum rewards: -0.278, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.779', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.034', 'weapon5': '0.072', 'ARMOR': '0.080', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'HITCOUNT': '0.140', 'weapon4': '0.196', 'WEAPON5': '0.200', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.861', 'weapon2': '1.256', 'weapon3': '1.612', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:17,375][2409597] DAMAGECOUNT value on done: 1289.0
[2023-02-25 12:39:17,376][2409597] Sum rewards: 0.514, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.052', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.060', 'AMMO4': '0.084', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.350', 'weapon4': '0.512', 'ARMOR': '0.580', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.329', 'weapon3': '1.424', 'weapon2': '1.462', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:17,397][2409485] DAMAGECOUNT value on done: 1079.0
[2023-02-25 12:39:17,400][2409485] Sum rewards: 3.694, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.402', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.190', 'HITCOUNT': '0.360', 'WEAPON3': '0.450', 'ARMOR': '0.524', 'DAMAGECOUNT': '1.710', 'weapon2': '1.716', 'weapon3': '1.786', 'FRAGCOUNT': '4.500'}
[2023-02-25 12:39:17,741][2409078] DAMAGECOUNT value on done: 914.0
[2023-02-25 12:39:17,742][2409078] Sum rewards: 3.736, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.397', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.007', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'HITCOUNT': '0.500', 'WEAPON3': '1.050', 'ARMOR': '1.205', 'DAMAGECOUNT': '1.791', 'weapon3': '1.856', 'weapon2': '1.912', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:39:17,760][2409355] DAMAGECOUNT value on done: 1225.0
[2023-02-25 12:39:18,153][2409105] DAMAGECOUNT value on done: 827.0
[2023-02-25 12:39:18,257][2409100] DAMAGECOUNT value on done: 1117.0
[2023-02-25 12:39:18,261][2409100] Sum rewards: 3.888, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.531', 'AMMO2': '0.021', 'ARMOR': '0.060', 'AMMO3': '0.063', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'HITCOUNT': '0.250', 'weapon4': '0.274', 'WEAPON3': '0.400', 'DAMAGECOUNT': '1.020', 'weapon2': '1.350', 'weapon3': '1.426', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:18,296][2409469] DAMAGECOUNT value on done: 968.0
[2023-02-25 12:39:18,298][2409469] Sum rewards: 0.571, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.522', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.032', 'AMMO4': '0.059', 'ARMOR': '0.076', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.242', 'HITCOUNT': '0.360', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.650', 'weapon2': '1.522', 'DAMAGECOUNT': '1.536', 'weapon3': '1.738'}
[2023-02-25 12:39:18,419][2409075] DAMAGECOUNT value on done: 834.0
[2023-02-25 12:39:18,419][2409075] Sum rewards: 5.369, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.375', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO3': '0.040', 'weapon7': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.370', 'weapon4': '0.436', 'weapon3': '0.970', 'DAMAGECOUNT': '1.272', 'weapon2': '1.380', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:39:18,426][2409405] DAMAGECOUNT value on done: 1442.0
[2023-02-25 12:39:18,427][2409405] Sum rewards: -0.203, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.862', 'AMMO2': '0.015', 'AMMO4': '0.076', 'AMMO3': '0.093', 'WEAPON4': '0.150', 'weapon4': '0.298', 'HITCOUNT': '0.330', 'ARMOR': '0.468', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.110', 'weapon3': '1.166', 'weapon2': '1.902', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:18,428][2409097] DAMAGECOUNT value on done: 720.0
[2023-02-25 12:39:18,432][2409097] Sum rewards: 0.895, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.084', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'AMMO3': '0.074', 'AMMO4': '0.165', 'HITCOUNT': '0.190', 'WEAPON4': '0.400', 'WEAPON3': '0.400', 'ARMOR': '0.504', 'DAMAGECOUNT': '0.660', 'weapon3': '0.860', 'weapon4': '0.910', 'weapon2': '1.220', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:18,514][2409074] Updated weights for policy 0, policy_version 7481 (0.0013)
[2023-02-25 12:39:18,768][2409076] DAMAGECOUNT value on done: 926.0
[2023-02-25 12:39:18,771][2409076] Sum rewards: -0.515, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.494', 'AMMO2': '0.012', 'ARMOR': '0.044', 'AMMO4': '0.060', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'HITCOUNT': '0.190', 'weapon4': '0.220', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.555', 'FRAGCOUNT': '1.000', 'weapon2': '1.094', 'weapon3': '1.374'}
[2023-02-25 12:39:18,843][2409099] DAMAGECOUNT value on done: 1331.0
[2023-02-25 12:39:18,844][2409099] Sum rewards: -1.420, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.870', 'AMMO2': '0.007', 'AMMO4': '0.036', 'AMMO3': '0.129', 'WEAPON4': '0.150', 'weapon4': '0.380', 'HITCOUNT': '0.430', 'ARMOR': '0.490', 'WEAPON3': '0.700', 'weapon3': '1.168', 'DAMAGECOUNT': '1.545', 'weapon2': '1.914', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:18,890][2409407] DAMAGECOUNT value on done: 932.0
[2023-02-25 12:39:18,891][2409407] Sum rewards: -0.710, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.090', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.092', 'HITCOUNT': '0.150', 'weapon4': '0.182', 'WEAPON3': '0.400', 'ARMOR': '0.463', 'DAMAGECOUNT': '0.627', 'FRAGCOUNT': '1.000', 'weapon3': '1.052', 'weapon2': '2.356'}
[2023-02-25 12:39:19,023][2409406] DAMAGECOUNT value on done: 1118.0
[2023-02-25 12:39:19,024][2409406] Sum rewards: 7.084, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.886', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.011', 'AMMO3': '0.093', 'WEAPON4': '0.200', 'weapon5': '0.248', 'WEAPON5': '0.250', 'weapon4': '0.394', 'HITCOUNT': '0.410', 'WEAPON3': '0.600', 'ARMOR': '0.913', 'weapon2': '0.946', 'weapon3': '1.392', 'DAMAGECOUNT': '2.034', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:39:19,080][2409486] DAMAGECOUNT value on done: 1064.0
[2023-02-25 12:39:19,083][2409486] Sum rewards: 2.954, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.013', 'AMMO5': '0.005', 'ARMOR': '0.013', 'weapon5': '0.014', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'WEAPON4': '0.150', 'weapon4': '0.224', 'HITCOUNT': '0.460', 'WEAPON3': '0.700', 'weapon2': '1.578', 'weapon3': '1.600', 'DAMAGECOUNT': '1.659', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:19,102][2409549] DAMAGECOUNT value on done: 1022.0
[2023-02-25 12:39:19,104][2409549] Sum rewards: -2.785, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'HEALTH': '-0.000', 'AMMO5': '0.010', 'AMMO3': '0.109', 'WEAPON5': '0.150', 'HITCOUNT': '0.190', 'weapon5': '0.204', 'ARMOR': '0.416', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.582', 'WEAPON3': '0.650', 'weapon2': '1.186', 'weapon3': '2.230'}
[2023-02-25 12:39:19,628][2409101] DAMAGECOUNT value on done: 1212.0
[2023-02-25 12:39:19,629][2409101] Sum rewards: 6.546, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon5': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'weapon4': '0.214', 'HEALTH': '0.320', 'WEAPON3': '0.350', 'ARMOR': '0.469', 'HITCOUNT': '0.500', 'DAMAGECOUNT': '1.434', 'weapon2': '1.650', 'weapon3': '1.670', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:19,689][2409548] DAMAGECOUNT value on done: 860.0
[2023-02-25 12:39:19,693][2409548] Sum rewards: 0.799, reward structure: {'DEATHCOUNT': '-4.500', 'ARMOR': '0.008', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.065', 'HITCOUNT': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.238', 'HEALTH': '0.366', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.576', 'weapon2': '0.958', 'FRAGCOUNT': '1.000', 'weapon3': '1.136'}
[2023-02-25 12:39:19,791][2409077] DAMAGECOUNT value on done: 711.0
[2023-02-25 12:39:19,792][2409077] Sum rewards: -6.513, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.043', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.081', 'AMMO4': '0.148', 'HITCOUNT': '0.190', 'ARMOR': '0.416', 'WEAPON4': '0.450', 'DAMAGECOUNT': '0.492', 'WEAPON3': '0.600', 'weapon4': '0.628', 'weapon3': '1.462', 'weapon2': '1.474'}
[2023-02-25 12:39:19,863][2409074] Updated weights for policy 0, policy_version 7491 (0.0012)
[2023-02-25 12:39:19,988][2409547] DAMAGECOUNT value on done: 824.0
[2023-02-25 12:39:20,087][2409102] DAMAGECOUNT value on done: 925.0
[2023-02-25 12:39:20,088][2409102] Sum rewards: 3.376, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.696', 'ARMOR': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'AMMO3': '0.060', 'AMMO4': '0.101', 'WEAPON4': '0.250', 'HITCOUNT': '0.440', 'WEAPON3': '0.450', 'weapon4': '0.514', 'weapon2': '1.358', 'weapon3': '1.528', 'DAMAGECOUNT': '1.575', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:20,119][2409373] DAMAGECOUNT value on done: 803.0
[2023-02-25 12:39:20,119][2409373] Sum rewards: 4.908, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.220', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.020', 'AMMO4': '0.038', 'WEAPON5': '0.050', 'weapon7': '0.054', 'AMMO3': '0.071', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.320', 'ARMOR': '0.432', 'WEAPON3': '0.500', 'weapon4': '0.546', 'weapon2': '0.654', 'weapon3': '0.872', 'DAMAGECOUNT': '1.320', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:39:20,212][2409096] DAMAGECOUNT value on done: 588.0
[2023-02-25 12:39:20,258][2409389] DAMAGECOUNT value on done: 1038.0
[2023-02-25 12:39:20,259][2409389] Sum rewards: 1.231, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.576', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'AMMO4': '0.094', 'AMMO3': '0.112', 'weapon4': '0.224', 'HITCOUNT': '0.460', 'WEAPON3': '0.600', 'weapon3': '1.390', 'DAMAGECOUNT': '1.446', 'weapon2': '1.662', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:20,399][2409565] DAMAGECOUNT value on done: 994.0
[2023-02-25 12:39:20,401][2409565] Sum rewards: 2.850, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.542', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'AMMO3': '0.072', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'weapon5': '0.106', 'WEAPON4': '0.150', 'HITCOUNT': '0.260', 'weapon4': '0.446', 'WEAPON3': '0.500', 'ARMOR': '0.898', 'weapon3': '1.318', 'weapon2': '1.378', 'DAMAGECOUNT': '1.530', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:39:20,527][2409079] DAMAGECOUNT value on done: 1001.0
[2023-02-25 12:39:20,531][2409079] Sum rewards: 1.210, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.235', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon7': '0.066', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.246', 'HITCOUNT': '0.300', 'ARMOR': '0.420', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.059', 'weapon2': '1.288', 'weapon3': '1.648', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:20,637][2409103] DAMAGECOUNT value on done: 982.0
[2023-02-25 12:39:20,640][2409103] Sum rewards: 3.365, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.138', 'AMMO5': '0.006', 'AMMO2': '0.012', 'AMMO4': '0.057', 'weapon5': '0.088', 'AMMO3': '0.102', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'HITCOUNT': '0.450', 'ARMOR': '0.477', 'weapon4': '0.506', 'WEAPON3': '0.600', 'weapon2': '1.198', 'weapon3': '1.702', 'DAMAGECOUNT': '2.055', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:39:20,919][2409104] DAMAGECOUNT value on done: 861.0
[2023-02-25 12:39:20,920][2409104] Sum rewards: 2.634, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.170', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.011', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.094', 'HITCOUNT': '0.340', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.200', 'weapon3': '1.784', 'weapon2': '1.908', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:39:20,975][2409485] DAMAGECOUNT value on done: 714.0
[2023-02-25 12:39:20,996][2409597] DAMAGECOUNT value on done: 817.0
[2023-02-25 12:39:20,999][2409597] Sum rewards: 1.741, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.094', 'WEAPON1': '0.010', 'AMMO2': '0.038', 'AMMO3': '0.081', 'AMMO4': '0.190', 'WEAPON4': '0.250', 'HITCOUNT': '0.400', 'WEAPON3': '0.500', 'ARMOR': '0.511', 'weapon4': '0.552', 'DAMAGECOUNT': '1.071', 'weapon3': '1.394', 'weapon2': '1.588', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:21,033][2409596] DAMAGECOUNT value on done: 568.0
[2023-02-25 12:39:21,036][2409596] Sum rewards: -9.713, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.524', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.099', 'AMMO3': '0.129', 'HITCOUNT': '0.180', 'WEAPON4': '0.300', 'ARMOR': '0.514', 'weapon3': '0.662', 'weapon4': '0.674', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.852', 'weapon2': '2.050'}
[2023-02-25 12:39:21,117][2409866] DAMAGECOUNT value on done: 890.0
[2023-02-25 12:39:21,121][2409866] Sum rewards: 0.902, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.444', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.081', 'AMMO3': '0.087', 'HITCOUNT': '0.300', 'ARMOR': '0.458', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.095', 'weapon3': '1.382', 'weapon2': '1.416', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:21,518][2409355] DAMAGECOUNT value on done: 622.0
[2023-02-25 12:39:21,519][2409355] Sum rewards: -1.163, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.440', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'ARMOR': '0.052', 'AMMO4': '0.077', 'AMMO3': '0.085', 'WEAPON4': '0.150', 'weapon4': '0.228', 'HITCOUNT': '0.270', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.771', 'FRAGCOUNT': '1.000', 'weapon3': '1.634', 'weapon2': '1.822'}
[2023-02-25 12:39:21,827][2409100] DAMAGECOUNT value on done: 782.0
[2023-02-25 12:39:21,828][2409100] Sum rewards: 0.210, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.538', 'AMMO5': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'weapon5': '0.060', 'AMMO4': '0.067', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.222', 'HITCOUNT': '0.290', 'WEAPON3': '0.350', 'ARMOR': '0.512', 'DAMAGECOUNT': '0.855', 'weapon3': '1.350', 'weapon2': '1.444', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:21,831][2409105] DAMAGECOUNT value on done: 752.0
[2023-02-25 12:39:21,832][2409105] Sum rewards: -3.380, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.528', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.037', 'weapon7': '0.048', 'AMMO3': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.198', 'WEAPON7': '0.200', 'HITCOUNT': '0.270', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.110', 'weapon2': '1.382', 'weapon3': '1.576'}
[2023-02-25 12:39:21,892][2409074] Updated weights for policy 0, policy_version 7501 (0.0012)
[2023-02-25 12:39:22,097][2409469] DAMAGECOUNT value on done: 1255.0
[2023-02-25 12:39:22,097][2409469] Sum rewards: 2.019, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.449', 'AMMO2': '0.003', 'AMMO5': '0.009', 'AMMO4': '0.017', 'weapon5': '0.038', 'ARMOR': '0.048', 'AMMO3': '0.071', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.320', 'weapon4': '0.384', 'WEAPON3': '0.550', 'weapon3': '1.222', 'DAMAGECOUNT': '1.284', 'weapon2': '1.522', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:22,186][2408954] Fps is (10 sec: 24985.4, 60 sec: 24917.3, 300 sec: 24770.4). Total num frames: 30732288. Throughput: 0: 6246.9. Samples: 7677948. Policy #0 lag: (min: 2.0, avg: 12.5, max: 26.0)
[2023-02-25 12:39:22,186][2408954] Avg episode reward: [(0, '0.198')]
[2023-02-25 12:39:22,256][2409078] DAMAGECOUNT value on done: 677.0
[2023-02-25 12:39:22,257][2409078] Sum rewards: -3.568, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-2.000', 'HEALTH': '-0.200', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon7': '0.050', 'AMMO3': '0.068', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'weapon4': '0.286', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.660', 'ARMOR': '0.800', 'weapon2': '0.854', 'weapon3': '0.974'}
[2023-02-25 12:39:22,417][2409099] DAMAGECOUNT value on done: 501.0
[2023-02-25 12:39:22,421][2409099] Sum rewards: -4.914, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.898', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.015', 'HITCOUNT': '0.060', 'AMMO4': '0.074', 'AMMO3': '0.122', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.180', 'weapon4': '0.206', 'WEAPON4': '0.300', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.750', 'ARMOR': '0.857', 'weapon3': '1.360', 'weapon2': '2.144'}
[2023-02-25 12:39:22,423][2409075] DAMAGECOUNT value on done: 438.0
[2023-02-25 12:39:22,424][2409075] Sum rewards: 0.181, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.940', 'weapon4': '0.008', 'AMMO2': '0.011', 'ARMOR': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.056', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.086', 'weapon2': '1.506'}
[2023-02-25 12:39:22,519][2409406] DAMAGECOUNT value on done: 604.0
[2023-02-25 12:39:22,519][2409406] Sum rewards: -0.855, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.670', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'WEAPON1': '0.020', 'AMMO3': '0.098', 'HITCOUNT': '0.320', 'ARMOR': '0.461', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.810', 'weapon3': '1.332', 'weapon2': '1.660', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:22,526][2409076] DAMAGECOUNT value on done: 1068.0
[2023-02-25 12:39:22,527][2409076] Sum rewards: -1.709, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.675', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'ARMOR': '0.052', 'weapon5': '0.056', 'weapon4': '0.118', 'AMMO3': '0.131', 'WEAPON5': '0.150', 'HITCOUNT': '0.250', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.179', 'weapon2': '1.394', 'weapon3': '1.694', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:22,560][2409407] DAMAGECOUNT value on done: 598.0
[2023-02-25 12:39:22,561][2409407] Sum rewards: 3.084, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.158', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'weapon4': '0.162', 'HITCOUNT': '0.230', 'ARMOR': '0.408', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.702', 'weapon2': '1.546', 'weapon3': '1.870', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:22,651][2409486] DAMAGECOUNT value on done: 642.0
[2023-02-25 12:39:22,817][2409097] DAMAGECOUNT value on done: 1173.0
[2023-02-25 12:39:22,823][2409405] DAMAGECOUNT value on done: 945.0
[2023-02-25 12:39:22,824][2409405] Sum rewards: 1.711, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.968', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'ARMOR': '0.076', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.176', 'HITCOUNT': '0.350', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.236', 'weapon2': '1.346', 'weapon3': '1.640', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:22,976][2409549] DAMAGECOUNT value on done: 863.0
[2023-02-25 12:39:22,980][2409549] Sum rewards: 0.299, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.612', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.017', 'ARMOR': '0.024', 'AMMO4': '0.082', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'HITCOUNT': '0.340', 'weapon4': '0.586', 'WEAPON3': '0.650', 'weapon2': '0.926', 'DAMAGECOUNT': '1.161', 'weapon3': '1.724', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:23,276][2409077] DAMAGECOUNT value on done: 476.0
[2023-02-25 12:39:23,345][2409548] DAMAGECOUNT value on done: 756.0
[2023-02-25 12:39:23,346][2409548] Sum rewards: -4.146, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.360', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon5': '0.098', 'AMMO3': '0.099', 'AMMO4': '0.118', 'WEAPON5': '0.200', 'HITCOUNT': '0.210', 'WEAPON4': '0.300', 'weapon4': '0.362', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.044', 'weapon3': '1.278', 'weapon2': '1.816', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:39:23,420][2409101] DAMAGECOUNT value on done: 752.0
[2023-02-25 12:39:23,429][2409101] Sum rewards: -0.682, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.490', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO3': '0.134', 'HITCOUNT': '0.240', 'ARMOR': '0.455', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.750', 'weapon2': '1.354', 'weapon3': '1.532', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:23,429][2409074] Updated weights for policy 0, policy_version 7511 (0.0012)
[2023-02-25 12:39:23,784][2409373] DAMAGECOUNT value on done: 1088.0
[2023-02-25 12:39:23,787][2409373] Sum rewards: -0.839, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.713', 'AMMO2': '0.007', 'AMMO5': '0.009', 'AMMO4': '0.033', 'weapon5': '0.080', 'AMMO3': '0.082', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'weapon4': '0.230', 'ARMOR': '0.476', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.059', 'FRAGCOUNT': '1.500', 'weapon3': '1.524', 'weapon2': '1.614'}
[2023-02-25 12:39:23,850][2409096] DAMAGECOUNT value on done: 1170.0
[2023-02-25 12:39:23,850][2409096] Sum rewards: 0.016, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.176', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'ARMOR': '0.016', 'AMMO3': '0.079', 'WEAPON4': '0.250', 'HITCOUNT': '0.520', 'weapon4': '0.676', 'WEAPON3': '0.700', 'weapon2': '1.306', 'weapon3': '1.528', 'DAMAGECOUNT': '1.872', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:24,076][2409389] DAMAGECOUNT value on done: 943.0
[2023-02-25 12:39:24,077][2409389] Sum rewards: -0.198, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.813', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO3': '0.050', 'weapon4': '0.060', 'WEAPON4': '0.100', 'HITCOUNT': '0.290', 'WEAPON3': '0.350', 'weapon3': '0.844', 'DAMAGECOUNT': '0.930', 'weapon2': '1.260', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:24,094][2409547] DAMAGECOUNT value on done: 989.0
[2023-02-25 12:39:24,095][2409547] Sum rewards: -1.423, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.072', 'AMMO5': '0.003', 'AMMO2': '0.008', 'WEAPON1': '0.030', 'AMMO4': '0.038', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.089', 'HITCOUNT': '0.240', 'ARMOR': '0.452', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.720', 'FRAGCOUNT': '1.000', 'weapon3': '1.200', 'weapon2': '1.968'}
[2023-02-25 12:39:24,147][2409079] DAMAGECOUNT value on done: 891.0
[2023-02-25 12:39:24,163][2409103] DAMAGECOUNT value on done: 842.0
[2023-02-25 12:39:24,164][2409103] Sum rewards: 3.113, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'weapon5': '0.076', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'HEALTH': '0.117', 'weapon4': '0.162', 'HITCOUNT': '0.340', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.975', 'ARMOR': '1.387', 'weapon3': '1.470', 'weapon2': '1.760', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:24,544][2409485] DAMAGECOUNT value on done: 841.0
[2023-02-25 12:39:24,545][2409485] Sum rewards: -0.154, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.062', 'AMMO5': '0.004', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.044', 'weapon5': '0.056', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'HITCOUNT': '0.200', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.675', 'ARMOR': '0.927', 'FRAGCOUNT': '1.000', 'weapon3': '1.164', 'weapon2': '2.022'}
[2023-02-25 12:39:24,597][2409080] DAMAGECOUNT value on done: 627.0
[2023-02-25 12:39:24,598][2409080] Sum rewards: 3.165, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.186', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.036', 'ARMOR': '0.040', 'AMMO3': '0.058', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'HITCOUNT': '0.270', 'weapon4': '0.334', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.900', 'weapon3': '1.006', 'weapon2': '1.482', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:24,655][2409866] DAMAGECOUNT value on done: 1069.0
[2023-02-25 12:39:24,658][2409866] Sum rewards: 2.275, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.282', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.034', 'weapon5': '0.044', 'AMMO3': '0.067', 'WEAPON5': '0.150', 'HITCOUNT': '0.290', 'WEAPON4': '0.300', 'ARMOR': '0.436', 'weapon4': '0.522', 'WEAPON3': '0.550', 'weapon2': '1.224', 'weapon3': '1.368', 'DAMAGECOUNT': '1.557', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:24,727][2409597] DAMAGECOUNT value on done: 1143.0
[2023-02-25 12:39:24,728][2409597] Sum rewards: 4.077, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.475', 'AMMO2': '0.004', 'AMMO4': '0.018', 'WEAPON1': '0.020', 'weapon7': '0.068', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.266', 'HITCOUNT': '0.390', 'ARMOR': '0.474', 'WEAPON3': '0.600', 'weapon3': '1.346', 'DAMAGECOUNT': '1.389', 'weapon2': '1.600', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:25,083][2409355] DAMAGECOUNT value on done: 734.0
[2023-02-25 12:39:25,086][2409355] Sum rewards: -1.088, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.151', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'AMMO3': '0.086', 'HITCOUNT': '0.130', 'weapon4': '0.156', 'DAMAGECOUNT': '0.432', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.238', 'ARMOR': '1.372', 'weapon2': '1.794'}
[2023-02-25 12:39:25,131][2409074] Updated weights for policy 0, policy_version 7521 (0.0012)
[2023-02-25 12:39:25,331][2409102] DAMAGECOUNT value on done: 1116.0
[2023-02-25 12:39:25,331][2409102] Sum rewards: 4.124, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.070', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'ARMOR': '0.400', 'weapon4': '0.456', 'HITCOUNT': '0.590', 'WEAPON3': '0.750', 'weapon3': '1.414', 'weapon2': '1.692', 'DAMAGECOUNT': '1.812', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:39:25,423][2409100] DAMAGECOUNT value on done: 1043.0
[2023-02-25 12:39:25,424][2409100] Sum rewards: 0.584, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.249', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO3': '0.074', 'weapon5': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.310', 'weapon4': '0.444', 'WEAPON3': '0.550', 'weapon2': '1.354', 'weapon3': '1.432', 'DAMAGECOUNT': '1.791', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:25,550][2409565] DAMAGECOUNT value on done: 992.0
[2023-02-25 12:39:25,551][2409565] Sum rewards: 0.573, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.734', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.019', 'WEAPON1': '0.030', 'weapon4': '0.038', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'WEAPON5': '0.150', 'weapon5': '0.154', 'HITCOUNT': '0.400', 'WEAPON3': '0.450', 'ARMOR': '0.894', 'weapon3': '1.182', 'DAMAGECOUNT': '1.443', 'FRAGCOUNT': '1.500', 'weapon2': '1.668'}
[2023-02-25 12:39:25,583][2409104] DAMAGECOUNT value on done: 1092.0
[2023-02-25 12:39:25,586][2409104] Sum rewards: -0.723, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.597', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'ARMOR': '0.024', 'WEAPON1': '0.040', 'AMMO3': '0.099', 'HITCOUNT': '0.180', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.705', 'FRAGCOUNT': '1.000', 'weapon3': '1.500', 'weapon2': '1.914'}
[2023-02-25 12:39:25,669][2409596] DAMAGECOUNT value on done: 1142.0
[2023-02-25 12:39:25,670][2409596] Sum rewards: -4.333, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.126', 'AMMO2': '0.015', 'WEAPON1': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.131', 'WEAPON4': '0.200', 'HITCOUNT': '0.320', 'weapon4': '0.352', 'ARMOR': '0.489', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.984', 'FRAGCOUNT': '1.000', 'weapon3': '1.304', 'weapon2': '1.772'}
[2023-02-25 12:39:25,699][2409105] DAMAGECOUNT value on done: 744.0
[2023-02-25 12:39:25,700][2409105] Sum rewards: -1.154, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.194', 'AMMO2': '0.013', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.062', 'weapon5': '0.076', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'HITCOUNT': '0.280', 'weapon4': '0.406', 'WEAPON3': '0.450', 'ARMOR': '0.494', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.194', 'weapon2': '1.418', 'weapon3': '1.718'}
[2023-02-25 12:39:25,982][2409469] DAMAGECOUNT value on done: 1525.0
[2023-02-25 12:39:25,985][2409469] Sum rewards: -0.271, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.579', 'AMMO5': '0.003', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.029', 'weapon7': '0.058', 'AMMO3': '0.088', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'HITCOUNT': '0.220', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.675', 'FRAGCOUNT': '1.000', 'weapon3': '1.328', 'weapon2': '1.490'}
[2023-02-25 12:39:26,010][2409075] DAMAGECOUNT value on done: 713.0
[2023-02-25 12:39:26,013][2409075] Sum rewards: -3.155, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.674', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.058', 'ARMOR': '0.072', 'AMMO3': '0.083', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'HITCOUNT': '0.200', 'weapon4': '0.450', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.726', 'weapon2': '0.898', 'weapon3': '1.418'}
[2023-02-25 12:39:26,032][2409099] DAMAGECOUNT value on done: 975.0
[2023-02-25 12:39:26,036][2409099] Sum rewards: 0.134, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.413', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'WEAPON4': '0.050', 'AMMO3': '0.114', 'weapon4': '0.238', 'HITCOUNT': '0.290', 'ARMOR': '0.416', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.122', 'weapon3': '1.288', 'weapon2': '1.402', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:26,053][2409078] DAMAGECOUNT value on done: 696.0
[2023-02-25 12:39:26,053][2409078] Sum rewards: 0.049, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.024', 'ARMOR': '0.068', 'AMMO3': '0.074', 'AMMO4': '0.121', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'HEALTH': '0.238', 'DAMAGECOUNT': '0.384', 'WEAPON3': '0.400', 'weapon4': '0.422', 'weapon3': '0.988', 'FRAGCOUNT': '1.000', 'weapon2': '1.300'}
[2023-02-25 12:39:26,190][2409406] DAMAGECOUNT value on done: 733.0
[2023-02-25 12:39:26,194][2409406] Sum rewards: -3.155, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.572', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'HITCOUNT': '0.140', 'WEAPON5': '0.150', 'weapon4': '0.206', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.700', 'ARMOR': '0.812', 'weapon3': '1.434', 'weapon2': '1.568'}
[2023-02-25 12:39:26,242][2409486] DAMAGECOUNT value on done: 1302.0
[2023-02-25 12:39:26,246][2409486] Sum rewards: -0.046, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.430', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.030', 'AMMO4': '0.035', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.113', 'HITCOUNT': '0.200', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.870', 'weapon2': '1.638', 'weapon3': '2.018', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:26,256][2409407] DAMAGECOUNT value on done: 764.0
[2023-02-25 12:39:26,260][2409407] Sum rewards: 0.623, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.324', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'weapon5': '0.064', 'AMMO3': '0.077', 'WEAPON5': '0.100', 'HITCOUNT': '0.210', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.651', 'FRAGCOUNT': '1.000', 'weapon3': '1.368', 'weapon2': '2.168'}
[2023-02-25 12:39:26,359][2409076] DAMAGECOUNT value on done: 1399.0
[2023-02-25 12:39:26,360][2409076] Sum rewards: -0.319, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.403', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'weapon5': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.098', 'weapon4': '0.198', 'HITCOUNT': '0.440', 'WEAPON3': '0.650', 'weapon3': '1.382', 'DAMAGECOUNT': '1.950', 'FRAGCOUNT': '2.000', 'weapon2': '2.086'}
[2023-02-25 12:39:26,530][2409405] DAMAGECOUNT value on done: 1360.0
[2023-02-25 12:39:26,534][2409405] Sum rewards: -1.320, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.694', 'AMMO5': '0.003', 'AMMO2': '0.008', 'WEAPON1': '0.030', 'AMMO4': '0.037', 'weapon5': '0.066', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.149', 'weapon4': '0.214', 'HITCOUNT': '0.520', 'ARMOR': '0.852', 'WEAPON3': '1.050', 'weapon2': '1.488', 'weapon3': '2.022', 'DAMAGECOUNT': '2.235', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:26,554][2409074] Updated weights for policy 0, policy_version 7531 (0.0013)
[2023-02-25 12:39:26,804][2409097] DAMAGECOUNT value on done: 1152.0
[2023-02-25 12:39:26,814][2409097] Sum rewards: 1.302, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.284', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon4': '0.230', 'HITCOUNT': '0.310', 'WEAPON3': '0.400', 'weapon3': '0.976', 'DAMAGECOUNT': '1.140', 'weapon2': '1.642', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:26,959][2409548] DAMAGECOUNT value on done: 680.0
[2023-02-25 12:39:26,961][2409548] Sum rewards: 0.865, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.480', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'ARMOR': '0.036', 'AMMO4': '0.037', 'AMMO3': '0.069', 'WEAPON4': '0.100', 'weapon4': '0.184', 'HITCOUNT': '0.190', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.711', 'weapon3': '1.066', 'weapon2': '1.724', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:26,994][2409077] DAMAGECOUNT value on done: 933.0
[2023-02-25 12:39:26,994][2409077] Sum rewards: 0.551, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.815', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'ARMOR': '0.020', 'WEAPON1': '0.060', 'AMMO3': '0.136', 'HITCOUNT': '0.380', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.368', 'weapon3': '1.594', 'weapon2': '1.760', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:27,186][2408954] Fps is (10 sec: 24576.0, 60 sec: 24917.4, 300 sec: 24742.6). Total num frames: 30855168. Throughput: 0: 6250.2. Samples: 7716000. Policy #0 lag: (min: 0.0, avg: 11.6, max: 33.0)
[2023-02-25 12:39:27,186][2408954] Avg episode reward: [(0, '-0.014')]
[2023-02-25 12:39:27,186][2409549] DAMAGECOUNT value on done: 1142.0
[2023-02-25 12:39:27,189][2409549] Sum rewards: 1.812, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.684', 'AMMO2': '0.006', 'ARMOR': '0.008', 'AMMO4': '0.030', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'weapon4': '0.234', 'HITCOUNT': '0.300', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.915', 'weapon2': '1.248', 'weapon3': '1.528', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:27,652][2409373] DAMAGECOUNT value on done: 1061.0
[2023-02-25 12:39:27,655][2409373] Sum rewards: -0.012, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.410', 'AMMO2': '0.004', 'AMMO4': '0.022', 'ARMOR': '0.024', 'weapon7': '0.050', 'AMMO3': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.370', 'weapon4': '0.404', 'WEAPON3': '0.700', 'weapon3': '1.148', 'weapon2': '1.274', 'DAMAGECOUNT': '1.401', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:27,677][2409389] DAMAGECOUNT value on done: 679.0
[2023-02-25 12:39:27,678][2409389] Sum rewards: 1.876, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.690', 'AMMO2': '0.014', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'AMMO4': '0.070', 'HITCOUNT': '0.120', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.450', 'weapon2': '1.222', 'weapon3': '1.254', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:27,704][2409101] DAMAGECOUNT value on done: 706.0
[2023-02-25 12:39:27,707][2409101] Sum rewards: -1.335, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.676', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'ARMOR': '0.048', 'AMMO4': '0.097', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'weapon4': '0.386', 'DAMAGECOUNT': '0.576', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.244', 'weapon3': '1.548'}
[2023-02-25 12:39:27,756][2409103] DAMAGECOUNT value on done: 1158.0
[2023-02-25 12:39:27,756][2409103] Sum rewards: 1.889, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.356', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'weapon4': '0.216', 'HITCOUNT': '0.340', 'WEAPON3': '0.700', 'ARMOR': '0.912', 'weapon2': '1.280', 'DAMAGECOUNT': '1.302', 'weapon3': '1.396', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:39:27,951][2409096] DAMAGECOUNT value on done: 1051.0
[2023-02-25 12:39:27,951][2409096] Sum rewards: -0.733, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'weapon5': '0.008', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO3': '0.040', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.085', 'HEALTH': '0.166', 'weapon4': '0.202', 'WEAPON3': '0.250', 'HITCOUNT': '0.260', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.774', 'weapon3': '0.988', 'weapon2': '1.856'}
[2023-02-25 12:39:28,112][2409485] DAMAGECOUNT value on done: 749.0
[2023-02-25 12:39:28,114][2409485] Sum rewards: 0.650, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.659', 'AMMO5': '0.004', 'AMMO2': '0.019', 'weapon5': '0.040', 'AMMO3': '0.083', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.158', 'HITCOUNT': '0.210', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.705', 'ARMOR': '0.914', 'FRAGCOUNT': '1.000', 'weapon3': '1.254', 'weapon2': '2.078'}
[2023-02-25 12:39:28,204][2409074] Updated weights for policy 0, policy_version 7541 (0.0013)
[2023-02-25 12:39:28,207][2409547] DAMAGECOUNT value on done: 1477.0
[2023-02-25 12:39:28,210][2409547] Sum rewards: -1.339, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.930', 'AMMO2': '0.006', 'ARMOR': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.029', 'AMMO3': '0.089', 'HITCOUNT': '0.320', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.915', 'weapon3': '1.500', 'weapon2': '1.602', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:28,257][2409079] DAMAGECOUNT value on done: 1295.0
[2023-02-25 12:39:28,258][2409079] Sum rewards: 0.124, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.086', 'AMMO5': '0.006', 'AMMO2': '0.024', 'ARMOR': '0.044', 'weapon5': '0.066', 'AMMO3': '0.080', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.330', 'WEAPON3': '0.550', 'HITCOUNT': '0.550', 'weapon3': '1.202', 'weapon2': '1.514', 'DAMAGECOUNT': '1.926', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:28,460][2409866] DAMAGECOUNT value on done: 1160.0
[2023-02-25 12:39:28,468][2409866] Sum rewards: -1.384, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.000', 'AMMO5': '0.003', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'AMMO2': '0.042', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.097', 'AMMO4': '0.210', 'HITCOUNT': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '0.600', 'weapon4': '0.968', 'DAMAGECOUNT': '1.014', 'weapon2': '1.110', 'weapon3': '1.408', 'FRAGCOUNT': '1.500'}
[2023-02-25 12:39:28,595][2409597] DAMAGECOUNT value on done: 530.0
[2023-02-25 12:39:28,934][2409080] DAMAGECOUNT value on done: 1014.0
[2023-02-25 12:39:28,936][2409080] Sum rewards: 1.063, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.326', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO3': '0.095', 'WEAPON4': '0.200', 'HITCOUNT': '0.340', 'weapon4': '0.470', 'WEAPON3': '0.550', 'weapon3': '1.140', 'weapon2': '1.604', 'DAMAGECOUNT': '1.614', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:29,088][2409100] DAMAGECOUNT value on done: 763.0
[2023-02-25 12:39:29,089][2409100] Sum rewards: -1.315, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.235', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'HITCOUNT': '0.180', 'weapon4': '0.200', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.645', 'FRAGCOUNT': '1.000', 'weapon2': '1.314', 'weapon3': '1.714'}
[2023-02-25 12:39:29,154][2409102] DAMAGECOUNT value on done: 1093.0
[2023-02-25 12:39:29,157][2409102] Sum rewards: -0.923, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.242', 'AMMO2': '0.019', 'AMMO5': '0.021', 'weapon5': '0.068', 'AMMO3': '0.084', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'HITCOUNT': '0.240', 'WEAPON5': '0.300', 'ARMOR': '0.372', 'weapon4': '0.378', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.819', 'FRAGCOUNT': '1.000', 'weapon2': '1.024', 'weapon3': '1.748'}
[2023-02-25 12:39:29,167][2409355] DAMAGECOUNT value on done: 723.0
[2023-02-25 12:39:29,170][2409355] Sum rewards: -1.750, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.014', 'AMMO2': '0.020', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.101', 'AMMO3': '0.121', 'HITCOUNT': '0.160', 'weapon4': '0.210', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.230', 'weapon3': '1.746'}
[2023-02-25 12:39:29,454][2409105] DAMAGECOUNT value on done: 1253.0
[2023-02-25 12:39:29,455][2409105] Sum rewards: 0.767, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.320', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'WEAPON1': '0.010', 'AMMO3': '0.030', 'weapon5': '0.036', 'WEAPON5': '0.050', 'HITCOUNT': '0.180', 'WEAPON3': '0.250', 'FRAGCOUNT': '0.500', 'weapon3': '0.716', 'DAMAGECOUNT': '1.020', 'weapon2': '1.286'}
[2023-02-25 12:39:29,541][2409565] DAMAGECOUNT value on done: 707.0
[2023-02-25 12:39:29,542][2409565] Sum rewards: 1.731, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.266', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'ARMOR': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.105', 'weapon4': '0.192', 'HITCOUNT': '0.290', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.945', 'weapon3': '1.484', 'weapon2': '1.890', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:29,657][2409075] DAMAGECOUNT value on done: 739.0
[2023-02-25 12:39:29,659][2409075] Sum rewards: 1.706, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.150', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO3': '0.040', 'ARMOR': '0.072', 'AMMO4': '0.081', 'WEAPON4': '0.200', 'WEAPON3': '0.250', 'weapon4': '0.280', 'HITCOUNT': '0.290', 'DAMAGECOUNT': '0.885', 'weapon3': '0.982', 'FRAGCOUNT': '1.000', 'weapon2': '1.500'}
[2023-02-25 12:39:29,691][2409074] Updated weights for policy 0, policy_version 7551 (0.0014)
[2023-02-25 12:39:29,726][2409104] DAMAGECOUNT value on done: 837.0
[2023-02-25 12:39:29,730][2409104] Sum rewards: 1.419, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.448', 'AMMO5': '0.003', 'ARMOR': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.050', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'HITCOUNT': '0.130', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.405', 'weapon3': '0.794', 'FRAGCOUNT': '1.000', 'weapon2': '1.626'}
[2023-02-25 12:39:29,797][2409596] DAMAGECOUNT value on done: 1090.0
[2023-02-25 12:39:29,798][2409596] Sum rewards: -1.201, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.802', 'AMMO5': '0.010', 'weapon7': '0.010', 'AMMO2': '0.013', 'weapon5': '0.042', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.064', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.224', 'HITCOUNT': '0.240', 'WEAPON3': '0.400', 'ARMOR': '0.432', 'DAMAGECOUNT': '0.648', 'weapon3': '0.798', 'FRAGCOUNT': '1.500', 'weapon2': '1.860'}
[2023-02-25 12:39:29,824][2409406] DAMAGECOUNT value on done: 1202.0
[2023-02-25 12:39:29,825][2409406] Sum rewards: 1.032, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.498', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO3': '0.050', 'weapon5': '0.084', 'AMMO4': '0.123', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.274', 'WEAPON3': '0.350', 'ARMOR': '0.436', 'DAMAGECOUNT': '0.921', 'weapon3': '1.048', 'weapon2': '1.772', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:29,901][2409099] DAMAGECOUNT value on done: 1709.0
[2023-02-25 12:39:29,902][2409099] Sum rewards: 1.347, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.150', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.052', 'AMMO3': '0.130', 'WEAPON4': '0.400', 'ARMOR': '0.412', 'weapon4': '0.416', 'HITCOUNT': '0.660', 'WEAPON3': '0.850', 'weapon2': '1.456', 'weapon3': '1.792', 'DAMAGECOUNT': '2.559', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:39:30,012][2409469] DAMAGECOUNT value on done: 1096.0
[2023-02-25 12:39:30,037][2409469] Sum rewards: 3.077, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.332', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.012', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon4': '0.268', 'HITCOUNT': '0.340', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.957', 'weapon3': '1.406', 'weapon2': '1.574', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:30,086][2409076] DAMAGECOUNT value on done: 1016.0
[2023-02-25 12:39:30,087][2409076] Sum rewards: -3.296, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.378', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.072', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.150', 'weapon4': '0.192', 'ARMOR': '0.475', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.138', 'weapon2': '1.772'}
[2023-02-25 12:39:30,243][2409486] DAMAGECOUNT value on done: 800.0
[2023-02-25 12:39:30,246][2409486] Sum rewards: 1.373, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.027', 'AMMO3': '0.050', 'weapon7': '0.068', 'HEALTH': '0.081', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.170', 'WEAPON3': '0.250', 'HITCOUNT': '0.310', 'ARMOR': '0.508', 'weapon3': '0.646', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.065', 'weapon2': '1.282'}
[2023-02-25 12:39:30,387][2409407] DAMAGECOUNT value on done: 1033.0
[2023-02-25 12:39:30,388][2409407] Sum rewards: -0.624, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.742', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.028', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.212', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.645', 'weapon2': '1.220', 'weapon3': '1.730', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:30,390][2409078] DAMAGECOUNT value on done: 1224.0
[2023-02-25 12:39:30,393][2409078] Sum rewards: -1.947, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.519', 'AMMO5': '0.007', 'AMMO2': '0.022', 'ARMOR': '0.056', 'weapon5': '0.072', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.121', 'WEAPON4': '0.250', 'HITCOUNT': '0.260', 'weapon4': '0.366', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.795', 'FRAGCOUNT': '1.000', 'weapon2': '1.266', 'weapon3': '1.446'}
[2023-02-25 12:39:30,509][2409097] DAMAGECOUNT value on done: 473.0
[2023-02-25 12:39:30,514][2409097] Sum rewards: 2.351, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.030', 'AMMO4': '0.031', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'HITCOUNT': '0.120', 'HEALTH': '0.122', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.492', 'ARMOR': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.020', 'weapon2': '2.194'}
[2023-02-25 12:39:30,572][2409077] DAMAGECOUNT value on done: 987.0
[2023-02-25 12:39:30,573][2409077] Sum rewards: 4.768, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.796', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.023', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'WEAPON4': '0.300', 'weapon4': '0.300', 'HITCOUNT': '0.370', 'ARMOR': '0.475', 'WEAPON3': '0.800', 'weapon2': '1.396', 'DAMAGECOUNT': '1.665', 'weapon3': '1.686', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:39:30,697][2409548] DAMAGECOUNT value on done: 1050.0
[2023-02-25 12:39:30,701][2409548] Sum rewards: 2.388, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.040', 'WEAPON5': '0.050', 'weapon7': '0.056', 'AMMO3': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.115', 'HITCOUNT': '0.180', 'HEALTH': '0.344', 'weapon4': '0.378', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.942', 'weapon2': '1.326', 'weapon3': '1.732', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:30,824][2409405] DAMAGECOUNT value on done: 1009.0
[2023-02-25 12:39:30,827][2409405] Sum rewards: -0.230, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.020', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.045', 'AMMO3': '0.058', 'HITCOUNT': '0.130', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.400', 'weapon4': '0.442', 'ARMOR': '0.870', 'weapon3': '1.098', 'weapon2': '1.852', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:31,288][2409389] DAMAGECOUNT value on done: 812.0
[2023-02-25 12:39:31,289][2409389] Sum rewards: 1.653, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.061', 'AMMO2': '0.017', 'AMMO3': '0.043', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'weapon4': '0.232', 'HITCOUNT': '0.260', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.810', 'ARMOR': '0.840', 'weapon3': '0.954', 'FRAGCOUNT': '1.000', 'weapon2': '2.324'}
[2023-02-25 12:39:31,347][2409549] DAMAGECOUNT value on done: 675.0
[2023-02-25 12:39:31,349][2409103] DAMAGECOUNT value on done: 1473.0
[2023-02-25 12:39:31,350][2409103] Sum rewards: 1.354, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.880', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.028', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'weapon4': '0.092', 'AMMO3': '0.095', 'AMMO4': '0.162', 'WEAPON4': '0.200', 'HITCOUNT': '0.240', 'ARMOR': '0.432', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.494', 'weapon3': '1.622', 'weapon2': '1.674', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:31,352][2409373] DAMAGECOUNT value on done: 1331.0
[2023-02-25 12:39:31,456][2409074] Updated weights for policy 0, policy_version 7561 (0.0013)
[2023-02-25 12:39:31,731][2409485] DAMAGECOUNT value on done: 431.0
[2023-02-25 12:39:31,734][2409485] Sum rewards: 0.765, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.623', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.012', 'AMMO3': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'HITCOUNT': '0.120', 'ARMOR': '0.127', 'WEAPON4': '0.150', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.357', 'weapon4': '0.428', 'weapon2': '0.690', 'weapon3': '0.998', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:39:31,772][2409101] DAMAGECOUNT value on done: 1220.0
[2023-02-25 12:39:31,775][2409101] Sum rewards: 4.188, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.217', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.010', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'WEAPON5': '0.150', 'weapon4': '0.220', 'HITCOUNT': '0.570', 'WEAPON3': '0.700', 'ARMOR': '0.824', 'weapon2': '1.452', 'weapon3': '1.466', 'DAMAGECOUNT': '1.845', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:39:31,865][2409547] DAMAGECOUNT value on done: 869.0
[2023-02-25 12:39:31,866][2409547] Sum rewards: 5.543, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.190', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.015', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.094', 'WEAPON3': '0.350', 'HITCOUNT': '0.380', 'ARMOR': '0.495', 'DAMAGECOUNT': '1.164', 'weapon3': '1.182', 'weapon2': '1.444', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:39:32,164][2409079] DAMAGECOUNT value on done: 667.0
[2023-02-25 12:39:32,167][2409079] Sum rewards: 0.789, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.009', 'AMMO2': '0.016', 'weapon5': '0.020', 'ARMOR': '0.048', 'AMMO3': '0.060', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'HEALTH': '0.108', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'WEAPON3': '0.350', 'weapon4': '0.430', 'DAMAGECOUNT': '0.798', 'weapon3': '0.974', 'weapon2': '1.416', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:32,186][2408954] Fps is (10 sec: 24576.1, 60 sec: 25053.9, 300 sec: 24770.4). Total num frames: 30978048. Throughput: 0: 6250.1. Samples: 7753284. Policy #0 lag: (min: 0.0, avg: 11.2, max: 26.0)
[2023-02-25 12:39:32,186][2408954] Avg episode reward: [(0, '0.101')]
[2023-02-25 12:39:32,276][2409468] DAMAGECOUNT value on done: 1273.0
[2023-02-25 12:39:32,278][2409468] Sum rewards: -2.282, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.759', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO2': '0.022', 'weapon5': '0.022', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.156', 'FRAGCOUNT': '0.500', 'HITCOUNT': '0.520', 'WEAPON3': '0.800', 'ARMOR': '1.428', 'weapon3': '1.702', 'DAMAGECOUNT': '1.845', 'weapon2': '1.950'}
[2023-02-25 12:39:32,422][2409096] DAMAGECOUNT value on done: 568.0
[2023-02-25 12:39:32,423][2409096] Sum rewards: 3.912, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.228', 'AMMO4': '-0.066', 'AMMO2': '-0.013', 'AMMO3': '0.052', 'ARMOR': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.166', 'HITCOUNT': '0.310', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.873', 'weapon3': '1.214', 'weapon2': '1.494', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:39:32,654][2409100] DAMAGECOUNT value on done: 648.0
[2023-02-25 12:39:32,658][2409100] Sum rewards: 0.634, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.066', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'weapon5': '0.026', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'WEAPON3': '0.300', 'weapon4': '0.398', 'ARMOR': '0.440', 'DAMAGECOUNT': '0.540', 'weapon3': '0.852', 'weapon2': '1.638', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:32,663][2409866] DAMAGECOUNT value on done: 855.0
[2023-02-25 12:39:32,664][2409866] Sum rewards: -7.464, reward structure: {'DEATHCOUNT': '-11.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.048', 'AMMO5': '0.003', 'weapon5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.155', 'weapon4': '0.190', 'HITCOUNT': '0.260', 'DAMAGECOUNT': '0.912', 'WEAPON3': '1.000', 'weapon2': '1.388', 'weapon3': '2.086'}
[2023-02-25 12:39:33,065][2409080] DAMAGECOUNT value on done: 1115.0
[2023-02-25 12:39:33,066][2409080] Sum rewards: 0.787, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.368', 'AMMO5': '0.005', 'AMMO2': '0.008', 'ARMOR': '0.020', 'weapon5': '0.036', 'AMMO4': '0.041', 'AMMO3': '0.071', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.252', 'WEAPON3': '0.500', 'HITCOUNT': '0.510', 'weapon3': '1.206', 'DAMAGECOUNT': '1.674', 'weapon2': '2.082', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:33,140][2409355] DAMAGECOUNT value on done: 702.0
[2023-02-25 12:39:33,213][2409075] DAMAGECOUNT value on done: 1079.0
[2023-02-25 12:39:33,214][2409075] Sum rewards: -0.734, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.869', 'AMMO2': '0.006', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'weapon4': '0.084', 'weapon5': '0.096', 'WEAPON5': '0.150', 'HITCOUNT': '0.260', 'ARMOR': '0.486', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.508', 'weapon2': '1.586', 'DAMAGECOUNT': '1.716'}
[2023-02-25 12:39:33,336][2409074] Updated weights for policy 0, policy_version 7571 (0.0012)
[2023-02-25 12:39:33,369][2409406] DAMAGECOUNT value on done: 595.0
[2023-02-25 12:39:33,439][2409102] DAMAGECOUNT value on done: 776.0
[2023-02-25 12:39:33,440][2409102] Sum rewards: -2.085, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.372', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO3': '0.083', 'HITCOUNT': '0.140', 'ARMOR': '0.428', 'DAMAGECOUNT': '0.465', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.268', 'weapon3': '1.340'}
[2023-02-25 12:39:33,550][2409597] DAMAGECOUNT value on done: 1196.0
[2023-02-25 12:39:33,550][2409597] Sum rewards: 0.535, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.064', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.010', 'AMMO3': '0.077', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.238', 'HITCOUNT': '0.310', 'ARMOR': '0.487', 'WEAPON3': '0.550', 'weapon3': '1.272', 'DAMAGECOUNT': '1.329', 'weapon2': '1.634', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:33,668][2409565] DAMAGECOUNT value on done: 1485.0
[2023-02-25 12:39:33,671][2409565] Sum rewards: -0.527, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.274', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'ARMOR': '0.040', 'AMMO4': '0.117', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'weapon4': '0.324', 'HITCOUNT': '0.450', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.275', 'weapon2': '1.470', 'weapon3': '1.836', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:33,797][2409076] DAMAGECOUNT value on done: 655.0
[2023-02-25 12:39:33,798][2409076] Sum rewards: -1.436, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.704', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon5': '0.078', 'AMMO3': '0.092', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'HITCOUNT': '0.190', 'WEAPON4': '0.300', 'ARMOR': '0.452', 'DAMAGECOUNT': '0.555', 'WEAPON3': '0.600', 'weapon4': '0.626', 'FRAGCOUNT': '1.000', 'weapon2': '1.126', 'weapon3': '1.452'}
[2023-02-25 12:39:33,984][2409104] DAMAGECOUNT value on done: 608.0
[2023-02-25 12:39:33,987][2409104] Sum rewards: -2.147, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.370', 'AMMO5': '0.003', 'AMMO2': '0.017', 'ARMOR': '0.030', 'weapon5': '0.052', 'AMMO3': '0.083', 'AMMO4': '0.083', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.170', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon3': '1.458', 'weapon2': '1.652'}
[2023-02-25 12:39:33,991][2409099] DAMAGECOUNT value on done: 1008.0
[2023-02-25 12:39:33,992][2409099] Sum rewards: 1.413, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.419', 'AMMO2': '0.002', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.008', 'WEAPON1': '0.020', 'AMMO3': '0.107', 'WEAPON5': '0.150', 'HITCOUNT': '0.390', 'ARMOR': '0.448', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.119', 'weapon3': '1.662', 'weapon2': '2.162', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:39:34,047][2409596] DAMAGECOUNT value on done: 1432.0
[2023-02-25 12:39:34,048][2409596] Sum rewards: 2.255, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.168', 'AMMO5': '0.008', 'weapon5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.067', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'weapon4': '0.136', 'WEAPON4': '0.150', 'HITCOUNT': '0.280', 'ARMOR': '0.412', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.305', 'weapon2': '1.522', 'weapon3': '1.982', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:34,139][2409407] DAMAGECOUNT value on done: 966.0
[2023-02-25 12:39:34,143][2409407] Sum rewards: -1.647, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.981', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.004', 'ARMOR': '0.036', 'weapon5': '0.040', 'weapon4': '0.044', 'AMMO3': '0.069', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.140', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.867', 'weapon3': '1.272', 'weapon2': '1.932', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:34,186][2409097] DAMAGECOUNT value on done: 1002.0
[2023-02-25 12:39:34,189][2409097] Sum rewards: -0.474, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.500', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'WEAPON1': '0.020', 'AMMO3': '0.151', 'HITCOUNT': '0.160', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.800', 'weapon2': '1.552', 'weapon3': '1.748', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:34,202][2409486] DAMAGECOUNT value on done: 1145.0
[2023-02-25 12:39:34,205][2409486] Sum rewards: 1.469, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.732', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.118', 'weapon4': '0.242', 'HITCOUNT': '0.330', 'ARMOR': '0.456', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.948', 'weapon2': '1.080', 'weapon3': '1.882', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:34,328][2409077] DAMAGECOUNT value on done: 928.0
[2023-02-25 12:39:34,331][2409077] Sum rewards: 2.553, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.410', 'AMMO5': '0.005', 'weapon5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO4': '0.105', 'AMMO3': '0.107', 'HITCOUNT': '0.230', 'WEAPON4': '0.250', 'ARMOR': '0.408', 'weapon4': '0.604', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.972', 'weapon2': '1.468', 'weapon3': '1.560', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:34,422][2409078] DAMAGECOUNT value on done: 625.0
[2023-02-25 12:39:34,424][2409078] Sum rewards: 1.515, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.886', 'AMMO4': '-0.055', 'AMMO2': '-0.011', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'HITCOUNT': '0.040', 'AMMO3': '0.052', 'weapon5': '0.056', 'WEAPON5': '0.100', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.450', 'weapon3': '1.192', 'weapon2': '1.454', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:34,542][2409074] Updated weights for policy 0, policy_version 7581 (0.0012)
[2023-02-25 12:39:34,647][2409548] DAMAGECOUNT value on done: 689.0
[2023-02-25 12:39:34,799][2409105] DAMAGECOUNT value on done: 1071.0
[2023-02-25 12:39:34,800][2409105] Sum rewards: -0.576, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.037', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'WEAPON4': '0.150', 'weapon4': '0.202', 'HITCOUNT': '0.430', 'ARMOR': '0.456', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.656', 'weapon2': '1.676', 'weapon3': '1.884', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:34,842][2409405] DAMAGECOUNT value on done: 866.0
[2023-02-25 12:39:34,847][2409549] DAMAGECOUNT value on done: 867.0
[2023-02-25 12:39:34,848][2409549] Sum rewards: -2.894, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.298', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'AMMO2': '0.039', 'ARMOR': '0.044', 'AMMO3': '0.092', 'AMMO4': '0.197', 'HITCOUNT': '0.280', 'WEAPON4': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.870', 'weapon4': '0.920', 'FRAGCOUNT': '1.000', 'weapon2': '1.274', 'weapon3': '1.452'}
[2023-02-25 12:39:34,855][2409389] DAMAGECOUNT value on done: 1514.0
[2023-02-25 12:39:34,872][2409389] Sum rewards: 2.620, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.284', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO3': '0.135', 'ARMOR': '0.489', 'HITCOUNT': '0.710', 'WEAPON3': '0.850', 'weapon3': '1.448', 'weapon2': '2.228', 'DAMAGECOUNT': '2.550', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:35,008][2409373] DAMAGECOUNT value on done: 541.0
[2023-02-25 12:39:35,011][2409373] Sum rewards: 1.855, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.079', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'weapon4': '0.126', 'HITCOUNT': '0.270', 'WEAPON3': '0.500', 'HEALTH': '0.594', 'DAMAGECOUNT': '0.834', 'weapon2': '1.412', 'weapon3': '1.720', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:35,228][2409469] DAMAGECOUNT value on done: 558.0
[2023-02-25 12:39:35,232][2409469] Sum rewards: -3.728, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.620', 'AMMO5': '0.003', 'weapon5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.139', 'AMMO4': '0.159', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'weapon4': '0.268', 'ARMOR': '0.404', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.578', 'weapon2': '1.858'}
[2023-02-25 12:39:35,278][2409103] DAMAGECOUNT value on done: 1248.0
[2023-02-25 12:39:35,279][2409103] Sum rewards: -2.691, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.848', 'AMMO5': '0.005', 'weapon5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'ARMOR': '0.028', 'weapon7': '0.048', 'AMMO4': '0.076', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.260', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'weapon4': '0.626', 'weapon2': '0.758', 'DAMAGECOUNT': '0.846', 'FRAGCOUNT': '1.000', 'weapon3': '1.242'}
[2023-02-25 12:39:35,483][2409101] DAMAGECOUNT value on done: 997.0
[2023-02-25 12:39:35,486][2409101] Sum rewards: -0.274, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.314', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.056', 'HITCOUNT': '0.350', 'WEAPON3': '0.400', 'ARMOR': '0.429', 'FRAGCOUNT': '0.500', 'weapon3': '0.800', 'DAMAGECOUNT': '1.611', 'weapon2': '1.742'}
[2023-02-25 12:39:35,631][2409547] DAMAGECOUNT value on done: 1525.0
[2023-02-25 12:39:35,634][2409547] Sum rewards: 3.074, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.674', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'weapon5': '0.074', 'AMMO4': '0.087', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'HITCOUNT': '0.380', 'weapon4': '0.388', 'WEAPON3': '0.700', 'weapon2': '1.108', 'DAMAGECOUNT': '1.968', 'weapon3': '2.018', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:35,647][2409485] DAMAGECOUNT value on done: 810.0
[2023-02-25 12:39:35,648][2409485] Sum rewards: -1.963, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.116', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.006', 'AMMO4': '0.030', 'WEAPON1': '0.030', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'HITCOUNT': '0.240', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.930', 'weapon2': '1.378', 'FRAGCOUNT': '2.000', 'weapon3': '2.248'}
[2023-02-25 12:39:35,866][2409079] DAMAGECOUNT value on done: 1021.0
[2023-02-25 12:39:35,871][2409079] Sum rewards: 0.437, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.039', 'AMMO2': '0.012', 'weapon4': '0.016', 'AMMO4': '0.058', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'HITCOUNT': '0.330', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'weapon3': '0.886', 'DAMAGECOUNT': '1.107', 'weapon2': '1.244', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:36,331][2409866] DAMAGECOUNT value on done: 578.0
[2023-02-25 12:39:36,332][2409866] Sum rewards: -1.278, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.920', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon4': '0.012', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'ARMOR': '0.052', 'weapon5': '0.070', 'AMMO3': '0.071', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.256', 'weapon2': '2.006'}
[2023-02-25 12:39:36,771][2409074] Updated weights for policy 0, policy_version 7591 (0.0013)
[2023-02-25 12:39:36,783][2409100] DAMAGECOUNT value on done: 977.0
[2023-02-25 12:39:36,786][2409100] Sum rewards: -2.996, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.664', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.164', 'HITCOUNT': '0.210', 'ARMOR': '0.448', 'DAMAGECOUNT': '0.738', 'WEAPON3': '0.950', 'weapon2': '1.466', 'weapon3': '1.830', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:36,830][2409075] DAMAGECOUNT value on done: 885.0
[2023-02-25 12:39:36,833][2409075] Sum rewards: 1.480, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.140', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'weapon5': '0.028', 'AMMO4': '0.029', 'AMMO3': '0.030', 'WEAPON5': '0.100', 'WEAPON3': '0.200', 'HITCOUNT': '0.200', 'weapon3': '0.770', 'DAMAGECOUNT': '0.852', 'weapon2': '1.130', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:36,844][2409355] DAMAGECOUNT value on done: 1088.0
[2023-02-25 12:39:36,844][2409355] Sum rewards: -4.868, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.006', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.092', 'AMMO3': '0.112', 'weapon4': '0.214', 'HITCOUNT': '0.220', 'ARMOR': '0.470', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.705', 'weapon2': '1.458', 'weapon3': '1.560'}
[2023-02-25 12:39:36,961][2409096] DAMAGECOUNT value on done: 1193.0
[2023-02-25 12:39:37,074][2409468] DAMAGECOUNT value on done: 230.0
[2023-02-25 12:39:37,186][2408954] Fps is (10 sec: 24985.5, 60 sec: 24849.1, 300 sec: 24839.8). Total num frames: 31105024. Throughput: 0: 6243.5. Samples: 7771596. Policy #0 lag: (min: 0.0, avg: 11.2, max: 26.0)
[2023-02-25 12:39:37,186][2408954] Avg episode reward: [(0, '-0.011')]
[2023-02-25 12:39:37,213][2409102] DAMAGECOUNT value on done: 950.0
[2023-02-25 12:39:37,214][2409102] Sum rewards: 3.230, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.129', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.079', 'HITCOUNT': '0.300', 'WEAPON3': '0.400', 'weapon3': '1.000', 'DAMAGECOUNT': '1.065', 'weapon2': '1.188', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:37,392][2409406] DAMAGECOUNT value on done: 884.0
[2023-02-25 12:39:37,393][2409406] Sum rewards: 2.123, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.614', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO3': '0.050', 'weapon4': '0.076', 'WEAPON4': '0.100', 'HITCOUNT': '0.300', 'WEAPON3': '0.350', 'ARMOR': '0.525', 'DAMAGECOUNT': '1.008', 'weapon3': '1.108', 'weapon2': '1.740', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:37,455][2409597] DAMAGECOUNT value on done: 1194.0
[2023-02-25 12:39:37,459][2409597] Sum rewards: 0.648, reward structure: {'DEATHCOUNT': '-6.000', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO3': '0.060', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'HITCOUNT': '0.240', 'WEAPON3': '0.300', 'weapon4': '0.350', 'HEALTH': '0.386', 'ARMOR': '0.440', 'DAMAGECOUNT': '0.789', 'FRAGCOUNT': '1.000', 'weapon3': '1.080', 'weapon2': '1.746'}
[2023-02-25 12:39:37,664][2409565] DAMAGECOUNT value on done: 590.0
[2023-02-25 12:39:37,665][2409565] Sum rewards: -2.025, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.790', 'AMMO5': '0.017', 'weapon5': '0.018', 'AMMO2': '0.035', 'AMMO3': '0.083', 'AMMO4': '0.173', 'WEAPON4': '0.250', 'HITCOUNT': '0.280', 'WEAPON5': '0.350', 'ARMOR': '0.424', 'WEAPON3': '0.550', 'weapon4': '0.572', 'DAMAGECOUNT': '0.756', 'weapon3': '1.342', 'weapon2': '1.664', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:37,670][2409080] DAMAGECOUNT value on done: 636.0
[2023-02-25 12:39:37,673][2409080] Sum rewards: -1.010, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.605', 'AMMO2': '0.002', 'AMMO4': '0.009', 'WEAPON4': '0.050', 'AMMO3': '0.106', 'weapon4': '0.168', 'HITCOUNT': '0.290', 'ARMOR': '0.466', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.954', 'FRAGCOUNT': '1.000', 'weapon3': '1.364', 'weapon2': '1.986'}
[2023-02-25 12:39:37,683][2409076] DAMAGECOUNT value on done: 974.0
[2023-02-25 12:39:37,686][2409076] Sum rewards: 5.130, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.911', 'AMMO2': '0.004', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.020', 'WEAPON4': '0.050', 'weapon7': '0.058', 'AMMO3': '0.076', 'weapon5': '0.086', 'weapon4': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.310', 'ARMOR': '0.424', 'WEAPON3': '0.500', 'weapon2': '0.980', 'DAMAGECOUNT': '1.092', 'weapon3': '1.406', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:37,759][2409407] DAMAGECOUNT value on done: 1124.0
[2023-02-25 12:39:37,925][2409104] DAMAGECOUNT value on done: 550.0
[2023-02-25 12:39:37,926][2409104] Sum rewards: 0.196, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.620', 'AMMO2': '0.007', 'ARMOR': '0.012', 'AMMO4': '0.034', 'AMMO3': '0.084', 'WEAPON4': '0.150', 'HITCOUNT': '0.260', 'weapon4': '0.354', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.795', 'FRAGCOUNT': '1.000', 'weapon2': '1.050', 'weapon3': '1.720'}
[2023-02-25 12:39:37,940][2409099] DAMAGECOUNT value on done: 941.0
[2023-02-25 12:39:37,943][2409099] Sum rewards: 0.895, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.528', 'AMMO5': '0.005', 'ARMOR': '0.008', 'weapon5': '0.018', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'weapon4': '0.042', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.100', 'AMMO3': '0.121', 'HITCOUNT': '0.310', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.053', 'weapon2': '1.538', 'weapon3': '1.678', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:37,964][2409596] DAMAGECOUNT value on done: 1031.0
[2023-02-25 12:39:37,965][2409596] Sum rewards: 0.040, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.706', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon5': '0.092', 'AMMO3': '0.111', 'AMMO4': '0.113', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.300', 'weapon4': '0.384', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.146', 'weapon2': '1.198', 'weapon3': '1.744', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:39:37,969][2409097] DAMAGECOUNT value on done: 646.0
[2023-02-25 12:39:37,969][2409097] Sum rewards: -0.238, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.704', 'AMMO5': '0.003', 'AMMO2': '0.020', 'AMMO3': '0.041', 'WEAPON5': '0.050', 'weapon5': '0.086', 'AMMO4': '0.097', 'HITCOUNT': '0.220', 'weapon4': '0.240', 'WEAPON3': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.527', 'DAMAGECOUNT': '0.675', 'weapon3': '0.752', 'FRAGCOUNT': '1.000', 'weapon2': '2.206'}
[2023-02-25 12:39:38,054][2409074] Updated weights for policy 0, policy_version 7601 (0.0014)
[2023-02-25 12:39:38,119][2409486] DAMAGECOUNT value on done: 790.0
[2023-02-25 12:39:38,120][2409486] Sum rewards: -1.159, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.294', 'AMMO2': '0.019', 'ARMOR': '0.080', 'AMMO3': '0.092', 'AMMO4': '0.095', 'HITCOUNT': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.436', 'DAMAGECOUNT': '0.636', 'WEAPON3': '0.650', 'weapon2': '1.440', 'weapon3': '1.686', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:38,171][2409077] DAMAGECOUNT value on done: 762.0
[2023-02-25 12:39:38,172][2409077] Sum rewards: -1.365, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.108', 'AMMO2': '0.004', 'AMMO5': '0.012', 'AMMO4': '0.021', 'WEAPON1': '0.040', 'weapon5': '0.068', 'AMMO3': '0.107', 'WEAPON5': '0.200', 'HITCOUNT': '0.280', 'ARMOR': '0.456', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.816', 'FRAGCOUNT': '1.000', 'weapon3': '1.692', 'weapon2': '1.846'}
[2023-02-25 12:39:38,399][2409105] DAMAGECOUNT value on done: 777.0
[2023-02-25 12:39:38,400][2409105] Sum rewards: 2.307, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.330', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'WEAPON1': '0.010', 'AMMO3': '0.030', 'weapon7': '0.054', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.130', 'WEAPON7': '0.200', 'weapon4': '0.202', 'WEAPON3': '0.250', 'DAMAGECOUNT': '0.708', 'weapon3': '0.730', 'FRAGCOUNT': '1.000', 'weapon2': '1.264'}
[2023-02-25 12:39:38,416][2409548] DAMAGECOUNT value on done: 702.0
[2023-02-25 12:39:38,419][2409548] Sum rewards: -1.252, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.978', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.027', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.096', 'weapon5': '0.100', 'weapon4': '0.146', 'HITCOUNT': '0.230', 'ARMOR': '0.516', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.747', 'weapon3': '1.264', 'FRAGCOUNT': '2.000', 'weapon2': '2.092'}
[2023-02-25 12:39:38,500][2409389] DAMAGECOUNT value on done: 1166.0
[2023-02-25 12:39:38,515][2409389] Sum rewards: 1.930, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.460', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.026', 'WEAPON1': '0.030', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon5': '0.210', 'weapon4': '0.236', 'HITCOUNT': '0.300', 'WEAPON3': '0.500', 'ARMOR': '0.905', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.215', 'weapon2': '1.402', 'weapon3': '1.430'}
[2023-02-25 12:39:38,657][2409078] DAMAGECOUNT value on done: 762.0
[2023-02-25 12:39:38,658][2409078] Sum rewards: -0.521, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.012', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.067', 'weapon5': '0.082', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.182', 'ARMOR': '0.472', 'WEAPON3': '0.500', 'HITCOUNT': '0.500', 'weapon3': '0.964', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.581', 'weapon2': '1.820'}
[2023-02-25 12:39:38,792][2409469] DAMAGECOUNT value on done: 940.0
[2023-02-25 12:39:38,795][2409469] Sum rewards: 0.013, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.828', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.084', 'weapon4': '0.206', 'HITCOUNT': '0.220', 'ARMOR': '0.452', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.768', 'weapon3': '1.176', 'weapon2': '1.218', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:38,978][2409103] DAMAGECOUNT value on done: 600.0
[2023-02-25 12:39:38,981][2409103] Sum rewards: -2.144, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.910', 'AMMO2': '0.007', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.034', 'weapon5': '0.078', 'AMMO3': '0.091', 'ARMOR': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.220', 'weapon4': '0.230', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.350', 'weapon3': '1.682'}
[2023-02-25 12:39:39,322][2409373] DAMAGECOUNT value on done: 661.0
[2023-02-25 12:39:39,323][2409373] Sum rewards: -1.146, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.527', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'weapon4': '0.446', 'ARMOR': '0.493', 'DAMAGECOUNT': '0.561', 'WEAPON3': '0.650', 'weapon3': '1.018', 'weapon2': '1.434', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:39,427][2409405] DAMAGECOUNT value on done: 1156.0
[2023-02-25 12:39:39,427][2409405] Sum rewards: 0.746, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.270', 'AMMO5': '0.009', 'AMMO2': '0.012', 'weapon5': '0.016', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.070', 'weapon4': '0.082', 'WEAPON5': '0.100', 'HITCOUNT': '0.320', 'WEAPON3': '0.400', 'ARMOR': '0.451', 'DAMAGECOUNT': '1.152', 'weapon3': '1.680', 'FRAGCOUNT': '2.000', 'weapon2': '2.096'}
[2023-02-25 12:39:39,452][2409485] DAMAGECOUNT value on done: 721.0
[2023-02-25 12:39:39,456][2409485] Sum rewards: -0.202, reward structure: {'DEATHCOUNT': '-4.500', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.034', 'AMMO3': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.083', 'WEAPON3': '0.100', 'HITCOUNT': '0.130', 'HEALTH': '0.438', 'DAMAGECOUNT': '0.540', 'ARMOR': '0.815', 'weapon3': '0.828', 'weapon2': '1.720'}
[2023-02-25 12:39:39,539][2409547] DAMAGECOUNT value on done: 635.0
[2023-02-25 12:39:39,567][2409549] DAMAGECOUNT value on done: 1313.0
[2023-02-25 12:39:39,570][2409549] Sum rewards: 3.848, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.610', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'weapon5': '0.100', 'WEAPON5': '0.250', 'weapon4': '0.374', 'HITCOUNT': '0.420', 'WEAPON3': '0.600', 'weapon3': '1.050', 'weapon2': '1.674', 'DAMAGECOUNT': '1.716', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:39,705][2409079] DAMAGECOUNT value on done: 597.0
[2023-02-25 12:39:39,710][2409079] Sum rewards: -1.138, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.020', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO3': '0.101', 'HITCOUNT': '0.150', 'DAMAGECOUNT': '0.462', 'ARMOR': '0.548', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.710', 'weapon2': '1.846'}
[2023-02-25 12:39:39,984][2409074] Updated weights for policy 0, policy_version 7611 (0.0012)
[2023-02-25 12:39:40,105][2409101] DAMAGECOUNT value on done: 484.0
[2023-02-25 12:39:40,106][2409101] Sum rewards: 1.671, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.056', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON5': '0.050', 'AMMO3': '0.074', 'WEAPON4': '0.250', 'HITCOUNT': '0.280', 'weapon4': '0.300', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.900', 'ARMOR': '0.937', 'weapon2': '1.070', 'weapon3': '1.514', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:40,277][2409100] DAMAGECOUNT value on done: 738.0
[2023-02-25 12:39:40,281][2409100] Sum rewards: 0.052, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.594', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.091', 'HITCOUNT': '0.140', 'weapon4': '0.232', 'DAMAGECOUNT': '0.447', 'ARMOR': '0.543', 'WEAPON3': '0.600', 'weapon3': '1.324', 'weapon2': '1.862', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:40,596][2409096] DAMAGECOUNT value on done: 761.0
[2023-02-25 12:39:40,601][2409096] Sum rewards: -2.051, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.900', 'AMMO5': '0.009', 'AMMO2': '0.011', 'weapon5': '0.030', 'AMMO4': '0.056', 'AMMO3': '0.066', 'weapon7': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'HITCOUNT': '0.180', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.474', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.633', 'ARMOR': '0.883', 'FRAGCOUNT': '1.000', 'weapon3': '1.180', 'weapon2': '1.362'}
[2023-02-25 12:39:40,637][2409866] DAMAGECOUNT value on done: 1004.0
[2023-02-25 12:39:40,640][2409866] Sum rewards: 4.775, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'AMMO4': '0.116', 'weapon5': '0.132', 'WEAPON5': '0.200', 'HEALTH': '0.332', 'weapon4': '0.342', 'HITCOUNT': '0.370', 'WEAPON3': '0.450', 'weapon2': '1.008', 'weapon3': '1.446', 'DAMAGECOUNT': '1.647', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:40,883][2409468] DAMAGECOUNT value on done: 962.0
[2023-02-25 12:39:40,884][2409468] Sum rewards: 0.529, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.697', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'AMMO4': '0.034', 'weapon5': '0.066', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.120', 'weapon4': '0.206', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.825', 'weapon3': '1.452', 'weapon2': '1.632', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:40,979][2409075] DAMAGECOUNT value on done: 1092.0
[2023-02-25 12:39:40,996][2409597] DAMAGECOUNT value on done: 967.0
[2023-02-25 12:39:40,997][2409597] Sum rewards: 3.703, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.367', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.085', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'HITCOUNT': '0.330', 'ARMOR': '0.415', 'weapon4': '0.416', 'WEAPON3': '0.550', 'weapon3': '1.118', 'weapon2': '1.358', 'DAMAGECOUNT': '1.422', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:41,163][2409406] DAMAGECOUNT value on done: 844.0
[2023-02-25 12:39:41,164][2409406] Sum rewards: -0.078, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.438', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.140', 'HITCOUNT': '0.260', 'ARMOR': '0.444', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.966', 'weapon3': '1.226', 'weapon2': '2.124', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:41,201][2409355] DAMAGECOUNT value on done: 945.0
[2023-02-25 12:39:41,433][2409080] DAMAGECOUNT value on done: 785.0
[2023-02-25 12:39:41,437][2409080] Sum rewards: -1.178, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.398', 'AMMO2': '0.002', 'AMMO5': '0.010', 'AMMO4': '0.011', 'WEAPON1': '0.040', 'weapon5': '0.060', 'AMMO3': '0.129', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.278', 'HITCOUNT': '0.510', 'WEAPON3': '0.900', 'weapon2': '1.300', 'DAMAGECOUNT': '1.467', 'weapon3': '1.912', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:41,474][2409102] DAMAGECOUNT value on done: 1005.0
[2023-02-25 12:39:41,479][2409102] Sum rewards: 4.243, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.416', 'AMMO5': '0.003', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'AMMO3': '0.094', 'weapon4': '0.206', 'HITCOUNT': '0.460', 'ARMOR': '0.476', 'WEAPON3': '0.550', 'weapon2': '1.014', 'DAMAGECOUNT': '1.638', 'weapon3': '1.852', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:39:41,536][2409074] Updated weights for policy 0, policy_version 7621 (0.0013)
[2023-02-25 12:39:41,615][2409407] DAMAGECOUNT value on done: 847.0
[2023-02-25 12:39:41,616][2409407] Sum rewards: -1.641, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.814', 'AMMO2': '0.013', 'AMMO4': '0.063', 'AMMO3': '0.087', 'HITCOUNT': '0.190', 'weapon4': '0.220', 'WEAPON4': '0.300', 'ARMOR': '0.416', 'DAMAGECOUNT': '0.594', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.636', 'weapon3': '1.804'}
[2023-02-25 12:39:41,708][2409076] DAMAGECOUNT value on done: 1187.0
[2023-02-25 12:39:41,712][2409076] Sum rewards: 4.953, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO3': '0.030', 'AMMO4': '0.034', 'WEAPON3': '0.200', 'HITCOUNT': '0.400', 'HEALTH': '0.460', 'weapon3': '0.736', 'weapon2': '1.122', 'DAMAGECOUNT': '1.194', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:41,731][2409565] DAMAGECOUNT value on done: 917.0
[2023-02-25 12:39:41,732][2409565] Sum rewards: -1.478, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.976', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.006', 'WEAPON1': '0.020', 'weapon5': '0.066', 'weapon7': '0.086', 'AMMO3': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.274', 'HITCOUNT': '0.370', 'WEAPON3': '0.800', 'ARMOR': '0.854', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.284', 'weapon2': '1.406', 'weapon3': '1.692'}
[2023-02-25 12:39:41,882][2409104] DAMAGECOUNT value on done: 632.0
[2023-02-25 12:39:41,883][2409104] Sum rewards: 4.071, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.006', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.017', 'ARMOR': '0.036', 'AMMO3': '0.040', 'HITCOUNT': '0.260', 'WEAPON3': '0.300', 'weapon3': '0.858', 'DAMAGECOUNT': '0.960', 'weapon2': '1.842', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:41,908][2409596] DAMAGECOUNT value on done: 734.0
[2023-02-25 12:39:41,909][2409596] Sum rewards: -2.959, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.290', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.125', 'weapon4': '0.248', 'HITCOUNT': '0.270', 'WEAPON4': '0.300', 'ARMOR': '0.523', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.780', 'FRAGCOUNT': '1.000', 'weapon2': '1.566', 'weapon3': '1.876'}
[2023-02-25 12:39:41,953][2409099] DAMAGECOUNT value on done: 725.0
[2023-02-25 12:39:41,954][2409548] DAMAGECOUNT value on done: 925.0
[2023-02-25 12:39:41,956][2409099] Sum rewards: -1.970, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.766', 'AMMO2': '0.002', 'AMMO4': '0.009', 'WEAPON1': '0.030', 'ARMOR': '0.036', 'AMMO3': '0.074', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'weapon4': '0.230', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.543', 'FRAGCOUNT': '1.000', 'weapon3': '1.478', 'weapon2': '2.084'}
[2023-02-25 12:39:41,956][2409548] Sum rewards: -0.703, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.362', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.118', 'HITCOUNT': '0.370', 'ARMOR': '0.412', 'WEAPON3': '0.800', 'weapon2': '1.136', 'DAMAGECOUNT': '1.239', 'weapon3': '1.700', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:42,068][2409077] DAMAGECOUNT value on done: 1192.0
[2023-02-25 12:39:42,069][2409077] Sum rewards: -1.770, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.848', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'ARMOR': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.091', 'weapon4': '0.204', 'HITCOUNT': '0.260', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.630', 'FRAGCOUNT': '1.000', 'weapon2': '1.314', 'weapon3': '1.548'}
[2023-02-25 12:39:42,087][2409486] DAMAGECOUNT value on done: 671.0
[2023-02-25 12:39:42,088][2409486] Sum rewards: 2.037, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.560', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'ARMOR': '0.052', 'AMMO3': '0.071', 'WEAPON4': '0.200', 'weapon4': '0.234', 'HITCOUNT': '0.250', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.984', 'weapon3': '1.216', 'weapon2': '1.322', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:42,170][2409105] DAMAGECOUNT value on done: 785.0
[2023-02-25 12:39:42,171][2409105] Sum rewards: -1.305, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.007', 'AMMO2': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.021', 'weapon5': '0.066', 'AMMO3': '0.073', 'WEAPON5': '0.150', 'HITCOUNT': '0.210', 'WEAPON4': '0.250', 'weapon4': '0.482', 'WEAPON3': '0.500', 'weapon3': '0.860', 'ARMOR': '0.928', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.005', 'weapon2': '1.628'}
[2023-02-25 12:39:42,186][2408954] Fps is (10 sec: 25804.4, 60 sec: 24917.3, 300 sec: 24825.9). Total num frames: 31236096. Throughput: 0: 6241.3. Samples: 7808772. Policy #0 lag: (min: 0.0, avg: 12.3, max: 27.0)
[2023-02-25 12:39:42,186][2408954] Avg episode reward: [(0, '0.085')]
[2023-02-25 12:39:42,277][2409097] DAMAGECOUNT value on done: 717.0
[2023-02-25 12:39:42,281][2409097] Sum rewards: 3.329, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.202', 'AMMO4': '-0.048', 'AMMO2': '-0.009', 'AMMO3': '0.057', 'WEAPON4': '0.150', 'weapon4': '0.354', 'HITCOUNT': '0.400', 'WEAPON3': '0.450', 'weapon3': '1.206', 'DAMAGECOUNT': '1.254', 'ARMOR': '1.433', 'weapon2': '1.534', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:42,567][2409389] DAMAGECOUNT value on done: 1222.0
[2023-02-25 12:39:42,570][2409389] Sum rewards: 3.138, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.905', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.007', 'WEAPON4': '0.050', 'AMMO3': '0.053', 'WEAPON5': '0.150', 'weapon5': '0.178', 'weapon4': '0.214', 'ARMOR': '0.426', 'WEAPON3': '0.450', 'HITCOUNT': '0.550', 'weapon3': '1.144', 'FRAGCOUNT': '1.500', 'weapon2': '1.710', 'DAMAGECOUNT': '2.109'}
[2023-02-25 12:39:42,714][2409103] DAMAGECOUNT value on done: 1102.0
[2023-02-25 12:39:42,715][2409103] Sum rewards: -1.384, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.440', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'ARMOR': '0.040', 'AMMO3': '0.068', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'weapon5': '0.126', 'weapon4': '0.140', 'HITCOUNT': '0.180', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.699', 'weapon3': '1.158', 'weapon2': '1.438', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:42,762][2409469] DAMAGECOUNT value on done: 1253.0
[2023-02-25 12:39:42,766][2409469] Sum rewards: 3.597, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.461', 'AMMO2': '0.009', 'ARMOR': '0.032', 'AMMO4': '0.045', 'AMMO3': '0.086', 'WEAPON4': '0.250', 'HITCOUNT': '0.510', 'weapon4': '0.512', 'WEAPON3': '0.550', 'weapon2': '1.000', 'weapon3': '1.592', 'DAMAGECOUNT': '1.722', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:42,836][2409078] DAMAGECOUNT value on done: 676.0
[2023-02-25 12:39:42,837][2409078] Sum rewards: 1.623, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.376', 'AMMO5': '0.007', 'weapon5': '0.014', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'AMMO3': '0.091', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'HITCOUNT': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.636', 'weapon2': '1.444', 'weapon3': '1.568', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:43,021][2409074] Updated weights for policy 0, policy_version 7631 (0.0012)
[2023-02-25 12:39:43,261][2409405] DAMAGECOUNT value on done: 425.0
[2023-02-25 12:39:43,269][2409485] DAMAGECOUNT value on done: 631.0
[2023-02-25 12:39:43,271][2409485] Sum rewards: 3.851, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.535', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'ARMOR': '0.020', 'AMMO3': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'weapon7': '0.066', 'weapon5': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.210', 'WEAPON3': '0.250', 'weapon3': '0.744', 'DAMAGECOUNT': '0.885', 'weapon2': '1.120', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:43,406][2409373] DAMAGECOUNT value on done: 1039.0
[2023-02-25 12:39:43,407][2409373] Sum rewards: 0.611, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.753', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'ARMOR': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'weapon4': '0.160', 'HITCOUNT': '0.270', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.894', 'weapon3': '1.514', 'weapon2': '1.560', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:43,426][2409079] DAMAGECOUNT value on done: 717.0
[2023-02-25 12:39:43,429][2409079] Sum rewards: 1.792, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'HEALTH': '0.038', 'AMMO4': '0.043', 'WEAPON5': '0.050', 'weapon5': '0.072', 'ARMOR': '0.084', 'AMMO3': '0.107', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'weapon4': '0.356', 'DAMAGECOUNT': '0.552', 'WEAPON3': '0.600', 'weapon3': '1.546', 'weapon2': '1.712', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:43,454][2409549] DAMAGECOUNT value on done: 1231.0
[2023-02-25 12:39:43,458][2409549] Sum rewards: -0.408, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.205', 'AMMO2': '0.003', 'AMMO4': '0.014', 'WEAPON1': '0.020', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'weapon4': '0.136', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.750', 'weapon2': '1.456', 'weapon3': '1.950', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:43,955][2409101] DAMAGECOUNT value on done: 970.0
[2023-02-25 12:39:43,957][2409101] Sum rewards: 4.218, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.028', 'HEALTH': '0.038', 'WEAPON4': '0.050', 'weapon4': '0.092', 'AMMO3': '0.127', 'AMMO4': '0.142', 'HITCOUNT': '0.390', 'WEAPON3': '0.700', 'weapon3': '1.518', 'DAMAGECOUNT': '1.635', 'weapon2': '1.748', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:39:44,041][2409100] DAMAGECOUNT value on done: 881.0
[2023-02-25 12:39:44,044][2409100] Sum rewards: -0.668, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.175', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'WEAPON1': '0.010', 'ARMOR': '0.028', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'HITCOUNT': '0.190', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.762', 'weapon2': '1.438', 'weapon3': '1.842', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:44,457][2409547] DAMAGECOUNT value on done: 1116.0
[2023-02-25 12:39:44,461][2409547] Sum rewards: 4.313, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.033', 'AMMO2': '0.027', 'AMMO3': '0.050', 'weapon7': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.134', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.290', 'WEAPON4': '0.350', 'ARMOR': '0.509', 'weapon3': '0.580', 'weapon4': '0.954', 'DAMAGECOUNT': '1.404', 'weapon2': '1.530', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:44,522][2409866] DAMAGECOUNT value on done: 1347.0
[2023-02-25 12:39:44,525][2409866] Sum rewards: -3.013, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.462', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'AMMO3': '0.093', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'weapon4': '0.182', 'HITCOUNT': '0.440', 'ARMOR': '0.491', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.509', 'weapon3': '1.678', 'weapon2': '1.854'}
[2023-02-25 12:39:44,766][2409406] DAMAGECOUNT value on done: 911.0
[2023-02-25 12:39:44,769][2409406] Sum rewards: 1.225, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.607', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.018', 'AMMO4': '0.033', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'HITCOUNT': '0.280', 'ARMOR': '0.432', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.254', 'weapon2': '1.544', 'weapon3': '1.762'}
[2023-02-25 12:39:44,875][2409468] DAMAGECOUNT value on done: 684.0
[2023-02-25 12:39:44,924][2409096] DAMAGECOUNT value on done: 1086.0
[2023-02-25 12:39:44,924][2409096] Sum rewards: 0.146, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.814', 'AMMO2': '0.001', 'AMMO4': '0.007', 'ARMOR': '0.032', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'weapon4': '0.124', 'HITCOUNT': '0.230', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.915', 'FRAGCOUNT': '1.000', 'weapon3': '1.368', 'weapon2': '1.904'}
[2023-02-25 12:39:44,931][2409074] Updated weights for policy 0, policy_version 7641 (0.0012)
[2023-02-25 12:39:44,952][2409075] DAMAGECOUNT value on done: 1085.0
[2023-02-25 12:39:44,953][2409075] Sum rewards: 0.349, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.880', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon5': '0.094', 'AMMO3': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.284', 'HITCOUNT': '0.460', 'WEAPON3': '0.700', 'weapon2': '0.882', 'ARMOR': '0.899', 'FRAGCOUNT': '1.500', 'weapon3': '1.574', 'DAMAGECOUNT': '1.971'}
[2023-02-25 12:39:44,975][2409597] DAMAGECOUNT value on done: 928.0
[2023-02-25 12:39:44,978][2409597] Sum rewards: -0.178, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.165', 'AMMO2': '0.013', 'AMMO5': '0.018', 'weapon5': '0.064', 'AMMO4': '0.066', 'weapon4': '0.072', 'AMMO3': '0.095', 'WEAPON4': '0.150', 'HITCOUNT': '0.280', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.885', 'FRAGCOUNT': '1.000', 'weapon3': '1.510', 'weapon2': '1.784'}
[2023-02-25 12:39:45,091][2409355] DAMAGECOUNT value on done: 897.0
[2023-02-25 12:39:45,092][2409355] Sum rewards: 6.389, reward structure: {'DEATHCOUNT': '-8.250', 'weapon5': '0.002', 'AMMO2': '0.012', 'AMMO5': '0.013', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'weapon4': '0.126', 'AMMO3': '0.127', 'HEALTH': '0.184', 'WEAPON5': '0.200', 'HITCOUNT': '0.440', 'WEAPON3': '0.650', 'ARMOR': '0.812', 'DAMAGECOUNT': '1.458', 'weapon2': '1.522', 'weapon3': '1.936', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:39:45,369][2409407] DAMAGECOUNT value on done: 1199.0
[2023-02-25 12:39:45,370][2409407] Sum rewards: 4.553, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.672', 'AMMO5': '0.005', 'AMMO2': '0.012', 'ARMOR': '0.020', 'AMMO4': '0.058', 'weapon5': '0.058', 'AMMO3': '0.096', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.340', 'weapon4': '0.576', 'WEAPON3': '0.600', 'weapon2': '1.208', 'weapon3': '1.402', 'DAMAGECOUNT': '1.500', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:39:45,399][2409080] DAMAGECOUNT value on done: 937.0
[2023-02-25 12:39:45,401][2409080] Sum rewards: 0.413, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.312', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.016', 'weapon4': '0.030', 'AMMO4': '0.036', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'HITCOUNT': '0.220', 'DAMAGECOUNT': '0.615', 'WEAPON3': '0.800', 'ARMOR': '0.934', 'weapon2': '1.644', 'weapon3': '1.836', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:45,433][2409102] DAMAGECOUNT value on done: 905.0
[2023-02-25 12:39:45,434][2409102] Sum rewards: 0.595, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.189', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'ARMOR': '0.056', 'AMMO4': '0.067', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'HITCOUNT': '0.320', 'weapon4': '0.396', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.002', 'weapon2': '1.360', 'weapon3': '1.880', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:45,811][2409077] DAMAGECOUNT value on done: 1388.0
[2023-02-25 12:39:45,814][2409077] Sum rewards: -0.738, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.529', 'AMMO5': '0.007', 'AMMO2': '0.026', 'ARMOR': '0.028', 'weapon5': '0.046', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'HITCOUNT': '0.200', 'weapon4': '0.312', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.906', 'weapon3': '1.474', 'weapon2': '1.728', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:45,821][2409565] DAMAGECOUNT value on done: 1615.0
[2023-02-25 12:39:45,822][2409565] Sum rewards: 4.579, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.875', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon4': '0.024', 'weapon5': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.082', 'ARMOR': '0.472', 'HITCOUNT': '0.610', 'WEAPON3': '0.650', 'weapon3': '1.612', 'weapon2': '1.920', 'DAMAGECOUNT': '2.205', 'FRAGCOUNT': '4.500'}
[2023-02-25 12:39:45,824][2409548] DAMAGECOUNT value on done: 1071.0
[2023-02-25 12:39:45,827][2409548] Sum rewards: 1.906, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '0.004', 'AMMO2': '0.013', 'AMMO3': '0.060', 'AMMO4': '0.064', 'WEAPON4': '0.200', 'WEAPON3': '0.300', 'weapon4': '0.362', 'HITCOUNT': '0.370', 'ARMOR': '0.500', 'weapon3': '1.052', 'DAMAGECOUNT': '1.335', 'weapon2': '1.646', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:45,848][2409104] DAMAGECOUNT value on done: 636.0
[2023-02-25 12:39:45,851][2409104] Sum rewards: 0.836, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.880', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.009', 'weapon5': '0.032', 'ARMOR': '0.048', 'AMMO3': '0.076', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.208', 'HITCOUNT': '0.310', 'WEAPON3': '0.550', 'weapon3': '0.916', 'DAMAGECOUNT': '0.978', 'weapon2': '1.470', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:45,873][2409596] DAMAGECOUNT value on done: 941.0
[2023-02-25 12:39:45,873][2409596] Sum rewards: -1.141, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.013', 'HEALTH': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.082', 'weapon4': '0.110', 'HITCOUNT': '0.260', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.816', 'FRAGCOUNT': '1.000', 'weapon2': '1.128', 'weapon3': '1.536'}
[2023-02-25 12:39:45,934][2409099] DAMAGECOUNT value on done: 869.0
[2023-02-25 12:39:45,937][2409099] Sum rewards: 3.524, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.909', 'AMMO2': '0.009', 'AMMO4': '0.047', 'ARMOR': '0.094', 'AMMO3': '0.095', 'WEAPON4': '0.150', 'HITCOUNT': '0.280', 'weapon4': '0.386', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.080', 'weapon3': '1.408', 'weapon2': '1.534', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:45,943][2409105] DAMAGECOUNT value on done: 933.0
[2023-02-25 12:39:45,947][2409105] Sum rewards: 4.624, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'AMMO3': '0.096', 'weapon5': '0.104', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.170', 'weapon4': '0.220', 'WEAPON3': '0.450', 'ARMOR': '0.528', 'HEALTH': '0.590', 'DAMAGECOUNT': '0.933', 'weapon2': '1.402', 'weapon3': '1.652', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:46,021][2409486] DAMAGECOUNT value on done: 703.0
[2023-02-25 12:39:46,023][2409486] Sum rewards: 2.629, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.547', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'ARMOR': '0.052', 'weapon7': '0.052', 'AMMO3': '0.072', 'AMMO4': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.250', 'HITCOUNT': '0.370', 'weapon4': '0.382', 'WEAPON3': '0.600', 'weapon2': '1.002', 'DAMAGECOUNT': '1.314', 'weapon3': '1.394', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:39:46,357][2409074] Updated weights for policy 0, policy_version 7651 (0.0012)
[2023-02-25 12:39:46,576][2409389] DAMAGECOUNT value on done: 851.0
[2023-02-25 12:39:46,577][2409389] Sum rewards: 1.718, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.685', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.004', 'ARMOR': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'weapon4': '0.206', 'HITCOUNT': '0.360', 'WEAPON3': '0.650', 'weapon3': '1.350', 'weapon2': '1.352', 'DAMAGECOUNT': '1.392', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:46,703][2409097] DAMAGECOUNT value on done: 1146.0
[2023-02-25 12:39:46,705][2409469] DAMAGECOUNT value on done: 1034.0
[2023-02-25 12:39:46,705][2409076] DAMAGECOUNT value on done: 1306.0
[2023-02-25 12:39:46,706][2409097] Sum rewards: -3.439, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.165', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'ARMOR': '0.044', 'AMMO3': '0.136', 'AMMO4': '0.149', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.254', 'DAMAGECOUNT': '0.555', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.612', 'weapon3': '1.776'}
[2023-02-25 12:39:46,707][2409076] Sum rewards: 2.918, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.890', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.014', 'WEAPON1': '0.040', 'weapon4': '0.056', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.126', 'ARMOR': '0.457', 'HITCOUNT': '0.480', 'WEAPON3': '0.850', 'weapon3': '1.570', 'DAMAGECOUNT': '1.638', 'weapon2': '1.884', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:39:46,706][2409469] Sum rewards: 1.224, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.740', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon4': '0.106', 'AMMO3': '0.115', 'WEAPON4': '0.150', 'HITCOUNT': '0.290', 'ARMOR': '0.480', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.843', 'weapon3': '1.536', 'weapon2': '1.722', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:46,835][2409103] DAMAGECOUNT value on done: 1284.0
[2023-02-25 12:39:46,838][2409103] Sum rewards: -0.724, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.980', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO3': '0.042', 'ARMOR': '0.060', 'weapon5': '0.082', 'WEAPON4': '0.100', 'weapon4': '0.118', 'WEAPON5': '0.150', 'HITCOUNT': '0.240', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.918', 'FRAGCOUNT': '1.000', 'weapon3': '1.036', 'weapon2': '1.482'}
[2023-02-25 12:39:47,186][2408954] Fps is (10 sec: 24985.6, 60 sec: 24985.6, 300 sec: 24812.0). Total num frames: 31354880. Throughput: 0: 6236.3. Samples: 7845888. Policy #0 lag: (min: 2.0, avg: 11.3, max: 26.0)
[2023-02-25 12:39:47,186][2408954] Avg episode reward: [(0, '0.394')]
[2023-02-25 12:39:47,320][2409079] DAMAGECOUNT value on done: 595.0
[2023-02-25 12:39:47,321][2409079] Sum rewards: 2.245, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'AMMO3': '0.040', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.071', 'weapon5': '0.078', 'HEALTH': '0.103', 'weapon4': '0.194', 'WEAPON3': '0.250', 'HITCOUNT': '0.290', 'weapon3': '0.814', 'DAMAGECOUNT': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '2.104'}
[2023-02-25 12:39:47,322][2409485] DAMAGECOUNT value on done: 769.0
[2023-02-25 12:39:47,326][2409485] Sum rewards: -0.715, reward structure: {'DEATHCOUNT': '-4.500', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.052', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.014', 'AMMO3': '0.040', 'WEAPON5': '0.050', 'weapon7': '0.050', 'AMMO4': '0.069', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'ARMOR': '0.404', 'weapon4': '0.438', 'weapon3': '0.480', 'DAMAGECOUNT': '0.606', 'weapon2': '1.100'}
[2023-02-25 12:39:47,423][2409078] DAMAGECOUNT value on done: 806.0
[2023-02-25 12:39:47,424][2409078] Sum rewards: -4.527, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.792', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.004', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.042', 'ARMOR': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'HITCOUNT': '0.170', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.402', 'weapon4': '0.404', 'WEAPON3': '0.650', 'weapon3': '1.186', 'weapon2': '1.878'}
[2023-02-25 12:39:47,519][2409549] DAMAGECOUNT value on done: 920.0
[2023-02-25 12:39:47,522][2409549] Sum rewards: -1.671, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.516', 'AMMO2': '0.002', 'AMMO4': '0.010', 'weapon4': '0.018', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'HITCOUNT': '0.270', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.894', 'weapon3': '1.792', 'weapon2': '1.894', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:47,608][2409100] DAMAGECOUNT value on done: 1064.0
[2023-02-25 12:39:47,904][2409405] DAMAGECOUNT value on done: 1129.0
[2023-02-25 12:39:47,905][2409405] Sum rewards: 2.745, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.850', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.061', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'weapon5': '0.106', 'weapon4': '0.210', 'WEAPON5': '0.250', 'HITCOUNT': '0.420', 'WEAPON3': '0.650', 'weapon3': '1.206', 'weapon2': '1.322', 'DAMAGECOUNT': '1.893', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:39:48,107][2409101] DAMAGECOUNT value on done: 911.0
[2023-02-25 12:39:48,132][2409373] DAMAGECOUNT value on done: 1187.0
[2023-02-25 12:39:48,133][2409373] Sum rewards: 3.117, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.358', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'WEAPON1': '0.040', 'weapon5': '0.054', 'AMMO3': '0.069', 'WEAPON5': '0.150', 'HITCOUNT': '0.320', 'WEAPON3': '0.500', 'ARMOR': '0.800', 'DAMAGECOUNT': '1.035', 'weapon3': '1.200', 'weapon2': '1.812', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:48,206][2409074] Updated weights for policy 0, policy_version 7661 (0.0012)
[2023-02-25 12:39:48,263][2409866] DAMAGECOUNT value on done: 880.0
[2023-02-25 12:39:48,264][2409866] Sum rewards: 0.103, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.759', 'AMMO4': '-0.008', 'AMMO2': '-0.001', 'ARMOR': '0.008', 'AMMO3': '0.066', 'HITCOUNT': '0.180', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.669', 'weapon3': '0.798', 'weapon2': '1.250', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:48,516][2409597] DAMAGECOUNT value on done: 832.0
[2023-02-25 12:39:48,523][2409406] DAMAGECOUNT value on done: 959.0
[2023-02-25 12:39:48,526][2409406] Sum rewards: 1.059, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.970', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO3': '0.060', 'WEAPON4': '0.150', 'weapon4': '0.230', 'HITCOUNT': '0.370', 'ARMOR': '0.416', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.993', 'FRAGCOUNT': '1.000', 'weapon3': '1.426', 'weapon2': '1.452'}
[2023-02-25 12:39:48,562][2409468] DAMAGECOUNT value on done: 866.0
[2023-02-25 12:39:48,565][2409468] Sum rewards: -4.124, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.490', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.028', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'HITCOUNT': '0.370', 'ARMOR': '0.404', 'WEAPON3': '1.050', 'DAMAGECOUNT': '1.095', 'weapon2': '1.284', 'FRAGCOUNT': '2.000', 'weapon3': '2.324'}
[2023-02-25 12:39:48,680][2409355] DAMAGECOUNT value on done: 1356.0
[2023-02-25 12:39:48,680][2409355] Sum rewards: 3.600, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.075', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.051', 'AMMO3': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.294', 'HITCOUNT': '0.480', 'WEAPON3': '0.650', 'weapon2': '1.280', 'DAMAGECOUNT': '1.770', 'weapon3': '1.820', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:48,693][2409096] DAMAGECOUNT value on done: 1137.0
[2023-02-25 12:39:48,697][2409096] Sum rewards: 1.707, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.805', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'AMMO3': '0.112', 'weapon4': '0.178', 'HITCOUNT': '0.450', 'ARMOR': '0.485', 'WEAPON3': '0.750', 'weapon2': '1.324', 'DAMAGECOUNT': '1.683', 'weapon3': '2.048', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:39:48,729][2409547] DAMAGECOUNT value on done: 1225.0
[2023-02-25 12:39:48,743][2409547] Sum rewards: -2.696, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.014', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO3': '0.137', 'AMMO4': '0.164', 'HITCOUNT': '0.170', 'WEAPON4': '0.300', 'weapon4': '0.372', 'ARMOR': '0.460', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.005', 'weapon2': '1.304', 'weapon3': '1.888', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:48,857][2409075] DAMAGECOUNT value on done: 1345.0
[2023-02-25 12:39:48,857][2409075] Sum rewards: 0.485, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.569', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON1': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.064', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon4': '0.214', 'HITCOUNT': '0.330', 'ARMOR': '0.432', 'WEAPON3': '0.550', 'weapon3': '1.346', 'DAMAGECOUNT': '1.500', 'weapon2': '1.966', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:49,189][2409080] DAMAGECOUNT value on done: 924.0
[2023-02-25 12:39:49,192][2409080] Sum rewards: 2.193, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.148', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'ARMOR': '0.012', 'WEAPON1': '0.050', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.166', 'HITCOUNT': '0.290', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.026', 'weapon2': '1.136', 'weapon3': '1.450', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:49,250][2409407] DAMAGECOUNT value on done: 758.0
[2023-02-25 12:39:49,258][2409407] Sum rewards: 2.602, reward structure: {'DEATHCOUNT': '-6.750', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.101', 'HEALTH': '0.114', 'WEAPON4': '0.150', 'weapon4': '0.198', 'HITCOUNT': '0.290', 'ARMOR': '0.412', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.924', 'weapon3': '1.662', 'weapon2': '1.810', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:49,315][2409074] Updated weights for policy 0, policy_version 7671 (0.0012)
[2023-02-25 12:39:49,452][2409102] DAMAGECOUNT value on done: 1447.0
[2023-02-25 12:39:49,456][2409102] Sum rewards: -1.324, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.670', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.106', 'weapon4': '0.238', 'WEAPON4': '0.250', 'HITCOUNT': '0.490', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.620', 'weapon2': '1.678', 'weapon3': '1.854', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:49,540][2409077] DAMAGECOUNT value on done: 1054.0
[2023-02-25 12:39:49,541][2409077] Sum rewards: 4.873, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.023', 'AMMO5': '0.003', 'WEAPON1': '0.030', 'AMMO2': '0.036', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO3': '0.075', 'AMMO4': '0.177', 'WEAPON4': '0.250', 'weapon4': '0.384', 'HITCOUNT': '0.420', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.095', 'weapon2': '1.296', 'weapon3': '1.468', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:39:49,547][2409596] DAMAGECOUNT value on done: 954.0
[2023-02-25 12:39:49,548][2409596] Sum rewards: -3.290, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.613', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.052', 'AMMO4': '0.073', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.220', 'WEAPON3': '0.550', 'ARMOR': '0.800', 'DAMAGECOUNT': '0.825', 'weapon3': '0.960', 'FRAGCOUNT': '2.000', 'weapon2': '2.272'}
[2023-02-25 12:39:49,557][2409104] DAMAGECOUNT value on done: 1802.0
[2023-02-25 12:39:49,558][2409104] Sum rewards: -1.171, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.175', 'AMMO5': '0.010', 'AMMO2': '0.011', 'weapon5': '0.026', 'weapon7': '0.052', 'AMMO4': '0.056', 'AMMO3': '0.061', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'HITCOUNT': '0.400', 'ARMOR': '0.445', 'WEAPON3': '0.500', 'weapon4': '0.608', 'weapon3': '0.966', 'weapon2': '1.408', 'DAMAGECOUNT': '1.470', 'FRAGCOUNT': '1.500'}
[2023-02-25 12:39:49,597][2409099] DAMAGECOUNT value on done: 1288.0
[2023-02-25 12:39:49,601][2409099] Sum rewards: 0.761, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.703', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'weapon5': '0.032', 'WEAPON4': '0.050', 'weapon7': '0.070', 'AMMO3': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.228', 'HITCOUNT': '0.330', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.176', 'weapon2': '1.208', 'weapon3': '1.524'}
[2023-02-25 12:39:49,654][2409486] DAMAGECOUNT value on done: 1222.0
[2023-02-25 12:39:49,659][2409486] Sum rewards: 5.020, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.574', 'AMMO5': '0.003', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'weapon5': '0.054', 'AMMO3': '0.067', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.258', 'HITCOUNT': '0.280', 'WEAPON3': '0.500', 'ARMOR': '0.824', 'weapon3': '1.122', 'weapon2': '1.158', 'DAMAGECOUNT': '1.203', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:39:49,671][2409105] DAMAGECOUNT value on done: 743.0
[2023-02-25 12:39:49,680][2409105] Sum rewards: 0.272, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.616', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.056', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.356', 'WEAPON3': '0.550', 'ARMOR': '0.872', 'DAMAGECOUNT': '1.038', 'weapon3': '1.272', 'weapon2': '1.742', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:39:49,761][2409565] DAMAGECOUNT value on done: 998.0
[2023-02-25 12:39:49,764][2409565] Sum rewards: -1.503, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.192', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'weapon4': '0.024', 'WEAPON4': '0.050', 'weapon5': '0.074', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.240', 'ARMOR': '0.520', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.278', 'weapon2': '1.530', 'weapon3': '1.700', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:49,870][2409548] DAMAGECOUNT value on done: 1223.0
[2023-02-25 12:39:49,871][2409548] Sum rewards: 3.066, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.252', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.128', 'weapon4': '0.364', 'HITCOUNT': '0.380', 'WEAPON3': '0.700', 'ARMOR': '0.831', 'DAMAGECOUNT': '1.107', 'weapon2': '1.384', 'weapon3': '1.956', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:50,574][2409076] DAMAGECOUNT value on done: 948.0
[2023-02-25 12:39:50,577][2409076] Sum rewards: -0.367, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.050', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.078', 'WEAPON4': '0.250', 'HITCOUNT': '0.320', 'WEAPON3': '0.400', 'weapon4': '0.430', 'ARMOR': '0.928', 'DAMAGECOUNT': '1.017', 'weapon3': '1.354', 'weapon2': '1.708', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:50,620][2409469] DAMAGECOUNT value on done: 479.0
[2023-02-25 12:39:50,632][2409103] DAMAGECOUNT value on done: 1011.0
[2023-02-25 12:39:50,632][2409103] Sum rewards: 1.509, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.872', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.078', 'AMMO3': '0.110', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.350', 'HITCOUNT': '0.450', 'ARMOR': '0.452', 'WEAPON3': '0.600', 'weapon3': '1.514', 'weapon2': '1.614', 'DAMAGECOUNT': '2.094', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:50,644][2409389] DAMAGECOUNT value on done: 1378.0
[2023-02-25 12:39:50,647][2409389] Sum rewards: 3.450, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.124', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.033', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO3': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.165', 'WEAPON4': '0.250', 'HITCOUNT': '0.360', 'WEAPON3': '0.450', 'weapon4': '0.450', 'ARMOR': '0.840', 'weapon3': '1.096', 'weapon2': '1.150', 'DAMAGECOUNT': '1.719', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:50,816][2409097] DAMAGECOUNT value on done: 958.0
[2023-02-25 12:39:50,817][2409097] Sum rewards: 3.860, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO3': '0.071', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.123', 'weapon4': '0.142', 'weapon5': '0.150', 'HITCOUNT': '0.290', 'WEAPON3': '0.350', 'ARMOR': '0.432', 'HEALTH': '0.458', 'weapon3': '1.342', 'DAMAGECOUNT': '1.371', 'weapon2': '1.646', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:39:51,220][2409079] DAMAGECOUNT value on done: 778.0
[2023-02-25 12:39:51,223][2409079] Sum rewards: 0.992, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.646', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'WEAPON4': '0.150', 'weapon4': '0.224', 'HITCOUNT': '0.320', 'ARMOR': '0.428', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.065', 'weapon2': '1.290', 'FRAGCOUNT': '2.000', 'weapon3': '2.082'}
[2023-02-25 12:39:51,306][2409485] DAMAGECOUNT value on done: 685.0
[2023-02-25 12:39:51,309][2409485] Sum rewards: 0.558, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.392', 'AMMO5': '0.004', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.024', 'WEAPON4': '0.050', 'AMMO4': '0.059', 'ARMOR': '0.068', 'AMMO3': '0.071', 'WEAPON5': '0.100', 'HITCOUNT': '0.230', 'weapon4': '0.238', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.550', 'weapon2': '0.796', 'DAMAGECOUNT': '0.930', 'weapon3': '1.798'}
[2023-02-25 12:39:51,568][2409074] Updated weights for policy 0, policy_version 7681 (0.0012)
[2023-02-25 12:39:51,604][2409549] DAMAGECOUNT value on done: 1100.0
[2023-02-25 12:39:51,607][2409549] Sum rewards: 3.687, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.900', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.142', 'WEAPON4': '0.200', 'weapon4': '0.264', 'ARMOR': '0.497', 'HITCOUNT': '0.540', 'WEAPON3': '0.750', 'weapon2': '1.374', 'weapon3': '1.706', 'DAMAGECOUNT': '1.785', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:39:51,659][2409373] DAMAGECOUNT value on done: 1427.0
[2023-02-25 12:39:51,662][2409373] Sum rewards: 3.402, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.003', 'ARMOR': '0.012', 'AMMO4': '0.013', 'HEALTH': '0.032', 'AMMO3': '0.079', 'HITCOUNT': '0.330', 'WEAPON3': '0.400', 'DAMAGECOUNT': '1.095', 'weapon3': '1.164', 'weapon2': '1.524', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:51,702][2409078] DAMAGECOUNT value on done: 847.0
[2023-02-25 12:39:51,702][2409078] Sum rewards: 1.477, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.638', 'AMMO2': '0.013', 'AMMO3': '0.050', 'weapon7': '0.060', 'AMMO4': '0.064', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.330', 'WEAPON4': '0.350', 'WEAPON3': '0.350', 'ARMOR': '0.424', 'weapon4': '0.824', 'weapon2': '0.926', 'DAMAGECOUNT': '1.140', 'weapon3': '1.144', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:51,805][2409100] DAMAGECOUNT value on done: 552.0
[2023-02-25 12:39:51,806][2409100] Sum rewards: 1.975, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.131', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'AMMO3': '0.057', 'WEAPON4': '0.100', 'AMMO4': '0.115', 'HITCOUNT': '0.170', 'weapon4': '0.190', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.462', 'ARMOR': '0.476', 'weapon3': '1.096', 'weapon2': '1.606', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:51,941][2409866] DAMAGECOUNT value on done: 1426.0
[2023-02-25 12:39:51,942][2409866] Sum rewards: 1.387, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.398', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.014', 'AMMO3': '0.095', 'weapon5': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.234', 'HITCOUNT': '0.390', 'ARMOR': '0.485', 'WEAPON3': '0.650', 'weapon3': '1.406', 'weapon2': '1.758', 'DAMAGECOUNT': '2.178', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:39:52,056][2409405] DAMAGECOUNT value on done: 865.0
[2023-02-25 12:39:52,059][2409405] Sum rewards: 2.178, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.409', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO3': '0.032', 'weapon7': '0.066', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.170', 'WEAPON7': '0.200', 'weapon4': '0.218', 'WEAPON3': '0.250', 'weapon3': '0.628', 'DAMAGECOUNT': '0.672', 'ARMOR': '0.923', 'FRAGCOUNT': '1.000', 'weapon2': '1.130'}
[2023-02-25 12:39:52,138][2409101] DAMAGECOUNT value on done: 1527.0
[2023-02-25 12:39:52,142][2409101] Sum rewards: 1.980, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.432', 'AMMO2': '0.003', 'AMMO4': '0.013', 'WEAPON1': '0.040', 'AMMO3': '0.111', 'WEAPON4': '0.150', 'weapon4': '0.350', 'HITCOUNT': '0.480', 'WEAPON3': '0.700', 'ARMOR': '0.977', 'weapon3': '1.282', 'weapon2': '1.524', 'DAMAGECOUNT': '1.782', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:52,186][2408954] Fps is (10 sec: 23756.5, 60 sec: 24917.2, 300 sec: 24839.8). Total num frames: 31473664. Throughput: 0: 6237.6. Samples: 7864680. Policy #0 lag: (min: 0.0, avg: 11.5, max: 24.0)
[2023-02-25 12:39:52,186][2408954] Avg episode reward: [(0, '0.781')]
[2023-02-25 12:39:52,254][2409033] Signal inference workers to stop experience collection... (1000 times)
[2023-02-25 12:39:52,265][2409033] Signal inference workers to resume experience collection... (1000 times)
[2023-02-25 12:39:52,276][2409074] InferenceWorker_p0-w0: stopping experience collection (1000 times)
[2023-02-25 12:39:52,300][2409074] InferenceWorker_p0-w0: resuming experience collection (1000 times)
[2023-02-25 12:39:52,384][2409468] DAMAGECOUNT value on done: 771.0
[2023-02-25 12:39:52,387][2409468] Sum rewards: 2.045, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.752', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO3': '0.083', 'weapon5': '0.098', 'AMMO4': '0.125', 'HITCOUNT': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.500', 'weapon4': '0.546', 'ARMOR': '0.890', 'DAMAGECOUNT': '1.257', 'weapon2': '1.358', 'weapon3': '1.460', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:52,402][2409355] DAMAGECOUNT value on done: 1374.0
[2023-02-25 12:39:52,403][2409355] Sum rewards: 1.792, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.406', 'AMMO2': '0.005', 'AMMO4': '0.026', 'AMMO3': '0.104', 'WEAPON4': '0.150', 'weapon4': '0.390', 'ARMOR': '0.408', 'HITCOUNT': '0.460', 'WEAPON3': '0.750', 'weapon2': '1.146', 'DAMAGECOUNT': '1.530', 'weapon3': '1.728', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:52,579][2409096] DAMAGECOUNT value on done: 884.0
[2023-02-25 12:39:52,583][2409096] Sum rewards: 0.141, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.260', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.012', 'WEAPON4': '0.050', 'AMMO3': '0.077', 'weapon4': '0.182', 'HITCOUNT': '0.330', 'WEAPON3': '0.500', 'ARMOR': '0.926', 'DAMAGECOUNT': '1.197', 'weapon3': '1.414', 'weapon2': '1.950', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:52,583][2409075] DAMAGECOUNT value on done: 1070.0
[2023-02-25 12:39:52,584][2409075] Sum rewards: 0.275, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.373', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.019', 'WEAPON5': '0.050', 'AMMO3': '0.068', 'WEAPON4': '0.200', 'HITCOUNT': '0.320', 'weapon4': '0.352', 'WEAPON3': '0.450', 'weapon3': '0.790', 'ARMOR': '0.912', 'DAMAGECOUNT': '0.975', 'FRAGCOUNT': '1.000', 'weapon2': '1.754'}
[2023-02-25 12:39:52,627][2409547] DAMAGECOUNT value on done: 917.0
[2023-02-25 12:39:52,631][2409547] Sum rewards: 2.692, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.896', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.027', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.069', 'weapon4': '0.204', 'HITCOUNT': '0.320', 'ARMOR': '0.448', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.221', 'weapon3': '1.242', 'weapon2': '1.708', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:52,762][2409597] DAMAGECOUNT value on done: 1111.0
[2023-02-25 12:39:52,832][2409074] Updated weights for policy 0, policy_version 7691 (0.0013)
[2023-02-25 12:39:52,944][2409407] DAMAGECOUNT value on done: 795.0
[2023-02-25 12:39:52,947][2409407] Sum rewards: -0.608, reward structure: {'DEATHCOUNT': '-5.250', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.050', 'ARMOR': '0.063', 'weapon5': '0.076', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'HEALTH': '0.104', 'WEAPON4': '0.150', 'HITCOUNT': '0.250', 'weapon4': '0.362', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.702', 'weapon3': '1.058', 'weapon2': '1.620'}
[2023-02-25 12:39:53,001][2409406] DAMAGECOUNT value on done: 914.0
[2023-02-25 12:39:53,004][2409406] Sum rewards: 0.899, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.478', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.014', 'weapon5': '0.042', 'WEAPON4': '0.050', 'AMMO3': '0.094', 'weapon4': '0.160', 'WEAPON5': '0.200', 'HITCOUNT': '0.320', 'WEAPON3': '0.450', 'ARMOR': '0.908', 'DAMAGECOUNT': '1.332', 'weapon3': '1.508', 'FRAGCOUNT': '2.000', 'weapon2': '2.074'}
[2023-02-25 12:39:53,010][2409080] DAMAGECOUNT value on done: 1310.0
[2023-02-25 12:39:53,013][2409080] Sum rewards: 0.883, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.772', 'AMMO2': '0.024', 'ARMOR': '0.052', 'AMMO3': '0.104', 'AMMO4': '0.119', 'HITCOUNT': '0.220', 'WEAPON4': '0.250', 'weapon4': '0.542', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.750', 'weapon3': '1.536', 'weapon2': '1.708', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:53,108][2409596] DAMAGECOUNT value on done: 1042.0
[2023-02-25 12:39:53,111][2409596] Sum rewards: 1.850, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.511', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'AMMO3': '0.100', 'AMMO4': '0.107', 'weapon4': '0.210', 'HITCOUNT': '0.370', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.362', 'weapon3': '1.414', 'weapon2': '2.016', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:53,133][2409104] DAMAGECOUNT value on done: 1039.0
[2023-02-25 12:39:53,134][2409104] Sum rewards: 2.265, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.110', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO3': '0.050', 'HITCOUNT': '0.150', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.480', 'FRAGCOUNT': '1.000', 'weapon3': '1.236', 'weapon2': '1.392'}
[2023-02-25 12:39:53,172][2409102] DAMAGECOUNT value on done: 947.0
[2023-02-25 12:39:53,172][2409102] Sum rewards: -0.420, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.452', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon5': '0.022', 'weapon4': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.082', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'HITCOUNT': '0.280', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.891', 'FRAGCOUNT': '1.000', 'weapon3': '1.096', 'weapon2': '2.234'}
[2023-02-25 12:39:53,277][2409099] DAMAGECOUNT value on done: 1194.0
[2023-02-25 12:39:53,280][2409099] Sum rewards: -2.444, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.150', 'AMMO2': '0.003', 'AMMO5': '0.004', 'weapon7': '0.006', 'AMMO4': '0.012', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.133', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.408', 'HITCOUNT': '0.430', 'weapon4': '0.440', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.572', 'weapon3': '1.572', 'weapon2': '1.732', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:53,302][2409486] DAMAGECOUNT value on done: 904.0
[2023-02-25 12:39:53,303][2409486] Sum rewards: -2.081, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.658', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.061', 'AMMO3': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.250', 'weapon4': '0.346', 'ARMOR': '0.461', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.837', 'FRAGCOUNT': '1.000', 'weapon3': '1.204', 'weapon2': '1.796'}
[2023-02-25 12:39:53,514][2409565] DAMAGECOUNT value on done: 1070.0
[2023-02-25 12:39:53,515][2409565] Sum rewards: 4.325, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.224', 'AMMO2': '0.001', 'AMMO4': '0.003', 'ARMOR': '0.004', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO3': '0.085', 'weapon5': '0.104', 'WEAPON5': '0.200', 'HITCOUNT': '0.440', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.536', 'weapon2': '1.610', 'weapon3': '1.838', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:39:53,836][2409077] DAMAGECOUNT value on done: 805.0
[2023-02-25 12:39:53,838][2409077] Sum rewards: 0.123, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.514', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.010', 'ARMOR': '0.040', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.230', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.549', 'weapon2': '1.014', 'weapon3': '1.116', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:54,009][2409548] DAMAGECOUNT value on done: 828.0
[2023-02-25 12:39:54,013][2409105] DAMAGECOUNT value on done: 1596.0
[2023-02-25 12:39:54,014][2409105] Sum rewards: 4.476, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.074', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.070', 'ARMOR': '0.440', 'WEAPON3': '0.450', 'HITCOUNT': '0.640', 'weapon3': '1.264', 'weapon2': '2.416', 'DAMAGECOUNT': '2.490', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:39:54,013][2409548] Sum rewards: -3.039, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.800', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.036', 'WEAPON4': '0.050', 'AMMO4': '0.106', 'weapon4': '0.108', 'AMMO3': '0.147', 'HITCOUNT': '0.160', 'WEAPON5': '0.200', 'ARMOR': '0.452', 'DAMAGECOUNT': '0.549', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.402', 'weapon3': '1.620'}
[2023-02-25 12:39:54,172][2409076] DAMAGECOUNT value on done: 627.0
[2023-02-25 12:39:54,173][2409076] Sum rewards: -0.970, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.872', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon4': '0.006', 'weapon5': '0.066', 'AMMO3': '0.068', 'HITCOUNT': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.225', 'ARMOR': '0.476', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.240', 'weapon2': '1.312'}
[2023-02-25 12:39:54,340][2409389] DAMAGECOUNT value on done: 776.0
[2023-02-25 12:39:54,394][2409103] DAMAGECOUNT value on done: 814.0
[2023-02-25 12:39:54,395][2409103] Sum rewards: 2.291, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.612', 'AMMO2': '0.012', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO4': '0.059', 'ARMOR': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.214', 'HITCOUNT': '0.310', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.152', 'weapon2': '1.362', 'weapon3': '1.402', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:54,461][2409469] DAMAGECOUNT value on done: 1159.0
[2023-02-25 12:39:54,461][2409469] Sum rewards: 0.683, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.544', 'ARMOR': '0.010', 'AMMO2': '0.025', 'AMMO3': '0.043', 'weapon7': '0.086', 'HITCOUNT': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.260', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.597', 'weapon2': '0.856', 'weapon3': '0.914', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:39:54,497][2409074] Updated weights for policy 0, policy_version 7701 (0.0013)
[2023-02-25 12:39:54,510][2409097] DAMAGECOUNT value on done: 922.0
[2023-02-25 12:39:54,512][2409097] Sum rewards: 2.145, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.108', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.018', 'AMMO3': '0.066', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.216', 'ARMOR': '0.441', 'WEAPON3': '0.450', 'HITCOUNT': '0.460', 'weapon3': '1.314', 'weapon2': '1.504', 'DAMAGECOUNT': '1.593', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:54,849][2409485] DAMAGECOUNT value on done: 850.0
[2023-02-25 12:39:54,852][2409485] Sum rewards: 0.490, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.896', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.027', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.068', 'weapon4': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'HITCOUNT': '0.160', 'DAMAGECOUNT': '0.459', 'ARMOR': '0.525', 'WEAPON3': '0.700', 'weapon2': '1.344', 'weapon3': '1.718', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:54,897][2409079] DAMAGECOUNT value on done: 1159.0
[2023-02-25 12:39:54,898][2409079] Sum rewards: 3.137, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.511', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.065', 'weapon5': '0.076', 'HITCOUNT': '0.310', 'WEAPON3': '0.400', 'ARMOR': '0.850', 'DAMAGECOUNT': '0.951', 'weapon3': '1.162', 'weapon2': '2.054', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:55,243][2409373] DAMAGECOUNT value on done: 1019.0
[2023-02-25 12:39:55,244][2409373] Sum rewards: 6.481, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.740', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.003', 'ARMOR': '0.020', 'WEAPON1': '0.020', 'AMMO3': '0.065', 'weapon5': '0.080', 'WEAPON5': '0.100', 'HITCOUNT': '0.330', 'WEAPON3': '0.450', 'weapon3': '1.258', 'DAMAGECOUNT': '1.389', 'weapon2': '1.752', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:39:55,459][2409549] DAMAGECOUNT value on done: 1495.0
[2023-02-25 12:39:55,462][2409549] Sum rewards: 3.158, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-3.074', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'weapon5': '0.054', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.161', 'weapon4': '0.214', 'HITCOUNT': '0.610', 'WEAPON3': '1.050', 'weapon2': '1.598', 'weapon3': '1.890', 'DAMAGECOUNT': '2.487', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:39:55,561][2409866] DAMAGECOUNT value on done: 725.0
[2023-02-25 12:39:55,562][2409866] Sum rewards: -0.892, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.970', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'AMMO3': '0.078', 'WEAPON4': '0.150', 'weapon4': '0.174', 'HITCOUNT': '0.240', 'ARMOR': '0.476', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.792', 'FRAGCOUNT': '1.000', 'weapon3': '1.292', 'weapon2': '2.072'}
[2023-02-25 12:39:55,669][2409078] DAMAGECOUNT value on done: 728.0
[2023-02-25 12:39:55,672][2409078] Sum rewards: -1.723, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.792', 'AMMO2': '0.003', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.016', 'weapon5': '0.020', 'WEAPON5': '0.050', 'ARMOR': '0.084', 'AMMO3': '0.113', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'weapon4': '0.394', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.822', 'weapon2': '0.950', 'weapon3': '1.632', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:55,897][2409100] DAMAGECOUNT value on done: 1168.0
[2023-02-25 12:39:55,898][2409100] Sum rewards: -0.202, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.639', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.010', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'weapon5': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.112', 'HITCOUNT': '0.290', 'ARMOR': '0.499', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.344', 'weapon2': '1.664', 'weapon3': '1.728', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:55,948][2409101] DAMAGECOUNT value on done: 1186.0
[2023-02-25 12:39:55,951][2409101] Sum rewards: 2.403, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.200', 'AMMO2': '0.013', 'weapon7': '0.064', 'AMMO4': '0.066', 'AMMO3': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.224', 'HITCOUNT': '0.310', 'ARMOR': '0.428', 'WEAPON3': '0.700', 'weapon3': '1.316', 'DAMAGECOUNT': '1.578', 'weapon2': '1.710', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:56,027][2409405] DAMAGECOUNT value on done: 1268.0
[2023-02-25 12:39:56,031][2409405] Sum rewards: 1.246, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.686', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'WEAPON4': '0.250', 'HITCOUNT': '0.390', 'ARMOR': '0.445', 'WEAPON3': '0.600', 'weapon4': '0.660', 'weapon2': '1.130', 'DAMAGECOUNT': '1.644', 'weapon3': '1.688', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:56,056][2409355] DAMAGECOUNT value on done: 944.0
[2023-02-25 12:39:56,060][2409355] Sum rewards: 4.707, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.865', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'weapon7': '0.052', 'AMMO3': '0.071', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.212', 'HITCOUNT': '0.360', 'WEAPON3': '0.450', 'ARMOR': '0.450', 'weapon2': '0.738', 'weapon3': '1.188', 'DAMAGECOUNT': '1.275', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:56,177][2409074] Updated weights for policy 0, policy_version 7711 (0.0012)
[2023-02-25 12:39:56,274][2409096] DAMAGECOUNT value on done: 748.0
[2023-02-25 12:39:56,278][2409096] Sum rewards: -0.452, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.286', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.041', 'weapon5': '0.104', 'AMMO3': '0.114', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO4': '0.203', 'HITCOUNT': '0.330', 'ARMOR': '0.400', 'weapon4': '0.446', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.206', 'weapon3': '1.256', 'weapon2': '1.714', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:56,474][2409468] DAMAGECOUNT value on done: 722.0
[2023-02-25 12:39:56,573][2409075] DAMAGECOUNT value on done: 829.0
[2023-02-25 12:39:56,577][2409075] Sum rewards: -0.351, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.249', 'AMMO2': '0.007', 'AMMO4': '0.034', 'ARMOR': '0.040', 'weapon7': '0.068', 'AMMO3': '0.073', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.220', 'WEAPON4': '0.250', 'WEAPON3': '0.500', 'weapon4': '0.602', 'DAMAGECOUNT': '0.870', 'FRAGCOUNT': '1.000', 'weapon3': '1.012', 'weapon2': '1.032'}
[2023-02-25 12:39:56,610][2409406] DAMAGECOUNT value on done: 686.0
[2023-02-25 12:39:56,610][2409406] Sum rewards: -1.304, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.060', 'AMMO5': '0.003', 'AMMO2': '0.017', 'ARMOR': '0.020', 'AMMO3': '0.050', 'weapon5': '0.080', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.160', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.459', 'FRAGCOUNT': '1.000', 'weapon3': '1.188', 'weapon2': '1.866'}
[2023-02-25 12:39:56,646][2409407] DAMAGECOUNT value on done: 850.0
[2023-02-25 12:39:56,669][2409547] DAMAGECOUNT value on done: 1013.0
[2023-02-25 12:39:56,670][2409547] Sum rewards: -5.593, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.314', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.008', 'WEAPON1': '0.030', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'HITCOUNT': '0.240', 'WEAPON4': '0.300', 'weapon4': '0.372', 'ARMOR': '0.476', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.762', 'weapon3': '1.426', 'weapon2': '1.654', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:56,678][2409102] DAMAGECOUNT value on done: 767.0
[2023-02-25 12:39:56,681][2409102] Sum rewards: -2.722, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.304', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'ARMOR': '0.028', 'WEAPON1': '0.030', 'weapon7': '0.052', 'weapon5': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon4': '0.176', 'WEAPON7': '0.200', 'HITCOUNT': '0.250', 'DAMAGECOUNT': '0.666', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.276', 'weapon3': '1.754'}
[2023-02-25 12:39:56,916][2409597] DAMAGECOUNT value on done: 970.0
[2023-02-25 12:39:56,917][2409597] Sum rewards: 1.804, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.340', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.065', 'weapon5': '0.066', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.164', 'HITCOUNT': '0.220', 'ARMOR': '0.440', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.630', 'weapon3': '1.436', 'weapon2': '1.546', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:56,944][2409596] DAMAGECOUNT value on done: 719.0
[2023-02-25 12:39:56,975][2409104] DAMAGECOUNT value on done: 1055.0
[2023-02-25 12:39:56,976][2409104] Sum rewards: 1.716, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.850', 'AMMO2': '0.003', 'AMMO5': '0.005', 'weapon5': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.017', 'WEAPON4': '0.050', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'weapon4': '0.146', 'HITCOUNT': '0.380', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.275', 'weapon2': '1.468', 'weapon3': '1.610', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:56,998][2409080] DAMAGECOUNT value on done: 745.0
[2023-02-25 12:39:57,001][2409080] Sum rewards: 0.250, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.310', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.113', 'WEAPON4': '0.250', 'weapon4': '0.308', 'HITCOUNT': '0.330', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.188', 'weapon3': '1.290', 'weapon2': '1.658', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:57,053][2409565] DAMAGECOUNT value on done: 853.0
[2023-02-25 12:39:57,054][2409565] Sum rewards: -3.327, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.210', 'AMMO4': '-0.062', 'AMMO2': '-0.012', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'weapon5': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.129', 'WEAPON5': '0.150', 'HITCOUNT': '0.230', 'weapon4': '0.230', 'ARMOR': '0.461', 'DAMAGECOUNT': '0.795', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.566', 'weapon2': '1.614'}
[2023-02-25 12:39:57,141][2409486] DAMAGECOUNT value on done: 926.0
[2023-02-25 12:39:57,143][2409099] DAMAGECOUNT value on done: 1096.0
[2023-02-25 12:39:57,144][2409486] Sum rewards: 4.090, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.355', 'AMMO2': '0.001', 'AMMO4': '0.003', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO3': '0.040', 'weapon4': '0.062', 'WEAPON4': '0.100', 'WEAPON3': '0.300', 'HITCOUNT': '0.410', 'weapon3': '0.958', 'weapon2': '1.218', 'DAMAGECOUNT': '1.335', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:57,145][2409099] Sum rewards: -0.119, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.900', 'AMMO5': '0.005', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.020', 'AMMO4': '0.025', 'ARMOR': '0.032', 'AMMO3': '0.059', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'WEAPON3': '0.350', 'weapon4': '0.400', 'DAMAGECOUNT': '0.603', 'weapon3': '0.814', 'FRAGCOUNT': '1.000', 'weapon2': '1.448'}
[2023-02-25 12:39:57,186][2408954] Fps is (10 sec: 26214.4, 60 sec: 24985.6, 300 sec: 24881.5). Total num frames: 31617024. Throughput: 0: 6261.6. Samples: 7903092. Policy #0 lag: (min: 0.0, avg: 11.5, max: 24.0)
[2023-02-25 12:39:57,186][2408954] Avg episode reward: [(0, '0.588')]
[2023-02-25 12:39:57,475][2409077] DAMAGECOUNT value on done: 1067.0
[2023-02-25 12:39:57,476][2409077] Sum rewards: 1.077, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.638', 'AMMO5': '0.003', 'AMMO2': '0.009', 'WEAPON1': '0.040', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.065', 'weapon5': '0.082', 'HITCOUNT': '0.170', 'weapon4': '0.192', 'ARMOR': '0.486', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.585', 'weapon2': '1.340', 'weapon3': '1.346', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:57,674][2409074] Updated weights for policy 0, policy_version 7721 (0.0012)
[2023-02-25 12:39:57,719][2409548] DAMAGECOUNT value on done: 1058.0
[2023-02-25 12:39:57,720][2409548] Sum rewards: 6.260, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.324', 'AMMO2': '0.014', 'WEAPON1': '0.040', 'AMMO4': '0.071', 'AMMO3': '0.081', 'WEAPON3': '0.450', 'HITCOUNT': '0.550', 'ARMOR': '0.856', 'weapon3': '1.386', 'DAMAGECOUNT': '1.749', 'weapon2': '2.136', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:39:57,988][2409105] DAMAGECOUNT value on done: 1299.0
[2023-02-25 12:39:57,988][2409469] DAMAGECOUNT value on done: 1198.0
[2023-02-25 12:39:57,989][2409105] Sum rewards: -1.002, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.858', 'AMMO5': '0.012', 'AMMO2': '0.012', 'weapon5': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.150', 'weapon4': '0.188', 'WEAPON5': '0.200', 'HITCOUNT': '0.320', 'ARMOR': '0.466', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.110', 'weapon2': '1.600', 'weapon3': '1.736', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:57,991][2409469] Sum rewards: 0.262, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.558', 'AMMO2': '0.003', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'ARMOR': '0.010', 'AMMO4': '0.014', 'WEAPON4': '0.050', 'weapon5': '0.066', 'AMMO3': '0.112', 'weapon4': '0.138', 'WEAPON5': '0.150', 'HITCOUNT': '0.490', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.452', 'weapon3': '1.510', 'weapon2': '1.658', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:39:58,107][2409076] DAMAGECOUNT value on done: 1137.0
[2023-02-25 12:39:58,107][2409076] Sum rewards: -0.544, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.770', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'weapon4': '0.276', 'HITCOUNT': '0.440', 'ARMOR': '0.451', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.329', 'weapon2': '1.658', 'weapon3': '1.696', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:58,156][2409389] DAMAGECOUNT value on done: 1141.0
[2023-02-25 12:39:58,159][2409389] Sum rewards: 3.178, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '0.003', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.032', 'WEAPON1': '0.050', 'AMMO3': '0.089', 'AMMO4': '0.097', 'WEAPON5': '0.150', 'HITCOUNT': '0.330', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.125', 'weapon2': '1.244', 'weapon3': '1.780', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:58,457][2409097] DAMAGECOUNT value on done: 1245.0
[2023-02-25 12:39:58,458][2409097] Sum rewards: 3.437, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.254', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.066', 'weapon5': '0.088', 'WEAPON5': '0.100', 'weapon4': '0.278', 'HITCOUNT': '0.290', 'WEAPON3': '0.400', 'weapon3': '1.228', 'weapon2': '1.476', 'DAMAGECOUNT': '1.638', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:58,787][2409079] DAMAGECOUNT value on done: 978.0
[2023-02-25 12:39:58,788][2409079] Sum rewards: -0.915, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.800', 'AMMO2': '0.003', 'AMMO4': '0.015', 'ARMOR': '0.032', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'weapon4': '0.274', 'HITCOUNT': '0.470', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.560', 'weapon2': '1.704', 'weapon3': '1.822', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:59,192][2409373] DAMAGECOUNT value on done: 1192.0
[2023-02-25 12:39:59,193][2409373] Sum rewards: 0.964, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.286', 'weapon4': '0.002', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.014', 'ARMOR': '0.040', 'AMMO4': '0.070', 'AMMO3': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.230', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.798', 'weapon3': '1.418', 'weapon2': '1.474', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:59,213][2409103] DAMAGECOUNT value on done: 944.0
[2023-02-25 12:39:59,214][2409103] Sum rewards: 0.559, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.926', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'AMMO3': '0.054', 'ARMOR': '0.060', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'weapon5': '0.102', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'weapon4': '0.340', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.903', 'weapon3': '1.214', 'weapon2': '1.870', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:39:59,222][2409866] DAMAGECOUNT value on done: 803.0
[2023-02-25 12:39:59,225][2409866] Sum rewards: 1.068, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.004', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'weapon5': '0.030', 'AMMO4': '0.064', 'AMMO3': '0.069', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.170', 'WEAPON3': '0.450', 'weapon4': '0.530', 'ARMOR': '0.568', 'DAMAGECOUNT': '1.002', 'weapon2': '1.008', 'weapon3': '1.386', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:59,439][2409549] DAMAGECOUNT value on done: 1045.0
[2023-02-25 12:39:59,442][2409549] Sum rewards: 3.661, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'HEALTH': '0.120', 'AMMO4': '0.143', 'HITCOUNT': '0.350', 'WEAPON3': '0.400', 'weapon4': '0.450', 'ARMOR': '0.504', 'weapon2': '0.928', 'DAMAGECOUNT': '1.182', 'weapon3': '1.262', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:39:59,475][2409078] DAMAGECOUNT value on done: 1022.0
[2023-02-25 12:39:59,476][2409078] Sum rewards: 3.459, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.105', 'AMMO2': '0.000', 'AMMO4': '0.001', 'WEAPON1': '0.020', 'AMMO3': '0.056', 'HITCOUNT': '0.350', 'WEAPON3': '0.400', 'weapon3': '1.112', 'weapon2': '1.118', 'DAMAGECOUNT': '1.257', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:39:59,492][2409074] Updated weights for policy 0, policy_version 7731 (0.0012)
[2023-02-25 12:39:59,695][2409485] DAMAGECOUNT value on done: 902.0
[2023-02-25 12:39:59,696][2409485] Sum rewards: -0.372, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.671', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'weapon4': '0.060', 'AMMO3': '0.083', 'WEAPON5': '0.150', 'HITCOUNT': '0.220', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.711', 'ARMOR': '0.857', 'FRAGCOUNT': '1.000', 'weapon3': '1.422', 'weapon2': '1.860'}
[2023-02-25 12:39:59,727][2409355] DAMAGECOUNT value on done: 816.0
[2023-02-25 12:39:59,731][2409355] Sum rewards: 4.705, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.258', 'AMMO5': '0.003', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'AMMO4': '0.045', 'WEAPON5': '0.050', 'weapon5': '0.060', 'WEAPON4': '0.150', 'HITCOUNT': '0.220', 'WEAPON3': '0.250', 'weapon4': '0.376', 'weapon3': '0.858', 'ARMOR': '0.940', 'DAMAGECOUNT': '1.038', 'weapon2': '1.904', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:40:00,030][2409096] DAMAGECOUNT value on done: 729.0
[2023-02-25 12:40:00,072][2409405] DAMAGECOUNT value on done: 1441.0
[2023-02-25 12:40:00,073][2409405] Sum rewards: 5.646, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.690', 'AMMO5': '0.011', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'AMMO4': '0.088', 'AMMO3': '0.088', 'weapon5': '0.162', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.330', 'weapon4': '0.406', 'ARMOR': '0.474', 'WEAPON3': '0.700', 'weapon2': '0.990', 'DAMAGECOUNT': '1.461', 'weapon3': '1.768', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:40:00,102][2409101] DAMAGECOUNT value on done: 1132.0
[2023-02-25 12:40:00,103][2409101] Sum rewards: -2.054, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.568', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'weapon5': '0.018', 'AMMO4': '0.045', 'AMMO3': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.196', 'HITCOUNT': '0.340', 'WEAPON3': '0.400', 'ARMOR': '0.804', 'DAMAGECOUNT': '1.038', 'weapon3': '1.146', 'weapon2': '1.698'}
[2023-02-25 12:40:00,184][2409468] DAMAGECOUNT value on done: 1126.0
[2023-02-25 12:40:00,184][2409468] Sum rewards: 2.058, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.444', 'AMMO2': '0.001', 'AMMO4': '0.007', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'ARMOR': '0.076', 'AMMO3': '0.134', 'weapon4': '0.202', 'HITCOUNT': '0.390', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.368', 'weapon2': '1.662', 'weapon3': '1.712', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:40:00,265][2409075] DAMAGECOUNT value on done: 738.0
[2023-02-25 12:40:00,271][2409075] Sum rewards: -1.444, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.322', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.084', 'AMMO3': '0.090', 'HITCOUNT': '0.140', 'weapon4': '0.146', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON3': '0.450', 'ARMOR': '0.494', 'DAMAGECOUNT': '0.555', 'FRAGCOUNT': '1.000', 'weapon3': '1.076', 'weapon2': '2.082'}
[2023-02-25 12:40:00,388][2409547] DAMAGECOUNT value on done: 987.0
[2023-02-25 12:40:00,391][2409547] Sum rewards: 0.035, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.448', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.022', 'weapon7': '0.056', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.186', 'WEAPON7': '0.200', 'HITCOUNT': '0.280', 'ARMOR': '0.489', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.276', 'weapon2': '1.840'}
[2023-02-25 12:40:00,413][2409102] DAMAGECOUNT value on done: 802.0
[2023-02-25 12:40:00,418][2409102] Sum rewards: 1.273, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.500', 'weapon5': '0.002', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'weapon4': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'AMMO3': '0.129', 'HITCOUNT': '0.280', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.969', 'weapon2': '1.424', 'weapon3': '2.092', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:40:00,425][2409074] Updated weights for policy 0, policy_version 7741 (0.0012)
[2023-02-25 12:40:00,515][2409596] DAMAGECOUNT value on done: 1291.0
[2023-02-25 12:40:00,516][2409596] Sum rewards: -1.973, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.791', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'weapon7': '0.012', 'AMMO5': '0.012', 'ARMOR': '0.052', 'AMMO3': '0.091', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.140', 'WEAPON5': '0.250', 'HITCOUNT': '0.390', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.353', 'weapon3': '1.742', 'weapon2': '1.844'}
[2023-02-25 12:40:00,530][2409406] DAMAGECOUNT value on done: 916.0
[2023-02-25 12:40:00,531][2409406] Sum rewards: 1.356, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.920', 'AMMO5': '0.005', 'AMMO2': '0.012', 'ARMOR': '0.029', 'AMMO4': '0.062', 'AMMO3': '0.087', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.202', 'weapon4': '0.212', 'HITCOUNT': '0.230', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.209', 'weapon3': '1.272', 'weapon2': '1.906', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:40:00,546][2409104] DAMAGECOUNT value on done: 994.0
[2023-02-25 12:40:00,546][2409104] Sum rewards: 1.420, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.112', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.064', 'AMMO3': '0.072', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.240', 'WEAPON3': '0.400', 'weapon4': '0.420', 'FRAGCOUNT': '0.500', 'weapon3': '1.022', 'DAMAGECOUNT': '1.104', 'weapon2': '1.218', 'ARMOR': '1.357'}
[2023-02-25 12:40:00,603][2409407] DAMAGECOUNT value on done: 988.0
[2023-02-25 12:40:00,604][2409407] Sum rewards: 2.264, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.702', 'AMMO5': '0.003', 'AMMO2': '0.009', 'ARMOR': '0.028', 'AMMO4': '0.043', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'HITCOUNT': '0.220', 'weapon4': '0.222', 'WEAPON3': '0.650', 'weapon3': '1.268', 'DAMAGECOUNT': '1.302', 'weapon2': '1.612', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:40:00,691][2409080] DAMAGECOUNT value on done: 923.0
[2023-02-25 12:40:00,695][2409080] Sum rewards: 1.308, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.162', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon7': '0.050', 'weapon5': '0.070', 'AMMO3': '0.079', 'AMMO4': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.310', 'weapon4': '0.390', 'ARMOR': '0.404', 'WEAPON3': '0.550', 'weapon2': '1.050', 'DAMAGECOUNT': '1.089', 'weapon3': '1.386', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:40:00,703][2409597] DAMAGECOUNT value on done: 625.0
[2023-02-25 12:40:00,707][2409597] Sum rewards: -1.075, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.670', 'AMMO5': '0.003', 'weapon7': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'ARMOR': '0.040', 'AMMO3': '0.074', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.119', 'HITCOUNT': '0.160', 'WEAPON4': '0.250', 'weapon4': '0.416', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.513', 'FRAGCOUNT': '1.000', 'weapon3': '1.070', 'weapon2': '1.718'}
[2023-02-25 12:40:00,800][2409486] DAMAGECOUNT value on done: 1131.0
[2023-02-25 12:40:00,803][2409486] Sum rewards: 3.305, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'weapon5': '0.060', 'AMMO3': '0.066', 'WEAPON4': '0.100', 'HEALTH': '0.130', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'HITCOUNT': '0.170', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.855', 'weapon3': '1.348', 'weapon2': '1.692', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:40:00,831][2409099] DAMAGECOUNT value on done: 896.0
[2023-02-25 12:40:00,832][2409099] Sum rewards: -1.511, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.038', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'HITCOUNT': '0.130', 'AMMO4': '0.191', 'DAMAGECOUNT': '0.285', 'HEALTH': '0.318', 'weapon4': '0.386', 'ARMOR': '0.432', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.488', 'weapon3': '1.666'}
[2023-02-25 12:40:00,854][2409565] DAMAGECOUNT value on done: 660.0
[2023-02-25 12:40:00,855][2409565] Sum rewards: -0.483, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.656', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon5': '0.032', 'AMMO4': '0.058', 'AMMO3': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.170', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.471', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.250', 'weapon3': '1.920'}
[2023-02-25 12:40:01,422][2409077] DAMAGECOUNT value on done: 618.0
[2023-02-25 12:40:01,423][2409077] Sum rewards: -2.060, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.454', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon5': '0.026', 'AMMO2': '0.028', 'ARMOR': '0.040', 'AMMO3': '0.083', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.202', 'HITCOUNT': '0.280', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.894', 'weapon3': '1.310', 'weapon2': '1.812'}
[2023-02-25 12:40:01,578][2409548] DAMAGECOUNT value on done: 885.0
[2023-02-25 12:40:01,578][2409548] Sum rewards: 4.217, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.068', 'AMMO2': '0.010', 'AMMO4': '0.048', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'ARMOR': '0.052', 'weapon4': '0.274', 'WEAPON3': '0.400', 'HITCOUNT': '0.420', 'DAMAGECOUNT': '1.335', 'weapon3': '1.344', 'weapon2': '1.802', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:40:01,772][2409469] DAMAGECOUNT value on done: 689.0
[2023-02-25 12:40:01,819][2409105] DAMAGECOUNT value on done: 906.0
[2023-02-25 12:40:01,823][2409105] Sum rewards: -0.387, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.200', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'HITCOUNT': '0.060', 'AMMO3': '0.073', 'AMMO4': '0.107', 'weapon5': '0.118', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.270', 'WEAPON3': '0.450', 'ARMOR': '0.557', 'weapon4': '0.566', 'FRAGCOUNT': '1.000', 'weapon3': '1.218', 'weapon2': '1.646'}
[2023-02-25 12:40:02,024][2409389] DAMAGECOUNT value on done: 852.0
[2023-02-25 12:40:02,031][2409389] Sum rewards: 0.152, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.573', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.066', 'weapon5': '0.094', 'HITCOUNT': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.218', 'WEAPON3': '0.450', 'ARMOR': '0.526', 'DAMAGECOUNT': '0.615', 'FRAGCOUNT': '1.000', 'weapon3': '1.118', 'weapon2': '1.486'}
[2023-02-25 12:40:02,186][2408954] Fps is (10 sec: 25805.3, 60 sec: 25053.9, 300 sec: 24839.8). Total num frames: 31731712. Throughput: 0: 6265.6. Samples: 7940808. Policy #0 lag: (min: 1.0, avg: 13.0, max: 25.0)
[2023-02-25 12:40:02,186][2408954] Avg episode reward: [(0, '0.717')]
[2023-02-25 12:40:02,191][2409097] DAMAGECOUNT value on done: 895.0
[2023-02-25 12:40:02,191][2409097] Sum rewards: 0.227, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.540', 'AMMO2': '0.014', 'weapon4': '0.016', 'WEAPON1': '0.030', 'ARMOR': '0.036', 'AMMO4': '0.071', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'HITCOUNT': '0.240', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.945', 'weapon3': '1.500', 'FRAGCOUNT': '2.000', 'weapon2': '2.086'}
[2023-02-25 12:40:02,337][2409076] DAMAGECOUNT value on done: 1234.0
[2023-02-25 12:40:02,338][2409076] Sum rewards: 3.411, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.790', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON5': '0.050', 'weapon7': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.204', 'HITCOUNT': '0.390', 'ARMOR': '0.405', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.290', 'weapon2': '1.464', 'weapon3': '2.058', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:40:02,863][2409079] DAMAGECOUNT value on done: 650.0
[2023-02-25 12:40:02,983][2409866] DAMAGECOUNT value on done: 1427.0
[2023-02-25 12:40:02,986][2409866] Sum rewards: 3.345, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.940', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'weapon5': '0.028', 'WEAPON4': '0.050', 'ARMOR': '0.052', 'weapon7': '0.052', 'AMMO4': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.128', 'weapon4': '0.150', 'HITCOUNT': '0.370', 'WEAPON3': '0.750', 'weapon2': '1.248', 'weapon3': '1.552', 'DAMAGECOUNT': '1.632', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:40:03,170][2409074] Updated weights for policy 0, policy_version 7751 (0.0012)
[2023-02-25 12:40:03,424][2409355] DAMAGECOUNT value on done: 871.0
[2023-02-25 12:40:03,563][2409549] DAMAGECOUNT value on done: 978.0
[2023-02-25 12:40:03,563][2409549] Sum rewards: 1.392, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.138', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon7': '0.026', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.105', 'AMMO4': '0.106', 'WEAPON4': '0.250', 'HITCOUNT': '0.300', 'ARMOR': '0.489', 'weapon4': '0.500', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.942', 'weapon2': '1.106', 'weapon3': '1.964', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:40:03,567][2409373] DAMAGECOUNT value on done: 478.0
[2023-02-25 12:40:03,568][2409373] Sum rewards: 1.631, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.608', 'AMMO4': '-0.078', 'AMMO2': '-0.015', 'AMMO3': '0.070', 'HITCOUNT': '0.290', 'ARMOR': '0.477', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.777', 'FRAGCOUNT': '1.000', 'weapon2': '1.278', 'weapon3': '1.690'}
[2023-02-25 12:40:03,655][2409078] DAMAGECOUNT value on done: 936.0
[2023-02-25 12:40:03,658][2409078] Sum rewards: 0.310, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.924', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.021', 'weapon4': '0.038', 'weapon5': '0.134', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.430', 'ARMOR': '0.485', 'WEAPON3': '0.750', 'weapon3': '1.722', 'weapon2': '1.784', 'DAMAGECOUNT': '1.911', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:40:03,832][2409096] DAMAGECOUNT value on done: 1171.0
[2023-02-25 12:40:03,833][2409096] Sum rewards: 1.309, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.314', 'AMMO2': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.021', 'AMMO3': '0.051', 'weapon5': '0.108', 'WEAPON5': '0.150', 'HITCOUNT': '0.200', 'WEAPON3': '0.350', 'ARMOR': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.124', 'DAMAGECOUNT': '1.290', 'weapon2': '2.050'}
[2023-02-25 12:40:04,004][2409075] DAMAGECOUNT value on done: 647.0
[2023-02-25 12:40:04,064][2409405] DAMAGECOUNT value on done: 854.0
[2023-02-25 12:40:04,066][2409405] Sum rewards: -5.343, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.892', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'ARMOR': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'HITCOUNT': '0.270', 'weapon4': '0.308', 'WEAPON3': '0.900', 'DAMAGECOUNT': '0.936', 'FRAGCOUNT': '1.000', 'weapon3': '1.498', 'weapon2': '1.602'}
[2023-02-25 12:40:04,076][2409468] DAMAGECOUNT value on done: 1030.0
[2023-02-25 12:40:04,079][2409468] Sum rewards: -2.372, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.050', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'AMMO4': '0.065', 'WEAPON5': '0.100', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'weapon4': '0.436', 'HITCOUNT': '0.480', 'WEAPON3': '1.000', 'weapon2': '1.250', 'DAMAGECOUNT': '1.647', 'weapon3': '1.962', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:40:04,131][2409074] Updated weights for policy 0, policy_version 7761 (0.0013)
[2023-02-25 12:40:04,154][2409547] DAMAGECOUNT value on done: 741.0
[2023-02-25 12:40:04,154][2409547] Sum rewards: -1.183, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.606', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.062', 'ARMOR': '0.068', 'AMMO3': '0.091', 'AMMO4': '0.094', 'HITCOUNT': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.600', 'weapon4': '0.618', 'DAMAGECOUNT': '0.798', 'FRAGCOUNT': '1.000', 'weapon3': '1.202', 'weapon2': '1.258'}
[2023-02-25 12:40:04,203][2409102] DAMAGECOUNT value on done: 1180.0
[2023-02-25 12:40:04,204][2409102] Sum rewards: 0.766, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.900', 'AMMO5': '0.007', 'AMMO2': '0.020', 'ARMOR': '0.048', 'weapon5': '0.072', 'AMMO4': '0.098', 'AMMO3': '0.111', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.318', 'HITCOUNT': '0.440', 'WEAPON3': '0.750', 'weapon3': '1.486', 'DAMAGECOUNT': '1.578', 'weapon2': '1.638', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:40:04,300][2409596] DAMAGECOUNT value on done: 1169.0
[2023-02-25 12:40:04,303][2409596] Sum rewards: 1.874, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.632', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.078', 'AMMO3': '0.082', 'HITCOUNT': '0.210', 'weapon4': '0.224', 'ARMOR': '0.496', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.912', 'weapon3': '1.296', 'weapon2': '2.322', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:40:04,351][2409407] DAMAGECOUNT value on done: 660.0
[2023-02-25 12:40:04,378][2409104] DAMAGECOUNT value on done: 1361.0
[2023-02-25 12:40:04,379][2409104] Sum rewards: 1.608, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.191', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'AMMO3': '0.092', 'AMMO4': '0.104', 'WEAPON4': '0.250', 'weapon4': '0.308', 'HITCOUNT': '0.470', 'WEAPON3': '0.550', 'ARMOR': '0.856', 'weapon3': '1.456', 'weapon2': '1.556', 'DAMAGECOUNT': '1.626', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:40:04,423][2409101] DAMAGECOUNT value on done: 1025.0
[2023-02-25 12:40:04,426][2409101] Sum rewards: 0.156, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.920', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.010', 'weapon5': '0.016', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'AMMO3': '0.102', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.350', 'weapon4': '0.586', 'WEAPON3': '0.650', 'weapon2': '0.942', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.095', 'weapon3': '1.796'}
[2023-02-25 12:40:04,570][2409080] DAMAGECOUNT value on done: 1450.0
[2023-02-25 12:40:04,573][2409406] DAMAGECOUNT value on done: 1484.0
[2023-02-25 12:40:04,585][2409080] Sum rewards: -2.578, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.084', 'AMMO4': '-0.069', 'AMMO2': '-0.014', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.022', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.154', 'weapon4': '0.204', 'HITCOUNT': '0.340', 'ARMOR': '0.470', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.458', 'weapon3': '1.604', 'weapon2': '1.724', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:40:04,585][2409406] Sum rewards: 0.794, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.212', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.110', 'WEAPON4': '0.250', 'HITCOUNT': '0.430', 'weapon4': '0.438', 'ARMOR': '0.440', 'WEAPON3': '0.800', 'weapon2': '1.284', 'DAMAGECOUNT': '1.605', 'weapon3': '1.810', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:40:04,650][2409565] DAMAGECOUNT value on done: 1350.0
[2023-02-25 12:40:04,654][2409565] Sum rewards: -1.572, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.514', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.005', 'weapon5': '0.008', 'ARMOR': '0.016', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.136', 'weapon4': '0.202', 'HITCOUNT': '0.620', 'WEAPON3': '0.900', 'weapon2': '1.248', 'DAMAGECOUNT': '1.956', 'weapon3': '2.148', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:40:04,678][2409486] DAMAGECOUNT value on done: 971.0
[2023-02-25 12:40:04,681][2409486] Sum rewards: 1.097, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.040', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.053', 'AMMO3': '0.068', 'weapon5': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.132', 'HITCOUNT': '0.400', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon3': '1.130', 'DAMAGECOUNT': '1.314', 'weapon2': '1.512'}
[2023-02-25 12:40:04,732][2409099] DAMAGECOUNT value on done: 1261.0
[2023-02-25 12:40:04,735][2409099] Sum rewards: -2.905, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.388', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon7': '0.050', 'weapon5': '0.074', 'AMMO3': '0.083', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.129', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.410', 'ARMOR': '0.456', 'DAMAGECOUNT': '0.531', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.240', 'weapon2': '1.254'}
[2023-02-25 12:40:04,917][2409485] DAMAGECOUNT value on done: 1094.0
[2023-02-25 12:40:04,970][2409597] DAMAGECOUNT value on done: 1359.0
[2023-02-25 12:40:04,973][2409597] Sum rewards: 1.012, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.105', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.009', 'WEAPON4': '0.050', 'weapon5': '0.088', 'AMMO3': '0.094', 'weapon4': '0.096', 'WEAPON5': '0.200', 'HITCOUNT': '0.390', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.320', 'weapon2': '1.574', 'weapon3': '1.686'}
[2023-02-25 12:40:05,360][2409077] DAMAGECOUNT value on done: 1052.0
[2023-02-25 12:40:05,363][2409077] Sum rewards: 0.258, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.342', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon5': '0.022', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'HITCOUNT': '0.130', 'WEAPON5': '0.150', 'weapon4': '0.260', 'DAMAGECOUNT': '0.540', 'WEAPON3': '0.600', 'ARMOR': '0.848', 'weapon2': '1.592', 'weapon3': '1.610', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:40:05,458][2409548] DAMAGECOUNT value on done: 1229.0
[2023-02-25 12:40:05,460][2409548] Sum rewards: -0.572, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.900', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.015', 'AMMO3': '0.067', 'weapon5': '0.146', 'WEAPON4': '0.300', 'HITCOUNT': '0.320', 'WEAPON5': '0.350', 'weapon4': '0.414', 'WEAPON3': '0.450', 'ARMOR': '0.477', 'DAMAGECOUNT': '0.972', 'weapon3': '1.108', 'weapon2': '1.470', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:40:05,696][2409389] DAMAGECOUNT value on done: 1131.0
[2023-02-25 12:40:05,700][2409389] Sum rewards: 1.517, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.376', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.017', 'WEAPON4': '0.050', 'AMMO3': '0.082', 'weapon4': '0.178', 'HITCOUNT': '0.270', 'WEAPON3': '0.500', 'ARMOR': '0.516', 'DAMAGECOUNT': '1.140', 'weapon3': '1.502', 'weapon2': '1.624', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:40:05,735][2409074] Updated weights for policy 0, policy_version 7771 (0.0012)
[2023-02-25 12:40:05,739][2409469] DAMAGECOUNT value on done: 1194.0
[2023-02-25 12:40:05,740][2409469] Sum rewards: -2.118, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.242', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'ARMOR': '0.064', 'AMMO3': '0.086', 'AMMO4': '0.103', 'weapon5': '0.128', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'HITCOUNT': '0.290', 'WEAPON3': '0.500', 'weapon4': '0.500', 'DAMAGECOUNT': '0.990', 'weapon2': '1.316', 'weapon3': '1.690'}
[2023-02-25 12:40:05,806][2409097] DAMAGECOUNT value on done: 850.0
[2023-02-25 12:40:05,807][2409097] Sum rewards: 0.073, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.960', 'AMMO5': '0.003', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.092', 'HITCOUNT': '0.160', 'ARMOR': '0.428', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.038', 'weapon2': '1.636', 'weapon3': '1.814'}
[2023-02-25 12:40:06,018][2409105] DAMAGECOUNT value on done: 1008.0
[2023-02-25 12:40:06,018][2409105] Sum rewards: 0.086, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.516', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'weapon5': '0.058', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.310', 'weapon4': '0.340', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.837', 'ARMOR': '0.905', 'weapon3': '1.508', 'weapon2': '1.716', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:40:06,105][2409076] DAMAGECOUNT value on done: 981.0
[2023-02-25 12:40:06,109][2409076] Sum rewards: 2.927, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'weapon5': '0.044', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.186', 'HITCOUNT': '0.220', 'HEALTH': '0.301', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.612', 'weapon3': '1.190', 'weapon2': '1.196', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:40:06,807][2409079] DAMAGECOUNT value on done: 1194.0
[2023-02-25 12:40:06,808][2409079] Sum rewards: 2.824, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.168', 'AMMO5': '0.005', 'weapon7': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'weapon5': '0.050', 'AMMO3': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.370', 'WEAPON3': '0.400', 'ARMOR': '0.436', 'weapon4': '0.552', 'weapon3': '1.212', 'DAMAGECOUNT': '1.260', 'weapon2': '1.446', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:40:07,091][2409373] DAMAGECOUNT value on done: 990.0
[2023-02-25 12:40:07,186][2408954] Fps is (10 sec: 22527.7, 60 sec: 24712.6, 300 sec: 24798.2). Total num frames: 31842304. Throughput: 0: 6249.6. Samples: 7959180. Policy #0 lag: (min: 2.0, avg: 15.6, max: 26.0)
[2023-02-25 12:40:07,187][2408954] Avg episode reward: [(0, '0.344')]
[2023-02-25 12:40:07,332][2409866] DAMAGECOUNT value on done: 1007.0
[2023-02-25 12:40:07,335][2409866] Sum rewards: 3.871, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.290', 'AMMO4': '-0.085', 'AMMO2': '-0.017', 'AMMO5': '0.004', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'weapon4': '0.196', 'HITCOUNT': '0.260', 'WEAPON3': '0.550', 'weapon3': '1.246', 'DAMAGECOUNT': '1.506', 'weapon2': '1.656', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:40:07,773][2409074] Updated weights for policy 0, policy_version 7781 (0.0013)
[2023-02-25 12:40:07,818][2409078] DAMAGECOUNT value on done: 881.0
[2023-02-25 12:40:07,818][2409078] Sum rewards: 0.889, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.768', 'AMMO2': '0.006', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.031', 'weapon7': '0.050', 'ARMOR': '0.052', 'AMMO3': '0.080', 'weapon5': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.190', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.258', 'WEAPON3': '0.600', 'weapon3': '1.024', 'weapon2': '1.086', 'DAMAGECOUNT': '1.281', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:40:07,846][2409355] DAMAGECOUNT value on done: 743.0
[2023-02-25 12:40:07,846][2409355] Sum rewards: 2.572, reward structure: {'DEATHCOUNT': '-2.250', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO3': '0.030', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'HEALTH': '0.125', 'HITCOUNT': '0.130', 'weapon4': '0.228', 'WEAPON3': '0.250', 'DAMAGECOUNT': '0.495', 'weapon3': '0.744', 'FRAGCOUNT': '1.000', 'weapon2': '1.700'}
[2023-02-25 12:40:07,919][2409075] DAMAGECOUNT value on done: 675.0
[2023-02-25 12:40:07,968][2409547] DAMAGECOUNT value on done: 870.0
[2023-02-25 12:40:07,972][2409547] Sum rewards: -1.159, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.180', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.119', 'HITCOUNT': '0.380', 'ARMOR': '0.448', 'WEAPON3': '0.450', 'WEAPON4': '0.450', 'weapon3': '0.846', 'weapon4': '0.926', 'DAMAGECOUNT': '1.239', 'weapon2': '1.748', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:40:08,004][2409468] DAMAGECOUNT value on done: 920.0
[2023-02-25 12:40:08,160][2409096] DAMAGECOUNT value on done: 1560.0
[2023-02-25 12:40:08,163][2409096] Sum rewards: -1.222, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.397', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON5': '0.050', 'ARMOR': '0.068', 'AMMO3': '0.099', 'weapon4': '0.274', 'WEAPON4': '0.300', 'HITCOUNT': '0.340', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.047', 'weapon3': '1.308', 'weapon2': '1.626', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:40:08,226][2409405] DAMAGECOUNT value on done: 1326.0
[2023-02-25 12:40:08,229][2409405] Sum rewards: -1.408, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.318', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO3': '0.135', 'WEAPON4': '0.150', 'HITCOUNT': '0.260', 'weapon4': '0.326', 'ARMOR': '0.400', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.885', 'weapon2': '1.310', 'weapon3': '1.694', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:40:08,263][2409101] DAMAGECOUNT value on done: 1130.0
[2023-02-25 12:40:08,264][2409101] Sum rewards: 5.943, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.865', 'AMMO4': '-0.062', 'AMMO2': '-0.012', 'ARMOR': '0.040', 'AMMO3': '0.060', 'weapon7': '0.082', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.176', 'WEAPON7': '0.200', 'HITCOUNT': '0.370', 'WEAPON3': '0.450', 'weapon3': '1.370', 'weapon2': '1.384', 'DAMAGECOUNT': '1.410', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:40:08,372][2409407] DAMAGECOUNT value on done: 602.0
[2023-02-25 12:40:08,431][2409596] DAMAGECOUNT value on done: 830.0
[2023-02-25 12:40:08,435][2409596] Sum rewards: 0.169, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.850', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO3': '0.069', 'weapon5': '0.070', 'WEAPON4': '0.150', 'weapon4': '0.196', 'WEAPON5': '0.200', 'HITCOUNT': '0.230', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.705', 'FRAGCOUNT': '1.000', 'weapon2': '1.008', 'weapon3': '1.346'}
[2023-02-25 12:40:08,457][2409485] DAMAGECOUNT value on done: 1224.0
[2023-02-25 12:40:08,460][2409485] Sum rewards: 2.829, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.382', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.064', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.380', 'HITCOUNT': '0.420', 'WEAPON3': '0.450', 'ARMOR': '0.477', 'weapon3': '0.968', 'DAMAGECOUNT': '1.512', 'weapon2': '2.100', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:40:08,484][2409080] DAMAGECOUNT value on done: 1063.0
[2023-02-25 12:40:08,485][2409080] Sum rewards: 0.136, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.524', 'AMMO2': '0.004', 'AMMO4': '0.020', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'HITCOUNT': '0.260', 'weapon4': '0.418', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.996', 'weapon3': '1.420', 'weapon2': '1.558', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:40:08,512][2409104] DAMAGECOUNT value on done: 984.0
[2023-02-25 12:40:08,513][2409104] Sum rewards: -2.384, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.135', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'weapon5': '0.002', 'AMMO5': '0.015', 'ARMOR': '0.052', 'AMMO3': '0.097', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.334', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.228', 'weapon3': '1.350'}
[2023-02-25 12:40:08,531][2409486] DAMAGECOUNT value on done: 744.0
[2023-02-25 12:40:08,536][2409486] Sum rewards: -2.312, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.517', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO2': '0.019', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'WEAPON5': '0.150', 'HITCOUNT': '0.210', 'weapon4': '0.314', 'ARMOR': '0.404', 'DAMAGECOUNT': '0.591', 'WEAPON3': '0.750', 'weapon2': '1.364', 'weapon3': '1.820', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:40:08,581][2409565] DAMAGECOUNT value on done: 1163.0
[2023-02-25 12:40:08,582][2409565] Sum rewards: 0.141, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.695', 'weapon4': '0.010', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.140', 'HITCOUNT': '0.260', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.945', 'FRAGCOUNT': '1.000', 'weapon3': '1.542', 'weapon2': '2.090'}
[2023-02-25 12:40:08,584][2409406] DAMAGECOUNT value on done: 1213.0
[2023-02-25 12:40:08,587][2409406] Sum rewards: 4.785, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.808', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.009', 'weapon7': '0.054', 'weapon4': '0.060', 'AMMO3': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.178', 'HITCOUNT': '0.460', 'ARMOR': '0.471', 'WEAPON3': '0.600', 'weapon3': '1.262', 'weapon2': '1.488', 'DAMAGECOUNT': '2.358', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:40:08,611][2409099] DAMAGECOUNT value on done: 1170.0
[2023-02-25 12:40:08,614][2409099] Sum rewards: 6.126, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.749', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'WEAPON1': '0.020', 'AMMO3': '0.060', 'HITCOUNT': '0.300', 'ARMOR': '0.476', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.975', 'weapon3': '1.504', 'weapon2': '2.298', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:40:09,090][2409074] Updated weights for policy 0, policy_version 7791 (0.0012)
[2023-02-25 12:40:09,337][2409077] DAMAGECOUNT value on done: 1627.0
[2023-02-25 12:40:09,338][2409077] Sum rewards: 7.069, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.265', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.030', 'AMMO4': '0.032', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'weapon4': '0.138', 'HITCOUNT': '0.610', 'WEAPON3': '0.800', 'weapon2': '1.230', 'weapon3': '2.252', 'DAMAGECOUNT': '2.430', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:40:09,463][2409548] DAMAGECOUNT value on done: 1326.0
[2023-02-25 12:40:09,466][2409548] Sum rewards: -1.724, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.142', 'FRAGCOUNT': '-1.000', 'AMMO4': '-0.053', 'AMMO2': '-0.011', 'AMMO5': '0.007', 'weapon5': '0.028', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.152', 'HITCOUNT': '0.280', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.771', 'ARMOR': '0.919', 'weapon3': '1.542', 'weapon2': '1.894'}
[2023-02-25 12:40:09,478][2409389] DAMAGECOUNT value on done: 923.0
[2023-02-25 12:40:09,481][2409389] Sum rewards: 1.425, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.860', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'WEAPON1': '0.010', 'ARMOR': '0.016', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'HITCOUNT': '0.130', 'weapon4': '0.194', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.456', 'weapon2': '1.296', 'weapon3': '1.402', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:40:09,533][2409097] DAMAGECOUNT value on done: 467.0
[2023-02-25 12:40:09,534][2409097] Sum rewards: -1.268, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.900', 'AMMO2': '0.015', 'ARMOR': '0.032', 'AMMO4': '0.074', 'AMMO3': '0.117', 'WEAPON4': '0.150', 'weapon4': '0.206', 'HITCOUNT': '0.210', 'DAMAGECOUNT': '0.546', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.616', 'weapon2': '1.766'}
[2023-02-25 12:40:09,589][2409597] DAMAGECOUNT value on done: 993.0
[2023-02-25 12:40:09,590][2409597] Sum rewards: -1.735, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.724', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO3': '0.087', 'weapon4': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.290', 'WEAPON3': '0.500', 'ARMOR': '0.532', 'DAMAGECOUNT': '1.125', 'weapon3': '1.376', 'weapon2': '1.796', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:40:09,906][2409076] DAMAGECOUNT value on done: 813.0
[2023-02-25 12:40:09,912][2409076] Sum rewards: 1.824, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'AMMO3': '0.060', 'AMMO4': '0.107', 'weapon5': '0.118', 'WEAPON5': '0.150', 'HEALTH': '0.180', 'HITCOUNT': '0.270', 'WEAPON3': '0.350', 'ARMOR': '0.500', 'DAMAGECOUNT': '0.936', 'weapon2': '1.422', 'weapon3': '1.442', 'FRAGCOUNT': '1.500'}
[2023-02-25 12:40:10,203][2409469] DAMAGECOUNT value on done: 1200.0
[2023-02-25 12:40:10,205][2409469] Sum rewards: 4.231, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.540', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO3': '0.059', 'weapon7': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'ARMOR': '0.424', 'HITCOUNT': '0.440', 'WEAPON3': '0.450', 'weapon4': '0.464', 'weapon3': '0.878', 'DAMAGECOUNT': '1.431', 'weapon2': '1.576', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:40:10,708][2409105] DAMAGECOUNT value on done: 558.0
[2023-02-25 12:40:10,882][2409079] DAMAGECOUNT value on done: 983.0
[2023-02-25 12:40:10,885][2409079] Sum rewards: -1.508, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.260', 'AMMO5': '0.010', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'AMMO3': '0.094', 'AMMO4': '0.120', 'weapon5': '0.128', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.180', 'DAMAGECOUNT': '0.369', 'WEAPON3': '0.500', 'weapon3': '0.922', 'weapon2': '1.444', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:40:10,893][2409373] DAMAGECOUNT value on done: 526.0
[2023-02-25 12:40:10,894][2409373] Sum rewards: -1.773, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.770', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'weapon5': '0.054', 'AMMO3': '0.119', 'HITCOUNT': '0.140', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'DAMAGECOUNT': '0.615', 'WEAPON3': '0.750', 'weapon4': '0.766', 'weapon3': '0.896', 'weapon2': '1.312', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:40:11,279][2409866] DAMAGECOUNT value on done: 895.0
[2023-02-25 12:40:11,284][2409866] Sum rewards: 1.827, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.396', 'AMMO2': '0.020', 'AMMO3': '0.090', 'AMMO4': '0.097', 'ARMOR': '0.100', 'WEAPON4': '0.250', 'HITCOUNT': '0.290', 'weapon4': '0.440', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.990', 'weapon3': '1.554', 'weapon2': '1.692', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:40:11,285][2409074] Updated weights for policy 0, policy_version 7801 (0.0012)
[2023-02-25 12:40:11,637][2409547] DAMAGECOUNT value on done: 757.0
[2023-02-25 12:40:11,641][2409547] Sum rewards: -1.686, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.710', 'ARMOR': '0.004', 'AMMO2': '0.014', 'AMMO4': '0.069', 'AMMO3': '0.095', 'WEAPON4': '0.150', 'weapon4': '0.216', 'HITCOUNT': '0.230', 'DAMAGECOUNT': '0.630', 'WEAPON3': '0.650', 'weapon3': '1.382', 'weapon2': '1.834', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:40:11,651][2409468] DAMAGECOUNT value on done: 936.0
[2023-02-25 12:40:11,652][2409468] Sum rewards: -1.491, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.440', 'AMMO4': '-0.062', 'AMMO2': '-0.012', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO3': '0.060', 'ARMOR': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'HITCOUNT': '0.310', 'weapon4': '0.330', 'WEAPON3': '0.500', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.996', 'weapon3': '1.210', 'weapon2': '1.708'}
[2023-02-25 12:40:11,727][2409355] DAMAGECOUNT value on done: 1425.0
[2023-02-25 12:40:11,728][2409355] Sum rewards: 6.054, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.612', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.020', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'weapon5': '0.142', 'WEAPON5': '0.250', 'HITCOUNT': '0.540', 'WEAPON3': '0.650', 'weapon2': '1.516', 'weapon3': '1.808', 'DAMAGECOUNT': '2.145', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:40:11,774][2409075] DAMAGECOUNT value on done: 1221.0
[2023-02-25 12:40:11,777][2409075] Sum rewards: -2.488, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.106', 'AMMO5': '0.003', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'AMMO4': '0.160', 'weapon4': '0.244', 'HITCOUNT': '0.310', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.170', 'weapon3': '1.392', 'weapon2': '1.772'}
[2023-02-25 12:40:11,874][2409078] DAMAGECOUNT value on done: 570.0
[2023-02-25 12:40:12,004][2409074] Updated weights for policy 0, policy_version 7811 (0.0012)
[2023-02-25 12:40:12,104][2409596] DAMAGECOUNT value on done: 715.0
[2023-02-25 12:40:12,105][2409080] DAMAGECOUNT value on done: 630.0
[2023-02-25 12:40:12,107][2409596] Sum rewards: -1.444, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.032', 'AMMO5': '0.005', 'AMMO2': '0.012', 'ARMOR': '0.024', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.083', 'HITCOUNT': '0.130', 'weapon5': '0.158', 'weapon4': '0.178', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.074', 'weapon3': '1.606'}
[2023-02-25 12:40:12,149][2409486] DAMAGECOUNT value on done: 1285.0
[2023-02-25 12:40:12,152][2409486] Sum rewards: -2.136, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.406', 'ARMOR': '0.004', 'AMMO2': '0.012', 'AMMO5': '0.014', 'weapon5': '0.018', 'AMMO4': '0.062', 'AMMO3': '0.129', 'weapon4': '0.144', 'WEAPON5': '0.200', 'HITCOUNT': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.897', 'weapon2': '1.472', 'weapon3': '1.916', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:40:12,186][2408954] Fps is (10 sec: 26624.2, 60 sec: 25258.6, 300 sec: 24937.0). Total num frames: 31997952. Throughput: 0: 6234.4. Samples: 7996548. Policy #0 lag: (min: 0.0, avg: 9.0, max: 24.0)
[2023-02-25 12:40:12,186][2408954] Avg episode reward: [(0, '0.441')]
[2023-02-25 12:40:12,203][2409104] DAMAGECOUNT value on done: 659.0
[2023-02-25 12:40:12,228][2409405] DAMAGECOUNT value on done: 789.0
[2023-02-25 12:40:12,232][2409405] Sum rewards: 0.156, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.690', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO3': '0.091', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.220', 'WEAPON4': '0.300', 'weapon4': '0.520', 'ARMOR': '0.539', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.855', 'weapon3': '1.286', 'weapon2': '1.534', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:40:12,250][2409099] DAMAGECOUNT value on done: 912.0
[2023-02-25 12:40:12,251][2409099] Sum rewards: 2.642, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.520', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.010', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.118', 'AMMO3': '0.131', 'weapon4': '0.144', 'WEAPON4': '0.200', 'HITCOUNT': '0.340', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.047', 'weapon2': '1.294', 'weapon3': '1.594', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:40:12,318][2409096] DAMAGECOUNT value on done: 916.0
[2023-02-25 12:40:12,336][2409096] Sum rewards: 0.415, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.948', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON1': '0.040', 'weapon5': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'HITCOUNT': '0.420', 'WEAPON3': '0.750', 'ARMOR': '0.898', 'weapon2': '1.278', 'DAMAGECOUNT': '1.410', 'weapon3': '1.820', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:40:12,330][2409565] DAMAGECOUNT value on done: 1003.0
[2023-02-25 12:40:12,336][2409565] Sum rewards: 3.996, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.039', 'AMMO2': '0.016', 'AMMO3': '0.062', 'AMMO4': '0.080', 'ARMOR': '0.094', 'WEAPON4': '0.200', 'HITCOUNT': '0.310', 'WEAPON3': '0.400', 'weapon4': '0.492', 'DAMAGECOUNT': '0.954', 'weapon3': '1.304', 'weapon2': '1.622', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:40:12,377][2409407] DAMAGECOUNT value on done: 891.0
[2023-02-25 12:40:12,378][2409407] Sum rewards: 0.971, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.231', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.054', 'ARMOR': '0.060', 'AMMO4': '0.074', 'HITCOUNT': '0.080', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.297', 'WEAPON3': '0.350', 'weapon4': '0.522', 'weapon2': '0.896', 'weapon3': '1.134', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:40:13,173][2409597] DAMAGECOUNT value on done: 805.0
[2023-02-25 12:40:13,198][2409097] DAMAGECOUNT value on done: 700.0
[2023-02-25 12:40:13,200][2409097] Sum rewards: 3.003, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.109', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO3': '0.065', 'AMMO4': '0.084', 'WEAPON4': '0.200', 'HITCOUNT': '0.260', 'WEAPON3': '0.400', 'weapon4': '0.434', 'ARMOR': '0.556', 'DAMAGECOUNT': '0.801', 'weapon2': '1.366', 'weapon3': '1.376', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:40:13,437][2409389] DAMAGECOUNT value on done: 1306.0
[2023-02-25 12:40:13,438][2409389] Sum rewards: 3.384, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.012', 'ARMOR': '0.016', 'weapon5': '0.028', 'HEALTH': '0.032', 'AMMO3': '0.041', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'WEAPON3': '0.300', 'HITCOUNT': '0.340', 'weapon3': '0.984', 'DAMAGECOUNT': '1.188', 'weapon2': '1.520', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:40:13,455][2409406] DAMAGECOUNT value on done: 1294.0
[2023-02-25 12:40:13,456][2409406] Sum rewards: -1.339, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.872', 'AMMO2': '0.004', 'weapon4': '0.006', 'AMMO5': '0.016', 'AMMO4': '0.022', 'WEAPON4': '0.100', 'weapon5': '0.104', 'AMMO3': '0.108', 'WEAPON5': '0.250', 'HITCOUNT': '0.360', 'ARMOR': '0.460', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.023', 'weapon3': '1.628', 'weapon2': '1.952'}
[2023-02-25 12:40:13,696][2409076] DAMAGECOUNT value on done: 962.0
[2023-02-25 12:40:13,697][2409076] Sum rewards: 1.511, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.174', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.028', 'ARMOR': '0.048', 'AMMO4': '0.142', 'AMMO3': '0.142', 'weapon5': '0.142', 'WEAPON5': '0.250', 'HITCOUNT': '0.310', 'weapon4': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.236', 'weapon2': '1.562', 'weapon3': '1.562', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:40:14,266][2409105] DAMAGECOUNT value on done: 811.0
[2023-02-25 12:40:14,267][2409105] Sum rewards: -9.621, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.180', 'FRAGCOUNT': '-1.000', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.013', 'ARMOR': '0.028', 'WEAPON1': '0.030', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.140', 'AMMO3': '0.145', 'weapon4': '0.268', 'DAMAGECOUNT': '0.687', 'WEAPON3': '0.950', 'weapon2': '1.326', 'weapon3': '1.722'}
[2023-02-25 12:40:14,548][2409074] Updated weights for policy 0, policy_version 7821 (0.0012)
[2023-02-25 12:40:14,626][2409373] DAMAGECOUNT value on done: 1207.0
[2023-02-25 12:40:14,629][2409373] Sum rewards: 0.442, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.294', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon5': '0.074', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'WEAPON4': '0.250', 'HITCOUNT': '0.330', 'WEAPON3': '0.550', 'weapon4': '0.688', 'weapon3': '0.850', 'weapon2': '1.096', 'DAMAGECOUNT': '1.266', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:40:14,711][2409077] DAMAGECOUNT value on done: 829.0
[2023-02-25 12:40:14,713][2409077] Sum rewards: 1.902, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.282', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.075', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.102', 'weapon4': '0.244', 'HITCOUNT': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.825', 'weapon2': '1.568', 'weapon3': '1.580', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:40:14,860][2409079] DAMAGECOUNT value on done: 889.0
[2023-02-25 12:40:14,947][2409469] DAMAGECOUNT value on done: 963.0
[2023-02-25 12:40:14,949][2409469] Sum rewards: 0.141, reward structure: {'DEATHCOUNT': '-8.250', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'ARMOR': '0.024', 'AMMO3': '0.102', 'AMMO4': '0.118', 'WEAPON4': '0.250', 'HITCOUNT': '0.320', 'HEALTH': '0.328', 'weapon4': '0.506', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.065', 'weapon3': '1.494', 'weapon2': '1.550', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:40:15,158][2409866] DAMAGECOUNT value on done: 857.0
[2023-02-25 12:40:15,159][2409866] Sum rewards: 0.860, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.700', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'ARMOR': '0.025', 'AMMO3': '0.050', 'AMMO4': '0.071', 'WEAPON4': '0.200', 'weapon4': '0.268', 'HITCOUNT': '0.270', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.840', 'FRAGCOUNT': '1.000', 'weapon3': '1.054', 'weapon2': '1.898'}
[2023-02-25 12:40:15,329][2409547] DAMAGECOUNT value on done: 931.0
[2023-02-25 12:40:15,333][2409547] Sum rewards: 4.933, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.501', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'WEAPON1': '0.030', 'AMMO3': '0.044', 'HITCOUNT': '0.280', 'WEAPON3': '0.350', 'weapon3': '0.928', 'weapon2': '0.968', 'DAMAGECOUNT': '1.095', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:40:15,461][2409075] DAMAGECOUNT value on done: 1022.0
[2023-02-25 12:40:15,464][2409075] Sum rewards: 3.878, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.694', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.037', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'WEAPON4': '0.150', 'weapon4': '0.228', 'ARMOR': '0.404', 'HITCOUNT': '0.460', 'WEAPON3': '0.750', 'weapon3': '1.352', 'weapon2': '1.600', 'DAMAGECOUNT': '1.872', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:40:15,592][2409074] Updated weights for policy 0, policy_version 7831 (0.0012)
[2023-02-25 12:40:15,600][2409355] DAMAGECOUNT value on done: 801.0
[2023-02-25 12:40:15,629][2409468] DAMAGECOUNT value on done: 1024.0
[2023-02-25 12:40:15,630][2409468] Sum rewards: -3.605, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.032', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.041', 'weapon5': '0.082', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.124', 'WEAPON5': '0.150', 'HITCOUNT': '0.210', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.771', 'ARMOR': '1.200', 'weapon3': '1.494', 'weapon2': '1.690'}
[2023-02-25 12:40:15,800][2409078] DAMAGECOUNT value on done: 979.0
[2023-02-25 12:40:15,913][2409486] DAMAGECOUNT value on done: 1217.0
[2023-02-25 12:40:15,957][2409104] DAMAGECOUNT value on done: 1178.0
[2023-02-25 12:40:15,958][2409104] Sum rewards: -0.212, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.120', 'AMMO2': '0.005', 'AMMO4': '0.024', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'HITCOUNT': '0.180', 'weapon4': '0.216', 'DAMAGECOUNT': '0.519', 'WEAPON3': '0.550', 'weapon3': '1.138', 'weapon2': '1.342', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:40:16,039][2409099] DAMAGECOUNT value on done: 1169.0
[2023-02-25 12:40:16,042][2409099] Sum rewards: -2.448, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.480', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.082', 'weapon4': '0.130', 'AMMO3': '0.134', 'WEAPON4': '0.150', 'HITCOUNT': '0.270', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.774', 'weapon2': '1.592', 'FRAGCOUNT': '2.000', 'weapon3': '2.030'}
[2023-02-25 12:40:16,065][2409405] DAMAGECOUNT value on done: 1391.0
[2023-02-25 12:40:16,068][2409405] Sum rewards: 1.778, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.056', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'weapon4': '0.174', 'WEAPON3': '0.400', 'HITCOUNT': '0.480', 'ARMOR': '0.851', 'FRAGCOUNT': '1.000', 'weapon2': '1.210', 'weapon3': '1.286', 'DAMAGECOUNT': '1.431'}
[2023-02-25 12:40:16,076][2409080] DAMAGECOUNT value on done: 876.0
[2023-02-25 12:40:16,084][2409080] Sum rewards: 0.741, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.430', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'AMMO3': '0.060', 'AMMO4': '0.098', 'weapon5': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'weapon4': '0.382', 'WEAPON3': '0.500', 'ARMOR': '0.504', 'DAMAGECOUNT': '0.714', 'weapon2': '1.496', 'weapon3': '1.558', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:40:16,233][2409407] DAMAGECOUNT value on done: 1059.0
[2023-02-25 12:40:16,234][2409407] Sum rewards: 5.419, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.500', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.046', 'AMMO3': '0.114', 'ARMOR': '0.464', 'HITCOUNT': '0.540', 'WEAPON3': '0.600', 'weapon2': '1.280', 'DAMAGECOUNT': '1.776', 'weapon3': '2.580', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:40:16,787][2409097] DAMAGECOUNT value on done: 833.0
[2023-02-25 12:40:16,788][2409097] Sum rewards: -2.538, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.070', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.020', 'AMMO3': '0.085', 'weapon5': '0.118', 'HITCOUNT': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.338', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.633', 'ARMOR': '0.901', 'weapon2': '1.186', 'weapon3': '1.402'}
[2023-02-25 12:40:17,124][2409389] DAMAGECOUNT value on done: 1275.0
[2023-02-25 12:40:17,127][2409389] Sum rewards: 2.511, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.920', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'weapon4': '0.150', 'HITCOUNT': '0.390', 'WEAPON3': '0.600', 'weapon3': '1.118', 'weapon2': '1.196', 'DAMAGECOUNT': '1.230', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:40:17,186][2408954] Fps is (10 sec: 26623.8, 60 sec: 24985.5, 300 sec: 24895.3). Total num frames: 32108544. Throughput: 0: 6231.4. Samples: 8033700. Policy #0 lag: (min: 0.0, avg: 9.0, max: 24.0)
[2023-02-25 12:40:17,186][2408954] Avg episode reward: [(0, '0.188')]
[2023-02-25 12:40:17,191][2409033] Saving /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000007839_32108544.pth...
[2023-02-25 12:40:17,267][2409096] DAMAGECOUNT value on done: 1389.0
[2023-02-25 12:40:17,271][2409096] Sum rewards: 3.473, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO3': '0.060', 'weapon4': '0.222', 'HITCOUNT': '0.360', 'WEAPON3': '0.400', 'HEALTH': '0.458', 'ARMOR': '0.919', 'weapon3': '1.168', 'DAMAGECOUNT': '1.356', 'weapon2': '1.558', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:40:17,287][2409033] Removing /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000006382_26140672.pth
[2023-02-25 12:40:17,670][2409074] Updated weights for policy 0, policy_version 7841 (0.0013)
[2023-02-25 12:40:17,845][2409076] DAMAGECOUNT value on done: 499.0
[2023-02-25 12:40:17,846][2409076] Sum rewards: 1.398, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.748', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO4': '0.032', 'weapon5': '0.060', 'AMMO3': '0.080', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'HITCOUNT': '0.290', 'weapon4': '0.482', 'WEAPON3': '0.550', 'ARMOR': '0.898', 'weapon2': '0.982', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.029', 'weapon3': '1.548'}
[2023-02-25 12:40:17,948][2409105] DAMAGECOUNT value on done: 880.0
[2023-02-25 12:40:17,952][2409105] Sum rewards: 0.496, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.880', 'AMMO4': '-0.058', 'AMMO2': '-0.011', 'WEAPON1': '0.020', 'ARMOR': '0.035', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'weapon4': '0.234', 'HITCOUNT': '0.260', 'WEAPON3': '0.700', 'weapon2': '1.008', 'DAMAGECOUNT': '1.065', 'weapon3': '1.442', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:40:18,542][2409079] DAMAGECOUNT value on done: 1232.0
[2023-02-25 12:40:18,543][2409079] Sum rewards: 2.421, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.486', 'AMMO5': '0.011', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.082', 'weapon5': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.220', 'WEAPON5': '0.250', 'HITCOUNT': '0.360', 'ARMOR': '0.451', 'WEAPON3': '0.500', 'weapon3': '1.180', 'DAMAGECOUNT': '1.335', 'weapon2': '1.416', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:40:18,805][2409866] DAMAGECOUNT value on done: 697.0
[2023-02-25 12:40:18,806][2409866] Sum rewards: -3.047, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.950', 'AMMO2': '0.002', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO4': '0.012', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.111', 'HITCOUNT': '0.300', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.810', 'ARMOR': '0.853', 'FRAGCOUNT': '1.000', 'weapon2': '1.688', 'weapon3': '2.048'}
[2023-02-25 12:40:19,126][2409469] DAMAGECOUNT value on done: 1099.0
[2023-02-25 12:40:19,129][2409469] Sum rewards: 1.609, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.310', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'WEAPON4': '0.050', 'weapon5': '0.066', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'weapon4': '0.184', 'HITCOUNT': '0.420', 'ARMOR': '0.436', 'WEAPON3': '0.650', 'weapon3': '1.344', 'DAMAGECOUNT': '1.515', 'weapon2': '1.602', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:40:19,242][2409547] DAMAGECOUNT value on done: 770.0
[2023-02-25 12:40:19,245][2409547] Sum rewards: 0.691, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.922', 'AMMO5': '0.003', 'AMMO2': '0.016', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.082', 'weapon4': '0.274', 'HITCOUNT': '0.280', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'DAMAGECOUNT': '1.020', 'weapon3': '1.228', 'weapon2': '1.850', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:40:19,317][2409074] Updated weights for policy 0, policy_version 7851 (0.0012)
[2023-02-25 12:40:19,408][2409355] DAMAGECOUNT value on done: 793.0
[2023-02-25 12:40:19,412][2409355] Sum rewards: -3.515, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.120', 'FRAGCOUNT': '-0.500', 'WEAPON1': '0.010', 'weapon5': '0.014', 'AMMO5': '0.015', 'AMMO2': '0.040', 'AMMO3': '0.095', 'HITCOUNT': '0.180', 'AMMO4': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.344', 'ARMOR': '0.476', 'DAMAGECOUNT': '0.549', 'WEAPON3': '0.600', 'weapon3': '1.452', 'weapon2': '1.830'}
[2023-02-25 12:40:19,688][2409078] DAMAGECOUNT value on done: 923.0
[2023-02-25 12:40:19,689][2409078] Sum rewards: 2.070, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'AMMO4': '0.173', 'HITCOUNT': '0.320', 'WEAPON3': '0.350', 'weapon4': '0.422', 'HEALTH': '0.592', 'weapon3': '1.208', 'DAMAGECOUNT': '1.275', 'weapon2': '1.408', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:40:19,754][2409468] DAMAGECOUNT value on done: 1037.0
[2023-02-25 12:40:19,754][2409468] Sum rewards: 0.156, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.462', 'AMMO2': '0.001', 'AMMO4': '0.003', 'WEAPON1': '0.010', 'ARMOR': '0.028', 'AMMO3': '0.132', 'HITCOUNT': '0.530', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.620', 'weapon2': '1.656', 'weapon3': '1.988', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:40:19,946][2409407] DAMAGECOUNT value on done: 1171.0
[2023-02-25 12:40:19,947][2409407] Sum rewards: -0.022, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.247', 'AMMO2': '0.021', 'AMMO4': '0.102', 'AMMO3': '0.112', 'WEAPON4': '0.250', 'HITCOUNT': '0.300', 'weapon4': '0.340', 'ARMOR': '0.424', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.008', 'weapon2': '1.388', 'weapon3': '1.780', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:40:19,959][2409405] DAMAGECOUNT value on done: 1367.0
[2023-02-25 12:40:19,961][2409405] Sum rewards: -1.769, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.000', 'HEALTH': '-0.240', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.013', 'weapon5': '0.054', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.226', 'HITCOUNT': '0.350', 'WEAPON3': '0.500', 'ARMOR': '0.534', 'DAMAGECOUNT': '1.170', 'weapon2': '1.288', 'weapon3': '1.798'}
[2023-02-25 12:40:19,964][2409486] DAMAGECOUNT value on done: 1066.0
[2023-02-25 12:40:19,965][2409486] Sum rewards: 0.500, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.272', 'AMMO2': '0.036', 'AMMO3': '0.083', 'AMMO4': '0.177', 'WEAPON4': '0.250', 'HITCOUNT': '0.280', 'ARMOR': '0.444', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.768', 'weapon4': '0.792', 'weapon3': '1.250', 'weapon2': '1.442', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:40:20,036][2409075] DAMAGECOUNT value on done: 1111.0
[2023-02-25 12:40:20,036][2409075] Sum rewards: 2.888, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.170', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.099', 'weapon5': '0.126', 'weapon4': '0.148', 'WEAPON4': '0.150', 'ARMOR': '0.428', 'HITCOUNT': '0.470', 'WEAPON3': '0.650', 'weapon3': '1.482', 'weapon2': '1.512', 'DAMAGECOUNT': '1.605', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:40:20,125][2409099] DAMAGECOUNT value on done: 763.0
[2023-02-25 12:40:20,128][2409099] Sum rewards: -3.606, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.359', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.011', 'AMMO3': '0.081', 'weapon5': '0.090', 'WEAPON5': '0.150', 'HITCOUNT': '0.160', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.732', 'ARMOR': '0.880', 'FRAGCOUNT': '1.000', 'weapon3': '1.082', 'weapon2': '2.048'}
[2023-02-25 12:40:20,249][2409080] DAMAGECOUNT value on done: 883.0
[2023-02-25 12:40:20,251][2409080] Sum rewards: -0.516, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.220', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon5': '0.020', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.127', 'weapon4': '0.148', 'WEAPON4': '0.150', 'HITCOUNT': '0.190', 'WEAPON5': '0.200', 'ARMOR': '0.440', 'DAMAGECOUNT': '0.555', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.678', 'weapon3': '1.806'}
[2023-02-25 12:40:20,771][2409074] Updated weights for policy 0, policy_version 7861 (0.0014)
[2023-02-25 12:40:21,147][2409096] DAMAGECOUNT value on done: 566.0
[2023-02-25 12:40:21,150][2409096] Sum rewards: 0.563, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.903', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'weapon4': '0.174', 'HITCOUNT': '0.310', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'DAMAGECOUNT': '0.966', 'weapon2': '1.596', 'weapon3': '1.688', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:40:21,227][2409097] DAMAGECOUNT value on done: 741.0
[2023-02-25 12:40:21,228][2409097] Sum rewards: 4.549, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO2': '0.025', 'AMMO3': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO4': '0.126', 'WEAPON3': '0.250', 'HITCOUNT': '0.250', 'HEALTH': '0.434', 'DAMAGECOUNT': '0.951', 'weapon3': '1.012', 'FRAGCOUNT': '2.000', 'weapon2': '2.190'}
[2023-02-25 12:40:21,608][2409076] DAMAGECOUNT value on done: 1146.0
[2023-02-25 12:40:21,618][2409076] Sum rewards: 0.804, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.298', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'ARMOR': '0.064', 'WEAPON4': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.123', 'weapon4': '0.340', 'HITCOUNT': '0.410', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.317', 'weapon2': '1.608', 'weapon3': '1.748', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:40:22,186][2408954] Fps is (10 sec: 22527.9, 60 sec: 24849.0, 300 sec: 24853.7). Total num frames: 32223232. Throughput: 0: 6240.8. Samples: 8052432. Policy #0 lag: (min: 0.0, avg: 11.9, max: 25.0)
[2023-02-25 12:40:22,186][2408954] Avg episode reward: [(0, '0.346')]
[2023-02-25 12:40:22,250][2409079] DAMAGECOUNT value on done: 923.0
[2023-02-25 12:40:22,254][2409079] Sum rewards: 1.896, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.350', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'ARMOR': '0.016', 'AMMO3': '0.087', 'weapon5': '0.122', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.376', 'HITCOUNT': '0.420', 'WEAPON3': '0.650', 'weapon2': '1.132', 'DAMAGECOUNT': '1.317', 'weapon3': '1.712', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:40:22,672][2409469] DAMAGECOUNT value on done: 769.0
[2023-02-25 12:40:22,899][2409074] Updated weights for policy 0, policy_version 7871 (0.0012)
[2023-02-25 12:40:23,302][2409078] DAMAGECOUNT value on done: 831.0
[2023-02-25 12:40:23,536][2409547] DAMAGECOUNT value on done: 1364.0
[2023-02-25 12:40:23,536][2409547] Sum rewards: 6.781, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'HEALTH': '0.236', 'HITCOUNT': '0.400', 'ARMOR': '0.404', 'WEAPON3': '0.800', 'weapon2': '1.132', 'DAMAGECOUNT': '2.130', 'weapon3': '2.534', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:40:23,548][2409405] DAMAGECOUNT value on done: 1133.0
[2023-02-25 12:40:23,549][2409405] Sum rewards: -0.559, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.380', 'WEAPON1': '0.010', 'AMMO2': '0.043', 'ARMOR': '0.060', 'AMMO3': '0.105', 'WEAPON4': '0.200', 'AMMO4': '0.217', 'HITCOUNT': '0.340', 'weapon4': '0.464', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.032', 'weapon2': '1.172', 'weapon3': '1.778', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:40:23,707][2409468] DAMAGECOUNT value on done: 702.0
[2023-02-25 12:40:23,821][2409074] Updated weights for policy 0, policy_version 7881 (0.0012)
[2023-02-25 12:40:24,113][2409080] DAMAGECOUNT value on done: 814.0
[2023-02-25 12:40:24,117][2409080] Sum rewards: -0.516, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.480', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.089', 'WEAPON4': '0.200', 'HITCOUNT': '0.270', 'weapon4': '0.322', 'ARMOR': '0.529', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.981', 'FRAGCOUNT': '1.000', 'weapon3': '1.324', 'weapon2': '1.530'}
[2023-02-25 12:40:24,381][2409075] DAMAGECOUNT value on done: 1088.0
[2023-02-25 12:40:24,382][2409075] Sum rewards: -5.636, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.786', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'weapon5': '0.036', 'AMMO2': '0.053', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'HITCOUNT': '0.230', 'AMMO4': '0.264', 'weapon4': '0.272', 'ARMOR': '0.465', 'FRAGCOUNT': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.801', 'weapon3': '1.598', 'weapon2': '1.684'}
[2023-02-25 12:40:24,835][2409096] DAMAGECOUNT value on done: 1145.0
[2023-02-25 12:40:24,838][2409096] Sum rewards: 1.935, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.195', 'AMMO2': '0.020', 'AMMO3': '0.058', 'AMMO4': '0.100', 'weapon4': '0.120', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'WEAPON3': '0.250', 'ARMOR': '0.455', 'DAMAGECOUNT': '0.630', 'weapon3': '0.824', 'weapon2': '1.812', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:40:24,863][2409097] DAMAGECOUNT value on done: 607.0
[2023-02-25 12:40:25,029][2409486] DAMAGECOUNT value on done: 1147.0
[2023-02-25 12:40:25,030][2409486] Sum rewards: -5.300, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.006', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon5': '0.086', 'AMMO3': '0.099', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.260', 'weapon4': '0.290', 'ARMOR': '0.444', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.765', 'weapon2': '1.466', 'weapon3': '1.692'}
[2023-02-25 12:40:25,275][2409099] DAMAGECOUNT value on done: 1038.0
[2023-02-25 12:40:25,301][2409099] Sum rewards: 3.551, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.104', 'AMMO2': '0.019', 'AMMO3': '0.062', 'AMMO4': '0.096', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'HITCOUNT': '0.450', 'weapon4': '0.464', 'WEAPON3': '0.500', 'weapon3': '1.288', 'DAMAGECOUNT': '1.425', 'weapon2': '1.700', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:40:25,909][2409079] DAMAGECOUNT value on done: 811.0
[2023-02-25 12:40:25,913][2409079] Sum rewards: 2.486, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON1': '0.030', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.066', 'HEALTH': '0.087', 'HITCOUNT': '0.270', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.837', 'weapon2': '1.046', 'weapon3': '1.342', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:40:25,964][2409074] Updated weights for policy 0, policy_version 7891 (0.0013)
[2023-02-25 12:40:27,166][2409078] DAMAGECOUNT value on done: 704.0
[2023-02-25 12:40:27,166][2409078] Sum rewards: 2.057, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.138', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.014', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'weapon4': '0.246', 'HITCOUNT': '0.450', 'WEAPON3': '0.600', 'ARMOR': '0.908', 'DAMAGECOUNT': '1.422', 'weapon3': '1.508', 'weapon2': '1.538', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:40:27,186][2408954] Fps is (10 sec: 24986.1, 60 sec: 25053.8, 300 sec: 24937.0). Total num frames: 32358400. Throughput: 0: 6238.4. Samples: 8089500. Policy #0 lag: (min: 0.0, avg: 13.2, max: 24.0)
[2023-02-25 12:40:27,186][2408954] Avg episode reward: [(0, '0.308')]
[2023-02-25 12:40:27,189][2409547] DAMAGECOUNT value on done: 1028.0
[2023-02-25 12:40:27,190][2409547] Sum rewards: 2.763, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.070', 'WEAPON4': '0.200', 'HEALTH': '0.277', 'WEAPON3': '0.400', 'HITCOUNT': '0.470', 'weapon4': '0.650', 'weapon3': '1.114', 'weapon2': '1.400', 'DAMAGECOUNT': '1.734', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:40:27,397][2409074] Updated weights for policy 0, policy_version 7901 (0.0012)
[2023-02-25 12:40:27,940][2409468] DAMAGECOUNT value on done: 770.0
[2023-02-25 12:40:27,944][2409468] Sum rewards: -4.472, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.540', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'AMMO4': '0.045', 'weapon5': '0.068', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.190', 'weapon4': '0.220', 'DAMAGECOUNT': '0.588', 'WEAPON3': '0.800', 'weapon3': '1.636', 'weapon2': '1.754'}
[2023-02-25 12:40:28,297][2409080] DAMAGECOUNT value on done: 844.0
[2023-02-25 12:40:28,299][2409080] Sum rewards: 4.463, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.934', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.013', 'weapon5': '0.056', 'AMMO3': '0.060', 'weapon7': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.160', 'WEAPON7': '0.200', 'HITCOUNT': '0.250', 'ARMOR': '0.424', 'WEAPON3': '0.450', 'weapon3': '1.226', 'weapon2': '1.510', 'DAMAGECOUNT': '1.518', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:40:28,434][2409097] DAMAGECOUNT value on done: 885.0
[2023-02-25 12:40:29,118][2409096] DAMAGECOUNT value on done: 804.0
[2023-02-25 12:40:29,121][2409096] Sum rewards: -0.790, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.720', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'weapon5': '0.008', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'weapon4': '0.220', 'HITCOUNT': '0.240', 'ARMOR': '0.527', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.894', 'FRAGCOUNT': '1.000', 'weapon2': '1.312', 'weapon3': '1.696'}
[2023-02-25 12:40:29,177][2409074] Updated weights for policy 0, policy_version 7911 (0.0013)
[2023-02-25 12:40:29,415][2409486] DAMAGECOUNT value on done: 1006.0
[2023-02-25 12:40:29,416][2409486] Sum rewards: 0.120, reward structure: {'DEATHCOUNT': '-3.750', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.264', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'weapon5': '0.060', 'HITCOUNT': '0.070', 'DAMAGECOUNT': '0.210', 'WEAPON3': '0.350', 'ARMOR': '0.524', 'weapon3': '1.242', 'weapon2': '1.986'}
[2023-02-25 12:40:29,646][2409099] DAMAGECOUNT value on done: 1093.0
[2023-02-25 12:40:29,648][2409099] Sum rewards: 1.582, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.025', 'AMMO5': '0.006', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'AMMO3': '0.078', 'AMMO4': '0.124', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.380', 'weapon4': '0.408', 'ARMOR': '0.448', 'WEAPON3': '0.600', 'weapon2': '0.876', 'DAMAGECOUNT': '1.404', 'weapon3': '1.540', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:40:29,730][2409079] DAMAGECOUNT value on done: 828.0
[2023-02-25 12:40:29,734][2409079] Sum rewards: -1.382, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.232', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'AMMO3': '0.098', 'HITCOUNT': '0.210', 'ARMOR': '0.474', 'DAMAGECOUNT': '0.609', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.670', 'weapon3': '1.856'}
[2023-02-25 12:40:30,684][2409074] Updated weights for policy 0, policy_version 7921 (0.0012)
[2023-02-25 12:40:30,853][2409547] DAMAGECOUNT value on done: 765.0
[2023-02-25 12:40:31,389][2409078] DAMAGECOUNT value on done: 1227.0
[2023-02-25 12:40:31,392][2409078] Sum rewards: 4.752, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.006', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.068', 'ARMOR': '0.096', 'WEAPON4': '0.200', 'weapon4': '0.274', 'HITCOUNT': '0.350', 'WEAPON3': '0.500', 'weapon2': '1.098', 'weapon3': '1.284', 'DAMAGECOUNT': '1.317', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:40:32,186][2408954] Fps is (10 sec: 25805.0, 60 sec: 25053.9, 300 sec: 24909.2). Total num frames: 32481280. Throughput: 0: 6238.1. Samples: 8126604. Policy #0 lag: (min: 0.0, avg: 15.4, max: 29.0)
[2023-02-25 12:40:32,186][2408954] Avg episode reward: [(0, '0.269')]
[2023-02-25 12:40:32,214][2409468] DAMAGECOUNT value on done: 1189.0
[2023-02-25 12:40:32,215][2409468] Sum rewards: 0.900, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.006', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'weapon5': '0.006', 'WEAPON1': '0.040', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'weapon4': '0.142', 'HITCOUNT': '0.380', 'WEAPON3': '0.700', 'ARMOR': '0.888', 'DAMAGECOUNT': '1.260', 'weapon3': '1.642', 'weapon2': '1.832', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:40:32,391][2409074] Updated weights for policy 0, policy_version 7931 (0.0012)
[2023-02-25 12:40:32,524][2409080] DAMAGECOUNT value on done: 1004.0
[2023-02-25 12:40:32,527][2409080] Sum rewards: -1.406, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.520', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'AMMO3': '0.118', 'AMMO4': '0.156', 'WEAPON4': '0.250', 'HITCOUNT': '0.290', 'weapon4': '0.348', 'ARMOR': '0.440', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.915', 'weapon2': '1.098', 'weapon3': '1.748', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:40:33,640][2409099] DAMAGECOUNT value on done: 926.0
[2023-02-25 12:40:33,643][2409099] Sum rewards: 1.151, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.868', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.031', 'AMMO3': '0.083', 'WEAPON5': '0.100', 'HITCOUNT': '0.390', 'WEAPON3': '0.500', 'ARMOR': '0.816', 'DAMAGECOUNT': '1.398', 'weapon3': '1.686', 'weapon2': '2.252', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:40:33,809][2409079] DAMAGECOUNT value on done: 696.0
[2023-02-25 12:40:33,810][2409079] Sum rewards: 4.760, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.387', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.076', 'AMMO3': '0.077', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'WEAPON4': '0.200', 'HITCOUNT': '0.290', 'WEAPON3': '0.450', 'weapon4': '0.622', 'ARMOR': '0.911', 'DAMAGECOUNT': '1.362', 'weapon3': '1.416', 'weapon2': '1.494', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:40:34,232][2409074] Updated weights for policy 0, policy_version 7941 (0.0012)
[2023-02-25 12:40:35,464][2409547] DAMAGECOUNT value on done: 948.0
[2023-02-25 12:40:35,464][2409547] Sum rewards: 0.738, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.604', 'AMMO2': '0.003', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO4': '0.017', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.170', 'HITCOUNT': '0.310', 'WEAPON3': '0.500', 'ARMOR': '0.508', 'DAMAGECOUNT': '1.095', 'weapon3': '1.230', 'weapon2': '1.660', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:40:35,639][2409074] Updated weights for policy 0, policy_version 7951 (0.0012)
[2023-02-25 12:40:35,973][2409468] DAMAGECOUNT value on done: 981.0
[2023-02-25 12:40:35,974][2409468] Sum rewards: 1.758, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.044', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'AMMO3': '0.086', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO4': '0.180', 'HITCOUNT': '0.260', 'weapon4': '0.312', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'ARMOR': '0.468', 'weapon3': '0.868', 'DAMAGECOUNT': '1.092', 'weapon2': '1.618', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:40:36,256][2409080] DAMAGECOUNT value on done: 994.0
[2023-02-25 12:40:36,261][2409080] Sum rewards: 1.728, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.749', 'AMMO2': '0.019', 'AMMO3': '0.078', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'weapon4': '0.352', 'HITCOUNT': '0.380', 'WEAPON3': '0.500', 'ARMOR': '0.851', 'weapon3': '1.112', 'DAMAGECOUNT': '1.281', 'weapon2': '2.158', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:40:37,186][2408954] Fps is (10 sec: 24166.5, 60 sec: 24917.3, 300 sec: 24881.5). Total num frames: 32600064. Throughput: 0: 6236.6. Samples: 8145324. Policy #0 lag: (min: 0.0, avg: 15.4, max: 29.0)
[2023-02-25 12:40:37,186][2408954] Avg episode reward: [(0, '0.318')]
[2023-02-25 12:40:37,539][2409074] Updated weights for policy 0, policy_version 7961 (0.0012)
[2023-02-25 12:40:37,607][2409099] DAMAGECOUNT value on done: 1223.0
[2023-02-25 12:40:37,611][2409099] Sum rewards: 4.027, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.729', 'AMMO5': '0.005', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.026', 'AMMO4': '0.026', 'WEAPON5': '0.050', 'AMMO3': '0.083', 'HITCOUNT': '0.420', 'WEAPON3': '0.550', 'ARMOR': '0.859', 'DAMAGECOUNT': '1.227', 'weapon3': '1.446', 'weapon2': '1.798', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:40:38,797][2409074] Updated weights for policy 0, policy_version 7971 (0.0012)
[2023-02-25 12:40:39,179][2409547] DAMAGECOUNT value on done: 906.0
[2023-02-25 12:40:39,183][2409547] Sum rewards: 1.007, reward structure: {'DEATHCOUNT': '-8.250', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'AMMO3': '0.080', 'AMMO4': '0.098', 'HEALTH': '0.124', 'WEAPON4': '0.150', 'HITCOUNT': '0.270', 'weapon4': '0.280', 'WEAPON3': '0.450', 'ARMOR': '0.496', 'DAMAGECOUNT': '0.795', 'weapon3': '1.612', 'weapon2': '1.872', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:40:40,417][2409468] DAMAGECOUNT value on done: 1098.0
[2023-02-25 12:40:40,420][2409468] Sum rewards: 3.576, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.378', 'AMMO2': '0.007', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.032', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'weapon4': '0.170', 'WEAPON5': '0.200', 'weapon5': '0.214', 'HITCOUNT': '0.430', 'WEAPON3': '0.750', 'ARMOR': '1.200', 'weapon2': '1.210', 'DAMAGECOUNT': '1.440', 'weapon3': '1.556', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:40:40,621][2409074] Updated weights for policy 0, policy_version 7981 (0.0013)
[2023-02-25 12:40:40,753][2409080] DAMAGECOUNT value on done: 1143.0
[2023-02-25 12:40:40,755][2409080] Sum rewards: 1.141, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.540', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'ARMOR': '0.064', 'weapon4': '0.086', 'AMMO3': '0.131', 'HITCOUNT': '0.270', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.885', 'weapon2': '1.374', 'weapon3': '2.182', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:40:41,906][2409074] Updated weights for policy 0, policy_version 7991 (0.0012)
[2023-02-25 12:40:42,104][2409099] DAMAGECOUNT value on done: 1194.0
[2023-02-25 12:40:42,109][2409099] Sum rewards: 0.535, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.619', 'ARMOR': '0.004', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'weapon4': '0.164', 'HITCOUNT': '0.480', 'WEAPON3': '0.800', 'weapon2': '1.460', 'DAMAGECOUNT': '1.572', 'weapon3': '1.944', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:40:42,187][2408954] Fps is (10 sec: 25390.9, 60 sec: 24984.9, 300 sec: 24909.1). Total num frames: 32735232. Throughput: 0: 6238.7. Samples: 8183844. Policy #0 lag: (min: 0.0, avg: 12.1, max: 28.0)
[2023-02-25 12:40:42,188][2408954] Avg episode reward: [(0, '0.318')]
[2023-02-25 12:40:42,365][2409033] Signal inference workers to stop experience collection... (1050 times)
[2023-02-25 12:40:42,381][2409033] Signal inference workers to resume experience collection... (1050 times)
[2023-02-25 12:40:42,402][2409074] InferenceWorker_p0-w0: stopping experience collection (1050 times)
[2023-02-25 12:40:42,428][2409074] InferenceWorker_p0-w0: resuming experience collection (1050 times)
[2023-02-25 12:40:42,964][2409547] DAMAGECOUNT value on done: 1189.0
[2023-02-25 12:40:42,967][2409547] Sum rewards: -0.223, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.073', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.080', 'AMMO3': '0.086', 'AMMO4': '0.124', 'HITCOUNT': '0.380', 'ARMOR': '0.462', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.230', 'weapon3': '1.230', 'weapon2': '2.110'}
[2023-02-25 12:40:43,724][2409074] Updated weights for policy 0, policy_version 8001 (0.0012)
[2023-02-25 12:40:44,408][2409468] DAMAGECOUNT value on done: 683.0
[2023-02-25 12:40:44,411][2409468] Sum rewards: -1.536, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.496', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'ARMOR': '0.016', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'weapon4': '0.180', 'HITCOUNT': '0.380', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.380', 'weapon2': '1.550', 'weapon3': '1.688', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:40:44,708][2409080] DAMAGECOUNT value on done: 807.0
[2023-02-25 12:40:45,399][2409074] Updated weights for policy 0, policy_version 8011 (0.0012)
[2023-02-25 12:40:46,397][2409074] Updated weights for policy 0, policy_version 8021 (0.0014)
[2023-02-25 12:40:46,638][2409547] DAMAGECOUNT value on done: 588.0
[2023-02-25 12:40:47,186][2408954] Fps is (10 sec: 26624.0, 60 sec: 25190.4, 300 sec: 24937.0). Total num frames: 32866304. Throughput: 0: 6257.6. Samples: 8222400. Policy #0 lag: (min: 0.0, avg: 11.8, max: 27.0)
[2023-02-25 12:40:47,186][2408954] Avg episode reward: [(0, '0.252')]
[2023-02-25 12:40:48,408][2409468] DAMAGECOUNT value on done: 725.0
[2023-02-25 12:40:48,409][2409468] Sum rewards: -2.017, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.556', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'ARMOR': '0.040', 'AMMO3': '0.070', 'AMMO4': '0.085', 'HITCOUNT': '0.110', 'DAMAGECOUNT': '0.267', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'weapon4': '0.622', 'FRAGCOUNT': '1.000', 'weapon2': '1.028', 'weapon3': '1.290'}
[2023-02-25 12:40:48,691][2409080] DAMAGECOUNT value on done: 1412.0
[2023-02-25 12:40:48,692][2409080] Sum rewards: 0.286, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.470', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'ARMOR': '0.024', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'weapon4': '0.250', 'HITCOUNT': '0.370', 'WEAPON3': '0.800', 'weapon2': '1.324', 'DAMAGECOUNT': '1.395', 'weapon3': '1.754', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:40:48,768][2409074] Updated weights for policy 0, policy_version 8031 (0.0012)
[2023-02-25 12:40:49,706][2409074] Updated weights for policy 0, policy_version 8041 (0.0012)
[2023-02-25 12:40:50,489][2409547] DAMAGECOUNT value on done: 925.0
[2023-02-25 12:40:50,490][2409547] Sum rewards: -0.980, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.620', 'AMMO5': '0.003', 'ARMOR': '0.032', 'AMMO2': '0.038', 'WEAPON1': '0.040', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.086', 'AMMO4': '0.192', 'weapon4': '0.238', 'HITCOUNT': '0.240', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.747', 'weapon3': '1.274', 'weapon2': '1.552', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:40:52,036][2409074] Updated weights for policy 0, policy_version 8051 (0.0013)
[2023-02-25 12:40:52,186][2408954] Fps is (10 sec: 24170.3, 60 sec: 25053.9, 300 sec: 24839.8). Total num frames: 32976896. Throughput: 0: 6272.5. Samples: 8241444. Policy #0 lag: (min: 0.0, avg: 12.1, max: 26.0)
[2023-02-25 12:40:52,186][2408954] Avg episode reward: [(0, '0.239')]
[2023-02-25 12:40:52,831][2409468] DAMAGECOUNT value on done: 1126.0
[2023-02-25 12:40:52,832][2409468] Sum rewards: 0.856, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.090', 'AMMO2': '0.005', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO4': '0.025', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'weapon4': '0.214', 'HITCOUNT': '0.350', 'ARMOR': '0.436', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.218', 'weapon2': '1.262', 'weapon3': '1.906', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:40:53,070][2409080] DAMAGECOUNT value on done: 957.0
[2023-02-25 12:40:53,076][2409074] Updated weights for policy 0, policy_version 8061 (0.0013)
[2023-02-25 12:40:53,076][2409080] Sum rewards: -5.034, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.470', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.024', 'AMMO4': '0.036', 'weapon4': '0.044', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'ARMOR': '0.459', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.645', 'weapon3': '1.566', 'weapon2': '1.964'}
[2023-02-25 12:40:54,802][2409074] Updated weights for policy 0, policy_version 8071 (0.0012)
[2023-02-25 12:40:56,649][2409074] Updated weights for policy 0, policy_version 8081 (0.0014)
[2023-02-25 12:40:56,731][2409468] DAMAGECOUNT value on done: 1371.0
[2023-02-25 12:40:56,736][2409468] Sum rewards: 3.970, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.531', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'weapon5': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.150', 'weapon4': '0.188', 'WEAPON5': '0.200', 'ARMOR': '0.467', 'HITCOUNT': '0.620', 'WEAPON3': '0.850', 'weapon2': '1.640', 'weapon3': '1.804', 'DAMAGECOUNT': '2.640', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:40:56,987][2409080] DAMAGECOUNT value on done: 664.0
[2023-02-25 12:40:56,991][2409080] Sum rewards: 0.796, reward structure: {'DEATHCOUNT': '-4.500', 'ARMOR': '0.016', 'HEALTH': '0.032', 'AMMO2': '0.036', 'AMMO3': '0.059', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'AMMO4': '0.181', 'WEAPON3': '0.350', 'weapon4': '0.434', 'DAMAGECOUNT': '0.435', 'FRAGCOUNT': '1.000', 'weapon3': '1.196', 'weapon2': '1.336'}
[2023-02-25 12:40:57,186][2408954] Fps is (10 sec: 26623.9, 60 sec: 25258.7, 300 sec: 24978.7). Total num frames: 33132544. Throughput: 0: 6297.6. Samples: 8279940. Policy #0 lag: (min: 0.0, avg: 12.1, max: 26.0)
[2023-02-25 12:40:57,187][2408954] Avg episode reward: [(0, '0.241')]
[2023-02-25 12:40:57,719][2409074] Updated weights for policy 0, policy_version 8091 (0.0014)
[2023-02-25 12:40:59,946][2409074] Updated weights for policy 0, policy_version 8101 (0.0012)
[2023-02-25 12:41:00,822][2409074] Updated weights for policy 0, policy_version 8111 (0.0013)
[2023-02-25 12:41:00,965][2409468] DAMAGECOUNT value on done: 767.0
[2023-02-25 12:41:00,966][2409468] Sum rewards: -1.575, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.990', 'AMMO5': '0.010', 'weapon5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO3': '0.138', 'AMMO4': '0.153', 'HITCOUNT': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.386', 'ARMOR': '0.550', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.825', 'FRAGCOUNT': '1.000', 'weapon3': '1.416', 'weapon2': '1.622'}
[2023-02-25 12:41:02,186][2408954] Fps is (10 sec: 27033.3, 60 sec: 25258.6, 300 sec: 24937.0). Total num frames: 33247232. Throughput: 0: 6331.5. Samples: 8318616. Policy #0 lag: (min: 0.0, avg: 13.4, max: 24.0)
[2023-02-25 12:41:02,186][2408954] Avg episode reward: [(0, '0.246')]
[2023-02-25 12:41:02,774][2409074] Updated weights for policy 0, policy_version 8121 (0.0012)
[2023-02-25 12:41:04,315][2409074] Updated weights for policy 0, policy_version 8131 (0.0013)
[2023-02-25 12:41:04,865][2409468] DAMAGECOUNT value on done: 543.0
[2023-02-25 12:41:04,866][2409468] Sum rewards: 0.224, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.585', 'AMMO2': '0.006', 'AMMO3': '0.030', 'AMMO4': '0.031', 'weapon7': '0.054', 'HITCOUNT': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON3': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.210', 'DAMAGECOUNT': '0.261', 'weapon3': '0.590', 'weapon2': '0.696', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:41:05,715][2409074] Updated weights for policy 0, policy_version 8141 (0.0013)
[2023-02-25 12:41:07,186][2408954] Fps is (10 sec: 24166.5, 60 sec: 25531.8, 300 sec: 24909.3). Total num frames: 33374208. Throughput: 0: 6352.5. Samples: 8338296. Policy #0 lag: (min: 0.0, avg: 14.4, max: 34.0)
[2023-02-25 12:41:07,186][2408954] Avg episode reward: [(0, '0.283')]
[2023-02-25 12:41:07,767][2409074] Updated weights for policy 0, policy_version 8151 (0.0013)
[2023-02-25 12:41:08,820][2409074] Updated weights for policy 0, policy_version 8161 (0.0012)
[2023-02-25 12:41:10,982][2409074] Updated weights for policy 0, policy_version 8171 (0.0013)
[2023-02-25 12:41:12,186][2408954] Fps is (10 sec: 25395.8, 60 sec: 25053.9, 300 sec: 24950.9). Total num frames: 33501184. Throughput: 0: 6387.7. Samples: 8376948. Policy #0 lag: (min: 0.0, avg: 12.3, max: 26.0)
[2023-02-25 12:41:12,186][2408954] Avg episode reward: [(0, '0.283')]
[2023-02-25 12:41:12,352][2409074] Updated weights for policy 0, policy_version 8181 (0.0013)
[2023-02-25 12:41:13,851][2409074] Updated weights for policy 0, policy_version 8191 (0.0012)
[2023-02-25 12:41:15,299][2409074] Updated weights for policy 0, policy_version 8201 (0.0013)
[2023-02-25 12:41:16,812][2409074] Updated weights for policy 0, policy_version 8211 (0.0012)
[2023-02-25 12:41:17,186][2408954] Fps is (10 sec: 26214.4, 60 sec: 25463.6, 300 sec: 25020.3). Total num frames: 33636352. Throughput: 0: 6419.7. Samples: 8415492. Policy #0 lag: (min: 0.0, avg: 12.3, max: 26.0)
[2023-02-25 12:41:17,186][2408954] Avg episode reward: [(0, '0.283')]
[2023-02-25 12:41:18,860][2409074] Updated weights for policy 0, policy_version 8221 (0.0013)
[2023-02-25 12:41:20,346][2409074] Updated weights for policy 0, policy_version 8231 (0.0012)
[2023-02-25 12:41:22,040][2409074] Updated weights for policy 0, policy_version 8241 (0.0012)
[2023-02-25 12:41:22,186][2408954] Fps is (10 sec: 25804.7, 60 sec: 25600.0, 300 sec: 24992.6). Total num frames: 33759232. Throughput: 0: 6425.6. Samples: 8434476. Policy #0 lag: (min: 1.0, avg: 11.7, max: 27.0)
[2023-02-25 12:41:22,186][2408954] Avg episode reward: [(0, '0.283')]
[2023-02-25 12:41:23,448][2409074] Updated weights for policy 0, policy_version 8251 (0.0012)
[2023-02-25 12:41:24,974][2409074] Updated weights for policy 0, policy_version 8261 (0.0012)
[2023-02-25 12:41:26,653][2409074] Updated weights for policy 0, policy_version 8271 (0.0013)
[2023-02-25 12:41:27,186][2408954] Fps is (10 sec: 25395.0, 60 sec: 25531.7, 300 sec: 25006.4). Total num frames: 33890304. Throughput: 0: 6423.7. Samples: 8472900. Policy #0 lag: (min: 2.0, avg: 12.6, max: 26.0)
[2023-02-25 12:41:27,186][2408954] Avg episode reward: [(0, '0.283')]
[2023-02-25 12:41:28,229][2409074] Updated weights for policy 0, policy_version 8281 (0.0012)
[2023-02-25 12:41:29,898][2409074] Updated weights for policy 0, policy_version 8291 (0.0015)
[2023-02-25 12:41:31,671][2409074] Updated weights for policy 0, policy_version 8301 (0.0012)
[2023-02-25 12:41:32,186][2408954] Fps is (10 sec: 25395.2, 60 sec: 25531.7, 300 sec: 24992.6). Total num frames: 34013184. Throughput: 0: 6422.4. Samples: 8511408. Policy #0 lag: (min: 2.0, avg: 12.6, max: 26.0)
[2023-02-25 12:41:32,186][2408954] Avg episode reward: [(0, '0.283')]
[2023-02-25 12:41:32,947][2409074] Updated weights for policy 0, policy_version 8311 (0.0012)
[2023-02-25 12:41:34,532][2409074] Updated weights for policy 0, policy_version 8321 (0.0012)
[2023-02-25 12:41:36,249][2409074] Updated weights for policy 0, policy_version 8331 (0.0012)
[2023-02-25 12:41:37,186][2408954] Fps is (10 sec: 25804.9, 60 sec: 25804.8, 300 sec: 25062.0). Total num frames: 34148352. Throughput: 0: 6432.5. Samples: 8530908. Policy #0 lag: (min: 0.0, avg: 13.0, max: 30.0)
[2023-02-25 12:41:37,186][2408954] Avg episode reward: [(0, '0.283')]
[2023-02-25 12:41:37,745][2409074] Updated weights for policy 0, policy_version 8341 (0.0012)
[2023-02-25 12:41:39,615][2409074] Updated weights for policy 0, policy_version 8351 (0.0012)
[2023-02-25 12:41:40,899][2409074] Updated weights for policy 0, policy_version 8361 (0.0012)
[2023-02-25 12:41:42,186][2408954] Fps is (10 sec: 25394.9, 60 sec: 25532.4, 300 sec: 25034.3). Total num frames: 34267136. Throughput: 0: 6428.3. Samples: 8569212. Policy #0 lag: (min: 0.0, avg: 11.5, max: 27.0)
[2023-02-25 12:41:42,186][2408954] Avg episode reward: [(0, '0.283')]
[2023-02-25 12:41:42,761][2409074] Updated weights for policy 0, policy_version 8371 (0.0012)
[2023-02-25 12:41:43,521][2409033] Signal inference workers to stop experience collection... (1100 times)
[2023-02-25 12:41:43,530][2409033] Signal inference workers to resume experience collection... (1100 times)
[2023-02-25 12:41:43,552][2409074] InferenceWorker_p0-w0: stopping experience collection (1100 times)
[2023-02-25 12:41:43,552][2409074] InferenceWorker_p0-w0: resuming experience collection (1100 times)
[2023-02-25 12:41:44,469][2409074] Updated weights for policy 0, policy_version 8381 (0.0012)
[2023-02-25 12:41:46,166][2409074] Updated weights for policy 0, policy_version 8391 (0.0012)
[2023-02-25 12:41:47,186][2408954] Fps is (10 sec: 24166.4, 60 sec: 25395.2, 300 sec: 25006.4). Total num frames: 34390016. Throughput: 0: 6379.0. Samples: 8605668. Policy #0 lag: (min: 0.0, avg: 11.0, max: 26.0)
[2023-02-25 12:41:47,186][2408954] Avg episode reward: [(0, '0.283')]
[2023-02-25 12:41:47,749][2409074] Updated weights for policy 0, policy_version 8401 (0.0012)
[2023-02-25 12:41:49,320][2409074] Updated weights for policy 0, policy_version 8411 (0.0012)
[2023-02-25 12:41:51,240][2409074] Updated weights for policy 0, policy_version 8421 (0.0012)
[2023-02-25 12:41:52,186][2408954] Fps is (10 sec: 25395.4, 60 sec: 25736.6, 300 sec: 25034.2). Total num frames: 34521088. Throughput: 0: 6343.5. Samples: 8623752. Policy #0 lag: (min: 0.0, avg: 11.0, max: 26.0)
[2023-02-25 12:41:52,186][2408954] Avg episode reward: [(0, '0.283')]
[2023-02-25 12:41:52,970][2409074] Updated weights for policy 0, policy_version 8431 (0.0012)
[2023-02-25 12:41:54,615][2409074] Updated weights for policy 0, policy_version 8441 (0.0014)
[2023-02-25 12:41:56,024][2409074] Updated weights for policy 0, policy_version 8451 (0.0012)
[2023-02-25 12:41:57,186][2408954] Fps is (10 sec: 24985.6, 60 sec: 25122.1, 300 sec: 25020.3). Total num frames: 34639872. Throughput: 0: 6304.5. Samples: 8660652. Policy #0 lag: (min: 0.0, avg: 13.9, max: 29.0)
[2023-02-25 12:41:57,186][2408954] Avg episode reward: [(0, '0.283')]
[2023-02-25 12:41:58,070][2409074] Updated weights for policy 0, policy_version 8461 (0.0013)
[2023-02-25 12:41:59,229][2409074] Updated weights for policy 0, policy_version 8471 (0.0016)
[2023-02-25 12:42:01,063][2409074] Updated weights for policy 0, policy_version 8481 (0.0012)
[2023-02-25 12:42:02,186][2408954] Fps is (10 sec: 23346.4, 60 sec: 25122.1, 300 sec: 25034.2). Total num frames: 34754560. Throughput: 0: 6270.9. Samples: 8697684. Policy #0 lag: (min: 0.0, avg: 12.0, max: 25.0)
[2023-02-25 12:42:02,187][2408954] Avg episode reward: [(0, '0.283')]
[2023-02-25 12:42:02,708][2409074] Updated weights for policy 0, policy_version 8491 (0.0012)
[2023-02-25 12:42:04,327][2409074] Updated weights for policy 0, policy_version 8501 (0.0013)
[2023-02-25 12:42:06,141][2409074] Updated weights for policy 0, policy_version 8511 (0.0012)
[2023-02-25 12:42:07,186][2408954] Fps is (10 sec: 24576.0, 60 sec: 25190.4, 300 sec: 25048.1). Total num frames: 34885632. Throughput: 0: 6268.0. Samples: 8716536. Policy #0 lag: (min: 0.0, avg: 12.0, max: 25.0)
[2023-02-25 12:42:07,186][2408954] Avg episode reward: [(0, '0.283')]
[2023-02-25 12:42:07,888][2409074] Updated weights for policy 0, policy_version 8521 (0.0012)
[2023-02-25 12:42:09,515][2409074] Updated weights for policy 0, policy_version 8531 (0.0012)
[2023-02-25 12:42:10,764][2409074] Updated weights for policy 0, policy_version 8541 (0.0012)
[2023-02-25 12:42:12,186][2408954] Fps is (10 sec: 25396.0, 60 sec: 25122.1, 300 sec: 25075.9). Total num frames: 35008512. Throughput: 0: 6243.2. Samples: 8753844. Policy #0 lag: (min: 0.0, avg: 11.9, max: 27.0)
[2023-02-25 12:42:12,186][2408954] Avg episode reward: [(0, '0.283')]
[2023-02-25 12:42:12,832][2409074] Updated weights for policy 0, policy_version 8551 (0.0013)
[2023-02-25 12:42:14,212][2409074] Updated weights for policy 0, policy_version 8561 (0.0013)
[2023-02-25 12:42:16,188][2409074] Updated weights for policy 0, policy_version 8571 (0.0012)
[2023-02-25 12:42:17,186][2408954] Fps is (10 sec: 25394.9, 60 sec: 25053.8, 300 sec: 25089.7). Total num frames: 35139584. Throughput: 0: 6208.2. Samples: 8790780. Policy #0 lag: (min: 0.0, avg: 13.6, max: 34.0)
[2023-02-25 12:42:17,186][2408954] Avg episode reward: [(0, '0.283')]
[2023-02-25 12:42:17,191][2409033] Saving /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000008579_35139584.pth...
[2023-02-25 12:42:17,286][2409033] Removing /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000007108_29114368.pth
[2023-02-25 12:42:17,603][2409074] Updated weights for policy 0, policy_version 8581 (0.0012)
[2023-02-25 12:42:19,504][2409074] Updated weights for policy 0, policy_version 8591 (0.0013)
[2023-02-25 12:42:21,015][2409074] Updated weights for policy 0, policy_version 8601 (0.0012)
[2023-02-25 12:42:22,187][2408954] Fps is (10 sec: 25393.0, 60 sec: 25053.5, 300 sec: 25089.7). Total num frames: 35262464. Throughput: 0: 6184.2. Samples: 8809200. Policy #0 lag: (min: 0.0, avg: 13.3, max: 24.0)
[2023-02-25 12:42:22,187][2408954] Avg episode reward: [(0, '0.283')]
[2023-02-25 12:42:22,554][2409074] Updated weights for policy 0, policy_version 8611 (0.0013)
[2023-02-25 12:42:24,405][2409074] Updated weights for policy 0, policy_version 8621 (0.0013)
[2023-02-25 12:42:25,749][2409074] Updated weights for policy 0, policy_version 8631 (0.0019)
[2023-02-25 12:42:27,186][2408954] Fps is (10 sec: 24166.7, 60 sec: 24849.1, 300 sec: 25089.7). Total num frames: 35381248. Throughput: 0: 6154.1. Samples: 8846148. Policy #0 lag: (min: 0.0, avg: 13.3, max: 24.0)
[2023-02-25 12:42:27,186][2408954] Avg episode reward: [(0, '0.283')]
[2023-02-25 12:42:27,914][2409074] Updated weights for policy 0, policy_version 8641 (0.0012)
[2023-02-25 12:42:29,090][2409074] Updated weights for policy 0, policy_version 8651 (0.0012)
[2023-02-25 12:42:30,868][2409074] Updated weights for policy 0, policy_version 8661 (0.0021)
[2023-02-25 12:42:32,186][2408954] Fps is (10 sec: 24168.6, 60 sec: 24849.1, 300 sec: 25089.7). Total num frames: 35504128. Throughput: 0: 6178.4. Samples: 8883696. Policy #0 lag: (min: 0.0, avg: 12.5, max: 25.0)
[2023-02-25 12:42:32,186][2408954] Avg episode reward: [(0, '0.283')]
[2023-02-25 12:42:32,348][2409074] Updated weights for policy 0, policy_version 8671 (0.0012)
[2023-02-25 12:42:33,962][2409074] Updated weights for policy 0, policy_version 8681 (0.0012)
[2023-02-25 12:42:35,882][2409074] Updated weights for policy 0, policy_version 8691 (0.0013)
[2023-02-25 12:42:37,158][2409074] Updated weights for policy 0, policy_version 8701 (0.0012)
[2023-02-25 12:42:37,186][2408954] Fps is (10 sec: 25804.8, 60 sec: 24849.1, 300 sec: 25131.4). Total num frames: 35639296. Throughput: 0: 6209.1. Samples: 8903160. Policy #0 lag: (min: 2.0, avg: 14.3, max: 25.0)
[2023-02-25 12:42:37,186][2408954] Avg episode reward: [(0, '0.283')]
[2023-02-25 12:42:39,420][2409074] Updated weights for policy 0, policy_version 8711 (0.0012)
[2023-02-25 12:42:40,566][2409074] Updated weights for policy 0, policy_version 8721 (0.0012)
[2023-02-25 12:42:41,939][2409074] Updated weights for policy 0, policy_version 8731 (0.0012)
[2023-02-25 12:42:42,091][2409100] DAMAGECOUNT value on done: 1437.0
[2023-02-25 12:42:42,092][2409100] Sum rewards: -1.867, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.945', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.033', 'AMMO3': '0.079', 'WEAPON4': '0.150', 'HITCOUNT': '0.300', 'weapon4': '0.310', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.804', 'ARMOR': '0.915', 'FRAGCOUNT': '1.000', 'weapon3': '1.510', 'weapon2': '1.810'}
[2023-02-25 12:42:42,186][2408954] Fps is (10 sec: 26214.2, 60 sec: 24985.6, 300 sec: 25145.3). Total num frames: 35766272. Throughput: 0: 6240.3. Samples: 8941464. Policy #0 lag: (min: 2.0, avg: 14.3, max: 25.0)
[2023-02-25 12:42:42,186][2408954] Avg episode reward: [(0, '0.279')]
[2023-02-25 12:42:42,601][2409103] DAMAGECOUNT value on done: 993.0
[2023-02-25 12:42:42,602][2409103] Sum rewards: -2.497, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.999', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.017', 'ARMOR': '0.036', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.131', 'weapon4': '0.156', 'DAMAGECOUNT': '0.237', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.526', 'weapon3': '1.694'}
[2023-02-25 12:42:43,762][2409074] Updated weights for policy 0, policy_version 8741 (0.0013)
[2023-02-25 12:42:45,436][2409074] Updated weights for policy 0, policy_version 8751 (0.0012)
[2023-02-25 12:42:45,718][2409100] DAMAGECOUNT value on done: 1727.0
[2023-02-25 12:42:45,721][2409100] Sum rewards: 6.036, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.136', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon5': '0.040', 'WEAPON5': '0.050', 'WEAPON1': '0.050', 'AMMO3': '0.086', 'ARMOR': '0.416', 'HITCOUNT': '0.490', 'WEAPON3': '0.550', 'weapon3': '1.536', 'DAMAGECOUNT': '1.812', 'weapon2': '1.846', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:42:46,504][2409103] DAMAGECOUNT value on done: 1084.0
[2023-02-25 12:42:46,505][2409103] Sum rewards: 0.887, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.120', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.040', 'weapon4': '0.050', 'AMMO3': '0.072', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.310', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.885', 'FRAGCOUNT': '1.000', 'weapon3': '1.486', 'weapon2': '1.560'}
[2023-02-25 12:42:47,013][2409074] Updated weights for policy 0, policy_version 8761 (0.0012)
[2023-02-25 12:42:47,058][2409549] DAMAGECOUNT value on done: 1008.0
[2023-02-25 12:42:47,062][2409549] Sum rewards: -1.777, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.890', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.004', 'weapon5': '0.034', 'weapon7': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.208', 'HITCOUNT': '0.290', 'ARMOR': '0.456', 'weapon2': '0.722', 'DAMAGECOUNT': '0.753', 'WEAPON3': '0.800', 'weapon3': '1.482', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:42:47,186][2408954] Fps is (10 sec: 24985.5, 60 sec: 24985.6, 300 sec: 25145.3). Total num frames: 35889152. Throughput: 0: 6269.9. Samples: 8979828. Policy #0 lag: (min: 0.0, avg: 12.0, max: 26.0)
[2023-02-25 12:42:47,186][2408954] Avg episode reward: [(0, '0.337')]
[2023-02-25 12:42:48,546][2409074] Updated weights for policy 0, policy_version 8771 (0.0012)
[2023-02-25 12:42:48,702][2409102] DAMAGECOUNT value on done: 1465.0
[2023-02-25 12:42:48,706][2409102] Sum rewards: -1.291, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.670', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON4': '0.050', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'weapon4': '0.194', 'HITCOUNT': '0.410', 'ARMOR': '0.439', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.132', 'DAMAGECOUNT': '1.521', 'weapon2': '1.972'}
[2023-02-25 12:42:49,306][2409100] DAMAGECOUNT value on done: 767.0
[2023-02-25 12:42:49,308][2409100] Sum rewards: 0.343, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.770', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'ARMOR': '0.036', 'AMMO3': '0.094', 'AMMO4': '0.102', 'HITCOUNT': '0.190', 'WEAPON4': '0.250', 'weapon4': '0.306', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.585', 'weapon3': '1.148', 'weapon2': '1.152', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:42:49,980][2409074] Updated weights for policy 0, policy_version 8781 (0.0012)
[2023-02-25 12:42:50,324][2409103] DAMAGECOUNT value on done: 1243.0
[2023-02-25 12:42:50,327][2409103] Sum rewards: 0.607, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.011', 'AMMO4': '0.056', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'weapon4': '0.202', 'HITCOUNT': '0.250', 'HEALTH': '0.410', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.825', 'ARMOR': '0.840', 'weapon2': '1.354', 'weapon3': '1.420', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:42:50,839][2409549] DAMAGECOUNT value on done: 964.0
[2023-02-25 12:42:50,842][2409549] Sum rewards: 0.418, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.116', 'AMMO2': '0.029', 'WEAPON4': '0.050', 'AMMO3': '0.051', 'AMMO4': '0.143', 'weapon4': '0.184', 'WEAPON3': '0.300', 'HITCOUNT': '0.330', 'ARMOR': '0.501', 'weapon3': '0.964', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.020', 'weapon2': '1.962'}
[2023-02-25 12:42:51,764][2409074] Updated weights for policy 0, policy_version 8791 (0.0012)
[2023-02-25 12:42:51,943][2409485] DAMAGECOUNT value on done: 1073.0
[2023-02-25 12:42:52,186][2408954] Fps is (10 sec: 25395.1, 60 sec: 24985.6, 300 sec: 25131.4). Total num frames: 36020224. Throughput: 0: 6277.1. Samples: 8999004. Policy #0 lag: (min: 0.0, avg: 12.5, max: 26.0)
[2023-02-25 12:42:52,186][2408954] Avg episode reward: [(0, '0.257')]
[2023-02-25 12:42:52,226][2409101] DAMAGECOUNT value on done: 728.0
[2023-02-25 12:42:52,343][2409102] DAMAGECOUNT value on done: 1106.0
[2023-02-25 12:42:52,344][2409102] Sum rewards: 0.989, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.678', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'weapon4': '0.118', 'AMMO3': '0.145', 'HITCOUNT': '0.410', 'WEAPON3': '0.850', 'ARMOR': '0.943', 'DAMAGECOUNT': '1.341', 'weapon2': '1.400', 'weapon3': '1.796', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:42:52,840][2409100] DAMAGECOUNT value on done: 1160.0
[2023-02-25 12:42:52,841][2409100] Sum rewards: 3.221, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.230', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.056', 'weapon7': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.248', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.438', 'weapon2': '0.986', 'weapon3': '1.040', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:42:53,280][2409074] Updated weights for policy 0, policy_version 8801 (0.0012)
[2023-02-25 12:42:53,980][2409103] DAMAGECOUNT value on done: 936.0
[2023-02-25 12:42:53,981][2409103] Sum rewards: -0.319, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.788', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.010', 'weapon5': '0.010', 'WEAPON1': '0.040', 'AMMO3': '0.098', 'HITCOUNT': '0.200', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.424', 'weapon3': '1.512'}
[2023-02-25 12:42:55,049][2409074] Updated weights for policy 0, policy_version 8811 (0.0013)
[2023-02-25 12:42:55,642][2409485] DAMAGECOUNT value on done: 1706.0
[2023-02-25 12:42:55,645][2409485] Sum rewards: 4.723, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.573', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.134', 'HITCOUNT': '0.440', 'WEAPON3': '0.450', 'ARMOR': '0.995', 'weapon3': '1.152', 'DAMAGECOUNT': '1.785', 'weapon2': '1.810', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:42:55,867][2409549] DAMAGECOUNT value on done: 1320.0
[2023-02-25 12:42:55,869][2409549] Sum rewards: 1.207, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.690', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO3': '0.061', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.360', 'weapon4': '0.396', 'WEAPON3': '0.450', 'ARMOR': '0.912', 'weapon3': '0.978', 'DAMAGECOUNT': '1.092', 'weapon2': '1.934', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:42:56,240][2409102] DAMAGECOUNT value on done: 1191.0
[2023-02-25 12:42:56,318][2409596] DAMAGECOUNT value on done: 1672.0
[2023-02-25 12:42:56,320][2409596] Sum rewards: 2.683, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.440', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon5': '0.060', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'HITCOUNT': '0.340', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.332', 'weapon3': '1.464', 'weapon2': '1.764', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:42:56,384][2409597] DAMAGECOUNT value on done: 1281.0
[2023-02-25 12:42:56,387][2409597] Sum rewards: 4.031, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.546', 'AMMO5': '0.003', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.038', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.083', 'weapon4': '0.276', 'HITCOUNT': '0.430', 'ARMOR': '0.461', 'WEAPON3': '0.550', 'weapon2': '1.124', 'DAMAGECOUNT': '1.455', 'weapon3': '1.540', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:42:56,408][2409548] DAMAGECOUNT value on done: 1048.0
[2023-02-25 12:42:56,409][2409548] Sum rewards: -3.403, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.784', 'AMMO5': '0.009', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'weapon5': '0.020', 'weapon4': '0.046', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'AMMO3': '0.145', 'WEAPON5': '0.200', 'HITCOUNT': '0.410', 'WEAPON3': '0.950', 'ARMOR': '0.951', 'DAMAGECOUNT': '1.230', 'weapon2': '1.488', 'FRAGCOUNT': '2.000', 'weapon3': '2.062'}
[2023-02-25 12:42:56,496][2409100] DAMAGECOUNT value on done: 1746.0
[2023-02-25 12:42:56,499][2409100] Sum rewards: 5.299, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.118', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'WEAPON1': '0.010', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.152', 'WEAPON3': '0.550', 'HITCOUNT': '0.660', 'ARMOR': '1.405', 'weapon3': '1.522', 'weapon2': '1.782', 'DAMAGECOUNT': '2.211', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:42:56,621][2409074] Updated weights for policy 0, policy_version 8821 (0.0012)
[2023-02-25 12:42:57,155][2409101] DAMAGECOUNT value on done: 1196.0
[2023-02-25 12:42:57,158][2409101] Sum rewards: 1.110, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.400', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO3': '0.038', 'weapon7': '0.048', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.130', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'weapon3': '0.492', 'DAMAGECOUNT': '0.648', 'weapon2': '0.774', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:42:57,186][2408954] Fps is (10 sec: 26214.5, 60 sec: 25190.4, 300 sec: 25145.3). Total num frames: 36151296. Throughput: 0: 6299.2. Samples: 9037308. Policy #0 lag: (min: 0.0, avg: 12.5, max: 26.0)
[2023-02-25 12:42:57,187][2408954] Avg episode reward: [(0, '0.401')]
[2023-02-25 12:42:57,807][2409103] DAMAGECOUNT value on done: 1071.0
[2023-02-25 12:42:57,808][2409103] Sum rewards: 3.754, reward structure: {'DEATHCOUNT': '-5.250', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'weapon7': '0.056', 'AMMO3': '0.081', 'AMMO4': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HEALTH': '0.150', 'weapon4': '0.182', 'HITCOUNT': '0.300', 'WEAPON3': '0.500', 'weapon3': '1.206', 'weapon2': '1.484', 'DAMAGECOUNT': '1.581', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:42:57,975][2409074] Updated weights for policy 0, policy_version 8831 (0.0012)
[2023-02-25 12:42:58,125][2409565] DAMAGECOUNT value on done: 1025.0
[2023-02-25 12:42:58,126][2409565] Sum rewards: 1.528, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.144', 'AMMO5': '0.013', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.068', 'weapon5': '0.072', 'AMMO3': '0.091', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.360', 'HITCOUNT': '0.380', 'ARMOR': '0.444', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.137', 'weapon3': '1.310', 'weapon2': '1.414', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:42:58,312][2409406] DAMAGECOUNT value on done: 950.0
[2023-02-25 12:42:59,217][2409077] DAMAGECOUNT value on done: 1618.0
[2023-02-25 12:42:59,218][2409077] Sum rewards: 0.974, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.154', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.012', 'ARMOR': '0.028', 'WEAPON1': '0.040', 'AMMO4': '0.043', 'AMMO3': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'HITCOUNT': '0.310', 'WEAPON3': '0.400', 'weapon4': '0.406', 'weapon2': '1.084', 'DAMAGECOUNT': '1.185', 'weapon3': '1.254', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:42:59,505][2409373] DAMAGECOUNT value on done: 592.0
[2023-02-25 12:42:59,508][2409373] Sum rewards: -5.079, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.340', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'weapon5': '0.012', 'WEAPON1': '0.050', 'WEAPON5': '0.100', 'HITCOUNT': '0.130', 'AMMO3': '0.141', 'DAMAGECOUNT': '0.525', 'WEAPON3': '0.800', 'ARMOR': '1.405', 'weapon3': '1.648', 'weapon2': '1.982'}
[2023-02-25 12:42:59,612][2409485] DAMAGECOUNT value on done: 658.0
[2023-02-25 12:42:59,616][2409485] Sum rewards: -1.530, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.287', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.090', 'HITCOUNT': '0.190', 'WEAPON4': '0.400', 'WEAPON3': '0.500', 'ARMOR': '0.501', 'DAMAGECOUNT': '0.537', 'weapon4': '0.582', 'weapon3': '1.062', 'weapon2': '1.300', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:42:59,727][2409549] DAMAGECOUNT value on done: 902.0
[2023-02-25 12:42:59,730][2409549] Sum rewards: -1.105, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-2.080', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'AMMO3': '0.043', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'HITCOUNT': '0.120', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.478', 'ARMOR': '0.535', 'DAMAGECOUNT': '0.561', 'weapon3': '0.910', 'FRAGCOUNT': '1.000', 'weapon2': '1.556'}
[2023-02-25 12:42:59,872][2409074] Updated weights for policy 0, policy_version 8841 (0.0012)
[2023-02-25 12:42:59,945][2409596] DAMAGECOUNT value on done: 1595.0
[2023-02-25 12:42:59,948][2409596] Sum rewards: 1.294, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.280', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.011', 'ARMOR': '0.040', 'WEAPON4': '0.100', 'weapon5': '0.102', 'AMMO3': '0.110', 'WEAPON5': '0.150', 'weapon4': '0.214', 'HITCOUNT': '0.260', 'WEAPON3': '0.650', 'weapon2': '0.818', 'DAMAGECOUNT': '1.203', 'weapon3': '1.906', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:00,181][2409548] DAMAGECOUNT value on done: 1155.0
[2023-02-25 12:43:00,185][2409548] Sum rewards: -3.426, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.789', 'FRAGCOUNT': '0.000', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.080', 'AMMO3': '0.097', 'weapon5': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.320', 'weapon4': '0.450', 'WEAPON3': '0.700', 'ARMOR': '0.872', 'DAMAGECOUNT': '1.110', 'weapon3': '1.428', 'weapon2': '1.542'}
[2023-02-25 12:43:00,248][2409100] DAMAGECOUNT value on done: 1354.0
[2023-02-25 12:43:00,250][2409100] Sum rewards: 3.029, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.990', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO3': '0.041', 'AMMO4': '0.043', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'HITCOUNT': '0.310', 'WEAPON3': '0.400', 'ARMOR': '0.501', 'weapon4': '0.506', 'DAMAGECOUNT': '0.915', 'weapon3': '1.008', 'weapon2': '1.476', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:00,260][2409597] DAMAGECOUNT value on done: 1270.0
[2023-02-25 12:43:00,261][2409597] Sum rewards: 1.602, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.300', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'ARMOR': '0.048', 'AMMO4': '0.075', 'AMMO3': '0.085', 'HITCOUNT': '0.370', 'WEAPON4': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.696', 'weapon3': '1.046', 'DAMAGECOUNT': '1.155', 'weapon2': '1.502', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:00,495][2409102] DAMAGECOUNT value on done: 1521.0
[2023-02-25 12:43:00,496][2409102] Sum rewards: 1.362, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.894', 'AMMO2': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.048', 'AMMO3': '0.108', 'weapon5': '0.226', 'WEAPON5': '0.250', 'HITCOUNT': '0.330', 'WEAPON3': '0.650', 'ARMOR': '0.946', 'weapon3': '1.142', 'DAMAGECOUNT': '1.452', 'weapon2': '2.326', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:00,588][2409104] DAMAGECOUNT value on done: 1021.0
[2023-02-25 12:43:00,588][2409104] Sum rewards: -0.776, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.244', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'ARMOR': '0.060', 'AMMO3': '0.084', 'weapon5': '0.098', 'AMMO4': '0.101', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.270', 'weapon4': '0.540', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.837', 'FRAGCOUNT': '1.000', 'weapon2': '1.300', 'weapon3': '1.588'}
[2023-02-25 12:43:00,867][2409101] DAMAGECOUNT value on done: 1399.0
[2023-02-25 12:43:01,110][2409074] Updated weights for policy 0, policy_version 8851 (0.0012)
[2023-02-25 12:43:01,573][2409103] DAMAGECOUNT value on done: 1289.0
[2023-02-25 12:43:01,574][2409103] Sum rewards: 1.779, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.650', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'WEAPON4': '0.050', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'weapon4': '0.198', 'ARMOR': '0.400', 'HITCOUNT': '0.520', 'WEAPON3': '0.600', 'weapon3': '1.400', 'weapon2': '1.790', 'DAMAGECOUNT': '1.791', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:01,918][2409105] DAMAGECOUNT value on done: 1417.0
[2023-02-25 12:43:01,919][2409105] Sum rewards: -2.255, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.076', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO3': '0.097', 'WEAPON5': '0.150', 'weapon5': '0.152', 'HITCOUNT': '0.350', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.047', 'weapon2': '1.728', 'weapon3': '1.836'}
[2023-02-25 12:43:02,066][2409406] DAMAGECOUNT value on done: 1180.0
[2023-02-25 12:43:02,070][2409406] Sum rewards: 1.262, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.590', 'weapon7': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.007', 'WEAPON1': '0.030', 'AMMO4': '0.035', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.264', 'HITCOUNT': '0.300', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.885', 'weapon2': '1.078', 'weapon3': '1.358', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:02,186][2408954] Fps is (10 sec: 25805.2, 60 sec: 25395.4, 300 sec: 25131.4). Total num frames: 36278272. Throughput: 0: 6330.7. Samples: 9075660. Policy #0 lag: (min: 0.0, avg: 13.6, max: 31.0)
[2023-02-25 12:43:02,186][2408954] Avg episode reward: [(0, '0.282')]
[2023-02-25 12:43:02,352][2409565] DAMAGECOUNT value on done: 1167.0
[2023-02-25 12:43:02,904][2409077] DAMAGECOUNT value on done: 1149.0
[2023-02-25 12:43:02,905][2409077] Sum rewards: -1.689, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.564', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon5': '0.024', 'AMMO3': '0.115', 'AMMO4': '0.119', 'WEAPON5': '0.200', 'HITCOUNT': '0.330', 'WEAPON4': '0.400', 'weapon4': '0.508', 'WEAPON3': '0.700', 'ARMOR': '0.873', 'DAMAGECOUNT': '0.993', 'weapon2': '1.292', 'weapon3': '1.772', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:02,907][2409389] DAMAGECOUNT value on done: 1128.0
[2023-02-25 12:43:02,910][2409389] Sum rewards: 2.153, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.246', 'AMMO2': '0.014', 'AMMO5': '0.016', 'WEAPON1': '0.030', 'AMMO3': '0.067', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'weapon5': '0.136', 'HITCOUNT': '0.170', 'WEAPON5': '0.250', 'weapon4': '0.386', 'WEAPON3': '0.400', 'ARMOR': '0.481', 'DAMAGECOUNT': '0.825', 'weapon3': '1.044', 'weapon2': '1.410', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:02,920][2409074] Updated weights for policy 0, policy_version 8861 (0.0012)
[2023-02-25 12:43:03,157][2409373] DAMAGECOUNT value on done: 1093.0
[2023-02-25 12:43:03,158][2409373] Sum rewards: 4.549, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.192', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'weapon5': '0.062', 'AMMO3': '0.063', 'weapon4': '0.136', 'HITCOUNT': '0.310', 'WEAPON3': '0.350', 'ARMOR': '0.408', 'DAMAGECOUNT': '0.882', 'weapon3': '1.186', 'weapon2': '1.668', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:03,211][2409485] DAMAGECOUNT value on done: 1415.0
[2023-02-25 12:43:03,212][2409485] Sum rewards: 2.423, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.780', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.052', 'AMMO3': '0.088', 'weapon4': '0.188', 'WEAPON5': '0.250', 'HITCOUNT': '0.360', 'ARMOR': '0.463', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.308', 'weapon3': '1.470', 'weapon2': '1.596', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:43:03,280][2409549] DAMAGECOUNT value on done: 1069.0
[2023-02-25 12:43:03,538][2409596] DAMAGECOUNT value on done: 997.0
[2023-02-25 12:43:03,539][2409596] Sum rewards: 0.967, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.369', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO3': '0.068', 'weapon5': '0.122', 'WEAPON5': '0.150', 'HITCOUNT': '0.260', 'WEAPON3': '0.450', 'ARMOR': '0.490', 'weapon3': '1.048', 'DAMAGECOUNT': '1.089', 'weapon2': '1.636', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:03,761][2409548] DAMAGECOUNT value on done: 1710.0
[2023-02-25 12:43:03,762][2409548] Sum rewards: -2.568, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.262', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.012', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.099', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'weapon4': '0.210', 'HITCOUNT': '0.290', 'WEAPON3': '0.850', 'ARMOR': '0.867', 'DAMAGECOUNT': '0.876', 'FRAGCOUNT': '1.000', 'weapon2': '1.346', 'weapon3': '1.780'}
[2023-02-25 12:43:03,804][2409100] DAMAGECOUNT value on done: 942.0
[2023-02-25 12:43:03,805][2409100] Sum rewards: 0.790, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.207', 'AMMO5': '0.004', 'AMMO2': '0.007', 'weapon5': '0.026', 'AMMO4': '0.033', 'ARMOR': '0.036', 'AMMO3': '0.072', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.290', 'weapon4': '0.378', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.963', 'weapon3': '1.214', 'weapon2': '1.424', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:04,184][2409597] DAMAGECOUNT value on done: 1013.0
[2023-02-25 12:43:04,187][2409597] Sum rewards: 2.313, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.394', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'weapon4': '0.240', 'HITCOUNT': '0.290', 'ARMOR': '0.436', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.852', 'weapon2': '1.254', 'weapon3': '1.330', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:04,257][2409104] DAMAGECOUNT value on done: 1151.0
[2023-02-25 12:43:04,257][2409104] Sum rewards: 0.042, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.220', 'AMMO5': '0.013', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.071', 'AMMO3': '0.094', 'weapon5': '0.096', 'weapon4': '0.290', 'WEAPON5': '0.300', 'HITCOUNT': '0.370', 'WEAPON4': '0.400', 'ARMOR': '0.472', 'WEAPON3': '0.700', 'weapon2': '1.398', 'weapon3': '1.736', 'DAMAGECOUNT': '1.788', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:04,446][2409074] Updated weights for policy 0, policy_version 8871 (0.0013)
[2023-02-25 12:43:04,652][2409101] DAMAGECOUNT value on done: 1194.0
[2023-02-25 12:43:04,653][2409101] Sum rewards: 1.152, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.910', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.052', 'weapon4': '0.068', 'weapon5': '0.076', 'HITCOUNT': '0.290', 'WEAPON3': '0.400', 'ARMOR': '0.935', 'DAMAGECOUNT': '1.095', 'weapon3': '1.194', 'weapon2': '1.844', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:04,754][2409102] DAMAGECOUNT value on done: 805.0
[2023-02-25 12:43:04,757][2409102] Sum rewards: 1.686, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.502', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.023', 'WEAPON1': '0.040', 'weapon5': '0.058', 'AMMO3': '0.068', 'WEAPON5': '0.100', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.248', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.555', 'weapon3': '0.886', 'ARMOR': '0.916', 'weapon2': '1.584', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:05,077][2409407] DAMAGECOUNT value on done: 1131.0
[2023-02-25 12:43:05,077][2409407] Sum rewards: -0.146, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.894', 'AMMO2': '0.021', 'AMMO3': '0.082', 'AMMO4': '0.104', 'HITCOUNT': '0.290', 'WEAPON4': '0.350', 'WEAPON3': '0.500', 'weapon4': '0.552', 'ARMOR': '0.579', 'DAMAGECOUNT': '0.906', 'weapon3': '1.342', 'weapon2': '1.522', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:05,137][2409103] DAMAGECOUNT value on done: 1045.0
[2023-02-25 12:43:05,519][2409105] DAMAGECOUNT value on done: 1145.0
[2023-02-25 12:43:05,521][2409105] Sum rewards: 2.068, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.070', 'AMMO5': '0.008', 'AMMO2': '0.008', 'weapon5': '0.016', 'AMMO4': '0.039', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.404', 'HITCOUNT': '0.450', 'ARMOR': '0.455', 'WEAPON3': '0.600', 'weapon2': '1.276', 'DAMAGECOUNT': '1.377', 'weapon3': '1.708', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:05,708][2409033] Signal inference workers to stop experience collection... (1150 times)
[2023-02-25 12:43:05,719][2409033] Signal inference workers to resume experience collection... (1150 times)
[2023-02-25 12:43:05,739][2409074] InferenceWorker_p0-w0: stopping experience collection (1150 times)
[2023-02-25 12:43:05,743][2409074] InferenceWorker_p0-w0: resuming experience collection (1150 times)
[2023-02-25 12:43:05,829][2409406] DAMAGECOUNT value on done: 1050.0
[2023-02-25 12:43:06,009][2409074] Updated weights for policy 0, policy_version 8881 (0.0012)
[2023-02-25 12:43:06,075][2409405] DAMAGECOUNT value on done: 1698.0
[2023-02-25 12:43:06,075][2409405] Sum rewards: 0.417, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.399', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'WEAPON4': '0.050', 'AMMO3': '0.082', 'WEAPON5': '0.150', 'weapon5': '0.184', 'weapon4': '0.196', 'HITCOUNT': '0.370', 'ARMOR': '0.474', 'WEAPON3': '0.500', 'weapon3': '1.522', 'DAMAGECOUNT': '1.587', 'weapon2': '1.678', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:06,367][2409565] DAMAGECOUNT value on done: 811.0
[2023-02-25 12:43:06,368][2409565] Sum rewards: 0.902, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.724', 'AMMO2': '0.004', 'AMMO4': '0.021', 'ARMOR': '0.028', 'AMMO3': '0.039', 'weapon7': '0.092', 'HITCOUNT': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'DAMAGECOUNT': '0.270', 'weapon4': '0.404', 'weapon2': '0.498', 'weapon3': '0.530', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:43:06,665][2409389] DAMAGECOUNT value on done: 1019.0
[2023-02-25 12:43:06,666][2409389] Sum rewards: -0.202, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.988', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.018', 'weapon5': '0.030', 'WEAPON5': '0.050', 'weapon4': '0.070', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'HITCOUNT': '0.280', 'ARMOR': '0.424', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.080', 'weapon3': '1.422', 'FRAGCOUNT': '2.000', 'weapon2': '2.060'}
[2023-02-25 12:43:06,688][2409077] DAMAGECOUNT value on done: 1428.0
[2023-02-25 12:43:06,689][2409077] Sum rewards: 5.133, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.288', 'AMMO2': '0.004', 'AMMO5': '0.015', 'AMMO4': '0.019', 'weapon7': '0.030', 'AMMO3': '0.080', 'weapon5': '0.116', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.270', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.365', 'weapon3': '1.754', 'weapon2': '1.798', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:06,807][2409485] DAMAGECOUNT value on done: 1055.0
[2023-02-25 12:43:06,808][2409485] Sum rewards: 2.276, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.140', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.029', 'WEAPON5': '0.050', 'AMMO3': '0.090', 'WEAPON4': '0.250', 'HITCOUNT': '0.330', 'weapon4': '0.430', 'WEAPON3': '0.650', 'ARMOR': '0.978', 'DAMAGECOUNT': '1.041', 'weapon3': '1.452', 'weapon2': '1.852', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:06,926][2409076] DAMAGECOUNT value on done: 1387.0
[2023-02-25 12:43:06,957][2409373] DAMAGECOUNT value on done: 1360.0
[2023-02-25 12:43:06,958][2409373] Sum rewards: -1.979, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.582', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'weapon5': '0.026', 'AMMO3': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.094', 'weapon4': '0.116', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'WEAPON3': '0.250', 'DAMAGECOUNT': '0.726', 'weapon3': '0.814', 'weapon2': '1.810'}
[2023-02-25 12:43:07,186][2408954] Fps is (10 sec: 24984.7, 60 sec: 25258.5, 300 sec: 25145.3). Total num frames: 36401152. Throughput: 0: 6354.7. Samples: 9095160. Policy #0 lag: (min: 0.0, avg: 13.9, max: 34.0)
[2023-02-25 12:43:07,187][2408954] Avg episode reward: [(0, '0.418')]
[2023-02-25 12:43:07,235][2409866] DAMAGECOUNT value on done: 1256.0
[2023-02-25 12:43:07,235][2409866] Sum rewards: 5.282, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.410', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'WEAPON1': '0.020', 'AMMO3': '0.044', 'WEAPON3': '0.350', 'HITCOUNT': '0.350', 'weapon3': '0.914', 'weapon2': '0.988', 'DAMAGECOUNT': '1.290', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:07,244][2409549] DAMAGECOUNT value on done: 1134.0
[2023-02-25 12:43:07,245][2409549] Sum rewards: -3.076, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.538', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'weapon5': '0.060', 'weapon4': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'HITCOUNT': '0.130', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.795', 'ARMOR': '0.855', 'weapon3': '1.196', 'weapon2': '2.110'}
[2023-02-25 12:43:07,698][2409596] DAMAGECOUNT value on done: 836.0
[2023-02-25 12:43:07,722][2409355] DAMAGECOUNT value on done: 1049.0
[2023-02-25 12:43:07,723][2409355] Sum rewards: 0.740, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.668', 'AMMO5': '0.003', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'weapon4': '0.010', 'AMMO4': '0.013', 'WEAPON5': '0.050', 'weapon7': '0.052', 'AMMO3': '0.066', 'weapon5': '0.080', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.230', 'ARMOR': '0.424', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.885', 'FRAGCOUNT': '1.000', 'weapon3': '1.146', 'weapon2': '1.696'}
[2023-02-25 12:43:07,756][2409074] Updated weights for policy 0, policy_version 8891 (0.0013)
[2023-02-25 12:43:08,012][2409548] DAMAGECOUNT value on done: 1164.0
[2023-02-25 12:43:08,013][2409548] Sum rewards: 0.773, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.366', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.069', 'AMMO4': '0.120', 'weapon4': '0.136', 'HITCOUNT': '0.180', 'ARMOR': '0.430', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.627', 'weapon3': '1.278', 'weapon2': '1.670', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:08,014][2409597] DAMAGECOUNT value on done: 1279.0
[2023-02-25 12:43:08,017][2409597] Sum rewards: -0.605, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.671', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.084', 'weapon4': '0.192', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'ARMOR': '0.476', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.744', 'FRAGCOUNT': '1.000', 'weapon3': '1.258', 'weapon2': '1.320'}
[2023-02-25 12:43:08,031][2409100] DAMAGECOUNT value on done: 1603.0
[2023-02-25 12:43:08,032][2409100] Sum rewards: 1.173, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.875', 'AMMO2': '0.007', 'AMMO5': '0.007', 'weapon5': '0.020', 'AMMO4': '0.036', 'WEAPON5': '0.100', 'AMMO3': '0.124', 'WEAPON4': '0.200', 'weapon4': '0.292', 'HITCOUNT': '0.390', 'ARMOR': '0.515', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.332', 'weapon3': '1.462', 'weapon2': '1.912', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:08,364][2409104] DAMAGECOUNT value on done: 2301.0
[2023-02-25 12:43:08,365][2409104] Sum rewards: 5.718, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.400', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon5': '0.080', 'AMMO4': '0.104', 'AMMO3': '0.126', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'HITCOUNT': '0.650', 'WEAPON3': '0.900', 'weapon2': '1.662', 'weapon3': '1.768', 'DAMAGECOUNT': '3.429', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:43:08,408][2409101] DAMAGECOUNT value on done: 1324.0
[2023-02-25 12:43:08,411][2409101] Sum rewards: 1.365, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.665', 'AMMO5': '0.009', 'AMMO2': '0.012', 'weapon5': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.061', 'AMMO3': '0.098', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'HITCOUNT': '0.360', 'ARMOR': '0.408', 'weapon4': '0.638', 'WEAPON3': '0.650', 'weapon2': '1.196', 'DAMAGECOUNT': '1.239', 'weapon3': '1.520', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:08,691][2409103] DAMAGECOUNT value on done: 1010.0
[2023-02-25 12:43:08,692][2409103] Sum rewards: 3.861, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.619', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'WEAPON1': '0.020', 'ARMOR': '0.043', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.194', 'HITCOUNT': '0.350', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.269', 'weapon3': '1.360', 'weapon2': '1.388', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:08,896][2409102] DAMAGECOUNT value on done: 1029.0
[2023-02-25 12:43:08,897][2409102] Sum rewards: 1.087, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.138', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.040', 'AMMO3': '0.104', 'WEAPON4': '0.150', 'weapon4': '0.318', 'HITCOUNT': '0.380', 'ARMOR': '0.456', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.278', 'weapon3': '1.528', 'weapon2': '1.792', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:08,933][2409407] DAMAGECOUNT value on done: 1314.0
[2023-02-25 12:43:08,933][2409407] Sum rewards: 4.809, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.310', 'AMMO5': '0.003', 'ARMOR': '0.020', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'weapon4': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.068', 'weapon5': '0.082', 'AMMO4': '0.140', 'WEAPON3': '0.450', 'HITCOUNT': '0.510', 'weapon3': '1.336', 'weapon2': '1.746', 'DAMAGECOUNT': '1.812', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:09,213][2409075] DAMAGECOUNT value on done: 1148.0
[2023-02-25 12:43:09,214][2409075] Sum rewards: -0.730, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.450', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.100', 'WEAPON4': '0.300', 'HITCOUNT': '0.370', 'weapon4': '0.642', 'WEAPON3': '0.750', 'ARMOR': '0.913', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.104', 'weapon3': '1.292', 'weapon2': '1.590'}
[2023-02-25 12:43:09,363][2409105] DAMAGECOUNT value on done: 1463.0
[2023-02-25 12:43:09,364][2409105] Sum rewards: 5.215, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.682', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO5': '0.003', 'weapon5': '0.014', 'WEAPON5': '0.050', 'AMMO3': '0.087', 'HITCOUNT': '0.420', 'WEAPON3': '0.500', 'weapon2': '0.970', 'weapon3': '1.306', 'DAMAGECOUNT': '1.347', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:43:09,378][2409406] DAMAGECOUNT value on done: 1409.0
[2023-02-25 12:43:09,379][2409406] Sum rewards: 2.636, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.762', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.023', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.094', 'weapon4': '0.200', 'HITCOUNT': '0.210', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.774', 'weapon2': '1.288', 'weapon3': '1.604', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:09,420][2409074] Updated weights for policy 0, policy_version 8901 (0.0012)
[2023-02-25 12:43:09,779][2409405] DAMAGECOUNT value on done: 1148.0
[2023-02-25 12:43:09,780][2409405] Sum rewards: 3.304, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.540', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.076', 'WEAPON4': '0.100', 'HITCOUNT': '0.210', 'weapon4': '0.294', 'WEAPON3': '0.400', 'ARMOR': '0.412', 'DAMAGECOUNT': '0.825', 'weapon3': '1.316', 'weapon2': '1.586', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:10,238][2409077] DAMAGECOUNT value on done: 1043.0
[2023-02-25 12:43:10,241][2409077] Sum rewards: 0.506, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.624', 'weapon4': '0.002', 'AMMO2': '0.016', 'AMMO4': '0.077', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'HITCOUNT': '0.260', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.885', 'weapon2': '1.764', 'weapon3': '1.830', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:10,275][2409389] DAMAGECOUNT value on done: 1340.0
[2023-02-25 12:43:10,276][2409389] Sum rewards: 0.956, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.366', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.041', 'AMMO3': '0.080', 'weapon5': '0.126', 'WEAPON5': '0.150', 'AMMO4': '0.205', 'WEAPON4': '0.350', 'HITCOUNT': '0.410', 'weapon4': '0.532', 'WEAPON3': '0.550', 'ARMOR': '0.895', 'weapon3': '1.388', 'weapon2': '1.644', 'DAMAGECOUNT': '1.686', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:10,379][2409485] DAMAGECOUNT value on done: 1661.0
[2023-02-25 12:43:10,380][2409485] Sum rewards: 0.308, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.472', 'AMMO2': '0.017', 'AMMO3': '0.050', 'AMMO4': '0.083', 'HITCOUNT': '0.190', 'WEAPON4': '0.300', 'WEAPON3': '0.300', 'ARMOR': '0.484', 'weapon4': '0.602', 'DAMAGECOUNT': '0.636', 'weapon3': '0.938', 'FRAGCOUNT': '1.000', 'weapon2': '1.430'}
[2023-02-25 12:43:10,542][2409565] DAMAGECOUNT value on done: 1571.0
[2023-02-25 12:43:10,543][2409565] Sum rewards: 9.914, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.114', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO3': '0.082', 'AMMO4': '0.095', 'weapon5': '0.122', 'WEAPON5': '0.150', 'ARMOR': '0.400', 'HITCOUNT': '0.530', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.746', 'weapon2': '1.778', 'weapon3': '1.800', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:43:10,685][2409076] DAMAGECOUNT value on done: 1133.0
[2023-02-25 12:43:10,687][2409076] Sum rewards: 1.983, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon7': '0.048', 'weapon5': '0.048', 'AMMO3': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.130', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'HEALTH': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'ARMOR': '0.436', 'weapon4': '0.572', 'weapon3': '0.666', 'DAMAGECOUNT': '0.711', 'weapon2': '0.920', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:10,706][2409373] DAMAGECOUNT value on done: 1313.0
[2023-02-25 12:43:10,707][2409373] Sum rewards: -1.749, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.950', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.115', 'WEAPON4': '0.200', 'HITCOUNT': '0.220', 'weapon4': '0.260', 'ARMOR': '0.480', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.705', 'weapon3': '1.250', 'weapon2': '1.426', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:10,913][2409866] DAMAGECOUNT value on done: 1318.0
[2023-02-25 12:43:10,918][2409866] Sum rewards: 3.304, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'AMMO3': '0.044', 'WEAPON5': '0.050', 'weapon5': '0.076', 'AMMO4': '0.110', 'HITCOUNT': '0.150', 'WEAPON3': '0.250', 'ARMOR': '0.400', 'HEALTH': '0.601', 'weapon3': '0.736', 'DAMAGECOUNT': '0.744', 'weapon2': '1.858', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:11,194][2409074] Updated weights for policy 0, policy_version 8911 (0.0012)
[2023-02-25 12:43:11,404][2409355] DAMAGECOUNT value on done: 1100.0
[2023-02-25 12:43:11,405][2409355] Sum rewards: 0.091, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.206', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'AMMO3': '0.088', 'AMMO4': '0.146', 'WEAPON4': '0.300', 'weapon4': '0.420', 'HITCOUNT': '0.480', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'ARMOR': '1.252', 'weapon3': '1.348', 'weapon2': '1.482', 'DAMAGECOUNT': '1.539'}
[2023-02-25 12:43:11,570][2409596] DAMAGECOUNT value on done: 1208.0
[2023-02-25 12:43:11,570][2409596] Sum rewards: -0.563, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.218', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO4': '0.029', 'AMMO3': '0.092', 'WEAPON4': '0.200', 'HITCOUNT': '0.230', 'weapon4': '0.332', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.768', 'weapon3': '0.928', 'weapon2': '1.548', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:11,581][2409597] DAMAGECOUNT value on done: 1907.0
[2023-02-25 12:43:11,585][2409597] Sum rewards: 5.064, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.497', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.029', 'AMMO3': '0.069', 'weapon5': '0.128', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.460', 'WEAPON3': '0.500', 'ARMOR': '0.542', 'weapon4': '0.588', 'weapon3': '1.148', 'weapon2': '1.304', 'DAMAGECOUNT': '2.562', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:11,655][2409549] DAMAGECOUNT value on done: 1250.0
[2023-02-25 12:43:11,656][2409549] Sum rewards: 3.029, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.012', 'AMMO3': '0.030', 'AMMO4': '0.060', 'weapon5': '0.062', 'weapon7': '0.072', 'weapon4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.150', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.465', 'ARMOR': '0.495', 'weapon3': '0.704', 'FRAGCOUNT': '1.000', 'weapon2': '1.298'}
[2023-02-25 12:43:11,840][2409100] DAMAGECOUNT value on done: 1468.0
[2023-02-25 12:43:11,850][2409100] Sum rewards: 8.398, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'AMMO4': '0.119', 'weapon4': '0.374', 'WEAPON3': '0.450', 'HITCOUNT': '0.720', 'ARMOR': '0.828', 'weapon3': '1.222', 'weapon2': '1.688', 'DAMAGECOUNT': '2.535', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:43:11,873][2409548] DAMAGECOUNT value on done: 1322.0
[2023-02-25 12:43:11,874][2409548] Sum rewards: 0.229, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.264', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.057', 'weapon5': '0.080', 'AMMO3': '0.087', 'WEAPON5': '0.200', 'HITCOUNT': '0.210', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.735', 'FRAGCOUNT': '1.000', 'weapon2': '1.496', 'weapon3': '1.578'}
[2023-02-25 12:43:12,186][2408954] Fps is (10 sec: 25394.9, 60 sec: 25395.2, 300 sec: 25159.2). Total num frames: 36532224. Throughput: 0: 6382.1. Samples: 9133344. Policy #0 lag: (min: 0.0, avg: 13.9, max: 34.0)
[2023-02-25 12:43:12,186][2408954] Avg episode reward: [(0, '0.820')]
[2023-02-25 12:43:12,401][2409104] DAMAGECOUNT value on done: 926.0
[2023-02-25 12:43:12,401][2409104] Sum rewards: 1.457, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.095', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'AMMO3': '0.042', 'ARMOR': '0.068', 'AMMO4': '0.136', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'WEAPON3': '0.300', 'weapon4': '0.356', 'DAMAGECOUNT': '0.570', 'weapon3': '0.934', 'weapon2': '1.218', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:12,587][2409074] Updated weights for policy 0, policy_version 8921 (0.0012)
[2023-02-25 12:43:12,601][2409407] DAMAGECOUNT value on done: 1824.0
[2023-02-25 12:43:12,601][2409407] Sum rewards: -2.257, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.066', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.040', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.169', 'WEAPON4': '0.250', 'WEAPON3': '0.250', 'HITCOUNT': '0.430', 'weapon4': '0.582', 'weapon3': '0.930', 'DAMAGECOUNT': '1.380', 'weapon2': '1.642'}
[2023-02-25 12:43:12,646][2409102] DAMAGECOUNT value on done: 1131.0
[2023-02-25 12:43:12,647][2409102] Sum rewards: 2.522, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.490', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'AMMO3': '0.070', 'weapon5': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'ARMOR': '0.410', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.768', 'weapon3': '1.428', 'weapon2': '1.638', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:12,756][2409103] DAMAGECOUNT value on done: 929.0
[2023-02-25 12:43:12,767][2409103] Sum rewards: -2.837, reward structure: {'DEATHCOUNT': '-5.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.441', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'ARMOR': '0.064', 'AMMO3': '0.067', 'weapon7': '0.088', 'HITCOUNT': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.200', 'DAMAGECOUNT': '0.321', 'WEAPON3': '0.400', 'weapon3': '1.170', 'weapon2': '1.266'}
[2023-02-25 12:43:12,813][2409101] DAMAGECOUNT value on done: 1741.0
[2023-02-25 12:43:12,853][2409469] DAMAGECOUNT value on done: 1148.0
[2023-02-25 12:43:12,854][2409469] Sum rewards: 0.088, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.554', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon5': '0.008', 'AMMO4': '0.023', 'AMMO3': '0.071', 'WEAPON5': '0.100', 'HITCOUNT': '0.370', 'ARMOR': '0.484', 'WEAPON3': '0.550', 'weapon3': '1.232', 'DAMAGECOUNT': '1.317', 'weapon2': '2.228', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:43:12,883][2409075] DAMAGECOUNT value on done: 1752.0
[2023-02-25 12:43:12,885][2409075] Sum rewards: 2.616, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.422', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'AMMO3': '0.121', 'weapon5': '0.130', 'WEAPON5': '0.150', 'weapon4': '0.172', 'HITCOUNT': '0.410', 'WEAPON3': '0.750', 'weapon2': '1.424', 'DAMAGECOUNT': '1.731', 'weapon3': '2.016', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:43:13,001][2409105] DAMAGECOUNT value on done: 1564.0
[2023-02-25 12:43:13,002][2409105] Sum rewards: 4.725, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.547', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.036', 'ARMOR': '0.060', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'HITCOUNT': '0.470', 'WEAPON3': '0.600', 'weapon3': '1.050', 'DAMAGECOUNT': '1.680', 'weapon2': '1.894', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:43:13,094][2409406] DAMAGECOUNT value on done: 1487.0
[2023-02-25 12:43:13,094][2409406] Sum rewards: 1.240, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.624', 'AMMO2': '0.003', 'AMMO4': '0.016', 'WEAPON1': '0.020', 'ARMOR': '0.056', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'weapon4': '0.154', 'HITCOUNT': '0.320', 'WEAPON3': '0.350', 'weapon3': '0.952', 'DAMAGECOUNT': '1.200', 'weapon2': '2.374', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:13,715][2409405] DAMAGECOUNT value on done: 1076.0
[2023-02-25 12:43:13,716][2409405] Sum rewards: -1.344, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.910', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.028', 'weapon7': '0.070', 'AMMO3': '0.081', 'weapon5': '0.108', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'HITCOUNT': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.525', 'weapon4': '0.532', 'WEAPON3': '0.550', 'weapon2': '1.324', 'weapon3': '1.490', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:13,945][2409074] Updated weights for policy 0, policy_version 8931 (0.0012)
[2023-02-25 12:43:13,969][2409389] DAMAGECOUNT value on done: 1199.0
[2023-02-25 12:43:13,989][2409077] DAMAGECOUNT value on done: 1920.0
[2023-02-25 12:43:13,990][2409077] Sum rewards: 0.898, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.618', 'AMMO2': '0.001', 'AMMO4': '0.005', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'weapon5': '0.032', 'AMMO3': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.252', 'HITCOUNT': '0.380', 'ARMOR': '0.521', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.158', 'weapon3': '1.530', 'weapon2': '1.714', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:14,324][2409565] DAMAGECOUNT value on done: 1396.0
[2023-02-25 12:43:14,325][2409565] Sum rewards: -0.835, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.132', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.035', 'ARMOR': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'AMMO4': '0.177', 'HITCOUNT': '0.230', 'WEAPON4': '0.250', 'WEAPON3': '0.600', 'weapon4': '0.624', 'DAMAGECOUNT': '0.660', 'FRAGCOUNT': '1.000', 'weapon2': '1.224', 'weapon3': '1.718'}
[2023-02-25 12:43:14,481][2409078] DAMAGECOUNT value on done: 1290.0
[2023-02-25 12:43:14,484][2409078] Sum rewards: -1.719, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.356', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.011', 'WEAPON4': '0.050', 'AMMO3': '0.118', 'WEAPON5': '0.200', 'weapon5': '0.242', 'HITCOUNT': '0.380', 'ARMOR': '0.493', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.584', 'weapon2': '1.702', 'weapon3': '1.876'}
[2023-02-25 12:43:14,589][2409076] DAMAGECOUNT value on done: 1400.0
[2023-02-25 12:43:14,590][2409076] Sum rewards: -1.185, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.086', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'WEAPON4': '0.050', 'weapon5': '0.062', 'AMMO3': '0.068', 'WEAPON5': '0.100', 'HITCOUNT': '0.120', 'weapon4': '0.186', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.453', 'ARMOR': '0.507', 'FRAGCOUNT': '1.000', 'weapon3': '1.072', 'weapon2': '1.826'}
[2023-02-25 12:43:14,597][2409373] DAMAGECOUNT value on done: 1410.0
[2023-02-25 12:43:14,598][2409373] Sum rewards: 3.184, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.009', 'WEAPON1': '0.030', 'AMMO3': '0.090', 'weapon5': '0.134', 'WEAPON5': '0.250', 'HEALTH': '0.256', 'HITCOUNT': '0.290', 'ARMOR': '0.500', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.287', 'weapon2': '1.522', 'weapon3': '1.708', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:14,675][2409097] DAMAGECOUNT value on done: 1401.0
[2023-02-25 12:43:14,678][2409097] Sum rewards: 1.121, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.956', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'weapon5': '0.046', 'AMMO3': '0.064', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.230', 'weapon4': '0.408', 'ARMOR': '0.542', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.864', 'weapon2': '1.480', 'weapon3': '1.496', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:14,821][2409485] DAMAGECOUNT value on done: 1543.0
[2023-02-25 12:43:14,822][2409485] Sum rewards: -3.318, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.674', 'AMMO2': '0.002', 'WEAPON1': '0.010', 'AMMO4': '0.012', 'ARMOR': '0.012', 'AMMO3': '0.114', 'WEAPON4': '0.200', 'HITCOUNT': '0.250', 'weapon4': '0.368', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.726', 'FRAGCOUNT': '1.000', 'weapon3': '1.536', 'weapon2': '1.676'}
[2023-02-25 12:43:14,844][2409486] DAMAGECOUNT value on done: 1368.0
[2023-02-25 12:43:14,846][2409486] Sum rewards: 1.104, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.372', 'weapon4': '0.018', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'AMMO2': '0.031', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'AMMO4': '0.153', 'WEAPON3': '0.300', 'HITCOUNT': '0.370', 'weapon3': '1.230', 'DAMAGECOUNT': '1.320', 'weapon2': '2.346', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:15,024][2409866] DAMAGECOUNT value on done: 1753.0
[2023-02-25 12:43:15,027][2409866] Sum rewards: -2.571, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.248', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.007', 'weapon5': '0.008', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'WEAPON5': '0.150', 'weapon4': '0.164', 'ARMOR': '0.459', 'HITCOUNT': '0.530', 'WEAPON3': '0.700', 'weapon3': '1.280', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.851', 'weapon2': '2.320'}
[2023-02-25 12:43:15,220][2409597] DAMAGECOUNT value on done: 1415.0
[2023-02-25 12:43:15,221][2409597] Sum rewards: -1.165, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.000', 'AMMO4': '-0.077', 'AMMO2': '-0.015', 'WEAPON1': '0.010', 'AMMO3': '0.094', 'HITCOUNT': '0.240', 'ARMOR': '0.492', 'DAMAGECOUNT': '0.735', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.626', 'weapon2': '1.980'}
[2023-02-25 12:43:15,229][2409549] DAMAGECOUNT value on done: 1382.0
[2023-02-25 12:43:15,231][2409549] Sum rewards: 5.747, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.696', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.018', 'ARMOR': '0.044', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'AMMO3': '0.082', 'WEAPON4': '0.250', 'weapon4': '0.384', 'WEAPON3': '0.550', 'HITCOUNT': '0.660', 'weapon3': '1.168', 'weapon2': '1.436', 'DAMAGECOUNT': '1.989', 'FRAGCOUNT': '6.500'}
[2023-02-25 12:43:15,481][2409100] DAMAGECOUNT value on done: 1029.0
[2023-02-25 12:43:15,484][2409100] Sum rewards: -4.272, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.570', 'FRAGCOUNT': '0.000', 'AMMO5': '0.008', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.051', 'weapon5': '0.064', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.366', 'ARMOR': '0.400', 'HITCOUNT': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.102', 'DAMAGECOUNT': '1.383', 'weapon3': '1.458'}
[2023-02-25 12:43:15,526][2409548] DAMAGECOUNT value on done: 1687.0
[2023-02-25 12:43:15,530][2409548] Sum rewards: 3.117, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.124', 'AMMO5': '0.009', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.064', 'AMMO3': '0.077', 'AMMO4': '0.093', 'WEAPON5': '0.200', 'HITCOUNT': '0.390', 'WEAPON3': '0.500', 'ARMOR': '0.800', 'weapon3': '1.418', 'DAMAGECOUNT': '1.647', 'weapon2': '1.754', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:15,578][2409355] DAMAGECOUNT value on done: 1241.0
[2023-02-25 12:43:15,579][2409355] Sum rewards: 2.189, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.374', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.019', 'weapon7': '0.080', 'AMMO4': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'weapon4': '0.336', 'ARMOR': '0.408', 'HITCOUNT': '0.610', 'WEAPON3': '0.650', 'weapon3': '1.256', 'weapon2': '1.716', 'DAMAGECOUNT': '1.965', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:15,638][2409596] DAMAGECOUNT value on done: 1137.0
[2023-02-25 12:43:15,639][2409596] Sum rewards: -2.083, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.109', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO3': '0.035', 'AMMO4': '0.049', 'weapon5': '0.092', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'WEAPON3': '0.250', 'HITCOUNT': '0.380', 'ARMOR': '0.420', 'weapon4': '0.490', 'weapon3': '0.546', 'DAMAGECOUNT': '1.215', 'weapon2': '1.634'}
[2023-02-25 12:43:15,769][2409074] Updated weights for policy 0, policy_version 8941 (0.0012)
[2023-02-25 12:43:16,254][2409407] DAMAGECOUNT value on done: 878.0
[2023-02-25 12:43:16,255][2409407] Sum rewards: 0.038, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.656', 'weapon4': '0.002', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.050', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.270', 'ARMOR': '0.404', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.840', 'weapon2': '1.656', 'weapon3': '1.916', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:16,309][2409104] DAMAGECOUNT value on done: 1352.0
[2023-02-25 12:43:16,311][2409102] DAMAGECOUNT value on done: 1336.0
[2023-02-25 12:43:16,313][2409104] Sum rewards: 1.652, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.255', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.006', 'AMMO3': '0.079', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.146', 'weapon5': '0.158', 'HITCOUNT': '0.310', 'ARMOR': '0.440', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.050', 'weapon3': '1.274', 'weapon2': '1.524', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:43:16,314][2409102] Sum rewards: -2.355, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.262', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.086', 'AMMO4': '0.094', 'weapon4': '0.142', 'WEAPON4': '0.250', 'HITCOUNT': '0.290', 'ARMOR': '0.424', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.870', 'FRAGCOUNT': '1.000', 'weapon3': '1.320', 'weapon2': '2.030'}
[2023-02-25 12:43:16,687][2409406] DAMAGECOUNT value on done: 974.0
[2023-02-25 12:43:16,690][2409406] Sum rewards: -2.317, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.636', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'AMMO3': '0.079', 'AMMO4': '0.159', 'HITCOUNT': '0.300', 'weapon4': '0.302', 'ARMOR': '0.444', 'WEAPON4': '0.500', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.011', 'weapon2': '1.534', 'weapon3': '1.588'}
[2023-02-25 12:43:16,695][2409101] DAMAGECOUNT value on done: 1184.0
[2023-02-25 12:43:16,696][2409101] Sum rewards: 1.836, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.232', 'AMMO4': '-0.064', 'AMMO2': '-0.013', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.062', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.206', 'HITCOUNT': '0.300', 'WEAPON3': '0.650', 'ARMOR': '0.902', 'DAMAGECOUNT': '0.972', 'weapon2': '1.086', 'weapon3': '1.604', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:16,748][2409103] DAMAGECOUNT value on done: 1150.0
[2023-02-25 12:43:16,751][2409103] Sum rewards: 2.131, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.340', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.049', 'AMMO3': '0.066', 'weapon5': '0.158', 'WEAPON5': '0.200', 'HITCOUNT': '0.350', 'WEAPON3': '0.500', 'ARMOR': '0.854', 'weapon3': '1.120', 'DAMAGECOUNT': '1.248', 'weapon2': '1.878', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:16,894][2409075] DAMAGECOUNT value on done: 1123.0
[2023-02-25 12:43:16,894][2409075] Sum rewards: -0.178, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.268', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.053', 'HITCOUNT': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.208', 'DAMAGECOUNT': '0.321', 'WEAPON3': '0.400', 'weapon3': '0.742', 'ARMOR': '0.865', 'FRAGCOUNT': '1.000', 'weapon2': '1.660'}
[2023-02-25 12:43:16,898][2409105] DAMAGECOUNT value on done: 1493.0
[2023-02-25 12:43:16,898][2409105] Sum rewards: -0.152, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.662', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.022', 'weapon5': '0.034', 'ARMOR': '0.068', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'HITCOUNT': '0.340', 'weapon4': '0.380', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.028', 'DAMAGECOUNT': '1.161', 'weapon3': '1.418'}
[2023-02-25 12:43:17,051][2409469] DAMAGECOUNT value on done: 1534.0
[2023-02-25 12:43:17,052][2409469] Sum rewards: 1.455, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.088', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon5': '0.030', 'AMMO4': '0.054', 'AMMO3': '0.105', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'ARMOR': '0.436', 'weapon4': '0.460', 'HITCOUNT': '0.490', 'WEAPON3': '0.700', 'weapon3': '1.266', 'weapon2': '1.580', 'DAMAGECOUNT': '2.304', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:17,186][2408954] Fps is (10 sec: 24986.5, 60 sec: 25190.5, 300 sec: 25131.4). Total num frames: 36651008. Throughput: 0: 6401.9. Samples: 9171780. Policy #0 lag: (min: 1.0, avg: 12.6, max: 25.0)
[2023-02-25 12:43:17,186][2408954] Avg episode reward: [(0, '0.770')]
[2023-02-25 12:43:17,372][2409405] DAMAGECOUNT value on done: 1367.0
[2023-02-25 12:43:17,375][2409405] Sum rewards: 0.137, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.730', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.068', 'AMMO4': '0.086', 'AMMO3': '0.095', 'WEAPON5': '0.200', 'HITCOUNT': '0.280', 'WEAPON4': '0.350', 'ARMOR': '0.484', 'WEAPON3': '0.600', 'weapon4': '0.642', 'weapon2': '1.306', 'DAMAGECOUNT': '1.479', 'weapon3': '1.482', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:17,384][2409074] Updated weights for policy 0, policy_version 8951 (0.0013)
[2023-02-25 12:43:17,554][2409077] DAMAGECOUNT value on done: 1164.0
[2023-02-25 12:43:17,555][2409077] Sum rewards: -0.945, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.386', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO3': '0.096', 'AMMO4': '0.133', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.364', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.630', 'FRAGCOUNT': '1.000', 'weapon3': '1.364', 'weapon2': '1.888'}
[2023-02-25 12:43:17,946][2409389] DAMAGECOUNT value on done: 1052.0
[2023-02-25 12:43:17,947][2409389] Sum rewards: -0.674, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon5': '0.038', 'AMMO3': '0.060', 'weapon7': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'HITCOUNT': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.184', 'WEAPON7': '0.200', 'HEALTH': '0.314', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.450', 'ARMOR': '0.488', 'FRAGCOUNT': '1.000', 'weapon3': '1.174', 'weapon2': '1.794'}
[2023-02-25 12:43:18,022][2409565] DAMAGECOUNT value on done: 1255.0
[2023-02-25 12:43:18,022][2409565] Sum rewards: 0.618, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.873', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO4': '0.018', 'ARMOR': '0.058', 'weapon5': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'WEAPON5': '0.150', 'weapon4': '0.190', 'HITCOUNT': '0.290', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.921', 'FRAGCOUNT': '1.000', 'weapon2': '1.144', 'weapon3': '1.290'}
[2023-02-25 12:43:18,139][2409078] DAMAGECOUNT value on done: 868.0
[2023-02-25 12:43:18,140][2409078] Sum rewards: -2.211, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.317', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'weapon4': '0.048', 'WEAPON4': '0.050', 'ARMOR': '0.060', 'AMMO4': '0.079', 'HITCOUNT': '0.090', 'AMMO3': '0.138', 'DAMAGECOUNT': '0.315', 'WEAPON3': '0.900', 'weapon2': '1.662', 'weapon3': '1.968', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:18,321][2409373] DAMAGECOUNT value on done: 1552.0
[2023-02-25 12:43:18,322][2409373] Sum rewards: 1.271, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.745', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.040', 'AMMO3': '0.052', 'WEAPON4': '0.100', 'HITCOUNT': '0.310', 'WEAPON3': '0.350', 'ARMOR': '0.947', 'weapon3': '1.006', 'DAMAGECOUNT': '1.041', 'FRAGCOUNT': '2.000', 'weapon2': '2.152'}
[2023-02-25 12:43:18,323][2409097] DAMAGECOUNT value on done: 615.0
[2023-02-25 12:43:18,326][2409097] Sum rewards: 4.535, reward structure: {'DEATHCOUNT': '-3.000', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'HEALTH': '0.063', 'AMMO4': '0.064', 'ARMOR': '0.064', 'AMMO3': '0.068', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'weapon4': '0.290', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.795', 'weapon2': '1.088', 'weapon3': '1.370', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:18,333][2409076] DAMAGECOUNT value on done: 1533.0
[2023-02-25 12:43:18,339][2409076] Sum rewards: 0.216, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.218', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon5': '0.058', 'AMMO3': '0.071', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'HITCOUNT': '0.310', 'WEAPON3': '0.400', 'weapon4': '0.470', 'ARMOR': '0.894', 'weapon3': '1.036', 'DAMAGECOUNT': '1.518', 'weapon2': '1.950', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:18,568][2409486] DAMAGECOUNT value on done: 1752.0
[2023-02-25 12:43:18,571][2409486] Sum rewards: -0.797, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.150', 'AMMO2': '0.014', 'WEAPON1': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.106', 'WEAPON4': '0.150', 'weapon4': '0.262', 'HITCOUNT': '0.330', 'ARMOR': '0.423', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.960', 'weapon2': '1.238', 'FRAGCOUNT': '2.000', 'weapon3': '2.298'}
[2023-02-25 12:43:18,676][2409866] DAMAGECOUNT value on done: 1214.0
[2023-02-25 12:43:18,676][2409866] Sum rewards: 1.329, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.759', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'weapon5': '0.006', 'WEAPON1': '0.040', 'weapon4': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'HITCOUNT': '0.310', 'WEAPON3': '0.700', 'ARMOR': '0.889', 'DAMAGECOUNT': '0.948', 'weapon2': '1.682', 'weapon3': '1.746', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:18,986][2409100] DAMAGECOUNT value on done: 1025.0
[2023-02-25 12:43:18,987][2409100] Sum rewards: -3.432, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.698', 'AMMO5': '0.008', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'HITCOUNT': '0.130', 'weapon4': '0.148', 'DAMAGECOUNT': '0.315', 'ARMOR': '0.460', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.256', 'weapon3': '1.822'}
[2023-02-25 12:43:19,036][2409548] DAMAGECOUNT value on done: 1122.0
[2023-02-25 12:43:19,040][2409548] Sum rewards: -0.644, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.962', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'AMMO3': '0.078', 'AMMO4': '0.102', 'weapon5': '0.122', 'WEAPON5': '0.150', 'weapon4': '0.176', 'WEAPON4': '0.200', 'HITCOUNT': '0.290', 'ARMOR': '0.465', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.921', 'FRAGCOUNT': '1.000', 'weapon3': '1.146', 'weapon2': '1.882'}
[2023-02-25 12:43:19,103][2409074] Updated weights for policy 0, policy_version 8961 (0.0012)
[2023-02-25 12:43:19,165][2409355] DAMAGECOUNT value on done: 564.0
[2023-02-25 12:43:19,168][2409355] Sum rewards: -0.721, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.790', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon7': '0.022', 'ARMOR': '0.025', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.056', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon4': '0.194', 'HITCOUNT': '0.240', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.678', 'weapon3': '0.898', 'FRAGCOUNT': '1.000', 'weapon2': '1.276'}
[2023-02-25 12:43:19,197][2409549] DAMAGECOUNT value on done: 1137.0
[2023-02-25 12:43:19,201][2409549] Sum rewards: -0.810, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.205', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.056', 'AMMO3': '0.084', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.260', 'weapon4': '0.272', 'WEAPON3': '0.450', 'ARMOR': '0.478', 'DAMAGECOUNT': '0.885', 'FRAGCOUNT': '1.000', 'weapon3': '1.236', 'weapon2': '2.042'}
[2023-02-25 12:43:19,309][2409485] DAMAGECOUNT value on done: 994.0
[2023-02-25 12:43:19,420][2409596] DAMAGECOUNT value on done: 1298.0
[2023-02-25 12:43:19,420][2409596] Sum rewards: 5.359, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'AMMO2': '0.016', 'HEALTH': '0.018', 'weapon5': '0.026', 'AMMO3': '0.070', 'AMMO4': '0.078', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.330', 'weapon4': '0.412', 'ARMOR': '0.452', 'WEAPON3': '0.500', 'weapon2': '1.154', 'DAMAGECOUNT': '1.332', 'weapon3': '1.664', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:43:19,632][2409597] DAMAGECOUNT value on done: 1569.0
[2023-02-25 12:43:19,633][2409597] Sum rewards: 2.950, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.084', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.019', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon5': '0.150', 'weapon4': '0.238', 'WEAPON5': '0.350', 'HITCOUNT': '0.370', 'ARMOR': '0.482', 'WEAPON3': '0.650', 'weapon2': '1.200', 'weapon3': '1.476', 'DAMAGECOUNT': '1.893', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:20,060][2409102] DAMAGECOUNT value on done: 1158.0
[2023-02-25 12:43:20,061][2409102] Sum rewards: -0.461, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.580', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'AMMO3': '0.053', 'AMMO4': '0.092', 'WEAPON4': '0.300', 'HITCOUNT': '0.350', 'WEAPON3': '0.400', 'weapon4': '0.426', 'DAMAGECOUNT': '1.143', 'weapon3': '1.144', 'weapon2': '1.894', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:20,151][2409096] DAMAGECOUNT value on done: 1174.0
[2023-02-25 12:43:20,157][2409096] Sum rewards: 0.201, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.840', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.007', 'weapon5': '0.014', 'ARMOR': '0.016', 'weapon4': '0.026', 'WEAPON1': '0.030', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.537', 'WEAPON3': '0.550', 'weapon2': '1.156', 'weapon3': '1.438', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:20,243][2409406] DAMAGECOUNT value on done: 1767.0
[2023-02-25 12:43:20,244][2409406] Sum rewards: 3.138, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.990', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.008', 'WEAPON1': '0.030', 'AMMO3': '0.095', 'weapon5': '0.160', 'WEAPON4': '0.200', 'weapon4': '0.238', 'WEAPON5': '0.250', 'HITCOUNT': '0.310', 'ARMOR': '0.428', 'WEAPON3': '0.600', 'weapon3': '1.372', 'DAMAGECOUNT': '1.839', 'weapon2': '1.880', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:43:20,245][2409407] DAMAGECOUNT value on done: 1496.0
[2023-02-25 12:43:20,247][2409407] Sum rewards: -0.515, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.272', 'ARMOR': '0.020', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'AMMO3': '0.124', 'AMMO4': '0.124', 'HITCOUNT': '0.220', 'WEAPON4': '0.300', 'weapon4': '0.538', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.858', 'weapon2': '1.400', 'weapon3': '1.718', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:20,390][2409101] DAMAGECOUNT value on done: 1198.0
[2023-02-25 12:43:20,527][2409104] DAMAGECOUNT value on done: 1405.0
[2023-02-25 12:43:20,530][2409104] Sum rewards: -2.840, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.830', 'AMMO4': '-0.008', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.074', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'weapon4': '0.140', 'WEAPON4': '0.150', 'HITCOUNT': '0.280', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.804', 'FRAGCOUNT': '1.000', 'weapon3': '1.558', 'weapon2': '1.574'}
[2023-02-25 12:43:20,586][2409075] DAMAGECOUNT value on done: 916.0
[2023-02-25 12:43:20,587][2409075] Sum rewards: -3.443, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.910', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.009', 'AMMO2': '0.012', 'ARMOR': '0.022', 'weapon5': '0.026', 'HITCOUNT': '0.040', 'AMMO4': '0.058', 'AMMO3': '0.080', 'DAMAGECOUNT': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.476', 'WEAPON3': '0.500', 'weapon2': '1.400', 'weapon3': '1.654'}
[2023-02-25 12:43:20,625][2409469] DAMAGECOUNT value on done: 936.0
[2023-02-25 12:43:20,625][2409469] Sum rewards: 1.157, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.563', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.009', 'weapon5': '0.026', 'AMMO3': '0.055', 'WEAPON5': '0.100', 'HITCOUNT': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.382', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.405', 'weapon2': '0.630', 'ARMOR': '0.986', 'FRAGCOUNT': '1.000', 'weapon3': '1.146'}
[2023-02-25 12:43:20,674][2409079] DAMAGECOUNT value on done: 1240.0
[2023-02-25 12:43:20,675][2409079] Sum rewards: 3.784, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.280', 'AMMO5': '0.003', 'ARMOR': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.084', 'AMMO3': '0.089', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'weapon4': '0.204', 'WEAPON3': '0.550', 'HITCOUNT': '0.590', 'weapon3': '1.656', 'weapon2': '1.740', 'DAMAGECOUNT': '2.034', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:43:20,738][2409074] Updated weights for policy 0, policy_version 8971 (0.0012)
[2023-02-25 12:43:21,087][2409077] DAMAGECOUNT value on done: 1094.0
[2023-02-25 12:43:21,088][2409077] Sum rewards: -1.771, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.997', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.016', 'weapon5': '0.026', 'weapon4': '0.080', 'AMMO4': '0.081', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.444', 'ARMOR': '0.497', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.302', 'weapon2': '1.462'}
[2023-02-25 12:43:21,124][2409103] DAMAGECOUNT value on done: 1115.0
[2023-02-25 12:43:21,304][2409105] DAMAGECOUNT value on done: 1552.0
[2023-02-25 12:43:21,305][2409105] Sum rewards: 2.511, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.744', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.017', 'ARMOR': '0.036', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.097', 'WEAPON5': '0.150', 'weapon4': '0.202', 'HITCOUNT': '0.300', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.945', 'weapon2': '1.174', 'weapon3': '1.770', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:21,501][2409405] DAMAGECOUNT value on done: 1056.0
[2023-02-25 12:43:21,505][2409405] Sum rewards: -2.473, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.258', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.029', 'weapon5': '0.048', 'AMMO3': '0.111', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'HITCOUNT': '0.320', 'weapon4': '0.640', 'WEAPON3': '0.700', 'ARMOR': '0.864', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.023', 'weapon2': '1.162', 'weapon3': '1.274'}
[2023-02-25 12:43:21,628][2409389] DAMAGECOUNT value on done: 1213.0
[2023-02-25 12:43:21,631][2409389] Sum rewards: 2.340, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.040', 'AMMO5': '0.006', 'AMMO2': '0.008', 'AMMO4': '0.041', 'AMMO3': '0.066', 'weapon5': '0.084', 'WEAPON5': '0.150', 'HITCOUNT': '0.430', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon2': '1.110', 'weapon3': '1.308', 'DAMAGECOUNT': '1.476'}
[2023-02-25 12:43:21,854][2409565] DAMAGECOUNT value on done: 1093.0
[2023-02-25 12:43:21,857][2409565] Sum rewards: 1.701, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.075', 'AMMO4': '-0.064', 'AMMO2': '-0.013', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'AMMO3': '0.060', 'weapon5': '0.098', 'WEAPON5': '0.200', 'HITCOUNT': '0.330', 'WEAPON3': '0.500', 'weapon2': '1.126', 'weapon3': '1.404', 'DAMAGECOUNT': '1.575', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:21,958][2409076] DAMAGECOUNT value on done: 1247.0
[2023-02-25 12:43:21,962][2409076] Sum rewards: -0.507, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.838', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'weapon4': '0.198', 'HITCOUNT': '0.320', 'ARMOR': '0.491', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.326', 'weapon3': '1.546', 'weapon2': '1.696', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:21,964][2409373] DAMAGECOUNT value on done: 1547.0
[2023-02-25 12:43:21,969][2409373] Sum rewards: 5.060, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.442', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.016', 'WEAPON1': '0.020', 'ARMOR': '0.044', 'AMMO3': '0.052', 'AMMO4': '0.057', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'WEAPON6': '0.200', 'HITCOUNT': '0.350', 'weapon6': '0.356', 'WEAPON3': '0.450', 'weapon4': '0.486', 'weapon2': '0.948', 'DAMAGECOUNT': '1.137', 'weapon3': '1.370', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:22,033][2409097] DAMAGECOUNT value on done: 1392.0
[2023-02-25 12:43:22,034][2409097] Sum rewards: 2.877, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.278', 'AMMO2': '0.005', 'AMMO5': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.024', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.106', 'WEAPON5': '0.150', 'weapon4': '0.182', 'HITCOUNT': '0.230', 'WEAPON3': '0.400', 'ARMOR': '0.481', 'weapon2': '1.128', 'DAMAGECOUNT': '1.293', 'weapon3': '1.470', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:22,152][2409074] Updated weights for policy 0, policy_version 8981 (0.0012)
[2023-02-25 12:43:22,186][2408954] Fps is (10 sec: 25395.4, 60 sec: 25395.6, 300 sec: 25173.0). Total num frames: 36786176. Throughput: 0: 6393.9. Samples: 9190884. Policy #0 lag: (min: 0.0, avg: 12.1, max: 24.0)
[2023-02-25 12:43:22,186][2408954] Avg episode reward: [(0, '0.757')]
[2023-02-25 12:43:22,316][2409078] DAMAGECOUNT value on done: 838.0
[2023-02-25 12:43:22,316][2409078] Sum rewards: 0.551, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.394', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.033', 'weapon5': '0.062', 'AMMO3': '0.089', 'WEAPON5': '0.150', 'HITCOUNT': '0.240', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.825', 'ARMOR': '0.883', 'weapon3': '1.410', 'FRAGCOUNT': '2.000', 'weapon2': '2.218'}
[2023-02-25 12:43:22,434][2409486] DAMAGECOUNT value on done: 1130.0
[2023-02-25 12:43:22,437][2409486] Sum rewards: -0.088, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.230', 'AMMO5': '0.005', 'AMMO2': '0.027', 'ARMOR': '0.036', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'HITCOUNT': '0.290', 'WEAPON4': '0.300', 'weapon4': '0.350', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.894', 'FRAGCOUNT': '1.000', 'weapon2': '1.190', 'weapon3': '1.220'}
[2023-02-25 12:43:22,586][2409100] DAMAGECOUNT value on done: 1352.0
[2023-02-25 12:43:22,587][2409100] Sum rewards: 3.282, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.311', 'AMMO2': '0.036', 'weapon7': '0.038', 'AMMO3': '0.111', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO4': '0.181', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.420', 'ARMOR': '0.428', 'WEAPON3': '0.650', 'weapon4': '0.778', 'weapon3': '1.194', 'weapon2': '1.398', 'DAMAGECOUNT': '1.788', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:43:22,651][2409548] DAMAGECOUNT value on done: 1753.0
[2023-02-25 12:43:22,653][2409548] Sum rewards: 2.683, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.190', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.078', 'weapon5': '0.132', 'HITCOUNT': '0.190', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.747', 'weapon2': '1.392', 'weapon3': '1.530', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:22,654][2409866] DAMAGECOUNT value on done: 1044.0
[2023-02-25 12:43:22,658][2409866] Sum rewards: 2.600, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.345', 'AMMO5': '0.003', 'AMMO2': '0.016', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO4': '0.078', 'AMMO3': '0.085', 'weapon4': '0.200', 'HITCOUNT': '0.320', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.810', 'weapon3': '1.272', 'weapon2': '1.654', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:22,724][2409549] DAMAGECOUNT value on done: 1291.0
[2023-02-25 12:43:22,725][2409549] Sum rewards: -1.128, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.225', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon7': '0.026', 'AMMO4': '0.029', 'weapon5': '0.066', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.114', 'WEAPON5': '0.150', 'HITCOUNT': '0.180', 'ARMOR': '0.507', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.384', 'weapon2': '1.658'}
[2023-02-25 12:43:22,978][2409485] DAMAGECOUNT value on done: 954.0
[2023-02-25 12:43:22,979][2409485] Sum rewards: 1.037, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'HEALTH': '0.052', 'AMMO3': '0.060', 'AMMO4': '0.067', 'HITCOUNT': '0.080', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.255', 'WEAPON3': '0.350', 'weapon4': '0.432', 'ARMOR': '0.440', 'FRAGCOUNT': '1.000', 'weapon2': '1.212', 'weapon3': '1.370'}
[2023-02-25 12:43:23,185][2409355] DAMAGECOUNT value on done: 1579.0
[2023-02-25 12:43:23,186][2409355] Sum rewards: 2.258, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.439', 'AMMO2': '0.002', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO4': '0.008', 'AMMO3': '0.050', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.192', 'HITCOUNT': '0.280', 'WEAPON3': '0.350', 'weapon3': '0.982', 'DAMAGECOUNT': '1.404', 'weapon2': '1.838', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:43:23,706][2409074] Updated weights for policy 0, policy_version 8991 (0.0012)
[2023-02-25 12:43:23,827][2409102] DAMAGECOUNT value on done: 1350.0
[2023-02-25 12:43:23,828][2409102] Sum rewards: 0.010, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.315', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'AMMO4': '0.173', 'weapon4': '0.310', 'HITCOUNT': '0.320', 'WEAPON3': '0.400', 'ARMOR': '0.456', 'DAMAGECOUNT': '0.909', 'weapon3': '0.924', 'FRAGCOUNT': '1.000', 'weapon2': '1.606'}
[2023-02-25 12:43:23,882][2409096] DAMAGECOUNT value on done: 924.0
[2023-02-25 12:43:23,883][2409096] Sum rewards: 1.631, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'AMMO3': '0.073', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'weapon4': '0.160', 'HITCOUNT': '0.240', 'HEALTH': '0.272', 'WEAPON3': '0.400', 'ARMOR': '0.453', 'DAMAGECOUNT': '0.960', 'weapon3': '1.064', 'weapon2': '1.674', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:23,998][2409596] DAMAGECOUNT value on done: 1420.0
[2023-02-25 12:43:23,999][2409596] Sum rewards: 0.799, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.844', 'AMMO2': '0.002', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO4': '0.012', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.098', 'weapon4': '0.134', 'HITCOUNT': '0.310', 'ARMOR': '0.537', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.945', 'weapon3': '1.158', 'weapon2': '1.648', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:24,034][2409407] DAMAGECOUNT value on done: 1492.0
[2023-02-25 12:43:24,038][2409407] Sum rewards: 0.044, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.003', 'AMMO2': '0.016', 'WEAPON1': '0.040', 'AMMO4': '0.080', 'AMMO3': '0.082', 'WEAPON4': '0.150', 'HITCOUNT': '0.220', 'weapon4': '0.398', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.735', 'ARMOR': '0.904', 'weapon3': '1.244', 'weapon2': '1.428', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:24,113][2409075] DAMAGECOUNT value on done: 954.0
[2023-02-25 12:43:24,145][2409597] DAMAGECOUNT value on done: 1321.0
[2023-02-25 12:43:24,146][2409597] Sum rewards: 2.074, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.643', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.013', 'AMMO3': '0.049', 'weapon5': '0.136', 'HITCOUNT': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'weapon4': '0.602', 'weapon3': '0.810', 'ARMOR': '0.876', 'DAMAGECOUNT': '1.224', 'weapon2': '1.396', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:43:24,284][2409406] DAMAGECOUNT value on done: 1168.0
[2023-02-25 12:43:24,287][2409406] Sum rewards: -0.852, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.292', 'weapon5': '0.004', 'AMMO2': '0.010', 'ARMOR': '0.012', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.051', 'AMMO3': '0.082', 'weapon4': '0.088', 'WEAPON4': '0.150', 'HITCOUNT': '0.340', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.095', 'weapon3': '1.460', 'weapon2': '1.610', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:24,356][2409469] DAMAGECOUNT value on done: 1638.0
[2023-02-25 12:43:24,357][2409469] Sum rewards: -0.951, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.622', 'AMMO4': '-0.060', 'AMMO2': '-0.012', 'AMMO5': '0.004', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'HITCOUNT': '0.380', 'ARMOR': '0.473', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.122', 'weapon2': '1.540', 'weapon3': '1.666', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:24,476][2409101] DAMAGECOUNT value on done: 774.0
[2023-02-25 12:43:24,479][2409101] Sum rewards: -0.576, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.434', 'AMMO2': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.052', 'AMMO3': '0.092', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'weapon4': '0.366', 'DAMAGECOUNT': '0.534', 'WEAPON3': '0.600', 'ARMOR': '0.904', 'weapon3': '1.344', 'weapon2': '1.846', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:24,488][2409079] DAMAGECOUNT value on done: 907.0
[2023-02-25 12:43:24,491][2409079] Sum rewards: -2.180, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.648', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.059', 'AMMO2': '-0.012', 'AMMO5': '0.007', 'AMMO3': '0.052', 'weapon5': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'weapon4': '0.186', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.765', 'weapon3': '1.160', 'ARMOR': '1.258', 'weapon2': '1.802'}
[2023-02-25 12:43:24,701][2409104] DAMAGECOUNT value on done: 846.0
[2023-02-25 12:43:24,746][2409103] DAMAGECOUNT value on done: 1109.0
[2023-02-25 12:43:24,749][2409103] Sum rewards: 1.243, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO4': '0.077', 'AMMO3': '0.090', 'HEALTH': '0.224', 'HITCOUNT': '0.290', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.930', 'weapon2': '1.088', 'weapon3': '1.446', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:25,141][2409077] DAMAGECOUNT value on done: 1484.0
[2023-02-25 12:43:25,141][2409077] Sum rewards: 3.977, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.460', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'AMMO5': '0.007', 'ARMOR': '0.008', 'WEAPON1': '0.050', 'weapon5': '0.094', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.190', 'weapon4': '0.222', 'WEAPON3': '0.700', 'weapon2': '1.048', 'DAMAGECOUNT': '1.347', 'weapon3': '1.476', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:43:25,156][2409389] DAMAGECOUNT value on done: 1499.0
[2023-02-25 12:43:25,156][2409389] Sum rewards: 3.484, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.155', 'AMMO5': '0.014', 'AMMO2': '0.018', 'weapon5': '0.060', 'AMMO4': '0.087', 'AMMO3': '0.093', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'HITCOUNT': '0.450', 'weapon4': '0.480', 'WEAPON3': '0.600', 'weapon2': '1.250', 'ARMOR': '1.391', 'DAMAGECOUNT': '1.434', 'weapon3': '1.662', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:25,285][2409074] Updated weights for policy 0, policy_version 9001 (0.0012)
[2023-02-25 12:43:25,421][2409405] DAMAGECOUNT value on done: 1006.0
[2023-02-25 12:43:25,422][2409405] Sum rewards: 1.206, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.602', 'AMMO4': '-0.013', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'AMMO3': '0.050', 'WEAPON1': '0.050', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.270', 'WEAPON3': '0.400', 'weapon4': '0.428', 'DAMAGECOUNT': '0.900', 'ARMOR': '0.971', 'weapon3': '1.096', 'weapon2': '1.708', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:25,688][2409105] DAMAGECOUNT value on done: 1444.0
[2023-02-25 12:43:25,689][2409105] Sum rewards: 0.359, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.130', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon7': '0.054', 'AMMO3': '0.075', 'AMMO4': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.290', 'WEAPON4': '0.300', 'ARMOR': '0.425', 'WEAPON3': '0.450', 'weapon4': '0.492', 'weapon3': '0.898', 'DAMAGECOUNT': '1.056', 'weapon2': '1.410', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:25,799][2409097] DAMAGECOUNT value on done: 1091.0
[2023-02-25 12:43:25,800][2409097] Sum rewards: 0.537, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.406', 'AMMO5': '0.005', 'weapon5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.113', 'HITCOUNT': '0.310', 'weapon4': '0.324', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.065', 'ARMOR': '1.257', 'weapon2': '1.560', 'weapon3': '1.712', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:25,802][2409565] DAMAGECOUNT value on done: 957.0
[2023-02-25 12:43:25,805][2409565] Sum rewards: 0.663, reward structure: {'DEATHCOUNT': '-6.000', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.067', 'HEALTH': '0.094', 'HITCOUNT': '0.250', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.696', 'FRAGCOUNT': '1.000', 'weapon3': '1.206', 'ARMOR': '1.324', 'weapon2': '1.596'}
[2023-02-25 12:43:25,997][2409373] DAMAGECOUNT value on done: 1159.0
[2023-02-25 12:43:26,009][2409076] DAMAGECOUNT value on done: 1117.0
[2023-02-25 12:43:26,012][2409076] Sum rewards: -0.640, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.994', 'AMMO2': '0.005', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.027', 'AMMO3': '0.060', 'weapon5': '0.062', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.220', 'weapon4': '0.380', 'WEAPON3': '0.400', 'ARMOR': '0.428', 'DAMAGECOUNT': '0.855', 'weapon3': '1.170', 'FRAGCOUNT': '1.500', 'weapon2': '1.620'}
[2023-02-25 12:43:26,061][2409100] DAMAGECOUNT value on done: 1523.0
[2023-02-25 12:43:26,062][2409100] Sum rewards: 2.770, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.306', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'weapon5': '0.032', 'AMMO3': '0.035', 'WEAPON1': '0.040', 'WEAPON5': '0.050', 'weapon7': '0.052', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.350', 'ARMOR': '0.408', 'weapon3': '0.616', 'DAMAGECOUNT': '1.086', 'weapon2': '1.240', 'FRAGCOUNT': '1.500'}
[2023-02-25 12:43:26,193][2409548] DAMAGECOUNT value on done: 1236.0
[2023-02-25 12:43:26,199][2409548] Sum rewards: -0.410, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.477', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'AMMO4': '0.121', 'weapon4': '0.244', 'HITCOUNT': '0.300', 'ARMOR': '0.468', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.110', 'weapon3': '1.490', 'weapon2': '1.772', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:26,245][2409078] DAMAGECOUNT value on done: 1408.0
[2023-02-25 12:43:26,250][2409078] Sum rewards: 2.715, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.400', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO4': '0.036', 'AMMO3': '0.062', 'WEAPON5': '0.100', 'weapon5': '0.194', 'HITCOUNT': '0.350', 'WEAPON3': '0.450', 'weapon3': '1.266', 'DAMAGECOUNT': '1.416', 'weapon2': '1.946', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:43:26,514][2409486] DAMAGECOUNT value on done: 527.0
[2023-02-25 12:43:26,517][2409486] Sum rewards: -0.075, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.170', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.074', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'HITCOUNT': '0.220', 'weapon4': '0.236', 'ARMOR': '0.444', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.573', 'weapon3': '0.816', 'FRAGCOUNT': '1.000', 'weapon2': '1.312'}
[2023-02-25 12:43:26,549][2409866] DAMAGECOUNT value on done: 1380.0
[2023-02-25 12:43:26,552][2409866] Sum rewards: -1.792, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.276', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.028', 'weapon7': '0.066', 'AMMO3': '0.086', 'HITCOUNT': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.471', 'WEAPON3': '0.500', 'ARMOR': '0.880', 'FRAGCOUNT': '1.000', 'weapon3': '1.426', 'weapon2': '1.808'}
[2023-02-25 12:43:26,625][2409485] DAMAGECOUNT value on done: 1397.0
[2023-02-25 12:43:26,629][2409485] Sum rewards: -0.186, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.294', 'AMMO5': '0.003', 'ARMOR': '0.020', 'AMMO2': '0.023', 'weapon5': '0.042', 'WEAPON5': '0.050', 'WEAPON1': '0.050', 'AMMO3': '0.111', 'AMMO4': '0.114', 'weapon4': '0.164', 'WEAPON4': '0.250', 'HITCOUNT': '0.300', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.014', 'weapon2': '1.282', 'weapon3': '1.986', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:26,804][2409549] DAMAGECOUNT value on done: 1296.0
[2023-02-25 12:43:26,808][2409549] Sum rewards: -1.349, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.886', 'WEAPON1': '0.010', 'AMMO2': '0.030', 'ARMOR': '0.056', 'AMMO3': '0.148', 'AMMO4': '0.149', 'weapon4': '0.230', 'WEAPON4': '0.250', 'HITCOUNT': '0.280', 'WEAPON3': '0.900', 'DAMAGECOUNT': '0.996', 'weapon2': '1.522', 'weapon3': '1.966', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:27,063][2409355] DAMAGECOUNT value on done: 1646.0
[2023-02-25 12:43:27,064][2409355] Sum rewards: 4.950, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.144', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'weapon7': '0.064', 'AMMO3': '0.070', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.360', 'weapon4': '0.390', 'weapon3': '0.994', 'DAMAGECOUNT': '1.290', 'weapon2': '1.486', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:27,077][2409074] Updated weights for policy 0, policy_version 9011 (0.0013)
[2023-02-25 12:43:27,186][2408954] Fps is (10 sec: 26214.2, 60 sec: 25531.7, 300 sec: 25214.7). Total num frames: 36913152. Throughput: 0: 6380.5. Samples: 9228588. Policy #0 lag: (min: 0.0, avg: 12.1, max: 24.0)
[2023-02-25 12:43:27,186][2408954] Avg episode reward: [(0, '0.471')]
[2023-02-25 12:43:27,599][2409407] DAMAGECOUNT value on done: 1731.0
[2023-02-25 12:43:27,600][2409407] Sum rewards: 3.792, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.134', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.004', 'WEAPON1': '0.010', 'weapon4': '0.050', 'weapon5': '0.054', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'ARMOR': '0.439', 'HITCOUNT': '0.490', 'WEAPON3': '0.650', 'weapon3': '1.456', 'weapon2': '1.576', 'DAMAGECOUNT': '1.920', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:27,622][2409596] DAMAGECOUNT value on done: 1337.0
[2023-02-25 12:43:27,625][2409596] Sum rewards: 0.100, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.730', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'weapon4': '0.080', 'AMMO3': '0.153', 'HITCOUNT': '0.580', 'WEAPON3': '1.000', 'weapon2': '1.510', 'DAMAGECOUNT': '1.767', 'weapon3': '2.124', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:43:27,725][2409075] DAMAGECOUNT value on done: 994.0
[2023-02-25 12:43:27,726][2409075] Sum rewards: 0.559, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'HEALTH': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'weapon5': '0.034', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.052', 'AMMO4': '0.089', 'weapon7': '0.122', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HITCOUNT': '0.240', 'WEAPON7': '0.300', 'WEAPON3': '0.300', 'weapon4': '0.408', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.834', 'weapon2': '1.010', 'weapon3': '1.156'}
[2023-02-25 12:43:27,819][2409099] DAMAGECOUNT value on done: 1432.0
[2023-02-25 12:43:27,820][2409099] Sum rewards: 0.161, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.940', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.005', 'weapon5': '0.006', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.192', 'WEAPON7': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.855', 'weapon2': '0.974', 'weapon3': '1.394', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:27,925][2409406] DAMAGECOUNT value on done: 1613.0
[2023-02-25 12:43:27,926][2409406] Sum rewards: 0.140, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.493', 'AMMO5': '0.005', 'weapon5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'ARMOR': '0.044', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'weapon4': '0.188', 'WEAPON4': '0.200', 'HITCOUNT': '0.290', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.116', 'weapon3': '1.354', 'weapon2': '1.394', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:28,020][2409102] DAMAGECOUNT value on done: 1218.0
[2023-02-25 12:43:28,023][2409102] Sum rewards: -0.725, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.435', 'AMMO4': '-0.064', 'AMMO2': '-0.013', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon5': '0.030', 'AMMO3': '0.117', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.292', 'HITCOUNT': '0.310', 'ARMOR': '0.458', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.870', 'weapon2': '1.580', 'weapon3': '1.610', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:28,021][2409096] DAMAGECOUNT value on done: 1062.0
[2023-02-25 12:43:28,028][2409096] Sum rewards: -1.670, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.148', 'AMMO5': '0.003', 'weapon7': '0.010', 'weapon5': '0.016', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.088', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'HITCOUNT': '0.300', 'ARMOR': '0.400', 'weapon4': '0.444', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.891', 'weapon3': '1.154', 'weapon2': '1.690'}
[2023-02-25 12:43:28,088][2409597] DAMAGECOUNT value on done: 1779.0
[2023-02-25 12:43:28,091][2409597] Sum rewards: 4.046, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.904', 'AMMO5': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'weapon5': '0.022', 'weapon7': '0.064', 'AMMO3': '0.078', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.420', 'weapon4': '0.638', 'ARMOR': '0.987', 'weapon2': '1.314', 'weapon3': '1.512', 'DAMAGECOUNT': '1.959', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:28,112][2409079] DAMAGECOUNT value on done: 1452.0
[2023-02-25 12:43:28,113][2409079] Sum rewards: 2.502, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.702', 'ARMOR': '0.008', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.073', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'HITCOUNT': '0.410', 'weapon4': '0.424', 'weapon2': '0.666', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.389', 'weapon3': '1.678', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:28,373][2409104] DAMAGECOUNT value on done: 1307.0
[2023-02-25 12:43:28,375][2409104] Sum rewards: 0.902, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.760', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'AMMO3': '0.055', 'WEAPON4': '0.200', 'HITCOUNT': '0.280', 'weapon4': '0.350', 'WEAPON3': '0.450', 'ARMOR': '0.499', 'DAMAGECOUNT': '0.840', 'weapon3': '1.106', 'weapon2': '1.190', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:28,418][2409469] DAMAGECOUNT value on done: 1400.0
[2023-02-25 12:43:28,421][2409469] Sum rewards: 5.012, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.134', 'AMMO2': '0.009', 'weapon4': '0.036', 'AMMO3': '0.040', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.450', 'weapon3': '0.968', 'DAMAGECOUNT': '1.650', 'weapon2': '1.696', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:28,464][2409101] DAMAGECOUNT value on done: 1392.0
[2023-02-25 12:43:28,469][2409101] Sum rewards: -5.848, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.912', 'AMMO5': '0.011', 'AMMO2': '0.031', 'ARMOR': '0.044', 'AMMO3': '0.110', 'weapon5': '0.120', 'AMMO4': '0.155', 'WEAPON5': '0.200', 'HITCOUNT': '0.380', 'FRAGCOUNT': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.674', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.164', 'weapon3': '1.424', 'weapon2': '1.450'}
[2023-02-25 12:43:28,711][2409074] Updated weights for policy 0, policy_version 9021 (0.0012)
[2023-02-25 12:43:28,729][2409103] DAMAGECOUNT value on done: 1549.0
[2023-02-25 12:43:28,730][2409103] Sum rewards: 4.446, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.801', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.057', 'HITCOUNT': '0.310', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'weapon3': '1.030', 'weapon2': '1.354', 'DAMAGECOUNT': '1.365', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:28,739][2409389] DAMAGECOUNT value on done: 1137.0
[2023-02-25 12:43:28,740][2409389] Sum rewards: 3.000, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.286', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO3': '0.056', 'AMMO4': '0.073', 'WEAPON4': '0.200', 'HITCOUNT': '0.260', 'weapon4': '0.316', 'WEAPON3': '0.350', 'ARMOR': '0.444', 'weapon3': '0.952', 'DAMAGECOUNT': '1.122', 'weapon2': '1.738', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:28,925][2409077] DAMAGECOUNT value on done: 1486.0
[2023-02-25 12:43:28,929][2409077] Sum rewards: 3.573, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.652', 'AMMO2': '0.006', 'AMMO4': '0.031', 'AMMO3': '0.080', 'WEAPON4': '0.150', 'weapon4': '0.374', 'WEAPON3': '0.400', 'HITCOUNT': '0.400', 'ARMOR': '0.998', 'weapon3': '1.348', 'DAMAGECOUNT': '1.407', 'weapon2': '1.780', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:29,434][2409405] DAMAGECOUNT value on done: 1142.0
[2023-02-25 12:43:29,435][2409405] Sum rewards: -0.206, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.598', 'AMMO4': '-0.048', 'AMMO2': '-0.009', 'AMMO5': '0.004', 'WEAPON1': '0.020', 'weapon5': '0.058', 'AMMO3': '0.065', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.138', 'HITCOUNT': '0.180', 'WEAPON3': '0.450', 'weapon3': '0.836', 'ARMOR': '0.877', 'DAMAGECOUNT': '0.942', 'FRAGCOUNT': '1.000', 'weapon2': '1.930'}
[2023-02-25 12:43:29,715][2409097] DAMAGECOUNT value on done: 1201.0
[2023-02-25 12:43:29,716][2409097] Sum rewards: 2.762, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.500', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO3': '0.059', 'weapon5': '0.068', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'WEAPON4': '0.300', 'HITCOUNT': '0.310', 'WEAPON3': '0.350', 'weapon4': '0.646', 'weapon3': '0.810', 'ARMOR': '1.278', 'DAMAGECOUNT': '1.401', 'weapon2': '1.578', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:29,740][2409105] DAMAGECOUNT value on done: 1025.0
[2023-02-25 12:43:29,744][2409105] Sum rewards: -2.936, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.624', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.059', 'AMMO3': '0.085', 'HITCOUNT': '0.280', 'WEAPON4': '0.300', 'weapon4': '0.338', 'ARMOR': '0.416', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.924', 'FRAGCOUNT': '1.000', 'weapon2': '1.258', 'weapon3': '1.696'}
[2023-02-25 12:43:29,785][2409100] DAMAGECOUNT value on done: 1422.0
[2023-02-25 12:43:29,785][2409100] Sum rewards: -0.267, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.854', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'weapon4': '0.190', 'HITCOUNT': '0.300', 'ARMOR': '0.453', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.915', 'weapon3': '1.688', 'weapon2': '1.948', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:29,899][2409373] DAMAGECOUNT value on done: 1144.0
[2023-02-25 12:43:29,901][2409373] Sum rewards: 5.135, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.582', 'AMMO2': '0.001', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.004', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.068', 'weapon4': '0.182', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'ARMOR': '0.863', 'weapon3': '1.012', 'DAMAGECOUNT': '1.332', 'weapon2': '1.400', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:43:29,912][2409076] DAMAGECOUNT value on done: 815.0
[2023-02-25 12:43:29,925][2409565] DAMAGECOUNT value on done: 1347.0
[2023-02-25 12:43:29,926][2409565] Sum rewards: -0.801, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.566', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.037', 'WEAPON5': '0.050', 'AMMO3': '0.066', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'weapon4': '0.210', 'ARMOR': '0.432', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.540', 'FRAGCOUNT': '1.000', 'weapon3': '1.168', 'weapon2': '2.170'}
[2023-02-25 12:43:29,943][2409548] DAMAGECOUNT value on done: 1819.0
[2023-02-25 12:43:29,944][2409548] Sum rewards: -1.788, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.936', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'WEAPON4': '0.350', 'HITCOUNT': '0.470', 'weapon4': '0.472', 'WEAPON3': '0.700', 'ARMOR': '0.900', 'DAMAGECOUNT': '1.530', 'weapon3': '1.534', 'weapon2': '1.626', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:30,247][2409078] DAMAGECOUNT value on done: 884.0
[2023-02-25 12:43:30,250][2409078] Sum rewards: 0.365, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.017', 'HEALTH': '0.030', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.068', 'AMMO4': '0.084', 'weapon4': '0.166', 'HITCOUNT': '0.210', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.876', 'weapon3': '1.104', 'weapon2': '1.202', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:30,405][2409074] Updated weights for policy 0, policy_version 9031 (0.0012)
[2023-02-25 12:43:30,454][2409866] DAMAGECOUNT value on done: 567.0
[2023-02-25 12:43:30,455][2409866] Sum rewards: 0.334, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.019', 'ARMOR': '0.036', 'WEAPON1': '0.040', 'weapon7': '0.062', 'AMMO3': '0.068', 'AMMO4': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'HEALTH': '0.162', 'WEAPON3': '0.400', 'weapon4': '0.484', 'DAMAGECOUNT': '0.525', 'weapon2': '0.860', 'FRAGCOUNT': '1.000', 'weapon3': '1.314'}
[2023-02-25 12:43:30,643][2409486] DAMAGECOUNT value on done: 843.0
[2023-02-25 12:43:30,644][2409486] Sum rewards: -3.428, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.754', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'weapon5': '0.058', 'AMMO4': '0.065', 'AMMO3': '0.076', 'HITCOUNT': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.303', 'weapon4': '0.304', 'WEAPON3': '0.450', 'weapon3': '0.882', 'ARMOR': '0.976', 'weapon2': '1.998'}
[2023-02-25 12:43:30,653][2409485] DAMAGECOUNT value on done: 1416.0
[2023-02-25 12:43:30,657][2409485] Sum rewards: 0.801, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.593', 'AMMO2': '0.005', 'ARMOR': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.023', 'AMMO3': '0.105', 'weapon4': '0.146', 'WEAPON4': '0.150', 'HITCOUNT': '0.320', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.011', 'weapon3': '1.396', 'weapon2': '1.498', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:30,787][2409549] DAMAGECOUNT value on done: 1212.0
[2023-02-25 12:43:30,791][2409549] Sum rewards: 1.054, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.686', 'AMMO5': '0.003', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.068', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'weapon4': '0.248', 'WEAPON3': '0.450', 'ARMOR': '0.533', 'DAMAGECOUNT': '0.645', 'weapon3': '1.194', 'weapon2': '1.376', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:30,963][2409355] DAMAGECOUNT value on done: 1021.0
[2023-02-25 12:43:30,963][2409355] Sum rewards: 0.029, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'weapon5': '0.010', 'WEAPON1': '0.010', 'HEALTH': '0.034', 'AMMO2': '0.042', 'WEAPON5': '0.050', 'ARMOR': '0.064', 'AMMO3': '0.093', 'HITCOUNT': '0.140', 'WEAPON4': '0.200', 'AMMO4': '0.208', 'DAMAGECOUNT': '0.474', 'WEAPON3': '0.500', 'weapon4': '0.606', 'FRAGCOUNT': '1.000', 'weapon2': '1.194', 'weapon3': '1.402'}
[2023-02-25 12:43:31,387][2409596] DAMAGECOUNT value on done: 935.0
[2023-02-25 12:43:31,387][2409596] Sum rewards: 2.376, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.330', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.022', 'ARMOR': '0.028', 'AMMO3': '0.044', 'WEAPON5': '0.050', 'weapon7': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.104', 'HITCOUNT': '0.190', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.735', 'weapon3': '0.870', 'weapon2': '0.886', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:31,426][2409075] DAMAGECOUNT value on done: 1162.0
[2023-02-25 12:43:31,427][2409075] Sum rewards: 2.168, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.437', 'AMMO4': '-0.081', 'AMMO2': '-0.016', 'AMMO3': '0.060', 'HITCOUNT': '0.300', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.984', 'weapon3': '1.468', 'weapon2': '1.690', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:31,725][2409406] DAMAGECOUNT value on done: 1634.0
[2023-02-25 12:43:31,730][2409406] Sum rewards: -0.520, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.542', 'AMMO2': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.021', 'AMMO3': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.184', 'weapon4': '0.318', 'HITCOUNT': '0.330', 'ARMOR': '0.487', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.550', 'weapon2': '1.246', 'DAMAGECOUNT': '1.548', 'weapon3': '1.912'}
[2023-02-25 12:43:31,773][2409096] DAMAGECOUNT value on done: 853.0
[2023-02-25 12:43:31,774][2409096] Sum rewards: -0.928, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.720', 'AMMO5': '0.003', 'weapon5': '0.018', 'AMMO2': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.061', 'AMMO4': '0.178', 'HITCOUNT': '0.240', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.789', 'weapon3': '0.888', 'weapon4': '0.900', 'ARMOR': '1.298', 'weapon2': '1.482', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:31,790][2409102] DAMAGECOUNT value on done: 891.0
[2023-02-25 12:43:31,793][2409102] Sum rewards: -0.796, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.028', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'HEALTH': '0.062', 'weapon7': '0.066', 'HITCOUNT': '0.070', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.107', 'DAMAGECOUNT': '0.195', 'weapon4': '0.208', 'WEAPON3': '0.400', 'ARMOR': '0.824', 'weapon3': '0.968', 'FRAGCOUNT': '2.000', 'weapon2': '2.002'}
[2023-02-25 12:43:31,818][2409074] Updated weights for policy 0, policy_version 9041 (0.0012)
[2023-02-25 12:43:31,965][2409099] DAMAGECOUNT value on done: 1046.0
[2023-02-25 12:43:31,969][2409099] Sum rewards: -2.702, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.882', 'AMMO5': '0.004', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon5': '0.040', 'ARMOR': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.118', 'HITCOUNT': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.504', 'DAMAGECOUNT': '0.714', 'WEAPON3': '0.850', 'weapon2': '1.240', 'weapon3': '1.852', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:32,037][2409101] DAMAGECOUNT value on done: 1515.0
[2023-02-25 12:43:32,039][2409101] Sum rewards: 2.419, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.136', 'AMMO5': '0.005', 'AMMO2': '0.031', 'AMMO3': '0.051', 'ARMOR': '0.052', 'WEAPON5': '0.100', 'weapon5': '0.116', 'AMMO4': '0.157', 'WEAPON4': '0.200', 'HITCOUNT': '0.290', 'weapon4': '0.336', 'WEAPON3': '0.350', 'DAMAGECOUNT': '1.035', 'weapon2': '1.070', 'weapon3': '1.262', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:32,118][2409469] DAMAGECOUNT value on done: 1378.0
[2023-02-25 12:43:32,121][2409469] Sum rewards: -0.499, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.604', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.026', 'weapon5': '0.074', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.100', 'HITCOUNT': '0.280', 'WEAPON3': '0.650', 'ARMOR': '0.865', 'DAMAGECOUNT': '0.960', 'weapon2': '1.538', 'weapon3': '1.812', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:32,122][2409104] DAMAGECOUNT value on done: 843.0
[2023-02-25 12:43:32,125][2409104] Sum rewards: 0.463, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.845', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'HITCOUNT': '0.190', 'weapon4': '0.202', 'DAMAGECOUNT': '0.669', 'WEAPON3': '0.700', 'weapon2': '1.570', 'weapon3': '1.638', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:32,186][2408954] Fps is (10 sec: 24985.5, 60 sec: 25531.7, 300 sec: 25159.2). Total num frames: 37036032. Throughput: 0: 6373.1. Samples: 9266616. Policy #0 lag: (min: 0.0, avg: 13.0, max: 26.0)
[2023-02-25 12:43:32,186][2408954] Avg episode reward: [(0, '0.576')]
[2023-02-25 12:43:32,288][2409597] DAMAGECOUNT value on done: 1585.0
[2023-02-25 12:43:32,289][2409597] Sum rewards: -2.301, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.982', 'AMMO2': '0.001', 'AMMO4': '0.006', 'WEAPON1': '0.020', 'AMMO3': '0.072', 'WEAPON4': '0.150', 'weapon4': '0.204', 'HITCOUNT': '0.290', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.888', 'ARMOR': '0.924', 'FRAGCOUNT': '1.000', 'weapon3': '1.138', 'weapon2': '1.938'}
[2023-02-25 12:43:32,421][2409407] DAMAGECOUNT value on done: 1292.0
[2023-02-25 12:43:32,422][2409407] Sum rewards: 1.754, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.522', 'AMMO2': '0.026', 'weapon7': '0.044', 'AMMO3': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.128', 'WEAPON3': '0.300', 'WEAPON4': '0.300', 'HITCOUNT': '0.320', 'ARMOR': '0.520', 'weapon4': '0.570', 'weapon3': '0.948', 'DAMAGECOUNT': '1.080', 'weapon2': '1.690', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:32,475][2409389] DAMAGECOUNT value on done: 1213.0
[2023-02-25 12:43:32,560][2409077] DAMAGECOUNT value on done: 768.0
[2023-02-25 12:43:32,640][2409103] DAMAGECOUNT value on done: 1073.0
[2023-02-25 12:43:32,641][2409103] Sum rewards: 0.664, reward structure: {'DEATHCOUNT': '-3.000', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.132', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.030', 'weapon5': '0.078', 'HITCOUNT': '0.100', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.200', 'DAMAGECOUNT': '0.273', 'weapon4': '0.404', 'weapon3': '0.846', 'ARMOR': '0.860', 'weapon2': '1.026'}
[2023-02-25 12:43:32,969][2409079] DAMAGECOUNT value on done: 686.0
[2023-02-25 12:43:32,972][2409079] Sum rewards: -3.161, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.206', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.006', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.035', 'weapon5': '0.094', 'AMMO3': '0.097', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.182', 'HITCOUNT': '0.200', 'ARMOR': '0.452', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.666', 'weapon3': '1.434', 'weapon2': '1.912'}
[2023-02-25 12:43:33,207][2409405] DAMAGECOUNT value on done: 1597.0
[2023-02-25 12:43:33,358][2409097] DAMAGECOUNT value on done: 937.0
[2023-02-25 12:43:33,359][2409097] Sum rewards: 0.777, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.224', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.030', 'AMMO4': '0.035', 'WEAPON5': '0.050', 'AMMO3': '0.069', 'weapon5': '0.086', 'WEAPON4': '0.100', 'weapon4': '0.120', 'HITCOUNT': '0.190', 'WEAPON3': '0.350', 'ARMOR': '0.408', 'DAMAGECOUNT': '0.651', 'weapon3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.452'}
[2023-02-25 12:43:33,373][2409074] Updated weights for policy 0, policy_version 9051 (0.0013)
[2023-02-25 12:43:33,643][2409565] DAMAGECOUNT value on done: 1959.0
[2023-02-25 12:43:33,643][2409565] Sum rewards: 7.176, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.470', 'AMMO5': '0.007', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'weapon5': '0.078', 'AMMO3': '0.090', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'HITCOUNT': '0.590', 'WEAPON3': '0.650', 'weapon2': '1.724', 'weapon3': '1.844', 'DAMAGECOUNT': '2.097', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:43:33,668][2409105] DAMAGECOUNT value on done: 1187.0
[2023-02-25 12:43:33,671][2409105] Sum rewards: 1.133, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.770', 'AMMO2': '0.004', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO4': '0.021', 'WEAPON1': '0.040', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.202', 'HITCOUNT': '0.350', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.080', 'weapon3': '1.470', 'weapon2': '1.568', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:33,770][2409100] DAMAGECOUNT value on done: 1242.0
[2023-02-25 12:43:33,771][2409100] Sum rewards: 1.158, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.401', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.062', 'weapon7': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.240', 'weapon4': '0.432', 'ARMOR': '0.436', 'WEAPON3': '0.500', 'weapon3': '0.888', 'DAMAGECOUNT': '1.380', 'weapon2': '1.552', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:33,918][2409373] DAMAGECOUNT value on done: 1079.0
[2023-02-25 12:43:33,919][2409373] Sum rewards: -0.133, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.445', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.015', 'WEAPON5': '0.050', 'AMMO3': '0.103', 'weapon5': '0.106', 'WEAPON4': '0.150', 'weapon4': '0.246', 'HITCOUNT': '0.270', 'ARMOR': '0.440', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.828', 'weapon3': '1.340', 'weapon2': '1.708', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:33,937][2409076] DAMAGECOUNT value on done: 1394.0
[2023-02-25 12:43:33,938][2409076] Sum rewards: 1.668, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.447', 'AMMO2': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.018', 'AMMO3': '0.092', 'weapon5': '0.104', 'WEAPON5': '0.200', 'HITCOUNT': '0.380', 'ARMOR': '0.472', 'WEAPON3': '0.650', 'weapon2': '1.042', 'DAMAGECOUNT': '1.404', 'weapon3': '1.732', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:33,990][2409548] DAMAGECOUNT value on done: 1165.0
[2023-02-25 12:43:33,994][2409548] Sum rewards: 0.961, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.960', 'AMMO4': '-0.117', 'AMMO2': '-0.023', 'AMMO5': '0.005', 'WEAPON1': '0.040', 'weapon5': '0.050', 'AMMO3': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.290', 'WEAPON3': '0.800', 'ARMOR': '0.895', 'DAMAGECOUNT': '0.915', 'weapon3': '1.716', 'weapon2': '1.850', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:34,038][2409866] DAMAGECOUNT value on done: 1394.0
[2023-02-25 12:43:34,041][2409866] Sum rewards: 3.201, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.562', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon7': '0.048', 'AMMO3': '0.060', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'HITCOUNT': '0.460', 'ARMOR': '0.938', 'weapon3': '1.268', 'DAMAGECOUNT': '1.425', 'weapon2': '1.850', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:34,086][2409078] DAMAGECOUNT value on done: 1195.0
[2023-02-25 12:43:34,089][2409078] Sum rewards: -0.021, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.032', 'WEAPON4': '0.050', 'HEALTH': '0.122', 'AMMO4': '0.124', 'AMMO3': '0.134', 'HITCOUNT': '0.170', 'WEAPON5': '0.200', 'weapon4': '0.208', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.843', 'ARMOR': '0.857', 'weapon2': '1.078', 'weapon3': '2.176', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:34,354][2409486] DAMAGECOUNT value on done: 1280.0
[2023-02-25 12:43:34,532][2409549] DAMAGECOUNT value on done: 1852.0
[2023-02-25 12:43:34,533][2409549] Sum rewards: 0.990, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.192', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon7': '0.054', 'AMMO3': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.126', 'HITCOUNT': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'weapon4': '0.608', 'weapon3': '1.022', 'weapon2': '1.450', 'DAMAGECOUNT': '1.893', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:34,571][2409355] DAMAGECOUNT value on done: 1425.0
[2023-02-25 12:43:34,572][2409355] Sum rewards: -0.592, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.590', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.012', 'AMMO4': '0.047', 'WEAPON1': '0.060', 'AMMO3': '0.082', 'WEAPON5': '0.100', 'HITCOUNT': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.230', 'ARMOR': '0.496', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.650', 'weapon3': '1.706'}
[2023-02-25 12:43:34,799][2409485] DAMAGECOUNT value on done: 959.0
[2023-02-25 12:43:34,803][2409485] Sum rewards: 0.452, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.822', 'AMMO5': '0.005', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'AMMO3': '0.079', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'HITCOUNT': '0.180', 'WEAPON4': '0.250', 'weapon4': '0.464', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.735', 'weapon2': '0.826', 'FRAGCOUNT': '1.000', 'weapon3': '1.468'}
[2023-02-25 12:43:35,144][2409074] Updated weights for policy 0, policy_version 9061 (0.0012)
[2023-02-25 12:43:35,180][2409075] DAMAGECOUNT value on done: 800.0
[2023-02-25 12:43:35,185][2409075] Sum rewards: 1.459, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.997', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'weapon5': '0.062', 'AMMO3': '0.092', 'AMMO4': '0.108', 'WEAPON4': '0.300', 'HITCOUNT': '0.380', 'weapon4': '0.424', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.086', 'weapon2': '1.422', 'weapon3': '1.648', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:35,272][2409406] DAMAGECOUNT value on done: 860.0
[2023-02-25 12:43:35,275][2409406] Sum rewards: -0.860, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.620', 'weapon7': '0.008', 'AMMO2': '0.012', 'AMMO5': '0.017', 'ARMOR': '0.044', 'AMMO4': '0.058', 'weapon5': '0.066', 'AMMO3': '0.109', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.466', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.768', 'weapon2': '0.976', 'FRAGCOUNT': '1.000', 'weapon3': '1.206'}
[2023-02-25 12:43:35,467][2409596] DAMAGECOUNT value on done: 1045.0
[2023-02-25 12:43:35,468][2409596] Sum rewards: 2.805, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.335', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.168', 'ARMOR': '0.400', 'HITCOUNT': '0.450', 'WEAPON3': '0.650', 'weapon2': '1.386', 'weapon3': '1.428', 'DAMAGECOUNT': '1.431', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:35,570][2409102] DAMAGECOUNT value on done: 1348.0
[2023-02-25 12:43:35,574][2409102] Sum rewards: -0.384, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.704', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'ARMOR': '0.036', 'AMMO2': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO3': '0.114', 'AMMO4': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.300', 'weapon4': '0.424', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.269', 'weapon3': '1.366', 'weapon2': '1.438', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:35,816][2409099] DAMAGECOUNT value on done: 1547.0
[2023-02-25 12:43:35,817][2409099] Sum rewards: -0.578, reward structure: {'DEATHCOUNT': '-3.750', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.132', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'ARMOR': '0.020', 'AMMO4': '0.029', 'AMMO3': '0.059', 'weapon5': '0.086', 'WEAPON5': '0.100', 'HITCOUNT': '0.140', 'WEAPON4': '0.200', 'weapon4': '0.276', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.648', 'weapon3': '0.832', 'weapon2': '1.040'}
[2023-02-25 12:43:35,856][2409597] DAMAGECOUNT value on done: 1002.0
[2023-02-25 12:43:35,857][2409597] Sum rewards: -1.145, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.466', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'AMMO3': '0.117', 'AMMO4': '0.129', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.226', 'DAMAGECOUNT': '0.555', 'WEAPON3': '0.650', 'weapon2': '1.514', 'weapon3': '1.970', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:36,017][2409101] DAMAGECOUNT value on done: 1558.0
[2023-02-25 12:43:36,020][2409101] Sum rewards: 2.175, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.768', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'weapon5': '0.024', 'weapon7': '0.046', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.280', 'DAMAGECOUNT': '1.038', 'weapon3': '1.130', 'weapon2': '1.836', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:36,062][2409077] DAMAGECOUNT value on done: 1226.0
[2023-02-25 12:43:36,065][2409077] Sum rewards: 1.590, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.128', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.022', 'AMMO3': '0.129', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.236', 'ARMOR': '0.452', 'HITCOUNT': '0.580', 'WEAPON3': '0.900', 'weapon3': '1.566', 'weapon2': '1.988', 'DAMAGECOUNT': '2.250', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:43:36,136][2409407] DAMAGECOUNT value on done: 1035.0
[2023-02-25 12:43:36,140][2409407] Sum rewards: 1.763, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.350', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.071', 'HITCOUNT': '0.420', 'ARMOR': '0.451', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.311', 'weapon3': '1.480', 'weapon2': '1.548', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:36,219][2409104] DAMAGECOUNT value on done: 1419.0
[2023-02-25 12:43:36,220][2409104] Sum rewards: 3.985, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.112', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'ARMOR': '0.016', 'weapon5': '0.036', 'AMMO3': '0.084', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.274', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'weapon3': '1.190', 'weapon2': '1.432', 'DAMAGECOUNT': '1.674', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:43:36,231][2409389] DAMAGECOUNT value on done: 1300.0
[2023-02-25 12:43:36,234][2409389] Sum rewards: 4.782, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.650', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.080', 'HITCOUNT': '0.340', 'WEAPON3': '0.450', 'weapon3': '1.030', 'DAMAGECOUNT': '1.071', 'weapon2': '1.348', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:36,400][2409096] DAMAGECOUNT value on done: 1063.0
[2023-02-25 12:43:36,401][2409096] Sum rewards: 1.058, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.656', 'AMMO5': '0.003', 'AMMO2': '0.010', 'ARMOR': '0.032', 'AMMO4': '0.050', 'WEAPON5': '0.050', 'weapon7': '0.056', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.190', 'WEAPON7': '0.200', 'weapon4': '0.204', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.693', 'weapon2': '0.874', 'weapon3': '1.044', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:36,674][2409103] DAMAGECOUNT value on done: 1517.0
[2023-02-25 12:43:36,675][2409103] Sum rewards: 1.781, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.043', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'ARMOR': '0.008', 'weapon5': '0.016', 'WEAPON1': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'HITCOUNT': '0.620', 'WEAPON3': '0.750', 'weapon2': '1.362', 'weapon3': '2.022', 'DAMAGECOUNT': '2.025', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:36,718][2409469] DAMAGECOUNT value on done: 1928.0
[2023-02-25 12:43:36,721][2409469] Sum rewards: 2.170, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.081', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'WEAPON4': '0.200', 'weapon4': '0.204', 'weapon5': '0.206', 'HEALTH': '0.344', 'HITCOUNT': '0.350', 'ARMOR': '0.428', 'WEAPON3': '0.450', 'weapon3': '1.026', 'DAMAGECOUNT': '1.260', 'FRAGCOUNT': '2.000', 'weapon2': '2.008'}
[2023-02-25 12:43:36,736][2409079] DAMAGECOUNT value on done: 1150.0
[2023-02-25 12:43:36,737][2409079] Sum rewards: -0.575, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.392', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'WEAPON1': '0.020', 'AMMO3': '0.060', 'HITCOUNT': '0.190', 'WEAPON4': '0.300', 'weapon4': '0.364', 'DAMAGECOUNT': '0.447', 'WEAPON3': '0.450', 'ARMOR': '0.465', 'weapon3': '0.878', 'FRAGCOUNT': '1.000', 'weapon2': '1.916'}
[2023-02-25 12:43:36,893][2409074] Updated weights for policy 0, policy_version 9071 (0.0012)
[2023-02-25 12:43:36,952][2409097] DAMAGECOUNT value on done: 1592.0
[2023-02-25 12:43:36,953][2409097] Sum rewards: 2.837, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.662', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'weapon7': '0.062', 'AMMO3': '0.083', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.312', 'HITCOUNT': '0.360', 'WEAPON3': '0.550', 'weapon3': '0.854', 'DAMAGECOUNT': '1.257', 'weapon2': '1.390', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:43:37,186][2408954] Fps is (10 sec: 24985.5, 60 sec: 25395.2, 300 sec: 25159.2). Total num frames: 37163008. Throughput: 0: 6371.5. Samples: 9285720. Policy #0 lag: (min: 0.0, avg: 11.2, max: 25.0)
[2023-02-25 12:43:37,186][2408954] Avg episode reward: [(0, '0.720')]
[2023-02-25 12:43:37,252][2409405] DAMAGECOUNT value on done: 1331.0
[2023-02-25 12:43:37,252][2409405] Sum rewards: 0.512, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.488', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.018', 'WEAPON1': '0.030', 'weapon5': '0.056', 'AMMO3': '0.089', 'WEAPON5': '0.150', 'HITCOUNT': '0.340', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.158', 'weapon3': '1.638', 'weapon2': '1.712', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:37,335][2409105] DAMAGECOUNT value on done: 957.0
[2023-02-25 12:43:37,338][2409105] Sum rewards: -4.007, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-2.000', 'HEALTH': '-0.636', 'AMMO2': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'weapon4': '0.058', 'AMMO3': '0.063', 'WEAPON5': '0.200', 'weapon5': '0.216', 'HITCOUNT': '0.230', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.615', 'weapon3': '0.774', 'weapon2': '1.496'}
[2023-02-25 12:43:37,708][2409100] DAMAGECOUNT value on done: 1365.0
[2023-02-25 12:43:37,709][2409100] Sum rewards: 2.177, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.861', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'weapon7': '0.062', 'AMMO3': '0.069', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.192', 'WEAPON7': '0.200', 'HITCOUNT': '0.310', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.966', 'weapon2': '1.040', 'weapon3': '1.126', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:37,843][2409373] DAMAGECOUNT value on done: 1600.0
[2023-02-25 12:43:37,846][2409373] Sum rewards: 0.464, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.205', 'AMMO4': '-0.087', 'AMMO2': '-0.017', 'AMMO5': '0.004', 'WEAPON1': '0.020', 'weapon5': '0.072', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.196', 'HITCOUNT': '0.520', 'WEAPON3': '0.750', 'ARMOR': '0.905', 'DAMAGECOUNT': '1.536', 'weapon3': '1.552', 'weapon2': '1.674', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:37,863][2409565] DAMAGECOUNT value on done: 1224.0
[2023-02-25 12:43:37,864][2409565] Sum rewards: 1.983, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.599', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO3': '0.058', 'weapon7': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'weapon4': '0.272', 'WEAPON3': '0.350', 'ARMOR': '0.456', 'DAMAGECOUNT': '0.690', 'weapon3': '0.776', 'weapon2': '1.612', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:37,869][2409076] DAMAGECOUNT value on done: 1657.0
[2023-02-25 12:43:37,870][2409076] Sum rewards: 3.382, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.156', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.088', 'AMMO4': '0.135', 'WEAPON4': '0.250', 'HITCOUNT': '0.420', 'ARMOR': '0.440', 'weapon4': '0.508', 'WEAPON3': '0.550', 'weapon2': '0.946', 'weapon3': '1.302', 'DAMAGECOUNT': '1.767', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:37,929][2409548] DAMAGECOUNT value on done: 990.0
[2023-02-25 12:43:37,930][2409548] Sum rewards: 3.337, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO3': '0.050', 'ARMOR': '0.067', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'WEAPON3': '0.200', 'HITCOUNT': '0.240', 'HEALTH': '0.464', 'weapon4': '0.492', 'DAMAGECOUNT': '0.702', 'weapon2': '0.740', 'FRAGCOUNT': '1.000', 'weapon3': '1.372'}
[2023-02-25 12:43:37,968][2409866] DAMAGECOUNT value on done: 1399.0
[2023-02-25 12:43:37,971][2409866] Sum rewards: 0.239, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.290', 'AMMO5': '0.003', 'AMMO2': '0.008', 'WEAPON1': '0.030', 'AMMO4': '0.039', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO3': '0.070', 'ARMOR': '0.080', 'WEAPON4': '0.200', 'weapon4': '0.204', 'HITCOUNT': '0.300', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.288', 'weapon2': '1.422', 'DAMAGECOUNT': '1.527'}
[2023-02-25 12:43:38,028][2409078] DAMAGECOUNT value on done: 1186.0
[2023-02-25 12:43:38,031][2409078] Sum rewards: -1.502, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.909', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'weapon5': '0.064', 'AMMO3': '0.086', 'weapon4': '0.138', 'HITCOUNT': '0.390', 'ARMOR': '0.474', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.550', 'weapon2': '1.360', 'DAMAGECOUNT': '1.527', 'weapon3': '1.644'}
[2023-02-25 12:43:38,303][2409486] DAMAGECOUNT value on done: 1278.0
[2023-02-25 12:43:38,304][2409486] Sum rewards: 4.227, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.181', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO2': '0.025', 'ARMOR': '0.060', 'AMMO3': '0.084', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.330', 'WEAPON3': '0.400', 'HITCOUNT': '0.490', 'weapon3': '1.166', 'weapon2': '1.896', 'DAMAGECOUNT': '1.908', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:43:38,351][2409549] DAMAGECOUNT value on done: 1325.0
[2023-02-25 12:43:38,354][2409549] Sum rewards: 0.144, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.102', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.024', 'ARMOR': '0.068', 'AMMO3': '0.081', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.320', 'weapon4': '0.390', 'WEAPON3': '0.450', 'weapon3': '1.160', 'DAMAGECOUNT': '1.386', 'weapon2': '1.742', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:38,436][2409074] Updated weights for policy 0, policy_version 9081 (0.0012)
[2023-02-25 12:43:38,511][2409485] DAMAGECOUNT value on done: 1126.0
[2023-02-25 12:43:38,512][2409485] Sum rewards: 2.341, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.512', 'weapon4': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.060', 'ARMOR': '0.064', 'weapon5': '0.076', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.230', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.855', 'weapon3': '1.344', 'weapon2': '1.696', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:38,531][2409355] DAMAGECOUNT value on done: 1091.0
[2023-02-25 12:43:38,534][2409355] Sum rewards: -2.644, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.014', 'AMMO5': '0.007', 'weapon5': '0.036', 'AMMO2': '0.039', 'AMMO3': '0.120', 'WEAPON5': '0.150', 'weapon4': '0.160', 'AMMO4': '0.193', 'HITCOUNT': '0.330', 'WEAPON4': '0.350', 'WEAPON3': '0.850', 'ARMOR': '0.873', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.407', 'weapon3': '1.762', 'weapon2': '1.842'}
[2023-02-25 12:43:38,764][2409547] DAMAGECOUNT value on done: 1257.0
[2023-02-25 12:43:38,767][2409547] Sum rewards: 3.462, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.676', 'AMMO2': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'AMMO3': '0.074', 'weapon5': '0.116', 'weapon4': '0.190', 'WEAPON5': '0.200', 'HITCOUNT': '0.330', 'ARMOR': '0.453', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.299', 'weapon2': '1.334', 'weapon3': '1.478', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:38,829][2409406] DAMAGECOUNT value on done: 1242.0
[2023-02-25 12:43:38,832][2409406] Sum rewards: 1.727, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.860', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.008', 'ARMOR': '0.022', 'AMMO4': '0.025', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'HITCOUNT': '0.350', 'WEAPON3': '0.550', 'weapon3': '1.162', 'DAMAGECOUNT': '1.527', 'weapon2': '1.902', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:38,894][2409075] DAMAGECOUNT value on done: 1002.0
[2023-02-25 12:43:38,895][2409075] Sum rewards: 1.279, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.536', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.022', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'weapon4': '0.212', 'HITCOUNT': '0.270', 'ARMOR': '0.440', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.867', 'weapon3': '1.200', 'weapon2': '1.354', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:39,360][2409596] DAMAGECOUNT value on done: 1647.0
[2023-02-25 12:43:39,360][2409596] Sum rewards: -0.730, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.950', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.086', 'WEAPON4': '0.200', 'HITCOUNT': '0.330', 'weapon4': '0.420', 'WEAPON3': '0.500', 'weapon3': '0.836', 'ARMOR': '0.870', 'DAMAGECOUNT': '1.515', 'weapon2': '1.794', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:43:39,604][2409101] DAMAGECOUNT value on done: 1343.0
[2023-02-25 12:43:39,607][2409101] Sum rewards: 2.679, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.867', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.054', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'weapon4': '0.400', 'ARMOR': '0.474', 'HITCOUNT': '0.580', 'WEAPON3': '0.600', 'weapon3': '1.412', 'weapon2': '1.726', 'DAMAGECOUNT': '1.773', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:39,622][2409077] DAMAGECOUNT value on done: 1840.0
[2023-02-25 12:43:39,625][2409077] Sum rewards: 7.862, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.046', 'AMMO4': '-0.028', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'weapon5': '0.136', 'WEAPON5': '0.150', 'weapon4': '0.202', 'ARMOR': '0.453', 'HITCOUNT': '0.590', 'WEAPON3': '0.650', 'weapon2': '1.212', 'weapon3': '1.634', 'DAMAGECOUNT': '2.721', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:43:39,763][2409099] DAMAGECOUNT value on done: 827.0
[2023-02-25 12:43:39,764][2409099] Sum rewards: -1.011, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.794', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.018', 'WEAPON5': '0.050', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'weapon5': '0.170', 'weapon4': '0.228', 'HITCOUNT': '0.250', 'ARMOR': '0.421', 'WEAPON3': '0.500', 'weapon2': '0.894', 'DAMAGECOUNT': '0.978', 'FRAGCOUNT': '1.000', 'weapon3': '1.082'}
[2023-02-25 12:43:39,792][2409074] Updated weights for policy 0, policy_version 9091 (0.0017)
[2023-02-25 12:43:39,827][2409102] DAMAGECOUNT value on done: 1371.0
[2023-02-25 12:43:39,831][2409102] Sum rewards: -1.373, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'weapon5': '0.030', 'AMMO4': '0.077', 'AMMO3': '0.078', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.182', 'HITCOUNT': '0.190', 'HEALTH': '0.253', 'WEAPON3': '0.400', 'ARMOR': '0.468', 'DAMAGECOUNT': '0.765', 'FRAGCOUNT': '1.000', 'weapon3': '1.234', 'weapon2': '1.670'}
[2023-02-25 12:43:39,855][2409597] DAMAGECOUNT value on done: 1402.0
[2023-02-25 12:43:39,855][2409597] Sum rewards: -2.881, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.990', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon5': '0.012', 'AMMO4': '0.044', 'AMMO3': '0.132', 'WEAPON5': '0.150', 'HITCOUNT': '0.270', 'WEAPON4': '0.350', 'ARMOR': '0.492', 'weapon4': '0.650', 'DAMAGECOUNT': '0.777', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.178', 'weapon3': '1.488'}
[2023-02-25 12:43:39,889][2409389] DAMAGECOUNT value on done: 1061.0
[2023-02-25 12:43:39,890][2409389] Sum rewards: -0.548, reward structure: {'DEATHCOUNT': '-9.000', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'AMMO4': '0.150', 'HEALTH': '0.164', 'HITCOUNT': '0.310', 'weapon4': '0.352', 'ARMOR': '0.420', 'WEAPON3': '0.450', 'weapon3': '1.020', 'DAMAGECOUNT': '1.146', 'FRAGCOUNT': '2.000', 'weapon2': '2.194'}
[2023-02-25 12:43:40,157][2409407] DAMAGECOUNT value on done: 1079.0
[2023-02-25 12:43:40,160][2409407] Sum rewards: 1.396, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.085', 'AMMO5': '0.005', 'weapon5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'ARMOR': '0.032', 'AMMO3': '0.068', 'weapon4': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'HITCOUNT': '0.270', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.945', 'weapon2': '1.240', 'weapon3': '1.374', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:40,198][2409104] DAMAGECOUNT value on done: 1625.0
[2023-02-25 12:43:40,201][2409104] Sum rewards: -1.323, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.992', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.119', 'WEAPON4': '0.400', 'HITCOUNT': '0.530', 'weapon4': '0.578', 'WEAPON3': '0.800', 'ARMOR': '1.282', 'weapon2': '1.548', 'DAMAGECOUNT': '1.599', 'weapon3': '1.672', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:40,204][2409103] DAMAGECOUNT value on done: 1642.0
[2023-02-25 12:43:40,205][2409103] Sum rewards: 2.754, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.303', 'AMMO4': '-0.064', 'AMMO2': '-0.013', 'AMMO3': '0.071', 'HITCOUNT': '0.400', 'WEAPON3': '0.600', 'weapon2': '1.268', 'DAMAGECOUNT': '1.452', 'weapon3': '1.592', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:40,564][2409096] DAMAGECOUNT value on done: 1323.0
[2023-02-25 12:43:40,568][2409096] Sum rewards: 2.445, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.994', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.008', 'AMMO3': '0.040', 'WEAPON1': '0.040', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.148', 'HITCOUNT': '0.330', 'WEAPON3': '0.350', 'ARMOR': '0.424', 'weapon3': '1.006', 'DAMAGECOUNT': '1.176', 'weapon2': '1.438', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:40,586][2409097] DAMAGECOUNT value on done: 1334.0
[2023-02-25 12:43:40,587][2409097] Sum rewards: -0.398, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.288', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.013', 'weapon5': '0.018', 'WEAPON1': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.089', 'ARMOR': '0.108', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'weapon4': '0.322', 'DAMAGECOUNT': '0.546', 'WEAPON3': '0.600', 'weapon2': '0.692', 'FRAGCOUNT': '1.000', 'weapon3': '1.336'}
[2023-02-25 12:43:40,762][2409405] DAMAGECOUNT value on done: 1606.0
[2023-02-25 12:43:40,927][2409079] DAMAGECOUNT value on done: 1460.0
[2023-02-25 12:43:40,928][2409079] Sum rewards: 3.441, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.054', 'AMMO3': '0.086', 'AMMO4': '0.105', 'HEALTH': '0.214', 'ARMOR': '0.400', 'HITCOUNT': '0.440', 'WEAPON3': '0.550', 'weapon3': '1.496', 'DAMAGECOUNT': '1.707', 'weapon2': '1.778', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:40,982][2409469] DAMAGECOUNT value on done: 1205.0
[2023-02-25 12:43:40,985][2409469] Sum rewards: -3.686, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.143', 'AMMO5': '0.005', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.036', 'ARMOR': '0.056', 'AMMO3': '0.078', 'WEAPON5': '0.100', 'HITCOUNT': '0.230', 'WEAPON4': '0.300', 'WEAPON3': '0.600', 'weapon4': '0.626', 'DAMAGECOUNT': '0.711', 'FRAGCOUNT': '1.000', 'weapon3': '1.252', 'weapon2': '1.696'}
[2023-02-25 12:43:41,240][2409105] DAMAGECOUNT value on done: 1309.0
[2023-02-25 12:43:41,243][2409105] Sum rewards: 4.593, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.505', 'AMMO2': '0.005', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.025', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.079', 'WEAPON4': '0.150', 'HITCOUNT': '0.400', 'ARMOR': '0.424', 'WEAPON3': '0.450', 'weapon4': '0.470', 'weapon2': '0.602', 'weapon3': '1.442', 'DAMAGECOUNT': '1.695', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:41,329][2409100] DAMAGECOUNT value on done: 959.0
[2023-02-25 12:43:41,332][2409100] Sum rewards: -1.895, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.823', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.028', 'ARMOR': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.121', 'HITCOUNT': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.542', 'DAMAGECOUNT': '0.588', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.152', 'weapon2': '1.640'}
[2023-02-25 12:43:41,577][2409078] DAMAGECOUNT value on done: 1060.0
[2023-02-25 12:43:41,578][2409078] Sum rewards: -2.642, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.386', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon5': '0.086', 'AMMO4': '0.107', 'AMMO3': '0.139', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.210', 'weapon4': '0.232', 'ARMOR': '0.432', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.092', 'weapon2': '1.538', 'weapon3': '1.658'}
[2023-02-25 12:43:41,588][2409548] DAMAGECOUNT value on done: 1055.0
[2023-02-25 12:43:41,591][2409548] Sum rewards: 3.094, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.062', 'AMMO5': '0.013', 'AMMO2': '0.015', 'weapon5': '0.060', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'weapon4': '0.204', 'WEAPON5': '0.250', 'HITCOUNT': '0.370', 'ARMOR': '0.400', 'weapon2': '0.588', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.125', 'weapon3': '1.386', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:41,620][2409074] Updated weights for policy 0, policy_version 9101 (0.0012)
[2023-02-25 12:43:41,666][2409373] DAMAGECOUNT value on done: 1595.0
[2023-02-25 12:43:41,667][2409373] Sum rewards: -0.558, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.412', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'weapon5': '0.060', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'weapon4': '0.278', 'HITCOUNT': '0.490', 'WEAPON3': '0.650', 'weapon3': '1.310', 'DAMAGECOUNT': '1.602', 'weapon2': '1.796', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:41,703][2409076] DAMAGECOUNT value on done: 1640.0
[2023-02-25 12:43:41,707][2409076] Sum rewards: -0.567, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.024', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.065', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'HEALTH': '0.238', 'HITCOUNT': '0.260', 'weapon4': '0.264', 'WEAPON3': '0.350', 'weapon3': '0.628', 'DAMAGECOUNT': '0.723', 'FRAGCOUNT': '1.000', 'weapon2': '1.506'}
[2023-02-25 12:43:41,793][2409565] DAMAGECOUNT value on done: 1261.0
[2023-02-25 12:43:41,794][2409565] Sum rewards: 3.205, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.096', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'AMMO3': '0.059', 'weapon5': '0.062', 'weapon7': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.180', 'weapon4': '0.302', 'WEAPON3': '0.350', 'ARMOR': '0.424', 'DAMAGECOUNT': '0.807', 'weapon3': '1.396', 'weapon2': '1.636', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:41,946][2409866] DAMAGECOUNT value on done: 1193.0
[2023-02-25 12:43:41,947][2409866] Sum rewards: 0.292, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.105', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'weapon4': '0.040', 'ARMOR': '0.041', 'AMMO3': '0.060', 'AMMO4': '0.123', 'HITCOUNT': '0.140', 'WEAPON4': '0.200', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.372', 'FRAGCOUNT': '1.000', 'weapon3': '1.152', 'weapon2': '1.384'}
[2023-02-25 12:43:42,186][2408954] Fps is (10 sec: 25395.2, 60 sec: 25395.2, 300 sec: 25200.8). Total num frames: 37289984. Throughput: 0: 6365.9. Samples: 9323772. Policy #0 lag: (min: 1.0, avg: 12.9, max: 26.0)
[2023-02-25 12:43:42,187][2408954] Avg episode reward: [(0, '0.757')]
[2023-02-25 12:43:42,231][2409549] DAMAGECOUNT value on done: 1272.0
[2023-02-25 12:43:42,231][2409549] Sum rewards: 0.823, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.160', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.031', 'weapon7': '0.048', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.130', 'weapon4': '0.204', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.390', 'weapon3': '0.944', 'FRAGCOUNT': '1.000', 'weapon2': '1.220'}
[2023-02-25 12:43:42,422][2409485] DAMAGECOUNT value on done: 1203.0
[2023-02-25 12:43:42,423][2409485] Sum rewards: 4.626, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.006', 'WEAPON1': '0.030', 'AMMO4': '0.032', 'AMMO3': '0.102', 'HEALTH': '0.186', 'ARMOR': '0.400', 'HITCOUNT': '0.430', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.362', 'weapon3': '1.482', 'weapon2': '1.696', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:43:42,445][2409075] DAMAGECOUNT value on done: 1562.0
[2023-02-25 12:43:42,448][2409075] Sum rewards: 7.277, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.462', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.139', 'weapon4': '0.240', 'ARMOR': '0.444', 'HITCOUNT': '0.630', 'WEAPON3': '0.750', 'weapon3': '1.462', 'weapon2': '1.562', 'DAMAGECOUNT': '2.469', 'FRAGCOUNT': '9.000'}
[2023-02-25 12:43:42,454][2409547] DAMAGECOUNT value on done: 1546.0
[2023-02-25 12:43:42,454][2409547] Sum rewards: 5.142, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.533', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'WEAPON1': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.073', 'ARMOR': '0.457', 'HITCOUNT': '0.460', 'WEAPON3': '0.500', 'weapon2': '1.292', 'weapon3': '1.414', 'DAMAGECOUNT': '1.671', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:43:42,492][2409406] DAMAGECOUNT value on done: 1453.0
[2023-02-25 12:43:42,495][2409406] Sum rewards: -0.623, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.359', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.090', 'HITCOUNT': '0.270', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.753', 'FRAGCOUNT': '1.000', 'weapon2': '1.100', 'weapon3': '1.802'}
[2023-02-25 12:43:42,512][2409355] DAMAGECOUNT value on done: 1257.0
[2023-02-25 12:43:42,513][2409355] Sum rewards: 0.651, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.850', 'AMMO5': '0.008', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.068', 'AMMO3': '0.073', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'WEAPON4': '0.350', 'HITCOUNT': '0.450', 'WEAPON3': '0.550', 'weapon4': '0.554', 'ARMOR': '0.983', 'weapon3': '1.150', 'DAMAGECOUNT': '1.569', 'weapon2': '1.774', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:42,676][2409486] DAMAGECOUNT value on done: 1597.0
[2023-02-25 12:43:42,677][2409486] Sum rewards: 1.623, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.143', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.003', 'weapon5': '0.008', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.065', 'weapon4': '0.076', 'WEAPON4': '0.100', 'HITCOUNT': '0.260', 'WEAPON3': '0.400', 'weapon3': '0.856', 'DAMAGECOUNT': '0.885', 'ARMOR': '0.922', 'weapon2': '1.630', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:43,174][2409596] DAMAGECOUNT value on done: 1815.0
[2023-02-25 12:43:43,175][2409596] Sum rewards: 1.511, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.300', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'weapon4': '0.332', 'ARMOR': '0.404', 'WEAPON3': '0.450', 'HITCOUNT': '0.490', 'FRAGCOUNT': '1.000', 'weapon2': '1.588', 'weapon3': '1.676', 'DAMAGECOUNT': '2.175'}
[2023-02-25 12:43:43,197][2409074] Updated weights for policy 0, policy_version 9111 (0.0012)
[2023-02-25 12:43:43,317][2409077] DAMAGECOUNT value on done: 1781.0
[2023-02-25 12:43:43,321][2409077] Sum rewards: 3.974, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.285', 'AMMO5': '0.009', 'AMMO2': '0.018', 'AMMO3': '0.082', 'AMMO4': '0.090', 'weapon5': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.300', 'weapon4': '0.322', 'HITCOUNT': '0.460', 'weapon3': '1.144', 'weapon2': '1.574', 'DAMAGECOUNT': '2.337', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:43:43,379][2409597] DAMAGECOUNT value on done: 711.0
[2023-02-25 12:43:43,382][2409597] Sum rewards: 2.331, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.358', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'weapon5': '0.106', 'HITCOUNT': '0.160', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.543', 'ARMOR': '0.823', 'weapon3': '1.492', 'FRAGCOUNT': '2.000', 'weapon2': '2.046'}
[2023-02-25 12:43:43,483][2409101] DAMAGECOUNT value on done: 1289.0
[2023-02-25 12:43:43,484][2409101] Sum rewards: -0.642, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.115', 'AMMO2': '0.009', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.045', 'AMMO3': '0.110', 'weapon5': '0.122', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.380', 'weapon4': '0.448', 'WEAPON3': '0.750', 'ARMOR': '0.909', 'weapon3': '1.144', 'DAMAGECOUNT': '1.749', 'weapon2': '2.126', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:43,594][2409389] DAMAGECOUNT value on done: 1026.0
[2023-02-25 12:43:43,595][2409389] Sum rewards: 2.610, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.314', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO3': '0.030', 'ARMOR': '0.048', 'weapon7': '0.058', 'AMMO4': '0.068', 'weapon5': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.300', 'weapon4': '0.468', 'DAMAGECOUNT': '0.579', 'weapon3': '0.824', 'weapon2': '1.072', 'FRAGCOUNT': '1.500'}
[2023-02-25 12:43:43,618][2409102] DAMAGECOUNT value on done: 1860.0
[2023-02-25 12:43:43,621][2409102] Sum rewards: 6.254, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.594', 'AMMO5': '0.006', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'AMMO3': '0.092', 'weapon5': '0.134', 'WEAPON5': '0.150', 'weapon4': '0.170', 'ARMOR': '0.400', 'HITCOUNT': '0.430', 'WEAPON3': '0.600', 'weapon2': '1.130', 'weapon3': '1.578', 'DAMAGECOUNT': '2.301', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:43:43,968][2409104] DAMAGECOUNT value on done: 1082.0
[2023-02-25 12:43:43,969][2409104] Sum rewards: -1.304, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.565', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.018', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'weapon4': '0.228', 'HITCOUNT': '0.240', 'ARMOR': '0.544', 'DAMAGECOUNT': '0.735', 'WEAPON3': '0.750', 'weapon3': '1.460', 'weapon2': '1.914', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:44,076][2409103] DAMAGECOUNT value on done: 1978.0
[2023-02-25 12:43:44,077][2409103] Sum rewards: 4.633, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.672', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO3': '0.066', 'AMMO4': '0.076', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'HITCOUNT': '0.460', 'weapon4': '0.482', 'weapon3': '1.124', 'DAMAGECOUNT': '1.515', 'weapon2': '1.778', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:43:44,098][2409407] DAMAGECOUNT value on done: 1560.0
[2023-02-25 12:43:44,101][2409407] Sum rewards: 1.925, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.145', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.139', 'HITCOUNT': '0.390', 'ARMOR': '0.493', 'WEAPON3': '0.750', 'weapon3': '1.468', 'DAMAGECOUNT': '1.581', 'weapon2': '1.654', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:44,210][2409099] DAMAGECOUNT value on done: 1073.0
[2023-02-25 12:43:44,213][2409099] Sum rewards: -0.692, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.538', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'AMMO5': '0.004', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.050', 'AMMO3': '0.088', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.204', 'DAMAGECOUNT': '0.294', 'WEAPON3': '0.600', 'ARMOR': '0.959', 'FRAGCOUNT': '1.000', 'weapon3': '1.638', 'weapon2': '1.802'}
[2023-02-25 12:43:44,238][2409097] DAMAGECOUNT value on done: 927.0
[2023-02-25 12:43:44,243][2409097] Sum rewards: 5.977, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon7': '0.064', 'weapon5': '0.066', 'HEALTH': '0.084', 'AMMO3': '0.088', 'AMMO4': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.300', 'weapon4': '0.344', 'ARMOR': '0.480', 'WEAPON3': '0.500', 'weapon3': '1.348', 'DAMAGECOUNT': '1.362', 'weapon2': '1.546', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:43:44,372][2409405] DAMAGECOUNT value on done: 1418.0
[2023-02-25 12:43:44,375][2409405] Sum rewards: -0.541, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.364', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO3': '0.065', 'AMMO4': '0.065', 'weapon5': '0.090', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.310', 'weapon4': '0.328', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.227', 'ARMOR': '1.303', 'weapon3': '1.308', 'weapon2': '1.686'}
[2023-02-25 12:43:44,715][2409074] Updated weights for policy 0, policy_version 9121 (0.0012)
[2023-02-25 12:43:44,790][2409079] DAMAGECOUNT value on done: 1967.0
[2023-02-25 12:43:44,794][2409079] Sum rewards: -1.085, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.388', 'AMMO5': '0.008', 'AMMO2': '0.031', 'WEAPON1': '0.050', 'weapon5': '0.062', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'AMMO4': '0.157', 'WEAPON5': '0.200', 'weapon4': '0.246', 'ARMOR': '0.481', 'HITCOUNT': '0.560', 'WEAPON3': '0.800', 'weapon2': '1.422', 'DAMAGECOUNT': '2.001', 'weapon3': '2.022', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:43:44,833][2409105] DAMAGECOUNT value on done: 1585.0
[2023-02-25 12:43:44,836][2409105] Sum rewards: 0.260, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.256', 'AMMO5': '0.004', 'AMMO2': '0.030', 'WEAPON1': '0.040', 'weapon5': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'AMMO4': '0.150', 'weapon4': '0.206', 'HITCOUNT': '0.230', 'ARMOR': '0.457', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.996', 'weapon2': '1.308', 'weapon3': '2.134', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:45,038][2409096] DAMAGECOUNT value on done: 955.0
[2023-02-25 12:43:45,042][2409096] Sum rewards: -4.477, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.208', 'AMMO5': '0.013', 'AMMO2': '0.029', 'WEAPON1': '0.050', 'weapon5': '0.070', 'AMMO3': '0.123', 'AMMO4': '0.144', 'WEAPON5': '0.200', 'HITCOUNT': '0.210', 'WEAPON4': '0.400', 'weapon4': '0.526', 'WEAPON3': '0.700', 'ARMOR': '0.883', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.101', 'weapon3': '1.300', 'weapon2': '1.482'}
[2023-02-25 12:43:45,075][2409100] DAMAGECOUNT value on done: 900.0
[2023-02-25 12:43:45,210][2409078] DAMAGECOUNT value on done: 1462.0
[2023-02-25 12:43:45,213][2409078] Sum rewards: 1.579, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.162', 'AMMO2': '0.010', 'weapon7': '0.024', 'WEAPON1': '0.040', 'AMMO4': '0.047', 'AMMO3': '0.060', 'ARMOR': '0.068', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.358', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.714', 'weapon3': '1.420', 'weapon2': '1.650', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:45,368][2409548] DAMAGECOUNT value on done: 1635.0
[2023-02-25 12:43:45,369][2409548] Sum rewards: 2.520, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.448', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'weapon5': '0.054', 'AMMO3': '0.101', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.352', 'HITCOUNT': '0.510', 'WEAPON3': '0.600', 'ARMOR': '0.882', 'weapon3': '1.458', 'DAMAGECOUNT': '1.755', 'weapon2': '1.788', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:45,438][2409469] DAMAGECOUNT value on done: 1400.0
[2023-02-25 12:43:45,635][2409565] DAMAGECOUNT value on done: 1101.0
[2023-02-25 12:43:45,638][2409565] Sum rewards: 0.865, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.524', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.029', 'weapon5': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.072', 'AMMO3': '0.085', 'WEAPON5': '0.150', 'HITCOUNT': '0.380', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.550', 'ARMOR': '0.936', 'DAMAGECOUNT': '1.182', 'weapon2': '1.630', 'weapon3': '1.782'}
[2023-02-25 12:43:45,640][2409373] DAMAGECOUNT value on done: 1846.0
[2023-02-25 12:43:45,642][2409373] Sum rewards: 1.163, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.240', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'WEAPON1': '0.040', 'WEAPON5': '0.100', 'weapon4': '0.102', 'AMMO3': '0.108', 'WEAPON4': '0.150', 'HITCOUNT': '0.410', 'WEAPON3': '0.850', 'ARMOR': '0.910', 'DAMAGECOUNT': '1.545', 'weapon3': '1.656', 'weapon2': '1.838', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:45,648][2409866] DAMAGECOUNT value on done: 1327.0
[2023-02-25 12:43:45,652][2409866] Sum rewards: 1.041, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.608', 'AMMO2': '0.019', 'AMMO3': '0.052', 'ARMOR': '0.087', 'AMMO4': '0.095', 'HITCOUNT': '0.180', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'weapon4': '0.426', 'DAMAGECOUNT': '0.501', 'weapon3': '0.696', 'weapon2': '1.192', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:45,720][2409076] DAMAGECOUNT value on done: 1269.0
[2023-02-25 12:43:45,721][2409076] Sum rewards: 1.747, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.540', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'WEAPON1': '0.020', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.092', 'weapon4': '0.094', 'HITCOUNT': '0.200', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.759', 'weapon3': '1.296', 'weapon2': '1.326', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:45,931][2409549] DAMAGECOUNT value on done: 1321.0
[2023-02-25 12:43:45,932][2409549] Sum rewards: 4.307, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.385', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.118', 'WEAPON4': '0.250', 'ARMOR': '0.504', 'HITCOUNT': '0.530', 'weapon4': '0.614', 'WEAPON3': '0.750', 'weapon2': '0.964', 'weapon3': '1.428', 'DAMAGECOUNT': '1.938', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:43:46,042][2409080] DAMAGECOUNT value on done: 1259.0
[2023-02-25 12:43:46,045][2409080] Sum rewards: 1.575, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.480', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO3': '0.123', 'AMMO4': '0.132', 'weapon4': '0.180', 'WEAPON4': '0.200', 'HITCOUNT': '0.430', 'WEAPON3': '0.650', 'weapon2': '1.294', 'weapon3': '1.704', 'DAMAGECOUNT': '1.896', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:46,146][2409547] DAMAGECOUNT value on done: 1557.0
[2023-02-25 12:43:46,149][2409547] Sum rewards: 0.850, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.138', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO3': '0.051', 'AMMO4': '0.064', 'HITCOUNT': '0.080', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.240', 'weapon4': '0.310', 'WEAPON3': '0.400', 'ARMOR': '0.448', 'FRAGCOUNT': '1.000', 'weapon3': '1.104', 'weapon2': '1.608'}
[2023-02-25 12:43:46,152][2409485] DAMAGECOUNT value on done: 925.0
[2023-02-25 12:43:46,156][2409485] Sum rewards: 1.828, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.290', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.023', 'WEAPON1': '0.050', 'AMMO3': '0.107', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'weapon4': '0.208', 'WEAPON4': '0.300', 'HITCOUNT': '0.450', 'WEAPON3': '0.600', 'weapon2': '1.476', 'DAMAGECOUNT': '1.482', 'weapon3': '1.650', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:46,188][2409406] DAMAGECOUNT value on done: 1022.0
[2023-02-25 12:43:46,188][2409406] Sum rewards: 0.819, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.860', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.126', 'weapon4': '0.226', 'WEAPON5': '0.250', 'HITCOUNT': '0.340', 'WEAPON3': '0.350', 'FRAGCOUNT': '0.500', 'weapon3': '0.950', 'DAMAGECOUNT': '1.281', 'ARMOR': '1.309', 'weapon2': '2.184'}
[2023-02-25 12:43:46,194][2409355] DAMAGECOUNT value on done: 820.0
[2023-02-25 12:43:46,522][2409486] DAMAGECOUNT value on done: 1289.0
[2023-02-25 12:43:46,523][2409486] Sum rewards: 4.399, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.375', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'AMMO3': '0.070', 'HITCOUNT': '0.390', 'WEAPON3': '0.600', 'weapon2': '1.296', 'weapon3': '1.446', 'DAMAGECOUNT': '1.467', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:43:46,529][2409075] DAMAGECOUNT value on done: 1242.0
[2023-02-25 12:43:46,614][2409074] Updated weights for policy 0, policy_version 9131 (0.0013)
[2023-02-25 12:43:46,950][2409077] DAMAGECOUNT value on done: 1268.0
[2023-02-25 12:43:46,951][2409077] Sum rewards: -2.571, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.988', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.084', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.280', 'WEAPON4': '0.350', 'weapon4': '0.480', 'ARMOR': '0.856', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.020', 'weapon3': '1.566', 'weapon2': '1.676', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:46,970][2409596] DAMAGECOUNT value on done: 1896.0
[2023-02-25 12:43:46,973][2409596] Sum rewards: 1.904, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.044', 'AMMO5': '0.003', 'AMMO2': '0.003', 'ARMOR': '0.008', 'weapon5': '0.008', 'AMMO4': '0.014', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.079', 'WEAPON4': '0.250', 'weapon4': '0.342', 'HITCOUNT': '0.360', 'WEAPON3': '0.550', 'weapon2': '1.230', 'weapon3': '1.390', 'DAMAGECOUNT': '1.392', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:47,125][2409597] DAMAGECOUNT value on done: 1626.0
[2023-02-25 12:43:47,126][2409597] Sum rewards: 1.788, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.209', 'AMMO5': '0.006', 'AMMO2': '0.008', 'WEAPON1': '0.030', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'AMMO3': '0.095', 'weapon5': '0.124', 'weapon4': '0.124', 'WEAPON5': '0.150', 'HITCOUNT': '0.270', 'WEAPON3': '0.650', 'ARMOR': '0.808', 'weapon2': '1.182', 'DAMAGECOUNT': '1.290', 'weapon3': '1.916', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:47,186][2408954] Fps is (10 sec: 25805.0, 60 sec: 25531.7, 300 sec: 25228.6). Total num frames: 37421056. Throughput: 0: 6361.3. Samples: 9361920. Policy #0 lag: (min: 1.0, avg: 12.9, max: 26.0)
[2023-02-25 12:43:47,186][2408954] Avg episode reward: [(0, '1.102')]
[2023-02-25 12:43:47,192][2409033] Saving new best policy, reward=1.102!
[2023-02-25 12:43:47,314][2409101] DAMAGECOUNT value on done: 1405.0
[2023-02-25 12:43:47,318][2409101] Sum rewards: 1.016, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.013', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.030', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.158', 'weapon4': '0.160', 'HITCOUNT': '0.210', 'DAMAGECOUNT': '0.555', 'WEAPON3': '0.600', 'weapon2': '1.014', 'weapon3': '1.440', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:47,695][2409102] DAMAGECOUNT value on done: 906.0
[2023-02-25 12:43:47,698][2409102] Sum rewards: 0.039, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.310', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'WEAPON1': '0.040', 'AMMO3': '0.073', 'HITCOUNT': '0.100', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.450', 'ARMOR': '0.459', 'FRAGCOUNT': '1.000', 'weapon2': '1.198', 'weapon3': '1.406'}
[2023-02-25 12:43:47,766][2409104] DAMAGECOUNT value on done: 848.0
[2023-02-25 12:43:47,767][2409104] Sum rewards: -1.439, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.908', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO3': '0.070', 'weapon5': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.260', 'weapon4': '0.394', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.720', 'FRAGCOUNT': '1.000', 'weapon3': '1.368', 'weapon2': '1.554'}
[2023-02-25 12:43:47,772][2409389] DAMAGECOUNT value on done: 1953.0
[2023-02-25 12:43:47,775][2409389] Sum rewards: -2.817, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.680', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'WEAPON4': '0.200', 'weapon4': '0.254', 'HITCOUNT': '0.400', 'WEAPON3': '0.650', 'ARMOR': '0.913', 'FRAGCOUNT': '1.000', 'weapon3': '1.048', 'DAMAGECOUNT': '1.317', 'weapon2': '1.868'}
[2023-02-25 12:43:47,904][2409074] Updated weights for policy 0, policy_version 9141 (0.0013)
[2023-02-25 12:43:47,952][2409103] DAMAGECOUNT value on done: 1458.0
[2023-02-25 12:43:47,953][2409103] Sum rewards: 2.277, reward structure: {'DEATHCOUNT': '-4.500', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'AMMO3': '0.048', 'weapon7': '0.048', 'WEAPON4': '0.100', 'AMMO4': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.240', 'WEAPON3': '0.250', 'HEALTH': '0.500', 'DAMAGECOUNT': '0.630', 'weapon3': '0.638', 'ARMOR': '0.804', 'FRAGCOUNT': '1.000', 'weapon2': '1.782'}
[2023-02-25 12:43:48,021][2409097] DAMAGECOUNT value on done: 1085.0
[2023-02-25 12:43:48,023][2409097] Sum rewards: -3.481, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.963', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.056', 'HITCOUNT': '0.080', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.198', 'DAMAGECOUNT': '0.249', 'ARMOR': '0.408', 'WEAPON3': '0.700', 'weapon2': '1.262', 'weapon3': '1.502', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:48,266][2409405] DAMAGECOUNT value on done: 1325.0
[2023-02-25 12:43:48,275][2409407] DAMAGECOUNT value on done: 1470.0
[2023-02-25 12:43:48,275][2409407] Sum rewards: -1.956, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.554', 'AMMO5': '0.003', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.039', 'weapon4': '0.042', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'ARMOR': '0.404', 'HITCOUNT': '0.440', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.100', 'DAMAGECOUNT': '1.512', 'weapon3': '1.582'}
[2023-02-25 12:43:48,292][2409099] DAMAGECOUNT value on done: 2053.0
[2023-02-25 12:43:48,294][2409099] Sum rewards: -0.605, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.808', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'weapon5': '0.022', 'WEAPON1': '0.030', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.136', 'HITCOUNT': '0.370', 'ARMOR': '0.484', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.032', 'weapon3': '1.272', 'weapon2': '1.662', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:48,556][2409105] DAMAGECOUNT value on done: 1487.0
[2023-02-25 12:43:48,557][2409105] Sum rewards: -1.086, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.364', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO3': '0.121', 'HITCOUNT': '0.380', 'ARMOR': '0.489', 'WEAPON3': '0.800', 'weapon2': '1.072', 'DAMAGECOUNT': '1.248', 'weapon3': '1.686', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:49,031][2409079] DAMAGECOUNT value on done: 918.0
[2023-02-25 12:43:49,131][2409100] DAMAGECOUNT value on done: 1242.0
[2023-02-25 12:43:49,135][2409100] Sum rewards: 3.497, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.412', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'weapon7': '0.048', 'AMMO4': '0.072', 'weapon5': '0.072', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.190', 'WEAPON6': '0.200', 'WEAPON5': '0.200', 'AMMO6': '0.207', 'AMMO7': '0.207', 'weapon4': '0.252', 'weapon6': '0.314', 'WEAPON3': '0.350', 'ARMOR': '0.432', 'DAMAGECOUNT': '0.795', 'weapon2': '1.004', 'weapon3': '1.034', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:49,158][2409078] DAMAGECOUNT value on done: 1005.0
[2023-02-25 12:43:49,159][2409078] Sum rewards: 0.835, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.112', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.012', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.126', 'weapon4': '0.130', 'HITCOUNT': '0.360', 'ARMOR': '0.461', 'WEAPON3': '0.700', 'weapon2': '0.906', 'DAMAGECOUNT': '1.140', 'weapon3': '1.706', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:49,187][2409096] DAMAGECOUNT value on done: 1630.0
[2023-02-25 12:43:49,192][2409096] Sum rewards: 2.826, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.186', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.076', 'WEAPON4': '0.200', 'weapon4': '0.298', 'HITCOUNT': '0.400', 'ARMOR': '0.412', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.380', 'weapon3': '1.448', 'weapon2': '1.450', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:49,471][2409373] DAMAGECOUNT value on done: 1169.0
[2023-02-25 12:43:49,474][2409373] Sum rewards: -1.399, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.244', 'AMMO2': '0.013', 'ARMOR': '0.036', 'AMMO4': '0.066', 'AMMO3': '0.107', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.350', 'HITCOUNT': '0.600', 'weapon4': '0.722', 'WEAPON3': '0.750', 'weapon2': '1.212', 'weapon3': '1.504', 'DAMAGECOUNT': '1.884', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:49,474][2409866] DAMAGECOUNT value on done: 1055.0
[2023-02-25 12:43:49,477][2409866] Sum rewards: -1.095, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.954', 'AMMO2': '0.007', 'WEAPON1': '0.030', 'AMMO4': '0.035', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'weapon4': '0.188', 'HITCOUNT': '0.190', 'ARMOR': '0.457', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.574', 'weapon3': '1.670'}
[2023-02-25 12:43:49,489][2409469] DAMAGECOUNT value on done: 1921.0
[2023-02-25 12:43:49,493][2409469] Sum rewards: -0.934, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.366', 'AMMO2': '0.006', 'AMMO4': '0.028', 'AMMO3': '0.076', 'WEAPON4': '0.150', 'weapon4': '0.214', 'HITCOUNT': '0.350', 'WEAPON3': '0.550', 'ARMOR': '0.852', 'weapon3': '1.046', 'DAMAGECOUNT': '1.188', 'weapon2': '1.472', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:49,571][2409548] DAMAGECOUNT value on done: 1209.0
[2023-02-25 12:43:49,572][2409548] Sum rewards: -4.068, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.660', 'AMMO5': '0.010', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'WEAPON1': '0.050', 'weapon5': '0.054', 'AMMO4': '0.069', 'weapon4': '0.112', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'HITCOUNT': '0.460', 'WEAPON3': '1.150', 'DAMAGECOUNT': '1.560', 'weapon2': '1.806', 'weapon3': '1.884', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:49,610][2409076] DAMAGECOUNT value on done: 855.0
[2023-02-25 12:43:49,614][2409076] Sum rewards: -1.799, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.852', 'AMMO4': '-0.062', 'AMMO2': '-0.012', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'weapon5': '0.060', 'AMMO3': '0.119', 'HITCOUNT': '0.170', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.850', 'ARMOR': '0.919', 'weapon3': '1.532', 'weapon2': '1.850', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:49,671][2409549] DAMAGECOUNT value on done: 1183.0
[2023-02-25 12:43:49,672][2409549] Sum rewards: -2.447, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.794', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'weapon4': '0.002', 'AMMO5': '0.004', 'WEAPON4': '0.050', 'weapon5': '0.058', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'HITCOUNT': '0.300', 'ARMOR': '0.450', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.948', 'FRAGCOUNT': '1.000', 'weapon3': '1.518', 'weapon2': '1.640'}
[2023-02-25 12:43:49,715][2409406] DAMAGECOUNT value on done: 1134.0
[2023-02-25 12:43:49,718][2409406] Sum rewards: 4.104, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.171', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'ARMOR': '0.024', 'AMMO4': '0.028', 'AMMO3': '0.040', 'WEAPON5': '0.050', 'HITCOUNT': '0.130', 'weapon5': '0.172', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.750', 'weapon3': '0.992', 'FRAGCOUNT': '2.000', 'weapon2': '2.018'}
[2023-02-25 12:43:49,727][2409565] DAMAGECOUNT value on done: 1643.0
[2023-02-25 12:43:49,730][2409565] Sum rewards: 0.325, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.015', 'AMMO2': '0.005', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.022', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'HITCOUNT': '0.130', 'weapon4': '0.184', 'DAMAGECOUNT': '0.474', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.494', 'weapon2': '1.722'}
[2023-02-25 12:43:49,878][2409485] DAMAGECOUNT value on done: 1074.0
[2023-02-25 12:43:49,878][2409485] Sum rewards: -1.614, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.186', 'AMMO5': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.056', 'AMMO4': '0.085', 'AMMO3': '0.119', 'WEAPON5': '0.250', 'HITCOUNT': '0.260', 'ARMOR': '0.400', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.792', 'weapon2': '1.760', 'weapon3': '1.850'}
[2023-02-25 12:43:49,987][2409074] Updated weights for policy 0, policy_version 9151 (0.0012)
[2023-02-25 12:43:50,050][2409355] DAMAGECOUNT value on done: 1031.0
[2023-02-25 12:43:50,052][2409355] Sum rewards: 0.676, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.308', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.055', 'AMMO4': '0.090', 'weapon4': '0.218', 'HITCOUNT': '0.340', 'WEAPON3': '0.400', 'ARMOR': '0.880', 'weapon3': '0.886', 'DAMAGECOUNT': '0.987', 'FRAGCOUNT': '1.000', 'weapon2': '1.290'}
[2023-02-25 12:43:50,197][2409547] DAMAGECOUNT value on done: 1332.0
[2023-02-25 12:43:50,201][2409547] Sum rewards: -1.097, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.572', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO3': '0.091', 'HITCOUNT': '0.230', 'WEAPON4': '0.300', 'weapon4': '0.448', 'ARMOR': '0.472', 'WEAPON3': '0.650', 'weapon3': '1.224', 'DAMAGECOUNT': '1.389', 'weapon2': '1.740', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:50,240][2409080] DAMAGECOUNT value on done: 1324.0
[2023-02-25 12:43:50,244][2409080] Sum rewards: -1.227, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.394', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'WEAPON1': '0.070', 'ARMOR': '0.072', 'AMMO3': '0.093', 'WEAPON4': '0.150', 'HITCOUNT': '0.270', 'weapon4': '0.354', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.930', 'FRAGCOUNT': '1.000', 'weapon3': '1.056', 'weapon2': '1.574'}
[2023-02-25 12:43:50,449][2409075] DAMAGECOUNT value on done: 1622.0
[2023-02-25 12:43:50,452][2409075] Sum rewards: 6.057, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.906', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON1': '0.030', 'AMMO4': '0.056', 'weapon5': '0.090', 'AMMO3': '0.109', 'weapon4': '0.140', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'ARMOR': '0.424', 'HITCOUNT': '0.620', 'WEAPON3': '0.750', 'weapon2': '1.678', 'weapon3': '1.786', 'DAMAGECOUNT': '2.211', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:43:50,540][2409077] DAMAGECOUNT value on done: 1508.0
[2023-02-25 12:43:50,541][2409077] Sum rewards: 3.863, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.062', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.047', 'weapon5': '0.054', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.252', 'WEAPON3': '0.400', 'ARMOR': '0.480', 'HITCOUNT': '0.520', 'weapon3': '1.270', 'weapon2': '2.032', 'DAMAGECOUNT': '2.238', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:50,799][2409597] DAMAGECOUNT value on done: 1629.0
[2023-02-25 12:43:50,800][2409597] Sum rewards: -2.055, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.015', 'AMMO2': '0.007', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'weapon4': '0.024', 'AMMO4': '0.033', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon5': '0.116', 'WEAPON5': '0.250', 'HITCOUNT': '0.390', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'weapon3': '1.170', 'DAMAGECOUNT': '1.305', 'FRAGCOUNT': '1.500', 'weapon2': '2.076'}
[2023-02-25 12:43:50,886][2409596] DAMAGECOUNT value on done: 1271.0
[2023-02-25 12:43:50,887][2409596] Sum rewards: -2.588, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.762', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.016', 'WEAPON1': '0.040', 'ARMOR': '0.060', 'AMMO4': '0.064', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'weapon4': '0.190', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.720', 'FRAGCOUNT': '1.000', 'weapon2': '1.342', 'weapon3': '1.866'}
[2023-02-25 12:43:50,893][2409101] DAMAGECOUNT value on done: 1923.0
[2023-02-25 12:43:50,896][2409101] Sum rewards: 4.726, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.359', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.089', 'AMMO3': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.194', 'HITCOUNT': '0.540', 'WEAPON3': '0.600', 'weapon2': '1.718', 'weapon3': '1.784', 'DAMAGECOUNT': '2.778', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:43:51,003][2409486] DAMAGECOUNT value on done: 1465.0
[2023-02-25 12:43:51,190][2409074] Updated weights for policy 0, policy_version 9161 (0.0013)
[2023-02-25 12:43:51,395][2409102] DAMAGECOUNT value on done: 1549.0
[2023-02-25 12:43:51,397][2409102] Sum rewards: 6.066, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.372', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.006', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.053', 'weapon5': '0.064', 'WEAPON3': '0.400', 'ARMOR': '0.405', 'HITCOUNT': '0.410', 'weapon3': '1.134', 'DAMAGECOUNT': '1.797', 'weapon2': '2.102', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:43:51,439][2409389] DAMAGECOUNT value on done: 1340.0
[2023-02-25 12:43:51,440][2409389] Sum rewards: 1.213, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.024', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.066', 'AMMO4': '0.085', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.170', 'weapon4': '0.206', 'WEAPON3': '0.300', 'HEALTH': '0.436', 'DAMAGECOUNT': '0.522', 'weapon3': '0.886', 'FRAGCOUNT': '1.000', 'weapon2': '1.528'}
[2023-02-25 12:43:51,464][2409103] DAMAGECOUNT value on done: 985.0
[2023-02-25 12:43:51,467][2409103] Sum rewards: -2.016, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.468', 'AMMO2': '0.004', 'AMMO4': '0.018', 'WEAPON4': '0.050', 'AMMO3': '0.099', 'weapon4': '0.158', 'HITCOUNT': '0.360', 'ARMOR': '0.462', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.120', 'DAMAGECOUNT': '1.155', 'weapon2': '1.726'}
[2023-02-25 12:43:51,799][2409104] DAMAGECOUNT value on done: 999.0
[2023-02-25 12:43:51,821][2409405] DAMAGECOUNT value on done: 1478.0
[2023-02-25 12:43:51,822][2409405] Sum rewards: 1.058, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.922', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'WEAPON1': '0.020', 'AMMO3': '0.066', 'HITCOUNT': '0.260', 'WEAPON3': '0.450', 'ARMOR': '0.856', 'DAMAGECOUNT': '0.966', 'weapon3': '0.994', 'weapon2': '1.626', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:51,965][2409097] DAMAGECOUNT value on done: 971.0
[2023-02-25 12:43:51,966][2409097] Sum rewards: 1.163, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.440', 'AMMO4': '-0.098', 'AMMO2': '-0.020', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'AMMO3': '0.071', 'weapon4': '0.078', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.300', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.975', 'weapon3': '0.990', 'weapon2': '1.998', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:51,980][2409407] DAMAGECOUNT value on done: 1574.0
[2023-02-25 12:43:51,983][2409407] Sum rewards: 1.694, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.550', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.094', 'HITCOUNT': '0.430', 'WEAPON3': '0.550', 'weapon2': '1.154', 'DAMAGECOUNT': '1.350', 'weapon3': '1.534', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:52,186][2408954] Fps is (10 sec: 26214.4, 60 sec: 25531.8, 300 sec: 25200.8). Total num frames: 37552128. Throughput: 0: 6344.8. Samples: 9380676. Policy #0 lag: (min: 0.0, avg: 11.4, max: 24.0)
[2023-02-25 12:43:52,186][2408954] Avg episode reward: [(0, '0.622')]
[2023-02-25 12:43:52,291][2409105] DAMAGECOUNT value on done: 1315.0
[2023-02-25 12:43:52,292][2409105] Sum rewards: 0.738, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.812', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.011', 'ARMOR': '0.036', 'weapon5': '0.036', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'weapon4': '0.120', 'WEAPON5': '0.250', 'HITCOUNT': '0.440', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.614', 'weapon2': '1.710', 'weapon3': '1.710', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:52,550][2409099] DAMAGECOUNT value on done: 1521.0
[2023-02-25 12:43:52,551][2409099] Sum rewards: 3.348, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.598', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.026', 'weapon7': '0.056', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.208', 'ARMOR': '0.432', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'weapon3': '1.266', 'DAMAGECOUNT': '1.539', 'weapon2': '1.928', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:43:52,709][2409078] DAMAGECOUNT value on done: 1437.0
[2023-02-25 12:43:52,710][2409078] Sum rewards: 5.901, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.480', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'ARMOR': '0.056', 'weapon5': '0.060', 'AMMO3': '0.073', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.142', 'HITCOUNT': '0.420', 'WEAPON3': '0.500', 'weapon3': '1.132', 'weapon2': '1.390', 'DAMAGECOUNT': '2.025', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:52,760][2409100] DAMAGECOUNT value on done: 840.0
[2023-02-25 12:43:52,762][2409100] Sum rewards: 1.514, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.144', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.013', 'AMMO3': '0.020', 'weapon5': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'HITCOUNT': '0.120', 'weapon4': '0.128', 'WEAPON3': '0.200', 'DAMAGECOUNT': '0.306', 'weapon3': '0.500', 'FRAGCOUNT': '1.000', 'ARMOR': '1.258', 'weapon2': '1.672'}
[2023-02-25 12:43:52,789][2409079] DAMAGECOUNT value on done: 1240.0
[2023-02-25 12:43:52,790][2409079] Sum rewards: -0.676, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.966', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.092', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'HITCOUNT': '0.220', 'weapon4': '0.352', 'ARMOR': '0.524', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.657', 'weapon3': '1.492', 'weapon2': '1.556', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:52,845][2409074] Updated weights for policy 0, policy_version 9171 (0.0013)
[2023-02-25 12:43:53,102][2409096] DAMAGECOUNT value on done: 1460.0
[2023-02-25 12:43:53,102][2409096] Sum rewards: -1.191, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.576', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.012', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO3': '0.112', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'weapon4': '0.220', 'HITCOUNT': '0.360', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.600', 'ARMOR': '0.861', 'DAMAGECOUNT': '1.227', 'weapon3': '1.478', 'weapon2': '1.902'}
[2023-02-25 12:43:53,113][2409548] DAMAGECOUNT value on done: 1300.0
[2023-02-25 12:43:53,116][2409548] Sum rewards: 7.185, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.144', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.055', 'AMMO3': '0.060', 'weapon7': '0.062', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.332', 'WEAPON3': '0.350', 'HITCOUNT': '0.450', 'ARMOR': '0.455', 'weapon2': '1.386', 'weapon3': '1.430', 'DAMAGECOUNT': '1.794', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:43:53,155][2409549] DAMAGECOUNT value on done: 1733.0
[2023-02-25 12:43:53,157][2409549] Sum rewards: -1.060, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.170', 'AMMO4': '-0.088', 'AMMO2': '-0.017', 'AMMO5': '0.005', 'weapon5': '0.028', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.380', 'HITCOUNT': '0.390', 'ARMOR': '0.452', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.260', 'weapon3': '1.334', 'weapon2': '1.886', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:53,480][2409565] DAMAGECOUNT value on done: 1000.0
[2023-02-25 12:43:53,480][2409565] Sum rewards: -0.395, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.145', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'weapon4': '0.220', 'HITCOUNT': '0.390', 'ARMOR': '0.428', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.146', 'DAMAGECOUNT': '1.230', 'weapon3': '1.518'}
[2023-02-25 12:43:53,496][2409469] DAMAGECOUNT value on done: 1381.0
[2023-02-25 12:43:53,500][2409469] Sum rewards: 0.254, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.750', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO3': '0.063', 'WEAPON4': '0.100', 'HITCOUNT': '0.230', 'weapon4': '0.308', 'WEAPON3': '0.450', 'ARMOR': '0.500', 'DAMAGECOUNT': '0.855', 'weapon3': '0.972', 'FRAGCOUNT': '1.000', 'weapon2': '1.028'}
[2023-02-25 12:43:53,550][2409406] DAMAGECOUNT value on done: 1201.0
[2023-02-25 12:43:53,551][2409406] Sum rewards: -0.633, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.274', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.047', 'weapon4': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.148', 'HITCOUNT': '0.330', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.071', 'ARMOR': '1.306', 'weapon3': '1.522', 'weapon2': '2.022', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:53,617][2409485] DAMAGECOUNT value on done: 1241.0
[2023-02-25 12:43:53,621][2409485] Sum rewards: 2.905, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.101', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon7': '0.058', 'weapon5': '0.076', 'AMMO3': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.132', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.416', 'HITCOUNT': '0.430', 'weapon4': '0.488', 'WEAPON3': '0.550', 'weapon2': '1.276', 'weapon3': '1.428', 'DAMAGECOUNT': '1.560', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:53,696][2409373] DAMAGECOUNT value on done: 1051.0
[2023-02-25 12:43:53,697][2409373] Sum rewards: 2.498, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.806', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.008', 'WEAPON4': '0.050', 'AMMO3': '0.086', 'weapon5': '0.120', 'weapon4': '0.140', 'WEAPON5': '0.150', 'HITCOUNT': '0.260', 'WEAPON3': '0.500', 'ARMOR': '0.519', 'DAMAGECOUNT': '1.170', 'weapon3': '1.474', 'weapon2': '1.820', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:53,867][2409076] DAMAGECOUNT value on done: 1093.0
[2023-02-25 12:43:54,021][2409866] DAMAGECOUNT value on done: 688.0
[2023-02-25 12:43:54,022][2409866] Sum rewards: -3.534, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.490', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.068', 'HITCOUNT': '0.080', 'AMMO4': '0.090', 'AMMO3': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.330', 'weapon4': '0.468', 'WEAPON3': '0.800', 'ARMOR': '0.895', 'FRAGCOUNT': '1.000', 'weapon3': '1.414', 'weapon2': '1.534'}
[2023-02-25 12:43:54,118][2409080] DAMAGECOUNT value on done: 1592.0
[2023-02-25 12:43:54,122][2409080] Sum rewards: 7.572, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.160', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO3': '0.040', 'weapon5': '0.040', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'weapon4': '0.188', 'WEAPON3': '0.200', 'HITCOUNT': '0.370', 'weapon3': '0.962', 'weapon2': '1.142', 'DAMAGECOUNT': '1.431', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:43:54,144][2409547] DAMAGECOUNT value on done: 2140.0
[2023-02-25 12:43:54,148][2409547] Sum rewards: 6.422, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'AMMO3': '0.040', 'WEAPON5': '0.050', 'weapon7': '0.052', 'weapon5': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.108', 'HITCOUNT': '0.160', 'WEAPON3': '0.200', 'HEALTH': '0.208', 'weapon4': '0.404', 'weapon3': '0.706', 'weapon2': '1.288', 'ARMOR': '1.370', 'DAMAGECOUNT': '1.845', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:54,309][2409077] DAMAGECOUNT value on done: 1462.0
[2023-02-25 12:43:54,309][2409077] Sum rewards: 2.542, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon4': '0.028', 'AMMO3': '0.040', 'WEAPON4': '0.050', 'weapon7': '0.058', 'AMMO4': '0.085', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON3': '0.250', 'HITCOUNT': '0.280', 'ARMOR': '0.440', 'weapon3': '0.754', 'DAMAGECOUNT': '0.810', 'FRAGCOUNT': '1.000', 'HEALTH': '1.071', 'weapon2': '1.838'}
[2023-02-25 12:43:54,370][2409101] DAMAGECOUNT value on done: 679.0
[2023-02-25 12:43:54,371][2409101] Sum rewards: -0.329, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.020', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'WEAPON1': '0.010', 'AMMO3': '0.030', 'HITCOUNT': '0.140', 'WEAPON3': '0.250', 'DAMAGECOUNT': '0.585', 'weapon3': '0.724', 'ARMOR': '0.887', 'FRAGCOUNT': '1.000', 'weapon2': '1.592'}
[2023-02-25 12:43:54,539][2409075] DAMAGECOUNT value on done: 1498.0
[2023-02-25 12:43:54,543][2409075] Sum rewards: 0.782, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.539', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO3': '0.030', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'weapon4': '0.070', 'WEAPON4': '0.100', 'WEAPON3': '0.250', 'HITCOUNT': '0.340', 'weapon3': '0.726', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.218', 'weapon2': '1.250'}
[2023-02-25 12:43:54,548][2409074] Updated weights for policy 0, policy_version 9181 (0.0012)
[2023-02-25 12:43:54,570][2409355] DAMAGECOUNT value on done: 1462.0
[2023-02-25 12:43:54,571][2409355] Sum rewards: -0.900, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.260', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.077', 'weapon4': '0.190', 'HITCOUNT': '0.390', 'ARMOR': '0.532', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.122', 'weapon3': '1.450', 'weapon2': '1.724'}
[2023-02-25 12:43:54,601][2409596] DAMAGECOUNT value on done: 1289.0
[2023-02-25 12:43:54,605][2409596] Sum rewards: 1.482, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.938', 'AMMO2': '0.008', 'AMMO5': '0.009', 'weapon5': '0.026', 'AMMO4': '0.042', 'AMMO3': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'weapon4': '0.472', 'HITCOUNT': '0.520', 'WEAPON3': '0.700', 'weapon2': '0.832', 'DAMAGECOUNT': '1.665', 'weapon3': '1.748', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:54,735][2409597] DAMAGECOUNT value on done: 1387.0
[2023-02-25 12:43:54,737][2409597] Sum rewards: -0.315, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.130', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.054', 'AMMO4': '0.073', 'AMMO3': '0.113', 'WEAPON5': '0.200', 'HITCOUNT': '0.200', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.260', 'weapon2': '1.544', 'weapon3': '2.076'}
[2023-02-25 12:43:54,780][2409468] DAMAGECOUNT value on done: 1623.0
[2023-02-25 12:43:54,905][2409486] DAMAGECOUNT value on done: 1118.0
[2023-02-25 12:43:54,908][2409486] Sum rewards: 4.160, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.793', 'AMMO2': '0.000', 'AMMO4': '0.002', 'WEAPON1': '0.010', 'AMMO3': '0.045', 'HITCOUNT': '0.310', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'weapon3': '0.868', 'DAMAGECOUNT': '0.984', 'weapon2': '1.734', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:55,096][2409102] DAMAGECOUNT value on done: 1295.0
[2023-02-25 12:43:55,096][2409102] Sum rewards: -3.396, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.258', 'AMMO2': '0.007', 'WEAPON1': '0.030', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'weapon4': '0.064', 'AMMO3': '0.163', 'HITCOUNT': '0.250', 'ARMOR': '0.444', 'DAMAGECOUNT': '0.870', 'WEAPON3': '0.950', 'weapon2': '1.398', 'FRAGCOUNT': '2.000', 'weapon3': '2.100'}
[2023-02-25 12:43:55,395][2409103] DAMAGECOUNT value on done: 1207.0
[2023-02-25 12:43:55,398][2409103] Sum rewards: -0.003, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.220', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO3': '0.030', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.056', 'AMMO4': '0.062', 'HITCOUNT': '0.120', 'WEAPON3': '0.200', 'DAMAGECOUNT': '0.315', 'weapon3': '0.716', 'FRAGCOUNT': '1.000', 'weapon2': '1.356'}
[2023-02-25 12:43:55,461][2409104] DAMAGECOUNT value on done: 1117.0
[2023-02-25 12:43:55,464][2409104] Sum rewards: 2.939, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.134', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'weapon5': '0.052', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'weapon4': '0.168', 'WEAPON4': '0.200', 'HITCOUNT': '0.310', 'ARMOR': '0.412', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.455', 'weapon3': '1.680', 'weapon2': '1.796', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:43:55,487][2409389] DAMAGECOUNT value on done: 1712.0
[2023-02-25 12:43:55,488][2409389] Sum rewards: -0.607, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.874', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.037', 'weapon5': '0.058', 'AMMO3': '0.081', 'WEAPON5': '0.100', 'AMMO4': '0.186', 'WEAPON4': '0.250', 'HITCOUNT': '0.330', 'weapon4': '0.366', 'ARMOR': '0.476', 'WEAPON3': '0.550', 'weapon3': '1.428', 'DAMAGECOUNT': '1.470', 'weapon2': '1.662', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:55,706][2409405] DAMAGECOUNT value on done: 699.0
[2023-02-25 12:43:55,709][2409405] Sum rewards: -2.202, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.472', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.066', 'AMMO4': '0.138', 'HITCOUNT': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.464', 'weapon4': '0.596', 'DAMAGECOUNT': '0.822', 'weapon2': '1.064', 'weapon3': '1.228'}
[2023-02-25 12:43:55,745][2409097] DAMAGECOUNT value on done: 946.0
[2023-02-25 12:43:55,793][2409407] DAMAGECOUNT value on done: 1102.0
[2023-02-25 12:43:55,797][2409407] Sum rewards: 1.413, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.472', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon7': '0.052', 'AMMO4': '0.084', 'AMMO3': '0.091', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.240', 'weapon4': '0.398', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.765', 'ARMOR': '0.857', 'weapon3': '0.986', 'weapon2': '1.902', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:55,814][2409074] Updated weights for policy 0, policy_version 9191 (0.0012)
[2023-02-25 12:43:56,177][2409105] DAMAGECOUNT value on done: 1296.0
[2023-02-25 12:43:56,178][2409105] Sum rewards: 2.486, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.447', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'WEAPON4': '0.050', 'AMMO3': '0.096', 'weapon4': '0.154', 'HITCOUNT': '0.430', 'ARMOR': '0.480', 'WEAPON3': '0.700', 'weapon2': '1.356', 'DAMAGECOUNT': '1.533', 'weapon3': '1.904', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:56,505][2409099] DAMAGECOUNT value on done: 1730.0
[2023-02-25 12:43:56,508][2409099] Sum rewards: 1.145, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.365', 'AMMO2': '0.010', 'AMMO5': '0.010', 'AMMO4': '0.049', 'weapon5': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'weapon4': '0.234', 'HITCOUNT': '0.700', 'WEAPON3': '1.000', 'weapon2': '1.316', 'weapon3': '1.778', 'DAMAGECOUNT': '2.367', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:43:56,636][2409079] DAMAGECOUNT value on done: 1178.0
[2023-02-25 12:43:56,639][2409079] Sum rewards: 3.445, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.273', 'AMMO2': '0.006', 'AMMO5': '0.009', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'AMMO3': '0.086', 'weapon5': '0.178', 'WEAPON5': '0.300', 'HITCOUNT': '0.460', 'WEAPON3': '0.500', 'ARMOR': '0.863', 'weapon3': '1.324', 'DAMAGECOUNT': '1.743', 'weapon2': '1.920', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:56,646][2409078] DAMAGECOUNT value on done: 771.0
[2023-02-25 12:43:56,855][2409549] DAMAGECOUNT value on done: 1535.0
[2023-02-25 12:43:56,872][2409549] Sum rewards: 1.207, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.388', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'weapon5': '0.060', 'AMMO3': '0.065', 'AMMO4': '0.079', 'WEAPON5': '0.150', 'weapon4': '0.158', 'HITCOUNT': '0.290', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.912', 'FRAGCOUNT': '1.000', 'weapon3': '1.188', 'ARMOR': '1.288', 'weapon2': '1.866'}
[2023-02-25 12:43:56,906][2409100] DAMAGECOUNT value on done: 1333.0
[2023-02-25 12:43:56,907][2409100] Sum rewards: 2.887, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.587', 'AMMO5': '0.003', 'AMMO2': '0.012', 'ARMOR': '0.016', 'WEAPON1': '0.020', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.080', 'WEAPON4': '0.200', 'weapon4': '0.336', 'HITCOUNT': '0.360', 'WEAPON3': '0.550', 'weapon2': '1.256', 'DAMAGECOUNT': '1.356', 'weapon3': '1.884', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:43:56,969][2409096] DAMAGECOUNT value on done: 1033.0
[2023-02-25 12:43:56,969][2409096] Sum rewards: -0.102, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.440', 'AMMO2': '0.007', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO4': '0.036', 'weapon5': '0.048', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'HITCOUNT': '0.280', 'weapon4': '0.300', 'WEAPON3': '0.850', 'weapon2': '1.276', 'DAMAGECOUNT': '1.395', 'weapon3': '2.084', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:57,076][2409565] DAMAGECOUNT value on done: 1101.0
[2023-02-25 12:43:57,080][2409565] Sum rewards: 0.752, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.570', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.022', 'AMMO3': '0.038', 'weapon7': '0.102', 'AMMO4': '0.111', 'HITCOUNT': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.200', 'weapon4': '0.288', 'weapon3': '0.538', 'DAMAGECOUNT': '0.552', 'FRAGCOUNT': '1.000', 'weapon2': '1.438'}
[2023-02-25 12:43:57,186][2408954] Fps is (10 sec: 24984.7, 60 sec: 25326.8, 300 sec: 25228.6). Total num frames: 37670912. Throughput: 0: 6336.5. Samples: 9418488. Policy #0 lag: (min: 0.0, avg: 11.4, max: 24.0)
[2023-02-25 12:43:57,187][2408954] Avg episode reward: [(0, '0.593')]
[2023-02-25 12:43:57,211][2409469] DAMAGECOUNT value on done: 996.0
[2023-02-25 12:43:57,212][2409469] Sum rewards: 0.298, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.324', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'weapon5': '0.170', 'weapon4': '0.214', 'HITCOUNT': '0.310', 'ARMOR': '0.440', 'WEAPON3': '0.450', 'weapon3': '0.684', 'DAMAGECOUNT': '1.314', 'FRAGCOUNT': '2.000', 'weapon2': '2.006'}
[2023-02-25 12:43:57,280][2409406] DAMAGECOUNT value on done: 1234.0
[2023-02-25 12:43:57,284][2409406] Sum rewards: 1.247, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.278', 'AMMO2': '0.012', 'AMMO4': '0.058', 'ARMOR': '0.084', 'AMMO3': '0.100', 'WEAPON4': '0.300', 'HITCOUNT': '0.330', 'WEAPON3': '0.550', 'weapon4': '0.560', 'DAMAGECOUNT': '0.969', 'weapon3': '1.124', 'weapon2': '1.438', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:57,476][2409548] DAMAGECOUNT value on done: 985.0
[2023-02-25 12:43:57,477][2409548] Sum rewards: -3.262, reward structure: {'DEATHCOUNT': '-5.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.844', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.041', 'weapon7': '0.056', 'HITCOUNT': '0.060', 'AMMO3': '0.063', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.180', 'WEAPON7': '0.200', 'weapon4': '0.328', 'WEAPON3': '0.400', 'ARMOR': '0.452', 'weapon3': '0.934', 'weapon2': '1.010'}
[2023-02-25 12:43:57,675][2409485] DAMAGECOUNT value on done: 868.0
[2023-02-25 12:43:57,676][2409485] Sum rewards: 1.915, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.284', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'HITCOUNT': '0.240', 'WEAPON3': '0.300', 'weapon4': '0.326', 'DAMAGECOUNT': '0.711', 'weapon3': '0.808', 'ARMOR': '0.899', 'weapon2': '1.902', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:57,686][2409373] DAMAGECOUNT value on done: 1283.0
[2023-02-25 12:43:57,689][2409373] Sum rewards: -0.232, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.663', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'weapon5': '0.030', 'AMMO3': '0.072', 'WEAPON5': '0.100', 'HITCOUNT': '0.240', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.732', 'ARMOR': '1.307', 'weapon3': '1.312', 'weapon2': '1.668', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:57,772][2409866] DAMAGECOUNT value on done: 1346.0
[2023-02-25 12:43:57,775][2409866] Sum rewards: 0.455, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.060', 'AMMO2': '0.009', 'AMMO4': '0.045', 'ARMOR': '0.057', 'AMMO3': '0.099', 'WEAPON4': '0.200', 'HITCOUNT': '0.340', 'weapon4': '0.510', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.026', 'weapon3': '1.350', 'weapon2': '1.828', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:57,807][2409547] DAMAGECOUNT value on done: 1145.0
[2023-02-25 12:43:57,808][2409547] Sum rewards: 3.458, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.357', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO3': '0.069', 'WEAPON3': '0.300', 'HITCOUNT': '0.450', 'ARMOR': '0.456', 'weapon2': '1.252', 'weapon3': '1.256', 'DAMAGECOUNT': '1.530', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:57,808][2409080] DAMAGECOUNT value on done: 1415.0
[2023-02-25 12:43:57,811][2409080] Sum rewards: 8.325, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.657', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.015', 'ARMOR': '0.020', 'AMMO4': '0.077', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.300', 'weapon4': '0.448', 'WEAPON3': '0.550', 'HITCOUNT': '0.580', 'weapon2': '1.114', 'weapon3': '2.092', 'DAMAGECOUNT': '2.337', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:43:57,860][2409076] DAMAGECOUNT value on done: 1783.0
[2023-02-25 12:43:57,861][2409076] Sum rewards: 5.512, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.281', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'WEAPON1': '0.010', 'AMMO3': '0.064', 'ARMOR': '0.483', 'WEAPON3': '0.550', 'HITCOUNT': '0.570', 'weapon3': '1.390', 'DAMAGECOUNT': '1.788', 'weapon2': '1.958', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:43:57,985][2409074] Updated weights for policy 0, policy_version 9201 (0.0012)
[2023-02-25 12:43:58,049][2409077] DAMAGECOUNT value on done: 1706.0
[2023-02-25 12:43:58,050][2409077] Sum rewards: -3.108, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.567', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.022', 'WEAPON1': '0.030', 'AMMO3': '0.091', 'WEAPON4': '0.250', 'HITCOUNT': '0.250', 'weapon4': '0.372', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.954', 'ARMOR': '0.977', 'weapon3': '1.418', 'weapon2': '1.888', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:58,149][2409075] DAMAGECOUNT value on done: 1645.0
[2023-02-25 12:43:58,152][2409075] Sum rewards: 5.262, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.500', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO3': '0.058', 'AMMO4': '0.108', 'weapon7': '0.142', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.372', 'WEAPON3': '0.400', 'HITCOUNT': '0.410', 'ARMOR': '0.412', 'weapon2': '0.620', 'weapon3': '0.878', 'DAMAGECOUNT': '1.680', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:43:58,231][2409101] DAMAGECOUNT value on done: 1373.0
[2023-02-25 12:43:58,234][2409101] Sum rewards: 1.750, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.103', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'AMMO3': '0.072', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.214', 'HITCOUNT': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.501', 'weapon3': '1.120', 'DAMAGECOUNT': '1.209', 'weapon2': '1.616', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:58,327][2409355] DAMAGECOUNT value on done: 1335.0
[2023-02-25 12:43:58,328][2409355] Sum rewards: 0.334, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.540', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'weapon4': '0.108', 'HITCOUNT': '0.350', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.170', 'weapon3': '1.242', 'ARMOR': '1.395', 'weapon2': '2.396', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:58,369][2409597] DAMAGECOUNT value on done: 1274.0
[2023-02-25 12:43:58,530][2409468] DAMAGECOUNT value on done: 560.0
[2023-02-25 12:43:58,531][2409468] Sum rewards: -0.139, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.621', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'AMMO4': '0.131', 'weapon4': '0.210', 'WEAPON4': '0.250', 'HITCOUNT': '0.280', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.990', 'ARMOR': '1.289', 'weapon3': '1.314', 'weapon2': '2.010', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:58,576][2409596] DAMAGECOUNT value on done: 1376.0
[2023-02-25 12:43:58,577][2409596] Sum rewards: 3.688, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.445', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO3': '0.073', 'weapon5': '0.074', 'WEAPON5': '0.100', 'HITCOUNT': '0.440', 'WEAPON3': '0.450', 'ARMOR': '0.800', 'weapon3': '1.266', 'DAMAGECOUNT': '1.305', 'weapon2': '1.612', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:43:58,702][2409486] DAMAGECOUNT value on done: 1078.0
[2023-02-25 12:43:58,705][2409486] Sum rewards: 2.874, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.527', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO3': '0.060', 'HITCOUNT': '0.350', 'WEAPON3': '0.400', 'ARMOR': '0.852', 'weapon3': '0.932', 'DAMAGECOUNT': '1.221', 'weapon2': '1.318', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:43:58,980][2409102] DAMAGECOUNT value on done: 1245.0
[2023-02-25 12:43:58,983][2409102] Sum rewards: 0.205, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.714', 'AMMO5': '0.010', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'ARMOR': '0.048', 'AMMO4': '0.098', 'AMMO3': '0.129', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.280', 'weapon4': '0.380', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.020', 'weapon2': '1.414', 'weapon3': '1.730', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:59,099][2409389] DAMAGECOUNT value on done: 1068.0
[2023-02-25 12:43:59,100][2409389] Sum rewards: 0.558, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.470', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon4': '0.054', 'AMMO3': '0.072', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.230', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.651', 'weapon3': '0.966', 'FRAGCOUNT': '1.000', 'weapon2': '1.042'}
[2023-02-25 12:43:59,229][2409074] Updated weights for policy 0, policy_version 9211 (0.0012)
[2023-02-25 12:43:59,420][2409103] DAMAGECOUNT value on done: 1619.0
[2023-02-25 12:43:59,421][2409103] Sum rewards: 1.552, reward structure: {'DEATHCOUNT': '-5.250', 'WEAPON1': '0.010', 'ARMOR': '0.028', 'AMMO2': '0.029', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.144', 'weapon4': '0.232', 'WEAPON3': '0.300', 'HITCOUNT': '0.350', 'HEALTH': '0.640', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.005', 'weapon3': '1.364', 'weapon2': '1.590'}
[2023-02-25 12:43:59,599][2409405] DAMAGECOUNT value on done: 1432.0
[2023-02-25 12:43:59,600][2409405] Sum rewards: -2.705, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.795', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.006', 'weapon5': '0.034', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO3': '0.123', 'WEAPON5': '0.150', 'HITCOUNT': '0.220', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.909', 'FRAGCOUNT': '1.000', 'weapon3': '1.490', 'weapon2': '1.670'}
[2023-02-25 12:43:59,658][2409104] DAMAGECOUNT value on done: 1174.0
[2023-02-25 12:43:59,659][2409104] Sum rewards: 4.211, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON1': '0.050', 'AMMO3': '0.077', 'HEALTH': '0.084', 'WEAPON4': '0.100', 'weapon4': '0.186', 'HITCOUNT': '0.430', 'WEAPON3': '0.450', 'ARMOR': '0.453', 'weapon3': '1.358', 'weapon2': '1.612', 'DAMAGECOUNT': '1.614', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:43:59,719][2409097] DAMAGECOUNT value on done: 1281.0
[2023-02-25 12:43:59,722][2409097] Sum rewards: 0.424, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.490', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.032', 'AMMO3': '0.041', 'WEAPON4': '0.050', 'weapon7': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.160', 'HITCOUNT': '0.190', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.405', 'weapon3': '0.948', 'FRAGCOUNT': '1.000', 'weapon2': '1.060'}
[2023-02-25 12:43:59,888][2409105] DAMAGECOUNT value on done: 1143.0
[2023-02-25 12:43:59,964][2409407] DAMAGECOUNT value on done: 1874.0
[2023-02-25 12:43:59,967][2409407] Sum rewards: 1.153, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.226', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'ARMOR': '0.112', 'AMMO4': '0.139', 'AMMO3': '0.152', 'WEAPON4': '0.400', 'weapon4': '0.514', 'HITCOUNT': '0.560', 'WEAPON3': '0.900', 'weapon2': '1.422', 'weapon3': '1.772', 'DAMAGECOUNT': '2.025', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:44:00,258][2409099] DAMAGECOUNT value on done: 1023.0
[2023-02-25 12:44:00,262][2409099] Sum rewards: 0.102, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.624', 'AMMO2': '0.002', 'AMMO4': '0.009', 'ARMOR': '0.016', 'AMMO3': '0.101', 'WEAPON4': '0.250', 'HITCOUNT': '0.300', 'weapon4': '0.464', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.894', 'weapon2': '1.342', 'weapon3': '1.398', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:00,513][2409078] DAMAGECOUNT value on done: 1130.0
[2023-02-25 12:44:00,514][2409078] Sum rewards: 0.749, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.116', 'AMMO2': '0.038', 'AMMO3': '0.074', 'AMMO4': '0.189', 'HITCOUNT': '0.340', 'WEAPON3': '0.450', 'WEAPON4': '0.500', 'ARMOR': '0.522', 'weapon4': '0.946', 'weapon2': '0.970', 'DAMAGECOUNT': '0.972', 'weapon3': '1.364', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:00,610][2409100] DAMAGECOUNT value on done: 1349.0
[2023-02-25 12:44:00,613][2409100] Sum rewards: 1.585, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.948', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'AMMO3': '0.076', 'AMMO4': '0.102', 'HITCOUNT': '0.260', 'WEAPON4': '0.350', 'ARMOR': '0.468', 'WEAPON3': '0.500', 'weapon4': '0.582', 'DAMAGECOUNT': '0.855', 'weapon3': '0.858', 'weapon2': '1.442', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:00,736][2409549] DAMAGECOUNT value on done: 1238.0
[2023-02-25 12:44:00,737][2409549] Sum rewards: 1.796, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.657', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.062', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.270', 'weapon4': '0.398', 'WEAPON3': '0.400', 'ARMOR': '0.502', 'weapon3': '0.880', 'DAMAGECOUNT': '0.954', 'weapon2': '1.214', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:00,925][2409079] DAMAGECOUNT value on done: 1272.0
[2023-02-25 12:44:00,926][2409079] Sum rewards: 3.081, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.740', 'AMMO5': '0.007', 'weapon5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'ARMOR': '0.024', 'weapon7': '0.058', 'AMMO4': '0.065', 'AMMO3': '0.066', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon4': '0.198', 'WEAPON7': '0.200', 'WEAPON3': '0.450', 'HITCOUNT': '0.530', 'weapon3': '1.154', 'weapon2': '1.632', 'DAMAGECOUNT': '1.665', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:44:00,927][2409096] DAMAGECOUNT value on done: 1303.0
[2023-02-25 12:44:00,930][2409096] Sum rewards: -2.604, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.624', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon7': '0.048', 'weapon5': '0.074', 'AMMO3': '0.092', 'AMMO4': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.120', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.500', 'ARMOR': '0.844', 'weapon3': '1.120', 'weapon2': '1.566'}
[2023-02-25 12:44:00,942][2409406] DAMAGECOUNT value on done: 1110.0
[2023-02-25 12:44:00,943][2409406] Sum rewards: -0.672, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.554', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.010', 'AMMO3': '0.072', 'weapon5': '0.072', 'WEAPON5': '0.150', 'HITCOUNT': '0.180', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.453', 'ARMOR': '0.458', 'weapon3': '1.048', 'weapon2': '1.782', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:01,039][2409074] Updated weights for policy 0, policy_version 9221 (0.0012)
[2023-02-25 12:44:01,053][2409565] DAMAGECOUNT value on done: 1715.0
[2023-02-25 12:44:01,063][2409548] DAMAGECOUNT value on done: 1353.0
[2023-02-25 12:44:01,064][2409548] Sum rewards: -2.407, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.616', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.055', 'AMMO2': '-0.011', 'AMMO5': '0.015', 'weapon5': '0.088', 'AMMO3': '0.117', 'WEAPON5': '0.150', 'HITCOUNT': '0.170', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.846', 'ARMOR': '1.028', 'weapon3': '1.404', 'weapon2': '2.106'}
[2023-02-25 12:44:01,108][2409469] DAMAGECOUNT value on done: 1422.0
[2023-02-25 12:44:01,108][2409469] Sum rewards: 3.422, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.550', 'AMMO2': '0.002', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.011', 'weapon5': '0.086', 'AMMO3': '0.093', 'WEAPON5': '0.200', 'HITCOUNT': '0.430', 'WEAPON3': '0.600', 'weapon2': '0.768', 'DAMAGECOUNT': '1.446', 'weapon3': '1.566', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:44:01,397][2409485] DAMAGECOUNT value on done: 1159.0
[2023-02-25 12:44:01,398][2409485] Sum rewards: -4.706, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.936', 'FRAGCOUNT': '-0.500', 'weapon4': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.042', 'AMMO4': '0.057', 'AMMO3': '0.074', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.390', 'ARMOR': '0.482', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.170', 'weapon3': '1.266', 'weapon2': '2.358'}
[2023-02-25 12:44:01,562][2409373] DAMAGECOUNT value on done: 2182.0
[2023-02-25 12:44:01,563][2409373] Sum rewards: 5.623, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.512', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'weapon4': '0.222', 'ARMOR': '0.483', 'HITCOUNT': '0.650', 'WEAPON3': '0.850', 'weapon2': '1.286', 'weapon3': '1.888', 'DAMAGECOUNT': '2.985', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:44:01,749][2409866] DAMAGECOUNT value on done: 1977.0
[2023-02-25 12:44:01,751][2409866] Sum rewards: -0.944, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.634', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.150', 'weapon4': '0.164', 'WEAPON4': '0.200', 'HITCOUNT': '0.500', 'ARMOR': '0.800', 'WEAPON3': '1.000', 'weapon2': '1.276', 'DAMAGECOUNT': '1.890', 'weapon3': '2.242', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:44:01,774][2409080] DAMAGECOUNT value on done: 1030.0
[2023-02-25 12:44:01,775][2409080] Sum rewards: -2.580, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.480', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.026', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon5': '0.058', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'weapon4': '0.124', 'HITCOUNT': '0.190', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.735', 'FRAGCOUNT': '1.000', 'weapon2': '1.526', 'weapon3': '1.726'}
[2023-02-25 12:44:01,777][2409076] DAMAGECOUNT value on done: 1601.0
[2023-02-25 12:44:01,810][2409547] DAMAGECOUNT value on done: 1749.0
[2023-02-25 12:44:01,813][2409547] Sum rewards: 3.000, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.658', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.036', 'WEAPON1': '0.040', 'weapon7': '0.048', 'weapon5': '0.048', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.122', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.214', 'ARMOR': '0.400', 'HITCOUNT': '0.570', 'WEAPON3': '0.850', 'weapon2': '0.926', 'weapon3': '1.800', 'DAMAGECOUNT': '1.899', 'FRAGCOUNT': '4.500'}
[2023-02-25 12:44:01,913][2409077] DAMAGECOUNT value on done: 1384.0
[2023-02-25 12:44:01,914][2409077] Sum rewards: 0.393, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.485', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO3': '0.051', 'AMMO4': '0.063', 'WEAPON5': '0.100', 'weapon5': '0.140', 'HITCOUNT': '0.290', 'WEAPON3': '0.350', 'ARMOR': '0.440', 'weapon3': '0.670', 'DAMAGECOUNT': '0.990', 'FRAGCOUNT': '1.500', 'weapon2': '2.264'}
[2023-02-25 12:44:02,160][2409101] DAMAGECOUNT value on done: 1121.0
[2023-02-25 12:44:02,161][2409101] Sum rewards: -2.587, reward structure: {'DEATHCOUNT': '-4.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.745', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'weapon5': '0.028', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.074', 'HITCOUNT': '0.190', 'weapon4': '0.192', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.630', 'weapon2': '0.682', 'weapon3': '1.608'}
[2023-02-25 12:44:02,169][2409597] DAMAGECOUNT value on done: 1051.0
[2023-02-25 12:44:02,170][2409597] Sum rewards: 0.255, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.170', 'AMMO2': '0.011', 'weapon5': '0.018', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'AMMO4': '0.056', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'HITCOUNT': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.200', 'ARMOR': '0.500', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.657', 'weapon3': '1.654', 'weapon2': '1.696', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:02,186][2408954] Fps is (10 sec: 24575.4, 60 sec: 25326.8, 300 sec: 25214.7). Total num frames: 37797888. Throughput: 0: 6336.5. Samples: 9456924. Policy #0 lag: (min: 0.0, avg: 10.9, max: 25.0)
[2023-02-25 12:44:02,186][2408954] Avg episode reward: [(0, '0.881')]
[2023-02-25 12:44:02,205][2409075] DAMAGECOUNT value on done: 1475.0
[2023-02-25 12:44:02,206][2409075] Sum rewards: 0.913, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.795', 'AMMO2': '0.000', 'AMMO4': '0.001', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO3': '0.069', 'WEAPON4': '0.100', 'HITCOUNT': '0.140', 'weapon4': '0.180', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.500', 'weapon2': '0.970', 'weapon3': '1.094', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:02,296][2409486] DAMAGECOUNT value on done: 798.0
[2023-02-25 12:44:02,395][2409355] DAMAGECOUNT value on done: 1447.0
[2023-02-25 12:44:02,397][2409355] Sum rewards: 2.471, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.748', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.030', 'weapon5': '0.038', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.260', 'HITCOUNT': '0.470', 'ARMOR': '0.476', 'WEAPON3': '0.550', 'weapon3': '1.318', 'DAMAGECOUNT': '1.650', 'weapon2': '1.814', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:02,487][2409468] DAMAGECOUNT value on done: 1385.0
[2023-02-25 12:44:02,490][2409468] Sum rewards: -0.202, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.406', 'ARMOR': '0.008', 'AMMO2': '0.023', 'AMMO3': '0.080', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'weapon4': '0.202', 'HITCOUNT': '0.330', 'WEAPON3': '0.450', 'weapon3': '0.962', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.269', 'weapon2': '1.614'}
[2023-02-25 12:44:02,530][2409596] DAMAGECOUNT value on done: 1104.0
[2023-02-25 12:44:02,531][2409596] Sum rewards: 1.394, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.254', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.009', 'weapon7': '0.014', 'AMMO4': '0.043', 'WEAPON5': '0.050', 'AMMO3': '0.051', 'HITCOUNT': '0.130', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON3': '0.350', 'WEAPON4': '0.450', 'DAMAGECOUNT': '0.450', 'ARMOR': '0.509', 'weapon3': '0.714', 'weapon4': '0.728', 'weapon2': '0.790', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:02,601][2409074] Updated weights for policy 0, policy_version 9231 (0.0014)
[2023-02-25 12:44:02,621][2409102] DAMAGECOUNT value on done: 1787.0
[2023-02-25 12:44:02,622][2409102] Sum rewards: 1.619, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.524', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'AMMO3': '0.070', 'weapon5': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'HITCOUNT': '0.330', 'WEAPON3': '0.500', 'ARMOR': '0.800', 'DAMAGECOUNT': '1.020', 'weapon3': '1.548', 'weapon2': '1.974', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:02,948][2409103] DAMAGECOUNT value on done: 1416.0
[2023-02-25 12:44:02,949][2409103] Sum rewards: 3.119, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.136', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON1': '0.050', 'weapon7': '0.054', 'weapon5': '0.060', 'AMMO3': '0.069', 'AMMO4': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.292', 'HITCOUNT': '0.360', 'ARMOR': '0.432', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.215', 'weapon3': '1.240', 'weapon2': '1.626', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:03,146][2409405] DAMAGECOUNT value on done: 1182.0
[2023-02-25 12:44:03,146][2409405] Sum rewards: 3.855, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.290', 'AMMO5': '0.005', 'weapon7': '0.006', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.236', 'HITCOUNT': '0.240', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.951', 'weapon2': '1.290', 'weapon3': '1.720', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:44:03,300][2409389] DAMAGECOUNT value on done: 2004.0
[2023-02-25 12:44:03,303][2409389] Sum rewards: 2.588, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.262', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'WEAPON1': '0.020', 'weapon5': '0.058', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'WEAPON4': '0.300', 'HITCOUNT': '0.420', 'ARMOR': '0.466', 'WEAPON3': '0.600', 'weapon4': '0.606', 'weapon2': '1.058', 'weapon3': '1.732', 'DAMAGECOUNT': '1.878', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:44:03,375][2409097] DAMAGECOUNT value on done: 1380.0
[2023-02-25 12:44:03,378][2409097] Sum rewards: -0.421, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.800', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.060', 'AMMO4': '0.083', 'AMMO3': '0.110', 'WEAPON4': '0.300', 'weapon4': '0.330', 'HITCOUNT': '0.350', 'WEAPON3': '0.700', 'ARMOR': '0.908', 'DAMAGECOUNT': '1.266', 'weapon3': '1.454', 'weapon2': '1.796', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:44:03,425][2409104] DAMAGECOUNT value on done: 1963.0
[2023-02-25 12:44:03,550][2409407] DAMAGECOUNT value on done: 883.0
[2023-02-25 12:44:03,554][2409407] Sum rewards: -0.777, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-2.080', 'AMMO4': '-0.080', 'AMMO2': '-0.016', 'WEAPON1': '0.040', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'HITCOUNT': '0.130', 'weapon4': '0.212', 'DAMAGECOUNT': '0.375', 'ARMOR': '0.456', 'WEAPON3': '0.600', 'weapon3': '1.280', 'weapon2': '1.388', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:03,666][2409105] DAMAGECOUNT value on done: 1131.0
[2023-02-25 12:44:03,670][2409105] Sum rewards: 1.420, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.170', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.148', 'weapon4': '0.260', 'WEAPON3': '0.300', 'WEAPON4': '0.350', 'HITCOUNT': '0.350', 'DAMAGECOUNT': '1.164', 'weapon2': '1.262', 'weapon3': '1.562', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:03,964][2409074] Updated weights for policy 0, policy_version 9241 (0.0012)
[2023-02-25 12:44:04,076][2409078] DAMAGECOUNT value on done: 1131.0
[2023-02-25 12:44:04,077][2409078] Sum rewards: 0.962, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.623', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.007', 'weapon5': '0.040', 'AMMO3': '0.054', 'WEAPON5': '0.100', 'HITCOUNT': '0.240', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.852', 'ARMOR': '0.912', 'weapon3': '1.038', 'weapon2': '1.236', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:04,144][2409099] DAMAGECOUNT value on done: 1156.0
[2023-02-25 12:44:04,147][2409099] Sum rewards: -0.601, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.149', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'WEAPON1': '0.040', 'weapon5': '0.068', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'HITCOUNT': '0.290', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.861', 'ARMOR': '0.880', 'FRAGCOUNT': '1.000', 'weapon3': '1.374', 'weapon2': '2.014'}
[2023-02-25 12:44:04,507][2409079] DAMAGECOUNT value on done: 986.0
[2023-02-25 12:44:04,508][2409079] Sum rewards: 0.892, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.347', 'AMMO5': '0.007', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'weapon5': '0.074', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'WEAPON5': '0.150', 'weapon4': '0.228', 'HITCOUNT': '0.370', 'WEAPON3': '0.550', 'ARMOR': '0.901', 'weapon3': '1.142', 'DAMAGECOUNT': '1.173', 'weapon2': '1.804', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:04,593][2409565] DAMAGECOUNT value on done: 1397.0
[2023-02-25 12:44:04,596][2409565] Sum rewards: 0.926, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.568', 'AMMO5': '0.003', 'AMMO2': '0.020', 'ARMOR': '0.041', 'AMMO3': '0.073', 'weapon5': '0.074', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.300', 'weapon4': '0.390', 'HITCOUNT': '0.430', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.197', 'weapon3': '1.608', 'weapon2': '1.660'}
[2023-02-25 12:44:04,610][2409100] DAMAGECOUNT value on done: 743.0
[2023-02-25 12:44:04,612][2409100] Sum rewards: 2.375, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.170', 'AMMO5': '0.003', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'AMMO3': '0.040', 'AMMO4': '0.041', 'weapon5': '0.056', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.190', 'weapon4': '0.308', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.573', 'weapon3': '0.944', 'weapon2': '1.530', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:04,629][2409096] DAMAGECOUNT value on done: 1352.0
[2023-02-25 12:44:04,633][2409096] Sum rewards: -0.296, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.484', 'AMMO5': '0.010', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.050', 'weapon5': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'WEAPON5': '0.250', 'HITCOUNT': '0.380', 'WEAPON3': '0.600', 'weapon3': '1.338', 'weapon2': '1.732', 'DAMAGECOUNT': '1.773', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:04,799][2409406] DAMAGECOUNT value on done: 1575.0
[2023-02-25 12:44:04,810][2409406] Sum rewards: 2.993, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO2': '0.008', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.042', 'AMMO3': '0.100', 'weapon5': '0.248', 'HITCOUNT': '0.310', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HEALTH': '0.571', 'weapon2': '1.596', 'weapon3': '1.800', 'DAMAGECOUNT': '1.983', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:44:04,878][2409469] DAMAGECOUNT value on done: 1608.0
[2023-02-25 12:44:04,882][2409469] Sum rewards: 2.265, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.226', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.078', 'weapon4': '0.218', 'HITCOUNT': '0.330', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.065', 'weapon3': '1.318', 'weapon2': '1.650', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:04,987][2409485] DAMAGECOUNT value on done: 943.0
[2023-02-25 12:44:04,991][2409485] Sum rewards: 1.192, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.315', 'ARMOR': '0.004', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.031', 'AMMO3': '0.043', 'weapon7': '0.052', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.250', 'weapon4': '0.374', 'DAMAGECOUNT': '0.774', 'weapon3': '0.802', 'FRAGCOUNT': '1.000', 'weapon2': '1.030'}
[2023-02-25 12:44:05,021][2409549] DAMAGECOUNT value on done: 1460.0
[2023-02-25 12:44:05,024][2409549] Sum rewards: 1.831, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.911', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'AMMO3': '0.030', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.200', 'weapon4': '0.234', 'HITCOUNT': '0.330', 'ARMOR': '0.495', 'weapon3': '0.560', 'DAMAGECOUNT': '1.080', 'weapon2': '1.316', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:05,079][2409548] DAMAGECOUNT value on done: 1608.0
[2023-02-25 12:44:05,080][2409548] Sum rewards: 0.021, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.050', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'AMMO4': '0.102', 'AMMO3': '0.126', 'WEAPON4': '0.150', 'HITCOUNT': '0.290', 'weapon4': '0.300', 'ARMOR': '0.428', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.155', 'weapon2': '1.448', 'weapon3': '1.962', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:44:05,361][2409373] DAMAGECOUNT value on done: 2266.0
[2023-02-25 12:44:05,364][2409373] Sum rewards: 5.797, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.760', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'weapon5': '0.062', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.168', 'HITCOUNT': '0.460', 'WEAPON3': '0.500', 'ARMOR': '0.853', 'weapon3': '1.552', 'weapon2': '1.918', 'DAMAGECOUNT': '2.517', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:44:05,476][2409080] DAMAGECOUNT value on done: 1096.0
[2023-02-25 12:44:05,476][2409080] Sum rewards: 1.580, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.010', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'weapon4': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.052', 'AMMO4': '0.102', 'HITCOUNT': '0.180', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.477', 'FRAGCOUNT': '1.000', 'weapon3': '1.184', 'weapon2': '2.208'}
[2023-02-25 12:44:05,724][2409076] DAMAGECOUNT value on done: 1676.0
[2023-02-25 12:44:05,725][2409076] Sum rewards: 6.083, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.880', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO5': '0.007', 'AMMO3': '0.079', 'weapon7': '0.088', 'weapon5': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.350', 'ARMOR': '0.508', 'WEAPON3': '0.650', 'weapon4': '0.718', 'weapon2': '0.852', 'weapon3': '1.522', 'DAMAGECOUNT': '2.184', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:44:05,768][2409077] DAMAGECOUNT value on done: 1354.0
[2023-02-25 12:44:05,769][2409077] Sum rewards: 1.845, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.987', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'WEAPON4': '0.200', 'HITCOUNT': '0.380', 'WEAPON3': '0.400', 'ARMOR': '0.404', 'weapon4': '0.444', 'weapon3': '1.172', 'DAMAGECOUNT': '1.647', 'weapon2': '1.774', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:05,818][2409866] DAMAGECOUNT value on done: 1240.0
[2023-02-25 12:44:05,818][2409866] Sum rewards: 2.834, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON1': '0.050', 'AMMO3': '0.066', 'HEALTH': '0.078', 'AMMO4': '0.093', 'weapon5': '0.148', 'WEAPON5': '0.200', 'HITCOUNT': '0.310', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.080', 'weapon3': '1.362', 'weapon2': '1.820', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:05,903][2409074] Updated weights for policy 0, policy_version 9251 (0.0012)
[2023-02-25 12:44:05,972][2409597] DAMAGECOUNT value on done: 1950.0
[2023-02-25 12:44:05,976][2409597] Sum rewards: 6.656, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.490', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'weapon7': '0.034', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'weapon4': '0.344', 'HITCOUNT': '0.650', 'WEAPON3': '0.800', 'weapon3': '1.460', 'weapon2': '1.534', 'DAMAGECOUNT': '2.517', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:44:06,118][2409547] DAMAGECOUNT value on done: 1569.0
[2023-02-25 12:44:06,121][2409547] Sum rewards: 2.554, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.470', 'AMMO2': '0.013', 'ARMOR': '0.032', 'AMMO4': '0.064', 'AMMO3': '0.077', 'WEAPON4': '0.150', 'HITCOUNT': '0.330', 'weapon4': '0.404', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.032', 'weapon2': '1.124', 'weapon3': '1.498', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:06,123][2409596] DAMAGECOUNT value on done: 1557.0
[2023-02-25 12:44:06,125][2409596] Sum rewards: 2.225, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.196', 'AMMO2': '0.033', 'AMMO3': '0.062', 'AMMO4': '0.165', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'HITCOUNT': '0.480', 'weapon4': '0.502', 'ARMOR': '0.527', 'weapon3': '0.938', 'DAMAGECOUNT': '1.500', 'weapon2': '1.564', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:06,140][2409075] DAMAGECOUNT value on done: 1245.0
[2023-02-25 12:44:06,229][2409468] DAMAGECOUNT value on done: 1066.0
[2023-02-25 12:44:06,230][2409468] Sum rewards: 0.684, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.062', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.022', 'AMMO4': '0.074', 'AMMO3': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.290', 'ARMOR': '0.414', 'weapon4': '0.496', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.146', 'weapon2': '1.500', 'weapon3': '1.628', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:44:06,362][2409355] DAMAGECOUNT value on done: 1618.0
[2023-02-25 12:44:06,363][2409355] Sum rewards: 0.279, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.859', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.150', 'HITCOUNT': '0.200', 'weapon4': '0.218', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.786', 'FRAGCOUNT': '1.000', 'weapon3': '1.374', 'weapon2': '1.398'}
[2023-02-25 12:44:06,366][2409102] DAMAGECOUNT value on done: 1444.0
[2023-02-25 12:44:06,367][2409102] Sum rewards: -0.688, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.357', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'ARMOR': '0.020', 'weapon7': '0.046', 'AMMO4': '0.068', 'weapon4': '0.110', 'AMMO3': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.360', 'WEAPON3': '0.600', 'weapon2': '1.376', 'DAMAGECOUNT': '1.491', 'weapon3': '1.858', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:06,459][2409486] DAMAGECOUNT value on done: 1377.0
[2023-02-25 12:44:06,462][2409486] Sum rewards: 2.214, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.956', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON1': '0.020', 'AMMO3': '0.042', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'weapon4': '0.184', 'HITCOUNT': '0.200', 'WEAPON3': '0.300', 'weapon3': '0.414', 'DAMAGECOUNT': '0.465', 'ARMOR': '1.352', 'weapon2': '1.784', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:06,479][2409103] DAMAGECOUNT value on done: 1339.0
[2023-02-25 12:44:06,482][2409103] Sum rewards: 2.256, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.630', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.029', 'ARMOR': '0.056', 'AMMO3': '0.075', 'weapon5': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.260', 'weapon4': '0.282', 'WEAPON3': '0.600', 'weapon3': '1.372', 'DAMAGECOUNT': '1.575', 'weapon2': '1.926', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:44:06,533][2409101] DAMAGECOUNT value on done: 1842.0
[2023-02-25 12:44:06,536][2409101] Sum rewards: -0.477, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.000', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'weapon4': '0.112', 'HITCOUNT': '0.300', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.945', 'weapon2': '1.568', 'FRAGCOUNT': '2.000', 'weapon3': '2.012'}
[2023-02-25 12:44:07,003][2409405] DAMAGECOUNT value on done: 1602.0
[2023-02-25 12:44:07,004][2409405] Sum rewards: 1.584, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.517', 'AMMO5': '0.003', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.057', 'weapon5': '0.094', 'HITCOUNT': '0.120', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.002', 'weapon3': '1.078', 'weapon2': '2.322'}
[2023-02-25 12:44:07,014][2409104] DAMAGECOUNT value on done: 1464.0
[2023-02-25 12:44:07,015][2409104] Sum rewards: 2.780, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.877', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'AMMO3': '0.051', 'WEAPON4': '0.100', 'weapon4': '0.112', 'HITCOUNT': '0.410', 'WEAPON3': '0.450', 'ARMOR': '0.941', 'FRAGCOUNT': '1.000', 'weapon2': '1.110', 'weapon3': '1.226', 'DAMAGECOUNT': '1.275'}
[2023-02-25 12:44:07,042][2409389] DAMAGECOUNT value on done: 1331.0
[2023-02-25 12:44:07,043][2409389] Sum rewards: 1.714, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.136', 'AMMO5': '0.004', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'weapon5': '0.046', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'WEAPON4': '0.350', 'ARMOR': '0.440', 'HITCOUNT': '0.440', 'WEAPON3': '0.550', 'weapon4': '0.598', 'weapon3': '0.948', 'DAMAGECOUNT': '1.665', 'weapon2': '1.698', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:44:07,186][2408954] Fps is (10 sec: 25396.1, 60 sec: 25395.3, 300 sec: 25228.6). Total num frames: 37924864. Throughput: 0: 6337.6. Samples: 9476076. Policy #0 lag: (min: 0.0, avg: 12.1, max: 24.0)
[2023-02-25 12:44:07,186][2408954] Avg episode reward: [(0, '1.009')]
[2023-02-25 12:44:07,290][2409074] Updated weights for policy 0, policy_version 9261 (0.0012)
[2023-02-25 12:44:07,457][2409105] DAMAGECOUNT value on done: 1735.0
[2023-02-25 12:44:07,471][2409097] DAMAGECOUNT value on done: 1318.0
[2023-02-25 12:44:07,526][2409407] DAMAGECOUNT value on done: 1115.0
[2023-02-25 12:44:07,528][2409407] Sum rewards: -3.535, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.296', 'AMMO5': '0.013', 'AMMO2': '0.014', 'ARMOR': '0.044', 'weapon5': '0.046', 'AMMO4': '0.068', 'AMMO3': '0.122', 'HITCOUNT': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'WEAPON3': '0.700', 'weapon4': '0.794', 'DAMAGECOUNT': '0.960', 'weapon2': '0.992', 'FRAGCOUNT': '1.000', 'weapon3': '1.258'}
[2023-02-25 12:44:07,959][2409078] DAMAGECOUNT value on done: 1154.0
[2023-02-25 12:44:07,960][2409078] Sum rewards: 3.734, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.103', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon7': '0.026', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'AMMO3': '0.083', 'weapon5': '0.092', 'weapon4': '0.126', 'WEAPON5': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'HITCOUNT': '0.380', 'WEAPON3': '0.550', 'ARMOR': '1.200', 'DAMAGECOUNT': '1.278', 'weapon2': '1.478', 'weapon3': '1.838', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:08,185][2409100] DAMAGECOUNT value on done: 1460.0
[2023-02-25 12:44:08,188][2409100] Sum rewards: -2.405, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.240', 'AMMO5': '0.005', 'AMMO2': '0.009', 'ARMOR': '0.032', 'AMMO4': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.143', 'WEAPON4': '0.200', 'HITCOUNT': '0.270', 'weapon4': '0.412', 'DAMAGECOUNT': '0.876', 'WEAPON3': '0.900', 'weapon2': '1.268', 'weapon3': '1.626', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:08,203][2409099] DAMAGECOUNT value on done: 1594.0
[2023-02-25 12:44:08,205][2409099] Sum rewards: 2.474, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.305', 'AMMO4': '-0.073', 'AMMO2': '-0.014', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.054', 'weapon5': '0.054', 'HITCOUNT': '0.320', 'ARMOR': '0.451', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.918', 'weapon3': '1.104', 'weapon2': '1.912', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:08,245][2409096] DAMAGECOUNT value on done: 1614.0
[2023-02-25 12:44:08,246][2409096] Sum rewards: -2.179, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.208', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO3': '0.136', 'WEAPON4': '0.250', 'weapon4': '0.388', 'HITCOUNT': '0.470', 'ARMOR': '0.495', 'WEAPON3': '0.850', 'weapon2': '1.232', 'DAMAGECOUNT': '1.584', 'weapon3': '2.114', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:08,403][2409469] DAMAGECOUNT value on done: 1309.0
[2023-02-25 12:44:08,405][2409469] Sum rewards: -4.487, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.042', 'FRAGCOUNT': '-1.000', 'AMMO5': '0.012', 'AMMO2': '0.018', 'weapon4': '0.078', 'AMMO3': '0.080', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'weapon5': '0.140', 'WEAPON5': '0.200', 'HITCOUNT': '0.290', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.795', 'weapon3': '1.156', 'ARMOR': '1.252', 'weapon2': '1.896'}
[2023-02-25 12:44:08,412][2409565] DAMAGECOUNT value on done: 1308.0
[2023-02-25 12:44:08,416][2409565] Sum rewards: -0.350, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.444', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.041', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'weapon4': '0.192', 'HITCOUNT': '0.240', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.714', 'ARMOR': '0.912', 'weapon3': '1.594', 'weapon2': '1.688', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:08,495][2409079] DAMAGECOUNT value on done: 1332.0
[2023-02-25 12:44:08,498][2409079] Sum rewards: 2.592, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO3': '0.064', 'weapon5': '0.122', 'HEALTH': '0.139', 'AMMO4': '0.185', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.300', 'WEAPON3': '0.400', 'ARMOR': '0.408', 'weapon4': '0.732', 'weapon3': '1.274', 'weapon2': '1.330', 'DAMAGECOUNT': '1.638', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:08,667][2409548] DAMAGECOUNT value on done: 1024.0
[2023-02-25 12:44:08,667][2409548] Sum rewards: -0.585, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.591', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.019', 'AMMO3': '0.069', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.200', 'weapon4': '0.436', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.588', 'FRAGCOUNT': '1.000', 'weapon3': '1.218', 'weapon2': '1.598'}
[2023-02-25 12:44:08,693][2409485] DAMAGECOUNT value on done: 1250.0
[2023-02-25 12:44:08,694][2409485] Sum rewards: 3.131, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.068', 'weapon5': '0.132', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.156', 'HITCOUNT': '0.270', 'WEAPON3': '0.350', 'HEALTH': '0.400', 'ARMOR': '0.870', 'weapon3': '1.008', 'DAMAGECOUNT': '1.200', 'FRAGCOUNT': '2.000', 'weapon2': '2.176'}
[2023-02-25 12:44:08,759][2409406] DAMAGECOUNT value on done: 876.0
[2023-02-25 12:44:08,762][2409406] Sum rewards: -1.038, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.710', 'AMMO2': '0.011', 'AMMO4': '0.052', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'HITCOUNT': '0.130', 'weapon4': '0.132', 'ARMOR': '0.523', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.650', 'weapon2': '1.768', 'weapon3': '1.812', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:08,782][2409549] DAMAGECOUNT value on done: 1825.0
[2023-02-25 12:44:08,782][2409549] Sum rewards: -3.290, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.706', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.007', 'AMMO2': '0.028', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.136', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'weapon5': '0.186', 'weapon4': '0.194', 'HITCOUNT': '0.340', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.990', 'weapon2': '1.198', 'ARMOR': '1.278', 'weapon3': '2.068'}
[2023-02-25 12:44:09,203][2409074] Updated weights for policy 0, policy_version 9271 (0.0012)
[2023-02-25 12:44:09,418][2409080] DAMAGECOUNT value on done: 1199.0
[2023-02-25 12:44:09,421][2409080] Sum rewards: -0.672, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.770', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon7': '0.048', 'weapon5': '0.060', 'AMMO3': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.173', 'HITCOUNT': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'weapon4': '0.494', 'weapon2': '0.722', 'DAMAGECOUNT': '0.825', 'FRAGCOUNT': '1.000', 'weapon3': '1.204'}
[2023-02-25 12:44:09,555][2409077] DAMAGECOUNT value on done: 1601.0
[2023-02-25 12:44:09,556][2409077] Sum rewards: 5.311, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.702', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon4': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.184', 'HITCOUNT': '0.290', 'WEAPON3': '0.500', 'weapon3': '1.252', 'DAMAGECOUNT': '1.602', 'weapon2': '1.692', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:44:09,613][2409597] DAMAGECOUNT value on done: 1400.0
[2023-02-25 12:44:09,617][2409597] Sum rewards: 0.652, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.110', 'AMMO5': '0.005', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.087', 'AMMO4': '0.093', 'weapon5': '0.102', 'WEAPON5': '0.150', 'weapon4': '0.204', 'HITCOUNT': '0.390', 'ARMOR': '0.476', 'WEAPON3': '0.550', 'weapon2': '1.250', 'DAMAGECOUNT': '1.290', 'FRAGCOUNT': '1.500', 'weapon3': '1.576'}
[2023-02-25 12:44:09,626][2409866] DAMAGECOUNT value on done: 1767.0
[2023-02-25 12:44:09,629][2409866] Sum rewards: -1.647, reward structure: {'DEATHCOUNT': '-5.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.100', 'AMMO5': '0.007', 'AMMO2': '0.027', 'ARMOR': '0.040', 'AMMO3': '0.057', 'weapon5': '0.110', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.320', 'WEAPON3': '0.350', 'weapon4': '0.434', 'DAMAGECOUNT': '1.023', 'weapon3': '1.128', 'weapon2': '1.224'}
[2023-02-25 12:44:09,755][2409075] DAMAGECOUNT value on done: 1229.0
[2023-02-25 12:44:09,756][2409075] Sum rewards: -0.459, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.925', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.006', 'WEAPON1': '0.020', 'weapon5': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.089', 'weapon4': '0.198', 'HITCOUNT': '0.390', 'ARMOR': '0.483', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.200', 'weapon2': '1.492', 'weapon3': '1.508', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:09,843][2409547] DAMAGECOUNT value on done: 1114.0
[2023-02-25 12:44:09,860][2409596] DAMAGECOUNT value on done: 1302.0
[2023-02-25 12:44:09,861][2409596] Sum rewards: 2.041, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.388', 'AMMO5': '0.011', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.064', 'weapon5': '0.096', 'AMMO3': '0.105', 'WEAPON4': '0.150', 'weapon4': '0.276', 'WEAPON5': '0.300', 'HITCOUNT': '0.480', 'WEAPON3': '0.700', 'ARMOR': '0.903', 'weapon3': '1.328', 'weapon2': '1.484', 'DAMAGECOUNT': '1.749', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:44:10,026][2409102] DAMAGECOUNT value on done: 1107.0
[2023-02-25 12:44:10,030][2409102] Sum rewards: 3.770, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.190', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.052', 'WEAPON5': '0.100', 'weapon5': '0.136', 'WEAPON3': '0.300', 'HITCOUNT': '0.310', 'weapon2': '0.992', 'DAMAGECOUNT': '1.020', 'weapon3': '1.274', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:10,052][2409101] DAMAGECOUNT value on done: 1522.0
[2023-02-25 12:44:10,052][2409101] Sum rewards: 1.695, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.949', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON1': '0.040', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.062', 'ARMOR': '0.068', 'weapon5': '0.068', 'weapon4': '0.168', 'HITCOUNT': '0.300', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.008', 'weapon2': '1.326', 'weapon3': '1.460', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:10,167][2409355] DAMAGECOUNT value on done: 1689.0
[2023-02-25 12:44:10,167][2409468] DAMAGECOUNT value on done: 1511.0
[2023-02-25 12:44:10,168][2409355] Sum rewards: -1.476, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.804', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO3': '0.090', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.260', 'weapon4': '0.284', 'ARMOR': '0.436', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.945', 'weapon3': '1.422', 'weapon2': '1.776', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:10,168][2409468] Sum rewards: 2.194, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.030', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.014', 'AMMO4': '0.061', 'weapon5': '0.064', 'WEAPON4': '0.100', 'weapon4': '0.108', 'AMMO3': '0.139', 'WEAPON5': '0.300', 'HITCOUNT': '0.530', 'weapon2': '0.680', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.935', 'weapon3': '2.170', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:44:10,216][2409103] DAMAGECOUNT value on done: 1433.0
[2023-02-25 12:44:10,217][2409103] Sum rewards: -0.549, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.315', 'AMMO5': '0.003', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.016', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'weapon5': '0.096', 'WEAPON5': '0.100', 'weapon4': '0.200', 'HITCOUNT': '0.410', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.600', 'ARMOR': '0.857', 'weapon2': '1.418', 'DAMAGECOUNT': '1.467', 'weapon3': '1.716'}
[2023-02-25 12:44:10,375][2409486] DAMAGECOUNT value on done: 1558.0
[2023-02-25 12:44:10,376][2409486] Sum rewards: 2.412, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.780', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.006', 'WEAPON1': '0.020', 'AMMO3': '0.088', 'weapon5': '0.092', 'WEAPON4': '0.100', 'weapon4': '0.168', 'WEAPON5': '0.200', 'HITCOUNT': '0.510', 'WEAPON3': '0.600', 'ARMOR': '0.902', 'weapon2': '1.638', 'weapon3': '1.694', 'DAMAGECOUNT': '1.962', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:10,603][2409405] DAMAGECOUNT value on done: 1488.0
[2023-02-25 12:44:10,641][2409389] DAMAGECOUNT value on done: 1561.0
[2023-02-25 12:44:10,644][2409389] Sum rewards: 0.519, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.216', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'ARMOR': '0.044', 'AMMO4': '0.092', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.356', 'HITCOUNT': '0.390', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.260', 'weapon2': '1.496', 'weapon3': '1.642', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:10,711][2409074] Updated weights for policy 0, policy_version 9281 (0.0012)
[2023-02-25 12:44:10,763][2409104] DAMAGECOUNT value on done: 1217.0
[2023-02-25 12:44:10,764][2409104] Sum rewards: -1.466, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.090', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.046', 'AMMO4': '0.054', 'weapon7': '0.056', 'AMMO3': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.348', 'DAMAGECOUNT': '0.486', 'ARMOR': '0.520', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.070', 'weapon2': '1.192'}
[2023-02-25 12:44:10,803][2409373] DAMAGECOUNT value on done: 1194.0
[2023-02-25 12:44:10,807][2409373] Sum rewards: -2.682, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.746', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.018', 'ARMOR': '0.032', 'weapon7': '0.064', 'AMMO3': '0.072', 'AMMO4': '0.089', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.160', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.382', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.525', 'FRAGCOUNT': '1.000', 'weapon3': '1.086', 'weapon2': '1.626'}
[2023-02-25 12:44:11,062][2409076] DAMAGECOUNT value on done: 886.0
[2023-02-25 12:44:11,063][2409076] Sum rewards: -2.879, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.075', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'ARMOR': '0.024', 'AMMO3': '0.089', 'HITCOUNT': '0.260', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.777', 'FRAGCOUNT': '1.000', 'weapon2': '1.558', 'weapon3': '1.570'}
[2023-02-25 12:44:11,099][2409407] DAMAGECOUNT value on done: 1347.0
[2023-02-25 12:44:11,102][2409407] Sum rewards: 4.357, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.022', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'weapon4': '0.038', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'HITCOUNT': '0.380', 'WEAPON3': '0.400', 'ARMOR': '0.945', 'weapon3': '1.450', 'DAMAGECOUNT': '1.491', 'weapon2': '1.642', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:11,175][2409105] DAMAGECOUNT value on done: 1583.0
[2023-02-25 12:44:11,176][2409105] Sum rewards: 2.116, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.093', 'HEALTH': '0.204', 'HITCOUNT': '0.220', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.852', 'weapon2': '1.310', 'weapon3': '1.572', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:11,355][2409097] DAMAGECOUNT value on done: 1501.0
[2023-02-25 12:44:11,356][2409097] Sum rewards: -5.136, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.166', 'weapon5': '0.008', 'AMMO2': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.040', 'weapon4': '0.088', 'AMMO3': '0.125', 'HITCOUNT': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'ARMOR': '0.504', 'DAMAGECOUNT': '0.768', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.622', 'weapon2': '1.946'}
[2023-02-25 12:44:11,838][2409078] DAMAGECOUNT value on done: 1226.0
[2023-02-25 12:44:12,009][2409099] DAMAGECOUNT value on done: 1478.0
[2023-02-25 12:44:12,012][2409099] Sum rewards: 0.986, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.973', 'AMMO5': '0.003', 'AMMO2': '0.003', 'ARMOR': '0.004', 'AMMO4': '0.017', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.094', 'weapon4': '0.208', 'HITCOUNT': '0.220', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.852', 'weapon2': '1.550', 'weapon3': '1.638', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:12,098][2409096] DAMAGECOUNT value on done: 1535.0
[2023-02-25 12:44:12,101][2409096] Sum rewards: 2.870, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '0.004', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.145', 'weapon4': '0.374', 'ARMOR': '0.404', 'HITCOUNT': '0.420', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.194', 'weapon3': '1.604', 'weapon2': '1.686', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:12,171][2409565] DAMAGECOUNT value on done: 1231.0
[2023-02-25 12:44:12,172][2409565] Sum rewards: 1.876, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.208', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.027', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.070', 'HITCOUNT': '0.190', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon3': '1.106', 'DAMAGECOUNT': '1.134', 'ARMOR': '1.200', 'weapon2': '1.262'}
[2023-02-25 12:44:12,176][2409074] Updated weights for policy 0, policy_version 9291 (0.0012)
[2023-02-25 12:44:12,186][2408954] Fps is (10 sec: 25805.6, 60 sec: 25395.2, 300 sec: 25242.5). Total num frames: 38055936. Throughput: 0: 6352.0. Samples: 9514428. Policy #0 lag: (min: 0.0, avg: 12.1, max: 24.0)
[2023-02-25 12:44:12,186][2408954] Avg episode reward: [(0, '0.520')]
[2023-02-25 12:44:12,263][2409469] DAMAGECOUNT value on done: 949.0
[2023-02-25 12:44:12,266][2409469] Sum rewards: 6.119, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'HEALTH': '0.040', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.050', 'weapon5': '0.058', 'weapon4': '0.060', 'WEAPON4': '0.100', 'HITCOUNT': '0.290', 'WEAPON3': '0.350', 'ARMOR': '0.800', 'weapon3': '1.158', 'weapon2': '1.170', 'DAMAGECOUNT': '1.410', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:44:12,264][2409079] DAMAGECOUNT value on done: 1406.0
[2023-02-25 12:44:12,267][2409079] Sum rewards: -0.460, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.055', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.012', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO3': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.202', 'HITCOUNT': '0.250', 'WEAPON3': '0.450', 'ARMOR': '0.481', 'DAMAGECOUNT': '0.741', 'FRAGCOUNT': '1.000', 'weapon2': '1.426', 'weapon3': '1.526'}
[2023-02-25 12:44:12,429][2409549] DAMAGECOUNT value on done: 1560.0
[2023-02-25 12:44:12,432][2409549] Sum rewards: -3.935, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.619', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO4': '0.016', 'weapon5': '0.058', 'AMMO3': '0.124', 'weapon4': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'HITCOUNT': '0.460', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.850', 'ARMOR': '0.955', 'weapon2': '1.252', 'DAMAGECOUNT': '1.545', 'weapon3': '1.756'}
[2023-02-25 12:44:12,524][2409485] DAMAGECOUNT value on done: 1389.0
[2023-02-25 12:44:12,526][2409485] Sum rewards: 0.366, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.850', 'AMMO4': '-0.056', 'AMMO2': '-0.011', 'ARMOR': '0.008', 'AMMO3': '0.050', 'WEAPON1': '0.060', 'WEAPON4': '0.200', 'weapon4': '0.222', 'HITCOUNT': '0.430', 'WEAPON3': '0.450', 'weapon3': '1.006', 'DAMAGECOUNT': '1.461', 'weapon2': '1.646', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:12,753][2409406] DAMAGECOUNT value on done: 1533.0
[2023-02-25 12:44:12,754][2409406] Sum rewards: 1.070, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.322', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'weapon4': '0.018', 'WEAPON4': '0.050', 'AMMO3': '0.092', 'weapon5': '0.128', 'WEAPON5': '0.200', 'HITCOUNT': '0.510', 'WEAPON3': '0.600', 'ARMOR': '0.824', 'weapon3': '0.952', 'DAMAGECOUNT': '1.851', 'weapon2': '2.460', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:12,876][2409548] DAMAGECOUNT value on done: 1173.0
[2023-02-25 12:44:13,247][2409866] DAMAGECOUNT value on done: 1295.0
[2023-02-25 12:44:13,251][2409866] Sum rewards: 1.619, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.444', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.038', 'AMMO3': '0.101', 'weapon4': '0.134', 'WEAPON4': '0.150', 'HITCOUNT': '0.460', 'WEAPON3': '0.750', 'ARMOR': '0.800', 'weapon3': '1.520', 'DAMAGECOUNT': '1.710', 'weapon2': '1.872', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:13,258][2409080] DAMAGECOUNT value on done: 1840.0
[2023-02-25 12:44:13,262][2409080] Sum rewards: 2.863, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.397', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.044', 'weapon5': '0.052', 'WEAPON4': '0.100', 'weapon4': '0.116', 'AMMO3': '0.141', 'WEAPON5': '0.200', 'HITCOUNT': '0.430', 'ARMOR': '0.440', 'WEAPON3': '0.750', 'weapon3': '1.520', 'DAMAGECOUNT': '1.590', 'weapon2': '1.600', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:44:13,531][2409596] DAMAGECOUNT value on done: 1391.0
[2023-02-25 12:44:13,534][2409596] Sum rewards: -1.581, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.174', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO3': '0.063', 'AMMO4': '0.068', 'weapon5': '0.076', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.184', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon3': '1.204', 'weapon2': '1.216'}
[2023-02-25 12:44:13,563][2409077] DAMAGECOUNT value on done: 843.0
[2023-02-25 12:44:13,567][2409077] Sum rewards: -0.492, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.490', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.004', 'AMMO3': '0.054', 'weapon5': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'HITCOUNT': '0.220', 'WEAPON3': '0.350', 'weapon4': '0.356', 'DAMAGECOUNT': '0.675', 'weapon3': '0.688', 'ARMOR': '0.929', 'FRAGCOUNT': '2.000', 'weapon2': '2.106'}
[2023-02-25 12:44:13,688][2409101] DAMAGECOUNT value on done: 1439.0
[2023-02-25 12:44:13,688][2409102] DAMAGECOUNT value on done: 1139.0
[2023-02-25 12:44:13,688][2409101] Sum rewards: 0.789, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.480', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.036', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.059', 'weapon4': '0.226', 'HITCOUNT': '0.230', 'WEAPON3': '0.450', 'ARMOR': '0.454', 'DAMAGECOUNT': '0.921', 'weapon3': '0.934', 'weapon2': '1.614', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:44:13,689][2409102] Sum rewards: 0.298, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.775', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.099', 'AMMO3': '0.103', 'weapon4': '0.206', 'HITCOUNT': '0.280', 'WEAPON4': '0.300', 'ARMOR': '0.566', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.011', 'weapon3': '1.762', 'weapon2': '1.806', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:44:13,755][2409597] DAMAGECOUNT value on done: 921.0
[2023-02-25 12:44:13,759][2409597] Sum rewards: -3.165, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.508', 'AMMO5': '0.005', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.027', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'weapon4': '0.174', 'WEAPON4': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.888', 'ARMOR': '0.930', 'weapon3': '1.402', 'FRAGCOUNT': '2.000', 'weapon2': '2.080'}
[2023-02-25 12:44:13,801][2409074] Updated weights for policy 0, policy_version 9301 (0.0015)
[2023-02-25 12:44:13,873][2409075] DAMAGECOUNT value on done: 1342.0
[2023-02-25 12:44:13,874][2409075] Sum rewards: 2.396, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'AMMO4': '0.114', 'weapon4': '0.262', 'HITCOUNT': '0.420', 'WEAPON3': '0.450', 'HEALTH': '0.658', 'weapon2': '1.396', 'weapon3': '1.778', 'DAMAGECOUNT': '1.812', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:13,935][2409547] DAMAGECOUNT value on done: 1291.0
[2023-02-25 12:44:14,034][2409468] DAMAGECOUNT value on done: 1193.0
[2023-02-25 12:44:14,035][2409468] Sum rewards: -2.633, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.493', 'AMMO2': '0.004', 'AMMO5': '0.017', 'AMMO4': '0.020', 'weapon5': '0.056', 'AMMO3': '0.127', 'WEAPON4': '0.200', 'weapon4': '0.246', 'WEAPON5': '0.350', 'HITCOUNT': '0.360', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.266', 'weapon2': '1.430', 'weapon3': '1.734', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:14,053][2409355] DAMAGECOUNT value on done: 1538.0
[2023-02-25 12:44:14,056][2409355] Sum rewards: 3.358, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.308', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.028', 'AMMO3': '0.069', 'WEAPON3': '0.450', 'HITCOUNT': '0.470', 'ARMOR': '0.491', 'weapon3': '1.042', 'weapon2': '1.568', 'DAMAGECOUNT': '1.782', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:14,376][2409405] DAMAGECOUNT value on done: 968.0
[2023-02-25 12:44:14,377][2409405] Sum rewards: -0.948, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'WEAPON1': '0.030', 'weapon5': '0.030', 'AMMO2': '0.031', 'ARMOR': '0.044', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'HITCOUNT': '0.110', 'AMMO4': '0.157', 'HEALTH': '0.165', 'WEAPON3': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.316', 'DAMAGECOUNT': '0.342', 'FRAGCOUNT': '1.000', 'weapon3': '1.106', 'weapon2': '1.818'}
[2023-02-25 12:44:14,398][2409486] DAMAGECOUNT value on done: 1282.0
[2023-02-25 12:44:14,399][2409486] Sum rewards: -4.450, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.333', 'AMMO2': '0.008', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'AMMO4': '0.040', 'weapon5': '0.048', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'weapon4': '0.178', 'WEAPON5': '0.200', 'HITCOUNT': '0.330', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.068', 'weapon2': '1.328', 'weapon3': '2.058'}
[2023-02-25 12:44:14,424][2409104] DAMAGECOUNT value on done: 1758.0
[2023-02-25 12:44:14,427][2409104] Sum rewards: 2.444, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.100', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'ARMOR': '0.044', 'weapon5': '0.066', 'AMMO3': '0.077', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'WEAPON4': '0.350', 'HITCOUNT': '0.440', 'WEAPON3': '0.500', 'weapon4': '0.706', 'weapon2': '1.130', 'weapon3': '1.222', 'DAMAGECOUNT': '2.292', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:44:14,752][2409373] DAMAGECOUNT value on done: 1573.0
[2023-02-25 12:44:14,753][2409373] Sum rewards: 1.695, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.697', 'AMMO2': '0.000', 'AMMO4': '0.000', 'WEAPON1': '0.020', 'AMMO3': '0.067', 'HITCOUNT': '0.310', 'WEAPON3': '0.500', 'ARMOR': '0.835', 'weapon2': '0.992', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.143', 'weapon3': '1.274'}
[2023-02-25 12:44:14,875][2409407] DAMAGECOUNT value on done: 1208.0
[2023-02-25 12:44:14,877][2409407] Sum rewards: -0.201, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.756', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.220', 'weapon4': '0.400', 'ARMOR': '0.484', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.660', 'weapon3': '0.862', 'FRAGCOUNT': '1.000', 'weapon2': '1.326'}
[2023-02-25 12:44:14,956][2409389] DAMAGECOUNT value on done: 1266.0
[2023-02-25 12:44:14,957][2409389] Sum rewards: 2.554, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.262', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon5': '0.068', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'HITCOUNT': '0.230', 'weapon4': '0.274', 'ARMOR': '0.424', 'WEAPON3': '0.550', 'weapon2': '1.078', 'DAMAGECOUNT': '1.242', 'weapon3': '1.418', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:15,006][2409076] DAMAGECOUNT value on done: 1287.0
[2023-02-25 12:44:15,010][2409076] Sum rewards: 1.442, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.848', 'AMMO5': '0.005', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.025', 'ARMOR': '0.036', 'AMMO3': '0.056', 'weapon7': '0.064', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.450', 'weapon4': '0.474', 'weapon3': '1.094', 'weapon2': '1.220', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:15,165][2409097] DAMAGECOUNT value on done: 1134.0
[2023-02-25 12:44:15,166][2409097] Sum rewards: 1.395, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.921', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO3': '0.041', 'WEAPON4': '0.050', 'weapon7': '0.050', 'weapon5': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.196', 'HITCOUNT': '0.230', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.717', 'ARMOR': '0.903', 'weapon3': '0.970', 'FRAGCOUNT': '1.000', 'weapon2': '1.024'}
[2023-02-25 12:44:15,302][2409074] Updated weights for policy 0, policy_version 9311 (0.0014)
[2023-02-25 12:44:15,330][2409105] DAMAGECOUNT value on done: 1261.0
[2023-02-25 12:44:15,333][2409105] Sum rewards: -1.798, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.314', 'AMMO2': '0.001', 'AMMO4': '0.002', 'WEAPON1': '0.020', 'AMMO3': '0.077', 'weapon7': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.340', 'weapon4': '0.414', 'WEAPON3': '0.450', 'ARMOR': '0.961', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.065', 'weapon3': '1.138', 'weapon2': '1.576'}
[2023-02-25 12:44:15,506][2409078] DAMAGECOUNT value on done: 1496.0
[2023-02-25 12:44:15,512][2409078] Sum rewards: 5.811, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.523', 'AMMO5': '0.005', 'weapon5': '0.024', 'AMMO2': '0.027', 'ARMOR': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'weapon4': '0.412', 'HITCOUNT': '0.500', 'WEAPON3': '0.600', 'weapon2': '0.806', 'weapon3': '1.498', 'DAMAGECOUNT': '1.680', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:44:15,676][2409565] DAMAGECOUNT value on done: 1407.0
[2023-02-25 12:44:15,677][2409565] Sum rewards: 4.339, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.170', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.047', 'AMMO3': '0.101', 'weapon5': '0.226', 'WEAPON5': '0.300', 'ARMOR': '0.437', 'HITCOUNT': '0.460', 'WEAPON3': '0.600', 'weapon3': '1.272', 'weapon2': '1.790', 'DAMAGECOUNT': '2.241', 'FRAGCOUNT': '4.500'}
[2023-02-25 12:44:16,009][2409096] DAMAGECOUNT value on done: 1438.0
[2023-02-25 12:44:16,014][2409096] Sum rewards: 2.755, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.215', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.024', 'AMMO4': '0.058', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.366', 'WEAPON3': '0.450', 'HITCOUNT': '0.500', 'ARMOR': '0.891', 'weapon3': '1.116', 'weapon2': '1.596', 'DAMAGECOUNT': '1.662', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:16,024][2409099] DAMAGECOUNT value on done: 1439.0
[2023-02-25 12:44:16,027][2409099] Sum rewards: 1.143, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.580', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.032', 'AMMO3': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.250', 'HITCOUNT': '0.280', 'ARMOR': '0.480', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.029', 'weapon3': '1.254', 'weapon2': '1.856', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:16,090][2409549] DAMAGECOUNT value on done: 1467.0
[2023-02-25 12:44:16,094][2409549] Sum rewards: 3.201, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.846', 'ARMOR': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.072', 'weapon7': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.440', 'WEAPON3': '0.600', 'weapon4': '0.662', 'weapon2': '0.974', 'weapon3': '1.424', 'DAMAGECOUNT': '1.467', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:44:16,148][2409469] DAMAGECOUNT value on done: 1309.0
[2023-02-25 12:44:16,238][2409079] DAMAGECOUNT value on done: 1311.0
[2023-02-25 12:44:16,241][2409079] Sum rewards: 3.144, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.586', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.042', 'AMMO3': '0.044', 'WEAPON4': '0.100', 'weapon4': '0.108', 'WEAPON3': '0.300', 'HITCOUNT': '0.320', 'ARMOR': '0.468', 'weapon3': '0.922', 'DAMAGECOUNT': '0.999', 'FRAGCOUNT': '2.000', 'weapon2': '2.148'}
[2023-02-25 12:44:16,463][2409485] DAMAGECOUNT value on done: 1237.0
[2023-02-25 12:44:16,464][2409485] Sum rewards: -3.462, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.229', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.016', 'AMMO2': '0.017', 'AMMO3': '0.060', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'HITCOUNT': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.264', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.429', 'ARMOR': '0.479', 'weapon2': '1.376', 'weapon3': '1.378'}
[2023-02-25 12:44:16,537][2409406] DAMAGECOUNT value on done: 1790.0
[2023-02-25 12:44:16,538][2409406] Sum rewards: 0.024, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.264', 'AMMO4': '-0.054', 'AMMO2': '-0.011', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'AMMO3': '0.058', 'WEAPON4': '0.100', 'weapon5': '0.128', 'WEAPON5': '0.200', 'weapon4': '0.206', 'HITCOUNT': '0.220', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.918', 'FRAGCOUNT': '1.000', 'weapon3': '1.070', 'weapon2': '1.468'}
[2023-02-25 12:44:16,600][2409548] DAMAGECOUNT value on done: 1096.0
[2023-02-25 12:44:16,603][2409548] Sum rewards: 2.187, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.289', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.010', 'ARMOR': '0.028', 'weapon5': '0.042', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'HITCOUNT': '0.050', 'weapon7': '0.086', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.188', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'weapon3': '0.248', 'DAMAGECOUNT': '0.633', 'weapon2': '0.846', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:44:17,063][2409596] DAMAGECOUNT value on done: 1608.0
[2023-02-25 12:44:17,066][2409596] Sum rewards: -1.977, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.680', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.004', 'WEAPON1': '0.020', 'weapon7': '0.056', 'weapon5': '0.060', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.170', 'WEAPON7': '0.200', 'HITCOUNT': '0.210', 'ARMOR': '0.433', 'WEAPON3': '0.600', 'weapon2': '1.118', 'weapon3': '1.264', 'DAMAGECOUNT': '1.317', 'FRAGCOUNT': '1.500'}
[2023-02-25 12:44:17,074][2409074] Updated weights for policy 0, policy_version 9321 (0.0013)
[2023-02-25 12:44:17,162][2409080] DAMAGECOUNT value on done: 1312.0
[2023-02-25 12:44:17,165][2409080] Sum rewards: 5.794, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.006', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO4': '0.028', 'weapon5': '0.046', 'WEAPON1': '0.050', 'AMMO3': '0.060', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HEALTH': '0.208', 'weapon4': '0.290', 'WEAPON3': '0.350', 'HITCOUNT': '0.450', 'weapon3': '1.164', 'DAMAGECOUNT': '1.701', 'weapon2': '1.826', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:44:17,186][2408954] Fps is (10 sec: 25804.8, 60 sec: 25531.7, 300 sec: 25256.3). Total num frames: 38182912. Throughput: 0: 6351.2. Samples: 9552420. Policy #0 lag: (min: 0.0, avg: 11.4, max: 24.0)
[2023-02-25 12:44:17,186][2408954] Avg episode reward: [(0, '0.636')]
[2023-02-25 12:44:17,201][2409033] Saving /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000009323_38187008.pth...
[2023-02-25 12:44:17,303][2409033] Removing /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000007839_32108544.pth
[2023-02-25 12:44:17,344][2409597] DAMAGECOUNT value on done: 1867.0
[2023-02-25 12:44:17,345][2409597] Sum rewards: -0.815, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.759', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon5': '0.012', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'AMMO3': '0.095', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'weapon4': '0.220', 'HITCOUNT': '0.400', 'ARMOR': '0.448', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.244', 'DAMAGECOUNT': '1.524', 'weapon2': '1.616'}
[2023-02-25 12:44:17,368][2409101] DAMAGECOUNT value on done: 1297.0
[2023-02-25 12:44:17,371][2409101] Sum rewards: -1.676, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.250', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.010', 'weapon5': '0.034', 'WEAPON1': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.091', 'HITCOUNT': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '0.650', 'weapon4': '0.738', 'DAMAGECOUNT': '0.816', 'ARMOR': '0.948', 'weapon2': '0.966', 'weapon3': '1.576', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:17,407][2409102] DAMAGECOUNT value on done: 1774.0
[2023-02-25 12:44:17,408][2409102] Sum rewards: 6.639, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.602', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon5': '0.060', 'AMMO3': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'ARMOR': '0.440', 'weapon4': '0.440', 'HITCOUNT': '0.450', 'WEAPON3': '0.500', 'weapon3': '1.200', 'weapon2': '1.378', 'DAMAGECOUNT': '1.782', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:44:17,503][2409077] DAMAGECOUNT value on done: 1230.0
[2023-02-25 12:44:17,773][2409547] DAMAGECOUNT value on done: 1487.0
[2023-02-25 12:44:17,774][2409547] Sum rewards: 4.880, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.045', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.020', 'AMMO4': '0.047', 'AMMO3': '0.054', 'WEAPON4': '0.100', 'weapon5': '0.132', 'weapon4': '0.138', 'WEAPON5': '0.200', 'HITCOUNT': '0.210', 'WEAPON3': '0.450', 'weapon3': '1.246', 'DAMAGECOUNT': '1.500', 'weapon2': '1.542', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:44:17,930][2409075] DAMAGECOUNT value on done: 1053.0
[2023-02-25 12:44:17,931][2409075] Sum rewards: 0.058, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.119', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'WEAPON1': '0.010', 'ARMOR': '0.028', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.188', 'HITCOUNT': '0.420', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.218', 'weapon2': '1.648', 'weapon3': '1.734'}
[2023-02-25 12:44:17,989][2409486] DAMAGECOUNT value on done: 1483.0
[2023-02-25 12:44:17,990][2409486] Sum rewards: -2.879, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.006', 'AMMO2': '0.003', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'ARMOR': '0.016', 'AMMO4': '0.017', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'WEAPON4': '0.150', 'weapon5': '0.178', 'HITCOUNT': '0.230', 'weapon4': '0.362', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.056', 'weapon3': '1.542', 'weapon2': '1.594'}
[2023-02-25 12:44:17,997][2409866] DAMAGECOUNT value on done: 1053.0
[2023-02-25 12:44:18,004][2409866] Sum rewards: 2.891, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.202', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.072', 'WEAPON4': '0.150', 'HITCOUNT': '0.260', 'weapon4': '0.360', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.750', 'weapon2': '1.104', 'weapon3': '1.628', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:18,039][2409468] DAMAGECOUNT value on done: 1409.0
[2023-02-25 12:44:18,042][2409468] Sum rewards: 6.503, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.330', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.014', 'AMMO2': '0.027', 'AMMO3': '0.092', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.278', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'ARMOR': '0.800', 'weapon2': '1.316', 'weapon3': '1.764', 'DAMAGECOUNT': '2.061', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:44:18,098][2409104] DAMAGECOUNT value on done: 1621.0
[2023-02-25 12:44:18,101][2409104] Sum rewards: -1.228, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.273', 'AMMO2': '0.011', 'AMMO4': '0.052', 'WEAPON1': '0.060', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'HITCOUNT': '0.180', 'weapon4': '0.308', 'DAMAGECOUNT': '0.780', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.500', 'weapon3': '1.906'}
[2023-02-25 12:44:18,265][2409405] DAMAGECOUNT value on done: 1811.0
[2023-02-25 12:44:18,268][2409405] Sum rewards: 1.198, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.020', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.046', 'AMMO3': '0.070', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.300', 'WEAPON3': '0.300', 'weapon4': '0.402', 'ARMOR': '0.456', 'weapon2': '1.042', 'weapon3': '1.446', 'DAMAGECOUNT': '1.455', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:18,549][2409355] DAMAGECOUNT value on done: 1559.0
[2023-02-25 12:44:18,550][2409355] Sum rewards: 0.261, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.027', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.005', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon5': '0.050', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'weapon4': '0.158', 'ARMOR': '0.400', 'HITCOUNT': '0.430', 'WEAPON3': '0.950', 'weapon2': '1.504', 'weapon3': '1.932', 'DAMAGECOUNT': '2.229', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:18,738][2409373] DAMAGECOUNT value on done: 898.0
[2023-02-25 12:44:18,739][2409373] Sum rewards: 0.316, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.520', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon4': '0.006', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'HITCOUNT': '0.300', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.260', 'weapon2': '1.626', 'weapon3': '1.832', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:18,768][2409074] Updated weights for policy 0, policy_version 9331 (0.0012)
[2023-02-25 12:44:18,772][2409389] DAMAGECOUNT value on done: 2061.0
[2023-02-25 12:44:18,773][2409389] Sum rewards: 4.849, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.884', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.045', 'ARMOR': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.135', 'weapon5': '0.136', 'WEAPON5': '0.200', 'weapon4': '0.220', 'HITCOUNT': '0.590', 'WEAPON3': '0.800', 'weapon2': '0.802', 'weapon3': '1.846', 'DAMAGECOUNT': '2.790', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:44:18,937][2409097] DAMAGECOUNT value on done: 1020.0
[2023-02-25 12:44:18,944][2409105] DAMAGECOUNT value on done: 1518.0
[2023-02-25 12:44:18,947][2409105] Sum rewards: 1.040, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.384', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.026', 'AMMO2': '0.038', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'AMMO4': '0.191', 'WEAPON4': '0.250', 'HITCOUNT': '0.340', 'ARMOR': '0.404', 'WEAPON3': '0.500', 'weapon4': '0.556', 'weapon3': '0.786', 'DAMAGECOUNT': '1.530', 'weapon2': '1.850', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:19,047][2409076] DAMAGECOUNT value on done: 1579.0
[2023-02-25 12:44:19,050][2409076] Sum rewards: 0.898, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.705', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'AMMO3': '0.066', 'weapon5': '0.072', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.280', 'weapon4': '0.322', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.035', 'weapon3': '1.154', 'weapon2': '1.716', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:19,303][2409407] DAMAGECOUNT value on done: 1444.0
[2023-02-25 12:44:19,304][2409407] Sum rewards: 3.557, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.022', 'AMMO5': '0.006', 'AMMO2': '0.009', 'WEAPON1': '0.030', 'AMMO4': '0.045', 'AMMO3': '0.080', 'weapon5': '0.100', 'weapon4': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.490', 'WEAPON3': '0.500', 'ARMOR': '0.520', 'weapon2': '1.318', 'weapon3': '1.794', 'DAMAGECOUNT': '2.352', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:44:19,341][2409078] DAMAGECOUNT value on done: 1425.0
[2023-02-25 12:44:19,343][2409078] Sum rewards: 2.821, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.046', 'AMMO2': '0.006', 'ARMOR': '0.016', 'AMMO4': '0.030', 'AMMO3': '0.084', 'HITCOUNT': '0.460', 'WEAPON3': '0.600', 'weapon2': '1.116', 'weapon3': '1.422', 'DAMAGECOUNT': '1.632', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:19,662][2409099] DAMAGECOUNT value on done: 1296.0
[2023-02-25 12:44:19,663][2409099] Sum rewards: 2.973, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.288', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'ARMOR': '0.044', 'weapon7': '0.084', 'AMMO3': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.430', 'weapon4': '0.600', 'WEAPON3': '0.650', 'weapon3': '0.936', 'weapon2': '0.998', 'DAMAGECOUNT': '1.200', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:19,820][2409565] DAMAGECOUNT value on done: 2151.0
[2023-02-25 12:44:19,823][2409565] Sum rewards: 4.627, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.980', 'AMMO2': '0.003', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO4': '0.017', 'WEAPON1': '0.040', 'weapon4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.141', 'ARMOR': '0.424', 'HITCOUNT': '0.610', 'WEAPON3': '0.900', 'weapon2': '1.364', 'weapon3': '2.174', 'DAMAGECOUNT': '2.403', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:44:19,862][2409096] DAMAGECOUNT value on done: 1091.0
[2023-02-25 12:44:19,865][2409096] Sum rewards: -2.190, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.418', 'AMMO2': '0.003', 'AMMO5': '0.013', 'AMMO4': '0.014', 'AMMO3': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.300', 'weapon4': '0.426', 'ARMOR': '0.468', 'WEAPON3': '0.700', 'weapon2': '0.852', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.029', 'weapon3': '1.522'}
[2023-02-25 12:44:20,013][2409469] DAMAGECOUNT value on done: 1509.0
[2023-02-25 12:44:20,017][2409469] Sum rewards: 2.620, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.182', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.063', 'AMMO3': '0.069', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.250', 'weapon4': '0.252', 'WEAPON3': '0.450', 'ARMOR': '0.460', 'DAMAGECOUNT': '0.933', 'weapon3': '1.294', 'weapon2': '1.886', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:20,152][2409485] DAMAGECOUNT value on done: 1605.0
[2023-02-25 12:44:20,163][2409485] Sum rewards: -1.881, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.410', 'weapon5': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.016', 'WEAPON1': '0.040', 'AMMO3': '0.071', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'HITCOUNT': '0.270', 'weapon4': '0.362', 'WEAPON3': '0.500', 'FRAGCOUNT': '0.500', 'ARMOR': '0.528', 'DAMAGECOUNT': '1.143', 'weapon2': '1.542', 'weapon3': '1.664'}
[2023-02-25 12:44:20,241][2409074] Updated weights for policy 0, policy_version 9341 (0.0012)
[2023-02-25 12:44:20,460][2409548] DAMAGECOUNT value on done: 1749.0
[2023-02-25 12:44:20,461][2409548] Sum rewards: 1.980, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.301', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.007', 'WEAPON1': '0.050', 'AMMO3': '0.103', 'WEAPON5': '0.250', 'weapon5': '0.276', 'HITCOUNT': '0.360', 'WEAPON3': '0.750', 'ARMOR': '0.800', 'weapon2': '1.166', 'DAMAGECOUNT': '1.560', 'weapon3': '1.746', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:20,528][2409079] DAMAGECOUNT value on done: 925.0
[2023-02-25 12:44:20,529][2409079] Sum rewards: -0.093, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.085', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'ARMOR': '0.024', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO3': '0.085', 'HITCOUNT': '0.160', 'weapon4': '0.166', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.825', 'weapon3': '1.134', 'weapon2': '1.738', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:20,692][2409406] DAMAGECOUNT value on done: 1685.0
[2023-02-25 12:44:20,693][2409406] Sum rewards: 1.751, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.998', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO4': '0.055', 'AMMO3': '0.067', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.100', 'weapon4': '0.316', 'ARMOR': '0.488', 'HITCOUNT': '0.500', 'WEAPON3': '0.500', 'weapon3': '1.066', 'DAMAGECOUNT': '1.416', 'FRAGCOUNT': '2.000', 'weapon2': '2.026'}
[2023-02-25 12:44:20,910][2409597] DAMAGECOUNT value on done: 1328.0
[2023-02-25 12:44:20,913][2409597] Sum rewards: 3.378, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.374', 'AMMO2': '0.007', 'WEAPON1': '0.030', 'AMMO4': '0.033', 'AMMO3': '0.092', 'WEAPON4': '0.200', 'HITCOUNT': '0.280', 'weapon4': '0.298', 'ARMOR': '0.505', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.005', 'weapon2': '1.638', 'weapon3': '1.764', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:44:21,041][2409101] DAMAGECOUNT value on done: 1580.0
[2023-02-25 12:44:21,042][2409101] Sum rewards: 3.966, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.382', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.020', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO3': '0.050', 'weapon5': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.220', 'WEAPON3': '0.350', 'ARMOR': '0.499', 'weapon3': '1.006', 'DAMAGECOUNT': '1.350', 'weapon2': '1.686', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:21,250][2409596] DAMAGECOUNT value on done: 1265.0
[2023-02-25 12:44:21,253][2409596] Sum rewards: 4.219, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.480', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.033', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.172', 'HITCOUNT': '0.380', 'WEAPON3': '0.450', 'weapon3': '0.936', 'ARMOR': '1.009', 'DAMAGECOUNT': '1.305', 'weapon2': '1.868', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:44:21,347][2409080] DAMAGECOUNT value on done: 1428.0
[2023-02-25 12:44:21,350][2409080] Sum rewards: -0.351, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.602', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'AMMO3': '0.079', 'weapon4': '0.098', 'AMMO4': '0.107', 'WEAPON4': '0.250', 'HITCOUNT': '0.440', 'ARMOR': '0.477', 'WEAPON3': '0.500', 'weapon3': '1.238', 'DAMAGECOUNT': '1.515', 'weapon2': '1.766', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:21,437][2409077] DAMAGECOUNT value on done: 2127.0
[2023-02-25 12:44:21,441][2409077] Sum rewards: 0.657, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.200', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO3': '0.062', 'weapon4': '0.080', 'WEAPON4': '0.100', 'WEAPON3': '0.500', 'HITCOUNT': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.304', 'DAMAGECOUNT': '1.500', 'weapon2': '2.052'}
[2023-02-25 12:44:21,489][2409547] DAMAGECOUNT value on done: 1013.0
[2023-02-25 12:44:21,492][2409547] Sum rewards: -0.718, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.668', 'weapon7': '0.004', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'AMMO3': '0.090', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon4': '0.212', 'HITCOUNT': '0.250', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.816', 'ARMOR': '0.851', 'FRAGCOUNT': '1.000', 'weapon3': '1.538', 'weapon2': '1.692'}
[2023-02-25 12:44:21,720][2409866] DAMAGECOUNT value on done: 1676.0
[2023-02-25 12:44:21,721][2409866] Sum rewards: -3.398, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.611', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'AMMO5': '0.003', 'weapon5': '0.008', 'WEAPON5': '0.050', 'WEAPON1': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'weapon4': '0.130', 'HITCOUNT': '0.210', 'ARMOR': '0.459', 'DAMAGECOUNT': '0.747', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '1.208', 'weapon3': '2.400'}
[2023-02-25 12:44:21,850][2409486] DAMAGECOUNT value on done: 1527.0
[2023-02-25 12:44:21,852][2409486] Sum rewards: 5.499, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.255', 'AMMO2': '0.013', 'AMMO3': '0.060', 'AMMO4': '0.065', 'WEAPON4': '0.350', 'ARMOR': '0.432', 'WEAPON3': '0.450', 'HITCOUNT': '0.520', 'weapon4': '0.712', 'weapon3': '1.220', 'DAMAGECOUNT': '1.668', 'weapon2': '1.764', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:44:21,947][2409075] DAMAGECOUNT value on done: 1091.0
[2023-02-25 12:44:21,949][2409075] Sum rewards: 0.342, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.690', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'WEAPON1': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.064', 'ARMOR': '0.069', 'WEAPON4': '0.100', 'AMMO3': '0.167', 'weapon4': '0.202', 'HITCOUNT': '0.310', 'weapon2': '0.682', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.248', 'weapon3': '1.650', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:44:21,991][2409074] Updated weights for policy 0, policy_version 9351 (0.0012)
[2023-02-25 12:44:22,025][2409405] DAMAGECOUNT value on done: 946.0
[2023-02-25 12:44:22,186][2408954] Fps is (10 sec: 24575.8, 60 sec: 25258.6, 300 sec: 25242.5). Total num frames: 38301696. Throughput: 0: 6342.1. Samples: 9571116. Policy #0 lag: (min: 0.0, avg: 13.2, max: 27.0)
[2023-02-25 12:44:22,186][2408954] Avg episode reward: [(0, '0.840')]
[2023-02-25 12:44:22,273][2409468] DAMAGECOUNT value on done: 1516.0
[2023-02-25 12:44:22,273][2409104] DAMAGECOUNT value on done: 1258.0
[2023-02-25 12:44:22,274][2409468] Sum rewards: 4.875, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.025', 'AMMO3': '0.030', 'HEALTH': '0.086', 'WEAPON4': '0.100', 'weapon4': '0.166', 'WEAPON3': '0.200', 'HITCOUNT': '0.330', 'weapon3': '0.726', 'DAMAGECOUNT': '1.170', 'weapon2': '1.276', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:22,283][2409104] Sum rewards: -2.840, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.520', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.027', 'WEAPON1': '0.030', 'AMMO3': '0.115', 'weapon5': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.220', 'weapon4': '0.242', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.822', 'ARMOR': '0.866', 'weapon2': '1.568', 'weapon3': '1.598'}
[2023-02-25 12:44:22,279][2409355] DAMAGECOUNT value on done: 1290.0
[2023-02-25 12:44:22,284][2409355] Sum rewards: 0.434, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'ARMOR': '0.036', 'weapon5': '0.062', 'AMMO3': '0.101', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HEALTH': '0.328', 'weapon4': '0.396', 'HITCOUNT': '0.410', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.070', 'DAMAGECOUNT': '1.257', 'weapon3': '2.108'}
[2023-02-25 12:44:22,481][2409105] DAMAGECOUNT value on done: 906.0
[2023-02-25 12:44:22,485][2409105] Sum rewards: 3.821, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.710', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.088', 'weapon5': '0.090', 'HITCOUNT': '0.290', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.494', 'DAMAGECOUNT': '1.044', 'weapon3': '1.428', 'weapon2': '1.450', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:44:22,530][2409373] DAMAGECOUNT value on done: 1356.0
[2023-02-25 12:44:22,533][2409373] Sum rewards: -3.462, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.766', 'AMMO5': '0.003', 'AMMO2': '0.004', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.021', 'weapon4': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'HITCOUNT': '0.300', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.098', 'weapon2': '1.798', 'weapon3': '1.910'}
[2023-02-25 12:44:22,547][2409104] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 12:44:22,583][2409097] DAMAGECOUNT value on done: 851.0
[2023-02-25 12:44:22,585][2409097] Sum rewards: 1.655, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.443', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'AMMO3': '0.073', 'weapon5': '0.086', 'AMMO4': '0.176', 'WEAPON4': '0.300', 'HITCOUNT': '0.350', 'WEAPON3': '0.450', 'ARMOR': '0.507', 'weapon4': '0.542', 'DAMAGECOUNT': '1.152', 'weapon3': '1.382', 'weapon2': '1.472', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:22,777][2409389] DAMAGECOUNT value on done: 1206.0
[2023-02-25 12:44:22,778][2409389] Sum rewards: -2.096, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.871', 'AMMO5': '0.009', 'ARMOR': '0.012', 'weapon5': '0.018', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'AMMO3': '0.091', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'weapon4': '0.168', 'WEAPON5': '0.200', 'HITCOUNT': '0.300', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.849', 'FRAGCOUNT': '1.000', 'weapon3': '1.690', 'weapon2': '1.710'}
[2023-02-25 12:44:22,899][2409076] DAMAGECOUNT value on done: 1437.0
[2023-02-25 12:44:22,903][2409076] Sum rewards: 1.494, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.234', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'weapon5': '0.052', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'weapon4': '0.130', 'HITCOUNT': '0.470', 'ARMOR': '0.503', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.368', 'weapon3': '1.544', 'weapon2': '1.748', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:23,054][2409078] DAMAGECOUNT value on done: 1015.0
[2023-02-25 12:44:23,057][2409078] Sum rewards: 0.865, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.615', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon7': '0.070', 'AMMO3': '0.112', 'WEAPON4': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.310', 'HITCOUNT': '0.440', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.335', 'weapon2': '1.502', 'weapon3': '1.836', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:23,081][2409407] DAMAGECOUNT value on done: 653.0
[2023-02-25 12:44:23,083][2409407] Sum rewards: -0.249, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.562', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'HITCOUNT': '0.040', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'DAMAGECOUNT': '0.153', 'AMMO4': '0.169', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'weapon4': '0.386', 'weapon2': '1.014', 'weapon3': '1.040', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:23,506][2409074] Updated weights for policy 0, policy_version 9361 (0.0012)
[2023-02-25 12:44:23,572][2409565] DAMAGECOUNT value on done: 1286.0
[2023-02-25 12:44:23,574][2409565] Sum rewards: -5.946, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.040', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.007', 'AMMO2': '0.024', 'ARMOR': '0.024', 'weapon5': '0.024', 'WEAPON1': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.118', 'HITCOUNT': '0.160', 'weapon4': '0.238', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.369', 'WEAPON3': '0.800', 'weapon3': '1.514', 'weapon2': '1.798'}
[2023-02-25 12:44:23,777][2409096] DAMAGECOUNT value on done: 1112.0
[2023-02-25 12:44:23,778][2409096] Sum rewards: -0.406, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.586', 'AMMO5': '0.005', 'AMMO2': '0.011', 'ARMOR': '0.028', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'weapon5': '0.058', 'AMMO3': '0.105', 'WEAPON5': '0.150', 'HITCOUNT': '0.270', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.149', 'weapon3': '1.504', 'weapon2': '1.596', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:23,866][2409099] DAMAGECOUNT value on done: 1746.0
[2023-02-25 12:44:23,869][2409099] Sum rewards: 1.227, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.432', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'ARMOR': '0.016', 'WEAPON1': '0.030', 'weapon5': '0.054', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.220', 'HITCOUNT': '0.290', 'WEAPON3': '0.550', 'weapon3': '1.244', 'DAMAGECOUNT': '1.455', 'weapon2': '1.460', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:23,891][2409469] DAMAGECOUNT value on done: 1032.0
[2023-02-25 12:44:23,893][2409469] Sum rewards: 2.717, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.366', 'AMMO5': '0.009', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'AMMO3': '0.064', 'AMMO4': '0.094', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.320', 'weapon4': '0.380', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.029', 'weapon3': '1.384', 'weapon2': '1.424', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:24,405][2409079] DAMAGECOUNT value on done: 1901.0
[2023-02-25 12:44:24,407][2409079] Sum rewards: 6.498, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.062', 'AMMO3': '0.090', 'AMMO4': '0.114', 'weapon4': '0.210', 'HEALTH': '0.234', 'HITCOUNT': '0.490', 'WEAPON3': '0.550', 'weapon2': '1.582', 'weapon3': '1.638', 'DAMAGECOUNT': '2.121', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:44:24,442][2409597] DAMAGECOUNT value on done: 1585.0
[2023-02-25 12:44:24,445][2409597] Sum rewards: 7.372, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.466', 'AMMO2': '0.010', 'WEAPON1': '0.040', 'AMMO4': '0.048', 'weapon4': '0.054', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'HITCOUNT': '0.580', 'WEAPON3': '0.600', 'ARMOR': '0.800', 'weapon3': '1.544', 'weapon2': '1.626', 'DAMAGECOUNT': '2.340', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:44:24,681][2409548] DAMAGECOUNT value on done: 1577.0
[2023-02-25 12:44:24,687][2409548] Sum rewards: -1.195, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.785', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'weapon4': '0.190', 'HITCOUNT': '0.270', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.753', 'FRAGCOUNT': '1.000', 'weapon2': '1.244', 'weapon3': '1.400'}
[2023-02-25 12:44:24,861][2409406] DAMAGECOUNT value on done: 1533.0
[2023-02-25 12:44:24,862][2409406] Sum rewards: -1.191, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.856', 'AMMO5': '0.009', 'AMMO2': '0.015', 'ARMOR': '0.016', 'WEAPON1': '0.030', 'weapon5': '0.062', 'AMMO4': '0.073', 'AMMO3': '0.119', 'WEAPON5': '0.200', 'HITCOUNT': '0.250', 'WEAPON4': '0.350', 'DAMAGECOUNT': '0.717', 'weapon4': '0.722', 'WEAPON3': '0.800', 'weapon2': '0.972', 'weapon3': '1.580', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:25,002][2409074] Updated weights for policy 0, policy_version 9371 (0.0012)
[2023-02-25 12:44:25,297][2409596] DAMAGECOUNT value on done: 1005.0
[2023-02-25 12:44:25,300][2409596] Sum rewards: 0.260, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'ARMOR': '0.052', 'AMMO3': '0.080', 'HEALTH': '0.143', 'weapon4': '0.186', 'HITCOUNT': '0.210', 'WEAPON3': '0.400', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.870', 'weapon3': '1.344', 'weapon2': '1.532'}
[2023-02-25 12:44:25,448][2409866] DAMAGECOUNT value on done: 1792.0
[2023-02-25 12:44:25,452][2409866] Sum rewards: 5.418, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.874', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO2': '0.037', 'weapon4': '0.042', 'weapon5': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'WEAPON5': '0.150', 'AMMO4': '0.186', 'HITCOUNT': '0.530', 'WEAPON3': '0.600', 'weapon2': '1.212', 'weapon3': '1.880', 'DAMAGECOUNT': '2.355', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:44:25,451][2409080] DAMAGECOUNT value on done: 1875.0
[2023-02-25 12:44:25,456][2409080] Sum rewards: -3.052, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.913', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON1': '0.040', 'WEAPON5': '0.050', 'ARMOR': '0.074', 'AMMO3': '0.135', 'WEAPON4': '0.200', 'weapon4': '0.350', 'HITCOUNT': '0.470', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.275', 'weapon3': '1.622', 'weapon2': '1.704'}
[2023-02-25 12:44:25,481][2409547] DAMAGECOUNT value on done: 1105.0
[2023-02-25 12:44:25,482][2409547] Sum rewards: 0.436, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.570', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'AMMO3': '0.098', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'HITCOUNT': '0.210', 'weapon4': '0.364', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.705', 'ARMOR': '0.800', 'weapon2': '1.298', 'weapon3': '1.892', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:25,560][2409405] DAMAGECOUNT value on done: 1950.0
[2023-02-25 12:44:25,560][2409405] Sum rewards: 6.154, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.071', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'weapon5': '0.156', 'weapon4': '0.198', 'HITCOUNT': '0.310', 'HEALTH': '0.366', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'weapon3': '1.314', 'weapon2': '1.408', 'DAMAGECOUNT': '1.677', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:44:25,721][2409486] DAMAGECOUNT value on done: 849.0
[2023-02-25 12:44:25,869][2409075] DAMAGECOUNT value on done: 1551.0
[2023-02-25 12:44:25,870][2409075] Sum rewards: 2.640, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.780', 'ARMOR': '0.004', 'AMMO2': '0.013', 'AMMO3': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'weapon4': '0.196', 'HITCOUNT': '0.390', 'WEAPON3': '0.400', 'weapon3': '0.798', 'DAMAGECOUNT': '0.990', 'weapon2': '1.216', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:25,876][2409077] DAMAGECOUNT value on done: 1160.0
[2023-02-25 12:44:25,879][2409077] Sum rewards: -3.255, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.618', 'AMMO5': '0.010', 'weapon5': '0.012', 'AMMO2': '0.015', 'ARMOR': '0.016', 'WEAPON1': '0.030', 'AMMO4': '0.073', 'AMMO3': '0.126', 'WEAPON5': '0.200', 'HITCOUNT': '0.240', 'WEAPON4': '0.300', 'weapon4': '0.360', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.993', 'weapon2': '1.332', 'weapon3': '1.356', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:44:26,009][2409355] DAMAGECOUNT value on done: 1109.0
[2023-02-25 12:44:26,010][2409355] Sum rewards: 4.177, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.059', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.045', 'AMMO3': '0.071', 'weapon5': '0.076', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.274', 'HITCOUNT': '0.350', 'WEAPON3': '0.500', 'ARMOR': '0.916', 'weapon3': '0.934', 'DAMAGECOUNT': '1.098', 'weapon2': '2.102', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:44:26,058][2409105] DAMAGECOUNT value on done: 1083.0
[2023-02-25 12:44:26,059][2409105] Sum rewards: 1.526, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.294', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'weapon4': '0.028', 'AMMO3': '0.035', 'AMMO4': '0.057', 'weapon7': '0.076', 'WEAPON4': '0.100', 'HITCOUNT': '0.140', 'WEAPON3': '0.200', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'ARMOR': '0.440', 'weapon3': '0.526', 'DAMAGECOUNT': '0.816', 'FRAGCOUNT': '1.000', 'weapon2': '1.830'}
[2023-02-25 12:44:26,319][2409104] DAMAGECOUNT value on done: 1057.0
[2023-02-25 12:44:26,320][2409104] Sum rewards: 0.686, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.350', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.030', 'AMMO3': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.234', 'HITCOUNT': '0.390', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.194', 'weapon3': '1.308', 'weapon2': '1.374', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:26,395][2409468] DAMAGECOUNT value on done: 1555.0
[2023-02-25 12:44:26,396][2409468] Sum rewards: -0.632, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.594', 'AMMO5': '0.003', 'AMMO2': '0.018', 'ARMOR': '0.028', 'weapon5': '0.060', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.136', 'HITCOUNT': '0.490', 'WEAPON3': '0.800', 'weapon3': '1.500', 'DAMAGECOUNT': '1.575', 'weapon2': '1.914', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:26,519][2409097] DAMAGECOUNT value on done: 1084.0
[2023-02-25 12:44:26,520][2409097] Sum rewards: 4.450, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.082', 'AMMO4': '-0.057', 'AMMO2': '-0.011', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'WEAPON4': '0.200', 'weapon4': '0.398', 'HITCOUNT': '0.430', 'WEAPON3': '0.450', 'ARMOR': '0.530', 'weapon3': '1.018', 'weapon2': '1.102', 'DAMAGECOUNT': '1.152', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:44:26,554][2409373] DAMAGECOUNT value on done: 701.0
[2023-02-25 12:44:26,557][2409373] Sum rewards: -0.242, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.604', 'AMMO5': '0.005', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.020', 'AMMO4': '0.032', 'AMMO3': '0.065', 'WEAPON5': '0.100', 'HITCOUNT': '0.140', 'ARMOR': '0.448', 'WEAPON3': '0.450', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.525', 'weapon3': '1.392', 'weapon2': '1.918'}
[2023-02-25 12:44:26,589][2409078] DAMAGECOUNT value on done: 1234.0
[2023-02-25 12:44:26,592][2409078] Sum rewards: 0.769, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.546', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'ARMOR': '0.040', 'weapon5': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'AMMO4': '0.143', 'HITCOUNT': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.338', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.765', 'weapon2': '1.238', 'weapon3': '1.978', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:26,650][2409074] Updated weights for policy 0, policy_version 9381 (0.0012)
[2023-02-25 12:44:26,780][2409389] DAMAGECOUNT value on done: 1826.0
[2023-02-25 12:44:26,783][2409389] Sum rewards: 3.985, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.015', 'AMMO3': '0.050', 'AMMO4': '0.076', 'HEALTH': '0.168', 'WEAPON3': '0.250', 'HITCOUNT': '0.450', 'weapon3': '0.734', 'ARMOR': '0.800', 'DAMAGECOUNT': '1.560', 'weapon2': '2.132', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:26,871][2409076] DAMAGECOUNT value on done: 1061.0
[2023-02-25 12:44:26,874][2409076] Sum rewards: -0.795, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.078', 'AMMO2': '0.008', 'AMMO4': '0.040', 'AMMO3': '0.099', 'HITCOUNT': '0.250', 'ARMOR': '0.412', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.744', 'weapon3': '0.960', 'weapon2': '1.120', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:26,971][2409407] DAMAGECOUNT value on done: 1229.0
[2023-02-25 12:44:26,988][2409407] Sum rewards: 2.736, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'HEALTH': '0.036', 'WEAPON4': '0.050', 'weapon5': '0.054', 'AMMO3': '0.062', 'AMMO4': '0.096', 'WEAPON5': '0.150', 'HITCOUNT': '0.160', 'weapon4': '0.200', 'WEAPON3': '0.450', 'ARMOR': '0.836', 'DAMAGECOUNT': '0.969', 'weapon2': '1.330', 'weapon3': '1.548', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:27,186][2408954] Fps is (10 sec: 25395.3, 60 sec: 25395.2, 300 sec: 25284.1). Total num frames: 38436864. Throughput: 0: 6345.9. Samples: 9609336. Policy #0 lag: (min: 0.0, avg: 13.2, max: 27.0)
[2023-02-25 12:44:27,186][2408954] Avg episode reward: [(0, '1.105')]
[2023-02-25 12:44:27,191][2409033] Saving new best policy, reward=1.105!
[2023-02-25 12:44:27,308][2409565] DAMAGECOUNT value on done: 1335.0
[2023-02-25 12:44:27,460][2409096] DAMAGECOUNT value on done: 1552.0
[2023-02-25 12:44:27,461][2409096] Sum rewards: -2.155, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.642', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.037', 'WEAPON1': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.076', 'AMMO4': '0.186', 'WEAPON4': '0.350', 'HITCOUNT': '0.360', 'ARMOR': '0.412', 'WEAPON3': '0.450', 'FRAGCOUNT': '0.500', 'weapon4': '0.870', 'weapon3': '0.994', 'DAMAGECOUNT': '1.143', 'weapon2': '1.260'}
[2023-02-25 12:44:27,498][2409099] DAMAGECOUNT value on done: 1852.0
[2023-02-25 12:44:27,499][2409099] Sum rewards: 2.573, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.499', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.033', 'AMMO3': '0.040', 'weapon5': '0.052', 'ARMOR': '0.077', 'WEAPON5': '0.100', 'AMMO4': '0.167', 'WEAPON3': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.430', 'weapon4': '0.482', 'weapon3': '0.808', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.046', 'weapon2': '2.274'}
[2023-02-25 12:44:27,584][2409469] DAMAGECOUNT value on done: 1329.0
[2023-02-25 12:44:27,585][2409469] Sum rewards: -4.206, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.315', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.048', 'AMMO3': '0.073', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'HITCOUNT': '0.140', 'WEAPON5': '0.150', 'weapon4': '0.160', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.450', 'ARMOR': '0.930', 'weapon3': '1.156', 'weapon2': '2.138'}
[2023-02-25 12:44:28,166][2409074] Updated weights for policy 0, policy_version 9391 (0.0012)
[2023-02-25 12:44:28,336][2409079] DAMAGECOUNT value on done: 1329.0
[2023-02-25 12:44:28,337][2409079] Sum rewards: -1.092, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.879', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'AMMO3': '0.110', 'AMMO4': '0.117', 'WEAPON4': '0.250', 'HITCOUNT': '0.320', 'weapon4': '0.362', 'WEAPON3': '0.700', 'ARMOR': '0.796', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.038', 'weapon3': '1.594', 'weapon2': '1.716'}
[2023-02-25 12:44:29,101][2409405] DAMAGECOUNT value on done: 1502.0
[2023-02-25 12:44:29,102][2409405] Sum rewards: 0.021, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.206', 'AMMO4': '-0.065', 'AMMO2': '-0.013', 'ARMOR': '0.028', 'WEAPON1': '0.040', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'HITCOUNT': '0.130', 'weapon4': '0.202', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.450', 'weapon3': '0.984', 'FRAGCOUNT': '1.000', 'weapon2': '1.656'}
[2023-02-25 12:44:29,190][2409547] DAMAGECOUNT value on done: 976.0
[2023-02-25 12:44:29,192][2409547] Sum rewards: -0.326, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.358', 'AMMO5': '0.005', 'AMMO2': '0.015', 'ARMOR': '0.016', 'WEAPON1': '0.020', 'weapon5': '0.048', 'AMMO4': '0.076', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'HITCOUNT': '0.240', 'WEAPON4': '0.250', 'weapon4': '0.566', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.657', 'weapon2': '0.872', 'weapon3': '1.232', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:29,275][2409866] DAMAGECOUNT value on done: 1078.0
[2023-02-25 12:44:29,275][2409866] Sum rewards: 1.987, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.660', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.024', 'WEAPON1': '0.050', 'AMMO3': '0.072', 'HITCOUNT': '0.160', 'WEAPON5': '0.300', 'weapon5': '0.322', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.549', 'weapon3': '1.214', 'weapon2': '1.688', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:29,571][2409080] DAMAGECOUNT value on done: 1368.0
[2023-02-25 12:44:29,572][2409080] Sum rewards: 0.090, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.117', 'AMMO4': '-0.008', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'HITCOUNT': '0.290', 'ARMOR': '0.464', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.915', 'FRAGCOUNT': '1.000', 'weapon3': '1.288', 'weapon2': '1.460'}
[2023-02-25 12:44:29,590][2409486] DAMAGECOUNT value on done: 1589.0
[2023-02-25 12:44:29,591][2409486] Sum rewards: 0.849, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.116', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.039', 'AMMO3': '0.090', 'HITCOUNT': '0.320', 'weapon4': '0.346', 'WEAPON4': '0.400', 'ARMOR': '0.490', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.912', 'weapon3': '1.536', 'weapon2': '1.754', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:44:29,630][2409075] DAMAGECOUNT value on done: 1473.0
[2023-02-25 12:44:29,631][2409075] Sum rewards: 7.151, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.032', 'weapon5': '0.078', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'AMMO4': '0.160', 'WEAPON5': '0.200', 'weapon4': '0.202', 'HITCOUNT': '0.380', 'WEAPON3': '0.500', 'ARMOR': '0.800', 'HEALTH': '0.830', 'DAMAGECOUNT': '1.353', 'weapon3': '1.552', 'weapon2': '1.604', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:44:29,773][2409105] DAMAGECOUNT value on done: 1249.0
[2023-02-25 12:44:29,776][2409105] Sum rewards: 0.075, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.444', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon5': '0.020', 'WEAPON1': '0.050', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'weapon4': '0.130', 'AMMO3': '0.138', 'WEAPON5': '0.200', 'HITCOUNT': '0.310', 'ARMOR': '0.440', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.107', 'weapon2': '1.206', 'FRAGCOUNT': '2.000', 'weapon3': '2.222'}
[2023-02-25 12:44:30,095][2409355] DAMAGECOUNT value on done: 1933.0
[2023-02-25 12:44:30,099][2409355] Sum rewards: 5.474, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.758', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.044', 'AMMO4': '0.049', 'AMMO3': '0.087', 'WEAPON4': '0.150', 'HITCOUNT': '0.410', 'weapon4': '0.418', 'WEAPON3': '0.500', 'weapon3': '1.340', 'DAMAGECOUNT': '1.524', 'weapon2': '1.680', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:44:30,125][2409104] DAMAGECOUNT value on done: 1693.0
[2023-02-25 12:44:30,128][2409104] Sum rewards: 4.487, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.133', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon4': '0.074', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'ARMOR': '0.400', 'HITCOUNT': '0.410', 'WEAPON3': '0.600', 'weapon3': '1.364', 'DAMAGECOUNT': '1.545', 'weapon2': '1.698', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:44:30,213][2409078] DAMAGECOUNT value on done: 1604.0
[2023-02-25 12:44:30,217][2409078] Sum rewards: 2.805, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.895', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'AMMO5': '0.004', 'WEAPON1': '0.020', 'AMMO3': '0.068', 'weapon5': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.294', 'HITCOUNT': '0.540', 'WEAPON3': '0.600', 'ARMOR': '0.951', 'weapon2': '1.320', 'weapon3': '1.330', 'DAMAGECOUNT': '2.043', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:44:30,252][2409074] Updated weights for policy 0, policy_version 9401 (0.0013)
[2023-02-25 12:44:30,275][2409097] DAMAGECOUNT value on done: 1225.0
[2023-02-25 12:44:30,276][2409097] Sum rewards: 2.146, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.120', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.040', 'AMMO4': '0.043', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.101', 'weapon4': '0.110', 'HITCOUNT': '0.390', 'ARMOR': '0.476', 'WEAPON3': '0.600', 'weapon2': '0.986', 'DAMAGECOUNT': '1.176', 'weapon3': '1.826', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:30,422][2409389] DAMAGECOUNT value on done: 1427.0
[2023-02-25 12:44:30,422][2409468] DAMAGECOUNT value on done: 1295.0
[2023-02-25 12:44:30,425][2409468] Sum rewards: 1.476, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.264', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'weapon7': '0.068', 'AMMO4': '0.071', 'AMMO3': '0.081', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.308', 'HITCOUNT': '0.330', 'WEAPON3': '0.550', 'ARMOR': '0.892', 'DAMAGECOUNT': '1.125', 'weapon3': '1.374', 'weapon2': '1.554', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:44:30,427][2409389] Sum rewards: -4.156, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.370', 'FRAGCOUNT': '-1.500', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'AMMO3': '0.058', 'HITCOUNT': '0.150', 'weapon5': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.270', 'DAMAGECOUNT': '0.456', 'WEAPON3': '0.500', 'ARMOR': '0.959', 'weapon3': '1.100', 'weapon2': '1.664'}
[2023-02-25 12:44:30,717][2409373] DAMAGECOUNT value on done: 1473.0
[2023-02-25 12:44:30,718][2409373] Sum rewards: -1.317, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.834', 'WEAPON1': '0.010', 'AMMO2': '0.043', 'AMMO3': '0.060', 'ARMOR': '0.139', 'AMMO4': '0.213', 'HITCOUNT': '0.260', 'WEAPON3': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.600', 'DAMAGECOUNT': '0.798', 'weapon3': '0.876', 'weapon2': '1.668', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:30,820][2409407] DAMAGECOUNT value on done: 1457.0
[2023-02-25 12:44:31,128][2409076] DAMAGECOUNT value on done: 1227.0
[2023-02-25 12:44:31,132][2409076] Sum rewards: -1.546, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.987', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.039', 'weapon5': '0.052', 'ARMOR': '0.068', 'AMMO3': '0.075', 'WEAPON5': '0.100', 'AMMO4': '0.194', 'HITCOUNT': '0.210', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'weapon4': '0.512', 'DAMAGECOUNT': '0.795', 'weapon3': '1.062', 'weapon2': '1.762', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:31,371][2409096] DAMAGECOUNT value on done: 1922.0
[2023-02-25 12:44:31,374][2409096] Sum rewards: 0.975, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-2.000', 'AMMO5': '0.003', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.025', 'WEAPON5': '0.050', 'AMMO3': '0.057', 'ARMOR': '0.057', 'WEAPON4': '0.250', 'HITCOUNT': '0.300', 'WEAPON3': '0.500', 'weapon4': '0.544', 'weapon3': '1.054', 'DAMAGECOUNT': '1.086', 'weapon2': '1.274', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:31,431][2409033] Signal inference workers to stop experience collection... (1200 times)
[2023-02-25 12:44:31,451][2409033] Signal inference workers to resume experience collection... (1200 times)
[2023-02-25 12:44:31,460][2409074] Updated weights for policy 0, policy_version 9411 (0.0012)
[2023-02-25 12:44:31,467][2409074] InferenceWorker_p0-w0: stopping experience collection (1200 times)
[2023-02-25 12:44:31,480][2409469] DAMAGECOUNT value on done: 1472.0
[2023-02-25 12:44:31,481][2409469] Sum rewards: -0.160, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.170', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON1': '0.050', 'AMMO3': '0.094', 'HITCOUNT': '0.210', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.816', 'FRAGCOUNT': '1.000', 'weapon2': '1.738', 'weapon3': '1.816'}
[2023-02-25 12:44:31,487][2409074] InferenceWorker_p0-w0: resuming experience collection (1200 times)
[2023-02-25 12:44:31,768][2409099] DAMAGECOUNT value on done: 1103.0
[2023-02-25 12:44:31,769][2409099] Sum rewards: -0.473, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.294', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'AMMO4': '0.160', 'HITCOUNT': '0.210', 'weapon4': '0.220', 'DAMAGECOUNT': '0.573', 'WEAPON3': '0.650', 'weapon2': '1.244', 'weapon3': '1.936', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:32,115][2409079] DAMAGECOUNT value on done: 1347.0
[2023-02-25 12:44:32,130][2409079] Sum rewards: 1.970, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.192', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.028', 'WEAPON1': '0.030', 'weapon5': '0.056', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'HITCOUNT': '0.310', 'weapon4': '0.354', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.374', 'weapon2': '1.572', 'weapon3': '1.650', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:32,186][2408954] Fps is (10 sec: 25804.7, 60 sec: 25395.2, 300 sec: 25270.2). Total num frames: 38559744. Throughput: 0: 6345.6. Samples: 9647472. Policy #0 lag: (min: 0.0, avg: 13.4, max: 26.0)
[2023-02-25 12:44:32,186][2408954] Avg episode reward: [(0, '1.021')]
[2023-02-25 12:44:32,922][2409405] DAMAGECOUNT value on done: 1463.0
[2023-02-25 12:44:32,925][2409405] Sum rewards: 2.816, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.644', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'AMMO4': '0.089', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.190', 'HITCOUNT': '0.280', 'WEAPON3': '0.650', 'ARMOR': '0.832', 'DAMAGECOUNT': '0.990', 'weapon3': '1.420', 'weapon2': '1.644', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:33,052][2409547] DAMAGECOUNT value on done: 1491.0
[2023-02-25 12:44:33,055][2409547] Sum rewards: 6.084, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.149', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.111', 'AMMO4': '0.131', 'WEAPON4': '0.200', 'weapon4': '0.250', 'HITCOUNT': '0.460', 'WEAPON3': '0.550', 'weapon2': '1.402', 'weapon3': '1.652', 'DAMAGECOUNT': '1.680', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:44:33,109][2409074] Updated weights for policy 0, policy_version 9421 (0.0012)
[2023-02-25 12:44:33,113][2409866] DAMAGECOUNT value on done: 1411.0
[2023-02-25 12:44:33,114][2409866] Sum rewards: 1.161, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.375', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon4': '0.078', 'AMMO3': '0.080', 'AMMO4': '0.083', 'WEAPON5': '0.150', 'weapon5': '0.164', 'HITCOUNT': '0.200', 'WEAPON4': '0.200', 'WEAPON3': '0.600', 'ARMOR': '0.909', 'weapon3': '1.418', 'DAMAGECOUNT': '1.662', 'weapon2': '1.950', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:44:33,286][2409080] DAMAGECOUNT value on done: 845.0
[2023-02-25 12:44:33,287][2409080] Sum rewards: -1.844, reward structure: {'DEATHCOUNT': '-4.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.501', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO3': '0.040', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.076', 'WEAPON4': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.260', 'weapon4': '0.380', 'ARMOR': '0.451', 'DAMAGECOUNT': '0.645', 'weapon3': '0.862', 'weapon2': '1.392'}
[2023-02-25 12:44:33,493][2409075] DAMAGECOUNT value on done: 1998.0
[2023-02-25 12:44:33,496][2409075] Sum rewards: 4.835, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.836', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO3': '0.050', 'AMMO4': '0.107', 'weapon5': '0.118', 'WEAPON5': '0.200', 'WEAPON3': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.420', 'weapon4': '0.446', 'ARMOR': '0.961', 'weapon3': '1.046', 'weapon2': '1.582', 'DAMAGECOUNT': '2.661', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:44:33,626][2409486] DAMAGECOUNT value on done: 1381.0
[2023-02-25 12:44:33,680][2409355] DAMAGECOUNT value on done: 1322.0
[2023-02-25 12:44:33,681][2409355] Sum rewards: 1.210, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.856', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.011', 'ARMOR': '0.012', 'weapon4': '0.016', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.122', 'HITCOUNT': '0.510', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.563', 'weapon2': '1.568', 'weapon3': '1.832', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:33,993][2409078] DAMAGECOUNT value on done: 1429.0
[2023-02-25 12:44:33,993][2409078] Sum rewards: 1.566, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.175', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO5': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.070', 'weapon5': '0.086', 'weapon4': '0.094', 'AMMO3': '0.118', 'WEAPON5': '0.250', 'HITCOUNT': '0.480', 'WEAPON3': '0.750', 'weapon3': '1.668', 'DAMAGECOUNT': '1.794', 'weapon2': '1.834', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:34,147][2409097] DAMAGECOUNT value on done: 1311.0
[2023-02-25 12:44:34,148][2409097] Sum rewards: 4.333, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.012', 'WEAPON1': '0.020', 'HEALTH': '0.050', 'weapon5': '0.070', 'weapon7': '0.072', 'AMMO3': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.320', 'WEAPON3': '0.450', 'ARMOR': '0.888', 'weapon3': '1.282', 'DAMAGECOUNT': '1.710', 'weapon2': '2.232', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:44:34,163][2409468] DAMAGECOUNT value on done: 1326.0
[2023-02-25 12:44:34,164][2409468] Sum rewards: -0.884, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.060', 'weapon5': '0.002', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.034', 'weapon7': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.318', 'HITCOUNT': '0.390', 'WEAPON3': '0.900', 'weapon2': '1.020', 'DAMAGECOUNT': '1.170', 'weapon3': '1.968', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:44:34,575][2409407] DAMAGECOUNT value on done: 1570.0
[2023-02-25 12:44:34,579][2409407] Sum rewards: -2.390, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.659', 'AMMO5': '0.015', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'AMMO4': '0.095', 'AMMO3': '0.107', 'weapon5': '0.114', 'WEAPON5': '0.200', 'HITCOUNT': '0.280', 'WEAPON4': '0.350', 'weapon4': '0.400', 'ARMOR': '0.466', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.197', 'weapon3': '1.392', 'weapon2': '1.654'}
[2023-02-25 12:44:34,694][2409074] Updated weights for policy 0, policy_version 9431 (0.0012)
[2023-02-25 12:44:34,964][2409096] DAMAGECOUNT value on done: 1216.0
[2023-02-25 12:44:34,964][2409096] Sum rewards: -0.544, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.788', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.135', 'WEAPON4': '0.150', 'weapon4': '0.226', 'HITCOUNT': '0.310', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.900', 'ARMOR': '1.370', 'weapon3': '1.482', 'weapon2': '1.720', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:35,030][2409469] DAMAGECOUNT value on done: 1263.0
[2023-02-25 12:44:35,031][2409469] Sum rewards: -2.085, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.445', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'ARMOR': '0.020', 'AMMO4': '0.033', 'weapon5': '0.056', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.184', 'HITCOUNT': '0.250', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.900', 'weapon3': '1.426', 'weapon2': '1.780'}
[2023-02-25 12:44:35,074][2409076] DAMAGECOUNT value on done: 799.0
[2023-02-25 12:44:35,453][2409099] DAMAGECOUNT value on done: 1431.0
[2023-02-25 12:44:36,035][2409079] DAMAGECOUNT value on done: 1890.0
[2023-02-25 12:44:36,038][2409079] Sum rewards: 4.269, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.638', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO3': '0.062', 'weapon7': '0.068', 'AMMO4': '0.071', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.300', 'weapon4': '0.308', 'WEAPON3': '0.400', 'HITCOUNT': '0.450', 'ARMOR': '0.850', 'weapon3': '1.182', 'weapon2': '1.540', 'DAMAGECOUNT': '1.974', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:44:36,392][2409074] Updated weights for policy 0, policy_version 9441 (0.0012)
[2023-02-25 12:44:36,647][2409866] DAMAGECOUNT value on done: 1056.0
[2023-02-25 12:44:36,669][2409866] Sum rewards: -0.296, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.557', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'weapon4': '0.214', 'HITCOUNT': '0.340', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.077', 'weapon3': '1.724', 'weapon2': '1.832'}
[2023-02-25 12:44:36,945][2409547] DAMAGECOUNT value on done: 1210.0
[2023-02-25 12:44:36,949][2409547] Sum rewards: 2.704, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.075', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.037', 'weapon5': '0.058', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.178', 'HITCOUNT': '0.310', 'WEAPON3': '0.400', 'ARMOR': '0.897', 'weapon3': '1.264', 'weapon2': '1.294', 'DAMAGECOUNT': '1.320', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:37,177][2409080] DAMAGECOUNT value on done: 1162.0
[2023-02-25 12:44:37,180][2409080] Sum rewards: 2.267, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.651', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO3': '0.058', 'WEAPON4': '0.150', 'HITCOUNT': '0.250', 'WEAPON3': '0.400', 'ARMOR': '0.448', 'weapon4': '0.452', 'DAMAGECOUNT': '0.858', 'weapon3': '0.876', 'weapon2': '1.152', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:37,186][2408954] Fps is (10 sec: 24985.6, 60 sec: 25395.2, 300 sec: 25256.4). Total num frames: 38686720. Throughput: 0: 6364.5. Samples: 9667080. Policy #0 lag: (min: 0.0, avg: 12.6, max: 24.0)
[2023-02-25 12:44:37,186][2408954] Avg episode reward: [(0, '0.973')]
[2023-02-25 12:44:37,312][2409486] DAMAGECOUNT value on done: 1458.0
[2023-02-25 12:44:37,315][2409486] Sum rewards: 3.486, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.680', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.065', 'weapon5': '0.070', 'AMMO3': '0.109', 'weapon4': '0.182', 'WEAPON5': '0.200', 'HITCOUNT': '0.280', 'WEAPON3': '0.650', 'weapon3': '1.070', 'DAMAGECOUNT': '1.176', 'ARMOR': '1.291', 'weapon2': '1.752', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:44:37,320][2409355] DAMAGECOUNT value on done: 1189.0
[2023-02-25 12:44:37,452][2409075] DAMAGECOUNT value on done: 1294.0
[2023-02-25 12:44:37,453][2409075] Sum rewards: 0.969, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.220', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'weapon5': '0.060', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'HITCOUNT': '0.180', 'WEAPON3': '0.400', 'ARMOR': '0.456', 'DAMAGECOUNT': '0.618', 'FRAGCOUNT': '1.000', 'weapon3': '1.214', 'weapon2': '1.544'}
[2023-02-25 12:44:37,804][2409097] DAMAGECOUNT value on done: 1337.0
[2023-02-25 12:44:37,807][2409097] Sum rewards: 1.790, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.684', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon5': '0.028', 'AMMO2': '0.030', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'weapon4': '0.370', 'HITCOUNT': '0.520', 'WEAPON3': '0.650', 'ARMOR': '0.851', 'weapon2': '1.286', 'weapon3': '1.530', 'DAMAGECOUNT': '2.190', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:44:37,840][2409078] DAMAGECOUNT value on done: 1088.0
[2023-02-25 12:44:37,843][2409078] Sum rewards: 0.022, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.424', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.036', 'AMMO4': '0.109', 'AMMO3': '0.109', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.400', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.650', 'weapon4': '0.668', 'ARMOR': '0.882', 'DAMAGECOUNT': '1.152', 'weapon3': '1.284', 'weapon2': '1.774'}
[2023-02-25 12:44:38,005][2409074] Updated weights for policy 0, policy_version 9451 (0.0013)
[2023-02-25 12:44:38,244][2409468] DAMAGECOUNT value on done: 1419.0
[2023-02-25 12:44:38,245][2409468] Sum rewards: 2.071, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.984', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'weapon5': '0.042', 'AMMO3': '0.104', 'WEAPON5': '0.250', 'HITCOUNT': '0.380', 'WEAPON3': '0.600', 'ARMOR': '0.919', 'DAMAGECOUNT': '1.185', 'weapon3': '1.590', 'weapon2': '1.734', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:38,883][2409096] DAMAGECOUNT value on done: 1760.0
[2023-02-25 12:44:38,884][2409096] Sum rewards: -0.238, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.815', 'AMMO5': '0.018', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.082', 'AMMO4': '0.096', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.160', 'HITCOUNT': '0.180', 'WEAPON5': '0.300', 'weapon4': '0.376', 'ARMOR': '0.496', 'WEAPON3': '0.500', 'weapon2': '1.070', 'DAMAGECOUNT': '1.113', 'weapon3': '1.196', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:38,913][2409469] DAMAGECOUNT value on done: 1692.0
[2023-02-25 12:44:38,914][2409469] Sum rewards: 0.554, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.311', 'AMMO2': '0.008', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.040', 'weapon5': '0.064', 'AMMO3': '0.099', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.244', 'HITCOUNT': '0.460', 'WEAPON3': '0.600', 'ARMOR': '0.854', 'weapon3': '1.386', 'DAMAGECOUNT': '1.779', 'weapon2': '1.898', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:39,337][2409074] Updated weights for policy 0, policy_version 9461 (0.0012)
[2023-02-25 12:44:39,370][2409076] DAMAGECOUNT value on done: 1961.0
[2023-02-25 12:44:39,373][2409076] Sum rewards: 6.860, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.110', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.034', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'AMMO4': '0.110', 'ARMOR': '0.456', 'HITCOUNT': '0.670', 'WEAPON3': '0.700', 'weapon2': '1.832', 'weapon3': '1.850', 'DAMAGECOUNT': '2.445', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:44:39,524][2409099] DAMAGECOUNT value on done: 1075.0
[2023-02-25 12:44:39,527][2409099] Sum rewards: -1.988, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.876', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.116', 'AMMO3': '0.150', 'HITCOUNT': '0.310', 'WEAPON3': '0.900', 'ARMOR': '0.901', 'DAMAGECOUNT': '0.936', 'FRAGCOUNT': '1.000', 'weapon2': '1.528', 'weapon3': '1.926'}
[2023-02-25 12:44:39,675][2409079] DAMAGECOUNT value on done: 1260.0
[2023-02-25 12:44:39,676][2409079] Sum rewards: -1.548, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.762', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.032', 'weapon5': '0.042', 'WEAPON1': '0.050', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'HITCOUNT': '0.280', 'WEAPON4': '0.300', 'weapon4': '0.398', 'ARMOR': '0.524', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.011', 'weapon2': '1.378', 'weapon3': '1.648', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:40,617][2409547] DAMAGECOUNT value on done: 1724.0
[2023-02-25 12:44:40,618][2409547] Sum rewards: 2.952, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.071', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.118', 'WEAPON4': '0.250', 'HITCOUNT': '0.310', 'weapon4': '0.364', 'ARMOR': '0.510', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.080', 'weapon2': '1.418', 'weapon3': '1.900', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:44:41,263][2409080] DAMAGECOUNT value on done: 1078.0
[2023-02-25 12:44:41,264][2409080] Sum rewards: -1.551, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.862', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon5': '0.036', 'WEAPON5': '0.050', 'ARMOR': '0.052', 'AMMO3': '0.061', 'AMMO4': '0.140', 'HITCOUNT': '0.150', 'weapon4': '0.310', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.585', 'weapon3': '0.912', 'FRAGCOUNT': '1.000', 'weapon2': '1.964'}
[2023-02-25 12:44:41,336][2409074] Updated weights for policy 0, policy_version 9471 (0.0012)
[2023-02-25 12:44:41,443][2409097] DAMAGECOUNT value on done: 1445.0
[2023-02-25 12:44:41,445][2409097] Sum rewards: 2.278, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.654', 'AMMO5': '0.014', 'AMMO2': '0.025', 'AMMO3': '0.067', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'weapon5': '0.202', 'WEAPON5': '0.300', 'HITCOUNT': '0.300', 'WEAPON3': '0.400', 'ARMOR': '0.499', 'weapon4': '0.636', 'weapon2': '0.830', 'weapon3': '1.204', 'DAMAGECOUNT': '1.680', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:44:41,598][2409078] DAMAGECOUNT value on done: 1407.0
[2023-02-25 12:44:41,602][2409078] Sum rewards: 0.868, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.576', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'weapon5': '0.026', 'ARMOR': '0.032', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.190', 'weapon4': '0.220', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.540', 'FRAGCOUNT': '1.000', 'weapon2': '1.254', 'weapon3': '1.294'}
[2023-02-25 12:44:41,650][2409486] DAMAGECOUNT value on done: 1232.0
[2023-02-25 12:44:42,186][2408954] Fps is (10 sec: 25804.9, 60 sec: 25463.5, 300 sec: 25298.0). Total num frames: 38817792. Throughput: 0: 6381.1. Samples: 9705636. Policy #0 lag: (min: 0.0, avg: 12.6, max: 24.0)
[2023-02-25 12:44:42,186][2408954] Avg episode reward: [(0, '0.842')]
[2023-02-25 12:44:42,382][2409468] DAMAGECOUNT value on done: 1395.0
[2023-02-25 12:44:42,383][2409468] Sum rewards: 1.083, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.022', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.140', 'WEAPON4': '0.250', 'HITCOUNT': '0.260', 'WEAPON3': '0.400', 'HEALTH': '0.486', 'weapon4': '0.576', 'ARMOR': '0.600', 'DAMAGECOUNT': '1.074', 'weapon2': '1.270', 'weapon3': '1.332', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:42,572][2409096] DAMAGECOUNT value on done: 949.0
[2023-02-25 12:44:42,575][2409096] Sum rewards: -3.624, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.800', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON1': '0.030', 'AMMO3': '0.150', 'HITCOUNT': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.414', 'ARMOR': '0.493', 'WEAPON3': '0.900', 'weapon2': '1.100', 'DAMAGECOUNT': '1.149', 'weapon3': '1.810', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:42,579][2409074] Updated weights for policy 0, policy_version 9481 (0.0012)
[2023-02-25 12:44:42,600][2409469] DAMAGECOUNT value on done: 1017.0
[2023-02-25 12:44:42,601][2409469] Sum rewards: 2.048, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.015', 'HEALTH': '0.016', 'AMMO3': '0.058', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'HITCOUNT': '0.200', 'weapon4': '0.206', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.744', 'weapon3': '1.004', 'ARMOR': '1.337', 'weapon2': '1.894', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:43,259][2409079] DAMAGECOUNT value on done: 1349.0
[2023-02-25 12:44:43,262][2409079] Sum rewards: 3.053, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.797', 'AMMO4': '-0.065', 'AMMO2': '-0.013', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'weapon4': '0.114', 'HITCOUNT': '0.490', 'WEAPON3': '0.550', 'ARMOR': '0.889', 'weapon2': '1.526', 'DAMAGECOUNT': '1.614', 'weapon3': '1.754', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:44,027][2409099] DAMAGECOUNT value on done: 1414.0
[2023-02-25 12:44:44,028][2409099] Sum rewards: -1.914, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.624', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.034', 'WEAPON5': '0.050', 'AMMO3': '0.131', 'WEAPON4': '0.250', 'weapon4': '0.258', 'HITCOUNT': '0.340', 'ARMOR': '0.483', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.128', 'weapon2': '1.538', 'weapon3': '1.562', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:44,305][2409547] DAMAGECOUNT value on done: 1397.0
[2023-02-25 12:44:44,309][2409547] Sum rewards: -0.033, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.858', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon5': '0.070', 'AMMO3': '0.110', 'WEAPON5': '0.150', 'HITCOUNT': '0.250', 'ARMOR': '0.440', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.107', 'weapon3': '1.706', 'weapon2': '1.874', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:44,369][2409074] Updated weights for policy 0, policy_version 9491 (0.0012)
[2023-02-25 12:44:45,533][2409080] DAMAGECOUNT value on done: 1148.0
[2023-02-25 12:44:45,538][2409080] Sum rewards: 2.748, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.429', 'AMMO5': '0.003', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'weapon5': '0.050', 'AMMO3': '0.064', 'WEAPON5': '0.100', 'weapon4': '0.128', 'HITCOUNT': '0.320', 'WEAPON3': '0.450', 'ARMOR': '0.469', 'DAMAGECOUNT': '1.002', 'weapon3': '1.190', 'weapon2': '1.798', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:45,773][2409074] Updated weights for policy 0, policy_version 9501 (0.0013)
[2023-02-25 12:44:46,222][2409486] DAMAGECOUNT value on done: 1124.0
[2023-02-25 12:44:46,251][2409096] DAMAGECOUNT value on done: 2061.0
[2023-02-25 12:44:46,252][2409096] Sum rewards: 7.706, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.074', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.072', 'WEAPON3': '0.550', 'HITCOUNT': '0.780', 'ARMOR': '0.851', 'weapon3': '1.656', 'weapon2': '1.798', 'DAMAGECOUNT': '2.748', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:44:46,452][2409468] DAMAGECOUNT value on done: 952.0
[2023-02-25 12:44:46,457][2409468] Sum rewards: 1.156, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.880', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO3': '0.089', 'HITCOUNT': '0.250', 'ARMOR': '0.460', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.750', 'weapon3': '1.250', 'weapon2': '2.398', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:44:46,860][2409079] DAMAGECOUNT value on done: 1173.0
[2023-02-25 12:44:46,864][2409079] Sum rewards: 1.375, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.450', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.027', 'WEAPON5': '0.100', 'AMMO3': '0.125', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.300', 'weapon4': '0.338', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.035', 'weapon3': '1.394', 'weapon2': '1.672', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:47,186][2408954] Fps is (10 sec: 25804.8, 60 sec: 25395.2, 300 sec: 25325.8). Total num frames: 38944768. Throughput: 0: 6381.9. Samples: 9744108. Policy #0 lag: (min: 0.0, avg: 12.0, max: 25.0)
[2023-02-25 12:44:47,186][2408954] Avg episode reward: [(0, '0.934')]
[2023-02-25 12:44:47,507][2409074] Updated weights for policy 0, policy_version 9511 (0.0012)
[2023-02-25 12:44:48,309][2409547] DAMAGECOUNT value on done: 1089.0
[2023-02-25 12:44:48,310][2409547] Sum rewards: 2.408, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.235', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'AMMO3': '0.064', 'WEAPON4': '0.100', 'weapon4': '0.138', 'WEAPON5': '0.150', 'weapon5': '0.190', 'HITCOUNT': '0.280', 'WEAPON3': '0.450', 'ARMOR': '0.850', 'weapon3': '0.862', 'DAMAGECOUNT': '0.972', 'weapon2': '1.342', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:48,528][2409099] DAMAGECOUNT value on done: 1524.0
[2023-02-25 12:44:48,529][2409099] Sum rewards: 2.192, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.930', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.058', 'AMMO3': '0.071', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.212', 'HITCOUNT': '0.280', 'WEAPON3': '0.450', 'ARMOR': '0.908', 'weapon3': '1.068', 'DAMAGECOUNT': '1.293', 'weapon2': '1.836', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:49,369][2409080] DAMAGECOUNT value on done: 1008.0
[2023-02-25 12:44:49,385][2409074] Updated weights for policy 0, policy_version 9521 (0.0012)
[2023-02-25 12:44:50,257][2409074] Updated weights for policy 0, policy_version 9531 (0.0012)
[2023-02-25 12:44:50,324][2409096] DAMAGECOUNT value on done: 1166.0
[2023-02-25 12:44:50,327][2409096] Sum rewards: 3.110, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.770', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'weapon7': '0.056', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'HITCOUNT': '0.300', 'ARMOR': '0.453', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.086', 'weapon3': '1.516', 'weapon2': '1.796', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:44:50,373][2409468] DAMAGECOUNT value on done: 1323.0
[2023-02-25 12:44:50,376][2409468] Sum rewards: 3.785, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.692', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'AMMO4': '0.063', 'AMMO3': '0.078', 'WEAPON5': '0.100', 'ARMOR': '0.457', 'HITCOUNT': '0.470', 'WEAPON3': '0.550', 'weapon3': '1.504', 'DAMAGECOUNT': '1.659', 'weapon2': '1.798', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:44:50,994][2409079] DAMAGECOUNT value on done: 811.0
[2023-02-25 12:44:52,099][2409547] DAMAGECOUNT value on done: 1418.0
[2023-02-25 12:44:52,104][2409547] Sum rewards: 3.788, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.515', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.093', 'WEAPON4': '0.150', 'weapon4': '0.190', 'HITCOUNT': '0.330', 'WEAPON3': '0.650', 'ARMOR': '0.937', 'weapon2': '1.380', 'DAMAGECOUNT': '1.410', 'weapon3': '1.650', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:44:52,186][2408954] Fps is (10 sec: 25395.1, 60 sec: 25326.9, 300 sec: 25270.2). Total num frames: 39071744. Throughput: 0: 6384.0. Samples: 9763356. Policy #0 lag: (min: 0.0, avg: 12.2, max: 25.0)
[2023-02-25 12:44:52,186][2408954] Avg episode reward: [(0, '1.076')]
[2023-02-25 12:44:52,286][2409099] DAMAGECOUNT value on done: 1171.0
[2023-02-25 12:44:52,290][2409099] Sum rewards: 0.545, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.915', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.056', 'weapon7': '0.062', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.206', 'HITCOUNT': '0.250', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.735', 'weapon2': '1.332', 'weapon3': '1.630', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:52,402][2409074] Updated weights for policy 0, policy_version 9541 (0.0012)
[2023-02-25 12:44:53,352][2409080] DAMAGECOUNT value on done: 1541.0
[2023-02-25 12:44:53,355][2409080] Sum rewards: 3.672, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.920', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.254', 'ARMOR': '0.400', 'HITCOUNT': '0.440', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.611', 'weapon3': '1.752', 'weapon2': '1.760', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:44:53,720][2409074] Updated weights for policy 0, policy_version 9551 (0.0012)
[2023-02-25 12:44:54,667][2409468] DAMAGECOUNT value on done: 1849.0
[2023-02-25 12:44:54,672][2409468] Sum rewards: 5.598, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.764', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.083', 'weapon5': '0.146', 'WEAPON5': '0.150', 'HITCOUNT': '0.420', 'WEAPON3': '0.450', 'ARMOR': '0.900', 'weapon3': '1.362', 'DAMAGECOUNT': '1.980', 'weapon2': '2.060', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:44:55,549][2409074] Updated weights for policy 0, policy_version 9561 (0.0012)
[2023-02-25 12:44:55,889][2409547] DAMAGECOUNT value on done: 1096.0
[2023-02-25 12:44:55,890][2409547] Sum rewards: -1.027, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.029', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'AMMO4': '0.146', 'weapon4': '0.156', 'HITCOUNT': '0.170', 'WEAPON3': '0.300', 'ARMOR': '0.412', 'HEALTH': '0.554', 'DAMAGECOUNT': '0.570', 'FRAGCOUNT': '1.000', 'weapon3': '1.332', 'weapon2': '1.632'}
[2023-02-25 12:44:56,170][2409099] DAMAGECOUNT value on done: 1743.0
[2023-02-25 12:44:56,173][2409099] Sum rewards: 2.771, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.410', 'AMMO2': '0.016', 'AMMO4': '0.080', 'AMMO3': '0.117', 'weapon4': '0.124', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'HITCOUNT': '0.410', 'WEAPON3': '0.650', 'weapon2': '1.530', 'DAMAGECOUNT': '1.560', 'weapon3': '1.844', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:44:57,127][2409074] Updated weights for policy 0, policy_version 9571 (0.0014)
[2023-02-25 12:44:57,186][2408954] Fps is (10 sec: 25804.3, 60 sec: 25531.8, 300 sec: 25325.8). Total num frames: 39202816. Throughput: 0: 6387.4. Samples: 9801864. Policy #0 lag: (min: 0.0, avg: 12.2, max: 25.0)
[2023-02-25 12:44:57,187][2408954] Avg episode reward: [(0, '1.074')]
[2023-02-25 12:44:57,449][2409080] DAMAGECOUNT value on done: 1453.0
[2023-02-25 12:44:57,453][2409080] Sum rewards: 0.675, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.734', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.012', 'AMMO3': '0.078', 'weapon5': '0.088', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.286', 'HITCOUNT': '0.390', 'WEAPON3': '0.600', 'ARMOR': '0.981', 'DAMAGECOUNT': '1.377', 'weapon2': '1.400', 'weapon3': '1.628', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:44:58,411][2409468] DAMAGECOUNT value on done: 1207.0
[2023-02-25 12:44:58,551][2409074] Updated weights for policy 0, policy_version 9581 (0.0012)
[2023-02-25 12:44:59,756][2409099] DAMAGECOUNT value on done: 1417.0
[2023-02-25 12:44:59,757][2409099] Sum rewards: -2.010, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.812', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.073', 'HITCOUNT': '0.240', 'WEAPON4': '0.300', 'weapon4': '0.306', 'ARMOR': '0.440', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.669', 'FRAGCOUNT': '1.000', 'weapon2': '1.198', 'weapon3': '1.556'}
[2023-02-25 12:45:00,101][2409547] DAMAGECOUNT value on done: 1341.0
[2023-02-25 12:45:00,102][2409547] Sum rewards: 1.454, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.805', 'AMMO4': '-0.065', 'AMMO2': '-0.013', 'WEAPON1': '0.010', 'AMMO3': '0.030', 'HITCOUNT': '0.170', 'WEAPON3': '0.250', 'DAMAGECOUNT': '0.456', 'weapon3': '0.732', 'ARMOR': '0.937', 'FRAGCOUNT': '1.000', 'weapon2': '1.752'}
[2023-02-25 12:45:00,106][2409074] Updated weights for policy 0, policy_version 9591 (0.0012)
[2023-02-25 12:45:01,231][2409080] DAMAGECOUNT value on done: 1872.0
[2023-02-25 12:45:01,235][2409080] Sum rewards: 2.081, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.134', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.014', 'weapon5': '0.046', 'AMMO3': '0.099', 'WEAPON5': '0.200', 'ARMOR': '0.440', 'HITCOUNT': '0.480', 'WEAPON3': '0.750', 'weapon2': '1.526', 'weapon3': '1.996', 'DAMAGECOUNT': '2.187', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:45:01,520][2409074] Updated weights for policy 0, policy_version 9601 (0.0012)
[2023-02-25 12:45:02,186][2408954] Fps is (10 sec: 26214.4, 60 sec: 25600.1, 300 sec: 25395.2). Total num frames: 39333888. Throughput: 0: 6408.8. Samples: 9840816. Policy #0 lag: (min: 0.0, avg: 12.6, max: 25.0)
[2023-02-25 12:45:02,186][2408954] Avg episode reward: [(0, '0.955')]
[2023-02-25 12:45:02,230][2409468] DAMAGECOUNT value on done: 1785.0
[2023-02-25 12:45:02,230][2409468] Sum rewards: 7.742, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.185', 'AMMO5': '0.003', 'AMMO2': '0.012', 'ARMOR': '0.040', 'AMMO3': '0.045', 'AMMO4': '0.059', 'weapon5': '0.060', 'WEAPON5': '0.100', 'weapon7': '0.138', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.460', 'weapon4': '0.602', 'weapon3': '0.870', 'weapon2': '1.578', 'DAMAGECOUNT': '2.061', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:45:03,333][2409074] Updated weights for policy 0, policy_version 9611 (0.0012)
[2023-02-25 12:45:03,723][2409547] DAMAGECOUNT value on done: 1577.0
[2023-02-25 12:45:03,723][2409547] Sum rewards: 9.141, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.845', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'weapon5': '0.048', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.292', 'WEAPON3': '0.600', 'HITCOUNT': '0.770', 'weapon2': '1.408', 'weapon3': '1.740', 'DAMAGECOUNT': '2.967', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:45:04,909][2409074] Updated weights for policy 0, policy_version 9621 (0.0012)
[2023-02-25 12:45:04,960][2409080] DAMAGECOUNT value on done: 1196.0
[2023-02-25 12:45:04,961][2409080] Sum rewards: 1.566, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.714', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.023', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.087', 'weapon4': '0.140', 'HITCOUNT': '0.410', 'WEAPON3': '0.550', 'ARMOR': '0.979', 'DAMAGECOUNT': '1.167', 'weapon3': '1.580', 'weapon2': '1.754', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:45:05,966][2409468] DAMAGECOUNT value on done: 1272.0
[2023-02-25 12:45:05,967][2409468] Sum rewards: 0.180, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.918', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.036', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.096', 'AMMO4': '0.180', 'weapon4': '0.272', 'WEAPON4': '0.350', 'ARMOR': '0.501', 'HITCOUNT': '0.530', 'WEAPON3': '0.600', 'weapon3': '1.352', 'DAMAGECOUNT': '1.767', 'weapon2': '2.054', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:45:06,713][2409074] Updated weights for policy 0, policy_version 9631 (0.0012)
[2023-02-25 12:45:07,186][2408954] Fps is (10 sec: 25805.1, 60 sec: 25600.0, 300 sec: 25298.0). Total num frames: 39460864. Throughput: 0: 6427.7. Samples: 9860364. Policy #0 lag: (min: 0.0, avg: 12.2, max: 27.0)
[2023-02-25 12:45:07,186][2408954] Avg episode reward: [(0, '1.090')]
[2023-02-25 12:45:07,855][2409547] DAMAGECOUNT value on done: 1255.0
[2023-02-25 12:45:07,858][2409547] Sum rewards: 1.244, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.300', 'AMMO4': '-0.088', 'AMMO2': '-0.018', 'AMMO5': '0.003', 'WEAPON1': '0.030', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.094', 'HITCOUNT': '0.320', 'ARMOR': '0.455', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.990', 'weapon3': '1.658', 'weapon2': '1.670', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:45:08,218][2409074] Updated weights for policy 0, policy_version 9641 (0.0012)
[2023-02-25 12:45:08,843][2409080] DAMAGECOUNT value on done: 1707.0
[2023-02-25 12:45:08,845][2409080] Sum rewards: 0.850, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.930', 'AMMO5': '0.011', 'AMMO2': '0.015', 'WEAPON1': '0.050', 'AMMO3': '0.067', 'weapon7': '0.074', 'AMMO4': '0.074', 'weapon5': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.220', 'weapon4': '0.246', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'weapon2': '0.636', 'DAMAGECOUNT': '0.885', 'weapon3': '1.328', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:45:09,834][2409074] Updated weights for policy 0, policy_version 9651 (0.0013)
[2023-02-25 12:45:09,880][2409468] DAMAGECOUNT value on done: 1139.0
[2023-02-25 12:45:09,884][2409468] Sum rewards: 0.575, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.845', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO3': '0.089', 'weapon4': '0.196', 'HITCOUNT': '0.390', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.242', 'weapon3': '1.336', 'weapon2': '1.548'}
[2023-02-25 12:45:11,296][2409074] Updated weights for policy 0, policy_version 9661 (0.0012)
[2023-02-25 12:45:12,186][2408954] Fps is (10 sec: 25804.8, 60 sec: 25600.0, 300 sec: 25367.4). Total num frames: 39591936. Throughput: 0: 6439.2. Samples: 9899100. Policy #0 lag: (min: 0.0, avg: 12.2, max: 27.0)
[2023-02-25 12:45:12,186][2408954] Avg episode reward: [(0, '1.072')]
[2023-02-25 12:45:12,492][2409074] Updated weights for policy 0, policy_version 9671 (0.0012)
[2023-02-25 12:45:12,748][2409080] DAMAGECOUNT value on done: 1222.0
[2023-02-25 12:45:12,751][2409080] Sum rewards: -0.067, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.302', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'weapon5': '0.002', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'WEAPON1': '0.090', 'AMMO3': '0.102', 'HITCOUNT': '0.240', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.795', 'weapon2': '1.454', 'FRAGCOUNT': '2.000', 'weapon3': '2.300'}
[2023-02-25 12:45:13,852][2409468] DAMAGECOUNT value on done: 1378.0
[2023-02-25 12:45:13,853][2409468] Sum rewards: -0.068, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.578', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.017', 'AMMO3': '0.070', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.220', 'weapon4': '0.238', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.756', 'FRAGCOUNT': '1.000', 'weapon2': '1.270', 'weapon3': '1.440'}
[2023-02-25 12:45:14,575][2409074] Updated weights for policy 0, policy_version 9681 (0.0013)
[2023-02-25 12:45:16,021][2409074] Updated weights for policy 0, policy_version 9691 (0.0013)
[2023-02-25 12:45:16,504][2409080] DAMAGECOUNT value on done: 897.0
[2023-02-25 12:45:16,506][2409080] Sum rewards: -5.263, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.840', 'ARMOR': '0.008', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON1': '0.040', 'AMMO3': '0.072', 'HITCOUNT': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.392', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.699', 'FRAGCOUNT': '1.000', 'weapon3': '1.218', 'weapon2': '1.850'}
[2023-02-25 12:45:17,186][2408954] Fps is (10 sec: 25804.9, 60 sec: 25600.0, 300 sec: 25409.1). Total num frames: 39718912. Throughput: 0: 6451.5. Samples: 9937788. Policy #0 lag: (min: 0.0, avg: 11.2, max: 24.0)
[2023-02-25 12:45:17,186][2408954] Avg episode reward: [(0, '0.973')]
[2023-02-25 12:45:17,540][2409468] DAMAGECOUNT value on done: 1501.0
[2023-02-25 12:45:17,627][2409074] Updated weights for policy 0, policy_version 9701 (0.0012)
[2023-02-25 12:45:19,126][2409074] Updated weights for policy 0, policy_version 9711 (0.0013)
[2023-02-25 12:45:21,154][2409074] Updated weights for policy 0, policy_version 9721 (0.0013)
[2023-02-25 12:45:21,401][2409468] DAMAGECOUNT value on done: 1164.0
[2023-02-25 12:45:21,402][2409468] Sum rewards: 3.227, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.838', 'AMMO2': '0.002', 'AMMO5': '0.010', 'AMMO4': '0.011', 'weapon5': '0.032', 'AMMO3': '0.053', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.310', 'WEAPON3': '0.400', 'weapon4': '0.424', 'weapon3': '1.112', 'DAMAGECOUNT': '1.191', 'weapon2': '1.420', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:45:22,186][2408954] Fps is (10 sec: 26214.5, 60 sec: 25873.1, 300 sec: 25409.1). Total num frames: 39854080. Throughput: 0: 6437.6. Samples: 9956772. Policy #0 lag: (min: 0.0, avg: 11.2, max: 24.0)
[2023-02-25 12:45:22,186][2408954] Avg episode reward: [(0, '0.966')]
[2023-02-25 12:45:22,422][2409074] Updated weights for policy 0, policy_version 9731 (0.0012)
[2023-02-25 12:45:23,536][2409074] Updated weights for policy 0, policy_version 9741 (0.0012)
[2023-02-25 12:45:25,491][2409468] DAMAGECOUNT value on done: 1091.0
[2023-02-25 12:45:25,492][2409468] Sum rewards: 2.405, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.561', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'weapon5': '0.050', 'AMMO3': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'weapon4': '0.130', 'WEAPON4': '0.200', 'HITCOUNT': '0.390', 'WEAPON3': '0.400', 'weapon3': '1.108', 'DAMAGECOUNT': '1.644', 'weapon2': '1.728', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:45:25,529][2409074] Updated weights for policy 0, policy_version 9751 (0.0012)
[2023-02-25 12:45:27,099][2409074] Updated weights for policy 0, policy_version 9761 (0.0012)
[2023-02-25 12:45:27,186][2408954] Fps is (10 sec: 26624.0, 60 sec: 25804.8, 300 sec: 25436.9). Total num frames: 39985152. Throughput: 0: 6438.9. Samples: 9995388. Policy #0 lag: (min: 0.0, avg: 12.3, max: 25.0)
[2023-02-25 12:45:27,186][2408954] Avg episode reward: [(0, '1.031')]
[2023-02-25 12:45:28,927][2409074] Updated weights for policy 0, policy_version 9771 (0.0012)
[2023-02-25 12:45:30,167][2409074] Updated weights for policy 0, policy_version 9781 (0.0013)
[2023-02-25 12:45:32,186][2408954] Fps is (10 sec: 24574.8, 60 sec: 25668.1, 300 sec: 25422.9). Total num frames: 40099840. Throughput: 0: 6442.6. Samples: 10034028. Policy #0 lag: (min: 1.0, avg: 13.4, max: 26.0)
[2023-02-25 12:45:32,187][2408954] Avg episode reward: [(0, '1.031')]
[2023-02-25 12:45:32,225][2409074] Updated weights for policy 0, policy_version 9791 (0.0012)
[2023-02-25 12:45:33,754][2409074] Updated weights for policy 0, policy_version 9801 (0.0013)
[2023-02-25 12:45:34,815][2409074] Updated weights for policy 0, policy_version 9811 (0.0013)
[2023-02-25 12:45:36,829][2409074] Updated weights for policy 0, policy_version 9821 (0.0013)
[2023-02-25 12:45:37,186][2408954] Fps is (10 sec: 24575.6, 60 sec: 25736.4, 300 sec: 25409.2). Total num frames: 40230912. Throughput: 0: 6446.9. Samples: 10053468. Policy #0 lag: (min: 1.0, avg: 13.4, max: 26.0)
[2023-02-25 12:45:37,186][2408954] Avg episode reward: [(0, '1.031')]
[2023-02-25 12:45:37,966][2409074] Updated weights for policy 0, policy_version 9831 (0.0013)
[2023-02-25 12:45:39,838][2409074] Updated weights for policy 0, policy_version 9841 (0.0013)
[2023-02-25 12:45:41,426][2409074] Updated weights for policy 0, policy_version 9851 (0.0013)
[2023-02-25 12:45:42,186][2408954] Fps is (10 sec: 27444.4, 60 sec: 25941.3, 300 sec: 25450.7). Total num frames: 40374272. Throughput: 0: 6455.2. Samples: 10092348. Policy #0 lag: (min: 3.0, avg: 13.9, max: 31.0)
[2023-02-25 12:45:42,186][2408954] Avg episode reward: [(0, '1.031')]
[2023-02-25 12:45:42,979][2409074] Updated weights for policy 0, policy_version 9861 (0.0012)
[2023-02-25 12:45:44,711][2409074] Updated weights for policy 0, policy_version 9871 (0.0013)
[2023-02-25 12:45:46,047][2409074] Updated weights for policy 0, policy_version 9881 (0.0012)
[2023-02-25 12:45:47,186][2408954] Fps is (10 sec: 26623.8, 60 sec: 25873.0, 300 sec: 25492.4). Total num frames: 40497152. Throughput: 0: 6448.5. Samples: 10131000. Policy #0 lag: (min: 0.0, avg: 11.8, max: 24.0)
[2023-02-25 12:45:47,186][2408954] Avg episode reward: [(0, '1.031')]
[2023-02-25 12:45:47,798][2409033] Signal inference workers to stop experience collection... (1250 times)
[2023-02-25 12:45:47,814][2409033] Signal inference workers to resume experience collection... (1250 times)
[2023-02-25 12:45:47,821][2409074] InferenceWorker_p0-w0: stopping experience collection (1250 times)
[2023-02-25 12:45:47,841][2409074] InferenceWorker_p0-w0: resuming experience collection (1250 times)
[2023-02-25 12:45:47,847][2409074] Updated weights for policy 0, policy_version 9891 (0.0012)
[2023-02-25 12:45:49,590][2409074] Updated weights for policy 0, policy_version 9901 (0.0012)
[2023-02-25 12:45:50,991][2409074] Updated weights for policy 0, policy_version 9911 (0.0012)
[2023-02-25 12:45:52,186][2408954] Fps is (10 sec: 25395.2, 60 sec: 25941.3, 300 sec: 25409.1). Total num frames: 40628224. Throughput: 0: 6441.6. Samples: 10150236. Policy #0 lag: (min: 0.0, avg: 11.8, max: 24.0)
[2023-02-25 12:45:52,186][2408954] Avg episode reward: [(0, '1.031')]
[2023-02-25 12:45:52,464][2409074] Updated weights for policy 0, policy_version 9921 (0.0013)
[2023-02-25 12:45:54,079][2409074] Updated weights for policy 0, policy_version 9931 (0.0012)
[2023-02-25 12:45:55,688][2409074] Updated weights for policy 0, policy_version 9941 (0.0012)
[2023-02-25 12:45:57,186][2408954] Fps is (10 sec: 25395.4, 60 sec: 25804.8, 300 sec: 25436.9). Total num frames: 40751104. Throughput: 0: 6440.5. Samples: 10188924. Policy #0 lag: (min: 0.0, avg: 11.7, max: 25.0)
[2023-02-25 12:45:57,187][2408954] Avg episode reward: [(0, '1.031')]
[2023-02-25 12:45:57,580][2409074] Updated weights for policy 0, policy_version 9951 (0.0012)
[2023-02-25 12:45:59,286][2409074] Updated weights for policy 0, policy_version 9961 (0.0012)
[2023-02-25 12:46:00,467][2409074] Updated weights for policy 0, policy_version 9971 (0.0013)
[2023-02-25 12:46:02,049][2409074] Updated weights for policy 0, policy_version 9981 (0.0012)
[2023-02-25 12:46:02,186][2408954] Fps is (10 sec: 25804.8, 60 sec: 25873.1, 300 sec: 25464.6). Total num frames: 40886272. Throughput: 0: 6436.0. Samples: 10227408. Policy #0 lag: (min: 0.0, avg: 12.4, max: 27.0)
[2023-02-25 12:46:02,186][2408954] Avg episode reward: [(0, '1.031')]
[2023-02-25 12:46:03,739][2409074] Updated weights for policy 0, policy_version 9991 (0.0012)
[2023-02-25 12:46:05,323][2409074] Updated weights for policy 0, policy_version 10001 (0.0012)
[2023-02-25 12:46:06,987][2409074] Updated weights for policy 0, policy_version 10011 (0.0012)
[2023-02-25 12:46:07,186][2408954] Fps is (10 sec: 25804.9, 60 sec: 25804.8, 300 sec: 25450.7). Total num frames: 41009152. Throughput: 0: 6434.4. Samples: 10246320. Policy #0 lag: (min: 0.0, avg: 12.4, max: 27.0)
[2023-02-25 12:46:07,186][2408954] Avg episode reward: [(0, '1.031')]
[2023-02-25 12:46:08,652][2409074] Updated weights for policy 0, policy_version 10021 (0.0012)
[2023-02-25 12:46:10,190][2409074] Updated weights for policy 0, policy_version 10031 (0.0012)
[2023-02-25 12:46:11,617][2409074] Updated weights for policy 0, policy_version 10041 (0.0012)
[2023-02-25 12:46:12,186][2408954] Fps is (10 sec: 24985.5, 60 sec: 25736.5, 300 sec: 25423.0). Total num frames: 41136128. Throughput: 0: 6435.2. Samples: 10284972. Policy #0 lag: (min: 0.0, avg: 13.7, max: 25.0)
[2023-02-25 12:46:12,186][2408954] Avg episode reward: [(0, '1.031')]
[2023-02-25 12:46:13,244][2409074] Updated weights for policy 0, policy_version 10051 (0.0012)
[2023-02-25 12:46:14,941][2409074] Updated weights for policy 0, policy_version 10061 (0.0012)
[2023-02-25 12:46:16,599][2409074] Updated weights for policy 0, policy_version 10071 (0.0012)
[2023-02-25 12:46:17,186][2408954] Fps is (10 sec: 26214.3, 60 sec: 25873.0, 300 sec: 25464.6). Total num frames: 41271296. Throughput: 0: 6432.3. Samples: 10323480. Policy #0 lag: (min: 0.0, avg: 13.7, max: 25.0)
[2023-02-25 12:46:17,186][2408954] Avg episode reward: [(0, '1.031')]
[2023-02-25 12:46:17,191][2409033] Saving /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000010076_41271296.pth...
[2023-02-25 12:46:17,291][2409033] Removing /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000008579_35139584.pth
[2023-02-25 12:46:18,290][2409074] Updated weights for policy 0, policy_version 10081 (0.0012)
[2023-02-25 12:46:19,609][2409074] Updated weights for policy 0, policy_version 10091 (0.0012)
[2023-02-25 12:46:21,127][2409074] Updated weights for policy 0, policy_version 10101 (0.0012)
[2023-02-25 12:46:22,186][2408954] Fps is (10 sec: 25803.8, 60 sec: 25668.1, 300 sec: 25436.8). Total num frames: 41394176. Throughput: 0: 6432.5. Samples: 10342932. Policy #0 lag: (min: 0.0, avg: 12.1, max: 26.0)
[2023-02-25 12:46:22,187][2408954] Avg episode reward: [(0, '1.031')]
[2023-02-25 12:46:23,107][2409074] Updated weights for policy 0, policy_version 10111 (0.0013)
[2023-02-25 12:46:24,367][2409074] Updated weights for policy 0, policy_version 10121 (0.0012)
[2023-02-25 12:46:25,941][2409074] Updated weights for policy 0, policy_version 10131 (0.0012)
[2023-02-25 12:46:27,186][2408954] Fps is (10 sec: 25395.6, 60 sec: 25668.3, 300 sec: 25464.6). Total num frames: 41525248. Throughput: 0: 6428.5. Samples: 10381632. Policy #0 lag: (min: 0.0, avg: 12.2, max: 25.0)
[2023-02-25 12:46:27,186][2408954] Avg episode reward: [(0, '1.031')]
[2023-02-25 12:46:27,544][2409074] Updated weights for policy 0, policy_version 10141 (0.0013)
[2023-02-25 12:46:29,421][2409074] Updated weights for policy 0, policy_version 10151 (0.0013)
[2023-02-25 12:46:30,900][2409074] Updated weights for policy 0, policy_version 10161 (0.0013)
[2023-02-25 12:46:32,186][2408954] Fps is (10 sec: 25805.8, 60 sec: 25873.3, 300 sec: 25436.9). Total num frames: 41652224. Throughput: 0: 6423.5. Samples: 10420056. Policy #0 lag: (min: 0.0, avg: 12.2, max: 25.0)
[2023-02-25 12:46:32,186][2408954] Avg episode reward: [(0, '1.031')]
[2023-02-25 12:46:32,249][2409074] Updated weights for policy 0, policy_version 10171 (0.0014)
[2023-02-25 12:46:34,279][2409074] Updated weights for policy 0, policy_version 10181 (0.0012)
[2023-02-25 12:46:35,364][2409074] Updated weights for policy 0, policy_version 10191 (0.0012)
[2023-02-25 12:46:37,186][2408954] Fps is (10 sec: 25395.2, 60 sec: 25804.9, 300 sec: 25464.6). Total num frames: 41779200. Throughput: 0: 6417.9. Samples: 10439040. Policy #0 lag: (min: 0.0, avg: 14.0, max: 29.0)
[2023-02-25 12:46:37,186][2408954] Avg episode reward: [(0, '1.031')]
[2023-02-25 12:46:37,266][2409074] Updated weights for policy 0, policy_version 10201 (0.0014)
[2023-02-25 12:46:38,697][2409074] Updated weights for policy 0, policy_version 10211 (0.0012)
[2023-02-25 12:46:40,191][2409074] Updated weights for policy 0, policy_version 10221 (0.0012)
[2023-02-25 12:46:41,837][2409074] Updated weights for policy 0, policy_version 10231 (0.0012)
[2023-02-25 12:46:42,186][2408954] Fps is (10 sec: 25395.2, 60 sec: 25531.7, 300 sec: 25478.5). Total num frames: 41906176. Throughput: 0: 6413.9. Samples: 10477548. Policy #0 lag: (min: 0.0, avg: 11.0, max: 24.0)
[2023-02-25 12:46:42,186][2408954] Avg episode reward: [(0, '1.031')]
[2023-02-25 12:46:43,601][2409074] Updated weights for policy 0, policy_version 10241 (0.0012)
[2023-02-25 12:46:45,195][2409033] Signal inference workers to stop experience collection... (1300 times)
[2023-02-25 12:46:45,196][2409033] Signal inference workers to resume experience collection... (1300 times)
[2023-02-25 12:46:45,227][2409074] InferenceWorker_p0-w0: stopping experience collection (1300 times)
[2023-02-25 12:46:45,227][2409074] InferenceWorker_p0-w0: resuming experience collection (1300 times)
[2023-02-25 12:46:45,315][2409074] Updated weights for policy 0, policy_version 10251 (0.0012)
[2023-02-25 12:46:46,845][2409074] Updated weights for policy 0, policy_version 10261 (0.0012)
[2023-02-25 12:46:47,186][2408954] Fps is (10 sec: 25804.9, 60 sec: 25668.4, 300 sec: 25478.5). Total num frames: 42037248. Throughput: 0: 6417.9. Samples: 10516212. Policy #0 lag: (min: 0.0, avg: 11.0, max: 24.0)
[2023-02-25 12:46:47,186][2408954] Avg episode reward: [(0, '1.031')]
[2023-02-25 12:46:48,517][2409074] Updated weights for policy 0, policy_version 10271 (0.0012)
[2023-02-25 12:46:48,742][2409100] DAMAGECOUNT value on done: 2026.0
[2023-02-25 12:46:48,743][2409100] Sum rewards: 2.764, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.826', 'AMMO2': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.021', 'weapon7': '0.064', 'AMMO3': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon5': '0.156', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.380', 'ARMOR': '0.404', 'weapon4': '0.452', 'WEAPON3': '0.600', 'weapon3': '0.994', 'weapon2': '1.282', 'DAMAGECOUNT': '1.767', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:46:49,984][2409074] Updated weights for policy 0, policy_version 10281 (0.0013)
[2023-02-25 12:46:51,339][2409074] Updated weights for policy 0, policy_version 10291 (0.0012)
[2023-02-25 12:46:52,186][2408954] Fps is (10 sec: 25804.8, 60 sec: 25600.0, 300 sec: 25506.3). Total num frames: 42164224. Throughput: 0: 6429.6. Samples: 10535652. Policy #0 lag: (min: 0.0, avg: 13.5, max: 27.0)
[2023-02-25 12:46:52,186][2408954] Avg episode reward: [(0, '1.080')]
[2023-02-25 12:46:52,460][2409100] DAMAGECOUNT value on done: 2017.0
[2023-02-25 12:46:52,460][2409100] Sum rewards: 1.979, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.190', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.030', 'AMMO4': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.061', 'HITCOUNT': '0.250', 'ARMOR': '0.446', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.870', 'FRAGCOUNT': '1.000', 'weapon2': '1.258', 'weapon3': '1.462'}
[2023-02-25 12:46:52,609][2409103] DAMAGECOUNT value on done: 1258.0
[2023-02-25 12:46:52,612][2409103] Sum rewards: 2.448, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.580', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'WEAPON4': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.099', 'weapon4': '0.146', 'HITCOUNT': '0.240', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.795', 'weapon3': '1.436', 'weapon2': '1.728', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:46:53,346][2409549] DAMAGECOUNT value on done: 1189.0
[2023-02-25 12:46:53,347][2409549] Sum rewards: -1.350, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.520', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.024', 'AMMO4': '0.043', 'weapon7': '0.066', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.170', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.300', 'ARMOR': '0.454', 'DAMAGECOUNT': '0.468', 'WEAPON3': '0.650', 'weapon2': '1.158', 'weapon3': '1.442', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:46:53,378][2409074] Updated weights for policy 0, policy_version 10301 (0.0012)
[2023-02-25 12:46:54,815][2409074] Updated weights for policy 0, policy_version 10311 (0.0012)
[2023-02-25 12:46:56,226][2409103] DAMAGECOUNT value on done: 1677.0
[2023-02-25 12:46:56,227][2409100] DAMAGECOUNT value on done: 1199.0
[2023-02-25 12:46:56,229][2409103] Sum rewards: 4.483, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.776', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.125', 'WEAPON4': '0.200', 'weapon4': '0.236', 'ARMOR': '0.420', 'HITCOUNT': '0.600', 'WEAPON3': '0.650', 'weapon2': '1.532', 'DAMAGECOUNT': '1.779', 'weapon3': '1.836', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:46:56,229][2409100] Sum rewards: 1.958, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.585', 'AMMO4': '-0.082', 'AMMO2': '-0.016', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'weapon5': '0.054', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.262', 'HITCOUNT': '0.410', 'ARMOR': '0.496', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.296', 'weapon3': '1.378', 'weapon2': '1.412', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:46:56,470][2409074] Updated weights for policy 0, policy_version 10321 (0.0013)
[2023-02-25 12:46:56,928][2409549] DAMAGECOUNT value on done: 1755.0
[2023-02-25 12:46:56,929][2409549] Sum rewards: 3.138, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.050', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.062', 'AMMO3': '0.083', 'weapon5': '0.104', 'WEAPON5': '0.150', 'HITCOUNT': '0.480', 'WEAPON3': '0.600', 'ARMOR': '1.300', 'weapon2': '1.548', 'weapon3': '1.710', 'DAMAGECOUNT': '2.373', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:46:57,186][2408954] Fps is (10 sec: 25804.7, 60 sec: 25736.6, 300 sec: 25561.8). Total num frames: 42295296. Throughput: 0: 6421.3. Samples: 10573932. Policy #0 lag: (min: 0.0, avg: 13.5, max: 27.0)
[2023-02-25 12:46:57,186][2408954] Avg episode reward: [(0, '1.217')]
[2023-02-25 12:46:57,190][2409033] Saving new best policy, reward=1.217!
[2023-02-25 12:46:57,883][2409074] Updated weights for policy 0, policy_version 10331 (0.0013)
[2023-02-25 12:46:59,307][2409101] DAMAGECOUNT value on done: 1313.0
[2023-02-25 12:46:59,308][2409101] Sum rewards: 1.455, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.766', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.018', 'AMMO3': '0.089', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'weapon5': '0.178', 'weapon4': '0.296', 'WEAPON5': '0.300', 'ARMOR': '0.408', 'WEAPON3': '0.450', 'HITCOUNT': '0.540', 'weapon3': '1.234', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.755', 'weapon2': '1.936'}
[2023-02-25 12:46:59,693][2409074] Updated weights for policy 0, policy_version 10341 (0.0012)
[2023-02-25 12:46:59,797][2409103] DAMAGECOUNT value on done: 1640.0
[2023-02-25 12:46:59,797][2409103] Sum rewards: 4.597, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.082', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'WEAPON1': '0.020', 'AMMO3': '0.060', 'WEAPON4': '0.150', 'weapon4': '0.332', 'HITCOUNT': '0.350', 'ARMOR': '0.416', 'WEAPON3': '0.450', 'weapon2': '1.054', 'DAMAGECOUNT': '1.191', 'weapon3': '1.412', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:46:59,977][2409100] DAMAGECOUNT value on done: 1504.0
[2023-02-25 12:46:59,978][2409100] Sum rewards: -0.687, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.278', 'AMMO5': '0.013', 'weapon5': '0.018', 'AMMO2': '0.028', 'WEAPON1': '0.050', 'AMMO3': '0.108', 'weapon7': '0.140', 'AMMO4': '0.142', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'HITCOUNT': '0.320', 'ARMOR': '0.464', 'weapon4': '0.470', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.032', 'weapon3': '1.404', 'weapon2': '1.462', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:47:00,899][2409549] DAMAGECOUNT value on done: 1792.0
[2023-02-25 12:47:00,900][2409549] Sum rewards: 2.308, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.172', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon5': '0.054', 'AMMO3': '0.081', 'AMMO4': '0.081', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'HITCOUNT': '0.400', 'weapon4': '0.414', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'ARMOR': '1.353', 'weapon3': '1.358', 'DAMAGECOUNT': '1.416', 'weapon2': '1.634'}
[2023-02-25 12:47:01,261][2409102] DAMAGECOUNT value on done: 1897.0
[2023-02-25 12:47:01,265][2409102] Sum rewards: 4.928, reward structure: {'DEATHCOUNT': '-6.750', 'weapon5': '0.002', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.062', 'AMMO3': '0.080', 'AMMO4': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.208', 'HITCOUNT': '0.380', 'WEAPON3': '0.400', 'HEALTH': '0.992', 'weapon2': '1.234', 'DAMAGECOUNT': '1.296', 'weapon3': '1.460', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:47:01,398][2409074] Updated weights for policy 0, policy_version 10351 (0.0012)
[2023-02-25 12:47:02,195][2408954] Fps is (10 sec: 25780.8, 60 sec: 25596.0, 300 sec: 25547.1). Total num frames: 42422272. Throughput: 0: 6417.9. Samples: 10612344. Policy #0 lag: (min: 1.0, avg: 13.7, max: 26.0)
[2023-02-25 12:47:02,195][2408954] Avg episode reward: [(0, '1.207')]
[2023-02-25 12:47:02,648][2409074] Updated weights for policy 0, policy_version 10361 (0.0012)
[2023-02-25 12:47:02,772][2409485] DAMAGECOUNT value on done: 1544.0
[2023-02-25 12:47:02,776][2409485] Sum rewards: 3.362, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.510', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO4': '0.046', 'AMMO3': '0.062', 'WEAPON4': '0.300', 'HITCOUNT': '0.410', 'WEAPON3': '0.450', 'weapon4': '0.748', 'weapon2': '1.148', 'weapon3': '1.242', 'DAMAGECOUNT': '1.413', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:03,077][2409101] DAMAGECOUNT value on done: 1528.0
[2023-02-25 12:47:03,080][2409101] Sum rewards: 0.018, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.480', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.016', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.089', 'WEAPON4': '0.150', 'weapon4': '0.250', 'HITCOUNT': '0.290', 'WEAPON3': '0.550', 'ARMOR': '0.965', 'DAMAGECOUNT': '0.996', 'weapon2': '1.118', 'weapon3': '1.190', 'FRAGCOUNT': '1.500'}
[2023-02-25 12:47:03,375][2409103] DAMAGECOUNT value on done: 1349.0
[2023-02-25 12:47:03,786][2409597] DAMAGECOUNT value on done: 1665.0
[2023-02-25 12:47:03,790][2409597] Sum rewards: 3.217, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.432', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.012', 'WEAPON1': '0.040', 'weapon5': '0.048', 'AMMO3': '0.051', 'WEAPON5': '0.150', 'HITCOUNT': '0.260', 'WEAPON3': '0.500', 'ARMOR': '0.879', 'DAMAGECOUNT': '1.152', 'weapon3': '1.202', 'weapon2': '1.598', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:03,788][2409100] DAMAGECOUNT value on done: 2289.0
[2023-02-25 12:47:03,791][2409100] Sum rewards: -1.449, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.718', 'AMMO5': '0.004', 'weapon5': '0.034', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'AMMO4': '0.179', 'HITCOUNT': '0.430', 'weapon4': '0.476', 'WEAPON4': '0.500', 'WEAPON3': '0.750', 'weapon3': '1.188', 'ARMOR': '1.346', 'DAMAGECOUNT': '1.629', 'weapon2': '1.716', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:04,463][2409074] Updated weights for policy 0, policy_version 10371 (0.0013)
[2023-02-25 12:47:05,086][2409549] DAMAGECOUNT value on done: 1369.0
[2023-02-25 12:47:05,088][2409549] Sum rewards: 3.992, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.000', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'ARMOR': '0.012', 'WEAPON1': '0.040', 'AMMO3': '0.062', 'HITCOUNT': '0.470', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.401', 'weapon3': '1.404', 'weapon2': '1.620', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:05,653][2409102] DAMAGECOUNT value on done: 1201.0
[2023-02-25 12:47:05,855][2409074] Updated weights for policy 0, policy_version 10381 (0.0012)
[2023-02-25 12:47:05,872][2409548] DAMAGECOUNT value on done: 1273.0
[2023-02-25 12:47:05,875][2409548] Sum rewards: 0.517, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'WEAPON1': '0.060', 'AMMO4': '0.086', 'AMMO3': '0.092', 'HEALTH': '0.116', 'HITCOUNT': '0.210', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.675', 'weapon2': '1.384', 'weapon3': '1.624', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:06,375][2409485] DAMAGECOUNT value on done: 1910.0
[2023-02-25 12:47:06,378][2409485] Sum rewards: -0.506, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.770', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.030', 'AMMO3': '0.060', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'weapon4': '0.336', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.612', 'ARMOR': '0.944', 'FRAGCOUNT': '1.000', 'weapon3': '1.164', 'weapon2': '1.276'}
[2023-02-25 12:47:06,745][2409596] DAMAGECOUNT value on done: 2168.0
[2023-02-25 12:47:06,746][2409596] Sum rewards: -0.557, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.459', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.011', 'WEAPON1': '0.030', 'AMMO4': '0.055', 'weapon5': '0.114', 'AMMO3': '0.117', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'HITCOUNT': '0.300', 'weapon4': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.416', 'DAMAGECOUNT': '1.488', 'weapon3': '1.658', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:06,972][2409103] DAMAGECOUNT value on done: 1504.0
[2023-02-25 12:47:06,973][2409103] Sum rewards: -3.004, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.250', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.061', 'AMMO3': '0.146', 'WEAPON4': '0.250', 'weapon4': '0.278', 'HITCOUNT': '0.370', 'WEAPON3': '0.800', 'ARMOR': '0.967', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.299', 'weapon3': '1.650', 'weapon2': '1.802'}
[2023-02-25 12:47:07,181][2409101] DAMAGECOUNT value on done: 1599.0
[2023-02-25 12:47:07,185][2409101] Sum rewards: 0.089, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.580', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'weapon5': '0.060', 'weapon7': '0.060', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'HITCOUNT': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.224', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.166', 'weapon2': '1.448'}
[2023-02-25 12:47:07,186][2408954] Fps is (10 sec: 24575.2, 60 sec: 25531.6, 300 sec: 25534.0). Total num frames: 42541056. Throughput: 0: 6416.8. Samples: 10631688. Policy #0 lag: (min: 0.0, avg: 13.5, max: 27.0)
[2023-02-25 12:47:07,186][2408954] Avg episode reward: [(0, '1.191')]
[2023-02-25 12:47:07,434][2409100] DAMAGECOUNT value on done: 1733.0
[2023-02-25 12:47:07,435][2409100] Sum rewards: 0.768, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.500', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON1': '0.040', 'weapon5': '0.056', 'AMMO4': '0.057', 'weapon7': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.115', 'weapon4': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.350', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.137', 'weapon3': '1.484', 'weapon2': '1.882', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:07,832][2409597] DAMAGECOUNT value on done: 1719.0
[2023-02-25 12:47:07,833][2409597] Sum rewards: 0.261, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.468', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO3': '0.077', 'AMMO4': '0.089', 'weapon5': '0.100', 'WEAPON5': '0.200', 'HITCOUNT': '0.270', 'weapon4': '0.276', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'ARMOR': '0.895', 'weapon3': '1.268', 'DAMAGECOUNT': '1.347', 'weapon2': '1.872', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:07,914][2409074] Updated weights for policy 0, policy_version 10391 (0.0012)
[2023-02-25 12:47:08,736][2409549] DAMAGECOUNT value on done: 1194.0
[2023-02-25 12:47:08,840][2409406] DAMAGECOUNT value on done: 1194.0
[2023-02-25 12:47:08,841][2409406] Sum rewards: 0.123, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.047', 'AMMO3': '0.050', 'HEALTH': '0.077', 'AMMO4': '0.236', 'HITCOUNT': '0.250', 'WEAPON3': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.488', 'DAMAGECOUNT': '0.732', 'weapon3': '0.932', 'weapon4': '0.934', 'FRAGCOUNT': '1.000', 'weapon2': '1.426'}
[2023-02-25 12:47:09,101][2409074] Updated weights for policy 0, policy_version 10401 (0.0012)
[2023-02-25 12:47:09,389][2409102] DAMAGECOUNT value on done: 1598.0
[2023-02-25 12:47:09,390][2409102] Sum rewards: 1.189, reward structure: {'DEATHCOUNT': '-8.250', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO3': '0.094', 'HEALTH': '0.098', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'HITCOUNT': '0.420', 'WEAPON3': '0.550', 'weapon4': '0.556', 'ARMOR': '0.824', 'DAMAGECOUNT': '1.221', 'weapon2': '1.468', 'weapon3': '1.806', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:09,464][2409548] DAMAGECOUNT value on done: 1585.0
[2023-02-25 12:47:09,467][2409548] Sum rewards: 3.979, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.422', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.056', 'AMMO3': '0.098', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'HITCOUNT': '0.380', 'ARMOR': '0.420', 'WEAPON3': '0.500', 'weapon4': '0.644', 'weapon3': '0.868', 'DAMAGECOUNT': '1.290', 'weapon2': '1.926', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:09,653][2409077] DAMAGECOUNT value on done: 2183.0
[2023-02-25 12:47:09,654][2409077] Sum rewards: 0.445, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.255', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon5': '0.072', 'AMMO3': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.334', 'HITCOUNT': '0.430', 'WEAPON3': '0.650', 'ARMOR': '0.955', 'weapon3': '1.514', 'weapon2': '1.568', 'DAMAGECOUNT': '1.695', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:09,711][2409105] DAMAGECOUNT value on done: 1754.0
[2023-02-25 12:47:09,713][2409105] Sum rewards: 3.085, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.596', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.100', 'AMMO4': '0.103', 'weapon5': '0.108', 'WEAPON4': '0.150', 'weapon4': '0.160', 'HITCOUNT': '0.180', 'WEAPON5': '0.200', 'WEAPON3': '0.500', 'weapon3': '0.944', 'DAMAGECOUNT': '1.011', 'weapon2': '1.418', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:10,423][2409485] DAMAGECOUNT value on done: 1149.0
[2023-02-25 12:47:10,424][2409485] Sum rewards: 4.675, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.928', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'AMMO5': '0.010', 'AMMO3': '0.088', 'weapon5': '0.094', 'WEAPON5': '0.250', 'HITCOUNT': '0.370', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'weapon2': '1.346', 'DAMAGECOUNT': '1.473', 'weapon3': '1.672', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:47:10,681][2409596] DAMAGECOUNT value on done: 2153.0
[2023-02-25 12:47:10,684][2409596] Sum rewards: 5.793, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.442', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.018', 'weapon7': '0.052', 'ARMOR': '0.060', 'AMMO4': '0.061', 'AMMO3': '0.075', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.470', 'weapon4': '0.514', 'weapon2': '0.684', 'weapon3': '1.570', 'DAMAGECOUNT': '1.674', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:47:10,843][2409101] DAMAGECOUNT value on done: 1628.0
[2023-02-25 12:47:10,844][2409101] Sum rewards: -0.277, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.214', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.013', 'weapon5': '0.020', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.066', 'AMMO3': '0.088', 'HITCOUNT': '0.390', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.302', 'FRAGCOUNT': '1.500', 'weapon2': '1.810', 'weapon3': '1.812'}
[2023-02-25 12:47:11,043][2409103] DAMAGECOUNT value on done: 1731.0
[2023-02-25 12:47:11,046][2409103] Sum rewards: 1.472, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.280', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon5': '0.068', 'AMMO3': '0.083', 'AMMO4': '0.086', 'weapon4': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.380', 'WEAPON3': '0.550', 'ARMOR': '0.913', 'DAMAGECOUNT': '1.326', 'weapon3': '1.366', 'weapon2': '1.760', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:11,155][2409074] Updated weights for policy 0, policy_version 10411 (0.0012)
[2023-02-25 12:47:11,312][2409100] DAMAGECOUNT value on done: 1580.0
[2023-02-25 12:47:11,313][2409100] Sum rewards: 5.573, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.579', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'ARMOR': '0.020', 'weapon7': '0.020', 'weapon5': '0.036', 'AMMO3': '0.082', 'AMMO4': '0.097', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.590', 'weapon4': '0.664', 'weapon2': '1.352', 'weapon3': '1.440', 'DAMAGECOUNT': '1.914', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:47:11,940][2409597] DAMAGECOUNT value on done: 1393.0
[2023-02-25 12:47:11,941][2409597] Sum rewards: 5.775, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.576', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon7': '0.082', 'AMMO3': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.140', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.298', 'HITCOUNT': '0.350', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.140', 'weapon3': '1.212', 'ARMOR': '1.798', 'weapon2': '1.846', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:12,010][2409104] DAMAGECOUNT value on done: 1434.0
[2023-02-25 12:47:12,011][2409104] Sum rewards: 2.181, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.409', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.084', 'AMMO3': '0.097', 'AMMO4': '0.099', 'weapon4': '0.228', 'HITCOUNT': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.453', 'WEAPON3': '0.600', 'weapon3': '1.196', 'DAMAGECOUNT': '1.239', 'weapon2': '1.972', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:12,186][2408954] Fps is (10 sec: 25008.8, 60 sec: 25600.0, 300 sec: 25534.1). Total num frames: 42672128. Throughput: 0: 6403.2. Samples: 10669776. Policy #0 lag: (min: 0.0, avg: 13.5, max: 27.0)
[2023-02-25 12:47:12,187][2408954] Avg episode reward: [(0, '1.396')]
[2023-02-25 12:47:12,187][2409033] Saving new best policy, reward=1.396!
[2023-02-25 12:47:12,414][2409565] DAMAGECOUNT value on done: 1269.0
[2023-02-25 12:47:12,415][2409565] Sum rewards: -2.599, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.300', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'AMMO5': '0.003', 'weapon5': '0.016', 'ARMOR': '0.020', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.071', 'weapon4': '0.196', 'HITCOUNT': '0.210', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.732', 'weapon3': '1.100', 'weapon2': '1.460'}
[2023-02-25 12:47:12,497][2409549] DAMAGECOUNT value on done: 1293.0
[2023-02-25 12:47:12,499][2409549] Sum rewards: 1.279, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.380', 'AMMO2': '0.015', 'AMMO3': '0.064', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'weapon4': '0.340', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.477', 'ARMOR': '0.487', 'weapon3': '1.182', 'weapon2': '1.548', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:12,502][2409074] Updated weights for policy 0, policy_version 10421 (0.0012)
[2023-02-25 12:47:12,633][2409373] DAMAGECOUNT value on done: 882.0
[2023-02-25 12:47:12,634][2409373] Sum rewards: -1.467, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.742', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'AMMO2': '0.037', 'WEAPON5': '0.100', 'AMMO3': '0.126', 'AMMO4': '0.183', 'WEAPON4': '0.200', 'HITCOUNT': '0.260', 'weapon4': '0.510', 'weapon2': '0.650', 'WEAPON3': '0.800', 'ARMOR': '0.804', 'DAMAGECOUNT': '0.870', 'FRAGCOUNT': '1.000', 'weapon3': '1.948'}
[2023-02-25 12:47:12,716][2409406] DAMAGECOUNT value on done: 1628.0
[2023-02-25 12:47:12,717][2409406] Sum rewards: 3.079, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.305', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO5': '0.015', 'weapon5': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.065', 'weapon4': '0.112', 'WEAPON5': '0.200', 'HITCOUNT': '0.440', 'WEAPON3': '0.550', 'ARMOR': '0.917', 'weapon3': '1.190', 'DAMAGECOUNT': '1.344', 'weapon2': '1.786', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:12,929][2409102] DAMAGECOUNT value on done: 2164.0
[2023-02-25 12:47:12,930][2409102] Sum rewards: 2.053, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.112', 'AMMO5': '0.003', 'AMMO2': '0.004', 'WEAPON1': '0.020', 'AMMO4': '0.022', 'ARMOR': '0.044', 'weapon5': '0.050', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.238', 'WEAPON3': '0.550', 'HITCOUNT': '0.610', 'weapon2': '1.402', 'weapon3': '1.650', 'DAMAGECOUNT': '1.929', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:13,592][2409548] DAMAGECOUNT value on done: 2023.0
[2023-02-25 12:47:13,593][2409548] Sum rewards: -0.195, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.379', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.030', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'weapon5': '0.082', 'weapon4': '0.094', 'AMMO3': '0.124', 'WEAPON5': '0.200', 'HITCOUNT': '0.350', 'ARMOR': '0.420', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.939', 'FRAGCOUNT': '1.000', 'weapon3': '1.740', 'weapon2': '1.846'}
[2023-02-25 12:47:13,880][2409074] Updated weights for policy 0, policy_version 10431 (0.0012)
[2023-02-25 12:47:13,981][2409077] DAMAGECOUNT value on done: 1871.0
[2023-02-25 12:47:13,981][2409105] DAMAGECOUNT value on done: 1428.0
[2023-02-25 12:47:13,982][2409105] Sum rewards: -0.350, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.068', 'weapon7': '0.070', 'AMMO4': '0.081', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.128', 'WEAPON5': '0.200', 'HEALTH': '0.212', 'weapon4': '0.228', 'HITCOUNT': '0.240', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.849', 'FRAGCOUNT': '1.000', 'weapon3': '1.148', 'weapon2': '1.720'}
[2023-02-25 12:47:13,985][2409077] Sum rewards: 3.110, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.438', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.015', 'weapon5': '0.060', 'weapon7': '0.074', 'AMMO4': '0.076', 'AMMO3': '0.099', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.282', 'WEAPON3': '0.500', 'HITCOUNT': '0.570', 'weapon3': '1.236', 'ARMOR': '1.346', 'weapon2': '1.708', 'DAMAGECOUNT': '2.166', 'FRAGCOUNT': '4.500'}
[2023-02-25 12:47:14,218][2409485] DAMAGECOUNT value on done: 2100.0
[2023-02-25 12:47:14,221][2409485] Sum rewards: 2.846, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.132', 'AMMO2': '0.010', 'weapon4': '0.022', 'WEAPON1': '0.040', 'AMMO4': '0.048', 'AMMO3': '0.075', 'WEAPON4': '0.150', 'HITCOUNT': '0.520', 'WEAPON3': '0.550', 'weapon3': '1.456', 'weapon2': '1.802', 'DAMAGECOUNT': '2.055', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:14,408][2409596] DAMAGECOUNT value on done: 1112.0
[2023-02-25 12:47:14,550][2409405] DAMAGECOUNT value on done: 2012.0
[2023-02-25 12:47:14,551][2409405] Sum rewards: -0.062, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.702', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'AMMO3': '0.106', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'weapon4': '0.254', 'HITCOUNT': '0.270', 'ARMOR': '0.432', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.942', 'FRAGCOUNT': '1.000', 'weapon2': '1.542', 'weapon3': '1.762'}
[2023-02-25 12:47:14,723][2409101] DAMAGECOUNT value on done: 1729.0
[2023-02-25 12:47:14,726][2409101] Sum rewards: 4.595, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.296', 'AMMO2': '0.012', 'AMMO5': '0.012', 'AMMO3': '0.052', 'AMMO4': '0.058', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.324', 'WEAPON3': '0.350', 'HITCOUNT': '0.370', 'ARMOR': '0.489', 'weapon3': '1.098', 'DAMAGECOUNT': '1.215', 'weapon2': '1.760', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:14,789][2409103] DAMAGECOUNT value on done: 1140.0
[2023-02-25 12:47:15,076][2409389] DAMAGECOUNT value on done: 1365.0
[2023-02-25 12:47:15,077][2409389] Sum rewards: -0.051, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.046', 'AMMO5': '0.005', 'weapon5': '0.024', 'WEAPON1': '0.030', 'AMMO2': '0.031', 'AMMO3': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.156', 'HITCOUNT': '0.240', 'weapon4': '0.330', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.711', 'weapon3': '1.068', 'ARMOR': '1.288', 'weapon2': '1.648', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:15,214][2409100] DAMAGECOUNT value on done: 2107.0
[2023-02-25 12:47:15,218][2409100] Sum rewards: 3.051, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.523', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.030', 'AMMO4': '0.039', 'WEAPON5': '0.100', 'AMMO3': '0.122', 'WEAPON4': '0.250', 'HITCOUNT': '0.400', 'ARMOR': '0.496', 'weapon4': '0.512', 'WEAPON3': '0.750', 'weapon2': '1.464', 'DAMAGECOUNT': '1.512', 'weapon3': '1.636', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:15,774][2409597] DAMAGECOUNT value on done: 1714.0
[2023-02-25 12:47:15,777][2409597] Sum rewards: 0.784, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.502', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.036', 'weapon5': '0.068', 'weapon4': '0.084', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'HITCOUNT': '0.320', 'WEAPON3': '0.600', 'ARMOR': '0.820', 'DAMAGECOUNT': '1.305', 'weapon3': '1.556', 'weapon2': '1.568', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:15,975][2409074] Updated weights for policy 0, policy_version 10441 (0.0012)
[2023-02-25 12:47:16,019][2409565] DAMAGECOUNT value on done: 1687.0
[2023-02-25 12:47:16,020][2409565] Sum rewards: 4.237, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.632', 'AMMO2': '0.005', 'AMMO4': '0.025', 'ARMOR': '0.040', 'AMMO3': '0.055', 'WEAPON4': '0.100', 'weapon4': '0.426', 'WEAPON3': '0.450', 'HITCOUNT': '0.450', 'weapon3': '0.950', 'weapon2': '1.308', 'DAMAGECOUNT': '1.560', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:16,051][2409104] DAMAGECOUNT value on done: 1391.0
[2023-02-25 12:47:16,054][2409104] Sum rewards: -0.165, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.514', 'AMMO5': '0.007', 'AMMO2': '0.016', 'ARMOR': '0.020', 'WEAPON1': '0.030', 'weapon5': '0.058', 'AMMO3': '0.077', 'AMMO4': '0.080', 'weapon7': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.344', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.720', 'weapon3': '1.132', 'weapon2': '1.276', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:16,163][2409549] DAMAGECOUNT value on done: 1798.0
[2023-02-25 12:47:16,167][2409549] Sum rewards: 2.421, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.510', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'weapon7': '0.034', 'weapon5': '0.062', 'AMMO4': '0.087', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.380', 'weapon4': '0.442', 'ARMOR': '0.452', 'WEAPON3': '0.600', 'weapon3': '1.038', 'DAMAGECOUNT': '1.644', 'weapon2': '1.726', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:16,497][2409102] DAMAGECOUNT value on done: 1100.0
[2023-02-25 12:47:16,500][2409102] Sum rewards: 3.277, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.258', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'ARMOR': '0.024', 'AMMO3': '0.040', 'WEAPON3': '0.300', 'HITCOUNT': '0.330', 'weapon3': '0.834', 'DAMAGECOUNT': '0.885', 'weapon2': '1.146', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:16,605][2409373] DAMAGECOUNT value on done: 1625.0
[2023-02-25 12:47:16,605][2409373] Sum rewards: 1.870, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.210', 'weapon5': '0.002', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.010', 'ARMOR': '0.020', 'WEAPON1': '0.040', 'AMMO3': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.190', 'WEAPON3': '0.500', 'HITCOUNT': '0.500', 'weapon3': '1.336', 'weapon2': '1.564', 'DAMAGECOUNT': '1.596', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:17,186][2408954] Fps is (10 sec: 26214.8, 60 sec: 25531.7, 300 sec: 25561.9). Total num frames: 42803200. Throughput: 0: 6394.1. Samples: 10707792. Policy #0 lag: (min: 0.0, avg: 12.8, max: 24.0)
[2023-02-25 12:47:17,186][2408954] Avg episode reward: [(0, '1.402')]
[2023-02-25 12:47:17,191][2409033] Saving new best policy, reward=1.402!
[2023-02-25 12:47:17,386][2409548] DAMAGECOUNT value on done: 1379.0
[2023-02-25 12:47:17,387][2409548] Sum rewards: -4.749, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.433', 'FRAGCOUNT': '-0.500', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon7': '0.046', 'AMMO4': '0.089', 'AMMO3': '0.094', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.200', 'weapon5': '0.222', 'HITCOUNT': '0.230', 'WEAPON5': '0.250', 'weapon4': '0.280', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.645', 'ARMOR': '0.928', 'weapon3': '1.326', 'weapon2': '1.686'}
[2023-02-25 12:47:17,391][2409074] Updated weights for policy 0, policy_version 10451 (0.0014)
[2023-02-25 12:47:17,605][2409866] DAMAGECOUNT value on done: 1716.0
[2023-02-25 12:47:17,608][2409866] Sum rewards: 1.266, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.456', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.056', 'AMMO3': '0.077', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'HITCOUNT': '0.340', 'ARMOR': '0.433', 'weapon4': '0.444', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.380', 'weapon3': '1.488', 'weapon2': '1.750', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:17,717][2409407] DAMAGECOUNT value on done: 1584.0
[2023-02-25 12:47:17,722][2409407] Sum rewards: 2.619, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.592', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'ARMOR': '0.008', 'weapon5': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.090', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.290', 'weapon4': '0.458', 'WEAPON3': '0.600', 'weapon2': '1.194', 'DAMAGECOUNT': '1.359', 'weapon3': '1.948', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:17,921][2409105] DAMAGECOUNT value on done: 1940.0
[2023-02-25 12:47:17,922][2409105] Sum rewards: -0.917, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.816', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.020', 'WEAPON1': '0.030', 'weapon5': '0.034', 'weapon7': '0.050', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.202', 'HITCOUNT': '0.390', 'ARMOR': '0.424', 'WEAPON3': '0.850', 'weapon2': '1.034', 'DAMAGECOUNT': '1.431', 'FRAGCOUNT': '1.500', 'weapon3': '2.092'}
[2023-02-25 12:47:18,092][2409485] DAMAGECOUNT value on done: 1700.0
[2023-02-25 12:47:18,094][2409485] Sum rewards: 4.717, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.480', 'AMMO4': '-0.055', 'AMMO2': '-0.011', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.024', 'AMMO3': '0.061', 'weapon7': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.212', 'WEAPON3': '0.550', 'HITCOUNT': '0.580', 'weapon2': '1.184', 'weapon3': '1.484', 'DAMAGECOUNT': '1.935', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:18,105][2409355] DAMAGECOUNT value on done: 1360.0
[2023-02-25 12:47:18,105][2409355] Sum rewards: -0.243, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.389', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.085', 'AMMO4': '0.121', 'weapon5': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.300', 'weapon4': '0.516', 'WEAPON3': '0.550', 'ARMOR': '0.874', 'DAMAGECOUNT': '0.933', 'FRAGCOUNT': '1.000', 'weapon3': '1.220', 'weapon2': '1.342'}
[2023-02-25 12:47:18,118][2409406] DAMAGECOUNT value on done: 1563.0
[2023-02-25 12:47:18,119][2409406] Sum rewards: -3.546, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.756', 'weapon5': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.143', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.324', 'HITCOUNT': '0.510', 'ARMOR': '0.840', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.539', 'weapon2': '1.636', 'weapon3': '1.680', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:18,227][2409405] DAMAGECOUNT value on done: 1375.0
[2023-02-25 12:47:18,227][2409405] Sum rewards: 2.187, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.008', 'weapon5': '0.020', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'ARMOR': '0.044', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'AMMO4': '0.117', 'HEALTH': '0.136', 'WEAPON5': '0.150', 'HITCOUNT': '0.220', 'weapon4': '0.386', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.681', 'weapon2': '1.076', 'weapon3': '1.812', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:18,629][2409103] DAMAGECOUNT value on done: 1429.0
[2023-02-25 12:47:18,632][2409103] Sum rewards: -0.945, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.373', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.024', 'WEAPON1': '0.030', 'weapon7': '0.074', 'AMMO3': '0.109', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.222', 'WEAPON5': '0.250', 'HITCOUNT': '0.290', 'ARMOR': '0.400', 'weapon4': '0.426', 'WEAPON3': '0.700', 'weapon2': '1.158', 'DAMAGECOUNT': '1.257', 'weapon3': '1.830', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:18,728][2409101] DAMAGECOUNT value on done: 2390.0
[2023-02-25 12:47:18,729][2409101] Sum rewards: 0.832, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.208', 'AMMO5': '0.010', 'AMMO2': '0.010', 'ARMOR': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.051', 'weapon5': '0.092', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.512', 'HITCOUNT': '0.540', 'WEAPON3': '0.900', 'weapon2': '0.950', 'weapon3': '1.640', 'DAMAGECOUNT': '1.917', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:18,934][2409100] DAMAGECOUNT value on done: 1835.0
[2023-02-25 12:47:18,937][2409100] Sum rewards: -1.296, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.798', 'WEAPON1': '0.030', 'AMMO2': '0.041', 'AMMO3': '0.123', 'weapon4': '0.174', 'AMMO4': '0.206', 'HITCOUNT': '0.320', 'WEAPON4': '0.400', 'ARMOR': '0.448', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.101', 'weapon3': '1.264', 'weapon2': '1.794', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:18,998][2409077] DAMAGECOUNT value on done: 1958.0
[2023-02-25 12:47:19,003][2409077] Sum rewards: 4.736, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.449', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.018', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'weapon4': '0.082', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'weapon5': '0.108', 'HITCOUNT': '0.470', 'ARMOR': '0.474', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.590', 'weapon3': '1.616', 'weapon2': '1.810', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:47:19,078][2409596] DAMAGECOUNT value on done: 1407.0
[2023-02-25 12:47:19,079][2409596] Sum rewards: 4.596, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.934', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.037', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'weapon5': '0.080', 'weapon4': '0.234', 'HITCOUNT': '0.410', 'ARMOR': '0.456', 'WEAPON3': '0.600', 'weapon3': '1.460', 'weapon2': '1.590', 'DAMAGECOUNT': '1.713', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:19,129][2409389] DAMAGECOUNT value on done: 1224.0
[2023-02-25 12:47:19,132][2409074] Updated weights for policy 0, policy_version 10461 (0.0012)
[2023-02-25 12:47:19,615][2409565] DAMAGECOUNT value on done: 1423.0
[2023-02-25 12:47:19,616][2409565] Sum rewards: 0.145, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.654', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.060', 'AMMO4': '0.071', 'AMMO3': '0.074', 'weapon5': '0.106', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.390', 'ARMOR': '0.444', 'WEAPON3': '0.550', 'weapon3': '1.356', 'DAMAGECOUNT': '1.836', 'weapon2': '2.288', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:19,738][2409597] DAMAGECOUNT value on done: 2592.0
[2023-02-25 12:47:19,739][2409597] Sum rewards: 4.310, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.549', 'AMMO4': '-0.088', 'AMMO2': '-0.018', 'AMMO5': '0.013', 'WEAPON1': '0.060', 'AMMO3': '0.072', 'weapon5': '0.074', 'WEAPON5': '0.250', 'HITCOUNT': '0.630', 'WEAPON3': '0.650', 'ARMOR': '0.857', 'weapon3': '1.772', 'weapon2': '1.782', 'DAMAGECOUNT': '2.055', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:20,062][2409102] DAMAGECOUNT value on done: 1498.0
[2023-02-25 12:47:20,066][2409102] Sum rewards: 1.803, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.608', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.012', 'weapon4': '0.014', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'HITCOUNT': '0.420', 'WEAPON3': '0.600', 'ARMOR': '0.854', 'DAMAGECOUNT': '1.407', 'weapon3': '1.578', 'weapon2': '1.906', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:20,221][2409549] DAMAGECOUNT value on done: 1556.0
[2023-02-25 12:47:20,224][2409549] Sum rewards: -2.406, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.780', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.007', 'WEAPON1': '0.020', 'weapon5': '0.060', 'AMMO3': '0.098', 'HITCOUNT': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.376', 'ARMOR': '0.468', 'DAMAGECOUNT': '0.522', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.392', 'weapon2': '1.694'}
[2023-02-25 12:47:20,503][2409104] DAMAGECOUNT value on done: 2706.0
[2023-02-25 12:47:20,504][2409104] Sum rewards: 0.023, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.371', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.020', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'weapon7': '0.072', 'AMMO4': '0.087', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.294', 'HITCOUNT': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.215', 'weapon2': '1.216', 'weapon3': '1.620', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:20,509][2409074] Updated weights for policy 0, policy_version 10471 (0.0012)
[2023-02-25 12:47:20,605][2409373] DAMAGECOUNT value on done: 1560.0
[2023-02-25 12:47:20,606][2409373] Sum rewards: 2.015, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.202', 'AMMO2': '0.006', 'WEAPON1': '0.030', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'HITCOUNT': '0.190', 'weapon4': '0.228', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.600', 'weapon2': '0.696', 'ARMOR': '0.800', 'weapon3': '0.874', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:21,132][2409548] DAMAGECOUNT value on done: 1781.0
[2023-02-25 12:47:21,132][2409548] Sum rewards: 2.073, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.194', 'AMMO5': '0.007', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'weapon5': '0.070', 'weapon4': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'HITCOUNT': '0.460', 'WEAPON3': '0.750', 'ARMOR': '0.800', 'DAMAGECOUNT': '1.377', 'weapon2': '1.684', 'weapon3': '1.750', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:21,369][2409866] DAMAGECOUNT value on done: 1720.0
[2023-02-25 12:47:21,370][2409866] Sum rewards: 3.262, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.982', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'WEAPON4': '0.250', 'HITCOUNT': '0.370', 'weapon4': '0.588', 'WEAPON3': '0.700', 'ARMOR': '0.944', 'weapon3': '1.144', 'DAMAGECOUNT': '1.206', 'weapon2': '1.472', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:21,555][2409105] DAMAGECOUNT value on done: 2073.0
[2023-02-25 12:47:21,556][2409105] Sum rewards: 4.921, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.006', 'AMMO2': '0.012', 'weapon5': '0.028', 'WEAPON1': '0.040', 'AMMO4': '0.057', 'AMMO3': '0.070', 'HEALTH': '0.146', 'WEAPON5': '0.150', 'HITCOUNT': '0.370', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.527', 'weapon2': '1.582', 'weapon3': '1.732', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:21,848][2409407] DAMAGECOUNT value on done: 1606.0
[2023-02-25 12:47:21,849][2409407] Sum rewards: 3.435, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.002', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.067', 'WEAPON5': '0.150', 'weapon5': '0.160', 'weapon4': '0.208', 'HITCOUNT': '0.290', 'WEAPON3': '0.350', 'weapon3': '0.750', 'DAMAGECOUNT': '0.876', 'weapon2': '1.232', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:21,892][2409355] DAMAGECOUNT value on done: 1505.0
[2023-02-25 12:47:21,893][2409355] Sum rewards: 1.838, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.902', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'weapon5': '0.064', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.370', 'weapon4': '0.396', 'WEAPON3': '0.400', 'ARMOR': '0.858', 'weapon3': '1.018', 'DAMAGECOUNT': '1.215', 'weapon2': '1.372', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:21,936][2409485] DAMAGECOUNT value on done: 2134.0
[2023-02-25 12:47:21,937][2409485] Sum rewards: 5.988, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.590', 'AMMO5': '0.003', 'AMMO2': '0.008', 'WEAPON1': '0.030', 'ARMOR': '0.036', 'AMMO4': '0.039', 'weapon5': '0.046', 'weapon7': '0.070', 'AMMO3': '0.073', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.260', 'WEAPON3': '0.500', 'weapon3': '1.170', 'weapon2': '1.274', 'DAMAGECOUNT': '1.419', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:47:21,944][2409406] DAMAGECOUNT value on done: 1636.0
[2023-02-25 12:47:21,945][2409406] Sum rewards: -0.508, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.480', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.024', 'WEAPON1': '0.030', 'AMMO3': '0.040', 'AMMO4': '0.081', 'HITCOUNT': '0.110', 'WEAPON5': '0.150', 'WEAPON3': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.612', 'DAMAGECOUNT': '0.681', 'weapon3': '0.762', 'FRAGCOUNT': '1.000', 'weapon2': '1.204'}
[2023-02-25 12:47:22,102][2409405] DAMAGECOUNT value on done: 1711.0
[2023-02-25 12:47:22,103][2409405] Sum rewards: 3.610, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.688', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO3': '0.066', 'WEAPON4': '0.100', 'weapon4': '0.206', 'weapon5': '0.236', 'HITCOUNT': '0.290', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'ARMOR': '0.854', 'weapon3': '1.322', 'weapon2': '1.462', 'DAMAGECOUNT': '1.905', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:22,107][2409074] Updated weights for policy 0, policy_version 10481 (0.0012)
[2023-02-25 12:47:22,186][2408954] Fps is (10 sec: 25804.9, 60 sec: 25600.2, 300 sec: 25589.6). Total num frames: 42930176. Throughput: 0: 6386.1. Samples: 10726416. Policy #0 lag: (min: 0.0, avg: 12.8, max: 24.0)
[2023-02-25 12:47:22,186][2408954] Avg episode reward: [(0, '1.381')]
[2023-02-25 12:47:22,219][2409076] DAMAGECOUNT value on done: 1671.0
[2023-02-25 12:47:22,221][2409076] Sum rewards: -1.165, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.254', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO3': '0.093', 'weapon5': '0.120', 'HITCOUNT': '0.180', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.852', 'ARMOR': '1.001', 'weapon2': '1.626', 'weapon3': '1.678', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:22,396][2409101] DAMAGECOUNT value on done: 1768.0
[2023-02-25 12:47:22,399][2409101] Sum rewards: 4.750, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'AMMO3': '0.065', 'weapon5': '0.080', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'WEAPON3': '0.350', 'HEALTH': '0.369', 'weapon4': '0.426', 'HITCOUNT': '0.430', 'ARMOR': '0.963', 'weapon3': '1.038', 'weapon2': '1.588', 'DAMAGECOUNT': '1.752', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:22,430][2409103] DAMAGECOUNT value on done: 1230.0
[2023-02-25 12:47:22,434][2409103] Sum rewards: 1.846, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.574', 'AMMO2': '0.012', 'AMMO5': '0.015', 'AMMO4': '0.058', 'AMMO3': '0.065', 'weapon5': '0.124', 'HITCOUNT': '0.230', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'weapon4': '0.590', 'ARMOR': '0.865', 'DAMAGECOUNT': '0.903', 'weapon3': '1.036', 'weapon2': '1.422', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:22,558][2409100] DAMAGECOUNT value on done: 1571.0
[2023-02-25 12:47:22,559][2409100] Sum rewards: 1.051, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.530', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.062', 'AMMO3': '0.075', 'AMMO4': '0.167', 'weapon7': '0.168', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HITCOUNT': '0.390', 'WEAPON4': '0.400', 'ARMOR': '0.474', 'WEAPON3': '0.500', 'weapon4': '0.718', 'weapon3': '1.104', 'weapon2': '1.166', 'DAMAGECOUNT': '1.626', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:22,748][2409077] DAMAGECOUNT value on done: 1187.0
[2023-02-25 12:47:22,816][2409075] DAMAGECOUNT value on done: 1398.0
[2023-02-25 12:47:22,817][2409075] Sum rewards: -0.983, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.700', 'AMMO5': '0.007', 'AMMO2': '0.020', 'WEAPON1': '0.080', 'weapon5': '0.080', 'AMMO4': '0.098', 'AMMO3': '0.114', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'WEAPON5': '0.200', 'weapon4': '0.274', 'ARMOR': '0.449', 'DAMAGECOUNT': '0.750', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.228', 'weapon3': '2.086'}
[2023-02-25 12:47:23,036][2409389] DAMAGECOUNT value on done: 1737.0
[2023-02-25 12:47:23,037][2409389] Sum rewards: 0.878, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.640', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'weapon5': '0.050', 'AMMO3': '0.085', 'AMMO4': '0.116', 'WEAPON5': '0.200', 'HITCOUNT': '0.270', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'weapon4': '0.682', 'ARMOR': '0.912', 'weapon2': '0.930', 'DAMAGECOUNT': '1.191', 'weapon3': '1.738', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:23,110][2409596] DAMAGECOUNT value on done: 1561.0
[2023-02-25 12:47:23,116][2409596] Sum rewards: 0.514, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.452', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO3': '0.071', 'WEAPON4': '0.100', 'weapon4': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.210', 'WEAPON3': '0.350', 'ARMOR': '0.911', 'weapon3': '0.924', 'DAMAGECOUNT': '1.059', 'weapon2': '1.740', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:23,375][2409597] DAMAGECOUNT value on done: 1675.0
[2023-02-25 12:47:23,376][2409597] Sum rewards: 0.329, reward structure: {'DEATHCOUNT': '-5.250', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.005', 'AMMO3': '0.030', 'AMMO2': '0.035', 'weapon5': '0.072', 'WEAPON5': '0.100', 'WEAPON3': '0.150', 'AMMO4': '0.175', 'WEAPON4': '0.200', 'HITCOUNT': '0.260', 'weapon3': '0.430', 'HEALTH': '0.568', 'weapon4': '0.586', 'DAMAGECOUNT': '0.780', 'ARMOR': '1.261', 'weapon2': '1.426'}
[2023-02-25 12:47:23,439][2409565] DAMAGECOUNT value on done: 2044.0
[2023-02-25 12:47:23,442][2409565] Sum rewards: 2.288, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.943', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'AMMO4': '0.163', 'weapon4': '0.390', 'HITCOUNT': '0.410', 'WEAPON3': '0.700', 'ARMOR': '1.275', 'DAMAGECOUNT': '1.419', 'weapon3': '1.422', 'weapon2': '1.598', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:23,891][2409549] DAMAGECOUNT value on done: 1661.0
[2023-02-25 12:47:23,903][2409549] Sum rewards: 1.433, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.821', 'AMMO5': '0.010', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'weapon5': '0.046', 'AMMO4': '0.130', 'AMMO3': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.430', 'ARMOR': '0.476', 'HITCOUNT': '0.490', 'WEAPON3': '0.850', 'weapon2': '0.890', 'DAMAGECOUNT': '1.572', 'weapon3': '2.016', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:23,935][2409074] Updated weights for policy 0, policy_version 10491 (0.0012)
[2023-02-25 12:47:23,981][2409469] DAMAGECOUNT value on done: 1323.0
[2023-02-25 12:47:23,981][2409469] Sum rewards: 1.556, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.590', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'WEAPON1': '0.040', 'weapon5': '0.048', 'AMMO3': '0.059', 'WEAPON5': '0.100', 'HITCOUNT': '0.130', 'WEAPON3': '0.400', 'ARMOR': '0.459', 'DAMAGECOUNT': '0.525', 'weapon3': '0.884', 'FRAGCOUNT': '1.000', 'weapon2': '1.488'}
[2023-02-25 12:47:24,080][2409102] DAMAGECOUNT value on done: 1659.0
[2023-02-25 12:47:24,083][2409102] Sum rewards: -0.910, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.148', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.040', 'AMMO4': '0.054', 'AMMO3': '0.125', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'HITCOUNT': '0.410', 'weapon4': '0.628', 'WEAPON3': '0.850', 'ARMOR': '0.932', 'weapon3': '1.336', 'DAMAGECOUNT': '1.584', 'weapon2': '1.708', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:47:24,173][2409469] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 12:47:24,508][2409104] DAMAGECOUNT value on done: 1205.0
[2023-02-25 12:47:24,512][2409104] Sum rewards: -1.616, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.520', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'AMMO3': '0.081', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'WEAPON3': '0.600', 'weapon4': '0.626', 'DAMAGECOUNT': '0.837', 'weapon3': '0.928', 'FRAGCOUNT': '1.000', 'weapon2': '1.284'}
[2023-02-25 12:47:24,540][2409078] DAMAGECOUNT value on done: 1642.0
[2023-02-25 12:47:24,541][2409078] Sum rewards: 0.581, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.931', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.016', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.070', 'WEAPON4': '0.300', 'HITCOUNT': '0.310', 'WEAPON3': '0.400', 'weapon4': '0.602', 'ARMOR': '0.840', 'weapon3': '0.930', 'DAMAGECOUNT': '1.056', 'FRAGCOUNT': '1.500', 'weapon2': '2.088'}
[2023-02-25 12:47:24,676][2409373] DAMAGECOUNT value on done: 2077.0
[2023-02-25 12:47:24,677][2409373] Sum rewards: 4.578, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.126', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'WEAPON4': '0.150', 'weapon4': '0.378', 'WEAPON3': '0.650', 'HITCOUNT': '0.690', 'weapon2': '1.540', 'weapon3': '1.940', 'DAMAGECOUNT': '2.292', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:47:24,749][2409548] DAMAGECOUNT value on done: 2072.0
[2023-02-25 12:47:24,750][2409548] Sum rewards: -0.303, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.914', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'AMMO3': '0.059', 'weapon5': '0.080', 'AMMO4': '0.082', 'WEAPON5': '0.150', 'weapon4': '0.252', 'WEAPON4': '0.300', 'HITCOUNT': '0.410', 'WEAPON3': '0.450', 'FRAGCOUNT': '0.500', 'ARMOR': '0.947', 'weapon3': '1.034', 'DAMAGECOUNT': '1.155', 'weapon2': '1.388'}
[2023-02-25 12:47:25,237][2409866] DAMAGECOUNT value on done: 2033.0
[2023-02-25 12:47:25,239][2409866] Sum rewards: -2.247, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.955', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.122', 'WEAPON4': '0.200', 'HITCOUNT': '0.250', 'weapon4': '0.334', 'ARMOR': '0.482', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.840', 'weapon2': '1.020', 'weapon3': '1.462', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:25,246][2409105] DAMAGECOUNT value on done: 1699.0
[2023-02-25 12:47:25,307][2409074] Updated weights for policy 0, policy_version 10501 (0.0012)
[2023-02-25 12:47:25,744][2409355] DAMAGECOUNT value on done: 1983.0
[2023-02-25 12:47:25,747][2409355] Sum rewards: 3.286, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.636', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'weapon4': '0.026', 'AMMO4': '0.069', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.130', 'HITCOUNT': '0.440', 'WEAPON3': '0.600', 'ARMOR': '0.800', 'weapon2': '1.460', 'weapon3': '1.590', 'DAMAGECOUNT': '2.226', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:25,800][2409485] DAMAGECOUNT value on done: 1985.0
[2023-02-25 12:47:25,801][2409485] Sum rewards: -0.759, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.744', 'AMMO2': '0.006', 'AMMO5': '0.011', 'AMMO4': '0.031', 'weapon5': '0.064', 'AMMO3': '0.094', 'WEAPON1': '0.100', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.290', 'ARMOR': '0.484', 'weapon4': '0.534', 'WEAPON3': '0.650', 'weapon2': '0.780', 'DAMAGECOUNT': '1.326', 'weapon3': '1.364', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:25,984][2409407] DAMAGECOUNT value on done: 2725.0
[2023-02-25 12:47:25,985][2409407] Sum rewards: 6.558, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.799', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon5': '0.016', 'AMMO2': '0.021', 'AMMO3': '0.099', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.260', 'HITCOUNT': '0.630', 'WEAPON3': '0.650', 'ARMOR': '0.928', 'weapon2': '1.586', 'weapon3': '1.742', 'DAMAGECOUNT': '2.703', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:47:26,131][2409405] DAMAGECOUNT value on done: 1752.0
[2023-02-25 12:47:26,132][2409101] DAMAGECOUNT value on done: 1393.0
[2023-02-25 12:47:26,134][2409101] Sum rewards: -0.853, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.539', 'AMMO2': '0.015', 'ARMOR': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.077', 'AMMO3': '0.093', 'HITCOUNT': '0.130', 'WEAPON4': '0.250', 'weapon4': '0.430', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.585', 'weapon2': '0.728', 'FRAGCOUNT': '1.000', 'weapon3': '1.778'}
[2023-02-25 12:47:26,133][2409405] Sum rewards: -1.296, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '0.000', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'AMMO3': '0.064', 'HEALTH': '0.083', 'weapon5': '0.084', 'WEAPON4': '0.150', 'AMMO4': '0.189', 'weapon4': '0.236', 'WEAPON5': '0.250', 'HITCOUNT': '0.310', 'WEAPON3': '0.450', 'ARMOR': '0.812', 'DAMAGECOUNT': '1.155', 'weapon3': '1.312', 'weapon2': '1.788'}
[2023-02-25 12:47:26,204][2409406] DAMAGECOUNT value on done: 1888.0
[2023-02-25 12:47:26,207][2409406] Sum rewards: 0.229, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.451', 'AMMO5': '0.005', 'weapon5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.087', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.300', 'HITCOUNT': '0.320', 'weapon4': '0.416', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.203', 'weapon3': '1.224', 'weapon2': '1.294', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:47:26,226][2409100] DAMAGECOUNT value on done: 1255.0
[2023-02-25 12:47:26,241][2409100] Sum rewards: 3.185, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon4': '0.018', 'AMMO2': '0.019', 'ARMOR': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO3': '0.083', 'AMMO4': '0.097', 'HITCOUNT': '0.200', 'HEALTH': '0.323', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.690', 'weapon2': '1.356', 'weapon3': '1.570', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:26,243][2409076] DAMAGECOUNT value on done: 1600.0
[2023-02-25 12:47:26,243][2409076] Sum rewards: 2.606, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.911', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.040', 'AMMO3': '0.070', 'AMMO4': '0.079', 'weapon5': '0.112', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.350', 'WEAPON3': '0.450', 'ARMOR': '0.479', 'weapon4': '0.576', 'weapon2': '1.360', 'DAMAGECOUNT': '1.401', 'weapon3': '1.574', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:26,287][2409103] DAMAGECOUNT value on done: 1435.0
[2023-02-25 12:47:26,290][2409103] Sum rewards: 0.382, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.889', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'weapon5': '0.016', 'WEAPON1': '0.020', 'weapon4': '0.042', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO3': '0.074', 'HITCOUNT': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.450', 'ARMOR': '0.800', 'DAMAGECOUNT': '0.855', 'weapon3': '1.204', 'weapon2': '1.894', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:26,716][2409075] DAMAGECOUNT value on done: 2086.0
[2023-02-25 12:47:26,717][2409075] Sum rewards: -1.518, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.565', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.040', 'AMMO4': '0.055', 'AMMO3': '0.091', 'weapon5': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.170', 'WEAPON5': '0.200', 'HITCOUNT': '0.310', 'WEAPON3': '0.550', 'ARMOR': '0.876', 'weapon3': '0.976', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.002', 'weapon2': '1.236'}
[2023-02-25 12:47:26,817][2409097] DAMAGECOUNT value on done: 1563.0
[2023-02-25 12:47:26,818][2409097] Sum rewards: 2.124, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO2': '0.021', 'ARMOR': '0.028', 'AMMO3': '0.030', 'AMMO4': '0.105', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'WEAPON3': '0.200', 'HEALTH': '0.291', 'weapon2': '0.418', 'DAMAGECOUNT': '0.486', 'weapon4': '0.596', 'weapon3': '0.828', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:47:26,923][2409596] DAMAGECOUNT value on done: 1313.0
[2023-02-25 12:47:26,924][2409596] Sum rewards: 0.949, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.576', 'AMMO2': '0.008', 'ARMOR': '0.024', 'AMMO4': '0.039', 'AMMO3': '0.056', 'WEAPON4': '0.150', 'HITCOUNT': '0.200', 'weapon4': '0.292', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.528', 'weapon2': '0.738', 'weapon3': '0.890', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:26,941][2409389] DAMAGECOUNT value on done: 1646.0
[2023-02-25 12:47:26,942][2409389] Sum rewards: -0.305, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.320', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'weapon5': '0.118', 'AMMO3': '0.127', 'WEAPON5': '0.150', 'HITCOUNT': '0.190', 'WEAPON4': '0.250', 'weapon4': '0.654', 'WEAPON3': '0.700', 'weapon2': '0.766', 'DAMAGECOUNT': '1.341', 'weapon3': '1.400', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:27,005][2409597] DAMAGECOUNT value on done: 1974.0
[2023-02-25 12:47:27,009][2409597] Sum rewards: 2.917, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.353', 'ARMOR': '0.012', 'AMMO2': '0.017', 'AMMO3': '0.060', 'AMMO4': '0.084', 'WEAPON4': '0.250', 'HITCOUNT': '0.400', 'WEAPON3': '0.400', 'weapon4': '0.458', 'DAMAGECOUNT': '1.215', 'weapon2': '1.276', 'weapon3': '1.348', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:27,095][2409074] Updated weights for policy 0, policy_version 10511 (0.0012)
[2023-02-25 12:47:27,186][2408954] Fps is (10 sec: 24985.6, 60 sec: 25463.4, 300 sec: 25589.6). Total num frames: 43053056. Throughput: 0: 6372.8. Samples: 10764324. Policy #0 lag: (min: 0.0, avg: 10.8, max: 25.0)
[2023-02-25 12:47:27,187][2408954] Avg episode reward: [(0, '1.200')]
[2023-02-25 12:47:27,224][2409077] DAMAGECOUNT value on done: 2139.0
[2023-02-25 12:47:27,228][2409077] Sum rewards: -2.565, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.775', 'AMMO2': '0.020', 'ARMOR': '0.040', 'WEAPON1': '0.080', 'AMMO3': '0.098', 'AMMO4': '0.100', 'HITCOUNT': '0.210', 'WEAPON4': '0.300', 'weapon4': '0.456', 'DAMAGECOUNT': '0.657', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.120', 'weapon3': '1.878'}
[2023-02-25 12:47:27,235][2409565] DAMAGECOUNT value on done: 1751.0
[2023-02-25 12:47:27,236][2409565] Sum rewards: 2.351, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.790', 'AMMO5': '0.005', 'AMMO2': '0.016', 'WEAPON1': '0.040', 'AMMO4': '0.079', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.112', 'weapon4': '0.168', 'WEAPON5': '0.200', 'HITCOUNT': '0.280', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.065', 'weapon2': '1.472', 'weapon3': '1.524', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:27,527][2409549] DAMAGECOUNT value on done: 1695.0
[2023-02-25 12:47:27,531][2409549] Sum rewards: 0.871, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.660', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.022', 'WEAPON1': '0.040', 'weapon7': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.129', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.320', 'weapon4': '0.458', 'WEAPON3': '0.700', 'ARMOR': '0.872', 'DAMAGECOUNT': '1.212', 'weapon3': '1.370', 'weapon2': '1.824', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:47:27,587][2409469] DAMAGECOUNT value on done: 2004.0
[2023-02-25 12:47:27,590][2409469] Sum rewards: -0.298, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.628', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.005', 'weapon5': '0.050', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'HITCOUNT': '0.340', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.106', 'DAMAGECOUNT': '1.410', 'weapon3': '1.632'}
[2023-02-25 12:47:27,644][2409102] DAMAGECOUNT value on done: 1660.0
[2023-02-25 12:47:27,644][2409102] Sum rewards: 1.261, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.796', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.047', 'weapon5': '0.068', 'AMMO3': '0.077', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'weapon4': '0.388', 'WEAPON3': '0.500', 'ARMOR': '0.850', 'DAMAGECOUNT': '0.972', 'weapon2': '1.300', 'weapon3': '1.432', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:28,176][2409078] DAMAGECOUNT value on done: 1108.0
[2023-02-25 12:47:28,354][2409373] DAMAGECOUNT value on done: 1834.0
[2023-02-25 12:47:28,355][2409373] Sum rewards: -0.866, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.584', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO3': '0.065', 'AMMO4': '0.065', 'weapon5': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.250', 'weapon4': '0.280', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.272', 'weapon3': '1.364', 'weapon2': '1.380', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:28,393][2409104] DAMAGECOUNT value on done: 1687.0
[2023-02-25 12:47:28,396][2409104] Sum rewards: 0.193, reward structure: {'DEATHCOUNT': '-6.750', 'weapon5': '0.002', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'HEALTH': '0.062', 'AMMO4': '0.149', 'HITCOUNT': '0.310', 'WEAPON4': '0.350', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'weapon2': '0.824', 'weapon4': '0.946', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.005', 'weapon3': '1.382'}
[2023-02-25 12:47:28,547][2409074] Updated weights for policy 0, policy_version 10521 (0.0012)
[2023-02-25 12:47:28,808][2409866] DAMAGECOUNT value on done: 1673.0
[2023-02-25 12:47:28,809][2409866] Sum rewards: 3.126, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.677', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'AMMO3': '0.048', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'WEAPON3': '0.300', 'WEAPON4': '0.300', 'ARMOR': '0.483', 'HITCOUNT': '0.490', 'weapon4': '0.662', 'weapon3': '0.808', 'weapon2': '1.082', 'DAMAGECOUNT': '1.377', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:28,843][2409105] DAMAGECOUNT value on done: 1852.0
[2023-02-25 12:47:28,846][2409105] Sum rewards: -0.305, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.942', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON1': '0.040', 'AMMO4': '0.053', 'weapon5': '0.080', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'HITCOUNT': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.404', 'weapon4': '0.456', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.900', 'weapon3': '1.376', 'weapon2': '1.472', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:29,035][2409486] DAMAGECOUNT value on done: 1781.0
[2023-02-25 12:47:29,035][2409486] Sum rewards: 3.688, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.456', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'ARMOR': '0.068', 'AMMO3': '0.073', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'weapon4': '0.248', 'HITCOUNT': '0.360', 'WEAPON3': '0.450', 'weapon3': '0.942', 'DAMAGECOUNT': '1.239', 'weapon2': '1.998', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:29,189][2409548] DAMAGECOUNT value on done: 1549.0
[2023-02-25 12:47:29,192][2409548] Sum rewards: -0.055, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.059', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.038', 'AMMO3': '0.068', 'weapon5': '0.072', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.410', 'ARMOR': '0.444', 'FRAGCOUNT': '0.500', 'weapon4': '0.576', 'WEAPON3': '0.600', 'weapon3': '1.260', 'DAMAGECOUNT': '1.281', 'weapon2': '1.370'}
[2023-02-25 12:47:29,312][2409355] DAMAGECOUNT value on done: 809.0
[2023-02-25 12:47:29,315][2409355] Sum rewards: 0.449, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.150', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'weapon7': '0.032', 'AMMO3': '0.048', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.134', 'HITCOUNT': '0.220', 'weapon4': '0.322', 'WEAPON5': '0.350', 'WEAPON3': '0.350', 'weapon3': '0.598', 'DAMAGECOUNT': '0.735', 'ARMOR': '0.921', 'FRAGCOUNT': '1.000', 'weapon2': '2.452'}
[2023-02-25 12:47:29,583][2409485] DAMAGECOUNT value on done: 1270.0
[2023-02-25 12:47:29,635][2409407] DAMAGECOUNT value on done: 1338.0
[2023-02-25 12:47:29,635][2409407] Sum rewards: -0.578, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.188', 'AMMO4': '-0.069', 'AMMO2': '-0.014', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon5': '0.054', 'AMMO3': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.310', 'weapon4': '0.470', 'WEAPON3': '0.550', 'weapon3': '0.734', 'ARMOR': '0.835', 'weapon2': '1.328', 'DAMAGECOUNT': '1.380', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:29,803][2409101] DAMAGECOUNT value on done: 1257.0
[2023-02-25 12:47:29,804][2409101] Sum rewards: 3.293, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.300', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO3': '0.078', 'AMMO4': '0.090', 'WEAPON5': '0.150', 'weapon5': '0.164', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.420', 'weapon4': '0.458', 'ARMOR': '0.884', 'weapon3': '1.044', 'weapon2': '1.370', 'DAMAGECOUNT': '1.449', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:29,868][2409076] DAMAGECOUNT value on done: 1555.0
[2023-02-25 12:47:29,996][2409405] DAMAGECOUNT value on done: 1556.0
[2023-02-25 12:47:30,000][2409405] Sum rewards: 2.409, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.484', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'AMMO3': '0.095', 'weapon4': '0.184', 'HITCOUNT': '0.360', 'WEAPON3': '0.700', 'ARMOR': '0.981', 'weapon3': '1.364', 'DAMAGECOUNT': '1.500', 'weapon2': '1.626', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:30,156][2409406] DAMAGECOUNT value on done: 1343.0
[2023-02-25 12:47:30,156][2409074] Updated weights for policy 0, policy_version 10531 (0.0013)
[2023-02-25 12:47:30,157][2409406] Sum rewards: -1.011, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.438', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.050', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'weapon4': '0.126', 'WEAPON4': '0.150', 'HITCOUNT': '0.320', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.107', 'weapon3': '1.158', 'weapon2': '1.462'}
[2023-02-25 12:47:30,275][2409103] DAMAGECOUNT value on done: 1388.0
[2023-02-25 12:47:30,278][2409103] Sum rewards: 4.033, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.950', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.009', 'WEAPON1': '0.030', 'AMMO3': '0.054', 'weapon5': '0.114', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.290', 'WEAPON3': '0.450', 'ARMOR': '0.520', 'DAMAGECOUNT': '0.819', 'weapon3': '1.216', 'weapon2': '1.634', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:30,629][2409597] DAMAGECOUNT value on done: 1596.0
[2023-02-25 12:47:30,629][2409597] Sum rewards: 2.879, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.336', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.030', 'weapon5': '0.064', 'AMMO4': '0.077', 'weapon7': '0.082', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.270', 'WEAPON4': '0.350', 'weapon4': '0.782', 'weapon3': '0.790', 'ARMOR': '0.800', 'weapon2': '0.816', 'DAMAGECOUNT': '0.825', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:30,696][2409097] DAMAGECOUNT value on done: 965.0
[2023-02-25 12:47:30,699][2409097] Sum rewards: 0.414, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.371', 'AMMO2': '0.006', 'WEAPON1': '0.030', 'AMMO4': '0.031', 'AMMO3': '0.080', 'HITCOUNT': '0.330', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.050', 'weapon2': '1.282', 'weapon3': '1.376'}
[2023-02-25 12:47:30,717][2409100] DAMAGECOUNT value on done: 1856.0
[2023-02-25 12:47:30,718][2409100] Sum rewards: 2.582, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.271', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'weapon7': '0.062', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.258', 'WEAPON5': '0.350', 'HITCOUNT': '0.410', 'ARMOR': '0.481', 'WEAPON3': '0.600', 'weapon2': '1.196', 'DAMAGECOUNT': '1.512', 'weapon3': '1.770', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:30,753][2409075] DAMAGECOUNT value on done: 1694.0
[2023-02-25 12:47:30,755][2409075] Sum rewards: 4.510, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.343', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.041', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'AMMO4': '0.203', 'WEAPON4': '0.250', 'weapon4': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.450', 'WEAPON3': '0.550', 'weapon2': '1.440', 'DAMAGECOUNT': '1.713', 'weapon3': '1.764', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:47:30,778][2409565] DAMAGECOUNT value on done: 1759.0
[2023-02-25 12:47:30,781][2409565] Sum rewards: 1.099, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.128', 'AMMO2': '0.001', 'AMMO4': '0.003', 'WEAPON1': '0.020', 'AMMO3': '0.111', 'HITCOUNT': '0.430', 'WEAPON3': '0.700', 'weapon2': '1.156', 'DAMAGECOUNT': '1.512', 'weapon3': '1.794', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:30,969][2409077] DAMAGECOUNT value on done: 1249.0
[2023-02-25 12:47:30,975][2409389] DAMAGECOUNT value on done: 1290.0
[2023-02-25 12:47:30,978][2409389] Sum rewards: -0.815, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.610', 'AMMO2': '0.006', 'AMMO5': '0.010', 'weapon5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.031', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'weapon4': '0.178', 'WEAPON4': '0.200', 'HITCOUNT': '0.250', 'ARMOR': '0.449', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.714', 'weapon3': '1.538', 'FRAGCOUNT': '2.000', 'weapon2': '2.088'}
[2023-02-25 12:47:31,119][2409549] DAMAGECOUNT value on done: 1932.0
[2023-02-25 12:47:31,120][2409549] Sum rewards: 3.724, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.576', 'AMMO5': '0.005', 'weapon5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'weapon7': '0.048', 'AMMO4': '0.078', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.238', 'HITCOUNT': '0.440', 'ARMOR': '0.447', 'WEAPON3': '0.550', 'weapon2': '0.880', 'weapon3': '1.636', 'DAMAGECOUNT': '1.908', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:31,147][2409596] DAMAGECOUNT value on done: 1821.0
[2023-02-25 12:47:31,148][2409596] Sum rewards: 1.364, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.864', 'AMMO4': '-0.061', 'AMMO2': '-0.012', 'AMMO5': '0.007', 'weapon4': '0.042', 'WEAPON4': '0.050', 'weapon5': '0.054', 'AMMO3': '0.063', 'WEAPON5': '0.200', 'HITCOUNT': '0.330', 'ARMOR': '0.450', 'WEAPON3': '0.450', 'weapon3': '1.176', 'DAMAGECOUNT': '1.569', 'weapon2': '1.660', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:31,164][2409102] DAMAGECOUNT value on done: 1654.0
[2023-02-25 12:47:31,167][2409102] Sum rewards: 0.164, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.724', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'ARMOR': '0.032', 'AMMO4': '0.083', 'AMMO3': '0.118', 'WEAPON4': '0.300', 'weapon4': '0.420', 'HITCOUNT': '0.490', 'WEAPON3': '0.800', 'weapon2': '1.108', 'DAMAGECOUNT': '1.488', 'weapon3': '1.522', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:31,539][2409469] DAMAGECOUNT value on done: 1324.0
[2023-02-25 12:47:31,540][2409469] Sum rewards: 1.284, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.220', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'WEAPON1': '0.040', 'weapon5': '0.060', 'AMMO3': '0.088', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.280', 'weapon4': '0.300', 'ARMOR': '0.481', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.164', 'weapon2': '1.288', 'weapon3': '1.604', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:32,051][2409078] DAMAGECOUNT value on done: 1413.0
[2023-02-25 12:47:32,052][2409078] Sum rewards: 0.523, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.200', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.032', 'WEAPON1': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.092', 'AMMO3': '0.099', 'WEAPON4': '0.300', 'HITCOUNT': '0.340', 'ARMOR': '0.404', 'weapon4': '0.494', 'WEAPON3': '0.700', 'weapon2': '1.518', 'weapon3': '1.658', 'DAMAGECOUNT': '1.725', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:32,089][2409074] Updated weights for policy 0, policy_version 10541 (0.0013)
[2023-02-25 12:47:32,186][2408954] Fps is (10 sec: 24985.5, 60 sec: 25463.5, 300 sec: 25561.8). Total num frames: 43180032. Throughput: 0: 6358.1. Samples: 10802328. Policy #0 lag: (min: 0.0, avg: 12.1, max: 26.0)
[2023-02-25 12:47:32,186][2408954] Avg episode reward: [(0, '1.118')]
[2023-02-25 12:47:32,187][2409373] DAMAGECOUNT value on done: 1807.0
[2023-02-25 12:47:32,189][2409373] Sum rewards: 2.243, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.845', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon7': '0.038', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.066', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.220', 'WEAPON3': '0.400', 'weapon4': '0.480', 'ARMOR': '0.481', 'DAMAGECOUNT': '0.765', 'weapon2': '0.810', 'weapon3': '1.468', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:32,418][2409096] DAMAGECOUNT value on done: 2086.0
[2023-02-25 12:47:32,422][2409096] Sum rewards: 7.392, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.800', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.029', 'WEAPON1': '0.040', 'AMMO3': '0.054', 'WEAPON4': '0.150', 'weapon5': '0.256', 'WEAPON5': '0.300', 'weapon4': '0.314', 'WEAPON3': '0.400', 'ARMOR': '0.449', 'HITCOUNT': '0.510', 'weapon3': '1.240', 'weapon2': '1.698', 'DAMAGECOUNT': '2.736', 'FRAGCOUNT': '4.500'}
[2023-02-25 12:47:32,460][2409105] DAMAGECOUNT value on done: 2079.0
[2023-02-25 12:47:32,464][2409105] Sum rewards: 5.325, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.587', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'ARMOR': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'weapon5': '0.106', 'WEAPON5': '0.200', 'weapon4': '0.260', 'HITCOUNT': '0.290', 'WEAPON3': '0.550', 'weapon3': '1.440', 'weapon2': '1.476', 'DAMAGECOUNT': '1.881', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:32,738][2409104] DAMAGECOUNT value on done: 1875.0
[2023-02-25 12:47:32,739][2409104] Sum rewards: 2.240, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.761', 'weapon5': '0.004', 'AMMO5': '0.010', 'weapon7': '0.018', 'ARMOR': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.070', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.346', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'weapon3': '1.092', 'weapon2': '1.212', 'DAMAGECOUNT': '1.410', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:32,913][2409548] DAMAGECOUNT value on done: 2293.0
[2023-02-25 12:47:32,917][2409548] Sum rewards: 7.534, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.328', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.004', 'WEAPON1': '0.030', 'weapon5': '0.032', 'AMMO3': '0.040', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.196', 'WEAPON3': '0.300', 'HITCOUNT': '0.450', 'ARMOR': '0.500', 'weapon3': '0.958', 'weapon2': '1.544', 'DAMAGECOUNT': '1.620', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:47:33,124][2409074] Updated weights for policy 0, policy_version 10551 (0.0012)
[2023-02-25 12:47:33,200][2409486] DAMAGECOUNT value on done: 2392.0
[2023-02-25 12:47:33,201][2409486] Sum rewards: 8.198, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.221', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.007', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.051', 'weapon7': '0.062', 'weapon5': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'HITCOUNT': '0.470', 'weapon4': '0.634', 'weapon3': '0.768', 'weapon2': '1.008', 'DAMAGECOUNT': '1.920', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:47:33,369][2409101] DAMAGECOUNT value on done: 2283.0
[2023-02-25 12:47:33,370][2409101] Sum rewards: 9.238, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.674', 'AMMO5': '0.019', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.102', 'AMMO4': '0.112', 'weapon4': '0.200', 'weapon5': '0.218', 'WEAPON5': '0.350', 'HITCOUNT': '0.480', 'WEAPON3': '0.600', 'ARMOR': '0.858', 'weapon3': '1.356', 'weapon2': '1.592', 'DAMAGECOUNT': '2.673', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:47:33,420][2409866] DAMAGECOUNT value on done: 1322.0
[2023-02-25 12:47:33,424][2409866] Sum rewards: 1.067, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.515', 'AMMO5': '0.003', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.042', 'AMMO3': '0.060', 'weapon4': '0.254', 'HITCOUNT': '0.270', 'WEAPON4': '0.350', 'ARMOR': '0.452', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.834', 'weapon3': '1.192', 'weapon2': '1.596', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:33,520][2409485] DAMAGECOUNT value on done: 1343.0
[2023-02-25 12:47:33,521][2409485] Sum rewards: 2.014, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.132', 'AMMO2': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.021', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.106', 'WEAPON5': '0.150', 'weapon4': '0.168', 'HITCOUNT': '0.220', 'WEAPON3': '0.400', 'FRAGCOUNT': '1.000', 'weapon3': '1.068', 'DAMAGECOUNT': '1.167', 'weapon2': '1.476'}
[2023-02-25 12:47:33,640][2409407] DAMAGECOUNT value on done: 1797.0
[2023-02-25 12:47:33,643][2409407] Sum rewards: 0.776, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.278', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'ARMOR': '0.052', 'AMMO3': '0.066', 'weapon5': '0.092', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.290', 'WEAPON3': '0.450', 'weapon4': '0.644', 'DAMAGECOUNT': '0.903', 'FRAGCOUNT': '1.000', 'weapon3': '1.132', 'weapon2': '1.222'}
[2023-02-25 12:47:33,822][2409406] DAMAGECOUNT value on done: 1951.0
[2023-02-25 12:47:33,826][2409406] Sum rewards: -0.133, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.732', 'AMMO5': '0.003', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.070', 'weapon7': '0.078', 'AMMO3': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'weapon4': '0.408', 'DAMAGECOUNT': '0.552', 'WEAPON3': '0.650', 'weapon2': '1.192', 'weapon3': '1.628', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:33,927][2409355] DAMAGECOUNT value on done: 2021.0
[2023-02-25 12:47:33,928][2409355] Sum rewards: 2.048, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.746', 'AMMO5': '0.005', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.034', 'weapon7': '0.052', 'AMMO3': '0.073', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.140', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.350', 'WEAPON3': '0.450', 'weapon4': '0.484', 'ARMOR': '0.501', 'weapon2': '0.786', 'weapon3': '0.936', 'DAMAGECOUNT': '1.326', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:33,931][2409103] DAMAGECOUNT value on done: 1672.0
[2023-02-25 12:47:33,934][2409103] Sum rewards: 4.524, reward structure: {'DEATHCOUNT': '-6.750', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.017', 'AMMO4': '0.060', 'weapon5': '0.076', 'AMMO3': '0.110', 'HEALTH': '0.249', 'WEAPON5': '0.300', 'HITCOUNT': '0.450', 'WEAPON3': '0.550', 'weapon2': '1.132', 'weapon3': '1.618', 'DAMAGECOUNT': '1.689', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:47:33,956][2409076] DAMAGECOUNT value on done: 1846.0
[2023-02-25 12:47:33,960][2409076] Sum rewards: 3.254, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.220', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO3': '0.040', 'weapon7': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.230', 'WEAPON3': '0.250', 'weapon3': '0.820', 'DAMAGECOUNT': '0.939', 'weapon2': '1.426', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:33,984][2409405] DAMAGECOUNT value on done: 1178.0
[2023-02-25 12:47:33,985][2409405] Sum rewards: -4.439, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-2.000', 'HEALTH': '-1.800', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.061', 'weapon7': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.125', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.200', 'weapon5': '0.228', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.516', 'weapon4': '0.534', 'ARMOR': '0.862', 'weapon3': '0.974', 'weapon2': '1.792'}
[2023-02-25 12:47:34,311][2409597] DAMAGECOUNT value on done: 2366.0
[2023-02-25 12:47:34,314][2409100] DAMAGECOUNT value on done: 1923.0
[2023-02-25 12:47:34,318][2409100] Sum rewards: -4.783, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.230', 'AMMO2': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.022', 'weapon4': '0.132', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'HITCOUNT': '0.470', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.200', 'weapon2': '1.306', 'weapon3': '1.690'}
[2023-02-25 12:47:34,315][2409597] Sum rewards: 5.026, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.774', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.212', 'WEAPON3': '0.450', 'HITCOUNT': '0.530', 'ARMOR': '0.903', 'weapon3': '1.228', 'weapon2': '1.356', 'DAMAGECOUNT': '1.761', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:34,332][2409097] DAMAGECOUNT value on done: 1898.0
[2023-02-25 12:47:34,333][2409097] Sum rewards: 1.799, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.522', 'weapon7': '0.002', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'AMMO3': '0.074', 'AMMO4': '0.103', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'ARMOR': '0.505', 'weapon4': '0.658', 'weapon3': '1.110', 'weapon2': '1.170', 'DAMAGECOUNT': '1.518', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:34,366][2409565] DAMAGECOUNT value on done: 1457.0
[2023-02-25 12:47:34,369][2409565] Sum rewards: 5.678, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.870', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO3': '0.032', 'AMMO4': '0.063', 'weapon7': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.260', 'weapon4': '0.270', 'ARMOR': '0.400', 'weapon3': '0.694', 'DAMAGECOUNT': '1.092', 'weapon2': '1.334', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:47:34,549][2409075] DAMAGECOUNT value on done: 1001.0
[2023-02-25 12:47:34,553][2409075] Sum rewards: 1.085, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.344', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO3': '0.052', 'HITCOUNT': '0.080', 'DAMAGECOUNT': '0.255', 'WEAPON3': '0.300', 'ARMOR': '0.432', 'FRAGCOUNT': '1.000', 'weapon3': '1.302', 'weapon2': '1.796'}
[2023-02-25 12:47:34,638][2409077] DAMAGECOUNT value on done: 1446.0
[2023-02-25 12:47:34,641][2409077] Sum rewards: 0.015, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.074', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.046', 'WEAPON1': '0.070', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'weapon5': '0.118', 'AMMO3': '0.137', 'WEAPON5': '0.200', 'HITCOUNT': '0.270', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.056', 'weapon2': '1.470', 'weapon3': '1.780', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:47:34,720][2409102] DAMAGECOUNT value on done: 2019.0
[2023-02-25 12:47:34,724][2409102] Sum rewards: 5.500, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.964', 'AMMO5': '0.005', 'AMMO2': '0.031', 'WEAPON1': '0.060', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'weapon5': '0.104', 'WEAPON4': '0.150', 'AMMO4': '0.157', 'weapon4': '0.198', 'ARMOR': '0.436', 'HITCOUNT': '0.560', 'WEAPON3': '0.650', 'weapon2': '1.632', 'weapon3': '1.788', 'DAMAGECOUNT': '2.007', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:47:34,833][2409389] DAMAGECOUNT value on done: 1355.0
[2023-02-25 12:47:34,834][2409389] Sum rewards: -0.488, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.014', 'WEAPON1': '0.030', 'weapon7': '0.032', 'AMMO2': '0.034', 'AMMO3': '0.073', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.150', 'AMMO4': '0.170', 'WEAPON5': '0.200', 'weapon4': '0.290', 'HEALTH': '0.318', 'WEAPON3': '0.400', 'ARMOR': '0.408', 'DAMAGECOUNT': '0.426', 'FRAGCOUNT': '1.000', 'weapon3': '1.246', 'weapon2': '1.620'}
[2023-02-25 12:47:34,879][2409549] DAMAGECOUNT value on done: 1569.0
[2023-02-25 12:47:34,880][2409549] Sum rewards: -0.569, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.550', 'ARMOR': '0.008', 'AMMO2': '0.014', 'AMMO5': '0.017', 'WEAPON1': '0.050', 'AMMO4': '0.071', 'weapon5': '0.112', 'AMMO3': '0.121', 'WEAPON4': '0.150', 'weapon4': '0.162', 'HITCOUNT': '0.230', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.071', 'weapon2': '1.356', 'weapon3': '1.868', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:35,221][2409596] DAMAGECOUNT value on done: 1990.0
[2023-02-25 12:47:35,224][2409596] Sum rewards: 4.248, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.252', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'ARMOR': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.080', 'weapon5': '0.102', 'WEAPON5': '0.150', 'weapon4': '0.152', 'HITCOUNT': '0.290', 'WEAPON3': '0.450', 'weapon3': '1.488', 'weapon2': '1.682', 'DAMAGECOUNT': '1.710', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:47:35,254][2409469] DAMAGECOUNT value on done: 2160.0
[2023-02-25 12:47:35,255][2409469] Sum rewards: -1.520, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.168', 'AMMO5': '0.015', 'weapon5': '0.046', 'AMMO2': '0.047', 'weapon7': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.124', 'WEAPON4': '0.200', 'AMMO4': '0.236', 'HITCOUNT': '0.240', 'WEAPON5': '0.300', 'weapon4': '0.436', 'WEAPON3': '0.800', 'weapon3': '1.174', 'ARMOR': '1.236', 'weapon2': '1.358', 'DAMAGECOUNT': '1.566', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:35,281][2409074] Updated weights for policy 0, policy_version 10561 (0.0012)
[2023-02-25 12:47:36,109][2409373] DAMAGECOUNT value on done: 2017.0
[2023-02-25 12:47:36,113][2409373] Sum rewards: 1.969, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.262', 'AMMO5': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON1': '0.080', 'AMMO3': '0.116', 'weapon5': '0.162', 'WEAPON5': '0.200', 'HITCOUNT': '0.260', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.410', 'weapon3': '1.562', 'weapon2': '1.720', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:36,128][2409096] DAMAGECOUNT value on done: 1379.0
[2023-02-25 12:47:36,133][2409096] Sum rewards: -0.281, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.090', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'ARMOR': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.067', 'AMMO4': '0.073', 'WEAPON4': '0.200', 'weapon4': '0.284', 'HITCOUNT': '0.430', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon3': '1.324', 'DAMAGECOUNT': '1.365', 'weapon2': '1.458'}
[2023-02-25 12:47:36,282][2409078] DAMAGECOUNT value on done: 2183.0
[2023-02-25 12:47:36,285][2409078] Sum rewards: 7.764, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.701', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO3': '0.051', 'WEAPON4': '0.100', 'weapon4': '0.130', 'WEAPON5': '0.200', 'weapon5': '0.228', 'WEAPON3': '0.450', 'HITCOUNT': '0.540', 'ARMOR': '0.832', 'weapon3': '1.210', 'weapon2': '1.602', 'DAMAGECOUNT': '2.325', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:47:36,518][2409105] DAMAGECOUNT value on done: 1455.0
[2023-02-25 12:47:36,522][2409105] Sum rewards: 2.675, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.470', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'WEAPON1': '0.060', 'AMMO3': '0.062', 'HITCOUNT': '0.320', 'ARMOR': '0.451', 'WEAPON3': '0.500', 'weapon3': '0.934', 'DAMAGECOUNT': '1.290', 'weapon2': '1.316', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:36,651][2409104] DAMAGECOUNT value on done: 1319.0
[2023-02-25 12:47:36,666][2409104] Sum rewards: 3.274, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.729', 'AMMO2': '0.027', 'weapon7': '0.048', 'AMMO3': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.132', 'weapon4': '0.414', 'HITCOUNT': '0.420', 'WEAPON3': '0.500', 'ARMOR': '0.501', 'weapon3': '1.020', 'weapon2': '1.294', 'DAMAGECOUNT': '1.419', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:36,753][2409074] Updated weights for policy 0, policy_version 10571 (0.0012)
[2023-02-25 12:47:36,915][2409079] DAMAGECOUNT value on done: 1483.0
[2023-02-25 12:47:36,918][2409079] Sum rewards: 5.192, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.414', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.081', 'weapon5': '0.116', 'WEAPON4': '0.200', 'HITCOUNT': '0.260', 'WEAPON3': '0.550', 'weapon4': '0.592', 'DAMAGECOUNT': '0.729', 'ARMOR': '0.836', 'weapon2': '1.310', 'weapon3': '1.328', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:37,041][2409548] DAMAGECOUNT value on done: 1596.0
[2023-02-25 12:47:37,042][2409548] Sum rewards: 0.516, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.302', 'AMMO4': '-0.043', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'AMMO3': '0.064', 'weapon5': '0.082', 'WEAPON5': '0.100', 'HITCOUNT': '0.310', 'WEAPON3': '0.450', 'ARMOR': '0.454', 'DAMAGECOUNT': '1.080', 'weapon3': '1.396', 'weapon2': '1.428', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:47:37,180][2409485] DAMAGECOUNT value on done: 1769.0
[2023-02-25 12:47:37,184][2409485] Sum rewards: -1.980, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.412', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.040', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'WEAPON4': '0.150', 'HITCOUNT': '0.190', 'ARMOR': '0.424', 'weapon4': '0.434', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.116', 'weapon3': '1.280', 'weapon2': '1.332'}
[2023-02-25 12:47:37,186][2408954] Fps is (10 sec: 26623.2, 60 sec: 25668.1, 300 sec: 25603.4). Total num frames: 43319296. Throughput: 0: 6349.5. Samples: 10821384. Policy #0 lag: (min: 0.0, avg: 12.1, max: 26.0)
[2023-02-25 12:47:37,187][2408954] Avg episode reward: [(0, '1.545')]
[2023-02-25 12:47:37,192][2409033] Saving new best policy, reward=1.545!
[2023-02-25 12:47:37,243][2409407] DAMAGECOUNT value on done: 1925.0
[2023-02-25 12:47:37,244][2409407] Sum rewards: -0.433, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.968', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.102', 'AMMO3': '0.111', 'weapon4': '0.164', 'AMMO4': '0.168', 'HITCOUNT': '0.230', 'WEAPON4': '0.300', 'WEAPON3': '0.750', 'ARMOR': '0.836', 'DAMAGECOUNT': '1.299', 'weapon3': '1.546', 'weapon2': '1.670', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:37,347][2409101] DAMAGECOUNT value on done: 1945.0
[2023-02-25 12:47:37,348][2409101] Sum rewards: -1.587, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.895', 'AMMO5': '0.003', 'AMMO2': '0.018', 'ARMOR': '0.025', 'WEAPON1': '0.060', 'weapon5': '0.080', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'WEAPON4': '0.200', 'weapon4': '0.304', 'HITCOUNT': '0.370', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.290', 'weapon2': '1.392', 'weapon3': '1.824', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:37,419][2409486] DAMAGECOUNT value on done: 1210.0
[2023-02-25 12:47:37,420][2409486] Sum rewards: 1.756, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.855', 'AMMO2': '0.005', 'AMMO5': '0.008', 'AMMO4': '0.024', 'WEAPON1': '0.030', 'AMMO3': '0.054', 'HITCOUNT': '0.080', 'weapon5': '0.156', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.240', 'WEAPON5': '0.250', 'weapon4': '0.258', 'WEAPON3': '0.400', 'ARMOR': '0.921', 'FRAGCOUNT': '1.000', 'weapon3': '1.124', 'weapon2': '1.610'}
[2023-02-25 12:47:37,565][2409103] DAMAGECOUNT value on done: 2221.0
[2023-02-25 12:47:37,566][2409103] Sum rewards: 4.518, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.068', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.046', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.174', 'weapon4': '0.216', 'HITCOUNT': '0.450', 'WEAPON3': '0.600', 'ARMOR': '0.852', 'weapon3': '1.286', 'weapon2': '1.576', 'DAMAGECOUNT': '2.016', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:37,592][2409866] DAMAGECOUNT value on done: 1788.0
[2023-02-25 12:47:37,593][2409866] Sum rewards: 2.451, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.231', 'AMMO4': '-0.074', 'AMMO2': '-0.015', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'weapon7': '0.066', 'weapon5': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.400', 'weapon3': '0.962', 'DAMAGECOUNT': '1.224', 'FRAGCOUNT': '1.500', 'weapon2': '1.820'}
[2023-02-25 12:47:37,654][2409076] DAMAGECOUNT value on done: 1867.0
[2023-02-25 12:47:37,657][2409076] Sum rewards: 3.886, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.590', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO3': '0.062', 'weapon7': '0.074', 'AMMO4': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.264', 'WEAPON3': '0.350', 'HITCOUNT': '0.450', 'weapon2': '1.164', 'weapon3': '1.336', 'DAMAGECOUNT': '1.860', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:47:37,757][2409406] DAMAGECOUNT value on done: 1623.0
[2023-02-25 12:47:37,758][2409406] Sum rewards: 0.693, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.984', 'AMMO2': '0.004', 'AMMO5': '0.013', 'AMMO4': '0.019', 'weapon5': '0.020', 'WEAPON1': '0.030', 'AMMO3': '0.100', 'WEAPON5': '0.200', 'HITCOUNT': '0.310', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.365', 'weapon2': '1.528', 'weapon3': '1.738', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:37,913][2409565] DAMAGECOUNT value on done: 1278.0
[2023-02-25 12:47:37,918][2409565] Sum rewards: -6.679, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.635', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.015', 'AMMO2': '0.016', 'weapon5': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.079', 'AMMO3': '0.089', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'HITCOUNT': '0.360', 'weapon4': '0.368', 'WEAPON3': '0.500', 'ARMOR': '0.842', 'weapon3': '0.844', 'DAMAGECOUNT': '0.963', 'weapon2': '2.242'}
[2023-02-25 12:47:38,141][2409405] DAMAGECOUNT value on done: 2177.0
[2023-02-25 12:47:38,145][2409405] Sum rewards: 3.839, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.444', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON1': '0.050', 'weapon5': '0.074', 'AMMO4': '0.109', 'AMMO3': '0.126', 'WEAPON5': '0.150', 'weapon4': '0.152', 'WEAPON4': '0.200', 'ARMOR': '0.456', 'HITCOUNT': '0.540', 'WEAPON3': '0.800', 'weapon2': '1.158', 'weapon3': '2.086', 'DAMAGECOUNT': '3.105', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:47:38,156][2409075] DAMAGECOUNT value on done: 1230.0
[2023-02-25 12:47:38,157][2409075] Sum rewards: 3.305, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.054', 'AMMO4': '0.076', 'HEALTH': '0.148', 'HITCOUNT': '0.270', 'WEAPON3': '0.300', 'ARMOR': '0.412', 'weapon3': '0.788', 'DAMAGECOUNT': '0.828', 'weapon2': '1.794', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:38,240][2409102] DAMAGECOUNT value on done: 1547.0
[2023-02-25 12:47:38,243][2409102] Sum rewards: 5.973, reward structure: {'DEATHCOUNT': '-4.500', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'AMMO3': '0.068', 'AMMO4': '0.136', 'HITCOUNT': '0.300', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'HEALTH': '0.590', 'DAMAGECOUNT': '0.987', 'weapon3': '1.246', 'weapon2': '2.348', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:38,295][2409597] DAMAGECOUNT value on done: 1811.0
[2023-02-25 12:47:38,296][2409597] Sum rewards: -0.439, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.410', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'WEAPON4': '0.050', 'weapon4': '0.104', 'weapon5': '0.112', 'AMMO3': '0.127', 'HITCOUNT': '0.130', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.678', 'WEAPON3': '0.750', 'ARMOR': '0.908', 'weapon2': '1.524', 'weapon3': '1.622', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:38,370][2409389] DAMAGECOUNT value on done: 1859.0
[2023-02-25 12:47:38,371][2409389] Sum rewards: 1.788, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.432', 'AMMO2': '0.020', 'AMMO3': '0.069', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'weapon4': '0.268', 'HITCOUNT': '0.310', 'ARMOR': '0.408', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.080', 'weapon3': '1.116', 'weapon2': '1.500', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:38,385][2409100] DAMAGECOUNT value on done: 1862.0
[2023-02-25 12:47:38,388][2409100] Sum rewards: 2.325, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.524', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'weapon5': '0.032', 'AMMO3': '0.070', 'WEAPON5': '0.150', 'HITCOUNT': '0.490', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.320', 'weapon3': '1.598', 'weapon2': '1.660', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:38,487][2409355] DAMAGECOUNT value on done: 1851.0
[2023-02-25 12:47:38,490][2409355] Sum rewards: -1.742, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.255', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.023', 'AMMO3': '0.040', 'weapon5': '0.048', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.516', 'DAMAGECOUNT': '0.615', 'weapon2': '0.686', 'weapon4': '0.806', 'weapon3': '0.872', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:47:38,494][2409097] DAMAGECOUNT value on done: 1315.0
[2023-02-25 12:47:38,495][2409097] Sum rewards: -2.931, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.937', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'ARMOR': '0.048', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.125', 'AMMO4': '0.129', 'HITCOUNT': '0.220', 'WEAPON4': '0.600', 'DAMAGECOUNT': '0.672', 'WEAPON3': '0.800', 'weapon2': '0.808', 'weapon4': '0.940', 'weapon3': '1.448', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:38,587][2409077] DAMAGECOUNT value on done: 2123.0
[2023-02-25 12:47:38,588][2409077] Sum rewards: 2.214, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.778', 'AMMO5': '0.003', 'AMMO2': '0.019', 'ARMOR': '0.040', 'weapon5': '0.044', 'WEAPON1': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.096', 'AMMO3': '0.105', 'WEAPON4': '0.250', 'HITCOUNT': '0.430', 'weapon4': '0.608', 'WEAPON3': '0.750', 'weapon2': '0.772', 'weapon3': '1.358', 'DAMAGECOUNT': '1.917', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:47:38,600][2409549] DAMAGECOUNT value on done: 2413.0
[2023-02-25 12:47:38,601][2409549] Sum rewards: 1.207, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.838', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.037', 'AMMO3': '0.063', 'AMMO4': '0.185', 'weapon5': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.560', 'weapon4': '0.818', 'ARMOR': '0.844', 'weapon2': '1.134', 'weapon3': '1.156', 'DAMAGECOUNT': '1.683', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:47:38,758][2409074] Updated weights for policy 0, policy_version 10581 (0.0012)
[2023-02-25 12:47:39,077][2409596] DAMAGECOUNT value on done: 1738.0
[2023-02-25 12:47:39,078][2409596] Sum rewards: -2.167, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.076', 'AMMO5': '0.013', 'AMMO2': '0.023', 'WEAPON1': '0.050', 'weapon5': '0.060', 'AMMO4': '0.113', 'weapon4': '0.142', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.350', 'ARMOR': '0.473', 'WEAPON3': '0.950', 'weapon2': '1.168', 'DAMAGECOUNT': '1.203', 'weapon3': '2.018', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:47:39,176][2409469] DAMAGECOUNT value on done: 1706.0
[2023-02-25 12:47:39,178][2409469] Sum rewards: -5.937, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.194', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.050', 'AMMO4': '0.091', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'weapon4': '0.142', 'HITCOUNT': '0.200', 'ARMOR': '0.492', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.918', 'weapon2': '1.332', 'weapon3': '1.654'}
[2023-02-25 12:47:39,698][2409373] DAMAGECOUNT value on done: 1315.0
[2023-02-25 12:47:39,699][2409373] Sum rewards: 2.631, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.051', 'AMMO2': '0.008', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'HITCOUNT': '0.170', 'weapon4': '0.184', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.468', 'weapon2': '1.056', 'weapon3': '1.294', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:39,965][2409074] Updated weights for policy 0, policy_version 10591 (0.0012)
[2023-02-25 12:47:40,177][2409096] DAMAGECOUNT value on done: 1587.0
[2023-02-25 12:47:40,178][2409096] Sum rewards: -0.662, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.200', 'weapon5': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.058', 'AMMO3': '0.109', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.420', 'ARMOR': '0.514', 'HITCOUNT': '0.570', 'WEAPON3': '0.800', 'weapon3': '1.568', 'DAMAGECOUNT': '1.575', 'weapon2': '1.614', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:40,446][2409104] DAMAGECOUNT value on done: 1608.0
[2023-02-25 12:47:40,446][2409104] Sum rewards: 0.513, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.164', 'AMMO2': '0.037', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'AMMO4': '0.184', 'weapon4': '0.258', 'HITCOUNT': '0.270', 'ARMOR': '0.436', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.903', 'weapon2': '1.358', 'weapon3': '1.818', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:40,529][2409078] DAMAGECOUNT value on done: 1517.0
[2023-02-25 12:47:40,532][2409078] Sum rewards: 4.866, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.382', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.014', 'AMMO4': '0.028', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.072', 'WEAPON5': '0.100', 'weapon4': '0.278', 'HITCOUNT': '0.550', 'WEAPON3': '0.650', 'weapon2': '1.288', 'weapon3': '1.768', 'DAMAGECOUNT': '1.899', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:40,620][2409548] DAMAGECOUNT value on done: 2319.0
[2023-02-25 12:47:40,623][2409548] Sum rewards: 3.002, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'HEALTH': '0.036', 'WEAPON4': '0.050', 'weapon5': '0.060', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon4': '0.152', 'HITCOUNT': '0.450', 'WEAPON3': '0.550', 'weapon3': '1.338', 'DAMAGECOUNT': '1.500', 'weapon2': '1.516', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:40,729][2409105] DAMAGECOUNT value on done: 1376.0
[2023-02-25 12:47:40,730][2409105] Sum rewards: 1.812, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO5': '0.003', 'AMMO2': '0.013', 'AMMO3': '0.035', 'weapon7': '0.048', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'HITCOUNT': '0.100', 'WEAPON7': '0.100', 'HEALTH': '0.126', 'WEAPON4': '0.150', 'WEAPON3': '0.200', 'weapon2': '0.210', 'weapon3': '0.344', 'weapon4': '0.374', 'ARMOR': '0.420', 'DAMAGECOUNT': '0.567', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:47:40,825][2409485] DAMAGECOUNT value on done: 1783.0
[2023-02-25 12:47:40,826][2409485] Sum rewards: 0.893, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.475', 'AMMO2': '0.005', 'ARMOR': '0.008', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO3': '0.073', 'weapon4': '0.224', 'HITCOUNT': '0.350', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.101', 'weapon2': '1.392', 'weapon3': '1.668', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:40,843][2409079] DAMAGECOUNT value on done: 1117.0
[2023-02-25 12:47:40,843][2409079] Sum rewards: -5.969, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-4.500', 'HEALTH': '-0.406', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.044', 'weapon7': '0.048', 'weapon5': '0.066', 'AMMO3': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.200', 'weapon4': '0.328', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.630', 'ARMOR': '0.852', 'weapon3': '1.152', 'weapon2': '1.246'}
[2023-02-25 12:47:40,935][2409101] DAMAGECOUNT value on done: 2008.0
[2023-02-25 12:47:40,936][2409101] Sum rewards: -1.252, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.960', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.018', 'AMMO4': '0.028', 'AMMO3': '0.046', 'weapon7': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'HITCOUNT': '0.250', 'WEAPON3': '0.300', 'ARMOR': '0.465', 'FRAGCOUNT': '0.500', 'weapon4': '0.620', 'weapon3': '0.858', 'weapon2': '1.242', 'DAMAGECOUNT': '1.350'}
[2023-02-25 12:47:41,189][2409407] DAMAGECOUNT value on done: 2047.0
[2023-02-25 12:47:41,190][2409407] Sum rewards: -0.206, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.441', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'AMMO3': '0.059', 'AMMO4': '0.083', 'weapon5': '0.154', 'HITCOUNT': '0.270', 'WEAPON4': '0.300', 'weapon4': '0.316', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'ARMOR': '0.832', 'DAMAGECOUNT': '0.948', 'weapon3': '1.072', 'FRAGCOUNT': '1.500', 'weapon2': '1.578'}
[2023-02-25 12:47:41,204][2409074] Updated weights for policy 0, policy_version 10601 (0.0013)
[2023-02-25 12:47:41,231][2409103] DAMAGECOUNT value on done: 1533.0
[2023-02-25 12:47:41,232][2409103] Sum rewards: -2.315, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.990', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'weapon5': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.132', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'HITCOUNT': '0.440', 'ARMOR': '0.468', 'weapon4': '0.698', 'WEAPON3': '0.850', 'weapon2': '1.110', 'DAMAGECOUNT': '1.380', 'weapon3': '1.898', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:47:41,280][2409486] DAMAGECOUNT value on done: 1037.0
[2023-02-25 12:47:41,281][2409486] Sum rewards: 6.035, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.651', 'weapon5': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.038', 'AMMO3': '0.101', 'WEAPON5': '0.150', 'ARMOR': '0.400', 'HITCOUNT': '0.430', 'WEAPON3': '0.550', 'weapon3': '1.330', 'DAMAGECOUNT': '1.485', 'weapon2': '2.162', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:47:41,304][2409406] DAMAGECOUNT value on done: 1823.0
[2023-02-25 12:47:41,305][2409406] Sum rewards: 1.741, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.373', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.037', 'WEAPON5': '0.050', 'weapon5': '0.096', 'AMMO3': '0.097', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.210', 'weapon4': '0.480', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.630', 'weapon2': '0.830', 'weapon3': '0.940', 'ARMOR': '1.381', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:41,372][2409076] DAMAGECOUNT value on done: 1862.0
[2023-02-25 12:47:41,375][2409076] Sum rewards: 4.817, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'weapon5': '0.116', 'WEAPON4': '0.150', 'weapon4': '0.250', 'HEALTH': '0.454', 'ARMOR': '0.501', 'HITCOUNT': '0.520', 'WEAPON3': '0.650', 'weapon2': '1.452', 'weapon3': '1.684', 'DAMAGECOUNT': '2.235', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:41,763][2409075] DAMAGECOUNT value on done: 1216.0
[2023-02-25 12:47:41,777][2409075] Sum rewards: 1.109, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'HEALTH': '0.072', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'HITCOUNT': '0.220', 'weapon4': '0.376', 'ARMOR': '0.495', 'DAMAGECOUNT': '0.666', 'WEAPON3': '0.700', 'weapon2': '1.392', 'weapon3': '1.520', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:41,826][2409565] DAMAGECOUNT value on done: 1712.0
[2023-02-25 12:47:41,827][2409565] Sum rewards: 0.853, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.230', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO3': '0.088', 'weapon5': '0.092', 'AMMO4': '0.096', 'WEAPON5': '0.200', 'HITCOUNT': '0.210', 'WEAPON4': '0.350', 'WEAPON3': '0.650', 'weapon2': '0.668', 'weapon4': '0.862', 'DAMAGECOUNT': '1.095', 'weapon3': '1.734', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:41,950][2409389] DAMAGECOUNT value on done: 1498.0
[2023-02-25 12:47:41,951][2409389] Sum rewards: 4.164, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO3': '0.030', 'AMMO4': '0.045', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HEALTH': '0.166', 'WEAPON3': '0.200', 'weapon4': '0.224', 'HITCOUNT': '0.330', 'ARMOR': '0.400', 'weapon3': '0.822', 'weapon2': '0.826', 'DAMAGECOUNT': '1.083', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:42,004][2409100] DAMAGECOUNT value on done: 1517.0
[2023-02-25 12:47:42,007][2409100] Sum rewards: 0.900, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.030', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.045', 'WEAPON4': '0.150', 'HITCOUNT': '0.250', 'weapon4': '0.304', 'WEAPON3': '0.350', 'ARMOR': '0.489', 'DAMAGECOUNT': '0.825', 'weapon3': '0.840', 'weapon2': '1.166', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:42,102][2409102] DAMAGECOUNT value on done: 955.0
[2023-02-25 12:47:42,128][2409077] DAMAGECOUNT value on done: 1791.0
[2023-02-25 12:47:42,129][2409077] Sum rewards: 2.428, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.128', 'WEAPON1': '0.020', 'AMMO2': '0.043', 'AMMO3': '0.108', 'WEAPON4': '0.200', 'AMMO4': '0.214', 'HITCOUNT': '0.250', 'ARMOR': '0.456', 'weapon4': '0.478', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.915', 'weapon2': '1.054', 'weapon3': '1.218', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:42,159][2409405] DAMAGECOUNT value on done: 2014.0
[2023-02-25 12:47:42,160][2409405] Sum rewards: -0.756, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.033', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'AMMO2': '0.043', 'weapon5': '0.048', 'AMMO3': '0.051', 'weapon7': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.217', 'HITCOUNT': '0.230', 'WEAPON3': '0.350', 'WEAPON4': '0.400', 'ARMOR': '0.472', 'weapon4': '0.666', 'weapon3': '0.886', 'DAMAGECOUNT': '1.251', 'weapon2': '1.352', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:42,186][2408954] Fps is (10 sec: 25395.3, 60 sec: 25463.5, 300 sec: 25575.7). Total num frames: 43433984. Throughput: 0: 6340.0. Samples: 10859232. Policy #0 lag: (min: 0.0, avg: 9.9, max: 25.0)
[2023-02-25 12:47:42,186][2408954] Avg episode reward: [(0, '1.483')]
[2023-02-25 12:47:42,407][2409597] DAMAGECOUNT value on done: 1134.0
[2023-02-25 12:47:42,408][2409597] Sum rewards: -0.987, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.582', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.040', 'weapon5': '0.058', 'AMMO4': '0.078', 'AMMO3': '0.092', 'HITCOUNT': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.154', 'DAMAGECOUNT': '0.396', 'WEAPON3': '0.500', 'ARMOR': '0.851', 'weapon3': '0.960', 'weapon2': '1.512', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:42,430][2409549] DAMAGECOUNT value on done: 1693.0
[2023-02-25 12:47:42,430][2409549] Sum rewards: 3.955, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.119', 'AMMO2': '0.024', 'AMMO3': '0.046', 'weapon7': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.118', 'WEAPON4': '0.200', 'WEAPON3': '0.300', 'HITCOUNT': '0.360', 'ARMOR': '0.400', 'weapon4': '0.658', 'weapon3': '0.824', 'DAMAGECOUNT': '1.104', 'weapon2': '1.180', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:42,546][2409097] DAMAGECOUNT value on done: 2022.0
[2023-02-25 12:47:42,549][2409097] Sum rewards: 5.043, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.802', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon5': '0.078', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'AMMO4': '0.161', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.246', 'WEAPON5': '0.250', 'ARMOR': '0.474', 'HITCOUNT': '0.560', 'WEAPON3': '0.600', 'weapon3': '1.602', 'weapon2': '1.768', 'DAMAGECOUNT': '2.463', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:47:42,699][2409866] DAMAGECOUNT value on done: 887.0
[2023-02-25 12:47:42,701][2409866] Sum rewards: 1.730, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.347', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON1': '0.040', 'AMMO3': '0.060', 'AMMO4': '0.079', 'weapon5': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'HITCOUNT': '0.280', 'WEAPON3': '0.450', 'ARMOR': '0.472', 'weapon4': '0.594', 'weapon2': '0.736', 'DAMAGECOUNT': '0.960', 'weapon3': '1.252', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:42,760][2409596] DAMAGECOUNT value on done: 1338.0
[2023-02-25 12:47:42,761][2409596] Sum rewards: 2.028, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.242', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.017', 'WEAPON1': '0.060', 'AMMO3': '0.108', 'weapon5': '0.156', 'HITCOUNT': '0.350', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.209', 'weapon2': '1.234', 'weapon3': '1.730', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:43,231][2409469] DAMAGECOUNT value on done: 1668.0
[2023-02-25 12:47:43,232][2409469] Sum rewards: 1.318, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.886', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'WEAPON1': '0.030', 'AMMO3': '0.054', 'WEAPON4': '0.150', 'HITCOUNT': '0.270', 'weapon4': '0.336', 'WEAPON3': '0.400', 'ARMOR': '0.508', 'weapon3': '0.788', 'DAMAGECOUNT': '0.870', 'weapon2': '1.312', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:43,270][2409355] DAMAGECOUNT value on done: 1941.0
[2023-02-25 12:47:43,271][2409355] Sum rewards: 8.467, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.532', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.055', 'WEAPON4': '0.150', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.456', 'HITCOUNT': '0.650', 'weapon3': '1.128', 'weapon2': '1.326', 'DAMAGECOUNT': '2.760', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:47:43,406][2409373] DAMAGECOUNT value on done: 1377.0
[2023-02-25 12:47:43,407][2409373] Sum rewards: 3.086, reward structure: {'DEATHCOUNT': '-0.750', 'AMMO2': '0.005', 'AMMO3': '0.010', 'AMMO4': '0.025', 'HITCOUNT': '0.030', 'WEAPON4': '0.050', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON3': '0.100', 'weapon4': '0.194', 'weapon3': '0.234', 'HEALTH': '0.252', 'weapon2': '0.432', 'ARMOR': '0.536', 'DAMAGECOUNT': '0.600', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:47:43,513][2409074] Updated weights for policy 0, policy_version 10611 (0.0012)
[2023-02-25 12:47:44,118][2409104] DAMAGECOUNT value on done: 920.0
[2023-02-25 12:47:44,119][2409104] Sum rewards: -0.826, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.862', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'weapon5': '0.060', 'weapon7': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.218', 'DAMAGECOUNT': '0.231', 'WEAPON3': '0.350', 'ARMOR': '0.440', 'weapon2': '0.572', 'weapon3': '0.812'}
[2023-02-25 12:47:44,318][2409096] DAMAGECOUNT value on done: 1112.0
[2023-02-25 12:47:44,319][2409096] Sum rewards: 2.317, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.423', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.064', 'WEAPON4': '0.100', 'weapon4': '0.212', 'HITCOUNT': '0.250', 'WEAPON3': '0.400', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.777', 'weapon3': '1.254', 'weapon2': '1.466', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:44,320][2409548] DAMAGECOUNT value on done: 1534.0
[2023-02-25 12:47:44,322][2409548] Sum rewards: 0.242, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.770', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO3': '0.102', 'AMMO4': '0.115', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.350', 'weapon4': '0.412', 'ARMOR': '0.429', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.107', 'weapon2': '1.382', 'weapon3': '1.426', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:44,345][2409078] DAMAGECOUNT value on done: 1648.0
[2023-02-25 12:47:44,348][2409078] Sum rewards: 3.252, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.616', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.138', 'weapon4': '0.194', 'HITCOUNT': '0.380', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.359', 'weapon2': '1.506', 'weapon3': '1.698', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:44,360][2409105] DAMAGECOUNT value on done: 1448.0
[2023-02-25 12:47:44,361][2409105] Sum rewards: 2.680, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.566', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon5': '0.072', 'weapon7': '0.078', 'AMMO3': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.136', 'WEAPON4': '0.200', 'HITCOUNT': '0.340', 'weapon4': '0.556', 'WEAPON3': '0.600', 'ARMOR': '0.859', 'weapon2': '0.986', 'weapon3': '1.416', 'DAMAGECOUNT': '1.473', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:44,541][2409079] DAMAGECOUNT value on done: 2061.0
[2023-02-25 12:47:44,541][2409079] Sum rewards: 2.160, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.360', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.048', 'AMMO3': '0.054', 'weapon5': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.350', 'WEAPON4': '0.350', 'HITCOUNT': '0.350', 'weapon4': '0.458', 'weapon3': '0.804', 'ARMOR': '0.902', 'weapon2': '1.732', 'DAMAGECOUNT': '1.827', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:44,681][2409485] DAMAGECOUNT value on done: 1273.0
[2023-02-25 12:47:44,684][2409485] Sum rewards: 1.217, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.478', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.032', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO3': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'weapon4': '0.198', 'HITCOUNT': '0.280', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.942', 'weapon2': '1.278', 'weapon3': '1.626', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:44,712][2409074] Updated weights for policy 0, policy_version 10621 (0.0013)
[2023-02-25 12:47:44,748][2409101] DAMAGECOUNT value on done: 1925.0
[2023-02-25 12:47:44,749][2409101] Sum rewards: 0.364, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.528', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON1': '0.040', 'AMMO3': '0.060', 'weapon7': '0.086', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.170', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.370', 'ARMOR': '0.400', 'weapon4': '0.440', 'WEAPON3': '0.500', 'weapon2': '1.026', 'weapon3': '1.410', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.746'}
[2023-02-25 12:47:44,800][2409407] DAMAGECOUNT value on done: 1636.0
[2023-02-25 12:47:44,801][2409407] Sum rewards: 0.184, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.599', 'AMMO2': '0.003', 'AMMO4': '0.014', 'WEAPON1': '0.030', 'weapon7': '0.072', 'AMMO3': '0.106', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'HITCOUNT': '0.310', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.032', 'weapon2': '1.710', 'weapon3': '1.736'}
[2023-02-25 12:47:44,889][2409406] DAMAGECOUNT value on done: 2014.0
[2023-02-25 12:47:44,892][2409406] Sum rewards: 2.632, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.351', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'AMMO3': '0.059', 'weapon5': '0.114', 'HITCOUNT': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.432', 'WEAPON3': '0.450', 'ARMOR': '0.973', 'weapon3': '0.998', 'weapon2': '1.004', 'DAMAGECOUNT': '1.140', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:44,959][2409076] DAMAGECOUNT value on done: 1321.0
[2023-02-25 12:47:44,970][2409076] Sum rewards: 1.541, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.322', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.012', 'weapon5': '0.014', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'weapon4': '0.320', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'ARMOR': '0.945', 'weapon2': '1.304', 'weapon3': '1.396', 'DAMAGECOUNT': '1.518', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:45,021][2409103] DAMAGECOUNT value on done: 1895.0
[2023-02-25 12:47:45,022][2409103] Sum rewards: 0.224, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.846', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.026', 'AMMO4': '0.027', 'AMMO3': '0.046', 'weapon4': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'HITCOUNT': '0.320', 'WEAPON3': '0.350', 'weapon3': '0.810', 'ARMOR': '0.854', 'DAMAGECOUNT': '1.134', 'FRAGCOUNT': '1.500', 'weapon2': '1.846'}
[2023-02-25 12:47:45,427][2409099] DAMAGECOUNT value on done: 1645.0
[2023-02-25 12:47:45,623][2409100] DAMAGECOUNT value on done: 1725.0
[2023-02-25 12:47:45,626][2409100] Sum rewards: 3.551, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.148', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.044', 'WEAPON1': '0.050', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'HITCOUNT': '0.350', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.080', 'weapon3': '1.562', 'weapon2': '1.818', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:45,709][2409077] DAMAGECOUNT value on done: 1014.0
[2023-02-25 12:47:45,766][2409405] DAMAGECOUNT value on done: 1943.0
[2023-02-25 12:47:45,771][2409405] Sum rewards: 5.654, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.033', 'AMMO5': '0.003', 'weapon7': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'weapon5': '0.048', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.148', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON3': '0.300', 'HITCOUNT': '0.340', 'weapon4': '0.394', 'ARMOR': '0.455', 'weapon3': '1.120', 'weapon2': '1.834', 'DAMAGECOUNT': '1.836', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:47:45,827][2409486] DAMAGECOUNT value on done: 1319.0
[2023-02-25 12:47:45,830][2409486] Sum rewards: -1.382, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.110', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon7': '0.048', 'AMMO3': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'HITCOUNT': '0.350', 'weapon4': '0.390', 'ARMOR': '0.420', 'WEAPON3': '0.500', 'FRAGCOUNT': '0.500', 'weapon3': '1.010', 'weapon2': '1.394', 'DAMAGECOUNT': '1.428'}
[2023-02-25 12:47:45,952][2409549] DAMAGECOUNT value on done: 1688.0
[2023-02-25 12:47:45,952][2409549] Sum rewards: -2.548, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.446', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.054', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'weapon4': '0.180', 'HITCOUNT': '0.240', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'ARMOR': '0.943', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.248', 'weapon3': '1.348', 'weapon2': '1.672'}
[2023-02-25 12:47:46,063][2409597] DAMAGECOUNT value on done: 2018.0
[2023-02-25 12:47:46,066][2409597] Sum rewards: 2.805, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'AMMO2': '0.024', 'HEALTH': '0.026', 'WEAPON1': '0.030', 'AMMO3': '0.074', 'weapon4': '0.076', 'weapon5': '0.086', 'WEAPON4': '0.100', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'WEAPON3': '0.450', 'HITCOUNT': '0.580', 'ARMOR': '0.808', 'weapon3': '1.416', 'weapon2': '1.758', 'DAMAGECOUNT': '1.848', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:46,112][2409565] DAMAGECOUNT value on done: 2438.0
[2023-02-25 12:47:46,115][2409565] Sum rewards: 1.110, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.276', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'weapon5': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'weapon4': '0.192', 'HITCOUNT': '0.420', 'WEAPON3': '0.700', 'ARMOR': '1.344', 'DAMAGECOUNT': '1.437', 'weapon3': '1.688', 'weapon2': '1.848', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:46,298][2409075] DAMAGECOUNT value on done: 1452.0
[2023-02-25 12:47:46,300][2409866] DAMAGECOUNT value on done: 1659.0
[2023-02-25 12:47:46,301][2409866] Sum rewards: 2.715, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.310', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'ARMOR': '0.020', 'AMMO4': '0.037', 'AMMO3': '0.049', 'WEAPON5': '0.050', 'weapon5': '0.072', 'WEAPON4': '0.100', 'weapon4': '0.180', 'HITCOUNT': '0.250', 'WEAPON3': '0.300', 'weapon3': '0.768', 'DAMAGECOUNT': '0.795', 'weapon2': '1.384', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:46,301][2409075] Sum rewards: -3.116, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.480', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.028', 'WEAPON1': '0.030', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'weapon7': '0.120', 'HITCOUNT': '0.180', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.450', 'weapon4': '0.482', 'DAMAGECOUNT': '0.870', 'ARMOR': '0.872', 'weapon3': '0.976', 'FRAGCOUNT': '1.000', 'weapon2': '1.234'}
[2023-02-25 12:47:46,357][2409102] DAMAGECOUNT value on done: 2240.0
[2023-02-25 12:47:46,358][2409102] Sum rewards: 7.810, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.178', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON1': '0.040', 'AMMO3': '0.065', 'AMMO4': '0.069', 'weapon5': '0.078', 'weapon4': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.720', 'weapon3': '1.404', 'weapon2': '1.552', 'DAMAGECOUNT': '2.676', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:47:46,423][2409596] DAMAGECOUNT value on done: 1658.0
[2023-02-25 12:47:46,424][2409596] Sum rewards: 1.641, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.775', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'HITCOUNT': '0.520', 'WEAPON3': '0.800', 'weapon2': '1.826', 'DAMAGECOUNT': '1.839', 'weapon3': '1.890', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:47:46,425][2409389] DAMAGECOUNT value on done: 1706.0
[2023-02-25 12:47:46,428][2409389] Sum rewards: 3.958, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.724', 'AMMO5': '0.003', 'AMMO2': '0.029', 'WEAPON1': '0.050', 'weapon7': '0.054', 'weapon5': '0.060', 'weapon4': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'HITCOUNT': '0.280', 'ARMOR': '0.420', 'WEAPON3': '0.750', 'weapon2': '1.448', 'weapon3': '1.474', 'DAMAGECOUNT': '1.479', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:47:46,669][2409074] Updated weights for policy 0, policy_version 10631 (0.0012)
[2023-02-25 12:47:46,762][2409097] DAMAGECOUNT value on done: 1084.0
[2023-02-25 12:47:46,882][2409355] DAMAGECOUNT value on done: 1966.0
[2023-02-25 12:47:46,883][2409355] Sum rewards: -1.975, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.306', 'AMMO5': '0.017', 'AMMO2': '0.033', 'WEAPON1': '0.040', 'weapon5': '0.108', 'AMMO3': '0.113', 'AMMO4': '0.166', 'WEAPON4': '0.300', 'HITCOUNT': '0.340', 'weapon4': '0.366', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'ARMOR': '0.926', 'weapon3': '1.498', 'DAMAGECOUNT': '1.623', 'weapon2': '1.650', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:47:47,165][2409100] Large shaping reward 2.578 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.546, 182.0), ('weapon7', 0.002)]
[2023-02-25 12:47:47,186][2408954] Fps is (10 sec: 24167.4, 60 sec: 25395.2, 300 sec: 25561.8). Total num frames: 43560960. Throughput: 0: 6333.6. Samples: 10897296. Policy #0 lag: (min: 2.0, avg: 12.6, max: 29.0)
[2023-02-25 12:47:47,186][2408954] Avg episode reward: [(0, '1.287')]
[2023-02-25 12:47:47,304][2409373] DAMAGECOUNT value on done: 1716.0
[2023-02-25 12:47:47,307][2409373] Sum rewards: 1.878, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.530', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'WEAPON3': '0.400', 'ARMOR': '0.400', 'weapon4': '0.420', 'HITCOUNT': '0.430', 'weapon3': '1.128', 'weapon2': '1.202', 'DAMAGECOUNT': '1.911', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:47,569][2409469] DAMAGECOUNT value on done: 2332.0
[2023-02-25 12:47:47,570][2409469] Sum rewards: -0.059, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.108', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.048', 'AMMO3': '0.056', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.284', 'HITCOUNT': '0.400', 'WEAPON3': '0.450', 'ARMOR': '0.454', 'FRAGCOUNT': '1.000', 'weapon3': '1.070', 'DAMAGECOUNT': '1.212', 'weapon2': '1.710'}
[2023-02-25 12:47:47,806][2409104] DAMAGECOUNT value on done: 1899.0
[2023-02-25 12:47:47,807][2409104] Sum rewards: 2.697, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.140', 'AMMO4': '-0.076', 'AMMO2': '-0.015', 'AMMO5': '0.005', 'AMMO3': '0.046', 'WEAPON5': '0.100', 'WEAPON3': '0.400', 'HITCOUNT': '0.430', 'ARMOR': '0.473', 'weapon3': '0.816', 'weapon2': '1.218', 'DAMAGECOUNT': '1.440', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:47,907][2409548] DAMAGECOUNT value on done: 1483.0
[2023-02-25 12:47:47,907][2409548] Sum rewards: 1.487, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.632', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.084', 'WEAPON5': '0.100', 'weapon4': '0.192', 'HITCOUNT': '0.370', 'ARMOR': '0.470', 'WEAPON3': '0.500', 'weapon3': '1.256', 'weapon2': '1.328', 'DAMAGECOUNT': '1.479', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:47,972][2409078] DAMAGECOUNT value on done: 1452.0
[2023-02-25 12:47:48,169][2409074] Updated weights for policy 0, policy_version 10641 (0.0012)
[2023-02-25 12:47:48,236][2409105] DAMAGECOUNT value on done: 1992.0
[2023-02-25 12:47:48,237][2409105] Sum rewards: 9.693, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.566', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.054', 'WEAPON4': '0.150', 'weapon4': '0.316', 'WEAPON3': '0.350', 'HITCOUNT': '0.630', 'ARMOR': '0.855', 'weapon3': '0.932', 'weapon2': '1.550', 'DAMAGECOUNT': '2.049', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:47:48,240][2409485] DAMAGECOUNT value on done: 1604.0
[2023-02-25 12:47:48,241][2409485] Sum rewards: 0.211, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.090', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO4': '0.031', 'ARMOR': '0.050', 'weapon5': '0.066', 'AMMO3': '0.068', 'WEAPON5': '0.150', 'HITCOUNT': '0.180', 'WEAPON4': '0.300', 'weapon4': '0.440', 'WEAPON3': '0.550', 'weapon3': '1.286', 'DAMAGECOUNT': '1.434', 'weapon2': '1.452', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:48,353][2409101] DAMAGECOUNT value on done: 1598.0
[2023-02-25 12:47:48,354][2409101] Sum rewards: 1.610, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.812', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'weapon5': '0.046', 'AMMO3': '0.060', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'HITCOUNT': '0.170', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.476', 'DAMAGECOUNT': '0.927', 'weapon3': '0.982', 'weapon2': '1.188', 'ARMOR': '1.570', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:48,399][2409406] DAMAGECOUNT value on done: 1158.0
[2023-02-25 12:47:48,400][2409406] Sum rewards: 2.554, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.120', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.040', 'AMMO4': '0.052', 'weapon5': '0.058', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'HITCOUNT': '0.300', 'weapon4': '0.428', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.894', 'weapon2': '1.396', 'weapon3': '1.590', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:48,483][2409079] DAMAGECOUNT value on done: 1069.0
[2023-02-25 12:47:48,487][2409079] Sum rewards: 1.078, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.883', 'AMMO5': '0.018', 'AMMO2': '0.046', 'WEAPON1': '0.050', 'weapon5': '0.056', 'AMMO3': '0.136', 'weapon4': '0.212', 'AMMO4': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'HITCOUNT': '0.360', 'WEAPON3': '0.850', 'ARMOR': '0.868', 'DAMAGECOUNT': '1.149', 'weapon3': '1.492', 'weapon2': '1.894', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:48,618][2409103] DAMAGECOUNT value on done: 2319.0
[2023-02-25 12:47:48,621][2409103] Sum rewards: 2.314, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.334', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.120', 'WEAPON4': '0.350', 'weapon4': '0.424', 'HITCOUNT': '0.630', 'WEAPON3': '0.750', 'weapon2': '1.328', 'weapon3': '1.404', 'DAMAGECOUNT': '2.031', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:48,697][2409407] DAMAGECOUNT value on done: 1889.0
[2023-02-25 12:47:48,698][2409407] Sum rewards: 0.826, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.652', 'AMMO4': '-0.048', 'AMMO2': '-0.010', 'AMMO5': '0.009', 'weapon7': '0.010', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.154', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.320', 'HITCOUNT': '0.500', 'WEAPON3': '0.800', 'ARMOR': '0.934', 'weapon3': '1.560', 'weapon2': '1.566', 'DAMAGECOUNT': '2.562', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:47:48,725][2409096] DAMAGECOUNT value on done: 1763.0
[2023-02-25 12:47:48,728][2409096] Sum rewards: 6.294, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.509', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'AMMO3': '0.098', 'weapon5': '0.130', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'WEAPON4': '0.200', 'weapon4': '0.316', 'ARMOR': '0.457', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'weapon2': '1.298', 'weapon3': '1.818', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:47:49,058][2409076] DAMAGECOUNT value on done: 2170.0
[2023-02-25 12:47:49,060][2409076] Sum rewards: 4.687, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.000', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO5': '0.003', 'WEAPON1': '0.040', 'weapon5': '0.050', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.140', 'ARMOR': '0.455', 'HITCOUNT': '0.620', 'WEAPON3': '0.650', 'weapon3': '1.468', 'weapon2': '1.702', 'DAMAGECOUNT': '2.328', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:47:49,231][2409099] DAMAGECOUNT value on done: 1590.0
[2023-02-25 12:47:49,234][2409099] Sum rewards: -1.039, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.050', 'AMMO2': '0.006', 'AMMO5': '0.015', 'weapon5': '0.016', 'ARMOR': '0.028', 'AMMO4': '0.028', 'WEAPON1': '0.040', 'AMMO3': '0.100', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'HITCOUNT': '0.430', 'weapon4': '0.518', 'WEAPON3': '0.650', 'weapon2': '1.070', 'weapon3': '1.178', 'DAMAGECOUNT': '1.632', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:49,328][2409077] DAMAGECOUNT value on done: 1771.0
[2023-02-25 12:47:49,331][2409077] Sum rewards: 1.101, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.255', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon7': '0.046', 'weapon5': '0.050', 'AMMO3': '0.071', 'AMMO4': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.400', 'ARMOR': '0.436', 'WEAPON3': '0.450', 'weapon4': '0.460', 'weapon2': '1.050', 'weapon3': '1.248', 'DAMAGECOUNT': '1.635', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:49,621][2409486] DAMAGECOUNT value on done: 1695.0
[2023-02-25 12:47:49,622][2409486] Sum rewards: 2.039, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.022', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.020', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.050', 'AMMO3': '0.066', 'weapon4': '0.120', 'HITCOUNT': '0.230', 'WEAPON3': '0.500', 'ARMOR': '0.855', 'weapon3': '1.128', 'DAMAGECOUNT': '1.245', 'weapon2': '1.710', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:49,646][2409100] DAMAGECOUNT value on done: 1527.0
[2023-02-25 12:47:49,647][2409100] Sum rewards: 1.550, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.540', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.014', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'weapon4': '0.108', 'AMMO3': '0.138', 'WEAPON5': '0.200', 'HITCOUNT': '0.420', 'ARMOR': '0.421', 'WEAPON3': '0.800', 'weapon2': '1.070', 'DAMAGECOUNT': '1.704', 'weapon3': '2.330', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:49,805][2409074] Updated weights for policy 0, policy_version 10651 (0.0013)
[2023-02-25 12:47:49,816][2409405] DAMAGECOUNT value on done: 1896.0
[2023-02-25 12:47:49,819][2409405] Sum rewards: 2.359, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.177', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.072', 'weapon4': '0.090', 'WEAPON5': '0.100', 'HITCOUNT': '0.240', 'WEAPON3': '0.350', 'weapon3': '0.742', 'DAMAGECOUNT': '0.870', 'weapon2': '0.952', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:49,870][2409866] DAMAGECOUNT value on done: 1941.0
[2023-02-25 12:47:49,870][2409866] Sum rewards: 3.267, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.774', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.022', 'AMMO2': '0.026', 'AMMO3': '0.056', 'ARMOR': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'weapon7': '0.148', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.330', 'WEAPON3': '0.350', 'weapon3': '0.664', 'weapon4': '0.756', 'weapon2': '0.948', 'DAMAGECOUNT': '1.626', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:49,901][2409565] DAMAGECOUNT value on done: 1553.0
[2023-02-25 12:47:49,904][2409565] Sum rewards: 2.359, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.099', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.057', 'WEAPON5': '0.100', 'weapon5': '0.106', 'WEAPON4': '0.200', 'weapon4': '0.210', 'HITCOUNT': '0.280', 'WEAPON3': '0.450', 'weapon3': '0.880', 'ARMOR': '0.894', 'DAMAGECOUNT': '0.987', 'weapon2': '1.016', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:49,942][2409549] DAMAGECOUNT value on done: 2050.0
[2023-02-25 12:47:49,943][2409549] Sum rewards: 4.583, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.704', 'AMMO5': '0.009', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'AMMO3': '0.056', 'weapon7': '0.066', 'AMMO4': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.132', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.410', 'WEAPON3': '0.450', 'weapon4': '0.454', 'weapon3': '1.098', 'weapon2': '1.486', 'DAMAGECOUNT': '2.187', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:47:50,029][2409075] DAMAGECOUNT value on done: 1310.0
[2023-02-25 12:47:50,037][2409075] Sum rewards: 2.620, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.633', 'AMMO5': '0.011', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'weapon5': '0.072', 'AMMO4': '0.078', 'AMMO3': '0.084', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.314', 'HITCOUNT': '0.390', 'WEAPON3': '0.550', 'weapon2': '0.970', 'DAMAGECOUNT': '1.530', 'weapon3': '1.758', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:50,093][2409597] DAMAGECOUNT value on done: 1431.0
[2023-02-25 12:47:50,094][2409597] Sum rewards: 2.170, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.286', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO4': '0.039', 'weapon5': '0.042', 'weapon4': '0.086', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'ARMOR': '0.424', 'HITCOUNT': '0.540', 'WEAPON3': '0.750', 'weapon2': '1.404', 'weapon3': '1.522', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.160'}
[2023-02-25 12:47:50,107][2409102] DAMAGECOUNT value on done: 1525.0
[2023-02-25 12:47:50,107][2409102] Sum rewards: 4.212, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.470', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'AMMO3': '0.052', 'HITCOUNT': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.300', 'weapon4': '0.450', 'DAMAGECOUNT': '0.462', 'weapon2': '0.800', 'weapon3': '1.192', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:50,207][2409596] DAMAGECOUNT value on done: 2247.0
[2023-02-25 12:47:50,208][2409596] Sum rewards: 2.795, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.327', 'AMMO5': '0.008', 'AMMO2': '0.011', 'AMMO3': '0.050', 'WEAPON1': '0.050', 'AMMO4': '0.055', 'weapon4': '0.060', 'weapon5': '0.094', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.250', 'WEAPON3': '0.400', 'ARMOR': '0.832', 'weapon3': '1.052', 'DAMAGECOUNT': '1.800', 'weapon2': '2.110', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:50,210][2409389] DAMAGECOUNT value on done: 1659.0
[2023-02-25 12:47:50,213][2409389] Sum rewards: 4.174, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.684', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO3': '0.040', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.055', 'weapon5': '0.066', 'WEAPON5': '0.100', 'weapon4': '0.286', 'HITCOUNT': '0.320', 'WEAPON3': '0.350', 'weapon3': '0.944', 'DAMAGECOUNT': '1.077', 'weapon2': '2.016', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:50,453][2409355] DAMAGECOUNT value on done: 1529.0
[2023-02-25 12:47:50,454][2409355] Sum rewards: 4.540, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.440', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.054', 'AMMO3': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.390', 'weapon4': '0.432', 'WEAPON3': '0.600', 'ARMOR': '0.960', 'weapon2': '1.050', 'weapon3': '1.282', 'DAMAGECOUNT': '1.314', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:51,056][2409373] DAMAGECOUNT value on done: 2065.0
[2023-02-25 12:47:51,059][2409373] Sum rewards: 2.074, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.705', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.206', 'HITCOUNT': '0.380', 'WEAPON3': '0.400', 'ARMOR': '0.490', 'weapon3': '0.840', 'weapon2': '1.094', 'DAMAGECOUNT': '1.395', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:51,075][2409097] DAMAGECOUNT value on done: 2202.0
[2023-02-25 12:47:51,076][2409097] Sum rewards: 1.387, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.540', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.009', 'WEAPON1': '0.020', 'weapon5': '0.072', 'AMMO3': '0.119', 'WEAPON5': '0.150', 'HITCOUNT': '0.460', 'WEAPON3': '0.750', 'weapon2': '1.428', 'weapon3': '1.580', 'DAMAGECOUNT': '1.830', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:51,242][2409074] Updated weights for policy 0, policy_version 10661 (0.0012)
[2023-02-25 12:47:51,396][2409469] DAMAGECOUNT value on done: 1720.0
[2023-02-25 12:47:51,397][2409469] Sum rewards: 3.840, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.564', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.027', 'WEAPON1': '0.040', 'weapon7': '0.076', 'weapon5': '0.080', 'AMMO3': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.510', 'WEAPON3': '0.550', 'weapon4': '0.776', 'weapon2': '0.938', 'weapon3': '1.478', 'DAMAGECOUNT': '1.545', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:51,611][2409104] DAMAGECOUNT value on done: 2000.0
[2023-02-25 12:47:51,613][2409104] Sum rewards: 0.265, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.151', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'AMMO3': '0.090', 'AMMO4': '0.124', 'HITCOUNT': '0.320', 'WEAPON4': '0.400', 'weapon4': '0.414', 'WEAPON3': '0.550', 'ARMOR': '0.860', 'DAMAGECOUNT': '1.125', 'weapon3': '1.446', 'weapon2': '1.552', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:51,850][2409485] DAMAGECOUNT value on done: 1555.0
[2023-02-25 12:47:51,851][2409485] Sum rewards: 0.879, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.244', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.030', 'AMMO3': '0.079', 'AMMO4': '0.096', 'WEAPON5': '0.150', 'HITCOUNT': '0.350', 'WEAPON4': '0.350', 'ARMOR': '0.428', 'weapon4': '0.542', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.056', 'weapon3': '1.068', 'weapon2': '1.874', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:52,009][2409406] DAMAGECOUNT value on done: 1595.0
[2023-02-25 12:47:52,026][2409406] Sum rewards: 0.618, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.664', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON1': '0.040', 'weapon5': '0.110', 'AMMO3': '0.125', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.258', 'HITCOUNT': '0.320', 'WEAPON3': '0.750', 'ARMOR': '0.812', 'DAMAGECOUNT': '1.059', 'weapon2': '1.480', 'weapon3': '1.862', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:52,036][2409105] DAMAGECOUNT value on done: 1792.0
[2023-02-25 12:47:52,037][2409105] Sum rewards: 0.213, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.834', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.015', 'ARMOR': '0.030', 'weapon5': '0.070', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.200', 'weapon4': '0.212', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.621', 'weapon2': '1.748', 'weapon3': '1.800', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:52,056][2409079] DAMAGECOUNT value on done: 1425.0
[2023-02-25 12:47:52,057][2409079] Sum rewards: 2.705, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.465', 'AMMO2': '0.005', 'AMMO4': '0.022', 'ARMOR': '0.036', 'AMMO3': '0.074', 'WEAPON4': '0.200', 'HITCOUNT': '0.280', 'weapon4': '0.296', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.825', 'weapon2': '1.014', 'weapon3': '1.468', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:52,127][2409548] DAMAGECOUNT value on done: 1634.0
[2023-02-25 12:47:52,127][2409548] Sum rewards: 4.052, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.031', 'AMMO5': '0.010', 'ARMOR': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'WEAPON4': '0.050', 'weapon5': '0.060', 'AMMO3': '0.086', 'AMMO4': '0.167', 'weapon4': '0.202', 'WEAPON5': '0.250', 'HITCOUNT': '0.510', 'WEAPON3': '0.550', 'weapon2': '1.366', 'weapon3': '1.522', 'DAMAGECOUNT': '1.737', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:47:52,170][2409103] DAMAGECOUNT value on done: 2317.0
[2023-02-25 12:47:52,174][2409103] Sum rewards: 3.309, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.080', 'AMMO2': '0.027', 'AMMO3': '0.053', 'weapon7': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.134', 'WEAPON7': '0.200', 'HITCOUNT': '0.290', 'WEAPON3': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.452', 'ARMOR': '0.456', 'weapon3': '0.618', 'DAMAGECOUNT': '1.017', 'weapon2': '1.084', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:47:52,186][2408954] Fps is (10 sec: 24985.6, 60 sec: 25326.9, 300 sec: 25534.0). Total num frames: 43683840. Throughput: 0: 6312.3. Samples: 10915740. Policy #0 lag: (min: 2.0, avg: 12.6, max: 29.0)
[2023-02-25 12:47:52,186][2408954] Avg episode reward: [(0, '1.555')]
[2023-02-25 12:47:52,206][2409033] Saving new best policy, reward=1.555!
[2023-02-25 12:47:52,241][2409407] DAMAGECOUNT value on done: 1697.0
[2023-02-25 12:47:52,242][2409407] Sum rewards: 4.800, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.860', 'AMMO2': '0.003', 'AMMO4': '0.017', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.316', 'weapon5': '0.392', 'WEAPON5': '0.400', 'HITCOUNT': '0.410', 'WEAPON3': '0.500', 'ARMOR': '0.953', 'weapon2': '1.276', 'weapon3': '1.338', 'DAMAGECOUNT': '1.854', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:52,304][2409096] DAMAGECOUNT value on done: 1501.0
[2023-02-25 12:47:52,308][2409096] Sum rewards: -0.460, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.414', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'ARMOR': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.088', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'weapon4': '0.246', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.534', 'FRAGCOUNT': '1.000', 'weapon3': '1.212', 'weapon2': '1.814'}
[2023-02-25 12:47:52,522][2409078] DAMAGECOUNT value on done: 1474.0
[2023-02-25 12:47:52,523][2409078] Sum rewards: 1.848, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'AMMO4': '0.167', 'weapon5': '0.192', 'weapon4': '0.388', 'HITCOUNT': '0.390', 'WEAPON3': '0.450', 'HEALTH': '0.480', 'FRAGCOUNT': '1.000', 'weapon2': '1.240', 'DAMAGECOUNT': '1.242', 'weapon3': '1.262'}
[2023-02-25 12:47:52,545][2409101] DAMAGECOUNT value on done: 1721.0
[2023-02-25 12:47:52,546][2409101] Sum rewards: 2.688, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.544', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.026', 'WEAPON5': '0.050', 'weapon7': '0.066', 'AMMO3': '0.077', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.310', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.948', 'weapon3': '1.454', 'weapon2': '1.558', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:52,617][2409076] DAMAGECOUNT value on done: 1899.0
[2023-02-25 12:47:52,618][2409076] Sum rewards: 0.842, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.970', 'AMMO2': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.048', 'AMMO3': '0.088', 'WEAPON4': '0.150', 'HITCOUNT': '0.260', 'weapon4': '0.312', 'ARMOR': '0.500', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.726', 'weapon2': '1.180', 'weapon3': '1.608', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:52,701][2409074] Updated weights for policy 0, policy_version 10671 (0.0012)
[2023-02-25 12:47:52,828][2409077] DAMAGECOUNT value on done: 2285.0
[2023-02-25 12:47:52,832][2409077] Sum rewards: 3.755, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.432', 'AMMO5': '0.009', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'weapon5': '0.036', 'AMMO3': '0.057', 'AMMO4': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.106', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.190', 'weapon4': '0.278', 'WEAPON3': '0.400', 'ARMOR': '0.404', 'weapon3': '0.874', 'weapon2': '1.248', 'DAMAGECOUNT': '1.335', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:53,181][2409099] DAMAGECOUNT value on done: 2046.0
[2023-02-25 12:47:53,184][2409099] Sum rewards: 3.587, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.496', 'AMMO5': '0.004', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'weapon5': '0.032', 'AMMO4': '0.039', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'WEAPON4': '0.250', 'weapon4': '0.430', 'HITCOUNT': '0.490', 'WEAPON3': '0.800', 'ARMOR': '0.800', 'weapon2': '1.412', 'DAMAGECOUNT': '1.497', 'weapon3': '1.594', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:47:53,439][2409565] DAMAGECOUNT value on done: 1510.0
[2023-02-25 12:47:53,444][2409565] Sum rewards: -0.560, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.516', 'AMMO5': '0.010', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'AMMO3': '0.071', 'weapon5': '0.116', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.240', 'weapon4': '0.380', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.747', 'ARMOR': '1.307', 'weapon3': '1.512', 'weapon2': '1.594', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:53,475][2409866] DAMAGECOUNT value on done: 1574.0
[2023-02-25 12:47:53,478][2409866] Sum rewards: 0.227, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.805', 'AMMO5': '0.003', 'weapon5': '0.006', 'ARMOR': '0.020', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.076', 'AMMO4': '0.140', 'WEAPON4': '0.250', 'HITCOUNT': '0.340', 'weapon4': '0.374', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.143', 'weapon2': '1.286', 'weapon3': '1.526', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:53,559][2409486] DAMAGECOUNT value on done: 1907.0
[2023-02-25 12:47:53,562][2409486] Sum rewards: 4.380, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.264', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.060', 'AMMO4': '0.060', 'AMMO3': '0.061', 'weapon4': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.370', 'WEAPON3': '0.450', 'ARMOR': '0.840', 'weapon3': '1.468', 'DAMAGECOUNT': '1.887', 'weapon2': '1.924', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:53,639][2409102] DAMAGECOUNT value on done: 2434.0
[2023-02-25 12:47:53,640][2409102] Sum rewards: 5.473, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.452', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon5': '0.062', 'ARMOR': '0.068', 'AMMO4': '0.075', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.324', 'HITCOUNT': '0.340', 'WEAPON3': '0.600', 'weapon2': '1.524', 'weapon3': '1.544', 'DAMAGECOUNT': '1.722', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:47:53,684][2409597] DAMAGECOUNT value on done: 1943.0
[2023-02-25 12:47:53,685][2409597] Sum rewards: 0.001, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.410', 'AMMO2': '0.001', 'AMMO4': '0.004', 'WEAPON1': '0.010', 'AMMO3': '0.064', 'weapon7': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.220', 'weapon4': '0.280', 'WEAPON3': '0.450', 'ARMOR': '0.495', 'DAMAGECOUNT': '0.951', 'weapon2': '1.016', 'weapon3': '1.186', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:53,827][2409596] DAMAGECOUNT value on done: 2322.0
[2023-02-25 12:47:53,830][2409596] Sum rewards: -0.086, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.115', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.064', 'AMMO3': '0.068', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.300', 'weapon4': '0.390', 'WEAPON3': '0.450', 'ARMOR': '0.453', 'weapon3': '1.046', 'DAMAGECOUNT': '1.521', 'weapon2': '1.834', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:53,934][2409100] DAMAGECOUNT value on done: 1376.0
[2023-02-25 12:47:53,935][2409100] Sum rewards: 2.304, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.335', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.053', 'AMMO3': '0.090', 'weapon5': '0.104', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.514', 'weapon4': '0.622', 'weapon3': '1.090', 'DAMAGECOUNT': '1.428', 'weapon2': '1.452', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:53,972][2409549] DAMAGECOUNT value on done: 1603.0
[2023-02-25 12:47:53,973][2409549] Sum rewards: 5.237, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.800', 'AMMO2': '0.003', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.013', 'weapon5': '0.048', 'AMMO3': '0.063', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'HITCOUNT': '0.310', 'weapon4': '0.350', 'WEAPON3': '0.500', 'weapon2': '1.210', 'weapon3': '1.210', 'DAMAGECOUNT': '1.260', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:47:54,067][2409355] DAMAGECOUNT value on done: 1822.0
[2023-02-25 12:47:54,068][2409355] Sum rewards: 3.584, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.514', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'AMMO3': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'WEAPON4': '0.200', 'weapon4': '0.244', 'WEAPON3': '0.500', 'HITCOUNT': '0.500', 'ARMOR': '0.816', 'weapon3': '1.158', 'weapon2': '1.684', 'DAMAGECOUNT': '1.695', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:54,128][2409405] DAMAGECOUNT value on done: 1658.0
[2023-02-25 12:47:54,132][2409405] Sum rewards: 0.861, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.499', 'ARMOR': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO3': '0.060', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'HITCOUNT': '0.220', 'weapon4': '0.228', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.720', 'weapon2': '1.248', 'weapon3': '1.468', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:54,597][2409074] Updated weights for policy 0, policy_version 10681 (0.0013)
[2023-02-25 12:47:54,805][2409075] DAMAGECOUNT value on done: 1420.0
[2023-02-25 12:47:54,808][2409075] Sum rewards: 3.075, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.826', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.046', 'WEAPON1': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.075', 'HITCOUNT': '0.140', 'weapon7': '0.188', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'WEAPON3': '0.500', 'weapon4': '0.628', 'weapon2': '0.712', 'ARMOR': '0.851', 'weapon3': '1.074', 'DAMAGECOUNT': '1.254', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:54,862][2409373] DAMAGECOUNT value on done: 2300.0
[2023-02-25 12:47:54,884][2409373] Sum rewards: 4.538, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.075', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.035', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'weapon4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon5': '0.200', 'WEAPON3': '0.300', 'HITCOUNT': '0.350', 'weapon3': '1.262', 'weapon2': '1.372', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:54,892][2409389] DAMAGECOUNT value on done: 1370.0
[2023-02-25 12:47:54,895][2409389] Sum rewards: 2.486, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.038', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.027', 'WEAPON1': '0.040', 'weapon7': '0.054', 'AMMO3': '0.058', 'weapon5': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.200', 'HITCOUNT': '0.260', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.927', 'weapon3': '1.048', 'weapon2': '1.536', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:55,376][2409469] DAMAGECOUNT value on done: 2550.0
[2023-02-25 12:47:55,377][2409469] Sum rewards: 10.020, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.009', 'AMMO4': '0.047', 'AMMO3': '0.062', 'HEALTH': '0.350', 'WEAPON3': '0.400', 'ARMOR': '0.444', 'HITCOUNT': '0.850', 'weapon3': '1.360', 'weapon2': '1.548', 'DAMAGECOUNT': '3.450', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:47:55,414][2409104] DAMAGECOUNT value on done: 1436.0
[2023-02-25 12:47:55,416][2409104] Sum rewards: 2.598, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.330', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'weapon4': '0.204', 'HITCOUNT': '0.290', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.062', 'weapon3': '1.220', 'weapon2': '2.020', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:55,444][2409097] DAMAGECOUNT value on done: 1898.0
[2023-02-25 12:47:55,445][2409097] Sum rewards: 1.456, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.660', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON1': '0.030', 'AMMO4': '0.054', 'weapon5': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'weapon4': '0.192', 'WEAPON5': '0.200', 'HITCOUNT': '0.360', 'ARMOR': '0.400', 'WEAPON3': '0.850', 'weapon2': '1.320', 'DAMAGECOUNT': '1.692', 'weapon3': '1.966', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:55,659][2409406] DAMAGECOUNT value on done: 1651.0
[2023-02-25 12:47:55,660][2409406] Sum rewards: 0.129, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.840', 'AMMO2': '0.012', 'ARMOR': '0.036', 'weapon4': '0.048', 'weapon7': '0.058', 'AMMO4': '0.061', 'AMMO3': '0.069', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.200', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.594', 'FRAGCOUNT': '1.000', 'weapon2': '1.138', 'weapon3': '1.262'}
[2023-02-25 12:47:55,679][2409079] DAMAGECOUNT value on done: 1813.0
[2023-02-25 12:47:55,683][2409079] Sum rewards: 2.241, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.172', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon7': '0.070', 'AMMO3': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.236', 'HITCOUNT': '0.240', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'weapon3': '1.038', 'DAMAGECOUNT': '1.059', 'weapon2': '1.232', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:55,711][2409485] DAMAGECOUNT value on done: 1683.0
[2023-02-25 12:47:55,715][2409485] Sum rewards: 6.390, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.496', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.085', 'weapon5': '0.108', 'weapon4': '0.162', 'WEAPON5': '0.200', 'HITCOUNT': '0.270', 'ARMOR': '0.453', 'WEAPON3': '0.550', 'weapon3': '0.904', 'weapon2': '0.994', 'DAMAGECOUNT': '2.274', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:47:55,815][2409407] DAMAGECOUNT value on done: 2071.0
[2023-02-25 12:47:55,816][2409407] Sum rewards: 2.297, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.500', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.017', 'WEAPON1': '0.030', 'AMMO3': '0.093', 'weapon5': '0.138', 'WEAPON5': '0.150', 'HITCOUNT': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.533', 'weapon2': '1.596', 'weapon3': '1.632', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:55,885][2409105] DAMAGECOUNT value on done: 1785.0
[2023-02-25 12:47:55,888][2409105] Sum rewards: 2.160, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.694', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'ARMOR': '0.040', 'AMMO4': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'WEAPON4': '0.150', 'HITCOUNT': '0.260', 'weapon4': '0.454', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.894', 'weapon2': '0.926', 'weapon3': '1.438', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:56,002][2409103] DAMAGECOUNT value on done: 1814.0
[2023-02-25 12:47:56,003][2409103] Sum rewards: 4.211, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.526', 'AMMO2': '0.002', 'AMMO4': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.064', 'weapon5': '0.134', 'WEAPON5': '0.200', 'weapon4': '0.228', 'HITCOUNT': '0.300', 'WEAPON3': '0.450', 'weapon3': '0.890', 'DAMAGECOUNT': '1.068', 'ARMOR': '1.296', 'weapon2': '1.508', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:56,301][2409074] Updated weights for policy 0, policy_version 10691 (0.0012)
[2023-02-25 12:47:56,316][2409096] DAMAGECOUNT value on done: 1804.0
[2023-02-25 12:47:56,317][2409096] Sum rewards: 1.716, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.590', 'AMMO5': '0.005', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.024', 'weapon7': '0.028', 'AMMO2': '0.033', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.163', 'WEAPON4': '0.300', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'weapon4': '0.374', 'HITCOUNT': '0.690', 'WEAPON3': '0.800', 'weapon2': '1.292', 'weapon3': '1.674', 'DAMAGECOUNT': '2.547', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:47:56,366][2409101] DAMAGECOUNT value on done: 2619.0
[2023-02-25 12:47:56,368][2409101] Sum rewards: 4.903, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.406', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'AMMO5': '0.007', 'WEAPON1': '0.040', 'weapon5': '0.048', 'AMMO3': '0.106', 'WEAPON5': '0.200', 'HITCOUNT': '0.350', 'ARMOR': '0.453', 'WEAPON3': '0.700', 'weapon2': '1.532', 'weapon3': '1.596', 'DAMAGECOUNT': '2.088', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:47:56,465][2409077] DAMAGECOUNT value on done: 2079.0
[2023-02-25 12:47:56,470][2409077] Sum rewards: -2.640, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.167', 'AMMO5': '0.010', 'AMMO2': '0.035', 'WEAPON1': '0.040', 'AMMO3': '0.099', 'weapon5': '0.126', 'AMMO4': '0.173', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.382', 'FRAGCOUNT': '0.500', 'ARMOR': '0.516', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.894', 'weapon2': '1.172', 'weapon3': '1.550'}
[2023-02-25 12:47:56,499][2409076] DAMAGECOUNT value on done: 2125.0
[2023-02-25 12:47:56,649][2409078] DAMAGECOUNT value on done: 1837.0
[2023-02-25 12:47:56,649][2409078] Sum rewards: 4.626, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.800', 'AMMO4': '-0.078', 'AMMO2': '-0.015', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'AMMO3': '0.076', 'weapon5': '0.090', 'WEAPON5': '0.150', 'HITCOUNT': '0.330', 'ARMOR': '0.451', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.125', 'weapon3': '1.372', 'weapon2': '1.790', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:56,756][2409548] DAMAGECOUNT value on done: 2234.0
[2023-02-25 12:47:56,756][2409548] Sum rewards: -2.918, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.312', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.030', 'weapon5': '0.068', 'AMMO3': '0.109', 'AMMO4': '0.150', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.440', 'HITCOUNT': '0.490', 'WEAPON3': '0.650', 'ARMOR': '0.848', 'weapon3': '1.396', 'weapon2': '1.748', 'DAMAGECOUNT': '1.797', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:57,101][2409099] DAMAGECOUNT value on done: 1355.0
[2023-02-25 12:47:57,104][2409099] Sum rewards: 3.550, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.086', 'AMMO5': '0.011', 'ARMOR': '0.020', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'AMMO3': '0.053', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'weapon5': '0.206', 'WEAPON5': '0.300', 'HITCOUNT': '0.370', 'WEAPON3': '0.400', 'weapon4': '0.472', 'weapon3': '1.160', 'DAMAGECOUNT': '1.584', 'weapon2': '1.686', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:57,186][2408954] Fps is (10 sec: 24985.7, 60 sec: 25258.7, 300 sec: 25534.0). Total num frames: 43810816. Throughput: 0: 6308.0. Samples: 10953636. Policy #0 lag: (min: 0.0, avg: 13.8, max: 28.0)
[2023-02-25 12:47:57,186][2408954] Avg episode reward: [(0, '2.082')]
[2023-02-25 12:47:57,192][2409033] Saving new best policy, reward=2.082!
[2023-02-25 12:47:57,192][2409565] DAMAGECOUNT value on done: 1646.0
[2023-02-25 12:47:57,195][2409565] Sum rewards: 1.952, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.710', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'weapon4': '0.054', 'AMMO3': '0.064', 'AMMO4': '0.085', 'WEAPON3': '0.400', 'HITCOUNT': '0.510', 'ARMOR': '0.953', 'weapon3': '1.264', 'DAMAGECOUNT': '1.635', 'weapon2': '2.130', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:57,264][2409866] DAMAGECOUNT value on done: 2262.0
[2023-02-25 12:47:57,264][2409866] Sum rewards: 1.623, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.533', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'weapon5': '0.038', 'WEAPON5': '0.050', 'weapon7': '0.072', 'AMMO3': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.125', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.432', 'ARMOR': '0.454', 'WEAPON3': '0.700', 'HITCOUNT': '0.810', 'weapon2': '0.884', 'weapon3': '1.944', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.805'}
[2023-02-25 12:47:57,390][2409102] DAMAGECOUNT value on done: 1688.0
[2023-02-25 12:47:57,391][2409102] Sum rewards: 7.064, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.800', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'AMMO3': '0.065', 'weapon5': '0.082', 'WEAPON5': '0.100', 'weapon4': '0.176', 'HITCOUNT': '0.470', 'WEAPON3': '0.500', 'ARMOR': '0.800', 'weapon3': '0.834', 'weapon2': '1.656', 'DAMAGECOUNT': '2.346', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:47:57,489][2409486] DAMAGECOUNT value on done: 1971.0
[2023-02-25 12:47:57,497][2409549] DAMAGECOUNT value on done: 2110.0
[2023-02-25 12:47:57,498][2409486] Sum rewards: 1.029, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.738', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.066', 'weapon7': '0.074', 'AMMO3': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.300', 'WEAPON4': '0.300', 'ARMOR': '0.410', 'weapon4': '0.494', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.122', 'weapon3': '1.410', 'weapon2': '1.814', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:57,498][2409549] Sum rewards: 2.212, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.398', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.075', 'AMMO3': '0.101', 'WEAPON5': '0.150', 'HITCOUNT': '0.360', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.131', 'weapon2': '1.240', 'weapon3': '1.604', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:57,529][2409597] DAMAGECOUNT value on done: 1849.0
[2023-02-25 12:47:57,530][2409597] Sum rewards: 0.353, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.840', 'AMMO2': '0.005', 'AMMO4': '0.023', 'AMMO3': '0.048', 'weapon7': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'WEAPON7': '0.200', 'weapon4': '0.240', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.660', 'weapon3': '0.720', 'ARMOR': '0.881', 'weapon2': '0.986', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:47:57,588][2409596] DAMAGECOUNT value on done: 2051.0
[2023-02-25 12:47:57,591][2409596] Sum rewards: 0.734, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.409', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.029', 'AMMO3': '0.052', 'WEAPON5': '0.100', 'HITCOUNT': '0.170', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.465', 'weapon3': '0.692', 'ARMOR': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.212'}
[2023-02-25 12:47:57,927][2409355] DAMAGECOUNT value on done: 1243.0
[2023-02-25 12:47:57,928][2409355] Sum rewards: -0.797, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.448', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'weapon4': '0.002', 'AMMO5': '0.003', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'WEAPON1': '0.070', 'AMMO3': '0.106', 'HITCOUNT': '0.240', 'ARMOR': '0.430', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.269', 'weapon3': '1.526', 'weapon2': '1.704', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:58,008][2409100] DAMAGECOUNT value on done: 1625.0
[2023-02-25 12:47:58,008][2409405] DAMAGECOUNT value on done: 1666.0
[2023-02-25 12:47:58,011][2409100] Sum rewards: 0.802, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.576', 'AMMO5': '0.006', 'AMMO2': '0.011', 'WEAPON1': '0.040', 'AMMO4': '0.056', 'weapon5': '0.092', 'AMMO3': '0.109', 'WEAPON5': '0.200', 'HITCOUNT': '0.320', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.149', 'weapon2': '1.282', 'weapon3': '1.862', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:58,011][2409405] Sum rewards: 1.751, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.552', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'AMMO4': '0.166', 'HITCOUNT': '0.390', 'WEAPON4': '0.400', 'ARMOR': '0.513', 'WEAPON3': '0.600', 'weapon4': '0.658', 'DAMAGECOUNT': '1.023', 'weapon2': '1.104', 'weapon3': '1.682', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:58,035][2409074] Updated weights for policy 0, policy_version 10701 (0.0012)
[2023-02-25 12:47:58,374][2409547] DAMAGECOUNT value on done: 1529.0
[2023-02-25 12:47:58,376][2409547] Sum rewards: 1.958, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.174', 'AMMO2': '0.002', 'AMMO4': '0.008', 'ARMOR': '0.012', 'weapon7': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.052', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.290', 'WEAPON3': '0.450', 'weapon4': '0.614', 'DAMAGECOUNT': '0.816', 'weapon2': '1.138', 'weapon3': '1.194', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:58,620][2409373] DAMAGECOUNT value on done: 2531.0
[2023-02-25 12:47:58,622][2409373] Sum rewards: 5.505, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.708', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'weapon5': '0.006', 'WEAPON1': '0.020', 'AMMO3': '0.073', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.158', 'WEAPON3': '0.550', 'HITCOUNT': '0.640', 'ARMOR': '0.900', 'weapon3': '1.428', 'weapon2': '1.430', 'DAMAGECOUNT': '2.055', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:58,977][2409469] DAMAGECOUNT value on done: 2303.0
[2023-02-25 12:47:58,981][2409469] Sum rewards: -0.048, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.031', 'AMMO4': '-0.078', 'AMMO2': '-0.015', 'AMMO5': '0.005', 'weapon5': '0.006', 'WEAPON1': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'HITCOUNT': '0.380', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.146', 'weapon3': '1.610', 'weapon2': '1.720', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:47:59,026][2409104] DAMAGECOUNT value on done: 1356.0
[2023-02-25 12:47:59,027][2409104] Sum rewards: -3.857, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.768', 'FRAGCOUNT': '-1.000', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO3': '0.098', 'WEAPON4': '0.150', 'weapon5': '0.172', 'WEAPON5': '0.250', 'weapon4': '0.306', 'HITCOUNT': '0.430', 'ARMOR': '0.476', 'WEAPON3': '0.700', 'weapon3': '1.334', 'DAMAGECOUNT': '1.524', 'weapon2': '1.708'}
[2023-02-25 12:47:59,262][2409075] DAMAGECOUNT value on done: 2035.0
[2023-02-25 12:47:59,263][2409075] Sum rewards: 0.971, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.280', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO3': '0.078', 'WEAPON4': '0.150', 'weapon4': '0.240', 'HITCOUNT': '0.470', 'WEAPON3': '0.550', 'ARMOR': '0.946', 'weapon3': '0.978', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.419', 'weapon2': '1.668'}
[2023-02-25 12:47:59,293][2409485] DAMAGECOUNT value on done: 1419.0
[2023-02-25 12:47:59,297][2409485] Sum rewards: -0.107, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.344', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.022', 'AMMO4': '0.052', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'weapon4': '0.246', 'HITCOUNT': '0.370', 'ARMOR': '0.508', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.035', 'weapon2': '1.522', 'weapon3': '1.654', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:59,357][2409389] DAMAGECOUNT value on done: 1263.0
[2023-02-25 12:47:59,360][2409389] Sum rewards: -0.043, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.128', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'AMMO3': '0.074', 'weapon5': '0.106', 'AMMO4': '0.131', 'weapon4': '0.164', 'HITCOUNT': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.711', 'ARMOR': '0.824', 'weapon2': '1.282', 'weapon3': '1.292', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:59,396][2409079] DAMAGECOUNT value on done: 2312.0
[2023-02-25 12:47:59,399][2409079] Sum rewards: 3.326, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.732', 'AMMO2': '0.008', 'WEAPON1': '0.040', 'AMMO4': '0.041', 'weapon7': '0.060', 'AMMO3': '0.074', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.206', 'HITCOUNT': '0.310', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.035', 'weapon2': '1.124', 'weapon3': '1.370', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:47:59,468][2409105] DAMAGECOUNT value on done: 1642.0
[2023-02-25 12:47:59,468][2409407] DAMAGECOUNT value on done: 1520.0
[2023-02-25 12:47:59,471][2409105] Sum rewards: 1.005, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.624', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.054', 'AMMO3': '0.080', 'WEAPON5': '0.150', 'HITCOUNT': '0.270', 'WEAPON3': '0.400', 'ARMOR': '0.458', 'DAMAGECOUNT': '0.981', 'weapon3': '0.986', 'weapon2': '1.432', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:47:59,533][2409103] DAMAGECOUNT value on done: 1343.0
[2023-02-25 12:47:59,534][2409103] Sum rewards: 2.070, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.838', 'AMMO4': '-0.065', 'AMMO2': '-0.013', 'AMMO5': '0.003', 'WEAPON1': '0.030', 'weapon5': '0.056', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'HITCOUNT': '0.290', 'ARMOR': '0.441', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.074', 'weapon3': '1.410', 'weapon2': '1.772'}
[2023-02-25 12:47:59,544][2409406] DAMAGECOUNT value on done: 1340.0
[2023-02-25 12:47:59,545][2409406] Sum rewards: 1.256, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.738', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'ARMOR': '0.020', 'WEAPON1': '0.060', 'AMMO3': '0.079', 'weapon5': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.220', 'weapon4': '0.298', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.954', 'FRAGCOUNT': '1.500', 'weapon2': '1.528', 'weapon3': '1.530'}
[2023-02-25 12:47:59,582][2409074] Updated weights for policy 0, policy_version 10711 (0.0015)
[2023-02-25 12:47:59,898][2409101] DAMAGECOUNT value on done: 1418.0
[2023-02-25 12:47:59,899][2409101] Sum rewards: 6.453, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.826', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.038', 'WEAPON5': '0.050', 'weapon7': '0.066', 'AMMO3': '0.079', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.376', 'HITCOUNT': '0.510', 'WEAPON3': '0.550', 'ARMOR': '0.862', 'weapon3': '1.232', 'weapon2': '2.078', 'DAMAGECOUNT': '2.217', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:47:59,913][2409096] DAMAGECOUNT value on done: 2187.0
[2023-02-25 12:47:59,914][2409096] Sum rewards: 0.361, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.810', 'AMMO2': '0.001', 'AMMO4': '0.005', 'WEAPON1': '0.010', 'weapon7': '0.046', 'AMMO3': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.238', 'HITCOUNT': '0.290', 'ARMOR': '0.472', 'WEAPON3': '0.600', 'weapon3': '1.308', 'weapon2': '1.536', 'DAMAGECOUNT': '1.671', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:00,268][2409097] DAMAGECOUNT value on done: 1147.0
[2023-02-25 12:48:00,270][2409097] Sum rewards: 1.592, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.028', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.027', 'AMMO3': '0.066', 'HITCOUNT': '0.170', 'weapon5': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.272', 'ARMOR': '0.471', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.660', 'weapon2': '1.142', 'weapon3': '1.178', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:00,312][2409076] DAMAGECOUNT value on done: 1581.0
[2023-02-25 12:48:00,315][2409076] Sum rewards: 2.209, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.468', 'AMMO2': '0.010', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.051', 'weapon5': '0.056', 'AMMO3': '0.082', 'WEAPON5': '0.150', 'HITCOUNT': '0.320', 'WEAPON3': '0.450', 'ARMOR': '0.851', 'DAMAGECOUNT': '0.936', 'weapon3': '1.494', 'weapon2': '1.994', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:00,317][2409078] DAMAGECOUNT value on done: 1746.0
[2023-02-25 12:48:00,318][2409078] Sum rewards: 6.076, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.624', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.008', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'weapon5': '0.168', 'WEAPON4': '0.250', 'HITCOUNT': '0.280', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.483', 'weapon4': '0.494', 'weapon2': '0.748', 'weapon3': '1.182', 'DAMAGECOUNT': '1.998', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:00,463][2409077] DAMAGECOUNT value on done: 1752.0
[2023-02-25 12:48:00,467][2409077] Sum rewards: 1.687, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.654', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon7': '0.060', 'weapon5': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.108', 'AMMO4': '0.126', 'WEAPON4': '0.300', 'HITCOUNT': '0.330', 'weapon4': '0.392', 'WEAPON3': '0.550', 'ARMOR': '0.900', 'weapon2': '1.368', 'DAMAGECOUNT': '1.452', 'weapon3': '1.764', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:00,628][2409548] DAMAGECOUNT value on done: 1651.0
[2023-02-25 12:48:00,632][2409548] Sum rewards: 1.651, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.572', 'AMMO2': '0.003', 'AMMO5': '0.008', 'AMMO4': '0.016', 'WEAPON1': '0.050', 'AMMO3': '0.090', 'weapon5': '0.112', 'WEAPON5': '0.250', 'HITCOUNT': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.326', 'weapon3': '1.596', 'weapon2': '1.922', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:00,769][2409565] DAMAGECOUNT value on done: 2110.0
[2023-02-25 12:48:00,773][2409565] Sum rewards: 3.500, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.958', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon4': '0.056', 'AMMO4': '0.076', 'weapon5': '0.078', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.380', 'WEAPON3': '0.550', 'ARMOR': '0.812', 'DAMAGECOUNT': '1.401', 'weapon3': '1.494', 'weapon2': '1.722', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:00,921][2409102] DAMAGECOUNT value on done: 2150.0
[2023-02-25 12:48:00,922][2409102] Sum rewards: 0.903, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.277', 'AMMO2': '0.003', 'AMMO5': '0.004', 'AMMO4': '0.014', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.074', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'weapon4': '0.136', 'HITCOUNT': '0.380', 'WEAPON3': '0.600', 'ARMOR': '0.910', 'weapon2': '1.556', 'DAMAGECOUNT': '1.803', 'weapon3': '1.948', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:00,983][2409866] DAMAGECOUNT value on done: 1384.0
[2023-02-25 12:48:00,985][2409866] Sum rewards: -0.118, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.506', 'ARMOR': '0.008', 'AMMO2': '0.024', 'WEAPON1': '0.060', 'AMMO3': '0.112', 'AMMO4': '0.120', 'weapon4': '0.268', 'HITCOUNT': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.987', 'weapon2': '1.428', 'weapon3': '1.890', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:00,999][2409549] DAMAGECOUNT value on done: 2195.0
[2023-02-25 12:48:01,002][2409549] Sum rewards: 3.852, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.869', 'AMMO2': '0.004', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO4': '0.022', 'WEAPON1': '0.040', 'AMMO3': '0.074', 'weapon5': '0.076', 'weapon4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.430', 'WEAPON3': '0.550', 'weapon2': '1.454', 'weapon3': '1.738', 'DAMAGECOUNT': '1.980', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:48:01,157][2409099] DAMAGECOUNT value on done: 1673.0
[2023-02-25 12:48:01,158][2409099] Sum rewards: 9.070, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.355', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'weapon5': '0.068', 'WEAPON5': '0.100', 'HITCOUNT': '0.370', 'WEAPON3': '0.400', 'weapon3': '1.218', 'weapon2': '1.394', 'DAMAGECOUNT': '1.800', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:48:01,416][2409597] DAMAGECOUNT value on done: 2025.0
[2023-02-25 12:48:01,417][2409597] Sum rewards: 5.512, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.128', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'weapon5': '0.056', 'weapon7': '0.080', 'AMMO4': '0.084', 'AMMO3': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.312', 'HITCOUNT': '0.420', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'weapon2': '1.080', 'weapon3': '1.748', 'DAMAGECOUNT': '1.914', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:01,446][2409596] DAMAGECOUNT value on done: 1539.0
[2023-02-25 12:48:01,447][2409596] Sum rewards: 3.510, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.514', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'weapon5': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.097', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'HITCOUNT': '0.220', 'weapon4': '0.238', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.804', 'ARMOR': '0.812', 'weapon3': '1.550', 'weapon2': '1.598', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:01,479][2409486] DAMAGECOUNT value on done: 1673.0
[2023-02-25 12:48:01,483][2409486] Sum rewards: 2.040, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.775', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.011', 'WEAPON1': '0.030', 'AMMO3': '0.070', 'weapon5': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.320', 'weapon4': '0.348', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.152', 'weapon2': '1.292', 'weapon3': '1.592', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:48:01,582][2409074] Updated weights for policy 0, policy_version 10721 (0.0012)
[2023-02-25 12:48:01,594][2409355] DAMAGECOUNT value on done: 1562.0
[2023-02-25 12:48:01,597][2409355] Sum rewards: 2.232, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.206', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.039', 'weapon5': '0.052', 'ARMOR': '0.068', 'AMMO3': '0.095', 'WEAPON5': '0.150', 'AMMO4': '0.193', 'WEAPON4': '0.200', 'HITCOUNT': '0.440', 'WEAPON3': '0.550', 'weapon4': '0.558', 'weapon2': '1.234', 'weapon3': '1.246', 'DAMAGECOUNT': '1.593', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:01,599][2409405] DAMAGECOUNT value on done: 1769.0
[2023-02-25 12:48:01,604][2409405] Sum rewards: 2.380, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.722', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'weapon5': '0.002', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.062', 'WEAPON4': '0.100', 'weapon7': '0.102', 'HITCOUNT': '0.180', 'weapon4': '0.186', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.851', 'DAMAGECOUNT': '0.873', 'weapon3': '1.068', 'weapon2': '1.282', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:01,905][2409100] DAMAGECOUNT value on done: 1430.0
[2023-02-25 12:48:01,906][2409100] Sum rewards: 3.586, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.045', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.008', 'AMMO3': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.122', 'weapon5': '0.160', 'WEAPON7': '0.200', 'HITCOUNT': '0.300', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.386', 'WEAPON3': '0.600', 'weapon3': '1.156', 'ARMOR': '1.294', 'weapon2': '1.734', 'DAMAGECOUNT': '1.770', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:02,186][2408954] Fps is (10 sec: 26214.4, 60 sec: 25399.1, 300 sec: 25575.7). Total num frames: 43945984. Throughput: 0: 6312.0. Samples: 10991832. Policy #0 lag: (min: 0.0, avg: 13.8, max: 28.0)
[2023-02-25 12:48:02,186][2408954] Avg episode reward: [(0, '2.300')]
[2023-02-25 12:48:02,187][2409033] Saving new best policy, reward=2.300!
[2023-02-25 12:48:02,264][2409373] DAMAGECOUNT value on done: 1389.0
[2023-02-25 12:48:02,265][2409373] Sum rewards: 1.333, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.263', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.056', 'AMMO4': '0.065', 'AMMO3': '0.083', 'WEAPON5': '0.100', 'HITCOUNT': '0.140', 'weapon4': '0.230', 'ARMOR': '0.440', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.660', 'weapon2': '0.886', 'FRAGCOUNT': '1.000', 'weapon3': '1.850'}
[2023-02-25 12:48:02,680][2409074] Updated weights for policy 0, policy_version 10731 (0.0012)
[2023-02-25 12:48:02,801][2409469] DAMAGECOUNT value on done: 1947.0
[2023-02-25 12:48:02,802][2409469] Sum rewards: 2.263, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.090', 'AMMO3': '0.094', 'HEALTH': '0.151', 'HITCOUNT': '0.510', 'WEAPON3': '0.550', 'ARMOR': '0.857', 'weapon3': '1.580', 'DAMAGECOUNT': '1.698', 'weapon2': '1.852', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:02,955][2409485] DAMAGECOUNT value on done: 1932.0
[2023-02-25 12:48:02,959][2409485] Sum rewards: 4.784, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.109', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.016', 'weapon4': '0.038', 'AMMO3': '0.070', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'weapon5': '0.234', 'HITCOUNT': '0.320', 'WEAPON5': '0.350', 'ARMOR': '0.465', 'WEAPON3': '0.550', 'weapon3': '1.652', 'weapon2': '1.674', 'DAMAGECOUNT': '2.073', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:48:03,024][2409547] DAMAGECOUNT value on done: 1761.0
[2023-02-25 12:48:03,025][2409547] Sum rewards: -1.633, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.190', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON1': '0.040', 'weapon5': '0.104', 'AMMO3': '0.113', 'WEAPON5': '0.200', 'HITCOUNT': '0.210', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.650', 'weapon3': '1.134', 'weapon2': '1.214', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:03,044][2409104] DAMAGECOUNT value on done: 1771.0
[2023-02-25 12:48:03,046][2409104] Sum rewards: 7.526, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.252', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'weapon7': '0.052', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.234', 'WEAPON3': '0.350', 'HITCOUNT': '0.370', 'ARMOR': '0.853', 'weapon3': '0.900', 'weapon2': '1.046', 'DAMAGECOUNT': '2.316', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:03,166][2409103] DAMAGECOUNT value on done: 1487.0
[2023-02-25 12:48:03,169][2409103] Sum rewards: 1.938, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.300', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'weapon5': '0.072', 'AMMO3': '0.088', 'AMMO4': '0.090', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'HITCOUNT': '0.310', 'weapon4': '0.344', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.840', 'ARMOR': '0.924', 'weapon2': '1.350', 'weapon3': '1.654', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:03,276][2409406] DAMAGECOUNT value on done: 1629.0
[2023-02-25 12:48:03,279][2409406] Sum rewards: 3.867, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.946', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.020', 'ARMOR': '0.040', 'WEAPON1': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.088', 'WEAPON4': '0.150', 'weapon4': '0.278', 'HITCOUNT': '0.360', 'WEAPON3': '0.650', 'weapon2': '1.270', 'DAMAGECOUNT': '1.485', 'weapon3': '1.550', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:03,358][2409105] DAMAGECOUNT value on done: 1685.0
[2023-02-25 12:48:03,359][2409105] Sum rewards: 2.281, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.178', 'AMMO2': '0.009', 'AMMO5': '0.012', 'AMMO4': '0.045', 'WEAPON1': '0.050', 'AMMO3': '0.061', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.298', 'HITCOUNT': '0.340', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.167', 'ARMOR': '1.304', 'weapon3': '1.564', 'weapon2': '1.660', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:03,451][2409101] DAMAGECOUNT value on done: 1775.0
[2023-02-25 12:48:03,452][2409101] Sum rewards: 1.354, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.740', 'ARMOR': '0.016', 'AMMO2': '0.023', 'AMMO3': '0.041', 'weapon7': '0.048', 'AMMO4': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.358', 'HITCOUNT': '0.370', 'weapon3': '0.816', 'DAMAGECOUNT': '1.206', 'weapon2': '1.362', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:03,545][2409075] DAMAGECOUNT value on done: 1867.0
[2023-02-25 12:48:03,548][2409075] Sum rewards: 2.096, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.790', 'AMMO5': '0.012', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'AMMO4': '0.136', 'weapon5': '0.154', 'WEAPON5': '0.200', 'weapon4': '0.398', 'HITCOUNT': '0.430', 'WEAPON3': '0.550', 'ARMOR': '0.875', 'weapon3': '1.444', 'weapon2': '1.566', 'DAMAGECOUNT': '1.875', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:48:03,597][2409079] DAMAGECOUNT value on done: 1490.0
[2023-02-25 12:48:03,599][2409079] Sum rewards: 4.321, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.841', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.003', 'WEAPON1': '0.060', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'HITCOUNT': '0.520', 'WEAPON3': '0.800', 'weapon2': '1.234', 'DAMAGECOUNT': '1.716', 'weapon3': '2.038', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:48:03,622][2409389] DAMAGECOUNT value on done: 2631.0
[2023-02-25 12:48:03,622][2409389] Sum rewards: 4.201, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.842', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'weapon5': '0.044', 'AMMO4': '0.074', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.148', 'ARMOR': '0.400', 'HITCOUNT': '0.460', 'WEAPON3': '0.550', 'weapon2': '1.436', 'weapon3': '1.804', 'DAMAGECOUNT': '2.034', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:03,627][2409407] DAMAGECOUNT value on done: 2074.0
[2023-02-25 12:48:03,629][2409407] Sum rewards: 1.814, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.556', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.040', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'WEAPON4': '0.300', 'HITCOUNT': '0.370', 'weapon4': '0.508', 'WEAPON3': '0.750', 'ARMOR': '0.912', 'weapon3': '0.928', 'DAMAGECOUNT': '1.500', 'weapon2': '1.740', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:03,756][2409096] DAMAGECOUNT value on done: 1989.0
[2023-02-25 12:48:03,757][2409096] Sum rewards: 3.214, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.114', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.083', 'AMMO3': '0.097', 'weapon5': '0.112', 'WEAPON5': '0.150', 'weapon4': '0.184', 'HITCOUNT': '0.210', 'WEAPON3': '0.500', 'ARMOR': '0.932', 'weapon3': '1.480', 'DAMAGECOUNT': '1.587', 'weapon2': '1.666', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:04,009][2409078] DAMAGECOUNT value on done: 2017.0
[2023-02-25 12:48:04,010][2409078] Sum rewards: 5.336, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON1': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'weapon5': '0.060', 'AMMO3': '0.070', 'WEAPON3': '0.400', 'HITCOUNT': '0.430', 'HEALTH': '0.600', 'weapon2': '1.508', 'weapon3': '1.622', 'DAMAGECOUNT': '1.740', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:04,063][2409077] DAMAGECOUNT value on done: 2108.0
[2023-02-25 12:48:04,065][2409077] Sum rewards: 3.863, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.640', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.030', 'AMMO4': '0.043', 'AMMO3': '0.066', 'weapon4': '0.070', 'WEAPON4': '0.100', 'weapon5': '0.108', 'WEAPON5': '0.200', 'HITCOUNT': '0.420', 'WEAPON3': '0.450', 'weapon3': '1.202', 'weapon2': '1.500', 'DAMAGECOUNT': '1.800', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:04,100][2409074] Updated weights for policy 0, policy_version 10741 (0.0012)
[2023-02-25 12:48:04,245][2409548] DAMAGECOUNT value on done: 2413.0
[2023-02-25 12:48:04,246][2409548] Sum rewards: 6.602, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.820', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON1': '0.050', 'weapon5': '0.066', 'AMMO3': '0.090', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.290', 'ARMOR': '0.447', 'WEAPON3': '0.650', 'HITCOUNT': '0.710', 'weapon3': '1.358', 'weapon2': '1.582', 'DAMAGECOUNT': '3.339', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:48:04,272][2409097] DAMAGECOUNT value on done: 1496.0
[2023-02-25 12:48:04,273][2409097] Sum rewards: 1.203, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.124', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'weapon5': '0.086', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'weapon4': '0.294', 'HITCOUNT': '0.400', 'ARMOR': '0.456', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.233', 'weapon2': '1.470', 'weapon3': '1.770', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:04,321][2409076] DAMAGECOUNT value on done: 1232.0
[2023-02-25 12:48:04,322][2409076] Sum rewards: 2.547, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.632', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.012', 'WEAPON1': '0.020', 'ARMOR': '0.036', 'weapon5': '0.062', 'AMMO3': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.350', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.131', 'weapon3': '1.332', 'weapon2': '1.576', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:04,404][2409565] DAMAGECOUNT value on done: 1373.0
[2023-02-25 12:48:04,407][2409565] Sum rewards: -0.242, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.518', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'weapon5': '0.076', 'AMMO4': '0.094', 'AMMO3': '0.107', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.240', 'weapon4': '0.258', 'ARMOR': '0.404', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.119', 'weapon2': '1.404', 'weapon3': '1.890'}
[2023-02-25 12:48:04,524][2409102] DAMAGECOUNT value on done: 1710.0
[2023-02-25 12:48:04,527][2409102] Sum rewards: -1.554, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.095', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.103', 'weapon5': '0.114', 'WEAPON5': '0.150', 'HITCOUNT': '0.310', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.245', 'ARMOR': '1.307', 'weapon2': '1.682', 'weapon3': '1.896'}
[2023-02-25 12:48:04,541][2409549] DAMAGECOUNT value on done: 1643.0
[2023-02-25 12:48:04,542][2409549] Sum rewards: -0.098, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.870', 'AMMO2': '0.019', 'AMMO3': '0.081', 'AMMO4': '0.092', 'WEAPON4': '0.250', 'HITCOUNT': '0.340', 'ARMOR': '0.471', 'WEAPON3': '0.500', 'weapon4': '0.648', 'DAMAGECOUNT': '1.215', 'weapon2': '1.328', 'weapon3': '1.328', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:04,692][2409866] DAMAGECOUNT value on done: 952.0
[2023-02-25 12:48:04,693][2409866] Sum rewards: 0.885, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'weapon4': '0.096', 'AMMO4': '0.119', 'HITCOUNT': '0.280', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.792', 'HEALTH': '0.874', 'FRAGCOUNT': '1.000', 'weapon2': '1.492', 'weapon3': '1.612'}
[2023-02-25 12:48:05,006][2409597] DAMAGECOUNT value on done: 1629.0
[2023-02-25 12:48:05,007][2409597] Sum rewards: 0.538, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.126', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'AMMO3': '0.046', 'weapon5': '0.072', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.300', 'weapon4': '0.314', 'ARMOR': '0.400', 'weapon3': '0.832', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.065', 'weapon2': '1.142'}
[2023-02-25 12:48:05,322][2409355] DAMAGECOUNT value on done: 1771.0
[2023-02-25 12:48:05,325][2409355] Sum rewards: 3.816, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.576', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.027', 'AMMO3': '0.076', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.224', 'HITCOUNT': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.927', 'weapon3': '1.064', 'weapon2': '1.810', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:05,324][2409099] DAMAGECOUNT value on done: 2358.0
[2023-02-25 12:48:05,328][2409596] DAMAGECOUNT value on done: 2044.0
[2023-02-25 12:48:05,329][2409099] Sum rewards: 1.347, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.416', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.029', 'WEAPON1': '0.030', 'weapon5': '0.076', 'AMMO3': '0.081', 'WEAPON5': '0.150', 'HITCOUNT': '0.270', 'ARMOR': '0.450', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.915', 'FRAGCOUNT': '1.000', 'weapon2': '1.260', 'weapon3': '1.488'}
[2023-02-25 12:48:05,329][2409596] Sum rewards: 4.022, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.996', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.057', 'weapon4': '0.094', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.120', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.460', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'weapon3': '1.558', 'weapon2': '1.590', 'DAMAGECOUNT': '2.265', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:05,364][2409405] DAMAGECOUNT value on done: 1509.0
[2023-02-25 12:48:05,366][2409405] Sum rewards: 2.653, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.240', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon5': '0.060', 'AMMO3': '0.102', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.192', 'WEAPON5': '0.300', 'ARMOR': '0.482', 'HITCOUNT': '0.580', 'WEAPON3': '0.700', 'weapon3': '1.458', 'weapon2': '1.512', 'DAMAGECOUNT': '2.430', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:05,572][2409100] DAMAGECOUNT value on done: 1574.0
[2023-02-25 12:48:05,576][2409100] Sum rewards: 3.216, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'weapon4': '0.052', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'weapon5': '0.116', 'WEAPON5': '0.150', 'HITCOUNT': '0.200', 'HEALTH': '0.210', 'WEAPON3': '0.250', 'DAMAGECOUNT': '0.723', 'ARMOR': '0.847', 'weapon3': '0.978', 'weapon2': '1.910', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:05,623][2409486] DAMAGECOUNT value on done: 1925.0
[2023-02-25 12:48:05,624][2409486] Sum rewards: 3.272, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.661', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.040', 'AMMO4': '0.042', 'AMMO3': '0.050', 'weapon5': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.312', 'HITCOUNT': '0.340', 'WEAPON3': '0.400', 'ARMOR': '0.460', 'weapon3': '1.190', 'DAMAGECOUNT': '1.380', 'weapon2': '1.592', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:06,165][2409074] Updated weights for policy 0, policy_version 10751 (0.0012)
[2023-02-25 12:48:06,342][2409373] DAMAGECOUNT value on done: 1722.0
[2023-02-25 12:48:06,345][2409373] Sum rewards: 7.735, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.718', 'AMMO5': '0.003', 'ARMOR': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.076', 'AMMO3': '0.077', 'AMMO4': '0.104', 'WEAPON4': '0.300', 'weapon4': '0.454', 'WEAPON3': '0.500', 'HITCOUNT': '0.660', 'weapon3': '1.552', 'weapon2': '1.606', 'DAMAGECOUNT': '2.013', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:48:06,407][2409469] DAMAGECOUNT value on done: 1327.0
[2023-02-25 12:48:06,683][2409485] DAMAGECOUNT value on done: 1143.0
[2023-02-25 12:48:06,684][2409485] Sum rewards: -4.197, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.560', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.051', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'WEAPON4': '0.300', 'HITCOUNT': '0.330', 'ARMOR': '0.432', 'weapon4': '0.634', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.825', 'weapon2': '1.456', 'weapon3': '1.518', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:06,859][2409103] DAMAGECOUNT value on done: 2724.0
[2023-02-25 12:48:06,861][2409103] Sum rewards: 7.044, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.570', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'ARMOR': '0.004', 'AMMO5': '0.017', 'weapon4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'weapon5': '0.220', 'WEAPON5': '0.300', 'HITCOUNT': '0.610', 'WEAPON3': '0.750', 'weapon2': '1.570', 'weapon3': '1.842', 'DAMAGECOUNT': '3.315', 'FRAGCOUNT': '6.500'}
[2023-02-25 12:48:06,965][2409547] DAMAGECOUNT value on done: 2027.0
[2023-02-25 12:48:06,966][2409547] Sum rewards: 1.737, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.017', 'AMMO2': '0.040', 'AMMO3': '0.072', 'weapon7': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.130', 'AMMO4': '0.200', 'HITCOUNT': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HEALTH': '0.300', 'WEAPON3': '0.450', 'weapon4': '0.592', 'weapon2': '0.728', 'ARMOR': '0.850', 'DAMAGECOUNT': '1.410', 'weapon3': '1.552', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:48:06,975][2409101] DAMAGECOUNT value on done: 1685.0
[2023-02-25 12:48:06,979][2409101] Sum rewards: 5.061, reward structure: {'DEATHCOUNT': '-6.750', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'AMMO3': '0.077', 'HEALTH': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'weapon4': '0.434', 'ARMOR': '0.448', 'WEAPON3': '0.450', 'HITCOUNT': '0.480', 'weapon3': '1.270', 'weapon2': '1.402', 'DAMAGECOUNT': '1.692', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:07,113][2409105] DAMAGECOUNT value on done: 1552.0
[2023-02-25 12:48:07,116][2409105] Sum rewards: -0.129, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.192', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'weapon7': '0.058', 'AMMO3': '0.078', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.400', 'ARMOR': '0.408', 'HITCOUNT': '0.450', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon2': '1.144', 'DAMAGECOUNT': '1.227', 'weapon3': '1.464'}
[2023-02-25 12:48:07,186][2408954] Fps is (10 sec: 26213.9, 60 sec: 25531.8, 300 sec: 25561.8). Total num frames: 44072960. Throughput: 0: 6318.9. Samples: 11010768. Policy #0 lag: (min: 1.0, avg: 13.7, max: 28.0)
[2023-02-25 12:48:07,186][2408954] Avg episode reward: [(0, '2.408')]
[2023-02-25 12:48:07,204][2409406] DAMAGECOUNT value on done: 1596.0
[2023-02-25 12:48:07,207][2409406] Sum rewards: 2.233, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.609', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.015', 'AMMO3': '0.088', 'HITCOUNT': '0.340', 'ARMOR': '0.497', 'WEAPON3': '0.500', 'weapon3': '1.066', 'DAMAGECOUNT': '1.185', 'weapon2': '1.388', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:07,215][2409033] Saving new best policy, reward=2.408!
[2023-02-25 12:48:07,222][2409074] Updated weights for policy 0, policy_version 10761 (0.0012)
[2023-02-25 12:48:07,232][2409104] DAMAGECOUNT value on done: 1378.0
[2023-02-25 12:48:07,235][2409104] Sum rewards: -1.363, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.266', 'AMMO2': '0.015', 'AMMO5': '0.015', 'WEAPON1': '0.060', 'weapon7': '0.062', 'AMMO4': '0.076', 'AMMO3': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.130', 'weapon4': '0.160', 'weapon5': '0.192', 'WEAPON5': '0.300', 'ARMOR': '0.408', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.783', 'FRAGCOUNT': '1.000', 'weapon3': '1.370', 'weapon2': '1.684'}
[2023-02-25 12:48:07,397][2409096] DAMAGECOUNT value on done: 1123.0
[2023-02-25 12:48:07,399][2409075] DAMAGECOUNT value on done: 1992.0
[2023-02-25 12:48:07,402][2409075] Sum rewards: -0.412, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.237', 'AMMO5': '0.006', 'AMMO2': '0.036', 'ARMOR': '0.060', 'WEAPON1': '0.080', 'AMMO3': '0.102', 'weapon5': '0.132', 'AMMO4': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.360', 'weapon4': '0.556', 'WEAPON3': '0.700', 'weapon2': '0.806', 'DAMAGECOUNT': '1.110', 'weapon3': '1.794', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:07,455][2409389] DAMAGECOUNT value on done: 1535.0
[2023-02-25 12:48:07,456][2409389] Sum rewards: -0.525, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.151', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO3': '0.050', 'AMMO4': '0.061', 'weapon7': '0.132', 'HITCOUNT': '0.160', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'ARMOR': '0.412', 'DAMAGECOUNT': '0.585', 'weapon4': '0.634', 'weapon3': '0.714', 'weapon2': '0.766', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:48:07,702][2409407] DAMAGECOUNT value on done: 1664.0
[2023-02-25 12:48:07,703][2409407] Sum rewards: 5.560, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.966', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'weapon4': '0.070', 'AMMO3': '0.076', 'weapon5': '0.108', 'WEAPON5': '0.150', 'HITCOUNT': '0.330', 'WEAPON3': '0.600', 'weapon2': '1.324', 'weapon3': '1.582', 'DAMAGECOUNT': '1.686', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:07,719][2409079] DAMAGECOUNT value on done: 2120.0
[2023-02-25 12:48:07,720][2409079] Sum rewards: 6.941, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.480', 'weapon5': '0.002', 'AMMO5': '0.005', 'ARMOR': '0.036', 'AMMO2': '0.036', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.181', 'weapon4': '0.440', 'WEAPON4': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '0.710', 'weapon2': '1.300', 'weapon3': '1.330', 'DAMAGECOUNT': '2.640', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:48:08,026][2409078] DAMAGECOUNT value on done: 1588.0
[2023-02-25 12:48:08,032][2409078] Sum rewards: 5.673, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.720', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'weapon5': '0.066', 'AMMO3': '0.108', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.384', 'HITCOUNT': '0.610', 'WEAPON3': '0.800', 'weapon2': '1.004', 'weapon3': '1.576', 'DAMAGECOUNT': '2.451', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:48:08,049][2409549] DAMAGECOUNT value on done: 1771.0
[2023-02-25 12:48:08,053][2409549] Sum rewards: 2.958, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO3': '0.030', 'WEAPON4': '0.050', 'weapon7': '0.054', 'AMMO4': '0.066', 'weapon4': '0.084', 'HITCOUNT': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HEALTH': '0.138', 'weapon5': '0.186', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'weapon3': '0.422', 'DAMAGECOUNT': '0.933', 'weapon2': '1.302', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:08,051][2409548] DAMAGECOUNT value on done: 1409.0
[2023-02-25 12:48:08,056][2409548] Sum rewards: 3.187, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.951', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'WEAPON1': '0.010', 'WEAPON4': '0.050', 'weapon4': '0.054', 'AMMO3': '0.107', 'HITCOUNT': '0.390', 'WEAPON3': '0.650', 'ARMOR': '0.911', 'DAMAGECOUNT': '1.272', 'weapon3': '1.632', 'weapon2': '1.846', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:08,079][2409097] DAMAGECOUNT value on done: 1324.0
[2023-02-25 12:48:08,080][2409097] Sum rewards: 4.964, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.517', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'weapon5': '0.124', 'WEAPON4': '0.150', 'weapon4': '0.332', 'HITCOUNT': '0.370', 'WEAPON3': '0.400', 'ARMOR': '0.908', 'DAMAGECOUNT': '1.059', 'weapon3': '1.156', 'weapon2': '1.298', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:08,249][2409565] DAMAGECOUNT value on done: 1418.0
[2023-02-25 12:48:08,252][2409565] Sum rewards: -0.205, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.690', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.086', 'AMMO4': '0.089', 'WEAPON4': '0.200', 'HITCOUNT': '0.270', 'weapon4': '0.624', 'WEAPON3': '0.650', 'ARMOR': '0.852', 'DAMAGECOUNT': '0.951', 'weapon3': '1.240', 'weapon2': '1.636', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:08,287][2409077] DAMAGECOUNT value on done: 1795.0
[2023-02-25 12:48:08,287][2409077] Sum rewards: 2.227, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.616', 'AMMO2': '0.007', 'AMMO5': '0.007', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.036', 'weapon5': '0.054', 'AMMO3': '0.087', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.270', 'weapon4': '0.320', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.999', 'weapon3': '1.444', 'weapon2': '1.550', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:08,356][2409102] DAMAGECOUNT value on done: 1632.0
[2023-02-25 12:48:08,357][2409102] Sum rewards: 1.609, reward structure: {'DEATHCOUNT': '-6.000', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.054', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.129', 'weapon4': '0.226', 'WEAPON5': '0.300', 'WEAPON3': '0.300', 'HITCOUNT': '0.310', 'weapon5': '0.314', 'ARMOR': '0.400', 'FRAGCOUNT': '0.500', 'HEALTH': '0.777', 'DAMAGECOUNT': '1.161', 'weapon3': '1.192', 'weapon2': '1.460'}
[2023-02-25 12:48:08,479][2409076] DAMAGECOUNT value on done: 1256.0
[2023-02-25 12:48:08,668][2409866] DAMAGECOUNT value on done: 1696.0
[2023-02-25 12:48:08,668][2409866] Sum rewards: 0.108, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.578', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO3': '0.074', 'ARMOR': '0.080', 'AMMO4': '0.090', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'HITCOUNT': '0.370', 'WEAPON3': '0.450', 'weapon4': '0.662', 'weapon2': '0.988', 'DAMAGECOUNT': '1.050', 'weapon3': '1.146', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:09,057][2409597] DAMAGECOUNT value on done: 1607.0
[2023-02-25 12:48:09,059][2409597] Sum rewards: 1.648, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.636', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO5': '0.017', 'WEAPON1': '0.050', 'AMMO3': '0.133', 'weapon5': '0.152', 'HITCOUNT': '0.270', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'weapon2': '1.144', 'DAMAGECOUNT': '1.668', 'weapon3': '2.182', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:09,284][2409080] DAMAGECOUNT value on done: 1776.0
[2023-02-25 12:48:09,287][2409080] Sum rewards: 5.398, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.052', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.063', 'weapon5': '0.074', 'AMMO4': '0.086', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.458', 'HITCOUNT': '0.460', 'weapon4': '0.470', 'WEAPON3': '0.500', 'weapon2': '1.120', 'weapon3': '1.420', 'DAMAGECOUNT': '1.551', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:09,351][2409355] DAMAGECOUNT value on done: 2323.0
[2023-02-25 12:48:09,352][2409355] Sum rewards: 5.207, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.308', 'AMMO5': '0.010', 'AMMO2': '0.027', 'WEAPON1': '0.040', 'AMMO3': '0.075', 'weapon5': '0.114', 'AMMO4': '0.137', 'WEAPON5': '0.200', 'HITCOUNT': '0.480', 'WEAPON4': '0.500', 'WEAPON3': '0.550', 'weapon4': '0.996', 'weapon3': '1.034', 'weapon2': '1.260', 'ARMOR': '1.378', 'DAMAGECOUNT': '2.964', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:09,484][2409074] Updated weights for policy 0, policy_version 10771 (0.0012)
[2023-02-25 12:48:09,486][2409596] DAMAGECOUNT value on done: 1661.0
[2023-02-25 12:48:09,487][2409596] Sum rewards: -2.756, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.128', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'HEALTH': '0.150', 'HITCOUNT': '0.220', 'weapon4': '0.274', 'ARMOR': '0.428', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.855', 'FRAGCOUNT': '1.000', 'weapon2': '1.106', 'weapon3': '1.626'}
[2023-02-25 12:48:09,496][2409405] DAMAGECOUNT value on done: 1987.0
[2023-02-25 12:48:09,497][2409405] Sum rewards: 1.633, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.710', 'AMMO4': '-0.058', 'AMMO2': '-0.011', 'AMMO5': '0.008', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'weapon4': '0.072', 'AMMO3': '0.090', 'weapon5': '0.112', 'WEAPON5': '0.250', 'HITCOUNT': '0.280', 'WEAPON3': '0.800', 'weapon2': '1.542', 'DAMAGECOUNT': '1.665', 'weapon3': '1.982', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:48:09,674][2409099] DAMAGECOUNT value on done: 1898.0
[2023-02-25 12:48:09,678][2409099] Sum rewards: -2.126, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.688', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.035', 'WEAPON1': '0.040', 'weapon5': '0.084', 'AMMO3': '0.098', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.318', 'HITCOUNT': '0.340', 'ARMOR': '0.466', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.131', 'weapon2': '1.362', 'weapon3': '1.624'}
[2023-02-25 12:48:09,755][2409033] Signal inference workers to stop experience collection... (1350 times)
[2023-02-25 12:48:09,768][2409033] Signal inference workers to resume experience collection... (1350 times)
[2023-02-25 12:48:09,782][2409074] InferenceWorker_p0-w0: stopping experience collection (1350 times)
[2023-02-25 12:48:09,812][2409074] InferenceWorker_p0-w0: resuming experience collection (1350 times)
[2023-02-25 12:48:09,896][2409100] DAMAGECOUNT value on done: 1614.0
[2023-02-25 12:48:09,897][2409100] Sum rewards: 0.249, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.168', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.019', 'weapon4': '0.032', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.240', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.795', 'ARMOR': '0.872', 'weapon3': '1.160', 'weapon2': '1.398', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:09,978][2409486] DAMAGECOUNT value on done: 1667.0
[2023-02-25 12:48:09,979][2409486] Sum rewards: 1.727, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.184', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.036', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.204', 'HITCOUNT': '0.440', 'WEAPON3': '0.600', 'weapon3': '1.202', 'weapon2': '1.228', 'DAMAGECOUNT': '1.647', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:10,127][2409469] DAMAGECOUNT value on done: 1748.0
[2023-02-25 12:48:10,130][2409469] Sum rewards: 2.216, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.498', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'AMMO3': '0.040', 'AMMO4': '0.064', 'WEAPON4': '0.250', 'HITCOUNT': '0.290', 'WEAPON3': '0.300', 'ARMOR': '0.423', 'weapon4': '0.582', 'weapon3': '0.962', 'DAMAGECOUNT': '0.978', 'weapon2': '1.282', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:10,483][2409373] DAMAGECOUNT value on done: 1854.0
[2023-02-25 12:48:10,486][2409373] Sum rewards: 5.499, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon4': '0.032', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.056', 'AMMO3': '0.060', 'AMMO4': '0.108', 'WEAPON3': '0.400', 'HEALTH': '0.419', 'HITCOUNT': '0.470', 'weapon3': '1.332', 'DAMAGECOUNT': '1.713', 'weapon2': '1.764', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:10,607][2409547] DAMAGECOUNT value on done: 1838.0
[2023-02-25 12:48:10,611][2409547] Sum rewards: 3.526, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.748', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'ARMOR': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'weapon7': '0.062', 'weapon5': '0.070', 'AMMO3': '0.093', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.390', 'WEAPON3': '0.650', 'weapon2': '1.360', 'DAMAGECOUNT': '1.518', 'weapon3': '1.522', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:10,682][2409074] Updated weights for policy 0, policy_version 10781 (0.0012)
[2023-02-25 12:48:10,795][2409101] DAMAGECOUNT value on done: 2182.0
[2023-02-25 12:48:10,796][2409101] Sum rewards: -0.175, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.412', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon5': '0.020', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.139', 'WEAPON4': '0.200', 'weapon4': '0.248', 'HITCOUNT': '0.280', 'ARMOR': '0.461', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.020', 'weapon2': '1.452', 'weapon3': '1.824', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:10,835][2409485] DAMAGECOUNT value on done: 1649.0
[2023-02-25 12:48:10,838][2409485] Sum rewards: 0.665, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.466', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO3': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.212', 'HITCOUNT': '0.440', 'WEAPON3': '0.800', 'ARMOR': '1.299', 'DAMAGECOUNT': '1.470', 'weapon3': '1.676', 'weapon2': '1.838', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:10,947][2409104] DAMAGECOUNT value on done: 1588.0
[2023-02-25 12:48:10,947][2409104] Sum rewards: 3.058, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.140', 'AMMO2': '0.008', 'AMMO5': '0.014', 'weapon4': '0.030', 'AMMO4': '0.040', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'weapon5': '0.178', 'HITCOUNT': '0.280', 'WEAPON5': '0.350', 'ARMOR': '0.454', 'WEAPON3': '0.700', 'weapon2': '1.130', 'DAMAGECOUNT': '1.242', 'weapon3': '2.242', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:10,989][2409105] DAMAGECOUNT value on done: 1590.0
[2023-02-25 12:48:10,993][2409105] Sum rewards: -1.320, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.968', 'AMMO5': '0.015', 'AMMO2': '0.016', 'WEAPON1': '0.040', 'weapon5': '0.060', 'AMMO3': '0.079', 'AMMO4': '0.081', 'WEAPON4': '0.200', 'weapon4': '0.208', 'WEAPON5': '0.250', 'HITCOUNT': '0.430', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.256', 'ARMOR': '1.263', 'DAMAGECOUNT': '1.377', 'weapon2': '1.822'}
[2023-02-25 12:48:10,993][2409075] DAMAGECOUNT value on done: 2239.0
[2023-02-25 12:48:10,996][2409075] Sum rewards: 10.581, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.465', 'AMMO4': '-0.055', 'AMMO2': '-0.011', 'AMMO5': '0.011', 'WEAPON1': '0.030', 'AMMO3': '0.040', 'weapon5': '0.136', 'WEAPON5': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.370', 'ARMOR': '0.443', 'weapon3': '0.926', 'weapon2': '1.382', 'DAMAGECOUNT': '2.223', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:48:11,030][2409103] DAMAGECOUNT value on done: 1963.0
[2023-02-25 12:48:11,032][2409103] Sum rewards: 6.632, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.772', 'AMMO2': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.027', 'AMMO3': '0.050', 'WEAPON4': '0.150', 'weapon4': '0.156', 'weapon5': '0.200', 'WEAPON3': '0.300', 'WEAPON5': '0.300', 'HITCOUNT': '0.390', 'weapon3': '0.806', 'ARMOR': '1.434', 'DAMAGECOUNT': '1.641', 'weapon2': '1.924', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:48:11,044][2409406] DAMAGECOUNT value on done: 1563.0
[2023-02-25 12:48:11,045][2409406] Sum rewards: 2.515, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.066', 'AMMO5': '0.003', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.044', 'ARMOR': '0.056', 'weapon7': '0.062', 'AMMO3': '0.068', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.270', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'weapon2': '0.748', 'weapon4': '0.770', 'DAMAGECOUNT': '0.987', 'weapon3': '1.080', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:11,055][2409389] DAMAGECOUNT value on done: 2050.0
[2023-02-25 12:48:11,059][2409389] Sum rewards: -0.164, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.620', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.056', 'AMMO3': '0.087', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'weapon4': '0.160', 'WEAPON5': '0.200', 'HITCOUNT': '0.340', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.014', 'weapon3': '1.300', 'weapon2': '1.830'}
[2023-02-25 12:48:11,337][2409096] DAMAGECOUNT value on done: 1736.0
[2023-02-25 12:48:11,340][2409096] Sum rewards: 0.622, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.326', 'AMMO5': '0.005', 'weapon4': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'HITCOUNT': '0.390', 'WEAPON3': '0.650', 'ARMOR': '0.917', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.299', 'weapon3': '1.390', 'weapon2': '1.692'}
[2023-02-25 12:48:11,628][2409407] DAMAGECOUNT value on done: 2281.0
[2023-02-25 12:48:11,631][2409407] Sum rewards: 1.445, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.096', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.097', 'weapon5': '0.102', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.250', 'weapon4': '0.370', 'WEAPON3': '0.700', 'ARMOR': '0.895', 'DAMAGECOUNT': '1.221', 'weapon2': '1.310', 'weapon3': '1.360', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:11,653][2409097] DAMAGECOUNT value on done: 1166.0
[2023-02-25 12:48:11,654][2409097] Sum rewards: 2.501, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.040', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.068', 'weapon5': '0.160', 'HITCOUNT': '0.220', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.660', 'weapon3': '1.222', 'weapon2': '1.922', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:11,662][2409079] DAMAGECOUNT value on done: 1458.0
[2023-02-25 12:48:11,668][2409079] Sum rewards: -1.729, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.280', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.052', 'weapon7': '0.056', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.200', 'HITCOUNT': '0.220', 'ARMOR': '0.455', 'WEAPON3': '0.550', 'weapon2': '0.686', 'DAMAGECOUNT': '0.840', 'weapon3': '1.120', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:11,789][2409077] DAMAGECOUNT value on done: 2134.0
[2023-02-25 12:48:11,790][2409077] Sum rewards: -3.495, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.452', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.039', 'weapon5': '0.058', 'WEAPON1': '0.060', 'AMMO3': '0.128', 'AMMO4': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.430', 'weapon4': '0.530', 'weapon2': '0.742', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.284', 'weapon3': '1.876'}
[2023-02-25 12:48:11,880][2409078] DAMAGECOUNT value on done: 1219.0
[2023-02-25 12:48:11,881][2409078] Sum rewards: 0.718, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.573', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.036', 'AMMO4': '0.048', 'AMMO3': '0.054', 'weapon7': '0.066', 'HITCOUNT': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.267', 'weapon4': '0.392', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon2': '1.024', 'weapon3': '1.124'}
[2023-02-25 12:48:12,168][2409549] DAMAGECOUNT value on done: 2120.0
[2023-02-25 12:48:12,186][2408954] Fps is (10 sec: 24576.0, 60 sec: 25326.9, 300 sec: 25561.8). Total num frames: 44191744. Throughput: 0: 6313.9. Samples: 11048448. Policy #0 lag: (min: 1.0, avg: 13.7, max: 28.0)
[2023-02-25 12:48:12,186][2408954] Avg episode reward: [(0, '2.297')]
[2023-02-25 12:48:12,208][2409076] DAMAGECOUNT value on done: 2346.0
[2023-02-25 12:48:12,209][2409076] Sum rewards: 3.300, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.790', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.048', 'WEAPON1': '0.070', 'weapon7': '0.090', 'AMMO4': '0.091', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.156', 'WEAPON4': '0.250', 'HITCOUNT': '0.480', 'weapon4': '0.518', 'weapon2': '0.662', 'ARMOR': '0.925', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.689', 'weapon3': '1.940', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:12,246][2409866] DAMAGECOUNT value on done: 2196.0
[2023-02-25 12:48:12,249][2409866] Sum rewards: 0.526, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.359', 'AMMO2': '0.008', 'weapon7': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.038', 'AMMO3': '0.098', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'DAMAGECOUNT': '0.657', 'WEAPON3': '0.700', 'weapon4': '0.718', 'ARMOR': '0.854', 'weapon2': '1.136', 'weapon3': '1.408', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:12,314][2409548] DAMAGECOUNT value on done: 2174.0
[2023-02-25 12:48:12,315][2409548] Sum rewards: 3.038, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.350', 'AMMO5': '0.015', 'AMMO2': '0.035', 'ARMOR': '0.036', 'WEAPON1': '0.050', 'weapon5': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.143', 'AMMO4': '0.174', 'weapon4': '0.218', 'WEAPON5': '0.300', 'HITCOUNT': '0.530', 'WEAPON3': '0.850', 'weapon2': '1.422', 'weapon3': '1.982', 'DAMAGECOUNT': '2.463', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:12,341][2409074] Updated weights for policy 0, policy_version 10791 (0.0012)
[2023-02-25 12:48:12,580][2409597] DAMAGECOUNT value on done: 2270.0
[2023-02-25 12:48:12,581][2409597] Sum rewards: -0.178, reward structure: {'DEATHCOUNT': '-3.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.410', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.009', 'AMMO3': '0.050', 'weapon5': '0.090', 'WEAPON5': '0.200', 'HITCOUNT': '0.350', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.960', 'weapon3': '1.214', 'weapon2': '1.452'}
[2023-02-25 12:48:12,969][2409355] DAMAGECOUNT value on done: 2046.0
[2023-02-25 12:48:12,971][2409355] Sum rewards: 2.674, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.642', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.128', 'weapon4': '0.254', 'HITCOUNT': '0.490', 'WEAPON3': '0.750', 'ARMOR': '0.871', 'weapon2': '1.442', 'weapon3': '1.592', 'DAMAGECOUNT': '1.797', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:13,059][2409596] DAMAGECOUNT value on done: 1444.0
[2023-02-25 12:48:13,060][2409596] Sum rewards: -2.071, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.832', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.029', 'AMMO3': '0.065', 'weapon5': '0.072', 'AMMO4': '0.145', 'HITCOUNT': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '0.400', 'weapon4': '0.724', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.020', 'weapon3': '1.240', 'weapon2': '1.400'}
[2023-02-25 12:48:13,109][2409080] DAMAGECOUNT value on done: 1758.0
[2023-02-25 12:48:13,110][2409080] Sum rewards: -1.517, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.217', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.046', 'WEAPON1': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.096', 'WEAPON5': '0.150', 'HITCOUNT': '0.350', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.302', 'weapon3': '1.388', 'weapon2': '1.784'}
[2023-02-25 12:48:13,128][2409565] DAMAGECOUNT value on done: 2097.0
[2023-02-25 12:48:13,129][2409565] Sum rewards: -0.811, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.166', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'AMMO3': '0.089', 'weapon5': '0.124', 'AMMO4': '0.134', 'WEAPON5': '0.250', 'HITCOUNT': '0.260', 'WEAPON4': '0.300', 'WEAPON3': '0.600', 'weapon4': '0.670', 'ARMOR': '0.812', 'weapon2': '1.042', 'weapon3': '1.120', 'DAMAGECOUNT': '1.146', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:13,206][2409405] DAMAGECOUNT value on done: 1817.0
[2023-02-25 12:48:13,209][2409405] Sum rewards: 3.719, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.965', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.076', 'weapon7': '0.076', 'AMMO4': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.226', 'WEAPON4': '0.250', 'HITCOUNT': '0.410', 'WEAPON3': '0.450', 'weapon3': '1.108', 'weapon2': '1.542', 'DAMAGECOUNT': '1.905', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:13,228][2409102] DAMAGECOUNT value on done: 1957.0
[2023-02-25 12:48:13,319][2409099] DAMAGECOUNT value on done: 2337.0
[2023-02-25 12:48:13,322][2409099] Sum rewards: 3.118, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.051', 'AMMO5': '0.005', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.032', 'weapon5': '0.068', 'AMMO3': '0.070', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.230', 'WEAPON3': '0.500', 'HITCOUNT': '0.540', 'ARMOR': '0.808', 'weapon3': '1.570', 'weapon2': '1.648', 'DAMAGECOUNT': '1.821', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:13,424][2409100] DAMAGECOUNT value on done: 1097.0
[2023-02-25 12:48:13,425][2409100] Sum rewards: 1.192, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.585', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'weapon5': '0.064', 'AMMO4': '0.071', 'AMMO3': '0.071', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'weapon4': '0.260', 'WEAPON3': '0.550', 'ARMOR': '0.884', 'DAMAGECOUNT': '1.062', 'weapon2': '1.348', 'weapon3': '1.468', 'FRAGCOUNT': '1.500'}
[2023-02-25 12:48:13,570][2409486] DAMAGECOUNT value on done: 1193.0
[2023-02-25 12:48:13,571][2409486] Sum rewards: -1.744, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.190', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.010', 'AMMO3': '0.053', 'weapon7': '0.064', 'weapon5': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.140', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.345', 'weapon4': '0.524', 'weapon3': '0.678', 'ARMOR': '0.889', 'weapon2': '1.174'}
[2023-02-25 12:48:13,907][2409074] Updated weights for policy 0, policy_version 10801 (0.0012)
[2023-02-25 12:48:14,037][2409469] DAMAGECOUNT value on done: 2095.0
[2023-02-25 12:48:14,038][2409469] Sum rewards: 6.383, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.630', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'weapon5': '0.002', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon7': '0.056', 'AMMO3': '0.067', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.386', 'WEAPON3': '0.400', 'HITCOUNT': '0.430', 'ARMOR': '0.482', 'weapon3': '1.062', 'weapon2': '1.238', 'DAMAGECOUNT': '1.461', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:48:14,405][2409373] DAMAGECOUNT value on done: 2602.0
[2023-02-25 12:48:14,405][2409373] Sum rewards: 2.087, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.955', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.032', 'weapon5': '0.036', 'weapon4': '0.066', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.440', 'ARMOR': '0.453', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.260', 'weapon3': '1.472', 'weapon2': '1.616', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:14,512][2409547] DAMAGECOUNT value on done: 2555.0
[2023-02-25 12:48:14,514][2409547] Sum rewards: 1.212, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.088', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.021', 'WEAPON1': '0.030', 'weapon5': '0.056', 'AMMO3': '0.060', 'WEAPON5': '0.150', 'HITCOUNT': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.245', 'weapon3': '1.366', 'weapon2': '1.510'}
[2023-02-25 12:48:14,549][2409406] DAMAGECOUNT value on done: 1471.0
[2023-02-25 12:48:14,553][2409406] Sum rewards: 2.906, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.995', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.048', 'weapon7': '0.078', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.286', 'HITCOUNT': '0.400', 'WEAPON3': '0.600', 'ARMOR': '0.889', 'DAMAGECOUNT': '1.083', 'weapon3': '1.220', 'weapon2': '1.476', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:14,766][2409485] DAMAGECOUNT value on done: 1415.0
[2023-02-25 12:48:14,770][2409485] Sum rewards: 4.327, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.915', 'AMMO5': '0.007', 'AMMO2': '0.030', 'WEAPON1': '0.050', 'weapon5': '0.052', 'AMMO3': '0.063', 'WEAPON4': '0.150', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'weapon4': '0.296', 'ARMOR': '0.428', 'HITCOUNT': '0.460', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.416', 'weapon3': '1.446', 'weapon2': '1.942', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:14,824][2409101] DAMAGECOUNT value on done: 2258.0
[2023-02-25 12:48:14,825][2409101] Sum rewards: 4.778, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.101', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.014', 'WEAPON1': '0.020', 'AMMO3': '0.061', 'weapon5': '0.252', 'weapon4': '0.290', 'WEAPON4': '0.300', 'HITCOUNT': '0.360', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'ARMOR': '0.519', 'weapon3': '1.038', 'weapon2': '1.954', 'DAMAGECOUNT': '2.208', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:14,829][2409075] DAMAGECOUNT value on done: 1927.0
[2023-02-25 12:48:14,833][2409075] Sum rewards: -5.257, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.686', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon4': '0.084', 'weapon5': '0.096', 'AMMO4': '0.102', 'AMMO3': '0.139', 'HITCOUNT': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'ARMOR': '0.496', 'DAMAGECOUNT': '0.846', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.238', 'weapon3': '2.050'}
[2023-02-25 12:48:14,873][2409389] DAMAGECOUNT value on done: 1737.0
[2023-02-25 12:48:14,874][2409389] Sum rewards: 4.593, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.218', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'weapon5': '0.062', 'AMMO3': '0.066', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.364', 'WEAPON3': '0.450', 'HITCOUNT': '0.530', 'ARMOR': '0.812', 'weapon3': '1.304', 'weapon2': '1.778', 'DAMAGECOUNT': '2.007', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:14,887][2409103] DAMAGECOUNT value on done: 1758.0
[2023-02-25 12:48:14,887][2409103] Sum rewards: 1.043, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.402', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.006', 'WEAPON1': '0.040', 'AMMO3': '0.064', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.262', 'HITCOUNT': '0.340', 'ARMOR': '0.428', 'WEAPON3': '0.550', 'weapon2': '0.970', 'DAMAGECOUNT': '1.257', 'weapon3': '1.456', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:14,912][2409104] DAMAGECOUNT value on done: 2253.0
[2023-02-25 12:48:14,912][2409104] Sum rewards: -1.684, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.150', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.186', 'HITCOUNT': '0.290', 'WEAPON4': '0.350', 'weapon4': '0.598', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.870', 'ARMOR': '0.883', 'weapon2': '0.980', 'weapon3': '1.476', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:15,010][2409105] DAMAGECOUNT value on done: 2295.0
[2023-02-25 12:48:15,021][2409105] Sum rewards: 3.696, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.070', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon4': '0.266', 'HITCOUNT': '0.550', 'WEAPON3': '0.700', 'weapon3': '1.272', 'DAMAGECOUNT': '1.680', 'weapon2': '1.738', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:15,104][2409096] DAMAGECOUNT value on done: 1830.0
[2023-02-25 12:48:15,107][2409096] Sum rewards: 1.631, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.414', 'ARMOR': '0.008', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.070', 'AMMO3': '0.103', 'WEAPON4': '0.250', 'HITCOUNT': '0.380', 'weapon4': '0.668', 'WEAPON3': '0.750', 'weapon2': '1.020', 'DAMAGECOUNT': '1.434', 'weapon3': '1.828', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:15,272][2409407] DAMAGECOUNT value on done: 1604.0
[2023-02-25 12:48:15,276][2409407] Sum rewards: 2.043, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.686', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'weapon5': '0.030', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'AMMO4': '0.174', 'weapon4': '0.240', 'WEAPON4': '0.300', 'HITCOUNT': '0.430', 'ARMOR': '0.470', 'WEAPON3': '0.700', 'weapon3': '1.678', 'weapon2': '1.754', 'DAMAGECOUNT': '2.163', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:15,308][2409077] DAMAGECOUNT value on done: 1826.0
[2023-02-25 12:48:15,309][2409077] Sum rewards: 0.079, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.668', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'ARMOR': '0.020', 'AMMO4': '0.066', 'AMMO3': '0.089', 'WEAPON4': '0.150', 'HITCOUNT': '0.350', 'weapon4': '0.404', 'WEAPON3': '0.500', 'weapon2': '1.178', 'DAMAGECOUNT': '1.326', 'weapon3': '1.390', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:15,356][2409079] DAMAGECOUNT value on done: 1682.0
[2023-02-25 12:48:15,360][2409079] Sum rewards: 4.800, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.012', 'weapon4': '0.018', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'HEALTH': '0.142', 'WEAPON3': '0.350', 'HITCOUNT': '0.380', 'ARMOR': '0.453', 'DAMAGECOUNT': '1.230', 'weapon3': '1.424', 'weapon2': '1.816', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:15,510][2409097] DAMAGECOUNT value on done: 1698.0
[2023-02-25 12:48:15,511][2409097] Sum rewards: -6.792, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.420', 'AMMO5': '0.007', 'weapon5': '0.036', 'AMMO2': '0.040', 'AMMO3': '0.073', 'WEAPON5': '0.150', 'AMMO4': '0.199', 'HITCOUNT': '0.260', 'WEAPON3': '0.450', 'ARMOR': '0.474', 'FRAGCOUNT': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.768', 'weapon3': '0.888', 'DAMAGECOUNT': '0.891', 'weapon2': '1.542'}
[2023-02-25 12:48:15,513][2409078] DAMAGECOUNT value on done: 1656.0
[2023-02-25 12:48:15,514][2409078] Sum rewards: 4.636, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.870', 'AMMO2': '0.009', 'AMMO5': '0.013', 'WEAPON1': '0.030', 'AMMO4': '0.046', 'AMMO3': '0.103', 'weapon5': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.300', 'weapon4': '0.432', 'WEAPON3': '0.700', 'ARMOR': '0.872', 'weapon3': '1.242', 'weapon2': '1.276', 'DAMAGECOUNT': '1.560', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:48:15,828][2409074] Updated weights for policy 0, policy_version 10811 (0.0012)
[2023-02-25 12:48:15,933][2409548] DAMAGECOUNT value on done: 2008.0
[2023-02-25 12:48:15,934][2409548] Sum rewards: 0.873, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.330', 'AMMO2': '0.002', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO4': '0.010', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.090', 'WEAPON4': '0.200', 'weapon4': '0.318', 'HITCOUNT': '0.340', 'ARMOR': '0.488', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.200', 'weapon2': '1.438', 'weapon3': '1.688', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:15,982][2409549] DAMAGECOUNT value on done: 1857.0
[2023-02-25 12:48:15,983][2409549] Sum rewards: 1.677, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.782', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon7': '0.058', 'AMMO3': '0.063', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.136', 'WEAPON4': '0.200', 'HITCOUNT': '0.230', 'weapon4': '0.384', 'ARMOR': '0.412', 'WEAPON3': '0.500', 'weapon2': '0.886', 'DAMAGECOUNT': '0.891', 'weapon3': '1.352', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:16,071][2409076] DAMAGECOUNT value on done: 2002.0
[2023-02-25 12:48:16,072][2409076] Sum rewards: 0.647, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.208', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'AMMO3': '0.086', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'weapon4': '0.222', 'HITCOUNT': '0.390', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.203', 'weapon2': '1.310', 'weapon3': '1.512', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:16,144][2409866] DAMAGECOUNT value on done: 1405.0
[2023-02-25 12:48:16,145][2409866] Sum rewards: -0.034, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.450', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon5': '0.070', 'AMMO3': '0.096', 'HITCOUNT': '0.120', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.310', 'DAMAGECOUNT': '0.495', 'weapon2': '0.558', 'WEAPON3': '0.600', 'ARMOR': '0.933', 'weapon3': '1.708', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:16,759][2409597] DAMAGECOUNT value on done: 1768.0
[2023-02-25 12:48:16,762][2409597] Sum rewards: -1.550, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.638', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.102', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'weapon4': '0.204', 'HITCOUNT': '0.360', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.104', 'weapon2': '1.208', 'weapon3': '1.662', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:16,869][2409355] DAMAGECOUNT value on done: 2019.0
[2023-02-25 12:48:16,873][2409355] Sum rewards: -1.336, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.818', 'FRAGCOUNT': '0.000', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON1': '0.040', 'weapon5': '0.050', 'weapon7': '0.064', 'AMMO3': '0.066', 'AMMO4': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'HITCOUNT': '0.340', 'WEAPON3': '0.450', 'weapon4': '0.616', 'ARMOR': '0.957', 'weapon2': '1.058', 'DAMAGECOUNT': '1.203', 'weapon3': '1.348'}
[2023-02-25 12:48:16,909][2409405] DAMAGECOUNT value on done: 1932.0
[2023-02-25 12:48:16,910][2409405] Sum rewards: 0.229, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.920', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.007', 'weapon4': '0.020', 'weapon5': '0.024', 'ARMOR': '0.028', 'WEAPON1': '0.030', 'AMMO3': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.360', 'WEAPON3': '0.400', 'weapon3': '0.964', 'DAMAGECOUNT': '0.990', 'weapon2': '1.262', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:17,017][2409100] DAMAGECOUNT value on done: 1900.0
[2023-02-25 12:48:17,018][2409100] Sum rewards: 4.383, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.102', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'weapon4': '0.016', 'AMMO4': '0.040', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'weapon5': '0.106', 'WEAPON5': '0.150', 'HITCOUNT': '0.300', 'ARMOR': '0.452', 'WEAPON3': '0.600', 'weapon3': '1.182', 'DAMAGECOUNT': '1.320', 'weapon2': '1.604', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:17,052][2409565] DAMAGECOUNT value on done: 1845.0
[2023-02-25 12:48:17,052][2409565] Sum rewards: 4.969, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.344', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO3': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'HITCOUNT': '0.170', 'weapon5': '0.188', 'WEAPON4': '0.200', 'weapon4': '0.214', 'WEAPON3': '0.400', 'ARMOR': '0.800', 'weapon3': '0.874', 'weapon2': '1.306', 'DAMAGECOUNT': '1.344', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:17,109][2409102] DAMAGECOUNT value on done: 2020.0
[2023-02-25 12:48:17,112][2409102] Sum rewards: 4.435, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.362', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.075', 'weapon5': '0.140', 'WEAPON5': '0.150', 'ARMOR': '0.400', 'HITCOUNT': '0.490', 'WEAPON3': '0.550', 'weapon2': '1.422', 'weapon3': '1.514', 'DAMAGECOUNT': '1.728', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:17,186][2409099] DAMAGECOUNT value on done: 1667.0
[2023-02-25 12:48:17,186][2408954] Fps is (10 sec: 24166.7, 60 sec: 25190.5, 300 sec: 25520.2). Total num frames: 44314624. Throughput: 0: 6316.8. Samples: 11086584. Policy #0 lag: (min: 0.0, avg: 12.6, max: 27.0)
[2023-02-25 12:48:17,186][2408954] Avg episode reward: [(0, '1.633')]
[2023-02-25 12:48:17,187][2409099] Sum rewards: 6.718, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.090', 'AMMO5': '0.010', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.051', 'AMMO3': '0.070', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.204', 'weapon4': '0.232', 'WEAPON3': '0.400', 'ARMOR': '0.404', 'HITCOUNT': '0.550', 'weapon3': '1.282', 'weapon2': '1.742', 'DAMAGECOUNT': '1.932', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:17,191][2409033] Saving /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000010819_44314624.pth...
[2023-02-25 12:48:17,255][2409596] DAMAGECOUNT value on done: 1986.0
[2023-02-25 12:48:17,259][2409596] Sum rewards: 0.272, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.440', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.100', 'ARMOR': '0.436', 'WEAPON3': '0.450', 'HITCOUNT': '0.460', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.287', 'weapon3': '1.554', 'weapon2': '1.782'}
[2023-02-25 12:48:17,294][2409033] Removing /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000009323_38187008.pth
[2023-02-25 12:48:17,403][2409486] DAMAGECOUNT value on done: 1350.0
[2023-02-25 12:48:17,407][2409486] Sum rewards: 2.617, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.247', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.066', 'weapon5': '0.082', 'AMMO3': '0.087', 'WEAPON5': '0.150', 'HITCOUNT': '0.420', 'WEAPON3': '0.650', 'ARMOR': '0.856', 'weapon3': '1.480', 'weapon2': '1.602', 'DAMAGECOUNT': '1.656', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:17,412][2409074] Updated weights for policy 0, policy_version 10821 (0.0013)
[2023-02-25 12:48:17,599][2409080] DAMAGECOUNT value on done: 2208.0
[2023-02-25 12:48:17,603][2409080] Sum rewards: 5.260, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.671', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.033', 'weapon7': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.053', 'weapon5': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.450', 'weapon4': '0.460', 'ARMOR': '0.470', 'HITCOUNT': '0.530', 'weapon3': '1.058', 'weapon2': '1.650', 'DAMAGECOUNT': '1.848', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:17,863][2409373] DAMAGECOUNT value on done: 2840.0
[2023-02-25 12:48:17,864][2409373] Sum rewards: 8.220, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.105', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.042', 'weapon4': '0.064', 'AMMO3': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON6': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.104', 'weapon6': '0.248', 'WEAPON5': '0.250', 'HITCOUNT': '0.390', 'ARMOR': '0.416', 'WEAPON3': '0.500', 'weapon2': '1.006', 'weapon3': '1.590', 'DAMAGECOUNT': '1.722', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:48:18,021][2409469] DAMAGECOUNT value on done: 1769.0
[2023-02-25 12:48:18,022][2409469] Sum rewards: 4.325, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.370', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'WEAPON1': '0.020', 'AMMO3': '0.060', 'WEAPON3': '0.400', 'HITCOUNT': '0.430', 'ARMOR': '0.453', 'DAMAGECOUNT': '1.380', 'weapon3': '1.392', 'weapon2': '1.620', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:18,116][2409406] DAMAGECOUNT value on done: 1965.0
[2023-02-25 12:48:18,119][2409406] Sum rewards: -3.693, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.764', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.026', 'AMMO2': '0.041', 'AMMO3': '0.104', 'WEAPON5': '0.150', 'AMMO4': '0.203', 'weapon4': '0.344', 'HITCOUNT': '0.430', 'WEAPON4': '0.450', 'WEAPON3': '0.650', 'ARMOR': '0.832', 'DAMAGECOUNT': '1.170', 'weapon3': '1.360', 'weapon2': '1.544', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:18,163][2409547] DAMAGECOUNT value on done: 1696.0
[2023-02-25 12:48:18,164][2409547] Sum rewards: -1.083, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.265', 'AMMO2': '0.015', 'AMMO5': '0.016', 'WEAPON1': '0.040', 'AMMO4': '0.072', 'AMMO3': '0.086', 'weapon5': '0.098', 'WEAPON4': '0.150', 'weapon4': '0.294', 'HITCOUNT': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'ARMOR': '0.800', 'weapon2': '1.140', 'weapon3': '1.568', 'DAMAGECOUNT': '1.653', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:18,459][2409075] DAMAGECOUNT value on done: 2279.0
[2023-02-25 12:48:18,463][2409075] Sum rewards: 3.145, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.710', 'AMMO2': '0.004', 'AMMO5': '0.012', 'AMMO4': '0.019', 'weapon5': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'weapon4': '0.180', 'WEAPON5': '0.300', 'HITCOUNT': '0.560', 'WEAPON3': '0.750', 'ARMOR': '0.881', 'weapon2': '1.112', 'weapon3': '2.328', 'DAMAGECOUNT': '2.412', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:18,493][2409389] DAMAGECOUNT value on done: 2598.0
[2023-02-25 12:48:18,494][2409389] Sum rewards: 1.678, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.306', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'WEAPON4': '0.050', 'weapon4': '0.072', 'AMMO3': '0.087', 'HITCOUNT': '0.600', 'WEAPON3': '0.700', 'weapon3': '1.566', 'DAMAGECOUNT': '1.782', 'weapon2': '1.872', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:18,628][2409074] Updated weights for policy 0, policy_version 10831 (0.0012)
[2023-02-25 12:48:18,633][2409485] DAMAGECOUNT value on done: 1658.0
[2023-02-25 12:48:18,635][2409485] Sum rewards: 2.876, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.734', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'weapon7': '0.002', 'AMMO5': '0.005', 'AMMO3': '0.089', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.420', 'WEAPON3': '0.600', 'ARMOR': '0.858', 'DAMAGECOUNT': '1.224', 'weapon3': '1.528', 'weapon2': '1.750', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:18,725][2409103] DAMAGECOUNT value on done: 2216.0
[2023-02-25 12:48:18,725][2409103] Sum rewards: -0.794, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.324', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.012', 'WEAPON1': '0.020', 'ARMOR': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'weapon4': '0.414', 'HITCOUNT': '0.670', 'WEAPON3': '1.050', 'weapon3': '1.656', 'weapon2': '1.668', 'DAMAGECOUNT': '2.349', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:18,757][2409101] DAMAGECOUNT value on done: 2120.0
[2023-02-25 12:48:18,757][2409101] Sum rewards: 3.498, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.130', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.099', 'weapon5': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.260', 'weapon4': '0.366', 'ARMOR': '0.464', 'WEAPON3': '0.750', 'weapon3': '1.510', 'weapon2': '1.634', 'DAMAGECOUNT': '2.043', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:18,773][2409104] DAMAGECOUNT value on done: 1581.0
[2023-02-25 12:48:18,875][2409077] DAMAGECOUNT value on done: 2298.0
[2023-02-25 12:48:18,878][2409077] Sum rewards: 3.322, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.024', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon7': '0.048', 'AMMO3': '0.052', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.260', 'WEAPON4': '0.300', 'WEAPON3': '0.300', 'weapon4': '0.410', 'ARMOR': '0.434', 'weapon2': '1.022', 'weapon3': '1.284', 'DAMAGECOUNT': '1.932', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:48:18,952][2409105] DAMAGECOUNT value on done: 2058.0
[2023-02-25 12:48:18,953][2409105] Sum rewards: 5.422, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.388', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'weapon5': '0.176', 'WEAPON5': '0.200', 'HITCOUNT': '0.330', 'ARMOR': '0.400', 'weapon4': '0.442', 'WEAPON3': '0.450', 'weapon3': '1.190', 'weapon2': '1.340', 'DAMAGECOUNT': '1.425', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:19,158][2409096] DAMAGECOUNT value on done: 2161.0
[2023-02-25 12:48:19,159][2409096] Sum rewards: 6.145, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.512', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO4': '0.049', 'weapon5': '0.054', 'AMMO3': '0.070', 'weapon4': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.360', 'ARMOR': '0.446', 'WEAPON3': '0.550', 'weapon3': '1.256', 'weapon2': '1.526', 'DAMAGECOUNT': '1.641', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:48:19,256][2409097] DAMAGECOUNT value on done: 1840.0
[2023-02-25 12:48:19,257][2409097] Sum rewards: 4.040, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.410', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.022', 'AMMO3': '0.050', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'weapon7': '0.118', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.300', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'HITCOUNT': '0.450', 'weapon2': '0.470', 'weapon4': '0.682', 'weapon3': '0.938', 'DAMAGECOUNT': '1.380', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:19,367][2409078] DAMAGECOUNT value on done: 1424.0
[2023-02-25 12:48:19,368][2409078] Sum rewards: -4.182, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.394', 'AMMO5': '0.013', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'weapon5': '0.022', 'ARMOR': '0.032', 'AMMO4': '0.071', 'AMMO3': '0.132', 'WEAPON5': '0.250', 'HITCOUNT': '0.260', 'WEAPON4': '0.300', 'weapon4': '0.432', 'DAMAGECOUNT': '0.810', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.294', 'weapon3': '1.712'}
[2023-02-25 12:48:19,455][2409468] DAMAGECOUNT value on done: 2078.0
[2023-02-25 12:48:19,458][2409468] Sum rewards: 5.272, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'WEAPON1': '0.060', 'AMMO4': '0.065', 'weapon5': '0.070', 'weapon4': '0.090', 'WEAPON5': '0.150', 'HEALTH': '0.202', 'HITCOUNT': '0.250', 'WEAPON3': '0.400', 'DAMAGECOUNT': '1.365', 'weapon2': '1.476', 'weapon3': '1.514', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:19,478][2409548] DAMAGECOUNT value on done: 1439.0
[2023-02-25 12:48:19,481][2409548] Sum rewards: 2.286, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.950', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO3': '0.053', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.350', 'WEAPON3': '0.450', 'weapon3': '1.196', 'DAMAGECOUNT': '1.245', 'weapon2': '1.420', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:19,499][2409407] DAMAGECOUNT value on done: 1321.0
[2023-02-25 12:48:19,500][2409407] Sum rewards: -0.779, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.272', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.112', 'AMMO4': '0.187', 'HITCOUNT': '0.230', 'WEAPON4': '0.400', 'ARMOR': '0.550', 'weapon4': '0.582', 'DAMAGECOUNT': '0.618', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.164', 'weapon2': '1.342'}
[2023-02-25 12:48:19,639][2409079] DAMAGECOUNT value on done: 1912.0
[2023-02-25 12:48:19,640][2409079] Sum rewards: 2.963, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.559', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.059', 'weapon5': '0.120', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.368', 'ARMOR': '0.455', 'HITCOUNT': '0.550', 'WEAPON3': '1.000', 'weapon2': '1.300', 'weapon3': '1.788', 'DAMAGECOUNT': '2.778', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:48:19,825][2409866] DAMAGECOUNT value on done: 2253.0
[2023-02-25 12:48:19,827][2409866] Sum rewards: 3.739, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.316', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'weapon5': '0.142', 'WEAPON5': '0.200', 'weapon4': '0.200', 'HITCOUNT': '0.280', 'WEAPON3': '0.500', 'ARMOR': '0.940', 'weapon2': '1.156', 'weapon3': '1.440', 'DAMAGECOUNT': '1.458', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:19,907][2409076] DAMAGECOUNT value on done: 1957.0
[2023-02-25 12:48:19,910][2409076] Sum rewards: 1.411, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.522', 'AMMO2': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.059', 'AMMO3': '0.082', 'weapon5': '0.106', 'weapon4': '0.130', 'WEAPON4': '0.150', 'HITCOUNT': '0.230', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.843', 'weapon3': '1.374', 'weapon2': '1.612', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:19,998][2409549] DAMAGECOUNT value on done: 1746.0
[2023-02-25 12:48:19,999][2409549] Sum rewards: 2.611, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.292', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.030', 'weapon4': '0.032', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'weapon5': '0.076', 'AMMO3': '0.093', 'WEAPON5': '0.200', 'HITCOUNT': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.837', 'weapon3': '1.476', 'weapon2': '1.550', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:20,575][2409405] DAMAGECOUNT value on done: 1839.0
[2023-02-25 12:48:20,579][2409405] Sum rewards: 2.064, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.032', 'AMMO3': '0.044', 'weapon5': '0.060', 'WEAPON5': '0.100', 'HEALTH': '0.133', 'WEAPON4': '0.150', 'AMMO4': '0.161', 'weapon4': '0.208', 'WEAPON3': '0.250', 'HITCOUNT': '0.340', 'weapon3': '0.874', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.053', 'weapon2': '1.396'}
[2023-02-25 12:48:20,625][2409074] Updated weights for policy 0, policy_version 10841 (0.0012)
[2023-02-25 12:48:20,728][2409355] DAMAGECOUNT value on done: 2175.0
[2023-02-25 12:48:20,729][2409355] Sum rewards: 3.421, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.143', 'AMMO5': '0.008', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.060', 'WEAPON1': '0.060', 'weapon7': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.170', 'weapon4': '0.220', 'WEAPON5': '0.300', 'HITCOUNT': '0.360', 'WEAPON3': '0.500', 'weapon3': '1.374', 'DAMAGECOUNT': '1.458', 'weapon2': '1.562', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:20,762][2409565] DAMAGECOUNT value on done: 1834.0
[2023-02-25 12:48:20,765][2409565] Sum rewards: 6.107, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.510', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'AMMO4': '0.062', 'AMMO3': '0.074', 'WEAPON4': '0.100', 'weapon4': '0.112', 'weapon5': '0.142', 'WEAPON5': '0.200', 'HITCOUNT': '0.370', 'WEAPON3': '0.500', 'weapon2': '1.300', 'DAMAGECOUNT': '1.578', 'weapon3': '1.628', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:20,810][2409102] DAMAGECOUNT value on done: 1674.0
[2023-02-25 12:48:20,813][2409102] Sum rewards: 3.561, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.358', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'WEAPON5': '0.150', 'weapon4': '0.210', 'HITCOUNT': '0.460', 'WEAPON3': '0.650', 'ARMOR': '0.900', 'weapon3': '1.698', 'DAMAGECOUNT': '1.701', 'weapon2': '1.818', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:21,004][2409597] DAMAGECOUNT value on done: 1180.0
[2023-02-25 12:48:21,008][2409597] Sum rewards: -0.144, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.544', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'weapon5': '0.060', 'AMMO3': '0.081', 'WEAPON5': '0.100', 'HITCOUNT': '0.250', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.777', 'FRAGCOUNT': '1.000', 'weapon2': '1.736', 'weapon3': '1.736'}
[2023-02-25 12:48:21,056][2409596] DAMAGECOUNT value on done: 1598.0
[2023-02-25 12:48:21,057][2409596] Sum rewards: 3.827, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.008', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'AMMO3': '0.052', 'weapon5': '0.054', 'weapon7': '0.068', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.141', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.212', 'HITCOUNT': '0.240', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.888', 'ARMOR': '0.905', 'weapon3': '1.016', 'weapon2': '1.318', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:21,229][2409099] DAMAGECOUNT value on done: 1559.0
[2023-02-25 12:48:21,234][2409099] Sum rewards: -1.486, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.428', 'AMMO4': '-0.075', 'AMMO2': '-0.015', 'AMMO5': '0.005', 'weapon5': '0.006', 'WEAPON1': '0.040', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'weapon4': '0.202', 'HITCOUNT': '0.400', 'ARMOR': '0.464', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.209', 'weapon2': '1.270', 'weapon3': '1.914'}
[2023-02-25 12:48:21,445][2409486] DAMAGECOUNT value on done: 1637.0
[2023-02-25 12:48:21,446][2409486] Sum rewards: 0.654, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.995', 'AMMO4': '-0.068', 'AMMO2': '-0.013', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'weapon4': '0.164', 'HITCOUNT': '0.210', 'ARMOR': '0.456', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.780', 'weapon3': '1.158', 'weapon2': '1.318', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:21,654][2409080] DAMAGECOUNT value on done: 1956.0
[2023-02-25 12:48:21,655][2409080] Sum rewards: 1.957, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.056', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.016', 'WEAPON5': '0.050', 'AMMO3': '0.062', 'ARMOR': '0.426', 'WEAPON3': '0.450', 'HITCOUNT': '0.500', 'weapon2': '1.420', 'weapon3': '1.448', 'DAMAGECOUNT': '1.623', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:21,783][2409373] DAMAGECOUNT value on done: 1690.0
[2023-02-25 12:48:21,783][2409373] Sum rewards: 1.790, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.335', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'WEAPON4': '0.250', 'weapon4': '0.344', 'ARMOR': '0.432', 'HITCOUNT': '0.440', 'WEAPON3': '0.550', 'weapon2': '1.186', 'weapon3': '1.354', 'DAMAGECOUNT': '1.488', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:21,851][2409406] DAMAGECOUNT value on done: 999.0
[2023-02-25 12:48:21,851][2409406] Sum rewards: -5.940, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.737', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.069', 'AMMO3': '0.107', 'HITCOUNT': '0.150', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.369', 'ARMOR': '0.432', 'WEAPON4': '0.450', 'WEAPON3': '0.700', 'weapon4': '0.784', 'FRAGCOUNT': '1.000', 'weapon3': '1.028', 'weapon2': '1.264'}
[2023-02-25 12:48:21,903][2409547] DAMAGECOUNT value on done: 1828.0
[2023-02-25 12:48:21,906][2409469] DAMAGECOUNT value on done: 1649.0
[2023-02-25 12:48:21,913][2409469] Sum rewards: 4.864, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.130', 'AMMO2': '0.006', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.027', 'AMMO3': '0.061', 'WEAPON4': '0.100', 'weapon5': '0.182', 'WEAPON5': '0.250', 'HITCOUNT': '0.360', 'ARMOR': '0.454', 'WEAPON3': '0.500', 'weapon2': '1.156', 'weapon3': '1.266', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:21,988][2409074] Updated weights for policy 0, policy_version 10851 (0.0013)
[2023-02-25 12:48:22,186][2408954] Fps is (10 sec: 26214.4, 60 sec: 25395.2, 300 sec: 25561.8). Total num frames: 44453888. Throughput: 0: 6323.5. Samples: 11105940. Policy #0 lag: (min: 1.0, avg: 11.2, max: 25.0)
[2023-02-25 12:48:22,186][2408954] Avg episode reward: [(0, '1.699')]
[2023-02-25 12:48:22,319][2409075] DAMAGECOUNT value on done: 1527.0
[2023-02-25 12:48:22,322][2409075] Sum rewards: 2.995, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.003', 'AMMO2': '0.018', 'AMMO3': '0.040', 'WEAPON1': '0.040', 'AMMO4': '0.088', 'weapon4': '0.168', 'WEAPON4': '0.200', 'HITCOUNT': '0.280', 'WEAPON3': '0.300', 'ARMOR': '0.808', 'DAMAGECOUNT': '0.846', 'weapon3': '0.976', 'weapon2': '1.734', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:22,332][2409389] DAMAGECOUNT value on done: 1631.0
[2023-02-25 12:48:22,333][2409389] Sum rewards: -3.189, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.930', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.014', 'weapon5': '0.032', 'WEAPON1': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'weapon4': '0.220', 'HITCOUNT': '0.250', 'ARMOR': '0.408', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.900', 'weapon2': '1.374', 'weapon3': '1.392'}
[2023-02-25 12:48:22,643][2409101] DAMAGECOUNT value on done: 1528.0
[2023-02-25 12:48:22,646][2409101] Sum rewards: -2.271, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.250', 'WEAPON1': '0.020', 'AMMO2': '0.037', 'AMMO3': '0.066', 'AMMO4': '0.184', 'HITCOUNT': '0.240', 'ARMOR': '0.436', 'WEAPON4': '0.450', 'WEAPON3': '0.450', 'weapon4': '0.450', 'DAMAGECOUNT': '0.648', 'FRAGCOUNT': '1.000', 'weapon3': '1.232', 'weapon2': '1.266'}
[2023-02-25 12:48:22,693][2409077] DAMAGECOUNT value on done: 1986.0
[2023-02-25 12:48:22,694][2409077] Sum rewards: 0.761, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.440', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'WEAPON1': '0.010', 'AMMO3': '0.082', 'WEAPON4': '0.200', 'weapon4': '0.218', 'HITCOUNT': '0.330', 'ARMOR': '0.468', 'WEAPON3': '0.600', 'weapon3': '0.908', 'DAMAGECOUNT': '1.155', 'weapon2': '1.498', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:22,712][2409104] DAMAGECOUNT value on done: 1627.0
[2023-02-25 12:48:22,713][2409104] Sum rewards: -1.738, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.403', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON1': '0.060', 'AMMO3': '0.082', 'WEAPON4': '0.200', 'weapon4': '0.256', 'HITCOUNT': '0.390', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.230', 'weapon3': '1.802', 'weapon2': '1.814'}
[2023-02-25 12:48:22,778][2409097] DAMAGECOUNT value on done: 1743.0
[2023-02-25 12:48:22,781][2409097] Sum rewards: 1.912, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.295', 'AMMO2': '0.006', 'AMMO5': '0.007', 'ARMOR': '0.008', 'WEAPON1': '0.030', 'AMMO4': '0.030', 'AMMO3': '0.106', 'weapon5': '0.168', 'WEAPON5': '0.200', 'HITCOUNT': '0.270', 'WEAPON3': '0.650', 'weapon3': '1.274', 'DAMAGECOUNT': '1.275', 'weapon2': '1.932', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:22,796][2409485] DAMAGECOUNT value on done: 2229.0
[2023-02-25 12:48:22,799][2409485] Sum rewards: 1.111, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.528', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.032', 'WEAPON1': '0.050', 'weapon5': '0.068', 'AMMO3': '0.132', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.396', 'ARMOR': '0.457', 'HITCOUNT': '0.630', 'WEAPON3': '0.950', 'weapon2': '1.270', 'weapon3': '1.920', 'DAMAGECOUNT': '2.520', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:48:22,945][2409096] DAMAGECOUNT value on done: 1881.0
[2023-02-25 12:48:22,945][2409096] Sum rewards: 3.555, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.282', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.029', 'WEAPON1': '0.060', 'AMMO3': '0.083', 'WEAPON4': '0.150', 'HITCOUNT': '0.200', 'weapon5': '0.268', 'weapon4': '0.430', 'ARMOR': '0.436', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon3': '0.846', 'DAMAGECOUNT': '1.038', 'weapon2': '1.526', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:23,018][2409105] DAMAGECOUNT value on done: 1581.0
[2023-02-25 12:48:23,019][2409105] Sum rewards: 0.065, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.880', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.042', 'weapon5': '0.068', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.154', 'HITCOUNT': '0.390', 'ARMOR': '0.404', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.960', 'FRAGCOUNT': '1.000', 'weapon3': '1.562', 'weapon2': '2.090'}
[2023-02-25 12:48:23,156][2409407] DAMAGECOUNT value on done: 2087.0
[2023-02-25 12:48:23,157][2409407] Sum rewards: 7.368, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.195', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'weapon7': '0.048', 'WEAPON5': '0.050', 'weapon5': '0.078', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.220', 'HITCOUNT': '0.470', 'WEAPON3': '0.550', 'weapon2': '1.022', 'weapon3': '1.244', 'DAMAGECOUNT': '2.220', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:48:23,207][2409548] DAMAGECOUNT value on done: 1854.0
[2023-02-25 12:48:23,209][2409548] Sum rewards: 5.503, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.046', 'WEAPON1': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.214', 'HITCOUNT': '0.500', 'WEAPON3': '0.550', 'ARMOR': '0.576', 'HEALTH': '0.648', 'weapon2': '1.362', 'weapon3': '1.618', 'DAMAGECOUNT': '2.043', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:23,301][2409079] DAMAGECOUNT value on done: 1752.0
[2023-02-25 12:48:23,301][2409079] Sum rewards: -0.736, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.472', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'WEAPON1': '0.020', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'weapon4': '0.186', 'HITCOUNT': '0.370', 'ARMOR': '0.471', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.260', 'weapon3': '1.540', 'weapon2': '1.920'}
[2023-02-25 12:48:23,482][2409078] DAMAGECOUNT value on done: 1720.0
[2023-02-25 12:48:23,485][2409078] Sum rewards: 2.346, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.380', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'weapon5': '0.072', 'AMMO3': '0.077', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.136', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'weapon3': '1.368', 'DAMAGECOUNT': '1.482', 'weapon2': '1.590', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:23,526][2409468] DAMAGECOUNT value on done: 1118.0
[2023-02-25 12:48:23,529][2409468] Sum rewards: 3.173, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'ARMOR': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.070', 'WEAPON4': '0.150', 'weapon4': '0.364', 'WEAPON3': '0.450', 'HITCOUNT': '0.540', 'HEALTH': '0.562', 'weapon2': '1.368', 'weapon3': '1.570', 'DAMAGECOUNT': '1.674', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:23,746][2409076] DAMAGECOUNT value on done: 1239.0
[2023-02-25 12:48:23,749][2409076] Sum rewards: 4.577, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.076', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.058', 'AMMO3': '0.071', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.320', 'weapon4': '0.380', 'WEAPON3': '0.400', 'ARMOR': '0.820', 'DAMAGECOUNT': '1.059', 'weapon3': '1.484', 'weapon2': '1.590', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:23,970][2409866] DAMAGECOUNT value on done: 1961.0
[2023-02-25 12:48:23,973][2409866] Sum rewards: 3.085, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.844', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.014', 'WEAPON4': '0.050', 'weapon5': '0.058', 'AMMO3': '0.098', 'WEAPON5': '0.150', 'weapon4': '0.202', 'ARMOR': '0.455', 'HITCOUNT': '0.500', 'WEAPON3': '0.700', 'weapon2': '1.492', 'weapon3': '1.702', 'DAMAGECOUNT': '1.998', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:24,021][2409074] Updated weights for policy 0, policy_version 10861 (0.0012)
[2023-02-25 12:48:24,578][2409597] DAMAGECOUNT value on done: 2351.0
[2023-02-25 12:48:24,582][2409597] Sum rewards: 4.821, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.166', 'ARMOR': '0.024', 'AMMO2': '0.035', 'WEAPON1': '0.050', 'AMMO3': '0.099', 'weapon7': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.173', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.410', 'WEAPON3': '0.550', 'weapon4': '0.610', 'weapon2': '0.848', 'DAMAGECOUNT': '1.452', 'weapon3': '1.692', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:24,608][2409565] DAMAGECOUNT value on done: 1816.0
[2023-02-25 12:48:24,612][2409565] Sum rewards: 3.743, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.288', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon7': '0.034', 'weapon4': '0.036', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'ARMOR': '0.408', 'HITCOUNT': '0.520', 'WEAPON3': '0.700', 'weapon3': '1.580', 'DAMAGECOUNT': '1.755', 'weapon2': '1.856', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:48:24,640][2409102] DAMAGECOUNT value on done: 1700.0
[2023-02-25 12:48:24,641][2409102] Sum rewards: -0.744, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.142', 'AMMO5': '0.012', 'AMMO2': '0.022', 'WEAPON1': '0.070', 'weapon5': '0.080', 'AMMO4': '0.111', 'AMMO3': '0.140', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.354', 'HITCOUNT': '0.430', 'WEAPON3': '0.950', 'ARMOR': '1.276', 'weapon2': '1.492', 'DAMAGECOUNT': '1.683', 'weapon3': '1.778', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:24,778][2409355] DAMAGECOUNT value on done: 1891.0
[2023-02-25 12:48:24,779][2409355] Sum rewards: 6.739, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.394', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.003', 'weapon5': '0.004', 'WEAPON1': '0.010', 'weapon4': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.100', 'HITCOUNT': '0.270', 'WEAPON3': '0.450', 'ARMOR': '0.495', 'DAMAGECOUNT': '1.059', 'weapon2': '1.550', 'weapon3': '1.564', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:48:24,863][2409596] DAMAGECOUNT value on done: 1515.0
[2023-02-25 12:48:25,098][2409405] DAMAGECOUNT value on done: 1588.0
[2023-02-25 12:48:25,099][2409405] Sum rewards: -0.125, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.926', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.028', 'WEAPON1': '0.040', 'weapon4': '0.062', 'weapon5': '0.066', 'AMMO3': '0.119', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.455', 'HITCOUNT': '0.620', 'WEAPON3': '0.800', 'weapon3': '1.406', 'weapon2': '1.432', 'DAMAGECOUNT': '1.860', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:25,290][2409074] Updated weights for policy 0, policy_version 10871 (0.0012)
[2023-02-25 12:48:25,370][2409099] DAMAGECOUNT value on done: 2459.0
[2023-02-25 12:48:25,372][2409099] Sum rewards: 6.795, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.048', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'weapon5': '0.064', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.206', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'weapon2': '1.486', 'weapon3': '1.572', 'DAMAGECOUNT': '2.595', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:25,519][2409547] DAMAGECOUNT value on done: 1913.0
[2023-02-25 12:48:25,520][2409547] Sum rewards: 2.566, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.162', 'AMMO2': '0.017', 'AMMO3': '0.050', 'AMMO4': '0.085', 'weapon4': '0.112', 'WEAPON4': '0.250', 'HITCOUNT': '0.300', 'WEAPON3': '0.400', 'ARMOR': '0.867', 'weapon3': '0.954', 'DAMAGECOUNT': '1.032', 'weapon2': '1.660', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:25,521][2409373] DAMAGECOUNT value on done: 1753.0
[2023-02-25 12:48:25,522][2409373] Sum rewards: -0.441, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.766', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.023', 'WEAPON1': '0.030', 'weapon7': '0.046', 'WEAPON4': '0.050', 'weapon5': '0.062', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.120', 'weapon4': '0.196', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.540', 'WEAPON3': '0.600', 'ARMOR': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.320', 'weapon2': '1.548'}
[2023-02-25 12:48:25,545][2409469] DAMAGECOUNT value on done: 2279.0
[2023-02-25 12:48:25,546][2409469] Sum rewards: 5.805, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.254', 'AMMO5': '0.010', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'AMMO3': '0.106', 'AMMO4': '0.124', 'weapon5': '0.220', 'weapon4': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.650', 'WEAPON3': '0.750', 'ARMOR': '1.271', 'weapon2': '1.298', 'weapon3': '1.968', 'DAMAGECOUNT': '2.829', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:48:25,573][2409080] DAMAGECOUNT value on done: 1377.0
[2023-02-25 12:48:25,574][2409080] Sum rewards: 1.724, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.190', 'WEAPON1': '0.030', 'AMMO2': '0.041', 'AMMO3': '0.063', 'WEAPON4': '0.200', 'AMMO4': '0.206', 'HITCOUNT': '0.300', 'weapon4': '0.326', 'WEAPON3': '0.400', 'ARMOR': '0.931', 'weapon3': '0.952', 'DAMAGECOUNT': '1.041', 'weapon2': '1.174', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:25,589][2409486] DAMAGECOUNT value on done: 1803.0
[2023-02-25 12:48:25,598][2409486] Sum rewards: 1.561, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.530', 'AMMO2': '0.019', 'AMMO3': '0.044', 'weapon7': '0.068', 'AMMO4': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.210', 'WEAPON4': '0.250', 'weapon4': '0.320', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.735', 'weapon3': '0.858', 'weapon2': '1.344', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:26,006][2409406] DAMAGECOUNT value on done: 1853.0
[2023-02-25 12:48:26,375][2409485] DAMAGECOUNT value on done: 1742.0
[2023-02-25 12:48:26,375][2409485] Sum rewards: 1.907, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.965', 'AMMO5': '0.006', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'weapon5': '0.050', 'AMMO3': '0.075', 'AMMO4': '0.090', 'weapon4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.450', 'ARMOR': '0.456', 'WEAPON3': '0.500', 'weapon2': '1.284', 'weapon3': '1.498', 'DAMAGECOUNT': '1.515', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:26,431][2409101] DAMAGECOUNT value on done: 2263.0
[2023-02-25 12:48:26,432][2409101] Sum rewards: 5.398, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.298', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'AMMO3': '0.081', 'AMMO4': '0.119', 'weapon5': '0.128', 'WEAPON5': '0.150', 'weapon4': '0.198', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.380', 'ARMOR': '0.404', 'WEAPON3': '0.500', 'weapon3': '1.522', 'weapon2': '1.806', 'DAMAGECOUNT': '2.049', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:26,449][2409097] DAMAGECOUNT value on done: 1823.0
[2023-02-25 12:48:26,449][2409097] Sum rewards: -0.172, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.172', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'weapon5': '0.060', 'AMMO3': '0.090', 'HITCOUNT': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'ARMOR': '0.530', 'weapon4': '0.602', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.966', 'weapon2': '1.172', 'weapon3': '1.676', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:26,584][2409096] DAMAGECOUNT value on done: 1673.0
[2023-02-25 12:48:26,585][2409096] Sum rewards: 0.780, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.085', 'AMMO4': '-0.062', 'AMMO2': '-0.012', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon7': '0.068', 'AMMO3': '0.083', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.705', 'weapon2': '1.126', 'weapon3': '1.142', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:26,597][2409075] DAMAGECOUNT value on done: 1489.0
[2023-02-25 12:48:26,598][2409075] Sum rewards: 0.193, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.118', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.044', 'AMMO3': '0.078', 'weapon7': '0.170', 'AMMO6': '0.240', 'AMMO7': '0.240', 'HITCOUNT': '0.270', 'WEAPON4': '0.400', 'WEAPON7': '0.400', 'weapon4': '0.464', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.780', 'ARMOR': '0.832', 'weapon3': '0.922', 'weapon2': '1.392', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:26,612][2409105] DAMAGECOUNT value on done: 1737.0
[2023-02-25 12:48:26,615][2409105] Sum rewards: 0.655, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.658', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'ARMOR': '0.059', 'AMMO3': '0.076', 'AMMO4': '0.089', 'WEAPON4': '0.200', 'HITCOUNT': '0.220', 'weapon4': '0.502', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.657', 'FRAGCOUNT': '1.000', 'weapon2': '1.074', 'weapon3': '1.328'}
[2023-02-25 12:48:26,617][2409389] DAMAGECOUNT value on done: 1916.0
[2023-02-25 12:48:26,618][2409389] Sum rewards: -0.176, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.282', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO3': '0.056', 'weapon4': '0.070', 'weapon7': '0.072', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.340', 'ARMOR': '0.428', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.065', 'weapon3': '1.090', 'weapon2': '2.332', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:26,713][2409104] DAMAGECOUNT value on done: 3057.0
[2023-02-25 12:48:26,714][2409104] Sum rewards: 7.906, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.344', 'AMMO2': '0.023', 'weapon7': '0.074', 'AMMO3': '0.083', 'AMMO4': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.274', 'WEAPON3': '0.400', 'HITCOUNT': '0.540', 'ARMOR': '0.936', 'weapon3': '1.104', 'weapon2': '1.666', 'DAMAGECOUNT': '2.397', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:48:26,785][2409077] DAMAGECOUNT value on done: 1110.0
[2023-02-25 12:48:26,785][2409077] Sum rewards: -1.782, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.020', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.030', 'weapon5': '0.052', 'AMMO4': '0.062', 'AMMO3': '0.134', 'HITCOUNT': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.586', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.801', 'weapon2': '1.008', 'weapon3': '1.468', 'ARMOR': '1.705'}
[2023-02-25 12:48:26,927][2409074] Updated weights for policy 0, policy_version 10881 (0.0012)
[2023-02-25 12:48:26,946][2409407] DAMAGECOUNT value on done: 1340.0
[2023-02-25 12:48:26,947][2409407] Sum rewards: -2.190, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.742', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON1': '0.040', 'weapon5': '0.056', 'weapon7': '0.056', 'AMMO3': '0.071', 'AMMO4': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.150', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.396', 'weapon4': '0.474', 'WEAPON3': '0.550', 'ARMOR': '0.885', 'FRAGCOUNT': '1.000', 'weapon3': '1.018', 'weapon2': '1.512'}
[2023-02-25 12:48:27,121][2409079] DAMAGECOUNT value on done: 2021.0
[2023-02-25 12:48:27,122][2409079] Sum rewards: 1.583, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.307', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.016', 'weapon5': '0.048', 'AMMO4': '0.077', 'AMMO3': '0.092', 'WEAPON4': '0.150', 'weapon4': '0.246', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'HITCOUNT': '0.580', 'WEAPON3': '0.650', 'weapon2': '0.972', 'weapon3': '1.792', 'DAMAGECOUNT': '1.845', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:27,186][2408954] Fps is (10 sec: 25804.4, 60 sec: 25326.9, 300 sec: 25547.9). Total num frames: 44572672. Throughput: 0: 6325.8. Samples: 11143896. Policy #0 lag: (min: 1.0, avg: 11.2, max: 25.0)
[2023-02-25 12:48:27,187][2408954] Avg episode reward: [(0, '1.908')]
[2023-02-25 12:48:27,283][2409548] DAMAGECOUNT value on done: 1704.0
[2023-02-25 12:48:27,284][2409548] Sum rewards: 2.833, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.532', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'weapon5': '0.066', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'weapon4': '0.192', 'HITCOUNT': '0.500', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'weapon3': '1.420', 'weapon2': '1.766', 'DAMAGECOUNT': '1.824', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:27,354][2409389] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)]
[2023-02-25 12:48:27,398][2409076] DAMAGECOUNT value on done: 1695.0
[2023-02-25 12:48:27,399][2409076] Sum rewards: 0.703, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'ARMOR': '0.032', 'AMMO3': '0.040', 'weapon5': '0.122', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.270', 'weapon4': '0.368', 'FRAGCOUNT': '0.500', 'HEALTH': '0.638', 'weapon3': '0.794', 'DAMAGECOUNT': '1.224', 'weapon2': '1.936'}
[2023-02-25 12:48:27,519][2409468] DAMAGECOUNT value on done: 2215.0
[2023-02-25 12:48:27,520][2409468] Sum rewards: 4.819, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.864', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO3': '0.040', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'weapon5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.202', 'WEAPON3': '0.300', 'HITCOUNT': '0.540', 'weapon3': '0.952', 'ARMOR': '1.232', 'weapon2': '2.404', 'DAMAGECOUNT': '2.490', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:27,791][2409078] DAMAGECOUNT value on done: 2147.0
[2023-02-25 12:48:27,791][2409078] Sum rewards: 6.549, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.355', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.011', 'WEAPON1': '0.040', 'weapon5': '0.040', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.084', 'WEAPON5': '0.200', 'WEAPON3': '0.400', 'ARMOR': '0.408', 'HITCOUNT': '0.510', 'weapon3': '1.032', 'weapon2': '1.660', 'DAMAGECOUNT': '1.953', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:28,072][2409866] DAMAGECOUNT value on done: 1598.0
[2023-02-25 12:48:28,075][2409866] Sum rewards: 4.423, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.982', 'AMMO5': '0.010', 'AMMO2': '0.033', 'ARMOR': '0.064', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'weapon5': '0.112', 'AMMO4': '0.165', 'WEAPON5': '0.250', 'HITCOUNT': '0.280', 'weapon4': '0.490', 'WEAPON3': '0.600', 'weapon2': '0.680', 'weapon3': '1.398', 'DAMAGECOUNT': '1.635', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:28,138][2409597] DAMAGECOUNT value on done: 2064.0
[2023-02-25 12:48:28,139][2409597] Sum rewards: 6.908, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.869', 'AMMO5': '0.004', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON1': '0.030', 'weapon5': '0.034', 'AMMO3': '0.071', 'WEAPON5': '0.100', 'weapon4': '0.146', 'WEAPON4': '0.150', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.570', 'weapon2': '1.066', 'weapon3': '1.418', 'DAMAGECOUNT': '2.208', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:48:28,139][2409565] DAMAGECOUNT value on done: 1620.0
[2023-02-25 12:48:28,142][2409565] Sum rewards: -0.686, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.064', 'AMMO2': '0.002', 'AMMO4': '0.008', 'WEAPON1': '0.010', 'ARMOR': '0.028', 'AMMO3': '0.051', 'weapon7': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'WEAPON7': '0.200', 'weapon4': '0.204', 'WEAPON3': '0.400', 'weapon2': '0.628', 'DAMAGECOUNT': '0.639', 'FRAGCOUNT': '1.000', 'weapon3': '1.078'}
[2023-02-25 12:48:28,159][2409102] DAMAGECOUNT value on done: 2376.0
[2023-02-25 12:48:28,160][2409102] Sum rewards: 1.500, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.023', 'AMMO5': '0.010', 'weapon4': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'weapon5': '0.242', 'WEAPON5': '0.250', 'ARMOR': '0.408', 'HITCOUNT': '0.410', 'WEAPON3': '0.700', 'weapon3': '1.624', 'weapon2': '1.730', 'DAMAGECOUNT': '1.806', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:28,740][2409074] Updated weights for policy 0, policy_version 10891 (0.0013)
[2023-02-25 12:48:28,830][2409355] DAMAGECOUNT value on done: 1933.0
[2023-02-25 12:48:28,833][2409355] Sum rewards: 1.446, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.025', 'AMMO5': '0.007', 'AMMO2': '0.037', 'WEAPON1': '0.040', 'weapon5': '0.056', 'ARMOR': '0.068', 'AMMO3': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.186', 'HITCOUNT': '0.290', 'WEAPON3': '0.500', 'weapon4': '0.534', 'DAMAGECOUNT': '1.122', 'weapon2': '1.380', 'weapon3': '1.622', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:29,076][2409469] DAMAGECOUNT value on done: 2788.0
[2023-02-25 12:48:29,079][2409469] Sum rewards: 3.445, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.297', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO3': '0.071', 'weapon5': '0.084', 'AMMO4': '0.092', 'weapon7': '0.152', 'HITCOUNT': '0.190', 'weapon4': '0.208', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'WEAPON3': '0.500', 'weapon3': '1.046', 'weapon2': '1.260', 'ARMOR': '1.334', 'DAMAGECOUNT': '2.037', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:29,150][2409596] DAMAGECOUNT value on done: 2292.0
[2023-02-25 12:48:29,153][2409596] Sum rewards: 4.906, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.944', 'AMMO5': '0.012', 'AMMO2': '0.020', 'WEAPON1': '0.070', 'weapon5': '0.072', 'AMMO3': '0.089', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.290', 'HITCOUNT': '0.410', 'WEAPON3': '0.600', 'weapon2': '1.420', 'weapon3': '1.512', 'DAMAGECOUNT': '2.052', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:48:29,211][2409099] DAMAGECOUNT value on done: 1938.0
[2023-02-25 12:48:29,215][2409547] DAMAGECOUNT value on done: 1656.0
[2023-02-25 12:48:29,215][2409099] Sum rewards: 1.817, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.017', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon7': '0.008', 'WEAPON1': '0.010', 'weapon5': '0.018', 'AMMO4': '0.037', 'AMMO3': '0.040', 'WEAPON5': '0.050', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.270', 'WEAPON3': '0.300', 'weapon4': '0.352', 'weapon3': '1.004', 'DAMAGECOUNT': '1.380', 'weapon2': '1.804', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:29,218][2409547] Sum rewards: 3.941, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.240', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'weapon5': '0.028', 'AMMO3': '0.064', 'weapon7': '0.064', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'weapon4': '0.746', 'weapon3': '0.840', 'ARMOR': '1.008', 'weapon2': '1.126', 'DAMAGECOUNT': '1.626', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:29,385][2409486] DAMAGECOUNT value on done: 1673.0
[2023-02-25 12:48:29,388][2409486] Sum rewards: -1.112, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.164', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon5': '0.054', 'weapon7': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'HITCOUNT': '0.310', 'weapon4': '0.386', 'weapon2': '0.448', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.173', 'FRAGCOUNT': '2.000', 'weapon3': '2.140'}
[2023-02-25 12:48:29,458][2409373] DAMAGECOUNT value on done: 1042.0
[2023-02-25 12:48:29,490][2409080] DAMAGECOUNT value on done: 1422.0
[2023-02-25 12:48:29,493][2409080] Sum rewards: 3.575, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.506', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.009', 'WEAPON1': '0.030', 'AMMO4': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.064', 'WEAPON4': '0.150', 'HITCOUNT': '0.320', 'weapon4': '0.396', 'ARMOR': '0.404', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.978', 'weapon2': '1.122', 'weapon3': '1.254', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:29,569][2409405] DAMAGECOUNT value on done: 2340.0
[2023-02-25 12:48:29,570][2409405] Sum rewards: -2.094, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.968', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.022', 'WEAPON1': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon5': '0.106', 'HITCOUNT': '0.500', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'ARMOR': '1.200', 'weapon3': '1.520', 'DAMAGECOUNT': '1.587', 'weapon2': '1.612'}
[2023-02-25 12:48:29,946][2409406] DAMAGECOUNT value on done: 1873.0
[2023-02-25 12:48:29,947][2409406] Sum rewards: -4.148, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.616', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO2': '0.019', 'weapon7': '0.060', 'AMMO3': '0.070', 'AMMO4': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.110', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.249', 'WEAPON4': '0.250', 'ARMOR': '0.448', 'WEAPON3': '0.450', 'weapon4': '0.564', 'weapon2': '0.840', 'weapon3': '1.038'}
[2023-02-25 12:48:29,966][2409097] DAMAGECOUNT value on done: 1918.0
[2023-02-25 12:48:29,967][2409097] Sum rewards: 6.277, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.489', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.019', 'AMMO3': '0.087', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'weapon5': '0.156', 'WEAPON5': '0.200', 'weapon4': '0.308', 'HITCOUNT': '0.560', 'WEAPON3': '0.700', 'weapon2': '1.354', 'weapon3': '1.754', 'DAMAGECOUNT': '2.352', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:48:30,033][2409485] DAMAGECOUNT value on done: 2449.0
[2023-02-25 12:48:30,036][2409485] Sum rewards: 2.484, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.772', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'AMMO3': '0.087', 'AMMO4': '0.089', 'weapon5': '0.110', 'WEAPON4': '0.150', 'weapon4': '0.278', 'WEAPON5': '0.300', 'HITCOUNT': '0.500', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'weapon2': '1.600', 'weapon3': '1.792', 'DAMAGECOUNT': '2.532', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:30,082][2409075] DAMAGECOUNT value on done: 1966.0
[2023-02-25 12:48:30,083][2409075] Sum rewards: 2.944, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.263', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'weapon5': '0.044', 'AMMO3': '0.060', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.404', 'WEAPON3': '0.450', 'HITCOUNT': '0.600', 'ARMOR': '0.933', 'weapon3': '1.212', 'weapon2': '1.752', 'DAMAGECOUNT': '1.872', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:30,113][2409389] DAMAGECOUNT value on done: 1930.0
[2023-02-25 12:48:30,114][2409389] Sum rewards: 4.918, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.280', 'AMMO4': '-0.028', 'AMMO2': '-0.005', 'AMMO5': '0.007', 'WEAPON1': '0.060', 'weapon5': '0.060', 'AMMO3': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.242', 'HITCOUNT': '0.540', 'WEAPON3': '0.750', 'ARMOR': '0.909', 'weapon2': '1.360', 'weapon3': '1.564', 'DAMAGECOUNT': '1.992', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:48:30,141][2409096] DAMAGECOUNT value on done: 1415.0
[2023-02-25 12:48:30,143][2409096] Sum rewards: 2.119, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.132', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'WEAPON1': '0.030', 'AMMO3': '0.078', 'WEAPON4': '0.250', 'HITCOUNT': '0.290', 'weapon4': '0.430', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.972', 'weapon3': '1.418', 'ARMOR': '1.471', 'weapon2': '1.750', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:30,207][2409105] DAMAGECOUNT value on done: 1309.0
[2023-02-25 12:48:30,208][2409105] Sum rewards: 1.489, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.758', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.085', 'AMMO3': '0.089', 'WEAPON4': '0.150', 'HITCOUNT': '0.330', 'weapon4': '0.382', 'ARMOR': '0.416', 'WEAPON3': '0.600', 'weapon3': '1.078', 'DAMAGECOUNT': '1.209', 'weapon2': '1.868', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:30,229][2409074] Updated weights for policy 0, policy_version 10901 (0.0012)
[2023-02-25 12:48:30,530][2409407] DAMAGECOUNT value on done: 1823.0
[2023-02-25 12:48:30,532][2409407] Sum rewards: 2.254, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.158', 'AMMO5': '0.003', 'AMMO2': '0.009', 'WEAPON1': '0.040', 'AMMO4': '0.044', 'AMMO3': '0.093', 'WEAPON4': '0.150', 'weapon4': '0.318', 'HITCOUNT': '0.390', 'ARMOR': '0.489', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.137', 'weapon3': '1.322', 'weapon2': '1.818', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:30,755][2409079] DAMAGECOUNT value on done: 1723.0
[2023-02-25 12:48:30,758][2409079] Sum rewards: 1.623, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.932', 'AMMO5': '0.011', 'AMMO2': '0.031', 'WEAPON1': '0.050', 'AMMO3': '0.101', 'weapon5': '0.128', 'AMMO4': '0.152', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'HITCOUNT': '0.370', 'weapon4': '0.642', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.236', 'ARMOR': '1.282', 'weapon2': '1.288', 'weapon3': '1.364', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:30,831][2409104] DAMAGECOUNT value on done: 1875.0
[2023-02-25 12:48:30,832][2409104] Sum rewards: 0.646, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.508', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.037', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.116', 'WEAPON5': '0.200', 'weapon4': '0.224', 'HITCOUNT': '0.260', 'ARMOR': '0.456', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.762', 'weapon3': '1.264', 'weapon2': '1.872', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:30,898][2409077] DAMAGECOUNT value on done: 2025.0
[2023-02-25 12:48:30,909][2409077] Sum rewards: 6.821, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.520', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'weapon5': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'weapon4': '0.172', 'WEAPON3': '0.600', 'HITCOUNT': '0.740', 'weapon2': '1.400', 'weapon3': '1.448', 'DAMAGECOUNT': '2.385', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:48:31,216][2409548] DAMAGECOUNT value on done: 1982.0
[2023-02-25 12:48:31,217][2409548] Sum rewards: 1.611, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'AMMO2': '0.021', 'ARMOR': '0.048', 'WEAPON1': '0.060', 'weapon5': '0.068', 'AMMO3': '0.070', 'AMMO4': '0.104', 'HEALTH': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.250', 'weapon4': '0.390', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.699', 'weapon2': '1.270', 'weapon3': '1.736', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:31,629][2409468] DAMAGECOUNT value on done: 1206.0
[2023-02-25 12:48:31,630][2409468] Sum rewards: 2.407, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.790', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'ARMOR': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.054', 'weapon4': '0.058', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'HITCOUNT': '0.130', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.450', 'weapon2': '0.726', 'weapon3': '1.024', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:31,674][2409076] DAMAGECOUNT value on done: 2002.0
[2023-02-25 12:48:31,676][2409076] Sum rewards: 3.403, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.432', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'AMMO3': '0.060', 'weapon5': '0.080', 'AMMO4': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.204', 'HITCOUNT': '0.300', 'WEAPON3': '0.350', 'ARMOR': '0.450', 'weapon3': '1.148', 'DAMAGECOUNT': '1.269', 'weapon2': '1.486', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:31,706][2409597] DAMAGECOUNT value on done: 2120.0
[2023-02-25 12:48:31,706][2409597] Sum rewards: 5.680, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.280', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'weapon5': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.059', 'weapon7': '0.064', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.230', 'WEAPON3': '0.350', 'HITCOUNT': '0.400', 'weapon3': '0.944', 'weapon2': '1.598', 'DAMAGECOUNT': '1.605', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:31,767][2409074] Updated weights for policy 0, policy_version 10911 (0.0012)
[2023-02-25 12:48:31,850][2409866] DAMAGECOUNT value on done: 2202.0
[2023-02-25 12:48:31,851][2409866] Sum rewards: 4.172, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.510', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.042', 'weapon7': '0.050', 'AMMO3': '0.055', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.122', 'AMMO4': '0.208', 'WEAPON4': '0.300', 'HITCOUNT': '0.330', 'WEAPON3': '0.350', 'ARMOR': '0.404', 'weapon4': '0.586', 'weapon2': '1.116', 'weapon3': '1.116', 'DAMAGECOUNT': '1.578', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:31,995][2409565] DAMAGECOUNT value on done: 2462.0
[2023-02-25 12:48:31,996][2409565] Sum rewards: 0.279, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.537', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'AMMO3': '0.036', 'weapon5': '0.058', 'weapon7': '0.138', 'AMMO4': '0.163', 'WEAPON5': '0.200', 'WEAPON3': '0.200', 'HITCOUNT': '0.230', 'weapon3': '0.316', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON4': '0.500', 'ARMOR': '0.536', 'weapon2': '0.786', 'DAMAGECOUNT': '0.933', 'weapon4': '1.120', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:32,186][2408954] Fps is (10 sec: 23756.9, 60 sec: 25190.4, 300 sec: 25520.2). Total num frames: 44691456. Throughput: 0: 6330.4. Samples: 11182164. Policy #0 lag: (min: 2.0, avg: 12.8, max: 27.0)
[2023-02-25 12:48:32,186][2408954] Avg episode reward: [(0, '2.108')]
[2023-02-25 12:48:32,582][2409355] DAMAGECOUNT value on done: 1499.0
[2023-02-25 12:48:32,583][2409355] Sum rewards: 1.427, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'AMMO3': '0.071', 'HEALTH': '0.074', 'weapon5': '0.078', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.394', 'ARMOR': '0.408', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.627', 'FRAGCOUNT': '1.000', 'weapon2': '1.074', 'weapon3': '1.772'}
[2023-02-25 12:48:32,630][2409469] DAMAGECOUNT value on done: 1446.0
[2023-02-25 12:48:32,952][2409078] DAMAGECOUNT value on done: 2030.0
[2023-02-25 12:48:32,953][2409078] Sum rewards: 5.779, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.002', 'AMMO4': '-0.062', 'AMMO2': '-0.012', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.052', 'weapon5': '0.106', 'WEAPON5': '0.200', 'WEAPON3': '0.450', 'HITCOUNT': '0.470', 'ARMOR': '0.901', 'weapon3': '1.218', 'DAMAGECOUNT': '1.815', 'weapon2': '1.868', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:32,975][2409099] DAMAGECOUNT value on done: 1884.0
[2023-02-25 12:48:32,976][2409099] Sum rewards: -0.904, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.901', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'WEAPON1': '0.010', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.140', 'HITCOUNT': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.335', 'ARMOR': '1.374', 'weapon3': '1.462', 'weapon2': '2.030', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:33,044][2409547] DAMAGECOUNT value on done: 1590.0
[2023-02-25 12:48:33,046][2409547] Sum rewards: 2.915, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.210', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.030', 'weapon5': '0.064', 'AMMO3': '0.085', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.270', 'weapon4': '0.444', 'WEAPON3': '0.550', 'ARMOR': '0.861', 'DAMAGECOUNT': '0.897', 'weapon2': '1.026', 'weapon3': '1.264', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:33,153][2409486] DAMAGECOUNT value on done: 1779.0
[2023-02-25 12:48:33,159][2409486] Sum rewards: 2.264, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'HEALTH': '0.014', 'weapon4': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'WEAPON4': '0.050', 'HITCOUNT': '0.270', 'WEAPON3': '0.300', 'ARMOR': '0.435', 'weapon3': '0.614', 'weapon2': '0.630', 'DAMAGECOUNT': '0.888', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:33,307][2409074] Updated weights for policy 0, policy_version 10921 (0.0012)
[2023-02-25 12:48:33,393][2409596] DAMAGECOUNT value on done: 1889.0
[2023-02-25 12:48:33,393][2409596] Sum rewards: 0.307, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.306', 'ARMOR': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'weapon4': '0.378', 'HITCOUNT': '0.550', 'WEAPON3': '0.600', 'weapon2': '1.314', 'weapon3': '1.578', 'DAMAGECOUNT': '1.872', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:33,481][2409080] DAMAGECOUNT value on done: 1829.0
[2023-02-25 12:48:33,482][2409080] Sum rewards: 1.974, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.430', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.024', 'WEAPON1': '0.030', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.074', 'WEAPON4': '0.150', 'weapon4': '0.480', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'weapon3': '1.586', 'weapon2': '1.612', 'DAMAGECOUNT': '1.890', 'FRAGCOUNT': '4.500'}
[2023-02-25 12:48:33,649][2409373] DAMAGECOUNT value on done: 1638.0
[2023-02-25 12:48:33,700][2409097] DAMAGECOUNT value on done: 1560.0
[2023-02-25 12:48:33,701][2409097] Sum rewards: 3.720, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.812', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.009', 'WEAPON1': '0.040', 'weapon5': '0.074', 'AMMO3': '0.093', 'WEAPON5': '0.200', 'HITCOUNT': '0.420', 'WEAPON3': '0.600', 'ARMOR': '0.856', 'weapon3': '1.592', 'DAMAGECOUNT': '1.620', 'weapon2': '1.780', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:33,786][2409406] DAMAGECOUNT value on done: 2219.0
[2023-02-25 12:48:33,787][2409406] Sum rewards: 2.890, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.376', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO5': '0.018', 'weapon4': '0.024', 'WEAPON4': '0.050', 'AMMO4': '0.079', 'weapon5': '0.108', 'AMMO3': '0.120', 'HITCOUNT': '0.360', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'ARMOR': '1.314', 'DAMAGECOUNT': '1.602', 'weapon2': '1.666', 'weapon3': '1.800', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:48:33,838][2409096] DAMAGECOUNT value on done: 1978.0
[2023-02-25 12:48:33,841][2409096] Sum rewards: 8.030, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.678', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.019', 'WEAPON1': '0.030', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.071', 'weapon4': '0.092', 'weapon5': '0.236', 'HITCOUNT': '0.420', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon3': '1.548', 'weapon2': '1.664', 'DAMAGECOUNT': '2.598', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:48:33,907][2409075] DAMAGECOUNT value on done: 1600.0
[2023-02-25 12:48:33,907][2409075] Sum rewards: 1.752, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.170', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.014', 'WEAPON1': '0.030', 'AMMO3': '0.123', 'weapon5': '0.134', 'HITCOUNT': '0.190', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.641', 'weapon3': '1.734', 'weapon2': '1.900', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:33,928][2409105] DAMAGECOUNT value on done: 1782.0
[2023-02-25 12:48:33,930][2409389] DAMAGECOUNT value on done: 2515.0
[2023-02-25 12:48:33,929][2409105] Sum rewards: 3.779, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.682', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.106', 'weapon5': '0.122', 'AMMO4': '0.146', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.466', 'HITCOUNT': '0.500', 'WEAPON3': '0.650', 'ARMOR': '0.924', 'weapon2': '1.212', 'weapon3': '1.628', 'DAMAGECOUNT': '2.097', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:33,934][2409389] Sum rewards: 1.233, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.700', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.012', 'AMMO2': '0.041', 'weapon7': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.206', 'WEAPON3': '0.250', 'HITCOUNT': '0.380', 'WEAPON4': '0.400', 'ARMOR': '0.487', 'weapon4': '0.556', 'weapon3': '0.906', 'DAMAGECOUNT': '1.362', 'weapon2': '1.612', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:34,366][2409405] DAMAGECOUNT value on done: 1471.0
[2023-02-25 12:48:34,368][2409405] Sum rewards: 1.645, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.676', 'AMMO2': '0.001', 'AMMO4': '0.006', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'ARMOR': '0.048', 'weapon5': '0.056', 'AMMO3': '0.186', 'WEAPON5': '0.300', 'HITCOUNT': '0.410', 'weapon2': '1.028', 'WEAPON3': '1.050', 'DAMAGECOUNT': '1.575', 'weapon3': '2.636', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:34,531][2409077] DAMAGECOUNT value on done: 2450.0
[2023-02-25 12:48:34,534][2409077] Sum rewards: 1.274, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.954', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'weapon5': '0.052', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.161', 'HITCOUNT': '0.220', 'weapon4': '0.448', 'ARMOR': '0.486', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.969', 'weapon2': '1.134', 'weapon3': '1.444', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:34,755][2409407] DAMAGECOUNT value on done: 1568.0
[2023-02-25 12:48:34,758][2409407] Sum rewards: 6.420, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.082', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'ARMOR': '0.051', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'weapon7': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.130', 'WEAPON7': '0.200', 'weapon4': '0.234', 'WEAPON5': '0.250', 'HITCOUNT': '0.640', 'WEAPON3': '0.700', 'weapon2': '0.820', 'weapon3': '1.938', 'DAMAGECOUNT': '2.745', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:48:35,000][2409104] DAMAGECOUNT value on done: 2066.0
[2023-02-25 12:48:35,001][2409104] Sum rewards: 6.391, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.348', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO3': '0.060', 'AMMO4': '0.074', 'weapon5': '0.144', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.477', 'weapon4': '0.528', 'HITCOUNT': '0.640', 'weapon2': '0.956', 'weapon3': '1.466', 'DAMAGECOUNT': '2.424', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:35,026][2409079] DAMAGECOUNT value on done: 1495.0
[2023-02-25 12:48:35,027][2409079] Sum rewards: -0.194, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.116', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO4': '0.019', 'WEAPON1': '0.020', 'weapon4': '0.050', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.490', 'WEAPON3': '0.700', 'weapon2': '1.364', 'DAMAGECOUNT': '1.710', 'weapon3': '1.766', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:35,040][2409548] DAMAGECOUNT value on done: 1946.0
[2023-02-25 12:48:35,043][2409548] Sum rewards: 4.175, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.190', 'AMMO5': '0.003', 'AMMO2': '0.021', 'AMMO3': '0.030', 'WEAPON5': '0.050', 'ARMOR': '0.083', 'AMMO4': '0.105', 'WEAPON3': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.300', 'weapon3': '0.762', 'weapon4': '0.786', 'DAMAGECOUNT': '1.107', 'weapon2': '1.368', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:35,347][2409074] Updated weights for policy 0, policy_version 10931 (0.0012)
[2023-02-25 12:48:35,420][2409866] DAMAGECOUNT value on done: 2816.0
[2023-02-25 12:48:35,424][2409866] Sum rewards: 3.708, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.746', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.076', 'AMMO3': '0.087', 'weapon5': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.481', 'weapon4': '0.510', 'WEAPON3': '0.600', 'HITCOUNT': '0.640', 'weapon2': '1.154', 'weapon3': '1.730', 'FRAGCOUNT': '3.000', 'DAMAGECOUNT': '3.072'}
[2023-02-25 12:48:35,516][2409076] DAMAGECOUNT value on done: 2177.0
[2023-02-25 12:48:35,517][2409076] Sum rewards: 4.301, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.354', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.036', 'AMMO3': '0.040', 'WEAPON5': '0.050', 'weapon7': '0.078', 'AMMO4': '0.093', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.380', 'weapon4': '0.446', 'weapon3': '0.830', 'weapon2': '1.446', 'DAMAGECOUNT': '2.220', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:35,552][2409468] DAMAGECOUNT value on done: 1917.0
[2023-02-25 12:48:35,552][2409468] Sum rewards: 3.426, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.768', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.047', 'weapon5': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.400', 'weapon4': '0.516', 'weapon3': '0.802', 'ARMOR': '1.019', 'weapon2': '1.158', 'DAMAGECOUNT': '1.218', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:35,835][2409565] DAMAGECOUNT value on done: 1485.0
[2023-02-25 12:48:35,839][2409565] Sum rewards: -2.644, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.044', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon5': '0.006', 'AMMO4': '0.018', 'WEAPON5': '0.050', 'AMMO3': '0.105', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'weapon4': '0.384', 'ARMOR': '0.436', 'DAMAGECOUNT': '0.597', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.118', 'weapon3': '1.120'}
[2023-02-25 12:48:36,173][2409355] DAMAGECOUNT value on done: 1690.0
[2023-02-25 12:48:36,176][2409355] Sum rewards: 3.164, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.302', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.030', 'AMMO2': '0.033', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'WEAPON3': '0.200', 'WEAPON4': '0.350', 'HITCOUNT': '0.410', 'ARMOR': '0.444', 'weapon3': '0.620', 'weapon2': '0.668', 'weapon4': '1.032', 'DAMAGECOUNT': '1.743', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:36,554][2409074] Updated weights for policy 0, policy_version 10941 (0.0012)
[2023-02-25 12:48:36,722][2409469] DAMAGECOUNT value on done: 1592.0
[2023-02-25 12:48:36,725][2409469] Sum rewards: -0.216, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.010', 'AMMO2': '0.027', 'AMMO3': '0.083', 'AMMO4': '0.135', 'HITCOUNT': '0.180', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'weapon4': '0.552', 'DAMAGECOUNT': '0.789', 'weapon3': '1.140', 'weapon2': '1.242', 'ARMOR': '1.345', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:36,762][2409547] DAMAGECOUNT value on done: 2208.0
[2023-02-25 12:48:36,765][2409547] Sum rewards: 4.702, reward structure: {'DEATHCOUNT': '-8.250', 'ARMOR': '0.004', 'AMMO2': '0.045', 'WEAPON1': '0.060', 'HEALTH': '0.076', 'AMMO3': '0.106', 'AMMO4': '0.225', 'WEAPON4': '0.250', 'weapon4': '0.298', 'WEAPON3': '0.600', 'HITCOUNT': '0.660', 'weapon2': '1.616', 'weapon3': '1.848', 'DAMAGECOUNT': '2.163', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:36,774][2409099] DAMAGECOUNT value on done: 1761.0
[2023-02-25 12:48:36,777][2409099] Sum rewards: 1.125, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.852', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.060', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'WEAPON5': '0.150', 'weapon4': '0.216', 'weapon5': '0.228', 'HITCOUNT': '0.240', 'WEAPON3': '0.700', 'ARMOR': '0.853', 'DAMAGECOUNT': '1.395', 'weapon3': '1.442', 'weapon2': '1.640', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:36,911][2409486] DAMAGECOUNT value on done: 1707.0
[2023-02-25 12:48:36,978][2409078] DAMAGECOUNT value on done: 1363.0
[2023-02-25 12:48:36,979][2409078] Sum rewards: -0.946, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.062', 'weapon5': '0.064', 'AMMO3': '0.070', 'HEALTH': '0.088', 'WEAPON5': '0.150', 'weapon4': '0.152', 'HITCOUNT': '0.250', 'WEAPON3': '0.400', 'ARMOR': '0.885', 'DAMAGECOUNT': '1.044', 'weapon3': '1.362', 'weapon2': '1.694'}
[2023-02-25 12:48:37,033][2409076] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 12:48:37,039][2409596] DAMAGECOUNT value on done: 1873.0
[2023-02-25 12:48:37,051][2409596] Sum rewards: 10.663, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.894', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO3': '0.078', 'weapon5': '0.168', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'HITCOUNT': '0.460', 'WEAPON3': '0.500', 'weapon2': '1.298', 'weapon3': '1.368', 'DAMAGECOUNT': '2.604', 'FRAGCOUNT': '9.000'}
[2023-02-25 12:48:37,164][2409373] DAMAGECOUNT value on done: 1434.0
[2023-02-25 12:48:37,167][2409373] Sum rewards: 3.345, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.118', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon4': '0.022', 'WEAPON4': '0.050', 'WEAPON1': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.076', 'weapon5': '0.086', 'AMMO4': '0.103', 'WEAPON3': '0.500', 'HITCOUNT': '0.610', 'weapon3': '1.432', 'weapon2': '1.512', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.199'}
[2023-02-25 12:48:37,186][2408954] Fps is (10 sec: 25395.6, 60 sec: 25122.3, 300 sec: 25547.9). Total num frames: 44826624. Throughput: 0: 6334.4. Samples: 11200788. Policy #0 lag: (min: 2.0, avg: 12.8, max: 27.0)
[2023-02-25 12:48:37,186][2408954] Avg episode reward: [(0, '2.351')]
[2023-02-25 12:48:37,262][2409548] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)]
[2023-02-25 12:48:37,350][2409097] DAMAGECOUNT value on done: 1000.0
[2023-02-25 12:48:37,351][2409097] Sum rewards: 2.340, reward structure: {'DEATHCOUNT': '-3.750', 'weapon5': '0.006', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'AMMO3': '0.040', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.132', 'HITCOUNT': '0.150', 'WEAPON3': '0.250', 'weapon4': '0.384', 'DAMAGECOUNT': '0.447', 'HEALTH': '0.500', 'ARMOR': '0.528', 'weapon3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.508'}
[2023-02-25 12:48:37,361][2409406] DAMAGECOUNT value on done: 1883.0
[2023-02-25 12:48:37,364][2409406] Sum rewards: 1.968, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'weapon7': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.060', 'weapon5': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.236', 'HITCOUNT': '0.340', 'WEAPON3': '0.350', 'ARMOR': '0.500', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.050', 'weapon3': '1.270', 'weapon2': '1.566'}
[2023-02-25 12:48:37,669][2409080] DAMAGECOUNT value on done: 2327.0
[2023-02-25 12:48:37,670][2409080] Sum rewards: -0.171, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.156', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.021', 'weapon5': '0.046', 'AMMO4': '0.106', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'HITCOUNT': '0.420', 'weapon4': '0.450', 'WEAPON3': '0.700', 'ARMOR': '0.853', 'FRAGCOUNT': '1.000', 'weapon3': '1.292', 'DAMAGECOUNT': '1.461', 'weapon2': '1.566'}
[2023-02-25 12:48:37,799][2409075] DAMAGECOUNT value on done: 1512.0
[2023-02-25 12:48:37,803][2409075] Sum rewards: 0.395, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.980', 'AMMO2': '0.007', 'AMMO5': '0.008', 'AMMO4': '0.037', 'WEAPON1': '0.040', 'weapon5': '0.046', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'weapon4': '0.130', 'WEAPON5': '0.200', 'HITCOUNT': '0.340', 'WEAPON3': '0.550', 'weapon3': '1.122', 'DAMAGECOUNT': '1.263', 'weapon2': '1.956', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:37,819][2409389] DAMAGECOUNT value on done: 2145.0
[2023-02-25 12:48:37,821][2409389] Sum rewards: 6.361, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.494', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.015', 'weapon7': '0.064', 'weapon5': '0.070', 'AMMO3': '0.073', 'AMMO4': '0.077', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.310', 'weapon4': '0.410', 'ARMOR': '0.472', 'WEAPON3': '0.500', 'weapon2': '1.174', 'weapon3': '1.410', 'DAMAGECOUNT': '1.617', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:37,841][2409096] DAMAGECOUNT value on done: 2050.0
[2023-02-25 12:48:37,841][2409096] Sum rewards: 3.072, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.030', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'weapon7': '0.052', 'AMMO4': '0.074', 'weapon5': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HEALTH': '0.164', 'WEAPON3': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.204', 'HITCOUNT': '0.360', 'weapon3': '0.724', 'FRAGCOUNT': '1.000', 'weapon2': '1.048', 'DAMAGECOUNT': '1.494'}
[2023-02-25 12:48:38,035][2409105] DAMAGECOUNT value on done: 1540.0
[2023-02-25 12:48:38,035][2409105] Sum rewards: 0.380, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.688', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO3': '0.089', 'AMMO4': '0.108', 'weapon5': '0.116', 'WEAPON5': '0.200', 'HITCOUNT': '0.310', 'WEAPON4': '0.350', 'weapon4': '0.534', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.873', 'ARMOR': '0.909', 'weapon3': '1.450', 'weapon2': '1.534', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:38,194][2409405] DAMAGECOUNT value on done: 2636.0
[2023-02-25 12:48:38,195][2409405] Sum rewards: 6.853, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.064', 'AMMO2': '0.013', 'AMMO5': '0.016', 'WEAPON1': '0.030', 'AMMO4': '0.064', 'AMMO3': '0.094', 'weapon5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.256', 'WEAPON5': '0.350', 'HITCOUNT': '0.600', 'WEAPON3': '0.700', 'weapon2': '1.256', 'weapon3': '1.480', 'DAMAGECOUNT': '2.058', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:48:38,207][2409074] Updated weights for policy 0, policy_version 10951 (0.0013)
[2023-02-25 12:48:38,213][2409077] DAMAGECOUNT value on done: 1688.0
[2023-02-25 12:48:38,214][2409077] Sum rewards: 0.514, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.524', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'weapon7': '0.068', 'AMMO3': '0.082', 'weapon5': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.312', 'HITCOUNT': '0.330', 'ARMOR': '0.508', 'WEAPON3': '0.550', 'weapon3': '1.200', 'DAMAGECOUNT': '1.584', 'weapon2': '1.596', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:38,905][2409104] DAMAGECOUNT value on done: 1218.0
[2023-02-25 12:48:38,909][2409104] Sum rewards: -2.463, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.675', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.045', 'WEAPON1': '0.060', 'AMMO3': '0.072', 'HITCOUNT': '0.130', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.436', 'DAMAGECOUNT': '0.483', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.500', 'weapon4': '0.514', 'weapon2': '1.046', 'weapon3': '1.322'}
[2023-02-25 12:48:38,980][2409866] DAMAGECOUNT value on done: 2532.0
[2023-02-25 12:48:38,981][2409866] Sum rewards: 5.930, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.480', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.013', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'weapon7': '0.060', 'weapon5': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.310', 'WEAPON3': '0.350', 'weapon4': '0.386', 'ARMOR': '0.416', 'weapon3': '0.960', 'weapon2': '1.304', 'DAMAGECOUNT': '2.562', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:48:38,983][2409407] DAMAGECOUNT value on done: 1650.0
[2023-02-25 12:48:38,985][2409407] Sum rewards: 5.073, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.920', 'AMMO5': '0.007', 'AMMO2': '0.014', 'ARMOR': '0.028', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'AMMO4': '0.069', 'WEAPON4': '0.200', 'weapon5': '0.202', 'WEAPON5': '0.250', 'weapon4': '0.300', 'HITCOUNT': '0.310', 'WEAPON3': '0.450', 'weapon3': '1.262', 'DAMAGECOUNT': '1.263', 'weapon2': '1.308', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:39,431][2409079] DAMAGECOUNT value on done: 2031.0
[2023-02-25 12:48:39,575][2409565] DAMAGECOUNT value on done: 2121.0
[2023-02-25 12:48:39,579][2409565] Sum rewards: 7.713, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON1': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.086', 'AMMO3': '0.089', 'HEALTH': '0.211', 'WEAPON3': '0.450', 'HITCOUNT': '0.740', 'weapon2': '1.440', 'weapon3': '1.696', 'DAMAGECOUNT': '2.358', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:39,719][2409355] DAMAGECOUNT value on done: 2168.0
[2023-02-25 12:48:39,722][2409355] Sum rewards: 2.819, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.422', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon7': '0.068', 'AMMO3': '0.069', 'HITCOUNT': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.109', 'weapon5': '0.118', 'WEAPON4': '0.150', 'weapon4': '0.190', 'WEAPON5': '0.200', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.705', 'ARMOR': '0.847', 'weapon3': '1.036', 'FRAGCOUNT': '2.000', 'weapon2': '2.162'}
[2023-02-25 12:48:39,732][2409468] DAMAGECOUNT value on done: 1538.0
[2023-02-25 12:48:39,733][2409468] Sum rewards: -0.414, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.978', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'AMMO3': '0.088', 'AMMO4': '0.102', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.290', 'weapon4': '0.412', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.600', 'ARMOR': '0.804', 'DAMAGECOUNT': '1.035', 'weapon2': '1.052', 'weapon3': '1.260'}
[2023-02-25 12:48:39,975][2409076] DAMAGECOUNT value on done: 1291.0
[2023-02-25 12:48:39,975][2409076] Sum rewards: 1.807, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.516', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.007', 'AMMO3': '0.042', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.106', 'weapon4': '0.146', 'HITCOUNT': '0.180', 'WEAPON5': '0.200', 'WEAPON3': '0.300', 'ARMOR': '0.497', 'DAMAGECOUNT': '0.690', 'weapon3': '0.770', 'FRAGCOUNT': '1.000', 'weapon2': '1.278'}
[2023-02-25 12:48:39,976][2409074] Updated weights for policy 0, policy_version 10961 (0.0012)
[2023-02-25 12:48:40,477][2409547] DAMAGECOUNT value on done: 1430.0
[2023-02-25 12:48:40,477][2409547] Sum rewards: -0.570, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.786', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.080', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'weapon4': '0.378', 'HITCOUNT': '0.390', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.251', 'ARMOR': '1.356', 'weapon2': '1.400', 'weapon3': '1.594', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:40,527][2409469] DAMAGECOUNT value on done: 2659.0
[2023-02-25 12:48:40,529][2409469] Sum rewards: 3.040, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.878', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon7': '0.048', 'weapon5': '0.050', 'AMMO3': '0.066', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.320', 'WEAPON3': '0.400', 'weapon4': '0.636', 'weapon3': '0.792', 'ARMOR': '0.879', 'weapon2': '1.458', 'DAMAGECOUNT': '2.061', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:40,812][2409099] DAMAGECOUNT value on done: 2162.0
[2023-02-25 12:48:40,812][2409099] Sum rewards: 0.136, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.552', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'AMMO4': '0.117', 'WEAPON4': '0.200', 'weapon4': '0.288', 'HITCOUNT': '0.420', 'ARMOR': '0.458', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.248', 'weapon3': '1.458', 'weapon2': '1.672', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:40,908][2409486] DAMAGECOUNT value on done: 1208.0
[2023-02-25 12:48:40,913][2409486] Sum rewards: 0.141, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.254', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.033', 'AMMO3': '0.044', 'weapon5': '0.054', 'WEAPON5': '0.100', 'HITCOUNT': '0.310', 'WEAPON4': '0.400', 'WEAPON3': '0.400', 'ARMOR': '0.455', 'weapon4': '0.776', 'weapon2': '0.858', 'weapon3': '0.858', 'DAMAGECOUNT': '1.077', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:40,980][2409078] DAMAGECOUNT value on done: 1478.0
[2023-02-25 12:48:40,981][2409078] Sum rewards: -5.679, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.130', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.074', 'AMMO3': '0.120', 'weapon5': '0.170', 'HITCOUNT': '0.220', 'weapon4': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'ARMOR': '0.451', 'DAMAGECOUNT': '0.732', 'WEAPON3': '0.750', 'weapon2': '1.336', 'weapon3': '1.562'}
[2023-02-25 12:48:41,031][2409097] DAMAGECOUNT value on done: 1590.0
[2023-02-25 12:48:41,032][2409097] Sum rewards: 0.305, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.995', 'AMMO5': '0.005', 'AMMO2': '0.027', 'ARMOR': '0.036', 'WEAPON1': '0.040', 'weapon5': '0.092', 'AMMO3': '0.121', 'AMMO4': '0.133', 'WEAPON5': '0.200', 'HITCOUNT': '0.430', 'WEAPON4': '0.500', 'weapon4': '0.544', 'weapon2': '0.830', 'WEAPON3': '0.900', 'weapon3': '1.424', 'DAMAGECOUNT': '1.518', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:41,274][2409075] DAMAGECOUNT value on done: 1881.0
[2023-02-25 12:48:41,277][2409075] Sum rewards: 3.778, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.465', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO3': '0.032', 'weapon5': '0.058', 'weapon7': '0.060', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.250', 'WEAPON3': '0.250', 'weapon4': '0.418', 'weapon3': '0.656', 'DAMAGECOUNT': '0.990', 'weapon2': '1.020', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:41,288][2409389] DAMAGECOUNT value on done: 1948.0
[2023-02-25 12:48:41,294][2409389] Sum rewards: 1.028, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.850', 'AMMO2': '0.013', 'AMMO3': '0.057', 'AMMO4': '0.062', 'HITCOUNT': '0.160', 'WEAPON3': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.300', 'DAMAGECOUNT': '0.366', 'ARMOR': '0.476', 'weapon2': '0.888', 'FRAGCOUNT': '1.000', 'weapon3': '1.056'}
[2023-02-25 12:48:41,592][2409373] DAMAGECOUNT value on done: 1760.0
[2023-02-25 12:48:41,593][2409373] Sum rewards: -1.103, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.366', 'AMMO2': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.062', 'AMMO3': '0.071', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.126', 'weapon7': '0.132', 'WEAPON4': '0.200', 'HITCOUNT': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'weapon4': '0.560', 'DAMAGECOUNT': '0.861', 'weapon3': '0.946', 'ARMOR': '1.354', 'weapon2': '1.504', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:41,597][2409074] Updated weights for policy 0, policy_version 10971 (0.0013)
[2023-02-25 12:48:41,748][2409096] DAMAGECOUNT value on done: 2106.0
[2023-02-25 12:48:41,750][2409096] Sum rewards: -1.415, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.165', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'weapon5': '0.078', 'weapon7': '0.086', 'AMMO3': '0.089', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.388', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.552', 'weapon2': '0.764', 'FRAGCOUNT': '1.000', 'weapon3': '1.126'}
[2023-02-25 12:48:41,992][2409080] DAMAGECOUNT value on done: 2155.0
[2023-02-25 12:48:41,996][2409080] Sum rewards: 5.812, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.450', 'AMMO4': '-0.048', 'AMMO2': '-0.010', 'AMMO5': '0.006', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'weapon4': '0.036', 'AMMO3': '0.074', 'WEAPON4': '0.100', 'weapon5': '0.100', 'WEAPON5': '0.200', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'weapon3': '1.610', 'weapon2': '1.662', 'DAMAGECOUNT': '2.529', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:42,142][2409405] DAMAGECOUNT value on done: 2111.0
[2023-02-25 12:48:42,143][2409405] Sum rewards: 3.275, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.839', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.031', 'AMMO4': '0.073', 'weapon5': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.250', 'HITCOUNT': '0.400', 'ARMOR': '0.543', 'weapon3': '0.544', 'weapon4': '0.600', 'weapon2': '1.430', 'DAMAGECOUNT': '1.827', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:48:42,186][2408954] Fps is (10 sec: 26623.8, 60 sec: 25395.2, 300 sec: 25547.9). Total num frames: 44957696. Throughput: 0: 6335.7. Samples: 11238744. Policy #0 lag: (min: 1.0, avg: 11.7, max: 23.0)
[2023-02-25 12:48:42,187][2408954] Avg episode reward: [(0, '2.166')]
[2023-02-25 12:48:42,663][2409866] DAMAGECOUNT value on done: 1912.0
[2023-02-25 12:48:42,664][2409866] Sum rewards: 2.620, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.017', 'AMMO2': '0.026', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'weapon5': '0.114', 'AMMO4': '0.130', 'WEAPON5': '0.300', 'weapon4': '0.358', 'HITCOUNT': '0.360', 'ARMOR': '0.400', 'HEALTH': '0.442', 'WEAPON3': '0.650', 'weapon2': '1.138', 'DAMAGECOUNT': '1.503', 'weapon3': '1.922', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:42,843][2409407] DAMAGECOUNT value on done: 1652.0
[2023-02-25 12:48:42,845][2409407] Sum rewards: -1.275, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.260', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.050', 'AMMO4': '0.066', 'weapon5': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'weapon4': '0.128', 'HITCOUNT': '0.180', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.585', 'WEAPON3': '0.750', 'ARMOR': '0.800', 'weapon3': '1.428', 'weapon2': '1.714', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:43,003][2409104] DAMAGECOUNT value on done: 2005.0
[2023-02-25 12:48:43,006][2409104] Sum rewards: 2.863, reward structure: {'DEATHCOUNT': '-5.250', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'HEALTH': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.067', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.121', 'weapon5': '0.158', 'WEAPON5': '0.300', 'HITCOUNT': '0.300', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.936', 'weapon3': '1.036', 'weapon2': '1.534', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:43,255][2409079] DAMAGECOUNT value on done: 2297.0
[2023-02-25 12:48:43,256][2409079] Sum rewards: 6.947, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.408', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.037', 'AMMO3': '0.063', 'WEAPON5': '0.100', 'weapon5': '0.120', 'AMMO4': '0.187', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '0.640', 'weapon4': '0.786', 'weapon2': '0.892', 'weapon3': '1.340', 'DAMAGECOUNT': '2.904', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:48:43,284][2409074] Updated weights for policy 0, policy_version 10981 (0.0012)
[2023-02-25 12:48:43,425][2409355] DAMAGECOUNT value on done: 1590.0
[2023-02-25 12:48:43,426][2409355] Sum rewards: -0.030, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.770', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon5': '0.048', 'AMMO4': '0.076', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'HITCOUNT': '0.280', 'weapon4': '0.380', 'WEAPON3': '0.450', 'ARMOR': '0.474', 'DAMAGECOUNT': '0.804', 'FRAGCOUNT': '1.000', 'weapon3': '1.172', 'weapon2': '1.588'}
[2023-02-25 12:48:43,660][2409076] DAMAGECOUNT value on done: 1759.0
[2023-02-25 12:48:43,661][2409076] Sum rewards: 0.308, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.054', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.016', 'WEAPON1': '0.080', 'weapon5': '0.090', 'AMMO3': '0.137', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'HITCOUNT': '0.430', 'weapon4': '0.446', 'WEAPON3': '0.850', 'weapon2': '1.082', 'DAMAGECOUNT': '1.596', 'weapon3': '1.822', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:44,026][2409468] DAMAGECOUNT value on done: 1793.0
[2023-02-25 12:48:44,029][2409468] Sum rewards: 1.753, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.524', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'weapon5': '0.056', 'weapon7': '0.060', 'AMMO3': '0.083', 'AMMO4': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.330', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.152', 'weapon3': '1.408', 'weapon2': '1.492', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:44,142][2409547] DAMAGECOUNT value on done: 1710.0
[2023-02-25 12:48:44,146][2409547] Sum rewards: 5.359, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.578', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.029', 'AMMO3': '0.050', 'WEAPON4': '0.150', 'weapon4': '0.162', 'WEAPON3': '0.350', 'HITCOUNT': '0.570', 'ARMOR': '0.881', 'weapon3': '1.058', 'DAMAGECOUNT': '1.815', 'weapon2': '2.096', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:44,506][2409099] DAMAGECOUNT value on done: 2325.0
[2023-02-25 12:48:44,507][2409099] Sum rewards: 5.701, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.370', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO3': '0.040', 'weapon7': '0.054', 'AMMO4': '0.069', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.170', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'HITCOUNT': '0.370', 'weapon3': '0.768', 'ARMOR': '0.900', 'DAMAGECOUNT': '1.419', 'weapon2': '2.168', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:44,521][2409074] Updated weights for policy 0, policy_version 10991 (0.0012)
[2023-02-25 12:48:44,566][2409486] DAMAGECOUNT value on done: 2088.0
[2023-02-25 12:48:44,567][2409486] Sum rewards: 3.465, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.858', 'AMMO5': '0.012', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'weapon5': '0.078', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'weapon4': '0.118', 'WEAPON5': '0.250', 'HITCOUNT': '0.430', 'WEAPON3': '0.750', 'weapon2': '1.292', 'DAMAGECOUNT': '1.497', 'weapon3': '1.516', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:44,606][2409469] DAMAGECOUNT value on done: 1793.0
[2023-02-25 12:48:44,607][2409469] Sum rewards: 1.804, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.385', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO5': '0.006', 'WEAPON1': '0.020', 'weapon5': '0.054', 'AMMO3': '0.090', 'WEAPON5': '0.150', 'ARMOR': '0.400', 'HITCOUNT': '0.470', 'WEAPON3': '0.650', 'weapon2': '0.830', 'DAMAGECOUNT': '1.590', 'weapon3': '1.726', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:44,624][2409097] DAMAGECOUNT value on done: 1645.0
[2023-02-25 12:48:44,624][2409097] Sum rewards: 1.143, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.450', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon4': '0.012', 'WEAPON1': '0.030', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'weapon5': '0.128', 'WEAPON5': '0.200', 'HITCOUNT': '0.340', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.260', 'weapon3': '1.366', 'weapon2': '1.736', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:44,870][2409078] DAMAGECOUNT value on done: 1944.0
[2023-02-25 12:48:44,873][2409078] Sum rewards: 2.036, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.382', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO3': '0.060', 'weapon5': '0.158', 'WEAPON5': '0.200', 'HITCOUNT': '0.360', 'WEAPON3': '0.400', 'ARMOR': '0.450', 'weapon2': '1.006', 'DAMAGECOUNT': '1.020', 'weapon3': '1.242', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:45,158][2409075] DAMAGECOUNT value on done: 2093.0
[2023-02-25 12:48:45,159][2409075] Sum rewards: 2.937, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.536', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON1': '0.060', 'weapon5': '0.078', 'AMMO3': '0.085', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.430', 'HITCOUNT': '0.470', 'WEAPON3': '0.550', 'weapon2': '1.286', 'weapon3': '1.342', 'DAMAGECOUNT': '1.860', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:45,160][2409389] DAMAGECOUNT value on done: 1771.0
[2023-02-25 12:48:45,163][2409389] Sum rewards: 2.214, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.610', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.057', 'weapon5': '0.072', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.260', 'weapon4': '0.384', 'ARMOR': '0.457', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.032', 'weapon3': '1.232', 'weapon2': '1.860', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:45,707][2409096] DAMAGECOUNT value on done: 1476.0
[2023-02-25 12:48:45,708][2409096] Sum rewards: -0.089, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.633', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.020', 'WEAPON1': '0.030', 'weapon4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'weapon5': '0.148', 'WEAPON5': '0.150', 'HITCOUNT': '0.270', 'ARMOR': '0.404', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.780', 'weapon3': '1.496', 'weapon2': '1.740', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:45,723][2409080] DAMAGECOUNT value on done: 1847.0
[2023-02-25 12:48:45,724][2409080] Sum rewards: -1.973, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.532', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.042', 'WEAPON1': '0.060', 'weapon5': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.122', 'AMMO3': '0.131', 'WEAPON5': '0.300', 'HITCOUNT': '0.320', 'WEAPON3': '0.850', 'ARMOR': '1.256', 'DAMAGECOUNT': '1.257', 'weapon3': '1.392', 'FRAGCOUNT': '2.000', 'weapon2': '2.116'}
[2023-02-25 12:48:45,943][2409405] DAMAGECOUNT value on done: 1776.0
[2023-02-25 12:48:45,944][2409405] Sum rewards: 0.255, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.675', 'AMMO5': '0.007', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'weapon5': '0.082', 'weapon7': '0.082', 'AMMO3': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'HITCOUNT': '0.230', 'WEAPON4': '0.250', 'ARMOR': '0.425', 'weapon4': '0.466', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.939', 'weapon2': '0.970', 'FRAGCOUNT': '1.000', 'weapon3': '1.134'}
[2023-02-25 12:48:46,165][2409074] Updated weights for policy 0, policy_version 11001 (0.0012)
[2023-02-25 12:48:46,543][2409866] DAMAGECOUNT value on done: 1657.0
[2023-02-25 12:48:46,547][2409866] Sum rewards: 7.968, reward structure: {'DEATHCOUNT': '-4.500', 'weapon7': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'WEAPON4': '0.100', 'weapon5': '0.102', 'HEALTH': '0.113', 'weapon4': '0.128', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.470', 'weapon3': '1.240', 'DAMAGECOUNT': '1.803', 'weapon2': '1.808', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:46,759][2409407] DAMAGECOUNT value on done: 1800.0
[2023-02-25 12:48:46,760][2409407] Sum rewards: -0.624, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.055', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'HEALTH': '0.130', 'weapon4': '0.156', 'HITCOUNT': '0.240', 'ARMOR': '0.404', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.690', 'FRAGCOUNT': '1.000', 'weapon2': '1.524', 'weapon3': '1.720'}
[2023-02-25 12:48:47,106][2409079] DAMAGECOUNT value on done: 1944.0
[2023-02-25 12:48:47,110][2409079] Sum rewards: 4.512, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.132', 'AMMO5': '0.012', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'weapon7': '0.052', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.142', 'weapon4': '0.174', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.420', 'ARMOR': '0.428', 'WEAPON3': '0.650', 'weapon2': '1.506', 'weapon3': '1.680', 'DAMAGECOUNT': '1.791', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:47,186][2408954] Fps is (10 sec: 24985.7, 60 sec: 25258.7, 300 sec: 25506.3). Total num frames: 45076480. Throughput: 0: 6344.0. Samples: 11277312. Policy #0 lag: (min: 0.0, avg: 12.9, max: 26.0)
[2023-02-25 12:48:47,187][2408954] Avg episode reward: [(0, '2.205')]
[2023-02-25 12:48:47,296][2409355] DAMAGECOUNT value on done: 1464.0
[2023-02-25 12:48:47,297][2409355] Sum rewards: -1.176, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.959', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'weapon5': '0.008', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.084', 'AMMO3': '0.109', 'HITCOUNT': '0.270', 'ARMOR': '0.456', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.825', 'weapon3': '1.552', 'weapon2': '1.896', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:47,480][2409076] DAMAGECOUNT value on done: 1316.0
[2023-02-25 12:48:47,481][2409076] Sum rewards: 2.129, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.715', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO3': '0.074', 'weapon7': '0.082', 'WEAPON4': '0.100', 'weapon4': '0.126', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.228', 'HITCOUNT': '0.230', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'ARMOR': '0.812', 'weapon3': '1.066', 'DAMAGECOUNT': '1.551', 'weapon2': '1.720', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:47,757][2409468] DAMAGECOUNT value on done: 1946.0
[2023-02-25 12:48:47,758][2409468] Sum rewards: 1.803, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.928', 'AMMO5': '0.010', 'weapon5': '0.022', 'AMMO2': '0.030', 'weapon7': '0.048', 'AMMO3': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.148', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.370', 'weapon4': '0.524', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.290', 'weapon3': '1.354', 'weapon2': '1.556', 'ARMOR': '1.687', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:47,767][2409074] Updated weights for policy 0, policy_version 11011 (0.0012)
[2023-02-25 12:48:48,239][2409469] DAMAGECOUNT value on done: 1991.0
[2023-02-25 12:48:48,240][2409469] Sum rewards: 3.825, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.725', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.007', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon5': '0.124', 'HITCOUNT': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.200', 'WEAPON3': '0.250', 'ARMOR': '0.459', 'DAMAGECOUNT': '0.897', 'weapon2': '1.188', 'weapon3': '1.738', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:48,252][2409547] DAMAGECOUNT value on done: 1294.0
[2023-02-25 12:48:48,255][2409547] Sum rewards: -0.138, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.912', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'WEAPON1': '0.010', 'AMMO3': '0.053', 'HITCOUNT': '0.290', 'WEAPON3': '0.400', 'ARMOR': '0.424', 'weapon3': '0.948', 'DAMAGECOUNT': '0.954', 'FRAGCOUNT': '1.000', 'weapon2': '1.226'}
[2023-02-25 12:48:48,510][2409078] DAMAGECOUNT value on done: 1955.0
[2023-02-25 12:48:48,511][2409078] Sum rewards: 4.320, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.364', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'weapon5': '0.048', 'AMMO4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.071', 'WEAPON4': '0.100', 'weapon4': '0.204', 'ARMOR': '0.420', 'WEAPON3': '0.450', 'HITCOUNT': '0.450', 'weapon2': '0.942', 'weapon3': '1.038', 'DAMAGECOUNT': '1.578', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:48,612][2409099] DAMAGECOUNT value on done: 1454.0
[2023-02-25 12:48:48,612][2409099] Sum rewards: 4.383, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.020', 'ARMOR': '0.023', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'weapon7': '0.058', 'AMMO4': '0.097', 'AMMO3': '0.099', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.354', 'HITCOUNT': '0.380', 'WEAPON3': '0.450', 'HEALTH': '0.646', 'weapon2': '0.948', 'DAMAGECOUNT': '1.053', 'weapon3': '1.512', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:48,639][2409486] DAMAGECOUNT value on done: 1826.0
[2023-02-25 12:48:48,640][2409486] Sum rewards: 3.360, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.838', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.027', 'WEAPON1': '0.040', 'weapon5': '0.066', 'AMMO3': '0.076', 'WEAPON5': '0.100', 'HITCOUNT': '0.410', 'WEAPON3': '0.550', 'ARMOR': '0.888', 'DAMAGECOUNT': '1.335', 'weapon3': '1.490', 'weapon2': '1.706', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:48:48,662][2409097] DAMAGECOUNT value on done: 2046.0
[2023-02-25 12:48:48,663][2409097] Sum rewards: 2.408, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.528', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.059', 'weapon5': '0.086', 'AMMO3': '0.114', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.400', 'weapon4': '0.620', 'WEAPON3': '0.700', 'ARMOR': '1.304', 'weapon3': '1.376', 'weapon2': '1.430', 'DAMAGECOUNT': '2.205', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:49,177][2409075] DAMAGECOUNT value on done: 2576.0
[2023-02-25 12:48:49,179][2409075] Sum rewards: 1.092, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.390', 'AMMO5': '0.005', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'weapon4': '0.022', 'AMMO4': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.071', 'WEAPON4': '0.100', 'HITCOUNT': '0.280', 'WEAPON3': '0.550', 'ARMOR': '0.828', 'weapon3': '1.222', 'weapon2': '1.520', 'DAMAGECOUNT': '1.734', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:49,369][2409096] DAMAGECOUNT value on done: 2328.0
[2023-02-25 12:48:49,370][2409096] Sum rewards: 1.684, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.439', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.041', 'AMMO3': '0.120', 'WEAPON4': '0.250', 'weapon4': '0.422', 'HITCOUNT': '0.550', 'WEAPON3': '0.750', 'ARMOR': '1.330', 'weapon3': '1.478', 'weapon2': '1.700', 'DAMAGECOUNT': '1.704', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:49,471][2409074] Updated weights for policy 0, policy_version 11021 (0.0012)
[2023-02-25 12:48:49,495][2409080] DAMAGECOUNT value on done: 2135.0
[2023-02-25 12:48:49,496][2409080] Sum rewards: -2.459, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.030', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.025', 'WEAPON1': '0.040', 'weapon5': '0.108', 'AMMO3': '0.117', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'WEAPON5': '0.250', 'weapon4': '0.262', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.780', 'weapon2': '1.046', 'weapon3': '1.868'}
[2023-02-25 12:48:50,972][2409079] DAMAGECOUNT value on done: 2270.0
[2023-02-25 12:48:50,976][2409079] Sum rewards: 2.798, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.282', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.040', 'AMMO3': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.120', 'WEAPON3': '0.350', 'HITCOUNT': '0.370', 'DAMAGECOUNT': '1.140', 'weapon3': '1.226', 'weapon2': '1.410', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:51,043][2409076] DAMAGECOUNT value on done: 2414.0
[2023-02-25 12:48:51,044][2409076] Sum rewards: 1.593, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.498', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO3': '0.079', 'weapon5': '0.140', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.380', 'ARMOR': '0.464', 'WEAPON3': '0.550', 'weapon4': '0.560', 'weapon2': '0.766', 'DAMAGECOUNT': '1.359', 'FRAGCOUNT': '1.500', 'weapon3': '1.618'}
[2023-02-25 12:48:51,095][2409074] Updated weights for policy 0, policy_version 11031 (0.0012)
[2023-02-25 12:48:51,603][2409468] DAMAGECOUNT value on done: 2060.0
[2023-02-25 12:48:51,604][2409468] Sum rewards: 1.219, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.210', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO4': '0.020', 'AMMO3': '0.068', 'WEAPON3': '0.450', 'HITCOUNT': '0.510', 'FRAGCOUNT': '1.000', 'weapon2': '1.130', 'weapon3': '1.222', 'DAMAGECOUNT': '1.515'}
[2023-02-25 12:48:51,780][2409469] DAMAGECOUNT value on done: 1447.0
[2023-02-25 12:48:51,781][2409469] Sum rewards: 4.530, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'ARMOR': '0.028', 'weapon7': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'weapon5': '0.126', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.214', 'WEAPON3': '0.350', 'HEALTH': '0.361', 'HITCOUNT': '0.390', 'weapon3': '1.270', 'DAMAGECOUNT': '1.290', 'weapon2': '1.838', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:52,186][2408954] Fps is (10 sec: 26214.5, 60 sec: 25600.0, 300 sec: 25589.6). Total num frames: 45219840. Throughput: 0: 6361.6. Samples: 11297040. Policy #0 lag: (min: 0.0, avg: 12.9, max: 26.0)
[2023-02-25 12:48:52,187][2408954] Avg episode reward: [(0, '2.072')]
[2023-02-25 12:48:52,323][2409547] DAMAGECOUNT value on done: 1971.0
[2023-02-25 12:48:52,328][2409547] Sum rewards: -1.774, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.220', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.058', 'weapon4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'WEAPON5': '0.150', 'HITCOUNT': '0.310', 'WEAPON3': '0.700', 'weapon3': '1.110', 'ARMOR': '1.374', 'DAMAGECOUNT': '1.440', 'FRAGCOUNT': '2.000', 'weapon2': '2.024'}
[2023-02-25 12:48:52,336][2409078] DAMAGECOUNT value on done: 1185.0
[2023-02-25 12:48:52,556][2409486] DAMAGECOUNT value on done: 1918.0
[2023-02-25 12:48:52,559][2409486] Sum rewards: -0.001, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.284', 'weapon6': '0.002', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.102', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'WEAPON6': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.430', 'ARMOR': '0.462', 'weapon4': '0.610', 'WEAPON3': '0.950', 'weapon2': '1.004', 'DAMAGECOUNT': '1.380', 'weapon3': '1.772', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:52,560][2409099] DAMAGECOUNT value on done: 2180.0
[2023-02-25 12:48:52,563][2409099] Sum rewards: 1.767, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.040', 'AMMO5': '0.011', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.065', 'weapon4': '0.066', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'weapon5': '0.148', 'WEAPON5': '0.200', 'ARMOR': '0.448', 'HITCOUNT': '0.470', 'WEAPON3': '0.650', 'weapon2': '1.510', 'weapon3': '1.772', 'DAMAGECOUNT': '2.247', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:48:52,592][2409074] Updated weights for policy 0, policy_version 11041 (0.0013)
[2023-02-25 12:48:52,715][2409097] DAMAGECOUNT value on done: 1977.0
[2023-02-25 12:48:52,716][2409097] Sum rewards: -1.026, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.442', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.090', 'WEAPON4': '0.250', 'ARMOR': '0.432', 'HITCOUNT': '0.460', 'WEAPON3': '0.650', 'weapon4': '0.688', 'weapon3': '0.912', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.920', 'weapon2': '2.072'}
[2023-02-25 12:48:53,119][2409096] DAMAGECOUNT value on done: 1192.0
[2023-02-25 12:48:53,120][2409096] Sum rewards: 0.143, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.618', 'AMMO5': '0.009', 'weapon7': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.048', 'AMMO3': '0.077', 'AMMO4': '0.087', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.200', 'HITCOUNT': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.302', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.729', 'weapon3': '0.848', 'ARMOR': '0.871', 'FRAGCOUNT': '1.000', 'weapon2': '1.290'}
[2023-02-25 12:48:53,321][2409075] DAMAGECOUNT value on done: 1861.0
[2023-02-25 12:48:53,322][2409075] Sum rewards: 3.106, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.080', 'weapon5': '0.086', 'weapon7': '0.096', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.208', 'HEALTH': '0.282', 'WEAPON3': '0.500', 'HITCOUNT': '0.520', 'weapon2': '1.076', 'weapon3': '1.474', 'DAMAGECOUNT': '1.701', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:48:53,420][2409080] DAMAGECOUNT value on done: 1677.0
[2023-02-25 12:48:53,421][2409080] Sum rewards: 1.885, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.924', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.018', 'WEAPON1': '0.020', 'AMMO3': '0.076', 'weapon4': '0.128', 'weapon7': '0.130', 'HITCOUNT': '0.150', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.154', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.927', 'weapon3': '0.992', 'weapon2': '1.182', 'ARMOR': '1.290', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:54,253][2409074] Updated weights for policy 0, policy_version 11051 (0.0012)
[2023-02-25 12:48:54,807][2409079] DAMAGECOUNT value on done: 1360.0
[2023-02-25 12:48:54,808][2409079] Sum rewards: 0.506, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.390', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.048', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.050', 'WEAPON1': '0.060', 'weapon4': '0.084', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.400', 'FRAGCOUNT': '1.000', 'weapon3': '1.092', 'weapon2': '1.310'}
[2023-02-25 12:48:55,552][2409468] DAMAGECOUNT value on done: 1570.0
[2023-02-25 12:48:55,556][2409468] Sum rewards: -1.078, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.328', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO5': '0.010', 'WEAPON1': '0.070', 'weapon4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'weapon5': '0.128', 'WEAPON5': '0.250', 'HITCOUNT': '0.300', 'ARMOR': '0.454', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.825', 'FRAGCOUNT': '1.000', 'weapon3': '1.376', 'weapon2': '1.684'}
[2023-02-25 12:48:55,675][2409074] Updated weights for policy 0, policy_version 11061 (0.0013)
[2023-02-25 12:48:56,031][2409078] DAMAGECOUNT value on done: 1925.0
[2023-02-25 12:48:56,035][2409078] Sum rewards: 2.290, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.682', 'AMMO2': '0.004', 'AMMO4': '0.022', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.076', 'weapon7': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.150', 'ARMOR': '0.400', 'HITCOUNT': '0.410', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.554', 'weapon3': '1.558', 'weapon2': '1.722', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:56,675][2409486] DAMAGECOUNT value on done: 1503.0
[2023-02-25 12:48:56,676][2409486] Sum rewards: 0.564, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO3': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.074', 'weapon4': '0.092', 'WEAPON5': '0.100', 'weapon5': '0.194', 'HITCOUNT': '0.220', 'WEAPON3': '0.250', 'ARMOR': '0.400', 'FRAGCOUNT': '0.500', 'HEALTH': '0.541', 'DAMAGECOUNT': '0.813', 'weapon3': '0.828', 'weapon2': '1.680'}
[2023-02-25 12:48:56,695][2409099] DAMAGECOUNT value on done: 1330.0
[2023-02-25 12:48:56,696][2409099] Sum rewards: 2.277, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.384', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'AMMO3': '0.020', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.052', 'weapon4': '0.066', 'weapon7': '0.090', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.190', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'weapon3': '0.472', 'ARMOR': '0.492', 'DAMAGECOUNT': '0.765', 'weapon2': '0.988', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:48:56,699][2409096] DAMAGECOUNT value on done: 2459.0
[2023-02-25 12:48:56,700][2409096] Sum rewards: 1.298, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.662', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.019', 'WEAPON1': '0.040', 'weapon5': '0.052', 'weapon4': '0.068', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.300', 'WEAPON3': '0.650', 'ARMOR': '0.858', 'DAMAGECOUNT': '1.194', 'weapon2': '1.388', 'weapon3': '1.594', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:56,758][2409547] DAMAGECOUNT value on done: 1607.0
[2023-02-25 12:48:56,759][2409547] Sum rewards: 0.053, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.930', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.080', 'WEAPON4': '0.200', 'HITCOUNT': '0.320', 'weapon4': '0.370', 'WEAPON3': '0.500', 'ARMOR': '0.861', 'weapon3': '0.984', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.191', 'weapon2': '1.398'}
[2023-02-25 12:48:57,098][2409097] DAMAGECOUNT value on done: 1872.0
[2023-02-25 12:48:57,100][2409097] Sum rewards: 3.247, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.970', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'AMMO4': '0.032', 'AMMO3': '0.067', 'weapon5': '0.134', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.350', 'WEAPON3': '0.500', 'weapon4': '0.616', 'weapon3': '1.272', 'DAMAGECOUNT': '1.281', 'weapon2': '1.402', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:48:57,186][2408954] Fps is (10 sec: 26624.0, 60 sec: 25531.7, 300 sec: 25575.7). Total num frames: 45342720. Throughput: 0: 6386.1. Samples: 11335824. Policy #0 lag: (min: 0.0, avg: 11.1, max: 24.0)
[2023-02-25 12:48:57,187][2408954] Avg episode reward: [(0, '1.868')]
[2023-02-25 12:48:57,194][2409080] DAMAGECOUNT value on done: 1110.0
[2023-02-25 12:48:57,195][2409080] Sum rewards: 1.819, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.555', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO3': '0.071', 'AMMO4': '0.097', 'WEAPON5': '0.150', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.308', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.795', 'ARMOR': '0.885', 'weapon3': '1.170', 'weapon2': '1.284', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:48:57,320][2409074] Updated weights for policy 0, policy_version 11071 (0.0012)
[2023-02-25 12:48:58,370][2409079] DAMAGECOUNT value on done: 2144.0
[2023-02-25 12:48:58,371][2409079] Sum rewards: 5.944, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.041', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO4': '0.029', 'AMMO3': '0.061', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.180', 'WEAPON3': '0.500', 'HITCOUNT': '0.550', 'weapon2': '0.878', 'ARMOR': '0.931', 'weapon3': '1.440', 'DAMAGECOUNT': '2.385', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:48:59,063][2409074] Updated weights for policy 0, policy_version 11081 (0.0012)
[2023-02-25 12:48:59,744][2409468] DAMAGECOUNT value on done: 1618.0
[2023-02-25 12:48:59,748][2409468] Sum rewards: 0.597, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'AMMO2': '0.011', 'ARMOR': '0.052', 'AMMO4': '0.057', 'HEALTH': '0.061', 'AMMO3': '0.079', 'WEAPON5': '0.100', 'weapon5': '0.148', 'WEAPON4': '0.200', 'weapon4': '0.236', 'HITCOUNT': '0.250', 'WEAPON3': '0.400', 'weapon2': '0.846', 'DAMAGECOUNT': '0.876', 'FRAGCOUNT': '1.000', 'weapon3': '1.526'}
[2023-02-25 12:49:00,230][2409486] DAMAGECOUNT value on done: 1559.0
[2023-02-25 12:49:00,231][2409486] Sum rewards: 3.630, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.521', 'AMMO2': '0.002', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.012', 'weapon5': '0.054', 'AMMO3': '0.067', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.206', 'HITCOUNT': '0.280', 'WEAPON3': '0.450', 'ARMOR': '0.492', 'weapon2': '1.206', 'DAMAGECOUNT': '1.305', 'weapon3': '1.312', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:49:00,268][2409099] DAMAGECOUNT value on done: 2086.0
[2023-02-25 12:49:00,269][2409099] Sum rewards: 9.330, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.012', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO3': '0.067', 'weapon5': '0.092', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.428', 'WEAPON3': '0.450', 'HITCOUNT': '0.620', 'weapon3': '1.258', 'ARMOR': '1.318', 'weapon2': '1.562', 'DAMAGECOUNT': '2.016', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:49:00,347][2409074] Updated weights for policy 0, policy_version 11091 (0.0012)
[2023-02-25 12:49:00,583][2409096] DAMAGECOUNT value on done: 1525.0
[2023-02-25 12:49:00,584][2409096] Sum rewards: 3.130, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.165', 'AMMO5': '0.005', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.025', 'weapon5': '0.062', 'AMMO3': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.342', 'HITCOUNT': '0.360', 'WEAPON3': '0.450', 'weapon2': '0.974', 'DAMAGECOUNT': '1.077', 'weapon3': '1.460', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:49:01,175][2409547] DAMAGECOUNT value on done: 2264.0
[2023-02-25 12:49:01,176][2409547] Sum rewards: 2.867, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.730', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.086', 'AMMO3': '0.120', 'weapon5': '0.182', 'WEAPON4': '0.200', 'weapon4': '0.210', 'WEAPON5': '0.250', 'HITCOUNT': '0.360', 'ARMOR': '0.420', 'WEAPON3': '0.800', 'weapon2': '0.864', 'DAMAGECOUNT': '1.620', 'weapon3': '1.928', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:49:01,362][2409080] DAMAGECOUNT value on done: 1494.0
[2023-02-25 12:49:01,363][2409080] Sum rewards: 0.857, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.608', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.040', 'AMMO4': '0.066', 'AMMO3': '0.084', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.290', 'weapon4': '0.396', 'ARMOR': '0.432', 'WEAPON3': '0.500', 'weapon2': '0.708', 'weapon3': '0.976', 'DAMAGECOUNT': '0.996', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:49:02,007][2409079] DAMAGECOUNT value on done: 1363.0
[2023-02-25 12:49:02,186][2408954] Fps is (10 sec: 24576.0, 60 sec: 25326.9, 300 sec: 25561.8). Total num frames: 45465600. Throughput: 0: 6404.8. Samples: 11374800. Policy #0 lag: (min: 0.0, avg: 11.1, max: 24.0)
[2023-02-25 12:49:02,187][2408954] Avg episode reward: [(0, '1.844')]
[2023-02-25 12:49:02,418][2409074] Updated weights for policy 0, policy_version 11101 (0.0012)
[2023-02-25 12:49:03,546][2409468] DAMAGECOUNT value on done: 1780.0
[2023-02-25 12:49:03,547][2409468] Sum rewards: 1.290, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.984', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'ARMOR': '0.020', 'AMMO3': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.130', 'HITCOUNT': '0.320', 'WEAPON3': '0.400', 'DAMAGECOUNT': '1.083', 'weapon3': '1.110', 'weapon2': '1.584', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:49:03,711][2409074] Updated weights for policy 0, policy_version 11111 (0.0012)
[2023-02-25 12:49:04,457][2409099] DAMAGECOUNT value on done: 1820.0
[2023-02-25 12:49:04,459][2409099] Sum rewards: 1.565, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.028', 'AMMO2': '0.007', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.034', 'AMMO3': '0.066', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.300', 'weapon4': '0.428', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.888', 'weapon3': '0.952', 'ARMOR': '1.314', 'weapon2': '1.586', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:49:04,757][2409074] Updated weights for policy 0, policy_version 11121 (0.0012)
[2023-02-25 12:49:05,079][2409547] DAMAGECOUNT value on done: 1427.0
[2023-02-25 12:49:05,164][2409080] DAMAGECOUNT value on done: 1578.0
[2023-02-25 12:49:05,984][2409079] DAMAGECOUNT value on done: 1423.0
[2023-02-25 12:49:05,988][2409079] Sum rewards: 3.463, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.454', 'AMMO5': '0.010', 'AMMO2': '0.014', 'WEAPON1': '0.060', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon4': '0.116', 'weapon5': '0.130', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'HITCOUNT': '0.430', 'WEAPON3': '0.600', 'weapon3': '1.558', 'weapon2': '1.734', 'DAMAGECOUNT': '1.836', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:49:06,943][2409074] Updated weights for policy 0, policy_version 11131 (0.0013)
[2023-02-25 12:49:07,186][2408954] Fps is (10 sec: 25804.7, 60 sec: 25463.5, 300 sec: 25575.7). Total num frames: 45600768. Throughput: 0: 6406.9. Samples: 11394252. Policy #0 lag: (min: 0.0, avg: 11.9, max: 24.0)
[2023-02-25 12:49:07,186][2408954] Avg episode reward: [(0, '1.820')]
[2023-02-25 12:49:07,374][2409468] DAMAGECOUNT value on done: 1807.0
[2023-02-25 12:49:07,376][2409468] Sum rewards: 2.693, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.282', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO3': '0.066', 'AMMO4': '0.079', 'WEAPON4': '0.200', 'weapon4': '0.278', 'HITCOUNT': '0.290', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'weapon3': '0.842', 'weapon2': '0.908', 'DAMAGECOUNT': '1.236', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:49:07,983][2409074] Updated weights for policy 0, policy_version 11141 (0.0013)
[2023-02-25 12:49:08,340][2409099] DAMAGECOUNT value on done: 1515.0
[2023-02-25 12:49:08,344][2409099] Sum rewards: 3.403, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.206', 'AMMO5': '0.003', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'weapon5': '0.012', 'AMMO4': '0.018', 'WEAPON5': '0.050', 'weapon7': '0.078', 'AMMO3': '0.099', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.280', 'weapon4': '0.434', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.032', 'weapon3': '1.320', 'ARMOR': '1.361', 'weapon2': '1.418', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:49:08,823][2409547] DAMAGECOUNT value on done: 1474.0
[2023-02-25 12:49:08,824][2409547] Sum rewards: -4.216, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.644', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.040', 'AMMO3': '0.070', 'weapon5': '0.074', 'WEAPON5': '0.150', 'AMMO4': '0.200', 'HITCOUNT': '0.360', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.514', 'ARMOR': '0.861', 'weapon3': '1.130', 'DAMAGECOUNT': '1.155', 'weapon2': '1.996'}
[2023-02-25 12:49:08,919][2409080] DAMAGECOUNT value on done: 1444.0
[2023-02-25 12:49:08,920][2409080] Sum rewards: -0.133, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.207', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'weapon7': '0.004', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'weapon4': '0.130', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.226', 'HITCOUNT': '0.230', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'ARMOR': '0.851', 'DAMAGECOUNT': '0.888', 'weapon2': '1.590', 'weapon3': '1.678', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:49:10,284][2409074] Updated weights for policy 0, policy_version 11151 (0.0012)
[2023-02-25 12:49:11,212][2409468] DAMAGECOUNT value on done: 1622.0
[2023-02-25 12:49:11,213][2409468] Sum rewards: 2.966, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.838', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.055', 'AMMO3': '0.076', 'weapon5': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.540', 'weapon4': '0.566', 'weapon3': '1.110', 'ARMOR': '1.371', 'weapon2': '1.462', 'DAMAGECOUNT': '2.010', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:49:11,582][2409074] Updated weights for policy 0, policy_version 11161 (0.0013)
[2023-02-25 12:49:12,186][2408954] Fps is (10 sec: 27033.5, 60 sec: 25736.5, 300 sec: 25603.5). Total num frames: 45735936. Throughput: 0: 6429.6. Samples: 11433228. Policy #0 lag: (min: 0.0, avg: 11.9, max: 24.0)
[2023-02-25 12:49:12,186][2408954] Avg episode reward: [(0, '1.780')]
[2023-02-25 12:49:12,591][2409099] DAMAGECOUNT value on done: 2488.0
[2023-02-25 12:49:12,592][2409099] Sum rewards: 4.437, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.826', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon7': '0.058', 'weapon5': '0.084', 'AMMO4': '0.091', 'AMMO3': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.400', 'weapon4': '0.456', 'WEAPON3': '0.650', 'weapon2': '1.262', 'weapon3': '1.454', 'DAMAGECOUNT': '2.235', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:49:12,733][2409080] DAMAGECOUNT value on done: 1495.0
[2023-02-25 12:49:12,736][2409080] Sum rewards: 5.366, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.164', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.058', 'WEAPON4': '0.100', 'HITCOUNT': '0.130', 'WEAPON5': '0.150', 'weapon5': '0.188', 'weapon4': '0.220', 'WEAPON3': '0.300', 'ARMOR': '0.800', 'weapon3': '0.988', 'DAMAGECOUNT': '1.461', 'weapon2': '1.818', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:49:12,813][2409074] Updated weights for policy 0, policy_version 11171 (0.0012)
[2023-02-25 12:49:13,021][2409547] DAMAGECOUNT value on done: 1705.0
[2023-02-25 12:49:13,023][2409547] Sum rewards: -3.711, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-1.000', 'HEALTH': '-0.696', 'AMMO5': '0.013', 'AMMO2': '0.028', 'AMMO3': '0.040', 'WEAPON1': '0.050', 'weapon5': '0.124', 'AMMO4': '0.139', 'WEAPON5': '0.250', 'HITCOUNT': '0.250', 'WEAPON3': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.412', 'DAMAGECOUNT': '0.861', 'ARMOR': '0.891', 'weapon3': '1.056', 'weapon2': '1.570'}
[2023-02-25 12:49:14,999][2409074] Updated weights for policy 0, policy_version 11181 (0.0017)
[2023-02-25 12:49:15,079][2409468] DAMAGECOUNT value on done: 1673.0
[2023-02-25 12:49:15,082][2409468] Sum rewards: 4.609, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.012', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.037', 'weapon7': '0.060', 'AMMO3': '0.062', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.446', 'WEAPON3': '0.450', 'ARMOR': '0.477', 'weapon3': '0.762', 'DAMAGECOUNT': '0.900', 'weapon2': '1.110', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:49:15,999][2409074] Updated weights for policy 0, policy_version 11191 (0.0012)
[2023-02-25 12:49:16,367][2409099] DAMAGECOUNT value on done: 1671.0
[2023-02-25 12:49:16,368][2409099] Sum rewards: -5.171, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.534', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.042', 'AMMO3': '0.121', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'WEAPON4': '0.250', 'HITCOUNT': '0.260', 'weapon4': '0.440', 'ARMOR': '0.460', 'DAMAGECOUNT': '0.762', 'WEAPON3': '0.850', 'weapon2': '1.352', 'weapon3': '1.732', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:49:16,580][2409080] DAMAGECOUNT value on done: 1946.0
[2023-02-25 12:49:16,580][2409080] Sum rewards: 5.885, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.002', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'AMMO3': '0.067', 'AMMO4': '0.104', 'weapon4': '0.202', 'HITCOUNT': '0.350', 'WEAPON3': '0.400', 'ARMOR': '0.804', 'weapon3': '1.000', 'DAMAGECOUNT': '1.215', 'weapon2': '1.664', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:49:17,186][2408954] Fps is (10 sec: 25394.3, 60 sec: 25668.1, 300 sec: 25603.4). Total num frames: 45854720. Throughput: 0: 6437.0. Samples: 11471832. Policy #0 lag: (min: 0.0, avg: 14.3, max: 25.0)
[2023-02-25 12:49:17,187][2408954] Avg episode reward: [(0, '1.775')]
[2023-02-25 12:49:17,337][2409547] DAMAGECOUNT value on done: 1180.0
[2023-02-25 12:49:17,337][2409547] Sum rewards: 0.666, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.140', 'AMMO2': '0.026', 'ARMOR': '0.040', 'WEAPON1': '0.040', 'AMMO3': '0.060', 'HITCOUNT': '0.090', 'AMMO4': '0.128', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.252', 'WEAPON3': '0.400', 'weapon4': '0.648', 'weapon3': '1.006', 'weapon2': '1.116', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:49:18,373][2409074] Updated weights for policy 0, policy_version 11201 (0.0012)
[2023-02-25 12:49:18,691][2409033] Signal inference workers to stop experience collection... (1400 times)
[2023-02-25 12:49:18,696][2409033] Signal inference workers to resume experience collection... (1400 times)
[2023-02-25 12:49:18,726][2409074] InferenceWorker_p0-w0: stopping experience collection (1400 times)
[2023-02-25 12:49:18,726][2409074] InferenceWorker_p0-w0: resuming experience collection (1400 times)
[2023-02-25 12:49:19,217][2409468] DAMAGECOUNT value on done: 2205.0
[2023-02-25 12:49:19,218][2409468] Sum rewards: -3.963, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.778', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'weapon5': '0.050', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'weapon4': '0.284', 'ARMOR': '0.485', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.068', 'weapon2': '1.480', 'weapon3': '1.906', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:49:19,591][2409074] Updated weights for policy 0, policy_version 11211 (0.0012)
[2023-02-25 12:49:20,723][2409080] DAMAGECOUNT value on done: 1872.0
[2023-02-25 12:49:20,726][2409080] Sum rewards: 1.434, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.354', 'AMMO5': '0.007', 'weapon5': '0.028', 'WEAPON1': '0.030', 'AMMO2': '0.051', 'AMMO3': '0.094', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.254', 'WEAPON4': '0.300', 'weapon4': '0.368', 'HITCOUNT': '0.450', 'WEAPON3': '0.550', 'ARMOR': '1.232', 'DAMAGECOUNT': '1.257', 'weapon3': '1.324', 'weapon2': '1.392', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:49:21,249][2409074] Updated weights for policy 0, policy_version 11221 (0.0013)
[2023-02-25 12:49:21,345][2409547] DAMAGECOUNT value on done: 1786.0
[2023-02-25 12:49:21,346][2409547] Sum rewards: 3.488, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.700', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.026', 'WEAPON1': '0.060', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'weapon5': '0.210', 'HITCOUNT': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.374', 'WEAPON3': '0.700', 'ARMOR': '0.812', 'weapon2': '1.226', 'DAMAGECOUNT': '1.335', 'weapon3': '1.386', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:49:22,186][2408954] Fps is (10 sec: 24166.3, 60 sec: 25395.2, 300 sec: 25561.8). Total num frames: 45977600. Throughput: 0: 6441.6. Samples: 11490660. Policy #0 lag: (min: 0.0, avg: 13.5, max: 31.0)
[2023-02-25 12:49:22,187][2408954] Avg episode reward: [(0, '1.691')]
[2023-02-25 12:49:22,857][2409074] Updated weights for policy 0, policy_version 11231 (0.0012)
[2023-02-25 12:49:23,040][2409468] DAMAGECOUNT value on done: 1741.0
[2023-02-25 12:49:23,042][2409468] Sum rewards: -1.436, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.440', 'AMMO5': '0.003', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.124', 'WEAPON4': '0.400', 'HITCOUNT': '0.490', 'weapon4': '0.528', 'WEAPON3': '0.800', 'weapon2': '1.168', 'weapon3': '1.586', 'DAMAGECOUNT': '1.602', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:49:23,926][2409074] Updated weights for policy 0, policy_version 11241 (0.0012)
[2023-02-25 12:49:24,826][2409080] DAMAGECOUNT value on done: 2215.0
[2023-02-25 12:49:24,828][2409080] Sum rewards: 0.659, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.079', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.018', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'WEAPON4': '0.150', 'HITCOUNT': '0.280', 'weapon4': '0.332', 'WEAPON3': '0.350', 'weapon3': '0.912', 'DAMAGECOUNT': '1.029', 'weapon2': '1.516', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:49:25,246][2409547] DAMAGECOUNT value on done: 1989.0
[2023-02-25 12:49:25,249][2409547] Sum rewards: 2.010, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.355', 'AMMO4': '-0.062', 'AMMO2': '-0.012', 'AMMO5': '0.008', 'WEAPON1': '0.040', 'AMMO3': '0.053', 'weapon5': '0.060', 'WEAPON5': '0.200', 'HITCOUNT': '0.250', 'WEAPON3': '0.400', 'ARMOR': '0.486', 'weapon3': '1.178', 'DAMAGECOUNT': '1.236', 'weapon2': '1.778', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:49:26,141][2409074] Updated weights for policy 0, policy_version 11251 (0.0013)
[2023-02-25 12:49:27,186][2408954] Fps is (10 sec: 26624.6, 60 sec: 25804.8, 300 sec: 25631.2). Total num frames: 46120960. Throughput: 0: 6456.8. Samples: 11529300. Policy #0 lag: (min: 0.0, avg: 13.5, max: 31.0)
[2023-02-25 12:49:27,186][2408954] Avg episode reward: [(0, '1.564')]
[2023-02-25 12:49:27,207][2409074] Updated weights for policy 0, policy_version 11261 (0.0012)
[2023-02-25 12:49:27,243][2409075] Large shaping reward 2.509 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.47700000000000004, 159.0), ('weapon5', 0.002)]
[2023-02-25 12:49:27,373][2409468] DAMAGECOUNT value on done: 2894.0
[2023-02-25 12:49:27,374][2409468] Sum rewards: 9.830, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.306', 'AMMO5': '0.010', 'AMMO2': '0.023', 'WEAPON1': '0.050', 'AMMO3': '0.063', 'AMMO4': '0.113', 'WEAPON4': '0.200', 'weapon4': '0.240', 'WEAPON5': '0.250', 'weapon5': '0.312', 'WEAPON3': '0.400', 'HITCOUNT': '0.620', 'ARMOR': '0.816', 'weapon3': '1.346', 'weapon2': '1.366', 'DAMAGECOUNT': '3.327', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:49:28,819][2409080] DAMAGECOUNT value on done: 1773.0
[2023-02-25 12:49:28,820][2409080] Sum rewards: 3.016, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.900', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.017', 'WEAPON1': '0.030', 'weapon7': '0.060', 'AMMO3': '0.073', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.112', 'WEAPON5': '0.150', 'HITCOUNT': '0.340', 'WEAPON3': '0.550', 'weapon2': '1.152', 'weapon3': '1.642', 'DAMAGECOUNT': '1.731', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:49:28,994][2409074] Updated weights for policy 0, policy_version 11271 (0.0013)
[2023-02-25 12:49:29,327][2409547] DAMAGECOUNT value on done: 1664.0
[2023-02-25 12:49:29,328][2409547] Sum rewards: -4.587, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.670', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.013', 'AMMO5': '0.015', 'ARMOR': '0.036', 'AMMO4': '0.063', 'WEAPON1': '0.070', 'weapon5': '0.092', 'AMMO3': '0.139', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.370', 'weapon4': '0.554', 'weapon2': '0.590', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.227', 'weapon3': '2.014'}
[2023-02-25 12:49:30,745][2409074] Updated weights for policy 0, policy_version 11281 (0.0012)
[2023-02-25 12:49:31,311][2409468] DAMAGECOUNT value on done: 1982.0
[2023-02-25 12:49:31,312][2409468] Sum rewards: 3.257, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.010', 'AMMO5': '0.013', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.094', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'AMMO3': '0.132', 'weapon4': '0.160', 'WEAPON5': '0.300', 'HITCOUNT': '0.570', 'WEAPON3': '0.800', 'weapon2': '1.204', 'weapon3': '1.880', 'DAMAGECOUNT': '2.130', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:49:32,186][2408954] Fps is (10 sec: 26624.1, 60 sec: 25873.1, 300 sec: 25617.4). Total num frames: 46243840. Throughput: 0: 6457.3. Samples: 11567892. Policy #0 lag: (min: 0.0, avg: 10.3, max: 24.0)
[2023-02-25 12:49:32,186][2408954] Avg episode reward: [(0, '1.643')]
[2023-02-25 12:49:32,230][2409074] Updated weights for policy 0, policy_version 11291 (0.0012)
[2023-02-25 12:49:32,760][2409080] DAMAGECOUNT value on done: 2142.0
[2023-02-25 12:49:32,761][2409080] Sum rewards: 5.313, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.660', 'AMMO2': '0.009', 'WEAPON1': '0.030', 'AMMO4': '0.045', 'weapon4': '0.054', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'HITCOUNT': '0.420', 'WEAPON3': '0.500', 'ARMOR': '0.592', 'DAMAGECOUNT': '1.305', 'weapon3': '1.350', 'weapon2': '1.734', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:49:33,986][2409074] Updated weights for policy 0, policy_version 11301 (0.0012)
[2023-02-25 12:49:35,052][2409074] Updated weights for policy 0, policy_version 11311 (0.0012)
[2023-02-25 12:49:35,263][2409468] DAMAGECOUNT value on done: 1556.0
[2023-02-25 12:49:35,267][2409468] Sum rewards: 2.094, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.591', 'AMMO4': '-0.038', 'AMMO2': '-0.007', 'WEAPON1': '0.020', 'AMMO3': '0.069', 'WEAPON4': '0.150', 'weapon4': '0.300', 'HITCOUNT': '0.430', 'ARMOR': '0.444', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.251', 'weapon3': '1.346', 'weapon2': '1.870', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:49:36,772][2409080] DAMAGECOUNT value on done: 1548.0
[2023-02-25 12:49:36,777][2409080] Sum rewards: 2.188, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.056', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.018', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.082', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.234', 'ARMOR': '0.493', 'WEAPON3': '0.550', 'weapon3': '0.884', 'DAMAGECOUNT': '0.978', 'weapon2': '1.754', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:49:37,186][2408954] Fps is (10 sec: 24576.1, 60 sec: 25668.2, 300 sec: 25589.6). Total num frames: 46366720. Throughput: 0: 6456.0. Samples: 11587560. Policy #0 lag: (min: 0.0, avg: 10.3, max: 24.0)
[2023-02-25 12:49:37,186][2408954] Avg episode reward: [(0, '1.706')]
[2023-02-25 12:49:37,255][2409074] Updated weights for policy 0, policy_version 11321 (0.0012)
[2023-02-25 12:49:38,427][2409074] Updated weights for policy 0, policy_version 11331 (0.0013)
[2023-02-25 12:49:39,294][2409468] DAMAGECOUNT value on done: 1946.0
[2023-02-25 12:49:39,298][2409468] Sum rewards: 3.287, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.090', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'weapon4': '0.114', 'AMMO3': '0.138', 'WEAPON5': '0.150', 'HITCOUNT': '0.450', 'ARMOR': '0.800', 'WEAPON3': '0.900', 'weapon2': '1.238', 'DAMAGECOUNT': '1.704', 'weapon3': '2.214', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:49:40,326][2409074] Updated weights for policy 0, policy_version 11341 (0.0012)
[2023-02-25 12:49:40,685][2409080] DAMAGECOUNT value on done: 1257.0
[2023-02-25 12:49:40,689][2409080] Sum rewards: 0.626, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.010', 'weapon5': '0.020', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.085', 'AMMO4': '0.114', 'weapon4': '0.122', 'WEAPON5': '0.200', 'HITCOUNT': '0.310', 'WEAPON3': '0.450', 'HEALTH': '0.614', 'DAMAGECOUNT': '1.080', 'weapon3': '1.438', 'weapon2': '1.580', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:49:41,914][2409074] Updated weights for policy 0, policy_version 11351 (0.0014)
[2023-02-25 12:49:42,186][2408954] Fps is (10 sec: 25804.8, 60 sec: 25736.5, 300 sec: 25617.4). Total num frames: 46501888. Throughput: 0: 6448.5. Samples: 11626008. Policy #0 lag: (min: 2.0, avg: 11.9, max: 26.0)
[2023-02-25 12:49:42,186][2408954] Avg episode reward: [(0, '1.799')]
[2023-02-25 12:49:43,273][2409468] DAMAGECOUNT value on done: 1887.0
[2023-02-25 12:49:43,275][2409468] Sum rewards: 0.921, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.726', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'weapon5': '0.020', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon4': '0.162', 'HITCOUNT': '0.330', 'WEAPON3': '0.400', 'ARMOR': '0.879', 'weapon3': '0.992', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.158', 'weapon2': '1.796'}
[2023-02-25 12:49:43,290][2409074] Updated weights for policy 0, policy_version 11361 (0.0012)
[2023-02-25 12:49:45,356][2409074] Updated weights for policy 0, policy_version 11371 (0.0012)
[2023-02-25 12:49:46,617][2409074] Updated weights for policy 0, policy_version 11381 (0.0012)
[2023-02-25 12:49:47,140][2409468] DAMAGECOUNT value on done: 1704.0
[2023-02-25 12:49:47,142][2409468] Sum rewards: 1.148, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.603', 'AMMO5': '0.010', 'AMMO2': '0.011', 'weapon4': '0.050', 'AMMO4': '0.053', 'weapon7': '0.078', 'weapon5': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.490', 'ARMOR': '0.496', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.394', 'DAMAGECOUNT': '1.620', 'weapon3': '1.714'}
[2023-02-25 12:49:47,186][2408954] Fps is (10 sec: 27034.0, 60 sec: 26009.6, 300 sec: 25645.1). Total num frames: 46637056. Throughput: 0: 6437.6. Samples: 11664492. Policy #0 lag: (min: 1.0, avg: 14.4, max: 28.0)
[2023-02-25 12:49:47,186][2408954] Avg episode reward: [(0, '1.770')]
[2023-02-25 12:49:48,059][2409074] Updated weights for policy 0, policy_version 11391 (0.0012)
[2023-02-25 12:49:49,794][2409076] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 12:49:49,932][2409074] Updated weights for policy 0, policy_version 11401 (0.0013)
[2023-02-25 12:49:51,291][2409074] Updated weights for policy 0, policy_version 11411 (0.0012)
[2023-02-25 12:49:51,311][2409099] Large shaping reward 2.602 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.582, 194.0)]
[2023-02-25 12:49:51,627][2409468] DAMAGECOUNT value on done: 1648.0
[2023-02-25 12:49:51,628][2409468] Sum rewards: 1.948, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.353', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'weapon7': '0.052', 'WEAPON1': '0.060', 'weapon5': '0.084', 'weapon4': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.108', 'WEAPON5': '0.150', 'HITCOUNT': '0.350', 'WEAPON3': '0.650', 'ARMOR': '0.848', 'weapon3': '1.582', 'DAMAGECOUNT': '1.671', 'weapon2': '1.762', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:49:52,186][2408954] Fps is (10 sec: 25804.2, 60 sec: 25668.2, 300 sec: 25617.4). Total num frames: 46759936. Throughput: 0: 6441.0. Samples: 11684100. Policy #0 lag: (min: 1.0, avg: 14.4, max: 28.0)
[2023-02-25 12:49:52,186][2408954] Avg episode reward: [(0, '1.802')]
[2023-02-25 12:49:53,068][2409074] Updated weights for policy 0, policy_version 11421 (0.0012)
[2023-02-25 12:49:54,389][2409074] Updated weights for policy 0, policy_version 11431 (0.0012)
[2023-02-25 12:49:56,000][2409074] Updated weights for policy 0, policy_version 11441 (0.0013)
[2023-02-25 12:49:57,186][2408954] Fps is (10 sec: 24576.0, 60 sec: 25668.3, 300 sec: 25589.6). Total num frames: 46882816. Throughput: 0: 6430.7. Samples: 11722608. Policy #0 lag: (min: 0.0, avg: 12.4, max: 25.0)
[2023-02-25 12:49:57,186][2408954] Avg episode reward: [(0, '1.802')]
[2023-02-25 12:49:57,771][2409074] Updated weights for policy 0, policy_version 11451 (0.0012)
[2023-02-25 12:49:59,216][2409074] Updated weights for policy 0, policy_version 11461 (0.0012)
[2023-02-25 12:50:01,108][2409074] Updated weights for policy 0, policy_version 11471 (0.0013)
[2023-02-25 12:50:02,187][2408954] Fps is (10 sec: 25391.4, 60 sec: 25804.1, 300 sec: 25603.3). Total num frames: 47013888. Throughput: 0: 6433.4. Samples: 11761344. Policy #0 lag: (min: 0.0, avg: 12.4, max: 25.0)
[2023-02-25 12:50:02,188][2408954] Avg episode reward: [(0, '1.802')]
[2023-02-25 12:50:02,388][2409074] Updated weights for policy 0, policy_version 11481 (0.0015)
[2023-02-25 12:50:04,312][2409074] Updated weights for policy 0, policy_version 11491 (0.0012)
[2023-02-25 12:50:05,727][2409074] Updated weights for policy 0, policy_version 11501 (0.0013)
[2023-02-25 12:50:07,186][2408954] Fps is (10 sec: 26623.7, 60 sec: 25804.8, 300 sec: 25617.3). Total num frames: 47149056. Throughput: 0: 6433.1. Samples: 11780148. Policy #0 lag: (min: 0.0, avg: 12.0, max: 25.0)
[2023-02-25 12:50:07,186][2408954] Avg episode reward: [(0, '1.802')]
[2023-02-25 12:50:07,193][2409074] Updated weights for policy 0, policy_version 11511 (0.0012)
[2023-02-25 12:50:09,101][2409074] Updated weights for policy 0, policy_version 11521 (0.0012)
[2023-02-25 12:50:10,363][2409074] Updated weights for policy 0, policy_version 11531 (0.0012)
[2023-02-25 12:50:12,186][2408954] Fps is (10 sec: 25399.6, 60 sec: 25531.7, 300 sec: 25589.6). Total num frames: 47267840. Throughput: 0: 6430.2. Samples: 11818656. Policy #0 lag: (min: 0.0, avg: 12.0, max: 25.0)
[2023-02-25 12:50:12,186][2408954] Avg episode reward: [(0, '1.802')]
[2023-02-25 12:50:12,197][2409074] Updated weights for policy 0, policy_version 11541 (0.0012)
[2023-02-25 12:50:13,573][2409074] Updated weights for policy 0, policy_version 11551 (0.0014)
[2023-02-25 12:50:14,801][2409075] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 12:50:15,167][2409074] Updated weights for policy 0, policy_version 11561 (0.0012)
[2023-02-25 12:50:16,950][2409074] Updated weights for policy 0, policy_version 11571 (0.0012)
[2023-02-25 12:50:17,186][2408954] Fps is (10 sec: 24985.8, 60 sec: 25736.7, 300 sec: 25575.7). Total num frames: 47398912. Throughput: 0: 6433.1. Samples: 11857380. Policy #0 lag: (min: 2.0, avg: 14.0, max: 31.0)
[2023-02-25 12:50:17,186][2408954] Avg episode reward: [(0, '1.802')]
[2023-02-25 12:50:17,199][2409033] Saving /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000011573_47403008.pth...
[2023-02-25 12:50:17,302][2409033] Removing /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000010076_41271296.pth
[2023-02-25 12:50:18,449][2409074] Updated weights for policy 0, policy_version 11581 (0.0012)
[2023-02-25 12:50:20,071][2409074] Updated weights for policy 0, policy_version 11591 (0.0012)
[2023-02-25 12:50:21,399][2409074] Updated weights for policy 0, policy_version 11601 (0.0013)
[2023-02-25 12:50:21,877][2409468] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)]
[2023-02-25 12:50:22,186][2408954] Fps is (10 sec: 26214.4, 60 sec: 25873.1, 300 sec: 25575.7). Total num frames: 47529984. Throughput: 0: 6427.0. Samples: 11876772. Policy #0 lag: (min: 1.0, avg: 11.5, max: 25.0)
[2023-02-25 12:50:22,186][2408954] Avg episode reward: [(0, '1.802')]
[2023-02-25 12:50:23,274][2409074] Updated weights for policy 0, policy_version 11611 (0.0012)
[2023-02-25 12:50:24,800][2409074] Updated weights for policy 0, policy_version 11621 (0.0012)
[2023-02-25 12:50:26,439][2409074] Updated weights for policy 0, policy_version 11631 (0.0013)
[2023-02-25 12:50:27,186][2408954] Fps is (10 sec: 25805.0, 60 sec: 25600.1, 300 sec: 25617.4). Total num frames: 47656960. Throughput: 0: 6429.6. Samples: 11915340. Policy #0 lag: (min: 1.0, avg: 11.5, max: 25.0)
[2023-02-25 12:50:27,186][2408954] Avg episode reward: [(0, '1.802')]
[2023-02-25 12:50:27,861][2409074] Updated weights for policy 0, policy_version 11641 (0.0012)
[2023-02-25 12:50:29,582][2409074] Updated weights for policy 0, policy_version 11651 (0.0013)
[2023-02-25 12:50:31,314][2409074] Updated weights for policy 0, policy_version 11661 (0.0012)
[2023-02-25 12:50:32,057][2409033] Signal inference workers to stop experience collection... (1450 times)
[2023-02-25 12:50:32,058][2409033] Signal inference workers to resume experience collection... (1450 times)
[2023-02-25 12:50:32,086][2409074] InferenceWorker_p0-w0: stopping experience collection (1450 times)
[2023-02-25 12:50:32,086][2409074] InferenceWorker_p0-w0: resuming experience collection (1450 times)
[2023-02-25 12:50:32,186][2408954] Fps is (10 sec: 26214.1, 60 sec: 25804.8, 300 sec: 25631.3). Total num frames: 47792128. Throughput: 0: 6430.1. Samples: 11953848. Policy #0 lag: (min: 0.0, avg: 13.3, max: 29.0)
[2023-02-25 12:50:32,186][2408954] Avg episode reward: [(0, '1.802')]
[2023-02-25 12:50:32,789][2409074] Updated weights for policy 0, policy_version 11671 (0.0016)
[2023-02-25 12:50:34,368][2409074] Updated weights for policy 0, policy_version 11681 (0.0012)
[2023-02-25 12:50:36,037][2409074] Updated weights for policy 0, policy_version 11691 (0.0012)
[2023-02-25 12:50:37,186][2408954] Fps is (10 sec: 25804.8, 60 sec: 25804.9, 300 sec: 25561.8). Total num frames: 47915008. Throughput: 0: 6422.4. Samples: 11973108. Policy #0 lag: (min: 0.0, avg: 13.3, max: 29.0)
[2023-02-25 12:50:37,186][2408954] Avg episode reward: [(0, '1.802')]
[2023-02-25 12:50:37,510][2409074] Updated weights for policy 0, policy_version 11701 (0.0013)
[2023-02-25 12:50:39,369][2409074] Updated weights for policy 0, policy_version 11711 (0.0013)
[2023-02-25 12:50:40,602][2409074] Updated weights for policy 0, policy_version 11721 (0.0013)
[2023-02-25 12:50:41,842][2409102] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 12:50:42,186][2408954] Fps is (10 sec: 25395.4, 60 sec: 25736.5, 300 sec: 25589.6). Total num frames: 48046080. Throughput: 0: 6421.1. Samples: 12011556. Policy #0 lag: (min: 0.0, avg: 11.4, max: 25.0)
[2023-02-25 12:50:42,186][2408954] Avg episode reward: [(0, '1.802')]
[2023-02-25 12:50:42,255][2409074] Updated weights for policy 0, policy_version 11731 (0.0014)
[2023-02-25 12:50:43,995][2409074] Updated weights for policy 0, policy_version 11741 (0.0012)
[2023-02-25 12:50:45,530][2409074] Updated weights for policy 0, policy_version 11751 (0.0013)
[2023-02-25 12:50:47,186][2408954] Fps is (10 sec: 24575.8, 60 sec: 25395.2, 300 sec: 25534.0). Total num frames: 48160768. Throughput: 0: 6414.4. Samples: 12049980. Policy #0 lag: (min: 0.0, avg: 11.4, max: 25.0)
[2023-02-25 12:50:47,186][2408954] Avg episode reward: [(0, '1.802')]
[2023-02-25 12:50:47,329][2409074] Updated weights for policy 0, policy_version 11761 (0.0012)
[2023-02-25 12:50:48,467][2409074] Updated weights for policy 0, policy_version 11771 (0.0012)
[2023-02-25 12:50:50,712][2409074] Updated weights for policy 0, policy_version 11781 (0.0013)
[2023-02-25 12:50:51,803][2409074] Updated weights for policy 0, policy_version 11791 (0.0012)
[2023-02-25 12:50:52,186][2408954] Fps is (10 sec: 25804.7, 60 sec: 25736.6, 300 sec: 25603.5). Total num frames: 48304128. Throughput: 0: 6418.9. Samples: 12069000. Policy #0 lag: (min: 0.0, avg: 11.9, max: 25.0)
[2023-02-25 12:50:52,186][2408954] Avg episode reward: [(0, '1.802')]
[2023-02-25 12:50:53,529][2409074] Updated weights for policy 0, policy_version 11801 (0.0012)
[2023-02-25 12:50:55,145][2409074] Updated weights for policy 0, policy_version 11811 (0.0012)
[2023-02-25 12:50:55,927][2409100] DAMAGECOUNT value on done: 2357.0
[2023-02-25 12:50:55,928][2409100] Sum rewards: 3.264, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.437', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.030', 'AMMO4': '0.041', 'AMMO3': '0.044', 'weapon5': '0.050', 'ARMOR': '0.056', 'WEAPON5': '0.150', 'HITCOUNT': '0.220', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'weapon4': '0.556', 'weapon3': '0.958', 'DAMAGECOUNT': '0.993', 'weapon2': '1.990', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:50:56,501][2409074] Updated weights for policy 0, policy_version 11821 (0.0012)
[2023-02-25 12:50:57,186][2408954] Fps is (10 sec: 27033.7, 60 sec: 25804.8, 300 sec: 25575.7). Total num frames: 48431104. Throughput: 0: 6424.8. Samples: 12107772. Policy #0 lag: (min: 0.0, avg: 11.9, max: 25.0)
[2023-02-25 12:50:57,186][2408954] Avg episode reward: [(0, '1.849')]
[2023-02-25 12:50:58,081][2409103] DAMAGECOUNT value on done: 1418.0
[2023-02-25 12:50:58,085][2409103] Sum rewards: 0.226, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.220', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'ARMOR': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO3': '0.070', 'AMMO4': '0.124', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.480', 'weapon4': '0.674', 'FRAGCOUNT': '1.000', 'weapon2': '1.096', 'weapon3': '1.294'}
[2023-02-25 12:50:58,401][2409074] Updated weights for policy 0, policy_version 11831 (0.0012)
[2023-02-25 12:50:58,760][2409549] DAMAGECOUNT value on done: 1811.0
[2023-02-25 12:50:58,760][2409549] Sum rewards: 5.347, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.110', 'AMMO5': '0.007', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'weapon5': '0.092', 'AMMO4': '0.100', 'AMMO3': '0.107', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.264', 'HITCOUNT': '0.410', 'WEAPON3': '0.600', 'ARMOR': '0.854', 'weapon2': '1.412', 'weapon3': '1.594', 'DAMAGECOUNT': '1.866', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:50:59,523][2409100] DAMAGECOUNT value on done: 2380.0
[2023-02-25 12:50:59,524][2409100] Sum rewards: -0.672, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.416', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.040', 'WEAPON1': '0.060', 'AMMO3': '0.081', 'weapon5': '0.090', 'AMMO4': '0.201', 'weapon4': '0.256', 'WEAPON5': '0.300', 'HITCOUNT': '0.320', 'WEAPON4': '0.400', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.089', 'weapon2': '1.456', 'weapon3': '1.734', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:50:59,880][2409074] Updated weights for policy 0, policy_version 11841 (0.0012)
[2023-02-25 12:51:01,686][2409103] DAMAGECOUNT value on done: 2384.0
[2023-02-25 12:51:01,688][2409103] Sum rewards: 5.609, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.293', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.006', 'WEAPON1': '0.020', 'weapon7': '0.072', 'AMMO3': '0.073', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.252', 'ARMOR': '0.454', 'HITCOUNT': '0.460', 'WEAPON3': '0.600', 'weapon3': '1.132', 'weapon2': '1.476', 'DAMAGECOUNT': '2.121', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:51:01,893][2409074] Updated weights for policy 0, policy_version 11851 (0.0012)
[2023-02-25 12:51:02,186][2408954] Fps is (10 sec: 24576.1, 60 sec: 25600.7, 300 sec: 25561.8). Total num frames: 48549888. Throughput: 0: 6420.8. Samples: 12146316. Policy #0 lag: (min: 0.0, avg: 12.2, max: 25.0)
[2023-02-25 12:51:02,186][2408954] Avg episode reward: [(0, '1.849')]
[2023-02-25 12:51:02,617][2409549] DAMAGECOUNT value on done: 2640.0
[2023-02-25 12:51:02,618][2409549] Sum rewards: 6.227, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.420', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.057', 'AMMO3': '0.060', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.288', 'WEAPON3': '0.450', 'HITCOUNT': '0.740', 'weapon3': '1.218', 'weapon2': '1.360', 'DAMAGECOUNT': '2.655', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:02,884][2409074] Updated weights for policy 0, policy_version 11861 (0.0012)
[2023-02-25 12:51:03,077][2409100] DAMAGECOUNT value on done: 1868.0
[2023-02-25 12:51:03,081][2409100] Sum rewards: 4.158, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.132', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.122', 'AMMO4': '0.151', 'WEAPON4': '0.250', 'ARMOR': '0.495', 'HITCOUNT': '0.580', 'weapon4': '0.628', 'WEAPON3': '0.750', 'weapon2': '1.312', 'weapon3': '1.552', 'DAMAGECOUNT': '2.007', 'FRAGCOUNT': '5.500'}
[2023-02-25 12:51:04,403][2409074] Updated weights for policy 0, policy_version 11871 (0.0012)
[2023-02-25 12:51:04,624][2409079] Large shaping reward 3.353 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.23700000000000002, -79.0), ('ARMOR', -0.039, -39.0), ('AMMO5', -0.0005, -1.0)]
[2023-02-25 12:51:05,580][2409103] DAMAGECOUNT value on done: 2225.0
[2023-02-25 12:51:05,583][2409103] Sum rewards: 3.095, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.557', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.037', 'WEAPON1': '0.040', 'weapon5': '0.050', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'HITCOUNT': '0.360', 'weapon4': '0.488', 'ARMOR': '0.528', 'weapon3': '0.842', 'DAMAGECOUNT': '1.755', 'weapon2': '1.782', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:05,867][2409101] DAMAGECOUNT value on done: 1503.0
[2023-02-25 12:51:05,870][2409101] Sum rewards: -2.667, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.313', 'ARMOR': '0.008', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.022', 'AMMO3': '0.057', 'weapon7': '0.104', 'AMMO4': '0.109', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.200', 'WEAPON3': '0.400', 'WEAPON4': '0.450', 'DAMAGECOUNT': '0.570', 'weapon4': '0.758', 'weapon2': '0.836', 'weapon3': '0.972', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:51:06,491][2409074] Updated weights for policy 0, policy_version 11881 (0.0012)
[2023-02-25 12:51:06,492][2409549] DAMAGECOUNT value on done: 2260.0
[2023-02-25 12:51:06,495][2409549] Sum rewards: 2.651, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.340', 'AMMO4': '-0.063', 'AMMO2': '-0.012', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'weapon5': '0.058', 'weapon7': '0.064', 'AMMO3': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.600', 'ARMOR': '0.908', 'DAMAGECOUNT': '1.404', 'weapon2': '1.470', 'weapon3': '1.546', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:06,908][2409100] DAMAGECOUNT value on done: 1937.0
[2023-02-25 12:51:06,911][2409100] Sum rewards: 3.666, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.018', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'ARMOR': '0.056', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'AMMO4': '0.122', 'weapon5': '0.190', 'HITCOUNT': '0.250', 'WEAPON5': '0.300', 'HEALTH': '0.386', 'WEAPON3': '0.450', 'weapon4': '0.508', 'weapon2': '1.134', 'DAMAGECOUNT': '1.299', 'weapon3': '1.706', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:07,191][2408954] Fps is (10 sec: 25792.3, 60 sec: 25666.2, 300 sec: 25603.1). Total num frames: 48689152. Throughput: 0: 6418.5. Samples: 12165636. Policy #0 lag: (min: 1.0, avg: 14.3, max: 30.0)
[2023-02-25 12:51:07,191][2408954] Avg episode reward: [(0, '1.849')]
[2023-02-25 12:51:07,709][2409074] Updated weights for policy 0, policy_version 11891 (0.0012)
[2023-02-25 12:51:08,762][2409102] DAMAGECOUNT value on done: 2532.0
[2023-02-25 12:51:08,765][2409102] Sum rewards: 2.443, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.662', 'AMMO5': '0.017', 'weapon4': '0.022', 'AMMO2': '0.024', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.087', 'AMMO4': '0.118', 'weapon5': '0.126', 'WEAPON5': '0.450', 'ARMOR': '0.456', 'WEAPON3': '0.550', 'HITCOUNT': '0.560', 'weapon3': '1.398', 'DAMAGECOUNT': '1.905', 'weapon2': '2.292', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:09,587][2409103] DAMAGECOUNT value on done: 1823.0
[2023-02-25 12:51:09,590][2409103] Sum rewards: -1.799, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.338', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.023', 'AMMO3': '0.077', 'WEAPON4': '0.200', 'weapon4': '0.200', 'ARMOR': '0.448', 'HITCOUNT': '0.450', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.214', 'DAMAGECOUNT': '1.422', 'weapon2': '1.448'}
[2023-02-25 12:51:09,666][2409101] DAMAGECOUNT value on done: 1930.0
[2023-02-25 12:51:09,669][2409101] Sum rewards: 3.979, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.550', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'weapon7': '0.056', 'weapon5': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.230', 'HITCOUNT': '0.340', 'WEAPON5': '0.400', 'ARMOR': '0.479', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.206', 'weapon3': '1.312', 'weapon2': '1.372', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:09,711][2409074] Updated weights for policy 0, policy_version 11901 (0.0013)
[2023-02-25 12:51:10,285][2409549] DAMAGECOUNT value on done: 1809.0
[2023-02-25 12:51:10,288][2409549] Sum rewards: 1.240, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.438', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.033', 'weapon5': '0.040', 'weapon7': '0.048', 'AMMO3': '0.089', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.164', 'HITCOUNT': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '0.500', 'ARMOR': '0.575', 'weapon4': '0.686', 'weapon2': '0.932', 'DAMAGECOUNT': '1.320', 'weapon3': '1.456', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:10,518][2409100] DAMAGECOUNT value on done: 2599.0
[2023-02-25 12:51:10,519][2409100] Sum rewards: 0.313, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.680', 'AMMO5': '0.003', 'AMMO2': '0.008', 'WEAPON1': '0.040', 'AMMO4': '0.041', 'weapon4': '0.048', 'WEAPON4': '0.050', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'HITCOUNT': '0.270', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.930', 'ARMOR': '0.957', 'FRAGCOUNT': '1.000', 'weapon3': '1.216', 'weapon2': '2.370'}
[2023-02-25 12:51:10,838][2409485] DAMAGECOUNT value on done: 2084.0
[2023-02-25 12:51:10,841][2409485] Sum rewards: 3.160, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.554', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON1': '0.040', 'weapon4': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'ARMOR': '0.400', 'HITCOUNT': '0.440', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.620', 'weapon3': '1.760', 'weapon2': '1.930', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:10,940][2409074] Updated weights for policy 0, policy_version 11911 (0.0012)
[2023-02-25 12:51:12,186][2408954] Fps is (10 sec: 27033.1, 60 sec: 25873.0, 300 sec: 25589.6). Total num frames: 48820224. Throughput: 0: 6416.0. Samples: 12204060. Policy #0 lag: (min: 1.0, avg: 14.3, max: 30.0)
[2023-02-25 12:51:12,186][2408954] Avg episode reward: [(0, '1.771')]
[2023-02-25 12:51:12,352][2409102] DAMAGECOUNT value on done: 1662.0
[2023-02-25 12:51:12,353][2409102] Sum rewards: 2.694, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.700', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO3': '0.083', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.240', 'weapon7': '0.260', 'HITCOUNT': '0.390', 'WEAPON7': '0.400', 'WEAPON3': '0.550', 'ARMOR': '0.972', 'DAMAGECOUNT': '1.383', 'weapon2': '1.444', 'weapon3': '1.446', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:13,014][2409074] Updated weights for policy 0, policy_version 11921 (0.0012)
[2023-02-25 12:51:13,288][2409101] DAMAGECOUNT value on done: 2182.0
[2023-02-25 12:51:13,289][2409101] Sum rewards: 1.027, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.003', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'AMMO5': '0.010', 'weapon5': '0.012', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO3': '0.112', 'WEAPON5': '0.200', 'weapon4': '0.218', 'HITCOUNT': '0.460', 'WEAPON3': '0.800', 'ARMOR': '0.924', 'weapon3': '1.436', 'DAMAGECOUNT': '1.749', 'weapon2': '1.792', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:13,484][2409103] DAMAGECOUNT value on done: 1764.0
[2023-02-25 12:51:13,485][2409103] Sum rewards: 0.441, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.258', 'AMMO2': '0.003', 'AMMO5': '0.010', 'weapon5': '0.012', 'AMMO4': '0.014', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.068', 'weapon4': '0.086', 'WEAPON5': '0.200', 'HITCOUNT': '0.260', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.780', 'ARMOR': '0.908', 'weapon2': '0.968', 'FRAGCOUNT': '1.000', 'weapon3': '1.250'}
[2023-02-25 12:51:13,982][2409549] DAMAGECOUNT value on done: 2186.0
[2023-02-25 12:51:13,983][2409549] Sum rewards: 9.675, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.868', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.064', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'weapon5': '0.122', 'weapon4': '0.158', 'WEAPON5': '0.300', 'HITCOUNT': '0.680', 'WEAPON3': '0.750', 'ARMOR': '0.866', 'weapon2': '1.584', 'weapon3': '1.812', 'DAMAGECOUNT': '2.976', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:51:14,195][2409597] DAMAGECOUNT value on done: 2205.0
[2023-02-25 12:51:14,196][2409597] Sum rewards: 2.304, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.612', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.115', 'weapon4': '0.212', 'ARMOR': '0.488', 'HITCOUNT': '0.530', 'WEAPON3': '0.750', 'weapon2': '1.450', 'DAMAGECOUNT': '1.620', 'weapon3': '1.902', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:14,256][2409100] DAMAGECOUNT value on done: 2383.0
[2023-02-25 12:51:14,256][2409100] Sum rewards: 3.627, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.155', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.014', 'AMMO2': '0.015', 'weapon7': '0.046', 'ARMOR': '0.052', 'AMMO4': '0.075', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.406', 'HITCOUNT': '0.510', 'WEAPON3': '0.550', 'weapon2': '0.924', 'weapon3': '1.738', 'DAMAGECOUNT': '1.950', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:14,315][2409074] Updated weights for policy 0, policy_version 11931 (0.0012)
[2023-02-25 12:51:14,629][2409485] DAMAGECOUNT value on done: 2217.0
[2023-02-25 12:51:14,630][2409485] Sum rewards: -0.823, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.161', 'AMMO5': '0.020', 'AMMO2': '0.031', 'weapon7': '0.052', 'weapon5': '0.078', 'AMMO3': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.153', 'WEAPON4': '0.250', 'HITCOUNT': '0.310', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon4': '0.696', 'DAMAGECOUNT': '0.921', 'FRAGCOUNT': '1.000', 'weapon3': '1.156', 'weapon2': '1.212', 'ARMOR': '1.315'}
[2023-02-25 12:51:14,986][2409548] DAMAGECOUNT value on done: 1511.0
[2023-02-25 12:51:14,987][2409548] Sum rewards: 0.193, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.504', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'weapon4': '0.050', 'AMMO4': '0.053', 'weapon5': '0.072', 'AMMO3': '0.083', 'WEAPON4': '0.150', 'HITCOUNT': '0.260', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.714', 'FRAGCOUNT': '1.000', 'weapon3': '1.354', 'ARMOR': '1.814', 'weapon2': '2.074'}
[2023-02-25 12:51:15,748][2409074] Updated weights for policy 0, policy_version 11941 (0.0012)
[2023-02-25 12:51:16,582][2409099] Large shaping reward 2.580 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.558, 186.0), ('weapon5', 0.002)]
[2023-02-25 12:51:16,968][2409102] DAMAGECOUNT value on done: 1870.0
[2023-02-25 12:51:16,969][2409102] Sum rewards: 2.007, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.234', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.044', 'AMMO3': '0.070', 'WEAPON5': '0.200', 'weapon5': '0.210', 'AMMO4': '0.219', 'WEAPON4': '0.250', 'HITCOUNT': '0.290', 'WEAPON3': '0.500', 'weapon4': '0.734', 'ARMOR': '0.808', 'DAMAGECOUNT': '0.816', 'weapon2': '0.834', 'FRAGCOUNT': '1.000', 'weapon3': '1.486'}
[2023-02-25 12:51:17,163][2409101] DAMAGECOUNT value on done: 1798.0
[2023-02-25 12:51:17,164][2409101] Sum rewards: 1.300, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.064', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.028', 'AMMO3': '0.067', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'WEAPON4': '0.200', 'HITCOUNT': '0.200', 'WEAPON3': '0.350', 'weapon4': '0.386', 'DAMAGECOUNT': '0.510', 'FRAGCOUNT': '1.000', 'weapon3': '1.202', 'weapon2': '1.566'}
[2023-02-25 12:51:17,186][2408954] Fps is (10 sec: 24177.9, 60 sec: 25531.7, 300 sec: 25548.0). Total num frames: 48930816. Throughput: 0: 6404.0. Samples: 12242028. Policy #0 lag: (min: 0.0, avg: 14.3, max: 26.0)
[2023-02-25 12:51:17,186][2408954] Avg episode reward: [(0, '1.851')]
[2023-02-25 12:51:17,240][2409103] DAMAGECOUNT value on done: 2174.0
[2023-02-25 12:51:17,243][2409103] Sum rewards: 1.417, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.138', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.021', 'weapon5': '0.080', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'weapon4': '0.170', 'HITCOUNT': '0.330', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.329', 'weapon2': '1.440', 'weapon3': '1.606', 'ARMOR': '1.768', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:51:17,802][2409100] DAMAGECOUNT value on done: 1960.0
[2023-02-25 12:51:17,806][2409100] Sum rewards: 0.464, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.494', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon5': '0.048', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'WEAPON5': '0.200', 'weapon4': '0.340', 'HITCOUNT': '0.380', 'WEAPON3': '0.550', 'ARMOR': '0.812', 'weapon3': '0.980', 'DAMAGECOUNT': '1.140', 'weapon2': '1.682', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:17,814][2409597] DAMAGECOUNT value on done: 2118.0
[2023-02-25 12:51:17,817][2409597] Sum rewards: 1.776, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.068', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.087', 'AMMO4': '0.131', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.390', 'WEAPON3': '0.500', 'weapon4': '0.526', 'weapon2': '0.914', 'ARMOR': '0.941', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.197', 'weapon3': '1.612'}
[2023-02-25 12:51:17,830][2409549] DAMAGECOUNT value on done: 1965.0
[2023-02-25 12:51:17,834][2409549] Sum rewards: 2.709, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.300', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.068', 'weapon7': '0.070', 'weapon5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'WEAPON7': '0.200', 'weapon4': '0.276', 'WEAPON5': '0.300', 'ARMOR': '0.473', 'WEAPON3': '0.500', 'weapon3': '1.150', 'weapon2': '1.752', 'DAMAGECOUNT': '2.016', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:17,886][2409074] Updated weights for policy 0, policy_version 11951 (0.0012)
[2023-02-25 12:51:18,268][2409485] DAMAGECOUNT value on done: 1477.0
[2023-02-25 12:51:18,269][2409485] Sum rewards: -3.351, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.970', 'AMMO5': '0.025', 'WEAPON1': '0.040', 'weapon5': '0.050', 'AMMO2': '0.051', 'AMMO3': '0.124', 'AMMO4': '0.253', 'HITCOUNT': '0.320', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'ARMOR': '0.420', 'weapon4': '0.674', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.984', 'weapon2': '1.124', 'FRAGCOUNT': '1.500', 'weapon3': '1.754'}
[2023-02-25 12:51:18,748][2409548] DAMAGECOUNT value on done: 1821.0
[2023-02-25 12:51:18,749][2409548] Sum rewards: 2.928, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.286', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO3': '0.069', 'AMMO4': '0.106', 'HITCOUNT': '0.120', 'WEAPON4': '0.300', 'weapon4': '0.368', 'WEAPON3': '0.400', 'ARMOR': '0.457', 'DAMAGECOUNT': '0.708', 'weapon3': '0.764', 'weapon2': '0.770', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:18,909][2409074] Updated weights for policy 0, policy_version 11961 (0.0014)
[2023-02-25 12:51:19,024][2409406] DAMAGECOUNT value on done: 1552.0
[2023-02-25 12:51:19,027][2409406] Sum rewards: 1.881, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.801', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'ARMOR': '0.044', 'AMMO3': '0.101', 'AMMO4': '0.107', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.326', 'HITCOUNT': '0.350', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.074', 'weapon3': '1.190', 'weapon2': '2.054', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:19,751][2409077] DAMAGECOUNT value on done: 2722.0
[2023-02-25 12:51:19,752][2409077] Sum rewards: 0.677, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.110', 'AMMO5': '0.014', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO4': '0.077', 'AMMO3': '0.101', 'weapon5': '0.174', 'weapon4': '0.194', 'WEAPON5': '0.300', 'HITCOUNT': '0.330', 'WEAPON3': '0.600', 'weapon2': '1.486', 'weapon3': '1.518', 'DAMAGECOUNT': '1.617', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:20,752][2409102] DAMAGECOUNT value on done: 2566.0
[2023-02-25 12:51:20,753][2409102] Sum rewards: 3.791, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.665', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO3': '0.065', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'weapon5': '0.142', 'WEAPON4': '0.300', 'HITCOUNT': '0.390', 'ARMOR': '0.432', 'WEAPON3': '0.450', 'weapon4': '0.518', 'weapon3': '1.200', 'DAMAGECOUNT': '1.206', 'weapon2': '1.510', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:20,840][2409105] DAMAGECOUNT value on done: 2491.0
[2023-02-25 12:51:20,840][2409105] Sum rewards: 4.995, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.644', 'AMMO2': '0.001', 'AMMO4': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'weapon7': '0.060', 'weapon4': '0.064', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'ARMOR': '0.510', 'WEAPON3': '0.550', 'HITCOUNT': '0.620', 'weapon2': '1.538', 'weapon3': '1.668', 'DAMAGECOUNT': '2.211', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:20,932][2409074] Updated weights for policy 0, policy_version 11971 (0.0012)
[2023-02-25 12:51:20,961][2409101] DAMAGECOUNT value on done: 2189.0
[2023-02-25 12:51:20,964][2409101] Sum rewards: 0.965, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO2': '0.035', 'WEAPON1': '0.060', 'weapon7': '0.064', 'AMMO3': '0.097', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.420', 'HEALTH': '0.426', 'weapon4': '0.534', 'WEAPON3': '0.550', 'ARMOR': '0.902', 'weapon2': '1.114', 'DAMAGECOUNT': '1.380', 'weapon3': '1.794', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:20,986][2409103] DAMAGECOUNT value on done: 1412.0
[2023-02-25 12:51:20,989][2409103] Sum rewards: 1.594, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.985', 'AMMO2': '0.003', 'AMMO5': '0.009', 'AMMO4': '0.012', 'WEAPON1': '0.040', 'AMMO3': '0.048', 'weapon7': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.328', 'WEAPON3': '0.350', 'ARMOR': '0.469', 'weapon3': '0.656', 'DAMAGECOUNT': '0.816', 'weapon2': '1.754', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:21,329][2409596] DAMAGECOUNT value on done: 2753.0
[2023-02-25 12:51:21,330][2409596] Sum rewards: 6.893, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.050', 'AMMO4': '-0.023', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'weapon4': '0.062', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'HITCOUNT': '0.450', 'WEAPON3': '0.500', 'weapon3': '1.688', 'DAMAGECOUNT': '1.755', 'weapon2': '1.772', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:51:21,516][2409565] DAMAGECOUNT value on done: 1544.0
[2023-02-25 12:51:21,517][2409565] Sum rewards: 1.291, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.778', 'AMMO2': '0.008', 'AMMO5': '0.008', 'AMMO4': '0.038', 'WEAPON1': '0.040', 'weapon5': '0.056', 'AMMO3': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.250', 'weapon4': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.825', 'FRAGCOUNT': '1.000', 'weapon2': '1.090', 'weapon3': '1.574'}
[2023-02-25 12:51:21,749][2409100] DAMAGECOUNT value on done: 2352.0
[2023-02-25 12:51:21,750][2409100] Sum rewards: 2.097, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.066', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.030', 'weapon5': '0.044', 'AMMO3': '0.068', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.250', 'ARMOR': '0.444', 'WEAPON3': '0.450', 'weapon4': '0.462', 'DAMAGECOUNT': '0.735', 'weapon3': '1.246', 'weapon2': '1.310', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:21,896][2409549] DAMAGECOUNT value on done: 2124.0
[2023-02-25 12:51:21,900][2409549] Sum rewards: 6.049, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.301', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.040', 'AMMO4': '0.062', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'weapon5': '0.178', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.236', 'HITCOUNT': '0.280', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'ARMOR': '0.850', 'DAMAGECOUNT': '0.978', 'weapon3': '1.256', 'weapon2': '1.906', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:51:22,113][2409597] DAMAGECOUNT value on done: 1911.0
[2023-02-25 12:51:22,114][2409597] Sum rewards: 4.200, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.770', 'AMMO5': '0.007', 'weapon7': '0.012', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'ARMOR': '0.048', 'AMMO3': '0.081', 'weapon5': '0.090', 'AMMO4': '0.095', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.372', 'HITCOUNT': '0.410', 'WEAPON3': '0.550', 'weapon2': '1.212', 'weapon3': '1.530', 'DAMAGECOUNT': '1.554', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:22,186][2408954] Fps is (10 sec: 24986.0, 60 sec: 25668.2, 300 sec: 25575.7). Total num frames: 49070080. Throughput: 0: 6402.7. Samples: 12261228. Policy #0 lag: (min: 0.0, avg: 14.3, max: 26.0)
[2023-02-25 12:51:22,187][2408954] Avg episode reward: [(0, '1.968')]
[2023-02-25 12:51:22,227][2409074] Updated weights for policy 0, policy_version 11981 (0.0012)
[2023-02-25 12:51:22,253][2409485] DAMAGECOUNT value on done: 2869.0
[2023-02-25 12:51:22,256][2409485] Sum rewards: 8.591, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.300', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'weapon5': '0.178', 'WEAPON5': '0.200', 'weapon4': '0.228', 'WEAPON3': '0.350', 'ARMOR': '0.420', 'HITCOUNT': '0.470', 'weapon3': '1.070', 'weapon2': '1.486', 'DAMAGECOUNT': '2.307', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:51:22,503][2409548] DAMAGECOUNT value on done: 2388.0
[2023-02-25 12:51:22,507][2409548] Sum rewards: -0.277, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.219', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'weapon7': '0.064', 'weapon5': '0.064', 'AMMO3': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.224', 'HITCOUNT': '0.330', 'ARMOR': '0.457', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.095', 'weapon3': '1.334', 'weapon2': '1.518'}
[2023-02-25 12:51:22,656][2409373] DAMAGECOUNT value on done: 1569.0
[2023-02-25 12:51:22,661][2409373] Sum rewards: 3.678, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.072', 'AMMO2': '0.007', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.037', 'weapon5': '0.050', 'AMMO3': '0.116', 'weapon7': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO6': '0.280', 'AMMO7': '0.280', 'weapon4': '0.358', 'WEAPON7': '0.400', 'HITCOUNT': '0.450', 'ARMOR': '0.458', 'WEAPON3': '0.800', 'weapon2': '1.490', 'weapon3': '1.580', 'DAMAGECOUNT': '2.061', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:51:22,757][2409406] DAMAGECOUNT value on done: 2328.0
[2023-02-25 12:51:22,760][2409406] Sum rewards: 6.597, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.366', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.010', 'WEAPON1': '0.030', 'weapon5': '0.056', 'AMMO3': '0.058', 'WEAPON4': '0.100', 'weapon7': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.242', 'WEAPON3': '0.400', 'ARMOR': '0.457', 'HITCOUNT': '0.610', 'weapon3': '1.034', 'weapon2': '1.648', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:23,607][2409077] DAMAGECOUNT value on done: 2270.0
[2023-02-25 12:51:23,608][2409077] Sum rewards: 1.345, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.919', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.030', 'AMMO4': '0.046', 'weapon4': '0.064', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'weapon5': '0.138', 'HITCOUNT': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'ARMOR': '0.800', 'weapon3': '1.152', 'DAMAGECOUNT': '1.197', 'weapon2': '1.632', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:23,958][2409074] Updated weights for policy 0, policy_version 11991 (0.0017)
[2023-02-25 12:51:24,343][2409102] DAMAGECOUNT value on done: 1710.0
[2023-02-25 12:51:24,344][2409102] Sum rewards: 8.160, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO3': '0.063', 'AMMO4': '0.066', 'weapon5': '0.080', 'HEALTH': '0.185', 'WEAPON3': '0.400', 'HITCOUNT': '0.450', 'ARMOR': '0.874', 'weapon3': '1.380', 'DAMAGECOUNT': '1.830', 'weapon2': '2.256', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:51:24,570][2409105] DAMAGECOUNT value on done: 1807.0
[2023-02-25 12:51:24,571][2409105] Sum rewards: 3.431, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.733', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO5': '0.010', 'weapon5': '0.014', 'WEAPON4': '0.050', 'AMMO3': '0.077', 'weapon4': '0.178', 'WEAPON5': '0.200', 'HITCOUNT': '0.360', 'WEAPON3': '0.550', 'ARMOR': '0.929', 'DAMAGECOUNT': '1.137', 'weapon3': '1.282', 'weapon2': '1.938', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:24,929][2409103] DAMAGECOUNT value on done: 1776.0
[2023-02-25 12:51:24,933][2409103] Sum rewards: -1.730, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.720', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.068', 'weapon7': '0.070', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.350', 'WEAPON4': '0.450', 'ARMOR': '0.469', 'WEAPON3': '0.650', 'weapon4': '0.656', 'DAMAGECOUNT': '1.041', 'weapon2': '1.170', 'weapon3': '1.640', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:24,943][2409101] DAMAGECOUNT value on done: 2932.0
[2023-02-25 12:51:24,946][2409101] Sum rewards: 4.799, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.940', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.071', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.390', 'weapon4': '0.400', 'WEAPON3': '0.600', 'ARMOR': '0.925', 'weapon2': '1.436', 'weapon3': '1.494', 'DAMAGECOUNT': '1.626', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:51:24,989][2409596] DAMAGECOUNT value on done: 2898.0
[2023-02-25 12:51:24,992][2409596] Sum rewards: 4.484, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.450', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon5': '0.104', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'weapon4': '0.312', 'WEAPON3': '0.400', 'ARMOR': '0.480', 'HITCOUNT': '0.670', 'weapon3': '1.238', 'weapon2': '1.508', 'DAMAGECOUNT': '2.235', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:51:25,149][2409565] DAMAGECOUNT value on done: 2617.0
[2023-02-25 12:51:25,150][2409565] Sum rewards: 8.073, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'AMMO3': '0.075', 'weapon5': '0.100', 'AMMO4': '0.104', 'weapon4': '0.178', 'WEAPON5': '0.200', 'HEALTH': '0.410', 'WEAPON3': '0.450', 'HITCOUNT': '0.690', 'weapon3': '1.456', 'weapon2': '1.516', 'DAMAGECOUNT': '2.790', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:51:25,364][2409100] DAMAGECOUNT value on done: 2491.0
[2023-02-25 12:51:25,365][2409100] Sum rewards: 3.944, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.074', 'AMMO5': '0.007', 'weapon7': '0.008', 'ARMOR': '0.016', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.093', 'AMMO3': '0.114', 'weapon5': '0.124', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.490', 'weapon2': '0.524', 'weapon4': '0.600', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.968', 'weapon3': '2.134', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:51:25,656][2409549] DAMAGECOUNT value on done: 2168.0
[2023-02-25 12:51:25,659][2409549] Sum rewards: 1.086, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.482', 'AMMO5': '0.007', 'weapon5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'AMMO3': '0.117', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'WEAPON4': '0.400', 'ARMOR': '0.424', 'HITCOUNT': '0.500', 'WEAPON3': '0.800', 'weapon2': '0.832', 'weapon4': '0.876', 'weapon3': '1.402', 'DAMAGECOUNT': '1.836', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:25,664][2409074] Updated weights for policy 0, policy_version 12001 (0.0012)
[2023-02-25 12:51:25,876][2409597] DAMAGECOUNT value on done: 2388.0
[2023-02-25 12:51:25,879][2409597] Sum rewards: -0.676, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.798', 'AMMO2': '0.009', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'AMMO4': '0.046', 'AMMO3': '0.141', 'weapon5': '0.142', 'WEAPON5': '0.450', 'FRAGCOUNT': '0.500', 'HITCOUNT': '0.640', 'ARMOR': '0.800', 'WEAPON3': '0.850', 'weapon2': '0.982', 'DAMAGECOUNT': '2.022', 'weapon3': '2.480'}
[2023-02-25 12:51:26,123][2409485] DAMAGECOUNT value on done: 2411.0
[2023-02-25 12:51:26,124][2409485] Sum rewards: 3.482, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.110', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'weapon5': '0.044', 'AMMO4': '0.051', 'AMMO3': '0.116', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'ARMOR': '0.404', 'HITCOUNT': '0.460', 'weapon4': '0.534', 'WEAPON3': '0.800', 'weapon2': '1.072', 'weapon3': '1.590', 'DAMAGECOUNT': '2.133', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:51:26,250][2409548] DAMAGECOUNT value on done: 1881.0
[2023-02-25 12:51:26,251][2409548] Sum rewards: 1.737, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.720', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.021', 'weapon5': '0.072', 'AMMO3': '0.099', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.356', 'HITCOUNT': '0.360', 'WEAPON3': '0.650', 'weapon3': '0.758', 'DAMAGECOUNT': '1.506', 'ARMOR': '1.746', 'FRAGCOUNT': '2.000', 'weapon2': '2.228'}
[2023-02-25 12:51:26,363][2409373] DAMAGECOUNT value on done: 2134.0
[2023-02-25 12:51:26,367][2409373] Sum rewards: 2.579, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.102', 'AMMO5': '0.012', 'ARMOR': '0.024', 'AMMO2': '0.035', 'WEAPON1': '0.040', 'AMMO3': '0.099', 'WEAPON4': '0.150', 'AMMO4': '0.174', 'weapon5': '0.174', 'WEAPON5': '0.300', 'HITCOUNT': '0.330', 'weapon4': '0.556', 'WEAPON3': '0.600', 'weapon2': '0.606', 'DAMAGECOUNT': '1.527', 'weapon3': '1.804', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:26,570][2409406] DAMAGECOUNT value on done: 1833.0
[2023-02-25 12:51:26,571][2409406] Sum rewards: 3.525, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.852', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO5': '0.013', 'WEAPON1': '0.040', 'AMMO3': '0.064', 'weapon5': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.218', 'HITCOUNT': '0.220', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.810', 'weapon3': '0.872', 'ARMOR': '0.919', 'weapon2': '1.438', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:27,088][2409104] DAMAGECOUNT value on done: 2005.0
[2023-02-25 12:51:27,089][2409104] Sum rewards: 0.726, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.407', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.039', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.128', 'AMMO3': '0.133', 'WEAPON5': '0.300', 'weapon4': '0.392', 'HITCOUNT': '0.410', 'WEAPON3': '0.850', 'weapon2': '1.282', 'weapon3': '1.708', 'DAMAGECOUNT': '1.713', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:27,186][2408954] Fps is (10 sec: 26214.6, 60 sec: 25600.0, 300 sec: 25561.8). Total num frames: 49192960. Throughput: 0: 6399.2. Samples: 12299520. Policy #0 lag: (min: 1.0, avg: 10.4, max: 25.0)
[2023-02-25 12:51:27,186][2408954] Avg episode reward: [(0, '2.197')]
[2023-02-25 12:51:27,263][2409405] DAMAGECOUNT value on done: 2615.0
[2023-02-25 12:51:27,267][2409405] Sum rewards: 5.528, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.986', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.011', 'WEAPON1': '0.040', 'weapon5': '0.068', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.256', 'ARMOR': '0.440', 'HITCOUNT': '0.540', 'WEAPON3': '0.650', 'weapon2': '1.194', 'weapon3': '1.410', 'DAMAGECOUNT': '1.809', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:51:27,301][2409077] DAMAGECOUNT value on done: 2359.0
[2023-02-25 12:51:27,305][2409077] Sum rewards: -0.354, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.320', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'AMMO4': '0.067', 'AMMO3': '0.072', 'WEAPON5': '0.200', 'HITCOUNT': '0.390', 'WEAPON4': '0.400', 'weapon4': '0.538', 'WEAPON3': '0.600', 'weapon3': '1.198', 'DAMAGECOUNT': '1.203', 'weapon2': '1.220', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:27,318][2409074] Updated weights for policy 0, policy_version 12011 (0.0012)
[2023-02-25 12:51:27,940][2409102] DAMAGECOUNT value on done: 1863.0
[2023-02-25 12:51:27,942][2409102] Sum rewards: 4.235, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.070', 'weapon4': '0.114', 'WEAPON4': '0.150', 'HITCOUNT': '0.370', 'WEAPON3': '0.400', 'HEALTH': '0.446', 'ARMOR': '0.908', 'DAMAGECOUNT': '1.095', 'weapon3': '1.126', 'weapon2': '1.428', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:28,224][2409866] DAMAGECOUNT value on done: 1975.0
[2023-02-25 12:51:28,225][2409866] Sum rewards: -0.882, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.750', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.076', 'AMMO3': '0.078', 'WEAPON4': '0.200', 'HITCOUNT': '0.250', 'ARMOR': '0.471', 'WEAPON3': '0.500', 'weapon4': '0.618', 'DAMAGECOUNT': '0.777', 'FRAGCOUNT': '1.000', 'weapon2': '1.168', 'weapon3': '1.444'}
[2023-02-25 12:51:28,688][2409105] DAMAGECOUNT value on done: 2663.0
[2023-02-25 12:51:28,688][2409101] DAMAGECOUNT value on done: 2293.0
[2023-02-25 12:51:28,691][2409101] Sum rewards: 3.827, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.735', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'AMMO4': '0.073', 'AMMO3': '0.096', 'WEAPON5': '0.150', 'weapon4': '0.216', 'HITCOUNT': '0.530', 'WEAPON3': '0.650', 'weapon2': '1.426', 'DAMAGECOUNT': '1.575', 'weapon3': '1.706', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:28,697][2409103] DAMAGECOUNT value on done: 1484.0
[2023-02-25 12:51:28,698][2409103] Sum rewards: 1.459, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.089', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.050', 'AMMO3': '0.060', 'weapon5': '0.080', 'WEAPON5': '0.150', 'HITCOUNT': '0.280', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.762', 'ARMOR': '0.858', 'weapon3': '1.254', 'weapon2': '1.638', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:28,689][2409105] Sum rewards: 7.615, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.185', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'AMMO3': '0.085', 'AMMO4': '0.091', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'HITCOUNT': '0.350', 'WEAPON3': '0.500', 'weapon4': '0.588', 'ARMOR': '0.946', 'weapon3': '1.196', 'weapon2': '1.278', 'DAMAGECOUNT': '2.169', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:51:28,725][2409565] DAMAGECOUNT value on done: 1715.0
[2023-02-25 12:51:28,725][2409565] Sum rewards: 2.014, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.605', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.010', 'WEAPON1': '0.010', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'weapon5': '0.074', 'WEAPON4': '0.100', 'HITCOUNT': '0.200', 'weapon4': '0.234', 'WEAPON3': '0.450', 'weapon2': '0.688', 'DAMAGECOUNT': '0.876', 'FRAGCOUNT': '1.000', 'weapon3': '1.820'}
[2023-02-25 12:51:28,835][2409074] Updated weights for policy 0, policy_version 12021 (0.0013)
[2023-02-25 12:51:28,935][2409596] DAMAGECOUNT value on done: 1541.0
[2023-02-25 12:51:28,938][2409596] Sum rewards: 0.812, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.450', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.013', 'weapon5': '0.014', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.066', 'AMMO3': '0.072', 'WEAPON5': '0.150', 'HITCOUNT': '0.380', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.287', 'FRAGCOUNT': '1.500', 'weapon2': '1.592', 'weapon3': '1.690'}
[2023-02-25 12:51:29,165][2409355] DAMAGECOUNT value on done: 2000.0
[2023-02-25 12:51:29,166][2409355] Sum rewards: 8.354, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.083', 'AMMO5': '0.005', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'weapon7': '0.076', 'AMMO4': '0.081', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.104', 'WEAPON5': '0.150', 'WEAPON3': '0.300', 'HITCOUNT': '0.330', 'weapon4': '0.350', 'weapon3': '0.930', 'weapon2': '1.714', 'DAMAGECOUNT': '1.920', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:51:29,290][2409549] DAMAGECOUNT value on done: 2311.0
[2023-02-25 12:51:29,293][2409549] Sum rewards: 4.281, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.466', 'AMMO4': '-0.066', 'AMMO2': '-0.013', 'AMMO5': '0.003', 'WEAPON1': '0.050', 'weapon5': '0.062', 'AMMO3': '0.069', 'WEAPON5': '0.100', 'HITCOUNT': '0.440', 'WEAPON3': '0.550', 'ARMOR': '0.918', 'weapon3': '1.262', 'weapon2': '1.922', 'DAMAGECOUNT': '1.950', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:29,443][2409407] DAMAGECOUNT value on done: 1792.0
[2023-02-25 12:51:29,444][2409407] Sum rewards: -1.694, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.695', 'AMMO2': '0.008', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO4': '0.038', 'weapon7': '0.046', 'ARMOR': '0.072', 'AMMO3': '0.093', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.230', 'WEAPON4': '0.500', 'DAMAGECOUNT': '0.624', 'WEAPON3': '0.700', 'weapon2': '0.772', 'weapon4': '0.824', 'weapon3': '1.180', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:29,720][2409100] DAMAGECOUNT value on done: 2386.0
[2023-02-25 12:51:29,720][2409100] Sum rewards: 5.717, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.398', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon7': '0.074', 'AMMO3': '0.095', 'weapon5': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'weapon4': '0.456', 'HITCOUNT': '0.490', 'WEAPON3': '0.650', 'ARMOR': '0.890', 'weapon2': '1.146', 'weapon3': '1.702', 'DAMAGECOUNT': '2.445', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:51:29,797][2409485] DAMAGECOUNT value on done: 2319.0
[2023-02-25 12:51:29,800][2409485] Sum rewards: -0.941, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.551', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.023', 'WEAPON1': '0.040', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.127', 'HITCOUNT': '0.210', 'ARMOR': '0.456', 'DAMAGECOUNT': '0.555', 'WEAPON3': '0.700', 'weapon2': '1.356', 'weapon3': '1.544', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:30,141][2409597] DAMAGECOUNT value on done: 3098.0
[2023-02-25 12:51:30,144][2409597] Sum rewards: 2.976, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.040', 'AMMO2': '0.008', 'AMMO5': '0.012', 'ARMOR': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.041', 'AMMO3': '0.104', 'WEAPON4': '0.150', 'weapon5': '0.276', 'HITCOUNT': '0.310', 'WEAPON5': '0.350', 'weapon4': '0.462', 'WEAPON3': '0.700', 'weapon3': '1.366', 'weapon2': '1.418', 'DAMAGECOUNT': '1.518', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:30,182][2409373] DAMAGECOUNT value on done: 1813.0
[2023-02-25 12:51:30,183][2409373] Sum rewards: 1.635, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.556', 'AMMO5': '0.003', 'weapon5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.084', 'weapon4': '0.228', 'HITCOUNT': '0.260', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.759', 'weapon2': '1.120', 'weapon3': '1.452', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:30,368][2409406] DAMAGECOUNT value on done: 2376.0
[2023-02-25 12:51:30,369][2409406] Sum rewards: 5.513, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.522', 'AMMO2': '0.007', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO4': '0.033', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.077', 'weapon4': '0.080', 'weapon5': '0.196', 'WEAPON5': '0.300', 'HITCOUNT': '0.360', 'WEAPON3': '0.550', 'weapon3': '1.582', 'weapon2': '1.746', 'DAMAGECOUNT': '2.220', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:30,371][2409389] DAMAGECOUNT value on done: 1804.0
[2023-02-25 12:51:30,371][2409389] Sum rewards: 5.269, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.262', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.044', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.210', 'HITCOUNT': '0.320', 'WEAPON3': '0.350', 'weapon3': '1.250', 'DAMAGECOUNT': '1.317', 'weapon2': '1.484', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:30,463][2409074] Updated weights for policy 0, policy_version 12031 (0.0012)
[2023-02-25 12:51:30,739][2409548] DAMAGECOUNT value on done: 2256.0
[2023-02-25 12:51:30,742][2409548] Sum rewards: 3.259, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.246', 'AMMO5': '0.012', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'weapon5': '0.064', 'AMMO3': '0.095', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'HITCOUNT': '0.360', 'weapon4': '0.432', 'ARMOR': '0.476', 'WEAPON3': '0.600', 'weapon3': '1.410', 'DAMAGECOUNT': '1.425', 'weapon2': '1.492', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:30,860][2409104] DAMAGECOUNT value on done: 1711.0
[2023-02-25 12:51:30,861][2409104] Sum rewards: 3.179, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon7': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.114', 'HITCOUNT': '0.170', 'weapon4': '0.202', 'WEAPON3': '0.300', 'ARMOR': '0.420', 'HEALTH': '0.575', 'DAMAGECOUNT': '0.960', 'weapon3': '1.024', 'weapon2': '1.928', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:31,115][2409077] DAMAGECOUNT value on done: 1677.0
[2023-02-25 12:51:31,119][2409077] Sum rewards: 0.557, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.638', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'weapon5': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.058', 'weapon4': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'WEAPON4': '0.250', 'HITCOUNT': '0.450', 'WEAPON3': '0.500', 'ARMOR': '0.816', 'weapon3': '1.006', 'DAMAGECOUNT': '1.470', 'weapon2': '2.550', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:31,143][2409405] DAMAGECOUNT value on done: 1585.0
[2023-02-25 12:51:31,144][2409405] Sum rewards: 1.391, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.240', 'AMMO4': '-0.043', 'AMMO2': '-0.008', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'weapon7': '0.064', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.210', 'weapon4': '0.234', 'WEAPON3': '0.400', 'ARMOR': '0.500', 'DAMAGECOUNT': '0.630', 'weapon3': '0.986', 'weapon2': '1.558', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:31,504][2409102] DAMAGECOUNT value on done: 2571.0
[2023-02-25 12:51:31,505][2409102] Sum rewards: 5.461, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.460', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.040', 'AMMO4': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.079', 'weapon5': '0.104', 'WEAPON3': '0.450', 'HITCOUNT': '0.540', 'weapon2': '1.034', 'weapon3': '1.330', 'DAMAGECOUNT': '2.736', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:32,186][2408954] Fps is (10 sec: 24576.0, 60 sec: 25395.2, 300 sec: 25547.9). Total num frames: 49315840. Throughput: 0: 6385.6. Samples: 12337332. Policy #0 lag: (min: 1.0, avg: 10.4, max: 25.0)
[2023-02-25 12:51:32,186][2408954] Avg episode reward: [(0, '2.675')]
[2023-02-25 12:51:32,187][2409033] Saving new best policy, reward=2.675!
[2023-02-25 12:51:32,236][2409103] DAMAGECOUNT value on done: 1753.0
[2023-02-25 12:51:32,242][2409103] Sum rewards: -0.192, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.530', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'weapon5': '0.064', 'AMMO3': '0.071', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'HITCOUNT': '0.300', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.954', 'FRAGCOUNT': '1.000', 'weapon3': '1.512', 'weapon2': '1.678'}
[2023-02-25 12:51:32,312][2409866] DAMAGECOUNT value on done: 2285.0
[2023-02-25 12:51:32,313][2409866] Sum rewards: 5.204, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.652', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.050', 'AMMO3': '0.052', 'WEAPON1': '0.060', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO4': '0.206', 'WEAPON3': '0.350', 'HITCOUNT': '0.420', 'weapon4': '0.458', 'ARMOR': '0.854', 'weapon3': '1.096', 'DAMAGECOUNT': '1.695', 'weapon2': '1.966', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:51:32,349][2409074] Updated weights for policy 0, policy_version 12041 (0.0013)
[2023-02-25 12:51:32,386][2409565] DAMAGECOUNT value on done: 2568.0
[2023-02-25 12:51:32,387][2409565] Sum rewards: 4.255, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.128', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.033', 'AMMO3': '0.058', 'weapon5': '0.060', 'weapon7': '0.078', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.220', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'weapon4': '0.450', 'weapon3': '0.898', 'weapon2': '1.060', 'DAMAGECOUNT': '1.572', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:32,540][2409101] DAMAGECOUNT value on done: 1971.0
[2023-02-25 12:51:32,541][2409101] Sum rewards: 6.218, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.342', 'AMMO5': '0.009', 'AMMO2': '0.012', 'WEAPON1': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.075', 'weapon5': '0.082', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'weapon2': '1.460', 'weapon3': '1.650', 'DAMAGECOUNT': '1.734', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:51:32,616][2409596] DAMAGECOUNT value on done: 1814.0
[2023-02-25 12:51:32,617][2409596] Sum rewards: 1.765, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.690', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.039', 'AMMO3': '0.084', 'weapon5': '0.102', 'weapon7': '0.160', 'AMMO4': '0.197', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'HITCOUNT': '0.260', 'ARMOR': '0.400', 'weapon4': '0.506', 'WEAPON3': '0.550', 'weapon2': '0.798', 'DAMAGECOUNT': '1.221', 'weapon3': '1.248', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:32,857][2409105] DAMAGECOUNT value on done: 2478.0
[2023-02-25 12:51:32,860][2409105] Sum rewards: 0.127, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.960', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.022', 'WEAPON1': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.126', 'HITCOUNT': '0.360', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.215', 'weapon3': '1.750', 'weapon2': '1.894'}
[2023-02-25 12:51:33,019][2409407] DAMAGECOUNT value on done: 2313.0
[2023-02-25 12:51:33,022][2409407] Sum rewards: 1.135, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.360', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.011', 'ARMOR': '0.048', 'AMMO4': '0.057', 'AMMO3': '0.083', 'WEAPON5': '0.100', 'weapon4': '0.308', 'WEAPON4': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.710', 'weapon2': '1.454', 'weapon3': '1.492', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.121'}
[2023-02-25 12:51:33,156][2409549] DAMAGECOUNT value on done: 1941.0
[2023-02-25 12:51:33,157][2409549] Sum rewards: 1.551, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.677', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'HITCOUNT': '0.270', 'ARMOR': '0.465', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.738', 'FRAGCOUNT': '1.000', 'weapon2': '1.402', 'weapon3': '1.450'}
[2023-02-25 12:51:33,328][2409355] DAMAGECOUNT value on done: 1740.0
[2023-02-25 12:51:33,329][2409355] Sum rewards: -0.142, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.097', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'AMMO3': '0.060', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'HITCOUNT': '0.190', 'ARMOR': '0.416', 'WEAPON3': '0.450', 'weapon4': '0.532', 'DAMAGECOUNT': '0.705', 'FRAGCOUNT': '1.000', 'weapon3': '1.138', 'weapon2': '1.716'}
[2023-02-25 12:51:33,502][2409076] DAMAGECOUNT value on done: 1990.0
[2023-02-25 12:51:33,503][2409076] Sum rewards: -3.157, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.462', 'AMMO2': '0.015', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'weapon5': '0.052', 'AMMO4': '0.074', 'AMMO3': '0.127', 'WEAPON5': '0.250', 'HITCOUNT': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.442', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.957', 'weapon2': '1.274', 'weapon3': '1.544', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:51:33,539][2409485] DAMAGECOUNT value on done: 2416.0
[2023-02-25 12:51:33,540][2409485] Sum rewards: 1.449, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.653', 'AMMO2': '0.011', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO3': '0.041', 'AMMO4': '0.053', 'weapon5': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.236', 'WEAPON5': '0.250', 'HITCOUNT': '0.270', 'WEAPON3': '0.350', 'FRAGCOUNT': '0.500', 'ARMOR': '0.937', 'weapon3': '1.002', 'DAMAGECOUNT': '1.293', 'weapon2': '1.436'}
[2023-02-25 12:51:33,638][2409100] DAMAGECOUNT value on done: 1473.0
[2023-02-25 12:51:33,639][2409100] Sum rewards: -3.853, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.714', 'AMMO5': '0.007', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'weapon5': '0.078', 'AMMO3': '0.084', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'HITCOUNT': '0.210', 'WEAPON4': '0.250', 'weapon4': '0.376', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.654', 'ARMOR': '0.893', 'weapon3': '1.120', 'weapon2': '1.308'}
[2023-02-25 12:51:33,715][2409074] Updated weights for policy 0, policy_version 12051 (0.0013)
[2023-02-25 12:51:34,144][2409597] DAMAGECOUNT value on done: 2150.0
[2023-02-25 12:51:34,145][2409597] Sum rewards: -0.079, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.496', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.009', 'WEAPON1': '0.040', 'weapon4': '0.054', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon5': '0.106', 'WEAPON5': '0.200', 'HITCOUNT': '0.310', 'WEAPON3': '0.700', 'weapon3': '1.310', 'ARMOR': '1.374', 'DAMAGECOUNT': '1.425', 'weapon2': '1.952', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:34,240][2409406] DAMAGECOUNT value on done: 2123.0
[2023-02-25 12:51:34,241][2409406] Sum rewards: 0.199, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.358', 'AMMO2': '0.003', 'AMMO5': '0.013', 'AMMO4': '0.013', 'weapon5': '0.026', 'weapon4': '0.050', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'HITCOUNT': '0.190', 'WEAPON5': '0.250', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.705', 'ARMOR': '0.909', 'weapon3': '1.654', 'weapon2': '2.016', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:34,250][2409389] DAMAGECOUNT value on done: 1688.0
[2023-02-25 12:51:34,251][2409389] Sum rewards: 5.131, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.140', 'AMMO2': '0.003', 'AMMO5': '0.009', 'AMMO4': '0.013', 'WEAPON1': '0.030', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'weapon5': '0.132', 'weapon4': '0.202', 'WEAPON5': '0.250', 'HITCOUNT': '0.400', 'WEAPON3': '0.500', 'ARMOR': '0.913', 'weapon3': '1.084', 'DAMAGECOUNT': '1.392', 'weapon2': '1.674', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:34,263][2409373] DAMAGECOUNT value on done: 2762.0
[2023-02-25 12:51:34,264][2409373] Sum rewards: 0.109, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.987', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.101', 'AMMO4': '0.111', 'WEAPON4': '0.400', 'weapon4': '0.484', 'HITCOUNT': '0.500', 'WEAPON3': '0.650', 'ARMOR': '0.884', 'weapon3': '0.920', 'weapon2': '1.388', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.025'}
[2023-02-25 12:51:34,499][2409548] DAMAGECOUNT value on done: 2796.0
[2023-02-25 12:51:34,499][2409548] Sum rewards: 6.088, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon5': '0.048', 'AMMO4': '0.079', 'AMMO3': '0.084', 'WEAPON5': '0.100', 'HEALTH': '0.120', 'WEAPON4': '0.200', 'weapon4': '0.282', 'WEAPON3': '0.450', 'HITCOUNT': '0.470', 'ARMOR': '0.500', 'weapon3': '0.930', 'weapon2': '1.362', 'DAMAGECOUNT': '2.172', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:51:34,752][2409405] DAMAGECOUNT value on done: 2406.0
[2023-02-25 12:51:34,753][2409405] Sum rewards: 2.929, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.027', 'AMMO3': '0.077', 'weapon5': '0.126', 'AMMO4': '0.135', 'HEALTH': '0.149', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'HITCOUNT': '0.380', 'WEAPON3': '0.450', 'weapon4': '0.488', 'weapon2': '0.996', 'weapon3': '1.222', 'DAMAGECOUNT': '2.085', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:34,851][2409104] DAMAGECOUNT value on done: 3469.0
[2023-02-25 12:51:34,855][2409104] Sum rewards: 2.677, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.134', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.040', 'AMMO4': '0.056', 'AMMO3': '0.111', 'weapon5': '0.132', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.318', 'ARMOR': '0.477', 'HITCOUNT': '0.530', 'WEAPON3': '0.750', 'weapon3': '1.320', 'weapon2': '1.466', 'DAMAGECOUNT': '2.289', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:51:35,014][2409077] DAMAGECOUNT value on done: 2768.0
[2023-02-25 12:51:35,017][2409077] Sum rewards: 4.028, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.411', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO3': '0.050', 'WEAPON3': '0.350', 'ARMOR': '0.447', 'HITCOUNT': '0.540', 'weapon3': '1.052', 'weapon2': '1.880', 'DAMAGECOUNT': '1.887', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:35,210][2409102] DAMAGECOUNT value on done: 2247.0
[2023-02-25 12:51:35,211][2409102] Sum rewards: 2.689, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.250', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'weapon5': '0.196', 'weapon4': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.420', 'WEAPON3': '0.650', 'ARMOR': '0.937', 'weapon2': '1.416', 'DAMAGECOUNT': '1.761', 'weapon3': '1.838', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:51:35,336][2409074] Updated weights for policy 0, policy_version 12061 (0.0012)
[2023-02-25 12:51:36,029][2409866] DAMAGECOUNT value on done: 2435.0
[2023-02-25 12:51:36,030][2409866] Sum rewards: 3.587, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.803', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'weapon5': '0.020', 'AMMO3': '0.064', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.114', 'ARMOR': '0.400', 'HITCOUNT': '0.410', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.206', 'weapon2': '1.310', 'weapon3': '1.356', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:36,055][2409565] DAMAGECOUNT value on done: 2473.0
[2023-02-25 12:51:36,056][2409565] Sum rewards: 4.384, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.560', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.033', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'weapon5': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.360', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'weapon3': '1.424', 'weapon2': '1.500', 'DAMAGECOUNT': '2.166', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:36,157][2409103] DAMAGECOUNT value on done: 1845.0
[2023-02-25 12:51:36,160][2409103] Sum rewards: -0.505, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.230', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.040', 'AMMO3': '0.068', 'AMMO4': '0.077', 'WEAPON5': '0.150', 'WEAPON4': '0.450', 'HITCOUNT': '0.460', 'weapon4': '0.494', 'WEAPON3': '0.550', 'ARMOR': '0.909', 'weapon3': '1.138', 'DAMAGECOUNT': '1.371', 'weapon2': '1.494', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:36,569][2409101] DAMAGECOUNT value on done: 1646.0
[2023-02-25 12:51:36,571][2409101] Sum rewards: 2.210, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.770', 'AMMO5': '0.015', 'AMMO2': '0.015', 'WEAPON1': '0.050', 'AMMO4': '0.077', 'weapon5': '0.102', 'AMMO3': '0.114', 'WEAPON4': '0.150', 'HITCOUNT': '0.280', 'WEAPON5': '0.300', 'weapon4': '0.316', 'ARMOR': '0.416', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.167', 'weapon2': '1.394', 'weapon3': '1.634', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:51:36,613][2409596] DAMAGECOUNT value on done: 1726.0
[2023-02-25 12:51:36,653][2409105] DAMAGECOUNT value on done: 2288.0
[2023-02-25 12:51:36,654][2409105] Sum rewards: 3.285, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.917', 'AMMO5': '0.015', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'weapon5': '0.068', 'AMMO3': '0.090', 'AMMO4': '0.099', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'HITCOUNT': '0.430', 'WEAPON3': '0.550', 'weapon4': '0.722', 'ARMOR': '0.873', 'weapon2': '1.230', 'weapon3': '1.248', 'DAMAGECOUNT': '1.767', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:36,941][2409407] DAMAGECOUNT value on done: 3257.0
[2023-02-25 12:51:36,944][2409407] Sum rewards: 1.920, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-2.100', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'ARMOR': '0.052', 'AMMO3': '0.060', 'weapon7': '0.112', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.330', 'WEAPON7': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.510', 'weapon3': '0.964', 'weapon2': '1.106', 'DAMAGECOUNT': '1.596', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:36,951][2409355] DAMAGECOUNT value on done: 2661.0
[2023-02-25 12:51:36,952][2409355] Sum rewards: 5.605, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.032', 'AMMO2': '0.005', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.024', 'weapon5': '0.074', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'weapon4': '0.148', 'WEAPON5': '0.150', 'HITCOUNT': '0.400', 'ARMOR': '0.453', 'WEAPON3': '0.600', 'weapon3': '1.446', 'weapon2': '1.610', 'DAMAGECOUNT': '2.034', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:37,051][2409074] Updated weights for policy 0, policy_version 12071 (0.0012)
[2023-02-25 12:51:37,168][2409549] DAMAGECOUNT value on done: 2346.0
[2023-02-25 12:51:37,171][2409549] Sum rewards: -3.709, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.372', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.076', 'AMMO3': '0.112', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'weapon4': '0.378', 'WEAPON3': '0.700', 'ARMOR': '0.881', 'DAMAGECOUNT': '1.242', 'weapon3': '1.482', 'FRAGCOUNT': '1.500', 'weapon2': '1.728'}
[2023-02-25 12:51:37,186][2408954] Fps is (10 sec: 25395.1, 60 sec: 25531.7, 300 sec: 25561.8). Total num frames: 49446912. Throughput: 0: 6383.2. Samples: 12356244. Policy #0 lag: (min: 0.0, avg: 12.2, max: 25.0)
[2023-02-25 12:51:37,186][2408954] Avg episode reward: [(0, '2.532')]
[2023-02-25 12:51:37,187][2409076] DAMAGECOUNT value on done: 2189.0
[2023-02-25 12:51:37,188][2409076] Sum rewards: 2.378, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon4': '0.072', 'AMMO4': '0.100', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.136', 'HITCOUNT': '0.380', 'WEAPON3': '0.550', 'HEALTH': '0.580', 'weapon2': '1.486', 'weapon3': '1.712', 'DAMAGECOUNT': '1.767', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:37,200][2409100] DAMAGECOUNT value on done: 2710.0
[2023-02-25 12:51:37,201][2409100] Sum rewards: 7.732, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.984', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.007', 'weapon4': '0.024', 'AMMO3': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.154', 'WEAPON3': '0.450', 'HITCOUNT': '0.650', 'ARMOR': '0.857', 'weapon3': '1.028', 'weapon2': '1.420', 'DAMAGECOUNT': '2.562', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:51:37,249][2409485] DAMAGECOUNT value on done: 2014.0
[2023-02-25 12:51:37,250][2409485] Sum rewards: 4.327, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.488', 'AMMO5': '0.010', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'AMMO4': '0.069', 'AMMO3': '0.102', 'WEAPON5': '0.150', 'weapon5': '0.166', 'WEAPON4': '0.250', 'HITCOUNT': '0.380', 'weapon4': '0.606', 'WEAPON3': '0.650', 'weapon3': '1.124', 'ARMOR': '1.236', 'weapon2': '1.546', 'DAMAGECOUNT': '2.232', 'FRAGCOUNT': '4.500'}
[2023-02-25 12:51:37,508][2409469] DAMAGECOUNT value on done: 1522.0
[2023-02-25 12:51:37,511][2409469] Sum rewards: 3.549, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO3': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.050', 'HITCOUNT': '0.090', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'WEAPON3': '0.200', 'weapon4': '0.216', 'ARMOR': '0.440', 'HEALTH': '0.486', 'DAMAGECOUNT': '0.597', 'weapon3': '0.756', 'FRAGCOUNT': '1.000', 'weapon2': '1.662'}
[2023-02-25 12:51:37,847][2409373] DAMAGECOUNT value on done: 2669.0
[2023-02-25 12:51:37,853][2409373] Sum rewards: 8.330, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.207', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.046', 'AMMO3': '0.084', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'ARMOR': '0.485', 'WEAPON3': '0.550', 'HITCOUNT': '0.570', 'weapon4': '0.600', 'weapon2': '1.016', 'weapon3': '1.478', 'DAMAGECOUNT': '2.505', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:51:37,896][2409389] DAMAGECOUNT value on done: 2109.0
[2023-02-25 12:51:37,900][2409389] Sum rewards: 0.620, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.456', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.017', 'weapon5': '0.024', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.113', 'WEAPON4': '0.250', 'HITCOUNT': '0.340', 'weapon4': '0.378', 'WEAPON3': '0.750', 'ARMOR': '0.856', 'DAMAGECOUNT': '1.116', 'weapon2': '1.270', 'weapon3': '1.876', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:38,055][2409597] DAMAGECOUNT value on done: 2573.0
[2023-02-25 12:51:38,058][2409597] Sum rewards: -0.280, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.012', 'AMMO2': '0.017', 'HEALTH': '0.054', 'WEAPON1': '0.060', 'AMMO4': '0.083', 'AMMO3': '0.099', 'weapon5': '0.144', 'WEAPON4': '0.150', 'weapon4': '0.214', 'WEAPON5': '0.300', 'HITCOUNT': '0.340', 'ARMOR': '0.480', 'WEAPON3': '0.600', 'weapon2': '1.272', 'weapon3': '1.348', 'DAMAGECOUNT': '1.797', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:51:38,197][2409406] DAMAGECOUNT value on done: 1752.0
[2023-02-25 12:51:38,202][2409406] Sum rewards: 1.895, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.538', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'AMMO3': '0.065', 'weapon5': '0.104', 'WEAPON4': '0.150', 'AMMO4': '0.167', 'weapon7': '0.190', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'HITCOUNT': '0.410', 'WEAPON3': '0.500', 'weapon4': '0.606', 'ARMOR': '0.866', 'weapon3': '1.216', 'DAMAGECOUNT': '1.227', 'weapon2': '1.414', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:38,262][2409548] DAMAGECOUNT value on done: 2042.0
[2023-02-25 12:51:38,263][2409548] Sum rewards: 5.453, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'weapon5': '0.154', 'WEAPON4': '0.250', 'HITCOUNT': '0.360', 'WEAPON3': '0.400', 'weapon4': '0.452', 'HEALTH': '0.708', 'ARMOR': '0.838', 'weapon3': '1.332', 'weapon2': '1.362', 'DAMAGECOUNT': '1.479', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:38,482][2409074] Updated weights for policy 0, policy_version 12081 (0.0012)
[2023-02-25 12:51:38,508][2409075] DAMAGECOUNT value on done: 1798.0
[2023-02-25 12:51:38,509][2409075] Sum rewards: -2.006, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.202', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.020', 'weapon5': '0.072', 'AMMO3': '0.079', 'AMMO4': '0.098', 'weapon4': '0.118', 'WEAPON4': '0.150', 'HITCOUNT': '0.340', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'ARMOR': '0.476', 'weapon3': '1.190', 'DAMAGECOUNT': '1.200', 'weapon2': '1.574', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:38,580][2409104] DAMAGECOUNT value on done: 1595.0
[2023-02-25 12:51:38,580][2409104] Sum rewards: 3.213, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.902', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon7': '0.054', 'AMMO3': '0.064', 'weapon5': '0.066', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.212', 'HITCOUNT': '0.370', 'WEAPON3': '0.450', 'ARMOR': '0.883', 'weapon3': '1.048', 'DAMAGECOUNT': '1.170', 'weapon2': '1.626', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:38,992][2409102] DAMAGECOUNT value on done: 2257.0
[2023-02-25 12:51:38,993][2409102] Sum rewards: 4.015, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.042', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'HEALTH': '0.144', 'AMMO4': '0.181', 'WEAPON4': '0.400', 'weapon4': '0.572', 'HITCOUNT': '0.590', 'WEAPON3': '0.600', 'ARMOR': '0.844', 'weapon3': '1.108', 'weapon2': '1.126', 'DAMAGECOUNT': '1.809', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:51:38,996][2409077] DAMAGECOUNT value on done: 1623.0
[2023-02-25 12:51:38,997][2409077] Sum rewards: -1.164, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.711', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.031', 'AMMO3': '0.100', 'weapon5': '0.116', 'AMMO4': '0.156', 'weapon4': '0.206', 'WEAPON5': '0.250', 'HITCOUNT': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '0.650', 'ARMOR': '0.910', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.122', 'weapon2': '1.346', 'weapon3': '1.430'}
[2023-02-25 12:51:39,115][2409405] DAMAGECOUNT value on done: 2419.0
[2023-02-25 12:51:39,118][2409405] Sum rewards: 2.704, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.695', 'AMMO2': '0.014', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO4': '0.070', 'weapon4': '0.176', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'HITCOUNT': '0.570', 'weapon2': '0.950', 'WEAPON3': '1.250', 'DAMAGECOUNT': '2.001', 'weapon3': '2.326', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:51:39,502][2409078] DAMAGECOUNT value on done: 1707.0
[2023-02-25 12:51:39,636][2409866] DAMAGECOUNT value on done: 1978.0
[2023-02-25 12:51:39,636][2409866] Sum rewards: 0.463, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.540', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.036', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.062', 'WEAPON4': '0.200', 'HITCOUNT': '0.250', 'weapon4': '0.294', 'WEAPON3': '0.350', 'ARMOR': '0.458', 'DAMAGECOUNT': '0.915', 'FRAGCOUNT': '1.000', 'weapon3': '1.140', 'weapon2': '1.428'}
[2023-02-25 12:51:39,719][2409097] DAMAGECOUNT value on done: 1842.0
[2023-02-25 12:51:39,778][2409103] DAMAGECOUNT value on done: 2284.0
[2023-02-25 12:51:39,779][2409103] Sum rewards: 6.188, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.706', 'AMMO5': '0.013', 'weapon5': '0.016', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'weapon7': '0.060', 'AMMO3': '0.076', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.256', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'ARMOR': '0.465', 'HITCOUNT': '0.540', 'WEAPON3': '0.600', 'weapon2': '1.530', 'weapon3': '1.660', 'DAMAGECOUNT': '1.836', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:51:39,903][2409565] DAMAGECOUNT value on done: 2240.0
[2023-02-25 12:51:39,904][2409565] Sum rewards: 0.513, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.181', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'weapon7': '0.060', 'weapon5': '0.068', 'AMMO3': '0.121', 'WEAPON4': '0.200', 'HITCOUNT': '0.300', 'WEAPON5': '0.300', 'AMMO6': '0.360', 'AMMO7': '0.360', 'WEAPON7': '0.400', 'ARMOR': '0.444', 'weapon4': '0.448', 'WEAPON3': '0.800', 'weapon2': '0.918', 'DAMAGECOUNT': '1.443', 'weapon3': '1.660', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:40,224][2409074] Updated weights for policy 0, policy_version 12091 (0.0012)
[2023-02-25 12:51:40,440][2409101] DAMAGECOUNT value on done: 3495.0
[2023-02-25 12:51:40,442][2409101] Sum rewards: 11.887, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.445', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.043', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'weapon4': '0.112', 'WEAPON5': '0.150', 'weapon5': '0.182', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.580', 'weapon2': '1.354', 'weapon3': '1.356', 'DAMAGECOUNT': '3.636', 'FRAGCOUNT': '9.000'}
[2023-02-25 12:51:40,530][2409596] DAMAGECOUNT value on done: 1549.0
[2023-02-25 12:51:40,557][2409355] DAMAGECOUNT value on done: 1270.0
[2023-02-25 12:51:40,561][2409355] Sum rewards: 5.577, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.589', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO3': '0.020', 'AMMO4': '0.020', 'WEAPON5': '0.050', 'weapon7': '0.056', 'weapon5': '0.068', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON3': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.236', 'HITCOUNT': '0.240', 'ARMOR': '0.448', 'weapon3': '0.482', 'DAMAGECOUNT': '1.383', 'weapon2': '1.466', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:40,778][2409105] DAMAGECOUNT value on done: 2149.0
[2023-02-25 12:51:40,781][2409105] Sum rewards: 3.274, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.448', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.065', 'WEAPON4': '0.200', 'HITCOUNT': '0.310', 'weapon4': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.891', 'weapon2': '1.152', 'weapon3': '1.252', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:40,807][2409407] DAMAGECOUNT value on done: 1753.0
[2023-02-25 12:51:40,810][2409407] Sum rewards: -0.351, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.120', 'AMMO2': '0.010', 'AMMO5': '0.010', 'AMMO4': '0.048', 'AMMO3': '0.089', 'weapon5': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.430', 'FRAGCOUNT': '0.500', 'weapon4': '0.580', 'WEAPON3': '0.600', 'ARMOR': '0.941', 'weapon2': '1.124', 'DAMAGECOUNT': '1.245', 'weapon3': '1.322'}
[2023-02-25 12:51:40,909][2409485] DAMAGECOUNT value on done: 2028.0
[2023-02-25 12:51:40,912][2409485] Sum rewards: 1.875, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.638', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.018', 'weapon5': '0.082', 'AMMO4': '0.091', 'AMMO3': '0.131', 'weapon4': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.620', 'WEAPON3': '0.800', 'weapon2': '1.452', 'weapon3': '1.604', 'DAMAGECOUNT': '2.055', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:51:41,044][2409100] DAMAGECOUNT value on done: 2372.0
[2023-02-25 12:51:41,044][2409100] Sum rewards: 2.342, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.576', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'AMMO3': '0.082', 'AMMO4': '0.167', 'WEAPON4': '0.350', 'weapon4': '0.404', 'HITCOUNT': '0.420', 'ARMOR': '0.495', 'WEAPON3': '0.500', 'weapon3': '1.314', 'DAMAGECOUNT': '1.347', 'weapon2': '1.536', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:41,156][2409549] DAMAGECOUNT value on done: 1869.0
[2023-02-25 12:51:41,157][2409549] Sum rewards: 1.445, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.010', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'HEALTH': '0.064', 'AMMO3': '0.078', 'AMMO4': '0.097', 'weapon5': '0.162', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.260', 'weapon4': '0.298', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.900', 'weapon3': '1.268', 'weapon2': '1.768', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:41,288][2409076] DAMAGECOUNT value on done: 1870.0
[2023-02-25 12:51:41,292][2409076] Sum rewards: 0.737, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.830', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.060', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'HITCOUNT': '0.330', 'ARMOR': '0.500', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.945', 'weapon3': '1.518', 'weapon2': '1.820', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:41,567][2409389] DAMAGECOUNT value on done: 2005.0
[2023-02-25 12:51:41,568][2409389] Sum rewards: 3.105, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.193', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.059', 'ARMOR': '0.072', 'weapon5': '0.078', 'AMMO3': '0.079', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'HITCOUNT': '0.280', 'WEAPON3': '0.450', 'weapon4': '0.700', 'weapon2': '1.008', 'DAMAGECOUNT': '1.077', 'weapon3': '1.308', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:41,775][2409469] DAMAGECOUNT value on done: 2425.0
[2023-02-25 12:51:41,775][2409469] Sum rewards: -0.322, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.700', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon5': '0.046', 'weapon4': '0.054', 'WEAPON1': '0.060', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.410', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.263', 'ARMOR': '1.352', 'weapon3': '1.434', 'FRAGCOUNT': '2.000', 'weapon2': '2.022'}
[2023-02-25 12:51:41,861][2409074] Updated weights for policy 0, policy_version 12101 (0.0012)
[2023-02-25 12:51:41,954][2409597] DAMAGECOUNT value on done: 2223.0
[2023-02-25 12:51:41,958][2409597] Sum rewards: 1.112, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.650', 'AMMO5': '0.014', 'AMMO2': '0.034', 'WEAPON1': '0.050', 'weapon7': '0.058', 'AMMO3': '0.079', 'weapon4': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.171', 'WEAPON4': '0.200', 'weapon5': '0.222', 'WEAPON5': '0.300', 'HITCOUNT': '0.370', 'ARMOR': '0.412', 'WEAPON3': '0.500', 'weapon2': '1.230', 'weapon3': '1.348', 'DAMAGECOUNT': '1.881', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:42,003][2409406] DAMAGECOUNT value on done: 2441.0
[2023-02-25 12:51:42,004][2409406] Sum rewards: 6.489, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.916', 'AMMO5': '0.013', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'AMMO3': '0.076', 'weapon5': '0.082', 'AMMO4': '0.145', 'weapon4': '0.184', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'HITCOUNT': '0.370', 'WEAPON3': '0.500', 'ARMOR': '0.532', 'weapon3': '1.180', 'DAMAGECOUNT': '1.470', 'weapon2': '1.694', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:51:42,043][2409548] DAMAGECOUNT value on done: 2811.0
[2023-02-25 12:51:42,049][2409548] Sum rewards: 0.457, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.210', 'AMMO5': '0.013', 'AMMO2': '0.038', 'WEAPON1': '0.040', 'weapon5': '0.078', 'AMMO3': '0.110', 'AMMO4': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.444', 'HITCOUNT': '0.550', 'WEAPON3': '0.700', 'ARMOR': '0.836', 'weapon2': '1.424', 'DAMAGECOUNT': '1.554', 'weapon3': '1.790', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:42,186][2408954] Fps is (10 sec: 25804.8, 60 sec: 25463.5, 300 sec: 25547.9). Total num frames: 49573888. Throughput: 0: 6366.7. Samples: 12394272. Policy #0 lag: (min: 0.0, avg: 12.2, max: 25.0)
[2023-02-25 12:51:42,186][2408954] Avg episode reward: [(0, '2.467')]
[2023-02-25 12:51:42,206][2409075] DAMAGECOUNT value on done: 2611.0
[2023-02-25 12:51:42,206][2409373] DAMAGECOUNT value on done: 2303.0
[2023-02-25 12:51:42,209][2409075] Sum rewards: 4.819, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.002', 'AMMO5': '0.005', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'weapon7': '0.050', 'AMMO3': '0.052', 'AMMO4': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'weapon4': '0.402', 'HITCOUNT': '0.450', 'weapon2': '1.050', 'weapon3': '1.250', 'DAMAGECOUNT': '1.575', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:42,209][2409373] Sum rewards: 5.904, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.260', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO3': '0.044', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.070', 'WEAPON5': '0.200', 'weapon4': '0.238', 'WEAPON3': '0.350', 'HITCOUNT': '0.370', 'ARMOR': '0.460', 'weapon2': '0.892', 'weapon3': '0.934', 'DAMAGECOUNT': '1.488', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:42,668][2409405] DAMAGECOUNT value on done: 1891.0
[2023-02-25 12:51:42,669][2409405] Sum rewards: 1.471, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.842', 'AMMO2': '0.002', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO4': '0.011', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon7': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'weapon4': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.330', 'WEAPON3': '0.700', 'ARMOR': '0.888', 'DAMAGECOUNT': '1.005', 'weapon3': '1.414', 'weapon2': '1.520', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:42,673][2409104] DAMAGECOUNT value on done: 2152.0
[2023-02-25 12:51:42,674][2409104] Sum rewards: 4.982, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.510', 'AMMO5': '0.007', 'AMMO2': '0.010', 'ARMOR': '0.040', 'AMMO4': '0.050', 'weapon7': '0.056', 'AMMO3': '0.083', 'weapon5': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.500', 'weapon4': '0.510', 'WEAPON3': '0.550', 'weapon2': '0.618', 'weapon3': '1.196', 'DAMAGECOUNT': '1.395', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:42,778][2409077] DAMAGECOUNT value on done: 1979.0
[2023-02-25 12:51:42,780][2409077] Sum rewards: 3.871, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.235', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO3': '0.040', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.242', 'WEAPON3': '0.350', 'HITCOUNT': '0.440', 'ARMOR': '0.482', 'weapon3': '0.932', 'DAMAGECOUNT': '1.599', 'weapon2': '1.834', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:42,898][2409102] DAMAGECOUNT value on done: 2279.0
[2023-02-25 12:51:42,899][2409102] Sum rewards: -0.314, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.914', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON1': '0.050', 'weapon5': '0.076', 'AMMO3': '0.079', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'HITCOUNT': '0.230', 'weapon4': '0.274', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.780', 'ARMOR': '0.828', 'weapon3': '1.292', 'weapon2': '1.614', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:43,161][2409078] DAMAGECOUNT value on done: 1738.0
[2023-02-25 12:51:43,164][2409078] Sum rewards: 2.221, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.015', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'AMMO3': '0.091', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'weapon5': '0.174', 'weapon4': '0.178', 'WEAPON5': '0.300', 'ARMOR': '0.416', 'HITCOUNT': '0.470', 'WEAPON3': '0.500', 'HEALTH': '0.544', 'weapon2': '1.214', 'weapon3': '1.840', 'DAMAGECOUNT': '1.890', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:51:43,259][2409866] DAMAGECOUNT value on done: 1914.0
[2023-02-25 12:51:43,259][2409866] Sum rewards: 4.601, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.438', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'weapon4': '0.158', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.440', 'weapon3': '0.952', 'weapon2': '1.192', 'DAMAGECOUNT': '1.776', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:43,278][2409074] Updated weights for policy 0, policy_version 12111 (0.0012)
[2023-02-25 12:51:43,542][2409103] DAMAGECOUNT value on done: 2596.0
[2023-02-25 12:51:43,543][2409103] Sum rewards: 1.354, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.968', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.023', 'WEAPON1': '0.030', 'weapon5': '0.052', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.310', 'HITCOUNT': '0.400', 'WEAPON3': '0.850', 'ARMOR': '0.861', 'DAMAGECOUNT': '1.125', 'weapon3': '1.524', 'weapon2': '1.834', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:43,818][2409097] DAMAGECOUNT value on done: 1131.0
[2023-02-25 12:51:43,822][2409097] Sum rewards: -3.820, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.890', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO3': '0.111', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'weapon4': '0.486', 'DAMAGECOUNT': '0.498', 'WEAPON3': '0.750', 'weapon2': '0.934', 'FRAGCOUNT': '1.000', 'weapon3': '1.442'}
[2023-02-25 12:51:43,851][2409565] DAMAGECOUNT value on done: 1879.0
[2023-02-25 12:51:43,854][2409565] Sum rewards: -0.504, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.670', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.050', 'AMMO4': '0.087', 'AMMO3': '0.119', 'weapon4': '0.206', 'HITCOUNT': '0.410', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.074', 'DAMAGECOUNT': '1.266', 'weapon3': '2.100'}
[2023-02-25 12:51:44,309][2409355] DAMAGECOUNT value on done: 2318.0
[2023-02-25 12:51:44,314][2409355] Sum rewards: 3.059, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.336', 'AMMO2': '0.007', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'AMMO3': '0.075', 'weapon5': '0.088', 'weapon4': '0.126', 'HITCOUNT': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.891', 'weapon2': '1.236', 'ARMOR': '1.300', 'weapon3': '1.390', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:44,353][2409596] DAMAGECOUNT value on done: 2501.0
[2023-02-25 12:51:44,354][2409596] Sum rewards: 2.456, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.218', 'AMMO5': '0.012', 'weapon5': '0.016', 'AMMO2': '0.020', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.155', 'WEAPON5': '0.250', 'HITCOUNT': '0.560', 'ARMOR': '0.860', 'WEAPON3': '1.000', 'weapon2': '1.502', 'DAMAGECOUNT': '2.040', 'weapon3': '2.256', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:51:44,395][2409101] DAMAGECOUNT value on done: 2240.0
[2023-02-25 12:51:44,395][2409101] Sum rewards: -1.434, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.858', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO4': '0.097', 'weapon5': '0.118', 'AMMO3': '0.119', 'HITCOUNT': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.376', 'ARMOR': '0.479', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.885', 'weapon3': '1.394', 'weapon2': '1.824', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:44,434][2409105] DAMAGECOUNT value on done: 2539.0
[2023-02-25 12:51:44,435][2409105] Sum rewards: 2.744, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.198', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO4': '0.018', 'weapon5': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'WEAPON5': '0.200', 'weapon4': '0.210', 'HITCOUNT': '0.430', 'WEAPON3': '0.750', 'ARMOR': '0.944', 'DAMAGECOUNT': '1.380', 'weapon3': '1.442', 'weapon2': '1.798', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:44,634][2409100] DAMAGECOUNT value on done: 2377.0
[2023-02-25 12:51:44,635][2409100] Sum rewards: 5.492, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.332', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon7': '0.046', 'AMMO3': '0.050', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.140', 'WEAPON5': '0.150', 'weapon5': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.290', 'WEAPON3': '0.400', 'ARMOR': '0.800', 'weapon3': '1.028', 'weapon2': '1.412', 'DAMAGECOUNT': '1.545', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:44,724][2409485] DAMAGECOUNT value on done: 2254.0
[2023-02-25 12:51:44,725][2409485] Sum rewards: 2.371, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.835', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.040', 'weapon5': '0.056', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'WEAPON5': '0.200', 'weapon4': '0.244', 'HITCOUNT': '0.380', 'ARMOR': '0.432', 'WEAPON3': '0.750', 'weapon2': '1.170', 'DAMAGECOUNT': '1.455', 'weapon3': '1.942', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:44,931][2409549] DAMAGECOUNT value on done: 3264.0
[2023-02-25 12:51:44,932][2409549] Sum rewards: 4.305, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.304', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.039', 'AMMO3': '0.053', 'AMMO4': '0.194', 'weapon5': '0.198', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'HITCOUNT': '0.410', 'ARMOR': '0.499', 'weapon4': '0.876', 'weapon3': '1.056', 'weapon2': '1.108', 'DAMAGECOUNT': '2.553', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:45,024][2409074] Updated weights for policy 0, policy_version 12121 (0.0012)
[2023-02-25 12:51:45,326][2409076] DAMAGECOUNT value on done: 2390.0
[2023-02-25 12:51:45,328][2409076] Sum rewards: 2.967, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.316', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.083', 'weapon5': '0.092', 'HITCOUNT': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'weapon4': '0.656', 'ARMOR': '0.863', 'weapon2': '1.134', 'weapon3': '1.232', 'DAMAGECOUNT': '1.632', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:45,400][2409407] DAMAGECOUNT value on done: 2387.0
[2023-02-25 12:51:45,409][2409407] Sum rewards: 2.676, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.756', 'AMMO5': '0.010', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'AMMO4': '0.071', 'AMMO3': '0.107', 'weapon5': '0.120', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.392', 'HITCOUNT': '0.500', 'WEAPON3': '0.750', 'ARMOR': '0.870', 'weapon3': '1.086', 'weapon2': '1.512', 'DAMAGECOUNT': '1.770', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:51:45,490][2409469] DAMAGECOUNT value on done: 1784.0
[2023-02-25 12:51:45,493][2409469] Sum rewards: 1.826, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.708', 'AMMO2': '0.010', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.049', 'AMMO3': '0.080', 'weapon5': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.330', 'weapon4': '0.446', 'WEAPON3': '0.600', 'ARMOR': '0.908', 'weapon2': '1.062', 'DAMAGECOUNT': '1.380', 'weapon3': '1.576', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:45,612][2409389] DAMAGECOUNT value on done: 2225.0
[2023-02-25 12:51:45,615][2409389] Sum rewards: 7.414, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.902', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.050', 'AMMO3': '0.095', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.208', 'WEAPON4': '0.250', 'AMMO4': '0.251', 'ARMOR': '0.400', 'HITCOUNT': '0.430', 'WEAPON3': '0.600', 'weapon4': '0.770', 'weapon3': '0.890', 'weapon2': '1.064', 'DAMAGECOUNT': '2.715', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:51:45,624][2409548] DAMAGECOUNT value on done: 1854.0
[2023-02-25 12:51:45,625][2409548] Sum rewards: 3.317, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'weapon5': '0.048', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'HEALTH': '0.070', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'HITCOUNT': '0.240', 'WEAPON3': '0.300', 'weapon4': '0.460', 'ARMOR': '0.552', 'DAMAGECOUNT': '0.774', 'weapon2': '1.080', 'weapon3': '1.166', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:45,756][2409406] DAMAGECOUNT value on done: 2059.0
[2023-02-25 12:51:45,757][2409406] Sum rewards: 1.497, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.665', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO5': '0.007', 'WEAPON4': '0.050', 'weapon5': '0.064', 'WEAPON1': '0.080', 'AMMO3': '0.084', 'weapon4': '0.096', 'WEAPON5': '0.200', 'HITCOUNT': '0.360', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.308', 'weapon3': '1.394', 'weapon2': '1.902', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:45,845][2409597] DAMAGECOUNT value on done: 2989.0
[2023-02-25 12:51:45,846][2409597] Sum rewards: 3.719, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.443', 'AMMO5': '0.012', 'AMMO2': '0.029', 'WEAPON1': '0.050', 'weapon5': '0.070', 'AMMO3': '0.082', 'weapon4': '0.102', 'AMMO4': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'ARMOR': '0.404', 'HITCOUNT': '0.470', 'WEAPON3': '0.650', 'weapon3': '1.788', 'weapon2': '1.792', 'DAMAGECOUNT': '1.869', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:46,132][2409373] DAMAGECOUNT value on done: 2222.0
[2023-02-25 12:51:46,133][2409373] Sum rewards: 2.710, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.284', 'AMMO2': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.020', 'weapon5': '0.056', 'AMMO3': '0.058', 'HITCOUNT': '0.180', 'WEAPON5': '0.200', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.615', 'ARMOR': '0.800', 'weapon3': '1.058', 'weapon2': '1.322', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:46,356][2409075] DAMAGECOUNT value on done: 1992.0
[2023-02-25 12:51:46,356][2409075] Sum rewards: -0.273, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.206', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon5': '0.060', 'AMMO3': '0.069', 'weapon7': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.350', 'ARMOR': '0.412', 'WEAPON3': '0.500', 'weapon2': '0.872', 'DAMAGECOUNT': '0.894', 'weapon3': '0.934', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:51:46,509][2409077] DAMAGECOUNT value on done: 2823.0
[2023-02-25 12:51:46,510][2409077] Sum rewards: 6.139, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.162', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.015', 'weapon5': '0.032', 'WEAPON1': '0.040', 'weapon4': '0.040', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'HITCOUNT': '0.600', 'WEAPON3': '0.650', 'ARMOR': '1.301', 'weapon2': '1.484', 'weapon3': '1.672', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:51:46,521][2409405] DAMAGECOUNT value on done: 1488.0
[2023-02-25 12:51:46,522][2409405] Sum rewards: -0.401, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.650', 'weapon5': '0.006', 'AMMO5': '0.015', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.124', 'AMMO3': '0.125', 'weapon4': '0.162', 'HITCOUNT': '0.280', 'WEAPON5': '0.300', 'ARMOR': '0.448', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.930', 'weapon2': '1.342', 'weapon3': '1.912', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:46,608][2409104] DAMAGECOUNT value on done: 2194.0
[2023-02-25 12:51:46,609][2409104] Sum rewards: 3.751, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.355', 'AMMO5': '0.003', 'AMMO2': '0.013', 'AMMO3': '0.035', 'weapon5': '0.064', 'AMMO4': '0.065', 'WEAPON5': '0.100', 'weapon7': '0.114', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.250', 'HITCOUNT': '0.260', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.459', 'weapon3': '0.572', 'weapon4': '0.588', 'DAMAGECOUNT': '0.957', 'weapon2': '1.036', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:46,628][2409074] Updated weights for policy 0, policy_version 12131 (0.0013)
[2023-02-25 12:51:46,734][2409102] DAMAGECOUNT value on done: 1993.0
[2023-02-25 12:51:46,734][2409102] Sum rewards: 3.673, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.054', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'weapon7': '0.012', 'AMMO4': '0.030', 'AMMO3': '0.097', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.360', 'weapon4': '0.414', 'WEAPON3': '0.600', 'weapon2': '0.802', 'ARMOR': '0.944', 'DAMAGECOUNT': '1.338', 'weapon3': '1.614', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:46,991][2409078] DAMAGECOUNT value on done: 1689.0
[2023-02-25 12:51:46,994][2409078] Sum rewards: 1.763, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'HEALTH': '0.016', 'weapon7': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.052', 'AMMO3': '0.069', 'AMMO4': '0.071', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.168', 'HITCOUNT': '0.230', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.828', 'FRAGCOUNT': '1.000', 'weapon3': '1.134', 'weapon2': '1.372'}
[2023-02-25 12:51:47,171][2409103] DAMAGECOUNT value on done: 2089.0
[2023-02-25 12:51:47,175][2409103] Sum rewards: 4.973, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.438', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'AMMO3': '0.067', 'AMMO4': '0.073', 'weapon5': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.270', 'WEAPON3': '0.400', 'HITCOUNT': '0.440', 'weapon3': '1.074', 'weapon2': '1.524', 'DAMAGECOUNT': '1.668', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:47,186][2408954] Fps is (10 sec: 25395.3, 60 sec: 25668.3, 300 sec: 25547.9). Total num frames: 49700864. Throughput: 0: 6353.6. Samples: 12432228. Policy #0 lag: (min: 1.0, avg: 12.9, max: 25.0)
[2023-02-25 12:51:47,186][2408954] Avg episode reward: [(0, '2.321')]
[2023-02-25 12:51:47,241][2409486] DAMAGECOUNT value on done: 2016.0
[2023-02-25 12:51:47,409][2409866] DAMAGECOUNT value on done: 2462.0
[2023-02-25 12:51:47,413][2409866] Sum rewards: 6.114, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.406', 'AMMO5': '0.003', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'WEAPON4': '0.150', 'weapon4': '0.230', 'ARMOR': '0.436', 'WEAPON3': '0.550', 'HITCOUNT': '0.580', 'weapon3': '1.460', 'weapon2': '1.644', 'DAMAGECOUNT': '2.022', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:51:47,517][2409096] DAMAGECOUNT value on done: 2418.0
[2023-02-25 12:51:47,519][2409096] Sum rewards: 2.855, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.488', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.094', 'weapon4': '0.212', 'weapon5': '0.230', 'WEAPON5': '0.250', 'HITCOUNT': '0.260', 'ARMOR': '0.412', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.996', 'weapon3': '1.280', 'weapon2': '1.480', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:47,529][2409097] DAMAGECOUNT value on done: 2183.0
[2023-02-25 12:51:47,530][2409097] Sum rewards: 3.630, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.013', 'ARMOR': '0.016', 'WEAPON1': '0.030', 'AMMO2': '0.041', 'weapon5': '0.072', 'AMMO3': '0.081', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO4': '0.206', 'HITCOUNT': '0.250', 'HEALTH': '0.352', 'WEAPON3': '0.450', 'weapon4': '0.598', 'DAMAGECOUNT': '0.855', 'weapon2': '0.880', 'weapon3': '1.436', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:47,601][2409565] DAMAGECOUNT value on done: 1739.0
[2023-02-25 12:51:47,605][2409565] Sum rewards: 1.451, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.710', 'AMMO2': '0.004', 'weapon4': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'weapon5': '0.094', 'AMMO3': '0.119', 'WEAPON5': '0.250', 'HITCOUNT': '0.420', 'ARMOR': '0.808', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.383', 'weapon2': '1.642', 'weapon3': '1.886', 'FRAGCOUNT': '4.500'}
[2023-02-25 12:51:47,942][2409101] DAMAGECOUNT value on done: 2658.0
[2023-02-25 12:51:47,942][2409101] Sum rewards: -1.239, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.684', 'AMMO2': '0.011', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'weapon4': '0.104', 'weapon5': '0.136', 'AMMO3': '0.162', 'WEAPON5': '0.400', 'HITCOUNT': '0.560', 'ARMOR': '0.858', 'WEAPON3': '0.900', 'weapon2': '1.444', 'weapon3': '1.730', 'DAMAGECOUNT': '1.950', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:51:48,143][2409100] DAMAGECOUNT value on done: 1910.0
[2023-02-25 12:51:48,144][2409100] Sum rewards: 2.567, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.599', 'ARMOR': '0.012', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.102', 'AMMO4': '0.112', 'WEAPON5': '0.250', 'HITCOUNT': '0.280', 'WEAPON3': '0.400', 'DAMAGECOUNT': '1.179', 'weapon3': '1.334', 'weapon2': '1.780', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:48,291][2409105] DAMAGECOUNT value on done: 1503.0
[2023-02-25 12:51:48,291][2409105] Sum rewards: -1.989, reward structure: {'DEATHCOUNT': '-2.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.550', 'AMMO4': '-0.018', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'AMMO3': '0.037', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon5': '0.058', 'HITCOUNT': '0.060', 'weapon4': '0.066', 'DAMAGECOUNT': '0.144', 'WEAPON5': '0.150', 'WEAPON3': '0.300', 'weapon3': '0.598', 'weapon2': '0.824'}
[2023-02-25 12:51:48,305][2409074] Updated weights for policy 0, policy_version 12141 (0.0013)
[2023-02-25 12:51:48,356][2409355] DAMAGECOUNT value on done: 2985.0
[2023-02-25 12:51:48,357][2409355] Sum rewards: 5.445, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.448', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.145', 'weapon5': '0.154', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.666', 'HITCOUNT': '0.800', 'WEAPON3': '0.850', 'ARMOR': '0.872', 'weapon2': '1.210', 'weapon3': '1.386', 'DAMAGECOUNT': '3.357', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:51:48,406][2409485] DAMAGECOUNT value on done: 2161.0
[2023-02-25 12:51:48,408][2409485] Sum rewards: 3.506, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.100', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.007', 'weapon5': '0.040', 'AMMO3': '0.067', 'WEAPON4': '0.100', 'weapon7': '0.100', 'weapon4': '0.110', 'WEAPON5': '0.150', 'AMMO6': '0.280', 'AMMO7': '0.280', 'HITCOUNT': '0.360', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'ARMOR': '0.592', 'weapon2': '1.052', 'DAMAGECOUNT': '1.134', 'weapon3': '1.278', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:48,473][2409549] DAMAGECOUNT value on done: 3178.0
[2023-02-25 12:51:48,474][2409549] Sum rewards: 13.909, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.038', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO3': '0.107', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'weapon4': '0.180', 'weapon5': '0.230', 'WEAPON5': '0.250', 'ARMOR': '0.408', 'WEAPON3': '0.650', 'HITCOUNT': '0.950', 'weapon2': '1.214', 'weapon3': '1.702', 'DAMAGECOUNT': '4.443', 'FRAGCOUNT': '12.000'}
[2023-02-25 12:51:48,910][2409596] DAMAGECOUNT value on done: 2512.0
[2023-02-25 12:51:48,913][2409596] Sum rewards: 0.658, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.355', 'AMMO5': '0.009', 'AMMO2': '0.016', 'weapon5': '0.032', 'WEAPON1': '0.040', 'AMMO4': '0.078', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.210', 'HITCOUNT': '0.430', 'ARMOR': '0.455', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.500', 'weapon2': '1.542', 'DAMAGECOUNT': '1.566', 'weapon3': '1.798'}
[2023-02-25 12:51:49,125][2409469] DAMAGECOUNT value on done: 2662.0
[2023-02-25 12:51:49,127][2409469] Sum rewards: 6.227, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.882', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.030', 'AMMO3': '0.058', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'weapon5': '0.114', 'HITCOUNT': '0.180', 'WEAPON5': '0.200', 'weapon4': '0.216', 'WEAPON3': '0.400', 'ARMOR': '0.850', 'weapon3': '1.096', 'DAMAGECOUNT': '1.506', 'weapon2': '1.778', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:51:49,174][2409548] DAMAGECOUNT value on done: 2830.0
[2023-02-25 12:51:49,179][2409548] Sum rewards: 6.104, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.925', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'AMMO3': '0.020', 'ARMOR': '0.040', 'weapon5': '0.056', 'WEAPON5': '0.100', 'WEAPON3': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.360', 'HITCOUNT': '0.370', 'weapon3': '0.488', 'weapon2': '0.932', 'DAMAGECOUNT': '1.533', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:51:49,307][2409407] DAMAGECOUNT value on done: 2324.0
[2023-02-25 12:51:49,309][2409407] Sum rewards: 3.981, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.740', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.059', 'AMMO3': '0.081', 'weapon4': '0.102', 'weapon5': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'HITCOUNT': '0.350', 'ARMOR': '0.436', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.197', 'weapon3': '1.328', 'weapon2': '1.792', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:51:49,317][2409406] DAMAGECOUNT value on done: 2096.0
[2023-02-25 12:51:49,320][2409406] Sum rewards: 5.717, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.003', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'weapon4': '0.038', 'AMMO3': '0.040', 'AMMO4': '0.041', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'HITCOUNT': '0.150', 'weapon7': '0.158', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.250', 'HEALTH': '0.281', 'WEAPON7': '0.300', 'DAMAGECOUNT': '0.819', 'ARMOR': '0.885', 'weapon3': '0.914', 'weapon2': '1.232', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:49,377][2409076] DAMAGECOUNT value on done: 2252.0
[2023-02-25 12:51:49,380][2409076] Sum rewards: 0.478, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.222', 'AMMO5': '0.010', 'AMMO2': '0.015', 'ARMOR': '0.048', 'AMMO4': '0.072', 'WEAPON1': '0.080', 'AMMO3': '0.108', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.320', 'weapon4': '0.444', 'WEAPON3': '0.650', 'weapon2': '0.976', 'DAMAGECOUNT': '1.155', 'weapon3': '1.944', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:49,415][2409597] DAMAGECOUNT value on done: 2419.0
[2023-02-25 12:51:49,416][2409597] Sum rewards: 0.115, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.111', 'AMMO2': '0.007', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.035', 'weapon5': '0.060', 'AMMO3': '0.123', 'WEAPON5': '0.300', 'HITCOUNT': '0.510', 'WEAPON3': '0.800', 'ARMOR': '0.864', 'weapon2': '1.432', 'weapon3': '1.738', 'DAMAGECOUNT': '1.824', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:51:49,860][2409389] DAMAGECOUNT value on done: 2080.0
[2023-02-25 12:51:49,864][2409389] Sum rewards: 3.827, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.200', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'weapon5': '0.114', 'AMMO3': '0.130', 'AMMO4': '0.154', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.457', 'weapon4': '0.460', 'HITCOUNT': '0.510', 'WEAPON3': '0.900', 'weapon2': '1.440', 'weapon3': '1.628', 'DAMAGECOUNT': '2.175', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:51:50,021][2409373] DAMAGECOUNT value on done: 2189.0
[2023-02-25 12:51:50,022][2409373] Sum rewards: 3.985, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.180', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO3': '0.087', 'AMMO4': '0.088', 'weapon5': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.472', 'WEAPON3': '0.600', 'HITCOUNT': '0.700', 'ARMOR': '0.954', 'weapon2': '1.122', 'weapon3': '1.232', 'DAMAGECOUNT': '2.622', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:51:50,032][2409074] Updated weights for policy 0, policy_version 12151 (0.0012)
[2023-02-25 12:51:50,049][2409405] DAMAGECOUNT value on done: 2586.0
[2023-02-25 12:51:50,052][2409405] Sum rewards: -0.636, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.540', 'AMMO2': '0.012', 'AMMO5': '0.016', 'WEAPON1': '0.040', 'weapon4': '0.044', 'AMMO4': '0.058', 'weapon5': '0.064', 'AMMO3': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'HITCOUNT': '0.350', 'WEAPON3': '0.700', 'ARMOR': '0.857', 'DAMAGECOUNT': '1.227', 'weapon2': '1.500', 'weapon3': '1.748', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:50,068][2409077] DAMAGECOUNT value on done: 2061.0
[2023-02-25 12:51:50,069][2409077] Sum rewards: -1.532, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.350', 'AMMO5': '0.004', 'AMMO2': '0.018', 'weapon5': '0.034', 'WEAPON1': '0.040', 'weapon7': '0.062', 'AMMO4': '0.092', 'AMMO3': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.230', 'WEAPON4': '0.250', 'weapon4': '0.518', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.810', 'ARMOR': '0.965', 'FRAGCOUNT': '1.000', 'weapon3': '1.114', 'weapon2': '1.136'}
[2023-02-25 12:51:50,381][2409102] DAMAGECOUNT value on done: 1499.0
[2023-02-25 12:51:50,382][2409102] Sum rewards: 2.068, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.312', 'AMMO5': '0.013', 'AMMO2': '0.014', 'weapon7': '0.036', 'weapon5': '0.062', 'AMMO4': '0.071', 'AMMO3': '0.137', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.302', 'AMMO6': '0.360', 'AMMO7': '0.360', 'HITCOUNT': '0.370', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.750', 'weapon2': '1.240', 'DAMAGECOUNT': '1.611', 'weapon3': '1.754', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:50,512][2409078] DAMAGECOUNT value on done: 2823.0
[2023-02-25 12:51:50,515][2409078] Sum rewards: 5.676, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.455', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'weapon7': '0.050', 'weapon5': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.103', 'weapon4': '0.140', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.500', 'WEAPON3': '0.650', 'ARMOR': '0.862', 'weapon3': '1.542', 'weapon2': '1.704', 'DAMAGECOUNT': '1.920', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:51:50,657][2409075] DAMAGECOUNT value on done: 1661.0
[2023-02-25 12:51:50,658][2409075] Sum rewards: 2.477, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.306', 'AMMO5': '0.005', 'AMMO2': '0.036', 'AMMO3': '0.075', 'WEAPON5': '0.100', 'AMMO4': '0.179', 'WEAPON4': '0.200', 'ARMOR': '0.436', 'WEAPON3': '0.450', 'weapon4': '0.466', 'HITCOUNT': '0.650', 'weapon3': '0.868', 'weapon2': '1.338', 'DAMAGECOUNT': '1.980', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:50,824][2409103] DAMAGECOUNT value on done: 2245.0
[2023-02-25 12:51:50,825][2409103] Sum rewards: 2.287, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.190', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'ARMOR': '0.020', 'AMMO3': '0.036', 'WEAPON4': '0.200', 'WEAPON3': '0.300', 'HITCOUNT': '0.310', 'weapon4': '0.446', 'weapon3': '0.548', 'weapon2': '0.604', 'DAMAGECOUNT': '1.050', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:50,856][2409104] DAMAGECOUNT value on done: 1618.0
[2023-02-25 12:51:50,856][2409104] Sum rewards: -4.791, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.264', 'ARMOR': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'AMMO2': '0.033', 'AMMO3': '0.097', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'HITCOUNT': '0.280', 'WEAPON4': '0.400', 'weapon4': '0.482', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.897', 'FRAGCOUNT': '1.000', 'weapon2': '1.378', 'weapon3': '1.552'}
[2023-02-25 12:51:50,912][2409486] DAMAGECOUNT value on done: 2774.0
[2023-02-25 12:51:50,914][2409486] Sum rewards: 4.820, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.298', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.046', 'AMMO4': '0.074', 'AMMO3': '0.084', 'weapon7': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.360', 'HITCOUNT': '0.370', 'WEAPON3': '0.500', 'weapon3': '0.860', 'ARMOR': '0.926', 'DAMAGECOUNT': '1.146', 'weapon2': '1.394', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:51,096][2409866] DAMAGECOUNT value on done: 1151.0
[2023-02-25 12:51:51,097][2409866] Sum rewards: -0.615, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.300', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.032', 'ARMOR': '0.064', 'weapon5': '0.108', 'AMMO3': '0.127', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.270', 'weapon4': '0.532', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.792', 'weapon2': '0.896', 'weapon3': '1.784', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:51,101][2409096] DAMAGECOUNT value on done: 1887.0
[2023-02-25 12:51:51,102][2409096] Sum rewards: 3.472, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.965', 'AMMO2': '0.014', 'ARMOR': '0.036', 'AMMO3': '0.066', 'AMMO4': '0.069', 'weapon7': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'WEAPON3': '0.350', 'HITCOUNT': '0.380', 'weapon4': '0.544', 'weapon3': '0.894', 'weapon2': '0.934', 'DAMAGECOUNT': '1.524', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:51,216][2409074] Updated weights for policy 0, policy_version 12161 (0.0012)
[2023-02-25 12:51:51,398][2409565] DAMAGECOUNT value on done: 2453.0
[2023-02-25 12:51:51,399][2409565] Sum rewards: 3.335, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.120', 'AMMO5': '0.010', 'AMMO2': '0.029', 'WEAPON1': '0.050', 'AMMO3': '0.096', 'weapon5': '0.134', 'AMMO4': '0.142', 'WEAPON4': '0.200', 'weapon4': '0.278', 'WEAPON5': '0.300', 'HITCOUNT': '0.480', 'WEAPON3': '0.650', 'ARMOR': '0.885', 'weapon2': '0.990', 'weapon3': '1.988', 'DAMAGECOUNT': '2.223', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:51:51,577][2409097] DAMAGECOUNT value on done: 1817.0
[2023-02-25 12:51:51,578][2409097] Sum rewards: 4.501, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.214', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.064', 'weapon7': '0.064', 'AMMO3': '0.069', 'weapon5': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.310', 'WEAPON3': '0.500', 'weapon4': '0.654', 'weapon2': '1.062', 'weapon3': '1.140', 'ARMOR': '1.322', 'DAMAGECOUNT': '1.506', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:51,687][2409100] DAMAGECOUNT value on done: 2404.0
[2023-02-25 12:51:51,689][2409100] Sum rewards: 1.657, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.915', 'AMMO2': '0.001', 'AMMO4': '0.004', 'weapon5': '0.006', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'weapon4': '0.034', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.250', 'ARMOR': '0.455', 'HITCOUNT': '0.670', 'WEAPON3': '0.700', 'weapon2': '1.452', 'weapon3': '1.744', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.037'}
[2023-02-25 12:51:51,942][2409101] DAMAGECOUNT value on done: 2574.0
[2023-02-25 12:51:51,946][2409101] Sum rewards: 3.391, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.808', 'AMMO4': '-0.054', 'AMMO2': '-0.011', 'AMMO5': '0.013', 'AMMO3': '0.085', 'WEAPON1': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.116', 'HITCOUNT': '0.190', 'weapon5': '0.292', 'ARMOR': '0.453', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'weapon3': '1.254', 'weapon2': '1.564', 'DAMAGECOUNT': '1.947', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:52,060][2409355] DAMAGECOUNT value on done: 2345.0
[2023-02-25 12:51:52,061][2409355] Sum rewards: 1.932, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.308', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO3': '0.030', 'AMMO4': '0.072', 'weapon4': '0.088', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.250', 'HITCOUNT': '0.310', 'weapon3': '0.760', 'ARMOR': '0.837', 'DAMAGECOUNT': '1.212', 'weapon2': '2.000', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:52,128][2409105] DAMAGECOUNT value on done: 2270.0
[2023-02-25 12:51:52,130][2409105] Sum rewards: 3.377, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.726', 'AMMO2': '0.010', 'AMMO5': '0.025', 'WEAPON1': '0.040', 'AMMO4': '0.052', 'weapon5': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'weapon4': '0.188', 'ARMOR': '0.450', 'WEAPON5': '0.500', 'HITCOUNT': '0.690', 'WEAPON3': '0.950', 'weapon2': '1.038', 'weapon3': '2.276', 'DAMAGECOUNT': '2.682', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:51:52,154][2409079] DAMAGECOUNT value on done: 2029.0
[2023-02-25 12:51:52,157][2409079] Sum rewards: 0.325, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.874', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.025', 'weapon7': '0.068', 'AMMO3': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.123', 'WEAPON4': '0.350', 'HITCOUNT': '0.420', 'ARMOR': '0.536', 'WEAPON3': '0.550', 'weapon4': '0.762', 'weapon3': '1.230', 'weapon2': '1.246', 'DAMAGECOUNT': '1.638', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:52,163][2409485] DAMAGECOUNT value on done: 1963.0
[2023-02-25 12:51:52,163][2409485] Sum rewards: 3.814, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.520', 'AMMO2': '0.011', 'AMMO5': '0.012', 'ARMOR': '0.024', 'WEAPON1': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.077', 'weapon5': '0.124', 'WEAPON4': '0.150', 'weapon4': '0.160', 'WEAPON5': '0.250', 'HITCOUNT': '0.350', 'WEAPON3': '0.400', 'weapon3': '1.202', 'weapon2': '1.652', 'DAMAGECOUNT': '2.070', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:52,186][2408954] Fps is (10 sec: 25395.1, 60 sec: 25395.2, 300 sec: 25534.0). Total num frames: 49827840. Throughput: 0: 6350.8. Samples: 12451392. Policy #0 lag: (min: 1.0, avg: 12.9, max: 25.0)
[2023-02-25 12:51:52,186][2408954] Avg episode reward: [(0, '2.641')]
[2023-02-25 12:51:52,487][2409549] DAMAGECOUNT value on done: 2168.0
[2023-02-25 12:51:52,487][2409549] Sum rewards: 0.421, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.410', 'AMMO5': '0.012', 'AMMO2': '0.038', 'WEAPON1': '0.040', 'weapon5': '0.046', 'AMMO3': '0.090', 'AMMO4': '0.190', 'weapon4': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'HITCOUNT': '0.320', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.440', 'weapon2': '1.568', 'weapon3': '1.652', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:52,543][2409596] DAMAGECOUNT value on done: 1873.0
[2023-02-25 12:51:52,806][2409469] DAMAGECOUNT value on done: 2220.0
[2023-02-25 12:51:52,809][2409469] Sum rewards: 3.828, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.286', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon5': '0.056', 'AMMO3': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'HITCOUNT': '0.360', 'ARMOR': '0.440', 'WEAPON3': '0.450', 'weapon4': '0.564', 'weapon2': '0.774', 'weapon3': '1.438', 'DAMAGECOUNT': '1.542', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:52,887][2409548] DAMAGECOUNT value on done: 1944.0
[2023-02-25 12:51:52,888][2409548] Sum rewards: 1.935, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.062', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'ARMOR': '0.032', 'weapon5': '0.044', 'AMMO3': '0.055', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'HITCOUNT': '0.390', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.644', 'weapon3': '1.080', 'DAMAGECOUNT': '1.230', 'weapon2': '1.400', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:53,028][2409074] Updated weights for policy 0, policy_version 12171 (0.0013)
[2023-02-25 12:51:53,229][2409406] DAMAGECOUNT value on done: 2427.0
[2023-02-25 12:51:53,230][2409406] Sum rewards: 2.989, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.350', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.049', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'weapon5': '0.104', 'WEAPON4': '0.150', 'weapon4': '0.344', 'HITCOUNT': '0.370', 'ARMOR': '0.520', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.239', 'weapon2': '1.296', 'weapon3': '1.492', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:53,446][2409597] DAMAGECOUNT value on done: 1379.0
[2023-02-25 12:51:53,447][2409597] Sum rewards: -0.305, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.512', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon5': '0.050', 'weapon7': '0.086', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.250', 'WEAPON4': '0.450', 'WEAPON3': '0.550', 'weapon4': '0.684', 'DAMAGECOUNT': '0.735', 'weapon3': '1.060', 'weapon2': '1.064', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:53,606][2409407] DAMAGECOUNT value on done: 2789.0
[2023-02-25 12:51:53,609][2409407] Sum rewards: 6.408, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.774', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.028', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.062', 'weapon5': '0.080', 'weapon4': '0.194', 'WEAPON5': '0.350', 'HITCOUNT': '0.380', 'ARMOR': '0.451', 'WEAPON3': '0.500', 'weapon3': '1.470', 'weapon2': '1.570', 'DAMAGECOUNT': '2.226', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:51:53,834][2409389] DAMAGECOUNT value on done: 2391.0
[2023-02-25 12:51:53,837][2409389] Sum rewards: 4.205, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.480', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO3': '0.074', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.378', 'WEAPON3': '0.500', 'HITCOUNT': '0.520', 'weapon3': '1.214', 'weapon2': '1.270', 'DAMAGECOUNT': '1.596', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:53,927][2409076] DAMAGECOUNT value on done: 1935.0
[2023-02-25 12:51:53,928][2409076] Sum rewards: -1.833, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.122', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon4': '0.046', 'weapon5': '0.048', 'HITCOUNT': '0.090', 'AMMO3': '0.118', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.219', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.376', 'ARMOR': '1.813', 'weapon2': '2.206'}
[2023-02-25 12:51:53,963][2409405] DAMAGECOUNT value on done: 3082.0
[2023-02-25 12:51:53,966][2409405] Sum rewards: 8.306, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.430', 'AMMO5': '0.015', 'AMMO2': '0.029', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'weapon5': '0.060', 'AMMO3': '0.098', 'AMMO4': '0.144', 'weapon4': '0.230', 'WEAPON5': '0.300', 'ARMOR': '0.464', 'WEAPON3': '0.600', 'HITCOUNT': '0.680', 'weapon2': '1.646', 'weapon3': '1.656', 'DAMAGECOUNT': '3.204', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:51:54,018][2409077] DAMAGECOUNT value on done: 1495.0
[2023-02-25 12:51:54,018][2409102] DAMAGECOUNT value on done: 2742.0
[2023-02-25 12:51:54,019][2409102] Sum rewards: 4.942, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.304', 'AMMO5': '0.003', 'AMMO2': '0.037', 'weapon5': '0.062', 'AMMO3': '0.076', 'weapon7': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.186', 'WEAPON4': '0.400', 'ARMOR': '0.436', 'HITCOUNT': '0.440', 'WEAPON3': '0.500', 'weapon2': '0.774', 'weapon4': '1.148', 'weapon3': '1.196', 'DAMAGECOUNT': '1.506', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:54,019][2409077] Sum rewards: -0.230, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.268', 'AMMO2': '0.008', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.039', 'weapon5': '0.040', 'AMMO3': '0.127', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'HITCOUNT': '0.430', 'weapon4': '0.544', 'ARMOR': '0.573', 'weapon2': '0.668', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.443', 'weapon3': '1.626', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:54,458][2409078] DAMAGECOUNT value on done: 2068.0
[2023-02-25 12:51:54,461][2409078] Sum rewards: 7.671, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.060', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.040', 'weapon5': '0.082', 'AMMO3': '0.087', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.202', 'weapon4': '0.244', 'HITCOUNT': '0.440', 'WEAPON3': '0.450', 'ARMOR': '0.940', 'weapon3': '0.968', 'DAMAGECOUNT': '1.653', 'weapon2': '2.308', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:51:54,468][2409373] DAMAGECOUNT value on done: 1974.0
[2023-02-25 12:51:54,472][2409373] Sum rewards: 8.686, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.552', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'AMMO3': '0.040', 'weapon5': '0.112', 'WEAPON5': '0.150', 'WEAPON3': '0.300', 'HITCOUNT': '0.300', 'ARMOR': '0.451', 'weapon3': '0.902', 'DAMAGECOUNT': '1.791', 'weapon2': '2.162', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:51:54,551][2409486] DAMAGECOUNT value on done: 1902.0
[2023-02-25 12:51:54,552][2409103] DAMAGECOUNT value on done: 2947.0
[2023-02-25 12:51:54,554][2409486] Sum rewards: 4.273, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.622', 'AMMO5': '0.015', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'AMMO3': '0.071', 'AMMO4': '0.099', 'weapon5': '0.100', 'WEAPON4': '0.200', 'HITCOUNT': '0.280', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'ARMOR': '0.492', 'weapon4': '0.648', 'weapon2': '1.002', 'weapon3': '1.062', 'DAMAGECOUNT': '2.076', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:54,555][2409103] Sum rewards: 3.299, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.100', 'AMMO5': '0.020', 'AMMO2': '0.039', 'weapon5': '0.044', 'WEAPON1': '0.060', 'AMMO3': '0.109', 'AMMO4': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'HITCOUNT': '0.520', 'weapon4': '0.560', 'WEAPON3': '0.800', 'ARMOR': '0.846', 'weapon2': '1.112', 'weapon3': '1.860', 'DAMAGECOUNT': '1.884', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:54,608][2409104] DAMAGECOUNT value on done: 1873.0
[2023-02-25 12:51:54,608][2409104] Sum rewards: -0.339, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.110', 'AMMO2': '0.013', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.064', 'AMMO3': '0.121', 'weapon5': '0.142', 'HITCOUNT': '0.250', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.795', 'ARMOR': '0.835', 'FRAGCOUNT': '1.500', 'weapon2': '1.588', 'weapon3': '1.774'}
[2023-02-25 12:51:54,611][2409075] DAMAGECOUNT value on done: 1696.0
[2023-02-25 12:51:54,612][2409075] Sum rewards: 3.278, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.356', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO3': '0.030', 'AMMO4': '0.066', 'weapon7': '0.066', 'weapon5': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.190', 'WEAPON3': '0.200', 'weapon4': '0.434', 'weapon3': '0.678', 'weapon2': '0.698', 'ARMOR': '0.935', 'DAMAGECOUNT': '1.398', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:54,621][2409033] Signal inference workers to stop experience collection... (1500 times)
[2023-02-25 12:51:54,633][2409033] Signal inference workers to resume experience collection... (1500 times)
[2023-02-25 12:51:54,658][2409074] InferenceWorker_p0-w0: stopping experience collection (1500 times)
[2023-02-25 12:51:54,661][2409074] InferenceWorker_p0-w0: resuming experience collection (1500 times)
[2023-02-25 12:51:54,691][2409074] Updated weights for policy 0, policy_version 12181 (0.0012)
[2023-02-25 12:51:54,798][2409096] DAMAGECOUNT value on done: 1956.0
[2023-02-25 12:51:54,801][2409096] Sum rewards: 2.397, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'weapon5': '0.040', 'AMMO3': '0.042', 'HEALTH': '0.042', 'AMMO4': '0.054', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.210', 'WEAPON3': '0.250', 'weapon4': '0.272', 'ARMOR': '0.540', 'weapon3': '0.836', 'weapon2': '1.028', 'DAMAGECOUNT': '1.107', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:54,806][2409866] DAMAGECOUNT value on done: 2046.0
[2023-02-25 12:51:54,806][2409866] Sum rewards: 3.603, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.180', 'AMMO2': '0.009', 'ARMOR': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon4': '0.102', 'WEAPON3': '0.350', 'HITCOUNT': '0.360', 'weapon3': '0.996', 'DAMAGECOUNT': '1.161', 'weapon2': '2.110', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:55,177][2409565] DAMAGECOUNT value on done: 3154.0
[2023-02-25 12:51:55,178][2409565] Sum rewards: 4.073, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.803', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.058', 'weapon5': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'HITCOUNT': '0.360', 'weapon4': '0.384', 'WEAPON3': '0.450', 'ARMOR': '0.854', 'weapon3': '1.044', 'weapon2': '1.952', 'DAMAGECOUNT': '2.148', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:55,307][2409100] DAMAGECOUNT value on done: 2137.0
[2023-02-25 12:51:55,311][2409100] Sum rewards: 5.987, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.138', 'AMMO4': '-0.091', 'AMMO2': '-0.018', 'AMMO3': '0.050', 'weapon7': '0.052', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'HITCOUNT': '0.470', 'ARMOR': '0.864', 'weapon3': '0.932', 'weapon2': '1.696', 'DAMAGECOUNT': '1.830', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:51:55,598][2409101] DAMAGECOUNT value on done: 2075.0
[2023-02-25 12:51:55,599][2409101] Sum rewards: 0.887, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.412', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.009', 'WEAPON1': '0.040', 'AMMO4': '0.044', 'weapon5': '0.068', 'AMMO3': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.336', 'HITCOUNT': '0.480', 'WEAPON3': '0.600', 'weapon3': '1.100', 'DAMAGECOUNT': '1.431', 'weapon2': '1.746', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:55,757][2409355] DAMAGECOUNT value on done: 2167.0
[2023-02-25 12:51:55,758][2409355] Sum rewards: 0.319, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.042', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.036', 'AMMO3': '0.045', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'weapon4': '0.268', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.603', 'weapon3': '0.634', 'weapon2': '0.928', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:51:55,774][2409485] DAMAGECOUNT value on done: 2208.0
[2023-02-25 12:51:55,775][2409485] Sum rewards: 3.717, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.883', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'weapon5': '0.074', 'AMMO3': '0.087', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.348', 'HITCOUNT': '0.580', 'WEAPON3': '0.700', 'weapon2': '1.344', 'DAMAGECOUNT': '1.812', 'weapon3': '1.872', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:51:55,947][2409097] DAMAGECOUNT value on done: 2716.0
[2023-02-25 12:51:55,951][2409097] Sum rewards: 2.295, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.515', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.032', 'AMMO3': '0.063', 'weapon5': '0.080', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'weapon4': '0.472', 'ARMOR': '0.491', 'HITCOUNT': '0.550', 'weapon3': '0.900', 'weapon2': '1.226', 'DAMAGECOUNT': '2.082', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:56,111][2409549] DAMAGECOUNT value on done: 2535.0
[2023-02-25 12:51:56,114][2409549] Sum rewards: 4.900, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'weapon7': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.032', 'AMMO3': '0.070', 'weapon5': '0.098', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'HEALTH': '0.136', 'WEAPON4': '0.150', 'AMMO4': '0.160', 'weapon4': '0.316', 'HITCOUNT': '0.330', 'WEAPON3': '0.400', 'ARMOR': '0.808', 'weapon3': '1.204', 'weapon2': '1.316', 'DAMAGECOUNT': '1.455', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:56,239][2409074] Updated weights for policy 0, policy_version 12191 (0.0012)
[2023-02-25 12:51:56,262][2409079] DAMAGECOUNT value on done: 1948.0
[2023-02-25 12:51:56,263][2409079] Sum rewards: 7.927, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.089', 'weapon4': '0.132', 'HEALTH': '0.148', 'WEAPON5': '0.150', 'weapon5': '0.154', 'WEAPON3': '0.550', 'HITCOUNT': '0.600', 'ARMOR': '0.944', 'weapon3': '1.268', 'weapon2': '1.776', 'DAMAGECOUNT': '2.478', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:51:56,285][2409596] DAMAGECOUNT value on done: 1729.0
[2023-02-25 12:51:56,287][2409596] Sum rewards: -1.089, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.826', 'AMMO5': '0.010', 'AMMO2': '0.035', 'ARMOR': '0.036', 'WEAPON1': '0.040', 'weapon5': '0.052', 'AMMO3': '0.090', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.370', 'weapon4': '0.514', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.173', 'weapon2': '1.202', 'weapon3': '1.892', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:56,301][2409105] DAMAGECOUNT value on done: 2095.0
[2023-02-25 12:51:56,302][2409105] Sum rewards: 1.581, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.016', 'AMMO2': '0.021', 'HEALTH': '0.055', 'AMMO4': '0.106', 'AMMO3': '0.115', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.340', 'HITCOUNT': '0.530', 'WEAPON3': '0.550', 'ARMOR': '0.851', 'weapon2': '1.338', 'weapon3': '1.550', 'DAMAGECOUNT': '1.941', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:51:56,460][2409469] DAMAGECOUNT value on done: 2044.0
[2023-02-25 12:51:56,460][2409469] Sum rewards: 1.906, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.868', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON1': '0.040', 'weapon5': '0.048', 'AMMO4': '0.062', 'AMMO3': '0.067', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.250', 'HITCOUNT': '0.300', 'WEAPON3': '0.400', 'ARMOR': '0.460', 'weapon3': '0.956', 'DAMAGECOUNT': '1.128', 'weapon2': '1.548', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:56,571][2409548] DAMAGECOUNT value on done: 2003.0
[2023-02-25 12:51:56,572][2409548] Sum rewards: 0.572, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.228', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'AMMO4': '0.068', 'AMMO3': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.418', 'ARMOR': '0.463', 'HITCOUNT': '0.470', 'WEAPON3': '0.500', 'weapon2': '1.238', 'weapon3': '1.358', 'DAMAGECOUNT': '1.560', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:57,186][2408954] Fps is (10 sec: 24985.6, 60 sec: 25326.9, 300 sec: 25521.0). Total num frames: 49950720. Throughput: 0: 6337.1. Samples: 12489228. Policy #0 lag: (min: 2.0, avg: 14.2, max: 28.0)
[2023-02-25 12:51:57,186][2408954] Avg episode reward: [(0, '2.721')]
[2023-02-25 12:51:57,199][2409033] Saving new best policy, reward=2.721!
[2023-02-25 12:51:57,378][2409406] DAMAGECOUNT value on done: 1595.0
[2023-02-25 12:51:57,381][2409406] Sum rewards: 2.807, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.060', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'AMMO4': '0.083', 'ARMOR': '0.084', 'WEAPON4': '0.100', 'weapon4': '0.252', 'WEAPON3': '0.300', 'HITCOUNT': '0.400', 'weapon3': '1.054', 'DAMAGECOUNT': '1.311', 'weapon2': '1.446', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:57,417][2409597] DAMAGECOUNT value on done: 2606.0
[2023-02-25 12:51:57,418][2409597] Sum rewards: 4.671, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.860', 'AMMO2': '0.004', 'AMMO5': '0.015', 'AMMO4': '0.020', 'WEAPON1': '0.060', 'AMMO3': '0.070', 'weapon5': '0.230', 'HITCOUNT': '0.380', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon2': '0.856', 'weapon3': '1.632', 'DAMAGECOUNT': '1.764', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:57,548][2409407] DAMAGECOUNT value on done: 2087.0
[2023-02-25 12:51:57,550][2409407] Sum rewards: 2.819, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.194', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.044', 'AMMO3': '0.063', 'AMMO4': '0.129', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.440', 'weapon4': '0.734', 'weapon3': '0.898', 'ARMOR': '0.914', 'weapon2': '1.004', 'DAMAGECOUNT': '1.353', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:51:57,602][2409405] DAMAGECOUNT value on done: 2404.0
[2023-02-25 12:51:57,606][2409405] Sum rewards: 4.924, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.532', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'AMMO3': '0.030', 'weapon5': '0.108', 'WEAPON5': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.250', 'ARMOR': '0.494', 'weapon3': '0.712', 'weapon2': '1.324', 'DAMAGECOUNT': '1.383', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:57,698][2409389] DAMAGECOUNT value on done: 2207.0
[2023-02-25 12:51:57,701][2409389] Sum rewards: 2.949, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.077', 'AMMO4': '-0.048', 'AMMO2': '-0.010', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon7': '0.056', 'weapon5': '0.060', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.131', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.214', 'HITCOUNT': '0.490', 'WEAPON3': '0.950', 'weapon2': '1.444', 'weapon3': '1.844', 'DAMAGECOUNT': '2.127', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:51:57,781][2409102] DAMAGECOUNT value on done: 2013.0
[2023-02-25 12:51:57,785][2409102] Sum rewards: 2.972, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.378', 'AMMO5': '0.017', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.034', 'AMMO3': '0.074', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'weapon4': '0.246', 'WEAPON5': '0.250', 'HITCOUNT': '0.410', 'WEAPON3': '0.450', 'ARMOR': '0.453', 'weapon3': '1.106', 'DAMAGECOUNT': '1.464', 'weapon2': '1.618', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:57,789][2409076] DAMAGECOUNT value on done: 2235.0
[2023-02-25 12:51:57,790][2409076] Sum rewards: 11.848, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.194', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'weapon4': '0.222', 'weapon5': '0.244', 'WEAPON3': '0.300', 'HITCOUNT': '0.390', 'weapon2': '0.740', 'ARMOR': '0.895', 'weapon3': '0.986', 'DAMAGECOUNT': '2.520', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:51:58,047][2409074] Updated weights for policy 0, policy_version 12201 (0.0012)
[2023-02-25 12:51:58,108][2409078] DAMAGECOUNT value on done: 2304.0
[2023-02-25 12:51:58,109][2409078] Sum rewards: 1.353, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.462', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.026', 'weapon7': '0.062', 'weapon5': '0.064', 'AMMO3': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.340', 'WEAPON4': '0.350', 'ARMOR': '0.412', 'WEAPON3': '0.500', 'weapon4': '0.556', 'weapon3': '0.718', 'weapon2': '1.594', 'DAMAGECOUNT': '1.962', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:51:58,238][2409077] DAMAGECOUNT value on done: 2127.0
[2023-02-25 12:51:58,241][2409077] Sum rewards: 0.878, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.888', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'weapon5': '0.022', 'AMMO2': '0.031', 'weapon4': '0.036', 'AMMO3': '0.114', 'AMMO4': '0.157', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.290', 'WEAPON3': '0.650', 'ARMOR': '0.880', 'DAMAGECOUNT': '1.068', 'weapon2': '1.718', 'weapon3': '1.880', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:58,301][2409104] DAMAGECOUNT value on done: 1373.0
[2023-02-25 12:51:58,302][2409104] Sum rewards: -0.138, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.590', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.044', 'weapon5': '0.074', 'weapon7': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.128', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.300', 'weapon4': '0.456', 'WEAPON3': '0.750', 'weapon2': '1.004', 'DAMAGECOUNT': '1.359', 'weapon3': '1.374', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:58,355][2409486] DAMAGECOUNT value on done: 1536.0
[2023-02-25 12:51:58,359][2409486] Sum rewards: 0.642, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.640', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.066', 'AMMO3': '0.090', 'AMMO4': '0.097', 'WEAPON5': '0.150', 'weapon4': '0.168', 'WEAPON4': '0.200', 'HITCOUNT': '0.450', 'ARMOR': '0.455', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.497', 'weapon3': '1.522', 'weapon2': '1.540', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:58,364][2409373] DAMAGECOUNT value on done: 2228.0
[2023-02-25 12:51:58,368][2409373] Sum rewards: 1.489, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.450', 'AMMO5': '0.007', 'AMMO2': '0.018', 'ARMOR': '0.028', 'WEAPON1': '0.040', 'AMMO3': '0.077', 'AMMO4': '0.088', 'weapon5': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.252', 'HITCOUNT': '0.350', 'WEAPON3': '0.500', 'weapon2': '1.386', 'FRAGCOUNT': '1.500', 'weapon3': '1.516', 'DAMAGECOUNT': '1.536'}
[2023-02-25 12:51:58,371][2409075] DAMAGECOUNT value on done: 1548.0
[2023-02-25 12:51:58,372][2409075] Sum rewards: -2.074, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.804', 'AMMO2': '0.010', 'AMMO5': '0.014', 'AMMO4': '0.049', 'AMMO3': '0.086', 'weapon5': '0.124', 'weapon4': '0.128', 'HITCOUNT': '0.170', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.600', 'weapon3': '0.894', 'DAMAGECOUNT': '0.996', 'ARMOR': '1.346', 'FRAGCOUNT': '2.000', 'weapon2': '2.012'}
[2023-02-25 12:51:58,618][2409096] DAMAGECOUNT value on done: 1302.0
[2023-02-25 12:51:58,622][2409096] Sum rewards: -0.180, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.765', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'ARMOR': '0.020', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.065', 'weapon4': '0.112', 'HITCOUNT': '0.160', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.570', 'weapon3': '0.716', 'FRAGCOUNT': '1.000', 'weapon2': '1.328'}
[2023-02-25 12:51:58,727][2409103] DAMAGECOUNT value on done: 2590.0
[2023-02-25 12:51:58,730][2409103] Sum rewards: 0.823, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.244', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.034', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'HITCOUNT': '0.260', 'weapon4': '0.262', 'ARMOR': '0.482', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.819', 'weapon2': '0.884', 'weapon3': '1.496', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:58,822][2409866] DAMAGECOUNT value on done: 2518.0
[2023-02-25 12:51:58,822][2409866] Sum rewards: 4.634, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.683', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'weapon4': '0.042', 'AMMO3': '0.062', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'weapon5': '0.138', 'WEAPON5': '0.150', 'HITCOUNT': '0.410', 'WEAPON3': '0.450', 'weapon3': '1.290', 'weapon2': '1.338', 'DAMAGECOUNT': '1.731', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:51:59,014][2409565] DAMAGECOUNT value on done: 2187.0
[2023-02-25 12:51:59,015][2409565] Sum rewards: 3.304, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.748', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.029', 'weapon7': '0.088', 'weapon5': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.113', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.350', 'HITCOUNT': '0.420', 'weapon4': '0.714', 'WEAPON3': '0.750', 'ARMOR': '0.900', 'DAMAGECOUNT': '1.902', 'weapon3': '1.934', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:51:59,371][2409100] DAMAGECOUNT value on done: 1706.0
[2023-02-25 12:51:59,372][2409100] Sum rewards: -0.411, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.054', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'ARMOR': '0.065', 'weapon5': '0.088', 'AMMO3': '0.094', 'AMMO4': '0.138', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.310', 'weapon4': '0.646', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.990', 'weapon2': '1.136', 'weapon3': '1.480', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:51:59,651][2409101] DAMAGECOUNT value on done: 1884.0
[2023-02-25 12:51:59,740][2409074] Updated weights for policy 0, policy_version 12211 (0.0012)
[2023-02-25 12:51:59,795][2409355] DAMAGECOUNT value on done: 2139.0
[2023-02-25 12:51:59,795][2409355] Sum rewards: 7.335, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.182', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO3': '0.060', 'weapon5': '0.060', 'AMMO4': '0.068', 'weapon7': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.242', 'WEAPON3': '0.400', 'HITCOUNT': '0.420', 'weapon2': '1.450', 'weapon3': '1.474', 'DAMAGECOUNT': '1.830', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:51:59,914][2409105] DAMAGECOUNT value on done: 2587.0
[2023-02-25 12:51:59,916][2409105] Sum rewards: 3.099, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.434', 'AMMO2': '0.011', 'weapon4': '0.032', 'WEAPON1': '0.040', 'AMMO4': '0.054', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'ARMOR': '0.400', 'HITCOUNT': '0.490', 'WEAPON3': '0.700', 'weapon3': '1.536', 'DAMAGECOUNT': '1.785', 'weapon2': '1.792', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:51:59,957][2409485] DAMAGECOUNT value on done: 2389.0
[2023-02-25 12:51:59,958][2409485] Sum rewards: 5.870, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.882', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO2': '0.028', 'ARMOR': '0.028', 'WEAPON1': '0.040', 'AMMO3': '0.136', 'AMMO4': '0.138', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.366', 'HITCOUNT': '0.720', 'WEAPON3': '0.900', 'weapon2': '0.930', 'weapon3': '2.238', 'DAMAGECOUNT': '2.502', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:52:00,061][2409596] DAMAGECOUNT value on done: 2233.0
[2023-02-25 12:52:00,062][2409596] Sum rewards: 6.285, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.074', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'ARMOR': '0.032', 'AMMO3': '0.040', 'WEAPON5': '0.050', 'weapon7': '0.070', 'weapon5': '0.094', 'AMMO4': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.250', 'HITCOUNT': '0.370', 'weapon4': '0.704', 'weapon3': '0.918', 'weapon2': '1.024', 'DAMAGECOUNT': '1.725', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:00,154][2409549] DAMAGECOUNT value on done: 2118.0
[2023-02-25 12:52:00,155][2409549] Sum rewards: 0.396, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.322', 'weapon5': '0.002', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.044', 'AMMO3': '0.124', 'WEAPON5': '0.200', 'AMMO4': '0.220', 'HITCOUNT': '0.480', 'WEAPON4': '0.500', 'WEAPON3': '0.750', 'weapon4': '0.832', 'ARMOR': '0.932', 'weapon2': '1.176', 'DAMAGECOUNT': '1.545', 'weapon3': '1.642', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:00,180][2409079] DAMAGECOUNT value on done: 2809.0
[2023-02-25 12:52:00,181][2409079] Sum rewards: 2.254, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.094', 'weapon4': '0.006', 'AMMO2': '0.009', 'AMMO5': '0.014', 'weapon5': '0.032', 'AMMO4': '0.043', 'AMMO3': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.680', 'weapon3': '1.630', 'weapon2': '1.768', 'DAMAGECOUNT': '2.244', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:00,280][2409097] DAMAGECOUNT value on done: 1545.0
[2023-02-25 12:52:00,281][2409097] Sum rewards: 5.470, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.206', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'ARMOR': '0.020', 'weapon4': '0.032', 'AMMO3': '0.064', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'weapon5': '0.116', 'WEAPON5': '0.250', 'HITCOUNT': '0.400', 'WEAPON3': '0.450', 'weapon3': '1.368', 'DAMAGECOUNT': '1.383', 'weapon2': '1.640', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:00,361][2409469] DAMAGECOUNT value on done: 2920.0
[2023-02-25 12:52:00,364][2409469] Sum rewards: 1.371, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.122', 'weapon7': '0.004', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'weapon5': '0.116', 'AMMO4': '0.175', 'WEAPON5': '0.300', 'HITCOUNT': '0.360', 'weapon4': '0.362', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.290', 'weapon3': '1.490', 'DAMAGECOUNT': '1.764', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:00,651][2409548] DAMAGECOUNT value on done: 1923.0
[2023-02-25 12:52:00,654][2409548] Sum rewards: 3.671, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.598', 'AMMO5': '0.003', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.039', 'AMMO3': '0.040', 'weapon7': '0.068', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.250', 'weapon4': '0.494', 'DAMAGECOUNT': '0.867', 'weapon3': '0.922', 'ARMOR': '1.361', 'weapon2': '1.432', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:00,977][2409597] DAMAGECOUNT value on done: 2205.0
[2023-02-25 12:52:00,980][2409597] Sum rewards: 3.158, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.992', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.029', 'AMMO3': '0.057', 'weapon5': '0.064', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'WEAPON3': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.562', 'HITCOUNT': '0.650', 'weapon3': '0.878', 'ARMOR': '1.335', 'weapon2': '1.940', 'DAMAGECOUNT': '2.322', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:01,231][2409405] DAMAGECOUNT value on done: 2995.0
[2023-02-25 12:52:01,234][2409405] Sum rewards: 8.895, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.122', 'AMMO2': '0.018', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'weapon4': '0.062', 'AMMO3': '0.072', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.290', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.650', 'ARMOR': '0.950', 'weapon3': '1.508', 'weapon2': '1.722', 'DAMAGECOUNT': '3.297', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:52:01,252][2409406] DAMAGECOUNT value on done: 1599.0
[2023-02-25 12:52:01,256][2409406] Sum rewards: -0.577, reward structure: {'FRAGCOUNT': '-1.500', 'DEATHCOUNT': '-1.500', 'HEALTH': '-0.280', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.003', 'HITCOUNT': '0.010', 'DAMAGECOUNT': '0.012', 'AMMO3': '0.020', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.060', 'WEAPON3': '0.150', 'ARMOR': '0.500', 'weapon3': '0.546', 'weapon2': '1.322'}
[2023-02-25 12:52:01,381][2409074] Updated weights for policy 0, policy_version 12221 (0.0012)
[2023-02-25 12:52:01,420][2409076] DAMAGECOUNT value on done: 2490.0
[2023-02-25 12:52:01,421][2409076] Sum rewards: 0.062, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'ARMOR': '0.066', 'AMMO4': '0.107', 'AMMO3': '0.108', 'weapon5': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.210', 'weapon4': '0.492', 'WEAPON3': '0.550', 'HEALTH': '0.571', 'DAMAGECOUNT': '0.960', 'weapon2': '1.152', 'weapon3': '1.560', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:01,460][2409407] DAMAGECOUNT value on done: 2453.0
[2023-02-25 12:52:01,460][2409407] Sum rewards: 6.795, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.358', 'AMMO5': '0.011', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.074', 'AMMO3': '0.095', 'WEAPON4': '0.200', 'weapon5': '0.202', 'WEAPON5': '0.250', 'weapon4': '0.264', 'HITCOUNT': '0.420', 'WEAPON3': '0.650', 'ARMOR': '0.824', 'weapon2': '1.452', 'DAMAGECOUNT': '1.692', 'weapon3': '1.724', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:52:01,605][2409389] DAMAGECOUNT value on done: 2040.0
[2023-02-25 12:52:01,608][2409389] Sum rewards: 1.755, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.070', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.012', 'WEAPON1': '0.060', 'AMMO3': '0.076', 'weapon5': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.300', 'weapon4': '0.466', 'ARMOR': '0.469', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.002', 'weapon3': '1.348', 'weapon2': '1.748', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:01,817][2409102] DAMAGECOUNT value on done: 2793.0
[2023-02-25 12:52:01,819][2409102] Sum rewards: -0.414, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.760', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.050', 'AMMO4': '0.085', 'AMMO3': '0.086', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'HITCOUNT': '0.360', 'weapon4': '0.364', 'ARMOR': '0.437', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.077', 'weapon3': '1.176', 'weapon2': '1.216'}
[2023-02-25 12:52:01,834][2409078] DAMAGECOUNT value on done: 1820.0
[2023-02-25 12:52:01,838][2409078] Sum rewards: 4.922, reward structure: {'DEATHCOUNT': '-1.500', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO3': '0.030', 'AMMO4': '0.050', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon5': '0.110', 'weapon4': '0.128', 'WEAPON3': '0.200', 'HITCOUNT': '0.220', 'HEALTH': '0.405', 'weapon3': '0.702', 'DAMAGECOUNT': '1.104', 'weapon2': '1.298', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:02,068][2409486] DAMAGECOUNT value on done: 1641.0
[2023-02-25 12:52:02,069][2409486] Sum rewards: 0.037, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.954', 'AMMO4': '-0.055', 'AMMO2': '-0.011', 'AMMO5': '0.007', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'weapon5': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.212', 'HITCOUNT': '0.290', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.966', 'weapon3': '1.044', 'weapon2': '1.922', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:02,081][2409077] DAMAGECOUNT value on done: 3080.0
[2023-02-25 12:52:02,084][2409077] Sum rewards: 3.860, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.508', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.078', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.113', 'ARMOR': '0.400', 'HITCOUNT': '0.620', 'WEAPON3': '0.700', 'weapon2': '1.396', 'weapon3': '2.118', 'DAMAGECOUNT': '2.385', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:52:02,132][2409373] DAMAGECOUNT value on done: 2655.0
[2023-02-25 12:52:02,134][2409373] Sum rewards: 5.403, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.656', 'AMMO5': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'AMMO4': '0.086', 'weapon5': '0.112', 'AMMO3': '0.137', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.346', 'ARMOR': '0.436', 'HITCOUNT': '0.460', 'WEAPON3': '0.900', 'weapon2': '1.138', 'weapon3': '1.604', 'DAMAGECOUNT': '1.770', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:52:02,186][2408954] Fps is (10 sec: 24985.3, 60 sec: 25463.4, 300 sec: 25548.0). Total num frames: 50077696. Throughput: 0: 6339.7. Samples: 12527316. Policy #0 lag: (min: 0.0, avg: 11.5, max: 26.0)
[2023-02-25 12:52:02,186][2408954] Avg episode reward: [(0, '2.825')]
[2023-02-25 12:52:02,187][2409033] Saving new best policy, reward=2.825!
[2023-02-25 12:52:02,276][2409075] DAMAGECOUNT value on done: 1784.0
[2023-02-25 12:52:02,279][2409075] Sum rewards: -5.113, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.262', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.034', 'AMMO3': '0.104', 'AMMO4': '0.169', 'weapon5': '0.202', 'WEAPON5': '0.250', 'HITCOUNT': '0.270', 'WEAPON4': '0.450', 'weapon4': '0.552', 'WEAPON3': '0.600', 'ARMOR': '0.940', 'DAMAGECOUNT': '0.996', 'weapon2': '1.386', 'weapon3': '1.404'}
[2023-02-25 12:52:02,420][2409866] DAMAGECOUNT value on done: 2379.0
[2023-02-25 12:52:02,421][2409104] DAMAGECOUNT value on done: 2512.0
[2023-02-25 12:52:02,423][2409866] Sum rewards: 8.408, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.244', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'weapon7': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon5': '0.104', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'weapon4': '0.378', 'HITCOUNT': '0.540', 'WEAPON3': '0.600', 'ARMOR': '1.300', 'weapon3': '1.452', 'weapon2': '1.468', 'DAMAGECOUNT': '2.415', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:52:02,426][2409104] Sum rewards: 3.731, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.900', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.091', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'weapon4': '0.338', 'ARMOR': '0.400', 'HITCOUNT': '0.430', 'WEAPON3': '0.650', 'weapon2': '1.104', 'weapon3': '1.448', 'DAMAGECOUNT': '1.839', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:02,486][2409103] DAMAGECOUNT value on done: 2224.0
[2023-02-25 12:52:02,487][2409103] Sum rewards: 0.784, reward structure: {'DEATHCOUNT': '-6.750', 'weapon4': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'weapon5': '0.034', 'AMMO4': '0.045', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HEALTH': '0.294', 'HITCOUNT': '0.390', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon2': '0.996', 'DAMAGECOUNT': '1.230', 'weapon3': '1.386', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:02,575][2409096] DAMAGECOUNT value on done: 2055.0
[2023-02-25 12:52:02,578][2409096] Sum rewards: 2.332, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.112', 'AMMO5': '0.017', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'AMMO4': '0.116', 'weapon5': '0.124', 'WEAPON5': '0.250', 'HITCOUNT': '0.300', 'weapon4': '0.334', 'ARMOR': '0.448', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.876', 'weapon3': '1.256', 'weapon2': '1.730', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:02,650][2409074] Updated weights for policy 0, policy_version 12231 (0.0012)
[2023-02-25 12:52:02,884][2409565] DAMAGECOUNT value on done: 1765.0
[2023-02-25 12:52:02,887][2409565] Sum rewards: -4.066, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.140', 'AMMO5': '0.017', 'AMMO2': '0.022', 'weapon5': '0.072', 'AMMO4': '0.109', 'AMMO3': '0.123', 'HITCOUNT': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.398', 'WEAPON5': '0.400', 'ARMOR': '0.432', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.765', 'FRAGCOUNT': '1.000', 'weapon3': '1.192', 'weapon2': '1.344'}
[2023-02-25 12:52:03,045][2409100] DAMAGECOUNT value on done: 2500.0
[2023-02-25 12:52:03,046][2409100] Sum rewards: 5.362, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.230', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon4': '0.030', 'AMMO4': '0.046', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.122', 'WEAPON5': '0.200', 'WEAPON3': '0.600', 'HITCOUNT': '0.670', 'weapon2': '1.272', 'weapon3': '1.568', 'DAMAGECOUNT': '2.625', 'FRAGCOUNT': '4.500'}
[2023-02-25 12:52:03,195][2409101] DAMAGECOUNT value on done: 2997.0
[2023-02-25 12:52:03,196][2409101] Sum rewards: 3.827, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.543', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'ARMOR': '0.048', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.093', 'AMMO4': '0.123', 'WEAPON4': '0.300', 'HITCOUNT': '0.320', 'weapon4': '0.452', 'WEAPON3': '0.500', 'weapon3': '0.964', 'DAMAGECOUNT': '1.134', 'weapon2': '1.296', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:03,371][2409355] DAMAGECOUNT value on done: 2025.0
[2023-02-25 12:52:03,411][2409099] DAMAGECOUNT value on done: 2006.0
[2023-02-25 12:52:03,412][2409099] Sum rewards: 4.938, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.294', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.013', 'WEAPON1': '0.020', 'AMMO3': '0.034', 'WEAPON4': '0.100', 'weapon5': '0.148', 'WEAPON5': '0.200', 'weapon4': '0.204', 'HITCOUNT': '0.250', 'WEAPON3': '0.250', 'weapon3': '0.388', 'ARMOR': '0.856', 'weapon2': '0.928', 'DAMAGECOUNT': '1.083', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:03,486][2409105] DAMAGECOUNT value on done: 1937.0
[2023-02-25 12:52:03,489][2409105] Sum rewards: -0.256, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.692', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'weapon5': '0.016', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.090', 'HITCOUNT': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.430', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.550', 'ARMOR': '0.845', 'FRAGCOUNT': '1.000', 'weapon2': '1.200', 'weapon3': '1.218'}
[2023-02-25 12:52:03,661][2409549] DAMAGECOUNT value on done: 2512.0
[2023-02-25 12:52:03,662][2409549] Sum rewards: 1.639, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.432', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'weapon4': '0.074', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'HITCOUNT': '0.330', 'WEAPON3': '0.450', 'ARMOR': '0.460', 'weapon3': '1.028', 'DAMAGECOUNT': '1.206', 'weapon2': '1.468', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:03,984][2409097] DAMAGECOUNT value on done: 2936.0
[2023-02-25 12:52:03,985][2409097] Sum rewards: 5.888, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.712', 'AMMO2': '0.006', 'AMMO5': '0.018', 'AMMO4': '0.031', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon7': '0.072', 'AMMO3': '0.084', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.142', 'weapon4': '0.162', 'WEAPON5': '0.400', 'HITCOUNT': '0.450', 'ARMOR': '0.458', 'WEAPON3': '0.500', 'weapon3': '1.328', 'weapon2': '1.856', 'DAMAGECOUNT': '2.202', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:52:04,052][2409079] DAMAGECOUNT value on done: 1565.0
[2023-02-25 12:52:04,053][2409079] Sum rewards: 1.751, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.698', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.040', 'AMMO4': '0.056', 'weapon5': '0.064', 'AMMO3': '0.075', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.310', 'ARMOR': '0.499', 'weapon4': '0.528', 'WEAPON3': '0.550', 'weapon2': '0.836', 'DAMAGECOUNT': '1.488', 'weapon3': '1.532', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:04,202][2409469] DAMAGECOUNT value on done: 2696.0
[2023-02-25 12:52:04,205][2409469] Sum rewards: 3.848, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.614', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO2': '0.044', 'AMMO3': '0.109', 'weapon5': '0.116', 'WEAPON5': '0.200', 'AMMO4': '0.219', 'weapon4': '0.318', 'WEAPON4': '0.400', 'HITCOUNT': '0.530', 'WEAPON3': '0.600', 'ARMOR': '0.800', 'weapon2': '1.346', 'weapon3': '1.564', 'DAMAGECOUNT': '2.928', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:04,227][2409596] DAMAGECOUNT value on done: 2292.0
[2023-02-25 12:52:04,299][2409548] DAMAGECOUNT value on done: 2903.0
[2023-02-25 12:52:04,299][2409548] Sum rewards: 7.515, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon7': '0.084', 'weapon5': '0.090', 'AMMO3': '0.091', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.134', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.416', 'HITCOUNT': '0.420', 'HEALTH': '0.506', 'weapon2': '0.506', 'WEAPON3': '0.550', 'weapon4': '0.666', 'weapon3': '1.790', 'DAMAGECOUNT': '1.965', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:52:04,334][2409074] Updated weights for policy 0, policy_version 12241 (0.0012)
[2023-02-25 12:52:04,443][2409485] DAMAGECOUNT value on done: 1993.0
[2023-02-25 12:52:04,444][2409485] Sum rewards: 0.583, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.284', 'AMMO4': '-0.074', 'AMMO2': '-0.015', 'AMMO5': '0.010', 'weapon4': '0.016', 'WEAPON1': '0.020', 'weapon5': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.075', 'WEAPON5': '0.250', 'HITCOUNT': '0.290', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.930', 'weapon3': '1.044', 'ARMOR': '1.416', 'weapon2': '1.758', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:04,554][2409597] DAMAGECOUNT value on done: 2197.0
[2023-02-25 12:52:04,557][2409597] Sum rewards: 0.772, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.724', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.008', 'WEAPON1': '0.010', 'weapon5': '0.058', 'AMMO3': '0.083', 'WEAPON5': '0.100', 'HITCOUNT': '0.210', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.762', 'weapon3': '1.250', 'weapon2': '1.308', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:05,098][2409406] DAMAGECOUNT value on done: 2058.0
[2023-02-25 12:52:05,101][2409406] Sum rewards: 0.136, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.994', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.061', 'AMMO3': '0.085', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.360', 'weapon4': '0.414', 'WEAPON3': '0.450', 'ARMOR': '0.520', 'weapon3': '1.170', 'weapon2': '1.220', 'DAMAGECOUNT': '1.221', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:05,233][2409389] DAMAGECOUNT value on done: 2258.0
[2023-02-25 12:52:05,234][2409389] Sum rewards: 2.948, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.301', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO2': '0.030', 'weapon5': '0.032', 'AMMO3': '0.103', 'AMMO4': '0.150', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.476', 'HITCOUNT': '0.500', 'ARMOR': '0.525', 'WEAPON3': '0.700', 'weapon2': '1.278', 'weapon3': '1.560', 'DAMAGECOUNT': '1.797', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:52:05,299][2409405] DAMAGECOUNT value on done: 2465.0
[2023-02-25 12:52:05,300][2409405] Sum rewards: 11.020, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.500', 'AMMO2': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.020', 'AMMO3': '0.053', 'WEAPON4': '0.100', 'weapon5': '0.126', 'weapon4': '0.220', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.530', 'weapon2': '1.110', 'weapon3': '1.216', 'DAMAGECOUNT': '2.421', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:52:05,334][2409076] DAMAGECOUNT value on done: 2144.0
[2023-02-25 12:52:05,336][2409076] Sum rewards: 1.709, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.053', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.016', 'weapon5': '0.052', 'weapon7': '0.062', 'AMMO3': '0.097', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.414', 'WEAPON3': '0.500', 'ARMOR': '0.532', 'weapon4': '0.700', 'DAMAGECOUNT': '0.735', 'weapon3': '0.948', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:05,483][2409407] DAMAGECOUNT value on done: 2208.0
[2023-02-25 12:52:05,516][2409407] Sum rewards: 5.000, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.695', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'weapon5': '0.034', 'weapon7': '0.048', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.148', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'ARMOR': '0.408', 'HITCOUNT': '0.460', 'weapon3': '1.278', 'DAMAGECOUNT': '1.533', 'weapon2': '1.610', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:05,787][2409102] DAMAGECOUNT value on done: 2500.0
[2023-02-25 12:52:05,792][2409102] Sum rewards: 8.891, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'weapon5': '0.044', 'AMMO2': '0.044', 'weapon7': '0.046', 'HEALTH': '0.059', 'AMMO3': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.220', 'WEAPON5': '0.250', 'weapon4': '0.292', 'HITCOUNT': '0.580', 'WEAPON3': '0.600', 'ARMOR': '0.800', 'weapon2': '1.300', 'weapon3': '1.694', 'DAMAGECOUNT': '2.436', 'FRAGCOUNT': '9.000'}
[2023-02-25 12:52:05,820][2409373] DAMAGECOUNT value on done: 2663.0
[2023-02-25 12:52:05,821][2409373] Sum rewards: -0.981, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.960', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.036', 'weapon5': '0.056', 'AMMO3': '0.074', 'AMMO4': '0.180', 'WEAPON5': '0.200', 'HITCOUNT': '0.280', 'WEAPON4': '0.300', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.500', 'weapon4': '0.762', 'ARMOR': '0.858', 'DAMAGECOUNT': '1.089', 'weapon3': '1.134', 'weapon2': '1.492'}
[2023-02-25 12:52:05,906][2409075] DAMAGECOUNT value on done: 1909.0
[2023-02-25 12:52:05,910][2409075] Sum rewards: 0.361, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.032', 'weapon5': '0.002', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon7': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.121', 'AMMO4': '0.154', 'WEAPON4': '0.250', 'HITCOUNT': '0.380', 'weapon4': '0.394', 'ARMOR': '0.491', 'WEAPON3': '0.700', 'weapon2': '1.152', 'weapon3': '1.218', 'DAMAGECOUNT': '1.566', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:05,934][2409486] DAMAGECOUNT value on done: 1879.0
[2023-02-25 12:52:05,937][2409486] Sum rewards: -3.494, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.500', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.068', 'AMMO3': '0.138', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'weapon4': '0.298', 'ARMOR': '0.532', 'DAMAGECOUNT': '0.552', 'WEAPON3': '1.000', 'weapon2': '1.516', 'weapon3': '1.996', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:06,044][2409078] DAMAGECOUNT value on done: 2364.0
[2023-02-25 12:52:06,047][2409078] Sum rewards: 4.605, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.408', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.063', 'AMMO3': '0.134', 'WEAPON4': '0.200', 'weapon5': '0.222', 'weapon4': '0.332', 'WEAPON5': '0.350', 'ARMOR': '0.477', 'HITCOUNT': '0.620', 'WEAPON3': '0.850', 'weapon2': '1.244', 'weapon3': '1.806', 'DAMAGECOUNT': '2.670', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:52:06,179][2409074] Updated weights for policy 0, policy_version 12251 (0.0012)
[2023-02-25 12:52:06,222][2409096] DAMAGECOUNT value on done: 1984.0
[2023-02-25 12:52:06,223][2409096] Sum rewards: 2.939, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.113', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO3': '0.093', 'weapon5': '0.110', 'WEAPON5': '0.300', 'HITCOUNT': '0.490', 'WEAPON3': '0.700', 'ARMOR': '1.253', 'DAMAGECOUNT': '1.449', 'weapon3': '1.678', 'weapon2': '1.730', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:06,230][2409866] DAMAGECOUNT value on done: 2539.0
[2023-02-25 12:52:06,231][2409866] Sum rewards: -1.216, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.954', 'AMMO5': '0.006', 'AMMO2': '0.013', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'AMMO4': '0.064', 'weapon5': '0.098', 'HITCOUNT': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'ARMOR': '0.428', 'weapon4': '0.430', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.831', 'weapon3': '0.972', 'weapon2': '1.336', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:06,266][2409104] DAMAGECOUNT value on done: 2349.0
[2023-02-25 12:52:06,267][2409077] DAMAGECOUNT value on done: 2872.0
[2023-02-25 12:52:06,268][2409077] Sum rewards: 1.688, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.316', 'AMMO5': '0.015', 'AMMO2': '0.035', 'WEAPON1': '0.040', 'AMMO3': '0.102', 'weapon5': '0.106', 'AMMO4': '0.177', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'HITCOUNT': '0.590', 'WEAPON3': '0.650', 'weapon2': '0.702', 'ARMOR': '0.869', 'weapon4': '1.102', 'weapon3': '1.514', 'DAMAGECOUNT': '2.352', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:06,655][2409100] DAMAGECOUNT value on done: 2006.0
[2023-02-25 12:52:06,655][2409100] Sum rewards: 3.190, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.620', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.009', 'weapon5': '0.026', 'WEAPON1': '0.040', 'AMMO3': '0.060', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.442', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'ARMOR': '0.829', 'weapon3': '1.022', 'weapon2': '1.464', 'DAMAGECOUNT': '1.728', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:06,902][2409101] DAMAGECOUNT value on done: 2215.0
[2023-02-25 12:52:06,905][2409101] Sum rewards: 5.847, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.141', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'weapon5': '0.022', 'AMMO4': '0.048', 'AMMO3': '0.080', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.424', 'WEAPON3': '0.500', 'HITCOUNT': '0.680', 'ARMOR': '0.875', 'weapon3': '1.240', 'weapon2': '2.000', 'DAMAGECOUNT': '2.391', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:06,909][2409565] DAMAGECOUNT value on done: 1943.0
[2023-02-25 12:52:06,912][2409565] Sum rewards: -0.400, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.640', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'weapon4': '0.014', 'WEAPON1': '0.020', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'weapon5': '0.114', 'WEAPON5': '0.150', 'HITCOUNT': '0.320', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.891', 'ARMOR': '0.952', 'FRAGCOUNT': '1.000', 'weapon3': '1.254', 'weapon2': '1.750'}
[2023-02-25 12:52:06,992][2409103] DAMAGECOUNT value on done: 1614.0
[2023-02-25 12:52:06,993][2409103] Sum rewards: 3.122, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.210', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO3': '0.060', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'HITCOUNT': '0.240', 'ARMOR': '0.400', 'weapon4': '0.448', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.813', 'weapon2': '0.946', 'weapon3': '1.268', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:07,097][2409105] DAMAGECOUNT value on done: 2245.0
[2023-02-25 12:52:07,098][2409105] Sum rewards: 2.648, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.655', 'AMMO5': '0.010', 'AMMO2': '0.011', 'weapon5': '0.024', 'WEAPON1': '0.030', 'AMMO4': '0.053', 'AMMO3': '0.074', 'weapon4': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.400', 'WEAPON3': '0.500', 'ARMOR': '0.935', 'DAMAGECOUNT': '1.380', 'weapon2': '1.414', 'weapon3': '1.634', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:07,186][2408954] Fps is (10 sec: 25395.2, 60 sec: 25260.7, 300 sec: 25534.0). Total num frames: 50204672. Throughput: 0: 6338.7. Samples: 12546468. Policy #0 lag: (min: 0.0, avg: 11.5, max: 26.0)
[2023-02-25 12:52:07,186][2408954] Avg episode reward: [(0, '2.753')]
[2023-02-25 12:52:07,195][2409355] DAMAGECOUNT value on done: 1478.0
[2023-02-25 12:52:07,196][2409355] Sum rewards: 0.724, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.994', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'WEAPON1': '0.020', 'AMMO3': '0.060', 'WEAPON4': '0.200', 'HITCOUNT': '0.230', 'WEAPON3': '0.450', 'weapon4': '0.472', 'DAMAGECOUNT': '0.705', 'FRAGCOUNT': '1.000', 'weapon2': '1.078', 'weapon3': '1.296'}
[2023-02-25 12:52:07,299][2409099] DAMAGECOUNT value on done: 2091.0
[2023-02-25 12:52:07,300][2409099] Sum rewards: 3.656, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.900', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'AMMO3': '0.053', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.108', 'WEAPON4': '0.300', 'weapon4': '0.330', 'WEAPON3': '0.350', 'HITCOUNT': '0.390', 'weapon3': '1.020', 'weapon2': '1.096', 'DAMAGECOUNT': '1.503', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:07,357][2409549] DAMAGECOUNT value on done: 2464.0
[2023-02-25 12:52:07,358][2409549] Sum rewards: 2.771, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.117', 'AMMO2': '0.003', 'AMMO4': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.067', 'WEAPON4': '0.150', 'HITCOUNT': '0.260', 'WEAPON3': '0.400', 'weapon4': '0.486', 'weapon2': '0.670', 'DAMAGECOUNT': '0.807', 'ARMOR': '1.330', 'weapon3': '1.428', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:07,448][2409074] Updated weights for policy 0, policy_version 12261 (0.0012)
[2023-02-25 12:52:07,768][2409469] DAMAGECOUNT value on done: 3380.0
[2023-02-25 12:52:07,771][2409469] Sum rewards: 2.746, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.617', 'AMMO2': '0.009', 'AMMO5': '0.028', 'AMMO4': '0.046', 'AMMO3': '0.162', 'weapon5': '0.228', 'WEAPON4': '0.250', 'weapon4': '0.390', 'WEAPON5': '0.450', 'HITCOUNT': '0.510', 'ARMOR': '0.516', 'weapon2': '0.844', 'WEAPON3': '1.000', 'weapon3': '2.190', 'DAMAGECOUNT': '2.490', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:07,808][2409097] DAMAGECOUNT value on done: 2567.0
[2023-02-25 12:52:07,812][2409097] Sum rewards: 6.398, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.728', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO3': '0.052', 'weapon4': '0.078', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'ARMOR': '0.408', 'WEAPON3': '0.450', 'HITCOUNT': '0.600', 'weapon3': '1.270', 'weapon2': '1.672', 'DAMAGECOUNT': '2.007', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:07,862][2409596] DAMAGECOUNT value on done: 2650.0
[2023-02-25 12:52:07,863][2409596] Sum rewards: 1.769, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.020', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon5': '0.040', 'AMMO3': '0.099', 'WEAPON5': '0.150', 'HITCOUNT': '0.260', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'weapon2': '0.886', 'DAMAGECOUNT': '0.984', 'weapon3': '1.644', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:08,021][2409548] DAMAGECOUNT value on done: 2404.0
[2023-02-25 12:52:08,023][2409548] Sum rewards: 6.801, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.398', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'WEAPON3': '0.400', 'ARMOR': '0.400', 'weapon4': '0.420', 'HITCOUNT': '0.630', 'weapon3': '1.060', 'weapon2': '1.314', 'DAMAGECOUNT': '2.259', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:08,183][2409597] DAMAGECOUNT value on done: 1922.0
[2023-02-25 12:52:08,237][2409485] DAMAGECOUNT value on done: 1825.0
[2023-02-25 12:52:08,238][2409485] Sum rewards: 0.492, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.247', 'AMMO5': '0.005', 'AMMO2': '0.023', 'AMMO3': '0.095', 'weapon5': '0.100', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'HITCOUNT': '0.390', 'weapon4': '0.390', 'WEAPON4': '0.400', 'ARMOR': '0.424', 'WEAPON3': '0.550', 'weapon2': '1.130', 'DAMAGECOUNT': '1.218', 'weapon3': '1.502', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:08,469][2409079] DAMAGECOUNT value on done: 1729.0
[2023-02-25 12:52:08,473][2409079] Sum rewards: -1.466, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.266', 'AMMO5': '0.007', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'AMMO3': '0.070', 'weapon7': '0.098', 'WEAPON4': '0.100', 'AMMO4': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.126', 'weapon5': '0.140', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.260', 'WEAPON3': '0.400', 'ARMOR': '0.441', 'DAMAGECOUNT': '0.912', 'weapon2': '1.374', 'weapon3': '1.618'}
[2023-02-25 12:52:08,812][2409389] DAMAGECOUNT value on done: 1549.0
[2023-02-25 12:52:08,813][2409389] Sum rewards: -2.420, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.396', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon7': '0.050', 'weapon5': '0.084', 'AMMO3': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.120', 'AMMO4': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'ARMOR': '0.459', 'DAMAGECOUNT': '0.537', 'weapon4': '0.548', 'WEAPON3': '0.550', 'weapon2': '0.674', 'FRAGCOUNT': '1.000', 'weapon3': '1.120'}
[2023-02-25 12:52:08,936][2409076] DAMAGECOUNT value on done: 2282.0
[2023-02-25 12:52:08,938][2409076] Sum rewards: 0.644, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.782', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO3': '0.055', 'AMMO4': '0.074', 'weapon7': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.471', 'weapon3': '0.528', 'weapon4': '0.630', 'weapon2': '0.950', 'ARMOR': '0.967', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:52:09,087][2409406] DAMAGECOUNT value on done: 1613.0
[2023-02-25 12:52:09,090][2409406] Sum rewards: 3.054, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.583', 'AMMO2': '0.004', 'AMMO5': '0.007', 'weapon5': '0.014', 'AMMO4': '0.020', 'WEAPON1': '0.020', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.208', 'HITCOUNT': '0.280', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.819', 'ARMOR': '0.928', 'weapon3': '1.036', 'weapon2': '1.340', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:09,405][2409373] DAMAGECOUNT value on done: 2915.0
[2023-02-25 12:52:09,405][2409373] Sum rewards: -0.011, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.508', 'AMMO5': '0.006', 'AMMO2': '0.015', 'WEAPON1': '0.060', 'AMMO4': '0.074', 'weapon5': '0.080', 'AMMO3': '0.107', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'ARMOR': '0.508', 'weapon4': '0.508', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.152', 'weapon2': '1.398', 'weapon3': '1.618', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:09,510][2409075] DAMAGECOUNT value on done: 1895.0
[2023-02-25 12:52:09,514][2409075] Sum rewards: 4.301, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.160', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.053', 'AMMO3': '0.074', 'weapon7': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.110', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.390', 'ARMOR': '0.404', 'WEAPON3': '0.500', 'weapon4': '0.532', 'weapon2': '0.692', 'DAMAGECOUNT': '1.425', 'weapon3': '1.452', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:09,566][2409074] Updated weights for policy 0, policy_version 12271 (0.0012)
[2023-02-25 12:52:09,591][2409407] DAMAGECOUNT value on done: 2950.0
[2023-02-25 12:52:09,591][2409407] Sum rewards: 6.898, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.349', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'weapon5': '0.002', 'AMMO5': '0.005', 'ARMOR': '0.024', 'WEAPON1': '0.050', 'AMMO3': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.282', 'WEAPON3': '0.600', 'HITCOUNT': '0.760', 'weapon3': '1.598', 'weapon2': '1.920', 'DAMAGECOUNT': '2.637', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:52:09,745][2409102] DAMAGECOUNT value on done: 2495.0
[2023-02-25 12:52:09,748][2409102] Sum rewards: 2.334, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.416', 'AMMO2': '0.008', 'AMMO5': '0.012', 'AMMO4': '0.040', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.056', 'AMMO3': '0.068', 'weapon4': '0.112', 'WEAPON5': '0.300', 'HITCOUNT': '0.320', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.035', 'weapon2': '1.056', 'weapon3': '1.242', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:09,779][2409405] DAMAGECOUNT value on done: 2320.0
[2023-02-25 12:52:09,780][2409405] Sum rewards: 6.200, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.025', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'ARMOR': '0.024', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'weapon5': '0.158', 'weapon4': '0.308', 'WEAPON5': '0.350', 'HITCOUNT': '0.440', 'WEAPON3': '0.600', 'weapon2': '1.262', 'weapon3': '1.772', 'DAMAGECOUNT': '1.962', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:52:09,869][2409866] DAMAGECOUNT value on done: 1826.0
[2023-02-25 12:52:09,870][2409866] Sum rewards: 4.596, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'ARMOR': '0.028', 'HEALTH': '0.038', 'AMMO3': '0.060', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.186', 'WEAPON3': '0.350', 'HITCOUNT': '0.390', 'weapon4': '0.420', 'weapon3': '1.278', 'DAMAGECOUNT': '1.326', 'weapon2': '1.556', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:09,887][2409077] DAMAGECOUNT value on done: 2107.0
[2023-02-25 12:52:09,890][2409077] Sum rewards: 2.293, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.140', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO3': '0.060', 'AMMO4': '0.065', 'weapon4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.170', 'WEAPON3': '0.300', 'HITCOUNT': '0.340', 'ARMOR': '0.466', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.065', 'weapon3': '1.362', 'weapon2': '1.726'}
[2023-02-25 12:52:10,085][2409096] DAMAGECOUNT value on done: 2353.0
[2023-02-25 12:52:10,087][2409096] Sum rewards: 1.313, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.008', 'AMMO2': '0.007', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.037', 'AMMO3': '0.090', 'weapon5': '0.126', 'WEAPON4': '0.150', 'weapon4': '0.284', 'WEAPON5': '0.300', 'ARMOR': '0.455', 'HITCOUNT': '0.510', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.647', 'weapon3': '1.678', 'weapon2': '1.752', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:10,135][2409104] DAMAGECOUNT value on done: 2073.0
[2023-02-25 12:52:10,138][2409104] Sum rewards: 2.416, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.923', 'AMMO2': '0.010', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'AMMO4': '0.051', 'AMMO3': '0.108', 'weapon5': '0.126', 'WEAPON4': '0.200', 'weapon4': '0.346', 'WEAPON5': '0.400', 'HITCOUNT': '0.530', 'WEAPON3': '0.800', 'ARMOR': '0.896', 'weapon2': '1.476', 'weapon3': '1.674', 'DAMAGECOUNT': '1.911', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:10,230][2409486] DAMAGECOUNT value on done: 2719.0
[2023-02-25 12:52:10,233][2409486] Sum rewards: 5.281, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.200', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon5': '0.014', 'AMMO2': '0.027', 'weapon7': '0.062', 'AMMO3': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.137', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'weapon4': '0.488', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'weapon2': '0.922', 'weapon3': '1.460', 'DAMAGECOUNT': '2.436', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:10,285][2409100] DAMAGECOUNT value on done: 1868.0
[2023-02-25 12:52:10,286][2409100] Sum rewards: 3.187, reward structure: {'DEATHCOUNT': '-1.500', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO3': '0.030', 'WEAPON1': '0.030', 'AMMO4': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.062', 'WEAPON3': '0.200', 'HEALTH': '0.240', 'HITCOUNT': '0.260', 'weapon3': '0.732', 'DAMAGECOUNT': '0.882', 'FRAGCOUNT': '1.000', 'weapon2': '1.158'}
[2023-02-25 12:52:10,411][2409101] DAMAGECOUNT value on done: 2508.0
[2023-02-25 12:52:10,415][2409101] Sum rewards: 9.034, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.928', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.013', 'weapon5': '0.026', 'AMMO3': '0.060', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.276', 'WEAPON3': '0.450', 'HITCOUNT': '0.570', 'ARMOR': '0.859', 'weapon3': '1.220', 'weapon2': '1.540', 'DAMAGECOUNT': '2.199', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:52:10,544][2409078] DAMAGECOUNT value on done: 2062.0
[2023-02-25 12:52:10,545][2409078] Sum rewards: 0.270, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.716', 'AMMO5': '0.014', 'weapon4': '0.014', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'AMMO3': '0.070', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.150', 'weapon5': '0.158', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.675', 'ARMOR': '0.831', 'FRAGCOUNT': '1.000', 'weapon3': '1.414', 'weapon2': '1.660'}
[2023-02-25 12:52:10,660][2409103] DAMAGECOUNT value on done: 1637.0
[2023-02-25 12:52:10,664][2409103] Sum rewards: -0.538, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.518', 'AMMO5': '0.014', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO3': '0.057', 'AMMO4': '0.072', 'weapon5': '0.154', 'HITCOUNT': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.352', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.450', 'weapon3': '0.912', 'FRAGCOUNT': '1.000', 'ARMOR': '1.347', 'weapon2': '1.478'}
[2023-02-25 12:52:10,742][2409105] DAMAGECOUNT value on done: 2285.0
[2023-02-25 12:52:10,743][2409105] Sum rewards: 1.496, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.679', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.046', 'WEAPON1': '0.050', 'AMMO4': '0.058', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'WEAPON4': '0.300', 'HITCOUNT': '0.400', 'weapon4': '0.486', 'WEAPON3': '0.950', 'ARMOR': '1.256', 'weapon3': '1.326', 'weapon2': '1.532', 'DAMAGECOUNT': '1.929', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:10,788][2409565] DAMAGECOUNT value on done: 2379.0
[2023-02-25 12:52:10,789][2409565] Sum rewards: -0.278, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.492', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.058', 'WEAPON4': '0.100', 'HITCOUNT': '0.130', 'weapon5': '0.144', 'weapon4': '0.214', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'ARMOR': '0.800', 'DAMAGECOUNT': '0.807', 'weapon3': '0.872', 'FRAGCOUNT': '1.000', 'weapon2': '1.350'}
[2023-02-25 12:52:10,832][2409549] DAMAGECOUNT value on done: 2990.0
[2023-02-25 12:52:10,836][2409549] Sum rewards: 13.935, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.892', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO4': '0.040', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'weapon5': '0.198', 'weapon4': '0.230', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.840', 'ARMOR': '0.970', 'weapon3': '1.564', 'weapon2': '1.630', 'DAMAGECOUNT': '4.041', 'FRAGCOUNT': '11.000'}
[2023-02-25 12:52:10,904][2409074] Updated weights for policy 0, policy_version 12281 (0.0012)
[2023-02-25 12:52:10,979][2409355] DAMAGECOUNT value on done: 1855.0
[2023-02-25 12:52:10,980][2409355] Sum rewards: 0.159, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.464', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.250', 'weapon4': '0.378', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.879', 'ARMOR': '0.943', 'weapon2': '1.318', 'weapon3': '1.390', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:11,501][2409097] DAMAGECOUNT value on done: 1521.0
[2023-02-25 12:52:11,502][2409097] Sum rewards: 1.657, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.044', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO4': '0.042', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'weapon5': '0.186', 'HITCOUNT': '0.240', 'WEAPON5': '0.250', 'weapon4': '0.256', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'weapon2': '1.114', 'DAMAGECOUNT': '1.122', 'weapon3': '1.986', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:11,705][2409596] DAMAGECOUNT value on done: 2346.0
[2023-02-25 12:52:11,709][2409596] Sum rewards: -0.130, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.036', 'AMMO5': '0.010', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'weapon5': '0.062', 'weapon4': '0.108', 'AMMO3': '0.136', 'AMMO4': '0.138', 'HITCOUNT': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.885', 'ARMOR': '1.355', 'weapon2': '1.584', 'weapon3': '1.880', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:11,778][2409099] DAMAGECOUNT value on done: 2574.0
[2023-02-25 12:52:11,781][2409099] Sum rewards: 2.881, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.610', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.013', 'WEAPON1': '0.030', 'AMMO3': '0.068', 'weapon5': '0.096', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.340', 'WEAPON3': '0.400', 'ARMOR': '0.400', 'weapon4': '0.440', 'weapon3': '0.994', 'DAMAGECOUNT': '1.584', 'weapon2': '1.718', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:11,844][2409469] DAMAGECOUNT value on done: 2889.0
[2023-02-25 12:52:11,845][2409469] Sum rewards: 4.600, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.071', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'weapon5': '0.050', 'AMMO3': '0.079', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'HITCOUNT': '0.440', 'weapon4': '0.476', 'WEAPON3': '0.500', 'ARMOR': '0.879', 'weapon3': '1.110', 'weapon2': '1.154', 'DAMAGECOUNT': '1.758', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:11,861][2409548] DAMAGECOUNT value on done: 3029.0
[2023-02-25 12:52:11,863][2409548] Sum rewards: 6.934, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.236', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'weapon4': '0.164', 'WEAPON3': '0.350', 'HITCOUNT': '0.470', 'ARMOR': '0.848', 'weapon3': '1.178', 'weapon2': '1.700', 'DAMAGECOUNT': '1.848', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:12,072][2409079] DAMAGECOUNT value on done: 2450.0
[2023-02-25 12:52:12,075][2409079] Sum rewards: -0.647, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.743', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO3': '0.112', 'weapon5': '0.124', 'AMMO4': '0.124', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.334', 'HITCOUNT': '0.500', 'WEAPON3': '0.700', 'ARMOR': '0.820', 'FRAGCOUNT': '1.500', 'weapon3': '1.564', 'weapon2': '1.568', 'DAMAGECOUNT': '1.911'}
[2023-02-25 12:52:12,101][2409485] DAMAGECOUNT value on done: 2372.0
[2023-02-25 12:52:12,132][2409485] Sum rewards: 4.523, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.040', 'AMMO5': '0.003', 'AMMO2': '0.012', 'AMMO3': '0.034', 'WEAPON4': '0.050', 'weapon5': '0.052', 'AMMO4': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon7': '0.136', 'WEAPON3': '0.200', 'weapon4': '0.212', 'HITCOUNT': '0.370', 'ARMOR': '0.520', 'weapon3': '0.670', 'weapon2': '0.772', 'DAMAGECOUNT': '1.320', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:12,186][2408954] Fps is (10 sec: 25805.2, 60 sec: 25258.7, 300 sec: 25534.1). Total num frames: 50335744. Throughput: 0: 6326.4. Samples: 12584208. Policy #0 lag: (min: 1.0, avg: 12.1, max: 25.0)
[2023-02-25 12:52:12,186][2408954] Avg episode reward: [(0, '2.603')]
[2023-02-25 12:52:12,256][2409597] DAMAGECOUNT value on done: 2469.0
[2023-02-25 12:52:12,256][2409597] Sum rewards: 4.131, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.198', 'AMMO5': '0.010', 'weapon5': '0.012', 'weapon7': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.108', 'weapon4': '0.188', 'WEAPON5': '0.200', 'HITCOUNT': '0.390', 'WEAPON3': '0.600', 'ARMOR': '0.828', 'weapon3': '1.150', 'DAMAGECOUNT': '1.332', 'weapon2': '2.002', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:12,311][2409074] Updated weights for policy 0, policy_version 12291 (0.0012)
[2023-02-25 12:52:12,350][2409389] DAMAGECOUNT value on done: 2142.0
[2023-02-25 12:52:12,351][2409389] Sum rewards: 4.421, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.922', 'AMMO5': '0.011', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO4': '0.082', 'AMMO3': '0.099', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.134', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.660', 'ARMOR': '0.899', 'weapon2': '1.308', 'weapon3': '2.078', 'DAMAGECOUNT': '2.637', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:52:13,070][2409075] DAMAGECOUNT value on done: 2973.0
[2023-02-25 12:52:13,072][2409075] Sum rewards: 9.948, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.012', 'AMMO2': '0.017', 'HEALTH': '0.036', 'weapon7': '0.064', 'AMMO3': '0.066', 'AMMO4': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.434', 'HITCOUNT': '0.450', 'WEAPON3': '0.450', 'weapon3': '1.064', 'weapon2': '1.384', 'ARMOR': '1.695', 'DAMAGECOUNT': '2.814', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:13,154][2409407] DAMAGECOUNT value on done: 2167.0
[2023-02-25 12:52:13,156][2409407] Sum rewards: 6.422, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.350', 'AMMO2': '0.005', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.024', 'weapon5': '0.030', 'AMMO3': '0.068', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.264', 'ARMOR': '0.476', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'weapon2': '0.658', 'weapon3': '1.348', 'DAMAGECOUNT': '1.941', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:52:13,283][2409076] DAMAGECOUNT value on done: 1941.0
[2023-02-25 12:52:13,285][2409076] Sum rewards: 2.143, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.354', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO3': '0.069', 'AMMO4': '0.113', 'HITCOUNT': '0.260', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'ARMOR': '0.448', 'weapon4': '0.612', 'weapon3': '0.964', 'DAMAGECOUNT': '1.080', 'weapon2': '1.108', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:13,307][2409406] DAMAGECOUNT value on done: 2280.0
[2023-02-25 12:52:13,307][2409406] Sum rewards: 3.895, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.814', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.047', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.066', 'weapon5': '0.202', 'WEAPON5': '0.250', 'HITCOUNT': '0.400', 'WEAPON3': '0.500', 'weapon3': '1.376', 'DAMAGECOUNT': '1.953', 'weapon2': '2.048', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:13,563][2409102] DAMAGECOUNT value on done: 2327.0
[2023-02-25 12:52:13,567][2409102] Sum rewards: 1.243, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.091', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO3': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.108', 'weapon7': '0.114', 'WEAPON5': '0.150', 'weapon5': '0.172', 'WEAPON3': '0.450', 'HITCOUNT': '0.460', 'FRAGCOUNT': '0.500', 'ARMOR': '0.800', 'weapon3': '1.156', 'DAMAGECOUNT': '1.851', 'weapon2': '1.910'}
[2023-02-25 12:52:13,680][2409104] DAMAGECOUNT value on done: 1853.0
[2023-02-25 12:52:13,682][2409104] Sum rewards: 3.345, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'weapon5': '0.052', 'AMMO4': '0.054', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HEALTH': '0.281', 'weapon4': '0.362', 'ARMOR': '0.428', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'weapon2': '1.332', 'DAMAGECOUNT': '1.491', 'weapon3': '1.686', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:13,730][2409373] DAMAGECOUNT value on done: 2216.0
[2023-02-25 12:52:13,731][2409373] Sum rewards: 6.190, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.029', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'weapon4': '0.088', 'weapon5': '0.112', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'AMMO4': '0.158', 'WEAPON5': '0.200', 'HITCOUNT': '0.590', 'WEAPON3': '0.800', 'ARMOR': '0.932', 'weapon3': '1.720', 'weapon2': '1.784', 'DAMAGECOUNT': '2.481', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:52:13,818][2409866] DAMAGECOUNT value on done: 1696.0
[2023-02-25 12:52:13,821][2409866] Sum rewards: 5.575, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.852', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.022', 'ARMOR': '0.032', 'WEAPON1': '0.050', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'WEAPON5': '0.200', 'weapon4': '0.330', 'HITCOUNT': '0.680', 'WEAPON3': '0.800', 'weapon2': '1.122', 'weapon3': '1.852', 'DAMAGECOUNT': '2.232', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:52:13,943][2409405] DAMAGECOUNT value on done: 2056.0
[2023-02-25 12:52:13,944][2409405] Sum rewards: -1.597, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.060', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon7': '0.050', 'weapon5': '0.054', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.220', 'WEAPON4': '0.300', 'ARMOR': '0.429', 'WEAPON3': '0.550', 'weapon4': '0.598', 'DAMAGECOUNT': '0.861', 'weapon3': '1.092', 'weapon2': '1.180', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:13,961][2409096] DAMAGECOUNT value on done: 2690.0
[2023-02-25 12:52:13,962][2409096] Sum rewards: -4.601, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.094', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO5': '0.021', 'WEAPON1': '0.040', 'weapon5': '0.062', 'AMMO3': '0.108', 'WEAPON4': '0.250', 'weapon4': '0.366', 'HITCOUNT': '0.430', 'WEAPON5': '0.450', 'ARMOR': '0.455', 'WEAPON3': '0.800', 'weapon2': '1.014', 'weapon3': '1.472', 'DAMAGECOUNT': '1.509'}
[2023-02-25 12:52:14,055][2409486] DAMAGECOUNT value on done: 2508.0
[2023-02-25 12:52:14,056][2409486] Sum rewards: 5.536, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '0.011', 'AMMO5': '0.015', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'AMMO3': '0.098', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'weapon5': '0.198', 'HITCOUNT': '0.390', 'WEAPON5': '0.400', 'weapon4': '0.436', 'ARMOR': '0.489', 'WEAPON3': '0.600', 'weapon2': '1.084', 'DAMAGECOUNT': '1.611', 'weapon3': '1.622', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:14,297][2409101] DAMAGECOUNT value on done: 2406.0
[2023-02-25 12:52:14,297][2409101] Sum rewards: 4.096, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.864', 'AMMO5': '0.012', 'AMMO2': '0.032', 'WEAPON1': '0.040', 'AMMO3': '0.103', 'weapon5': '0.150', 'AMMO4': '0.158', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.314', 'HITCOUNT': '0.430', 'ARMOR': '0.520', 'WEAPON3': '0.550', 'weapon2': '1.384', 'weapon3': '1.804', 'DAMAGECOUNT': '2.163', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:14,314][2409077] DAMAGECOUNT value on done: 2688.0
[2023-02-25 12:52:14,318][2409077] Sum rewards: 5.577, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'AMMO3': '0.040', 'WEAPON5': '0.100', 'weapon4': '0.120', 'AMMO4': '0.129', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON3': '0.200', 'HITCOUNT': '0.430', 'HEALTH': '0.628', 'weapon3': '0.976', 'weapon2': '1.386', 'DAMAGECOUNT': '1.740', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:14,393][2409103] DAMAGECOUNT value on done: 3394.0
[2023-02-25 12:52:14,394][2409103] Sum rewards: 5.184, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.998', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.022', 'weapon5': '0.046', 'WEAPON1': '0.080', 'AMMO4': '0.109', 'AMMO3': '0.128', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.504', 'HITCOUNT': '0.540', 'WEAPON3': '0.750', 'weapon2': '1.374', 'weapon3': '1.442', 'DAMAGECOUNT': '2.010', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:52:14,416][2409074] Updated weights for policy 0, policy_version 12301 (0.0012)
[2023-02-25 12:52:14,430][2409100] DAMAGECOUNT value on done: 2164.0
[2023-02-25 12:52:14,434][2409100] Sum rewards: 0.820, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.867', 'AMMO5': '0.010', 'weapon5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.098', 'AMMO4': '0.117', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.500', 'HITCOUNT': '0.540', 'weapon4': '0.592', 'ARMOR': '0.855', 'weapon2': '1.324', 'weapon3': '1.542', 'DAMAGECOUNT': '1.650', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:14,709][2409547] DAMAGECOUNT value on done: 2004.0
[2023-02-25 12:52:14,712][2409547] Sum rewards: 4.541, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.296', 'AMMO4': '-0.066', 'AMMO2': '-0.013', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO3': '0.050', 'WEAPON5': '0.150', 'weapon5': '0.178', 'WEAPON3': '0.350', 'HITCOUNT': '0.360', 'weapon3': '1.000', 'ARMOR': '1.321', 'DAMAGECOUNT': '1.380', 'weapon2': '2.112', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:14,720][2409565] DAMAGECOUNT value on done: 1757.0
[2023-02-25 12:52:14,720][2409565] Sum rewards: 1.940, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.582', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.015', 'AMMO3': '0.058', 'AMMO4': '0.074', 'ARMOR': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'HITCOUNT': '0.390', 'WEAPON3': '0.400', 'weapon4': '0.560', 'weapon2': '0.928', 'weapon3': '1.008', 'DAMAGECOUNT': '1.152', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:14,767][2409078] DAMAGECOUNT value on done: 2201.0
[2023-02-25 12:52:14,769][2409549] DAMAGECOUNT value on done: 1906.0
[2023-02-25 12:52:14,771][2409078] Sum rewards: 1.979, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.035', 'AMMO2': '0.008', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.039', 'AMMO3': '0.061', 'weapon5': '0.106', 'WEAPON5': '0.200', 'HITCOUNT': '0.280', 'WEAPON3': '0.400', 'weapon2': '0.924', 'FRAGCOUNT': '1.000', 'weapon3': '1.362', 'DAMAGECOUNT': '1.365'}
[2023-02-25 12:52:14,911][2409105] DAMAGECOUNT value on done: 2147.0
[2023-02-25 12:52:14,911][2409105] Sum rewards: 2.089, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.954', 'AMMO2': '0.010', 'AMMO5': '0.018', 'AMMO4': '0.048', 'WEAPON1': '0.050', 'weapon5': '0.082', 'AMMO3': '0.103', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'weapon4': '0.332', 'HITCOUNT': '0.470', 'WEAPON3': '0.650', 'ARMOR': '1.348', 'weapon3': '1.370', 'DAMAGECOUNT': '1.386', 'weapon2': '1.476', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:15,209][2409355] DAMAGECOUNT value on done: 2075.0
[2023-02-25 12:52:15,210][2409355] Sum rewards: 0.739, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.332', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon5': '0.068', 'AMMO4': '0.109', 'AMMO3': '0.117', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.300', 'weapon4': '0.424', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.912', 'weapon2': '1.238', 'ARMOR': '1.323', 'weapon3': '1.538', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:15,256][2409596] DAMAGECOUNT value on done: 1784.0
[2023-02-25 12:52:15,259][2409596] Sum rewards: 3.785, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.061', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO3': '0.060', 'weapon5': '0.174', 'HITCOUNT': '0.240', 'WEAPON5': '0.350', 'ARMOR': '0.445', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.735', 'weapon3': '1.338', 'weapon2': '1.716', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:15,280][2409097] DAMAGECOUNT value on done: 2224.0
[2023-02-25 12:52:15,281][2409097] Sum rewards: 3.234, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.496', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.040', 'weapon5': '0.072', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.188', 'ARMOR': '0.515', 'HITCOUNT': '0.550', 'WEAPON3': '0.650', 'weapon2': '1.260', 'weapon3': '1.460', 'DAMAGECOUNT': '2.184', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:15,430][2409099] DAMAGECOUNT value on done: 1969.0
[2023-02-25 12:52:15,433][2409099] Sum rewards: -2.571, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.050', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.015', 'weapon4': '0.070', 'weapon5': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.128', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.420', 'WEAPON3': '0.850', 'weapon2': '1.440', 'weapon3': '1.596', 'DAMAGECOUNT': '1.842', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:15,549][2409074] Updated weights for policy 0, policy_version 12311 (0.0012)
[2023-02-25 12:52:15,565][2409469] DAMAGECOUNT value on done: 2579.0
[2023-02-25 12:52:15,566][2409469] Sum rewards: 0.397, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.196', 'AMMO2': '0.006', 'AMMO5': '0.022', 'AMMO4': '0.031', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.114', 'AMMO3': '0.135', 'weapon5': '0.232', 'HITCOUNT': '0.390', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'weapon2': '0.998', 'DAMAGECOUNT': '1.896', 'weapon3': '2.198', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:15,704][2409485] DAMAGECOUNT value on done: 1606.0
[2023-02-25 12:52:15,708][2409485] Sum rewards: -1.504, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.946', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.015', 'weapon5': '0.034', 'AMMO4': '0.076', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'HITCOUNT': '0.390', 'weapon4': '0.398', 'ARMOR': '0.854', 'WEAPON3': '0.900', 'weapon2': '1.198', 'DAMAGECOUNT': '1.389', 'weapon3': '1.818', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:15,935][2409079] DAMAGECOUNT value on done: 3124.0
[2023-02-25 12:52:15,938][2409079] Sum rewards: 6.202, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.880', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'WEAPON4': '0.100', 'weapon4': '0.124', 'weapon5': '0.138', 'AMMO3': '0.143', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.400', 'HITCOUNT': '0.540', 'WEAPON3': '0.850', 'weapon3': '1.486', 'weapon2': '1.700', 'ARMOR': '1.809', 'DAMAGECOUNT': '2.436', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:52:15,948][2409597] DAMAGECOUNT value on done: 2239.0
[2023-02-25 12:52:15,949][2409597] Sum rewards: 4.468, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.376', 'AMMO4': '-0.043', 'AMMO2': '-0.008', 'AMMO5': '0.019', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'weapon5': '0.132', 'weapon4': '0.184', 'WEAPON5': '0.350', 'HITCOUNT': '0.500', 'WEAPON3': '0.600', 'ARMOR': '0.800', 'weapon3': '1.126', 'weapon2': '1.678', 'DAMAGECOUNT': '1.830', 'FRAGCOUNT': '4.500'}
[2023-02-25 12:52:16,071][2409548] DAMAGECOUNT value on done: 1845.0
[2023-02-25 12:52:16,072][2409548] Sum rewards: 3.862, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.005', 'AMMO2': '0.015', 'ARMOR': '0.044', 'AMMO3': '0.058', 'HEALTH': '0.066', 'AMMO4': '0.075', 'WEAPON5': '0.150', 'HITCOUNT': '0.170', 'weapon5': '0.178', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'weapon2': '0.468', 'weapon4': '0.676', 'weapon3': '1.048', 'DAMAGECOUNT': '1.308', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:16,471][2409389] DAMAGECOUNT value on done: 3626.0
[2023-02-25 12:52:16,472][2409389] Sum rewards: 6.789, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.248', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.005', 'AMMO3': '0.097', 'weapon5': '0.172', 'WEAPON5': '0.200', 'HITCOUNT': '0.690', 'WEAPON3': '0.700', 'ARMOR': '0.850', 'weapon2': '1.126', 'weapon3': '1.456', 'DAMAGECOUNT': '2.985', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:16,841][2409076] DAMAGECOUNT value on done: 1779.0
[2023-02-25 12:52:16,842][2409076] Sum rewards: 3.521, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.377', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'WEAPON4': '0.050', 'weapon5': '0.070', 'AMMO3': '0.098', 'weapon4': '0.146', 'HITCOUNT': '0.370', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'weapon3': '1.604', 'DAMAGECOUNT': '1.641', 'weapon2': '1.728', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:17,023][2409407] DAMAGECOUNT value on done: 2624.0
[2023-02-25 12:52:17,026][2409407] Sum rewards: 4.038, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.482', 'AMMO5': '0.014', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'AMMO3': '0.102', 'AMMO4': '0.106', 'weapon5': '0.144', 'WEAPON4': '0.150', 'weapon4': '0.200', 'WEAPON5': '0.350', 'ARMOR': '0.424', 'HITCOUNT': '0.440', 'WEAPON3': '0.750', 'weapon2': '1.132', 'DAMAGECOUNT': '1.650', 'weapon3': '1.996', 'FRAGCOUNT': '5.500'}
[2023-02-25 12:52:17,186][2408954] Fps is (10 sec: 24576.1, 60 sec: 25327.0, 300 sec: 25492.4). Total num frames: 50450432. Throughput: 0: 6326.9. Samples: 12622044. Policy #0 lag: (min: 1.0, avg: 12.1, max: 25.0)
[2023-02-25 12:52:17,186][2408954] Avg episode reward: [(0, '2.754')]
[2023-02-25 12:52:17,197][2409033] Saving /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000012318_50454528.pth...
[2023-02-25 12:52:17,239][2409102] DAMAGECOUNT value on done: 2187.0
[2023-02-25 12:52:17,240][2409102] Sum rewards: 1.472, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.662', 'AMMO5': '0.015', 'weapon5': '0.034', 'ARMOR': '0.040', 'WEAPON1': '0.040', 'AMMO2': '0.054', 'AMMO3': '0.163', 'AMMO4': '0.269', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'HITCOUNT': '0.460', 'weapon2': '0.538', 'weapon4': '0.708', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.665', 'weapon3': '2.098', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:17,251][2409075] DAMAGECOUNT value on done: 2298.0
[2023-02-25 12:52:17,252][2409075] Sum rewards: 2.703, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.205', 'AMMO5': '0.012', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.098', 'AMMO3': '0.116', 'weapon5': '0.116', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.410', 'weapon4': '0.476', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.293', 'weapon3': '1.294', 'weapon2': '1.350', 'ARMOR': '1.752', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:17,268][2409104] DAMAGECOUNT value on done: 1862.0
[2023-02-25 12:52:17,287][2409373] DAMAGECOUNT value on done: 2497.0
[2023-02-25 12:52:17,288][2409373] Sum rewards: 9.513, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'AMMO3': '0.076', 'AMMO4': '0.077', 'HEALTH': '0.082', 'weapon5': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.310', 'HITCOUNT': '0.390', 'WEAPON3': '0.500', 'weapon3': '1.414', 'weapon2': '1.458', 'DAMAGECOUNT': '2.325', 'FRAGCOUNT': '9.000'}
[2023-02-25 12:52:17,295][2409033] Removing /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000010819_44314624.pth
[2023-02-25 12:52:17,343][2409406] DAMAGECOUNT value on done: 2535.0
[2023-02-25 12:52:17,343][2409406] Sum rewards: 3.527, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.319', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.018', 'weapon4': '0.024', 'weapon7': '0.068', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.188', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.480', 'WEAPON3': '0.600', 'ARMOR': '0.800', 'weapon3': '1.254', 'weapon2': '2.142', 'DAMAGECOUNT': '2.817', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:17,490][2409074] Updated weights for policy 0, policy_version 12321 (0.0012)
[2023-02-25 12:52:17,862][2409096] DAMAGECOUNT value on done: 2199.0
[2023-02-25 12:52:17,865][2409486] DAMAGECOUNT value on done: 2444.0
[2023-02-25 12:52:17,865][2409096] Sum rewards: 2.279, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.281', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.024', 'WEAPON1': '0.030', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'weapon5': '0.120', 'WEAPON5': '0.150', 'HITCOUNT': '0.220', 'weapon4': '0.254', 'ARMOR': '0.436', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.630', 'weapon3': '1.236', 'weapon2': '1.332', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:17,868][2409486] Sum rewards: 7.407, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.734', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.072', 'AMMO3': '0.074', 'weapon4': '0.086', 'weapon5': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.450', 'WEAPON3': '0.550', 'ARMOR': '0.849', 'weapon2': '1.584', 'weapon3': '1.660', 'DAMAGECOUNT': '2.313', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:52:17,880][2409101] DAMAGECOUNT value on done: 2608.0
[2023-02-25 12:52:17,880][2409101] Sum rewards: 0.865, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.175', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.005', 'weapon5': '0.006', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'weapon7': '0.048', 'AMMO3': '0.057', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.430', 'weapon2': '0.914', 'weapon3': '1.100', 'DAMAGECOUNT': '1.278', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:17,944][2409103] DAMAGECOUNT value on done: 2177.0
[2023-02-25 12:52:17,947][2409103] Sum rewards: 1.998, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.114', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'weapon5': '0.048', 'AMMO3': '0.077', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'HITCOUNT': '0.160', 'weapon7': '0.198', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'ARMOR': '0.444', 'weapon4': '0.638', 'DAMAGECOUNT': '0.642', 'weapon3': '0.798', 'weapon2': '0.832', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:52:17,985][2409866] DAMAGECOUNT value on done: 2265.0
[2023-02-25 12:52:17,986][2409866] Sum rewards: 6.922, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.859', 'AMMO2': '0.004', 'AMMO5': '0.010', 'weapon7': '0.016', 'AMMO4': '0.022', 'WEAPON1': '0.040', 'AMMO3': '0.080', 'weapon5': '0.114', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.388', 'HITCOUNT': '0.480', 'ARMOR': '0.500', 'WEAPON3': '0.650', 'weapon2': '1.314', 'weapon3': '1.656', 'DAMAGECOUNT': '1.707', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:18,252][2409549] DAMAGECOUNT value on done: 2746.0
[2023-02-25 12:52:18,252][2409565] DAMAGECOUNT value on done: 1798.0
[2023-02-25 12:52:18,255][2409549] Sum rewards: 4.231, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.806', 'AMMO2': '0.003', 'weapon5': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.016', 'ARMOR': '0.077', 'AMMO3': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.450', 'HITCOUNT': '0.550', 'WEAPON3': '0.700', 'weapon2': '0.888', 'DAMAGECOUNT': '1.878', 'weapon3': '1.944', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:18,255][2409565] Sum rewards: -0.908, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.088', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.158', 'WEAPON4': '0.350', 'HITCOUNT': '0.420', 'weapon4': '0.544', 'WEAPON3': '0.650', 'ARMOR': '0.878', 'DAMAGECOUNT': '1.140', 'weapon3': '1.298', 'weapon2': '1.408', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:18,285][2409100] DAMAGECOUNT value on done: 2060.0
[2023-02-25 12:52:18,286][2409100] Sum rewards: 1.309, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.932', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.026', 'weapon5': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'AMMO4': '0.128', 'WEAPON5': '0.300', 'HITCOUNT': '0.690', 'WEAPON3': '0.800', 'ARMOR': '0.800', 'weapon2': '1.494', 'weapon3': '1.790', 'DAMAGECOUNT': '2.889', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:52:18,356][2409077] DAMAGECOUNT value on done: 2265.0
[2023-02-25 12:52:18,357][2409077] Sum rewards: 3.308, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.990', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'weapon5': '0.060', 'AMMO3': '0.070', 'WEAPON5': '0.150', 'weapon4': '0.228', 'HITCOUNT': '0.460', 'WEAPON3': '0.550', 'weapon2': '1.254', 'DAMAGECOUNT': '1.410', 'weapon3': '1.536', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:18,464][2409405] DAMAGECOUNT value on done: 2225.0
[2023-02-25 12:52:18,466][2409405] Sum rewards: 5.547, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.200', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'weapon5': '0.038', 'AMMO4': '0.053', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.112', 'WEAPON5': '0.150', 'ARMOR': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.590', 'weapon3': '1.390', 'weapon2': '1.748', 'DAMAGECOUNT': '2.148', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:18,758][2409105] DAMAGECOUNT value on done: 1784.0
[2023-02-25 12:52:18,759][2409105] Sum rewards: 0.299, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.622', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO5': '0.013', 'AMMO3': '0.065', 'WEAPON1': '0.070', 'HITCOUNT': '0.130', 'weapon5': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.350', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.696', 'weapon2': '0.862', 'weapon3': '0.924', 'ARMOR': '0.934', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:18,805][2409596] DAMAGECOUNT value on done: 2621.0
[2023-02-25 12:52:18,806][2409596] Sum rewards: 2.321, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.414', 'AMMO5': '0.009', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'weapon5': '0.046', 'AMMO4': '0.089', 'AMMO3': '0.114', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.330', 'ARMOR': '0.420', 'HITCOUNT': '0.610', 'WEAPON3': '0.750', 'weapon2': '0.946', 'DAMAGECOUNT': '1.731', 'weapon3': '2.242', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:18,978][2409074] Updated weights for policy 0, policy_version 12331 (0.0012)
[2023-02-25 12:52:18,990][2409547] DAMAGECOUNT value on done: 2190.0
[2023-02-25 12:52:18,990][2409547] Sum rewards: 2.545, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.578', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.029', 'WEAPON1': '0.040', 'AMMO3': '0.089', 'weapon4': '0.124', 'AMMO4': '0.145', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.410', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.287', 'weapon2': '1.510', 'weapon3': '1.520', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:19,128][2409078] DAMAGECOUNT value on done: 2421.0
[2023-02-25 12:52:19,131][2409078] Sum rewards: 4.671, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.265', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO3': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.060', 'WEAPON3': '0.300', 'HITCOUNT': '0.410', 'weapon3': '0.958', 'DAMAGECOUNT': '1.212', 'weapon2': '1.916', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:19,135][2409355] DAMAGECOUNT value on done: 2686.0
[2023-02-25 12:52:19,140][2409355] Sum rewards: 4.804, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.276', 'AMMO5': '0.003', 'AMMO2': '0.020', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'weapon7': '0.090', 'AMMO4': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.200', 'HITCOUNT': '0.260', 'WEAPON3': '0.350', 'ARMOR': '0.492', 'weapon4': '0.684', 'weapon2': '1.002', 'DAMAGECOUNT': '1.089', 'weapon3': '1.142', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:19,262][2409485] DAMAGECOUNT value on done: 2055.0
[2023-02-25 12:52:19,263][2409485] Sum rewards: -0.741, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.868', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'WEAPON4': '0.350', 'HITCOUNT': '0.360', 'weapon4': '0.538', 'WEAPON3': '0.750', 'ARMOR': '0.927', 'DAMAGECOUNT': '1.218', 'weapon2': '1.410', 'weapon3': '1.496', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:19,432][2409099] DAMAGECOUNT value on done: 2558.0
[2023-02-25 12:52:19,437][2409099] Sum rewards: 4.566, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.160', 'AMMO2': '0.005', 'weapon5': '0.014', 'AMMO5': '0.015', 'AMMO4': '0.026', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.358', 'ARMOR': '0.400', 'HITCOUNT': '0.710', 'WEAPON3': '0.900', 'weapon2': '1.242', 'weapon3': '1.918', 'DAMAGECOUNT': '2.655', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:52:19,523][2409469] DAMAGECOUNT value on done: 1752.0
[2023-02-25 12:52:19,528][2409469] Sum rewards: 4.269, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.008', 'HEALTH': '0.014', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'weapon5': '0.056', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.158', 'HITCOUNT': '0.270', 'WEAPON3': '0.350', 'weapon3': '0.848', 'ARMOR': '0.910', 'DAMAGECOUNT': '1.275', 'weapon2': '1.606', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:19,625][2409097] DAMAGECOUNT value on done: 2011.0
[2023-02-25 12:52:19,630][2409097] Sum rewards: 1.638, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.503', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon5': '0.026', 'weapon7': '0.084', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.124', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.226', 'HITCOUNT': '0.550', 'WEAPON3': '0.700', 'ARMOR': '0.874', 'weapon2': '1.364', 'weapon3': '1.664', 'DAMAGECOUNT': '2.061', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:19,788][2409548] DAMAGECOUNT value on done: 2524.0
[2023-02-25 12:52:19,789][2409548] Sum rewards: 0.835, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.638', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon4': '0.060', 'weapon5': '0.072', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.109', 'HITCOUNT': '0.260', 'ARMOR': '0.464', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.050', 'weapon3': '1.568', 'weapon2': '1.856', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:19,793][2409597] DAMAGECOUNT value on done: 2342.0
[2023-02-25 12:52:19,794][2409597] Sum rewards: 3.956, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.562', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'weapon5': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'weapon4': '0.338', 'HITCOUNT': '0.540', 'WEAPON3': '0.600', 'weapon2': '0.924', 'weapon3': '1.386', 'ARMOR': '1.708', 'DAMAGECOUNT': '2.205', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:19,818][2409079] DAMAGECOUNT value on done: 2057.0
[2023-02-25 12:52:19,819][2409079] Sum rewards: 1.092, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.288', 'AMMO5': '0.007', 'weapon5': '0.024', 'WEAPON1': '0.030', 'AMMO2': '0.046', 'ARMOR': '0.052', 'AMMO3': '0.112', 'WEAPON5': '0.150', 'AMMO4': '0.231', 'WEAPON4': '0.250', 'HITCOUNT': '0.520', 'WEAPON3': '0.700', 'weapon4': '0.746', 'weapon2': '0.820', 'DAMAGECOUNT': '1.701', 'weapon3': '1.740', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:20,264][2409389] DAMAGECOUNT value on done: 1625.0
[2023-02-25 12:52:20,621][2409076] DAMAGECOUNT value on done: 1781.0
[2023-02-25 12:52:20,626][2409076] Sum rewards: -0.896, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.010', 'AMMO5': '0.015', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'AMMO4': '0.142', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'weapon5': '0.202', 'HITCOUNT': '0.260', 'weapon4': '0.276', 'WEAPON5': '0.350', 'ARMOR': '0.486', 'WEAPON3': '0.850', 'weapon2': '1.392', 'DAMAGECOUNT': '1.575', 'weapon3': '1.712', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:20,770][2409074] Updated weights for policy 0, policy_version 12341 (0.0012)
[2023-02-25 12:52:20,853][2409104] DAMAGECOUNT value on done: 1746.0
[2023-02-25 12:52:20,856][2409104] Sum rewards: 0.358, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.050', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon7': '0.062', 'weapon5': '0.082', 'AMMO3': '0.083', 'ARMOR': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.320', 'WEAPON4': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.598', 'weapon2': '0.754', 'DAMAGECOUNT': '1.104', 'weapon3': '1.338', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:20,863][2409407] DAMAGECOUNT value on done: 2324.0
[2023-02-25 12:52:20,867][2409407] Sum rewards: 5.279, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.446', 'AMMO5': '0.005', 'AMMO2': '0.030', 'AMMO3': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'weapon5': '0.156', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.474', 'WEAPON3': '0.500', 'HITCOUNT': '0.590', 'ARMOR': '0.862', 'weapon3': '1.186', 'weapon2': '1.202', 'DAMAGECOUNT': '1.980', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:21,008][2409075] DAMAGECOUNT value on done: 2486.0
[2023-02-25 12:52:21,012][2409075] Sum rewards: 5.857, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.297', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'AMMO4': '0.050', 'AMMO3': '0.062', 'weapon4': '0.106', 'weapon7': '0.134', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HITCOUNT': '0.380', 'WEAPON3': '0.400', 'ARMOR': '0.935', 'DAMAGECOUNT': '1.482', 'weapon3': '1.506', 'weapon2': '1.538', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:21,082][2409373] DAMAGECOUNT value on done: 2909.0
[2023-02-25 12:52:21,086][2409373] Sum rewards: 8.404, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.500', 'AMMO5': '0.012', 'AMMO2': '0.019', 'ARMOR': '0.060', 'AMMO3': '0.087', 'AMMO4': '0.092', 'weapon5': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.392', 'HITCOUNT': '0.450', 'WEAPON3': '0.600', 'weapon4': '0.704', 'weapon3': '1.586', 'DAMAGECOUNT': '3.165', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:52:21,406][2409101] DAMAGECOUNT value on done: 2985.0
[2023-02-25 12:52:21,407][2409101] Sum rewards: 9.427, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.532', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO3': '0.030', 'weapon5': '0.060', 'weapon7': '0.064', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.280', 'WEAPON3': '0.300', 'ARMOR': '0.474', 'HITCOUNT': '0.500', 'weapon3': '0.720', 'weapon2': '0.890', 'DAMAGECOUNT': '2.181', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:52:21,518][2409406] DAMAGECOUNT value on done: 1813.0
[2023-02-25 12:52:21,521][2409406] Sum rewards: -0.703, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.714', 'AMMO5': '0.017', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO3': '0.084', 'AMMO4': '0.103', 'weapon5': '0.120', 'weapon4': '0.122', 'HITCOUNT': '0.190', 'WEAPON5': '0.400', 'ARMOR': '0.433', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.370', 'weapon2': '1.480'}
[2023-02-25 12:52:21,564][2409103] DAMAGECOUNT value on done: 2185.0
[2023-02-25 12:52:21,567][2409103] Sum rewards: 1.333, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.806', 'ARMOR': '0.012', 'AMMO2': '0.013', 'AMMO5': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.085', 'weapon5': '0.120', 'weapon4': '0.124', 'HITCOUNT': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'weapon2': '1.186', 'DAMAGECOUNT': '1.281', 'weapon3': '1.340', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:21,648][2409096] DAMAGECOUNT value on done: 1212.0
[2023-02-25 12:52:21,676][2409102] DAMAGECOUNT value on done: 2684.0
[2023-02-25 12:52:21,679][2409102] Sum rewards: 9.400, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'AMMO3': '0.071', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'weapon4': '0.220', 'weapon5': '0.228', 'HEALTH': '0.288', 'WEAPON5': '0.400', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'ARMOR': '1.314', 'weapon3': '1.560', 'weapon2': '1.662', 'DAMAGECOUNT': '2.181', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:52:21,772][2409486] DAMAGECOUNT value on done: 2155.0
[2023-02-25 12:52:21,773][2409486] Sum rewards: -2.777, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.914', 'AMMO2': '0.005', 'weapon4': '0.008', 'AMMO4': '0.024', 'AMMO5': '0.026', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon5': '0.102', 'AMMO3': '0.120', 'HITCOUNT': '0.170', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'DAMAGECOUNT': '0.690', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.466', 'weapon3': '1.796'}
[2023-02-25 12:52:21,792][2409866] DAMAGECOUNT value on done: 2406.0
[2023-02-25 12:52:21,795][2409866] Sum rewards: 1.710, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.420', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'weapon5': '0.066', 'AMMO4': '0.094', 'HITCOUNT': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.382', 'WEAPON3': '0.400', 'ARMOR': '0.482', 'DAMAGECOUNT': '0.630', 'weapon3': '1.154', 'weapon2': '1.240', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:21,942][2409100] DAMAGECOUNT value on done: 2390.0
[2023-02-25 12:52:21,942][2409100] Sum rewards: -2.321, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.870', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'weapon7': '0.062', 'AMMO4': '0.071', 'weapon5': '0.092', 'AMMO3': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.308', 'WEAPON4': '0.350', 'ARMOR': '0.456', 'HITCOUNT': '0.490', 'WEAPON3': '0.700', 'weapon3': '1.290', 'weapon2': '1.376', 'DAMAGECOUNT': '1.470', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:21,979][2409549] DAMAGECOUNT value on done: 2739.0
[2023-02-25 12:52:21,980][2409549] Sum rewards: 5.726, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.133', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON1': '0.030', 'weapon5': '0.030', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'weapon4': '0.304', 'ARMOR': '0.436', 'HITCOUNT': '0.670', 'WEAPON3': '0.800', 'weapon2': '1.286', 'weapon3': '1.690', 'DAMAGECOUNT': '2.646', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:52:22,101][2409405] DAMAGECOUNT value on done: 2517.0
[2023-02-25 12:52:22,101][2409405] Sum rewards: 3.298, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.628', 'AMMO2': '0.002', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.011', 'AMMO3': '0.070', 'weapon5': '0.114', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.500', 'WEAPON3': '0.500', 'weapon4': '0.530', 'ARMOR': '0.862', 'weapon3': '1.296', 'weapon2': '1.580', 'DAMAGECOUNT': '1.590', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:22,186][2408954] Fps is (10 sec: 24985.7, 60 sec: 25258.7, 300 sec: 25534.1). Total num frames: 50585600. Throughput: 0: 6324.8. Samples: 12640860. Policy #0 lag: (min: 0.0, avg: 14.7, max: 25.0)
[2023-02-25 12:52:22,186][2408954] Avg episode reward: [(0, '3.055')]
[2023-02-25 12:52:22,192][2409033] Saving new best policy, reward=3.055!
[2023-02-25 12:52:22,199][2409074] Updated weights for policy 0, policy_version 12351 (0.0012)
[2023-02-25 12:52:22,382][2409596] DAMAGECOUNT value on done: 1994.0
[2023-02-25 12:52:22,385][2409596] Sum rewards: 0.860, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.754', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'AMMO3': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'WEAPON4': '0.250', 'HITCOUNT': '0.350', 'weapon4': '0.392', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.999', 'weapon2': '1.346', 'weapon3': '1.376', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:22,413][2409077] DAMAGECOUNT value on done: 2699.0
[2023-02-25 12:52:22,414][2409077] Sum rewards: 5.177, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.078', 'weapon4': '0.080', 'AMMO4': '0.127', 'weapon5': '0.134', 'WEAPON5': '0.150', 'HITCOUNT': '0.300', 'WEAPON3': '0.400', 'HEALTH': '0.610', 'ARMOR': '0.864', 'weapon3': '1.176', 'DAMAGECOUNT': '1.695', 'weapon2': '2.210', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:22,436][2409105] DAMAGECOUNT value on done: 2702.0
[2023-02-25 12:52:22,438][2409105] Sum rewards: 10.722, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.044', 'AMMO3': '0.067', 'WEAPON4': '0.100', 'HEALTH': '0.128', 'weapon5': '0.152', 'WEAPON5': '0.200', 'weapon4': '0.222', 'WEAPON3': '0.400', 'ARMOR': '0.456', 'HITCOUNT': '0.650', 'weapon2': '1.064', 'weapon3': '1.376', 'DAMAGECOUNT': '3.336', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:52:22,703][2409565] DAMAGECOUNT value on done: 2560.0
[2023-02-25 12:52:22,706][2409565] Sum rewards: 0.670, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.278', 'AMMO5': '0.003', 'weapon5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.115', 'AMMO4': '0.161', 'WEAPON4': '0.300', 'HITCOUNT': '0.410', 'weapon4': '0.604', 'WEAPON3': '0.700', 'ARMOR': '0.932', 'weapon2': '1.136', 'weapon3': '1.338', 'DAMAGECOUNT': '1.389', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:22,770][2409078] DAMAGECOUNT value on done: 1867.0
[2023-02-25 12:52:22,773][2409078] Sum rewards: 2.674, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.252', 'AMMO5': '0.018', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'AMMO3': '0.067', 'weapon5': '0.100', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'HITCOUNT': '0.320', 'weapon4': '0.378', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.837', 'ARMOR': '0.893', 'weapon2': '1.150', 'weapon3': '1.362', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:22,795][2409355] DAMAGECOUNT value on done: 2396.0
[2023-02-25 12:52:22,795][2409355] Sum rewards: 3.872, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.180', 'AMMO5': '0.005', 'AMMO2': '0.027', 'ARMOR': '0.048', 'AMMO3': '0.129', 'AMMO4': '0.136', 'WEAPON4': '0.250', 'HITCOUNT': '0.330', 'weapon4': '0.508', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.050', 'weapon2': '1.178', 'weapon3': '1.640', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:23,105][2409485] DAMAGECOUNT value on done: 1929.0
[2023-02-25 12:52:23,115][2409485] Sum rewards: 2.655, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.257', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.022', 'WEAPON1': '0.060', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'weapon5': '0.176', 'WEAPON5': '0.200', 'weapon4': '0.246', 'HITCOUNT': '0.400', 'ARMOR': '0.436', 'WEAPON3': '0.600', 'weapon3': '1.386', 'DAMAGECOUNT': '1.542', 'weapon2': '1.652', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:23,128][2409547] DAMAGECOUNT value on done: 2424.0
[2023-02-25 12:52:23,131][2409547] Sum rewards: 2.142, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.411', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'AMMO3': '0.066', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'weapon4': '0.196', 'WEAPON4': '0.200', 'HITCOUNT': '0.350', 'WEAPON3': '0.400', 'weapon3': '0.902', 'DAMAGECOUNT': '1.191', 'ARMOR': '1.293', 'weapon2': '1.764', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:23,138][2409469] DAMAGECOUNT value on done: 2295.0
[2023-02-25 12:52:23,138][2409469] Sum rewards: 2.458, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.472', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.008', 'weapon7': '0.052', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.252', 'weapon5': '0.266', 'HITCOUNT': '0.310', 'ARMOR': '0.420', 'WEAPON3': '0.750', 'weapon2': '1.258', 'weapon3': '1.304', 'DAMAGECOUNT': '1.641', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:23,313][2409548] DAMAGECOUNT value on done: 2465.0
[2023-02-25 12:52:23,317][2409548] Sum rewards: 2.331, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.076', 'weapon5': '0.104', 'weapon4': '0.198', 'WEAPON5': '0.200', 'HEALTH': '0.312', 'WEAPON3': '0.400', 'HITCOUNT': '0.410', 'ARMOR': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.118', 'DAMAGECOUNT': '1.371', 'weapon2': '1.424'}
[2023-02-25 12:52:23,439][2409597] DAMAGECOUNT value on done: 2724.0
[2023-02-25 12:52:23,440][2409597] Sum rewards: 0.510, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.276', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.060', 'WEAPON1': '0.080', 'AMMO4': '0.081', 'AMMO3': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.300', 'weapon4': '0.352', 'ARMOR': '0.483', 'WEAPON3': '0.700', 'weapon3': '1.228', 'DAMAGECOUNT': '1.362', 'weapon2': '1.860', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:23,498][2409074] Updated weights for policy 0, policy_version 12361 (0.0013)
[2023-02-25 12:52:23,522][2409099] DAMAGECOUNT value on done: 2923.0
[2023-02-25 12:52:23,531][2409099] Sum rewards: 6.555, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.825', 'AMMO2': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.012', 'weapon7': '0.014', 'AMMO4': '0.018', 'AMMO3': '0.061', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.430', 'WEAPON3': '0.450', 'HITCOUNT': '0.560', 'weapon2': '1.152', 'weapon3': '1.516', 'DAMAGECOUNT': '1.695', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:23,549][2409373] Large shaping reward 2.623 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.591, 197.0), ('weapon7', 0.002)]
[2023-02-25 12:52:23,648][2409097] DAMAGECOUNT value on done: 1630.0
[2023-02-25 12:52:23,651][2409097] Sum rewards: 3.798, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.380', 'AMMO5': '0.005', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.027', 'AMMO3': '0.064', 'WEAPON4': '0.100', 'weapon4': '0.216', 'HITCOUNT': '0.480', 'ARMOR': '0.481', 'WEAPON3': '0.500', 'weapon3': '1.178', 'DAMAGECOUNT': '1.392', 'weapon2': '2.210', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:24,225][2409079] DAMAGECOUNT value on done: 3121.0
[2023-02-25 12:52:24,228][2409079] Sum rewards: 9.037, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.762', 'AMMO2': '0.003', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO4': '0.013', 'AMMO3': '0.052', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.272', 'WEAPON3': '0.450', 'HITCOUNT': '0.550', 'weapon3': '1.182', 'weapon2': '1.568', 'DAMAGECOUNT': '3.003', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:52:24,473][2409104] DAMAGECOUNT value on done: 1993.0
[2023-02-25 12:52:24,473][2409104] Sum rewards: -0.832, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.359', 'AMMO5': '0.009', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.090', 'AMMO4': '0.095', 'AMMO3': '0.113', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.368', 'HITCOUNT': '0.380', 'ARMOR': '0.456', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.215', 'weapon2': '1.464', 'weapon3': '1.698', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:24,491][2409389] DAMAGECOUNT value on done: 2496.0
[2023-02-25 12:52:24,493][2409389] Sum rewards: 2.584, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.066', 'HEALTH': '0.070', 'AMMO3': '0.070', 'weapon7': '0.082', 'AMMO4': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.310', 'WEAPON3': '0.400', 'ARMOR': '0.424', 'weapon4': '0.440', 'weapon2': '1.150', 'weapon3': '1.298', 'DAMAGECOUNT': '1.338', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:24,767][2409076] DAMAGECOUNT value on done: 2761.0
[2023-02-25 12:52:24,770][2409076] Sum rewards: 1.694, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.567', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO3': '0.040', 'weapon5': '0.072', 'AMMO4': '0.075', 'WEAPON5': '0.150', 'HITCOUNT': '0.160', 'weapon7': '0.174', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.300', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'weapon4': '0.620', 'weapon2': '0.728', 'weapon3': '0.782', 'ARMOR': '0.855', 'DAMAGECOUNT': '1.245', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:25,162][2409102] DAMAGECOUNT value on done: 2264.0
[2023-02-25 12:52:25,163][2409102] Sum rewards: 0.437, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.718', 'AMMO5': '0.005', 'weapon5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO3': '0.081', 'AMMO4': '0.121', 'HITCOUNT': '0.290', 'WEAPON4': '0.300', 'ARMOR': '0.415', 'WEAPON3': '0.500', 'weapon4': '0.538', 'DAMAGECOUNT': '0.732', 'weapon3': '1.394', 'weapon2': '1.416', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:25,205][2409373] DAMAGECOUNT value on done: 3148.0
[2023-02-25 12:52:25,208][2409373] Sum rewards: 6.008, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.590', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.039', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.420', 'WEAPON3': '0.500', 'HITCOUNT': '0.520', 'ARMOR': '0.800', 'weapon3': '1.178', 'DAMAGECOUNT': '1.638', 'weapon2': '1.894', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:52:25,304][2409407] DAMAGECOUNT value on done: 2574.0
[2023-02-25 12:52:25,304][2409407] Sum rewards: -0.632, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.046', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON1': '0.060', 'AMMO3': '0.115', 'weapon5': '0.130', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.300', 'ARMOR': '0.424', 'weapon4': '0.430', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.879', 'weapon3': '1.344', 'weapon2': '1.716', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:25,349][2409075] DAMAGECOUNT value on done: 2795.0
[2023-02-25 12:52:25,350][2409075] Sum rewards: 5.717, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'weapon5': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.082', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'weapon4': '0.216', 'WEAPON3': '0.400', 'HITCOUNT': '0.450', 'HEALTH': '0.610', 'ARMOR': '0.928', 'weapon2': '1.356', 'weapon3': '1.596', 'DAMAGECOUNT': '1.668', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:25,381][2409101] DAMAGECOUNT value on done: 2710.0
[2023-02-25 12:52:25,383][2409101] Sum rewards: 1.620, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.451', 'AMMO5': '0.010', 'AMMO2': '0.011', 'ARMOR': '0.036', 'WEAPON1': '0.040', 'AMMO4': '0.052', 'weapon5': '0.058', 'AMMO3': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.250', 'HITCOUNT': '0.410', 'WEAPON3': '0.850', 'weapon2': '1.088', 'weapon3': '1.666', 'DAMAGECOUNT': '1.770', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:25,434][2409096] DAMAGECOUNT value on done: 2516.0
[2023-02-25 12:52:25,436][2409096] Sum rewards: 9.392, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.953', 'AMMO2': '0.010', 'AMMO5': '0.015', 'weapon4': '0.018', 'WEAPON1': '0.040', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'AMMO3': '0.099', 'weapon5': '0.118', 'WEAPON5': '0.350', 'HITCOUNT': '0.510', 'WEAPON3': '0.600', 'ARMOR': '0.880', 'weapon2': '1.402', 'weapon3': '1.864', 'DAMAGECOUNT': '2.340', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:52:25,490][2409406] DAMAGECOUNT value on done: 2101.0
[2023-02-25 12:52:25,493][2409406] Sum rewards: 4.236, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO2': '0.041', 'AMMO3': '0.060', 'weapon5': '0.076', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO4': '0.203', 'WEAPON3': '0.300', 'HITCOUNT': '0.310', 'ARMOR': '0.416', 'weapon4': '0.530', 'HEALTH': '0.578', 'weapon3': '1.300', 'weapon2': '1.394', 'DAMAGECOUNT': '1.890', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:52:25,517][2409866] DAMAGECOUNT value on done: 2381.0
[2023-02-25 12:52:25,519][2409866] Sum rewards: 3.600, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.824', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.123', 'WEAPON4': '0.200', 'weapon5': '0.218', 'WEAPON5': '0.250', 'weapon4': '0.292', 'ARMOR': '0.412', 'HITCOUNT': '0.570', 'WEAPON3': '0.750', 'weapon2': '1.014', 'weapon3': '1.506', 'DAMAGECOUNT': '2.928', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:25,578][2409103] DAMAGECOUNT value on done: 2641.0
[2023-02-25 12:52:25,580][2409103] Sum rewards: -0.695, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.941', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'weapon5': '0.054', 'AMMO4': '0.064', 'AMMO3': '0.105', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.300', 'HITCOUNT': '0.400', 'ARMOR': '0.432', 'WEAPON3': '0.800', 'weapon2': '0.900', 'DAMAGECOUNT': '1.275', 'weapon3': '1.838', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:25,636][2409074] Updated weights for policy 0, policy_version 12371 (0.0012)
[2023-02-25 12:52:25,742][2409405] DAMAGECOUNT value on done: 2163.0
[2023-02-25 12:52:25,746][2409405] Sum rewards: 3.297, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.980', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO3': '0.107', 'weapon5': '0.238', 'HITCOUNT': '0.290', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'ARMOR': '0.851', 'DAMAGECOUNT': '1.038', 'weapon2': '1.418', 'weapon3': '1.672', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:25,751][2409549] DAMAGECOUNT value on done: 2344.0
[2023-02-25 12:52:25,752][2409549] Sum rewards: 1.439, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.002', 'AMMO2': '0.007', 'AMMO5': '0.012', 'AMMO4': '0.034', 'ARMOR': '0.036', 'WEAPON1': '0.040', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'weapon5': '0.150', 'weapon4': '0.182', 'WEAPON5': '0.300', 'HITCOUNT': '0.390', 'WEAPON3': '0.750', 'weapon2': '1.402', 'DAMAGECOUNT': '1.794', 'weapon3': '1.834', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:25,865][2409486] DAMAGECOUNT value on done: 1812.0
[2023-02-25 12:52:26,036][2409596] DAMAGECOUNT value on done: 1779.0
[2023-02-25 12:52:26,039][2409596] Sum rewards: 0.199, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.054', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'weapon4': '0.016', 'WEAPON1': '0.030', 'AMMO3': '0.061', 'weapon5': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.270', 'ARMOR': '0.489', 'WEAPON3': '0.500', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '1.005', 'weapon2': '1.216', 'weapon3': '1.426'}
[2023-02-25 12:52:26,077][2409105] DAMAGECOUNT value on done: 2752.0
[2023-02-25 12:52:26,077][2409105] Sum rewards: 0.319, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.260', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.075', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'weapon5': '0.188', 'WEAPON5': '0.200', 'weapon4': '0.282', 'HITCOUNT': '0.440', 'WEAPON3': '0.550', 'ARMOR': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.316', 'DAMAGECOUNT': '1.371', 'weapon3': '1.600'}
[2023-02-25 12:52:26,287][2409077] DAMAGECOUNT value on done: 2133.0
[2023-02-25 12:52:26,302][2409077] Sum rewards: 7.392, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.022', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'AMMO4': '0.107', 'HITCOUNT': '0.270', 'weapon4': '0.292', 'WEAPON3': '0.350', 'HEALTH': '0.585', 'DAMAGECOUNT': '0.921', 'weapon3': '1.042', 'ARMOR': '1.413', 'weapon2': '1.480', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:52:26,397][2409078] DAMAGECOUNT value on done: 1701.0
[2023-02-25 12:52:26,398][2409078] Sum rewards: 3.566, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.826', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon5': '0.056', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'WEAPON5': '0.250', 'weapon4': '0.386', 'ARMOR': '0.420', 'HITCOUNT': '0.440', 'WEAPON3': '0.650', 'weapon2': '1.128', 'DAMAGECOUNT': '1.446', 'weapon3': '1.516', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:26,435][2409565] DAMAGECOUNT value on done: 2373.0
[2023-02-25 12:52:26,436][2409565] Sum rewards: -2.825, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.030', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO5': '0.018', 'weapon5': '0.026', 'AMMO4': '0.086', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'weapon4': '0.214', 'WEAPON5': '0.350', 'ARMOR': '0.432', 'HITCOUNT': '0.440', 'WEAPON3': '1.000', 'weapon2': '1.094', 'DAMAGECOUNT': '1.584', 'FRAGCOUNT': '2.000', 'weapon3': '2.136'}
[2023-02-25 12:52:26,636][2409355] DAMAGECOUNT value on done: 2656.0
[2023-02-25 12:52:26,637][2409355] Sum rewards: 2.457, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-2.030', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.059', 'weapon5': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.457', 'WEAPON3': '0.500', 'HITCOUNT': '0.500', 'weapon4': '0.622', 'weapon3': '0.954', 'weapon2': '1.072', 'DAMAGECOUNT': '1.911', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:26,890][2409485] DAMAGECOUNT value on done: 2343.0
[2023-02-25 12:52:26,893][2409485] Sum rewards: 6.020, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.462', 'AMMO5': '0.015', 'AMMO2': '0.022', 'WEAPON1': '0.060', 'AMMO3': '0.078', 'AMMO4': '0.111', 'weapon5': '0.176', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'HITCOUNT': '0.440', 'WEAPON3': '0.450', 'ARMOR': '0.460', 'weapon4': '0.622', 'weapon3': '1.024', 'weapon2': '1.618', 'DAMAGECOUNT': '2.055', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:52:27,088][2409547] DAMAGECOUNT value on done: 2489.0
[2023-02-25 12:52:27,090][2409074] Updated weights for policy 0, policy_version 12381 (0.0012)
[2023-02-25 12:52:27,089][2409547] Sum rewards: 4.524, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.731', 'AMMO5': '0.015', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.088', 'AMMO3': '0.092', 'weapon5': '0.184', 'weapon4': '0.192', 'WEAPON5': '0.300', 'HITCOUNT': '0.400', 'ARMOR': '0.487', 'WEAPON3': '0.600', 'weapon2': '1.196', 'weapon3': '1.650', 'DAMAGECOUNT': '1.953', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:27,151][2409597] DAMAGECOUNT value on done: 2090.0
[2023-02-25 12:52:27,154][2409597] Sum rewards: -3.723, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.088', 'WEAPON1': '0.010', 'AMMO2': '0.033', 'AMMO5': '0.034', 'AMMO3': '0.119', 'AMMO4': '0.166', 'WEAPON4': '0.250', 'HITCOUNT': '0.260', 'weapon5': '0.266', 'weapon4': '0.314', 'ARMOR': '0.404', 'WEAPON5': '0.700', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.966', 'weapon3': '1.278', 'weapon2': '1.314', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:27,176][2409469] DAMAGECOUNT value on done: 2798.0
[2023-02-25 12:52:27,178][2409469] Sum rewards: 6.966, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.336', 'AMMO5': '0.005', 'AMMO2': '0.040', 'WEAPON1': '0.050', 'weapon5': '0.056', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.198', 'WEAPON4': '0.300', 'HITCOUNT': '0.420', 'ARMOR': '0.456', 'WEAPON3': '0.500', 'weapon4': '0.500', 'weapon3': '1.480', 'weapon2': '1.500', 'DAMAGECOUNT': '2.109', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:52:27,186][2408954] Fps is (10 sec: 26213.6, 60 sec: 25326.8, 300 sec: 25534.0). Total num frames: 50712576. Throughput: 0: 6332.0. Samples: 12679212. Policy #0 lag: (min: 0.0, avg: 14.7, max: 25.0)
[2023-02-25 12:52:27,186][2408954] Avg episode reward: [(0, '2.868')]
[2023-02-25 12:52:27,290][2409099] DAMAGECOUNT value on done: 2385.0
[2023-02-25 12:52:27,291][2409099] Sum rewards: -3.679, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.628', 'AMMO5': '0.012', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'AMMO4': '0.104', 'AMMO3': '0.124', 'weapon5': '0.184', 'HITCOUNT': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.638', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.080', 'ARMOR': '1.310', 'DAMAGECOUNT': '1.461', 'weapon2': '1.554'}
[2023-02-25 12:52:27,304][2409548] DAMAGECOUNT value on done: 2299.0
[2023-02-25 12:52:27,306][2409548] Sum rewards: 5.542, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.015', 'HEALTH': '0.018', 'AMMO2': '0.024', 'ARMOR': '0.052', 'weapon5': '0.086', 'AMMO3': '0.118', 'AMMO4': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.508', 'HITCOUNT': '0.510', 'WEAPON3': '0.700', 'weapon2': '0.972', 'weapon3': '1.838', 'DAMAGECOUNT': '2.580', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:27,512][2409097] DAMAGECOUNT value on done: 1768.0
[2023-02-25 12:52:27,915][2409079] DAMAGECOUNT value on done: 1818.0
[2023-02-25 12:52:27,918][2409079] Sum rewards: -1.125, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.332', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.026', 'WEAPON1': '0.040', 'AMMO4': '0.112', 'AMMO3': '0.122', 'WEAPON5': '0.150', 'HITCOUNT': '0.310', 'WEAPON4': '0.350', 'weapon4': '0.708', 'WEAPON3': '0.850', 'ARMOR': '0.961', 'DAMAGECOUNT': '1.080', 'weapon2': '1.132', 'weapon3': '1.586', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:28,122][2409104] DAMAGECOUNT value on done: 2963.0
[2023-02-25 12:52:28,123][2409104] Sum rewards: 3.024, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.426', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO3': '0.126', 'WEAPON4': '0.150', 'weapon5': '0.164', 'weapon4': '0.266', 'WEAPON5': '0.450', 'ARMOR': '0.452', 'HITCOUNT': '0.630', 'WEAPON3': '0.800', 'weapon3': '1.596', 'weapon2': '1.654', 'DAMAGECOUNT': '2.130', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:28,635][2409389] DAMAGECOUNT value on done: 2443.0
[2023-02-25 12:52:28,635][2409389] Sum rewards: 2.781, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.082', 'AMMO2': '0.010', 'AMMO5': '0.023', 'AMMO4': '0.049', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'weapon5': '0.170', 'HITCOUNT': '0.410', 'weapon4': '0.426', 'WEAPON5': '0.450', 'ARMOR': '0.496', 'WEAPON3': '0.650', 'weapon2': '0.792', 'weapon3': '2.018', 'DAMAGECOUNT': '2.118', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:28,705][2409076] DAMAGECOUNT value on done: 2297.0
[2023-02-25 12:52:28,706][2409076] Sum rewards: 2.741, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.410', 'AMMO5': '0.011', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO3': '0.066', 'AMMO4': '0.088', 'weapon5': '0.120', 'weapon4': '0.248', 'HITCOUNT': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'ARMOR': '0.863', 'DAMAGECOUNT': '0.885', 'weapon3': '1.288', 'weapon2': '1.664', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:28,873][2409101] DAMAGECOUNT value on done: 1743.0
[2023-02-25 12:52:28,874][2409101] Sum rewards: 1.259, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.203', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.055', 'WEAPON1': '0.060', 'AMMO3': '0.066', 'weapon5': '0.098', 'WEAPON5': '0.200', 'HITCOUNT': '0.230', 'WEAPON4': '0.250', 'weapon4': '0.350', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.645', 'ARMOR': '0.820', 'weapon3': '1.118', 'weapon2': '1.798', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:28,977][2409102] DAMAGECOUNT value on done: 2059.0
[2023-02-25 12:52:28,981][2409102] Sum rewards: 1.205, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.916', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON1': '0.040', 'weapon5': '0.052', 'AMMO4': '0.056', 'weapon4': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.124', 'HITCOUNT': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.155', 'weapon2': '1.164', 'weapon3': '1.492', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:29,004][2409407] DAMAGECOUNT value on done: 2159.0
[2023-02-25 12:52:29,004][2409407] Sum rewards: 0.919, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.468', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.041', 'WEAPON1': '0.050', 'AMMO3': '0.081', 'weapon5': '0.114', 'WEAPON4': '0.150', 'AMMO4': '0.203', 'weapon4': '0.260', 'WEAPON5': '0.400', 'HITCOUNT': '0.430', 'WEAPON3': '0.500', 'weapon3': '1.468', 'weapon2': '1.496', 'DAMAGECOUNT': '1.665', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:29,105][2409373] DAMAGECOUNT value on done: 3336.0
[2023-02-25 12:52:29,108][2409373] Sum rewards: 0.095, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.733', 'AMMO5': '0.017', 'AMMO2': '0.029', 'WEAPON1': '0.060', 'AMMO3': '0.097', 'weapon5': '0.098', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'HITCOUNT': '0.280', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.416', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.963', 'weapon2': '1.292', 'weapon3': '1.480', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:29,115][2409074] Updated weights for policy 0, policy_version 12391 (0.0012)
[2023-02-25 12:52:29,197][2409406] DAMAGECOUNT value on done: 2139.0
[2023-02-25 12:52:29,198][2409406] Sum rewards: -1.070, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.584', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon5': '0.014', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.109', 'WEAPON5': '0.150', 'HITCOUNT': '0.210', 'weapon4': '0.278', 'DAMAGECOUNT': '0.522', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.244', 'weapon3': '1.914'}
[2023-02-25 12:52:29,336][2409866] DAMAGECOUNT value on done: 2543.0
[2023-02-25 12:52:29,337][2409866] Sum rewards: 3.180, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.364', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'ARMOR': '0.043', 'AMMO3': '0.059', 'WEAPON4': '0.100', 'weapon4': '0.222', 'HITCOUNT': '0.240', 'WEAPON3': '0.250', 'weapon2': '0.426', 'weapon3': '0.858', 'DAMAGECOUNT': '0.870', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:29,345][2409405] DAMAGECOUNT value on done: 2273.0
[2023-02-25 12:52:29,353][2409405] Sum rewards: 2.897, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.318', 'AMMO5': '0.010', 'weapon5': '0.022', 'AMMO2': '0.022', 'AMMO3': '0.055', 'AMMO4': '0.111', 'weapon7': '0.168', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.250', 'WEAPON3': '0.350', 'WEAPON4': '0.350', 'ARMOR': '0.476', 'weapon3': '0.778', 'weapon2': '0.836', 'weapon4': '0.964', 'DAMAGECOUNT': '1.023', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:29,394][2409075] DAMAGECOUNT value on done: 2421.0
[2023-02-25 12:52:29,398][2409075] Sum rewards: -0.137, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.057', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.012', 'weapon7': '0.052', 'AMMO3': '0.060', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.172', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.380', 'HITCOUNT': '0.410', 'ARMOR': '0.495', 'WEAPON3': '0.500', 'weapon3': '1.350', 'DAMAGECOUNT': '1.482', 'weapon2': '1.612'}
[2023-02-25 12:52:29,399][2409096] DAMAGECOUNT value on done: 2174.0
[2023-02-25 12:52:29,405][2409096] Sum rewards: 0.940, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.294', 'AMMO4': '-0.048', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'weapon5': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.118', 'WEAPON5': '0.150', 'HITCOUNT': '0.290', 'WEAPON3': '0.350', 'weapon3': '0.870', 'ARMOR': '0.883', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.032', 'weapon2': '1.844'}
[2023-02-25 12:52:29,450][2409486] DAMAGECOUNT value on done: 2315.0
[2023-02-25 12:52:29,451][2409486] Sum rewards: 7.632, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.960', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.019', 'WEAPON1': '0.070', 'AMMO3': '0.095', 'WEAPON4': '0.150', 'weapon5': '0.156', 'weapon4': '0.278', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '0.770', 'weapon2': '0.836', 'weapon3': '1.738', 'DAMAGECOUNT': '3.339', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:52:29,707][2409596] DAMAGECOUNT value on done: 2296.0
[2023-02-25 12:52:29,711][2409596] Sum rewards: 0.975, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.892', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO3': '0.040', 'ARMOR': '0.048', 'weapon5': '0.048', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'HITCOUNT': '0.280', 'WEAPON3': '0.300', 'WEAPON4': '0.350', 'weapon3': '0.574', 'weapon4': '0.666', 'DAMAGECOUNT': '0.930', 'weapon2': '0.964', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:29,910][2409105] DAMAGECOUNT value on done: 2643.0
[2023-02-25 12:52:29,913][2409105] Sum rewards: 4.099, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.150', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.041', 'ARMOR': '0.056', 'weapon7': '0.070', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.560', 'weapon4': '0.586', 'WEAPON3': '0.650', 'weapon2': '1.046', 'weapon3': '1.578', 'DAMAGECOUNT': '1.755', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:30,105][2409565] DAMAGECOUNT value on done: 2470.0
[2023-02-25 12:52:30,106][2409565] Sum rewards: 6.046, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.872', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.006', 'AMMO3': '0.050', 'weapon7': '0.066', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.100', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON3': '0.400', 'HITCOUNT': '0.470', 'ARMOR': '0.494', 'weapon4': '0.516', 'weapon3': '1.256', 'weapon2': '1.488', 'DAMAGECOUNT': '1.908', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:30,116][2409074] Updated weights for policy 0, policy_version 12401 (0.0012)
[2023-02-25 12:52:30,185][2409077] DAMAGECOUNT value on done: 2617.0
[2023-02-25 12:52:30,186][2409077] Sum rewards: -1.019, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.780', 'FRAGCOUNT': '0.000', 'AMMO2': '0.010', 'AMMO5': '0.010', 'weapon5': '0.048', 'AMMO4': '0.049', 'AMMO3': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.230', 'HITCOUNT': '0.290', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.957', 'weapon2': '1.242', 'ARMOR': '1.292', 'weapon3': '1.484'}
[2023-02-25 12:52:30,348][2409355] DAMAGECOUNT value on done: 2652.0
[2023-02-25 12:52:30,350][2409355] Sum rewards: 1.922, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.462', 'AMMO2': '0.016', 'AMMO5': '0.020', 'weapon5': '0.050', 'AMMO4': '0.079', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'HITCOUNT': '0.310', 'WEAPON5': '0.350', 'ARMOR': '0.408', 'weapon4': '0.410', 'WEAPON3': '0.500', 'weapon2': '1.040', 'weapon3': '1.340', 'DAMAGECOUNT': '1.431', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:30,384][2409078] DAMAGECOUNT value on done: 2468.0
[2023-02-25 12:52:30,387][2409078] Sum rewards: 9.436, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.160', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.018', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.256', 'WEAPON3': '0.350', 'HITCOUNT': '0.510', 'weapon3': '1.006', 'weapon2': '1.044', 'DAMAGECOUNT': '2.436', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:52:30,578][2409485] DAMAGECOUNT value on done: 2712.0
[2023-02-25 12:52:30,579][2409485] Sum rewards: 4.698, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.619', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.069', 'AMMO4': '0.083', 'weapon5': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.384', 'WEAPON3': '0.450', 'HITCOUNT': '0.470', 'ARMOR': '0.895', 'weapon2': '1.078', 'weapon3': '1.182', 'DAMAGECOUNT': '1.449', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:30,909][2409099] DAMAGECOUNT value on done: 3316.0
[2023-02-25 12:52:30,912][2409099] Sum rewards: 6.859, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.992', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.015', 'ARMOR': '0.024', 'WEAPON1': '0.030', 'weapon5': '0.058', 'AMMO3': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.250', 'WEAPON3': '0.650', 'HITCOUNT': '0.650', 'weapon3': '1.474', 'weapon2': '1.608', 'DAMAGECOUNT': '2.937', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:31,005][2409597] DAMAGECOUNT value on done: 2152.0
[2023-02-25 12:52:31,006][2409597] Sum rewards: 5.259, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.060', 'AMMO4': '-0.078', 'AMMO2': '-0.016', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO3': '0.030', 'weapon5': '0.048', 'weapon7': '0.064', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.200', 'WEAPON3': '0.300', 'ARMOR': '0.456', 'weapon3': '0.742', 'DAMAGECOUNT': '1.416', 'weapon2': '1.594', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:31,072][2409469] DAMAGECOUNT value on done: 2528.0
[2023-02-25 12:52:31,074][2409469] Sum rewards: 4.777, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.029', 'WEAPON4': '0.050', 'AMMO3': '0.108', 'AMMO4': '0.146', 'weapon5': '0.154', 'weapon4': '0.186', 'WEAPON5': '0.250', 'ARMOR': '0.456', 'HITCOUNT': '0.610', 'WEAPON3': '0.650', 'weapon2': '1.392', 'weapon3': '1.938', 'DAMAGECOUNT': '2.277', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:31,093][2409547] DAMAGECOUNT value on done: 3020.0
[2023-02-25 12:52:31,094][2409547] Sum rewards: 1.411, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.934', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.059', 'AMMO3': '0.102', 'weapon5': '0.108', 'WEAPON4': '0.200', 'weapon4': '0.276', 'WEAPON5': '0.300', 'HITCOUNT': '0.400', 'ARMOR': '0.408', 'WEAPON3': '0.550', 'weapon2': '1.218', 'DAMAGECOUNT': '1.395', 'weapon3': '1.784', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:31,202][2409548] DAMAGECOUNT value on done: 2776.0
[2023-02-25 12:52:31,203][2409548] Sum rewards: 5.156, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.252', 'AMMO5': '0.003', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'weapon5': '0.020', 'ARMOR': '0.024', 'AMMO4': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.091', 'WEAPON4': '0.250', 'weapon4': '0.612', 'WEAPON3': '0.650', 'HITCOUNT': '0.780', 'weapon2': '1.272', 'weapon3': '1.594', 'DAMAGECOUNT': '2.766', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:31,390][2409097] DAMAGECOUNT value on done: 2220.0
[2023-02-25 12:52:31,405][2409097] Sum rewards: 1.418, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.090', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO2': '0.016', 'AMMO4': '0.080', 'AMMO3': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.300', 'weapon4': '0.418', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.130', 'DAMAGECOUNT': '1.140', 'weapon3': '1.486'}
[2023-02-25 12:52:31,513][2409486] Large shaping reward -2.521 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0)]
[2023-02-25 12:52:31,909][2409079] DAMAGECOUNT value on done: 2484.0
[2023-02-25 12:52:31,910][2409079] Sum rewards: 5.087, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.532', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon7': '0.052', 'AMMO4': '0.072', 'weapon4': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.126', 'AMMO3': '0.130', 'WEAPON5': '0.150', 'HITCOUNT': '0.330', 'WEAPON3': '0.750', 'weapon2': '1.210', 'ARMOR': '1.258', 'weapon3': '1.658', 'DAMAGECOUNT': '2.406', 'FRAGCOUNT': '4.500'}
[2023-02-25 12:52:31,928][2409080] DAMAGECOUNT value on done: 2531.0
[2023-02-25 12:52:31,929][2409080] Sum rewards: 2.906, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.556', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'AMMO3': '0.074', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.310', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.650', 'weapon2': '1.334', 'weapon3': '1.460', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.265'}
[2023-02-25 12:52:31,937][2409074] Updated weights for policy 0, policy_version 12411 (0.0012)
[2023-02-25 12:52:32,068][2409104] DAMAGECOUNT value on done: 2519.0
[2023-02-25 12:52:32,070][2409104] Sum rewards: 6.609, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.616', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.130', 'weapon5': '0.148', 'weapon4': '0.188', 'WEAPON5': '0.200', 'HITCOUNT': '0.740', 'WEAPON3': '0.800', 'ARMOR': '0.824', 'weapon2': '1.408', 'weapon3': '1.716', 'DAMAGECOUNT': '2.814', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:52:32,186][2408954] Fps is (10 sec: 25394.4, 60 sec: 25395.1, 300 sec: 25492.4). Total num frames: 50839552. Throughput: 0: 6338.1. Samples: 12717444. Policy #0 lag: (min: 3.0, avg: 13.7, max: 28.0)
[2023-02-25 12:52:32,186][2408954] Avg episode reward: [(0, '2.786')]
[2023-02-25 12:52:32,483][2409076] DAMAGECOUNT value on done: 2377.0
[2023-02-25 12:52:32,484][2409076] Sum rewards: 1.538, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.050', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.082', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.206', 'HITCOUNT': '0.380', 'ARMOR': '0.432', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.260', 'weapon2': '1.546', 'weapon3': '1.748'}
[2023-02-25 12:52:32,627][2409389] DAMAGECOUNT value on done: 2951.0
[2023-02-25 12:52:32,631][2409389] Sum rewards: 0.248, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.270', 'AMMO2': '0.011', 'AMMO5': '0.013', 'weapon4': '0.026', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon5': '0.054', 'AMMO4': '0.056', 'AMMO3': '0.109', 'WEAPON5': '0.300', 'HITCOUNT': '0.320', 'ARMOR': '0.450', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.059', 'weapon3': '1.370', 'weapon2': '1.720', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:32,761][2409102] DAMAGECOUNT value on done: 2374.0
[2023-02-25 12:52:32,765][2409102] Sum rewards: 5.041, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.702', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'weapon5': '0.070', 'AMMO4': '0.092', 'AMMO3': '0.124', 'weapon4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.600', 'WEAPON3': '0.850', 'ARMOR': '1.259', 'weapon2': '1.422', 'weapon3': '2.020', 'DAMAGECOUNT': '2.022', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:32,827][2409373] DAMAGECOUNT value on done: 2158.0
[2023-02-25 12:52:32,828][2409373] Sum rewards: 5.766, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.896', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.066', 'AMMO4': '0.086', 'weapon7': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.136', 'WEAPON4': '0.250', 'HITCOUNT': '0.290', 'WEAPON3': '0.400', 'weapon4': '0.406', 'ARMOR': '0.486', 'weapon3': '0.740', 'weapon2': '1.362', 'DAMAGECOUNT': '1.404', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:32,869][2409407] DAMAGECOUNT value on done: 2107.0
[2023-02-25 12:52:32,872][2409407] Sum rewards: 5.715, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.416', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.206', 'HITCOUNT': '0.410', 'weapon4': '0.428', 'WEAPON3': '0.500', 'weapon2': '1.070', 'weapon3': '1.354', 'DAMAGECOUNT': '2.358', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:52:32,898][2409866] DAMAGECOUNT value on done: 2476.0
[2023-02-25 12:52:32,899][2409866] Sum rewards: 3.580, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.764', 'weapon5': '0.002', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'weapon4': '0.098', 'AMMO3': '0.115', 'WEAPON5': '0.150', 'HITCOUNT': '0.430', 'WEAPON3': '0.800', 'ARMOR': '0.878', 'weapon2': '1.344', 'DAMAGECOUNT': '1.545', 'weapon3': '2.342', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:32,968][2409486] DAMAGECOUNT value on done: 2175.0
[2023-02-25 12:52:32,971][2409486] Sum rewards: 6.491, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.684', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.037', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'weapon4': '0.218', 'WEAPON3': '0.650', 'HITCOUNT': '0.730', 'weapon2': '1.628', 'weapon3': '1.830', 'DAMAGECOUNT': '2.475', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:52:33,035][2409101] DAMAGECOUNT value on done: 2625.0
[2023-02-25 12:52:33,038][2409101] Sum rewards: 0.380, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.384', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON1': '0.040', 'WEAPON5': '0.050', 'weapon7': '0.052', 'weapon5': '0.062', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.204', 'HITCOUNT': '0.270', 'WEAPON3': '0.800', 'ARMOR': '0.900', 'DAMAGECOUNT': '1.086', 'weapon3': '1.610', 'weapon2': '1.696', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:33,191][2409406] DAMAGECOUNT value on done: 1649.0
[2023-02-25 12:52:33,192][2409406] Sum rewards: 3.978, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.956', 'AMMO5': '0.008', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'AMMO3': '0.067', 'weapon7': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.122', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.380', 'WEAPON3': '0.450', 'ARMOR': '0.483', 'weapon4': '0.542', 'weapon2': '1.104', 'weapon3': '1.240', 'DAMAGECOUNT': '1.950', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:52:33,351][2409075] DAMAGECOUNT value on done: 2972.0
[2023-02-25 12:52:33,352][2409075] Sum rewards: 1.296, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.880', 'AMMO5': '0.010', 'weapon4': '0.014', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'AMMO3': '0.108', 'weapon5': '0.116', 'AMMO4': '0.137', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'HITCOUNT': '0.560', 'WEAPON3': '0.700', 'weapon2': '1.286', 'weapon3': '1.758', 'DAMAGECOUNT': '2.079', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:52:33,401][2409096] DAMAGECOUNT value on done: 2801.0
[2023-02-25 12:52:33,402][2409096] Sum rewards: 7.977, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.256', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.009', 'WEAPON1': '0.010', 'AMMO3': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.106', 'weapon4': '0.226', 'HITCOUNT': '0.240', 'WEAPON3': '0.300', 'ARMOR': '0.487', 'weapon3': '0.982', 'weapon2': '1.006', 'DAMAGECOUNT': '1.920', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:33,505][2409074] Updated weights for policy 0, policy_version 12421 (0.0013)
[2023-02-25 12:52:33,662][2409596] DAMAGECOUNT value on done: 2188.0
[2023-02-25 12:52:33,663][2409596] Sum rewards: 5.404, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.731', 'AMMO5': '0.007', 'AMMO2': '0.026', 'WEAPON1': '0.040', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'weapon5': '0.106', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'weapon4': '0.346', 'HITCOUNT': '0.560', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'weapon2': '1.354', 'weapon3': '1.756', 'DAMAGECOUNT': '1.770', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:33,726][2409405] DAMAGECOUNT value on done: 2511.0
[2023-02-25 12:52:33,727][2409405] Sum rewards: 8.378, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.416', 'AMMO2': '0.007', 'AMMO5': '0.012', 'AMMO4': '0.033', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.061', 'weapon5': '0.202', 'weapon4': '0.238', 'HITCOUNT': '0.290', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'weapon3': '1.132', 'ARMOR': '1.297', 'weapon2': '1.606', 'DAMAGECOUNT': '2.016', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:52:33,820][2409105] DAMAGECOUNT value on done: 2116.0
[2023-02-25 12:52:33,823][2409105] Sum rewards: 3.418, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'weapon5': '0.068', 'AMMO3': '0.069', 'HEALTH': '0.070', 'WEAPON5': '0.100', 'weapon4': '0.202', 'HITCOUNT': '0.390', 'WEAPON3': '0.400', 'weapon3': '1.034', 'DAMAGECOUNT': '1.605', 'weapon2': '1.824', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:33,909][2409355] DAMAGECOUNT value on done: 2483.0
[2023-02-25 12:52:33,909][2409355] Sum rewards: 3.214, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.170', 'AMMO2': '0.016', 'AMMO5': '0.020', 'AMMO4': '0.079', 'AMMO3': '0.087', 'weapon5': '0.156', 'WEAPON4': '0.200', 'HITCOUNT': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.402', 'ARMOR': '0.470', 'WEAPON3': '0.500', 'weapon3': '1.336', 'weapon2': '1.392', 'DAMAGECOUNT': '1.776', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:33,987][2409565] DAMAGECOUNT value on done: 2621.0
[2023-02-25 12:52:33,987][2409565] Sum rewards: 3.469, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.820', 'AMMO5': '0.013', 'AMMO2': '0.017', 'weapon5': '0.052', 'AMMO4': '0.083', 'AMMO3': '0.094', 'weapon4': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.580', 'WEAPON3': '0.700', 'ARMOR': '0.859', 'weapon3': '1.456', 'weapon2': '1.530', 'DAMAGECOUNT': '2.415', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:33,992][2409077] DAMAGECOUNT value on done: 2419.0
[2023-02-25 12:52:33,995][2409077] Sum rewards: 5.660, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.394', 'AMMO5': '0.005', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'AMMO3': '0.065', 'ARMOR': '0.080', 'AMMO4': '0.094', 'weapon5': '0.116', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.220', 'weapon4': '0.442', 'WEAPON3': '0.450', 'weapon3': '1.130', 'weapon2': '1.254', 'DAMAGECOUNT': '1.299', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:34,361][2409485] DAMAGECOUNT value on done: 2619.0
[2023-02-25 12:52:34,362][2409485] Sum rewards: 4.820, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.367', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'weapon5': '0.056', 'AMMO4': '0.071', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.482', 'WEAPON3': '0.650', 'HITCOUNT': '0.650', 'ARMOR': '0.822', 'weapon3': '1.476', 'weapon2': '1.756', 'DAMAGECOUNT': '2.631', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:34,470][2409078] DAMAGECOUNT value on done: 1859.0
[2023-02-25 12:52:34,471][2409078] Sum rewards: 0.910, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.988', 'AMMO2': '0.006', 'AMMO5': '0.011', 'AMMO4': '0.030', 'WEAPON1': '0.040', 'AMMO3': '0.090', 'WEAPON4': '0.150', 'weapon4': '0.150', 'weapon5': '0.160', 'HITCOUNT': '0.290', 'WEAPON5': '0.300', 'ARMOR': '0.473', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.305', 'weapon2': '1.356', 'weapon3': '1.436', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:34,495][2409099] DAMAGECOUNT value on done: 1874.0
[2023-02-25 12:52:34,498][2409099] Sum rewards: -0.363, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.000', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.046', 'weapon7': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.052', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'ARMOR': '0.455', 'DAMAGECOUNT': '0.621', 'FRAGCOUNT': '1.000', 'weapon3': '1.176', 'weapon2': '1.406'}
[2023-02-25 12:52:34,844][2409597] DAMAGECOUNT value on done: 3024.0
[2023-02-25 12:52:34,847][2409597] Sum rewards: 3.616, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.400', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.082', 'AMMO3': '0.099', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.258', 'HITCOUNT': '0.380', 'weapon4': '0.460', 'WEAPON3': '0.650', 'ARMOR': '0.930', 'weapon2': '1.072', 'weapon3': '1.280', 'DAMAGECOUNT': '2.019', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:34,939][2409548] DAMAGECOUNT value on done: 2122.0
[2023-02-25 12:52:34,940][2409548] Sum rewards: 4.095, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'weapon5': '0.020', 'AMMO2': '0.043', 'HEALTH': '0.133', 'AMMO3': '0.135', 'WEAPON5': '0.150', 'AMMO4': '0.215', 'WEAPON4': '0.300', 'HITCOUNT': '0.310', 'ARMOR': '0.421', 'weapon4': '0.630', 'WEAPON3': '0.650', 'weapon2': '1.134', 'DAMAGECOUNT': '1.254', 'weapon3': '1.682', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:52:35,144][2409074] Updated weights for policy 0, policy_version 12431 (0.0012)
[2023-02-25 12:52:35,153][2409469] DAMAGECOUNT value on done: 2346.0
[2023-02-25 12:52:35,154][2409469] Sum rewards: 4.123, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.942', 'AMMO4': '-0.061', 'AMMO2': '-0.012', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO3': '0.088', 'weapon5': '0.106', 'WEAPON5': '0.250', 'HITCOUNT': '0.480', 'WEAPON3': '0.750', 'ARMOR': '0.869', 'weapon2': '1.692', 'weapon3': '1.772', 'DAMAGECOUNT': '2.091', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:35,205][2409547] DAMAGECOUNT value on done: 1981.0
[2023-02-25 12:52:35,208][2409547] Sum rewards: 0.991, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.344', 'AMMO5': '0.012', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO4': '0.094', 'AMMO3': '0.106', 'weapon5': '0.126', 'weapon4': '0.146', 'HITCOUNT': '0.210', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.855', 'weapon2': '1.416', 'weapon3': '1.980', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:35,446][2409097] DAMAGECOUNT value on done: 2206.0
[2023-02-25 12:52:35,447][2409097] Sum rewards: 0.907, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.356', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'weapon5': '0.122', 'AMMO4': '0.149', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.400', 'weapon4': '0.518', 'weapon2': '0.760', 'ARMOR': '0.851', 'weapon3': '0.962', 'DAMAGECOUNT': '1.389', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:35,618][2409079] DAMAGECOUNT value on done: 2759.0
[2023-02-25 12:52:35,618][2409079] Sum rewards: 4.754, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.267', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.100', 'AMMO3': '0.129', 'weapon4': '0.190', 'WEAPON5': '0.450', 'HITCOUNT': '0.580', 'WEAPON3': '0.850', 'ARMOR': '0.949', 'weapon2': '1.306', 'weapon3': '1.594', 'DAMAGECOUNT': '2.520', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:52:35,888][2409104] DAMAGECOUNT value on done: 2068.0
[2023-02-25 12:52:35,889][2409104] Sum rewards: 2.796, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.619', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.013', 'WEAPON1': '0.050', 'AMMO3': '0.052', 'weapon5': '0.062', 'ARMOR': '0.063', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.340', 'WEAPON3': '0.450', 'weapon4': '0.616', 'weapon3': '1.068', 'weapon2': '1.188', 'DAMAGECOUNT': '1.323', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:36,164][2409076] DAMAGECOUNT value on done: 1854.0
[2023-02-25 12:52:36,165][2409076] Sum rewards: 3.892, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.854', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'weapon5': '0.018', 'AMMO2': '0.029', 'AMMO3': '0.053', 'weapon7': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'weapon4': '0.304', 'WEAPON4': '0.350', 'WEAPON3': '0.350', 'HITCOUNT': '0.480', 'ARMOR': '0.826', 'weapon3': '0.966', 'weapon2': '1.396', 'DAMAGECOUNT': '1.845', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:52:36,218][2409080] DAMAGECOUNT value on done: 2205.0
[2023-02-25 12:52:36,222][2409080] Sum rewards: 4.010, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.571', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.005', 'AMMO3': '0.039', 'WEAPON4': '0.150', 'weapon5': '0.152', 'WEAPON5': '0.200', 'HITCOUNT': '0.250', 'WEAPON3': '0.300', 'weapon4': '0.370', 'weapon3': '0.514', 'weapon2': '0.554', 'ARMOR': '0.954', 'DAMAGECOUNT': '1.341', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:36,418][2409102] DAMAGECOUNT value on done: 2827.0
[2023-02-25 12:52:36,419][2409389] DAMAGECOUNT value on done: 2275.0
[2023-02-25 12:52:36,433][2409389] Sum rewards: 3.314, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.774', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.041', 'weapon7': '0.068', 'AMMO3': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.148', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.500', 'WEAPON3': '0.600', 'ARMOR': '0.948', 'weapon3': '1.330', 'DAMAGECOUNT': '1.932', 'weapon2': '2.230', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:36,433][2409102] Sum rewards: 2.749, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.105', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.022', 'ARMOR': '0.028', 'weapon7': '0.038', 'weapon5': '0.084', 'AMMO3': '0.091', 'AMMO4': '0.109', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.410', 'weapon4': '0.438', 'WEAPON3': '0.600', 'weapon2': '0.900', 'DAMAGECOUNT': '1.353', 'weapon3': '1.436', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:36,448][2409866] DAMAGECOUNT value on done: 2312.0
[2023-02-25 12:52:36,452][2409866] Sum rewards: 6.240, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.140', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.055', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.164', 'weapon4': '0.236', 'WEAPON3': '0.350', 'ARMOR': '0.450', 'HITCOUNT': '0.470', 'weapon3': '1.100', 'weapon2': '1.762', 'DAMAGECOUNT': '2.142', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:52:36,464][2409373] DAMAGECOUNT value on done: 1993.0
[2023-02-25 12:52:36,465][2409373] Sum rewards: 2.701, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.918', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.036', 'AMMO3': '0.070', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'weapon5': '0.230', 'weapon4': '0.258', 'WEAPON5': '0.400', 'ARMOR': '0.454', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.720', 'weapon2': '0.786', 'weapon3': '1.762', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:36,509][2409407] DAMAGECOUNT value on done: 2718.0
[2023-02-25 12:52:36,509][2409407] Sum rewards: 7.181, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.918', 'AMMO2': '0.005', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.022', 'AMMO3': '0.061', 'WEAPON4': '0.100', 'weapon5': '0.144', 'weapon4': '0.236', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.510', 'WEAPON3': '0.550', 'weapon2': '1.444', 'weapon3': '1.600', 'DAMAGECOUNT': '1.893', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:52:36,541][2409486] DAMAGECOUNT value on done: 1876.0
[2023-02-25 12:52:36,719][2409074] Updated weights for policy 0, policy_version 12441 (0.0013)
[2023-02-25 12:52:36,929][2409406] DAMAGECOUNT value on done: 2073.0
[2023-02-25 12:52:36,932][2409406] Sum rewards: -0.684, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.977', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon5': '0.078', 'AMMO3': '0.123', 'AMMO4': '0.126', 'HITCOUNT': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.477', 'weapon4': '0.558', 'DAMAGECOUNT': '0.660', 'WEAPON3': '0.700', 'weapon2': '0.832', 'weapon3': '1.504', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:37,117][2409075] DAMAGECOUNT value on done: 2238.0
[2023-02-25 12:52:37,120][2409075] Sum rewards: 4.123, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.132', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.045', 'weapon5': '0.094', 'AMMO3': '0.114', 'AMMO4': '0.226', 'HITCOUNT': '0.320', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.564', 'WEAPON3': '0.700', 'weapon3': '1.210', 'weapon2': '1.444', 'ARMOR': '1.621', 'DAMAGECOUNT': '2.133', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:37,186][2408954] Fps is (10 sec: 25805.5, 60 sec: 25395.2, 300 sec: 25547.9). Total num frames: 50970624. Throughput: 0: 6330.7. Samples: 12736272. Policy #0 lag: (min: 3.0, avg: 13.7, max: 28.0)
[2023-02-25 12:52:37,186][2408954] Avg episode reward: [(0, '3.069')]
[2023-02-25 12:52:37,212][2409033] Saving new best policy, reward=3.069!
[2023-02-25 12:52:37,406][2409405] DAMAGECOUNT value on done: 2344.0
[2023-02-25 12:52:37,406][2409405] Sum rewards: 4.023, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.759', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.008', 'WEAPON1': '0.010', 'weapon4': '0.012', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'weapon5': '0.094', 'WEAPON5': '0.150', 'HITCOUNT': '0.530', 'WEAPON3': '0.550', 'weapon3': '1.706', 'weapon2': '1.794', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.268'}
[2023-02-25 12:52:37,415][2409596] DAMAGECOUNT value on done: 2104.0
[2023-02-25 12:52:37,566][2409355] DAMAGECOUNT value on done: 2547.0
[2023-02-25 12:52:37,570][2409355] Sum rewards: 1.525, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.964', 'AMMO5': '0.009', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'weapon7': '0.042', 'ARMOR': '0.044', 'AMMO4': '0.063', 'weapon5': '0.092', 'AMMO3': '0.121', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.530', 'weapon4': '0.606', 'WEAPON3': '0.750', 'weapon2': '0.934', 'DAMAGECOUNT': '1.842', 'weapon3': '1.942', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:37,653][2409565] DAMAGECOUNT value on done: 2134.0
[2023-02-25 12:52:37,658][2409565] Sum rewards: 3.850, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.427', 'AMMO2': '0.012', 'AMMO5': '0.012', 'weapon4': '0.030', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.052', 'AMMO4': '0.060', 'weapon5': '0.204', 'WEAPON5': '0.300', 'HITCOUNT': '0.380', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'weapon3': '1.270', 'DAMAGECOUNT': '1.542', 'FRAGCOUNT': '2.000', 'weapon2': '2.024'}
[2023-02-25 12:52:37,798][2409096] DAMAGECOUNT value on done: 2581.0
[2023-02-25 12:52:37,799][2409096] Sum rewards: 3.918, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.024', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO3': '0.076', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.484', 'HITCOUNT': '0.590', 'weapon2': '1.088', 'weapon3': '1.138', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:37,991][2409485] DAMAGECOUNT value on done: 2603.0
[2023-02-25 12:52:38,100][2409077] DAMAGECOUNT value on done: 1447.0
[2023-02-25 12:52:38,133][2409078] DAMAGECOUNT value on done: 2422.0
[2023-02-25 12:52:38,133][2409078] Sum rewards: 5.978, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.750', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon7': '0.060', 'AMMO3': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.120', 'WEAPON4': '0.200', 'weapon4': '0.402', 'HITCOUNT': '0.510', 'WEAPON3': '0.550', 'ARMOR': '1.200', 'weapon3': '1.210', 'weapon2': '1.598', 'DAMAGECOUNT': '2.106', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:38,178][2409099] DAMAGECOUNT value on done: 2250.0
[2023-02-25 12:52:38,179][2409099] Sum rewards: 5.638, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.105', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'AMMO4': '0.127', 'weapon5': '0.158', 'weapon4': '0.198', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'HITCOUNT': '0.620', 'weapon3': '1.458', 'weapon2': '1.688', 'DAMAGECOUNT': '2.073', 'FRAGCOUNT': '4.500'}
[2023-02-25 12:52:38,215][2409074] Updated weights for policy 0, policy_version 12451 (0.0012)
[2023-02-25 12:52:38,505][2409105] DAMAGECOUNT value on done: 2052.0
[2023-02-25 12:52:38,505][2409105] Sum rewards: 3.000, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.532', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'AMMO3': '0.078', 'AMMO4': '0.105', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.320', 'weapon4': '0.358', 'WEAPON3': '0.500', 'ARMOR': '0.531', 'DAMAGECOUNT': '0.945', 'weapon2': '1.400', 'weapon3': '1.500', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:38,943][2409548] DAMAGECOUNT value on done: 2248.0
[2023-02-25 12:52:38,944][2409548] Sum rewards: -1.247, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.485', 'AMMO2': '0.017', 'AMMO3': '0.077', 'AMMO4': '0.084', 'HITCOUNT': '0.290', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'weapon2': '0.588', 'DAMAGECOUNT': '0.798', 'ARMOR': '0.836', 'weapon4': '0.854', 'FRAGCOUNT': '1.000', 'weapon3': '1.594'}
[2023-02-25 12:52:38,992][2409547] DAMAGECOUNT value on done: 2379.0
[2023-02-25 12:52:38,994][2409547] Sum rewards: 6.803, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.198', 'AMMO2': '0.008', 'AMMO5': '0.022', 'AMMO3': '0.030', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'HITCOUNT': '0.160', 'weapon4': '0.184', 'WEAPON3': '0.200', 'weapon5': '0.292', 'WEAPON5': '0.300', 'weapon3': '0.848', 'ARMOR': '0.993', 'weapon2': '1.222', 'DAMAGECOUNT': '1.653', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:39,185][2409097] DAMAGECOUNT value on done: 2572.0
[2023-02-25 12:52:39,188][2409097] Sum rewards: 6.915, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.124', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'AMMO5': '0.013', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.054', 'weapon5': '0.144', 'weapon4': '0.230', 'WEAPON5': '0.300', 'HITCOUNT': '0.460', 'WEAPON3': '0.500', 'weapon3': '1.142', 'ARMOR': '1.219', 'weapon2': '1.934', 'DAMAGECOUNT': '2.247', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:39,216][2409079] DAMAGECOUNT value on done: 2884.0
[2023-02-25 12:52:39,217][2409079] Sum rewards: 4.121, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.287', 'AMMO2': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.019', 'weapon7': '0.058', 'AMMO3': '0.077', 'WEAPON5': '0.100', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.300', 'ARMOR': '0.459', 'WEAPON3': '0.550', 'weapon4': '0.566', 'weapon2': '0.822', 'weapon3': '1.242', 'DAMAGECOUNT': '1.626', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:39,435][2409597] DAMAGECOUNT value on done: 2527.0
[2023-02-25 12:52:39,439][2409597] Sum rewards: 2.765, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.830', 'AMMO2': '0.011', 'AMMO5': '0.012', 'weapon5': '0.030', 'AMMO4': '0.053', 'AMMO3': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'HITCOUNT': '0.390', 'weapon2': '0.544', 'weapon4': '0.582', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.389', 'weapon3': '1.980', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:39,598][2409469] DAMAGECOUNT value on done: 2660.0
[2023-02-25 12:52:39,599][2409469] Sum rewards: 2.434, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.154', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.006', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.069', 'HITCOUNT': '0.330', 'WEAPON3': '0.400', 'weapon3': '0.920', 'DAMAGECOUNT': '1.143', 'ARMOR': '1.312', 'weapon2': '1.334', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:39,825][2409104] DAMAGECOUNT value on done: 3375.0
[2023-02-25 12:52:39,826][2409104] Sum rewards: 0.648, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.819', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.048', 'ARMOR': '0.048', 'AMMO3': '0.073', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.134', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.280', 'weapon2': '0.412', 'WEAPON3': '0.500', 'weapon4': '0.638', 'DAMAGECOUNT': '0.954', 'FRAGCOUNT': '1.000', 'weapon3': '1.170'}
[2023-02-25 12:52:40,056][2409076] DAMAGECOUNT value on done: 2498.0
[2023-02-25 12:52:40,057][2409076] Sum rewards: 4.393, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.510', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO3': '0.040', 'weapon7': '0.074', 'weapon5': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'HITCOUNT': '0.520', 'weapon4': '0.628', 'ARMOR': '0.951', 'weapon3': '1.036', 'weapon2': '1.128', 'DAMAGECOUNT': '2.355', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:40,064][2409407] DAMAGECOUNT value on done: 1925.0
[2023-02-25 12:52:40,068][2409407] Sum rewards: 5.588, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.258', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.006', 'AMMO4': '0.032', 'WEAPON5': '0.050', 'weapon7': '0.060', 'AMMO3': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.164', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.570', 'weapon3': '1.022', 'weapon2': '1.312', 'DAMAGECOUNT': '1.755', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:40,115][2409866] DAMAGECOUNT value on done: 2602.0
[2023-02-25 12:52:40,116][2409866] Sum rewards: -1.954, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.624', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'weapon4': '0.048', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'weapon5': '0.112', 'AMMO3': '0.119', 'WEAPON5': '0.150', 'HITCOUNT': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.200', 'weapon2': '1.352', 'weapon3': '1.428'}
[2023-02-25 12:52:40,222][2409074] Updated weights for policy 0, policy_version 12461 (0.0012)
[2023-02-25 12:52:40,365][2409373] DAMAGECOUNT value on done: 1814.0
[2023-02-25 12:52:40,366][2409373] Sum rewards: 5.456, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.982', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.056', 'weapon7': '0.082', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'weapon5': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.152', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.390', 'WEAPON3': '0.500', 'ARMOR': '0.957', 'weapon3': '1.282', 'weapon2': '1.406', 'DAMAGECOUNT': '2.316', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:40,409][2409486] DAMAGECOUNT value on done: 2133.0
[2023-02-25 12:52:40,413][2409486] Sum rewards: 5.834, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'AMMO3': '0.045', 'WEAPON4': '0.050', 'weapon4': '0.074', 'AMMO4': '0.075', 'HEALTH': '0.086', 'WEAPON5': '0.100', 'WEAPON3': '0.300', 'HITCOUNT': '0.300', 'weapon2': '0.838', 'weapon3': '0.902', 'DAMAGECOUNT': '0.990', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:40,502][2409080] DAMAGECOUNT value on done: 2558.0
[2023-02-25 12:52:40,505][2409080] Sum rewards: -3.075, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.136', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.064', 'AMMO4': '0.095', 'AMMO3': '0.162', 'WEAPON5': '0.200', 'HITCOUNT': '0.240', 'WEAPON4': '0.250', 'weapon4': '0.508', 'ARMOR': '0.975', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.050', 'weapon3': '1.328', 'weapon2': '1.642', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:40,563][2409389] DAMAGECOUNT value on done: 2500.0
[2023-02-25 12:52:40,565][2409389] Sum rewards: 5.440, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO3': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.062', 'AMMO4': '0.067', 'HEALTH': '0.074', 'weapon5': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.236', 'WEAPON3': '0.300', 'HITCOUNT': '0.360', 'ARMOR': '0.400', 'weapon3': '0.754', 'weapon2': '1.212', 'DAMAGECOUNT': '1.392', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:41,164][2409565] DAMAGECOUNT value on done: 2810.0
[2023-02-25 12:52:41,168][2409565] Sum rewards: 0.423, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.010', 'AMMO5': '0.003', 'AMMO2': '0.008', 'WEAPON1': '0.040', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.058', 'weapon5': '0.074', 'weapon7': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.290', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'weapon2': '0.488', 'weapon4': '0.644', 'weapon3': '0.980', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.044'}
[2023-02-25 12:52:41,169][2409355] DAMAGECOUNT value on done: 2496.0
[2023-02-25 12:52:41,172][2409355] Sum rewards: 4.882, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.518', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.031', 'AMMO3': '0.040', 'weapon5': '0.074', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.262', 'WEAPON3': '0.300', 'HITCOUNT': '0.340', 'weapon3': '0.912', 'ARMOR': '0.949', 'weapon2': '1.498', 'DAMAGECOUNT': '2.091', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:52:41,243][2409405] DAMAGECOUNT value on done: 3135.0
[2023-02-25 12:52:41,247][2409405] Sum rewards: 2.699, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.332', 'AMMO5': '0.005', 'AMMO2': '0.022', 'ARMOR': '0.024', 'WEAPON1': '0.060', 'AMMO3': '0.098', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'weapon5': '0.162', 'WEAPON4': '0.250', 'HITCOUNT': '0.540', 'WEAPON3': '0.650', 'weapon4': '0.662', 'weapon2': '0.702', 'weapon3': '1.710', 'DAMAGECOUNT': '2.385', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:41,320][2409406] DAMAGECOUNT value on done: 2197.0
[2023-02-25 12:52:41,325][2409406] Sum rewards: -2.037, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.122', 'AMMO2': '0.013', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.064', 'weapon5': '0.078', 'AMMO3': '0.095', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'HITCOUNT': '0.300', 'ARMOR': '0.408', 'weapon4': '0.420', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.972', 'FRAGCOUNT': '1.000', 'weapon2': '1.326', 'weapon3': '1.504'}
[2023-02-25 12:52:41,450][2409074] Updated weights for policy 0, policy_version 12471 (0.0013)
[2023-02-25 12:52:41,496][2409596] DAMAGECOUNT value on done: 2554.0
[2023-02-25 12:52:41,497][2409596] Sum rewards: -2.335, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.305', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'AMMO4': '0.086', 'weapon5': '0.092', 'AMMO3': '0.102', 'HITCOUNT': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.700', 'weapon4': '0.754', 'DAMAGECOUNT': '0.786', 'FRAGCOUNT': '1.000', 'weapon2': '1.206', 'ARMOR': '1.310', 'weapon3': '1.436'}
[2023-02-25 12:52:41,531][2409075] DAMAGECOUNT value on done: 1815.0
[2023-02-25 12:52:41,534][2409075] Sum rewards: 0.382, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.378', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'weapon5': '0.066', 'AMMO3': '0.072', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.236', 'HITCOUNT': '0.320', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.978', 'FRAGCOUNT': '1.000', 'weapon3': '1.326', 'weapon2': '1.790'}
[2023-02-25 12:52:41,914][2409096] DAMAGECOUNT value on done: 2022.0
[2023-02-25 12:52:41,915][2409096] Sum rewards: 0.252, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.157', 'AMMO5': '0.006', 'AMMO2': '0.031', 'WEAPON1': '0.040', 'weapon5': '0.050', 'AMMO3': '0.073', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'HITCOUNT': '0.330', 'WEAPON4': '0.350', 'WEAPON3': '0.500', 'weapon4': '0.592', 'ARMOR': '0.828', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.047', 'weapon2': '1.378', 'weapon3': '1.630'}
[2023-02-25 12:52:41,961][2409078] DAMAGECOUNT value on done: 2562.0
[2023-02-25 12:52:41,961][2409078] Sum rewards: -0.990, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.512', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.040', 'AMMO4': '0.053', 'weapon5': '0.056', 'AMMO3': '0.091', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.198', 'HITCOUNT': '0.360', 'WEAPON3': '0.750', 'ARMOR': '0.856', 'DAMAGECOUNT': '1.245', 'weapon3': '1.512', 'weapon2': '2.040', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:41,976][2409099] DAMAGECOUNT value on done: 2971.0
[2023-02-25 12:52:41,977][2409099] Sum rewards: -1.204, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.398', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO5': '0.022', 'AMMO4': '0.105', 'AMMO3': '0.167', 'HITCOUNT': '0.250', 'weapon5': '0.266', 'WEAPON4': '0.300', 'weapon4': '0.368', 'WEAPON5': '0.450', 'ARMOR': '0.934', 'WEAPON3': '1.000', 'weapon3': '1.498', 'weapon2': '1.506', 'DAMAGECOUNT': '1.536', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:42,186][2408954] Fps is (10 sec: 26215.1, 60 sec: 25463.5, 300 sec: 25561.8). Total num frames: 51101696. Throughput: 0: 6341.9. Samples: 12774612. Policy #0 lag: (min: 0.0, avg: 15.2, max: 29.0)
[2023-02-25 12:52:42,186][2408954] Avg episode reward: [(0, '2.916')]
[2023-02-25 12:52:42,193][2409105] DAMAGECOUNT value on done: 1969.0
[2023-02-25 12:52:42,196][2409105] Sum rewards: -0.388, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.019', 'FRAGCOUNT': '-1.000', 'AMMO5': '0.009', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.052', 'AMMO3': '0.060', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.236', 'ARMOR': '0.440', 'WEAPON3': '0.450', 'HITCOUNT': '0.480', 'weapon3': '1.328', 'weapon2': '1.348', 'DAMAGECOUNT': '1.980'}
[2023-02-25 12:52:42,413][2409077] DAMAGECOUNT value on done: 2424.0
[2023-02-25 12:52:42,417][2409077] Sum rewards: -1.511, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.046', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON1': '0.060', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'weapon4': '0.110', 'AMMO3': '0.128', 'weapon5': '0.152', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'HITCOUNT': '0.400', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.197', 'weapon3': '1.248', 'weapon2': '1.622', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:42,508][2409548] DAMAGECOUNT value on done: 2385.0
[2023-02-25 12:52:42,508][2409548] Sum rewards: -1.490, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.840', 'AMMO5': '0.015', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'weapon5': '0.080', 'AMMO4': '0.088', 'AMMO3': '0.114', 'WEAPON4': '0.200', 'HITCOUNT': '0.310', 'WEAPON5': '0.350', 'weapon4': '0.558', 'WEAPON3': '0.700', 'weapon2': '0.960', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.317', 'weapon3': '1.820'}
[2023-02-25 12:52:42,969][2409547] DAMAGECOUNT value on done: 2403.0
[2023-02-25 12:52:42,973][2409547] Sum rewards: 5.477, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.410', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.021', 'WEAPON1': '0.040', 'weapon5': '0.062', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'HITCOUNT': '0.290', 'weapon4': '0.412', 'ARMOR': '0.500', 'WEAPON3': '0.550', 'weapon2': '0.950', 'DAMAGECOUNT': '1.470', 'weapon3': '1.644', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:43,052][2409079] DAMAGECOUNT value on done: 2651.0
[2023-02-25 12:52:43,056][2409079] Sum rewards: 3.360, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.913', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.012', 'weapon5': '0.046', 'AMMO4': '0.054', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.118', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'HITCOUNT': '0.460', 'WEAPON3': '0.550', 'weapon2': '1.246', 'weapon3': '1.296', 'DAMAGECOUNT': '1.890', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:43,107][2409597] DAMAGECOUNT value on done: 2846.0
[2023-02-25 12:52:43,108][2409597] Sum rewards: 7.678, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.700', 'AMMO2': '0.013', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'AMMO4': '0.067', 'AMMO3': '0.092', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.192', 'weapon4': '0.348', 'WEAPON5': '0.500', 'HITCOUNT': '0.500', 'WEAPON3': '0.600', 'ARMOR': '0.969', 'weapon2': '1.416', 'weapon3': '1.500', 'DAMAGECOUNT': '2.178', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:52:43,142][2409097] DAMAGECOUNT value on done: 2343.0
[2023-02-25 12:52:43,142][2409097] Sum rewards: 0.803, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.599', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'weapon5': '0.014', 'WEAPON1': '0.030', 'AMMO3': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.202', 'HITCOUNT': '0.370', 'WEAPON3': '0.600', 'ARMOR': '0.850', 'DAMAGECOUNT': '1.275', 'weapon3': '1.384', 'weapon2': '1.738', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:43,305][2409074] Updated weights for policy 0, policy_version 12481 (0.0012)
[2023-02-25 12:52:43,373][2409469] DAMAGECOUNT value on done: 3193.0
[2023-02-25 12:52:43,374][2409469] Sum rewards: 2.796, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.160', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.015', 'weapon4': '0.030', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'weapon5': '0.214', 'HITCOUNT': '0.270', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'ARMOR': '0.460', 'DAMAGECOUNT': '1.125', 'weapon2': '1.460', 'weapon3': '1.670', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:43,638][2409104] DAMAGECOUNT value on done: 2090.0
[2023-02-25 12:52:43,641][2409104] Sum rewards: -1.652, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.000', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.058', 'AMMO4': '0.085', 'AMMO3': '0.115', 'weapon4': '0.134', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.240', 'ARMOR': '0.478', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.380', 'weapon2': '1.668'}
[2023-02-25 12:52:43,689][2409866] DAMAGECOUNT value on done: 3420.0
[2023-02-25 12:52:43,692][2409866] Sum rewards: 3.573, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.620', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO4': '0.059', 'AMMO3': '0.090', 'weapon5': '0.142', 'weapon4': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'HITCOUNT': '0.410', 'ARMOR': '0.465', 'WEAPON3': '0.700', 'weapon2': '1.110', 'weapon3': '1.558', 'DAMAGECOUNT': '1.812', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:43,806][2409076] DAMAGECOUNT value on done: 2803.0
[2023-02-25 12:52:43,810][2409076] Sum rewards: 7.600, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.700', 'AMMO5': '0.009', 'AMMO2': '0.012', 'AMMO3': '0.059', 'WEAPON1': '0.060', 'AMMO4': '0.061', 'WEAPON4': '0.150', 'weapon5': '0.202', 'weapon4': '0.252', 'WEAPON5': '0.300', 'ARMOR': '0.443', 'WEAPON3': '0.450', 'HITCOUNT': '0.510', 'weapon3': '1.022', 'weapon2': '1.476', 'DAMAGECOUNT': '2.043', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:43,844][2409407] DAMAGECOUNT value on done: 2232.0
[2023-02-25 12:52:43,847][2409407] Sum rewards: -1.302, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.048', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO3': '0.083', 'AMMO4': '0.089', 'weapon4': '0.094', 'weapon5': '0.104', 'WEAPON4': '0.150', 'HITCOUNT': '0.330', 'WEAPON5': '0.350', 'ARMOR': '0.458', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.227', 'weapon2': '1.522', 'weapon3': '1.778'}
[2023-02-25 12:52:44,020][2409468] DAMAGECOUNT value on done: 2633.0
[2023-02-25 12:52:44,023][2409468] Sum rewards: -1.460, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.758', 'AMMO2': '0.017', 'AMMO5': '0.028', 'WEAPON4': '0.050', 'weapon5': '0.054', 'WEAPON1': '0.080', 'AMMO4': '0.084', 'AMMO3': '0.135', 'weapon4': '0.250', 'ARMOR': '0.464', 'HITCOUNT': '0.470', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'weapon2': '1.116', 'DAMAGECOUNT': '1.665', 'weapon3': '2.086', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:44,054][2409373] DAMAGECOUNT value on done: 2426.0
[2023-02-25 12:52:44,057][2409373] Sum rewards: 7.822, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.201', 'AMMO2': '0.011', 'AMMO5': '0.012', 'ARMOR': '0.028', 'WEAPON1': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.148', 'weapon5': '0.216', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '0.640', 'weapon2': '1.546', 'weapon3': '1.820', 'DAMAGECOUNT': '2.364', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:52:44,095][2409486] DAMAGECOUNT value on done: 2175.0
[2023-02-25 12:52:44,096][2409486] Sum rewards: 5.535, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.916', 'AMMO2': '0.002', 'ARMOR': '0.005', 'AMMO4': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.081', 'weapon5': '0.082', 'weapon7': '0.090', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.236', 'WEAPON5': '0.250', 'HITCOUNT': '0.430', 'WEAPON3': '0.550', 'weapon3': '1.290', 'DAMAGECOUNT': '1.506', 'weapon2': '1.600', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:44,356][2409389] DAMAGECOUNT value on done: 2479.0
[2023-02-25 12:52:44,357][2409389] Sum rewards: 6.633, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.028', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'weapon5': '0.058', 'AMMO4': '0.072', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.248', 'HITCOUNT': '0.330', 'ARMOR': '0.456', 'WEAPON3': '0.550', 'weapon3': '1.282', 'weapon2': '1.626', 'DAMAGECOUNT': '1.647', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:52:44,443][2409080] DAMAGECOUNT value on done: 2370.0
[2023-02-25 12:52:44,448][2409080] Sum rewards: 2.759, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.952', 'AMMO5': '0.015', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'AMMO3': '0.069', 'AMMO4': '0.087', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.340', 'WEAPON3': '0.550', 'weapon4': '0.598', 'weapon2': '0.840', 'ARMOR': '0.908', 'DAMAGECOUNT': '1.242', 'weapon3': '1.414', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:44,555][2409074] Updated weights for policy 0, policy_version 12491 (0.0013)
[2023-02-25 12:52:44,871][2409565] DAMAGECOUNT value on done: 2113.0
[2023-02-25 12:52:44,874][2409565] Sum rewards: 0.559, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.784', 'AMMO2': '0.005', 'AMMO5': '0.019', 'AMMO4': '0.023', 'WEAPON1': '0.040', 'weapon5': '0.042', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'weapon4': '0.230', 'WEAPON5': '0.400', 'ARMOR': '0.449', 'HITCOUNT': '0.450', 'WEAPON3': '0.750', 'weapon2': '0.950', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.884', 'weapon3': '1.888'}
[2023-02-25 12:52:44,901][2409355] DAMAGECOUNT value on done: 2206.0
[2023-02-25 12:52:44,903][2409355] Sum rewards: 3.809, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.887', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO3': '0.030', 'WEAPON1': '0.050', 'AMMO4': '0.053', 'WEAPON4': '0.150', 'weapon5': '0.172', 'WEAPON3': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.278', 'HITCOUNT': '0.380', 'weapon3': '0.772', 'ARMOR': '0.904', 'DAMAGECOUNT': '1.548', 'weapon2': '2.090', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:45,158][2409596] DAMAGECOUNT value on done: 2424.0
[2023-02-25 12:52:45,159][2409596] Sum rewards: 1.920, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.789', 'AMMO2': '0.005', 'AMMO5': '0.015', 'AMMO4': '0.023', 'WEAPON1': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon5': '0.120', 'weapon4': '0.202', 'WEAPON5': '0.350', 'HITCOUNT': '0.450', 'WEAPON3': '0.700', 'weapon3': '1.440', 'DAMAGECOUNT': '1.605', 'weapon2': '1.818', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:45,210][2409075] DAMAGECOUNT value on done: 2607.0
[2023-02-25 12:52:45,211][2409075] Sum rewards: 1.777, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.230', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.113', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'weapon4': '0.348', 'ARMOR': '0.476', 'HITCOUNT': '0.560', 'WEAPON3': '0.650', 'weapon3': '1.392', 'weapon2': '1.490', 'DAMAGECOUNT': '1.923', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:45,388][2409405] DAMAGECOUNT value on done: 1574.0
[2023-02-25 12:52:45,392][2409405] Sum rewards: 1.664, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.631', 'AMMO5': '0.015', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'WEAPON1': '0.060', 'AMMO4': '0.076', 'weapon5': '0.098', 'weapon4': '0.126', 'HITCOUNT': '0.130', 'DAMAGECOUNT': '0.309', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'ARMOR': '0.444', 'FRAGCOUNT': '1.000', 'weapon3': '1.068', 'weapon2': '1.844'}
[2023-02-25 12:52:45,408][2409406] DAMAGECOUNT value on done: 2537.0
[2023-02-25 12:52:45,409][2409406] Sum rewards: 4.738, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.510', 'AMMO2': '0.016', 'ARMOR': '0.040', 'WEAPON1': '0.040', 'AMMO3': '0.070', 'AMMO4': '0.078', 'WEAPON4': '0.200', 'HITCOUNT': '0.280', 'weapon4': '0.358', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.954', 'weapon2': '1.400', 'weapon3': '1.562', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:45,772][2409105] DAMAGECOUNT value on done: 2067.0
[2023-02-25 12:52:45,773][2409105] Sum rewards: 0.533, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.260', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON1': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'HITCOUNT': '0.230', 'WEAPON4': '0.250', 'weapon4': '0.402', 'ARMOR': '0.504', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.855', 'weapon2': '0.968', 'FRAGCOUNT': '1.000', 'weapon3': '1.848'}
[2023-02-25 12:52:45,825][2409099] DAMAGECOUNT value on done: 2110.0
[2023-02-25 12:52:45,828][2409099] Sum rewards: 1.076, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.140', 'AMMO2': '0.004', 'AMMO5': '0.012', 'AMMO4': '0.018', 'WEAPON1': '0.020', 'weapon4': '0.032', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'weapon5': '0.110', 'weapon7': '0.122', 'HITCOUNT': '0.160', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'ARMOR': '0.404', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.516', 'weapon3': '0.862', 'FRAGCOUNT': '1.000', 'weapon2': '2.308'}
[2023-02-25 12:52:46,143][2409078] DAMAGECOUNT value on done: 2494.0
[2023-02-25 12:52:46,144][2409078] Sum rewards: 4.346, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.440', 'AMMO5': '0.003', 'AMMO2': '0.014', 'ARMOR': '0.028', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.073', 'WEAPON4': '0.150', 'weapon4': '0.282', 'HITCOUNT': '0.400', 'WEAPON3': '0.450', 'weapon2': '0.958', 'weapon3': '1.126', 'DAMAGECOUNT': '1.392', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:46,147][2409096] DAMAGECOUNT value on done: 1834.0
[2023-02-25 12:52:46,151][2409096] Sum rewards: 2.163, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.930', 'AMMO4': '-0.068', 'AMMO2': '-0.014', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO3': '0.055', 'weapon5': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.204', 'HITCOUNT': '0.410', 'WEAPON3': '0.450', 'weapon3': '1.112', 'weapon2': '1.120', 'DAMAGECOUNT': '1.257', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:46,288][2409077] DAMAGECOUNT value on done: 2654.0
[2023-02-25 12:52:46,289][2409077] Sum rewards: 1.278, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.930', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.040', 'AMMO3': '0.072', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.136', 'HITCOUNT': '0.140', 'weapon5': '0.144', 'WEAPON5': '0.300', 'ARMOR': '0.453', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.612', 'FRAGCOUNT': '1.000', 'weapon3': '1.240', 'weapon2': '1.862'}
[2023-02-25 12:52:46,337][2409074] Updated weights for policy 0, policy_version 12501 (0.0012)
[2023-02-25 12:52:46,687][2409079] DAMAGECOUNT value on done: 2228.0
[2023-02-25 12:52:46,702][2409079] Sum rewards: 4.716, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.343', 'weapon5': '0.014', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO2': '0.039', 'ARMOR': '0.052', 'AMMO3': '0.108', 'AMMO4': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.440', 'WEAPON3': '0.600', 'weapon2': '0.692', 'weapon4': '0.834', 'weapon3': '1.474', 'DAMAGECOUNT': '1.515', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:52:47,047][2409547] DAMAGECOUNT value on done: 2490.0
[2023-02-25 12:52:47,050][2409547] Sum rewards: 2.250, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.113', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.088', 'AMMO3': '0.141', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'weapon4': '0.574', 'HITCOUNT': '0.770', 'WEAPON3': '0.900', 'weapon2': '1.122', 'weapon3': '1.870', 'DAMAGECOUNT': '2.502', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:47,106][2409097] DAMAGECOUNT value on done: 1802.0
[2023-02-25 12:52:47,106][2409097] Sum rewards: 3.231, reward structure: {'DEATHCOUNT': '-0.750', 'AMMO2': '0.010', 'AMMO3': '0.020', 'HEALTH': '0.030', 'AMMO4': '0.049', 'weapon2': '0.090', 'WEAPON4': '0.150', 'WEAPON3': '0.150', 'HITCOUNT': '0.250', 'ARMOR': '0.400', 'weapon4': '0.516', 'weapon3': '0.590', 'DAMAGECOUNT': '0.726', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:52:47,186][2408954] Fps is (10 sec: 24575.5, 60 sec: 25258.6, 300 sec: 25534.0). Total num frames: 51216384. Throughput: 0: 6346.7. Samples: 12812916. Policy #0 lag: (min: 0.0, avg: 15.2, max: 29.0)
[2023-02-25 12:52:47,187][2408954] Avg episode reward: [(0, '2.804')]
[2023-02-25 12:52:47,382][2409407] DAMAGECOUNT value on done: 1906.0
[2023-02-25 12:52:47,384][2409407] Sum rewards: -0.665, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'weapon5': '0.036', 'weapon7': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.125', 'AMMO4': '0.143', 'WEAPON5': '0.250', 'weapon4': '0.294', 'HITCOUNT': '0.350', 'ARMOR': '0.400', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.600', 'HEALTH': '0.618', 'DAMAGECOUNT': '1.014', 'weapon3': '1.346', 'weapon2': '1.358'}
[2023-02-25 12:52:47,388][2409866] DAMAGECOUNT value on done: 3059.0
[2023-02-25 12:52:47,388][2409866] Sum rewards: 2.168, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.087', 'AMMO2': '0.007', 'AMMO5': '0.013', 'AMMO4': '0.034', 'WEAPON1': '0.050', 'weapon4': '0.060', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'weapon5': '0.112', 'WEAPON5': '0.350', 'ARMOR': '0.428', 'HITCOUNT': '0.450', 'WEAPON3': '0.650', 'weapon3': '1.476', 'DAMAGECOUNT': '1.581', 'weapon2': '1.596', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:47,460][2409104] DAMAGECOUNT value on done: 2692.0
[2023-02-25 12:52:47,463][2409104] Sum rewards: 5.241, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.093', 'HEALTH': '0.210', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.560', 'weapon2': '1.744', 'weapon3': '1.746', 'DAMAGECOUNT': '1.878', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:47,728][2409469] DAMAGECOUNT value on done: 2051.0
[2023-02-25 12:52:47,729][2409469] Sum rewards: 2.257, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.637', 'AMMO4': '-0.073', 'AMMO2': '-0.014', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.088', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.117', 'WEAPON5': '0.300', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'ARMOR': '1.303', 'weapon2': '1.488', 'DAMAGECOUNT': '1.815', 'weapon3': '1.948', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:47,774][2409486] DAMAGECOUNT value on done: 2674.0
[2023-02-25 12:52:47,777][2409486] Sum rewards: 5.176, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.304', 'AMMO5': '0.015', 'AMMO2': '0.015', 'ARMOR': '0.028', 'AMMO4': '0.075', 'AMMO3': '0.138', 'weapon5': '0.146', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.426', 'HITCOUNT': '0.610', 'WEAPON3': '0.850', 'weapon2': '1.356', 'weapon3': '1.586', 'DAMAGECOUNT': '2.685', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:52:47,791][2409076] DAMAGECOUNT value on done: 2601.0
[2023-02-25 12:52:47,793][2409076] Sum rewards: -2.514, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.272', 'AMMO5': '0.017', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'weapon7': '0.038', 'AMMO3': '0.062', 'AMMO4': '0.126', 'weapon5': '0.154', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.300', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'ARMOR': '0.485', 'FRAGCOUNT': '0.500', 'weapon4': '0.658', 'weapon3': '0.988', 'DAMAGECOUNT': '1.272', 'weapon2': '1.452'}
[2023-02-25 12:52:47,959][2409074] Updated weights for policy 0, policy_version 12511 (0.0012)
[2023-02-25 12:52:47,975][2409389] DAMAGECOUNT value on done: 3351.0
[2023-02-25 12:52:47,976][2409389] Sum rewards: 4.142, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.512', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.007', 'WEAPON1': '0.030', 'AMMO4': '0.034', 'weapon4': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'weapon5': '0.078', 'WEAPON4': '0.200', 'HITCOUNT': '0.580', 'WEAPON3': '0.600', 'weapon2': '1.434', 'weapon3': '1.508', 'DAMAGECOUNT': '2.508', 'FRAGCOUNT': '4.500'}
[2023-02-25 12:52:48,027][2409373] DAMAGECOUNT value on done: 1961.0
[2023-02-25 12:52:48,031][2409373] Sum rewards: 5.212, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.190', 'AMMO5': '0.005', 'ARMOR': '0.005', 'AMMO2': '0.012', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'AMMO4': '0.061', 'weapon5': '0.082', 'weapon7': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.230', 'WEAPON3': '0.300', 'weapon4': '0.382', 'weapon3': '0.712', 'DAMAGECOUNT': '1.581', 'weapon2': '1.800', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:48,161][2409468] DAMAGECOUNT value on done: 1408.0
[2023-02-25 12:52:48,164][2409468] Sum rewards: 1.399, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.470', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.014', 'WEAPON1': '0.020', 'weapon5': '0.028', 'WEAPON4': '0.050', 'AMMO3': '0.059', 'weapon4': '0.094', 'WEAPON5': '0.150', 'HITCOUNT': '0.210', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.870', 'weapon3': '0.966', 'weapon2': '1.448', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:48,439][2409355] DAMAGECOUNT value on done: 2760.0
[2023-02-25 12:52:48,440][2409355] Sum rewards: 0.612, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.870', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO2': '0.045', 'weapon5': '0.114', 'AMMO3': '0.115', 'AMMO4': '0.226', 'weapon4': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.420', 'WEAPON3': '0.700', 'weapon2': '0.992', 'DAMAGECOUNT': '1.776', 'weapon3': '1.780', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:48,465][2409565] DAMAGECOUNT value on done: 2720.0
[2023-02-25 12:52:48,466][2409565] Sum rewards: 4.063, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'AMMO3': '0.083', 'weapon5': '0.098', 'weapon7': '0.122', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'HEALTH': '0.204', 'WEAPON5': '0.250', 'weapon4': '0.296', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'HITCOUNT': '0.400', 'WEAPON3': '0.450', 'weapon2': '1.166', 'weapon3': '1.212', 'ARMOR': '1.264', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.797'}
[2023-02-25 12:52:48,533][2409080] DAMAGECOUNT value on done: 1636.0
[2023-02-25 12:52:48,534][2409080] Sum rewards: 0.170, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.496', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.036', 'AMMO3': '0.114', 'WEAPON4': '0.150', 'HITCOUNT': '0.260', 'weapon4': '0.418', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.777', 'ARMOR': '0.853', 'FRAGCOUNT': '1.000', 'weapon2': '1.428', 'weapon3': '1.662'}
[2023-02-25 12:52:48,822][2409075] DAMAGECOUNT value on done: 1989.0
[2023-02-25 12:52:48,824][2409075] Sum rewards: 1.708, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.728', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'AMMO2': '0.033', 'weapon5': '0.050', 'AMMO3': '0.089', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'HITCOUNT': '0.310', 'WEAPON4': '0.400', 'weapon4': '0.456', 'WEAPON3': '0.500', 'weapon3': '1.018', 'DAMAGECOUNT': '1.167', 'ARMOR': '1.251', 'weapon2': '1.312', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:49,089][2409405] DAMAGECOUNT value on done: 2984.0
[2023-02-25 12:52:49,090][2409405] Sum rewards: 0.978, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.590', 'weapon5': '0.002', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'weapon7': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.105', 'WEAPON5': '0.200', 'HITCOUNT': '0.220', 'weapon4': '0.238', 'WEAPON3': '0.650', 'weapon3': '0.710', 'ARMOR': '0.850', 'DAMAGECOUNT': '1.044', 'weapon2': '1.052', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:49,145][2409596] DAMAGECOUNT value on done: 2369.0
[2023-02-25 12:52:49,146][2409596] Sum rewards: 3.174, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.798', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO3': '0.072', 'AMMO4': '0.082', 'weapon5': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'HITCOUNT': '0.330', 'WEAPON3': '0.400', 'weapon4': '0.538', 'ARMOR': '0.930', 'weapon3': '1.182', 'weapon2': '1.222', 'DAMAGECOUNT': '1.488', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:49,215][2409406] DAMAGECOUNT value on done: 2258.0
[2023-02-25 12:52:49,216][2409406] Sum rewards: 5.480, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.342', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO3': '0.075', 'weapon5': '0.190', 'WEAPON5': '0.200', 'HITCOUNT': '0.300', 'WEAPON3': '0.400', 'ARMOR': '0.440', 'weapon2': '0.664', 'DAMAGECOUNT': '1.125', 'weapon3': '1.444', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:49,358][2409105] DAMAGECOUNT value on done: 2253.0
[2023-02-25 12:52:49,361][2409105] Sum rewards: 4.519, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.676', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.013', 'WEAPON1': '0.060', 'AMMO3': '0.098', 'weapon5': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.414', 'HITCOUNT': '0.460', 'ARMOR': '0.481', 'WEAPON3': '0.750', 'weapon2': '1.074', 'weapon3': '1.784', 'DAMAGECOUNT': '2.139', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:49,419][2409099] DAMAGECOUNT value on done: 2154.0
[2023-02-25 12:52:49,422][2409099] Sum rewards: 0.842, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.450', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'AMMO3': '0.094', 'AMMO4': '0.100', 'weapon4': '0.122', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.810', 'ARMOR': '0.911', 'weapon3': '1.150', 'FRAGCOUNT': '2.000', 'weapon2': '2.134'}
[2023-02-25 12:52:49,427][2409074] Updated weights for policy 0, policy_version 12521 (0.0012)
[2023-02-25 12:52:49,861][2409078] DAMAGECOUNT value on done: 2037.0
[2023-02-25 12:52:49,864][2409078] Sum rewards: 1.856, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.556', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO3': '0.074', 'weapon5': '0.160', 'AMMO4': '0.181', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.520', 'weapon4': '0.928', 'weapon2': '1.126', 'weapon3': '1.140', 'DAMAGECOUNT': '2.022', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:50,219][2409077] DAMAGECOUNT value on done: 1953.0
[2023-02-25 12:52:50,220][2409077] Sum rewards: -1.990, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.986', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.044', 'AMMO3': '0.116', 'weapon7': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.146', 'HITCOUNT': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.795', 'ARMOR': '0.874', 'FRAGCOUNT': '1.000', 'weapon3': '1.298', 'weapon2': '2.068'}
[2023-02-25 12:52:50,408][2409096] DAMAGECOUNT value on done: 2310.0
[2023-02-25 12:52:50,411][2409096] Sum rewards: 0.518, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.450', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.058', 'AMMO3': '0.066', 'weapon7': '0.084', 'AMMO4': '0.089', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.190', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.372', 'WEAPON4': '0.400', 'ARMOR': '0.496', 'WEAPON3': '0.500', 'weapon2': '0.902', 'DAMAGECOUNT': '0.951', 'weapon3': '1.122', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:50,519][2409079] DAMAGECOUNT value on done: 2364.0
[2023-02-25 12:52:50,520][2409079] Sum rewards: 6.914, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.170', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.060', 'weapon7': '0.060', 'AMMO4': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.250', 'WEAPON3': '0.300', 'HITCOUNT': '0.460', 'weapon4': '0.460', 'weapon3': '0.848', 'ARMOR': '1.315', 'weapon2': '1.710', 'DAMAGECOUNT': '2.607', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:50,978][2409547] DAMAGECOUNT value on done: 2003.0
[2023-02-25 12:52:50,979][2409547] Sum rewards: 2.958, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.624', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.024', 'WEAPON1': '0.040', 'weapon7': '0.052', 'AMMO3': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.226', 'HITCOUNT': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'ARMOR': '0.474', 'weapon4': '0.530', 'weapon3': '0.840', 'DAMAGECOUNT': '1.239', 'weapon2': '1.502', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:51,000][2409097] DAMAGECOUNT value on done: 1497.0
[2023-02-25 12:52:51,001][2409097] Sum rewards: 4.502, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.330', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'AMMO3': '0.052', 'weapon5': '0.080', 'WEAPON5': '0.100', 'weapon4': '0.108', 'HITCOUNT': '0.290', 'WEAPON3': '0.400', 'ARMOR': '0.816', 'weapon3': '1.168', 'weapon2': '1.456', 'DAMAGECOUNT': '1.491', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:51,134][2409407] DAMAGECOUNT value on done: 2117.0
[2023-02-25 12:52:51,137][2409407] Sum rewards: 3.812, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.818', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.064', 'weapon4': '0.100', 'weapon5': '0.166', 'WEAPON5': '0.250', 'HITCOUNT': '0.330', 'WEAPON3': '0.500', 'weapon3': '1.210', 'DAMAGECOUNT': '1.401', 'weapon2': '1.828', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:51,181][2409866] DAMAGECOUNT value on done: 2222.0
[2023-02-25 12:52:51,184][2409866] Sum rewards: 2.135, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon4': '0.026', 'weapon5': '0.060', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'WEAPON5': '0.200', 'HEALTH': '0.234', 'HITCOUNT': '0.270', 'WEAPON3': '0.450', 'ARMOR': '0.845', 'DAMAGECOUNT': '0.930', 'weapon3': '1.176', 'weapon2': '1.614', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:51,277][2409074] Updated weights for policy 0, policy_version 12531 (0.0012)
[2023-02-25 12:52:51,322][2409104] DAMAGECOUNT value on done: 1789.0
[2023-02-25 12:52:51,324][2409104] Sum rewards: 4.779, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.820', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO3': '0.054', 'weapon5': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.244', 'HITCOUNT': '0.430', 'WEAPON3': '0.450', 'weapon2': '1.130', 'weapon3': '1.222', 'DAMAGECOUNT': '1.713', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:51,484][2409076] DAMAGECOUNT value on done: 1496.0
[2023-02-25 12:52:51,485][2409076] Sum rewards: 1.193, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.660', 'AMMO2': '0.005', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.027', 'weapon5': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.059', 'weapon4': '0.134', 'HITCOUNT': '0.170', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.615', 'ARMOR': '1.354', 'weapon3': '1.504', 'weapon2': '1.956'}
[2023-02-25 12:52:51,548][2409486] DAMAGECOUNT value on done: 2029.0
[2023-02-25 12:52:51,552][2409486] Sum rewards: -0.379, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.396', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.070', 'AMMO4': '0.089', 'AMMO3': '0.104', 'weapon4': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.310', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.966', 'weapon2': '1.444', 'weapon3': '1.892', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:51,802][2409373] DAMAGECOUNT value on done: 2448.0
[2023-02-25 12:52:51,819][2409373] Sum rewards: 2.568, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.702', 'ARMOR': '0.004', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.037', 'AMMO3': '0.060', 'weapon5': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.370', 'WEAPON3': '0.400', 'weapon4': '0.462', 'weapon2': '1.048', 'weapon3': '1.388', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.064'}
[2023-02-25 12:52:51,910][2409389] DAMAGECOUNT value on done: 2511.0
[2023-02-25 12:52:51,911][2409389] Sum rewards: 1.241, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.177', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.038', 'AMMO3': '0.050', 'weapon4': '0.084', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.330', 'WEAPON3': '0.350', 'weapon3': '0.750', 'ARMOR': '0.868', 'DAMAGECOUNT': '1.098', 'weapon2': '1.846', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:52:52,002][2409468] DAMAGECOUNT value on done: 3075.0
[2023-02-25 12:52:52,003][2409468] Sum rewards: 5.848, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.504', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.020', 'WEAPON1': '0.030', 'weapon7': '0.062', 'AMMO3': '0.085', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.224', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.610', 'weapon3': '1.380', 'weapon2': '1.608', 'DAMAGECOUNT': '2.580', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:52,031][2409469] DAMAGECOUNT value on done: 1977.0
[2023-02-25 12:52:52,032][2409469] Sum rewards: -4.697, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.000', 'AMMO5': '0.017', 'AMMO2': '0.021', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'weapon5': '0.080', 'AMMO4': '0.105', 'AMMO3': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'HITCOUNT': '0.370', 'weapon4': '0.470', 'weapon2': '0.670', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.050', 'DAMAGECOUNT': '1.155', 'weapon3': '2.028'}
[2023-02-25 12:52:52,186][2408954] Fps is (10 sec: 25804.9, 60 sec: 25531.8, 300 sec: 25589.6). Total num frames: 51359744. Throughput: 0: 6354.4. Samples: 12832416. Policy #0 lag: (min: 0.0, avg: 13.9, max: 28.0)
[2023-02-25 12:52:52,186][2408954] Avg episode reward: [(0, '2.288')]
[2023-02-25 12:52:52,231][2409355] DAMAGECOUNT value on done: 1965.0
[2023-02-25 12:52:52,232][2409355] Sum rewards: 4.736, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.512', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.070', 'WEAPON5': '0.200', 'HITCOUNT': '0.210', 'weapon5': '0.246', 'WEAPON3': '0.400', 'weapon3': '0.730', 'ARMOR': '0.951', 'DAMAGECOUNT': '1.125', 'weapon2': '1.286', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:52,498][2409080] DAMAGECOUNT value on done: 2077.0
[2023-02-25 12:52:52,499][2409080] Sum rewards: 5.643, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.373', 'AMMO5': '0.009', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'weapon5': '0.072', 'AMMO3': '0.076', 'AMMO4': '0.085', 'weapon4': '0.216', 'WEAPON5': '0.250', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'ARMOR': '1.269', 'weapon3': '1.368', 'weapon2': '1.608', 'DAMAGECOUNT': '1.965', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:52,509][2409074] Updated weights for policy 0, policy_version 12541 (0.0013)
[2023-02-25 12:52:52,872][2409405] DAMAGECOUNT value on done: 2754.0
[2023-02-25 12:52:52,875][2409405] Sum rewards: 3.216, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.260', 'weapon5': '0.002', 'AMMO2': '0.003', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.015', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'WEAPON4': '0.200', 'weapon4': '0.228', 'ARMOR': '0.458', 'HITCOUNT': '0.630', 'WEAPON3': '0.750', 'weapon3': '1.264', 'weapon2': '1.522', 'DAMAGECOUNT': '1.929', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:52,898][2409075] DAMAGECOUNT value on done: 1980.0
[2023-02-25 12:52:52,902][2409075] Sum rewards: 0.665, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.780', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO4': '0.022', 'AMMO3': '0.052', 'weapon7': '0.084', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.390', 'WEAPON3': '0.400', 'weapon4': '0.418', 'ARMOR': '0.520', 'weapon3': '1.066', 'weapon2': '1.328', 'DAMAGECOUNT': '1.404'}
[2023-02-25 12:52:53,233][2409099] DAMAGECOUNT value on done: 2045.0
[2023-02-25 12:52:53,234][2409099] Sum rewards: -0.795, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.532', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.028', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.085', 'weapon5': '0.102', 'weapon4': '0.170', 'WEAPON5': '0.200', 'HITCOUNT': '0.280', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.852', 'ARMOR': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.322', 'weapon2': '1.640'}
[2023-02-25 12:52:53,677][2409078] DAMAGECOUNT value on done: 2072.0
[2023-02-25 12:52:53,678][2409078] Sum rewards: 4.468, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.432', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.056', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'weapon5': '0.136', 'weapon4': '0.218', 'WEAPON5': '0.300', 'HITCOUNT': '0.330', 'WEAPON3': '0.550', 'ARMOR': '0.800', 'weapon2': '1.204', 'weapon3': '1.542', 'DAMAGECOUNT': '1.782', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:54,292][2409079] DAMAGECOUNT value on done: 2468.0
[2023-02-25 12:52:54,293][2409079] Sum rewards: 3.399, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-2.245', 'AMMO2': '0.002', 'AMMO4': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.082', 'WEAPON4': '0.300', 'HITCOUNT': '0.360', 'weapon4': '0.508', 'ARMOR': '0.537', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.311', 'weapon3': '1.506', 'weapon2': '1.658', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:54,713][2409074] Updated weights for policy 0, policy_version 12551 (0.0013)
[2023-02-25 12:52:54,781][2409866] DAMAGECOUNT value on done: 2237.0
[2023-02-25 12:52:54,782][2409866] Sum rewards: 3.587, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.870', 'AMMO2': '0.014', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.068', 'AMMO3': '0.086', 'weapon5': '0.128', 'WEAPON4': '0.150', 'weapon4': '0.218', 'WEAPON5': '0.300', 'HITCOUNT': '0.380', 'WEAPON3': '0.600', 'weapon3': '1.024', 'ARMOR': '1.286', 'DAMAGECOUNT': '1.740', 'weapon2': '1.908', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:54,810][2409096] DAMAGECOUNT value on done: 2172.0
[2023-02-25 12:52:54,894][2409407] DAMAGECOUNT value on done: 2183.0
[2023-02-25 12:52:54,894][2409407] Sum rewards: 5.830, reward structure: {'DEATHCOUNT': '-4.500', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'weapon4': '0.226', 'HEALTH': '0.344', 'WEAPON3': '0.400', 'HITCOUNT': '0.490', 'weapon3': '1.432', 'weapon2': '1.532', 'DAMAGECOUNT': '1.593', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:55,016][2409104] DAMAGECOUNT value on done: 2461.0
[2023-02-25 12:52:55,020][2409104] Sum rewards: 0.320, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.499', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.039', 'weapon5': '0.112', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'HITCOUNT': '0.280', 'WEAPON5': '0.300', 'weapon4': '0.376', 'WEAPON3': '0.600', 'ARMOR': '0.869', 'weapon2': '0.934', 'DAMAGECOUNT': '1.368', 'weapon3': '1.642', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:55,159][2409486] DAMAGECOUNT value on done: 1587.0
[2023-02-25 12:52:55,163][2409486] Sum rewards: 3.456, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.264', 'AMMO2': '0.004', 'AMMO4': '0.018', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'weapon7': '0.058', 'AMMO3': '0.073', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.420', 'weapon4': '0.434', 'WEAPON3': '0.500', 'weapon3': '1.120', 'DAMAGECOUNT': '1.137', 'weapon2': '1.494', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:55,289][2409076] DAMAGECOUNT value on done: 2132.0
[2023-02-25 12:52:55,293][2409076] Sum rewards: 0.362, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.622', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.041', 'WEAPON5': '0.050', 'AMMO3': '0.084', 'AMMO4': '0.206', 'HITCOUNT': '0.340', 'WEAPON4': '0.450', 'WEAPON3': '0.550', 'weapon4': '0.656', 'weapon3': '0.828', 'weapon2': '1.088', 'DAMAGECOUNT': '1.119', 'ARMOR': '1.307', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:55,370][2409097] DAMAGECOUNT value on done: 1954.0
[2023-02-25 12:52:55,374][2409097] Sum rewards: -1.805, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.538', 'AMMO2': '0.014', 'AMMO5': '0.016', 'AMMO4': '0.070', 'weapon5': '0.114', 'AMMO3': '0.115', 'WEAPON5': '0.350', 'HITCOUNT': '0.360', 'WEAPON4': '0.450', 'ARMOR': '0.541', 'WEAPON3': '0.700', 'weapon2': '0.730', 'weapon4': '0.920', 'DAMAGECOUNT': '1.092', 'weapon3': '1.260', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:55,376][2409547] DAMAGECOUNT value on done: 2985.0
[2023-02-25 12:52:55,378][2409547] Sum rewards: 8.152, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.624', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON1': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'weapon4': '0.206', 'weapon5': '0.240', 'WEAPON5': '0.300', 'ARMOR': '0.424', 'HITCOUNT': '0.530', 'WEAPON3': '0.550', 'weapon3': '1.432', 'weapon2': '1.434', 'DAMAGECOUNT': '2.331', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:52:55,595][2409074] Updated weights for policy 0, policy_version 12561 (0.0012)
[2023-02-25 12:52:55,919][2409389] DAMAGECOUNT value on done: 2446.0
[2023-02-25 12:52:55,921][2409389] Sum rewards: 5.226, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.594', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'weapon5': '0.046', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.065', 'WEAPON4': '0.200', 'HITCOUNT': '0.350', 'WEAPON3': '0.400', 'weapon4': '0.458', 'ARMOR': '0.472', 'weapon3': '0.914', 'weapon2': '1.096', 'DAMAGECOUNT': '1.449', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:56,254][2409468] DAMAGECOUNT value on done: 1823.0
[2023-02-25 12:52:56,255][2409468] Sum rewards: 3.882, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.539', 'AMMO5': '0.009', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'AMMO3': '0.086', 'AMMO4': '0.096', 'weapon5': '0.120', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon4': '0.514', 'HITCOUNT': '0.520', 'WEAPON3': '0.650', 'weapon2': '0.822', 'weapon3': '1.594', 'DAMAGECOUNT': '1.851', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:56,353][2409355] DAMAGECOUNT value on done: 1989.0
[2023-02-25 12:52:56,354][2409355] Sum rewards: -1.287, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.220', 'AMMO5': '0.007', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'weapon5': '0.062', 'weapon7': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.136', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.460', 'weapon4': '0.556', 'WEAPON3': '0.850', 'weapon2': '1.024', 'DAMAGECOUNT': '1.575', 'weapon3': '1.846', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:52:56,441][2409469] DAMAGECOUNT value on done: 3345.0
[2023-02-25 12:52:56,442][2409469] Sum rewards: 5.203, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.210', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.060', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.158', 'HITCOUNT': '0.610', 'WEAPON3': '0.800', 'weapon2': '1.514', 'weapon3': '1.660', 'DAMAGECOUNT': '2.058', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:52:56,578][2409405] DAMAGECOUNT value on done: 1939.0
[2023-02-25 12:52:56,616][2409080] DAMAGECOUNT value on done: 2549.0
[2023-02-25 12:52:56,617][2409080] Sum rewards: 9.139, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.785', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.053', 'AMMO4': '0.085', 'weapon4': '0.094', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.370', 'WEAPON3': '0.400', 'ARMOR': '0.915', 'weapon3': '1.176', 'weapon2': '1.588', 'DAMAGECOUNT': '2.160', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:52:56,773][2409075] DAMAGECOUNT value on done: 2116.0
[2023-02-25 12:52:56,776][2409075] Sum rewards: 0.932, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.988', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON1': '0.040', 'AMMO3': '0.070', 'weapon5': '0.106', 'WEAPON5': '0.150', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'WEAPON3': '0.400', 'weapon4': '0.426', 'ARMOR': '0.499', 'DAMAGECOUNT': '0.705', 'weapon2': '0.914', 'weapon3': '1.252', 'FRAGCOUNT': '1.500'}
[2023-02-25 12:52:57,141][2409099] DAMAGECOUNT value on done: 2826.0
[2023-02-25 12:52:57,142][2409099] Sum rewards: 6.292, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.324', 'AMMO5': '0.022', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.121', 'AMMO4': '0.139', 'weapon5': '0.178', 'WEAPON4': '0.200', 'weapon4': '0.388', 'HITCOUNT': '0.410', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'ARMOR': '0.903', 'weapon3': '1.290', 'weapon2': '1.404', 'DAMAGECOUNT': '1.992', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:52:57,186][2408954] Fps is (10 sec: 27033.9, 60 sec: 25600.0, 300 sec: 25561.8). Total num frames: 51486720. Throughput: 0: 6367.7. Samples: 12870756. Policy #0 lag: (min: 0.0, avg: 13.9, max: 28.0)
[2023-02-25 12:52:57,187][2408954] Avg episode reward: [(0, '2.301')]
[2023-02-25 12:52:57,255][2409074] Updated weights for policy 0, policy_version 12571 (0.0012)
[2023-02-25 12:52:57,548][2409078] DAMAGECOUNT value on done: 2726.0
[2023-02-25 12:52:57,548][2409078] Sum rewards: 7.224, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.438', 'AMMO5': '0.029', 'AMMO2': '0.038', 'weapon5': '0.088', 'AMMO3': '0.114', 'AMMO4': '0.189', 'weapon4': '0.332', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'HITCOUNT': '0.680', 'WEAPON3': '0.750', 'weapon2': '1.238', 'ARMOR': '1.434', 'weapon3': '1.774', 'DAMAGECOUNT': '2.346', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:52:57,907][2409079] DAMAGECOUNT value on done: 2633.0
[2023-02-25 12:52:57,908][2409079] Sum rewards: 3.505, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.925', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO3': '0.040', 'WEAPON4': '0.100', 'weapon5': '0.154', 'weapon4': '0.170', 'HITCOUNT': '0.190', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'DAMAGECOUNT': '1.008', 'weapon2': '1.046', 'weapon3': '1.046', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:52:58,149][2409099] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)]
[2023-02-25 12:52:58,446][2409407] DAMAGECOUNT value on done: 2602.0
[2023-02-25 12:52:58,446][2409407] Sum rewards: 5.315, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.209', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.020', 'weapon7': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.230', 'WEAPON5': '0.300', 'ARMOR': '0.404', 'HITCOUNT': '0.560', 'WEAPON3': '0.750', 'weapon2': '1.226', 'weapon3': '2.128', 'DAMAGECOUNT': '2.406', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:52:58,986][2409076] DAMAGECOUNT value on done: 2086.0
[2023-02-25 12:52:58,989][2409076] Sum rewards: 7.173, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.496', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.078', 'AMMO3': '0.084', 'weapon5': '0.116', 'weapon4': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.459', 'WEAPON3': '0.600', 'HITCOUNT': '0.670', 'weapon2': '1.352', 'weapon3': '1.658', 'DAMAGECOUNT': '2.310', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:52:59,153][2409074] Updated weights for policy 0, policy_version 12581 (0.0012)
[2023-02-25 12:52:59,192][2409096] DAMAGECOUNT value on done: 2924.0
[2023-02-25 12:52:59,193][2409096] Sum rewards: 11.157, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.316', 'weapon5': '0.002', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'weapon7': '0.062', 'AMMO3': '0.077', 'AMMO4': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.108', 'WEAPON5': '0.150', 'WEAPON3': '0.500', 'HITCOUNT': '0.660', 'ARMOR': '0.872', 'weapon2': '1.050', 'weapon3': '1.516', 'DAMAGECOUNT': '2.454', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:52:59,431][2409097] DAMAGECOUNT value on done: 2371.0
[2023-02-25 12:52:59,432][2409097] Sum rewards: 7.515, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.016', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON1': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.053', 'AMMO4': '0.059', 'weapon5': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.230', 'WEAPON3': '0.350', 'HITCOUNT': '0.480', 'weapon3': '1.150', 'weapon2': '1.728', 'DAMAGECOUNT': '2.178', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:52:59,515][2409547] DAMAGECOUNT value on done: 1892.0
[2023-02-25 12:52:59,516][2409547] Sum rewards: 6.031, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.768', 'AMMO2': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.033', 'AMMO3': '0.071', 'weapon4': '0.158', 'weapon5': '0.162', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.450', 'ARMOR': '0.500', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.386', 'weapon2': '1.468', 'weapon3': '1.824', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:52:59,753][2409486] DAMAGECOUNT value on done: 3047.0
[2023-02-25 12:52:59,753][2409486] Sum rewards: 5.054, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.410', 'AMMO2': '0.008', 'AMMO5': '0.022', 'AMMO4': '0.039', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'weapon4': '0.140', 'weapon5': '0.186', 'WEAPON5': '0.600', 'HITCOUNT': '0.610', 'WEAPON3': '0.750', 'weapon2': '1.444', 'weapon3': '1.506', 'DAMAGECOUNT': '2.877', 'FRAGCOUNT': '6.500'}
[2023-02-25 12:52:59,987][2409389] DAMAGECOUNT value on done: 2149.0
[2023-02-25 12:52:59,990][2409389] Sum rewards: -1.878, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.832', 'ARMOR': '0.008', 'AMMO2': '0.010', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon5': '0.016', 'AMMO4': '0.049', 'AMMO3': '0.121', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.340', 'weapon4': '0.476', 'WEAPON3': '0.700', 'weapon2': '1.046', 'DAMAGECOUNT': '1.134', 'weapon3': '1.384', 'FRAGCOUNT': '1.500'}
[2023-02-25 12:53:00,194][2409468] DAMAGECOUNT value on done: 2226.0
[2023-02-25 12:53:00,195][2409468] Sum rewards: -0.383, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.630', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON1': '0.050', 'weapon5': '0.068', 'AMMO4': '0.070', 'AMMO3': '0.073', 'WEAPON5': '0.100', 'HITCOUNT': '0.320', 'WEAPON4': '0.450', 'WEAPON3': '0.550', 'weapon4': '0.730', 'DAMAGECOUNT': '0.927', 'ARMOR': '0.969', 'weapon2': '0.982', 'weapon3': '1.438', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:53:00,495][2409080] DAMAGECOUNT value on done: 2866.0
[2023-02-25 12:53:00,498][2409080] Sum rewards: 5.408, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.932', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.028', 'AMMO3': '0.055', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.236', 'WEAPON3': '0.450', 'ARMOR': '0.496', 'HITCOUNT': '0.500', 'weapon3': '1.140', 'weapon2': '1.382', 'DAMAGECOUNT': '1.617', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:53:00,532][2409469] DAMAGECOUNT value on done: 2365.0
[2023-02-25 12:53:00,537][2409469] Sum rewards: 4.702, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.133', 'AMMO5': '0.012', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'AMMO3': '0.061', 'WEAPON4': '0.100', 'weapon4': '0.110', 'AMMO4': '0.126', 'weapon5': '0.230', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '0.440', 'ARMOR': '0.473', 'weapon3': '1.194', 'weapon2': '1.558', 'DAMAGECOUNT': '1.716', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:53:00,582][2409074] Updated weights for policy 0, policy_version 12591 (0.0012)
[2023-02-25 12:53:01,067][2409075] DAMAGECOUNT value on done: 2346.0
[2023-02-25 12:53:01,070][2409075] Sum rewards: 2.501, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.193', 'AMMO5': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.052', 'AMMO3': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.220', 'weapon4': '0.360', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.759', 'ARMOR': '0.887', 'weapon3': '1.130', 'weapon2': '1.540', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:53:01,178][2409078] DAMAGECOUNT value on done: 2853.0
[2023-02-25 12:53:01,181][2409078] Sum rewards: 1.889, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.632', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.026', 'weapon7': '0.048', 'WEAPON1': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.200', 'weapon5': '0.268', 'WEAPON5': '0.300', 'ARMOR': '0.483', 'HITCOUNT': '0.510', 'WEAPON3': '0.800', 'weapon2': '1.562', 'weapon3': '1.578', 'DAMAGECOUNT': '2.694', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:53:01,739][2409079] DAMAGECOUNT value on done: 2613.0
[2023-02-25 12:53:01,741][2409079] Sum rewards: 3.501, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.235', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.007', 'WEAPON1': '0.040', 'weapon5': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.063', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'weapon3': '1.462', 'weapon2': '1.530', 'DAMAGECOUNT': '2.007', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:53:01,791][2409099] DAMAGECOUNT value on done: 2565.0
[2023-02-25 12:53:01,792][2409099] Sum rewards: -5.165, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.178', 'ARMOR': '0.004', 'AMMO2': '0.020', 'AMMO5': '0.024', 'WEAPON1': '0.040', 'weapon5': '0.042', 'AMMO4': '0.098', 'AMMO3': '0.115', 'HITCOUNT': '0.220', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.660', 'DAMAGECOUNT': '0.720', 'WEAPON3': '0.750', 'weapon2': '0.756', 'FRAGCOUNT': '1.000', 'weapon3': '1.464'}
[2023-02-25 12:53:02,186][2408954] Fps is (10 sec: 24575.8, 60 sec: 25463.5, 300 sec: 25534.1). Total num frames: 51605504. Throughput: 0: 6383.7. Samples: 12909312. Policy #0 lag: (min: 0.0, avg: 12.3, max: 25.0)
[2023-02-25 12:53:02,197][2408954] Avg episode reward: [(0, '2.895')]
[2023-02-25 12:53:02,367][2409074] Updated weights for policy 0, policy_version 12601 (0.0012)
[2023-02-25 12:53:02,575][2409076] DAMAGECOUNT value on done: 2579.0
[2023-02-25 12:53:02,576][2409076] Sum rewards: 0.282, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.606', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'WEAPON1': '0.040', 'AMMO3': '0.048', 'WEAPON4': '0.050', 'HITCOUNT': '0.100', 'weapon4': '0.182', 'WEAPON3': '0.300', 'weapon3': '0.380', 'DAMAGECOUNT': '0.495', 'ARMOR': '0.837', 'FRAGCOUNT': '1.000', 'weapon2': '1.222'}
[2023-02-25 12:53:02,954][2409096] DAMAGECOUNT value on done: 2137.0
[2023-02-25 12:53:02,956][2409096] Sum rewards: 7.827, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.061', 'weapon7': '0.072', 'AMMO3': '0.085', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.118', 'weapon4': '0.122', 'HEALTH': '0.169', 'WEAPON5': '0.250', 'HITCOUNT': '0.330', 'WEAPON3': '0.400', 'ARMOR': '0.800', 'weapon2': '1.266', 'weapon3': '1.276', 'DAMAGECOUNT': '1.983', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:53:03,174][2409097] DAMAGECOUNT value on done: 2586.0
[2023-02-25 12:53:03,175][2409097] Sum rewards: 2.332, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.274', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'AMMO3': '0.093', 'weapon5': '0.202', 'WEAPON5': '0.400', 'HITCOUNT': '0.480', 'WEAPON3': '0.700', 'ARMOR': '0.844', 'weapon2': '1.574', 'DAMAGECOUNT': '1.620', 'weapon3': '1.692', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:53:03,286][2409547] DAMAGECOUNT value on done: 2320.0
[2023-02-25 12:53:03,289][2409547] Sum rewards: 5.694, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.843', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.065', 'weapon5': '0.100', 'AMMO3': '0.105', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.316', 'HITCOUNT': '0.430', 'WEAPON3': '0.650', 'ARMOR': '0.880', 'weapon3': '1.222', 'weapon2': '1.746', 'DAMAGECOUNT': '1.830', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:53:03,610][2409486] DAMAGECOUNT value on done: 1931.0
[2023-02-25 12:53:03,972][2409468] DAMAGECOUNT value on done: 2322.0
[2023-02-25 12:53:03,974][2409468] Sum rewards: 5.605, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.335', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'weapon7': '0.052', 'AMMO3': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.190', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.380', 'WEAPON5': '0.450', 'ARMOR': '0.456', 'WEAPON3': '0.500', 'weapon4': '0.512', 'weapon2': '0.720', 'weapon3': '1.020', 'DAMAGECOUNT': '2.352', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:53:04,079][2409074] Updated weights for policy 0, policy_version 12611 (0.0012)
[2023-02-25 12:53:04,259][2409080] DAMAGECOUNT value on done: 2639.0
[2023-02-25 12:53:04,263][2409080] Sum rewards: -0.093, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.827', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'WEAPON4': '0.150', 'weapon4': '0.254', 'HITCOUNT': '0.440', 'WEAPON3': '0.700', 'ARMOR': '0.938', 'DAMAGECOUNT': '1.452', 'weapon3': '1.472', 'weapon2': '1.642', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:53:04,823][2409469] DAMAGECOUNT value on done: 3064.0
[2023-02-25 12:53:04,824][2409469] Sum rewards: 8.175, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.550', 'AMMO2': '0.009', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.045', 'weapon7': '0.064', 'AMMO3': '0.081', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.198', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.495', 'HITCOUNT': '0.510', 'WEAPON3': '0.550', 'weapon4': '0.584', 'weapon2': '1.038', 'weapon3': '1.404', 'DAMAGECOUNT': '3.219', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:53:04,885][2409075] DAMAGECOUNT value on done: 2921.0
[2023-02-25 12:53:04,885][2409075] Sum rewards: 4.929, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.380', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'weapon5': '0.048', 'AMMO3': '0.050', 'AMMO4': '0.053', 'weapon7': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.320', 'WEAPON3': '0.350', 'weapon4': '0.454', 'weapon2': '0.908', 'DAMAGECOUNT': '1.035', 'weapon3': '1.080', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:53:04,960][2409078] DAMAGECOUNT value on done: 1648.0
[2023-02-25 12:53:04,962][2409078] Sum rewards: 3.147, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.297', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.005', 'AMMO3': '0.050', 'weapon5': '0.060', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.380', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'weapon4': '0.424', 'weapon3': '0.904', 'weapon2': '0.932', 'DAMAGECOUNT': '1.389', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:53:05,433][2409079] DAMAGECOUNT value on done: 3200.0
[2023-02-25 12:53:05,434][2409079] Sum rewards: 4.412, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.240', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.030', 'WEAPON1': '0.040', 'AMMO3': '0.144', 'AMMO4': '0.144', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.278', 'ARMOR': '0.421', 'HITCOUNT': '0.730', 'WEAPON3': '1.000', 'weapon2': '1.128', 'weapon3': '2.170', 'DAMAGECOUNT': '2.775', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:53:05,481][2409074] Updated weights for policy 0, policy_version 12621 (0.0012)
[2023-02-25 12:53:05,652][2409099] DAMAGECOUNT value on done: 2062.0
[2023-02-25 12:53:05,656][2409099] Sum rewards: 1.947, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.451', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.017', 'AMMO3': '0.115', 'weapon5': '0.178', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'WEAPON5': '0.300', 'ARMOR': '0.439', 'weapon4': '0.510', 'WEAPON3': '0.850', 'weapon2': '1.244', 'weapon3': '1.658', 'DAMAGECOUNT': '1.824', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:53:06,913][2409097] DAMAGECOUNT value on done: 2462.0
[2023-02-25 12:53:06,914][2409097] Sum rewards: 2.147, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.784', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon7': '0.066', 'AMMO3': '0.087', 'weapon4': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.310', 'WEAPON3': '0.450', 'ARMOR': '0.460', 'weapon3': '1.014', 'DAMAGECOUNT': '1.332', 'weapon2': '1.604', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:53:07,090][2409547] DAMAGECOUNT value on done: 1760.0
[2023-02-25 12:53:07,093][2409547] Sum rewards: 6.508, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.224', 'AMMO2': '0.016', 'AMMO5': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.079', 'weapon5': '0.116', 'WEAPON5': '0.200', 'weapon4': '0.220', 'HITCOUNT': '0.330', 'ARMOR': '0.432', 'WEAPON3': '0.500', 'weapon2': '1.016', 'DAMAGECOUNT': '1.398', 'weapon3': '1.530', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:53:07,136][2409096] DAMAGECOUNT value on done: 2813.0
[2023-02-25 12:53:07,140][2409096] Sum rewards: 3.597, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.708', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon7': '0.064', 'AMMO3': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.137', 'WEAPON4': '0.350', 'HITCOUNT': '0.370', 'WEAPON3': '0.450', 'ARMOR': '0.456', 'weapon4': '0.652', 'weapon2': '1.060', 'DAMAGECOUNT': '1.455', 'weapon3': '1.590', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:53:07,186][2408954] Fps is (10 sec: 24985.9, 60 sec: 25531.8, 300 sec: 25575.7). Total num frames: 51736576. Throughput: 0: 6392.5. Samples: 12928524. Policy #0 lag: (min: 0.0, avg: 12.3, max: 25.0)
[2023-02-25 12:53:07,189][2409074] Updated weights for policy 0, policy_version 12631 (0.0012)
[2023-02-25 12:53:07,199][2408954] Avg episode reward: [(0, '2.925')]
[2023-02-25 12:53:07,531][2409486] DAMAGECOUNT value on done: 2442.0
[2023-02-25 12:53:07,531][2409486] Sum rewards: 5.153, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.306', 'AMMO5': '0.003', 'AMMO2': '0.019', 'AMMO3': '0.043', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.093', 'weapon4': '0.244', 'HITCOUNT': '0.290', 'WEAPON3': '0.300', 'weapon3': '0.812', 'weapon2': '0.944', 'ARMOR': '0.992', 'DAMAGECOUNT': '1.572', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:53:07,811][2409468] DAMAGECOUNT value on done: 2480.0
[2023-02-25 12:53:07,814][2409468] Sum rewards: 1.742, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.129', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.008', 'WEAPON1': '0.030', 'AMMO3': '0.087', 'weapon5': '0.148', 'WEAPON5': '0.200', 'HITCOUNT': '0.580', 'WEAPON3': '0.650', 'weapon2': '1.542', 'weapon3': '1.572', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.061'}
[2023-02-25 12:53:08,060][2409080] DAMAGECOUNT value on done: 2251.0
[2023-02-25 12:53:08,539][2409469] DAMAGECOUNT value on done: 1977.0
[2023-02-25 12:53:08,540][2409469] Sum rewards: 3.000, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.160', 'AMMO5': '0.005', 'weapon7': '0.006', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'AMMO3': '0.055', 'weapon5': '0.082', 'AMMO4': '0.098', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.420', 'ARMOR': '0.572', 'weapon4': '0.724', 'weapon2': '0.992', 'weapon3': '1.076', 'DAMAGECOUNT': '1.590', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:53:08,587][2409075] DAMAGECOUNT value on done: 2287.0
[2023-02-25 12:53:08,590][2409075] Sum rewards: 5.267, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.365', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO3': '0.040', 'weapon7': '0.064', 'WEAPON4': '0.100', 'weapon5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.200', 'WEAPON3': '0.250', 'weapon4': '0.294', 'weapon3': '1.098', 'DAMAGECOUNT': '1.278', 'weapon2': '1.282', 'ARMOR': '1.359', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:53:08,735][2409074] Updated weights for policy 0, policy_version 12641 (0.0012)
[2023-02-25 12:53:08,995][2409078] DAMAGECOUNT value on done: 2551.0
[2023-02-25 12:53:08,999][2409078] Sum rewards: 7.227, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.017', 'AMMO3': '0.069', 'AMMO4': '0.082', 'weapon5': '0.112', 'HEALTH': '0.146', 'WEAPON5': '0.150', 'weapon7': '0.176', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.350', 'WEAPON3': '0.400', 'weapon4': '0.598', 'weapon3': '0.968', 'weapon2': '1.450', 'DAMAGECOUNT': '1.878', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:53:09,079][2409079] DAMAGECOUNT value on done: 1718.0
[2023-02-25 12:53:09,080][2409079] Sum rewards: 0.231, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.287', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.036', 'AMMO3': '0.058', 'weapon5': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.222', 'HITCOUNT': '0.280', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.074', 'weapon3': '1.082', 'weapon2': '1.218', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:53:09,500][2409099] DAMAGECOUNT value on done: 2598.0
[2023-02-25 12:53:09,501][2409099] Sum rewards: -2.016, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.626', 'AMMO2': '0.013', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.065', 'weapon5': '0.138', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'HITCOUNT': '0.310', 'WEAPON5': '0.350', 'weapon4': '0.480', 'weapon2': '0.764', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.254', 'FRAGCOUNT': '1.500', 'weapon3': '1.746'}
[2023-02-25 12:53:10,457][2409074] Updated weights for policy 0, policy_version 12651 (0.0012)
[2023-02-25 12:53:10,788][2409097] DAMAGECOUNT value on done: 2192.0
[2023-02-25 12:53:10,790][2409097] Sum rewards: -3.953, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.830', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO5': '0.032', 'ARMOR': '0.032', 'AMMO4': '0.035', 'weapon5': '0.064', 'AMMO3': '0.115', 'WEAPON4': '0.150', 'HITCOUNT': '0.320', 'weapon4': '0.376', 'FRAGCOUNT': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.960', 'weapon2': '1.104', 'weapon3': '1.762'}
[2023-02-25 12:53:11,129][2409547] DAMAGECOUNT value on done: 2354.0
[2023-02-25 12:53:11,133][2409547] Sum rewards: -1.193, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.578', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon7': '0.070', 'AMMO4': '0.074', 'AMMO3': '0.090', 'weapon5': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.210', 'WEAPON4': '0.300', 'ARMOR': '0.449', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.550', 'weapon2': '0.762', 'weapon4': '0.816', 'DAMAGECOUNT': '1.149', 'weapon3': '1.158'}
[2023-02-25 12:53:11,224][2409486] DAMAGECOUNT value on done: 2113.0
[2023-02-25 12:53:11,225][2409486] Sum rewards: 2.600, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.505', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.007', 'WEAPON1': '0.020', 'ARMOR': '0.048', 'AMMO3': '0.060', 'weapon5': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.300', 'HITCOUNT': '0.420', 'weapon4': '0.474', 'WEAPON3': '0.550', 'weapon2': '1.142', 'weapon3': '1.332', 'DAMAGECOUNT': '1.830', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:53:11,291][2409096] DAMAGECOUNT value on done: 1722.0
[2023-02-25 12:53:11,293][2409096] Sum rewards: 3.242, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.624', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'weapon5': '0.018', 'AMMO4': '0.044', 'ARMOR': '0.052', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'weapon4': '0.434', 'HITCOUNT': '0.540', 'WEAPON3': '0.700', 'weapon2': '1.082', 'weapon3': '1.576', 'DAMAGECOUNT': '1.590', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:53:11,713][2409468] DAMAGECOUNT value on done: 3345.0
[2023-02-25 12:53:11,714][2409468] Sum rewards: 10.427, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.892', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon7': '0.048', 'AMMO3': '0.099', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.111', 'weapon5': '0.152', 'weapon4': '0.258', 'WEAPON5': '0.350', 'HITCOUNT': '0.530', 'WEAPON3': '0.650', 'ARMOR': '0.832', 'weapon2': '1.102', 'weapon3': '1.622', 'DAMAGECOUNT': '4.104', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:53:11,818][2409074] Updated weights for policy 0, policy_version 12661 (0.0012)
[2023-02-25 12:53:11,928][2409080] DAMAGECOUNT value on done: 3199.0
[2023-02-25 12:53:11,929][2409080] Sum rewards: 9.758, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.434', 'AMMO2': '0.017', 'AMMO5': '0.023', 'WEAPON1': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.082', 'weapon5': '0.186', 'WEAPON4': '0.200', 'weapon4': '0.332', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'ARMOR': '0.500', 'HITCOUNT': '0.690', 'weapon2': '1.064', 'weapon3': '1.586', 'DAMAGECOUNT': '3.192', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:53:12,186][2408954] Fps is (10 sec: 26214.2, 60 sec: 25531.7, 300 sec: 25603.5). Total num frames: 51867648. Throughput: 0: 6403.2. Samples: 12967356. Policy #0 lag: (min: 0.0, avg: 11.1, max: 27.0)
[2023-02-25 12:53:12,187][2408954] Avg episode reward: [(0, '3.029')]
[2023-02-25 12:53:12,941][2409079] DAMAGECOUNT value on done: 3373.0
[2023-02-25 12:53:12,942][2409079] Sum rewards: 3.741, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.110', 'AMMO5': '0.015', 'AMMO2': '0.020', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.088', 'weapon5': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.100', 'weapon7': '0.114', 'WEAPON5': '0.250', 'weapon4': '0.256', 'HITCOUNT': '0.420', 'WEAPON3': '0.550', 'ARMOR': '0.855', 'FRAGCOUNT': '1.000', 'weapon2': '1.040', 'weapon3': '1.706', 'DAMAGECOUNT': '2.190'}
[2023-02-25 12:53:13,148][2409074] Updated weights for policy 0, policy_version 12671 (0.0012)
[2023-02-25 12:53:13,425][2409099] DAMAGECOUNT value on done: 1794.0
[2023-02-25 12:53:13,425][2409099] Sum rewards: -0.681, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.795', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'weapon4': '0.016', 'AMMO5': '0.019', 'weapon5': '0.044', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'WEAPON5': '0.300', 'HITCOUNT': '0.390', 'ARMOR': '0.432', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.392', 'weapon2': '1.524', 'weapon3': '1.828', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:53:13,640][2409102] Large shaping reward 2.563 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.531, 177.0), ('weapon7', 0.002)]
[2023-02-25 12:53:14,982][2409547] DAMAGECOUNT value on done: 2139.0
[2023-02-25 12:53:14,983][2409547] Sum rewards: 2.231, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.790', 'AMMO2': '0.003', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.014', 'weapon7': '0.078', 'AMMO3': '0.089', 'weapon5': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.296', 'HITCOUNT': '0.470', 'WEAPON3': '0.500', 'ARMOR': '0.857', 'weapon3': '1.200', 'DAMAGECOUNT': '1.596', 'weapon2': '1.706', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:53:15,361][2409074] Updated weights for policy 0, policy_version 12681 (0.0013)
[2023-02-25 12:53:15,526][2409096] DAMAGECOUNT value on done: 2633.0
[2023-02-25 12:53:15,530][2409096] Sum rewards: 1.031, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.016', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.016', 'weapon4': '0.036', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon5': '0.060', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'HITCOUNT': '0.190', 'DAMAGECOUNT': '0.522', 'WEAPON3': '0.550', 'ARMOR': '0.900', 'weapon3': '1.284', 'FRAGCOUNT': '2.000', 'weapon2': '2.208'}
[2023-02-25 12:53:15,616][2409486] DAMAGECOUNT value on done: 2022.0
[2023-02-25 12:53:15,620][2409486] Sum rewards: 4.682, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.222', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.078', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.102', 'WEAPON5': '0.250', 'HITCOUNT': '0.370', 'weapon4': '0.402', 'ARMOR': '0.404', 'WEAPON3': '0.550', 'weapon3': '1.298', 'DAMAGECOUNT': '1.389', 'weapon2': '1.588', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:53:15,724][2409468] DAMAGECOUNT value on done: 2470.0
[2023-02-25 12:53:15,728][2409468] Sum rewards: -0.453, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.062', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.005', 'AMMO5': '0.009', 'AMMO4': '0.027', 'weapon5': '0.058', 'AMMO3': '0.060', 'weapon7': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.240', 'HITCOUNT': '0.340', 'WEAPON3': '0.500', 'weapon2': '0.860', 'ARMOR': '0.876', 'DAMAGECOUNT': '1.230', 'weapon3': '1.242'}
[2023-02-25 12:53:15,917][2409080] DAMAGECOUNT value on done: 2458.0
[2023-02-25 12:53:15,920][2409080] Sum rewards: 1.339, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.612', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.038', 'AMMO3': '0.108', 'weapon5': '0.138', 'AMMO4': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.420', 'WEAPON3': '0.650', 'weapon4': '0.682', 'ARMOR': '0.903', 'weapon2': '0.978', 'weapon3': '1.460', 'DAMAGECOUNT': '2.343', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:53:16,308][2409074] Updated weights for policy 0, policy_version 12691 (0.0012)
[2023-02-25 12:53:16,786][2409079] DAMAGECOUNT value on done: 1989.0
[2023-02-25 12:53:16,787][2409079] Sum rewards: 4.439, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.228', 'AMMO5': '0.003', 'AMMO2': '0.039', 'AMMO3': '0.081', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.196', 'WEAPON3': '0.550', 'WEAPON4': '0.600', 'HITCOUNT': '0.630', 'weapon4': '0.702', 'ARMOR': '0.866', 'weapon2': '1.108', 'weapon3': '1.580', 'DAMAGECOUNT': '1.878', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:53:17,186][2408954] Fps is (10 sec: 26624.0, 60 sec: 25873.1, 300 sec: 25589.6). Total num frames: 52002816. Throughput: 0: 6404.0. Samples: 13005624. Policy #0 lag: (min: 1.0, avg: 15.0, max: 27.0)
[2023-02-25 12:53:17,186][2408954] Avg episode reward: [(0, '2.961')]
[2023-02-25 12:53:17,975][2409099] DAMAGECOUNT value on done: 2516.0
[2023-02-25 12:53:17,979][2409099] Sum rewards: 2.799, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.011', 'AMMO5': '0.012', 'ARMOR': '0.028', 'weapon5': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.077', 'weapon4': '0.140', 'HEALTH': '0.174', 'WEAPON5': '0.250', 'HITCOUNT': '0.380', 'WEAPON3': '0.500', 'weapon2': '0.652', 'DAMAGECOUNT': '1.290', 'weapon3': '1.392', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:53:18,774][2409074] Updated weights for policy 0, policy_version 12701 (0.0012)
[2023-02-25 12:53:18,913][2409547] DAMAGECOUNT value on done: 2816.0
[2023-02-25 12:53:18,913][2409547] Sum rewards: 5.879, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.581', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon7': '0.048', 'AMMO3': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.131', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.448', 'HITCOUNT': '0.470', 'weapon4': '0.508', 'WEAPON3': '0.750', 'weapon2': '1.224', 'DAMAGECOUNT': '1.656', 'weapon3': '1.686', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:53:19,315][2409096] DAMAGECOUNT value on done: 2061.0
[2023-02-25 12:53:19,316][2409096] Sum rewards: 3.267, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.503', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon5': '0.056', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.210', 'ARMOR': '0.400', 'HITCOUNT': '0.400', 'WEAPON3': '0.550', 'weapon2': '1.196', 'weapon3': '1.244', 'DAMAGECOUNT': '1.608', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:53:19,708][2409468] DAMAGECOUNT value on done: 2069.0
[2023-02-25 12:53:19,711][2409468] Sum rewards: 5.635, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.496', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO3': '0.060', 'weapon5': '0.194', 'WEAPON5': '0.250', 'HITCOUNT': '0.390', 'WEAPON3': '0.450', 'ARMOR': '0.455', 'weapon3': '1.418', 'DAMAGECOUNT': '1.497', 'weapon2': '1.914', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:53:19,779][2409074] Updated weights for policy 0, policy_version 12711 (0.0012)
[2023-02-25 12:53:19,892][2409080] DAMAGECOUNT value on done: 1365.0
[2023-02-25 12:53:19,895][2409080] Sum rewards: -2.935, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.684', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.038', 'WEAPON1': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.134', 'AMMO3': '0.139', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.240', 'weapon4': '0.270', 'DAMAGECOUNT': '0.765', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.020', 'weapon3': '1.496'}
[2023-02-25 12:53:20,590][2409079] DAMAGECOUNT value on done: 1638.0
[2023-02-25 12:53:20,593][2409079] Sum rewards: 1.989, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.696', 'AMMO2': '0.014', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'AMMO4': '0.070', 'weapon5': '0.166', 'WEAPON4': '0.200', 'HITCOUNT': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.388', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.645', 'ARMOR': '0.948', 'FRAGCOUNT': '1.000', 'weapon3': '1.222', 'weapon2': '1.476'}
[2023-02-25 12:53:21,616][2409074] Updated weights for policy 0, policy_version 12721 (0.0012)
[2023-02-25 12:53:22,156][2409099] DAMAGECOUNT value on done: 2285.0
[2023-02-25 12:53:22,159][2409099] Sum rewards: 1.378, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.628', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.013', 'AMMO3': '0.050', 'weapon5': '0.052', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.100', 'WEAPON5': '0.300', 'HITCOUNT': '0.350', 'ARMOR': '0.404', 'WEAPON3': '0.500', 'weapon3': '1.284', 'DAMAGECOUNT': '1.395', 'weapon2': '1.900', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:53:22,186][2408954] Fps is (10 sec: 24576.3, 60 sec: 25463.4, 300 sec: 25561.8). Total num frames: 52113408. Throughput: 0: 6413.6. Samples: 13024884. Policy #0 lag: (min: 1.0, avg: 15.0, max: 27.0)
[2023-02-25 12:53:22,186][2408954] Avg episode reward: [(0, '3.020')]
[2023-02-25 12:53:23,040][2409547] DAMAGECOUNT value on done: 2287.0
[2023-02-25 12:53:23,041][2409547] Sum rewards: 6.568, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.956', 'AMMO5': '0.012', 'AMMO2': '0.024', 'ARMOR': '0.024', 'WEAPON1': '0.030', 'weapon5': '0.048', 'AMMO4': '0.119', 'AMMO3': '0.121', 'WEAPON4': '0.200', 'weapon4': '0.266', 'WEAPON5': '0.300', 'HITCOUNT': '0.660', 'WEAPON3': '0.900', 'weapon2': '1.014', 'weapon3': '1.976', 'DAMAGECOUNT': '2.580', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:53:23,091][2409033] Signal inference workers to stop experience collection... (1550 times)
[2023-02-25 12:53:23,092][2409033] Signal inference workers to resume experience collection... (1550 times)
[2023-02-25 12:53:23,123][2409074] InferenceWorker_p0-w0: stopping experience collection (1550 times)
[2023-02-25 12:53:23,123][2409074] InferenceWorker_p0-w0: resuming experience collection (1550 times)
[2023-02-25 12:53:23,192][2409074] Updated weights for policy 0, policy_version 12731 (0.0014)
[2023-02-25 12:53:23,497][2409468] DAMAGECOUNT value on done: 2488.0
[2023-02-25 12:53:23,501][2409468] Sum rewards: 10.197, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.131', 'AMMO2': '0.003', 'AMMO5': '0.013', 'AMMO4': '0.015', 'weapon5': '0.038', 'AMMO3': '0.096', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.256', 'ARMOR': '0.429', 'WEAPON3': '0.550', 'HITCOUNT': '0.680', 'weapon2': '0.696', 'weapon3': '1.592', 'DAMAGECOUNT': '2.610', 'FRAGCOUNT': '10.000'}
[2023-02-25 12:53:23,652][2409080] DAMAGECOUNT value on done: 2199.0
[2023-02-25 12:53:23,654][2409080] Sum rewards: 7.296, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.818', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO3': '0.077', 'weapon5': '0.088', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.408', 'HITCOUNT': '0.550', 'WEAPON3': '0.600', 'ARMOR': '0.864', 'weapon3': '1.332', 'weapon2': '1.662', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:53:24,251][2409074] Updated weights for policy 0, policy_version 12741 (0.0012)
[2023-02-25 12:53:26,182][2409099] DAMAGECOUNT value on done: 2138.0
[2023-02-25 12:53:26,183][2409099] Sum rewards: 6.227, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.555', 'AMMO5': '0.007', 'AMMO2': '0.010', 'ARMOR': '0.020', 'WEAPON1': '0.020', 'weapon7': '0.030', 'AMMO4': '0.049', 'weapon5': '0.060', 'AMMO3': '0.073', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.380', 'WEAPON3': '0.450', 'weapon2': '0.520', 'weapon4': '0.556', 'weapon3': '1.306', 'DAMAGECOUNT': '1.830', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:53:26,807][2409074] Updated weights for policy 0, policy_version 12751 (0.0012)
[2023-02-25 12:53:26,856][2409547] DAMAGECOUNT value on done: 1711.0
[2023-02-25 12:53:26,860][2409547] Sum rewards: 1.454, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.568', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.014', 'WEAPON1': '0.020', 'weapon7': '0.060', 'AMMO4': '0.063', 'AMMO3': '0.087', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'HITCOUNT': '0.170', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.500', 'weapon4': '0.544', 'DAMAGECOUNT': '0.711', 'weapon2': '0.898', 'weapon3': '1.344', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:53:27,152][2409486] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)]
[2023-02-25 12:53:27,186][2408954] Fps is (10 sec: 24984.5, 60 sec: 25668.2, 300 sec: 25631.2). Total num frames: 52252672. Throughput: 0: 6411.1. Samples: 13063116. Policy #0 lag: (min: 0.0, avg: 8.3, max: 24.0)
[2023-02-25 12:53:27,187][2408954] Avg episode reward: [(0, '3.239')]
[2023-02-25 12:53:27,210][2409033] Saving new best policy, reward=3.239!
[2023-02-25 12:53:27,440][2409468] DAMAGECOUNT value on done: 2167.0
[2023-02-25 12:53:27,441][2409468] Sum rewards: -3.888, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.848', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'weapon5': '0.010', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'AMMO4': '0.119', 'WEAPON4': '0.300', 'HITCOUNT': '0.350', 'weapon4': '0.592', 'WEAPON3': '0.650', 'ARMOR': '0.928', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.161', 'weapon3': '1.482', 'weapon2': '1.622'}
[2023-02-25 12:53:27,608][2409080] DAMAGECOUNT value on done: 2105.0
[2023-02-25 12:53:27,609][2409080] Sum rewards: 6.134, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.226', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO3': '0.091', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'weapon4': '0.198', 'weapon5': '0.208', 'WEAPON5': '0.300', 'HITCOUNT': '0.310', 'WEAPON3': '0.500', 'ARMOR': '0.900', 'weapon3': '1.124', 'DAMAGECOUNT': '1.581', 'weapon2': '1.836', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:53:27,628][2409074] Updated weights for policy 0, policy_version 12761 (0.0012)
[2023-02-25 12:53:29,835][2409074] Updated weights for policy 0, policy_version 12771 (0.0012)
[2023-02-25 12:53:29,977][2409099] DAMAGECOUNT value on done: 2888.0
[2023-02-25 12:53:29,978][2409099] Sum rewards: 2.826, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.161', 'AMMO2': '0.008', 'AMMO5': '0.017', 'AMMO4': '0.038', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.080', 'AMMO3': '0.082', 'weapon4': '0.092', 'HITCOUNT': '0.290', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'ARMOR': '0.880', 'DAMAGECOUNT': '1.200', 'weapon3': '1.330', 'weapon2': '1.720', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:53:30,516][2409547] DAMAGECOUNT value on done: 2485.0
[2023-02-25 12:53:30,517][2409547] Sum rewards: 5.020, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.783', 'AMMO2': '0.013', 'AMMO5': '0.015', 'WEAPON1': '0.060', 'AMMO4': '0.064', 'AMMO3': '0.114', 'weapon5': '0.160', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'HITCOUNT': '0.400', 'ARMOR': '0.547', 'weapon4': '0.634', 'WEAPON3': '0.800', 'weapon2': '1.282', 'weapon3': '1.374', 'DAMAGECOUNT': '2.340', 'FRAGCOUNT': '9.000'}
[2023-02-25 12:53:30,979][2409074] Updated weights for policy 0, policy_version 12781 (0.0013)
[2023-02-25 12:53:31,535][2409468] DAMAGECOUNT value on done: 2503.0
[2023-02-25 12:53:31,536][2409468] Sum rewards: 1.967, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.540', 'AMMO2': '0.007', 'AMMO5': '0.010', 'weapon5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.034', 'weapon4': '0.076', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'ARMOR': '0.458', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'weapon3': '1.412', 'weapon2': '1.542', 'DAMAGECOUNT': '2.088', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:53:31,716][2409080] DAMAGECOUNT value on done: 2447.0
[2023-02-25 12:53:31,719][2409080] Sum rewards: 8.609, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.044', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.060', 'AMMO4': '0.061', 'AMMO3': '0.062', 'weapon5': '0.154', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'weapon4': '0.534', 'weapon2': '0.642', 'HITCOUNT': '0.700', 'ARMOR': '0.902', 'weapon3': '1.504', 'DAMAGECOUNT': '3.009', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:53:31,795][2409101] Large shaping reward -2.506 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0)]
[2023-02-25 12:53:32,186][2408954] Fps is (10 sec: 27033.6, 60 sec: 25736.7, 300 sec: 25617.4). Total num frames: 52383744. Throughput: 0: 6420.3. Samples: 13101828. Policy #0 lag: (min: 0.0, avg: 8.3, max: 24.0)
[2023-02-25 12:53:32,186][2408954] Avg episode reward: [(0, '3.195')]
[2023-02-25 12:53:32,464][2409074] Updated weights for policy 0, policy_version 12791 (0.0012)
[2023-02-25 12:53:33,915][2409099] DAMAGECOUNT value on done: 2371.0
[2023-02-25 12:53:33,919][2409099] Sum rewards: 6.456, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.516', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.005', 'AMMO3': '0.056', 'WEAPON1': '0.060', 'WEAPON5': '0.150', 'weapon5': '0.180', 'WEAPON4': '0.250', 'HITCOUNT': '0.390', 'WEAPON3': '0.500', 'weapon4': '0.584', 'ARMOR': '0.853', 'weapon3': '1.126', 'weapon2': '1.740', 'DAMAGECOUNT': '2.073', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:53:34,307][2409547] DAMAGECOUNT value on done: 1443.0
[2023-02-25 12:53:34,310][2409547] Sum rewards: -0.660, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.726', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.011', 'WEAPON1': '0.030', 'weapon4': '0.084', 'weapon5': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'HITCOUNT': '0.240', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.789', 'WEAPON3': '0.850', 'ARMOR': '1.414', 'FRAGCOUNT': '1.500', 'weapon2': '1.510', 'weapon3': '1.562'}
[2023-02-25 12:53:34,421][2409074] Updated weights for policy 0, policy_version 12801 (0.0012)
[2023-02-25 12:53:35,572][2409468] DAMAGECOUNT value on done: 2217.0
[2023-02-25 12:53:35,573][2409468] Sum rewards: -0.177, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.880', 'AMMO2': '0.009', 'AMMO5': '0.018', 'AMMO4': '0.043', 'AMMO3': '0.109', 'weapon5': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.362', 'HITCOUNT': '0.500', 'WEAPON3': '0.500', 'weapon2': '0.864', 'FRAGCOUNT': '1.000', 'weapon3': '1.596', 'DAMAGECOUNT': '1.785'}
[2023-02-25 12:53:35,578][2409074] Updated weights for policy 0, policy_version 12811 (0.0012)
[2023-02-25 12:53:35,717][2409080] DAMAGECOUNT value on done: 2225.0
[2023-02-25 12:53:35,719][2409080] Sum rewards: 0.625, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.050', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon5': '0.108', 'AMMO3': '0.109', 'AMMO4': '0.117', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'HITCOUNT': '0.600', 'WEAPON3': '0.650', 'weapon4': '0.658', 'ARMOR': '0.823', 'weapon2': '1.088', 'weapon3': '1.436', 'DAMAGECOUNT': '2.190', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:53:37,186][2408954] Fps is (10 sec: 24985.9, 60 sec: 25531.6, 300 sec: 25575.7). Total num frames: 52502528. Throughput: 0: 6415.7. Samples: 13121124. Policy #0 lag: (min: 0.0, avg: 14.4, max: 26.0)
[2023-02-25 12:53:37,187][2408954] Avg episode reward: [(0, '3.211')]
[2023-02-25 12:53:37,584][2409074] Updated weights for policy 0, policy_version 12821 (0.0012)
[2023-02-25 12:53:37,998][2409547] DAMAGECOUNT value on done: 2391.0
[2023-02-25 12:53:37,999][2409547] Sum rewards: 5.474, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.846', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.093', 'weapon4': '0.104', 'AMMO4': '0.118', 'weapon5': '0.130', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.452', 'HITCOUNT': '0.570', 'WEAPON3': '0.600', 'weapon3': '1.282', 'weapon2': '1.298', 'DAMAGECOUNT': '1.815', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:53:39,151][2409074] Updated weights for policy 0, policy_version 12831 (0.0013)
[2023-02-25 12:53:39,510][2409468] DAMAGECOUNT value on done: 2142.0
[2023-02-25 12:53:39,514][2409468] Sum rewards: -2.927, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.000', 'HEALTH': '-0.806', 'AMMO5': '0.016', 'AMMO2': '0.037', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'weapon4': '0.124', 'weapon5': '0.160', 'AMMO4': '0.183', 'HITCOUNT': '0.310', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'ARMOR': '0.857', 'DAMAGECOUNT': '1.407', 'weapon3': '1.682', 'weapon2': '1.754'}
[2023-02-25 12:53:39,626][2409080] DAMAGECOUNT value on done: 2395.0
[2023-02-25 12:53:39,627][2409080] Sum rewards: 3.212, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.162', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.084', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.320', 'weapon4': '0.358', 'WEAPON3': '0.700', 'ARMOR': '0.943', 'weapon2': '1.050', 'DAMAGECOUNT': '1.347', 'weapon3': '1.448', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:53:40,148][2409548] Large shaping reward -2.501 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.21, -70.0), ('ARMOR', -0.042, -42.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 12:53:40,524][2409074] Updated weights for policy 0, policy_version 12841 (0.0012)
[2023-02-25 12:53:41,873][2409547] DAMAGECOUNT value on done: 2361.0
[2023-02-25 12:53:41,877][2409547] Sum rewards: 2.603, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.094', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO3': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'weapon4': '0.280', 'WEAPON3': '0.300', 'HITCOUNT': '0.350', 'ARMOR': '0.879', 'weapon3': '0.964', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.116', 'weapon2': '1.292'}
[2023-02-25 12:53:42,186][2408954] Fps is (10 sec: 24985.5, 60 sec: 25531.7, 300 sec: 25617.4). Total num frames: 52633600. Throughput: 0: 6416.0. Samples: 13159476. Policy #0 lag: (min: 0.0, avg: 14.4, max: 26.0)
[2023-02-25 12:53:42,186][2408954] Avg episode reward: [(0, '3.180')]
[2023-02-25 12:53:42,237][2409074] Updated weights for policy 0, policy_version 12851 (0.0012)
[2023-02-25 12:53:43,398][2409468] DAMAGECOUNT value on done: 2853.0
[2023-02-25 12:53:43,399][2409468] Sum rewards: 4.779, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.144', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'weapon5': '0.064', 'weapon7': '0.074', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.222', 'ARMOR': '0.457', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'weapon2': '1.118', 'weapon3': '1.428', 'DAMAGECOUNT': '1.944', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:53:43,482][2409080] DAMAGECOUNT value on done: 2177.0
[2023-02-25 12:53:43,483][2409080] Sum rewards: 4.945, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'ARMOR': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.050', 'AMMO3': '0.063', 'weapon5': '0.064', 'HEALTH': '0.078', 'WEAPON4': '0.100', 'weapon4': '0.236', 'HITCOUNT': '0.290', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.915', 'weapon3': '1.084', 'weapon2': '1.630', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:53:43,565][2409074] Updated weights for policy 0, policy_version 12861 (0.0012)
[2023-02-25 12:53:45,489][2409074] Updated weights for policy 0, policy_version 12871 (0.0012)
[2023-02-25 12:53:45,903][2409547] DAMAGECOUNT value on done: 2227.0
[2023-02-25 12:53:45,906][2409547] Sum rewards: 4.601, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.495', 'AMMO2': '0.005', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.023', 'weapon5': '0.068', 'AMMO3': '0.080', 'WEAPON4': '0.150', 'weapon4': '0.254', 'WEAPON5': '0.300', 'HITCOUNT': '0.340', 'WEAPON3': '0.600', 'ARMOR': '0.939', 'weapon3': '1.400', 'weapon2': '1.466', 'DAMAGECOUNT': '1.689', 'FRAGCOUNT': '5.500'}
[2023-02-25 12:53:47,108][2409074] Updated weights for policy 0, policy_version 12881 (0.0013)
[2023-02-25 12:53:47,186][2408954] Fps is (10 sec: 26215.1, 60 sec: 25804.9, 300 sec: 25575.7). Total num frames: 52764672. Throughput: 0: 6416.3. Samples: 13198044. Policy #0 lag: (min: 0.0, avg: 10.8, max: 24.0)
[2023-02-25 12:53:47,186][2408954] Avg episode reward: [(0, '3.292')]
[2023-02-25 12:53:47,218][2409033] Saving new best policy, reward=3.292!
[2023-02-25 12:53:47,557][2409468] DAMAGECOUNT value on done: 2484.0
[2023-02-25 12:53:47,561][2409468] Sum rewards: 3.428, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.469', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO5': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.073', 'weapon5': '0.080', 'AMMO3': '0.102', 'weapon4': '0.238', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.560', 'WEAPON3': '0.650', 'weapon2': '1.288', 'weapon3': '1.532', 'DAMAGECOUNT': '2.229', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:53:47,623][2409080] DAMAGECOUNT value on done: 2789.0
[2023-02-25 12:53:47,625][2409080] Sum rewards: 1.505, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.567', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON1': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.090', 'weapon5': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'ARMOR': '0.432', 'HITCOUNT': '0.470', 'WEAPON3': '0.550', 'weapon4': '0.618', 'weapon3': '1.482', 'weapon2': '1.500', 'DAMAGECOUNT': '1.722', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:53:48,446][2409074] Updated weights for policy 0, policy_version 12891 (0.0012)
[2023-02-25 12:53:50,306][2409074] Updated weights for policy 0, policy_version 12901 (0.0013)
[2023-02-25 12:53:51,611][2409468] DAMAGECOUNT value on done: 3284.0
[2023-02-25 12:53:51,619][2409468] Sum rewards: 3.960, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon5': '0.022', 'AMMO2': '0.036', 'AMMO3': '0.054', 'weapon7': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.181', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.300', 'HITCOUNT': '0.320', 'ARMOR': '0.413', 'HEALTH': '0.552', 'weapon4': '0.880', 'weapon2': '0.970', 'weapon3': '1.092', 'DAMAGECOUNT': '1.170', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:53:51,689][2409080] DAMAGECOUNT value on done: 2569.0
[2023-02-25 12:53:51,693][2409080] Sum rewards: 2.749, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.511', 'AMMO4': '-0.065', 'AMMO2': '-0.013', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.020', 'AMMO3': '0.144', 'WEAPON5': '0.300', 'ARMOR': '0.450', 'HITCOUNT': '0.660', 'WEAPON3': '0.950', 'weapon2': '1.372', 'weapon3': '2.020', 'DAMAGECOUNT': '2.388', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:53:51,870][2409074] Updated weights for policy 0, policy_version 12911 (0.0012)
[2023-02-25 12:53:52,186][2408954] Fps is (10 sec: 26214.7, 60 sec: 25600.0, 300 sec: 25603.5). Total num frames: 52895744. Throughput: 0: 6423.5. Samples: 13217580. Policy #0 lag: (min: 0.0, avg: 10.8, max: 24.0)
[2023-02-25 12:53:52,186][2408954] Avg episode reward: [(0, '3.307')]
[2023-02-25 12:53:52,197][2409033] Saving new best policy, reward=3.307!
[2023-02-25 12:53:53,473][2409074] Updated weights for policy 0, policy_version 12921 (0.0012)
[2023-02-25 12:53:54,754][2409074] Updated weights for policy 0, policy_version 12931 (0.0013)
[2023-02-25 12:53:55,818][2409468] DAMAGECOUNT value on done: 2931.0
[2023-02-25 12:53:55,819][2409468] Sum rewards: 5.958, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.038', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO3': '0.060', 'AMMO4': '0.094', 'weapon5': '0.172', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.448', 'HITCOUNT': '0.770', 'ARMOR': '0.933', 'weapon2': '1.168', 'weapon3': '1.522', 'DAMAGECOUNT': '2.847', 'FRAGCOUNT': '5.500'}
[2023-02-25 12:53:55,829][2409080] DAMAGECOUNT value on done: 2535.0
[2023-02-25 12:53:55,830][2409080] Sum rewards: 5.461, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.077', 'AMMO2': '0.028', 'AMMO3': '0.040', 'weapon7': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.139', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'ARMOR': '0.428', 'weapon4': '0.520', 'weapon2': '0.716', 'weapon3': '1.002', 'DAMAGECOUNT': '1.179', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:53:56,563][2409074] Updated weights for policy 0, policy_version 12941 (0.0014)
[2023-02-25 12:53:57,186][2408954] Fps is (10 sec: 25804.8, 60 sec: 25600.0, 300 sec: 25617.4). Total num frames: 53022720. Throughput: 0: 6411.5. Samples: 13255872. Policy #0 lag: (min: 2.0, avg: 13.9, max: 26.0)
[2023-02-25 12:53:57,186][2408954] Avg episode reward: [(0, '3.359')]
[2023-02-25 12:53:57,191][2409033] Saving new best policy, reward=3.359!
[2023-02-25 12:53:58,149][2409074] Updated weights for policy 0, policy_version 12951 (0.0013)
[2023-02-25 12:54:00,066][2409074] Updated weights for policy 0, policy_version 12961 (0.0012)
[2023-02-25 12:54:00,283][2409468] DAMAGECOUNT value on done: 1956.0
[2023-02-25 12:54:00,284][2409468] Sum rewards: -0.871, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.418', 'ARMOR': '0.008', 'AMMO2': '0.014', 'AMMO5': '0.025', 'WEAPON1': '0.040', 'AMMO4': '0.072', 'AMMO3': '0.150', 'weapon5': '0.232', 'WEAPON4': '0.250', 'HITCOUNT': '0.310', 'weapon4': '0.456', 'weapon2': '0.498', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.200', 'FRAGCOUNT': '2.000', 'weapon3': '2.092'}
[2023-02-25 12:54:00,300][2409080] DAMAGECOUNT value on done: 2467.0
[2023-02-25 12:54:00,301][2409080] Sum rewards: 5.431, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.076', 'AMMO5': '0.012', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'AMMO3': '0.068', 'AMMO4': '0.100', 'WEAPON5': '0.200', 'weapon5': '0.258', 'ARMOR': '0.424', 'WEAPON4': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '0.580', 'weapon4': '0.708', 'weapon2': '1.160', 'weapon3': '1.440', 'DAMAGECOUNT': '2.757', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:54:01,503][2409074] Updated weights for policy 0, policy_version 12971 (0.0012)
[2023-02-25 12:54:02,186][2408954] Fps is (10 sec: 26214.2, 60 sec: 25873.1, 300 sec: 25617.4). Total num frames: 53157888. Throughput: 0: 6412.8. Samples: 13294200. Policy #0 lag: (min: 2.0, avg: 13.9, max: 26.0)
[2023-02-25 12:54:02,186][2408954] Avg episode reward: [(0, '3.367')]
[2023-02-25 12:54:02,187][2409033] Saving new best policy, reward=3.367!
[2023-02-25 12:54:02,504][2409105] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 12:54:03,003][2409074] Updated weights for policy 0, policy_version 12981 (0.0012)
[2023-02-25 12:54:04,285][2409080] DAMAGECOUNT value on done: 1462.0
[2023-02-25 12:54:04,287][2409080] Sum rewards: 0.408, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.018', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'HITCOUNT': '0.160', 'HEALTH': '0.210', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.615', 'FRAGCOUNT': '1.000', 'weapon3': '1.350', 'ARMOR': '1.355', 'weapon2': '1.608'}
[2023-02-25 12:54:04,307][2409468] DAMAGECOUNT value on done: 2466.0
[2023-02-25 12:54:04,308][2409468] Sum rewards: -0.674, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.895', 'AMMO2': '0.011', 'AMMO5': '0.017', 'WEAPON1': '0.050', 'ARMOR': '0.052', 'AMMO4': '0.053', 'AMMO3': '0.082', 'weapon5': '0.098', 'WEAPON5': '0.350', 'HITCOUNT': '0.380', 'WEAPON4': '0.400', 'weapon2': '0.490', 'WEAPON3': '0.600', 'weapon4': '0.850', 'weapon3': '1.478', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.560'}
[2023-02-25 12:54:04,675][2409074] Updated weights for policy 0, policy_version 12991 (0.0012)
[2023-02-25 12:54:04,962][2409597] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 12:54:06,035][2409074] Updated weights for policy 0, policy_version 13001 (0.0012)
[2023-02-25 12:54:07,186][2408954] Fps is (10 sec: 25395.1, 60 sec: 25668.2, 300 sec: 25561.8). Total num frames: 53276672. Throughput: 0: 6415.5. Samples: 13313580. Policy #0 lag: (min: 0.0, avg: 11.7, max: 22.0)
[2023-02-25 12:54:07,186][2408954] Avg episode reward: [(0, '3.301')]
[2023-02-25 12:54:08,130][2409074] Updated weights for policy 0, policy_version 13011 (0.0012)
[2023-02-25 12:54:08,157][2409468] DAMAGECOUNT value on done: 2170.0
[2023-02-25 12:54:08,158][2409468] Sum rewards: -0.450, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.344', 'weapon5': '0.002', 'AMMO5': '0.003', 'WEAPON1': '0.030', 'AMMO2': '0.049', 'WEAPON5': '0.050', 'ARMOR': '0.064', 'AMMO3': '0.115', 'HITCOUNT': '0.200', 'AMMO4': '0.246', 'WEAPON4': '0.300', 'WEAPON3': '0.650', 'weapon2': '0.656', 'weapon4': '0.702', 'DAMAGECOUNT': '0.849', 'weapon3': '1.478', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:54:09,488][2409074] Updated weights for policy 0, policy_version 13021 (0.0014)
[2023-02-25 12:54:10,907][2409074] Updated weights for policy 0, policy_version 13031 (0.0012)
[2023-02-25 12:54:12,186][2408954] Fps is (10 sec: 23756.8, 60 sec: 25463.5, 300 sec: 25561.9). Total num frames: 53395456. Throughput: 0: 6417.1. Samples: 13351884. Policy #0 lag: (min: 0.0, avg: 11.7, max: 22.0)
[2023-02-25 12:54:12,186][2408954] Avg episode reward: [(0, '3.244')]
[2023-02-25 12:54:12,280][2409468] DAMAGECOUNT value on done: 2280.0
[2023-02-25 12:54:12,288][2409468] Sum rewards: 4.794, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.655', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO5': '0.017', 'WEAPON4': '0.050', 'weapon4': '0.054', 'WEAPON1': '0.060', 'AMMO3': '0.098', 'weapon5': '0.146', 'WEAPON5': '0.350', 'ARMOR': '0.445', 'HITCOUNT': '0.500', 'WEAPON3': '0.750', 'weapon3': '1.596', 'weapon2': '1.642', 'DAMAGECOUNT': '1.728', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:54:12,819][2409074] Updated weights for policy 0, policy_version 13041 (0.0012)
[2023-02-25 12:54:14,007][2409074] Updated weights for policy 0, policy_version 13051 (0.0013)
[2023-02-25 12:54:16,064][2409074] Updated weights for policy 0, policy_version 13061 (0.0012)
[2023-02-25 12:54:16,310][2409468] DAMAGECOUNT value on done: 2992.0
[2023-02-25 12:54:16,311][2409468] Sum rewards: 13.692, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.164', 'AMMO2': '0.013', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'weapon7': '0.052', 'AMMO4': '0.063', 'AMMO3': '0.071', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.680', 'weapon4': '0.680', 'weapon3': '1.230', 'ARMOR': '1.249', 'weapon2': '1.298', 'DAMAGECOUNT': '4.032', 'FRAGCOUNT': '9.000'}
[2023-02-25 12:54:17,163][2409074] Updated weights for policy 0, policy_version 13071 (0.0012)
[2023-02-25 12:54:17,186][2408954] Fps is (10 sec: 26214.5, 60 sec: 25600.0, 300 sec: 25631.2). Total num frames: 53538816. Throughput: 0: 6417.1. Samples: 13390596. Policy #0 lag: (min: 0.0, avg: 13.3, max: 25.0)
[2023-02-25 12:54:17,186][2408954] Avg episode reward: [(0, '3.403')]
[2023-02-25 12:54:17,193][2409033] Saving /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000013071_53538816.pth...
[2023-02-25 12:54:17,311][2409033] Removing /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000011573_47403008.pth
[2023-02-25 12:54:17,318][2409033] Saving new best policy, reward=3.403!
[2023-02-25 12:54:18,639][2409074] Updated weights for policy 0, policy_version 13081 (0.0012)
[2023-02-25 12:54:20,706][2409074] Updated weights for policy 0, policy_version 13091 (0.0013)
[2023-02-25 12:54:21,688][2409074] Updated weights for policy 0, policy_version 13101 (0.0012)
[2023-02-25 12:54:22,191][2408954] Fps is (10 sec: 27020.6, 60 sec: 25871.0, 300 sec: 25575.3). Total num frames: 53665792. Throughput: 0: 6402.3. Samples: 13409256. Policy #0 lag: (min: 0.0, avg: 13.3, max: 25.0)
[2023-02-25 12:54:22,191][2408954] Avg episode reward: [(0, '3.403')]
[2023-02-25 12:54:24,029][2409033] Signal inference workers to stop experience collection... (1600 times)
[2023-02-25 12:54:24,030][2409033] Signal inference workers to resume experience collection... (1600 times)
[2023-02-25 12:54:24,040][2409074] InferenceWorker_p0-w0: stopping experience collection (1600 times)
[2023-02-25 12:54:24,057][2409074] InferenceWorker_p0-w0: resuming experience collection (1600 times)
[2023-02-25 12:54:24,082][2409074] Updated weights for policy 0, policy_version 13111 (0.0012)
[2023-02-25 12:54:25,298][2409074] Updated weights for policy 0, policy_version 13121 (0.0012)
[2023-02-25 12:54:26,147][2409102] Large shaping reward 2.538 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.516, 172.0), ('weapon7', 0.002)]
[2023-02-25 12:54:27,163][2409074] Updated weights for policy 0, policy_version 13131 (0.0012)
[2023-02-25 12:54:27,186][2408954] Fps is (10 sec: 24575.4, 60 sec: 25531.8, 300 sec: 25561.8). Total num frames: 53784576. Throughput: 0: 6408.5. Samples: 13447860. Policy #0 lag: (min: 0.0, avg: 13.2, max: 28.0)
[2023-02-25 12:54:27,187][2408954] Avg episode reward: [(0, '3.403')]
[2023-02-25 12:54:28,545][2409074] Updated weights for policy 0, policy_version 13141 (0.0013)
[2023-02-25 12:54:29,827][2409074] Updated weights for policy 0, policy_version 13151 (0.0012)
[2023-02-25 12:54:31,903][2409074] Updated weights for policy 0, policy_version 13161 (0.0012)
[2023-02-25 12:54:32,186][2408954] Fps is (10 sec: 25407.6, 60 sec: 25600.0, 300 sec: 25603.5). Total num frames: 53919744. Throughput: 0: 6413.9. Samples: 13486668. Policy #0 lag: (min: 0.0, avg: 13.2, max: 28.0)
[2023-02-25 12:54:32,186][2408954] Avg episode reward: [(0, '3.403')]
[2023-02-25 12:54:32,245][2409077] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 12:54:33,125][2409074] Updated weights for policy 0, policy_version 13171 (0.0012)
[2023-02-25 12:54:35,312][2409074] Updated weights for policy 0, policy_version 13181 (0.0012)
[2023-02-25 12:54:36,542][2409074] Updated weights for policy 0, policy_version 13191 (0.0013)
[2023-02-25 12:54:37,186][2408954] Fps is (10 sec: 27034.3, 60 sec: 25873.2, 300 sec: 25603.5). Total num frames: 54054912. Throughput: 0: 6401.3. Samples: 13505640. Policy #0 lag: (min: 0.0, avg: 9.5, max: 24.0)
[2023-02-25 12:54:37,186][2408954] Avg episode reward: [(0, '3.403')]
[2023-02-25 12:54:37,659][2409104] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 12:54:37,976][2409074] Updated weights for policy 0, policy_version 13201 (0.0012)
[2023-02-25 12:54:40,002][2409074] Updated weights for policy 0, policy_version 13211 (0.0012)
[2023-02-25 12:54:40,960][2409074] Updated weights for policy 0, policy_version 13221 (0.0013)
[2023-02-25 12:54:42,186][2408954] Fps is (10 sec: 25394.5, 60 sec: 25668.2, 300 sec: 25547.9). Total num frames: 54173696. Throughput: 0: 6399.2. Samples: 13543836. Policy #0 lag: (min: 0.0, avg: 9.5, max: 24.0)
[2023-02-25 12:54:42,186][2408954] Avg episode reward: [(0, '3.403')]
[2023-02-25 12:54:43,051][2409074] Updated weights for policy 0, policy_version 13231 (0.0014)
[2023-02-25 12:54:44,474][2409074] Updated weights for policy 0, policy_version 13241 (0.0013)
[2023-02-25 12:54:45,938][2409074] Updated weights for policy 0, policy_version 13251 (0.0012)
[2023-02-25 12:54:47,186][2408954] Fps is (10 sec: 24166.4, 60 sec: 25531.7, 300 sec: 25547.9). Total num frames: 54296576. Throughput: 0: 6398.1. Samples: 13582116. Policy #0 lag: (min: 0.0, avg: 14.5, max: 33.0)
[2023-02-25 12:54:47,186][2408954] Avg episode reward: [(0, '3.403')]
[2023-02-25 12:54:48,008][2409074] Updated weights for policy 0, policy_version 13261 (0.0012)
[2023-02-25 12:54:49,067][2409074] Updated weights for policy 0, policy_version 13271 (0.0012)
[2023-02-25 12:54:51,042][2409101] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 12:54:51,171][2409074] Updated weights for policy 0, policy_version 13281 (0.0012)
[2023-02-25 12:54:52,171][2409074] Updated weights for policy 0, policy_version 13291 (0.0012)
[2023-02-25 12:54:52,186][2408954] Fps is (10 sec: 26624.8, 60 sec: 25736.5, 300 sec: 25617.4). Total num frames: 54439936. Throughput: 0: 6396.5. Samples: 13601424. Policy #0 lag: (min: 0.0, avg: 14.5, max: 33.0)
[2023-02-25 12:54:52,187][2408954] Avg episode reward: [(0, '3.403')]
[2023-02-25 12:54:54,076][2409074] Updated weights for policy 0, policy_version 13301 (0.0012)
[2023-02-25 12:54:54,641][2409075] Large shaping reward 3.640 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200)]
[2023-02-25 12:54:55,749][2409074] Updated weights for policy 0, policy_version 13311 (0.0015)
[2023-02-25 12:54:57,069][2409074] Updated weights for policy 0, policy_version 13321 (0.0013)
[2023-02-25 12:54:57,186][2408954] Fps is (10 sec: 26624.0, 60 sec: 25668.3, 300 sec: 25589.7). Total num frames: 54562816. Throughput: 0: 6401.9. Samples: 13639968. Policy #0 lag: (min: 0.0, avg: 10.8, max: 25.0)
[2023-02-25 12:54:57,186][2408954] Avg episode reward: [(0, '3.403')]
[2023-02-25 12:54:59,127][2409074] Updated weights for policy 0, policy_version 13331 (0.0013)
[2023-02-25 12:55:00,562][2409074] Updated weights for policy 0, policy_version 13341 (0.0012)
[2023-02-25 12:55:02,178][2409074] Updated weights for policy 0, policy_version 13351 (0.0013)
[2023-02-25 12:55:02,186][2408954] Fps is (10 sec: 24575.9, 60 sec: 25463.5, 300 sec: 25547.9). Total num frames: 54685696. Throughput: 0: 6397.3. Samples: 13678476. Policy #0 lag: (min: 0.0, avg: 10.8, max: 25.0)
[2023-02-25 12:55:02,186][2408954] Avg episode reward: [(0, '3.403')]
[2023-02-25 12:55:03,790][2409074] Updated weights for policy 0, policy_version 13361 (0.0012)
[2023-02-25 12:55:03,990][2409549] DAMAGECOUNT value on done: 2343.0
[2023-02-25 12:55:03,993][2409549] Sum rewards: 0.991, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.720', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.020', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'WEAPON4': '0.250', 'weapon4': '0.250', 'ARMOR': '0.408', 'WEAPON3': '0.450', 'HITCOUNT': '0.480', 'weapon3': '1.438', 'DAMAGECOUNT': '1.596', 'weapon2': '1.780', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:55:04,783][2409100] DAMAGECOUNT value on done: 3032.0
[2023-02-25 12:55:04,787][2409100] Sum rewards: 5.900, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.380', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.076', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.260', 'HITCOUNT': '0.420', 'WEAPON3': '0.500', 'weapon2': '0.972', 'ARMOR': '1.337', 'weapon3': '1.396', 'DAMAGECOUNT': '2.025', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:55:05,110][2409548] Large shaping reward 2.539 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.537, 179.0), ('HEALTH', -0.03, -10.0), ('weapon7', 0.002)]
[2023-02-25 12:55:05,338][2409074] Updated weights for policy 0, policy_version 13371 (0.0012)
[2023-02-25 12:55:06,795][2409074] Updated weights for policy 0, policy_version 13381 (0.0012)
[2023-02-25 12:55:07,135][2409103] DAMAGECOUNT value on done: 2028.0
[2023-02-25 12:55:07,136][2409103] Sum rewards: 8.687, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.835', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.008', 'AMMO4': '0.035', 'AMMO3': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.360', 'WEAPON3': '0.400', 'HITCOUNT': '0.550', 'weapon3': '1.158', 'weapon2': '1.316', 'DAMAGECOUNT': '1.830', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:55:07,186][2408954] Fps is (10 sec: 24985.6, 60 sec: 25600.0, 300 sec: 25575.7). Total num frames: 54812672. Throughput: 0: 6413.0. Samples: 13697808. Policy #0 lag: (min: 1.0, avg: 13.6, max: 29.0)
[2023-02-25 12:55:07,186][2408954] Avg episode reward: [(0, '3.438')]
[2023-02-25 12:55:07,192][2409033] Saving new best policy, reward=3.438!
[2023-02-25 12:55:07,867][2409549] DAMAGECOUNT value on done: 3460.0
[2023-02-25 12:55:07,868][2409549] Sum rewards: 2.874, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.350', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'weapon5': '0.008', 'ARMOR': '0.028', 'WEAPON1': '0.040', 'weapon7': '0.084', 'AMMO3': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.332', 'HITCOUNT': '0.690', 'WEAPON3': '0.850', 'weapon2': '1.052', 'weapon3': '1.538', 'DAMAGECOUNT': '2.460', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:55:08,393][2409100] DAMAGECOUNT value on done: 2810.0
[2023-02-25 12:55:08,396][2409100] Sum rewards: 2.402, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.268', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'AMMO3': '0.070', 'weapon5': '0.086', 'AMMO4': '0.141', 'WEAPON5': '0.200', 'HITCOUNT': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.426', 'WEAPON3': '0.450', 'ARMOR': '0.878', 'DAMAGECOUNT': '1.290', 'weapon3': '1.318', 'weapon2': '1.602', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:55:08,518][2409074] Updated weights for policy 0, policy_version 13391 (0.0012)
[2023-02-25 12:55:10,073][2409074] Updated weights for policy 0, policy_version 13401 (0.0014)
[2023-02-25 12:55:10,740][2409103] DAMAGECOUNT value on done: 3609.0
[2023-02-25 12:55:10,744][2409103] Sum rewards: 3.972, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.865', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.109', 'weapon7': '0.112', 'WEAPON5': '0.150', 'AMMO6': '0.380', 'AMMO7': '0.380', 'WEAPON4': '0.400', 'WEAPON7': '0.500', 'HITCOUNT': '0.550', 'weapon2': '0.558', 'WEAPON3': '0.750', 'weapon4': '1.064', 'weapon3': '1.312', 'DAMAGECOUNT': '2.484', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:55:11,515][2409101] DAMAGECOUNT value on done: 1980.0
[2023-02-25 12:55:11,516][2409101] Sum rewards: 0.862, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.012', 'weapon5': '0.022', 'AMMO2': '0.031', 'WEAPON1': '0.040', 'AMMO3': '0.095', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.157', 'WEAPON5': '0.250', 'weapon4': '0.410', 'ARMOR': '0.428', 'HITCOUNT': '0.430', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.500', 'HEALTH': '0.750', 'weapon2': '1.346', 'DAMAGECOUNT': '1.431', 'weapon3': '1.560'}
[2023-02-25 12:55:11,591][2409549] DAMAGECOUNT value on done: 2634.0
[2023-02-25 12:55:11,594][2409549] Sum rewards: 5.099, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.040', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO3': '0.030', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.180', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.360', 'weapon3': '0.710', 'weapon2': '1.088', 'DAMAGECOUNT': '1.122', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:55:11,888][2409074] Updated weights for policy 0, policy_version 13411 (0.0012)
[2023-02-25 12:55:12,164][2409100] DAMAGECOUNT value on done: 2315.0
[2023-02-25 12:55:12,164][2409100] Sum rewards: 1.427, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.540', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon5': '0.012', 'AMMO4': '0.046', 'weapon7': '0.086', 'AMMO3': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.380', 'WEAPON3': '0.750', 'weapon4': '0.784', 'weapon2': '1.110', 'DAMAGECOUNT': '1.341', 'weapon3': '1.680', 'ARMOR': '1.760', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:55:12,186][2408954] Fps is (10 sec: 25395.2, 60 sec: 25736.6, 300 sec: 25561.8). Total num frames: 54939648. Throughput: 0: 6407.5. Samples: 13736196. Policy #0 lag: (min: 1.0, avg: 13.6, max: 29.0)
[2023-02-25 12:55:12,186][2408954] Avg episode reward: [(0, '3.357')]
[2023-02-25 12:55:13,193][2409074] Updated weights for policy 0, policy_version 13421 (0.0013)
[2023-02-25 12:55:13,955][2409389] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 12:55:14,491][2409102] DAMAGECOUNT value on done: 3012.0
[2023-02-25 12:55:14,492][2409102] Sum rewards: 3.578, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.758', 'AMMO2': '0.005', 'AMMO5': '0.017', 'AMMO4': '0.023', 'WEAPON1': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'weapon5': '0.228', 'HITCOUNT': '0.260', 'weapon4': '0.306', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'ARMOR': '0.875', 'weapon3': '1.212', 'weapon2': '1.374', 'DAMAGECOUNT': '1.440', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:55:14,855][2409074] Updated weights for policy 0, policy_version 13431 (0.0013)
[2023-02-25 12:55:14,887][2409103] DAMAGECOUNT value on done: 2692.0
[2023-02-25 12:55:14,890][2409103] Sum rewards: 1.904, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.020', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO5': '0.007', 'weapon5': '0.012', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO3': '0.064', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.210', 'WEAPON3': '0.450', 'HITCOUNT': '0.450', 'ARMOR': '0.451', 'weapon3': '0.860', 'DAMAGECOUNT': '1.401', 'weapon2': '1.628', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:55:15,281][2409101] DAMAGECOUNT value on done: 2691.0
[2023-02-25 12:55:15,282][2409101] Sum rewards: 5.295, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.106', 'AMMO5': '0.010', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'AMMO4': '0.114', 'weapon5': '0.132', 'WEAPON5': '0.300', 'HITCOUNT': '0.430', 'weapon4': '0.438', 'WEAPON3': '0.650', 'weapon3': '1.380', 'weapon2': '1.414', 'DAMAGECOUNT': '2.283', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:55:15,337][2409549] DAMAGECOUNT value on done: 2539.0
[2023-02-25 12:55:15,338][2409549] Sum rewards: 1.348, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.659', 'AMMO5': '0.021', 'AMMO2': '0.024', 'AMMO3': '0.098', 'AMMO4': '0.118', 'weapon5': '0.136', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'HITCOUNT': '0.460', 'weapon4': '0.522', 'ARMOR': '0.523', 'WEAPON3': '0.700', 'weapon2': '0.852', 'weapon3': '1.664', 'DAMAGECOUNT': '2.190', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:55:15,948][2409100] DAMAGECOUNT value on done: 2520.0
[2023-02-25 12:55:15,949][2409100] Sum rewards: 5.427, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.934', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.076', 'AMMO3': '0.096', 'weapon5': '0.096', 'WEAPON5': '0.400', 'HITCOUNT': '0.540', 'WEAPON3': '0.750', 'weapon2': '1.470', 'DAMAGECOUNT': '1.749', 'weapon3': '1.882', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:55:16,249][2409033] Signal inference workers to stop experience collection... (1650 times)
[2023-02-25 12:55:16,261][2409033] Signal inference workers to resume experience collection... (1650 times)
[2023-02-25 12:55:16,277][2409074] InferenceWorker_p0-w0: stopping experience collection (1650 times)
[2023-02-25 12:55:16,286][2409074] InferenceWorker_p0-w0: resuming experience collection (1650 times)
[2023-02-25 12:55:16,424][2409074] Updated weights for policy 0, policy_version 13441 (0.0013)
[2023-02-25 12:55:17,186][2408954] Fps is (10 sec: 25804.8, 60 sec: 25531.7, 300 sec: 25561.8). Total num frames: 55070720. Throughput: 0: 6393.1. Samples: 13774356. Policy #0 lag: (min: 0.0, avg: 14.1, max: 29.0)
[2023-02-25 12:55:17,186][2408954] Avg episode reward: [(0, '3.196')]
[2023-02-25 12:55:17,829][2409074] Updated weights for policy 0, policy_version 13451 (0.0018)
[2023-02-25 12:55:18,249][2409102] DAMAGECOUNT value on done: 2405.0
[2023-02-25 12:55:18,275][2409102] Sum rewards: 2.050, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.375', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'weapon5': '0.058', 'AMMO3': '0.089', 'WEAPON4': '0.200', 'weapon4': '0.278', 'ARMOR': '0.479', 'HITCOUNT': '0.520', 'WEAPON3': '0.600', 'weapon3': '1.592', 'weapon2': '1.760', 'DAMAGECOUNT': '2.229', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:55:18,485][2409103] DAMAGECOUNT value on done: 2332.0
[2023-02-25 12:55:18,489][2409103] Sum rewards: 6.008, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.372', 'AMMO5': '0.015', 'AMMO2': '0.022', 'weapon4': '0.084', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'HITCOUNT': '0.510', 'WEAPON3': '0.600', 'ARMOR': '0.900', 'weapon3': '1.078', 'DAMAGECOUNT': '1.527', 'weapon2': '1.938', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:55:19,086][2409101] DAMAGECOUNT value on done: 2809.0
[2023-02-25 12:55:19,090][2409101] Sum rewards: 3.873, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.333', 'AMMO4': '-0.082', 'AMMO2': '-0.016', 'AMMO5': '0.003', 'weapon7': '0.048', 'weapon5': '0.052', 'AMMO3': '0.055', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.330', 'WEAPON3': '0.400', 'weapon3': '0.698', 'ARMOR': '1.333', 'weapon2': '1.464', 'DAMAGECOUNT': '1.881', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:55:19,111][2409549] DAMAGECOUNT value on done: 2863.0
[2023-02-25 12:55:19,112][2409549] Sum rewards: 8.228, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.630', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO5': '0.017', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'weapon7': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.103', 'weapon5': '0.138', 'weapon4': '0.230', 'HITCOUNT': '0.320', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon2': '0.732', 'weapon3': '1.278', 'DAMAGECOUNT': '2.031', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:55:19,560][2409100] DAMAGECOUNT value on done: 3044.0
[2023-02-25 12:55:19,561][2409100] Sum rewards: 4.201, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.530', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO2': '0.028', 'AMMO3': '0.067', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'WEAPON4': '0.200', 'weapon4': '0.354', 'WEAPON3': '0.400', 'HITCOUNT': '0.500', 'weapon3': '1.298', 'DAMAGECOUNT': '1.335', 'ARMOR': '1.727', 'weapon2': '1.808', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:55:19,971][2409074] Updated weights for policy 0, policy_version 13461 (0.0012)
[2023-02-25 12:55:21,027][2409485] DAMAGECOUNT value on done: 2761.0
[2023-02-25 12:55:21,031][2409485] Sum rewards: 2.933, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO2': '0.015', 'AMMO5': '0.020', 'AMMO4': '0.074', 'weapon7': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.200', 'HEALTH': '0.282', 'WEAPON5': '0.300', 'HITCOUNT': '0.390', 'weapon4': '0.490', 'WEAPON3': '0.750', 'weapon2': '0.758', 'ARMOR': '0.856', 'weapon3': '1.710', 'DAMAGECOUNT': '2.031', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:55:21,266][2409074] Updated weights for policy 0, policy_version 13471 (0.0012)
[2023-02-25 12:55:21,476][2409406] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)]
[2023-02-25 12:55:22,186][2408954] Fps is (10 sec: 25804.7, 60 sec: 25533.8, 300 sec: 25561.8). Total num frames: 55197696. Throughput: 0: 6397.6. Samples: 13793532. Policy #0 lag: (min: 0.0, avg: 14.1, max: 29.0)
[2023-02-25 12:55:22,186][2408954] Avg episode reward: [(0, '3.293')]
[2023-02-25 12:55:22,213][2409102] DAMAGECOUNT value on done: 3265.0
[2023-02-25 12:55:22,216][2409102] Sum rewards: 10.685, reward structure: {'DEATHCOUNT': '-9.000', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.039', 'AMMO3': '0.103', 'weapon5': '0.130', 'AMMO4': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.300', 'ARMOR': '0.420', 'HEALTH': '0.538', 'WEAPON3': '0.550', 'HITCOUNT': '0.940', 'weapon2': '1.398', 'weapon3': '1.862', 'DAMAGECOUNT': '4.185', 'FRAGCOUNT': '8.500'}
[2023-02-25 12:55:22,486][2409103] DAMAGECOUNT value on done: 2454.0
[2023-02-25 12:55:22,489][2409103] Sum rewards: 2.197, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.032', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'AMMO4': '0.060', 'AMMO3': '0.102', 'weapon5': '0.144', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'HITCOUNT': '0.520', 'weapon4': '0.528', 'WEAPON3': '0.750', 'weapon2': '1.246', 'ARMOR': '1.306', 'weapon3': '1.496', 'DAMAGECOUNT': '2.070', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:55:23,055][2409101] DAMAGECOUNT value on done: 2193.0
[2023-02-25 12:55:23,056][2409101] Sum rewards: 1.241, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.395', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO3': '0.051', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'weapon4': '0.234', 'WEAPON3': '0.350', 'HITCOUNT': '0.380', 'ARMOR': '0.460', 'FRAGCOUNT': '1.000', 'weapon2': '1.096', 'DAMAGECOUNT': '1.185', 'weapon3': '1.208'}
[2023-02-25 12:55:23,064][2409549] DAMAGECOUNT value on done: 2232.0
[2023-02-25 12:55:23,065][2409549] Sum rewards: 3.796, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.674', 'AMMO5': '0.015', 'AMMO2': '0.018', 'weapon5': '0.050', 'AMMO3': '0.061', 'AMMO4': '0.090', 'HITCOUNT': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.563', 'DAMAGECOUNT': '0.801', 'weapon4': '0.936', 'weapon2': '0.958', 'weapon3': '1.528', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:55:23,277][2409100] DAMAGECOUNT value on done: 2698.0
[2023-02-25 12:55:23,292][2409100] Sum rewards: 3.066, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.276', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'weapon5': '0.064', 'AMMO3': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'WEAPON4': '0.200', 'HITCOUNT': '0.260', 'weapon4': '0.364', 'WEAPON3': '0.500', 'ARMOR': '0.858', 'DAMAGECOUNT': '0.945', 'weapon3': '1.264', 'weapon2': '1.292', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:55:23,315][2409074] Updated weights for policy 0, policy_version 13481 (0.0012)
[2023-02-25 12:55:23,564][2409597] DAMAGECOUNT value on done: 2655.0
[2023-02-25 12:55:23,565][2409597] Sum rewards: 2.097, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.561', 'AMMO2': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.048', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'weapon5': '0.150', 'weapon4': '0.226', 'WEAPON5': '0.300', 'HITCOUNT': '0.350', 'WEAPON3': '0.600', 'ARMOR': '0.911', 'weapon2': '1.084', 'DAMAGECOUNT': '1.350', 'weapon3': '1.430', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:55:24,638][2409074] Updated weights for policy 0, policy_version 13491 (0.0014)
[2023-02-25 12:55:24,784][2409485] DAMAGECOUNT value on done: 2833.0
[2023-02-25 12:55:24,785][2409485] Sum rewards: 3.140, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.746', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO5': '0.017', 'AMMO4': '0.067', 'weapon5': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.138', 'weapon4': '0.166', 'WEAPON5': '0.350', 'ARMOR': '0.480', 'HITCOUNT': '0.520', 'WEAPON3': '0.900', 'weapon2': '1.508', 'weapon3': '1.670', 'DAMAGECOUNT': '1.848', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:55:25,908][2409074] Updated weights for policy 0, policy_version 13501 (0.0013)
[2023-02-25 12:55:25,946][2409102] DAMAGECOUNT value on done: 3048.0
[2023-02-25 12:55:25,949][2409102] Sum rewards: 2.374, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.634', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.032', 'AMMO3': '0.078', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.386', 'HITCOUNT': '0.440', 'WEAPON3': '0.500', 'ARMOR': '0.880', 'weapon2': '0.996', 'DAMAGECOUNT': '1.446', 'weapon3': '1.450', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:55:26,128][2409103] DAMAGECOUNT value on done: 2516.0
[2023-02-25 12:55:26,130][2409103] Sum rewards: 4.859, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.247', 'AMMO2': '0.005', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.025', 'AMMO3': '0.040', 'WEAPON4': '0.150', 'HITCOUNT': '0.150', 'weapon4': '0.294', 'WEAPON3': '0.300', 'weapon5': '0.320', 'WEAPON5': '0.400', 'ARMOR': '0.497', 'DAMAGECOUNT': '1.026', 'weapon3': '1.084', 'weapon2': '1.532', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:55:26,269][2409548] DAMAGECOUNT value on done: 1968.0
[2023-02-25 12:55:26,271][2409548] Sum rewards: -0.497, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.516', 'AMMO5': '0.019', 'WEAPON1': '0.030', 'AMMO2': '0.039', 'weapon5': '0.086', 'AMMO3': '0.107', 'AMMO4': '0.197', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.362', 'HITCOUNT': '0.370', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.650', 'ARMOR': '0.860', 'weapon3': '1.352', 'DAMAGECOUNT': '1.371', 'weapon2': '1.626', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:55:26,876][2409549] DAMAGECOUNT value on done: 2521.0
[2023-02-25 12:55:26,879][2409549] Sum rewards: 2.079, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.945', 'AMMO2': '0.006', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.030', 'ARMOR': '0.076', 'AMMO3': '0.089', 'weapon5': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.350', 'WEAPON3': '0.600', 'weapon4': '0.604', 'weapon2': '0.798', 'DAMAGECOUNT': '1.191', 'weapon3': '1.792', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:55:26,887][2409101] DAMAGECOUNT value on done: 2737.0
[2023-02-25 12:55:26,888][2409101] Sum rewards: 3.122, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.634', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon7': '0.038', 'weapon5': '0.058', 'AMMO4': '0.060', 'AMMO3': '0.107', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'HITCOUNT': '0.460', 'ARMOR': '0.472', 'WEAPON3': '0.650', 'weapon4': '0.662', 'weapon2': '1.004', 'DAMAGECOUNT': '1.644', 'weapon3': '1.886', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:55:27,024][2409100] DAMAGECOUNT value on done: 2695.0
[2023-02-25 12:55:27,024][2409100] Sum rewards: 5.242, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.309', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO3': '0.067', 'AMMO4': '0.072', 'weapon5': '0.176', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.450', 'weapon3': '1.304', 'weapon2': '1.704', 'DAMAGECOUNT': '2.205', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:55:27,186][2408954] Fps is (10 sec: 24575.2, 60 sec: 25531.7, 300 sec: 25506.3). Total num frames: 55316480. Throughput: 0: 6397.0. Samples: 13831704. Policy #0 lag: (min: 1.0, avg: 10.4, max: 24.0)
[2023-02-25 12:55:27,187][2408954] Avg episode reward: [(0, '3.340')]
[2023-02-25 12:55:27,988][2409597] DAMAGECOUNT value on done: 2737.0
[2023-02-25 12:55:27,989][2409597] Sum rewards: 3.955, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.462', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.016', 'WEAPON1': '0.050', 'weapon5': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon4': '0.128', 'WEAPON5': '0.350', 'ARMOR': '0.456', 'HITCOUNT': '0.550', 'WEAPON3': '0.650', 'weapon2': '0.990', 'DAMAGECOUNT': '1.857', 'weapon3': '2.096', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:55:28,033][2409565] DAMAGECOUNT value on done: 2211.0
[2023-02-25 12:55:28,036][2409565] Sum rewards: 5.551, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.853', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.120', 'weapon5': '0.150', 'WEAPON5': '0.250', 'HITCOUNT': '0.550', 'WEAPON3': '0.800', 'weapon3': '1.460', 'weapon2': '1.560', 'DAMAGECOUNT': '2.001', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:55:28,231][2409074] Updated weights for policy 0, policy_version 13511 (0.0012)
[2023-02-25 12:55:28,746][2409485] DAMAGECOUNT value on done: 1860.0
[2023-02-25 12:55:28,750][2409485] Sum rewards: 4.454, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.640', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'AMMO3': '0.046', 'WEAPON5': '0.050', 'weapon5': '0.064', 'HITCOUNT': '0.290', 'WEAPON3': '0.300', 'weapon3': '0.784', 'DAMAGECOUNT': '1.149', 'ARMOR': '1.373', 'weapon2': '1.570', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:55:29,230][2409074] Updated weights for policy 0, policy_version 13521 (0.0012)
[2023-02-25 12:55:29,621][2409102] DAMAGECOUNT value on done: 2153.0
[2023-02-25 12:55:29,624][2409102] Sum rewards: 1.803, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.278', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.026', 'ARMOR': '0.056', 'AMMO3': '0.072', 'weapon5': '0.108', 'AMMO4': '0.131', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.460', 'WEAPON3': '0.500', 'weapon2': '0.634', 'weapon4': '0.682', 'weapon3': '1.262', 'DAMAGECOUNT': '1.329', 'FRAGCOUNT': '1.500'}
[2023-02-25 12:55:30,093][2409548] DAMAGECOUNT value on done: 2697.0
[2023-02-25 12:55:30,094][2409548] Sum rewards: 9.172, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.943', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.007', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.116', 'weapon4': '0.234', 'WEAPON3': '0.450', 'HITCOUNT': '0.510', 'weapon3': '1.254', 'weapon2': '1.408', 'ARMOR': '1.774', 'DAMAGECOUNT': '2.628', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:55:30,243][2409103] DAMAGECOUNT value on done: 1971.0
[2023-02-25 12:55:30,244][2409103] Sum rewards: 3.402, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.091', 'AMMO5': '0.011', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'AMMO3': '0.073', 'weapon5': '0.076', 'AMMO4': '0.120', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.430', 'WEAPON3': '0.600', 'weapon4': '0.642', 'ARMOR': '0.949', 'weapon3': '1.140', 'weapon2': '1.410', 'DAMAGECOUNT': '1.677', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:55:30,673][2409100] DAMAGECOUNT value on done: 3113.0
[2023-02-25 12:55:30,677][2409100] Sum rewards: 6.599, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.400', 'AMMO4': '-0.013', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'AMMO3': '0.078', 'weapon5': '0.078', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'weapon4': '0.642', 'ARMOR': '0.912', 'weapon2': '1.010', 'weapon3': '1.336', 'DAMAGECOUNT': '2.283', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:55:31,046][2409549] DAMAGECOUNT value on done: 2827.0
[2023-02-25 12:55:31,049][2409549] Sum rewards: -1.377, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.042', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.138', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon4': '0.334', 'HITCOUNT': '0.390', 'WEAPON5': '0.400', 'ARMOR': '0.454', 'WEAPON3': '1.050', 'weapon2': '1.214', 'weapon3': '1.818', 'DAMAGECOUNT': '1.977', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:55:31,069][2409101] DAMAGECOUNT value on done: 3452.0
[2023-02-25 12:55:31,070][2409101] Sum rewards: 5.300, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.240', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.056', 'AMMO4': '0.073', 'AMMO3': '0.075', 'WEAPON5': '0.200', 'HITCOUNT': '0.340', 'WEAPON3': '0.450', 'weapon3': '1.424', 'DAMAGECOUNT': '1.560', 'weapon2': '2.070', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:55:31,236][2409074] Updated weights for policy 0, policy_version 13531 (0.0014)
[2023-02-25 12:55:31,491][2409105] DAMAGECOUNT value on done: 2791.0
[2023-02-25 12:55:31,492][2409105] Sum rewards: 4.430, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.472', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.030', 'weapon7': '0.062', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'HITCOUNT': '0.300', 'ARMOR': '0.482', 'weapon3': '0.714', 'DAMAGECOUNT': '0.900', 'weapon2': '1.066', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:55:31,594][2409597] DAMAGECOUNT value on done: 2490.0
[2023-02-25 12:55:31,598][2409597] Sum rewards: 3.836, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.185', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'ARMOR': '0.028', 'weapon7': '0.074', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.210', 'WEAPON4': '0.250', 'weapon4': '0.520', 'WEAPON3': '0.550', 'weapon2': '0.810', 'weapon3': '1.194', 'DAMAGECOUNT': '1.737', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:55:32,079][2409565] DAMAGECOUNT value on done: 3103.0
[2023-02-25 12:55:32,080][2409565] Sum rewards: 4.417, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.687', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'weapon7': '0.046', 'AMMO4': '0.056', 'weapon5': '0.062', 'AMMO3': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.410', 'WEAPON3': '0.600', 'ARMOR': '0.887', 'weapon3': '1.418', 'DAMAGECOUNT': '1.458', 'weapon2': '2.096', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:55:32,186][2408954] Fps is (10 sec: 24576.0, 60 sec: 25395.2, 300 sec: 25520.2). Total num frames: 55443456. Throughput: 0: 6392.5. Samples: 13869780. Policy #0 lag: (min: 1.0, avg: 10.4, max: 24.0)
[2023-02-25 12:55:32,186][2408954] Avg episode reward: [(0, '3.579')]
[2023-02-25 12:55:32,211][2409033] Saving new best policy, reward=3.579!
[2023-02-25 12:55:32,504][2409074] Updated weights for policy 0, policy_version 13541 (0.0012)
[2023-02-25 12:55:32,865][2409485] DAMAGECOUNT value on done: 3200.0
[2023-02-25 12:55:32,874][2409485] Sum rewards: 4.788, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.174', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon7': '0.050', 'weapon5': '0.054', 'AMMO3': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.290', 'WEAPON3': '0.400', 'weapon4': '0.572', 'weapon3': '0.944', 'DAMAGECOUNT': '0.993', 'ARMOR': '1.368', 'weapon2': '1.376', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:55:32,912][2409596] DAMAGECOUNT value on done: 3553.0
[2023-02-25 12:55:32,915][2409596] Sum rewards: 8.920, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.400', 'AMMO2': '0.014', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.071', 'AMMO3': '0.095', 'weapon5': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'weapon4': '0.432', 'WEAPON3': '0.650', 'HITCOUNT': '0.650', 'ARMOR': '0.986', 'weapon2': '1.064', 'weapon3': '1.894', 'DAMAGECOUNT': '2.400', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:55:33,826][2409102] DAMAGECOUNT value on done: 2162.0
[2023-02-25 12:55:33,830][2409102] Sum rewards: 2.319, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.376', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON1': '0.030', 'ARMOR': '0.036', 'AMMO3': '0.050', 'AMMO4': '0.056', 'weapon5': '0.070', 'weapon7': '0.086', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.280', 'WEAPON3': '0.400', 'weapon4': '0.418', 'DAMAGECOUNT': '0.897', 'FRAGCOUNT': '1.000', 'weapon3': '1.206', 'weapon2': '1.212'}
[2023-02-25 12:55:33,906][2409548] DAMAGECOUNT value on done: 3161.0
[2023-02-25 12:55:33,907][2409548] Sum rewards: 3.530, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.704', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'weapon5': '0.054', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.157', 'WEAPON4': '0.250', 'HITCOUNT': '0.630', 'weapon4': '0.868', 'WEAPON3': '0.950', 'ARMOR': '0.971', 'weapon2': '1.084', 'weapon3': '1.348', 'DAMAGECOUNT': '2.319', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:55:34,266][2409103] DAMAGECOUNT value on done: 2685.0
[2023-02-25 12:55:34,269][2409103] Sum rewards: 7.357, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.739', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.034', 'weapon5': '0.070', 'AMMO3': '0.088', 'WEAPON5': '0.300', 'HITCOUNT': '0.570', 'WEAPON3': '0.600', 'ARMOR': '0.935', 'weapon3': '1.618', 'weapon2': '1.624', 'DAMAGECOUNT': '2.727', 'FRAGCOUNT': '5.500'}
[2023-02-25 12:55:34,416][2409074] Updated weights for policy 0, policy_version 13551 (0.0013)
[2023-02-25 12:55:34,461][2409100] DAMAGECOUNT value on done: 3355.0
[2023-02-25 12:55:34,469][2409100] Sum rewards: 8.176, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.633', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.030', 'AMMO4': '0.032', 'weapon7': '0.048', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.120', 'weapon4': '0.122', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.520', 'WEAPON3': '0.550', 'ARMOR': '1.275', 'weapon3': '1.518', 'weapon2': '1.746', 'DAMAGECOUNT': '2.568', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:55:34,669][2409549] DAMAGECOUNT value on done: 3074.0
[2023-02-25 12:55:34,670][2409549] Sum rewards: 7.525, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.212', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.073', 'AMMO3': '0.078', 'weapon5': '0.126', 'weapon4': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.540', 'WEAPON3': '0.600', 'ARMOR': '1.290', 'weapon2': '1.450', 'weapon3': '1.624', 'DAMAGECOUNT': '2.289', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:55:34,688][2409101] DAMAGECOUNT value on done: 2722.0
[2023-02-25 12:55:34,689][2409101] Sum rewards: -0.702, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.598', 'AMMO5': '0.013', 'AMMO2': '0.056', 'WEAPON1': '0.060', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.118', 'weapon5': '0.128', 'AMMO4': '0.278', 'WEAPON5': '0.300', 'HITCOUNT': '0.390', 'ARMOR': '0.432', 'WEAPON4': '0.500', 'weapon4': '0.706', 'WEAPON3': '0.750', 'weapon2': '1.082', 'DAMAGECOUNT': '1.287', 'weapon3': '1.496', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:55:34,780][2409406] DAMAGECOUNT value on done: 2319.0
[2023-02-25 12:55:34,786][2409406] Sum rewards: 3.909, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.590', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.044', 'weapon4': '0.050', 'AMMO3': '0.060', 'weapon5': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.415', 'WEAPON3': '0.500', 'HITCOUNT': '0.600', 'weapon3': '1.282', 'weapon2': '1.400', 'DAMAGECOUNT': '2.301', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:55:35,191][2409105] DAMAGECOUNT value on done: 2745.0
[2023-02-25 12:55:35,195][2409105] Sum rewards: 9.334, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.652', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon7': '0.048', 'AMMO4': '0.076', 'AMMO3': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.228', 'weapon4': '0.262', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.600', 'weapon2': '0.982', 'weapon3': '1.920', 'DAMAGECOUNT': '2.814', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:55:35,302][2409597] DAMAGECOUNT value on done: 3237.0
[2023-02-25 12:55:35,305][2409597] Sum rewards: 2.656, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.013', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'AMMO3': '0.123', 'weapon5': '0.134', 'AMMO4': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.418', 'ARMOR': '0.492', 'HITCOUNT': '0.630', 'WEAPON3': '0.700', 'weapon2': '1.268', 'weapon3': '1.854', 'DAMAGECOUNT': '2.547', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:55:35,376][2409077] DAMAGECOUNT value on done: 3516.0
[2023-02-25 12:55:35,376][2409077] Sum rewards: 3.820, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.313', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon5': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'WEAPON5': '0.200', 'weapon4': '0.254', 'HITCOUNT': '0.520', 'WEAPON3': '0.800', 'ARMOR': '1.314', 'weapon3': '1.624', 'weapon2': '1.786', 'DAMAGECOUNT': '2.382', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:55:35,824][2409565] DAMAGECOUNT value on done: 2737.0
[2023-02-25 12:55:35,827][2409565] Sum rewards: 10.239, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.421', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'WEAPON1': '0.040', 'AMMO3': '0.074', 'weapon4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon5': '0.212', 'ARMOR': '0.451', 'HITCOUNT': '0.520', 'WEAPON3': '0.550', 'weapon3': '1.114', 'weapon2': '1.790', 'DAMAGECOUNT': '3.066', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:55:36,095][2409074] Updated weights for policy 0, policy_version 13561 (0.0012)
[2023-02-25 12:55:36,597][2409389] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 12:55:36,960][2409485] DAMAGECOUNT value on done: 3163.0
[2023-02-25 12:55:36,962][2409485] Sum rewards: -3.297, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.260', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.042', 'AMMO3': '0.112', 'AMMO4': '0.211', 'weapon5': '0.240', 'WEAPON5': '0.350', 'HITCOUNT': '0.370', 'WEAPON4': '0.500', 'WEAPON3': '0.600', 'weapon4': '0.776', 'ARMOR': '0.904', 'weapon2': '1.138', 'weapon3': '1.184', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.256'}
[2023-02-25 12:55:37,079][2409074] Updated weights for policy 0, policy_version 13571 (0.0012)
[2023-02-25 12:55:37,186][2408954] Fps is (10 sec: 27034.5, 60 sec: 25531.7, 300 sec: 25561.8). Total num frames: 55586816. Throughput: 0: 6384.3. Samples: 13888716. Policy #0 lag: (min: 0.0, avg: 13.7, max: 25.0)
[2023-02-25 12:55:37,187][2408954] Avg episode reward: [(0, '3.825')]
[2023-02-25 12:55:37,191][2409033] Saving new best policy, reward=3.825!
[2023-02-25 12:55:37,209][2409596] DAMAGECOUNT value on done: 3274.0
[2023-02-25 12:55:37,212][2409596] Sum rewards: 2.578, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.538', 'AMMO5': '0.007', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'AMMO3': '0.045', 'AMMO4': '0.097', 'weapon5': '0.152', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'HITCOUNT': '0.340', 'WEAPON4': '0.350', 'weapon3': '0.640', 'weapon2': '0.754', 'weapon4': '0.762', 'DAMAGECOUNT': '1.128', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:55:37,420][2409102] DAMAGECOUNT value on done: 3530.0
[2023-02-25 12:55:37,423][2409102] Sum rewards: 7.806, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.534', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.030', 'WEAPON1': '0.040', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.166', 'weapon5': '0.200', 'HITCOUNT': '0.390', 'WEAPON5': '0.400', 'ARMOR': '0.404', 'WEAPON3': '0.500', 'weapon2': '1.396', 'weapon3': '1.746', 'DAMAGECOUNT': '2.877', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:55:37,431][2409373] DAMAGECOUNT value on done: 2078.0
[2023-02-25 12:55:37,439][2409373] Sum rewards: 3.022, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.041', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'weapon5': '0.052', 'AMMO3': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'WEAPON4': '0.200', 'HITCOUNT': '0.430', 'WEAPON3': '0.500', 'weapon4': '0.500', 'weapon3': '1.200', 'ARMOR': '1.341', 'weapon2': '1.492', 'DAMAGECOUNT': '1.527', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:55:37,624][2409866] DAMAGECOUNT value on done: 2465.0
[2023-02-25 12:55:37,627][2409866] Sum rewards: 2.159, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.875', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.023', 'weapon5': '0.084', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'weapon4': '0.238', 'WEAPON5': '0.400', 'HITCOUNT': '0.490', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.470', 'weapon2': '1.672', 'weapon3': '1.756', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:55:37,923][2409548] DAMAGECOUNT value on done: 2515.0
[2023-02-25 12:55:37,925][2409548] Sum rewards: 1.602, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.350', 'AMMO5': '0.010', 'AMMO2': '0.030', 'WEAPON1': '0.070', 'weapon5': '0.070', 'AMMO3': '0.115', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.455', 'HITCOUNT': '0.460', 'weapon4': '0.566', 'WEAPON3': '0.700', 'weapon3': '1.342', 'weapon2': '1.382', 'DAMAGECOUNT': '1.902', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:55:38,216][2409103] DAMAGECOUNT value on done: 2581.0
[2023-02-25 12:55:38,216][2409103] Sum rewards: 11.688, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.714', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO5': '0.025', 'ARMOR': '0.036', 'AMMO4': '0.050', 'AMMO3': '0.118', 'weapon5': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.636', 'WEAPON3': '0.700', 'HITCOUNT': '0.700', 'weapon2': '1.020', 'weapon3': '1.646', 'DAMAGECOUNT': '3.291', 'FRAGCOUNT': '10.000'}
[2023-02-25 12:55:38,287][2409549] DAMAGECOUNT value on done: 2188.0
[2023-02-25 12:55:38,290][2409549] Sum rewards: 0.126, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.106', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon5': '0.052', 'weapon7': '0.070', 'AMMO3': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.124', 'HITCOUNT': '0.140', 'WEAPON4': '0.350', 'weapon4': '0.498', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.741', 'ARMOR': '0.933', 'weapon3': '0.958', 'FRAGCOUNT': '1.000', 'weapon2': '1.344'}
[2023-02-25 12:55:38,315][2409101] DAMAGECOUNT value on done: 2386.0
[2023-02-25 12:55:38,326][2409101] Sum rewards: -0.940, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.466', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.066', 'AMMO4': '0.077', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.274', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.420', 'ARMOR': '0.904', 'FRAGCOUNT': '1.000', 'weapon3': '1.086', 'DAMAGECOUNT': '1.245', 'weapon2': '1.618'}
[2023-02-25 12:55:38,336][2409406] DAMAGECOUNT value on done: 2786.0
[2023-02-25 12:55:38,339][2409406] Sum rewards: 4.015, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.324', 'AMMO4': '-0.064', 'AMMO2': '-0.013', 'AMMO5': '0.020', 'weapon5': '0.074', 'AMMO3': '0.078', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'ARMOR': '0.453', 'HITCOUNT': '0.460', 'weapon4': '0.464', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.374', 'weapon2': '1.376', 'weapon3': '1.416', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:55:38,462][2409100] DAMAGECOUNT value on done: 2831.0
[2023-02-25 12:55:38,465][2409100] Sum rewards: 3.721, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.904', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'AMMO4': '0.046', 'weapon5': '0.088', 'AMMO3': '0.116', 'WEAPON4': '0.200', 'weapon4': '0.300', 'HITCOUNT': '0.350', 'WEAPON5': '0.550', 'ARMOR': '0.856', 'WEAPON3': '0.900', 'weapon2': '1.084', 'DAMAGECOUNT': '1.335', 'weapon3': '1.996', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:55:38,953][2409077] DAMAGECOUNT value on done: 2954.0
[2023-02-25 12:55:38,956][2409077] Sum rewards: 5.992, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.208', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'weapon5': '0.052', 'AMMO4': '0.085', 'AMMO3': '0.107', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.528', 'WEAPON3': '0.650', 'HITCOUNT': '0.660', 'ARMOR': '0.892', 'weapon3': '1.032', 'DAMAGECOUNT': '2.052', 'weapon2': '2.158', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:55:39,151][2409355] DAMAGECOUNT value on done: 2504.0
[2023-02-25 12:55:39,155][2409355] Sum rewards: 5.992, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'HEALTH': '0.010', 'AMMO2': '0.011', 'weapon4': '0.020', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.057', 'weapon5': '0.142', 'WEAPON5': '0.200', 'HITCOUNT': '0.330', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'weapon3': '1.092', 'DAMAGECOUNT': '1.512', 'weapon2': '2.178', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:55:39,199][2409074] Updated weights for policy 0, policy_version 13581 (0.0013)
[2023-02-25 12:55:39,203][2409105] DAMAGECOUNT value on done: 3435.0
[2023-02-25 12:55:39,204][2409105] Sum rewards: 7.834, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.042', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON1': '0.050', 'weapon5': '0.060', 'AMMO3': '0.086', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.440', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'ARMOR': '0.857', 'weapon2': '1.512', 'weapon3': '1.634', 'DAMAGECOUNT': '2.316', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:55:39,316][2409597] DAMAGECOUNT value on done: 3798.0
[2023-02-25 12:55:39,320][2409597] Sum rewards: 4.962, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.380', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.058', 'AMMO3': '0.091', 'weapon5': '0.106', 'WEAPON5': '0.250', 'HITCOUNT': '0.600', 'WEAPON3': '0.750', 'ARMOR': '1.333', 'weapon2': '1.486', 'weapon3': '2.008', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:55:39,492][2409565] DAMAGECOUNT value on done: 3570.0
[2023-02-25 12:55:39,494][2409565] Sum rewards: 10.181, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.575', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon5': '0.078', 'AMMO3': '0.109', 'AMMO4': '0.122', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.440', 'HITCOUNT': '0.540', 'weapon4': '0.688', 'WEAPON3': '0.700', 'weapon2': '0.878', 'weapon3': '1.392', 'DAMAGECOUNT': '3.006', 'FRAGCOUNT': '9.000'}
[2023-02-25 12:55:39,709][2409405] DAMAGECOUNT value on done: 3115.0
[2023-02-25 12:55:39,712][2409405] Sum rewards: -1.838, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.138', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'weapon5': '0.130', 'AMMO3': '0.137', 'AMMO4': '0.155', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.360', 'HITCOUNT': '0.440', 'WEAPON3': '0.850', 'ARMOR': '0.936', 'weapon2': '1.452', 'DAMAGECOUNT': '1.500', 'weapon3': '1.626', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:55:39,735][2409079] Large shaping reward 3.640 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200)]
[2023-02-25 12:55:40,251][2409104] DAMAGECOUNT value on done: 2933.0
[2023-02-25 12:55:40,252][2409104] Sum rewards: 6.679, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.146', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.012', 'AMMO3': '0.117', 'weapon5': '0.276', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'HITCOUNT': '0.780', 'ARMOR': '0.921', 'weapon2': '1.434', 'weapon3': '1.718', 'DAMAGECOUNT': '2.784', 'FRAGCOUNT': '5.500'}
[2023-02-25 12:55:40,677][2409074] Updated weights for policy 0, policy_version 13591 (0.0014)
[2023-02-25 12:55:40,706][2409485] DAMAGECOUNT value on done: 3153.0
[2023-02-25 12:55:40,707][2409485] Sum rewards: 7.051, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.364', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.126', 'WEAPON4': '0.150', 'weapon4': '0.154', 'weapon5': '0.204', 'WEAPON5': '0.300', 'ARMOR': '0.420', 'HITCOUNT': '0.620', 'WEAPON3': '0.850', 'weapon2': '1.080', 'weapon3': '1.472', 'DAMAGECOUNT': '2.502', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:55:40,972][2409373] Large shaping reward 2.602 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('weapon7', 0.002)]
[2023-02-25 12:55:40,994][2409407] DAMAGECOUNT value on done: 2419.0
[2023-02-25 12:55:40,995][2409407] Sum rewards: 3.902, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.648', 'AMMO5': '0.016', 'AMMO2': '0.020', 'AMMO3': '0.069', 'weapon5': '0.094', 'AMMO4': '0.100', 'weapon7': '0.102', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'HITCOUNT': '0.390', 'WEAPON3': '0.450', 'weapon4': '0.708', 'weapon3': '0.778', 'ARMOR': '0.859', 'weapon2': '0.932', 'DAMAGECOUNT': '1.881', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:55:41,076][2409102] DAMAGECOUNT value on done: 2787.0
[2023-02-25 12:55:41,077][2409102] Sum rewards: 4.170, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.480', 'AMMO2': '0.007', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.036', 'AMMO3': '0.077', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.206', 'weapon4': '0.258', 'HITCOUNT': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'ARMOR': '0.854', 'weapon3': '1.104', 'weapon2': '1.448', 'DAMAGECOUNT': '1.575', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:55:41,231][2409866] DAMAGECOUNT value on done: 2865.0
[2023-02-25 12:55:41,234][2409866] Sum rewards: 4.702, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.854', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO4': '0.036', 'weapon5': '0.110', 'AMMO3': '0.127', 'WEAPON4': '0.300', 'HITCOUNT': '0.470', 'WEAPON5': '0.500', 'weapon4': '0.546', 'weapon2': '0.734', 'ARMOR': '0.858', 'WEAPON3': '0.900', 'weapon3': '1.686', 'DAMAGECOUNT': '1.740', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:55:41,283][2409596] DAMAGECOUNT value on done: 1755.0
[2023-02-25 12:55:41,287][2409596] Sum rewards: 1.963, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon7': '0.048', 'AMMO3': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'HITCOUNT': '0.170', 'WEAPON4': '0.250', 'weapon5': '0.260', 'WEAPON3': '0.300', 'HEALTH': '0.390', 'DAMAGECOUNT': '0.642', 'weapon4': '0.724', 'weapon3': '0.800', 'ARMOR': '0.836', 'weapon2': '0.896', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:55:41,557][2409373] DAMAGECOUNT value on done: 2727.0
[2023-02-25 12:55:41,560][2409373] Sum rewards: 6.866, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.311', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.031', 'weapon7': '0.046', 'AMMO3': '0.053', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'weapon4': '0.388', 'HITCOUNT': '0.400', 'ARMOR': '0.446', 'weapon2': '0.760', 'weapon3': '0.962', 'DAMAGECOUNT': '1.779', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:55:41,642][2409548] DAMAGECOUNT value on done: 2773.0
[2023-02-25 12:55:41,647][2409548] Sum rewards: 2.118, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.224', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO5': '0.020', 'WEAPON1': '0.050', 'AMMO3': '0.094', 'weapon5': '0.150', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'HITCOUNT': '0.410', 'ARMOR': '0.454', 'weapon4': '0.518', 'WEAPON3': '0.650', 'weapon2': '1.090', 'weapon3': '1.486', 'DAMAGECOUNT': '1.551', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:55:41,979][2409103] DAMAGECOUNT value on done: 2140.0
[2023-02-25 12:55:41,980][2409103] Sum rewards: 0.098, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.550', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO5': '0.007', 'weapon5': '0.046', 'AMMO3': '0.102', 'WEAPON5': '0.150', 'HITCOUNT': '0.360', 'ARMOR': '0.454', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.161', 'weapon2': '1.500', 'weapon3': '1.528', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:55:42,087][2409100] DAMAGECOUNT value on done: 1732.0
[2023-02-25 12:55:42,091][2409100] Sum rewards: 3.569, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.011', 'AMMO5': '0.014', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'weapon7': '0.050', 'AMMO4': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.152', 'HITCOUNT': '0.240', 'WEAPON3': '0.300', 'WEAPON5': '0.350', 'HEALTH': '0.376', 'DAMAGECOUNT': '0.777', 'FRAGCOUNT': '1.000', 'weapon3': '1.108', 'weapon2': '1.250', 'ARMOR': '1.254'}
[2023-02-25 12:55:42,186][2408954] Fps is (10 sec: 25395.2, 60 sec: 25395.3, 300 sec: 25547.9). Total num frames: 55697408. Throughput: 0: 6371.2. Samples: 13926672. Policy #0 lag: (min: 0.0, avg: 13.7, max: 25.0)
[2023-02-25 12:55:42,186][2408954] Avg episode reward: [(0, '4.055')]
[2023-02-25 12:55:42,217][2409033] Saving new best policy, reward=4.055!
[2023-02-25 12:55:42,368][2409549] DAMAGECOUNT value on done: 2580.0
[2023-02-25 12:55:42,371][2409549] Sum rewards: -2.683, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.130', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO3': '0.116', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'weapon5': '0.192', 'HITCOUNT': '0.240', 'weapon4': '0.294', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.687', 'WEAPON3': '0.700', 'weapon2': '1.056', 'weapon3': '1.868'}
[2023-02-25 12:55:42,467][2409101] DAMAGECOUNT value on done: 2043.0
[2023-02-25 12:55:42,468][2409101] Sum rewards: -0.199, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.568', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.012', 'WEAPON1': '0.050', 'AMMO3': '0.083', 'WEAPON4': '0.150', 'weapon5': '0.174', 'weapon4': '0.204', 'HITCOUNT': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.191', 'weapon3': '1.404', 'weapon2': '1.790'}
[2023-02-25 12:55:42,537][2409074] Updated weights for policy 0, policy_version 13601 (0.0012)
[2023-02-25 12:55:42,595][2409406] DAMAGECOUNT value on done: 2438.0
[2023-02-25 12:55:42,598][2409406] Sum rewards: 3.077, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.782', 'AMMO5': '0.009', 'AMMO2': '0.023', 'WEAPON4': '0.050', 'AMMO3': '0.083', 'weapon5': '0.112', 'AMMO4': '0.116', 'weapon4': '0.214', 'WEAPON5': '0.250', 'HITCOUNT': '0.280', 'WEAPON3': '0.550', 'weapon3': '1.098', 'ARMOR': '1.244', 'weapon2': '1.764', 'DAMAGECOUNT': '1.815', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:55:42,752][2409355] DAMAGECOUNT value on done: 2401.0
[2023-02-25 12:55:42,755][2409355] Sum rewards: 3.362, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.519', 'AMMO5': '0.010', 'AMMO2': '0.032', 'WEAPON1': '0.040', 'AMMO3': '0.126', 'AMMO4': '0.160', 'weapon5': '0.162', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.457', 'weapon4': '0.460', 'HITCOUNT': '0.550', 'WEAPON3': '0.800', 'weapon2': '1.298', 'weapon3': '1.502', 'DAMAGECOUNT': '1.983', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:55:42,811][2409105] DAMAGECOUNT value on done: 3098.0
[2023-02-25 12:55:42,812][2409105] Sum rewards: 1.104, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.735', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon7': '0.082', 'AMMO3': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.350', 'HITCOUNT': '0.520', 'weapon4': '0.598', 'WEAPON3': '0.650', 'weapon3': '1.024', 'weapon2': '1.310', 'ARMOR': '1.392', 'DAMAGECOUNT': '1.860', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:55:42,923][2409597] DAMAGECOUNT value on done: 2813.0
[2023-02-25 12:55:42,924][2409597] Sum rewards: 7.867, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon4': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.050', 'AMMO3': '0.077', 'AMMO4': '0.107', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.490', 'HEALTH': '0.676', 'weapon2': '1.368', 'weapon3': '1.380', 'DAMAGECOUNT': '1.989', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:55:43,081][2409565] DAMAGECOUNT value on done: 3491.0
[2023-02-25 12:55:43,081][2409565] Sum rewards: 6.739, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.570', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon5': '0.070', 'AMMO3': '0.099', 'WEAPON4': '0.150', 'AMMO4': '0.162', 'WEAPON5': '0.250', 'weapon4': '0.416', 'WEAPON3': '0.750', 'HITCOUNT': '0.820', 'weapon2': '1.020', 'weapon3': '1.972', 'DAMAGECOUNT': '3.054', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:55:43,222][2409389] DAMAGECOUNT value on done: 2187.0
[2023-02-25 12:55:43,224][2409389] Sum rewards: 1.791, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.958', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'AMMO3': '0.044', 'weapon7': '0.050', 'weapon5': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.210', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'ARMOR': '0.424', 'weapon4': '0.600', 'weapon2': '0.756', 'weapon3': '0.784', 'DAMAGECOUNT': '1.110', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:55:43,310][2409077] DAMAGECOUNT value on done: 2989.0
[2023-02-25 12:55:43,335][2409077] Sum rewards: 3.548, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.188', 'AMMO2': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.060', 'weapon5': '0.070', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'weapon4': '0.248', 'WEAPON5': '0.350', 'ARMOR': '0.424', 'HITCOUNT': '0.480', 'WEAPON3': '0.700', 'weapon2': '1.040', 'weapon3': '1.714', 'DAMAGECOUNT': '1.890', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:55:43,985][2409405] DAMAGECOUNT value on done: 1985.0
[2023-02-25 12:55:43,986][2409405] Sum rewards: 1.388, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.290', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'weapon5': '0.046', 'AMMO3': '0.062', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.440', 'weapon4': '0.444', 'ARMOR': '0.500', 'DAMAGECOUNT': '1.200', 'weapon3': '1.200', 'weapon2': '1.612', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:55:44,123][2409104] DAMAGECOUNT value on done: 2633.0
[2023-02-25 12:55:44,125][2409104] Sum rewards: 8.106, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.636', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'AMMO3': '0.088', 'AMMO4': '0.162', 'weapon5': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '0.570', 'ARMOR': '0.913', 'weapon2': '1.120', 'weapon3': '1.374', 'DAMAGECOUNT': '2.766', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:55:44,197][2409074] Updated weights for policy 0, policy_version 13611 (0.0013)
[2023-02-25 12:55:44,448][2409485] DAMAGECOUNT value on done: 2656.0
[2023-02-25 12:55:44,785][2409102] DAMAGECOUNT value on done: 2745.0
[2023-02-25 12:55:44,786][2409102] Sum rewards: 1.992, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'HEALTH': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon7': '0.058', 'AMMO3': '0.065', 'AMMO4': '0.106', 'weapon5': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.310', 'WEAPON3': '0.400', 'ARMOR': '0.432', 'weapon4': '0.522', 'weapon3': '0.788', 'DAMAGECOUNT': '1.464', 'weapon2': '1.636', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:55:44,813][2409407] DAMAGECOUNT value on done: 2658.0
[2023-02-25 12:55:44,814][2409407] Sum rewards: -1.425, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.915', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon5': '0.108', 'AMMO3': '0.116', 'AMMO4': '0.119', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'HITCOUNT': '0.330', 'weapon4': '0.382', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.035', 'ARMOR': '1.288', 'weapon2': '1.474', 'FRAGCOUNT': '1.500', 'weapon3': '1.624'}
[2023-02-25 12:55:44,889][2409866] DAMAGECOUNT value on done: 2677.0
[2023-02-25 12:55:44,890][2409866] Sum rewards: 1.447, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.652', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'weapon7': '0.054', 'weapon5': '0.058', 'AMMO3': '0.059', 'AMMO4': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'ARMOR': '0.440', 'WEAPON3': '0.450', 'weapon4': '0.534', 'DAMAGECOUNT': '0.726', 'FRAGCOUNT': '1.000', 'weapon3': '1.000', 'weapon2': '1.206'}
[2023-02-25 12:55:45,109][2409596] DAMAGECOUNT value on done: 2141.0
[2023-02-25 12:55:45,112][2409596] Sum rewards: 3.194, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO3': '0.030', 'weapon7': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON3': '0.150', 'HITCOUNT': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.388', 'HEALTH': '0.466', 'ARMOR': '0.512', 'weapon3': '0.582', 'weapon2': '0.922', 'DAMAGECOUNT': '0.981', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:55:45,383][2409074] Updated weights for policy 0, policy_version 13621 (0.0016)
[2023-02-25 12:55:45,404][2409548] DAMAGECOUNT value on done: 3574.0
[2023-02-25 12:55:45,407][2409548] Sum rewards: 6.094, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.860', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO5': '0.032', 'WEAPON4': '0.050', 'weapon7': '0.058', 'AMMO4': '0.075', 'AMMO3': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.232', 'weapon5': '0.266', 'HITCOUNT': '0.420', 'WEAPON3': '0.550', 'WEAPON5': '0.550', 'ARMOR': '0.914', 'weapon2': '1.368', 'weapon3': '1.524', 'DAMAGECOUNT': '2.334', 'FRAGCOUNT': '5.500'}
[2023-02-25 12:55:45,573][2409373] DAMAGECOUNT value on done: 2331.0
[2023-02-25 12:55:45,575][2409373] Sum rewards: 5.484, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.216', 'AMMO5': '0.021', 'AMMO2': '0.023', 'ARMOR': '0.036', 'AMMO3': '0.054', 'WEAPON1': '0.060', 'AMMO4': '0.114', 'weapon5': '0.208', 'WEAPON4': '0.300', 'weapon4': '0.322', 'HITCOUNT': '0.350', 'WEAPON3': '0.400', 'WEAPON5': '0.500', 'weapon3': '1.238', 'DAMAGECOUNT': '1.554', 'weapon2': '1.770', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:55:45,646][2409103] DAMAGECOUNT value on done: 2343.0
[2023-02-25 12:55:45,647][2409103] Sum rewards: -0.915, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.522', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.065', 'AMMO3': '0.068', 'weapon5': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.354', 'HITCOUNT': '0.410', 'ARMOR': '0.461', 'WEAPON3': '0.550', 'weapon3': '1.254', 'DAMAGECOUNT': '1.494', 'weapon2': '1.586', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:55:45,786][2409100] DAMAGECOUNT value on done: 3515.0
[2023-02-25 12:55:45,787][2409100] Sum rewards: 0.145, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.720', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon5': '0.052', 'AMMO3': '0.104', 'AMMO4': '0.127', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.430', 'HITCOUNT': '0.650', 'WEAPON3': '0.700', 'weapon3': '1.202', 'weapon2': '1.472', 'DAMAGECOUNT': '2.415', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:55:46,465][2409355] DAMAGECOUNT value on done: 4378.0
[2023-02-25 12:55:46,466][2409355] Sum rewards: 9.275, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.125', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.011', 'AMMO3': '0.067', 'weapon7': '0.092', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.188', 'WEAPON7': '0.200', 'weapon4': '0.236', 'WEAPON5': '0.300', 'HITCOUNT': '0.490', 'WEAPON3': '0.500', 'weapon3': '1.072', 'weapon2': '1.442', 'ARMOR': '1.809', 'DAMAGECOUNT': '3.651', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:55:46,538][2409549] DAMAGECOUNT value on done: 2599.0
[2023-02-25 12:55:46,539][2409549] Sum rewards: 5.653, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.904', 'AMMO5': '0.016', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'weapon4': '0.096', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.120', 'weapon5': '0.164', 'WEAPON5': '0.450', 'HITCOUNT': '0.620', 'ARMOR': '0.846', 'WEAPON3': '0.850', 'weapon2': '1.604', 'weapon3': '1.834', 'DAMAGECOUNT': '2.190', 'FRAGCOUNT': '7.500'}
[2023-02-25 12:55:46,639][2409101] DAMAGECOUNT value on done: 4387.0
[2023-02-25 12:55:46,643][2409101] Sum rewards: 6.388, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.894', 'AMMO2': '0.007', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.033', 'AMMO3': '0.066', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.320', 'HITCOUNT': '0.470', 'ARMOR': '0.490', 'WEAPON3': '0.500', 'weapon3': '1.262', 'weapon2': '1.890', 'DAMAGECOUNT': '2.676', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:55:46,655][2409406] DAMAGECOUNT value on done: 2725.0
[2023-02-25 12:55:46,656][2409406] Sum rewards: 5.635, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.116', 'AMMO5': '0.005', 'AMMO2': '0.024', 'AMMO3': '0.058', 'weapon7': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.112', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'HITCOUNT': '0.160', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'weapon2': '0.558', 'weapon4': '0.898', 'ARMOR': '0.999', 'DAMAGECOUNT': '1.047', 'weapon3': '1.144', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:55:46,987][2409565] DAMAGECOUNT value on done: 2733.0
[2023-02-25 12:55:46,989][2409565] Sum rewards: 3.040, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.548', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.070', 'weapon7': '0.072', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.210', 'weapon5': '0.224', 'weapon4': '0.262', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon2': '0.862', 'weapon3': '1.270', 'DAMAGECOUNT': '1.479', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:55:47,186][2408954] Fps is (10 sec: 24166.4, 60 sec: 25531.7, 300 sec: 25506.3). Total num frames: 55828480. Throughput: 0: 6365.6. Samples: 13964928. Policy #0 lag: (min: 3.0, avg: 13.1, max: 24.0)
[2023-02-25 12:55:47,186][2408954] Avg episode reward: [(0, '3.937')]
[2023-02-25 12:55:47,206][2409389] DAMAGECOUNT value on done: 2171.0
[2023-02-25 12:55:47,208][2409074] Updated weights for policy 0, policy_version 13631 (0.0012)
[2023-02-25 12:55:47,207][2409389] Sum rewards: 2.185, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.058', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.030', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.380', 'HITCOUNT': '0.460', 'ARMOR': '0.477', 'FRAGCOUNT': '0.500', 'weapon3': '0.722', 'weapon2': '1.340', 'DAMAGECOUNT': '1.449'}
[2023-02-25 12:55:47,212][2409105] DAMAGECOUNT value on done: 2782.0
[2023-02-25 12:55:47,213][2409105] Sum rewards: 1.006, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.515', 'AMMO5': '0.012', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.067', 'AMMO3': '0.100', 'weapon5': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.334', 'HITCOUNT': '0.400', 'ARMOR': '0.453', 'WEAPON3': '0.700', 'weapon2': '1.230', 'DAMAGECOUNT': '1.482', 'weapon3': '1.744', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:55:47,281][2409077] DAMAGECOUNT value on done: 2347.0
[2023-02-25 12:55:47,282][2409077] Sum rewards: 5.486, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.329', 'AMMO5': '0.015', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'weapon7': '0.046', 'AMMO3': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.120', 'AMMO4': '0.121', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.330', 'WEAPON3': '0.500', 'weapon4': '0.512', 'weapon3': '1.066', 'ARMOR': '1.295', 'weapon2': '1.556', 'DAMAGECOUNT': '2.010', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:55:47,323][2409597] DAMAGECOUNT value on done: 3063.0
[2023-02-25 12:55:47,324][2409597] Sum rewards: -0.698, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.446', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'weapon5': '0.086', 'AMMO4': '0.092', 'AMMO3': '0.154', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.400', 'weapon4': '0.454', 'weapon2': '0.882', 'ARMOR': '0.907', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.470', 'FRAGCOUNT': '1.500', 'weapon3': '2.194'}
[2023-02-25 12:55:47,647][2409405] DAMAGECOUNT value on done: 2626.0
[2023-02-25 12:55:47,647][2409405] Sum rewards: 2.766, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.340', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'AMMO3': '0.062', 'weapon2': '0.190', 'HITCOUNT': '0.210', 'weapon4': '0.222', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.660', 'ARMOR': '0.900', 'weapon3': '1.436', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:55:48,059][2409104] DAMAGECOUNT value on done: 4205.0
[2023-02-25 12:55:48,060][2409104] Sum rewards: 6.574, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.624', 'AMMO5': '0.015', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.066', 'AMMO4': '0.076', 'AMMO3': '0.090', 'weapon5': '0.172', 'WEAPON5': '0.400', 'HITCOUNT': '0.470', 'WEAPON3': '0.550', 'ARMOR': '0.800', 'weapon3': '1.508', 'weapon2': '1.998', 'DAMAGECOUNT': '2.208', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:55:48,069][2409485] DAMAGECOUNT value on done: 2664.0
[2023-02-25 12:55:48,070][2409485] Sum rewards: 7.618, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.010', 'AMMO5': '0.010', 'weapon4': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.040', 'weapon5': '0.056', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.101', 'WEAPON5': '0.250', 'HITCOUNT': '0.500', 'WEAPON3': '0.650', 'ARMOR': '1.367', 'weapon3': '1.484', 'DAMAGECOUNT': '1.950', 'weapon2': '2.240', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:55:48,588][2409102] DAMAGECOUNT value on done: 2694.0
[2023-02-25 12:55:48,593][2409102] Sum rewards: 0.568, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.950', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO3': '0.040', 'WEAPON4': '0.150', 'weapon5': '0.184', 'HITCOUNT': '0.220', 'WEAPON5': '0.250', 'weapon4': '0.324', 'WEAPON3': '0.350', 'weapon3': '1.012', 'DAMAGECOUNT': '1.245', 'weapon2': '1.490', 'FRAGCOUNT': '1.500'}
[2023-02-25 12:55:48,609][2409074] Updated weights for policy 0, policy_version 13641 (0.0012)
[2023-02-25 12:55:48,703][2409866] DAMAGECOUNT value on done: 2912.0
[2023-02-25 12:55:48,704][2409866] Sum rewards: 4.832, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.952', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO4': '0.045', 'AMMO3': '0.103', 'weapon5': '0.110', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'ARMOR': '0.460', 'HITCOUNT': '0.590', 'weapon4': '0.632', 'WEAPON3': '0.650', 'weapon3': '1.352', 'weapon2': '1.438', 'DAMAGECOUNT': '2.802', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:55:48,710][2409407] DAMAGECOUNT value on done: 3697.0
[2023-02-25 12:55:48,712][2409407] Sum rewards: 1.808, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.868', 'AMMO2': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'weapon5': '0.074', 'weapon7': '0.088', 'AMMO3': '0.105', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.296', 'AMMO6': '0.360', 'AMMO7': '0.360', 'HITCOUNT': '0.370', 'WEAPON7': '0.400', 'ARMOR': '0.447', 'WEAPON3': '0.700', 'weapon2': '1.132', 'weapon3': '1.260', 'DAMAGECOUNT': '1.320', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:55:48,965][2409596] DAMAGECOUNT value on done: 2364.0
[2023-02-25 12:55:48,966][2409596] Sum rewards: 5.590, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.033', 'weapon7': '0.066', 'HEALTH': '0.072', 'AMMO3': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'WEAPON4': '0.200', 'weapon4': '0.432', 'WEAPON3': '0.500', 'HITCOUNT': '0.570', 'ARMOR': '0.915', 'weapon3': '1.092', 'weapon2': '1.472', 'DAMAGECOUNT': '1.914', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:55:49,214][2409548] DAMAGECOUNT value on done: 2646.0
[2023-02-25 12:55:49,218][2409548] Sum rewards: 6.417, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.648', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.015', 'WEAPON1': '0.070', 'AMMO3': '0.093', 'weapon5': '0.192', 'WEAPON5': '0.450', 'HITCOUNT': '0.480', 'WEAPON3': '0.700', 'ARMOR': '0.950', 'weapon2': '1.574', 'weapon3': '1.730', 'DAMAGECOUNT': '1.812', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:55:49,345][2409469] DAMAGECOUNT value on done: 1921.0
[2023-02-25 12:55:49,346][2409469] Sum rewards: 4.974, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.612', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO5': '0.003', 'weapon5': '0.020', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'weapon7': '0.050', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.266', 'HITCOUNT': '0.380', 'WEAPON3': '0.400', 'ARMOR': '0.887', 'weapon3': '1.024', 'DAMAGECOUNT': '1.197', 'weapon2': '1.274', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:55:49,567][2409373] DAMAGECOUNT value on done: 3294.0
[2023-02-25 12:55:49,570][2409373] Sum rewards: 2.817, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.859', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON1': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.066', 'weapon5': '0.102', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.350', 'HITCOUNT': '0.360', 'ARMOR': '0.453', 'WEAPON3': '0.500', 'weapon2': '0.786', 'weapon3': '1.438', 'DAMAGECOUNT': '1.596', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:55:49,581][2409100] DAMAGECOUNT value on done: 2785.0
[2023-02-25 12:55:49,585][2409100] Sum rewards: 1.657, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.380', 'AMMO5': '0.010', 'AMMO2': '0.019', 'ARMOR': '0.020', 'WEAPON1': '0.030', 'AMMO3': '0.056', 'weapon7': '0.092', 'AMMO4': '0.093', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.260', 'weapon4': '0.358', 'WEAPON3': '0.450', 'weapon2': '0.776', 'weapon3': '1.124', 'DAMAGECOUNT': '1.239', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:55:50,015][2409103] DAMAGECOUNT value on done: 2760.0
[2023-02-25 12:55:50,016][2409103] Sum rewards: 3.257, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.404', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'AMMO3': '0.047', 'weapon7': '0.062', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.350', 'WEAPON3': '0.350', 'weapon4': '0.688', 'weapon3': '0.812', 'ARMOR': '0.957', 'DAMAGECOUNT': '1.428', 'weapon2': '1.668', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:55:50,149][2409549] DAMAGECOUNT value on done: 3633.0
[2023-02-25 12:55:50,153][2409549] Sum rewards: 2.613, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.580', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.039', 'AMMO3': '0.065', 'WEAPON4': '0.250', 'HITCOUNT': '0.360', 'weapon4': '0.430', 'ARMOR': '0.492', 'WEAPON3': '0.500', 'weapon2': '1.004', 'DAMAGECOUNT': '1.107', 'weapon3': '1.428', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:55:50,224][2409406] DAMAGECOUNT value on done: 2394.0
[2023-02-25 12:55:50,225][2409406] Sum rewards: -0.667, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.618', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO3': '0.041', 'weapon7': '0.068', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.147', 'WEAPON7': '0.200', 'HITCOUNT': '0.240', 'WEAPON5': '0.250', 'WEAPON3': '0.250', 'WEAPON4': '0.400', 'ARMOR': '0.400', 'weapon4': '0.522', 'weapon2': '0.706', 'DAMAGECOUNT': '0.813', 'weapon3': '1.022', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:55:50,267][2409355] DAMAGECOUNT value on done: 2153.0
[2023-02-25 12:55:50,271][2409355] Sum rewards: 4.330, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.984', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'AMMO3': '0.087', 'WEAPON4': '0.250', 'weapon5': '0.302', 'HITCOUNT': '0.410', 'ARMOR': '0.420', 'weapon4': '0.546', 'WEAPON3': '0.550', 'WEAPON5': '0.550', 'weapon3': '1.194', 'weapon2': '1.540', 'DAMAGECOUNT': '2.649', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:55:50,280][2409101] DAMAGECOUNT value on done: 2395.0
[2023-02-25 12:55:50,280][2409101] Sum rewards: 1.005, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.880', 'AMMO5': '0.007', 'AMMO2': '0.014', 'ARMOR': '0.020', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.069', 'weapon5': '0.072', 'AMMO3': '0.085', 'weapon4': '0.142', 'HITCOUNT': '0.180', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.465', 'WEAPON3': '0.600', 'weapon3': '1.354', 'weapon2': '1.826', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:55:50,442][2409076] DAMAGECOUNT value on done: 3091.0
[2023-02-25 12:55:50,444][2409076] Sum rewards: 7.855, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.187', 'AMMO2': '0.010', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.050', 'AMMO3': '0.107', 'WEAPON4': '0.200', 'weapon5': '0.220', 'WEAPON5': '0.250', 'HITCOUNT': '0.370', 'weapon4': '0.464', 'WEAPON3': '0.700', 'ARMOR': '0.832', 'weapon2': '1.200', 'weapon3': '1.264', 'DAMAGECOUNT': '3.069', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:55:50,599][2409074] Updated weights for policy 0, policy_version 13651 (0.0012)
[2023-02-25 12:55:50,770][2409565] DAMAGECOUNT value on done: 2579.0
[2023-02-25 12:55:50,773][2409565] Sum rewards: 7.063, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.978', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.011', 'WEAPON1': '0.060', 'weapon5': '0.074', 'AMMO3': '0.122', 'WEAPON5': '0.250', 'ARMOR': '0.458', 'HITCOUNT': '0.490', 'WEAPON3': '0.800', 'weapon2': '1.426', 'weapon3': '1.794', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '9.000'}
[2023-02-25 12:55:50,804][2409105] DAMAGECOUNT value on done: 2479.0
[2023-02-25 12:55:50,806][2409105] Sum rewards: 2.534, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.020', 'AMMO2': '0.002', 'AMMO5': '0.010', 'AMMO4': '0.012', 'WEAPON1': '0.020', 'weapon4': '0.052', 'AMMO3': '0.053', 'weapon5': '0.096', 'HITCOUNT': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'ARMOR': '0.955', 'DAMAGECOUNT': '0.990', 'weapon3': '1.160', 'weapon2': '1.924', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:55:50,863][2409097] DAMAGECOUNT value on done: 2867.0
[2023-02-25 12:55:50,864][2409097] Sum rewards: 7.441, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.088', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.076', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'weapon4': '0.178', 'WEAPON3': '0.450', 'HITCOUNT': '0.780', 'weapon3': '1.360', 'weapon2': '1.484', 'DAMAGECOUNT': '3.075', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:55:50,870][2409077] DAMAGECOUNT value on done: 3112.0
[2023-02-25 12:55:50,875][2409077] Sum rewards: 3.775, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.022', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.068', 'AMMO4': '0.068', 'weapon4': '0.158', 'HITCOUNT': '0.370', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'DAMAGECOUNT': '1.032', 'weapon3': '1.232', 'weapon2': '1.656', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:55:50,898][2409597] DAMAGECOUNT value on done: 2637.0
[2023-02-25 12:55:50,899][2409597] Sum rewards: 0.069, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.684', 'AMMO5': '0.005', 'AMMO2': '0.016', 'WEAPON1': '0.060', 'AMMO4': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.100', 'AMMO3': '0.104', 'weapon5': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.290', 'ARMOR': '0.432', 'weapon4': '0.462', 'WEAPON3': '0.550', 'weapon3': '0.994', 'weapon2': '1.182', 'DAMAGECOUNT': '1.242', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:55:51,089][2409389] DAMAGECOUNT value on done: 2619.0
[2023-02-25 12:55:51,092][2409389] Sum rewards: 2.031, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.355', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.027', 'WEAPON1': '0.030', 'AMMO3': '0.136', 'weapon5': '0.192', 'HITCOUNT': '0.460', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'ARMOR': '1.299', 'weapon2': '1.436', 'DAMAGECOUNT': '1.530', 'weapon3': '2.074', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:55:51,561][2409405] DAMAGECOUNT value on done: 2574.0
[2023-02-25 12:55:51,562][2409405] Sum rewards: 3.360, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO5': '0.003', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.015', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'HITCOUNT': '0.170', 'HEALTH': '0.206', 'WEAPON3': '0.250', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.465', 'weapon2': '0.608', 'weapon3': '1.370', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:55:51,701][2409104] DAMAGECOUNT value on done: 2403.0
[2023-02-25 12:55:51,703][2409104] Sum rewards: 5.149, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.097', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.053', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'weapon7': '0.134', 'WEAPON4': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'ARMOR': '0.420', 'weapon4': '0.472', 'HITCOUNT': '0.710', 'WEAPON3': '0.750', 'weapon2': '1.074', 'weapon3': '1.622', 'DAMAGECOUNT': '2.424', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:55:52,018][2409074] Updated weights for policy 0, policy_version 13661 (0.0012)
[2023-02-25 12:55:52,186][2408954] Fps is (10 sec: 26214.5, 60 sec: 25326.9, 300 sec: 25520.2). Total num frames: 55959552. Throughput: 0: 6356.5. Samples: 13983852. Policy #0 lag: (min: 3.0, avg: 13.1, max: 24.0)
[2023-02-25 12:55:52,186][2408954] Avg episode reward: [(0, '3.841')]
[2023-02-25 12:55:52,324][2409102] DAMAGECOUNT value on done: 2404.0
[2023-02-25 12:55:52,327][2409102] Sum rewards: 3.395, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.367', 'AMMO5': '0.008', 'AMMO2': '0.016', 'WEAPON1': '0.050', 'AMMO3': '0.063', 'weapon5': '0.070', 'AMMO4': '0.082', 'weapon7': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.260', 'weapon4': '0.388', 'WEAPON3': '0.400', 'ARMOR': '0.400', 'weapon2': '0.884', 'weapon3': '1.214', 'DAMAGECOUNT': '1.233', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:55:52,434][2409075] DAMAGECOUNT value on done: 2628.0
[2023-02-25 12:55:52,435][2409075] Sum rewards: 9.239, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.866', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.041', 'AMMO3': '0.067', 'weapon5': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.416', 'WEAPON3': '0.450', 'HITCOUNT': '0.550', 'weapon2': '1.280', 'weapon3': '1.316', 'ARMOR': '1.332', 'DAMAGECOUNT': '2.490', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:55:52,512][2409866] DAMAGECOUNT value on done: 2864.0
[2023-02-25 12:55:52,513][2409866] Sum rewards: 9.874, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.844', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO3': '0.075', 'AMMO4': '0.106', 'weapon4': '0.152', 'WEAPON4': '0.200', 'weapon5': '0.220', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'HITCOUNT': '0.600', 'weapon3': '0.868', 'ARMOR': '0.951', 'weapon2': '1.350', 'DAMAGECOUNT': '2.850', 'FRAGCOUNT': '10.000'}
[2023-02-25 12:55:52,548][2409407] DAMAGECOUNT value on done: 2663.0
[2023-02-25 12:55:52,549][2409407] Sum rewards: 7.174, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.745', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.083', 'AMMO4': '0.084', 'weapon5': '0.096', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.498', 'HITCOUNT': '0.580', 'WEAPON3': '0.600', 'weapon4': '0.656', 'weapon3': '1.468', 'weapon2': '1.472', 'DAMAGECOUNT': '2.730', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:55:52,628][2409596] DAMAGECOUNT value on done: 1981.0
[2023-02-25 12:55:52,629][2409596] Sum rewards: 2.352, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.207', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO3': '0.032', 'AMMO4': '0.090', 'weapon5': '0.112', 'weapon7': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.260', 'weapon4': '0.304', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'weapon3': '0.784', 'FRAGCOUNT': '1.000', 'ARMOR': '1.228', 'DAMAGECOUNT': '1.296', 'weapon2': '1.554'}
[2023-02-25 12:55:52,819][2409548] DAMAGECOUNT value on done: 3386.0
[2023-02-25 12:55:52,820][2409548] Sum rewards: 4.540, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.729', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'WEAPON4': '0.050', 'weapon5': '0.056', 'weapon4': '0.094', 'AMMO3': '0.097', 'WEAPON5': '0.200', 'HITCOUNT': '0.490', 'ARMOR': '0.658', 'WEAPON3': '0.700', 'weapon2': '1.438', 'weapon3': '1.502', 'DAMAGECOUNT': '1.725', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:55:53,112][2409485] DAMAGECOUNT value on done: 2683.0
[2023-02-25 12:55:53,113][2409485] Sum rewards: 0.835, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.991', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.014', 'WEAPON1': '0.030', 'weapon7': '0.080', 'weapon5': '0.112', 'AMMO3': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.262', 'HITCOUNT': '0.430', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.700', 'weapon2': '1.290', 'ARMOR': '1.311', 'weapon3': '1.666', 'DAMAGECOUNT': '1.965'}
[2023-02-25 12:55:53,131][2409469] DAMAGECOUNT value on done: 2778.0
[2023-02-25 12:55:53,134][2409469] Sum rewards: -0.642, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.520', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.055', 'weapon5': '0.064', 'AMMO3': '0.087', 'HITCOUNT': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'ARMOR': '0.479', 'WEAPON3': '0.600', 'weapon4': '0.648', 'weapon3': '1.054', 'DAMAGECOUNT': '1.059', 'weapon2': '1.168', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:55:53,146][2409100] DAMAGECOUNT value on done: 2812.0
[2023-02-25 12:55:53,146][2409100] Sum rewards: 2.013, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.100', 'AMMO2': '0.008', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.038', 'weapon5': '0.048', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'WEAPON5': '0.250', 'HITCOUNT': '0.260', 'weapon4': '0.514', 'weapon2': '0.904', 'WEAPON3': '0.950', 'ARMOR': '0.976', 'DAMAGECOUNT': '1.305', 'weapon3': '1.754', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:55:53,529][2409373] DAMAGECOUNT value on done: 3333.0
[2023-02-25 12:55:53,530][2409373] Sum rewards: 5.772, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.682', 'AMMO2': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.021', 'AMMO3': '0.099', 'weapon5': '0.106', 'WEAPON5': '0.200', 'HITCOUNT': '0.430', 'WEAPON3': '0.650', 'ARMOR': '0.857', 'weapon2': '1.182', 'weapon3': '1.892', 'DAMAGECOUNT': '1.992', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:55:53,545][2409078] DAMAGECOUNT value on done: 2137.0
[2023-02-25 12:55:53,546][2409078] Sum rewards: 2.379, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.424', 'AMMO2': '0.010', 'AMMO5': '0.013', 'weapon5': '0.016', 'AMMO4': '0.048', 'AMMO3': '0.069', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.384', 'HITCOUNT': '0.410', 'WEAPON3': '0.500', 'weapon3': '0.944', 'ARMOR': '0.947', 'DAMAGECOUNT': '1.290', 'weapon2': '1.472', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:55:53,768][2409074] Updated weights for policy 0, policy_version 13671 (0.0012)
[2023-02-25 12:55:53,978][2409406] DAMAGECOUNT value on done: 2518.0
[2023-02-25 12:55:53,981][2409406] Sum rewards: 5.712, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.104', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO3': '0.049', 'AMMO4': '0.061', 'weapon5': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'weapon4': '0.418', 'HITCOUNT': '0.450', 'weapon3': '0.842', 'weapon2': '0.866', 'ARMOR': '0.939', 'DAMAGECOUNT': '2.172', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:55:54,032][2409355] DAMAGECOUNT value on done: 2685.0
[2023-02-25 12:55:54,032][2409355] Sum rewards: 3.138, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.858', 'AMMO5': '0.012', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'weapon5': '0.058', 'AMMO3': '0.074', 'AMMO4': '0.112', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.350', 'weapon4': '0.354', 'ARMOR': '0.428', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.101', 'weapon3': '1.298', 'weapon2': '2.006', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:55:54,189][2409103] DAMAGECOUNT value on done: 2773.0
[2023-02-25 12:55:54,375][2409076] DAMAGECOUNT value on done: 2604.0
[2023-02-25 12:55:54,379][2409076] Sum rewards: 3.682, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO3': '0.040', 'ARMOR': '0.040', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.230', 'WEAPON3': '0.250', 'HEALTH': '0.330', 'HITCOUNT': '0.350', 'weapon4': '0.420', 'weapon2': '0.876', 'weapon3': '1.042', 'DAMAGECOUNT': '1.245', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:55:54,366][2409549] DAMAGECOUNT value on done: 3616.0
[2023-02-25 12:55:54,383][2409549] Sum rewards: 2.185, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.314', 'weapon5': '0.002', 'AMMO2': '0.005', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.025', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'WEAPON5': '0.150', 'weapon4': '0.222', 'HITCOUNT': '0.430', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'weapon2': '0.884', 'DAMAGECOUNT': '1.314', 'weapon3': '1.390', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:55:54,443][2409565] DAMAGECOUNT value on done: 2513.0
[2023-02-25 12:55:54,447][2409565] Sum rewards: 6.748, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.854', 'AMMO2': '0.005', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO4': '0.025', 'WEAPON1': '0.030', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'weapon5': '0.180', 'WEAPON5': '0.250', 'weapon4': '0.322', 'HITCOUNT': '0.660', 'WEAPON3': '0.750', 'weapon2': '1.004', 'weapon3': '2.032', 'DAMAGECOUNT': '2.322', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:55:54,606][2409389] DAMAGECOUNT value on done: 2460.0
[2023-02-25 12:55:54,607][2409389] Sum rewards: 4.308, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.182', 'AMMO5': '0.005', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'AMMO3': '0.049', 'AMMO4': '0.080', 'weapon7': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.118', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.300', 'WEAPON3': '0.350', 'ARMOR': '0.458', 'weapon4': '0.506', 'weapon3': '0.882', 'DAMAGECOUNT': '1.365', 'FRAGCOUNT': '1.500', 'weapon2': '1.840'}
[2023-02-25 12:55:54,663][2409101] DAMAGECOUNT value on done: 2975.0
[2023-02-25 12:55:54,676][2409101] Sum rewards: 0.692, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.890', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.052', 'AMMO3': '0.058', 'weapon4': '0.090', 'WEAPON4': '0.150', 'HITCOUNT': '0.260', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'ARMOR': '0.500', 'DAMAGECOUNT': '0.951', 'weapon3': '1.076', 'weapon2': '2.408', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:55:54,678][2409077] DAMAGECOUNT value on done: 1860.0
[2023-02-25 12:55:54,681][2409077] Sum rewards: 0.416, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.766', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO4': '0.030', 'weapon7': '0.046', 'AMMO3': '0.055', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'weapon4': '0.452', 'ARMOR': '0.460', 'DAMAGECOUNT': '0.711', 'weapon3': '0.914', 'FRAGCOUNT': '1.000', 'weapon2': '1.398'}
[2023-02-25 12:55:54,723][2409105] DAMAGECOUNT value on done: 3494.0
[2023-02-25 12:55:54,726][2409105] Sum rewards: 7.764, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.348', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.033', 'ARMOR': '0.051', 'AMMO3': '0.111', 'weapon5': '0.112', 'WEAPON4': '0.150', 'AMMO4': '0.164', 'weapon4': '0.224', 'WEAPON5': '0.400', 'HITCOUNT': '0.720', 'WEAPON3': '0.750', 'weapon2': '1.216', 'weapon3': '2.036', 'DAMAGECOUNT': '2.865', 'FRAGCOUNT': '8.500'}
[2023-02-25 12:55:54,809][2409597] DAMAGECOUNT value on done: 3449.0
[2023-02-25 12:55:54,812][2409597] Sum rewards: 1.809, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.036', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'AMMO3': '0.094', 'weapon5': '0.160', 'AMMO4': '0.161', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.398', 'HITCOUNT': '0.410', 'ARMOR': '0.444', 'WEAPON3': '0.550', 'weapon2': '0.952', 'DAMAGECOUNT': '1.380', 'weapon3': '1.876', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:55:55,175][2409097] DAMAGECOUNT value on done: 1625.0
[2023-02-25 12:55:55,179][2409097] Sum rewards: 3.387, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.310', 'AMMO5': '0.006', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON1': '0.040', 'AMMO3': '0.124', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.376', 'HITCOUNT': '0.440', 'WEAPON3': '0.750', 'ARMOR': '0.897', 'weapon3': '1.330', 'DAMAGECOUNT': '1.482', 'weapon2': '1.486', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:55:55,580][2409074] Updated weights for policy 0, policy_version 13681 (0.0012)
[2023-02-25 12:55:55,656][2409104] DAMAGECOUNT value on done: 2660.0
[2023-02-25 12:55:55,660][2409104] Sum rewards: 6.928, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.089', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO3': '0.050', 'AMMO4': '0.072', 'weapon5': '0.086', 'WEAPON4': '0.150', 'HITCOUNT': '0.200', 'WEAPON3': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.590', 'weapon2': '0.758', 'ARMOR': '1.414', 'weapon3': '1.490', 'DAMAGECOUNT': '1.524', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:55:55,952][2409405] DAMAGECOUNT value on done: 2472.0
[2023-02-25 12:55:55,953][2409405] Sum rewards: 6.926, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.124', 'weapon5': '0.190', 'WEAPON5': '0.200', 'HITCOUNT': '0.310', 'ARMOR': '0.428', 'WEAPON3': '0.450', 'HEALTH': '0.520', 'weapon4': '0.522', 'weapon2': '1.028', 'weapon3': '1.668', 'DAMAGECOUNT': '1.743', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:55:55,961][2409102] DAMAGECOUNT value on done: 2014.0
[2023-02-25 12:55:55,964][2409102] Sum rewards: 4.549, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.058', 'AMMO2': '0.010', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'ARMOR': '0.017', 'AMMO4': '0.049', 'AMMO3': '0.060', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.344', 'HITCOUNT': '0.400', 'WEAPON3': '0.450', 'weapon2': '0.646', 'weapon3': '1.328', 'DAMAGECOUNT': '1.545', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:55:56,079][2409075] DAMAGECOUNT value on done: 3679.0
[2023-02-25 12:55:56,082][2409075] Sum rewards: 13.389, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.884', 'AMMO2': '0.012', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'weapon5': '0.052', 'AMMO4': '0.060', 'AMMO3': '0.064', 'weapon4': '0.092', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.500', 'HITCOUNT': '0.820', 'ARMOR': '0.894', 'weapon3': '1.198', 'weapon2': '1.994', 'DAMAGECOUNT': '3.204', 'FRAGCOUNT': '11.000'}
[2023-02-25 12:55:56,245][2409866] DAMAGECOUNT value on done: 3111.0
[2023-02-25 12:55:56,249][2409866] Sum rewards: 0.298, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.053', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.034', 'AMMO3': '0.108', 'AMMO4': '0.168', 'weapon5': '0.176', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.400', 'ARMOR': '0.453', 'HITCOUNT': '0.610', 'WEAPON3': '0.700', 'weapon2': '1.336', 'weapon3': '1.426', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.947'}
[2023-02-25 12:55:56,407][2409407] DAMAGECOUNT value on done: 2995.0
[2023-02-25 12:55:56,408][2409407] Sum rewards: 2.674, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.053', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon5': '0.052', 'weapon4': '0.082', 'AMMO3': '0.084', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'HITCOUNT': '0.440', 'WEAPON3': '0.650', 'weapon2': '1.758', 'DAMAGECOUNT': '1.824', 'weapon3': '1.836', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:55:56,455][2409548] DAMAGECOUNT value on done: 2229.0
[2023-02-25 12:55:56,456][2409548] Sum rewards: 0.327, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.582', 'AMMO5': '0.017', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'AMMO3': '0.089', 'AMMO4': '0.106', 'weapon5': '0.146', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.342', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.125', 'weapon3': '1.304', 'weapon2': '1.438', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:55:56,504][2409074] Updated weights for policy 0, policy_version 13691 (0.0012)
[2023-02-25 12:55:56,556][2409596] DAMAGECOUNT value on done: 2886.0
[2023-02-25 12:55:56,559][2409596] Sum rewards: 3.178, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.207', 'AMMO5': '0.022', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'weapon7': '0.056', 'AMMO3': '0.065', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.420', 'ARMOR': '0.453', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.155', 'weapon3': '1.396', 'weapon2': '1.468', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:55:56,691][2409485] DAMAGECOUNT value on done: 2817.0
[2023-02-25 12:55:56,694][2409485] Sum rewards: 0.977, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.346', 'AMMO2': '0.008', 'AMMO5': '0.012', 'AMMO4': '0.037', 'WEAPON1': '0.060', 'weapon5': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'weapon4': '0.264', 'WEAPON5': '0.300', 'HITCOUNT': '0.500', 'WEAPON3': '0.800', 'weapon2': '1.412', 'DAMAGECOUNT': '1.689', 'weapon3': '1.950', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:55:56,756][2409100] DAMAGECOUNT value on done: 2333.0
[2023-02-25 12:55:56,756][2409100] Sum rewards: 4.694, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.141', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO3': '0.060', 'AMMO4': '0.092', 'weapon5': '0.110', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.290', 'weapon4': '0.338', 'WEAPON3': '0.350', 'ARMOR': '0.416', 'weapon2': '1.000', 'DAMAGECOUNT': '1.269', 'weapon3': '1.314', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:55:56,808][2409469] DAMAGECOUNT value on done: 2368.0
[2023-02-25 12:55:56,811][2409469] Sum rewards: 3.567, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.558', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon7': '0.036', 'AMMO3': '0.068', 'weapon5': '0.080', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon4': '0.178', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.470', 'WEAPON3': '0.500', 'ARMOR': '0.856', 'weapon3': '1.124', 'DAMAGECOUNT': '1.752', 'weapon2': '2.028', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:55:57,088][2409373] DAMAGECOUNT value on done: 2703.0
[2023-02-25 12:55:57,091][2409373] Sum rewards: 3.188, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.666', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'WEAPON1': '0.030', 'AMMO3': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.054', 'WEAPON4': '0.100', 'HITCOUNT': '0.250', 'weapon4': '0.252', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'weapon3': '1.004', 'DAMAGECOUNT': '1.200', 'weapon2': '1.694', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:55:57,186][2408954] Fps is (10 sec: 25804.9, 60 sec: 25395.2, 300 sec: 25547.9). Total num frames: 56086528. Throughput: 0: 6348.0. Samples: 14021856. Policy #0 lag: (min: 0.0, avg: 11.4, max: 24.0)
[2023-02-25 12:55:57,186][2408954] Avg episode reward: [(0, '3.581')]
[2023-02-25 12:55:57,719][2409078] DAMAGECOUNT value on done: 2093.0
[2023-02-25 12:55:57,723][2409078] Sum rewards: 4.213, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.510', 'AMMO2': '0.005', 'AMMO5': '0.019', 'AMMO4': '0.026', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.074', 'AMMO3': '0.075', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.188', 'weapon4': '0.246', 'HITCOUNT': '0.260', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'ARMOR': '0.500', 'weapon2': '0.650', 'DAMAGECOUNT': '1.065', 'weapon3': '1.564', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:55:57,755][2409103] DAMAGECOUNT value on done: 2354.0
[2023-02-25 12:55:57,782][2409355] DAMAGECOUNT value on done: 3531.0
[2023-02-25 12:55:57,785][2409355] Sum rewards: 4.792, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.710', 'AMMO2': '0.018', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.061', 'weapon7': '0.068', 'AMMO4': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.138', 'WEAPON5': '0.250', 'HITCOUNT': '0.290', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'ARMOR': '0.482', 'weapon2': '0.580', 'weapon4': '0.934', 'weapon3': '1.012', 'DAMAGECOUNT': '1.638', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:55:58,000][2409076] DAMAGECOUNT value on done: 2317.0
[2023-02-25 12:55:58,001][2409076] Sum rewards: 0.130, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.559', 'AMMO5': '0.013', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.070', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'weapon5': '0.166', 'weapon4': '0.184', 'HITCOUNT': '0.340', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.330', 'DAMAGECOUNT': '1.341', 'weapon3': '1.834'}
[2023-02-25 12:55:58,019][2409406] DAMAGECOUNT value on done: 3136.0
[2023-02-25 12:55:58,022][2409406] Sum rewards: 4.451, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.454', 'AMMO5': '0.012', 'AMMO2': '0.023', 'WEAPON1': '0.060', 'AMMO3': '0.107', 'AMMO4': '0.116', 'weapon5': '0.134', 'WEAPON4': '0.150', 'weapon4': '0.160', 'WEAPON5': '0.300', 'HITCOUNT': '0.520', 'WEAPON3': '0.800', 'ARMOR': '0.855', 'weapon2': '1.348', 'weapon3': '1.984', 'DAMAGECOUNT': '2.085', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:55:58,263][2409074] Updated weights for policy 0, policy_version 13701 (0.0012)
[2023-02-25 12:55:58,341][2409105] DAMAGECOUNT value on done: 2125.0
[2023-02-25 12:55:58,344][2409105] Sum rewards: 1.712, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.054', 'AMMO5': '0.019', 'AMMO2': '0.021', 'weapon5': '0.046', 'weapon7': '0.050', 'AMMO3': '0.105', 'AMMO4': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.550', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'ARMOR': '1.368', 'weapon3': '1.416', 'weapon2': '1.678', 'DAMAGECOUNT': '1.866'}
[2023-02-25 12:55:58,414][2409549] DAMAGECOUNT value on done: 3365.0
[2023-02-25 12:55:58,415][2409549] Sum rewards: 3.299, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.116', 'AMMO2': '0.008', 'AMMO5': '0.020', 'AMMO4': '0.038', 'weapon7': '0.050', 'AMMO3': '0.055', 'WEAPON4': '0.100', 'weapon5': '0.134', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HITCOUNT': '0.330', 'WEAPON5': '0.400', 'weapon4': '0.432', 'WEAPON3': '0.450', 'ARMOR': '0.857', 'weapon2': '0.960', 'weapon3': '1.200', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '2.391'}
[2023-02-25 12:55:58,425][2409597] DAMAGECOUNT value on done: 2773.0
[2023-02-25 12:55:58,428][2409597] Sum rewards: 2.919, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.340', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO3': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon4': '0.174', 'HITCOUNT': '0.320', 'WEAPON3': '0.350', 'ARMOR': '0.476', 'weapon3': '0.728', 'weapon2': '0.948', 'DAMAGECOUNT': '1.062', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:55:58,575][2409101] DAMAGECOUNT value on done: 3712.0
[2023-02-25 12:55:58,576][2409101] Sum rewards: 7.967, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.188', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.094', 'AMMO4': '0.147', 'weapon5': '0.212', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.538', 'WEAPON3': '0.650', 'HITCOUNT': '0.770', 'weapon2': '1.214', 'weapon3': '1.396', 'ARMOR': '1.408', 'DAMAGECOUNT': '3.414', 'FRAGCOUNT': '7.500'}
[2023-02-25 12:55:58,676][2409565] DAMAGECOUNT value on done: 3166.0
[2023-02-25 12:55:58,676][2409565] Sum rewards: 4.025, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.516', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON1': '0.060', 'weapon5': '0.076', 'AMMO3': '0.082', 'WEAPON5': '0.150', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.640', 'weapon2': '1.134', 'weapon3': '1.500', 'DAMAGECOUNT': '2.139', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:55:58,719][2409077] DAMAGECOUNT value on done: 2943.0
[2023-02-25 12:55:58,722][2409077] Sum rewards: 11.570, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.566', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'AMMO3': '0.098', 'weapon5': '0.104', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.418', 'HITCOUNT': '0.510', 'WEAPON3': '0.700', 'ARMOR': '0.995', 'weapon3': '1.368', 'weapon2': '1.608', 'DAMAGECOUNT': '2.892', 'FRAGCOUNT': '10.000'}
[2023-02-25 12:55:58,837][2409389] DAMAGECOUNT value on done: 2390.0
[2023-02-25 12:55:58,838][2409389] Sum rewards: 1.843, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.270', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.035', 'AMMO3': '0.041', 'WEAPON5': '0.050', 'weapon5': '0.060', 'weapon7': '0.072', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.170', 'WEAPON7': '0.200', 'weapon4': '0.228', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.495', 'weapon3': '0.966', 'FRAGCOUNT': '1.000', 'weapon2': '1.126'}
[2023-02-25 12:55:59,046][2409097] DAMAGECOUNT value on done: 2831.0
[2023-02-25 12:55:59,046][2409097] Sum rewards: 6.326, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.990', 'AMMO4': '-0.101', 'AMMO2': '-0.020', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'weapon5': '0.048', 'AMMO3': '0.083', 'weapon4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'HITCOUNT': '0.570', 'WEAPON3': '0.600', 'ARMOR': '0.905', 'weapon3': '0.926', 'DAMAGECOUNT': '1.944', 'weapon2': '2.190', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:55:59,631][2409104] DAMAGECOUNT value on done: 2853.0
[2023-02-25 12:55:59,632][2409104] Sum rewards: 1.266, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.100', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'AMMO3': '0.080', 'AMMO4': '0.090', 'weapon5': '0.190', 'weapon4': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'HITCOUNT': '0.520', 'WEAPON3': '0.650', 'weapon2': '1.180', 'weapon3': '1.890', 'DAMAGECOUNT': '1.977', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:55:59,947][2409866] DAMAGECOUNT value on done: 1573.0
[2023-02-25 12:55:59,949][2409866] Sum rewards: 1.385, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.160', 'AMMO5': '0.018', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'weapon5': '0.078', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.143', 'weapon4': '0.248', 'WEAPON5': '0.350', 'HITCOUNT': '0.350', 'ARMOR': '0.460', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.266', 'weapon3': '1.608', 'weapon2': '1.668', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:00,025][2409405] DAMAGECOUNT value on done: 1996.0
[2023-02-25 12:56:00,028][2409405] Sum rewards: 5.282, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.788', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'weapon5': '0.002', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'WEAPON4': '0.200', 'weapon4': '0.298', 'HITCOUNT': '0.450', 'WEAPON3': '0.500', 'ARMOR': '0.541', 'weapon2': '1.460', 'weapon3': '1.496', 'DAMAGECOUNT': '1.524', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:00,067][2409074] Updated weights for policy 0, policy_version 13711 (0.0012)
[2023-02-25 12:56:00,221][2409548] DAMAGECOUNT value on done: 3302.0
[2023-02-25 12:56:00,221][2409548] Sum rewards: 3.932, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.802', 'AMMO5': '0.005', 'AMMO2': '0.030', 'AMMO3': '0.057', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.151', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '0.400', 'weapon4': '0.422', 'ARMOR': '0.938', 'weapon3': '1.058', 'weapon2': '1.306', 'DAMAGECOUNT': '1.416', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:00,239][2409485] DAMAGECOUNT value on done: 2861.0
[2023-02-25 12:56:00,240][2409485] Sum rewards: 3.149, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.935', 'AMMO2': '0.009', 'AMMO5': '0.012', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.043', 'weapon5': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'WEAPON5': '0.300', 'weapon4': '0.344', 'HITCOUNT': '0.380', 'WEAPON3': '0.850', 'weapon2': '1.456', 'weapon3': '1.790', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:00,455][2409075] DAMAGECOUNT value on done: 2365.0
[2023-02-25 12:56:00,458][2409075] Sum rewards: 0.040, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.636', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'AMMO3': '0.072', 'weapon5': '0.124', 'AMMO4': '0.165', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.280', 'weapon4': '0.310', 'ARMOR': '0.452', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.119', 'weapon3': '1.368', 'weapon2': '1.472'}
[2023-02-25 12:56:00,469][2409096] DAMAGECOUNT value on done: 3153.0
[2023-02-25 12:56:00,473][2409096] Sum rewards: 3.790, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.436', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.028', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon5': '0.062', 'weapon4': '0.062', 'AMMO3': '0.137', 'WEAPON5': '0.550', 'HITCOUNT': '0.640', 'WEAPON3': '0.900', 'ARMOR': '0.900', 'weapon2': '1.590', 'weapon3': '1.818', 'DAMAGECOUNT': '2.205', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:00,570][2409100] DAMAGECOUNT value on done: 2925.0
[2023-02-25 12:56:00,573][2409100] Sum rewards: 3.807, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.706', 'AMMO2': '0.004', 'AMMO5': '0.012', 'AMMO4': '0.017', 'weapon5': '0.020', 'WEAPON1': '0.040', 'AMMO3': '0.080', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.322', 'HITCOUNT': '0.520', 'WEAPON3': '0.600', 'ARMOR': '0.877', 'weapon2': '1.270', 'weapon3': '1.488', 'DAMAGECOUNT': '1.563', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:00,627][2409469] DAMAGECOUNT value on done: 3438.0
[2023-02-25 12:56:00,628][2409469] Sum rewards: 6.032, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.980', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.048', 'AMMO3': '0.092', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.200', 'HITCOUNT': '0.550', 'WEAPON3': '0.600', 'ARMOR': '0.960', 'weapon3': '1.394', 'weapon2': '1.586', 'DAMAGECOUNT': '2.328', 'FRAGCOUNT': '5.500'}
[2023-02-25 12:56:00,713][2409373] DAMAGECOUNT value on done: 2983.0
[2023-02-25 12:56:00,714][2409373] Sum rewards: 6.880, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.483', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'WEAPON1': '0.040', 'weapon5': '0.050', 'AMMO3': '0.066', 'WEAPON5': '0.100', 'ARMOR': '0.451', 'WEAPON3': '0.500', 'HITCOUNT': '0.590', 'weapon3': '1.336', 'weapon2': '1.476', 'DAMAGECOUNT': '2.283', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:00,794][2409407] DAMAGECOUNT value on done: 3323.0
[2023-02-25 12:56:00,797][2409407] Sum rewards: 2.067, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.626', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO3': '0.078', 'weapon5': '0.094', 'weapon7': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.380', 'WEAPON3': '0.550', 'ARMOR': '0.857', 'weapon3': '1.378', 'weapon2': '1.612', 'DAMAGECOUNT': '1.797', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:00,805][2409596] DAMAGECOUNT value on done: 3021.0
[2023-02-25 12:56:00,808][2409596] Sum rewards: 3.021, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.652', 'AMMO2': '0.018', 'AMMO5': '0.022', 'WEAPON1': '0.040', 'AMMO4': '0.090', 'AMMO3': '0.099', 'weapon5': '0.192', 'WEAPON4': '0.200', 'weapon4': '0.346', 'HITCOUNT': '0.440', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'weapon2': '1.022', 'DAMAGECOUNT': '1.527', 'weapon3': '2.076', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:00,808][2409102] DAMAGECOUNT value on done: 3400.0
[2023-02-25 12:56:00,811][2409102] Sum rewards: 1.313, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.550', 'AMMO5': '0.003', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.122', 'AMMO4': '0.127', 'WEAPON4': '0.300', 'HITCOUNT': '0.470', 'weapon4': '0.542', 'WEAPON3': '0.750', 'weapon3': '1.400', 'weapon2': '1.772', 'DAMAGECOUNT': '1.974', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:01,237][2409103] DAMAGECOUNT value on done: 2774.0
[2023-02-25 12:56:01,238][2409103] Sum rewards: -0.732, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.572', 'AMMO5': '0.013', 'weapon5': '0.014', 'AMMO2': '0.044', 'ARMOR': '0.058', 'AMMO3': '0.101', 'AMMO4': '0.221', 'WEAPON5': '0.250', 'weapon2': '0.352', 'HITCOUNT': '0.480', 'WEAPON4': '0.600', 'WEAPON3': '0.700', 'weapon3': '1.332', 'weapon4': '1.338', 'DAMAGECOUNT': '1.587', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:01,596][2409078] DAMAGECOUNT value on done: 2208.0
[2023-02-25 12:56:01,597][2409078] Sum rewards: 3.930, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.072', 'AMMO5': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'AMMO3': '0.080', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'weapon4': '0.154', 'HITCOUNT': '0.280', 'weapon5': '0.282', 'WEAPON5': '0.300', 'ARMOR': '0.408', 'WEAPON3': '0.500', 'weapon3': '1.328', 'DAMAGECOUNT': '1.557', 'weapon2': '1.620', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:01,728][2409355] DAMAGECOUNT value on done: 2620.0
[2023-02-25 12:56:01,834][2409076] DAMAGECOUNT value on done: 2880.0
[2023-02-25 12:56:01,835][2409076] Sum rewards: 6.991, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.515', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO3': '0.101', 'weapon5': '0.226', 'WEAPON5': '0.300', 'HITCOUNT': '0.370', 'ARMOR': '0.445', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.470', 'weapon3': '1.492', 'weapon2': '1.682', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:56:01,887][2409074] Updated weights for policy 0, policy_version 13721 (0.0012)
[2023-02-25 12:56:01,907][2409406] DAMAGECOUNT value on done: 2518.0
[2023-02-25 12:56:01,907][2409406] Sum rewards: 4.012, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.035', 'AMMO5': '0.010', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'weapon7': '0.054', 'AMMO3': '0.077', 'AMMO4': '0.109', 'weapon5': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.300', 'ARMOR': '0.436', 'weapon4': '0.458', 'WEAPON3': '0.500', 'weapon2': '1.004', 'weapon3': '1.120', 'DAMAGECOUNT': '1.377', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:02,160][2409105] DAMAGECOUNT value on done: 2706.0
[2023-02-25 12:56:02,161][2409105] Sum rewards: 2.060, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'weapon7': '0.048', 'AMMO3': '0.074', 'weapon5': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.370', 'ARMOR': '0.420', 'WEAPON3': '0.450', 'weapon4': '0.572', 'HEALTH': '0.634', 'weapon3': '1.178', 'weapon2': '1.276', 'DAMAGECOUNT': '1.308', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:02,186][2408954] Fps is (10 sec: 24985.4, 60 sec: 25395.2, 300 sec: 25492.8). Total num frames: 56209408. Throughput: 0: 6333.3. Samples: 14059356. Policy #0 lag: (min: 0.0, avg: 11.4, max: 24.0)
[2023-02-25 12:56:02,186][2408954] Avg episode reward: [(0, '3.785')]
[2023-02-25 12:56:02,238][2409597] DAMAGECOUNT value on done: 2369.0
[2023-02-25 12:56:02,239][2409597] Sum rewards: 10.830, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.908', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO3': '0.072', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.232', 'ARMOR': '0.432', 'WEAPON3': '0.500', 'HITCOUNT': '0.760', 'weapon3': '1.154', 'weapon2': '1.358', 'DAMAGECOUNT': '2.970', 'FRAGCOUNT': '9.000'}
[2023-02-25 12:56:02,372][2409549] DAMAGECOUNT value on done: 3751.0
[2023-02-25 12:56:02,375][2409549] Sum rewards: 5.633, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon7': '0.056', 'AMMO3': '0.060', 'weapon5': '0.064', 'AMMO4': '0.075', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'HEALTH': '0.432', 'weapon4': '0.474', 'HITCOUNT': '0.520', 'weapon3': '1.176', 'weapon2': '1.358', 'DAMAGECOUNT': '2.148', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:56:02,492][2409077] DAMAGECOUNT value on done: 3103.0
[2023-02-25 12:56:02,496][2409077] Sum rewards: 3.086, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'AMMO3': '0.053', 'HEALTH': '0.076', 'WEAPON4': '0.100', 'weapon5': '0.120', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.250', 'WEAPON3': '0.300', 'weapon4': '0.512', 'DAMAGECOUNT': '0.840', 'ARMOR': '0.963', 'weapon3': '1.224', 'weapon2': '1.698', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:02,514][2409486] DAMAGECOUNT value on done: 2765.0
[2023-02-25 12:56:02,515][2409486] Sum rewards: 6.408, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO2': '0.035', 'weapon5': '0.036', 'AMMO3': '0.131', 'AMMO4': '0.174', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'HEALTH': '0.414', 'HITCOUNT': '0.620', 'WEAPON3': '0.700', 'weapon4': '0.716', 'weapon2': '0.992', 'weapon3': '1.684', 'DAMAGECOUNT': '2.247', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:56:02,564][2409101] DAMAGECOUNT value on done: 2720.0
[2023-02-25 12:56:02,565][2409101] Sum rewards: 3.374, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.051', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.007', 'weapon5': '0.022', 'AMMO3': '0.057', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.256', 'WEAPON3': '0.450', 'ARMOR': '0.511', 'HITCOUNT': '0.530', 'weapon2': '0.826', 'weapon3': '1.104', 'DAMAGECOUNT': '1.935', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:02,793][2409097] DAMAGECOUNT value on done: 2333.0
[2023-02-25 12:56:02,794][2409097] Sum rewards: 7.596, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.086', 'AMMO5': '0.003', 'AMMO3': '0.030', 'AMMO2': '0.045', 'weapon5': '0.056', 'WEAPON5': '0.100', 'WEAPON3': '0.200', 'weapon7': '0.222', 'AMMO4': '0.223', 'HITCOUNT': '0.250', 'WEAPON4': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'ARMOR': '0.484', 'weapon3': '0.732', 'weapon4': '0.808', 'weapon2': '0.892', 'DAMAGECOUNT': '1.548', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:02,961][2409565] DAMAGECOUNT value on done: 3678.0
[2023-02-25 12:56:02,966][2409565] Sum rewards: 3.991, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.234', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon5': '0.056', 'AMMO4': '0.074', 'AMMO3': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.440', 'ARMOR': '0.487', 'weapon4': '0.488', 'WEAPON3': '0.550', 'weapon2': '1.302', 'weapon3': '1.334', 'DAMAGECOUNT': '1.572', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:56:03,001][2409389] DAMAGECOUNT value on done: 2853.0
[2023-02-25 12:56:03,002][2409389] Sum rewards: 6.365, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.477', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon7': '0.056', 'AMMO3': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'weapon5': '0.202', 'WEAPON5': '0.250', 'weapon4': '0.306', 'ARMOR': '0.400', 'HITCOUNT': '0.540', 'WEAPON3': '0.650', 'weapon2': '1.262', 'weapon3': '1.834', 'DAMAGECOUNT': '2.319', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:03,652][2409074] Updated weights for policy 0, policy_version 13731 (0.0013)
[2023-02-25 12:56:03,782][2409104] DAMAGECOUNT value on done: 2271.0
[2023-02-25 12:56:03,785][2409104] Sum rewards: 2.376, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.220', 'AMMO5': '0.017', 'AMMO2': '0.022', 'WEAPON1': '0.050', 'AMMO4': '0.109', 'AMMO3': '0.115', 'weapon4': '0.240', 'weapon5': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'HITCOUNT': '0.470', 'WEAPON3': '0.900', 'ARMOR': '0.910', 'weapon2': '0.984', 'DAMAGECOUNT': '1.959', 'weapon3': '2.078', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:03,848][2409405] DAMAGECOUNT value on done: 3131.0
[2023-02-25 12:56:03,850][2409405] Sum rewards: 3.017, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.494', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.039', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.099', 'AMMO4': '0.196', 'WEAPON4': '0.350', 'HITCOUNT': '0.440', 'WEAPON3': '0.600', 'ARMOR': '0.887', 'weapon4': '0.894', 'weapon3': '1.240', 'weapon2': '1.506', 'DAMAGECOUNT': '1.635', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:03,880][2409866] DAMAGECOUNT value on done: 2423.0
[2023-02-25 12:56:03,884][2409866] Sum rewards: -0.159, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.310', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon7': '0.042', 'AMMO4': '0.073', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'HITCOUNT': '0.290', 'WEAPON4': '0.400', 'WEAPON3': '0.650', 'weapon4': '0.664', 'ARMOR': '0.941', 'DAMAGECOUNT': '1.131', 'weapon3': '1.140', 'weapon2': '1.332', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:04,170][2409096] DAMAGECOUNT value on done: 2608.0
[2023-02-25 12:56:04,171][2409096] Sum rewards: 5.467, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.811', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.080', 'AMMO4': '0.089', 'AMMO3': '0.111', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon4': '0.448', 'HITCOUNT': '0.450', 'WEAPON3': '0.650', 'weapon2': '1.054', 'weapon3': '1.512', 'DAMAGECOUNT': '2.163', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:04,207][2409485] DAMAGECOUNT value on done: 2601.0
[2023-02-25 12:56:04,211][2409485] Sum rewards: 6.110, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.860', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'AMMO3': '0.050', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'WEAPON3': '0.400', 'HITCOUNT': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.676', 'weapon2': '0.690', 'weapon3': '1.152', 'DAMAGECOUNT': '1.914', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:04,299][2409469] DAMAGECOUNT value on done: 2793.0
[2023-02-25 12:56:04,302][2409469] Sum rewards: 0.306, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.000', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO2': '0.044', 'AMMO3': '0.117', 'weapon5': '0.186', 'AMMO4': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'ARMOR': '0.448', 'HITCOUNT': '0.500', 'weapon4': '0.744', 'WEAPON3': '0.800', 'weapon2': '0.810', 'DAMAGECOUNT': '1.719', 'weapon3': '1.780', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:04,432][2409075] DAMAGECOUNT value on done: 1863.0
[2023-02-25 12:56:04,435][2409075] Sum rewards: 2.808, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.705', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.013', 'AMMO3': '0.055', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'weapon7': '0.142', 'WEAPON4': '0.200', 'HITCOUNT': '0.220', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.300', 'ARMOR': '0.511', 'DAMAGECOUNT': '0.606', 'weapon2': '0.684', 'weapon4': '0.760', 'weapon3': '0.854', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:04,453][2409102] DAMAGECOUNT value on done: 2666.0
[2023-02-25 12:56:04,454][2409102] Sum rewards: 5.175, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '0.002', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'ARMOR': '0.040', 'weapon7': '0.046', 'AMMO3': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.151', 'WEAPON4': '0.250', 'weapon4': '0.334', 'HITCOUNT': '0.450', 'WEAPON3': '0.450', 'weapon3': '1.366', 'weapon2': '1.844', 'DAMAGECOUNT': '1.959', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:04,456][2409548] DAMAGECOUNT value on done: 2382.0
[2023-02-25 12:56:04,456][2409548] Sum rewards: 1.131, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.240', 'AMMO5': '0.009', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'AMMO4': '0.078', 'AMMO3': '0.085', 'weapon5': '0.140', 'WEAPON5': '0.200', 'HITCOUNT': '0.390', 'WEAPON4': '0.450', 'ARMOR': '0.469', 'weapon2': '0.544', 'WEAPON3': '0.600', 'weapon4': '0.922', 'DAMAGECOUNT': '1.314', 'weapon3': '1.374', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:04,531][2409407] DAMAGECOUNT value on done: 3505.0
[2023-02-25 12:56:04,534][2409407] Sum rewards: 3.885, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.638', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO3': '0.094', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'WEAPON4': '0.400', 'HITCOUNT': '0.420', 'ARMOR': '0.568', 'WEAPON3': '0.650', 'weapon4': '0.676', 'weapon2': '1.234', 'weapon3': '1.620', 'DAMAGECOUNT': '2.148', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:04,655][2409596] DAMAGECOUNT value on done: 2442.0
[2023-02-25 12:56:04,656][2409596] Sum rewards: -0.303, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.932', 'AMMO5': '0.015', 'weapon5': '0.028', 'ARMOR': '0.032', 'AMMO2': '0.035', 'AMMO3': '0.108', 'AMMO4': '0.176', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.510', 'WEAPON4': '0.650', 'weapon2': '0.926', 'weapon4': '1.124', 'weapon3': '1.268', 'DAMAGECOUNT': '1.707', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:04,736][2409100] DAMAGECOUNT value on done: 2553.0
[2023-02-25 12:56:04,739][2409100] Sum rewards: 3.877, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.946', 'ARMOR': '0.008', 'AMMO5': '0.012', 'weapon5': '0.018', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon7': '0.066', 'AMMO3': '0.077', 'AMMO4': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.360', 'WEAPON3': '0.450', 'weapon4': '0.498', 'weapon2': '1.074', 'DAMAGECOUNT': '1.248', 'weapon3': '1.636', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:04,796][2409373] DAMAGECOUNT value on done: 2932.0
[2023-02-25 12:56:04,799][2409373] Sum rewards: 5.922, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.817', 'AMMO2': '0.006', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.031', 'AMMO3': '0.076', 'weapon5': '0.096', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.450', 'weapon4': '0.486', 'WEAPON3': '0.650', 'weapon2': '0.884', 'weapon3': '1.734', 'DAMAGECOUNT': '2.229', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:05,213][2409074] Updated weights for policy 0, policy_version 13741 (0.0013)
[2023-02-25 12:56:05,219][2409103] DAMAGECOUNT value on done: 3771.0
[2023-02-25 12:56:05,219][2409103] Sum rewards: 1.771, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.052', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'ARMOR': '0.040', 'AMMO3': '0.065', 'AMMO4': '0.118', 'weapon5': '0.152', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'WEAPON4': '0.500', 'HITCOUNT': '0.530', 'weapon4': '0.572', 'weapon3': '1.196', 'weapon2': '1.576', 'DAMAGECOUNT': '2.472', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:05,448][2409355] DAMAGECOUNT value on done: 2530.0
[2023-02-25 12:56:05,449][2409355] Sum rewards: 2.193, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.410', 'AMMO5': '0.009', 'AMMO2': '0.014', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.058', 'AMMO4': '0.070', 'weapon7': '0.102', 'weapon5': '0.128', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.268', 'HITCOUNT': '0.310', 'WEAPON3': '0.350', 'weapon3': '0.796', 'weapon2': '1.068', 'DAMAGECOUNT': '1.089', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:05,626][2409406] DAMAGECOUNT value on done: 2731.0
[2023-02-25 12:56:05,627][2409406] Sum rewards: 2.854, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.798', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.083', 'AMMO3': '0.102', 'WEAPON4': '0.250', 'HITCOUNT': '0.340', 'weapon4': '0.614', 'WEAPON3': '0.650', 'weapon2': '1.076', 'weapon3': '1.206', 'DAMAGECOUNT': '1.905', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:05,799][2409079] DAMAGECOUNT value on done: 2644.0
[2023-02-25 12:56:05,802][2409079] Sum rewards: 3.434, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.914', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.080', 'weapon4': '0.220', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'HITCOUNT': '0.480', 'ARMOR': '0.912', 'weapon3': '1.404', 'weapon2': '1.782', 'DAMAGECOUNT': '1.845', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:56:05,803][2409076] DAMAGECOUNT value on done: 2967.0
[2023-02-25 12:56:05,807][2409076] Sum rewards: 7.374, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.289', 'AMMO5': '0.017', 'weapon7': '0.018', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'AMMO3': '0.085', 'AMMO4': '0.118', 'weapon5': '0.194', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.304', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.560', 'weapon2': '1.554', 'weapon3': '1.654', 'DAMAGECOUNT': '2.145', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:56:05,857][2409078] DAMAGECOUNT value on done: 3252.0
[2023-02-25 12:56:05,858][2409078] Sum rewards: 7.048, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.470', 'AMMO5': '0.003', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.014', 'weapon5': '0.062', 'AMMO3': '0.069', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.236', 'HITCOUNT': '0.400', 'WEAPON3': '0.450', 'ARMOR': '0.452', 'weapon3': '1.270', 'DAMAGECOUNT': '1.287', 'weapon2': '1.562', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:06,180][2409105] DAMAGECOUNT value on done: 2910.0
[2023-02-25 12:56:06,181][2409105] Sum rewards: 1.189, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.292', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'weapon4': '0.012', 'AMMO5': '0.012', 'weapon7': '0.032', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.106', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon5': '0.260', 'WEAPON5': '0.300', 'HITCOUNT': '0.610', 'WEAPON3': '0.800', 'weapon2': '0.974', 'weapon3': '1.832', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.445'}
[2023-02-25 12:56:06,189][2409549] DAMAGECOUNT value on done: 2678.0
[2023-02-25 12:56:06,190][2409549] Sum rewards: 4.393, reward structure: {'DEATHCOUNT': '-6.750', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'AMMO3': '0.090', 'AMMO4': '0.103', 'weapon4': '0.234', 'WEAPON3': '0.450', 'HITCOUNT': '0.530', 'ARMOR': '0.800', 'HEALTH': '0.949', 'weapon3': '1.372', 'DAMAGECOUNT': '1.680', 'weapon2': '1.854', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:06,232][2409077] DAMAGECOUNT value on done: 2441.0
[2023-02-25 12:56:06,233][2409077] Sum rewards: 0.847, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.230', 'AMMO2': '0.005', 'AMMO5': '0.015', 'AMMO4': '0.023', 'weapon7': '0.046', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.220', 'HITCOUNT': '0.240', 'WEAPON5': '0.400', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.600', 'ARMOR': '0.827', 'weapon2': '0.864', 'DAMAGECOUNT': '1.140', 'weapon3': '1.444'}
[2023-02-25 12:56:06,234][2409486] DAMAGECOUNT value on done: 3263.0
[2023-02-25 12:56:06,237][2409486] Sum rewards: 1.431, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.268', 'AMMO5': '0.025', 'AMMO2': '0.038', 'weapon5': '0.094', 'weapon4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'AMMO4': '0.192', 'HITCOUNT': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'ARMOR': '0.899', 'DAMAGECOUNT': '1.467', 'weapon2': '1.548', 'weapon3': '1.612', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:06,244][2409597] DAMAGECOUNT value on done: 3106.0
[2023-02-25 12:56:06,245][2409597] Sum rewards: 3.173, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.102', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.039', 'WEAPON1': '0.040', 'AMMO3': '0.093', 'weapon5': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.330', 'ARMOR': '0.481', 'weapon4': '0.598', 'WEAPON3': '0.600', 'weapon2': '1.264', 'DAMAGECOUNT': '1.500', 'weapon3': '1.506', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:06,377][2409097] DAMAGECOUNT value on done: 3514.0
[2023-02-25 12:56:06,380][2409097] Sum rewards: 5.518, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.824', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.063', 'weapon7': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.122', 'WEAPON4': '0.200', 'weapon5': '0.200', 'HITCOUNT': '0.280', 'WEAPON5': '0.350', 'ARMOR': '0.408', 'weapon4': '0.570', 'WEAPON3': '0.900', 'weapon2': '0.932', 'weapon3': '1.748', 'DAMAGECOUNT': '2.394', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:56:06,388][2409101] DAMAGECOUNT value on done: 2407.0
[2023-02-25 12:56:06,391][2409101] Sum rewards: 6.647, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.880', 'AMMO5': '0.012', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'weapon7': '0.068', 'weapon5': '0.072', 'AMMO3': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.113', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'HITCOUNT': '0.450', 'WEAPON3': '0.600', 'weapon4': '0.714', 'ARMOR': '0.884', 'weapon2': '1.180', 'weapon3': '1.558', 'DAMAGECOUNT': '1.569', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:06,544][2409565] DAMAGECOUNT value on done: 2454.0
[2023-02-25 12:56:06,690][2409074] Updated weights for policy 0, policy_version 13751 (0.0012)
[2023-02-25 12:56:06,694][2409389] DAMAGECOUNT value on done: 2882.0
[2023-02-25 12:56:06,695][2409389] Sum rewards: 3.855, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'AMMO3': '0.050', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.420', 'weapon4': '0.542', 'HEALTH': '0.622', 'weapon3': '0.736', 'weapon2': '1.332', 'DAMAGECOUNT': '1.473', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:07,186][2408954] Fps is (10 sec: 24166.3, 60 sec: 25258.7, 300 sec: 25450.8). Total num frames: 56328192. Throughput: 0: 6328.8. Samples: 14078328. Policy #0 lag: (min: 0.0, avg: 14.1, max: 25.0)
[2023-02-25 12:56:07,186][2408954] Avg episode reward: [(0, '3.633')]
[2023-02-25 12:56:07,409][2409104] DAMAGECOUNT value on done: 2273.0
[2023-02-25 12:56:07,410][2409104] Sum rewards: 1.366, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.880', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.106', 'WEAPON4': '0.200', 'HITCOUNT': '0.350', 'weapon4': '0.490', 'WEAPON3': '0.550', 'weapon3': '0.788', 'ARMOR': '0.850', 'DAMAGECOUNT': '1.200', 'weapon2': '1.326', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:07,639][2409866] DAMAGECOUNT value on done: 3037.0
[2023-02-25 12:56:07,643][2409866] Sum rewards: 2.080, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.035', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'AMMO3': '0.087', 'weapon5': '0.138', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.280', 'weapon4': '0.362', 'WEAPON3': '0.600', 'weapon2': '0.650', 'weapon3': '1.376', 'DAMAGECOUNT': '1.557', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:07,769][2409485] DAMAGECOUNT value on done: 2483.0
[2023-02-25 12:56:07,773][2409485] Sum rewards: 2.268, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.355', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'weapon5': '0.064', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.250', 'ARMOR': '0.420', 'weapon4': '0.436', 'DAMAGECOUNT': '0.825', 'weapon3': '0.850', 'weapon2': '1.516', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:07,811][2409033] Signal inference workers to stop experience collection... (1700 times)
[2023-02-25 12:56:07,812][2409033] Signal inference workers to resume experience collection... (1700 times)
[2023-02-25 12:56:07,841][2409074] InferenceWorker_p0-w0: stopping experience collection (1700 times)
[2023-02-25 12:56:07,841][2409074] InferenceWorker_p0-w0: resuming experience collection (1700 times)
[2023-02-25 12:56:07,995][2409074] Updated weights for policy 0, policy_version 13761 (0.0012)
[2023-02-25 12:56:08,089][2409075] DAMAGECOUNT value on done: 2064.0
[2023-02-25 12:56:08,090][2409075] Sum rewards: 5.432, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.844', 'AMMO4': '-0.086', 'AMMO2': '-0.017', 'AMMO5': '0.010', 'AMMO3': '0.020', 'weapon7': '0.058', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.300', 'HITCOUNT': '0.330', 'weapon3': '0.498', 'ARMOR': '0.869', 'DAMAGECOUNT': '1.104', 'weapon2': '1.600', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:08,165][2409405] DAMAGECOUNT value on done: 3622.0
[2023-02-25 12:56:08,166][2409405] Sum rewards: 4.070, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.145', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon5': '0.204', 'weapon4': '0.234', 'WEAPON5': '0.250', 'HITCOUNT': '0.380', 'WEAPON3': '0.550', 'weapon3': '1.082', 'ARMOR': '1.296', 'DAMAGECOUNT': '1.620', 'weapon2': '1.626', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:08,283][2409596] DAMAGECOUNT value on done: 2111.0
[2023-02-25 12:56:08,284][2409596] Sum rewards: 4.228, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.067', 'AMMO4': '0.070', 'weapon7': '0.078', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HEALTH': '0.226', 'weapon4': '0.246', 'HITCOUNT': '0.260', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'weapon3': '0.990', 'DAMAGECOUNT': '1.146', 'weapon2': '1.242', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:08,348][2409407] DAMAGECOUNT value on done: 2523.0
[2023-02-25 12:56:08,351][2409407] Sum rewards: -0.393, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.480', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'AMMO4': '0.113', 'weapon5': '0.126', 'AMMO3': '0.132', 'WEAPON4': '0.200', 'HITCOUNT': '0.380', 'WEAPON5': '0.400', 'weapon4': '0.406', 'WEAPON3': '0.900', 'weapon2': '1.026', 'DAMAGECOUNT': '1.308', 'weapon3': '2.012', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:08,522][2409102] DAMAGECOUNT value on done: 3514.0
[2023-02-25 12:56:08,523][2409102] Sum rewards: 3.100, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.372', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.064', 'AMMO4': '0.072', 'AMMO3': '0.098', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.460', 'HITCOUNT': '0.520', 'weapon4': '0.626', 'WEAPON3': '0.700', 'weapon2': '1.244', 'weapon3': '1.432', 'DAMAGECOUNT': '2.163', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:08,747][2409103] DAMAGECOUNT value on done: 3535.0
[2023-02-25 12:56:08,748][2409103] Sum rewards: 12.093, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.046', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.020', 'weapon7': '0.048', 'AMMO4': '0.054', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.498', 'HITCOUNT': '0.660', 'weapon3': '1.290', 'weapon2': '1.298', 'DAMAGECOUNT': '2.835', 'FRAGCOUNT': '9.000'}
[2023-02-25 12:56:08,874][2409548] DAMAGECOUNT value on done: 2589.0
[2023-02-25 12:56:08,877][2409548] Sum rewards: 1.142, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.990', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'weapon7': '0.056', 'AMMO3': '0.092', 'AMMO4': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.450', 'HITCOUNT': '0.590', 'WEAPON3': '0.650', 'weapon4': '0.700', 'weapon2': '1.212', 'weapon3': '1.396', 'DAMAGECOUNT': '1.758', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:08,945][2409096] DAMAGECOUNT value on done: 2407.0
[2023-02-25 12:56:08,947][2409096] Sum rewards: 3.898, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'ARMOR': '0.060', 'AMMO3': '0.089', 'weapon5': '0.110', 'AMMO4': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.280', 'weapon4': '0.324', 'HEALTH': '0.350', 'WEAPON3': '0.500', 'weapon2': '1.256', 'DAMAGECOUNT': '1.353', 'weapon3': '1.670', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:08,980][2409373] DAMAGECOUNT value on done: 3121.0
[2023-02-25 12:56:08,984][2409373] Sum rewards: 8.395, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.540', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO3': '0.050', 'AMMO4': '0.065', 'weapon7': '0.116', 'WEAPON5': '0.200', 'weapon5': '0.228', 'WEAPON3': '0.350', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'AMMO6': '0.420', 'AMMO7': '0.420', 'HITCOUNT': '0.440', 'WEAPON7': '0.500', 'weapon4': '0.770', 'weapon2': '0.866', 'weapon3': '1.046', 'DAMAGECOUNT': '3.441', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:09,046][2409469] DAMAGECOUNT value on done: 2363.0
[2023-02-25 12:56:09,056][2409469] Sum rewards: 5.511, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO3': '0.040', 'AMMO4': '0.040', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon7': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HEALTH': '0.224', 'WEAPON3': '0.250', 'HITCOUNT': '0.280', 'weapon4': '0.454', 'weapon3': '0.708', 'weapon2': '0.802', 'DAMAGECOUNT': '0.957', 'ARMOR': '1.739', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:09,103][2409100] DAMAGECOUNT value on done: 2219.0
[2023-02-25 12:56:09,105][2409100] Sum rewards: 5.585, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.805', 'AMMO2': '0.008', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.039', 'AMMO3': '0.087', 'weapon5': '0.122', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.450', 'HITCOUNT': '0.570', 'WEAPON3': '0.750', 'ARMOR': '0.913', 'weapon2': '1.370', 'DAMAGECOUNT': '1.539', 'weapon3': '1.608', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:09,384][2409355] DAMAGECOUNT value on done: 2841.0
[2023-02-25 12:56:09,385][2409355] Sum rewards: 3.473, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.938', 'AMMO4': '-0.056', 'AMMO2': '-0.011', 'AMMO5': '0.012', 'weapon5': '0.078', 'AMMO3': '0.096', 'WEAPON5': '0.300', 'HITCOUNT': '0.640', 'WEAPON3': '0.650', 'ARMOR': '0.856', 'weapon3': '1.448', 'weapon2': '2.042', 'DAMAGECOUNT': '2.106', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:09,659][2409079] DAMAGECOUNT value on done: 2410.0
[2023-02-25 12:56:09,661][2409079] Sum rewards: 0.816, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.560', 'AMMO2': '0.009', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.046', 'AMMO3': '0.100', 'weapon5': '0.126', 'WEAPON4': '0.150', 'weapon4': '0.194', 'WEAPON5': '0.300', 'HITCOUNT': '0.320', 'ARMOR': '0.488', 'WEAPON3': '0.700', 'weapon2': '1.208', 'DAMAGECOUNT': '1.386', 'weapon3': '1.796', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:09,716][2409406] DAMAGECOUNT value on done: 3165.0
[2023-02-25 12:56:09,717][2409406] Sum rewards: 3.144, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.785', 'weapon7': '0.002', 'AMMO2': '0.002', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO4': '0.012', 'AMMO3': '0.069', 'weapon5': '0.108', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.274', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'weapon3': '1.274', 'weapon2': '1.678', 'DAMAGECOUNT': '2.214', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:09,933][2409105] DAMAGECOUNT value on done: 3481.0
[2023-02-25 12:56:09,934][2409105] Sum rewards: 8.770, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.400', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.088', 'AMMO4': '0.094', 'weapon5': '0.104', 'WEAPON5': '0.150', 'weapon4': '0.256', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.720', 'weapon2': '1.338', 'weapon3': '1.642', 'DAMAGECOUNT': '2.682', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:56:09,959][2409078] DAMAGECOUNT value on done: 2744.0
[2023-02-25 12:56:09,962][2409078] Sum rewards: 0.891, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.563', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO3': '0.129', 'WEAPON4': '0.150', 'weapon5': '0.196', 'weapon4': '0.212', 'HITCOUNT': '0.380', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'ARMOR': '0.904', 'weapon2': '1.124', 'weapon3': '1.476', 'DAMAGECOUNT': '2.028', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:56:09,963][2409597] DAMAGECOUNT value on done: 2715.0
[2023-02-25 12:56:09,964][2409597] Sum rewards: 4.759, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.224', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'AMMO3': '0.073', 'weapon5': '0.210', 'HITCOUNT': '0.240', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'WEAPON5': '0.550', 'weapon3': '1.270', 'DAMAGECOUNT': '1.530', 'weapon2': '1.652', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:10,000][2409076] DAMAGECOUNT value on done: 2407.0
[2023-02-25 12:56:10,004][2409097] DAMAGECOUNT value on done: 2121.0
[2023-02-25 12:56:10,004][2409076] Sum rewards: 3.607, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.186', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.076', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.318', 'HITCOUNT': '0.360', 'ARMOR': '0.408', 'WEAPON3': '0.450', 'weapon3': '1.272', 'DAMAGECOUNT': '1.416', 'weapon2': '1.712', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:10,006][2409097] Sum rewards: 5.909, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.765', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'weapon5': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.130', 'WEAPON5': '0.250', 'HITCOUNT': '0.350', 'ARMOR': '0.500', 'WEAPON3': '0.750', 'weapon2': '1.524', 'DAMAGECOUNT': '1.728', 'weapon3': '1.908', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:56:10,190][2409074] Updated weights for policy 0, policy_version 13771 (0.0012)
[2023-02-25 12:56:10,224][2409486] DAMAGECOUNT value on done: 2782.0
[2023-02-25 12:56:10,225][2409486] Sum rewards: 6.944, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.020', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.015', 'WEAPON4': '0.050', 'WEAPON1': '0.050', 'weapon4': '0.110', 'AMMO3': '0.123', 'weapon5': '0.160', 'WEAPON5': '0.400', 'HITCOUNT': '0.620', 'WEAPON3': '0.800', 'ARMOR': '0.851', 'weapon3': '1.642', 'weapon2': '1.758', 'DAMAGECOUNT': '2.640', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:56:10,405][2409077] DAMAGECOUNT value on done: 2188.0
[2023-02-25 12:56:10,409][2409077] Sum rewards: 0.946, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.746', 'AMMO5': '0.024', 'WEAPON1': '0.030', 'AMMO2': '0.065', 'AMMO3': '0.119', 'weapon5': '0.216', 'AMMO4': '0.325', 'HITCOUNT': '0.440', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '0.700', 'weapon4': '0.774', 'weapon2': '0.876', 'ARMOR': '1.308', 'weapon3': '1.536', 'DAMAGECOUNT': '2.079', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:10,489][2409389] DAMAGECOUNT value on done: 2902.0
[2023-02-25 12:56:10,490][2409389] Sum rewards: 4.541, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.866', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.037', 'weapon7': '0.072', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'HITCOUNT': '0.460', 'WEAPON3': '0.550', 'weapon4': '0.622', 'weapon3': '0.974', 'ARMOR': '1.319', 'weapon2': '1.538', 'DAMAGECOUNT': '2.085', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:10,622][2409549] DAMAGECOUNT value on done: 3134.0
[2023-02-25 12:56:10,623][2409549] Sum rewards: 2.096, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.048', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO5': '0.017', 'weapon7': '0.048', 'AMMO4': '0.079', 'AMMO3': '0.087', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.176', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'HITCOUNT': '0.360', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.564', 'ARMOR': '0.925', 'weapon3': '1.304', 'weapon2': '1.502', 'DAMAGECOUNT': '1.866', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:10,627][2409565] DAMAGECOUNT value on done: 2448.0
[2023-02-25 12:56:10,628][2409565] Sum rewards: 3.370, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.756', 'AMMO2': '0.004', 'AMMO5': '0.011', 'AMMO4': '0.019', 'weapon5': '0.038', 'AMMO3': '0.068', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.344', 'ARMOR': '0.424', 'HITCOUNT': '0.430', 'WEAPON3': '0.500', 'weapon2': '0.950', 'weapon3': '1.124', 'DAMAGECOUNT': '1.464', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:10,832][2409101] DAMAGECOUNT value on done: 3508.0
[2023-02-25 12:56:10,835][2409101] Sum rewards: 4.882, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.719', 'AMMO2': '0.003', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.014', 'AMMO3': '0.043', 'WEAPON4': '0.100', 'weapon7': '0.152', 'weapon5': '0.198', 'weapon4': '0.222', 'HITCOUNT': '0.230', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'WEAPON7': '0.400', 'ARMOR': '0.454', 'weapon3': '0.924', 'weapon2': '1.028', 'DAMAGECOUNT': '1.533', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:11,237][2409104] DAMAGECOUNT value on done: 1826.0
[2023-02-25 12:56:11,240][2409104] Sum rewards: -0.777, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.664', 'AMMO2': '0.007', 'AMMO5': '0.017', 'AMMO4': '0.033', 'WEAPON1': '0.040', 'weapon7': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.126', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.322', 'WEAPON5': '0.350', 'HITCOUNT': '0.390', 'WEAPON3': '0.950', 'weapon2': '1.114', 'ARMOR': '1.356', 'DAMAGECOUNT': '1.359', 'weapon3': '1.756', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:11,421][2409485] DAMAGECOUNT value on done: 2682.0
[2023-02-25 12:56:11,422][2409485] Sum rewards: 1.148, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.602', 'AMMO5': '0.003', 'AMMO2': '0.028', 'AMMO3': '0.030', 'weapon7': '0.054', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.138', 'WEAPON7': '0.200', 'WEAPON3': '0.200', 'HITCOUNT': '0.250', 'WEAPON4': '0.300', 'weapon3': '0.622', 'weapon2': '0.684', 'ARMOR': '0.804', 'weapon4': '0.818', 'DAMAGECOUNT': '0.879', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:56:11,559][2409074] Updated weights for policy 0, policy_version 13781 (0.0012)
[2023-02-25 12:56:11,779][2409866] DAMAGECOUNT value on done: 3515.0
[2023-02-25 12:56:11,780][2409866] Sum rewards: 4.861, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.388', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.054', 'weapon7': '0.056', 'AMMO3': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.270', 'WEAPON5': '0.300', 'weapon4': '0.328', 'WEAPON3': '0.450', 'weapon3': '1.370', 'weapon2': '1.612', 'DAMAGECOUNT': '2.208', 'FRAGCOUNT': '4.500'}
[2023-02-25 12:56:11,995][2409407] DAMAGECOUNT value on done: 3537.0
[2023-02-25 12:56:11,996][2409407] Sum rewards: 12.695, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.716', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.080', 'AMMO3': '0.107', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.314', 'WEAPON3': '0.750', 'HITCOUNT': '0.810', 'ARMOR': '0.897', 'weapon2': '1.576', 'weapon3': '1.622', 'DAMAGECOUNT': '3.252', 'FRAGCOUNT': '11.000'}
[2023-02-25 12:56:12,045][2409405] DAMAGECOUNT value on done: 2966.0
[2023-02-25 12:56:12,046][2409405] Sum rewards: 1.560, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.886', 'AMMO2': '0.008', 'AMMO5': '0.024', 'WEAPON1': '0.030', 'AMMO4': '0.041', 'weapon7': '0.048', 'AMMO3': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.194', 'weapon4': '0.266', 'ARMOR': '0.453', 'HITCOUNT': '0.490', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'weapon2': '1.320', 'weapon3': '1.498', 'DAMAGECOUNT': '1.686', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:12,076][2409075] DAMAGECOUNT value on done: 2143.0
[2023-02-25 12:56:12,077][2409075] Sum rewards: 9.113, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.994', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'weapon5': '0.006', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO3': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.164', 'ARMOR': '0.400', 'HITCOUNT': '0.500', 'WEAPON3': '0.550', 'weapon3': '1.356', 'weapon2': '1.550', 'DAMAGECOUNT': '1.785', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:56:12,128][2409596] DAMAGECOUNT value on done: 2630.0
[2023-02-25 12:56:12,128][2409596] Sum rewards: 0.431, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.122', 'AMMO5': '0.015', 'weapon5': '0.020', 'AMMO2': '0.034', 'WEAPON1': '0.040', 'weapon7': '0.070', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.122', 'AMMO4': '0.172', 'WEAPON5': '0.300', 'HITCOUNT': '0.340', 'WEAPON4': '0.350', 'weapon4': '0.626', 'weapon2': '0.714', 'WEAPON3': '0.750', 'ARMOR': '0.935', 'DAMAGECOUNT': '1.191', 'weapon3': '1.824', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:12,180][2409102] DAMAGECOUNT value on done: 3097.0
[2023-02-25 12:56:12,183][2409102] Sum rewards: 5.405, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.746', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon7': '0.066', 'AMMO3': '0.095', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'weapon5': '0.198', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.402', 'ARMOR': '0.478', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'weapon2': '1.118', 'weapon3': '1.664', 'DAMAGECOUNT': '1.791', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:12,186][2408954] Fps is (10 sec: 25804.6, 60 sec: 25463.4, 300 sec: 25547.9). Total num frames: 56467456. Throughput: 0: 6315.0. Samples: 14115876. Policy #0 lag: (min: 0.0, avg: 14.1, max: 25.0)
[2023-02-25 12:56:12,186][2408954] Avg episode reward: [(0, '3.852')]
[2023-02-25 12:56:12,498][2409548] DAMAGECOUNT value on done: 2613.0
[2023-02-25 12:56:12,501][2409548] Sum rewards: 6.948, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'weapon7': '0.050', 'AMMO3': '0.061', 'AMMO4': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'HEALTH': '0.131', 'WEAPON3': '0.350', 'weapon4': '0.438', 'HITCOUNT': '0.510', 'ARMOR': '0.899', 'weapon3': '1.060', 'weapon2': '1.736', 'DAMAGECOUNT': '2.070', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:12,665][2409103] DAMAGECOUNT value on done: 2794.0
[2023-02-25 12:56:12,669][2409103] Sum rewards: 2.414, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'weapon7': '0.050', 'AMMO3': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.156', 'weapon5': '0.182', 'WEAPON5': '0.200', 'weapon4': '0.354', 'HITCOUNT': '0.440', 'WEAPON3': '0.600', 'HEALTH': '0.706', 'ARMOR': '0.804', 'weapon3': '1.548', 'weapon2': '1.562', 'DAMAGECOUNT': '1.710', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:12,690][2409100] DAMAGECOUNT value on done: 3024.0
[2023-02-25 12:56:12,690][2409100] Sum rewards: 3.766, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.300', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.055', 'AMMO3': '0.067', 'weapon5': '0.068', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.324', 'HITCOUNT': '0.330', 'ARMOR': '0.412', 'WEAPON3': '0.500', 'weapon2': '1.258', 'weapon3': '1.258', 'DAMAGECOUNT': '1.572', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:12,799][2409096] DAMAGECOUNT value on done: 2042.0
[2023-02-25 12:56:12,802][2409096] Sum rewards: 4.610, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.458', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'weapon7': '0.046', 'WEAPON1': '0.070', 'weapon5': '0.072', 'AMMO3': '0.094', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.272', 'HITCOUNT': '0.430', 'ARMOR': '0.456', 'WEAPON3': '0.700', 'weapon2': '1.310', 'weapon3': '1.484', 'DAMAGECOUNT': '2.220', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:12,848][2409373] DAMAGECOUNT value on done: 2733.0
[2023-02-25 12:56:12,852][2409373] Sum rewards: 1.960, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.046', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.030', 'ARMOR': '0.046', 'weapon5': '0.078', 'AMMO3': '0.082', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'HITCOUNT': '0.390', 'WEAPON4': '0.450', 'WEAPON3': '0.450', 'weapon4': '0.728', 'weapon2': '1.030', 'weapon3': '1.138', 'DAMAGECOUNT': '1.515', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:12,880][2409469] DAMAGECOUNT value on done: 3770.0
[2023-02-25 12:56:12,883][2409469] Sum rewards: 8.379, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.230', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'AMMO3': '0.070', 'weapon5': '0.118', 'WEAPON5': '0.150', 'WEAPON3': '0.450', 'HITCOUNT': '0.650', 'weapon2': '1.672', 'weapon3': '1.720', 'DAMAGECOUNT': '2.550', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:13,321][2409079] DAMAGECOUNT value on done: 3103.0
[2023-02-25 12:56:13,325][2409074] Updated weights for policy 0, policy_version 13791 (0.0012)
[2023-02-25 12:56:13,334][2409079] Sum rewards: -4.197, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.056', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.033', 'ARMOR': '0.036', 'weapon5': '0.040', 'AMMO3': '0.125', 'AMMO4': '0.164', 'HITCOUNT': '0.250', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon2': '0.708', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.882', 'FRAGCOUNT': '1.000', 'weapon4': '1.034', 'weapon3': '1.610'}
[2023-02-25 12:56:13,413][2409406] DAMAGECOUNT value on done: 1952.0
[2023-02-25 12:56:13,414][2409406] Sum rewards: 1.850, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.825', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon5': '0.066', 'AMMO3': '0.068', 'AMMO4': '0.103', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.340', 'ARMOR': '0.412', 'WEAPON3': '0.450', 'weapon4': '0.512', 'DAMAGECOUNT': '1.071', 'weapon3': '1.076', 'weapon2': '1.344', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:13,570][2409355] DAMAGECOUNT value on done: 2925.0
[2023-02-25 12:56:13,571][2409355] Sum rewards: 4.995, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.370', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.046', 'AMMO4': '0.082', 'AMMO3': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.530', 'WEAPON3': '0.550', 'HITCOUNT': '0.620', 'weapon3': '0.878', 'weapon2': '1.306', 'DAMAGECOUNT': '2.700', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:13,744][2409078] DAMAGECOUNT value on done: 2787.0
[2023-02-25 12:56:13,745][2409078] Sum rewards: 4.504, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.370', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.020', 'weapon7': '0.038', 'weapon5': '0.048', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.320', 'weapon4': '0.326', 'WEAPON3': '0.500', 'ARMOR': '0.505', 'weapon2': '1.396', 'DAMAGECOUNT': '1.449', 'weapon3': '1.552', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:13,895][2409097] DAMAGECOUNT value on done: 3641.0
[2023-02-25 12:56:13,896][2409097] Sum rewards: 4.812, reward structure: {'DEATHCOUNT': '-6.750', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.023', 'AMMO3': '0.070', 'AMMO4': '0.113', 'weapon5': '0.124', 'WEAPON4': '0.150', 'HEALTH': '0.180', 'WEAPON5': '0.200', 'WEAPON3': '0.400', 'weapon4': '0.552', 'HITCOUNT': '0.600', 'weapon2': '1.390', 'weapon3': '1.620', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:13,945][2409076] DAMAGECOUNT value on done: 2635.0
[2023-02-25 12:56:13,948][2409076] Sum rewards: 1.709, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.055', 'weapon5': '0.060', 'AMMO3': '0.065', 'weapon4': '0.186', 'WEAPON5': '0.200', 'HEALTH': '0.255', 'HITCOUNT': '0.340', 'WEAPON3': '0.400', 'ARMOR': '0.861', 'DAMAGECOUNT': '1.200', 'weapon3': '1.324', 'FRAGCOUNT': '1.500', 'weapon2': '1.932'}
[2023-02-25 12:56:14,004][2409077] DAMAGECOUNT value on done: 2571.0
[2023-02-25 12:56:14,005][2409077] Sum rewards: 3.660, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.336', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.046', 'AMMO3': '0.060', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'weapon7': '0.172', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.250', 'HITCOUNT': '0.260', 'WEAPON4': '0.300', 'WEAPON7': '0.400', 'ARMOR': '0.412', 'weapon4': '0.560', 'weapon3': '0.870', 'DAMAGECOUNT': '1.332', 'weapon2': '1.536', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:14,028][2409105] DAMAGECOUNT value on done: 2439.0
[2023-02-25 12:56:14,029][2409105] Sum rewards: 4.135, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.200', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'weapon5': '0.058', 'AMMO3': '0.074', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'HITCOUNT': '0.440', 'weapon4': '0.442', 'WEAPON3': '0.550', 'weapon2': '0.828', 'ARMOR': '0.901', 'weapon3': '1.250', 'DAMAGECOUNT': '1.506', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:14,069][2409597] DAMAGECOUNT value on done: 3027.0
[2023-02-25 12:56:14,072][2409597] Sum rewards: 10.318, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.715', 'AMMO2': '0.019', 'AMMO5': '0.022', 'ARMOR': '0.048', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO4': '0.096', 'AMMO3': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'HITCOUNT': '0.530', 'weapon4': '0.618', 'WEAPON3': '0.750', 'weapon2': '1.198', 'weapon3': '1.608', 'DAMAGECOUNT': '2.490', 'FRAGCOUNT': '10.000'}
[2023-02-25 12:56:14,280][2409486] DAMAGECOUNT value on done: 2036.0
[2023-02-25 12:56:14,281][2409486] Sum rewards: 1.637, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.132', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO3': '0.042', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.124', 'WEAPON5': '0.200', 'weapon4': '0.220', 'WEAPON3': '0.350', 'HITCOUNT': '0.350', 'ARMOR': '0.840', 'weapon3': '0.934', 'DAMAGECOUNT': '1.500', 'weapon2': '1.776', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:14,573][2409565] DAMAGECOUNT value on done: 2498.0
[2023-02-25 12:56:14,577][2409565] Sum rewards: 4.405, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.312', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'weapon5': '0.052', 'AMMO3': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.177', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'weapon4': '0.446', 'HITCOUNT': '0.560', 'ARMOR': '0.885', 'weapon3': '1.414', 'weapon2': '1.646', 'DAMAGECOUNT': '1.665', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:14,688][2409549] DAMAGECOUNT value on done: 3166.0
[2023-02-25 12:56:14,688][2409549] Sum rewards: 3.714, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.788', 'AMMO2': '0.016', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'AMMO4': '0.078', 'AMMO3': '0.091', 'weapon5': '0.138', 'WEAPON4': '0.200', 'weapon4': '0.252', 'WEAPON5': '0.400', 'HITCOUNT': '0.440', 'WEAPON3': '0.550', 'ARMOR': '0.959', 'weapon3': '1.136', 'weapon2': '1.834', 'DAMAGECOUNT': '2.106', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:14,715][2409389] DAMAGECOUNT value on done: 2666.0
[2023-02-25 12:56:14,716][2409389] Sum rewards: 4.104, reward structure: {'DEATHCOUNT': '-6.750', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'HEALTH': '0.016', 'AMMO2': '0.035', 'AMMO3': '0.104', 'weapon5': '0.138', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.420', 'WEAPON3': '0.550', 'weapon4': '0.684', 'weapon2': '0.768', 'ARMOR': '0.932', 'weapon3': '1.680', 'DAMAGECOUNT': '1.878', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:14,922][2409101] DAMAGECOUNT value on done: 2575.0
[2023-02-25 12:56:14,924][2409101] Sum rewards: -0.293, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.740', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'weapon5': '0.064', 'AMMO3': '0.071', 'weapon7': '0.076', 'AMMO4': '0.079', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.350', 'ARMOR': '0.420', 'weapon4': '0.450', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.500', 'weapon2': '1.022', 'DAMAGECOUNT': '1.080', 'weapon3': '1.132'}
[2023-02-25 12:56:14,936][2409104] DAMAGECOUNT value on done: 3021.0
[2023-02-25 12:56:14,939][2409104] Sum rewards: 3.087, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.990', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.055', 'AMMO3': '0.088', 'weapon5': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.440', 'weapon4': '0.586', 'WEAPON3': '0.600', 'ARMOR': '0.911', 'weapon2': '1.044', 'DAMAGECOUNT': '1.527', 'weapon3': '1.614', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:56:15,047][2409074] Updated weights for policy 0, policy_version 13801 (0.0012)
[2023-02-25 12:56:15,320][2409485] DAMAGECOUNT value on done: 2664.0
[2023-02-25 12:56:15,321][2409485] Sum rewards: 7.398, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.806', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'weapon7': '0.084', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.153', 'weapon5': '0.180', 'WEAPON7': '0.200', 'weapon4': '0.206', 'WEAPON5': '0.350', 'HITCOUNT': '0.650', 'ARMOR': '0.851', 'WEAPON3': '0.950', 'weapon2': '1.012', 'weapon3': '1.950', 'DAMAGECOUNT': '2.013', 'FRAGCOUNT': '10.000'}
[2023-02-25 12:56:15,662][2409866] DAMAGECOUNT value on done: 3286.0
[2023-02-25 12:56:15,663][2409866] Sum rewards: 4.206, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.446', 'AMMO2': '0.009', 'AMMO5': '0.022', 'AMMO4': '0.045', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'weapon5': '0.210', 'weapon4': '0.372', 'WEAPON5': '0.400', 'ARMOR': '0.468', 'HITCOUNT': '0.520', 'WEAPON3': '0.550', 'weapon2': '1.014', 'weapon3': '1.372', 'DAMAGECOUNT': '2.241', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:15,773][2409596] DAMAGECOUNT value on done: 2804.0
[2023-02-25 12:56:15,776][2409596] Sum rewards: 1.048, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.657', 'AMMO2': '0.003', 'AMMO5': '0.009', 'AMMO4': '0.014', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon4': '0.080', 'weapon5': '0.124', 'WEAPON5': '0.200', 'HITCOUNT': '0.370', 'WEAPON3': '0.400', 'weapon3': '1.244', 'ARMOR': '1.335', 'DAMAGECOUNT': '1.536', 'weapon2': '1.760', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:16,070][2409405] DAMAGECOUNT value on done: 3183.0
[2023-02-25 12:56:16,113][2409102] DAMAGECOUNT value on done: 2846.0
[2023-02-25 12:56:16,117][2409102] Sum rewards: 1.361, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.450', 'AMMO5': '0.022', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'weapon4': '0.056', 'AMMO3': '0.075', 'AMMO4': '0.125', 'WEAPON4': '0.200', 'weapon5': '0.218', 'HITCOUNT': '0.360', 'WEAPON5': '0.450', 'ARMOR': '0.456', 'WEAPON3': '0.500', 'weapon2': '1.044', 'DAMAGECOUNT': '1.053', 'FRAGCOUNT': '1.500', 'weapon3': '1.696'}
[2023-02-25 12:56:16,135][2409548] DAMAGECOUNT value on done: 3600.0
[2023-02-25 12:56:16,139][2409548] Sum rewards: 10.585, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.116', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO3': '0.079', 'AMMO4': '0.082', 'weapon7': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.400', 'weapon4': '0.424', 'HITCOUNT': '0.440', 'ARMOR': '0.855', 'weapon3': '1.154', 'weapon2': '1.536', 'DAMAGECOUNT': '2.091', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:56:16,170][2409407] DAMAGECOUNT value on done: 2702.0
[2023-02-25 12:56:16,173][2409407] Sum rewards: 3.344, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.710', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.080', 'AMMO4': '0.114', 'AMMO3': '0.129', 'WEAPON5': '0.150', 'HITCOUNT': '0.280', 'WEAPON4': '0.300', 'weapon4': '0.740', 'WEAPON3': '0.800', 'ARMOR': '0.949', 'weapon3': '1.142', 'weapon2': '1.360', 'DAMAGECOUNT': '1.482', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:16,286][2409100] DAMAGECOUNT value on done: 2786.0
[2023-02-25 12:56:16,287][2409100] Sum rewards: 5.907, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.964', 'AMMO5': '0.007', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'AMMO3': '0.095', 'AMMO4': '0.108', 'weapon5': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.432', 'ARMOR': '0.488', 'HITCOUNT': '0.580', 'WEAPON3': '0.650', 'weapon3': '1.316', 'weapon2': '1.778', 'DAMAGECOUNT': '2.340', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:16,361][2409103] DAMAGECOUNT value on done: 2019.0
[2023-02-25 12:56:16,362][2409103] Sum rewards: 0.782, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.894', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.007', 'weapon4': '0.014', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon5': '0.092', 'AMMO3': '0.096', 'weapon7': '0.096', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'HITCOUNT': '0.410', 'ARMOR': '0.456', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.215', 'weapon3': '1.478', 'weapon2': '1.522', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:16,374][2409074] Updated weights for policy 0, policy_version 13811 (0.0012)
[2023-02-25 12:56:16,394][2409075] DAMAGECOUNT value on done: 2419.0
[2023-02-25 12:56:16,396][2409075] Sum rewards: 5.162, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.733', 'AMMO2': '0.005', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO4': '0.024', 'AMMO3': '0.072', 'WEAPON5': '0.200', 'WEAPON3': '0.500', 'HITCOUNT': '0.530', 'weapon3': '1.216', 'ARMOR': '1.315', 'weapon2': '1.602', 'DAMAGECOUNT': '1.905', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:16,409][2409096] DAMAGECOUNT value on done: 2634.0
[2023-02-25 12:56:16,410][2409096] Sum rewards: 2.991, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.430', 'AMMO5': '0.011', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'AMMO4': '0.065', 'weapon7': '0.090', 'AMMO3': '0.097', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.348', 'HITCOUNT': '0.400', 'ARMOR': '0.404', 'WEAPON3': '0.450', 'weapon3': '1.454', 'weapon2': '1.512', 'DAMAGECOUNT': '1.737', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:16,496][2409469] DAMAGECOUNT value on done: 3733.0
[2023-02-25 12:56:16,497][2409469] Sum rewards: 8.338, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.305', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'WEAPON1': '0.010', 'AMMO5': '0.025', 'WEAPON4': '0.050', 'weapon4': '0.060', 'AMMO3': '0.080', 'weapon5': '0.128', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'HITCOUNT': '0.580', 'ARMOR': '0.921', 'weapon3': '1.592', 'weapon2': '1.674', 'DAMAGECOUNT': '3.111', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:56:16,619][2409373] DAMAGECOUNT value on done: 3103.0
[2023-02-25 12:56:16,619][2409373] Sum rewards: 1.025, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.604', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.023', 'AMMO3': '0.091', 'AMMO4': '0.114', 'weapon5': '0.126', 'WEAPON5': '0.350', 'HITCOUNT': '0.440', 'weapon2': '0.444', 'WEAPON4': '0.450', 'WEAPON3': '0.650', 'weapon4': '0.766', 'DAMAGECOUNT': '1.344', 'weapon3': '1.554', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:17,186][2408954] Fps is (10 sec: 25804.0, 60 sec: 25258.5, 300 sec: 25478.5). Total num frames: 56586240. Throughput: 0: 6309.3. Samples: 14153700. Policy #0 lag: (min: 0.0, avg: 11.0, max: 25.0)
[2023-02-25 12:56:17,187][2408954] Avg episode reward: [(0, '3.724')]
[2023-02-25 12:56:17,192][2409033] Saving /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000013815_56586240.pth...
[2023-02-25 12:56:17,271][2409355] DAMAGECOUNT value on done: 2432.0
[2023-02-25 12:56:17,274][2409355] Sum rewards: 3.142, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.482', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon7': '0.020', 'WEAPON1': '0.050', 'weapon5': '0.054', 'AMMO4': '0.078', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.139', 'WEAPON5': '0.150', 'weapon4': '0.152', 'HITCOUNT': '0.780', 'ARMOR': '0.800', 'WEAPON3': '0.950', 'weapon2': '1.322', 'weapon3': '2.094', 'DAMAGECOUNT': '2.862', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:17,287][2409033] Removing /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000012318_50454528.pth
[2023-02-25 12:56:17,542][2409079] DAMAGECOUNT value on done: 2373.0
[2023-02-25 12:56:17,544][2409079] Sum rewards: 9.197, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.147', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.050', 'AMMO3': '0.085', 'weapon5': '0.156', 'AMMO4': '0.248', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'ARMOR': '0.493', 'WEAPON3': '0.550', 'weapon4': '0.598', 'HITCOUNT': '0.640', 'weapon2': '1.310', 'weapon3': '1.416', 'DAMAGECOUNT': '2.424', 'FRAGCOUNT': '9.000'}
[2023-02-25 12:56:17,600][2409406] DAMAGECOUNT value on done: 1735.0
[2023-02-25 12:56:17,603][2409406] Sum rewards: 1.170, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.820', 'AMMO5': '0.003', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO3': '0.042', 'AMMO4': '0.044', 'weapon5': '0.050', 'WEAPON5': '0.100', 'HITCOUNT': '0.140', 'weapon7': '0.180', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.300', 'WEAPON4': '0.350', 'WEAPON7': '0.400', 'DAMAGECOUNT': '0.408', 'weapon3': '0.596', 'weapon4': '0.700', 'weapon2': '0.716', 'ARMOR': '0.953', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:56:17,703][2409076] DAMAGECOUNT value on done: 2858.0
[2023-02-25 12:56:17,704][2409076] Sum rewards: -0.383, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.512', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.040', 'AMMO4': '0.053', 'weapon5': '0.054', 'AMMO3': '0.091', 'weapon4': '0.120', 'WEAPON4': '0.150', 'HITCOUNT': '0.190', 'WEAPON5': '0.250', 'ARMOR': '0.506', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.104', 'weapon2': '1.486', 'weapon3': '1.664', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:17,852][2409105] DAMAGECOUNT value on done: 3231.0
[2023-02-25 12:56:17,853][2409105] Sum rewards: 8.422, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.430', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon5': '0.056', 'weapon7': '0.072', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.115', 'AMMO4': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.582', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'weapon2': '1.034', 'ARMOR': '1.396', 'weapon3': '1.600', 'DAMAGECOUNT': '2.919', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:56:17,899][2409078] DAMAGECOUNT value on done: 2360.0
[2023-02-25 12:56:17,908][2409078] Sum rewards: 3.611, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.010', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.049', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'HEALTH': '0.137', 'weapon5': '0.188', 'WEAPON5': '0.300', 'HITCOUNT': '0.300', 'weapon4': '0.312', 'WEAPON3': '0.500', 'ARMOR': '0.861', 'weapon2': '1.016', 'weapon3': '1.346', 'DAMAGECOUNT': '1.620', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:17,909][2409074] Updated weights for policy 0, policy_version 13821 (0.0012)
[2023-02-25 12:56:17,939][2409597] DAMAGECOUNT value on done: 3170.0
[2023-02-25 12:56:17,940][2409597] Sum rewards: 8.515, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.204', 'AMMO2': '0.004', 'AMMO5': '0.015', 'AMMO4': '0.020', 'WEAPON1': '0.040', 'AMMO3': '0.083', 'weapon4': '0.084', 'WEAPON4': '0.100', 'weapon5': '0.230', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.570', 'weapon2': '1.616', 'weapon3': '1.662', 'DAMAGECOUNT': '3.744', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:17,945][2409097] DAMAGECOUNT value on done: 3182.0
[2023-02-25 12:56:17,948][2409097] Sum rewards: 4.955, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.870', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon7': '0.050', 'AMMO3': '0.070', 'weapon5': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.125', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.412', 'WEAPON3': '0.450', 'HITCOUNT': '0.610', 'weapon4': '0.724', 'weapon2': '1.058', 'weapon3': '1.110', 'DAMAGECOUNT': '1.845', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:56:17,976][2409486] DAMAGECOUNT value on done: 2310.0
[2023-02-25 12:56:17,977][2409486] Sum rewards: 4.541, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.730', 'AMMO2': '0.004', 'AMMO5': '0.006', 'AMMO4': '0.019', 'WEAPON1': '0.030', 'weapon5': '0.090', 'AMMO3': '0.117', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.284', 'ARMOR': '0.474', 'HITCOUNT': '0.570', 'WEAPON3': '0.800', 'weapon2': '1.428', 'weapon3': '1.542', 'DAMAGECOUNT': '2.007', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:18,192][2409077] DAMAGECOUNT value on done: 3794.0
[2023-02-25 12:56:18,195][2409077] Sum rewards: 4.492, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.906', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'weapon7': '0.056', 'weapon4': '0.058', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.120', 'AMMO3': '0.127', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.420', 'WEAPON3': '0.750', 'ARMOR': '0.918', 'weapon2': '1.196', 'weapon3': '1.736', 'DAMAGECOUNT': '2.142', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:18,481][2409565] DAMAGECOUNT value on done: 2945.0
[2023-02-25 12:56:18,484][2409565] Sum rewards: 3.821, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.905', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON1': '0.040', 'AMMO3': '0.063', 'weapon5': '0.104', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.386', 'WEAPON3': '0.450', 'HITCOUNT': '0.530', 'weapon2': '1.066', 'weapon3': '1.436', 'DAMAGECOUNT': '1.698', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:18,567][2409389] DAMAGECOUNT value on done: 2839.0
[2023-02-25 12:56:18,568][2409389] Sum rewards: 1.178, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.985', 'AMMO2': '0.006', 'AMMO5': '0.021', 'AMMO4': '0.027', 'WEAPON1': '0.050', 'AMMO3': '0.093', 'weapon5': '0.214', 'WEAPON4': '0.250', 'HITCOUNT': '0.370', 'WEAPON5': '0.500', 'weapon4': '0.582', 'WEAPON3': '0.650', 'ARMOR': '0.916', 'weapon2': '1.082', 'weapon3': '1.658', 'DAMAGECOUNT': '1.743', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:56:18,625][2409104] DAMAGECOUNT value on done: 3110.0
[2023-02-25 12:56:18,626][2409104] Sum rewards: 8.558, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.186', 'AMMO2': '0.004', 'AMMO5': '0.012', 'AMMO4': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.060', 'AMMO3': '0.093', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.374', 'HITCOUNT': '0.470', 'WEAPON3': '0.700', 'ARMOR': '0.852', 'weapon2': '1.250', 'weapon3': '1.458', 'DAMAGECOUNT': '2.283', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:56:18,795][2409549] DAMAGECOUNT value on done: 3432.0
[2023-02-25 12:56:18,796][2409549] Sum rewards: 3.891, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.516', 'AMMO2': '0.008', 'AMMO5': '0.008', 'WEAPON1': '0.040', 'AMMO4': '0.042', 'AMMO3': '0.060', 'weapon5': '0.086', 'WEAPON4': '0.200', 'weapon4': '0.230', 'WEAPON5': '0.250', 'HITCOUNT': '0.400', 'WEAPON3': '0.450', 'weapon3': '1.304', 'DAMAGECOUNT': '1.326', 'weapon2': '1.502', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:18,974][2409485] DAMAGECOUNT value on done: 2457.0
[2023-02-25 12:56:18,977][2409485] Sum rewards: 4.167, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.655', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'weapon5': '0.030', 'weapon7': '0.048', 'AMMO3': '0.075', 'AMMO4': '0.089', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.262', 'ARMOR': '0.444', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'weapon2': '0.872', 'weapon3': '1.298', 'DAMAGECOUNT': '1.896', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:19,107][2409101] DAMAGECOUNT value on done: 3020.0
[2023-02-25 12:56:19,108][2409101] Sum rewards: -2.991, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.812', 'AMMO5': '0.012', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'weapon7': '0.066', 'AMMO4': '0.098', 'weapon5': '0.102', 'AMMO3': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.230', 'WEAPON5': '0.250', 'weapon4': '0.338', 'WEAPON4': '0.350', 'WEAPON3': '0.700', 'ARMOR': '0.849', 'weapon2': '1.240', 'weapon3': '1.434', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.536'}
[2023-02-25 12:56:19,464][2409866] DAMAGECOUNT value on done: 2278.0
[2023-02-25 12:56:19,465][2409866] Sum rewards: 3.852, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.194', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon5': '0.024', 'WEAPON1': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'AMMO3': '0.097', 'WEAPON4': '0.150', 'weapon4': '0.202', 'HITCOUNT': '0.420', 'WEAPON3': '0.550', 'ARMOR': '1.294', 'DAMAGECOUNT': '1.356', 'weapon2': '1.606', 'weapon3': '1.906', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:19,596][2409596] DAMAGECOUNT value on done: 3470.0
[2023-02-25 12:56:19,599][2409596] Sum rewards: 6.526, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.180', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.112', 'weapon5': '0.180', 'WEAPON5': '0.200', 'weapon4': '0.234', 'HITCOUNT': '0.500', 'WEAPON3': '0.700', 'weapon2': '1.388', 'weapon3': '1.762', 'DAMAGECOUNT': '2.460', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:19,632][2409074] Updated weights for policy 0, policy_version 13831 (0.0012)
[2023-02-25 12:56:19,849][2409405] DAMAGECOUNT value on done: 2981.0
[2023-02-25 12:56:19,852][2409405] Sum rewards: 5.484, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.116', 'AMMO5': '0.003', 'AMMO2': '0.022', 'ARMOR': '0.032', 'AMMO3': '0.040', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'WEAPON4': '0.250', 'WEAPON3': '0.300', 'HITCOUNT': '0.400', 'weapon4': '0.576', 'weapon3': '0.958', 'weapon2': '1.454', 'DAMAGECOUNT': '1.548', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:19,893][2409407] DAMAGECOUNT value on done: 3339.0
[2023-02-25 12:56:19,896][2409407] Sum rewards: 1.133, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.612', 'AMMO2': '0.014', 'weapon5': '0.016', 'AMMO5': '0.023', 'AMMO4': '0.071', 'AMMO3': '0.124', 'WEAPON4': '0.200', 'HITCOUNT': '0.380', 'weapon4': '0.394', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.167', 'weapon2': '1.248', 'ARMOR': '1.294', 'weapon3': '1.764', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:19,900][2409102] DAMAGECOUNT value on done: 3011.0
[2023-02-25 12:56:19,903][2409102] Sum rewards: 6.755, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.908', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'weapon5': '0.030', 'AMMO3': '0.064', 'AMMO4': '0.081', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.418', 'ARMOR': '0.516', 'HITCOUNT': '0.630', 'weapon3': '1.272', 'weapon2': '1.446', 'DAMAGECOUNT': '2.052', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:56:19,911][2409103] DAMAGECOUNT value on done: 1965.0
[2023-02-25 12:56:19,912][2409103] Sum rewards: 1.284, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.993', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.015', 'WEAPON1': '0.050', 'AMMO3': '0.107', 'weapon5': '0.176', 'HITCOUNT': '0.310', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.984', 'ARMOR': '1.323', 'weapon3': '1.382', 'weapon2': '1.552', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:20,012][2409548] DAMAGECOUNT value on done: 2664.0
[2023-02-25 12:56:20,015][2409548] Sum rewards: 3.617, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.350', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'weapon5': '0.048', 'AMMO3': '0.062', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.204', 'HITCOUNT': '0.250', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.780', 'weapon2': '1.032', 'weapon3': '1.414', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:20,079][2409096] DAMAGECOUNT value on done: 2860.0
[2023-02-25 12:56:20,080][2409096] Sum rewards: 4.325, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.498', 'AMMO2': '0.004', 'AMMO5': '0.008', 'AMMO4': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.032', 'AMMO3': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.462', 'WEAPON3': '0.750', 'HITCOUNT': '0.770', 'ARMOR': '0.863', 'weapon3': '1.460', 'weapon2': '1.604', 'DAMAGECOUNT': '2.628', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:20,155][2409100] DAMAGECOUNT value on done: 2924.0
[2023-02-25 12:56:20,158][2409100] Sum rewards: 10.788, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.928', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.089', 'weapon5': '0.146', 'weapon4': '0.230', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'HITCOUNT': '0.710', 'ARMOR': '0.930', 'weapon2': '1.292', 'weapon3': '1.516', 'DAMAGECOUNT': '3.168', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:56:20,180][2409469] DAMAGECOUNT value on done: 4284.0
[2023-02-25 12:56:20,181][2409469] Sum rewards: 7.415, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.796', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'AMMO4': '0.082', 'AMMO3': '0.090', 'weapon5': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'HITCOUNT': '0.450', 'weapon4': '0.456', 'WEAPON3': '0.650', 'weapon3': '1.372', 'weapon2': '1.422', 'DAMAGECOUNT': '2.712', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:20,236][2409075] DAMAGECOUNT value on done: 2600.0
[2023-02-25 12:56:20,240][2409075] Sum rewards: 7.412, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.680', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.056', 'AMMO4': '0.084', 'weapon7': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.340', 'WEAPON3': '0.350', 'ARMOR': '0.463', 'weapon4': '0.614', 'weapon2': '0.762', 'weapon3': '0.856', 'DAMAGECOUNT': '1.878', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:56:20,342][2409373] DAMAGECOUNT value on done: 3593.0
[2023-02-25 12:56:20,345][2409373] Sum rewards: 7.901, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.029', 'AMMO3': '0.060', 'weapon7': '0.070', 'weapon5': '0.074', 'weapon4': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HEALTH': '0.254', 'WEAPON3': '0.300', 'HITCOUNT': '0.540', 'ARMOR': '0.854', 'weapon3': '1.118', 'weapon2': '1.662', 'DAMAGECOUNT': '2.790', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:21,221][2409355] DAMAGECOUNT value on done: 2302.0
[2023-02-25 12:56:21,222][2409355] Sum rewards: 1.934, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.556', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.062', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.350', 'HITCOUNT': '0.390', 'WEAPON3': '0.400', 'weapon4': '0.680', 'weapon3': '0.818', 'ARMOR': '0.882', 'weapon2': '1.088', 'DAMAGECOUNT': '1.341', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:21,329][2409079] DAMAGECOUNT value on done: 1978.0
[2023-02-25 12:56:21,330][2409079] Sum rewards: 0.851, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.798', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'weapon4': '0.042', 'AMMO3': '0.060', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'weapon5': '0.118', 'WEAPON5': '0.200', 'HITCOUNT': '0.250', 'WEAPON3': '0.400', 'ARMOR': '0.455', 'DAMAGECOUNT': '0.747', 'weapon3': '1.288', 'weapon2': '1.840', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:21,405][2409074] Updated weights for policy 0, policy_version 13841 (0.0012)
[2023-02-25 12:56:21,480][2409076] DAMAGECOUNT value on done: 2947.0
[2023-02-25 12:56:21,481][2409076] Sum rewards: 5.654, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.240', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.026', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.188', 'weapon4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'ARMOR': '0.500', 'HITCOUNT': '0.500', 'weapon3': '1.120', 'weapon2': '1.736', 'DAMAGECOUNT': '2.409', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:21,540][2409406] DAMAGECOUNT value on done: 2687.0
[2023-02-25 12:56:21,543][2409406] Sum rewards: 4.729, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.872', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO3': '0.080', 'AMMO4': '0.086', 'weapon5': '0.118', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.312', 'HITCOUNT': '0.540', 'WEAPON3': '0.550', 'weapon3': '1.156', 'weapon2': '1.266', 'ARMOR': '1.271', 'DAMAGECOUNT': '1.887', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:21,563][2409097] DAMAGECOUNT value on done: 2156.0
[2023-02-25 12:56:21,564][2409097] Sum rewards: 4.897, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.679', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.013', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.056', 'weapon5': '0.090', 'WEAPON5': '0.150', 'weapon4': '0.240', 'HITCOUNT': '0.360', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon3': '1.076', 'weapon2': '1.488', 'DAMAGECOUNT': '1.905', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:21,720][2409104] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200.0), ('weapon7', 0.002)]
[2023-02-25 12:56:21,820][2409078] DAMAGECOUNT value on done: 3135.0
[2023-02-25 12:56:21,820][2409078] Sum rewards: 2.043, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.935', 'AMMO5': '0.011', 'AMMO2': '0.016', 'WEAPON1': '0.040', 'AMMO4': '0.079', 'weapon5': '0.126', 'AMMO3': '0.139', 'weapon4': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.500', 'weapon2': '0.986', 'WEAPON3': '1.000', 'weapon3': '2.080', 'DAMAGECOUNT': '2.313', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:22,094][2409099] DAMAGECOUNT value on done: 2558.0
[2023-02-25 12:56:22,095][2409099] Sum rewards: 5.104, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.292', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO5': '0.015', 'WEAPON1': '0.050', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon5': '0.194', 'weapon4': '0.236', 'HITCOUNT': '0.310', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'ARMOR': '0.924', 'weapon2': '1.078', 'DAMAGECOUNT': '1.656', 'weapon3': '1.728', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:22,123][2409486] DAMAGECOUNT value on done: 2314.0
[2023-02-25 12:56:22,124][2409486] Sum rewards: 4.585, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.631', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'weapon5': '0.002', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'weapon7': '0.022', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.410', 'ARMOR': '0.484', 'weapon3': '1.058', 'DAMAGECOUNT': '1.305', 'weapon2': '1.496', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:22,125][2409565] DAMAGECOUNT value on done: 2122.0
[2023-02-25 12:56:22,127][2409565] Sum rewards: 3.228, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.184', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.083', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'weapon5': '0.134', 'weapon4': '0.278', 'WEAPON5': '0.350', 'HITCOUNT': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'weapon3': '0.946', 'DAMAGECOUNT': '1.095', 'weapon2': '1.978', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:22,173][2409077] DAMAGECOUNT value on done: 3526.0
[2023-02-25 12:56:22,173][2409077] Sum rewards: 6.209, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.274', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.017', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'weapon5': '0.062', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.450', 'weapon4': '0.456', 'HITCOUNT': '0.480', 'ARMOR': '0.568', 'weapon3': '1.082', 'weapon2': '1.560', 'DAMAGECOUNT': '1.962', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:22,186][2408954] Fps is (10 sec: 24985.8, 60 sec: 25326.9, 300 sec: 25506.3). Total num frames: 56717312. Throughput: 0: 6314.4. Samples: 14172864. Policy #0 lag: (min: 0.0, avg: 11.0, max: 25.0)
[2023-02-25 12:56:22,186][2408954] Avg episode reward: [(0, '4.175')]
[2023-02-25 12:56:22,187][2409033] Saving new best policy, reward=4.175!
[2023-02-25 12:56:22,363][2409389] DAMAGECOUNT value on done: 2084.0
[2023-02-25 12:56:22,364][2409389] Sum rewards: 2.041, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.554', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO5': '0.022', 'AMMO4': '0.093', 'AMMO3': '0.094', 'weapon5': '0.138', 'WEAPON4': '0.300', 'HITCOUNT': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.554', 'WEAPON3': '0.650', 'weapon2': '1.030', 'ARMOR': '1.262', 'DAMAGECOUNT': '1.605', 'weapon3': '1.668', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:22,387][2409105] DAMAGECOUNT value on done: 2766.0
[2023-02-25 12:56:22,388][2409105] Sum rewards: 4.062, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.010', 'ARMOR': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.050', 'AMMO3': '0.082', 'WEAPON4': '0.200', 'HEALTH': '0.212', 'weapon4': '0.352', 'HITCOUNT': '0.370', 'WEAPON3': '0.500', 'weapon3': '1.360', 'weapon2': '1.382', 'DAMAGECOUNT': '1.443', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:22,463][2409597] DAMAGECOUNT value on done: 3040.0
[2023-02-25 12:56:22,467][2409597] Sum rewards: 2.239, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.806', 'AMMO2': '0.005', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.023', 'weapon4': '0.028', 'WEAPON4': '0.050', 'AMMO3': '0.095', 'weapon5': '0.112', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'HITCOUNT': '0.500', 'WEAPON3': '0.700', 'weapon2': '1.270', 'DAMAGECOUNT': '1.713', 'weapon3': '1.934', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:22,475][2409549] DAMAGECOUNT value on done: 2135.0
[2023-02-25 12:56:22,478][2409549] Sum rewards: 1.970, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'weapon5': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.060', 'HEALTH': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.230', 'weapon4': '0.362', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.687', 'FRAGCOUNT': '1.000', 'weapon3': '1.118', 'ARMOR': '1.738', 'weapon2': '1.862'}
[2023-02-25 12:56:22,530][2409485] DAMAGECOUNT value on done: 2940.0
[2023-02-25 12:56:22,533][2409485] Sum rewards: 1.205, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.432', 'AMMO5': '0.005', 'weapon7': '0.008', 'AMMO2': '0.024', 'WEAPON1': '0.060', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.250', 'HITCOUNT': '0.390', 'ARMOR': '0.481', 'WEAPON3': '0.850', 'weapon2': '1.366', 'DAMAGECOUNT': '1.704', 'weapon3': '2.054', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:22,696][2409104] DAMAGECOUNT value on done: 2982.0
[2023-02-25 12:56:22,697][2409104] Sum rewards: 11.030, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.010', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'weapon7': '0.046', 'AMMO4': '0.049', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.132', 'HEALTH': '0.178', 'WEAPON7': '0.200', 'weapon4': '0.284', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.510', 'ARMOR': '0.993', 'weapon2': '1.084', 'weapon3': '2.042', 'DAMAGECOUNT': '2.727', 'FRAGCOUNT': '9.000'}
[2023-02-25 12:56:22,786][2409101] DAMAGECOUNT value on done: 2980.0
[2023-02-25 12:56:22,789][2409101] Sum rewards: 3.608, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.720', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'weapon7': '0.058', 'weapon5': '0.064', 'AMMO3': '0.065', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'ARMOR': '0.424', 'HITCOUNT': '0.510', 'weapon4': '0.754', 'weapon2': '0.910', 'weapon3': '1.204', 'DAMAGECOUNT': '1.722', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:23,123][2409074] Updated weights for policy 0, policy_version 13851 (0.0012)
[2023-02-25 12:56:23,211][2409866] DAMAGECOUNT value on done: 2321.0
[2023-02-25 12:56:23,214][2409866] Sum rewards: 1.470, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.492', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'ARMOR': '0.040', 'AMMO2': '0.043', 'AMMO3': '0.088', 'AMMO4': '0.214', 'weapon5': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'HITCOUNT': '0.380', 'WEAPON3': '0.550', 'weapon4': '0.606', 'weapon2': '1.198', 'weapon3': '1.352', 'DAMAGECOUNT': '1.875', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:23,425][2409103] DAMAGECOUNT value on done: 3790.0
[2023-02-25 12:56:23,429][2409103] Sum rewards: 1.686, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.100', 'AMMO4': '-0.095', 'AMMO2': '-0.019', 'AMMO5': '0.005', 'weapon5': '0.098', 'AMMO3': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.420', 'WEAPON3': '0.450', 'ARMOR': '0.475', 'DAMAGECOUNT': '1.188', 'weapon3': '1.264', 'FRAGCOUNT': '2.000', 'weapon2': '2.000'}
[2023-02-25 12:56:23,619][2409596] DAMAGECOUNT value on done: 2990.0
[2023-02-25 12:56:23,622][2409596] Sum rewards: 4.877, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.521', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'AMMO3': '0.094', 'weapon5': '0.138', 'weapon4': '0.232', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'HITCOUNT': '0.510', 'ARMOR': '0.800', 'weapon3': '1.410', 'weapon2': '1.432', 'DAMAGECOUNT': '1.932', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:23,642][2409096] DAMAGECOUNT value on done: 2915.0
[2023-02-25 12:56:23,646][2409096] Sum rewards: 7.696, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.742', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.035', 'AMMO3': '0.054', 'weapon7': '0.054', 'weapon5': '0.064', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.330', 'HITCOUNT': '0.380', 'WEAPON3': '0.400', 'weapon2': '0.466', 'ARMOR': '0.848', 'weapon3': '0.996', 'DAMAGECOUNT': '1.686', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:23,677][2409407] DAMAGECOUNT value on done: 2775.0
[2023-02-25 12:56:23,680][2409407] Sum rewards: 0.557, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.007', 'AMMO2': '0.040', 'HEALTH': '0.048', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'weapon5': '0.186', 'AMMO4': '0.198', 'WEAPON4': '0.250', 'HITCOUNT': '0.500', 'WEAPON3': '0.650', 'weapon4': '0.726', 'FRAGCOUNT': '1.000', 'weapon3': '1.010', 'ARMOR': '1.228', 'weapon2': '1.324', 'DAMAGECOUNT': '1.824'}
[2023-02-25 12:56:23,736][2409548] DAMAGECOUNT value on done: 3825.0
[2023-02-25 12:56:23,739][2409548] Sum rewards: 3.426, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.084', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO3': '0.090', 'weapon5': '0.094', 'WEAPON5': '0.250', 'HITCOUNT': '0.420', 'WEAPON3': '0.550', 'ARMOR': '0.913', 'weapon2': '1.538', 'weapon3': '1.710', 'DAMAGECOUNT': '2.388', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:23,738][2409469] DAMAGECOUNT value on done: 3534.0
[2023-02-25 12:56:23,743][2409469] Sum rewards: 1.566, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.918', 'AMMO2': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.021', 'AMMO3': '0.068', 'weapon7': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.122', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.298', 'HITCOUNT': '0.390', 'WEAPON3': '0.500', 'ARMOR': '0.886', 'FRAGCOUNT': '1.000', 'weapon3': '1.162', 'weapon2': '1.208', 'DAMAGECOUNT': '1.935'}
[2023-02-25 12:56:23,823][2409102] DAMAGECOUNT value on done: 2733.0
[2023-02-25 12:56:23,824][2409102] Sum rewards: 4.222, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.448', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO3': '0.059', 'AMMO4': '0.078', 'weapon7': '0.124', 'weapon5': '0.140', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'HITCOUNT': '0.270', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'weapon4': '0.480', 'weapon3': '0.874', 'ARMOR': '1.438', 'weapon2': '1.500', 'DAMAGECOUNT': '1.638', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:23,834][2409100] DAMAGECOUNT value on done: 2863.0
[2023-02-25 12:56:23,835][2409100] Sum rewards: 5.454, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.594', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO5': '0.029', 'AMMO4': '0.066', 'AMMO3': '0.095', 'weapon5': '0.114', 'WEAPON4': '0.300', 'weapon4': '0.360', 'WEAPON5': '0.500', 'HITCOUNT': '0.620', 'WEAPON3': '0.650', 'ARMOR': '0.948', 'weapon2': '1.284', 'weapon3': '1.462', 'DAMAGECOUNT': '2.097', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:24,004][2409075] DAMAGECOUNT value on done: 2482.0
[2023-02-25 12:56:24,005][2409075] Sum rewards: 7.446, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.644', 'AMMO5': '0.005', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.058', 'AMMO4': '0.081', 'WEAPON5': '0.150', 'weapon5': '0.162', 'weapon4': '0.198', 'WEAPON4': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.410', 'weapon2': '0.934', 'weapon3': '0.990', 'ARMOR': '1.255', 'DAMAGECOUNT': '1.761', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:24,018][2409405] DAMAGECOUNT value on done: 2775.0
[2023-02-25 12:56:24,021][2409405] Sum rewards: 3.217, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.011', 'HEALTH': '0.045', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.061', 'weapon5': '0.066', 'weapon7': '0.114', 'WEAPON4': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'HITCOUNT': '0.320', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.400', 'weapon4': '0.432', 'weapon2': '0.992', 'weapon3': '1.124', 'DAMAGECOUNT': '1.365', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:24,292][2409074] Updated weights for policy 0, policy_version 13861 (0.0013)
[2023-02-25 12:56:24,314][2409373] DAMAGECOUNT value on done: 3384.0
[2023-02-25 12:56:24,315][2409373] Sum rewards: 1.318, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.986', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.043', 'weapon7': '0.048', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.107', 'AMMO4': '0.213', 'WEAPON4': '0.250', 'weapon4': '0.302', 'HITCOUNT': '0.450', 'ARMOR': '0.468', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.407', 'weapon2': '1.516', 'weapon3': '1.788', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:24,964][2409355] DAMAGECOUNT value on done: 3170.0
[2023-02-25 12:56:24,967][2409355] Sum rewards: 11.464, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.797', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO5': '0.010', 'WEAPON1': '0.050', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'weapon4': '0.146', 'weapon5': '0.204', 'WEAPON5': '0.250', 'ARMOR': '0.458', 'WEAPON3': '0.600', 'HITCOUNT': '0.730', 'weapon3': '1.346', 'weapon2': '2.036', 'DAMAGECOUNT': '3.285', 'FRAGCOUNT': '10.000'}
[2023-02-25 12:56:25,209][2409079] DAMAGECOUNT value on done: 2855.0
[2023-02-25 12:56:25,213][2409079] Sum rewards: 1.904, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.162', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'AMMO3': '0.062', 'weapon7': '0.102', 'AMMO4': '0.102', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.320', 'WEAPON3': '0.450', 'weapon4': '0.482', 'weapon2': '0.594', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.215', 'weapon3': '1.292'}
[2023-02-25 12:56:25,268][2409406] DAMAGECOUNT value on done: 1991.0
[2023-02-25 12:56:25,269][2409406] Sum rewards: 2.983, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.540', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.074', 'weapon5': '0.172', 'weapon4': '0.174', 'WEAPON5': '0.350', 'HITCOUNT': '0.390', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.134', 'weapon2': '1.534', 'weapon3': '1.636', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:56:25,493][2409097] DAMAGECOUNT value on done: 2624.0
[2023-02-25 12:56:25,494][2409097] Sum rewards: 2.549, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.806', 'AMMO5': '0.010', 'AMMO2': '0.024', 'WEAPON1': '0.050', 'AMMO3': '0.094', 'AMMO4': '0.121', 'weapon5': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.254', 'HITCOUNT': '0.380', 'ARMOR': '0.457', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.200', 'weapon3': '1.562', 'weapon2': '1.608', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:25,597][2409076] DAMAGECOUNT value on done: 3038.0
[2023-02-25 12:56:25,599][2409076] Sum rewards: 2.497, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.199', 'AMMO2': '0.015', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'weapon7': '0.050', 'AMMO4': '0.074', 'AMMO3': '0.097', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.142', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'HITCOUNT': '0.490', 'weapon4': '0.592', 'WEAPON3': '0.600', 'weapon3': '1.318', 'weapon2': '1.352', 'ARMOR': '1.408', 'DAMAGECOUNT': '2.268', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:25,725][2409078] DAMAGECOUNT value on done: 2823.0
[2023-02-25 12:56:25,726][2409078] Sum rewards: 6.595, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.060', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.041', 'weapon5': '0.054', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.207', 'WEAPON4': '0.450', 'WEAPON3': '0.450', 'HITCOUNT': '0.640', 'ARMOR': '0.840', 'weapon4': '0.890', 'weapon2': '1.238', 'weapon3': '1.356', 'DAMAGECOUNT': '2.283', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:56:25,886][2409077] DAMAGECOUNT value on done: 2458.0
[2023-02-25 12:56:25,889][2409077] Sum rewards: 1.680, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.782', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.046', 'AMMO3': '0.078', 'WEAPON4': '0.150', 'weapon5': '0.178', 'WEAPON5': '0.250', 'HITCOUNT': '0.340', 'WEAPON3': '0.400', 'weapon4': '0.454', 'ARMOR': '0.926', 'DAMAGECOUNT': '1.053', 'weapon2': '1.344', 'weapon3': '1.464', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:56:25,940][2409105] DAMAGECOUNT value on done: 2482.0
[2023-02-25 12:56:25,941][2409105] Sum rewards: 5.022, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.063', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.022', 'AMMO3': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon7': '0.176', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.226', 'HITCOUNT': '0.230', 'WEAPON3': '0.250', 'WEAPON7': '0.300', 'ARMOR': '0.478', 'DAMAGECOUNT': '1.005', 'weapon3': '1.044', 'weapon2': '1.466', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:25,968][2409099] DAMAGECOUNT value on done: 2903.0
[2023-02-25 12:56:25,971][2409099] Sum rewards: 3.978, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.526', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.010', 'AMMO3': '0.105', 'weapon5': '0.128', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.384', 'HITCOUNT': '0.540', 'WEAPON3': '0.750', 'ARMOR': '0.854', 'weapon3': '1.326', 'weapon2': '1.670', 'DAMAGECOUNT': '2.436', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:25,987][2409486] DAMAGECOUNT value on done: 2883.0
[2023-02-25 12:56:25,989][2409486] Sum rewards: -2.809, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.296', 'AMMO5': '0.007', 'weapon5': '0.016', 'AMMO2': '0.024', 'WEAPON1': '0.050', 'AMMO3': '0.105', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'HITCOUNT': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.392', 'DAMAGECOUNT': '0.492', 'WEAPON3': '0.650', 'ARMOR': '0.878', 'FRAGCOUNT': '1.000', 'weapon2': '1.258', 'weapon3': '1.794'}
[2023-02-25 12:56:25,994][2409074] Updated weights for policy 0, policy_version 13871 (0.0012)
[2023-02-25 12:56:25,998][2409597] DAMAGECOUNT value on done: 2419.0
[2023-02-25 12:56:26,048][2409549] DAMAGECOUNT value on done: 3197.0
[2023-02-25 12:56:26,049][2409549] Sum rewards: 5.242, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO3': '0.068', 'AMMO4': '0.083', 'WEAPON5': '0.150', 'HEALTH': '0.346', 'WEAPON3': '0.350', 'HITCOUNT': '0.370', 'weapon3': '0.612', 'ARMOR': '0.800', 'weapon2': '1.086', 'DAMAGECOUNT': '1.353', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:26,132][2409565] DAMAGECOUNT value on done: 2303.0
[2023-02-25 12:56:26,135][2409565] Sum rewards: 4.995, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.110', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon7': '0.056', 'AMMO3': '0.062', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.300', 'HITCOUNT': '0.390', 'WEAPON3': '0.500', 'ARMOR': '0.948', 'weapon3': '1.260', 'DAMAGECOUNT': '1.515', 'weapon2': '1.646', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:26,293][2409389] DAMAGECOUNT value on done: 2550.0
[2023-02-25 12:56:26,297][2409389] Sum rewards: 0.046, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.850', 'ARMOR': '0.012', 'AMMO5': '0.014', 'AMMO2': '0.019', 'WEAPON1': '0.050', 'AMMO4': '0.095', 'AMMO3': '0.106', 'weapon5': '0.136', 'WEAPON4': '0.250', 'HITCOUNT': '0.280', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'weapon4': '0.650', 'weapon2': '0.892', 'DAMAGECOUNT': '1.224', 'weapon3': '1.468', 'FRAGCOUNT': '1.500'}
[2023-02-25 12:56:26,328][2409485] DAMAGECOUNT value on done: 2087.0
[2023-02-25 12:56:26,333][2409485] Sum rewards: 3.729, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.780', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'AMMO4': '0.064', 'ARMOR': '0.068', 'AMMO3': '0.083', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.382', 'HITCOUNT': '0.440', 'WEAPON3': '0.550', 'weapon3': '1.410', 'DAMAGECOUNT': '1.443', 'weapon2': '1.490', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:26,342][2409101] DAMAGECOUNT value on done: 3143.0
[2023-02-25 12:56:26,345][2409101] Sum rewards: -0.656, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.450', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.058', 'AMMO3': '0.117', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.324', 'HITCOUNT': '0.450', 'ARMOR': '0.485', 'WEAPON3': '0.750', 'weapon2': '1.330', 'weapon3': '1.412', 'DAMAGECOUNT': '1.605', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:26,631][2409104] DAMAGECOUNT value on done: 2618.0
[2023-02-25 12:56:26,631][2409104] Sum rewards: 4.744, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.246', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.061', 'AMMO3': '0.090', 'weapon5': '0.104', 'WEAPON4': '0.150', 'weapon4': '0.222', 'WEAPON5': '0.350', 'ARMOR': '0.497', 'WEAPON3': '0.650', 'HITCOUNT': '0.720', 'weapon2': '1.126', 'weapon3': '1.500', 'DAMAGECOUNT': '2.205', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:26,673][2409866] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 12:56:26,928][2409866] DAMAGECOUNT value on done: 2740.0
[2023-02-25 12:56:26,932][2409866] Sum rewards: 7.557, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.420', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO3': '0.040', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.268', 'WEAPON3': '0.350', 'HITCOUNT': '0.390', 'ARMOR': '0.451', 'weapon3': '0.940', 'weapon2': '1.368', 'DAMAGECOUNT': '1.425', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:27,186][2408954] Fps is (10 sec: 24576.8, 60 sec: 25258.8, 300 sec: 25478.5). Total num frames: 56832000. Throughput: 0: 6317.6. Samples: 14210964. Policy #0 lag: (min: 0.0, avg: 12.8, max: 26.0)
[2023-02-25 12:56:27,186][2408954] Avg episode reward: [(0, '3.956')]
[2023-02-25 12:56:27,190][2409103] DAMAGECOUNT value on done: 2851.0
[2023-02-25 12:56:27,193][2409103] Sum rewards: 8.493, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.506', 'AMMO5': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'AMMO3': '0.060', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'weapon5': '0.202', 'weapon4': '0.266', 'WEAPON5': '0.350', 'ARMOR': '0.436', 'HITCOUNT': '0.470', 'WEAPON3': '0.500', 'weapon2': '1.292', 'weapon3': '1.598', 'DAMAGECOUNT': '2.022', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:27,427][2409596] DAMAGECOUNT value on done: 2419.0
[2023-02-25 12:56:27,431][2409596] Sum rewards: 1.957, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.360', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.007', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.172', 'weapon4': '0.174', 'WEAPON5': '0.200', 'HITCOUNT': '0.410', 'WEAPON3': '0.500', 'weapon2': '1.488', 'weapon3': '1.558', 'DAMAGECOUNT': '1.905', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:27,477][2409548] DAMAGECOUNT value on done: 2405.0
[2023-02-25 12:56:27,479][2409548] Sum rewards: 4.177, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.370', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.124', 'WEAPON5': '0.150', 'weapon4': '0.162', 'HITCOUNT': '0.340', 'WEAPON3': '0.450', 'weapon3': '1.334', 'weapon2': '1.602', 'DAMAGECOUNT': '1.680', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:27,500][2409102] DAMAGECOUNT value on done: 3310.0
[2023-02-25 12:56:27,501][2409102] Sum rewards: 6.464, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.184', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.017', 'weapon4': '0.032', 'AMMO3': '0.042', 'weapon7': '0.056', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.158', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'ARMOR': '0.400', 'HITCOUNT': '0.410', 'weapon3': '0.894', 'weapon2': '1.664', 'DAMAGECOUNT': '1.878', 'FRAGCOUNT': '4.500'}
[2023-02-25 12:56:27,551][2409100] DAMAGECOUNT value on done: 2630.0
[2023-02-25 12:56:27,553][2409407] DAMAGECOUNT value on done: 3489.0
[2023-02-25 12:56:27,555][2409100] Sum rewards: 6.741, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.277', 'AMMO5': '0.010', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.073', 'AMMO4': '0.099', 'weapon5': '0.122', 'weapon4': '0.214', 'WEAPON5': '0.250', 'HITCOUNT': '0.350', 'WEAPON3': '0.550', 'weapon3': '1.428', 'weapon2': '1.622', 'DAMAGECOUNT': '1.710', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:27,554][2409407] Sum rewards: 0.856, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.250', 'AMMO5': '0.019', 'AMMO2': '0.027', 'WEAPON1': '0.050', 'AMMO4': '0.136', 'weapon5': '0.156', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon4': '0.212', 'WEAPON5': '0.500', 'HITCOUNT': '0.610', 'weapon2': '0.726', 'WEAPON3': '1.100', 'weapon3': '2.416', 'DAMAGECOUNT': '2.535', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:27,635][2409405] DAMAGECOUNT value on done: 2926.0
[2023-02-25 12:56:27,639][2409405] Sum rewards: 6.863, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.121', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'WEAPON4': '0.050', 'AMMO3': '0.097', 'weapon5': '0.140', 'weapon4': '0.158', 'ARMOR': '0.447', 'WEAPON5': '0.450', 'HITCOUNT': '0.530', 'WEAPON3': '0.750', 'weapon2': '1.302', 'weapon3': '1.674', 'DAMAGECOUNT': '2.610', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:56:27,681][2409074] Updated weights for policy 0, policy_version 13881 (0.0012)
[2023-02-25 12:56:27,954][2409096] DAMAGECOUNT value on done: 3462.0
[2023-02-25 12:56:27,955][2409096] Sum rewards: 7.138, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'weapon4': '0.034', 'WEAPON4': '0.050', 'weapon5': '0.052', 'AMMO4': '0.065', 'AMMO3': '0.077', 'WEAPON5': '0.100', 'HEALTH': '0.296', 'ARMOR': '0.400', 'HITCOUNT': '0.440', 'WEAPON3': '0.450', 'weapon3': '1.218', 'weapon2': '1.854', 'DAMAGECOUNT': '2.316', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:28,060][2409469] DAMAGECOUNT value on done: 3433.0
[2023-02-25 12:56:28,061][2409469] Sum rewards: 8.735, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.013', 'AMMO5': '0.020', 'AMMO4': '0.064', 'AMMO3': '0.077', 'weapon5': '0.158', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'HITCOUNT': '0.530', 'HEALTH': '0.587', 'ARMOR': '0.800', 'weapon2': '1.100', 'weapon3': '1.524', 'DAMAGECOUNT': '2.562', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:28,098][2409075] DAMAGECOUNT value on done: 3491.0
[2023-02-25 12:56:28,101][2409075] Sum rewards: 1.425, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.176', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.007', 'WEAPON1': '0.040', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon5': '0.114', 'weapon4': '0.128', 'WEAPON5': '0.250', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'ARMOR': '0.932', 'FRAGCOUNT': '1.000', 'weapon3': '1.384', 'DAMAGECOUNT': '1.554', 'weapon2': '1.960'}
[2023-02-25 12:56:28,764][2409355] DAMAGECOUNT value on done: 3296.0
[2023-02-25 12:56:28,767][2409355] Sum rewards: 2.478, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.347', 'weapon7': '0.006', 'AMMO5': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.070', 'AMMO4': '0.075', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'weapon4': '0.450', 'WEAPON3': '0.500', 'HITCOUNT': '0.620', 'weapon2': '1.142', 'weapon3': '1.542', 'DAMAGECOUNT': '1.830', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:28,858][2409373] DAMAGECOUNT value on done: 2618.0
[2023-02-25 12:56:28,862][2409373] Sum rewards: 0.924, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.985', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.018', 'weapon5': '0.074', 'AMMO4': '0.088', 'AMMO3': '0.096', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.352', 'HITCOUNT': '0.410', 'ARMOR': '0.428', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.206', 'weapon2': '1.286', 'weapon3': '1.828'}
[2023-02-25 12:56:29,083][2409406] DAMAGECOUNT value on done: 3110.0
[2023-02-25 12:56:29,085][2409406] Sum rewards: 3.805, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.484', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.044', 'weapon5': '0.098', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.316', 'HITCOUNT': '0.530', 'WEAPON3': '0.800', 'ARMOR': '0.892', 'weapon3': '1.212', 'weapon2': '1.576', 'DAMAGECOUNT': '2.490', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:29,122][2409079] DAMAGECOUNT value on done: 3434.0
[2023-02-25 12:56:29,123][2409079] Sum rewards: 1.719, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.046', 'weapon7': '0.048', 'AMMO3': '0.060', 'weapon5': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.180', 'AMMO4': '0.228', 'WEAPON3': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.556', 'HEALTH': '0.796', 'weapon3': '0.888', 'weapon2': '0.906', 'DAMAGECOUNT': '0.930', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:29,126][2409074] Updated weights for policy 0, policy_version 13891 (0.0015)
[2023-02-25 12:56:29,354][2409547] DAMAGECOUNT value on done: 2384.0
[2023-02-25 12:56:29,358][2409547] Sum rewards: 3.368, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.304', 'AMMO5': '0.007', 'AMMO2': '0.049', 'AMMO3': '0.067', 'WEAPON5': '0.100', 'weapon5': '0.164', 'HITCOUNT': '0.230', 'AMMO4': '0.243', 'WEAPON3': '0.350', 'WEAPON4': '0.500', 'ARMOR': '0.508', 'weapon4': '0.980', 'weapon3': '1.080', 'DAMAGECOUNT': '1.140', 'weapon2': '1.254', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:29,453][2409078] DAMAGECOUNT value on done: 2626.0
[2023-02-25 12:56:29,457][2409078] Sum rewards: 2.248, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.276', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.017', 'weapon5': '0.036', 'WEAPON1': '0.040', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'weapon4': '0.146', 'WEAPON5': '0.350', 'HITCOUNT': '0.370', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.275', 'weapon2': '1.364', 'weapon3': '1.966', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:29,489][2409105] DAMAGECOUNT value on done: 2422.0
[2023-02-25 12:56:29,492][2409105] Sum rewards: 5.269, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.703', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'AMMO3': '0.097', 'WEAPON4': '0.150', 'AMMO4': '0.158', 'weapon4': '0.334', 'HITCOUNT': '0.340', 'WEAPON5': '0.350', 'weapon5': '0.364', 'ARMOR': '0.486', 'WEAPON3': '0.600', 'weapon2': '1.252', 'weapon3': '1.600', 'DAMAGECOUNT': '1.914', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:29,520][2409597] DAMAGECOUNT value on done: 3437.0
[2023-02-25 12:56:29,525][2409597] Sum rewards: 5.920, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.870', 'AMMO5': '0.015', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.079', 'AMMO3': '0.105', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'weapon4': '0.326', 'HITCOUNT': '0.580', 'WEAPON3': '0.650', 'ARMOR': '0.804', 'weapon3': '1.198', 'weapon2': '1.394', 'DAMAGECOUNT': '3.285', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:29,536][2409549] DAMAGECOUNT value on done: 3425.0
[2023-02-25 12:56:29,536][2409549] Sum rewards: 4.612, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.298', 'AMMO5': '0.010', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'weapon5': '0.036', 'AMMO4': '0.124', 'AMMO3': '0.148', 'weapon4': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'ARMOR': '0.495', 'HITCOUNT': '0.560', 'WEAPON3': '0.750', 'weapon2': '1.166', 'DAMAGECOUNT': '2.058', 'weapon3': '2.160', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:29,595][2409097] DAMAGECOUNT value on done: 2367.0
[2023-02-25 12:56:29,599][2409097] Sum rewards: 1.660, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.044', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.038', 'weapon5': '0.056', 'AMMO3': '0.063', 'AMMO4': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.360', 'WEAPON3': '0.400', 'weapon3': '0.818', 'weapon4': '0.826', 'ARMOR': '0.887', 'DAMAGECOUNT': '1.068', 'weapon2': '1.330', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:29,843][2409101] DAMAGECOUNT value on done: 3477.0
[2023-02-25 12:56:29,844][2409101] Sum rewards: 6.699, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.190', 'AMMO4': '-0.018', 'AMMO2': '-0.003', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO3': '0.080', 'weapon5': '0.110', 'WEAPON5': '0.150', 'ARMOR': '0.458', 'HITCOUNT': '0.460', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.476', 'weapon3': '1.628', 'weapon2': '1.998', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:29,859][2409565] DAMAGECOUNT value on done: 3387.0
[2023-02-25 12:56:29,860][2409565] Sum rewards: 4.869, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.533', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'AMMO3': '0.077', 'AMMO4': '0.137', 'weapon5': '0.210', 'WEAPON5': '0.400', 'ARMOR': '0.461', 'WEAPON4': '0.550', 'WEAPON3': '0.600', 'HITCOUNT': '0.660', 'weapon4': '0.660', 'weapon2': '0.850', 'weapon3': '1.504', 'DAMAGECOUNT': '2.481', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:29,984][2409486] DAMAGECOUNT value on done: 2877.0
[2023-02-25 12:56:29,988][2409076] DAMAGECOUNT value on done: 3235.0
[2023-02-25 12:56:29,997][2409076] Sum rewards: 10.270, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.562', 'AMMO5': '0.012', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'AMMO4': '0.092', 'AMMO3': '0.097', 'weapon5': '0.102', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'weapon4': '0.608', 'HITCOUNT': '0.750', 'ARMOR': '0.804', 'weapon2': '1.080', 'weapon3': '1.696', 'DAMAGECOUNT': '3.882', 'FRAGCOUNT': '11.000'}
[2023-02-25 12:56:29,996][2409486] Sum rewards: 0.993, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.778', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.042', 'weapon5': '0.056', 'weapon4': '0.070', 'AMMO3': '0.073', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.340', 'ARMOR': '0.441', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.107', 'weapon3': '1.456', 'weapon2': '1.560'}
[2023-02-25 12:56:30,004][2409099] DAMAGECOUNT value on done: 3406.0
[2023-02-25 12:56:30,005][2409099] Sum rewards: 8.394, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.068', 'AMMO2': '0.006', 'AMMO5': '0.014', 'AMMO4': '0.028', 'WEAPON1': '0.030', 'AMMO3': '0.076', 'weapon5': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.392', 'HITCOUNT': '0.400', 'WEAPON3': '0.500', 'ARMOR': '0.514', 'weapon3': '1.180', 'weapon2': '1.316', 'DAMAGECOUNT': '2.496', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:56:30,013][2409077] DAMAGECOUNT value on done: 3682.0
[2023-02-25 12:56:30,015][2409077] Sum rewards: 2.262, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.968', 'AMMO5': '0.018', 'AMMO2': '0.031', 'weapon7': '0.074', 'weapon5': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.121', 'AMMO4': '0.154', 'HITCOUNT': '0.320', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.674', 'WEAPON3': '0.750', 'ARMOR': '0.978', 'weapon2': '1.072', 'weapon3': '1.230', 'DAMAGECOUNT': '2.082', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:30,022][2409485] DAMAGECOUNT value on done: 2636.0
[2023-02-25 12:56:30,026][2409485] Sum rewards: 1.761, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.012', 'AMMO2': '0.014', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.078', 'weapon4': '0.084', 'weapon5': '0.136', 'WEAPON5': '0.250', 'HEALTH': '0.304', 'WEAPON3': '0.450', 'HITCOUNT': '0.470', 'weapon3': '1.464', 'weapon2': '1.584', 'DAMAGECOUNT': '1.743', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:56:30,198][2409389] DAMAGECOUNT value on done: 4158.0
[2023-02-25 12:56:30,198][2409389] Sum rewards: 0.658, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.855', 'AMMO2': '0.008', 'AMMO5': '0.012', 'ARMOR': '0.024', 'AMMO4': '0.039', 'WEAPON1': '0.040', 'weapon5': '0.078', 'AMMO3': '0.092', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.530', 'WEAPON3': '0.600', 'weapon4': '0.600', 'weapon2': '1.010', 'DAMAGECOUNT': '1.596', 'weapon3': '1.634', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:30,287][2409104] DAMAGECOUNT value on done: 2623.0
[2023-02-25 12:56:30,289][2409104] Sum rewards: 7.438, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.555', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO3': '0.067', 'AMMO4': '0.070', 'weapon5': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.520', 'weapon4': '0.520', 'weapon2': '1.398', 'weapon3': '1.412', 'DAMAGECOUNT': '2.268', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:30,887][2409103] DAMAGECOUNT value on done: 3003.0
[2023-02-25 12:56:30,889][2409103] Sum rewards: 5.189, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.730', 'AMMO5': '0.017', 'AMMO2': '0.034', 'WEAPON1': '0.050', 'weapon7': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.104', 'weapon5': '0.154', 'AMMO4': '0.170', 'WEAPON4': '0.250', 'HITCOUNT': '0.370', 'WEAPON5': '0.400', 'ARMOR': '0.493', 'WEAPON3': '0.600', 'weapon4': '0.632', 'weapon3': '1.264', 'weapon2': '1.566', 'DAMAGECOUNT': '2.454', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:31,047][2409074] Updated weights for policy 0, policy_version 13901 (0.0013)
[2023-02-25 12:56:31,063][2409548] DAMAGECOUNT value on done: 3132.0
[2023-02-25 12:56:31,064][2409548] Sum rewards: 2.650, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.842', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.037', 'AMMO3': '0.137', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'HITCOUNT': '0.460', 'weapon4': '0.686', 'WEAPON3': '0.800', 'weapon2': '0.972', 'ARMOR': '1.352', 'weapon3': '1.732', 'DAMAGECOUNT': '1.824', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:31,102][2409100] DAMAGECOUNT value on done: 3280.0
[2023-02-25 12:56:31,105][2409100] Sum rewards: 5.909, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.620', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO3': '0.091', 'weapon5': '0.100', 'weapon4': '0.142', 'AMMO4': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.620', 'ARMOR': '0.854', 'weapon3': '1.396', 'weapon2': '1.652', 'DAMAGECOUNT': '2.670', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:31,120][2409866] DAMAGECOUNT value on done: 3005.0
[2023-02-25 12:56:31,120][2409596] DAMAGECOUNT value on done: 3260.0
[2023-02-25 12:56:31,126][2409866] Sum rewards: 5.358, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.790', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.076', 'weapon7': '0.116', 'weapon5': '0.138', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'HITCOUNT': '0.330', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.564', 'weapon3': '0.970', 'ARMOR': '1.309', 'weapon2': '1.492', 'DAMAGECOUNT': '1.797', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:31,126][2409596] Sum rewards: -1.700, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.906', 'AMMO5': '0.010', 'AMMO2': '0.025', 'WEAPON1': '0.050', 'weapon5': '0.100', 'weapon4': '0.118', 'AMMO4': '0.123', 'AMMO3': '0.143', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.420', 'WEAPON3': '0.900', 'weapon2': '1.602', 'weapon3': '1.798', 'DAMAGECOUNT': '1.917', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:31,234][2409102] DAMAGECOUNT value on done: 2707.0
[2023-02-25 12:56:31,237][2409102] Sum rewards: 4.184, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.189', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'AMMO3': '0.070', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'weapon5': '0.162', 'WEAPON5': '0.250', 'HITCOUNT': '0.440', 'weapon4': '0.452', 'WEAPON3': '0.500', 'weapon2': '1.196', 'DAMAGECOUNT': '1.329', 'weapon3': '1.704', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:31,239][2409405] DAMAGECOUNT value on done: 2756.0
[2023-02-25 12:56:31,240][2409405] Sum rewards: 4.810, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.398', 'AMMO2': '0.013', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.062', 'AMMO3': '0.081', 'weapon5': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'HITCOUNT': '0.390', 'WEAPON3': '0.650', 'weapon4': '0.656', 'weapon2': '0.884', 'ARMOR': '0.925', 'weapon3': '1.580', 'DAMAGECOUNT': '1.593', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:31,361][2409407] DAMAGECOUNT value on done: 3201.0
[2023-02-25 12:56:31,364][2409407] Sum rewards: 6.878, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.690', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.005', 'weapon5': '0.048', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'ARMOR': '0.424', 'weapon4': '0.472', 'WEAPON3': '0.500', 'HITCOUNT': '0.600', 'weapon3': '1.300', 'weapon2': '1.426', 'DAMAGECOUNT': '2.631', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:31,721][2409075] DAMAGECOUNT value on done: 2579.0
[2023-02-25 12:56:31,724][2409075] Sum rewards: 3.185, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.690', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.013', 'AMMO3': '0.033', 'weapon7': '0.068', 'weapon5': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.250', 'weapon4': '0.388', 'ARMOR': '0.523', 'weapon3': '0.684', 'DAMAGECOUNT': '0.843', 'weapon2': '0.936', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:31,901][2409096] DAMAGECOUNT value on done: 2898.0
[2023-02-25 12:56:31,902][2409096] Sum rewards: 1.665, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.814', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon5': '0.056', 'AMMO3': '0.100', 'AMMO4': '0.106', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.364', 'ARMOR': '0.400', 'HITCOUNT': '0.440', 'WEAPON3': '0.700', 'weapon2': '1.046', 'weapon3': '1.936', 'DAMAGECOUNT': '2.097', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:31,965][2409469] DAMAGECOUNT value on done: 2022.0
[2023-02-25 12:56:31,966][2409469] Sum rewards: -0.083, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.888', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO5': '0.010', 'WEAPON1': '0.060', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'HITCOUNT': '0.290', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.810', 'weapon2': '0.976', 'FRAGCOUNT': '1.000', 'weapon3': '1.426'}
[2023-02-25 12:56:32,186][2408954] Fps is (10 sec: 25395.4, 60 sec: 25463.5, 300 sec: 25506.3). Total num frames: 56971264. Throughput: 0: 6313.6. Samples: 14249040. Policy #0 lag: (min: 0.0, avg: 12.8, max: 26.0)
[2023-02-25 12:56:32,186][2408954] Avg episode reward: [(0, '3.998')]
[2023-02-25 12:56:32,552][2409074] Updated weights for policy 0, policy_version 13911 (0.0012)
[2023-02-25 12:56:32,601][2409373] DAMAGECOUNT value on done: 2821.0
[2023-02-25 12:56:32,602][2409373] Sum rewards: -0.389, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.946', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'AMMO3': '0.090', 'weapon5': '0.122', 'AMMO4': '0.134', 'WEAPON4': '0.200', 'HITCOUNT': '0.270', 'WEAPON5': '0.300', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.550', 'weapon4': '0.620', 'DAMAGECOUNT': '0.972', 'weapon3': '1.236', 'ARMOR': '1.312', 'weapon2': '1.692'}
[2023-02-25 12:56:33,001][2409355] DAMAGECOUNT value on done: 2865.0
[2023-02-25 12:56:33,004][2409355] Sum rewards: -1.280, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.278', 'AMMO2': '0.017', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'AMMO4': '0.082', 'weapon4': '0.118', 'weapon5': '0.124', 'AMMO3': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'HITCOUNT': '0.410', 'WEAPON3': '0.900', 'ARMOR': '0.961', 'weapon2': '1.270', 'DAMAGECOUNT': '1.407', 'weapon3': '2.156', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:33,019][2409078] DAMAGECOUNT value on done: 2945.0
[2023-02-25 12:56:33,022][2409078] Sum rewards: -0.975, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.820', 'AMMO2': '0.005', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.024', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'weapon5': '0.136', 'weapon4': '0.168', 'WEAPON5': '0.250', 'HITCOUNT': '0.360', 'ARMOR': '0.481', 'WEAPON3': '0.800', 'weapon3': '1.378', 'DAMAGECOUNT': '1.572', 'weapon2': '1.670', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:33,107][2409079] DAMAGECOUNT value on done: 2772.0
[2023-02-25 12:56:33,108][2409079] Sum rewards: 0.623, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.394', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.012', 'weapon4': '0.028', 'WEAPON1': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'WEAPON5': '0.200', 'weapon5': '0.204', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'ARMOR': '1.320', 'weapon3': '1.380', 'weapon2': '1.912', 'DAMAGECOUNT': '2.145', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:56:33,166][2409549] DAMAGECOUNT value on done: 2767.0
[2023-02-25 12:56:33,167][2409549] Sum rewards: 6.298, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.685', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.074', 'WEAPON5': '0.150', 'weapon4': '0.258', 'WEAPON3': '0.400', 'HITCOUNT': '0.460', 'ARMOR': '0.471', 'weapon3': '1.014', 'DAMAGECOUNT': '1.269', 'weapon2': '1.590', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:33,174][2409547] DAMAGECOUNT value on done: 3225.0
[2023-02-25 12:56:33,174][2409547] Sum rewards: 7.335, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.996', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.061', 'AMMO4': '0.104', 'weapon5': '0.148', 'WEAPON4': '0.200', 'weapon4': '0.212', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.700', 'ARMOR': '0.922', 'weapon3': '0.952', 'weapon2': '2.128', 'DAMAGECOUNT': '3.105', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:33,175][2409406] DAMAGECOUNT value on done: 3395.0
[2023-02-25 12:56:33,179][2409406] Sum rewards: 9.865, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.091', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO3': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'weapon4': '0.082', 'weapon5': '0.262', 'WEAPON3': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.410', 'weapon3': '0.974', 'weapon2': '1.968', 'DAMAGECOUNT': '2.580', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:56:33,391][2409105] DAMAGECOUNT value on done: 3222.0
[2023-02-25 12:56:33,393][2409105] Sum rewards: 8.238, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'AMMO3': '0.043', 'HEALTH': '0.066', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.158', 'WEAPON3': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.346', 'ARMOR': '0.408', 'HITCOUNT': '0.420', 'weapon3': '0.858', 'weapon2': '1.524', 'DAMAGECOUNT': '1.560', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:33,397][2409597] DAMAGECOUNT value on done: 3121.0
[2023-02-25 12:56:33,401][2409597] Sum rewards: 3.112, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.721', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.044', 'weapon7': '0.068', 'weapon5': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.230', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'weapon3': '0.888', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.191', 'weapon2': '1.804'}
[2023-02-25 12:56:33,461][2409101] DAMAGECOUNT value on done: 3374.0
[2023-02-25 12:56:33,465][2409101] Sum rewards: 3.701, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.836', 'AMMO2': '0.015', 'AMMO5': '0.017', 'weapon5': '0.030', 'WEAPON1': '0.040', 'AMMO4': '0.076', 'AMMO3': '0.090', 'weapon4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.350', 'HITCOUNT': '0.540', 'WEAPON3': '0.650', 'ARMOR': '0.905', 'weapon2': '1.192', 'weapon3': '1.848', 'DAMAGECOUNT': '1.992', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:33,474][2409097] DAMAGECOUNT value on done: 2040.0
[2023-02-25 12:56:33,475][2409097] Sum rewards: 5.475, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO3': '0.040', 'AMMO4': '0.075', 'weapon7': '0.078', 'WEAPON4': '0.100', 'HEALTH': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.230', 'weapon4': '0.248', 'HITCOUNT': '0.270', 'WEAPON3': '0.300', 'ARMOR': '0.812', 'weapon3': '1.032', 'DAMAGECOUNT': '1.230', 'weapon2': '1.284', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:33,611][2409565] DAMAGECOUNT value on done: 2733.0
[2023-02-25 12:56:33,611][2409565] Sum rewards: 4.820, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.373', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.057', 'AMMO3': '0.069', 'weapon5': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.256', 'HITCOUNT': '0.270', 'WEAPON3': '0.300', 'ARMOR': '0.996', 'DAMAGECOUNT': '1.080', 'weapon2': '1.136', 'weapon3': '1.268', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:33,803][2409077] DAMAGECOUNT value on done: 2826.0
[2023-02-25 12:56:33,807][2409077] Sum rewards: 3.646, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.167', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon7': '0.042', 'AMMO3': '0.085', 'weapon5': '0.088', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.116', 'weapon4': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'HITCOUNT': '0.420', 'WEAPON3': '0.600', 'ARMOR': '0.812', 'weapon3': '1.512', 'weapon2': '1.540', 'DAMAGECOUNT': '1.683', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:33,823][2409076] DAMAGECOUNT value on done: 2732.0
[2023-02-25 12:56:33,826][2409076] Sum rewards: 6.756, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.445', 'AMMO2': '0.004', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.021', 'AMMO3': '0.064', 'weapon7': '0.080', 'weapon5': '0.134', 'AMMO6': '0.280', 'AMMO7': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON7': '0.400', 'HITCOUNT': '0.470', 'weapon4': '0.510', 'WEAPON3': '0.550', 'weapon3': '1.270', 'weapon2': '1.350', 'DAMAGECOUNT': '2.805', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:56:33,835][2409485] DAMAGECOUNT value on done: 2354.0
[2023-02-25 12:56:33,838][2409485] Sum rewards: 3.012, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.730', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO3': '0.050', 'weapon5': '0.136', 'WEAPON5': '0.150', 'HITCOUNT': '0.280', 'WEAPON3': '0.300', 'ARMOR': '0.500', 'weapon3': '1.240', 'DAMAGECOUNT': '1.275', 'weapon2': '1.542', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:33,903][2409104] DAMAGECOUNT value on done: 2296.0
[2023-02-25 12:56:33,906][2409104] Sum rewards: 8.192, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.025', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.060', 'weapon5': '0.060', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.394', 'HITCOUNT': '0.470', 'WEAPON3': '0.500', 'ARMOR': '0.500', 'weapon3': '1.120', 'weapon2': '1.536', 'DAMAGECOUNT': '1.650', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:56:34,232][2409486] DAMAGECOUNT value on done: 2881.0
[2023-02-25 12:56:34,235][2409486] Sum rewards: 2.270, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.587', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'weapon7': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.228', 'HITCOUNT': '0.270', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.480', 'ARMOR': '0.940', 'weapon3': '1.054', 'DAMAGECOUNT': '1.311', 'weapon2': '1.360', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:34,257][2409389] DAMAGECOUNT value on done: 1959.0
[2023-02-25 12:56:34,258][2409389] Sum rewards: -0.711, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.336', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.039', 'weapon5': '0.076', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'HITCOUNT': '0.360', 'ARMOR': '0.404', 'weapon4': '0.450', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.002', 'weapon2': '1.088', 'weapon3': '1.678'}
[2023-02-25 12:56:34,262][2409099] DAMAGECOUNT value on done: 2406.0
[2023-02-25 12:56:34,263][2409099] Sum rewards: 4.387, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.020', 'AMMO2': '0.021', 'AMMO3': '0.072', 'AMMO4': '0.106', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.490', 'weapon2': '0.892', 'weapon4': '0.914', 'DAMAGECOUNT': '1.311', 'weapon3': '1.350', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:34,623][2409074] Updated weights for policy 0, policy_version 13921 (0.0012)
[2023-02-25 12:56:34,714][2409103] DAMAGECOUNT value on done: 3213.0
[2023-02-25 12:56:34,715][2409103] Sum rewards: 4.665, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.202', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'weapon5': '0.048', 'AMMO4': '0.057', 'ARMOR': '0.060', 'AMMO3': '0.076', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.400', 'weapon4': '0.586', 'WEAPON3': '0.650', 'weapon2': '1.086', 'weapon3': '1.584', 'DAMAGECOUNT': '1.716', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:34,719][2409596] DAMAGECOUNT value on done: 2377.0
[2023-02-25 12:56:34,722][2409596] Sum rewards: 1.301, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.422', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon5': '0.020', 'AMMO3': '0.069', 'weapon7': '0.078', 'AMMO4': '0.087', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'HITCOUNT': '0.350', 'ARMOR': '0.477', 'WEAPON3': '0.500', 'weapon4': '0.798', 'weapon2': '0.896', 'DAMAGECOUNT': '1.149', 'weapon3': '1.282', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:34,745][2409486] Large shaping reward 2.584 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.552, 184.0), ('weapon7', 0.002)]
[2023-02-25 12:56:34,787][2409548] DAMAGECOUNT value on done: 2885.0
[2023-02-25 12:56:34,790][2409548] Sum rewards: 5.283, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.176', 'AMMO2': '0.010', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.048', 'weapon5': '0.068', 'AMMO3': '0.076', 'WEAPON5': '0.250', 'HITCOUNT': '0.360', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.260', 'weapon3': '1.666', 'weapon2': '1.978', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:34,929][2409405] DAMAGECOUNT value on done: 3311.0
[2023-02-25 12:56:34,932][2409405] Sum rewards: 4.980, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.675', 'AMMO5': '0.015', 'AMMO2': '0.027', 'WEAPON1': '0.040', 'weapon5': '0.060', 'AMMO3': '0.118', 'AMMO4': '0.133', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'HITCOUNT': '0.560', 'weapon4': '0.604', 'WEAPON3': '0.800', 'weapon2': '1.130', 'ARMOR': '1.282', 'weapon3': '1.904', 'DAMAGECOUNT': '2.382', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:35,223][2409866] DAMAGECOUNT value on done: 2876.0
[2023-02-25 12:56:35,224][2409866] Sum rewards: 1.460, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.095', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'AMMO3': '0.085', 'AMMO4': '0.112', 'weapon5': '0.180', 'WEAPON5': '0.350', 'HITCOUNT': '0.370', 'WEAPON4': '0.450', 'WEAPON3': '0.600', 'weapon4': '0.734', 'weapon2': '1.098', 'DAMAGECOUNT': '1.485', 'weapon3': '1.516', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:35,497][2409096] DAMAGECOUNT value on done: 2424.0
[2023-02-25 12:56:35,498][2409096] Sum rewards: -1.773, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.034', 'AMMO5': '0.011', 'AMMO2': '0.021', 'weapon5': '0.030', 'AMMO3': '0.047', 'AMMO4': '0.102', 'weapon7': '0.104', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'HITCOUNT': '0.380', 'WEAPON7': '0.400', 'WEAPON4': '0.450', 'ARMOR': '0.461', 'FRAGCOUNT': '0.500', 'weapon4': '0.526', 'weapon3': '0.832', 'weapon2': '0.980', 'DAMAGECOUNT': '1.836'}
[2023-02-25 12:56:35,521][2409469] DAMAGECOUNT value on done: 2515.0
[2023-02-25 12:56:35,522][2409469] Sum rewards: -0.538, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.754', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.015', 'weapon7': '0.038', 'AMMO3': '0.054', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'HITCOUNT': '0.230', 'WEAPON3': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.518', 'DAMAGECOUNT': '0.660', 'weapon3': '0.754', 'ARMOR': '0.929', 'FRAGCOUNT': '1.000', 'weapon2': '1.402'}
[2023-02-25 12:56:35,532][2409102] DAMAGECOUNT value on done: 2471.0
[2023-02-25 12:56:35,536][2409102] Sum rewards: -2.459, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.776', 'AMMO5': '0.013', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'weapon5': '0.050', 'WEAPON1': '0.060', 'weapon4': '0.080', 'AMMO4': '0.110', 'AMMO3': '0.140', 'HITCOUNT': '0.280', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.236', 'weapon2': '1.548', 'weapon3': '1.878', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:35,663][2409407] DAMAGECOUNT value on done: 2969.0
[2023-02-25 12:56:35,664][2409407] Sum rewards: 2.233, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.799', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO5': '0.003', 'weapon5': '0.018', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.084', 'HITCOUNT': '0.240', 'ARMOR': '0.454', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.185', 'weapon3': '1.364', 'weapon2': '1.562', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:35,750][2409074] Updated weights for policy 0, policy_version 13931 (0.0012)
[2023-02-25 12:56:36,296][2409075] DAMAGECOUNT value on done: 3218.0
[2023-02-25 12:56:36,299][2409075] Sum rewards: 3.991, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'AMMO4': '0.064', 'AMMO3': '0.070', 'weapon5': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'HEALTH': '0.414', 'weapon4': '0.444', 'WEAPON3': '0.450', 'HITCOUNT': '0.510', 'weapon2': '0.860', 'weapon3': '1.230', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.196'}
[2023-02-25 12:56:36,420][2409373] DAMAGECOUNT value on done: 3497.0
[2023-02-25 12:56:36,421][2409373] Sum rewards: 0.086, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.110', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO3': '0.129', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.400', 'weapon4': '0.472', 'HITCOUNT': '0.560', 'WEAPON3': '0.750', 'ARMOR': '0.861', 'weapon2': '1.372', 'DAMAGECOUNT': '1.764', 'weapon3': '1.818', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:36,869][2409406] DAMAGECOUNT value on done: 2314.0
[2023-02-25 12:56:36,870][2409406] Sum rewards: 3.935, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.620', 'AMMO5': '0.010', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'AMMO3': '0.040', 'weapon7': '0.046', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.115', 'weapon5': '0.208', 'WEAPON5': '0.250', 'HITCOUNT': '0.290', 'weapon4': '0.296', 'WEAPON3': '0.350', 'ARMOR': '0.923', 'weapon3': '0.986', 'weapon2': '1.084', 'DAMAGECOUNT': '1.503', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:36,933][2409597] DAMAGECOUNT value on done: 2260.0
[2023-02-25 12:56:36,956][2409078] DAMAGECOUNT value on done: 2727.0
[2023-02-25 12:56:36,957][2409105] DAMAGECOUNT value on done: 3119.0
[2023-02-25 12:56:36,960][2409105] Sum rewards: -0.098, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.060', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon5': '0.070', 'AMMO3': '0.089', 'AMMO4': '0.138', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'HITCOUNT': '0.320', 'ARMOR': '0.460', 'weapon4': '0.472', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.101', 'weapon2': '1.106', 'weapon3': '1.698'}
[2023-02-25 12:56:36,960][2409078] Sum rewards: 10.420, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO3': '0.060', 'weapon5': '0.074', 'WEAPON5': '0.250', 'HEALTH': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '0.640', 'weapon3': '1.266', 'weapon2': '2.002', 'DAMAGECOUNT': '2.580', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:56:36,985][2409101] DAMAGECOUNT value on done: 2333.0
[2023-02-25 12:56:36,988][2409101] Sum rewards: 1.505, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.148', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.009', 'weapon5': '0.052', 'AMMO3': '0.070', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.360', 'HITCOUNT': '0.490', 'WEAPON3': '0.550', 'ARMOR': '0.911', 'weapon2': '1.200', 'weapon3': '1.410', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.770'}
[2023-02-25 12:56:36,988][2409355] DAMAGECOUNT value on done: 3401.0
[2023-02-25 12:56:36,988][2409355] Sum rewards: 10.212, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.270', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'ARMOR': '0.036', 'weapon5': '0.076', 'AMMO3': '0.090', 'AMMO4': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'weapon4': '0.552', 'HITCOUNT': '0.710', 'weapon2': '1.448', 'weapon3': '1.608', 'DAMAGECOUNT': '2.235', 'FRAGCOUNT': '10.000'}
[2023-02-25 12:56:37,132][2409074] Updated weights for policy 0, policy_version 13941 (0.0012)
[2023-02-25 12:56:37,186][2408954] Fps is (10 sec: 27033.5, 60 sec: 25258.7, 300 sec: 25520.2). Total num frames: 57102336. Throughput: 0: 6316.0. Samples: 14268072. Policy #0 lag: (min: 0.0, avg: 12.4, max: 27.0)
[2023-02-25 12:56:37,186][2408954] Avg episode reward: [(0, '3.714')]
[2023-02-25 12:56:37,193][2409079] DAMAGECOUNT value on done: 3657.0
[2023-02-25 12:56:37,194][2409079] Sum rewards: 1.272, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.936', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon5': '0.102', 'AMMO3': '0.129', 'AMMO4': '0.194', 'WEAPON5': '0.300', 'HITCOUNT': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'ARMOR': '0.902', 'weapon2': '0.962', 'weapon4': '0.988', 'weapon3': '1.560', 'DAMAGECOUNT': '1.608', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:37,290][2409547] DAMAGECOUNT value on done: 2970.0
[2023-02-25 12:56:37,292][2409547] Sum rewards: 3.860, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.312', 'AMMO5': '0.009', 'AMMO2': '0.011', 'WEAPON1': '0.040', 'AMMO4': '0.057', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'weapon5': '0.206', 'weapon4': '0.224', 'WEAPON5': '0.300', 'ARMOR': '0.480', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'weapon3': '1.132', 'DAMAGECOUNT': '1.638', 'weapon2': '2.126', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:37,381][2409097] DAMAGECOUNT value on done: 2393.0
[2023-02-25 12:56:37,384][2409097] Sum rewards: 3.724, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.609', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.008', 'AMMO3': '0.040', 'WEAPON4': '0.050', 'weapon5': '0.080', 'WEAPON5': '0.200', 'weapon4': '0.202', 'WEAPON3': '0.400', 'HITCOUNT': '0.520', 'ARMOR': '0.835', 'weapon3': '0.982', 'DAMAGECOUNT': '1.875', 'weapon2': '2.154', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:37,487][2409077] DAMAGECOUNT value on done: 2944.0
[2023-02-25 12:56:37,488][2409077] Sum rewards: -0.119, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.838', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.054', 'WEAPON1': '0.060', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.230', 'HITCOUNT': '0.240', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.735', 'weapon2': '0.786', 'FRAGCOUNT': '1.000', 'weapon3': '1.554'}
[2023-02-25 12:56:37,539][2409104] DAMAGECOUNT value on done: 2423.0
[2023-02-25 12:56:37,540][2409104] Sum rewards: 4.105, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon7': '0.068', 'AMMO3': '0.074', 'ARMOR': '0.076', 'weapon5': '0.084', 'HEALTH': '0.099', 'AMMO4': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'weapon4': '0.518', 'weapon2': '1.156', 'weapon3': '1.234', 'DAMAGECOUNT': '1.290', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:37,545][2409485] DAMAGECOUNT value on done: 2758.0
[2023-02-25 12:56:37,546][2409485] Sum rewards: 2.425, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.411', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'weapon5': '0.036', 'AMMO3': '0.047', 'WEAPON5': '0.050', 'weapon7': '0.050', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.220', 'weapon4': '0.254', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'weapon2': '0.684', 'weapon3': '0.774', 'DAMAGECOUNT': '1.245', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:37,595][2409076] DAMAGECOUNT value on done: 2149.0
[2023-02-25 12:56:37,595][2409076] Sum rewards: 0.607, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.002', 'AMMO5': '0.017', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'AMMO3': '0.085', 'AMMO4': '0.119', 'weapon5': '0.120', 'WEAPON4': '0.200', 'weapon4': '0.344', 'WEAPON5': '0.350', 'HITCOUNT': '0.450', 'ARMOR': '0.490', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.104', 'weapon2': '1.328', 'weapon3': '1.788', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:38,134][2409486] DAMAGECOUNT value on done: 3119.0
[2023-02-25 12:56:38,135][2409486] Sum rewards: 8.794, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.090', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO5': '0.015', 'weapon4': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.082', 'weapon5': '0.134', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.570', 'weapon3': '1.448', 'weapon2': '1.698', 'DAMAGECOUNT': '2.820', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:38,190][2409099] DAMAGECOUNT value on done: 2728.0
[2023-02-25 12:56:38,215][2409565] DAMAGECOUNT value on done: 2830.0
[2023-02-25 12:56:38,216][2409565] Sum rewards: -0.276, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.237', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'weapon5': '0.168', 'HITCOUNT': '0.210', 'WEAPON5': '0.300', 'weapon4': '0.300', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.080', 'weapon2': '1.170', 'ARMOR': '1.277', 'weapon3': '1.860'}
[2023-02-25 12:56:38,390][2409596] DAMAGECOUNT value on done: 2217.0
[2023-02-25 12:56:38,391][2409596] Sum rewards: -2.032, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.206', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.040', 'AMMO4': '0.041', 'weapon7': '0.058', 'weapon5': '0.064', 'AMMO3': '0.099', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.314', 'HITCOUNT': '0.340', 'WEAPON3': '0.800', 'weapon2': '0.894', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.314', 'weapon3': '1.854'}
[2023-02-25 12:56:38,394][2409389] DAMAGECOUNT value on done: 3320.0
[2023-02-25 12:56:38,397][2409389] Sum rewards: 8.963, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.051', 'AMMO5': '0.005', 'AMMO2': '0.007', 'WEAPON1': '0.030', 'AMMO4': '0.033', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'weapon5': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.210', 'ARMOR': '0.454', 'WEAPON3': '0.550', 'HITCOUNT': '0.760', 'weapon2': '1.272', 'weapon3': '2.040', 'DAMAGECOUNT': '2.472', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:56:38,657][2409548] DAMAGECOUNT value on done: 2722.0
[2023-02-25 12:56:38,658][2409548] Sum rewards: 2.921, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.552', 'AMMO5': '0.003', 'AMMO2': '0.016', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.060', 'AMMO4': '0.081', 'WEAPON4': '0.200', 'WEAPON3': '0.400', 'HITCOUNT': '0.410', 'weapon4': '0.554', 'weapon3': '0.958', 'DAMAGECOUNT': '1.269', 'weapon2': '1.388', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:38,681][2409405] DAMAGECOUNT value on done: 3210.0
[2023-02-25 12:56:38,684][2409405] Sum rewards: 6.470, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.012', 'AMMO2': '0.037', 'WEAPON1': '0.040', 'ARMOR': '0.048', 'AMMO3': '0.088', 'weapon5': '0.134', 'AMMO4': '0.185', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'HEALTH': '0.412', 'WEAPON3': '0.550', 'weapon4': '0.636', 'HITCOUNT': '0.690', 'weapon2': '1.050', 'weapon3': '1.696', 'DAMAGECOUNT': '3.141', 'FRAGCOUNT': '5.500'}
[2023-02-25 12:56:39,001][2409866] DAMAGECOUNT value on done: 3620.0
[2023-02-25 12:56:39,004][2409866] Sum rewards: 9.122, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.462', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon5': '0.056', 'AMMO3': '0.073', 'WEAPON5': '0.250', 'ARMOR': '0.478', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'weapon2': '1.076', 'weapon3': '1.484', 'DAMAGECOUNT': '3.231', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:56:39,099][2409074] Updated weights for policy 0, policy_version 13951 (0.0012)
[2023-02-25 12:56:39,124][2409096] DAMAGECOUNT value on done: 2868.0
[2023-02-25 12:56:39,125][2409096] Sum rewards: 0.148, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.224', 'AMMO2': '0.007', 'AMMO5': '0.015', 'AMMO4': '0.033', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'WEAPON5': '0.200', 'HITCOUNT': '0.310', 'weapon4': '0.316', 'ARMOR': '0.540', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.056', 'weapon2': '1.380', 'weapon3': '1.680', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:39,145][2409469] DAMAGECOUNT value on done: 3423.0
[2023-02-25 12:56:39,146][2409469] Sum rewards: 3.265, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.920', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.115', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'weapon4': '0.304', 'HITCOUNT': '0.590', 'WEAPON3': '0.750', 'ARMOR': '0.858', 'weapon2': '1.490', 'weapon3': '1.750', 'DAMAGECOUNT': '1.875', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:39,366][2409407] DAMAGECOUNT value on done: 2400.0
[2023-02-25 12:56:39,899][2409102] DAMAGECOUNT value on done: 2908.0
[2023-02-25 12:56:39,902][2409102] Sum rewards: 2.246, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.670', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.014', 'WEAPON5': '0.050', 'AMMO3': '0.066', 'AMMO4': '0.067', 'WEAPON4': '0.350', 'HITCOUNT': '0.470', 'WEAPON3': '0.500', 'FRAGCOUNT': '0.500', 'weapon2': '0.698', 'weapon4': '0.782', 'ARMOR': '0.967', 'weapon3': '1.334', 'DAMAGECOUNT': '1.602'}
[2023-02-25 12:56:40,048][2409075] DAMAGECOUNT value on done: 3004.0
[2023-02-25 12:56:40,048][2409075] Sum rewards: 5.317, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.015', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'weapon7': '0.056', 'HEALTH': '0.093', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.180', 'WEAPON7': '0.200', 'weapon5': '0.232', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.627', 'weapon3': '1.284', 'weapon2': '1.694', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:40,060][2409373] DAMAGECOUNT value on done: 3821.0
[2023-02-25 12:56:40,064][2409373] Sum rewards: 2.391, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.852', 'weapon5': '0.006', 'AMMO2': '0.017', 'AMMO5': '0.018', 'WEAPON1': '0.050', 'AMMO4': '0.086', 'weapon4': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.155', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.570', 'WEAPON3': '0.900', 'weapon2': '1.158', 'weapon3': '1.784', 'DAMAGECOUNT': '2.019', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:40,506][2409074] Updated weights for policy 0, policy_version 13961 (0.0012)
[2023-02-25 12:56:40,664][2409355] DAMAGECOUNT value on done: 3323.0
[2023-02-25 12:56:40,664][2409355] Sum rewards: 6.172, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.920', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.028', 'AMMO3': '0.082', 'weapon5': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.424', 'weapon4': '0.448', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'weapon2': '0.636', 'weapon3': '1.414', 'DAMAGECOUNT': '2.013', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:40,767][2409101] DAMAGECOUNT value on done: 3476.0
[2023-02-25 12:56:40,770][2409101] Sum rewards: 7.969, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.178', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.078', 'weapon5': '0.154', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.458', 'weapon4': '0.482', 'WEAPON3': '0.550', 'HITCOUNT': '0.560', 'weapon2': '1.190', 'weapon3': '1.354', 'DAMAGECOUNT': '2.553', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:56:40,875][2409078] DAMAGECOUNT value on done: 2271.0
[2023-02-25 12:56:40,876][2409078] Sum rewards: 2.445, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.540', 'AMMO5': '0.015', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.076', 'weapon5': '0.084', 'AMMO3': '0.090', 'WEAPON5': '0.350', 'HITCOUNT': '0.390', 'WEAPON4': '0.400', 'weapon4': '0.460', 'WEAPON3': '0.600', 'weapon3': '1.270', 'ARMOR': '1.362', 'weapon2': '1.392', 'DAMAGECOUNT': '1.710', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:40,930][2409406] DAMAGECOUNT value on done: 2655.0
[2023-02-25 12:56:40,939][2409406] Sum rewards: 4.062, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.090', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO3': '0.066', 'weapon7': '0.082', 'AMMO4': '0.095', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.192', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.240', 'weapon2': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'weapon3': '0.796', 'weapon4': '0.940', 'DAMAGECOUNT': '1.662', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:40,990][2409079] DAMAGECOUNT value on done: 2602.0
[2023-02-25 12:56:40,992][2409079] Sum rewards: 1.654, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.950', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.052', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'weapon7': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.448', 'HITCOUNT': '0.470', 'WEAPON3': '0.700', 'ARMOR': '1.246', 'weapon3': '1.490', 'weapon2': '1.500', 'DAMAGECOUNT': '2.160', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:41,001][2409597] DAMAGECOUNT value on done: 2699.0
[2023-02-25 12:56:41,003][2409597] Sum rewards: 2.011, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.153', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.031', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'weapon5': '0.118', 'AMMO4': '0.155', 'HITCOUNT': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.470', 'WEAPON3': '0.650', 'ARMOR': '0.889', 'weapon2': '1.330', 'DAMAGECOUNT': '1.641', 'weapon3': '1.826', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:41,043][2409105] DAMAGECOUNT value on done: 3269.0
[2023-02-25 12:56:41,045][2409105] Sum rewards: 5.037, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.353', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.012', 'WEAPON1': '0.050', 'weapon5': '0.066', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'weapon4': '0.106', 'WEAPON5': '0.300', 'ARMOR': '0.449', 'HITCOUNT': '0.560', 'WEAPON3': '0.700', 'weapon2': '1.642', 'weapon3': '1.722', 'DAMAGECOUNT': '1.878', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:41,353][2409104] DAMAGECOUNT value on done: 3448.0
[2023-02-25 12:56:41,356][2409104] Sum rewards: 1.943, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.013', 'AMMO5': '0.003', 'AMMO2': '0.013', 'ARMOR': '0.036', 'weapon5': '0.038', 'AMMO3': '0.040', 'WEAPON1': '0.040', 'AMMO4': '0.067', 'weapon7': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.250', 'HITCOUNT': '0.320', 'WEAPON3': '0.400', 'weapon4': '0.492', 'weapon2': '0.532', 'weapon3': '1.040', 'DAMAGECOUNT': '1.455', 'FRAGCOUNT': '1.500'}
[2023-02-25 12:56:41,388][2409076] DAMAGECOUNT value on done: 3137.0
[2023-02-25 12:56:41,388][2409076] Sum rewards: 1.466, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.039', 'WEAPON1': '0.040', 'AMMO3': '0.117', 'WEAPON5': '0.150', 'AMMO4': '0.194', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'HEALTH': '0.312', 'HITCOUNT': '0.370', 'weapon4': '0.442', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'DAMAGECOUNT': '1.128', 'weapon2': '1.370', 'weapon3': '1.938', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:41,475][2409547] DAMAGECOUNT value on done: 3290.0
[2023-02-25 12:56:41,483][2409547] Sum rewards: 6.179, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.820', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO5': '0.022', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'weapon4': '0.202', 'weapon5': '0.236', 'HITCOUNT': '0.470', 'WEAPON5': '0.600', 'WEAPON3': '0.850', 'ARMOR': '0.909', 'weapon2': '1.308', 'weapon3': '2.008', 'DAMAGECOUNT': '2.403', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:56:41,514][2409097] DAMAGECOUNT value on done: 2832.0
[2023-02-25 12:56:41,515][2409097] Sum rewards: 5.983, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.704', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'weapon4': '0.024', 'AMMO4': '0.060', 'AMMO3': '0.077', 'WEAPON4': '0.150', 'WEAPON3': '0.550', 'HITCOUNT': '0.560', 'ARMOR': '0.800', 'weapon3': '1.404', 'weapon2': '1.444', 'DAMAGECOUNT': '1.836', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:41,701][2409077] DAMAGECOUNT value on done: 2746.0
[2023-02-25 12:56:41,702][2409077] Sum rewards: 2.465, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.796', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.011', 'WEAPON1': '0.050', 'AMMO3': '0.096', 'weapon5': '0.124', 'WEAPON4': '0.200', 'weapon4': '0.246', 'WEAPON5': '0.300', 'HITCOUNT': '0.530', 'WEAPON3': '0.700', 'ARMOR': '0.920', 'weapon2': '1.522', 'weapon3': '1.760', 'DAMAGECOUNT': '1.839', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:41,759][2409486] DAMAGECOUNT value on done: 3250.0
[2023-02-25 12:56:41,762][2409486] Sum rewards: 11.458, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.017', 'AMMO3': '0.040', 'HEALTH': '0.077', 'AMMO4': '0.084', 'weapon7': '0.102', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.250', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'weapon4': '0.410', 'HITCOUNT': '0.490', 'weapon3': '0.948', 'weapon2': '1.336', 'DAMAGECOUNT': '3.414', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:41,840][2409099] DAMAGECOUNT value on done: 3310.0
[2023-02-25 12:56:41,843][2409099] Sum rewards: 4.298, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.797', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'weapon4': '0.264', 'HITCOUNT': '0.370', 'WEAPON3': '0.450', 'ARMOR': '0.487', 'weapon2': '1.098', 'DAMAGECOUNT': '1.161', 'weapon3': '1.480', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:41,973][2409485] DAMAGECOUNT value on done: 3012.0
[2023-02-25 12:56:41,974][2409485] Sum rewards: 4.264, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.546', 'AMMO2': '0.004', 'AMMO4': '0.022', 'AMMO3': '0.051', 'weapon7': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.280', 'WEAPON3': '0.300', 'weapon3': '0.680', 'ARMOR': '0.855', 'DAMAGECOUNT': '0.900', 'weapon2': '1.206', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:42,137][2409596] DAMAGECOUNT value on done: 2751.0
[2023-02-25 12:56:42,137][2409596] Sum rewards: 4.154, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.158', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.036', 'AMMO4': '0.053', 'WEAPON5': '0.100', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'weapon4': '0.336', 'HITCOUNT': '0.400', 'WEAPON3': '0.650', 'ARMOR': '0.866', 'weapon2': '1.150', 'DAMAGECOUNT': '1.365', 'weapon3': '1.812', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:42,186][2408954] Fps is (10 sec: 24575.9, 60 sec: 25326.9, 300 sec: 25478.5). Total num frames: 57217024. Throughput: 0: 6324.3. Samples: 14306448. Policy #0 lag: (min: 0.0, avg: 12.4, max: 27.0)
[2023-02-25 12:56:42,186][2408954] Avg episode reward: [(0, '3.627')]
[2023-02-25 12:56:42,312][2409565] DAMAGECOUNT value on done: 3395.0
[2023-02-25 12:56:42,313][2409565] Sum rewards: 0.663, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.642', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.038', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.406', 'WEAPON3': '0.600', 'HITCOUNT': '0.660', 'ARMOR': '0.836', 'weapon3': '1.460', 'weapon2': '1.820', 'DAMAGECOUNT': '2.322', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:42,329][2409389] DAMAGECOUNT value on done: 2927.0
[2023-02-25 12:56:42,330][2409389] Sum rewards: 1.757, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.126', 'weapon5': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.077', 'weapon7': '0.078', 'AMMO4': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.370', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.602', 'weapon2': '1.040', 'weapon3': '1.158', 'DAMAGECOUNT': '1.452', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:42,457][2409548] DAMAGECOUNT value on done: 3380.0
[2023-02-25 12:56:42,460][2409548] Sum rewards: 2.799, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.308', 'AMMO2': '0.004', 'AMMO4': '0.021', 'AMMO5': '0.023', 'WEAPON1': '0.040', 'AMMO3': '0.061', 'WEAPON4': '0.100', 'weapon5': '0.244', 'weapon4': '0.384', 'HITCOUNT': '0.460', 'WEAPON3': '0.550', 'WEAPON5': '0.550', 'ARMOR': '0.859', 'weapon2': '1.472', 'weapon3': '1.526', 'DAMAGECOUNT': '1.812', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:56:42,533][2409866] DAMAGECOUNT value on done: 3127.0
[2023-02-25 12:56:42,534][2409866] Sum rewards: 1.580, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.814', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO5': '0.029', 'AMMO4': '0.070', 'weapon5': '0.094', 'AMMO3': '0.144', 'WEAPON4': '0.300', 'weapon4': '0.412', 'WEAPON5': '0.450', 'HITCOUNT': '0.500', 'WEAPON3': '0.850', 'ARMOR': '0.952', 'weapon2': '1.310', 'weapon3': '1.796', 'DAMAGECOUNT': '1.953', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:56:42,678][2409074] Updated weights for policy 0, policy_version 13971 (0.0013)
[2023-02-25 12:56:42,689][2409405] DAMAGECOUNT value on done: 2991.0
[2023-02-25 12:56:42,692][2409405] Sum rewards: 1.829, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.823', 'AMMO2': '0.014', 'AMMO5': '0.016', 'AMMO4': '0.067', 'AMMO3': '0.101', 'weapon4': '0.132', 'WEAPON4': '0.150', 'weapon5': '0.190', 'WEAPON5': '0.350', 'HITCOUNT': '0.530', 'WEAPON3': '0.850', 'weapon2': '0.938', 'weapon3': '1.910', 'DAMAGECOUNT': '2.154', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:43,228][2409469] DAMAGECOUNT value on done: 3480.0
[2023-02-25 12:56:43,229][2409469] Sum rewards: 9.153, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.300', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'WEAPON4': '0.050', 'weapon5': '0.090', 'AMMO3': '0.094', 'AMMO4': '0.137', 'weapon4': '0.180', 'WEAPON5': '0.200', 'HITCOUNT': '0.560', 'WEAPON3': '0.600', 'ARMOR': '0.800', 'weapon2': '0.890', 'weapon3': '1.688', 'DAMAGECOUNT': '2.856', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:56:43,234][2409096] DAMAGECOUNT value on done: 2959.0
[2023-02-25 12:56:43,235][2409096] Sum rewards: 10.238, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.472', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'weapon5': '0.052', 'AMMO3': '0.060', 'WEAPON5': '0.150', 'weapon4': '0.172', 'WEAPON3': '0.450', 'HITCOUNT': '0.610', 'ARMOR': '0.902', 'weapon3': '1.412', 'weapon2': '1.708', 'DAMAGECOUNT': '2.355', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:56:43,237][2409407] DAMAGECOUNT value on done: 2371.0
[2023-02-25 12:56:43,237][2409407] Sum rewards: 1.033, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'AMMO3': '0.049', 'weapon5': '0.066', 'weapon7': '0.070', 'HEALTH': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'WEAPON3': '0.250', 'weapon4': '0.316', 'weapon3': '0.596', 'DAMAGECOUNT': '0.792', 'ARMOR': '0.875', 'FRAGCOUNT': '1.000', 'weapon2': '1.322'}
[2023-02-25 12:56:43,661][2409102] DAMAGECOUNT value on done: 3457.0
[2023-02-25 12:56:43,664][2409102] Sum rewards: 5.535, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.070', 'AMMO2': '0.012', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'weapon4': '0.034', 'AMMO4': '0.058', 'AMMO3': '0.078', 'weapon5': '0.094', 'WEAPON4': '0.100', 'HITCOUNT': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'weapon3': '1.072', 'DAMAGECOUNT': '1.890', 'weapon2': '2.228', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:43,827][2409074] Updated weights for policy 0, policy_version 13981 (0.0013)
[2023-02-25 12:56:43,875][2409373] DAMAGECOUNT value on done: 4202.0
[2023-02-25 12:56:43,876][2409373] Sum rewards: 9.193, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.974', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.040', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'weapon4': '0.074', 'AMMO3': '0.086', 'weapon5': '0.158', 'WEAPON5': '0.200', 'ARMOR': '0.436', 'HITCOUNT': '0.580', 'WEAPON3': '0.600', 'weapon3': '1.390', 'weapon2': '1.642', 'DAMAGECOUNT': '2.598', 'FRAGCOUNT': '9.000'}
[2023-02-25 12:56:43,881][2409075] DAMAGECOUNT value on done: 2937.0
[2023-02-25 12:56:43,882][2409075] Sum rewards: -2.211, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.880', 'AMMO5': '0.011', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'weapon5': '0.094', 'AMMO4': '0.103', 'AMMO3': '0.109', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'HITCOUNT': '0.440', 'WEAPON3': '0.700', 'weapon4': '0.708', 'ARMOR': '0.808', 'weapon2': '1.196', 'weapon3': '1.400', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.548'}
[2023-02-25 12:56:44,211][2409355] DAMAGECOUNT value on done: 3082.0
[2023-02-25 12:56:44,212][2409355] Sum rewards: -0.451, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.893', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'WEAPON4': '0.100', 'weapon5': '0.108', 'AMMO3': '0.125', 'WEAPON5': '0.250', 'weapon4': '0.268', 'ARMOR': '0.440', 'HITCOUNT': '0.480', 'WEAPON3': '0.950', 'weapon2': '1.166', 'DAMAGECOUNT': '1.797', 'weapon3': '1.946', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:44,527][2409078] DAMAGECOUNT value on done: 2843.0
[2023-02-25 12:56:44,531][2409078] Sum rewards: 2.072, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.010', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'AMMO4': '0.107', 'AMMO3': '0.111', 'weapon5': '0.132', 'HEALTH': '0.230', 'WEAPON5': '0.250', 'HITCOUNT': '0.310', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.125', 'weapon3': '1.412', 'weapon2': '1.784', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:44,824][2409597] DAMAGECOUNT value on done: 3587.0
[2023-02-25 12:56:44,824][2409597] Sum rewards: 4.765, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.092', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'weapon5': '0.058', 'AMMO3': '0.067', 'AMMO4': '0.079', 'WEAPON5': '0.200', 'weapon4': '0.230', 'HITCOUNT': '0.400', 'ARMOR': '0.420', 'WEAPON3': '0.450', 'weapon3': '1.132', 'weapon2': '1.296', 'DAMAGECOUNT': '1.689', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:44,883][2409105] DAMAGECOUNT value on done: 2576.0
[2023-02-25 12:56:44,884][2409105] Sum rewards: -2.250, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.008', 'AMMO5': '0.007', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'weapon5': '0.056', 'AMMO3': '0.110', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'HITCOUNT': '0.470', 'ARMOR': '0.495', 'WEAPON3': '0.650', 'weapon4': '0.666', 'weapon3': '1.266', 'DAMAGECOUNT': '1.380', 'weapon2': '1.580', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:44,990][2409079] DAMAGECOUNT value on done: 3193.0
[2023-02-25 12:56:44,990][2409079] Sum rewards: 3.750, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.364', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'AMMO4': '0.067', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'WEAPON4': '0.150', 'weapon4': '0.270', 'HITCOUNT': '0.460', 'WEAPON3': '0.700', 'ARMOR': '0.832', 'weapon2': '1.136', 'weapon3': '1.798', 'DAMAGECOUNT': '2.127', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:45,000][2409406] DAMAGECOUNT value on done: 2741.0
[2023-02-25 12:56:45,003][2409406] Sum rewards: 6.822, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.725', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'ARMOR': '0.030', 'weapon5': '0.050', 'AMMO3': '0.055', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.410', 'WEAPON3': '0.450', 'weapon4': '0.452', 'weapon2': '0.958', 'weapon3': '1.012', 'DAMAGECOUNT': '1.806', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:45,111][2409097] DAMAGECOUNT value on done: 3080.0
[2023-02-25 12:56:45,112][2409097] Sum rewards: 6.858, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.925', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.021', 'ARMOR': '0.052', 'weapon5': '0.090', 'AMMO3': '0.097', 'AMMO4': '0.104', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.630', 'WEAPON3': '0.650', 'HITCOUNT': '0.720', 'weapon4': '0.920', 'weapon3': '1.754', 'DAMAGECOUNT': '2.622', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:56:45,172][2409547] DAMAGECOUNT value on done: 3349.0
[2023-02-25 12:56:45,175][2409547] Sum rewards: 4.897, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.204', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.061', 'AMMO4': '0.117', 'WEAPON4': '0.250', 'HITCOUNT': '0.330', 'weapon4': '0.382', 'WEAPON3': '0.400', 'ARMOR': '0.459', 'weapon2': '0.960', 'DAMAGECOUNT': '0.987', 'weapon3': '1.534', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:45,210][2409104] DAMAGECOUNT value on done: 3308.0
[2023-02-25 12:56:45,211][2409104] Sum rewards: 6.567, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.076', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon7': '0.048', 'AMMO3': '0.061', 'AMMO4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.258', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.450', 'weapon4': '0.574', 'weapon2': '0.794', 'weapon3': '1.218', 'DAMAGECOUNT': '2.367', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:45,228][2409076] DAMAGECOUNT value on done: 2416.0
[2023-02-25 12:56:45,496][2409074] Updated weights for policy 0, policy_version 13991 (0.0012)
[2023-02-25 12:56:45,545][2409077] DAMAGECOUNT value on done: 2982.0
[2023-02-25 12:56:45,545][2409077] Sum rewards: 5.139, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.170', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'weapon7': '0.054', 'weapon5': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.200', 'HITCOUNT': '0.210', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'weapon3': '1.044', 'DAMAGECOUNT': '1.095', 'weapon2': '1.512', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:45,586][2409486] DAMAGECOUNT value on done: 2580.0
[2023-02-25 12:56:45,587][2409486] Sum rewards: 1.845, reward structure: {'DEATHCOUNT': '-5.250', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'HEALTH': '0.048', 'WEAPON5': '0.050', 'weapon7': '0.056', 'AMMO3': '0.060', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.230', 'WEAPON3': '0.350', 'weapon4': '0.356', 'ARMOR': '0.484', 'DAMAGECOUNT': '0.795', 'weapon3': '0.898', 'weapon2': '1.086', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:45,705][2409099] DAMAGECOUNT value on done: 2692.0
[2023-02-25 12:56:45,708][2409099] Sum rewards: 2.043, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.774', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO3': '0.033', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'HITCOUNT': '0.200', 'WEAPON3': '0.250', 'WEAPON4': '0.350', 'ARMOR': '0.440', 'weapon2': '0.806', 'weapon3': '0.826', 'weapon4': '0.832', 'DAMAGECOUNT': '0.921', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:45,871][2409565] DAMAGECOUNT value on done: 2429.0
[2023-02-25 12:56:45,871][2409565] Sum rewards: 0.414, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.746', 'AMMO5': '0.022', 'AMMO2': '0.027', 'weapon7': '0.050', 'WEAPON1': '0.060', 'weapon5': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.122', 'AMMO4': '0.135', 'HITCOUNT': '0.310', 'WEAPON4': '0.350', 'ARMOR': '0.412', 'WEAPON5': '0.500', 'weapon2': '0.522', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.885', 'weapon4': '1.022', 'weapon3': '1.512', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:45,919][2409389] DAMAGECOUNT value on done: 3031.0
[2023-02-25 12:56:45,958][2409548] DAMAGECOUNT value on done: 2661.0
[2023-02-25 12:56:45,961][2409548] Sum rewards: 4.707, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.418', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO3': '0.050', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'weapon5': '0.192', 'HITCOUNT': '0.230', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'weapon4': '0.518', 'weapon2': '1.038', 'weapon3': '1.222', 'ARMOR': '1.347', 'DAMAGECOUNT': '1.617', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:46,005][2409596] DAMAGECOUNT value on done: 2678.0
[2023-02-25 12:56:46,009][2409596] Sum rewards: 5.973, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.919', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO3': '0.050', 'WEAPON1': '0.050', 'AMMO4': '0.126', 'weapon5': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'HITCOUNT': '0.370', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.536', 'weapon2': '0.744', 'weapon3': '1.358', 'DAMAGECOUNT': '1.470', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:46,064][2409485] DAMAGECOUNT value on done: 3244.0
[2023-02-25 12:56:46,067][2409485] Sum rewards: 5.316, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.757', 'AMMO2': '0.007', 'AMMO5': '0.012', 'ARMOR': '0.024', 'WEAPON1': '0.030', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'weapon5': '0.172', 'weapon4': '0.280', 'WEAPON5': '0.300', 'HITCOUNT': '0.350', 'WEAPON3': '0.500', 'weapon3': '1.288', 'weapon2': '1.582', 'DAMAGECOUNT': '1.875', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:46,139][2409866] DAMAGECOUNT value on done: 2857.0
[2023-02-25 12:56:46,142][2409866] Sum rewards: -0.404, reward structure: {'DEATHCOUNT': '-11.250', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon5': '0.070', 'AMMO3': '0.142', 'AMMO4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'HEALTH': '0.401', 'HITCOUNT': '0.430', 'weapon4': '0.528', 'weapon2': '0.718', 'WEAPON3': '0.800', 'ARMOR': '0.835', 'DAMAGECOUNT': '1.635', 'weapon3': '2.134', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:56:46,669][2409405] DAMAGECOUNT value on done: 3375.0
[2023-02-25 12:56:46,671][2409405] Sum rewards: 10.217, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.422', 'AMMO2': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.021', 'AMMO3': '0.054', 'weapon5': '0.168', 'WEAPON5': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.520', 'ARMOR': '0.858', 'weapon3': '1.152', 'weapon2': '2.202', 'DAMAGECOUNT': '2.592', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:56:46,849][2409469] DAMAGECOUNT value on done: 2895.0
[2023-02-25 12:56:46,854][2409469] Sum rewards: 3.025, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.579', 'weapon7': '0.006', 'AMMO2': '0.016', 'AMMO5': '0.021', 'AMMO3': '0.067', 'AMMO4': '0.078', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.216', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'HITCOUNT': '0.450', 'ARMOR': '0.460', 'WEAPON3': '0.500', 'weapon4': '0.826', 'weapon2': '1.218', 'weapon3': '1.248', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.647'}
[2023-02-25 12:56:46,897][2409096] DAMAGECOUNT value on done: 3681.0
[2023-02-25 12:56:46,898][2409096] Sum rewards: 9.088, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.331', 'AMMO5': '0.007', 'AMMO2': '0.031', 'WEAPON1': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.156', 'weapon5': '0.184', 'WEAPON5': '0.250', 'weapon4': '0.378', 'WEAPON3': '0.450', 'WEAPON4': '0.450', 'HITCOUNT': '0.720', 'weapon2': '1.190', 'weapon3': '1.602', 'DAMAGECOUNT': '2.640', 'FRAGCOUNT': '9.000'}
[2023-02-25 12:56:47,052][2409407] DAMAGECOUNT value on done: 3589.0
[2023-02-25 12:56:47,055][2409407] Sum rewards: 8.598, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.110', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.013', 'weapon7': '0.056', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'weapon5': '0.156', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.410', 'WEAPON3': '0.450', 'HITCOUNT': '0.590', 'weapon3': '1.362', 'weapon2': '1.412', 'ARMOR': '2.159', 'DAMAGECOUNT': '2.613', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:56:47,087][2409074] Updated weights for policy 0, policy_version 14001 (0.0012)
[2023-02-25 12:56:47,186][2408954] Fps is (10 sec: 24985.2, 60 sec: 25395.1, 300 sec: 25506.3). Total num frames: 57352192. Throughput: 0: 6337.3. Samples: 14344536. Policy #0 lag: (min: 0.0, avg: 12.2, max: 25.0)
[2023-02-25 12:56:47,187][2408954] Avg episode reward: [(0, '3.698')]
[2023-02-25 12:56:47,448][2409075] DAMAGECOUNT value on done: 3372.0
[2023-02-25 12:56:47,451][2409075] Sum rewards: 4.047, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.222', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO5': '0.010', 'AMMO3': '0.040', 'weapon5': '0.092', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.300', 'HITCOUNT': '0.310', 'weapon4': '0.506', 'weapon2': '0.946', 'weapon3': '1.092', 'DAMAGECOUNT': '1.200', 'ARMOR': '1.434', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:47,825][2409355] DAMAGECOUNT value on done: 2915.0
[2023-02-25 12:56:47,828][2409355] Sum rewards: -0.688, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.046', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO5': '0.022', 'AMMO3': '0.053', 'weapon7': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.109', 'weapon5': '0.116', 'WEAPON4': '0.200', 'HITCOUNT': '0.280', 'weapon4': '0.290', 'WEAPON3': '0.300', 'WEAPON5': '0.450', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.104', 'weapon3': '1.130', 'weapon2': '1.392'}
[2023-02-25 12:56:48,131][2409373] DAMAGECOUNT value on done: 2972.0
[2023-02-25 12:56:48,133][2409373] Sum rewards: 10.283, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.016', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'weapon5': '0.120', 'WEAPON5': '0.200', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.490', 'HEALTH': '0.634', 'weapon2': '1.218', 'weapon3': '1.362', 'DAMAGECOUNT': '2.442', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:48,538][2409074] Updated weights for policy 0, policy_version 14011 (0.0012)
[2023-02-25 12:56:48,593][2409597] DAMAGECOUNT value on done: 3251.0
[2023-02-25 12:56:48,597][2409597] Sum rewards: 7.093, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.334', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon5': '0.074', 'AMMO3': '0.075', 'AMMO4': '0.267', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.436', 'WEAPON3': '0.500', 'HITCOUNT': '0.560', 'weapon4': '0.754', 'weapon2': '0.946', 'weapon3': '1.426', 'DAMAGECOUNT': '2.172', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:56:48,670][2409105] DAMAGECOUNT value on done: 2627.0
[2023-02-25 12:56:48,671][2409105] Sum rewards: 2.066, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.822', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO2': '0.044', 'AMMO3': '0.106', 'weapon5': '0.168', 'WEAPON4': '0.200', 'AMMO4': '0.218', 'WEAPON5': '0.350', 'HITCOUNT': '0.380', 'ARMOR': '0.440', 'weapon4': '0.482', 'WEAPON3': '0.650', 'weapon3': '1.280', 'weapon2': '1.550', 'DAMAGECOUNT': '1.725', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:56:48,821][2409406] DAMAGECOUNT value on done: 2238.0
[2023-02-25 12:56:48,822][2409406] Sum rewards: 3.699, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.265', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.012', 'ARMOR': '0.024', 'WEAPON1': '0.040', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'weapon5': '0.180', 'weapon4': '0.256', 'WEAPON5': '0.350', 'HITCOUNT': '0.500', 'WEAPON3': '0.650', 'weapon2': '1.438', 'weapon3': '1.584', 'DAMAGECOUNT': '1.767', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:48,895][2409079] DAMAGECOUNT value on done: 3843.0
[2023-02-25 12:56:48,896][2409079] Sum rewards: 10.380, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.049', 'AMMO3': '0.080', 'weapon7': '0.092', 'WEAPON4': '0.150', 'weapon5': '0.158', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'HEALTH': '0.292', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.350', 'weapon4': '0.366', 'ARMOR': '0.400', 'weapon3': '1.128', 'weapon2': '1.694', 'DAMAGECOUNT': '3.243', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:56:48,899][2409097] DAMAGECOUNT value on done: 3381.0
[2023-02-25 12:56:48,902][2409097] Sum rewards: 5.854, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.443', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon7': '0.062', 'AMMO3': '0.070', 'AMMO4': '0.079', 'weapon5': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.434', 'ARMOR': '0.476', 'WEAPON3': '0.500', 'HITCOUNT': '0.630', 'weapon2': '0.834', 'weapon3': '1.476', 'DAMAGECOUNT': '2.427', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:56:49,016][2409547] DAMAGECOUNT value on done: 2021.0
[2023-02-25 12:56:49,025][2409078] DAMAGECOUNT value on done: 2442.0
[2023-02-25 12:56:49,026][2409078] Sum rewards: 5.273, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.554', 'AMMO2': '0.004', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.017', 'weapon7': '0.080', 'AMMO3': '0.092', 'weapon5': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.310', 'weapon4': '0.354', 'ARMOR': '0.447', 'WEAPON3': '0.450', 'weapon2': '0.816', 'weapon3': '1.044', 'DAMAGECOUNT': '1.749', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:49,200][2409104] DAMAGECOUNT value on done: 2937.0
[2023-02-25 12:56:49,204][2409104] Sum rewards: 7.026, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.918', 'AMMO2': '0.017', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.082', 'AMMO4': '0.084', 'weapon5': '0.168', 'WEAPON4': '0.300', 'HITCOUNT': '0.440', 'WEAPON5': '0.450', 'weapon4': '0.484', 'ARMOR': '0.493', 'WEAPON3': '0.550', 'weapon3': '1.128', 'weapon2': '1.604', 'DAMAGECOUNT': '2.607', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:56:49,445][2409077] DAMAGECOUNT value on done: 2864.0
[2023-02-25 12:56:49,446][2409077] Sum rewards: 0.825, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.452', 'weapon5': '0.008', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.144', 'WEAPON5': '0.350', 'HITCOUNT': '0.390', 'WEAPON4': '0.400', 'weapon4': '0.638', 'WEAPON3': '0.900', 'weapon2': '0.994', 'DAMAGECOUNT': '1.335', 'ARMOR': '1.372', 'weapon3': '1.808', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:49,470][2409486] DAMAGECOUNT value on done: 2664.0
[2023-02-25 12:56:49,474][2409486] Sum rewards: 2.701, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.965', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.039', 'weapon7': '0.048', 'AMMO3': '0.050', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.330', 'WEAPON3': '0.350', 'WEAPON4': '0.350', 'ARMOR': '0.452', 'weapon4': '0.874', 'weapon3': '0.924', 'weapon2': '0.942', 'DAMAGECOUNT': '1.467', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:49,562][2409076] DAMAGECOUNT value on done: 2675.0
[2023-02-25 12:56:49,613][2409099] DAMAGECOUNT value on done: 4128.0
[2023-02-25 12:56:49,614][2409099] Sum rewards: 7.408, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.942', 'AMMO2': '0.006', 'AMMO5': '0.011', 'AMMO4': '0.030', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO3': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'ARMOR': '0.408', 'WEAPON3': '0.550', 'weapon4': '0.556', 'HITCOUNT': '0.630', 'weapon3': '1.338', 'weapon2': '1.364', 'DAMAGECOUNT': '2.436', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:56:49,656][2409548] DAMAGECOUNT value on done: 3013.0
[2023-02-25 12:56:49,657][2409548] Sum rewards: 5.183, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.628', 'AMMO2': '0.009', 'AMMO5': '0.012', 'AMMO4': '0.042', 'WEAPON1': '0.050', 'weapon5': '0.080', 'AMMO3': '0.105', 'WEAPON5': '0.300', 'HITCOUNT': '0.660', 'WEAPON3': '0.700', 'weapon2': '1.200', 'weapon3': '2.108', 'DAMAGECOUNT': '2.295', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:49,775][2409565] DAMAGECOUNT value on done: 4013.0
[2023-02-25 12:56:49,775][2409565] Sum rewards: 4.574, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.558', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'weapon7': '0.046', 'AMMO3': '0.053', 'AMMO4': '0.090', 'weapon5': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.246', 'HITCOUNT': '0.320', 'WEAPON3': '0.400', 'weapon3': '1.168', 'weapon2': '1.798', 'DAMAGECOUNT': '2.109', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:49,822][2409389] DAMAGECOUNT value on done: 3006.0
[2023-02-25 12:56:49,829][2409389] Sum rewards: 5.512, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.090', 'AMMO2': '0.018', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.050', 'AMMO3': '0.063', 'AMMO4': '0.089', 'WEAPON4': '0.250', 'weapon4': '0.296', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.690', 'ARMOR': '0.800', 'weapon3': '1.274', 'weapon2': '1.840', 'DAMAGECOUNT': '2.193', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:49,832][2409866] DAMAGECOUNT value on done: 3093.0
[2023-02-25 12:56:49,835][2409866] Sum rewards: 2.435, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.776', 'weapon4': '0.006', 'AMMO5': '0.011', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon7': '0.056', 'AMMO4': '0.073', 'AMMO3': '0.085', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.112', 'WEAPON5': '0.300', 'HITCOUNT': '0.350', 'WEAPON3': '0.600', 'ARMOR': '0.800', 'weapon2': '1.330', 'weapon3': '1.370', 'DAMAGECOUNT': '1.473', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:49,984][2409485] DAMAGECOUNT value on done: 3219.0
[2023-02-25 12:56:49,984][2409485] Sum rewards: 3.512, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.500', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.004', 'weapon5': '0.046', 'AMMO3': '0.052', 'WEAPON5': '0.100', 'weapon4': '0.144', 'WEAPON4': '0.200', 'WEAPON3': '0.400', 'HITCOUNT': '0.510', 'weapon3': '0.924', 'DAMAGECOUNT': '1.848', 'ARMOR': '1.858', 'weapon2': '1.922', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:49,994][2409596] DAMAGECOUNT value on done: 2664.0
[2023-02-25 12:56:49,998][2409596] Sum rewards: -0.920, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.240', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.021', 'weapon5': '0.024', 'WEAPON5': '0.050', 'weapon7': '0.058', 'AMMO3': '0.073', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.107', 'WEAPON4': '0.350', 'weapon4': '0.448', 'WEAPON3': '0.500', 'HITCOUNT': '0.540', 'FRAGCOUNT': '1.000', 'weapon3': '1.110', 'weapon2': '1.540', 'DAMAGECOUNT': '1.680'}
[2023-02-25 12:56:50,499][2409074] Updated weights for policy 0, policy_version 14021 (0.0012)
[2023-02-25 12:56:50,697][2409405] DAMAGECOUNT value on done: 2872.0
[2023-02-25 12:56:50,698][2409405] Sum rewards: 6.803, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.050', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO5': '0.015', 'WEAPON1': '0.050', 'AMMO3': '0.065', 'weapon5': '0.182', 'HITCOUNT': '0.370', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'weapon3': '1.292', 'DAMAGECOUNT': '1.584', 'weapon2': '1.782', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:50,777][2409469] DAMAGECOUNT value on done: 3281.0
[2023-02-25 12:56:50,777][2409469] Sum rewards: 3.932, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.420', 'AMMO5': '0.007', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'weapon7': '0.052', 'weapon5': '0.064', 'AMMO3': '0.073', 'AMMO4': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.340', 'WEAPON4': '0.450', 'ARMOR': '0.487', 'WEAPON3': '0.500', 'weapon4': '0.712', 'weapon2': '0.914', 'weapon3': '1.588', 'DAMAGECOUNT': '1.863', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:50,813][2409096] DAMAGECOUNT value on done: 3129.0
[2023-02-25 12:56:50,814][2409096] Sum rewards: 6.905, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.655', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.027', 'AMMO3': '0.040', 'weapon5': '0.092', 'WEAPON5': '0.150', 'weapon7': '0.176', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.300', 'WEAPON7': '0.400', 'HITCOUNT': '0.440', 'weapon4': '0.476', 'weapon2': '0.872', 'weapon3': '0.992', 'DAMAGECOUNT': '1.644', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:51,035][2409407] DAMAGECOUNT value on done: 2310.0
[2023-02-25 12:56:51,039][2409407] Sum rewards: 2.575, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.928', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.037', 'WEAPON1': '0.040', 'weapon7': '0.068', 'AMMO3': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.340', 'ARMOR': '0.457', 'weapon4': '0.522', 'WEAPON3': '0.550', 'weapon3': '0.910', 'weapon2': '1.150', 'DAMAGECOUNT': '1.155', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:51,529][2409074] Updated weights for policy 0, policy_version 14031 (0.0012)
[2023-02-25 12:56:51,552][2409355] DAMAGECOUNT value on done: 2714.0
[2023-02-25 12:56:52,022][2409373] DAMAGECOUNT value on done: 2614.0
[2023-02-25 12:56:52,026][2409373] Sum rewards: 1.750, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.400', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO3': '0.090', 'weapon5': '0.128', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'weapon4': '0.328', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.640', 'weapon3': '1.408', 'DAMAGECOUNT': '1.863', 'weapon2': '1.906', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:52,036][2409075] DAMAGECOUNT value on done: 3097.0
[2023-02-25 12:56:52,044][2409075] Sum rewards: 9.144, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.616', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.104', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'weapon4': '0.442', 'WEAPON3': '0.650', 'HITCOUNT': '0.660', 'weapon2': '1.396', 'ARMOR': '1.708', 'weapon3': '1.796', 'DAMAGECOUNT': '2.577', 'FRAGCOUNT': '6.500'}
[2023-02-25 12:56:52,186][2408954] Fps is (10 sec: 26623.5, 60 sec: 25395.1, 300 sec: 25534.0). Total num frames: 57483264. Throughput: 0: 6332.5. Samples: 14363292. Policy #0 lag: (min: 0.0, avg: 12.2, max: 25.0)
[2023-02-25 12:56:52,186][2408954] Avg episode reward: [(0, '3.860')]
[2023-02-25 12:56:52,452][2409597] DAMAGECOUNT value on done: 3136.0
[2023-02-25 12:56:52,453][2409597] Sum rewards: 1.380, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.460', 'AMMO2': '0.010', 'AMMO5': '0.010', 'weapon5': '0.010', 'ARMOR': '0.012', 'AMMO4': '0.048', 'weapon7': '0.072', 'AMMO3': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.250', 'WEAPON3': '0.500', 'weapon4': '0.566', 'weapon2': '0.778', 'DAMAGECOUNT': '0.870', 'weapon3': '1.334', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:52,556][2409105] DAMAGECOUNT value on done: 2659.0
[2023-02-25 12:56:52,557][2409105] Sum rewards: 3.989, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.366', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'weapon7': '0.048', 'AMMO3': '0.055', 'AMMO4': '0.059', 'weapon5': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'ARMOR': '0.416', 'HITCOUNT': '0.680', 'weapon4': '0.730', 'weapon3': '1.098', 'weapon2': '1.246', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.070'}
[2023-02-25 12:56:52,557][2409078] DAMAGECOUNT value on done: 3269.0
[2023-02-25 12:56:52,560][2409078] Sum rewards: 4.946, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.524', 'AMMO2': '0.004', 'AMMO4': '0.019', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.036', 'AMMO3': '0.056', 'weapon7': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.500', 'weapon4': '0.540', 'ARMOR': '0.913', 'weapon2': '1.044', 'weapon3': '1.046', 'DAMAGECOUNT': '2.541', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:52,672][2409097] DAMAGECOUNT value on done: 3150.0
[2023-02-25 12:56:52,673][2409097] Sum rewards: 5.656, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.882', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'WEAPON4': '0.050', 'AMMO3': '0.094', 'weapon5': '0.104', 'weapon4': '0.128', 'WEAPON5': '0.200', 'HITCOUNT': '0.430', 'WEAPON3': '0.600', 'ARMOR': '0.856', 'weapon3': '1.644', 'weapon2': '1.742', 'DAMAGECOUNT': '2.421', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:52,707][2409406] DAMAGECOUNT value on done: 2388.0
[2023-02-25 12:56:52,711][2409406] Sum rewards: 2.258, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.330', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.085', 'weapon7': '0.098', 'AMMO3': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'weapon4': '0.300', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.945', 'ARMOR': '0.955', 'weapon3': '1.224', 'weapon2': '1.660', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:52,712][2409079] DAMAGECOUNT value on done: 3124.0
[2023-02-25 12:56:52,715][2409079] Sum rewards: 2.157, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.870', 'AMMO4': '-0.059', 'AMMO2': '-0.012', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon7': '0.050', 'weapon5': '0.050', 'AMMO3': '0.058', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.170', 'WEAPON7': '0.200', 'weapon4': '0.240', 'ARMOR': '0.415', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.720', 'FRAGCOUNT': '1.000', 'weapon3': '1.106', 'weapon2': '1.246'}
[2023-02-25 12:56:52,841][2409104] DAMAGECOUNT value on done: 4187.0
[2023-02-25 12:56:52,842][2409104] Sum rewards: 8.275, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.860', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'weapon5': '0.056', 'AMMO4': '0.083', 'weapon7': '0.110', 'AMMO3': '0.123', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'AMMO6': '0.420', 'AMMO7': '0.420', 'HITCOUNT': '0.480', 'WEAPON7': '0.500', 'weapon4': '0.532', 'WEAPON3': '0.600', 'weapon2': '0.810', 'weapon3': '1.490', 'DAMAGECOUNT': '2.436', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:56:52,849][2409547] DAMAGECOUNT value on done: 2611.0
[2023-02-25 12:56:52,850][2409547] Sum rewards: 3.206, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.420', 'AMMO5': '0.003', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO3': '0.034', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon7': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON3': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.210', 'weapon4': '0.482', 'ARMOR': '0.487', 'weapon3': '0.648', 'DAMAGECOUNT': '0.696', 'weapon2': '0.998', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:53,136][2409486] DAMAGECOUNT value on done: 2392.0
[2023-02-25 12:56:53,140][2409486] Sum rewards: 3.358, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.450', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.052', 'ARMOR': '0.056', 'weapon7': '0.056', 'AMMO3': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.360', 'weapon4': '0.444', 'WEAPON3': '0.450', 'weapon3': '1.080', 'weapon2': '1.238', 'DAMAGECOUNT': '1.548', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:53,272][2409077] DAMAGECOUNT value on done: 2093.0
[2023-02-25 12:56:53,273][2409077] Sum rewards: 9.080, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO3': '0.058', 'AMMO4': '0.059', 'weapon5': '0.070', 'weapon7': '0.126', 'HEALTH': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.300', 'WEAPON7': '0.400', 'ARMOR': '0.412', 'weapon4': '0.464', 'HITCOUNT': '0.510', 'weapon3': '0.698', 'weapon2': '1.298', 'DAMAGECOUNT': '1.938', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:56:53,324][2409099] DAMAGECOUNT value on done: 2629.0
[2023-02-25 12:56:53,324][2409076] DAMAGECOUNT value on done: 2764.0
[2023-02-25 12:56:53,341][2409099] Sum rewards: 6.554, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.330', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'ARMOR': '0.048', 'AMMO3': '0.087', 'weapon5': '0.108', 'AMMO4': '0.114', 'WEAPON5': '0.200', 'weapon2': '0.488', 'WEAPON4': '0.500', 'HITCOUNT': '0.580', 'weapon4': '0.590', 'WEAPON3': '0.600', 'weapon3': '1.264', 'DAMAGECOUNT': '2.265', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:56:53,342][2409076] Sum rewards: 7.452, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.814', 'AMMO5': '0.017', 'AMMO2': '0.037', 'AMMO3': '0.094', 'weapon7': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.136', 'AMMO4': '0.187', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'ARMOR': '0.489', 'WEAPON3': '0.550', 'HITCOUNT': '0.560', 'weapon4': '0.600', 'weapon2': '1.008', 'weapon3': '1.160', 'DAMAGECOUNT': '2.730', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:56:53,353][2409565] DAMAGECOUNT value on done: 3001.0
[2023-02-25 12:56:53,355][2409565] Sum rewards: 6.145, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'AMMO2': '0.022', 'AMMO3': '0.057', 'weapon5': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.109', 'weapon4': '0.186', 'WEAPON3': '0.300', 'HEALTH': '0.532', 'HITCOUNT': '0.570', 'ARMOR': '0.852', 'weapon3': '1.062', 'weapon2': '1.742', 'DAMAGECOUNT': '2.664', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:53,416][2409548] DAMAGECOUNT value on done: 2656.0
[2023-02-25 12:56:53,416][2409548] Sum rewards: 6.685, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.380', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO3': '0.040', 'WEAPON1': '0.040', 'weapon7': '0.060', 'AMMO4': '0.065', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.270', 'WEAPON3': '0.350', 'weapon4': '0.500', 'DAMAGECOUNT': '0.813', 'ARMOR': '0.836', 'weapon3': '0.984', 'weapon2': '1.128', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:53,451][2409866] DAMAGECOUNT value on done: 3999.0
[2023-02-25 12:56:53,454][2409866] Sum rewards: 4.503, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.515', 'ARMOR': '0.008', 'AMMO2': '0.022', 'AMMO3': '0.040', 'AMMO4': '0.109', 'WEAPON4': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.510', 'weapon4': '0.516', 'weapon3': '0.948', 'weapon2': '1.178', 'DAMAGECOUNT': '1.737', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:53,585][2409596] DAMAGECOUNT value on done: 3212.0
[2023-02-25 12:56:53,586][2409596] Sum rewards: 6.031, reward structure: {'DEATHCOUNT': '-6.750', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO2': '0.025', 'weapon7': '0.052', 'weapon5': '0.086', 'AMMO3': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.124', 'HEALTH': '0.179', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'HITCOUNT': '0.400', 'ARMOR': '0.494', 'WEAPON3': '0.500', 'weapon3': '0.810', 'weapon4': '1.012', 'weapon2': '1.044', 'DAMAGECOUNT': '1.974', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:53,928][2409074] Updated weights for policy 0, policy_version 14041 (0.0012)
[2023-02-25 12:56:54,213][2409389] DAMAGECOUNT value on done: 2813.0
[2023-02-25 12:56:54,518][2409080] DAMAGECOUNT value on done: 3621.0
[2023-02-25 12:56:54,519][2409080] Sum rewards: 11.322, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.522', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'AMMO3': '0.076', 'weapon7': '0.120', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon5': '0.308', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'WEAPON4': '0.500', 'ARMOR': '0.503', 'HITCOUNT': '0.520', 'weapon2': '0.646', 'weapon4': '0.746', 'weapon3': '0.992', 'DAMAGECOUNT': '3.270', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:56:54,641][2409407] DAMAGECOUNT value on done: 2595.0
[2023-02-25 12:56:54,644][2409407] Sum rewards: 0.122, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.021', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.042', 'AMMO3': '0.065', 'weapon7': '0.084', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.230', 'WEAPON4': '0.250', 'ARMOR': '0.498', 'WEAPON3': '0.550', 'weapon2': '0.556', 'weapon4': '0.716', 'DAMAGECOUNT': '1.089', 'weapon3': '1.228', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:54,646][2409469] DAMAGECOUNT value on done: 3852.0
[2023-02-25 12:56:54,648][2409469] Sum rewards: 8.207, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.074', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.113', 'WEAPON4': '0.200', 'weapon4': '0.236', 'HITCOUNT': '0.560', 'WEAPON3': '0.700', 'ARMOR': '1.259', 'weapon3': '1.382', 'weapon2': '1.718', 'DAMAGECOUNT': '1.977', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:56:54,665][2409096] DAMAGECOUNT value on done: 2822.0
[2023-02-25 12:56:54,666][2409096] Sum rewards: 7.590, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.758', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'ARMOR': '0.044', 'weapon7': '0.050', 'AMMO3': '0.076', 'AMMO4': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.370', 'weapon4': '0.478', 'WEAPON3': '0.500', 'weapon2': '0.796', 'weapon3': '1.440', 'DAMAGECOUNT': '2.400', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:56:54,743][2409405] DAMAGECOUNT value on done: 3816.0
[2023-02-25 12:56:54,745][2409405] Sum rewards: 8.343, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.872', 'weapon7': '0.002', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.010', 'WEAPON1': '0.050', 'AMMO3': '0.066', 'weapon5': '0.072', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.226', 'HITCOUNT': '0.450', 'WEAPON3': '0.500', 'ARMOR': '0.884', 'weapon3': '1.226', 'DAMAGECOUNT': '2.043', 'weapon2': '2.076', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:56:54,954][2409074] Updated weights for policy 0, policy_version 14051 (0.0012)
[2023-02-25 12:56:55,272][2409355] DAMAGECOUNT value on done: 2825.0
[2023-02-25 12:56:55,273][2409355] Sum rewards: 2.597, reward structure: {'DEATHCOUNT': '-4.500', 'FRAGCOUNT': '0.000', 'AMMO2': '0.009', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'weapon5': '0.028', 'AMMO4': '0.045', 'AMMO3': '0.060', 'weapon7': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.280', 'WEAPON3': '0.400', 'HEALTH': '0.438', 'HITCOUNT': '0.540', 'weapon2': '1.234', 'weapon3': '1.294', 'DAMAGECOUNT': '1.857'}
[2023-02-25 12:56:55,691][2409373] DAMAGECOUNT value on done: 2174.0
[2023-02-25 12:56:55,692][2409373] Sum rewards: 5.468, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.608', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.058', 'weapon7': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.330', 'weapon4': '0.346', 'WEAPON3': '0.350', 'ARMOR': '0.851', 'weapon3': '1.022', 'DAMAGECOUNT': '1.080', 'weapon2': '1.376', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:56,194][2409075] DAMAGECOUNT value on done: 2172.0
[2023-02-25 12:56:56,195][2409075] Sum rewards: 1.718, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'weapon5': '0.012', 'ARMOR': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'AMMO3': '0.086', 'HEALTH': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'HITCOUNT': '0.270', 'WEAPON3': '0.550', 'weapon2': '0.678', 'weapon4': '0.784', 'DAMAGECOUNT': '1.071', 'weapon3': '1.598', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:56:56,259][2409097] DAMAGECOUNT value on done: 2654.0
[2023-02-25 12:56:56,259][2409097] Sum rewards: 4.119, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.190', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'weapon7': '0.052', 'AMMO4': '0.054', 'AMMO3': '0.073', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.178', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.443', 'WEAPON3': '0.450', 'weapon4': '0.458', 'HITCOUNT': '0.500', 'weapon3': '1.170', 'weapon2': '1.404', 'DAMAGECOUNT': '2.556', 'FRAGCOUNT': '4.500'}
[2023-02-25 12:56:56,370][2409105] DAMAGECOUNT value on done: 3006.0
[2023-02-25 12:56:56,371][2409105] Sum rewards: 4.838, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.100', 'AMMO2': '0.012', 'AMMO5': '0.026', 'WEAPON1': '0.030', 'AMMO4': '0.062', 'weapon7': '0.080', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.132', 'AMMO3': '0.135', 'WEAPON7': '0.200', 'weapon4': '0.266', 'ARMOR': '0.471', 'WEAPON5': '0.550', 'HITCOUNT': '0.550', 'weapon2': '0.786', 'WEAPON3': '0.900', 'weapon3': '2.080', 'DAMAGECOUNT': '2.817', 'FRAGCOUNT': '5.500'}
[2023-02-25 12:56:56,404][2409079] DAMAGECOUNT value on done: 3204.0
[2023-02-25 12:56:56,405][2409079] Sum rewards: 5.697, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.492', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.027', 'AMMO3': '0.040', 'WEAPON4': '0.050', 'weapon5': '0.178', 'weapon4': '0.238', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'HITCOUNT': '0.310', 'ARMOR': '0.444', 'weapon3': '0.832', 'weapon2': '1.346', 'DAMAGECOUNT': '1.659', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:56,476][2409104] DAMAGECOUNT value on done: 3063.0
[2023-02-25 12:56:56,481][2409104] Sum rewards: 3.983, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-3.140', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.012', 'AMMO3': '0.072', 'weapon5': '0.152', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'ARMOR': '0.465', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'weapon4': '0.662', 'weapon3': '1.160', 'weapon2': '1.736', 'DAMAGECOUNT': '2.919', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:56:56,507][2409547] DAMAGECOUNT value on done: 3237.0
[2023-02-25 12:56:56,508][2409547] Sum rewards: 8.092, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.623', 'AMMO2': '0.014', 'AMMO5': '0.014', 'WEAPON1': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.098', 'weapon5': '0.144', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.540', 'WEAPON3': '0.700', 'weapon3': '1.782', 'weapon2': '1.802', 'DAMAGECOUNT': '2.502', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:56:56,633][2409406] DAMAGECOUNT value on done: 2689.0
[2023-02-25 12:56:56,635][2409406] Sum rewards: -0.067, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.742', 'AMMO5': '0.014', 'AMMO2': '0.019', 'WEAPON1': '0.060', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'AMMO3': '0.130', 'weapon5': '0.134', 'weapon4': '0.150', 'HITCOUNT': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.862', 'WEAPON3': '0.950', 'weapon2': '1.234', 'DAMAGECOUNT': '1.476', 'FRAGCOUNT': '2.000', 'weapon3': '2.148'}
[2023-02-25 12:56:56,821][2409074] Updated weights for policy 0, policy_version 14061 (0.0013)
[2023-02-25 12:56:56,959][2409486] DAMAGECOUNT value on done: 2663.0
[2023-02-25 12:56:56,960][2409486] Sum rewards: 1.878, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.856', 'AMMO2': '0.008', 'AMMO5': '0.012', 'weapon4': '0.036', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'weapon5': '0.096', 'AMMO3': '0.109', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'HITCOUNT': '0.400', 'WEAPON3': '0.700', 'weapon2': '1.340', 'weapon3': '1.454', 'DAMAGECOUNT': '1.590', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:57,015][2409076] DAMAGECOUNT value on done: 3087.0
[2023-02-25 12:56:57,016][2409076] Sum rewards: 4.070, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.514', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.042', 'AMMO3': '0.044', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.210', 'WEAPON3': '0.250', 'weapon4': '0.320', 'WEAPON4': '0.350', 'HITCOUNT': '0.370', 'weapon3': '0.858', 'weapon2': '1.518', 'ARMOR': '1.676', 'DAMAGECOUNT': '1.767', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:57,186][2408954] Fps is (10 sec: 24985.9, 60 sec: 25258.7, 300 sec: 25506.3). Total num frames: 57602048. Throughput: 0: 6346.9. Samples: 14401488. Policy #0 lag: (min: 0.0, avg: 12.7, max: 24.0)
[2023-02-25 12:56:57,186][2408954] Avg episode reward: [(0, '4.336')]
[2023-02-25 12:56:57,188][2409565] DAMAGECOUNT value on done: 3031.0
[2023-02-25 12:56:57,190][2409033] Saving new best policy, reward=4.336!
[2023-02-25 12:56:57,191][2409866] DAMAGECOUNT value on done: 3618.0
[2023-02-25 12:56:57,195][2409866] Sum rewards: 3.208, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.082', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.031', 'AMMO3': '0.056', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'weapon4': '0.236', 'WEAPON3': '0.350', 'HITCOUNT': '0.390', 'weapon3': '0.652', 'ARMOR': '1.279', 'weapon2': '1.536', 'DAMAGECOUNT': '1.677', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:57,198][2409077] DAMAGECOUNT value on done: 3132.0
[2023-02-25 12:56:57,201][2409077] Sum rewards: 1.998, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.390', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO5': '0.028', 'ARMOR': '0.032', 'weapon5': '0.032', 'AMMO4': '0.082', 'AMMO3': '0.160', 'WEAPON4': '0.250', 'weapon4': '0.328', 'HITCOUNT': '0.470', 'WEAPON5': '0.550', 'WEAPON3': '0.950', 'weapon2': '0.998', 'weapon3': '2.098', 'DAMAGECOUNT': '2.124', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:57,207][2409596] DAMAGECOUNT value on done: 3358.0
[2023-02-25 12:56:57,210][2409596] Sum rewards: 9.162, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.663', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.040', 'AMMO4': '0.047', 'weapon5': '0.052', 'AMMO3': '0.086', 'WEAPON5': '0.150', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.750', 'weapon3': '1.344', 'weapon2': '1.536', 'DAMAGECOUNT': '2.802', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:56:57,244][2409099] DAMAGECOUNT value on done: 3018.0
[2023-02-25 12:56:57,244][2409099] Sum rewards: 4.976, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.704', 'AMMO5': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.074', 'AMMO3': '0.101', 'weapon5': '0.120', 'WEAPON5': '0.250', 'HITCOUNT': '0.460', 'WEAPON3': '0.650', 'weapon2': '1.448', 'weapon3': '1.474', 'DAMAGECOUNT': '2.295', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:57,510][2409078] DAMAGECOUNT value on done: 2883.0
[2023-02-25 12:56:57,513][2409078] Sum rewards: -2.210, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.480', 'AMMO5': '0.010', 'AMMO2': '0.014', 'ARMOR': '0.032', 'WEAPON1': '0.050', 'AMMO4': '0.071', 'weapon5': '0.102', 'AMMO3': '0.139', 'weapon4': '0.168', 'WEAPON4': '0.200', 'HITCOUNT': '0.220', 'WEAPON5': '0.300', 'WEAPON3': '0.950', 'DAMAGECOUNT': '0.963', 'weapon2': '1.196', 'weapon3': '1.854', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:58,306][2409407] DAMAGECOUNT value on done: 2794.0
[2023-02-25 12:56:58,309][2409407] Sum rewards: 5.300, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.424', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.058', 'weapon7': '0.074', 'AMMO4': '0.087', 'AMMO3': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.200', 'WEAPON4': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.600', 'weapon4': '0.700', 'ARMOR': '0.917', 'weapon3': '0.982', 'weapon2': '1.208', 'DAMAGECOUNT': '2.664', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:58,393][2409074] Updated weights for policy 0, policy_version 14071 (0.0012)
[2023-02-25 12:56:58,396][2409469] DAMAGECOUNT value on done: 2501.0
[2023-02-25 12:56:58,399][2409469] Sum rewards: 3.898, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.070', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.061', 'WEAPON4': '0.100', 'weapon4': '0.240', 'WEAPON3': '0.400', 'HITCOUNT': '0.420', 'ARMOR': '0.455', 'weapon3': '0.758', 'DAMAGECOUNT': '1.350', 'weapon2': '1.372', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:58,421][2409096] DAMAGECOUNT value on done: 2204.0
[2023-02-25 12:56:58,422][2409096] Sum rewards: 3.910, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.590', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon7': '0.050', 'AMMO3': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.128', 'WEAPON7': '0.200', 'HITCOUNT': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'ARMOR': '0.576', 'weapon4': '0.726', 'weapon2': '0.896', 'DAMAGECOUNT': '1.110', 'weapon3': '1.328', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:56:58,468][2409080] DAMAGECOUNT value on done: 2765.0
[2023-02-25 12:56:58,471][2409080] Sum rewards: 6.428, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.076', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'AMMO3': '0.068', 'weapon4': '0.092', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon5': '0.204', 'WEAPON3': '0.350', 'HITCOUNT': '0.460', 'weapon3': '1.344', 'DAMAGECOUNT': '1.680', 'weapon2': '1.986', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:58,716][2409033] Signal inference workers to stop experience collection... (1750 times)
[2023-02-25 12:56:58,720][2409033] Signal inference workers to resume experience collection... (1750 times)
[2023-02-25 12:56:58,735][2409389] DAMAGECOUNT value on done: 2974.0
[2023-02-25 12:56:58,736][2409389] Sum rewards: 6.242, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.482', 'AMMO2': '0.008', 'WEAPON1': '0.030', 'AMMO4': '0.041', 'AMMO3': '0.067', 'WEAPON4': '0.200', 'HITCOUNT': '0.410', 'WEAPON3': '0.450', 'weapon4': '0.452', 'ARMOR': '0.501', 'weapon3': '1.086', 'DAMAGECOUNT': '1.485', 'weapon2': '1.494', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:58,743][2409074] InferenceWorker_p0-w0: stopping experience collection (1750 times)
[2023-02-25 12:56:58,743][2409074] InferenceWorker_p0-w0: resuming experience collection (1750 times)
[2023-02-25 12:56:58,908][2409355] DAMAGECOUNT value on done: 3393.0
[2023-02-25 12:56:58,911][2409355] Sum rewards: 6.757, reward structure: {'DEATHCOUNT': '-5.250', 'weapon4': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO3': '0.067', 'WEAPON4': '0.100', 'weapon5': '0.114', 'AMMO4': '0.126', 'HEALTH': '0.172', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'HITCOUNT': '0.470', 'ARMOR': '0.846', 'weapon3': '1.252', 'weapon2': '1.306', 'DAMAGECOUNT': '1.899', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:56:59,129][2409405] DAMAGECOUNT value on done: 2045.0
[2023-02-25 12:56:59,132][2409405] Sum rewards: 6.845, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.060', 'HEALTH': '0.072', 'weapon7': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.160', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.410', 'weapon4': '0.688', 'ARMOR': '0.931', 'weapon2': '1.180', 'DAMAGECOUNT': '1.413', 'weapon3': '1.464', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:56:59,226][2409373] DAMAGECOUNT value on done: 3131.0
[2023-02-25 12:56:59,229][2409373] Sum rewards: 1.775, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.894', 'AMMO2': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.018', 'ARMOR': '0.036', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'weapon5': '0.144', 'WEAPON5': '0.200', 'weapon4': '0.254', 'HITCOUNT': '0.500', 'WEAPON3': '0.700', 'weapon2': '1.184', 'weapon3': '1.798', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:56:59,846][2409074] Updated weights for policy 0, policy_version 14081 (0.0012)
[2023-02-25 12:57:00,066][2409105] DAMAGECOUNT value on done: 3132.0
[2023-02-25 12:57:00,067][2409105] Sum rewards: 10.327, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'HEALTH': '0.031', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.071', 'WEAPON4': '0.100', 'weapon4': '0.150', 'WEAPON3': '0.400', 'HITCOUNT': '0.590', 'ARMOR': '0.868', 'weapon2': '1.406', 'weapon3': '1.412', 'DAMAGECOUNT': '2.637', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:57:00,097][2409104] DAMAGECOUNT value on done: 3298.0
[2023-02-25 12:57:00,100][2409104] Sum rewards: 3.736, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.695', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.048', 'AMMO3': '0.071', 'weapon5': '0.076', 'weapon7': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.410', 'ARMOR': '0.455', 'HITCOUNT': '0.470', 'WEAPON3': '0.500', 'weapon3': '1.122', 'weapon2': '1.210', 'DAMAGECOUNT': '1.818', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:57:00,123][2409079] DAMAGECOUNT value on done: 2860.0
[2023-02-25 12:57:00,124][2409079] Sum rewards: 7.012, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.508', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'AMMO2': '0.044', 'AMMO4': '0.219', 'WEAPON3': '0.250', 'weapon5': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.410', 'weapon4': '0.528', 'weapon3': '0.782', 'ARMOR': '1.271', 'weapon2': '1.888', 'DAMAGECOUNT': '1.896', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:57:00,378][2409406] DAMAGECOUNT value on done: 3462.0
[2023-02-25 12:57:00,382][2409406] Sum rewards: 6.969, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.534', 'AMMO2': '0.012', 'AMMO5': '0.012', 'AMMO4': '0.057', 'AMMO3': '0.076', 'WEAPON4': '0.150', 'weapon5': '0.236', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.480', 'weapon4': '0.494', 'weapon2': '0.898', 'ARMOR': '0.944', 'weapon3': '1.118', 'DAMAGECOUNT': '2.775', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:57:00,478][2409097] DAMAGECOUNT value on done: 1972.0
[2023-02-25 12:57:00,479][2409097] Sum rewards: 3.957, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.227', 'AMMO2': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.048', 'AMMO3': '0.110', 'weapon5': '0.116', 'WEAPON4': '0.200', 'weapon4': '0.302', 'WEAPON5': '0.350', 'HITCOUNT': '0.390', 'ARMOR': '0.502', 'WEAPON3': '0.700', 'weapon2': '1.358', 'weapon3': '1.408', 'DAMAGECOUNT': '1.425', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:57:00,567][2409076] DAMAGECOUNT value on done: 3251.0
[2023-02-25 12:57:00,570][2409076] Sum rewards: 2.535, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.780', 'AMMO2': '0.005', 'AMMO5': '0.010', 'weapon7': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.026', 'AMMO3': '0.053', 'WEAPON4': '0.100', 'weapon5': '0.130', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.270', 'weapon4': '0.310', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon3': '0.994', 'DAMAGECOUNT': '1.209', 'weapon2': '1.724', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:57:00,729][2409075] DAMAGECOUNT value on done: 2909.0
[2023-02-25 12:57:00,732][2409075] Sum rewards: 0.411, reward structure: {'DEATHCOUNT': '-7.500', 'ARMOR': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'weapon4': '0.072', 'AMMO4': '0.080', 'weapon5': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'WEAPON5': '0.200', 'HITCOUNT': '0.280', 'HEALTH': '0.288', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.906', 'weapon2': '1.382', 'weapon3': '1.764', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:57:00,780][2409547] DAMAGECOUNT value on done: 2765.0
[2023-02-25 12:57:00,781][2409547] Sum rewards: 3.887, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO3': '0.050', 'AMMO4': '0.084', 'weapon5': '0.196', 'WEAPON5': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.270', 'HEALTH': '0.330', 'DAMAGECOUNT': '0.825', 'FRAGCOUNT': '1.000', 'weapon3': '1.138', 'ARMOR': '1.295', 'weapon2': '1.962'}
[2023-02-25 12:57:00,787][2409596] DAMAGECOUNT value on done: 3046.0
[2023-02-25 12:57:00,787][2409596] Sum rewards: 0.675, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.526', 'AMMO5': '0.022', 'AMMO2': '0.027', 'AMMO3': '0.093', 'AMMO4': '0.133', 'weapon5': '0.134', 'WEAPON4': '0.250', 'weapon4': '0.396', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'HITCOUNT': '0.560', 'WEAPON3': '0.700', 'weapon2': '1.466', 'weapon3': '1.538', 'DAMAGECOUNT': '2.031', 'FRAGCOUNT': '4.500'}
[2023-02-25 12:57:00,798][2409866] DAMAGECOUNT value on done: 2932.0
[2023-02-25 12:57:00,801][2409866] Sum rewards: 5.352, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.088', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'weapon4': '0.044', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.107', 'AMMO4': '0.107', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.590', 'WEAPON3': '0.750', 'ARMOR': '1.200', 'weapon2': '1.498', 'weapon3': '1.698', 'DAMAGECOUNT': '2.130', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:57:00,956][2409077] DAMAGECOUNT value on done: 3479.0
[2023-02-25 12:57:00,957][2409077] Sum rewards: 7.509, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.938', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO3': '0.095', 'weapon5': '0.138', 'AMMO4': '0.143', 'WEAPON4': '0.250', 'weapon4': '0.306', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.610', 'WEAPON3': '0.700', 'weapon2': '1.242', 'weapon3': '1.944', 'DAMAGECOUNT': '2.475', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:57:00,975][2409486] DAMAGECOUNT value on done: 3333.0
[2023-02-25 12:57:00,979][2409486] Sum rewards: 11.423, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.076', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'weapon5': '0.128', 'WEAPON5': '0.150', 'weapon4': '0.468', 'WEAPON3': '0.500', 'ARMOR': '0.800', 'HITCOUNT': '0.800', 'weapon2': '0.974', 'weapon3': '1.420', 'DAMAGECOUNT': '3.474', 'FRAGCOUNT': '8.500'}
[2023-02-25 12:57:01,032][2409078] DAMAGECOUNT value on done: 3018.0
[2023-02-25 12:57:01,036][2409078] Sum rewards: -0.569, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.725', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'weapon4': '0.072', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'weapon5': '0.114', 'WEAPON5': '0.150', 'HITCOUNT': '0.290', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'weapon3': '1.410', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.572', 'weapon2': '1.866'}
[2023-02-25 12:57:01,285][2409099] DAMAGECOUNT value on done: 3579.0
[2023-02-25 12:57:01,286][2409099] Sum rewards: 3.552, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.240', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'weapon4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'weapon5': '0.122', 'WEAPON5': '0.400', 'HITCOUNT': '0.460', 'WEAPON3': '0.650', 'ARMOR': '0.843', 'weapon2': '1.110', 'DAMAGECOUNT': '1.824', 'weapon3': '2.286', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:57:01,716][2409074] Updated weights for policy 0, policy_version 14091 (0.0013)
[2023-02-25 12:57:01,911][2409469] DAMAGECOUNT value on done: 2515.0
[2023-02-25 12:57:01,914][2409469] Sum rewards: 3.693, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.965', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.038', 'weapon7': '0.066', 'AMMO3': '0.069', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.242', 'WEAPON5': '0.250', 'HITCOUNT': '0.420', 'WEAPON3': '0.500', 'weapon2': '1.152', 'weapon3': '1.252', 'DAMAGECOUNT': '1.614', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:57:01,954][2409096] DAMAGECOUNT value on done: 3184.0
[2023-02-25 12:57:01,955][2409096] Sum rewards: 8.677, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'AMMO2': '0.031', 'AMMO3': '0.073', 'HEALTH': '0.078', 'AMMO4': '0.153', 'weapon5': '0.242', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'WEAPON5': '0.450', 'HITCOUNT': '0.470', 'weapon4': '0.484', 'ARMOR': '0.892', 'weapon2': '1.336', 'weapon3': '1.594', 'DAMAGECOUNT': '2.622', 'FRAGCOUNT': '5.500'}
[2023-02-25 12:57:02,012][2409407] DAMAGECOUNT value on done: 2512.0
[2023-02-25 12:57:02,013][2409407] Sum rewards: 3.703, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'weapon7': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.101', 'WEAPON5': '0.200', 'weapon5': '0.216', 'weapon4': '0.218', 'HITCOUNT': '0.330', 'WEAPON3': '0.350', 'ARMOR': '0.504', 'HEALTH': '1.064', 'DAMAGECOUNT': '1.185', 'weapon3': '1.422', 'weapon2': '1.582', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:57:02,186][2408954] Fps is (10 sec: 24576.5, 60 sec: 25327.0, 300 sec: 25506.3). Total num frames: 57729024. Throughput: 0: 6368.3. Samples: 14440272. Policy #0 lag: (min: 0.0, avg: 12.7, max: 24.0)
[2023-02-25 12:57:02,186][2408954] Avg episode reward: [(0, '4.599')]
[2023-02-25 12:57:02,187][2409033] Saving new best policy, reward=4.599!
[2023-02-25 12:57:02,537][2409355] DAMAGECOUNT value on done: 2437.0
[2023-02-25 12:57:02,538][2409355] Sum rewards: -0.743, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.257', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.029', 'weapon5': '0.046', 'weapon7': '0.050', 'AMMO3': '0.089', 'AMMO4': '0.143', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.300', 'weapon4': '0.340', 'AMMO6': '0.420', 'AMMO7': '0.420', 'WEAPON7': '0.500', 'WEAPON3': '0.600', 'ARMOR': '0.860', 'FRAGCOUNT': '1.000', 'weapon3': '1.212', 'DAMAGECOUNT': '1.416', 'weapon2': '1.422'}
[2023-02-25 12:57:02,745][2409373] DAMAGECOUNT value on done: 2611.0
[2023-02-25 12:57:02,746][2409373] Sum rewards: 2.484, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.895', 'AMMO5': '0.003', 'AMMO2': '0.004', 'WEAPON1': '0.020', 'AMMO4': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.238', 'HITCOUNT': '0.540', 'WEAPON3': '0.600', 'weapon2': '1.648', 'weapon3': '1.816', 'DAMAGECOUNT': '1.950', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:57:02,786][2409074] Updated weights for policy 0, policy_version 14101 (0.0012)
[2023-02-25 12:57:02,863][2409080] DAMAGECOUNT value on done: 2840.0
[2023-02-25 12:57:02,868][2409080] Sum rewards: -2.844, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.754', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'weapon5': '0.034', 'AMMO2': '0.036', 'AMMO3': '0.110', 'AMMO4': '0.180', 'HITCOUNT': '0.230', 'ARMOR': '0.493', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.618', 'weapon2': '0.696', 'DAMAGECOUNT': '0.846', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.922'}
[2023-02-25 12:57:02,878][2409405] DAMAGECOUNT value on done: 3154.0
[2023-02-25 12:57:02,881][2409405] Sum rewards: 1.119, reward structure: {'DEATHCOUNT': '-4.500', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.091', 'AMMO5': '0.007', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'AMMO3': '0.070', 'AMMO4': '0.113', 'weapon7': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.122', 'WEAPON4': '0.150', 'HITCOUNT': '0.190', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.324', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.510', 'ARMOR': '0.894', 'weapon2': '1.104', 'weapon3': '1.518'}
[2023-02-25 12:57:03,592][2409389] DAMAGECOUNT value on done: 3911.0
[2023-02-25 12:57:03,595][2409389] Sum rewards: 3.255, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.955', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon5': '0.058', 'AMMO3': '0.090', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'WEAPON4': '0.400', 'HITCOUNT': '0.470', 'WEAPON3': '0.500', 'weapon4': '0.732', 'weapon2': '1.162', 'weapon3': '1.178', 'ARMOR': '1.368', 'DAMAGECOUNT': '1.680', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:57:03,996][2409079] DAMAGECOUNT value on done: 2600.0
[2023-02-25 12:57:03,997][2409079] Sum rewards: 2.690, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.815', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO3': '0.072', 'weapon5': '0.080', 'WEAPON5': '0.100', 'HITCOUNT': '0.200', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.708', 'ARMOR': '0.891', 'weapon3': '1.154', 'weapon2': '1.560', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:57:04,085][2409104] DAMAGECOUNT value on done: 2213.0
[2023-02-25 12:57:04,086][2409104] Sum rewards: 6.057, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.610', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.051', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.160', 'WEAPON5': '0.250', 'HITCOUNT': '0.330', 'WEAPON3': '0.400', 'ARMOR': '0.500', 'weapon3': '1.088', 'DAMAGECOUNT': '1.272', 'weapon2': '1.906', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:57:04,137][2409076] DAMAGECOUNT value on done: 3441.0
[2023-02-25 12:57:04,137][2409076] Sum rewards: 5.438, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.698', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.030', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.108', 'weapon4': '0.138', 'weapon5': '0.206', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.710', 'weapon2': '1.318', 'weapon3': '1.800', 'DAMAGECOUNT': '2.520', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:57:04,214][2409406] DAMAGECOUNT value on done: 2691.0
[2023-02-25 12:57:04,215][2409406] Sum rewards: 0.558, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.445', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.035', 'WEAPON5': '0.050', 'AMMO3': '0.063', 'weapon5': '0.072', 'WEAPON4': '0.150', 'weapon4': '0.320', 'HITCOUNT': '0.430', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.299', 'weapon3': '1.422', 'weapon2': '1.432', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:57:04,390][2409097] DAMAGECOUNT value on done: 3025.0
[2023-02-25 12:57:04,392][2409097] Sum rewards: 5.957, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.267', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'AMMO3': '0.088', 'weapon7': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.144', 'AMMO4': '0.161', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'HITCOUNT': '0.420', 'ARMOR': '0.451', 'WEAPON3': '0.550', 'weapon4': '0.814', 'weapon2': '0.980', 'weapon3': '1.048', 'DAMAGECOUNT': '3.213', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:57:04,655][2409866] DAMAGECOUNT value on done: 2961.0
[2023-02-25 12:57:04,658][2409866] Sum rewards: 5.692, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.554', 'AMMO5': '0.025', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'AMMO3': '0.089', 'weapon5': '0.098', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'ARMOR': '0.428', 'weapon4': '0.428', 'WEAPON5': '0.500', 'HITCOUNT': '0.530', 'WEAPON3': '0.600', 'weapon2': '1.202', 'weapon3': '1.840', 'DAMAGECOUNT': '2.172', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:57:04,731][2409547] DAMAGECOUNT value on done: 2628.0
[2023-02-25 12:57:04,734][2409077] DAMAGECOUNT value on done: 2369.0
[2023-02-25 12:57:04,732][2409547] Sum rewards: 4.715, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.388', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.075', 'AMMO4': '0.101', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.457', 'HITCOUNT': '0.510', 'weapon4': '0.698', 'weapon3': '0.758', 'weapon2': '1.536', 'DAMAGECOUNT': '1.875', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:57:04,737][2409077] Sum rewards: 4.753, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.865', 'AMMO4': '-0.055', 'AMMO2': '-0.011', 'AMMO5': '0.010', 'AMMO3': '0.030', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon7': '0.056', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.132', 'weapon4': '0.156', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.250', 'WEAPON5': '0.300', 'weapon3': '0.594', 'ARMOR': '1.028', 'DAMAGECOUNT': '1.248', 'weapon2': '1.850', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:57:04,867][2409078] DAMAGECOUNT value on done: 2701.0
[2023-02-25 12:57:04,871][2409078] Sum rewards: 3.947, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.564', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO3': '0.034', 'WEAPON1': '0.040', 'weapon7': '0.050', 'weapon5': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.132', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.390', 'WEAPON4': '0.450', 'ARMOR': '0.488', 'weapon4': '0.518', 'weapon3': '0.706', 'weapon2': '1.236', 'DAMAGECOUNT': '1.992', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:57:05,104][2409074] Updated weights for policy 0, policy_version 14111 (0.0012)
[2023-02-25 12:57:05,208][2409486] DAMAGECOUNT value on done: 3302.0
[2023-02-25 12:57:05,209][2409486] Sum rewards: 3.658, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.196', 'AMMO2': '0.010', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'AMMO4': '0.051', 'AMMO3': '0.070', 'weapon5': '0.148', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'HITCOUNT': '0.460', 'WEAPON3': '0.500', 'weapon4': '0.640', 'weapon2': '1.046', 'weapon3': '1.330', 'DAMAGECOUNT': '1.884', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:57:05,476][2409469] DAMAGECOUNT value on done: 3960.0
[2023-02-25 12:57:05,477][2409469] Sum rewards: 2.124, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.172', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO3': '0.106', 'weapon5': '0.112', 'AMMO4': '0.138', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.470', 'WEAPON3': '0.550', 'weapon4': '0.596', 'weapon2': '0.820', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.845', 'weapon3': '1.856'}
[2023-02-25 12:57:05,515][2409096] DAMAGECOUNT value on done: 2623.0
[2023-02-25 12:57:05,518][2409096] Sum rewards: 1.585, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.856', 'AMMO5': '0.009', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'AMMO4': '0.130', 'weapon5': '0.130', 'WEAPON5': '0.200', 'HITCOUNT': '0.300', 'weapon4': '0.474', 'WEAPON3': '0.600', 'weapon2': '1.052', 'ARMOR': '1.129', 'weapon3': '1.308', 'DAMAGECOUNT': '1.353', 'FRAGCOUNT': '1.500'}
[2023-02-25 12:57:05,540][2409099] DAMAGECOUNT value on done: 2362.0
[2023-02-25 12:57:05,545][2409099] Sum rewards: -0.589, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.634', 'AMMO5': '0.007', 'AMMO2': '0.021', 'ARMOR': '0.032', 'WEAPON1': '0.050', 'weapon5': '0.066', 'AMMO4': '0.104', 'AMMO3': '0.122', 'HITCOUNT': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.500', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.756', 'FRAGCOUNT': '1.000', 'weapon2': '1.070', 'weapon3': '1.676'}
[2023-02-25 12:57:06,008][2409407] DAMAGECOUNT value on done: 2674.0
[2023-02-25 12:57:06,009][2409407] Sum rewards: 1.948, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.435', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'weapon5': '0.050', 'AMMO3': '0.056', 'WEAPON5': '0.100', 'WEAPON4': '0.300', 'HITCOUNT': '0.380', 'WEAPON3': '0.450', 'weapon4': '0.664', 'weapon3': '1.076', 'weapon2': '1.288', 'DAMAGECOUNT': '1.473', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:57:06,040][2409075] DAMAGECOUNT value on done: 2848.0
[2023-02-25 12:57:06,043][2409075] Sum rewards: 5.271, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.781', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.033', 'weapon5': '0.058', 'AMMO3': '0.114', 'AMMO4': '0.166', 'WEAPON5': '0.250', 'weapon4': '0.402', 'WEAPON4': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'ARMOR': '0.889', 'weapon2': '1.432', 'weapon3': '1.700', 'DAMAGECOUNT': '2.577', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:57:06,212][2409074] Updated weights for policy 0, policy_version 14121 (0.0012)
[2023-02-25 12:57:06,345][2409355] DAMAGECOUNT value on done: 3147.0
[2023-02-25 12:57:06,348][2409355] Sum rewards: 10.386, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.880', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.050', 'AMMO3': '0.062', 'AMMO4': '0.063', 'weapon5': '0.104', 'WEAPON4': '0.150', 'weapon4': '0.186', 'WEAPON5': '0.250', 'ARMOR': '0.440', 'WEAPON3': '0.500', 'HITCOUNT': '0.680', 'weapon2': '1.088', 'weapon3': '1.446', 'DAMAGECOUNT': '3.474', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:57:06,547][2409373] DAMAGECOUNT value on done: 3054.0
[2023-02-25 12:57:06,550][2409373] Sum rewards: 1.025, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.374', 'AMMO2': '0.009', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.046', 'AMMO3': '0.106', 'WEAPON4': '0.250', 'weapon5': '0.266', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.480', 'weapon4': '0.492', 'WEAPON3': '0.750', 'weapon2': '1.210', 'weapon3': '1.616', 'DAMAGECOUNT': '1.818', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:57:06,852][2409405] DAMAGECOUNT value on done: 3319.0
[2023-02-25 12:57:06,853][2409405] Sum rewards: 4.641, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-2.060', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.022', 'WEAPON1': '0.040', 'AMMO3': '0.059', 'weapon5': '0.178', 'WEAPON4': '0.300', 'HITCOUNT': '0.400', 'weapon4': '0.426', 'WEAPON3': '0.500', 'WEAPON5': '0.500', 'ARMOR': '0.511', 'weapon3': '1.132', 'weapon2': '1.190', 'DAMAGECOUNT': '1.695', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:57:07,109][2409080] DAMAGECOUNT value on done: 2596.0
[2023-02-25 12:57:07,110][2409080] Sum rewards: -0.157, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.141', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO3': '0.053', 'AMMO4': '0.064', 'WEAPON5': '0.200', 'HITCOUNT': '0.200', 'weapon5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.302', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.678', 'ARMOR': '0.870', 'FRAGCOUNT': '1.000', 'weapon3': '1.258', 'weapon2': '1.478'}
[2023-02-25 12:57:07,187][2408954] Fps is (10 sec: 27031.2, 60 sec: 25736.2, 300 sec: 25547.9). Total num frames: 57872384. Throughput: 0: 6363.6. Samples: 14459232. Policy #0 lag: (min: 0.0, avg: 12.1, max: 25.0)
[2023-02-25 12:57:07,187][2408954] Avg episode reward: [(0, '4.158')]
[2023-02-25 12:57:07,890][2409104] DAMAGECOUNT value on done: 2677.0
[2023-02-25 12:57:07,894][2409104] Sum rewards: 1.285, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.615', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.030', 'AMMO3': '0.039', 'weapon7': '0.068', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'weapon3': '0.522', 'DAMAGECOUNT': '0.648', 'weapon2': '0.896', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:57:07,932][2409076] DAMAGECOUNT value on done: 2452.0
[2023-02-25 12:57:07,933][2409076] Sum rewards: 7.326, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.981', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO4': '0.034', 'AMMO3': '0.050', 'weapon7': '0.060', 'weapon5': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'HITCOUNT': '0.610', 'weapon3': '1.050', 'weapon2': '1.676', 'DAMAGECOUNT': '2.868', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:57:07,956][2409074] Updated weights for policy 0, policy_version 14131 (0.0012)
[2023-02-25 12:57:07,997][2409468] DAMAGECOUNT value on done: 3110.0
[2023-02-25 12:57:08,001][2409468] Sum rewards: 0.981, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.700', 'AMMO5': '0.009', 'ARMOR': '0.024', 'WEAPON1': '0.030', 'AMMO2': '0.033', 'weapon5': '0.072', 'AMMO3': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'WEAPON4': '0.450', 'HITCOUNT': '0.460', 'WEAPON3': '0.550', 'weapon4': '0.584', 'weapon2': '1.366', 'DAMAGECOUNT': '1.431', 'weapon3': '1.510', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:57:08,051][2409079] DAMAGECOUNT value on done: 2918.0
[2023-02-25 12:57:08,053][2409079] Sum rewards: 4.287, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.372', 'AMMO5': '0.004', 'AMMO2': '0.008', 'weapon5': '0.018', 'AMMO4': '0.039', 'AMMO3': '0.045', 'weapon7': '0.094', 'WEAPON5': '0.100', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON3': '0.350', 'HITCOUNT': '0.370', 'WEAPON7': '0.400', 'WEAPON4': '0.450', 'ARMOR': '0.481', 'weapon2': '0.794', 'weapon3': '0.798', 'weapon4': '0.968', 'DAMAGECOUNT': '1.350', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:57:08,235][2409097] DAMAGECOUNT value on done: 2980.0
[2023-02-25 12:57:08,236][2409097] Sum rewards: 3.069, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.156', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO5': '0.012', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.127', 'weapon4': '0.148', 'WEAPON5': '0.300', 'weapon5': '0.318', 'HITCOUNT': '0.440', 'ARMOR': '0.451', 'WEAPON3': '0.850', 'weapon2': '1.358', 'weapon3': '1.770', 'DAMAGECOUNT': '1.827', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:57:08,556][2409389] DAMAGECOUNT value on done: 2846.0
[2023-02-25 12:57:08,557][2409389] Sum rewards: 2.263, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.677', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'weapon7': '0.050', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.170', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'WEAPON5': '0.250', 'weapon3': '0.806', 'DAMAGECOUNT': '1.005', 'ARMOR': '1.388', 'weapon2': '1.664', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:57:08,621][2409547] DAMAGECOUNT value on done: 3701.0
[2023-02-25 12:57:08,622][2409547] Sum rewards: 3.593, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.980', 'AMMO2': '0.005', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.023', 'ARMOR': '0.028', 'AMMO3': '0.107', 'weapon5': '0.148', 'WEAPON4': '0.150', 'weapon4': '0.180', 'WEAPON5': '0.250', 'HITCOUNT': '0.480', 'WEAPON3': '0.750', 'weapon2': '1.462', 'weapon3': '1.564', 'DAMAGECOUNT': '2.148', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:57:08,911][2409078] DAMAGECOUNT value on done: 2991.0
[2023-02-25 12:57:08,914][2409078] Sum rewards: 6.069, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.423', 'AMMO2': '0.005', 'AMMO5': '0.022', 'AMMO4': '0.024', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.094', 'weapon5': '0.160', 'weapon4': '0.216', 'WEAPON5': '0.500', 'HITCOUNT': '0.550', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'weapon2': '1.366', 'weapon3': '1.708', 'DAMAGECOUNT': '2.757', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:57:09,199][2409469] DAMAGECOUNT value on done: 3090.0
[2023-02-25 12:57:09,200][2409469] Sum rewards: 7.388, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.425', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'weapon5': '0.066', 'AMMO3': '0.093', 'AMMO4': '0.094', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.364', 'HITCOUNT': '0.450', 'WEAPON3': '0.650', 'weapon2': '1.358', 'weapon3': '1.750', 'DAMAGECOUNT': '2.175', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:57:09,275][2409486] DAMAGECOUNT value on done: 2741.0
[2023-02-25 12:57:09,275][2409486] Sum rewards: 6.943, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.856', 'AMMO4': '-0.083', 'AMMO2': '-0.016', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'weapon5': '0.100', 'weapon4': '0.216', 'HITCOUNT': '0.380', 'ARMOR': '0.449', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'weapon2': '1.644', 'weapon3': '1.648', 'DAMAGECOUNT': '2.136', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:57:09,288][2409096] DAMAGECOUNT value on done: 3706.0
[2023-02-25 12:57:09,312][2409096] Sum rewards: 7.576, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.118', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.010', 'AMMO3': '0.112', 'weapon5': '0.116', 'WEAPON5': '0.200', 'ARMOR': '0.433', 'HITCOUNT': '0.560', 'WEAPON3': '0.700', 'weapon2': '1.132', 'weapon3': '1.830', 'DAMAGECOUNT': '2.346', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:57:09,616][2409099] DAMAGECOUNT value on done: 2343.0
[2023-02-25 12:57:09,711][2409074] Updated weights for policy 0, policy_version 14141 (0.0012)
[2023-02-25 12:57:10,162][2409407] DAMAGECOUNT value on done: 2627.0
[2023-02-25 12:57:10,163][2409407] Sum rewards: 1.299, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.430', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'AMMO3': '0.010', 'WEAPON1': '0.030', 'HITCOUNT': '0.030', 'weapon7': '0.054', 'DAMAGECOUNT': '0.075', 'WEAPON3': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.122', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.206', 'weapon3': '0.274', 'weapon2': '0.642', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:57:10,257][2409075] DAMAGECOUNT value on done: 2391.0
[2023-02-25 12:57:10,258][2409075] Sum rewards: 6.355, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon7': '0.034', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.089', 'weapon4': '0.094', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON3': '0.300', 'HITCOUNT': '0.380', 'HEALTH': '1.032', 'DAMAGECOUNT': '1.233', 'weapon3': '1.324', 'weapon2': '1.576', 'ARMOR': '1.624', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:57:10,581][2409405] DAMAGECOUNT value on done: 2280.0
[2023-02-25 12:57:10,584][2409405] Sum rewards: 1.571, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.524', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.030', 'AMMO3': '0.060', 'weapon5': '0.062', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.162', 'HITCOUNT': '0.320', 'WEAPON3': '0.400', 'ARMOR': '0.816', 'DAMAGECOUNT': '1.023', 'weapon3': '1.152', 'weapon2': '1.798', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:57:10,868][2409074] Updated weights for policy 0, policy_version 14151 (0.0012)
[2023-02-25 12:57:11,026][2409080] DAMAGECOUNT value on done: 2476.0
[2023-02-25 12:57:11,027][2409080] Sum rewards: 3.904, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.200', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.050', 'AMMO4': '0.066', 'weapon5': '0.088', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon7': '0.100', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.326', 'HITCOUNT': '0.640', 'WEAPON3': '0.750', 'ARMOR': '0.915', 'weapon2': '1.170', 'weapon3': '1.686', 'DAMAGECOUNT': '2.520', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:57:11,815][2409097] DAMAGECOUNT value on done: 3189.0
[2023-02-25 12:57:11,816][2409097] Sum rewards: 3.361, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.184', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.058', 'AMMO3': '0.101', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.422', 'HITCOUNT': '0.510', 'WEAPON3': '0.700', 'ARMOR': '0.856', 'weapon2': '1.184', 'weapon3': '1.208', 'DAMAGECOUNT': '1.809', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:57:11,841][2409076] DAMAGECOUNT value on done: 2759.0
[2023-02-25 12:57:11,842][2409076] Sum rewards: 5.300, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.318', 'AMMO5': '0.008', 'WEAPON1': '0.030', 'AMMO2': '0.031', 'AMMO3': '0.088', 'weapon5': '0.110', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.436', 'WEAPON3': '0.550', 'HITCOUNT': '0.570', 'weapon4': '0.598', 'weapon2': '0.816', 'weapon3': '1.694', 'DAMAGECOUNT': '1.881', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:57:11,955][2409468] DAMAGECOUNT value on done: 2298.0
[2023-02-25 12:57:11,956][2409468] Sum rewards: 4.663, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.708', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.040', 'AMMO4': '0.062', 'weapon7': '0.070', 'weapon5': '0.086', 'AMMO3': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'ARMOR': '0.404', 'HITCOUNT': '0.590', 'WEAPON3': '0.650', 'weapon4': '0.728', 'weapon3': '1.080', 'weapon2': '1.134', 'DAMAGECOUNT': '2.670', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:57:12,186][2408954] Fps is (10 sec: 25804.7, 60 sec: 25327.0, 300 sec: 25547.9). Total num frames: 57987072. Throughput: 0: 6368.3. Samples: 14497536. Policy #0 lag: (min: 0.0, avg: 12.1, max: 25.0)
[2023-02-25 12:57:12,186][2408954] Avg episode reward: [(0, '4.207')]
[2023-02-25 12:57:12,218][2409389] DAMAGECOUNT value on done: 2833.0
[2023-02-25 12:57:12,221][2409389] Sum rewards: 1.277, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.945', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'weapon5': '0.112', 'weapon4': '0.124', 'WEAPON4': '0.150', 'HITCOUNT': '0.280', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'ARMOR': '0.916', 'weapon3': '1.036', 'DAMAGECOUNT': '1.161', 'weapon2': '1.962', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:57:12,249][2409547] DAMAGECOUNT value on done: 2137.0
[2023-02-25 12:57:12,252][2409547] Sum rewards: -0.604, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.556', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon7': '0.068', 'AMMO3': '0.070', 'weapon5': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.200', 'weapon4': '0.310', 'WEAPON3': '0.450', 'weapon3': '0.686', 'DAMAGECOUNT': '0.735', 'ARMOR': '1.208', 'weapon2': '1.556', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:57:12,278][2409079] DAMAGECOUNT value on done: 3466.0
[2023-02-25 12:57:12,279][2409079] Sum rewards: 5.673, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.969', 'AMMO2': '0.007', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.033', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'weapon4': '0.130', 'weapon5': '0.158', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'HITCOUNT': '0.510', 'ARMOR': '0.855', 'weapon3': '1.070', 'weapon2': '1.960', 'DAMAGECOUNT': '2.499', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:57:12,515][2409078] DAMAGECOUNT value on done: 3158.0
[2023-02-25 12:57:12,516][2409078] Sum rewards: -1.871, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.157', 'AMMO5': '0.012', 'AMMO2': '0.025', 'WEAPON1': '0.050', 'weapon5': '0.084', 'AMMO4': '0.125', 'AMMO3': '0.136', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.380', 'ARMOR': '0.478', 'weapon4': '0.488', 'WEAPON3': '0.750', 'weapon2': '1.288', 'DAMAGECOUNT': '1.296', 'weapon3': '1.624', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:57:12,827][2409486] DAMAGECOUNT value on done: 1867.0
[2023-02-25 12:57:12,832][2409486] Sum rewards: 3.804, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.750', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO3': '0.063', 'AMMO4': '0.091', 'weapon4': '0.176', 'weapon5': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.280', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.840', 'weapon3': '0.930', 'weapon2': '1.858', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:57:12,993][2409469] DAMAGECOUNT value on done: 3168.0
[2023-02-25 12:57:13,042][2409096] DAMAGECOUNT value on done: 2788.0
[2023-02-25 12:57:13,043][2409096] Sum rewards: 6.329, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.094', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.063', 'AMMO3': '0.070', 'weapon5': '0.164', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.430', 'weapon4': '0.474', 'weapon2': '1.362', 'weapon3': '1.624', 'DAMAGECOUNT': '1.953', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:57:13,128][2409074] Updated weights for policy 0, policy_version 14161 (0.0012)
[2023-02-25 12:57:13,199][2409099] DAMAGECOUNT value on done: 2734.0
[2023-02-25 12:57:13,200][2409099] Sum rewards: 2.246, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.048', 'AMMO5': '0.011', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'weapon7': '0.056', 'weapon5': '0.060', 'AMMO4': '0.068', 'AMMO3': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.340', 'weapon2': '0.360', 'WEAPON4': '0.450', 'WEAPON3': '0.600', 'weapon4': '0.858', 'weapon3': '1.616', 'DAMAGECOUNT': '1.767', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:57:13,858][2409075] DAMAGECOUNT value on done: 2810.0
[2023-02-25 12:57:13,859][2409075] Sum rewards: 7.100, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.336', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.017', 'AMMO4': '0.086', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'weapon4': '0.112', 'weapon5': '0.130', 'WEAPON5': '0.300', 'HITCOUNT': '0.340', 'WEAPON3': '0.550', 'ARMOR': '1.017', 'weapon3': '1.406', 'weapon2': '1.672', 'DAMAGECOUNT': '2.082', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:57:14,084][2409074] Updated weights for policy 0, policy_version 14171 (0.0013)
[2023-02-25 12:57:14,854][2409080] DAMAGECOUNT value on done: 2963.0
[2023-02-25 12:57:14,856][2409080] Sum rewards: 10.565, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.060', 'weapon5': '0.078', 'AMMO4': '0.086', 'HEALTH': '0.112', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'ARMOR': '0.408', 'WEAPON3': '0.450', 'weapon4': '0.560', 'HITCOUNT': '0.640', 'weapon2': '1.022', 'weapon3': '1.344', 'DAMAGECOUNT': '2.658', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:57:15,429][2409097] DAMAGECOUNT value on done: 3106.0
[2023-02-25 12:57:15,434][2409097] Sum rewards: -0.370, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.040', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.105', 'AMMO3': '0.134', 'weapon5': '0.148', 'WEAPON5': '0.200', 'weapon4': '0.236', 'WEAPON4': '0.350', 'HITCOUNT': '0.400', 'ARMOR': '0.510', 'WEAPON3': '0.800', 'weapon3': '1.238', 'weapon2': '1.576', 'DAMAGECOUNT': '1.932', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:57:15,775][2409389] DAMAGECOUNT value on done: 2672.0
[2023-02-25 12:57:15,776][2409389] Sum rewards: 3.060, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.392', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.060', 'AMMO4': '0.073', 'AMMO3': '0.094', 'weapon5': '0.094', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'HITCOUNT': '0.390', 'weapon4': '0.532', 'WEAPON3': '0.600', 'ARMOR': '0.981', 'weapon3': '1.472', 'DAMAGECOUNT': '1.569', 'weapon2': '1.664', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:57:15,786][2409076] DAMAGECOUNT value on done: 2726.0
[2023-02-25 12:57:15,789][2409076] Sum rewards: 4.394, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.993', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.067', 'weapon5': '0.068', 'WEAPON4': '0.200', 'weapon4': '0.440', 'HITCOUNT': '0.490', 'WEAPON3': '0.500', 'weapon3': '1.144', 'ARMOR': '1.249', 'weapon2': '1.430', 'DAMAGECOUNT': '1.920', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:57:15,788][2409468] DAMAGECOUNT value on done: 3563.0
[2023-02-25 12:57:15,793][2409468] Sum rewards: 1.058, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.536', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO5': '0.022', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.108', 'weapon5': '0.192', 'weapon4': '0.222', 'HITCOUNT': '0.320', 'ARMOR': '0.459', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon2': '1.226', 'DAMAGECOUNT': '1.464', 'weapon3': '1.668', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:57:15,939][2409547] DAMAGECOUNT value on done: 3005.0
[2023-02-25 12:57:15,942][2409547] Sum rewards: 5.810, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.905', 'weapon5': '0.006', 'AMMO5': '0.013', 'AMMO2': '0.015', 'AMMO4': '0.073', 'AMMO3': '0.075', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.266', 'WEAPON3': '0.550', 'HITCOUNT': '0.600', 'ARMOR': '0.881', 'weapon3': '1.498', 'weapon2': '1.534', 'DAMAGECOUNT': '2.055', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:57:16,124][2409074] Updated weights for policy 0, policy_version 14181 (0.0012)
[2023-02-25 12:57:16,369][2409078] DAMAGECOUNT value on done: 3099.0
[2023-02-25 12:57:16,370][2409078] Sum rewards: 3.181, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.160', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'weapon7': '0.048', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO3': '0.081', 'AMMO4': '0.093', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.260', 'weapon4': '0.372', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.738', 'weapon3': '0.910', 'ARMOR': '1.220', 'weapon2': '1.418', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:57:16,563][2409469] DAMAGECOUNT value on done: 2336.0
[2023-02-25 12:57:16,566][2409469] Sum rewards: 4.572, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.640', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO3': '0.040', 'WEAPON4': '0.150', 'weapon7': '0.180', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HITCOUNT': '0.240', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'weapon4': '0.368', 'ARMOR': '0.895', 'weapon3': '1.028', 'DAMAGECOUNT': '1.077', 'weapon2': '1.132', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:57:16,616][2409096] DAMAGECOUNT value on done: 3288.0
[2023-02-25 12:57:16,617][2409096] Sum rewards: 5.949, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.511', 'AMMO5': '0.013', 'AMMO2': '0.013', 'weapon5': '0.014', 'WEAPON1': '0.040', 'AMMO3': '0.051', 'AMMO4': '0.062', 'weapon7': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.272', 'HITCOUNT': '0.350', 'WEAPON3': '0.400', 'weapon2': '1.200', 'weapon3': '1.264', 'DAMAGECOUNT': '1.425', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:57:16,698][2409079] DAMAGECOUNT value on done: 3258.0
[2023-02-25 12:57:16,698][2409079] Sum rewards: 5.579, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.968', 'AMMO5': '0.007', 'AMMO2': '0.032', 'WEAPON1': '0.040', 'AMMO3': '0.064', 'weapon5': '0.140', 'AMMO4': '0.159', 'weapon7': '0.166', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.520', 'weapon4': '0.572', 'ARMOR': '0.905', 'weapon2': '0.960', 'weapon3': '1.246', 'DAMAGECOUNT': '1.935', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:57:16,723][2409486] DAMAGECOUNT value on done: 3442.0
[2023-02-25 12:57:16,727][2409486] Sum rewards: 0.896, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.668', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon7': '0.052', 'AMMO3': '0.079', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.104', 'WEAPON5': '0.200', 'HITCOUNT': '0.360', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.550', 'weapon2': '1.184', 'DAMAGECOUNT': '1.185', 'weapon3': '1.542'}
[2023-02-25 12:57:17,125][2409099] DAMAGECOUNT value on done: 3601.0
[2023-02-25 12:57:17,126][2409099] Sum rewards: 4.824, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.874', 'weapon5': '0.008', 'AMMO2': '0.011', 'AMMO5': '0.025', 'AMMO4': '0.052', 'weapon7': '0.054', 'WEAPON1': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'weapon4': '0.282', 'ARMOR': '0.470', 'WEAPON5': '0.500', 'HITCOUNT': '0.710', 'WEAPON3': '0.900', 'weapon2': '1.244', 'weapon3': '1.720', 'DAMAGECOUNT': '2.325', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:57:17,186][2408954] Fps is (10 sec: 23758.9, 60 sec: 25395.3, 300 sec: 25506.3). Total num frames: 58109952. Throughput: 0: 6380.3. Samples: 14536152. Policy #0 lag: (min: 0.0, avg: 10.7, max: 25.0)
[2023-02-25 12:57:17,187][2408954] Avg episode reward: [(0, '3.814')]
[2023-02-25 12:57:17,514][2409074] Updated weights for policy 0, policy_version 14191 (0.0013)
[2023-02-25 12:57:17,552][2409075] DAMAGECOUNT value on done: 3077.0
[2023-02-25 12:57:17,556][2409075] Sum rewards: 4.245, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.545', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.078', 'AMMO4': '0.123', 'weapon5': '0.124', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.445', 'weapon4': '0.490', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'weapon3': '1.420', 'weapon2': '1.502', 'DAMAGECOUNT': '2.193', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:57:18,796][2409074] Updated weights for policy 0, policy_version 14201 (0.0012)
[2023-02-25 12:57:18,905][2409080] DAMAGECOUNT value on done: 2889.0
[2023-02-25 12:57:18,908][2409080] Sum rewards: 1.022, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.774', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO3': '0.063', 'AMMO4': '0.096', 'weapon5': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.340', 'ARMOR': '0.408', 'WEAPON3': '0.450', 'weapon4': '0.618', 'weapon3': '0.964', 'DAMAGECOUNT': '1.020', 'weapon2': '1.236', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:57:19,071][2409097] DAMAGECOUNT value on done: 2732.0
[2023-02-25 12:57:19,074][2409097] Sum rewards: 4.507, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.182', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.014', 'AMMO2': '0.019', 'AMMO3': '0.076', 'AMMO4': '0.095', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.366', 'HITCOUNT': '0.460', 'WEAPON3': '0.500', 'weapon2': '1.058', 'ARMOR': '1.345', 'weapon3': '1.518', 'DAMAGECOUNT': '1.620', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:57:19,075][2409103] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 12:57:19,658][2409547] DAMAGECOUNT value on done: 2732.0
[2023-02-25 12:57:19,663][2409547] Sum rewards: 5.157, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.468', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon7': '0.056', 'AMMO3': '0.067', 'AMMO4': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.112', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.322', 'WEAPON3': '0.350', 'HITCOUNT': '0.530', 'ARMOR': '0.915', 'weapon3': '1.090', 'weapon2': '1.946', 'DAMAGECOUNT': '2.850', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:57:19,867][2409468] DAMAGECOUNT value on done: 2529.0
[2023-02-25 12:57:19,868][2409468] Sum rewards: 4.005, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.482', 'AMMO5': '0.014', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'weapon5': '0.084', 'AMMO3': '0.105', 'AMMO4': '0.109', 'WEAPON4': '0.150', 'weapon4': '0.172', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'HITCOUNT': '0.530', 'WEAPON3': '0.650', 'weapon2': '1.608', 'weapon3': '1.744', 'DAMAGECOUNT': '2.118', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:57:19,883][2409078] DAMAGECOUNT value on done: 2451.0
[2023-02-25 12:57:19,886][2409078] Sum rewards: 5.510, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.156', 'AMMO5': '0.009', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.075', 'AMMO3': '0.082', 'weapon5': '0.140', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.354', 'ARMOR': '0.437', 'HITCOUNT': '0.490', 'WEAPON3': '0.750', 'weapon2': '1.134', 'weapon3': '1.930', 'DAMAGECOUNT': '2.409', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:57:20,065][2409076] DAMAGECOUNT value on done: 2890.0
[2023-02-25 12:57:20,066][2409076] Sum rewards: 3.494, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.067', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'AMMO3': '0.047', 'WEAPON5': '0.050', 'weapon5': '0.054', 'weapon7': '0.056', 'AMMO4': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.688', 'weapon3': '0.830', 'DAMAGECOUNT': '0.933', 'weapon2': '0.950', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:57:20,262][2409079] DAMAGECOUNT value on done: 3425.0
[2023-02-25 12:57:20,266][2409079] Sum rewards: -1.955, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.458', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.030', 'weapon5': '0.042', 'AMMO4': '0.049', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.220', 'weapon4': '0.314', 'ARMOR': '0.470', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.675', 'weapon2': '0.994', 'weapon3': '1.360'}
[2023-02-25 12:57:20,470][2409096] DAMAGECOUNT value on done: 2107.0
[2023-02-25 12:57:20,471][2409096] Sum rewards: -0.350, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.758', 'AMMO5': '0.015', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.056', 'AMMO4': '0.076', 'AMMO3': '0.093', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'HITCOUNT': '0.390', 'ARMOR': '0.400', 'weapon4': '0.502', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.155', 'weapon3': '1.480', 'weapon2': '1.706'}
[2023-02-25 12:57:20,501][2409486] DAMAGECOUNT value on done: 2683.0
[2023-02-25 12:57:20,502][2409486] Sum rewards: 6.229, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.235', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon7': '0.046', 'weapon5': '0.060', 'AMMO4': '0.067', 'AMMO3': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.238', 'HITCOUNT': '0.330', 'WEAPON3': '0.550', 'weapon2': '0.796', 'weapon3': '1.146', 'ARMOR': '1.204', 'DAMAGECOUNT': '2.256', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:57:20,947][2409099] DAMAGECOUNT value on done: 3120.0
[2023-02-25 12:57:20,950][2409099] Sum rewards: 5.448, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.203', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.005', 'WEAPON1': '0.010', 'AMMO3': '0.064', 'weapon5': '0.134', 'WEAPON5': '0.150', 'ARMOR': '0.400', 'HITCOUNT': '0.410', 'WEAPON3': '0.450', 'weapon3': '1.324', 'DAMAGECOUNT': '1.665', 'weapon2': '1.782', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:57:21,024][2409074] Updated weights for policy 0, policy_version 14211 (0.0012)
[2023-02-25 12:57:21,397][2409075] DAMAGECOUNT value on done: 3793.0
[2023-02-25 12:57:21,398][2409075] Sum rewards: 3.989, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.824', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'weapon5': '0.052', 'AMMO3': '0.075', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'WEAPON4': '0.400', 'ARMOR': '0.434', 'WEAPON3': '0.450', 'weapon4': '0.456', 'HITCOUNT': '0.510', 'weapon3': '1.408', 'weapon2': '1.604', 'DAMAGECOUNT': '2.616', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:57:22,045][2409074] Updated weights for policy 0, policy_version 14221 (0.0012)
[2023-02-25 12:57:22,186][2408954] Fps is (10 sec: 26623.7, 60 sec: 25600.0, 300 sec: 25561.8). Total num frames: 58253312. Throughput: 0: 6389.9. Samples: 14555616. Policy #0 lag: (min: 0.0, avg: 10.7, max: 25.0)
[2023-02-25 12:57:22,186][2408954] Avg episode reward: [(0, '3.827')]
[2023-02-25 12:57:22,672][2409080] DAMAGECOUNT value on done: 3212.0
[2023-02-25 12:57:22,675][2409080] Sum rewards: 0.821, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.780', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO3': '0.030', 'weapon7': '0.048', 'AMMO4': '0.051', 'weapon5': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.250', 'WEAPON4': '0.350', 'HITCOUNT': '0.460', 'ARMOR': '0.476', 'weapon4': '0.496', 'weapon3': '0.650', 'DAMAGECOUNT': '1.038', 'weapon2': '1.740', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:57:23,397][2409547] DAMAGECOUNT value on done: 2840.0
[2023-02-25 12:57:23,400][2409547] Sum rewards: 3.042, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.109', 'AMMO2': '0.008', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.042', 'AMMO3': '0.114', 'weapon5': '0.206', 'HITCOUNT': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.682', 'WEAPON3': '0.800', 'weapon2': '1.012', 'ARMOR': '1.396', 'DAMAGECOUNT': '1.458', 'weapon3': '1.488', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:57:23,687][2409468] DAMAGECOUNT value on done: 2902.0
[2023-02-25 12:57:23,690][2409468] Sum rewards: 6.149, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.827', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.041', 'AMMO3': '0.082', 'weapon7': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO4': '0.205', 'WEAPON4': '0.350', 'ARMOR': '0.492', 'WEAPON3': '0.550', 'weapon2': '0.588', 'HITCOUNT': '0.640', 'weapon4': '0.806', 'weapon3': '1.572', 'DAMAGECOUNT': '2.028', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:57:23,894][2409078] DAMAGECOUNT value on done: 2856.0
[2023-02-25 12:57:23,897][2409078] Sum rewards: 2.851, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.792', 'AMMO5': '0.025', 'AMMO2': '0.029', 'AMMO3': '0.050', 'WEAPON1': '0.060', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'weapon4': '0.240', 'HITCOUNT': '0.250', 'WEAPON3': '0.400', 'weapon5': '0.404', 'WEAPON5': '0.450', 'DAMAGECOUNT': '0.915', 'weapon3': '1.310', 'weapon2': '1.416', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:57:24,089][2409074] Updated weights for policy 0, policy_version 14231 (0.0012)
[2023-02-25 12:57:24,288][2409079] DAMAGECOUNT value on done: 2310.0
[2023-02-25 12:57:24,289][2409079] Sum rewards: 4.531, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.670', 'AMMO2': '0.014', 'AMMO5': '0.025', 'weapon4': '0.038', 'AMMO4': '0.068', 'weapon5': '0.072', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'HITCOUNT': '0.450', 'ARMOR': '0.457', 'WEAPON5': '0.550', 'WEAPON3': '0.550', 'weapon3': '1.588', 'weapon2': '1.686', 'DAMAGECOUNT': '1.776', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:57:24,450][2409096] DAMAGECOUNT value on done: 3015.0
[2023-02-25 12:57:24,451][2409096] Sum rewards: 2.286, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.494', 'weapon7': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'weapon5': '0.076', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.112', 'WEAPON4': '0.200', 'HITCOUNT': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.481', 'WEAPON3': '0.650', 'weapon4': '0.652', 'weapon2': '0.754', 'DAMAGECOUNT': '1.146', 'weapon3': '1.812', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:57:24,675][2409486] DAMAGECOUNT value on done: 3172.0
[2023-02-25 12:57:24,677][2409486] Sum rewards: 5.040, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.923', 'AMMO2': '0.009', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'AMMO4': '0.045', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'weapon5': '0.120', 'weapon4': '0.372', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'weapon2': '1.346', 'weapon3': '1.538', 'DAMAGECOUNT': '2.190', 'FRAGCOUNT': '4.500'}
[2023-02-25 12:57:25,124][2409099] DAMAGECOUNT value on done: 2878.0
[2023-02-25 12:57:25,125][2409099] Sum rewards: 5.555, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.654', 'AMMO5': '0.017', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.024', 'AMMO4': '0.088', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'weapon4': '0.264', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.660', 'ARMOR': '0.800', 'weapon2': '1.378', 'weapon3': '1.648', 'DAMAGECOUNT': '2.448', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:57:25,352][2409074] Updated weights for policy 0, policy_version 14241 (0.0013)
[2023-02-25 12:57:25,629][2409075] DAMAGECOUNT value on done: 2724.0
[2023-02-25 12:57:25,632][2409075] Sum rewards: 4.250, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.008', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.065', 'AMMO4': '0.071', 'WEAPON4': '0.200', 'weapon4': '0.268', 'HITCOUNT': '0.380', 'WEAPON3': '0.400', 'ARMOR': '0.892', 'DAMAGECOUNT': '1.311', 'weapon3': '1.348', 'weapon2': '1.466', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:57:26,569][2409080] DAMAGECOUNT value on done: 3168.0
[2023-02-25 12:57:26,570][2409080] Sum rewards: 6.225, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.101', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.034', 'WEAPON4': '0.050', 'AMMO3': '0.077', 'weapon4': '0.082', 'WEAPON5': '0.250', 'HITCOUNT': '0.490', 'WEAPON3': '0.500', 'weapon3': '1.466', 'weapon2': '1.504', 'DAMAGECOUNT': '1.587', 'FRAGCOUNT': '5.500'}
[2023-02-25 12:57:27,186][2408954] Fps is (10 sec: 25804.8, 60 sec: 25600.0, 300 sec: 25520.2). Total num frames: 58368000. Throughput: 0: 6386.7. Samples: 14593848. Policy #0 lag: (min: 0.0, avg: 10.7, max: 25.0)
[2023-02-25 12:57:27,186][2408954] Avg episode reward: [(0, '3.666')]
[2023-02-25 12:57:27,272][2409074] Updated weights for policy 0, policy_version 14251 (0.0012)
[2023-02-25 12:57:27,298][2409547] DAMAGECOUNT value on done: 3054.0
[2023-02-25 12:57:27,299][2409547] Sum rewards: 12.804, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.278', 'AMMO5': '0.007', 'weapon7': '0.012', 'AMMO2': '0.027', 'AMMO3': '0.074', 'weapon5': '0.128', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.438', 'ARMOR': '0.500', 'WEAPON3': '0.500', 'HITCOUNT': '0.650', 'weapon3': '1.382', 'weapon2': '1.536', 'DAMAGECOUNT': '2.745', 'FRAGCOUNT': '10.000'}
[2023-02-25 12:57:27,562][2409468] DAMAGECOUNT value on done: 2730.0
[2023-02-25 12:57:27,566][2409468] Sum rewards: 3.501, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.691', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO3': '0.040', 'AMMO4': '0.045', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.100', 'weapon7': '0.114', 'HITCOUNT': '0.240', 'WEAPON3': '0.300', 'AMMO6': '0.340', 'AMMO7': '0.340', 'weapon3': '0.486', 'WEAPON7': '0.500', 'weapon4': '0.500', 'ARMOR': '0.978', 'DAMAGECOUNT': '1.224', 'weapon2': '1.270', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:57:28,119][2409079] DAMAGECOUNT value on done: 3963.0
[2023-02-25 12:57:28,120][2409079] Sum rewards: 0.629, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.230', 'AMMO5': '0.005', 'AMMO2': '0.025', 'ARMOR': '0.028', 'AMMO3': '0.079', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'WEAPON4': '0.250', 'weapon4': '0.476', 'WEAPON3': '0.500', 'HITCOUNT': '0.520', 'weapon3': '1.006', 'weapon2': '1.140', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.770'}
[2023-02-25 12:57:28,121][2409096] DAMAGECOUNT value on done: 3215.0
[2023-02-25 12:57:28,122][2409096] Sum rewards: 8.316, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.218', 'AMMO5': '0.014', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'AMMO3': '0.085', 'AMMO4': '0.109', 'weapon5': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.528', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'weapon4': '0.646', 'weapon2': '0.966', 'weapon3': '1.640', 'DAMAGECOUNT': '3.462', 'FRAGCOUNT': '6.500'}
[2023-02-25 12:57:28,436][2409486] DAMAGECOUNT value on done: 2832.0
[2023-02-25 12:57:28,439][2409486] Sum rewards: 4.350, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.790', 'weapon5': '0.006', 'AMMO2': '0.010', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.049', 'weapon7': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.114', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.298', 'ARMOR': '0.455', 'HITCOUNT': '0.540', 'WEAPON3': '0.750', 'weapon3': '1.414', 'weapon2': '1.742', 'DAMAGECOUNT': '2.157', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:57:28,923][2409074] Updated weights for policy 0, policy_version 14261 (0.0012)
[2023-02-25 12:57:29,002][2409099] DAMAGECOUNT value on done: 3317.0
[2023-02-25 12:57:29,003][2409099] Sum rewards: 6.326, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.629', 'AMMO4': '-0.057', 'AMMO2': '-0.011', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'weapon5': '0.162', 'weapon4': '0.296', 'WEAPON5': '0.300', 'ARMOR': '0.506', 'HITCOUNT': '0.540', 'WEAPON3': '0.700', 'weapon2': '1.102', 'weapon3': '1.992', 'DAMAGECOUNT': '2.157', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:57:29,829][2409074] Updated weights for policy 0, policy_version 14271 (0.0013)
[2023-02-25 12:57:30,694][2409080] DAMAGECOUNT value on done: 3397.0
[2023-02-25 12:57:30,698][2409080] Sum rewards: 8.929, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.134', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.059', 'weapon4': '0.062', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'weapon7': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.234', 'WEAPON5': '0.350', 'HITCOUNT': '0.470', 'WEAPON3': '0.600', 'ARMOR': '0.876', 'weapon2': '1.358', 'weapon3': '1.570', 'DAMAGECOUNT': '3.438', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:57:31,412][2409547] DAMAGECOUNT value on done: 3563.0
[2023-02-25 12:57:31,414][2409547] Sum rewards: 7.981, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.035', 'AMMO2': '0.006', 'AMMO5': '0.030', 'AMMO4': '0.031', 'WEAPON1': '0.040', 'weapon4': '0.088', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'weapon5': '0.140', 'ARMOR': '0.408', 'HITCOUNT': '0.530', 'WEAPON5': '0.650', 'WEAPON3': '0.650', 'weapon2': '1.694', 'weapon3': '1.728', 'DAMAGECOUNT': '1.830', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:57:31,685][2409468] DAMAGECOUNT value on done: 2965.0
[2023-02-25 12:57:31,689][2409468] Sum rewards: 2.501, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'HEALTH': '0.012', 'AMMO2': '0.015', 'weapon5': '0.066', 'AMMO4': '0.077', 'AMMO3': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.400', 'weapon4': '0.430', 'WEAPON3': '0.550', 'ARMOR': '0.800', 'weapon2': '1.360', 'weapon3': '1.376', 'DAMAGECOUNT': '1.455', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:57:31,899][2409079] DAMAGECOUNT value on done: 2466.0
[2023-02-25 12:57:31,903][2409079] Sum rewards: 0.524, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.526', 'AMMO2': '0.010', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.048', 'AMMO4': '0.051', 'AMMO3': '0.072', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.376', 'HITCOUNT': '0.400', 'ARMOR': '0.503', 'WEAPON3': '0.550', 'weapon3': '0.972', 'DAMAGECOUNT': '1.431', 'weapon2': '1.954', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:57:31,911][2409074] Updated weights for policy 0, policy_version 14281 (0.0012)
[2023-02-25 12:57:32,186][2408954] Fps is (10 sec: 24576.2, 60 sec: 25463.4, 300 sec: 25520.2). Total num frames: 58499072. Throughput: 0: 6399.5. Samples: 14632512. Policy #0 lag: (min: 0.0, avg: 11.6, max: 26.0)
[2023-02-25 12:57:32,186][2408954] Avg episode reward: [(0, '3.803')]
[2023-02-25 12:57:32,597][2409486] DAMAGECOUNT value on done: 3032.0
[2023-02-25 12:57:32,598][2409486] Sum rewards: 9.161, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.925', 'AMMO5': '0.015', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.068', 'AMMO4': '0.080', 'weapon7': '0.082', 'weapon5': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.204', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'HITCOUNT': '0.520', 'weapon3': '0.774', 'ARMOR': '1.208', 'weapon2': '1.614', 'DAMAGECOUNT': '2.985', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:57:33,146][2409099] DAMAGECOUNT value on done: 2446.0
[2023-02-25 12:57:33,149][2409099] Sum rewards: 4.771, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.830', 'AMMO5': '0.015', 'AMMO2': '0.019', 'ARMOR': '0.040', 'weapon5': '0.058', 'WEAPON1': '0.070', 'weapon7': '0.078', 'AMMO4': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.510', 'HITCOUNT': '0.640', 'WEAPON3': '0.850', 'weapon2': '1.132', 'weapon3': '1.674', 'DAMAGECOUNT': '1.956', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:57:33,289][2409074] Updated weights for policy 0, policy_version 14291 (0.0012)
[2023-02-25 12:57:34,521][2409080] DAMAGECOUNT value on done: 3480.0
[2023-02-25 12:57:34,523][2409080] Sum rewards: -1.079, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.358', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.018', 'weapon7': '0.020', 'AMMO3': '0.058', 'AMMO4': '0.090', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.158', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'ARMOR': '0.500', 'weapon4': '0.594', 'DAMAGECOUNT': '0.843', 'weapon2': '1.002', 'weapon3': '1.114'}
[2023-02-25 12:57:34,887][2409074] Updated weights for policy 0, policy_version 14301 (0.0012)
[2023-02-25 12:57:35,479][2409547] DAMAGECOUNT value on done: 3286.0
[2023-02-25 12:57:35,483][2409547] Sum rewards: 7.806, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.460', 'AMMO5': '0.012', 'AMMO2': '0.012', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO4': '0.061', 'weapon4': '0.078', 'weapon5': '0.090', 'AMMO3': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'weapon3': '1.548', 'weapon2': '1.674', 'DAMAGECOUNT': '2.997', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:57:35,510][2409468] DAMAGECOUNT value on done: 4065.0
[2023-02-25 12:57:35,513][2409468] Sum rewards: 5.994, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.110', 'AMMO4': '-0.043', 'AMMO2': '-0.008', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO3': '0.090', 'WEAPON5': '0.150', 'weapon5': '0.158', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'ARMOR': '0.453', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'weapon2': '1.640', 'weapon3': '1.776', 'DAMAGECOUNT': '2.160', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:57:36,548][2409079] DAMAGECOUNT value on done: 1976.0
[2023-02-25 12:57:36,549][2409079] Sum rewards: -1.182, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.628', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO2': '0.040', 'AMMO3': '0.076', 'weapon5': '0.118', 'AMMO4': '0.199', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'HITCOUNT': '0.350', 'ARMOR': '0.400', 'weapon4': '0.542', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.014', 'weapon2': '1.226', 'weapon3': '1.484'}
[2023-02-25 12:57:36,695][2409074] Updated weights for policy 0, policy_version 14311 (0.0012)
[2023-02-25 12:57:37,093][2409099] DAMAGECOUNT value on done: 2962.0
[2023-02-25 12:57:37,095][2409099] Sum rewards: 4.379, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'HEALTH': '0.060', 'AMMO3': '0.060', 'weapon5': '0.070', 'WEAPON5': '0.100', 'WEAPON3': '0.400', 'HITCOUNT': '0.410', 'ARMOR': '0.893', 'weapon3': '1.324', 'DAMAGECOUNT': '1.338', 'weapon2': '1.472', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:57:37,186][2408954] Fps is (10 sec: 26214.1, 60 sec: 25463.4, 300 sec: 25520.2). Total num frames: 58630144. Throughput: 0: 6414.1. Samples: 14651928. Policy #0 lag: (min: 0.0, avg: 11.6, max: 26.0)
[2023-02-25 12:57:37,187][2408954] Avg episode reward: [(0, '3.916')]
[2023-02-25 12:57:38,324][2409074] Updated weights for policy 0, policy_version 14321 (0.0012)
[2023-02-25 12:57:38,572][2409080] DAMAGECOUNT value on done: 2898.0
[2023-02-25 12:57:38,576][2409080] Sum rewards: 2.683, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.960', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO3': '0.055', 'weapon5': '0.062', 'weapon7': '0.082', 'AMMO4': '0.097', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.370', 'WEAPON3': '0.450', 'weapon4': '0.608', 'weapon2': '0.712', 'ARMOR': '0.876', 'weapon3': '1.186', 'DAMAGECOUNT': '1.320', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:57:39,459][2409547] DAMAGECOUNT value on done: 2531.0
[2023-02-25 12:57:39,460][2409547] Sum rewards: 7.981, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.500', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.010', 'WEAPON1': '0.050', 'AMMO3': '0.086', 'weapon5': '0.166', 'WEAPON5': '0.300', 'ARMOR': '0.456', 'HITCOUNT': '0.530', 'WEAPON3': '0.600', 'weapon3': '1.592', 'weapon2': '1.750', 'DAMAGECOUNT': '2.460', 'FRAGCOUNT': '6.500'}
[2023-02-25 12:57:39,708][2409074] Updated weights for policy 0, policy_version 14331 (0.0013)
[2023-02-25 12:57:39,825][2409468] DAMAGECOUNT value on done: 3489.0
[2023-02-25 12:57:39,826][2409468] Sum rewards: 9.775, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.307', 'AMMO2': '0.008', 'AMMO5': '0.021', 'AMMO4': '0.041', 'weapon7': '0.048', 'AMMO3': '0.067', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.158', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.382', 'WEAPON3': '0.500', 'HITCOUNT': '0.690', 'weapon3': '1.324', 'ARMOR': '1.369', 'weapon2': '1.626', 'DAMAGECOUNT': '3.057', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:57:40,988][2409099] DAMAGECOUNT value on done: 2921.0
[2023-02-25 12:57:40,990][2409099] Sum rewards: 1.832, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.007', 'WEAPON1': '0.040', 'AMMO2': '0.049', 'AMMO3': '0.122', 'weapon5': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO4': '0.243', 'weapon4': '0.396', 'ARMOR': '0.412', 'HEALTH': '0.420', 'HITCOUNT': '0.600', 'WEAPON3': '0.650', 'weapon2': '1.298', 'weapon3': '1.494', 'DAMAGECOUNT': '1.908', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:57:41,581][2409074] Updated weights for policy 0, policy_version 14341 (0.0012)
[2023-02-25 12:57:42,186][2408954] Fps is (10 sec: 25804.9, 60 sec: 25668.3, 300 sec: 25561.8). Total num frames: 58757120. Throughput: 0: 6423.2. Samples: 14690532. Policy #0 lag: (min: 0.0, avg: 12.4, max: 24.0)
[2023-02-25 12:57:42,186][2408954] Avg episode reward: [(0, '4.008')]
[2023-02-25 12:57:42,648][2409080] DAMAGECOUNT value on done: 2195.0
[2023-02-25 12:57:42,648][2409080] Sum rewards: 2.924, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.768', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon5': '0.046', 'weapon4': '0.072', 'AMMO4': '0.075', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'ARMOR': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'weapon2': '1.638', 'weapon3': '1.834', 'DAMAGECOUNT': '2.490', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:57:42,853][2409074] Updated weights for policy 0, policy_version 14351 (0.0013)
[2023-02-25 12:57:43,321][2409547] DAMAGECOUNT value on done: 3082.0
[2023-02-25 12:57:43,322][2409547] Sum rewards: 3.393, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.997', 'AMMO5': '0.007', 'weapon5': '0.014', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.086', 'AMMO3': '0.087', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'weapon4': '0.440', 'ARMOR': '0.479', 'HITCOUNT': '0.540', 'WEAPON3': '0.600', 'weapon2': '0.956', 'weapon3': '1.602', 'DAMAGECOUNT': '1.791', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:57:43,915][2409468] DAMAGECOUNT value on done: 2852.0
[2023-02-25 12:57:43,918][2409468] Sum rewards: 3.371, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.348', 'AMMO2': '0.007', 'AMMO5': '0.030', 'AMMO4': '0.035', 'WEAPON1': '0.040', 'weapon4': '0.086', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.114', 'WEAPON5': '0.500', 'HITCOUNT': '0.550', 'WEAPON3': '0.700', 'ARMOR': '1.255', 'weapon3': '1.332', 'weapon2': '1.780', 'DAMAGECOUNT': '2.349', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:57:44,446][2409074] Updated weights for policy 0, policy_version 14361 (0.0013)
[2023-02-25 12:57:45,025][2409099] DAMAGECOUNT value on done: 2827.0
[2023-02-25 12:57:45,029][2409099] Sum rewards: 4.098, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.300', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'weapon5': '0.102', 'AMMO3': '0.104', 'WEAPON4': '0.150', 'HITCOUNT': '0.360', 'weapon4': '0.364', 'WEAPON3': '0.700', 'ARMOR': '0.891', 'weapon3': '1.234', 'weapon2': '1.266', 'DAMAGECOUNT': '2.067', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:57:46,102][2409074] Updated weights for policy 0, policy_version 14371 (0.0012)
[2023-02-25 12:57:46,588][2409080] DAMAGECOUNT value on done: 2995.0
[2023-02-25 12:57:46,588][2409080] Sum rewards: 7.465, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.873', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'AMMO5': '0.022', 'AMMO3': '0.063', 'AMMO4': '0.101', 'WEAPON4': '0.250', 'weapon5': '0.380', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.590', 'weapon4': '0.724', 'ARMOR': '0.877', 'weapon3': '0.976', 'weapon2': '1.086', 'DAMAGECOUNT': '2.388', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:57:47,164][2409547] DAMAGECOUNT value on done: 2328.0
[2023-02-25 12:57:47,165][2409547] Sum rewards: 4.684, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.020', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'AMMO3': '0.070', 'weapon5': '0.102', 'weapon7': '0.106', 'AMMO4': '0.141', 'WEAPON5': '0.200', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.500', 'weapon4': '0.512', 'weapon3': '0.998', 'weapon2': '1.684', 'DAMAGECOUNT': '2.655', 'FRAGCOUNT': '5.500'}
[2023-02-25 12:57:47,186][2408954] Fps is (10 sec: 26214.7, 60 sec: 25668.3, 300 sec: 25534.0). Total num frames: 58892288. Throughput: 0: 6416.0. Samples: 14728992. Policy #0 lag: (min: 0.0, avg: 12.4, max: 24.0)
[2023-02-25 12:57:47,186][2408954] Avg episode reward: [(0, '3.996')]
[2023-02-25 12:57:47,656][2409468] DAMAGECOUNT value on done: 2853.0
[2023-02-25 12:57:47,657][2409468] Sum rewards: 5.722, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.213', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.056', 'AMMO4': '0.060', 'weapon7': '0.088', 'AMMO3': '0.095', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.370', 'weapon4': '0.392', 'ARMOR': '0.404', 'WEAPON3': '0.600', 'weapon3': '0.966', 'DAMAGECOUNT': '1.095', 'weapon2': '1.124', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:57:47,972][2409074] Updated weights for policy 0, policy_version 14381 (0.0012)
[2023-02-25 12:57:49,483][2409099] DAMAGECOUNT value on done: 3241.0
[2023-02-25 12:57:49,484][2409099] Sum rewards: 2.277, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.552', 'AMMO2': '0.009', 'AMMO4': '0.044', 'AMMO3': '0.049', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.350', 'ARMOR': '0.428', 'weapon4': '0.450', 'DAMAGECOUNT': '1.059', 'weapon2': '1.082', 'weapon3': '1.208', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:57:49,518][2409074] Updated weights for policy 0, policy_version 14391 (0.0012)
[2023-02-25 12:57:50,642][2409080] DAMAGECOUNT value on done: 2633.0
[2023-02-25 12:57:50,646][2409080] Sum rewards: 4.422, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.086', 'AMMO2': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'weapon5': '0.058', 'AMMO3': '0.067', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.490', 'weapon3': '1.270', 'DAMAGECOUNT': '1.584', 'weapon2': '1.672', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:57:50,828][2409074] Updated weights for policy 0, policy_version 14401 (0.0013)
[2023-02-25 12:57:50,977][2409547] DAMAGECOUNT value on done: 3045.0
[2023-02-25 12:57:50,978][2409547] Sum rewards: 4.457, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.070', 'AMMO2': '0.008', 'AMMO5': '0.020', 'AMMO4': '0.040', 'WEAPON1': '0.050', 'weapon7': '0.072', 'weapon5': '0.084', 'weapon4': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'HITCOUNT': '0.420', 'WEAPON3': '0.750', 'weapon2': '1.010', 'weapon3': '1.954', 'DAMAGECOUNT': '1.962', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:57:51,734][2409468] DAMAGECOUNT value on done: 2635.0
[2023-02-25 12:57:51,736][2409468] Sum rewards: 1.875, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.142', 'AMMO2': '0.005', 'AMMO5': '0.014', 'weapon5': '0.024', 'AMMO4': '0.024', 'WEAPON1': '0.040', 'AMMO3': '0.068', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.420', 'ARMOR': '0.467', 'WEAPON3': '0.500', 'weapon4': '0.708', 'weapon2': '0.720', 'weapon3': '1.322', 'DAMAGECOUNT': '1.404', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:57:52,186][2408954] Fps is (10 sec: 26214.3, 60 sec: 25600.1, 300 sec: 25534.1). Total num frames: 59019264. Throughput: 0: 6429.2. Samples: 14748540. Policy #0 lag: (min: 0.0, avg: 13.5, max: 28.0)
[2023-02-25 12:57:52,187][2408954] Avg episode reward: [(0, '4.076')]
[2023-02-25 12:57:52,742][2409074] Updated weights for policy 0, policy_version 14411 (0.0013)
[2023-02-25 12:57:53,622][2409099] DAMAGECOUNT value on done: 2950.0
[2023-02-25 12:57:53,622][2409099] Sum rewards: 9.190, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'HEALTH': '0.037', 'weapon5': '0.046', 'AMMO3': '0.084', 'weapon7': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'ARMOR': '0.404', 'HITCOUNT': '0.450', 'weapon2': '0.528', 'WEAPON3': '0.550', 'weapon4': '0.678', 'DAMAGECOUNT': '1.737', 'weapon3': '1.758', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:57:53,785][2409074] Updated weights for policy 0, policy_version 14421 (0.0012)
[2023-02-25 12:57:54,344][2409080] DAMAGECOUNT value on done: 2777.0
[2023-02-25 12:57:54,346][2409080] Sum rewards: 2.441, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.760', 'AMMO4': '-0.082', 'AMMO2': '-0.016', 'AMMO5': '0.005', 'WEAPON1': '0.060', 'AMMO3': '0.072', 'weapon5': '0.126', 'WEAPON5': '0.200', 'HITCOUNT': '0.330', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.990', 'weapon2': '1.580', 'weapon3': '1.736', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:57:54,700][2409547] DAMAGECOUNT value on done: 2760.0
[2023-02-25 12:57:54,704][2409547] Sum rewards: 3.575, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.114', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.007', 'weapon7': '0.050', 'weapon5': '0.054', 'AMMO3': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.118', 'WEAPON5': '0.200', 'HITCOUNT': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'weapon3': '0.976', 'weapon2': '1.118', 'DAMAGECOUNT': '1.197', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:57:55,510][2409468] DAMAGECOUNT value on done: 3242.0
[2023-02-25 12:57:55,512][2409468] Sum rewards: 6.249, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.697', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'weapon5': '0.054', 'WEAPON1': '0.060', 'AMMO3': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'ARMOR': '0.481', 'weapon4': '0.550', 'HITCOUNT': '0.570', 'WEAPON3': '0.900', 'weapon2': '1.058', 'weapon3': '1.760', 'DAMAGECOUNT': '2.217', 'FRAGCOUNT': '9.000'}
[2023-02-25 12:57:55,864][2409074] Updated weights for policy 0, policy_version 14431 (0.0012)
[2023-02-25 12:57:57,186][2408954] Fps is (10 sec: 25395.2, 60 sec: 25736.5, 300 sec: 25561.8). Total num frames: 59146240. Throughput: 0: 6435.2. Samples: 14787120. Policy #0 lag: (min: 0.0, avg: 13.5, max: 28.0)
[2023-02-25 12:57:57,186][2408954] Avg episode reward: [(0, '4.104')]
[2023-02-25 12:57:57,286][2409074] Updated weights for policy 0, policy_version 14441 (0.0012)
[2023-02-25 12:57:58,392][2409080] DAMAGECOUNT value on done: 2819.0
[2023-02-25 12:57:58,393][2409080] Sum rewards: 5.716, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.290', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.034', 'weapon7': '0.048', 'AMMO3': '0.080', 'AMMO4': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'ARMOR': '0.400', 'HITCOUNT': '0.440', 'WEAPON3': '0.550', 'weapon2': '1.070', 'weapon3': '1.342', 'DAMAGECOUNT': '1.782', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:57:58,429][2409547] DAMAGECOUNT value on done: 2782.0
[2023-02-25 12:57:58,430][2409547] Sum rewards: 6.501, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.636', 'AMMO2': '0.012', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'weapon5': '0.030', 'AMMO4': '0.061', 'AMMO3': '0.088', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'ARMOR': '0.456', 'HITCOUNT': '0.460', 'WEAPON3': '0.650', 'weapon2': '0.654', 'weapon4': '0.674', 'weapon3': '1.454', 'DAMAGECOUNT': '1.665', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:57:58,936][2409074] Updated weights for policy 0, policy_version 14451 (0.0012)
[2023-02-25 12:57:59,785][2409468] DAMAGECOUNT value on done: 2796.0
[2023-02-25 12:57:59,786][2409468] Sum rewards: 5.970, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'HEALTH': '0.036', 'AMMO3': '0.040', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'WEAPON4': '0.200', 'WEAPON3': '0.300', 'weapon4': '0.442', 'ARMOR': '0.460', 'HITCOUNT': '0.530', 'weapon2': '0.942', 'weapon3': '0.962', 'DAMAGECOUNT': '1.737', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:58:00,498][2409074] Updated weights for policy 0, policy_version 14461 (0.0012)
[2023-02-25 12:58:01,546][2409074] Updated weights for policy 0, policy_version 14471 (0.0013)
[2023-02-25 12:58:02,186][2408954] Fps is (10 sec: 26214.4, 60 sec: 25873.1, 300 sec: 25575.7). Total num frames: 59281408. Throughput: 0: 6439.7. Samples: 14825940. Policy #0 lag: (min: 0.0, avg: 12.2, max: 25.0)
[2023-02-25 12:58:02,186][2408954] Avg episode reward: [(0, '4.168')]
[2023-02-25 12:58:02,312][2409080] DAMAGECOUNT value on done: 2922.0
[2023-02-25 12:58:02,315][2409080] Sum rewards: 6.825, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.260', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO3': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON3': '0.300', 'weapon4': '0.344', 'HITCOUNT': '0.520', 'ARMOR': '0.528', 'weapon3': '1.086', 'weapon2': '1.468', 'DAMAGECOUNT': '1.581', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:58:03,618][2409468] DAMAGECOUNT value on done: 2673.0
[2023-02-25 12:58:03,625][2409468] Sum rewards: 0.513, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.731', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'weapon7': '0.048', 'weapon5': '0.066', 'AMMO4': '0.067', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.125', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.288', 'HITCOUNT': '0.490', 'WEAPON3': '0.800', 'weapon2': '1.256', 'DAMAGECOUNT': '1.593', 'FRAGCOUNT': '2.000', 'weapon3': '2.110'}
[2023-02-25 12:58:03,999][2409074] Updated weights for policy 0, policy_version 14481 (0.0012)
[2023-02-25 12:58:04,960][2409033] Signal inference workers to stop experience collection... (1800 times)
[2023-02-25 12:58:04,977][2409033] Signal inference workers to resume experience collection... (1800 times)
[2023-02-25 12:58:04,997][2409074] InferenceWorker_p0-w0: stopping experience collection (1800 times)
[2023-02-25 12:58:04,997][2409074] InferenceWorker_p0-w0: resuming experience collection (1800 times)
[2023-02-25 12:58:05,031][2409074] Updated weights for policy 0, policy_version 14491 (0.0013)
[2023-02-25 12:58:06,473][2409080] DAMAGECOUNT value on done: 2732.0
[2023-02-25 12:58:06,478][2409080] Sum rewards: 2.015, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'HEALTH': '0.034', 'weapon5': '0.036', 'weapon7': '0.074', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.440', 'weapon4': '0.440', 'HITCOUNT': '0.450', 'WEAPON3': '0.550', 'weapon2': '0.976', 'weapon3': '1.312', 'DAMAGECOUNT': '1.665', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:58:06,786][2409074] Updated weights for policy 0, policy_version 14501 (0.0012)
[2023-02-25 12:58:07,186][2408954] Fps is (10 sec: 25804.8, 60 sec: 25532.1, 300 sec: 25547.9). Total num frames: 59404288. Throughput: 0: 6426.1. Samples: 14844792. Policy #0 lag: (min: 0.0, avg: 12.2, max: 25.0)
[2023-02-25 12:58:07,186][2408954] Avg episode reward: [(0, '4.196')]
[2023-02-25 12:58:07,746][2409468] DAMAGECOUNT value on done: 3554.0
[2023-02-25 12:58:07,750][2409468] Sum rewards: 6.085, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.881', 'AMMO2': '0.004', 'weapon4': '0.012', 'AMMO5': '0.015', 'AMMO4': '0.020', 'WEAPON1': '0.030', 'weapon5': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'WEAPON5': '0.350', 'HITCOUNT': '0.630', 'WEAPON3': '0.750', 'ARMOR': '0.892', 'weapon2': '1.574', 'weapon3': '1.806', 'DAMAGECOUNT': '2.103', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:58:08,330][2409074] Updated weights for policy 0, policy_version 14511 (0.0012)
[2023-02-25 12:58:09,831][2409074] Updated weights for policy 0, policy_version 14521 (0.0012)
[2023-02-25 12:58:10,592][2409080] DAMAGECOUNT value on done: 3376.0
[2023-02-25 12:58:10,597][2409080] Sum rewards: 1.691, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.818', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.019', 'WEAPON1': '0.030', 'weapon5': '0.060', 'AMMO3': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'ARMOR': '0.404', 'HITCOUNT': '0.470', 'weapon4': '0.482', 'WEAPON3': '0.550', 'weapon2': '1.480', 'weapon3': '1.618', 'DAMAGECOUNT': '1.761', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:58:11,914][2409074] Updated weights for policy 0, policy_version 14531 (0.0012)
[2023-02-25 12:58:12,012][2409468] DAMAGECOUNT value on done: 3150.0
[2023-02-25 12:58:12,013][2409468] Sum rewards: 5.567, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.601', 'AMMO2': '0.015', 'AMMO5': '0.018', 'WEAPON1': '0.030', 'weapon5': '0.060', 'AMMO4': '0.073', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'weapon4': '0.280', 'WEAPON5': '0.300', 'HITCOUNT': '0.550', 'WEAPON3': '0.700', 'ARMOR': '0.832', 'weapon2': '1.034', 'weapon3': '1.762', 'DAMAGECOUNT': '1.998', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:58:12,186][2408954] Fps is (10 sec: 24575.8, 60 sec: 25668.2, 300 sec: 25506.3). Total num frames: 59527168. Throughput: 0: 6441.1. Samples: 14883696. Policy #0 lag: (min: 0.0, avg: 14.4, max: 26.0)
[2023-02-25 12:58:12,187][2408954] Avg episode reward: [(0, '4.240')]
[2023-02-25 12:58:13,311][2409074] Updated weights for policy 0, policy_version 14541 (0.0012)
[2023-02-25 12:58:14,542][2409080] DAMAGECOUNT value on done: 3300.0
[2023-02-25 12:58:14,548][2409080] Sum rewards: 7.497, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.208', 'AMMO2': '0.008', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.039', 'AMMO3': '0.067', 'weapon7': '0.068', 'weapon5': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.370', 'WEAPON3': '0.500', 'ARMOR': '0.500', 'weapon4': '0.508', 'weapon2': '1.206', 'weapon3': '1.286', 'DAMAGECOUNT': '2.193', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:58:14,962][2409074] Updated weights for policy 0, policy_version 14551 (0.0013)
[2023-02-25 12:58:15,904][2409468] DAMAGECOUNT value on done: 3706.0
[2023-02-25 12:58:15,905][2409468] Sum rewards: 0.704, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'weapon4': '0.030', 'WEAPON4': '0.050', 'weapon7': '0.062', 'HEALTH': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.123', 'AMMO4': '0.133', 'HITCOUNT': '0.310', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'weapon3': '1.204', 'DAMAGECOUNT': '1.266', 'weapon2': '1.680', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:58:16,248][2409074] Updated weights for policy 0, policy_version 14561 (0.0012)
[2023-02-25 12:58:17,186][2408954] Fps is (10 sec: 25804.7, 60 sec: 25873.1, 300 sec: 25589.6). Total num frames: 59662336. Throughput: 0: 6441.3. Samples: 14922372. Policy #0 lag: (min: 0.0, avg: 14.4, max: 26.0)
[2023-02-25 12:58:17,186][2408954] Avg episode reward: [(0, '4.188')]
[2023-02-25 12:58:17,210][2409033] Saving /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000014567_59666432.pth...
[2023-02-25 12:58:17,301][2409033] Removing /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000013071_53538816.pth
[2023-02-25 12:58:17,908][2409074] Updated weights for policy 0, policy_version 14571 (0.0012)
[2023-02-25 12:58:18,606][2409080] DAMAGECOUNT value on done: 2960.0
[2023-02-25 12:58:18,608][2409080] Sum rewards: 3.451, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.430', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.009', 'AMMO3': '0.043', 'AMMO4': '0.046', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'WEAPON3': '0.300', 'HITCOUNT': '0.350', 'weapon4': '0.446', 'weapon3': '0.866', 'weapon2': '0.984', 'DAMAGECOUNT': '1.275', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:58:19,614][2409074] Updated weights for policy 0, policy_version 14581 (0.0012)
[2023-02-25 12:58:19,913][2409468] DAMAGECOUNT value on done: 3454.0
[2023-02-25 12:58:19,915][2409468] Sum rewards: 1.635, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.272', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon5': '0.056', 'weapon7': '0.064', 'AMMO4': '0.081', 'AMMO3': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'ARMOR': '0.489', 'HITCOUNT': '0.500', 'weapon4': '0.534', 'WEAPON3': '0.550', 'weapon3': '0.922', 'weapon2': '0.976', 'DAMAGECOUNT': '1.569', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:58:21,250][2409074] Updated weights for policy 0, policy_version 14591 (0.0012)
[2023-02-25 12:58:21,650][2409078] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 12:58:22,186][2408954] Fps is (10 sec: 26623.9, 60 sec: 25668.3, 300 sec: 25561.8). Total num frames: 59793408. Throughput: 0: 6430.4. Samples: 14941296. Policy #0 lag: (min: 1.0, avg: 13.7, max: 26.0)
[2023-02-25 12:58:22,186][2408954] Avg episode reward: [(0, '4.093')]
[2023-02-25 12:58:22,353][2409080] DAMAGECOUNT value on done: 2942.0
[2023-02-25 12:58:22,354][2409080] Sum rewards: 4.503, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.718', 'AMMO2': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.034', 'weapon5': '0.068', 'weapon4': '0.068', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'HITCOUNT': '0.410', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'weapon2': '1.364', 'DAMAGECOUNT': '1.425', 'weapon3': '1.908', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:58:22,434][2409075] Large shaping reward 2.608 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5760000000000001, 192.0), ('weapon7', 0.002)]
[2023-02-25 12:58:22,928][2409074] Updated weights for policy 0, policy_version 14601 (0.0012)
[2023-02-25 12:58:23,691][2409468] DAMAGECOUNT value on done: 2646.0
[2023-02-25 12:58:23,692][2409468] Sum rewards: 5.318, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.995', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.063', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.106', 'weapon5': '0.114', 'WEAPON5': '0.300', 'ARMOR': '0.425', 'WEAPON3': '0.450', 'HITCOUNT': '0.590', 'weapon3': '1.410', 'weapon2': '1.790', 'DAMAGECOUNT': '2.070', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:58:24,369][2409074] Updated weights for policy 0, policy_version 14611 (0.0013)
[2023-02-25 12:58:24,798][2409548] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)]
[2023-02-25 12:58:25,893][2409074] Updated weights for policy 0, policy_version 14621 (0.0012)
[2023-02-25 12:58:26,537][2409080] DAMAGECOUNT value on done: 2009.0
[2023-02-25 12:58:26,538][2409080] Sum rewards: 10.850, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.492', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.012', 'AMMO2': '0.013', 'AMMO3': '0.053', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'weapon7': '0.146', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.302', 'WEAPON3': '0.400', 'HITCOUNT': '0.400', 'weapon2': '1.196', 'weapon3': '1.198', 'ARMOR': '1.300', 'DAMAGECOUNT': '1.641', 'FRAGCOUNT': '9.000'}
[2023-02-25 12:58:27,186][2408954] Fps is (10 sec: 25395.1, 60 sec: 25804.8, 300 sec: 25534.0). Total num frames: 59916288. Throughput: 0: 6423.7. Samples: 14979600. Policy #0 lag: (min: 1.0, avg: 13.7, max: 26.0)
[2023-02-25 12:58:27,187][2408954] Avg episode reward: [(0, '4.232')]
[2023-02-25 12:58:27,681][2409074] Updated weights for policy 0, policy_version 14631 (0.0012)
[2023-02-25 12:58:27,988][2409468] DAMAGECOUNT value on done: 2865.0
[2023-02-25 12:58:27,989][2409468] Sum rewards: 3.668, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.593', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO3': '0.020', 'weapon5': '0.062', 'WEAPON3': '0.100', 'weapon7': '0.146', 'HITCOUNT': '0.150', 'WEAPON5': '0.150', 'weapon3': '0.178', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'ARMOR': '0.446', 'weapon4': '0.476', 'weapon2': '0.986', 'DAMAGECOUNT': '1.197', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:58:29,178][2409074] Updated weights for policy 0, policy_version 14641 (0.0014)
[2023-02-25 12:58:30,465][2409596] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 12:58:30,628][2409075] Large shaping reward -2.527 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.23700000000000002, -79.0), ('ARMOR', -0.041, -41.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 12:58:30,872][2409074] Updated weights for policy 0, policy_version 14651 (0.0012)
[2023-02-25 12:58:32,186][2408954] Fps is (10 sec: 24985.7, 60 sec: 25736.5, 300 sec: 25561.8). Total num frames: 60043264. Throughput: 0: 6434.4. Samples: 15018540. Policy #0 lag: (min: 0.0, avg: 12.6, max: 25.0)
[2023-02-25 12:58:32,186][2408954] Avg episode reward: [(0, '4.253')]
[2023-02-25 12:58:32,286][2409074] Updated weights for policy 0, policy_version 14661 (0.0012)
[2023-02-25 12:58:32,701][2409468] DAMAGECOUNT value on done: 2959.0
[2023-02-25 12:58:32,704][2409468] Sum rewards: 7.430, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.570', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.094', 'AMMO3': '0.095', 'WEAPON5': '0.150', 'WEAPON3': '0.500', 'HITCOUNT': '0.540', 'weapon3': '1.154', 'ARMOR': '1.350', 'weapon2': '2.014', 'DAMAGECOUNT': '2.367', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:58:33,824][2409074] Updated weights for policy 0, policy_version 14671 (0.0013)
[2023-02-25 12:58:35,646][2409074] Updated weights for policy 0, policy_version 14681 (0.0012)
[2023-02-25 12:58:36,392][2409468] DAMAGECOUNT value on done: 3153.0
[2023-02-25 12:58:36,397][2409468] Sum rewards: 5.435, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.566', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO4': '0.068', 'weapon5': '0.106', 'AMMO3': '0.113', 'weapon4': '0.210', 'WEAPON5': '0.250', 'ARMOR': '0.404', 'HITCOUNT': '0.570', 'WEAPON3': '0.750', 'weapon2': '1.274', 'weapon3': '2.006', 'DAMAGECOUNT': '2.619', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:58:37,095][2409074] Updated weights for policy 0, policy_version 14691 (0.0012)
[2023-02-25 12:58:37,186][2408954] Fps is (10 sec: 25805.0, 60 sec: 25736.6, 300 sec: 25561.8). Total num frames: 60174336. Throughput: 0: 6423.5. Samples: 15037596. Policy #0 lag: (min: 0.0, avg: 12.6, max: 25.0)
[2023-02-25 12:58:37,187][2408954] Avg episode reward: [(0, '4.309')]
[2023-02-25 12:58:38,937][2409074] Updated weights for policy 0, policy_version 14701 (0.0012)
[2023-02-25 12:58:40,322][2409074] Updated weights for policy 0, policy_version 14711 (0.0012)
[2023-02-25 12:58:40,423][2409468] DAMAGECOUNT value on done: 3356.0
[2023-02-25 12:58:40,425][2409468] Sum rewards: 1.989, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.004', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO3': '0.055', 'AMMO4': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.100', 'weapon4': '0.148', 'WEAPON5': '0.250', 'HITCOUNT': '0.370', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.092', 'weapon2': '1.100', 'weapon3': '1.206'}
[2023-02-25 12:58:41,788][2409074] Updated weights for policy 0, policy_version 14721 (0.0012)
[2023-02-25 12:58:42,186][2408954] Fps is (10 sec: 25395.4, 60 sec: 25668.2, 300 sec: 25534.0). Total num frames: 60297216. Throughput: 0: 6428.8. Samples: 15076416. Policy #0 lag: (min: 0.0, avg: 12.4, max: 23.0)
[2023-02-25 12:58:42,186][2408954] Avg episode reward: [(0, '4.276')]
[2023-02-25 12:58:43,284][2409074] Updated weights for policy 0, policy_version 14731 (0.0013)
[2023-02-25 12:58:43,818][2409077] Large shaping reward 2.578 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.546, 182.0), ('weapon7', 0.002)]
[2023-02-25 12:58:45,149][2409074] Updated weights for policy 0, policy_version 14741 (0.0012)
[2023-02-25 12:58:46,781][2409074] Updated weights for policy 0, policy_version 14751 (0.0012)
[2023-02-25 12:58:47,186][2408954] Fps is (10 sec: 25804.7, 60 sec: 25668.3, 300 sec: 25547.9). Total num frames: 60432384. Throughput: 0: 6427.2. Samples: 15115164. Policy #0 lag: (min: 0.0, avg: 12.4, max: 23.0)
[2023-02-25 12:58:47,186][2408954] Avg episode reward: [(0, '4.276')]
[2023-02-25 12:58:48,218][2409074] Updated weights for policy 0, policy_version 14761 (0.0012)
[2023-02-25 12:58:49,765][2409074] Updated weights for policy 0, policy_version 14771 (0.0012)
[2023-02-25 12:58:51,272][2409074] Updated weights for policy 0, policy_version 14781 (0.0012)
[2023-02-25 12:58:52,186][2408954] Fps is (10 sec: 26214.6, 60 sec: 25668.3, 300 sec: 25547.9). Total num frames: 60559360. Throughput: 0: 6439.5. Samples: 15134568. Policy #0 lag: (min: 0.0, avg: 12.4, max: 23.0)
[2023-02-25 12:58:52,186][2408954] Avg episode reward: [(0, '4.276')]
[2023-02-25 12:58:52,912][2409074] Updated weights for policy 0, policy_version 14791 (0.0012)
[2023-02-25 12:58:54,400][2409074] Updated weights for policy 0, policy_version 14801 (0.0012)
[2023-02-25 12:58:56,252][2409074] Updated weights for policy 0, policy_version 14811 (0.0013)
[2023-02-25 12:58:57,186][2408954] Fps is (10 sec: 25804.5, 60 sec: 25736.5, 300 sec: 25534.0). Total num frames: 60690432. Throughput: 0: 6431.7. Samples: 15173124. Policy #0 lag: (min: 0.0, avg: 12.3, max: 25.0)
[2023-02-25 12:58:57,186][2408954] Avg episode reward: [(0, '4.276')]
[2023-02-25 12:58:57,824][2409074] Updated weights for policy 0, policy_version 14821 (0.0013)
[2023-02-25 12:58:59,499][2409101] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 12:58:59,545][2409074] Updated weights for policy 0, policy_version 14831 (0.0013)
[2023-02-25 12:59:00,650][2409074] Updated weights for policy 0, policy_version 14841 (0.0012)
[2023-02-25 12:59:02,186][2408954] Fps is (10 sec: 26623.9, 60 sec: 25736.5, 300 sec: 25589.6). Total num frames: 60825600. Throughput: 0: 6428.8. Samples: 15211668. Policy #0 lag: (min: 0.0, avg: 12.3, max: 25.0)
[2023-02-25 12:59:02,187][2408954] Avg episode reward: [(0, '4.276')]
[2023-02-25 12:59:02,436][2409074] Updated weights for policy 0, policy_version 14851 (0.0012)
[2023-02-25 12:59:03,327][2409485] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)]
[2023-02-25 12:59:04,186][2409074] Updated weights for policy 0, policy_version 14861 (0.0013)
[2023-02-25 12:59:05,472][2409074] Updated weights for policy 0, policy_version 14871 (0.0012)
[2023-02-25 12:59:07,186][2408954] Fps is (10 sec: 24985.7, 60 sec: 25600.0, 300 sec: 25575.7). Total num frames: 60940288. Throughput: 0: 6439.5. Samples: 15231072. Policy #0 lag: (min: 1.0, avg: 10.9, max: 25.0)
[2023-02-25 12:59:07,186][2408954] Avg episode reward: [(0, '4.276')]
[2023-02-25 12:59:07,454][2409074] Updated weights for policy 0, policy_version 14881 (0.0012)
[2023-02-25 12:59:08,507][2409100] DAMAGECOUNT value on done: 3732.0
[2023-02-25 12:59:08,508][2409100] Sum rewards: 6.577, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.094', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'AMMO3': '0.060', 'WEAPON1': '0.060', 'weapon7': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.162', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.262', 'ARMOR': '0.400', 'HITCOUNT': '0.430', 'WEAPON3': '0.550', 'weapon3': '1.498', 'weapon2': '1.730', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:59:08,712][2409074] Updated weights for policy 0, policy_version 14891 (0.0012)
[2023-02-25 12:59:10,423][2409866] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)]
[2023-02-25 12:59:10,876][2409074] Updated weights for policy 0, policy_version 14901 (0.0012)
[2023-02-25 12:59:11,873][2409103] DAMAGECOUNT value on done: 2566.0
[2023-02-25 12:59:11,874][2409103] Sum rewards: 3.700, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.790', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'AMMO3': '0.057', 'weapon5': '0.076', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'weapon7': '0.156', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'ARMOR': '0.420', 'weapon4': '0.430', 'HITCOUNT': '0.480', 'weapon3': '1.060', 'weapon2': '1.206', 'DAMAGECOUNT': '1.614', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:59:12,084][2409074] Updated weights for policy 0, policy_version 14911 (0.0013)
[2023-02-25 12:59:12,132][2409100] DAMAGECOUNT value on done: 3521.0
[2023-02-25 12:59:12,133][2409100] Sum rewards: 5.487, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.988', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO3': '0.060', 'WEAPON1': '0.070', 'weapon7': '0.082', 'AMMO4': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.300', 'HITCOUNT': '0.380', 'WEAPON3': '0.450', 'ARMOR': '0.454', 'weapon2': '1.466', 'weapon3': '1.472', 'DAMAGECOUNT': '2.133', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:59:12,186][2408954] Fps is (10 sec: 25395.3, 60 sec: 25873.1, 300 sec: 25561.8). Total num frames: 61079552. Throughput: 0: 6441.6. Samples: 15269472. Policy #0 lag: (min: 1.0, avg: 10.9, max: 25.0)
[2023-02-25 12:59:12,186][2408954] Avg episode reward: [(0, '4.381')]
[2023-02-25 12:59:13,444][2409074] Updated weights for policy 0, policy_version 14921 (0.0012)
[2023-02-25 12:59:15,112][2409074] Updated weights for policy 0, policy_version 14931 (0.0012)
[2023-02-25 12:59:15,465][2409103] DAMAGECOUNT value on done: 3939.0
[2023-02-25 12:59:15,466][2409103] Sum rewards: 0.861, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.210', 'AMMO2': '0.008', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.041', 'AMMO4': '0.041', 'weapon5': '0.098', 'weapon4': '0.106', 'WEAPON4': '0.200', 'HITCOUNT': '0.280', 'WEAPON5': '0.350', 'WEAPON3': '0.350', 'ARMOR': '0.457', 'weapon3': '0.978', 'DAMAGECOUNT': '0.990', 'FRAGCOUNT': '1.000', 'weapon2': '1.636'}
[2023-02-25 12:59:15,748][2409100] DAMAGECOUNT value on done: 2993.0
[2023-02-25 12:59:15,751][2409100] Sum rewards: 1.448, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.730', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.033', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'weapon5': '0.156', 'weapon4': '0.228', 'HITCOUNT': '0.460', 'ARMOR': '0.492', 'WEAPON5': '0.650', 'WEAPON3': '0.850', 'weapon2': '1.138', 'weapon3': '1.860', 'DAMAGECOUNT': '2.034', 'FRAGCOUNT': '3.500'}
[2023-02-25 12:59:16,902][2409074] Updated weights for policy 0, policy_version 14941 (0.0012)
[2023-02-25 12:59:17,186][2408954] Fps is (10 sec: 26624.1, 60 sec: 25736.5, 300 sec: 25562.2). Total num frames: 61206528. Throughput: 0: 6426.4. Samples: 15307728. Policy #0 lag: (min: 0.0, avg: 12.4, max: 25.0)
[2023-02-25 12:59:17,186][2408954] Avg episode reward: [(0, '4.366')]
[2023-02-25 12:59:18,556][2409074] Updated weights for policy 0, policy_version 14951 (0.0012)
[2023-02-25 12:59:19,206][2409103] DAMAGECOUNT value on done: 2887.0
[2023-02-25 12:59:19,209][2409103] Sum rewards: 0.865, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.000', 'AMMO5': '0.009', 'AMMO2': '0.012', 'weapon4': '0.018', 'WEAPON1': '0.030', 'AMMO4': '0.061', 'AMMO3': '0.071', 'weapon5': '0.124', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.585', 'weapon3': '1.230', 'weapon2': '1.904', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:59:19,337][2409549] DAMAGECOUNT value on done: 3221.0
[2023-02-25 12:59:19,339][2409549] Sum rewards: 8.235, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.406', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.032', 'WEAPON1': '0.040', 'AMMO3': '0.061', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'WEAPON5': '0.200', 'weapon5': '0.226', 'WEAPON3': '0.400', 'HITCOUNT': '0.520', 'ARMOR': '0.832', 'weapon3': '0.984', 'weapon2': '1.978', 'DAMAGECOUNT': '2.634', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:59:19,423][2409100] DAMAGECOUNT value on done: 2721.0
[2023-02-25 12:59:19,426][2409100] Sum rewards: 2.485, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'AMMO3': '0.040', 'HEALTH': '0.080', 'weapon5': '0.106', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'WEAPON3': '0.200', 'HITCOUNT': '0.210', 'weapon4': '0.242', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.603', 'weapon3': '0.646', 'weapon2': '1.660', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:59:20,028][2409074] Updated weights for policy 0, policy_version 14961 (0.0012)
[2023-02-25 12:59:20,050][2409406] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 12:59:22,059][2409074] Updated weights for policy 0, policy_version 14971 (0.0012)
[2023-02-25 12:59:22,186][2408954] Fps is (10 sec: 24575.1, 60 sec: 25531.6, 300 sec: 25561.8). Total num frames: 61325312. Throughput: 0: 6436.8. Samples: 15327252. Policy #0 lag: (min: 0.0, avg: 12.4, max: 25.0)
[2023-02-25 12:59:22,187][2408954] Avg episode reward: [(0, '4.381')]
[2023-02-25 12:59:22,920][2409103] DAMAGECOUNT value on done: 2859.0
[2023-02-25 12:59:22,921][2409103] Sum rewards: 3.598, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.926', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'weapon5': '0.112', 'weapon4': '0.296', 'HITCOUNT': '0.390', 'WEAPON3': '0.550', 'ARMOR': '1.313', 'weapon2': '1.550', 'DAMAGECOUNT': '1.581', 'weapon3': '1.832', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:59:23,022][2409100] DAMAGECOUNT value on done: 3561.0
[2023-02-25 12:59:23,025][2409100] Sum rewards: 3.593, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.234', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.057', 'weapon7': '0.074', 'AMMO4': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.178', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.230', 'weapon4': '0.252', 'WEAPON3': '0.400', 'weapon3': '0.930', 'ARMOR': '1.355', 'DAMAGECOUNT': '1.551', 'weapon2': '2.202', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:59:23,431][2409074] Updated weights for policy 0, policy_version 14981 (0.0012)
[2023-02-25 12:59:23,588][2409549] DAMAGECOUNT value on done: 4025.0
[2023-02-25 12:59:23,591][2409549] Sum rewards: 1.843, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.440', 'AMMO5': '0.011', 'AMMO2': '0.032', 'WEAPON1': '0.050', 'weapon5': '0.100', 'AMMO3': '0.118', 'WEAPON4': '0.150', 'AMMO4': '0.159', 'weapon4': '0.162', 'WEAPON5': '0.300', 'HITCOUNT': '0.510', 'WEAPON3': '0.850', 'weapon2': '1.438', 'DAMAGECOUNT': '1.695', 'weapon3': '1.958', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:59:23,905][2409548] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)]
[2023-02-25 12:59:24,865][2409074] Updated weights for policy 0, policy_version 14991 (0.0013)
[2023-02-25 12:59:25,017][2409102] DAMAGECOUNT value on done: 3362.0
[2023-02-25 12:59:25,017][2409102] Sum rewards: 4.889, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'HEALTH': '0.128', 'HITCOUNT': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.242', 'weapon4': '0.312', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'weapon3': '1.040', 'DAMAGECOUNT': '1.050', 'weapon2': '1.648', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:59:26,343][2409074] Updated weights for policy 0, policy_version 15001 (0.0012)
[2023-02-25 12:59:26,603][2409103] DAMAGECOUNT value on done: 2760.0
[2023-02-25 12:59:26,604][2409103] Sum rewards: 4.577, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO3': '0.020', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.123', 'WEAPON3': '0.150', 'weapon7': '0.164', 'HEALTH': '0.196', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.240', 'weapon3': '0.498', 'weapon4': '0.522', 'weapon2': '0.806', 'DAMAGECOUNT': '0.918', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:59:26,660][2409100] DAMAGECOUNT value on done: 3100.0
[2023-02-25 12:59:26,662][2409100] Sum rewards: 3.948, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.928', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'AMMO4': '0.087', 'weapon7': '0.102', 'weapon5': '0.104', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'HITCOUNT': '0.380', 'WEAPON3': '0.450', 'weapon4': '0.462', 'ARMOR': '0.488', 'weapon2': '1.180', 'DAMAGECOUNT': '1.206', 'weapon3': '1.256', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:59:26,943][2409485] DAMAGECOUNT value on done: 2976.0
[2023-02-25 12:59:27,186][2408954] Fps is (10 sec: 24985.7, 60 sec: 25668.3, 300 sec: 25547.9). Total num frames: 61456384. Throughput: 0: 6424.8. Samples: 15365532. Policy #0 lag: (min: 0.0, avg: 13.8, max: 26.0)
[2023-02-25 12:59:27,186][2408954] Avg episode reward: [(0, '4.296')]
[2023-02-25 12:59:27,190][2409549] DAMAGECOUNT value on done: 3266.0
[2023-02-25 12:59:27,194][2409549] Sum rewards: 3.177, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.141', 'AMMO5': '0.007', 'AMMO2': '0.016', 'ARMOR': '0.024', 'weapon5': '0.050', 'WEAPON1': '0.070', 'AMMO3': '0.072', 'AMMO4': '0.080', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.242', 'HITCOUNT': '0.470', 'WEAPON3': '0.550', 'weapon3': '1.554', 'weapon2': '1.686', 'DAMAGECOUNT': '1.896', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:59:27,976][2409074] Updated weights for policy 0, policy_version 15011 (0.0014)
[2023-02-25 12:59:28,043][2409101] DAMAGECOUNT value on done: 2727.0
[2023-02-25 12:59:28,047][2409101] Sum rewards: 5.958, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.804', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon7': '0.020', 'AMMO4': '0.077', 'weapon5': '0.078', 'AMMO3': '0.083', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.428', 'HITCOUNT': '0.530', 'WEAPON3': '0.550', 'weapon4': '0.756', 'weapon2': '0.772', 'weapon3': '1.642', 'DAMAGECOUNT': '2.241', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:59:28,727][2409102] DAMAGECOUNT value on done: 3036.0
[2023-02-25 12:59:28,732][2409102] Sum rewards: -0.552, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.130', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'AMMO4': '0.091', 'weapon5': '0.106', 'AMMO3': '0.109', 'WEAPON5': '0.200', 'weapon4': '0.378', 'WEAPON4': '0.400', 'HITCOUNT': '0.470', 'ARMOR': '0.481', 'WEAPON3': '0.800', 'weapon2': '1.108', 'DAMAGECOUNT': '1.893', 'weapon3': '1.988', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:59:29,997][2409074] Updated weights for policy 0, policy_version 15021 (0.0013)
[2023-02-25 12:59:30,147][2409103] DAMAGECOUNT value on done: 3326.0
[2023-02-25 12:59:30,151][2409103] Sum rewards: 6.157, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.310', 'AMMO2': '0.006', 'AMMO5': '0.008', 'weapon5': '0.028', 'AMMO4': '0.029', 'weapon7': '0.054', 'AMMO3': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.324', 'ARMOR': '0.412', 'WEAPON3': '0.550', 'HITCOUNT': '0.660', 'weapon2': '0.992', 'weapon3': '1.056', 'DAMAGECOUNT': '2.430', 'FRAGCOUNT': '4.500'}
[2023-02-25 12:59:30,504][2409485] DAMAGECOUNT value on done: 3918.0
[2023-02-25 12:59:30,508][2409485] Sum rewards: 4.758, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.246', 'AMMO5': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.060', 'AMMO4': '0.085', 'AMMO3': '0.110', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'ARMOR': '0.436', 'weapon4': '0.622', 'WEAPON3': '0.650', 'HITCOUNT': '0.860', 'weapon2': '1.130', 'weapon3': '1.746', 'FRAGCOUNT': '3.000', 'DAMAGECOUNT': '3.255'}
[2023-02-25 12:59:30,781][2409100] DAMAGECOUNT value on done: 3550.0
[2023-02-25 12:59:30,782][2409100] Sum rewards: 5.915, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.834', 'AMMO5': '0.013', 'AMMO2': '0.020', 'weapon7': '0.054', 'AMMO3': '0.078', 'AMMO4': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.142', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.640', 'weapon4': '0.802', 'weapon3': '1.012', 'weapon2': '1.274', 'DAMAGECOUNT': '2.565', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:59:31,027][2409549] DAMAGECOUNT value on done: 3136.0
[2023-02-25 12:59:31,031][2409549] Sum rewards: 2.035, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.166', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.035', 'AMMO3': '0.105', 'weapon5': '0.132', 'AMMO4': '0.177', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.330', 'weapon4': '0.354', 'ARMOR': '0.404', 'WEAPON3': '0.600', 'weapon3': '1.294', 'weapon2': '1.688', 'DAMAGECOUNT': '1.791', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:59:31,143][2409405] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 12:59:31,483][2409074] Updated weights for policy 0, policy_version 15031 (0.0013)
[2023-02-25 12:59:31,895][2409101] DAMAGECOUNT value on done: 3584.0
[2023-02-25 12:59:31,898][2409101] Sum rewards: 6.766, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.536', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.054', 'weapon4': '0.072', 'AMMO3': '0.090', 'weapon5': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'ARMOR': '0.824', 'weapon3': '1.648', 'weapon2': '1.826', 'DAMAGECOUNT': '2.679', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:59:32,186][2408954] Fps is (10 sec: 27443.8, 60 sec: 25941.3, 300 sec: 25575.7). Total num frames: 61599744. Throughput: 0: 6412.0. Samples: 15403704. Policy #0 lag: (min: 0.0, avg: 13.8, max: 26.0)
[2023-02-25 12:59:32,187][2408954] Avg episode reward: [(0, '4.288')]
[2023-02-25 12:59:32,333][2409548] DAMAGECOUNT value on done: 2670.0
[2023-02-25 12:59:32,336][2409548] Sum rewards: 5.061, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.820', 'AMMO5': '0.015', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'weapon4': '0.068', 'AMMO4': '0.093', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'weapon5': '0.192', 'WEAPON5': '0.400', 'HITCOUNT': '0.540', 'WEAPON3': '0.650', 'weapon2': '1.450', 'weapon3': '1.860', 'DAMAGECOUNT': '2.106', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:59:32,463][2409102] DAMAGECOUNT value on done: 3768.0
[2023-02-25 12:59:32,465][2409102] Sum rewards: 1.874, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.725', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'ARMOR': '0.020', 'AMMO4': '0.031', 'weapon7': '0.050', 'AMMO3': '0.057', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.134', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.376', 'HITCOUNT': '0.390', 'WEAPON3': '0.400', 'weapon3': '0.898', 'DAMAGECOUNT': '1.509', 'weapon2': '1.716', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:59:32,784][2409099] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 12:59:33,108][2409074] Updated weights for policy 0, policy_version 15041 (0.0012)
[2023-02-25 12:59:33,245][2409597] DAMAGECOUNT value on done: 3413.0
[2023-02-25 12:59:33,246][2409597] Sum rewards: 3.549, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.124', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon5': '0.088', 'AMMO3': '0.103', 'AMMO4': '0.110', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'HITCOUNT': '0.500', 'WEAPON3': '0.650', 'weapon4': '0.910', 'weapon2': '0.914', 'weapon3': '1.198', 'ARMOR': '1.326', 'DAMAGECOUNT': '2.274', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:59:33,727][2409103] DAMAGECOUNT value on done: 2223.0
[2023-02-25 12:59:33,728][2409103] Sum rewards: 4.445, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.566', 'AMMO2': '0.004', 'AMMO4': '0.022', 'AMMO3': '0.041', 'weapon7': '0.082', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.224', 'HITCOUNT': '0.290', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.756', 'weapon3': '0.756', 'ARMOR': '0.800', 'weapon2': '1.196', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:59:34,089][2409485] DAMAGECOUNT value on done: 2293.0
[2023-02-25 12:59:34,092][2409485] Sum rewards: 3.308, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.800', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'AMMO3': '0.067', 'weapon5': '0.126', 'AMMO4': '0.129', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.370', 'WEAPON3': '0.400', 'ARMOR': '0.428', 'weapon4': '0.480', 'weapon2': '1.110', 'DAMAGECOUNT': '1.299', 'weapon3': '1.456', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:59:34,417][2409100] DAMAGECOUNT value on done: 3415.0
[2023-02-25 12:59:34,421][2409100] Sum rewards: 2.168, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.942', 'AMMO5': '0.009', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'AMMO3': '0.075', 'AMMO4': '0.076', 'weapon5': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.320', 'weapon4': '0.330', 'WEAPON3': '0.450', 'ARMOR': '0.905', 'DAMAGECOUNT': '0.906', 'weapon3': '1.018', 'weapon2': '1.426', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:59:34,746][2409074] Updated weights for policy 0, policy_version 15051 (0.0013)
[2023-02-25 12:59:34,771][2409549] DAMAGECOUNT value on done: 3856.0
[2023-02-25 12:59:34,773][2409549] Sum rewards: 7.901, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.564', 'weapon7': '0.004', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.031', 'AMMO3': '0.056', 'weapon5': '0.138', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.420', 'weapon4': '0.476', 'weapon2': '0.798', 'ARMOR': '0.932', 'weapon3': '1.172', 'DAMAGECOUNT': '2.916', 'FRAGCOUNT': '4.500'}
[2023-02-25 12:59:35,622][2409101] DAMAGECOUNT value on done: 3538.0
[2023-02-25 12:59:35,624][2409101] Sum rewards: 4.076, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.858', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.013', 'WEAPON1': '0.020', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'weapon5': '0.190', 'WEAPON5': '0.200', 'weapon4': '0.322', 'HITCOUNT': '0.450', 'WEAPON3': '0.650', 'ARMOR': '1.204', 'weapon2': '1.468', 'weapon3': '1.716', 'DAMAGECOUNT': '2.187', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:59:36,039][2409074] Updated weights for policy 0, policy_version 15061 (0.0012)
[2023-02-25 12:59:36,513][2409102] DAMAGECOUNT value on done: 3807.0
[2023-02-25 12:59:36,516][2409102] Sum rewards: 6.844, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.588', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.081', 'AMMO4': '0.088', 'weapon4': '0.100', 'weapon5': '0.138', 'WEAPON5': '0.250', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'ARMOR': '1.344', 'weapon3': '1.446', 'weapon2': '1.550', 'DAMAGECOUNT': '2.247', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:59:36,603][2409548] DAMAGECOUNT value on done: 3605.0
[2023-02-25 12:59:36,606][2409548] Sum rewards: 14.159, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.662', 'AMMO2': '0.016', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.082', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.206', 'weapon4': '0.230', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'ARMOR': '0.935', 'weapon2': '1.218', 'weapon3': '1.730', 'DAMAGECOUNT': '2.694', 'FRAGCOUNT': '11.000'}
[2023-02-25 12:59:37,164][2409597] DAMAGECOUNT value on done: 3312.0
[2023-02-25 12:59:37,164][2409597] Sum rewards: 5.587, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.006', 'AMMO2': '0.010', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.049', 'weapon5': '0.060', 'AMMO3': '0.070', 'WEAPON4': '0.150', 'weapon4': '0.240', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.453', 'HITCOUNT': '0.480', 'weapon3': '1.598', 'weapon2': '1.716', 'DAMAGECOUNT': '1.725', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:59:37,186][2408954] Fps is (10 sec: 25395.1, 60 sec: 25600.0, 300 sec: 25548.0). Total num frames: 61710336. Throughput: 0: 6409.9. Samples: 15423012. Policy #0 lag: (min: 1.0, avg: 12.1, max: 26.0)
[2023-02-25 12:59:37,186][2408954] Avg episode reward: [(0, '4.491')]
[2023-02-25 12:59:37,292][2409103] DAMAGECOUNT value on done: 3364.0
[2023-02-25 12:59:37,293][2409103] Sum rewards: 5.385, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.632', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.034', 'weapon7': '0.052', 'AMMO3': '0.077', 'AMMO4': '0.149', 'WEAPON5': '0.250', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.470', 'WEAPON4': '0.500', 'WEAPON3': '0.550', 'ARMOR': '0.832', 'weapon4': '0.892', 'weapon3': '1.070', 'weapon2': '1.162', 'DAMAGECOUNT': '2.037', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:59:37,695][2409485] DAMAGECOUNT value on done: 3892.0
[2023-02-25 12:59:37,696][2409485] Sum rewards: 6.791, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.660', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.066', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.104', 'weapon5': '0.112', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.492', 'WEAPON3': '0.500', 'HITCOUNT': '0.560', 'ARMOR': '0.857', 'weapon3': '1.156', 'weapon2': '1.412', 'DAMAGECOUNT': '2.076', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:59:37,805][2409074] Updated weights for policy 0, policy_version 15071 (0.0012)
[2023-02-25 12:59:38,525][2409549] DAMAGECOUNT value on done: 2965.0
[2023-02-25 12:59:38,528][2409549] Sum rewards: 8.535, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'HEALTH': '0.020', 'AMMO2': '0.025', 'ARMOR': '0.032', 'AMMO3': '0.066', 'weapon5': '0.070', 'AMMO4': '0.127', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.600', 'weapon4': '0.702', 'weapon2': '1.000', 'weapon3': '1.274', 'DAMAGECOUNT': '2.199', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:59:38,676][2409100] DAMAGECOUNT value on done: 4163.0
[2023-02-25 12:59:38,676][2409100] Sum rewards: 4.315, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.050', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.056', 'weapon7': '0.058', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.250', 'WEAPON3': '0.600', 'HITCOUNT': '0.670', 'weapon2': '1.042', 'weapon3': '1.440', 'DAMAGECOUNT': '2.424', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:59:39,398][2409074] Updated weights for policy 0, policy_version 15081 (0.0013)
[2023-02-25 12:59:39,458][2409101] DAMAGECOUNT value on done: 3230.0
[2023-02-25 12:59:39,458][2409101] Sum rewards: 6.424, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.012', 'AMMO2': '0.009', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.043', 'weapon7': '0.056', 'AMMO3': '0.057', 'weapon4': '0.116', 'weapon5': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.540', 'ARMOR': '0.903', 'weapon3': '1.090', 'weapon2': '1.920', 'DAMAGECOUNT': '2.511', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:59:40,318][2409548] DAMAGECOUNT value on done: 3746.0
[2023-02-25 12:59:40,322][2409548] Sum rewards: 3.109, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.040', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'AMMO3': '0.096', 'WEAPON4': '0.250', 'weapon4': '0.350', 'ARMOR': '0.473', 'HITCOUNT': '0.540', 'WEAPON3': '0.650', 'weapon2': '1.330', 'weapon3': '1.522', 'DAMAGECOUNT': '1.755', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:59:40,641][2409565] DAMAGECOUNT value on done: 2581.0
[2023-02-25 12:59:40,644][2409565] Sum rewards: 4.608, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.266', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO2': '0.034', 'AMMO3': '0.083', 'weapon5': '0.150', 'AMMO4': '0.169', 'WEAPON4': '0.200', 'HITCOUNT': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.456', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.110', 'ARMOR': '1.204', 'weapon3': '1.330', 'weapon2': '1.588', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:59:40,805][2409097] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 12:59:40,826][2409102] DAMAGECOUNT value on done: 3225.0
[2023-02-25 12:59:40,836][2409102] Sum rewards: 14.119, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'weapon7': '0.066', 'AMMO4': '0.067', 'AMMO3': '0.071', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'HEALTH': '0.164', 'WEAPON5': '0.200', 'weapon5': '0.248', 'WEAPON3': '0.350', 'weapon4': '0.440', 'ARMOR': '0.455', 'weapon2': '0.772', 'HITCOUNT': '0.810', 'weapon3': '1.568', 'DAMAGECOUNT': '3.216', 'FRAGCOUNT': '9.000'}
[2023-02-25 12:59:40,846][2409103] DAMAGECOUNT value on done: 3160.0
[2023-02-25 12:59:40,850][2409103] Sum rewards: 6.007, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.070', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon5': '0.052', 'AMMO3': '0.067', 'weapon7': '0.138', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HITCOUNT': '0.320', 'WEAPON3': '0.550', 'weapon3': '1.358', 'weapon2': '1.672', 'DAMAGECOUNT': '1.737', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:59:41,098][2409074] Updated weights for policy 0, policy_version 15091 (0.0012)
[2023-02-25 12:59:41,214][2409597] DAMAGECOUNT value on done: 2858.0
[2023-02-25 12:59:41,215][2409597] Sum rewards: 1.502, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'HEALTH': '0.029', 'AMMO2': '0.038', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.126', 'AMMO4': '0.190', 'weapon4': '0.196', 'HITCOUNT': '0.300', 'WEAPON3': '0.350', 'WEAPON5': '0.450', 'ARMOR': '0.464', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.104', 'weapon3': '1.216', 'weapon2': '1.840'}
[2023-02-25 12:59:41,263][2409485] DAMAGECOUNT value on done: 4438.0
[2023-02-25 12:59:41,266][2409485] Sum rewards: 9.987, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.440', 'AMMO2': '0.006', 'AMMO5': '0.021', 'AMMO4': '0.029', 'WEAPON1': '0.030', 'AMMO3': '0.092', 'weapon5': '0.092', 'WEAPON4': '0.100', 'weapon4': '0.116', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.760', 'weapon2': '1.282', 'ARMOR': '1.321', 'weapon3': '2.154', 'DAMAGECOUNT': '3.825', 'FRAGCOUNT': '9.500'}
[2023-02-25 12:59:41,811][2409105] DAMAGECOUNT value on done: 3163.0
[2023-02-25 12:59:41,812][2409105] Sum rewards: 0.502, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.685', 'AMMO5': '0.007', 'AMMO2': '0.027', 'WEAPON1': '0.040', 'AMMO3': '0.078', 'weapon5': '0.104', 'AMMO4': '0.137', 'WEAPON5': '0.200', 'HITCOUNT': '0.270', 'WEAPON4': '0.350', 'weapon4': '0.388', 'WEAPON3': '0.450', 'ARMOR': '0.465', 'DAMAGECOUNT': '1.116', 'weapon3': '1.180', 'weapon2': '1.874', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:59:41,885][2409077] Large shaping reward 3.642 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 12:59:42,186][2408954] Fps is (10 sec: 24166.8, 60 sec: 25736.6, 300 sec: 25575.7). Total num frames: 61841408. Throughput: 0: 6399.2. Samples: 15461088. Policy #0 lag: (min: 1.0, avg: 12.1, max: 26.0)
[2023-02-25 12:59:42,186][2408954] Avg episode reward: [(0, '4.649')]
[2023-02-25 12:59:42,186][2409033] Saving new best policy, reward=4.649!
[2023-02-25 12:59:42,491][2409549] DAMAGECOUNT value on done: 2892.0
[2023-02-25 12:59:42,492][2409549] Sum rewards: 4.194, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.297', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'weapon7': '0.048', 'weapon5': '0.082', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.240', 'HITCOUNT': '0.380', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.113', 'weapon2': '1.492', 'weapon3': '1.730', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:59:42,494][2409100] DAMAGECOUNT value on done: 3109.0
[2023-02-25 12:59:42,497][2409100] Sum rewards: -0.539, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.285', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO2': '0.038', 'AMMO3': '0.094', 'weapon5': '0.162', 'AMMO4': '0.192', 'HITCOUNT': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon4': '0.504', 'ARMOR': '0.530', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.834', 'weapon2': '1.306', 'weapon3': '1.566', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:59:42,991][2409074] Updated weights for policy 0, policy_version 15101 (0.0012)
[2023-02-25 12:59:43,352][2409101] DAMAGECOUNT value on done: 3206.0
[2023-02-25 12:59:43,355][2409101] Sum rewards: 5.617, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.731', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.056', 'weapon7': '0.076', 'AMMO3': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.280', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'ARMOR': '0.849', 'weapon2': '1.398', 'DAMAGECOUNT': '1.407', 'weapon3': '1.506', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:59:44,028][2409074] Updated weights for policy 0, policy_version 15111 (0.0014)
[2023-02-25 12:59:44,146][2409548] DAMAGECOUNT value on done: 2751.0
[2023-02-25 12:59:44,149][2409548] Sum rewards: 4.320, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.294', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.005', 'weapon5': '0.044', 'AMMO3': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.132', 'WEAPON7': '0.200', 'weapon4': '0.228', 'HITCOUNT': '0.250', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.708', 'weapon3': '0.764', 'weapon2': '0.840', 'ARMOR': '0.855', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:59:44,340][2409565] DAMAGECOUNT value on done: 3113.0
[2023-02-25 12:59:44,436][2409102] DAMAGECOUNT value on done: 2210.0
[2023-02-25 12:59:44,440][2409103] DAMAGECOUNT value on done: 2615.0
[2023-02-25 12:59:44,441][2409103] Sum rewards: 2.087, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.952', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'weapon5': '0.050', 'AMMO3': '0.095', 'AMMO4': '0.106', 'weapon4': '0.128', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.380', 'WEAPON3': '0.600', 'ARMOR': '0.800', 'DAMAGECOUNT': '1.425', 'weapon3': '1.434', 'weapon2': '1.612', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:59:44,849][2409596] DAMAGECOUNT value on done: 3994.0
[2023-02-25 12:59:44,854][2409596] Sum rewards: 0.151, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.100', 'AMMO2': '0.011', 'AMMO5': '0.019', 'WEAPON1': '0.030', 'AMMO4': '0.057', 'AMMO3': '0.064', 'weapon5': '0.074', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'HITCOUNT': '0.460', 'ARMOR': '0.494', 'weapon4': '0.784', 'weapon2': '0.922', 'weapon3': '1.162', 'DAMAGECOUNT': '1.323', 'FRAGCOUNT': '1.500'}
[2023-02-25 12:59:45,076][2409485] DAMAGECOUNT value on done: 4033.0
[2023-02-25 12:59:45,080][2409485] Sum rewards: 3.459, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.926', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.056', 'AMMO4': '0.137', 'AMMO3': '0.160', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.537', 'weapon4': '0.650', 'HITCOUNT': '0.840', 'WEAPON3': '0.950', 'weapon2': '0.992', 'weapon3': '1.682', 'DAMAGECOUNT': '2.640', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:59:45,117][2409597] DAMAGECOUNT value on done: 4266.0
[2023-02-25 12:59:45,120][2409597] Sum rewards: 10.367, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.080', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.068', 'WEAPON5': '0.100', 'weapon5': '0.158', 'weapon4': '0.254', 'WEAPON3': '0.500', 'ARMOR': '0.500', 'HITCOUNT': '0.750', 'weapon3': '1.310', 'weapon2': '1.860', 'DAMAGECOUNT': '3.087', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:59:45,753][2409105] DAMAGECOUNT value on done: 3080.0
[2023-02-25 12:59:45,754][2409105] Sum rewards: -1.818, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.624', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.044', 'AMMO3': '0.076', 'weapon7': '0.076', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.130', 'AMMO4': '0.218', 'WEAPON5': '0.250', 'HITCOUNT': '0.280', 'WEAPON3': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.562', 'ARMOR': '0.853', 'DAMAGECOUNT': '1.005', 'weapon3': '1.218', 'weapon2': '1.504', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:59:45,798][2409866] DAMAGECOUNT value on done: 3053.0
[2023-02-25 12:59:45,799][2409866] Sum rewards: 0.290, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.320', 'AMMO2': '0.010', 'AMMO5': '0.013', 'WEAPON1': '0.030', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'weapon5': '0.118', 'AMMO3': '0.121', 'weapon4': '0.230', 'WEAPON5': '0.300', 'HITCOUNT': '0.400', 'ARMOR': '0.600', 'WEAPON3': '0.750', 'weapon3': '1.388', 'weapon2': '1.576', 'DAMAGECOUNT': '1.725', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:59:45,901][2409074] Updated weights for policy 0, policy_version 15121 (0.0012)
[2023-02-25 12:59:46,057][2409100] DAMAGECOUNT value on done: 1982.0
[2023-02-25 12:59:46,060][2409100] Sum rewards: -2.098, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.990', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.094', 'AMMO3': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.270', 'WEAPON4': '0.500', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.750', 'weapon3': '0.936', 'ARMOR': '0.953', 'weapon4': '1.230', 'weapon2': '1.310', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:59:46,066][2409549] DAMAGECOUNT value on done: 3275.0
[2023-02-25 12:59:46,067][2409549] Sum rewards: 4.290, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.911', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'weapon5': '0.058', 'AMMO3': '0.063', 'WEAPON5': '0.100', 'weapon7': '0.106', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.224', 'HITCOUNT': '0.270', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon3': '0.712', 'weapon2': '1.100', 'DAMAGECOUNT': '1.344', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:59:46,913][2409101] DAMAGECOUNT value on done: 4088.0
[2023-02-25 12:59:46,916][2409101] Sum rewards: 5.169, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.734', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'ARMOR': '0.024', 'weapon5': '0.040', 'weapon7': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.075', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.376', 'HITCOUNT': '0.450', 'WEAPON3': '0.550', 'weapon3': '1.108', 'weapon2': '1.228', 'DAMAGECOUNT': '1.908', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:59:47,186][2408954] Fps is (10 sec: 25804.2, 60 sec: 25599.9, 300 sec: 25520.1). Total num frames: 61968384. Throughput: 0: 6391.2. Samples: 15499272. Policy #0 lag: (min: 0.0, avg: 11.4, max: 25.0)
[2023-02-25 12:59:47,186][2408954] Avg episode reward: [(0, '4.310')]
[2023-02-25 12:59:47,351][2409074] Updated weights for policy 0, policy_version 15131 (0.0012)
[2023-02-25 12:59:47,654][2409355] DAMAGECOUNT value on done: 2746.0
[2023-02-25 12:59:47,656][2409355] Sum rewards: 2.303, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO3': '0.070', 'weapon5': '0.110', 'AMMO4': '0.142', 'HITCOUNT': '0.160', 'WEAPON5': '0.200', 'HEALTH': '0.246', 'WEAPON4': '0.300', 'WEAPON3': '0.300', 'weapon2': '0.588', 'DAMAGECOUNT': '0.726', 'weapon4': '0.750', 'ARMOR': '0.875', 'weapon3': '1.050', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:59:47,954][2409565] DAMAGECOUNT value on done: 3585.0
[2023-02-25 12:59:47,957][2409565] Sum rewards: 10.248, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon7': '0.052', 'AMMO3': '0.085', 'weapon4': '0.086', 'AMMO4': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon5': '0.150', 'HEALTH': '0.172', 'WEAPON7': '0.200', 'WEAPON3': '0.450', 'HITCOUNT': '0.580', 'ARMOR': '0.907', 'weapon3': '1.346', 'weapon2': '2.102', 'DAMAGECOUNT': '2.544', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:59:48,040][2409102] DAMAGECOUNT value on done: 4124.0
[2023-02-25 12:59:48,041][2409102] Sum rewards: 4.483, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.035', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.075', 'weapon5': '0.088', 'WEAPON4': '0.100', 'weapon4': '0.120', 'WEAPON5': '0.250', 'HITCOUNT': '0.440', 'WEAPON3': '0.550', 'weapon3': '1.438', 'DAMAGECOUNT': '1.782', 'weapon2': '1.894', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:59:48,123][2409406] DAMAGECOUNT value on done: 2614.0
[2023-02-25 12:59:48,123][2409406] Sum rewards: 1.856, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.020', 'AMMO2': '0.030', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO3': '0.091', 'weapon5': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'WEAPON5': '0.400', 'HEALTH': '0.427', 'weapon4': '0.446', 'WEAPON3': '0.550', 'ARMOR': '0.832', 'DAMAGECOUNT': '0.885', 'weapon2': '1.226', 'weapon3': '1.488', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:59:48,164][2409548] DAMAGECOUNT value on done: 3240.0
[2023-02-25 12:59:48,174][2409548] Sum rewards: 6.961, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.637', 'AMMO5': '0.017', 'AMMO2': '0.030', 'weapon5': '0.050', 'AMMO3': '0.085', 'AMMO4': '0.151', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.430', 'WEAPON3': '0.550', 'ARMOR': '0.871', 'DAMAGECOUNT': '1.401', 'weapon2': '1.758', 'weapon3': '1.776', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:59:48,185][2409103] DAMAGECOUNT value on done: 2903.0
[2023-02-25 12:59:48,186][2409103] Sum rewards: 5.695, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.408', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.078', 'weapon4': '0.232', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.500', 'weapon3': '1.178', 'weapon2': '1.426', 'DAMAGECOUNT': '1.680', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:59:48,248][2409077] DAMAGECOUNT value on done: 4313.0
[2023-02-25 12:59:48,251][2409077] Sum rewards: 5.626, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.794', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.040', 'weapon5': '0.064', 'AMMO3': '0.077', 'weapon7': '0.098', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.266', 'WEAPON7': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.630', 'ARMOR': '0.808', 'weapon3': '1.288', 'weapon2': '1.932', 'DAMAGECOUNT': '2.391', 'FRAGCOUNT': '5.500'}
[2023-02-25 12:59:48,459][2409373] DAMAGECOUNT value on done: 3052.0
[2023-02-25 12:59:48,461][2409373] Sum rewards: 3.306, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.667', 'WEAPON1': '0.020', 'AMMO5': '0.026', 'AMMO2': '0.032', 'AMMO3': '0.116', 'AMMO4': '0.159', 'weapon5': '0.276', 'WEAPON4': '0.550', 'weapon2': '0.550', 'WEAPON5': '0.600', 'HITCOUNT': '0.670', 'WEAPON3': '0.750', 'weapon4': '0.860', 'ARMOR': '1.288', 'weapon3': '1.404', 'DAMAGECOUNT': '2.922', 'FRAGCOUNT': '5.500'}
[2023-02-25 12:59:48,499][2409596] DAMAGECOUNT value on done: 3536.0
[2023-02-25 12:59:48,500][2409596] Sum rewards: 1.036, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.630', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon5': '0.022', 'weapon7': '0.048', 'AMMO4': '0.056', 'AMMO3': '0.062', 'ARMOR': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.270', 'WEAPON3': '0.450', 'weapon2': '0.552', 'weapon4': '0.610', 'DAMAGECOUNT': '0.786', 'weapon3': '0.820', 'FRAGCOUNT': '1.000'}
[2023-02-25 12:59:48,670][2409485] DAMAGECOUNT value on done: 3133.0
[2023-02-25 12:59:48,672][2409485] Sum rewards: 7.028, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.320', 'AMMO2': '0.005', 'weapon7': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.022', 'weapon5': '0.024', 'AMMO3': '0.094', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.420', 'weapon4': '0.444', 'WEAPON3': '0.700', 'weapon2': '1.062', 'DAMAGECOUNT': '1.431', 'weapon3': '1.716', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:59:48,734][2409597] DAMAGECOUNT value on done: 4257.0
[2023-02-25 12:59:48,734][2409597] Sum rewards: -2.136, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.961', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.008', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'AMMO4': '0.086', 'weapon5': '0.162', 'WEAPON3': '0.300', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'HITCOUNT': '0.420', 'ARMOR': '0.492', 'weapon4': '0.572', 'weapon3': '0.812', 'DAMAGECOUNT': '1.377', 'weapon2': '2.118'}
[2023-02-25 12:59:48,821][2409074] Updated weights for policy 0, policy_version 15141 (0.0012)
[2023-02-25 12:59:49,493][2409866] DAMAGECOUNT value on done: 3647.0
[2023-02-25 12:59:49,497][2409866] Sum rewards: 7.170, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.060', 'weapon4': '0.080', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'HEALTH': '0.224', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.740', 'weapon3': '1.434', 'weapon2': '1.466', 'DAMAGECOUNT': '2.346', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:59:49,509][2409105] DAMAGECOUNT value on done: 4202.0
[2023-02-25 12:59:49,510][2409105] Sum rewards: 7.279, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.034', 'WEAPON1': '0.040', 'HEALTH': '0.042', 'AMMO3': '0.070', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.202', 'HITCOUNT': '0.400', 'WEAPON3': '0.400', 'ARMOR': '0.408', 'weapon2': '1.550', 'weapon3': '1.704', 'DAMAGECOUNT': '2.301', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:59:49,608][2409549] DAMAGECOUNT value on done: 3424.0
[2023-02-25 12:59:49,610][2409549] Sum rewards: 2.358, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.297', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.036', 'AMMO3': '0.060', 'weapon5': '0.060', 'WEAPON5': '0.200', 'HITCOUNT': '0.320', 'WEAPON3': '0.400', 'weapon3': '0.966', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.050', 'weapon2': '1.528'}
[2023-02-25 12:59:49,942][2409033] Signal inference workers to stop experience collection... (1850 times)
[2023-02-25 12:59:49,948][2409033] Signal inference workers to resume experience collection... (1850 times)
[2023-02-25 12:59:49,962][2409074] InferenceWorker_p0-w0: stopping experience collection (1850 times)
[2023-02-25 12:59:49,984][2409074] InferenceWorker_p0-w0: resuming experience collection (1850 times)
[2023-02-25 12:59:50,391][2409100] DAMAGECOUNT value on done: 4106.0
[2023-02-25 12:59:50,394][2409100] Sum rewards: 1.946, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.576', 'weapon7': '0.018', 'AMMO5': '0.025', 'AMMO2': '0.031', 'WEAPON1': '0.060', 'AMMO3': '0.106', 'weapon5': '0.110', 'AMMO4': '0.157', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.400', 'HITCOUNT': '0.400', 'WEAPON5': '0.450', 'ARMOR': '0.481', 'WEAPON3': '0.750', 'weapon4': '0.768', 'weapon2': '0.888', 'weapon3': '1.754', 'DAMAGECOUNT': '1.773', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:59:50,853][2409074] Updated weights for policy 0, policy_version 15151 (0.0013)
[2023-02-25 12:59:51,081][2409101] DAMAGECOUNT value on done: 2997.0
[2023-02-25 12:59:51,084][2409101] Sum rewards: 0.751, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.670', 'AMMO5': '0.004', 'AMMO2': '0.020', 'weapon5': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.056', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'HITCOUNT': '0.270', 'WEAPON3': '0.300', 'weapon4': '0.346', 'DAMAGECOUNT': '0.825', 'ARMOR': '0.853', 'FRAGCOUNT': '1.000', 'weapon3': '1.232', 'weapon2': '1.490'}
[2023-02-25 12:59:51,494][2409355] DAMAGECOUNT value on done: 2771.0
[2023-02-25 12:59:51,679][2409565] DAMAGECOUNT value on done: 4507.0
[2023-02-25 12:59:51,680][2409565] Sum rewards: 6.631, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.637', 'AMMO2': '0.020', 'AMMO3': '0.060', 'ARMOR': '0.064', 'AMMO4': '0.097', 'weapon7': '0.118', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'WEAPON3': '0.400', 'WEAPON4': '0.400', 'HITCOUNT': '0.500', 'weapon3': '0.768', 'weapon4': '0.838', 'weapon2': '1.082', 'DAMAGECOUNT': '2.541', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:59:51,735][2409102] DAMAGECOUNT value on done: 3630.0
[2023-02-25 12:59:51,738][2409102] Sum rewards: 5.251, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.854', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.059', 'AMMO3': '0.067', 'weapon7': '0.068', 'weapon5': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.364', 'HITCOUNT': '0.390', 'WEAPON3': '0.450', 'weapon4': '0.506', 'ARMOR': '0.800', 'weapon3': '1.136', 'DAMAGECOUNT': '2.529', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:59:51,773][2409406] DAMAGECOUNT value on done: 3278.0
[2023-02-25 12:59:51,776][2409406] Sum rewards: 6.240, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.381', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO3': '0.060', 'AMMO4': '0.109', 'weapon5': '0.174', 'WEAPON5': '0.300', 'HITCOUNT': '0.380', 'WEAPON3': '0.400', 'WEAPON4': '0.450', 'ARMOR': '0.502', 'weapon2': '0.578', 'weapon4': '0.988', 'weapon3': '1.402', 'DAMAGECOUNT': '1.476', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:59:51,894][2409077] DAMAGECOUNT value on done: 3281.0
[2023-02-25 12:59:51,897][2409077] Sum rewards: 3.511, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.662', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.036', 'weapon7': '0.084', 'AMMO4': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.250', 'weapon4': '0.546', 'weapon3': '0.606', 'weapon2': '0.802', 'ARMOR': '0.854', 'DAMAGECOUNT': '0.981', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:59:51,898][2409103] DAMAGECOUNT value on done: 3687.0
[2023-02-25 12:59:51,898][2409103] Sum rewards: 9.080, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.517', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon7': '0.048', 'AMMO3': '0.087', 'AMMO4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.152', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.422', 'WEAPON3': '0.500', 'HITCOUNT': '0.510', 'weapon2': '1.058', 'weapon3': '1.238', 'ARMOR': '1.331', 'DAMAGECOUNT': '2.781', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:59:52,079][2409074] Updated weights for policy 0, policy_version 15161 (0.0012)
[2023-02-25 12:59:52,139][2409548] DAMAGECOUNT value on done: 4169.0
[2023-02-25 12:59:52,139][2409548] Sum rewards: 3.578, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.440', 'AMMO2': '0.005', 'AMMO5': '0.005', 'weapon5': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.024', 'AMMO3': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon7': '0.124', 'weapon4': '0.240', 'HITCOUNT': '0.500', 'WEAPON3': '0.550', 'ARMOR': '0.583', 'weapon2': '1.012', 'weapon3': '1.348', 'DAMAGECOUNT': '1.785', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:59:52,186][2408954] Fps is (10 sec: 25804.1, 60 sec: 25668.2, 300 sec: 25547.9). Total num frames: 62099456. Throughput: 0: 6384.8. Samples: 15518388. Policy #0 lag: (min: 0.0, avg: 11.4, max: 25.0)
[2023-02-25 12:59:52,186][2408954] Avg episode reward: [(0, '4.212')]
[2023-02-25 12:59:52,201][2409547] Large shaping reward 3.652 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 12:59:52,335][2409104] DAMAGECOUNT value on done: 3270.0
[2023-02-25 12:59:52,336][2409104] Sum rewards: 1.307, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.286', 'AMMO5': '0.005', 'weapon5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'AMMO3': '0.083', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'weapon7': '0.132', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.310', 'weapon4': '0.550', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.011', 'weapon2': '1.250', 'weapon3': '1.316', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:59:52,450][2409597] DAMAGECOUNT value on done: 3660.0
[2023-02-25 12:59:52,453][2409597] Sum rewards: 8.323, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.074', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'AMMO4': '0.104', 'weapon5': '0.196', 'WEAPON5': '0.250', 'weapon4': '0.318', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'weapon2': '1.086', 'weapon3': '1.944', 'DAMAGECOUNT': '2.541', 'FRAGCOUNT': '6.500'}
[2023-02-25 12:59:52,516][2409373] DAMAGECOUNT value on done: 3017.0
[2023-02-25 12:59:52,519][2409596] DAMAGECOUNT value on done: 2208.0
[2023-02-25 12:59:52,520][2409596] Sum rewards: -0.298, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.660', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.075', 'weapon5': '0.104', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'HITCOUNT': '0.280', 'WEAPON4': '0.350', 'ARMOR': '0.416', 'WEAPON3': '0.450', 'weapon4': '0.532', 'FRAGCOUNT': '1.000', 'weapon3': '1.234', 'DAMAGECOUNT': '1.359', 'weapon2': '1.640'}
[2023-02-25 12:59:52,517][2409373] Sum rewards: 2.406, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.909', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon7': '0.046', 'weapon5': '0.072', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'weapon4': '0.192', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.870', 'weapon2': '1.158', 'weapon3': '1.504', 'ARMOR': '1.801', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:59:52,551][2409485] DAMAGECOUNT value on done: 3359.0
[2023-02-25 12:59:52,553][2409485] Sum rewards: 8.215, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.948', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO3': '0.078', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.172', 'WEAPON5': '0.300', 'HITCOUNT': '0.440', 'weapon4': '0.474', 'ARMOR': '0.538', 'WEAPON3': '0.600', 'weapon2': '1.210', 'weapon3': '1.530', 'DAMAGECOUNT': '2.085', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:59:53,119][2409105] DAMAGECOUNT value on done: 3318.0
[2023-02-25 12:59:53,120][2409105] Sum rewards: -1.317, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.037', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.012', 'AMMO2': '0.030', 'WEAPON1': '0.050', 'AMMO3': '0.065', 'weapon4': '0.120', 'WEAPON4': '0.150', 'AMMO4': '0.152', 'weapon5': '0.158', 'HITCOUNT': '0.190', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.660', 'weapon3': '1.228', 'weapon2': '1.404'}
[2023-02-25 12:59:53,368][2409866] DAMAGECOUNT value on done: 3358.0
[2023-02-25 12:59:53,372][2409866] Sum rewards: 1.087, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.970', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'weapon5': '0.080', 'AMMO3': '0.085', 'AMMO4': '0.091', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.482', 'WEAPON3': '0.500', 'HITCOUNT': '0.570', 'ARMOR': '0.962', 'weapon3': '1.272', 'weapon2': '1.506', 'DAMAGECOUNT': '2.043', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:59:53,843][2409549] DAMAGECOUNT value on done: 2593.0
[2023-02-25 12:59:53,844][2409549] Sum rewards: 1.406, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.782', 'AMMO5': '0.006', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.072', 'weapon5': '0.118', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.282', 'HITCOUNT': '0.350', 'WEAPON3': '0.500', 'ARMOR': '0.800', 'weapon3': '1.140', 'DAMAGECOUNT': '1.215', 'weapon2': '1.742', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:59:53,862][2409485] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 12:59:53,914][2409405] DAMAGECOUNT value on done: 3908.0
[2023-02-25 12:59:53,917][2409405] Sum rewards: 5.329, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.240', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon7': '0.052', 'weapon4': '0.078', 'AMMO3': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.455', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'weapon3': '1.298', 'weapon2': '1.536', 'DAMAGECOUNT': '2.379', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:59:53,943][2409074] Updated weights for policy 0, policy_version 15171 (0.0013)
[2023-02-25 12:59:53,951][2409100] DAMAGECOUNT value on done: 3464.0
[2023-02-25 12:59:53,952][2409100] Sum rewards: 4.949, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.312', 'AMMO5': '0.008', 'AMMO2': '0.038', 'AMMO3': '0.040', 'weapon4': '0.110', 'AMMO4': '0.191', 'weapon5': '0.224', 'WEAPON5': '0.250', 'WEAPON3': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.360', 'weapon3': '0.846', 'ARMOR': '0.851', 'weapon2': '2.006', 'DAMAGECOUNT': '2.037', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:59:54,572][2409407] DAMAGECOUNT value on done: 2932.0
[2023-02-25 12:59:54,575][2409407] Sum rewards: 8.673, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.645', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'AMMO3': '0.058', 'WEAPON1': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.128', 'weapon7': '0.130', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.426', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'weapon3': '1.110', 'weapon2': '1.440', 'DAMAGECOUNT': '1.539', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:59:54,759][2409101] DAMAGECOUNT value on done: 2820.0
[2023-02-25 12:59:54,760][2409101] Sum rewards: 2.865, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.436', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO5': '0.013', 'WEAPON1': '0.060', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.234', 'weapon5': '0.282', 'HITCOUNT': '0.330', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.302', 'weapon3': '1.370', 'ARMOR': '1.756', 'weapon2': '1.812', 'FRAGCOUNT': '2.000'}
[2023-02-25 12:59:55,216][2409074] Updated weights for policy 0, policy_version 15181 (0.0014)
[2023-02-25 12:59:55,304][2409565] DAMAGECOUNT value on done: 4483.0
[2023-02-25 12:59:55,307][2409565] Sum rewards: 6.456, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.843', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.102', 'AMMO3': '0.111', 'WEAPON4': '0.150', 'weapon5': '0.170', 'WEAPON5': '0.300', 'weapon4': '0.312', 'ARMOR': '0.460', 'HITCOUNT': '0.670', 'WEAPON3': '0.700', 'weapon2': '1.208', 'weapon3': '1.596', 'DAMAGECOUNT': '2.976', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:59:55,360][2409102] DAMAGECOUNT value on done: 3348.0
[2023-02-25 12:59:55,362][2409102] Sum rewards: 4.045, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.167', 'AMMO5': '0.013', 'AMMO2': '0.033', 'WEAPON1': '0.040', 'weapon5': '0.070', 'AMMO3': '0.091', 'AMMO4': '0.163', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.530', 'weapon4': '0.602', 'WEAPON3': '0.700', 'ARMOR': '0.953', 'weapon2': '1.088', 'weapon3': '1.620', 'DAMAGECOUNT': '1.809', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:59:55,386][2409406] DAMAGECOUNT value on done: 2905.0
[2023-02-25 12:59:55,387][2409406] Sum rewards: 3.851, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'ARMOR': '0.020', 'AMMO2': '0.042', 'weapon7': '0.048', 'AMMO3': '0.060', 'weapon5': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HEALTH': '0.110', 'AMMO4': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.420', 'weapon4': '0.724', 'weapon2': '0.840', 'weapon3': '1.376', 'DAMAGECOUNT': '1.401', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:59:55,502][2409077] DAMAGECOUNT value on done: 3702.0
[2023-02-25 12:59:55,503][2409077] Sum rewards: 0.233, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.442', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.033', 'weapon7': '0.082', 'AMMO3': '0.140', 'weapon5': '0.152', 'AMMO4': '0.163', 'AMMO6': '0.260', 'AMMO7': '0.260', 'HITCOUNT': '0.290', 'WEAPON7': '0.300', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.634', 'WEAPON3': '0.800', 'ARMOR': '0.887', 'weapon2': '1.200', 'weapon3': '1.556', 'DAMAGECOUNT': '2.139', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:59:55,641][2409389] DAMAGECOUNT value on done: 2933.0
[2023-02-25 12:59:55,642][2409389] Sum rewards: 6.420, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.484', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.040', 'weapon5': '0.060', 'AMMO4': '0.063', 'AMMO3': '0.071', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.206', 'WEAPON3': '0.450', 'HITCOUNT': '0.630', 'weapon3': '1.446', 'weapon2': '2.030', 'DAMAGECOUNT': '2.238', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:59:55,643][2409103] DAMAGECOUNT value on done: 3325.0
[2023-02-25 12:59:55,646][2409103] Sum rewards: 1.948, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.285', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.016', 'WEAPON1': '0.020', 'weapon5': '0.048', 'AMMO3': '0.050', 'WEAPON5': '0.100', 'WEAPON3': '0.350', 'HITCOUNT': '0.500', 'weapon3': '0.982', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.656', 'weapon2': '2.002'}
[2023-02-25 12:59:55,849][2409355] DAMAGECOUNT value on done: 4983.0
[2023-02-25 12:59:55,850][2409355] Sum rewards: 2.486, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.652', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'weapon5': '0.086', 'AMMO3': '0.087', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.493', 'HITCOUNT': '0.510', 'weapon4': '0.548', 'WEAPON3': '0.650', 'weapon2': '1.452', 'weapon3': '1.500', 'DAMAGECOUNT': '1.815', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:59:55,862][2409548] DAMAGECOUNT value on done: 3750.0
[2023-02-25 12:59:55,863][2409548] Sum rewards: 8.560, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.454', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO5': '0.016', 'AMMO4': '0.067', 'AMMO3': '0.074', 'WEAPON4': '0.150', 'weapon5': '0.206', 'WEAPON5': '0.300', 'weapon4': '0.348', 'WEAPON3': '0.450', 'ARMOR': '0.452', 'HITCOUNT': '0.590', 'weapon3': '1.268', 'weapon2': '1.422', 'DAMAGECOUNT': '3.147', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:59:55,954][2409104] DAMAGECOUNT value on done: 3158.0
[2023-02-25 12:59:55,958][2409104] Sum rewards: 6.135, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.063', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.003', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.058', 'weapon7': '0.064', 'WEAPON5': '0.100', 'weapon4': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.178', 'WEAPON7': '0.200', 'WEAPON3': '0.450', 'HITCOUNT': '0.490', 'weapon3': '1.008', 'ARMOR': '1.382', 'DAMAGECOUNT': '1.560', 'weapon2': '1.790', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:59:56,023][2409597] DAMAGECOUNT value on done: 4093.0
[2023-02-25 12:59:56,024][2409597] Sum rewards: 8.847, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.038', 'AMMO3': '0.080', 'HEALTH': '0.098', 'weapon5': '0.110', 'WEAPON4': '0.150', 'AMMO4': '0.192', 'WEAPON5': '0.250', 'weapon4': '0.260', 'ARMOR': '0.420', 'WEAPON3': '0.450', 'HITCOUNT': '0.630', 'weapon3': '1.276', 'weapon2': '1.760', 'DAMAGECOUNT': '3.090', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:59:56,103][2409596] DAMAGECOUNT value on done: 2535.0
[2023-02-25 12:59:56,105][2409596] Sum rewards: 1.056, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.233', 'weapon5': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'AMMO3': '0.081', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.390', 'WEAPON3': '0.500', 'weapon4': '0.590', 'FRAGCOUNT': '1.000', 'ARMOR': '1.001', 'weapon2': '1.020', 'weapon3': '1.070', 'DAMAGECOUNT': '1.182'}
[2023-02-25 12:59:56,208][2409485] DAMAGECOUNT value on done: 3392.0
[2023-02-25 12:59:56,209][2409485] Sum rewards: 6.732, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.290', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.040', 'weapon7': '0.040', 'AMMO4': '0.055', 'AMMO3': '0.072', 'weapon5': '0.116', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.298', 'HITCOUNT': '0.450', 'ARMOR': '0.460', 'WEAPON3': '0.550', 'weapon2': '1.342', 'weapon3': '1.530', 'DAMAGECOUNT': '2.127', 'FRAGCOUNT': '6.000'}
[2023-02-25 12:59:56,376][2409373] DAMAGECOUNT value on done: 3001.0
[2023-02-25 12:59:56,377][2409373] Sum rewards: 3.770, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.806', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.053', 'weapon5': '0.060', 'weapon7': '0.076', 'AMMO3': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'AMMO4': '0.264', 'WEAPON4': '0.450', 'weapon4': '0.580', 'HITCOUNT': '0.600', 'WEAPON3': '0.750', 'weapon2': '0.908', 'weapon3': '1.736', 'DAMAGECOUNT': '2.010', 'FRAGCOUNT': '7.000'}
[2023-02-25 12:59:56,723][2409105] DAMAGECOUNT value on done: 3365.0
[2023-02-25 12:59:56,725][2409105] Sum rewards: 4.343, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.678', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.087', 'weapon5': '0.134', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'HITCOUNT': '0.590', 'WEAPON3': '0.650', 'weapon4': '0.710', 'weapon2': '1.078', 'ARMOR': '1.455', 'weapon3': '1.496', 'DAMAGECOUNT': '1.749', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:59:57,186][2408954] Fps is (10 sec: 24986.2, 60 sec: 25463.5, 300 sec: 25534.0). Total num frames: 62218240. Throughput: 0: 6378.1. Samples: 15556488. Policy #0 lag: (min: 0.0, avg: 11.4, max: 25.0)
[2023-02-25 12:59:57,186][2408954] Avg episode reward: [(0, '4.205')]
[2023-02-25 12:59:57,430][2409074] Updated weights for policy 0, policy_version 15191 (0.0012)
[2023-02-25 12:59:57,589][2409549] DAMAGECOUNT value on done: 2933.0
[2023-02-25 12:59:57,590][2409549] Sum rewards: -3.592, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.750', 'AMMO2': '0.016', 'AMMO5': '0.018', 'WEAPON1': '0.040', 'AMMO4': '0.082', 'weapon4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.129', 'weapon5': '0.176', 'HITCOUNT': '0.290', 'WEAPON5': '0.400', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.800', 'ARMOR': '0.854', 'DAMAGECOUNT': '1.059', 'weapon3': '1.542', 'weapon2': '1.818'}
[2023-02-25 12:59:57,595][2409866] DAMAGECOUNT value on done: 3903.0
[2023-02-25 12:59:57,597][2409866] Sum rewards: 9.415, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.020', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'WEAPON1': '0.040', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'weapon4': '0.180', 'ARMOR': '0.453', 'WEAPON3': '0.800', 'HITCOUNT': '0.870', 'weapon3': '1.578', 'weapon2': '1.780', 'DAMAGECOUNT': '2.973', 'FRAGCOUNT': '10.000'}
[2023-02-25 12:59:57,734][2409100] DAMAGECOUNT value on done: 3227.0
[2023-02-25 12:59:57,737][2409100] Sum rewards: 4.086, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.797', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'weapon5': '0.038', 'AMMO3': '0.057', 'weapon7': '0.114', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HITCOUNT': '0.380', 'WEAPON4': '0.400', 'WEAPON3': '0.400', 'weapon3': '0.826', 'weapon2': '0.888', 'weapon4': '0.910', 'DAMAGECOUNT': '1.245', 'ARMOR': '1.283', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:59:57,861][2409405] DAMAGECOUNT value on done: 2508.0
[2023-02-25 12:59:57,874][2409405] Sum rewards: 4.624, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.446', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO4': '0.047', 'AMMO3': '0.065', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.252', 'WEAPON3': '0.350', 'HITCOUNT': '0.480', 'ARMOR': '0.816', 'weapon3': '1.220', 'DAMAGECOUNT': '1.569', 'weapon2': '2.188', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:59:58,370][2409407] DAMAGECOUNT value on done: 3167.0
[2023-02-25 12:59:58,373][2409407] Sum rewards: 2.124, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.276', 'AMMO2': '0.011', 'AMMO5': '0.015', 'weapon4': '0.022', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.055', 'weapon5': '0.060', 'AMMO3': '0.119', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.350', 'HITCOUNT': '0.440', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.527', 'weapon3': '1.546', 'ARMOR': '1.720', 'weapon2': '1.854', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:59:58,477][2409101] DAMAGECOUNT value on done: 2858.0
[2023-02-25 12:59:58,481][2409101] Sum rewards: 6.084, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.461', 'AMMO2': '0.017', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.084', 'AMMO3': '0.085', 'WEAPON4': '0.300', 'weapon4': '0.320', 'weapon5': '0.320', 'HITCOUNT': '0.530', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'ARMOR': '0.858', 'weapon2': '1.376', 'weapon3': '1.470', 'DAMAGECOUNT': '2.445', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:59:58,568][2409074] Updated weights for policy 0, policy_version 15201 (0.0012)
[2023-02-25 12:59:59,136][2409565] DAMAGECOUNT value on done: 3360.0
[2023-02-25 12:59:59,136][2409565] Sum rewards: 3.173, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.565', 'AMMO5': '0.008', 'AMMO2': '0.013', 'AMMO3': '0.030', 'AMMO4': '0.067', 'weapon7': '0.068', 'weapon5': '0.126', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON4': '0.400', 'HITCOUNT': '0.440', 'weapon4': '0.518', 'weapon3': '0.726', 'weapon2': '1.120', 'DAMAGECOUNT': '1.881', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:59:59,186][2409102] DAMAGECOUNT value on done: 4132.0
[2023-02-25 12:59:59,186][2409102] Sum rewards: 9.499, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.400', 'AMMO4': '-0.068', 'AMMO2': '-0.013', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'weapon5': '0.028', 'weapon7': '0.056', 'AMMO3': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'ARMOR': '0.447', 'HITCOUNT': '0.580', 'WEAPON3': '0.700', 'weapon3': '1.562', 'weapon2': '1.790', 'DAMAGECOUNT': '3.114', 'FRAGCOUNT': '8.000'}
[2023-02-25 12:59:59,192][2409406] DAMAGECOUNT value on done: 3488.0
[2023-02-25 12:59:59,193][2409406] Sum rewards: 4.919, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.538', 'AMMO2': '0.006', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.024', 'AMMO4': '0.028', 'weapon4': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.106', 'WEAPON5': '0.350', 'HITCOUNT': '0.680', 'WEAPON3': '0.750', 'ARMOR': '1.200', 'weapon2': '1.490', 'weapon3': '1.898', 'DAMAGECOUNT': '2.289', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:59:59,198][2409103] DAMAGECOUNT value on done: 2794.0
[2023-02-25 12:59:59,201][2409103] Sum rewards: 5.940, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.658', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO3': '0.040', 'WEAPON1': '0.040', 'weapon7': '0.066', 'AMMO4': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON3': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.204', 'WEAPON4': '0.250', 'HITCOUNT': '0.410', 'weapon4': '0.612', 'ARMOR': '0.882', 'weapon3': '1.062', 'DAMAGECOUNT': '1.320', 'weapon2': '1.740', 'FRAGCOUNT': '5.000'}
[2023-02-25 12:59:59,303][2409077] DAMAGECOUNT value on done: 2577.0
[2023-02-25 12:59:59,304][2409077] Sum rewards: 2.721, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.039', 'weapon4': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.100', 'WEAPON3': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.190', 'ARMOR': '0.455', 'DAMAGECOUNT': '0.690', 'weapon3': '0.842', 'FRAGCOUNT': '1.000', 'weapon2': '1.918'}
[2023-02-25 12:59:59,425][2409355] DAMAGECOUNT value on done: 2913.0
[2023-02-25 12:59:59,425][2409355] Sum rewards: 4.264, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.670', 'AMMO5': '0.020', 'AMMO2': '0.038', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO3': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.142', 'WEAPON4': '0.150', 'AMMO4': '0.188', 'weapon4': '0.222', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'HITCOUNT': '0.580', 'ARMOR': '0.800', 'weapon2': '1.250', 'weapon3': '1.350', 'DAMAGECOUNT': '2.280', 'FRAGCOUNT': '2.500'}
[2023-02-25 12:59:59,459][2409389] DAMAGECOUNT value on done: 2431.0
[2023-02-25 12:59:59,460][2409389] Sum rewards: 3.255, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.762', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon7': '0.046', 'AMMO3': '0.057', 'weapon5': '0.100', 'AMMO4': '0.107', 'weapon4': '0.110', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HITCOUNT': '0.250', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'ARMOR': '0.439', 'DAMAGECOUNT': '0.780', 'weapon3': '1.140', 'weapon2': '1.758', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:59:59,625][2409548] DAMAGECOUNT value on done: 3863.0
[2023-02-25 12:59:59,629][2409548] Sum rewards: 6.353, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'HEALTH': '0.036', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.072', 'weapon7': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.120', 'WEAPON5': '0.150', 'weapon4': '0.254', 'HITCOUNT': '0.310', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'weapon2': '0.606', 'weapon3': '1.082', 'DAMAGECOUNT': '1.431', 'FRAGCOUNT': '4.000'}
[2023-02-25 12:59:59,800][2409485] DAMAGECOUNT value on done: 3270.0
[2023-02-25 12:59:59,801][2409485] Sum rewards: 3.100, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.065', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.032', 'WEAPON1': '0.050', 'weapon7': '0.052', 'weapon5': '0.056', 'AMMO3': '0.061', 'weapon4': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.220', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'weapon3': '0.820', 'DAMAGECOUNT': '1.332', 'weapon2': '2.116', 'FRAGCOUNT': '3.000'}
[2023-02-25 12:59:59,956][2409373] DAMAGECOUNT value on done: 3747.0
[2023-02-25 12:59:59,956][2409373] Sum rewards: -0.491, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.436', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon7': '0.046', 'weapon5': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.151', 'AMMO4': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.268', 'HITCOUNT': '0.400', 'WEAPON3': '0.800', 'ARMOR': '1.339', 'DAMAGECOUNT': '1.359', 'weapon3': '1.496', 'weapon2': '1.690', 'FRAGCOUNT': '3.500'}
[2023-02-25 13:00:00,060][2409597] DAMAGECOUNT value on done: 2934.0
[2023-02-25 13:00:00,064][2409597] Sum rewards: -1.370, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.500', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.030', 'AMMO4': '0.055', 'weapon5': '0.066', 'AMMO3': '0.111', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.280', 'weapon4': '0.292', 'ARMOR': '0.473', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.891', 'weapon3': '1.460', 'weapon2': '1.500', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:00,410][2409074] Updated weights for policy 0, policy_version 15211 (0.0013)
[2023-02-25 13:00:00,542][2409104] DAMAGECOUNT value on done: 4710.0
[2023-02-25 13:00:00,543][2409104] Sum rewards: 1.833, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.317', 'AMMO2': '0.007', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.033', 'AMMO3': '0.088', 'weapon5': '0.092', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'HITCOUNT': '0.350', 'weapon4': '0.544', 'WEAPON3': '0.650', 'weapon2': '0.850', 'ARMOR': '0.905', 'DAMAGECOUNT': '1.515', 'weapon3': '1.874', 'FRAGCOUNT': '2.500'}
[2023-02-25 13:00:00,610][2409469] DAMAGECOUNT value on done: 2859.0
[2023-02-25 13:00:00,613][2409469] Sum rewards: 7.696, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.017', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'HEALTH': '0.051', 'AMMO3': '0.073', 'weapon7': '0.084', 'AMMO4': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'weapon4': '0.528', 'HITCOUNT': '0.620', 'weapon2': '1.274', 'weapon3': '1.420', 'DAMAGECOUNT': '2.814', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:00,670][2409596] DAMAGECOUNT value on done: 3218.0
[2023-02-25 13:00:00,671][2409596] Sum rewards: 7.527, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.300', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO3': '0.103', 'weapon5': '0.114', 'WEAPON4': '0.150', 'AMMO4': '0.185', 'weapon4': '0.254', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'HITCOUNT': '0.660', 'weapon3': '1.422', 'weapon2': '1.466', 'DAMAGECOUNT': '2.562', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:00,948][2409105] DAMAGECOUNT value on done: 2754.0
[2023-02-25 13:00:00,952][2409105] Sum rewards: 0.728, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.150', 'AMMO5': '0.009', 'AMMO2': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.057', 'weapon7': '0.072', 'AMMO3': '0.093', 'weapon5': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'HITCOUNT': '0.280', 'ARMOR': '0.420', 'weapon4': '0.546', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.825', 'weapon2': '1.112', 'weapon3': '1.228', 'FRAGCOUNT': '1.500'}
[2023-02-25 13:00:01,233][2409866] DAMAGECOUNT value on done: 3607.0
[2023-02-25 13:00:01,234][2409866] Sum rewards: 4.261, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.825', 'AMMO2': '0.013', 'AMMO5': '0.017', 'AMMO3': '0.056', 'AMMO4': '0.066', 'weapon5': '0.116', 'WEAPON3': '0.400', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'HITCOUNT': '0.530', 'weapon4': '0.658', 'ARMOR': '0.890', 'weapon3': '0.900', 'weapon2': '1.060', 'DAMAGECOUNT': '2.229', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:01,353][2409100] DAMAGECOUNT value on done: 2873.0
[2023-02-25 13:00:01,354][2409100] Sum rewards: 6.945, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.130', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.021', 'WEAPON1': '0.030', 'AMMO3': '0.077', 'weapon4': '0.088', 'WEAPON4': '0.100', 'weapon5': '0.240', 'WEAPON5': '0.300', 'HITCOUNT': '0.390', 'WEAPON3': '0.500', 'weapon3': '1.320', 'DAMAGECOUNT': '1.620', 'weapon2': '1.624', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:01,505][2409549] DAMAGECOUNT value on done: 3299.0
[2023-02-25 13:00:01,509][2409549] Sum rewards: 6.051, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.236', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.012', 'WEAPON1': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'AMMO3': '0.122', 'WEAPON3': '0.600', 'HITCOUNT': '0.630', 'weapon2': '1.164', 'weapon3': '1.742', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:01,736][2409405] DAMAGECOUNT value on done: 2872.0
[2023-02-25 13:00:01,737][2409405] Sum rewards: 1.030, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.760', 'AMMO2': '0.011', 'AMMO5': '0.012', 'weapon4': '0.026', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.076', 'weapon5': '0.136', 'HITCOUNT': '0.210', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.738', 'weapon3': '1.134', 'weapon2': '1.350', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:02,042][2409074] Updated weights for policy 0, policy_version 15221 (0.0012)
[2023-02-25 13:00:02,186][2408954] Fps is (10 sec: 25395.0, 60 sec: 25463.3, 300 sec: 25561.8). Total num frames: 62353408. Throughput: 0: 6373.0. Samples: 15594516. Policy #0 lag: (min: 1.0, avg: 10.8, max: 23.0)
[2023-02-25 13:00:02,187][2408954] Avg episode reward: [(0, '4.097')]
[2023-02-25 13:00:02,356][2409097] DAMAGECOUNT value on done: 3537.0
[2023-02-25 13:00:02,357][2409097] Sum rewards: 4.022, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.891', 'AMMO2': '0.008', 'AMMO5': '0.016', 'AMMO4': '0.040', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO3': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.180', 'WEAPON7': '0.200', 'weapon5': '0.218', 'HITCOUNT': '0.360', 'ARMOR': '0.444', 'WEAPON5': '0.500', 'WEAPON3': '0.500', 'weapon3': '1.282', 'weapon2': '1.354', 'DAMAGECOUNT': '2.010', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:02,395][2409101] DAMAGECOUNT value on done: 5256.0
[2023-02-25 13:00:02,398][2409101] Sum rewards: 4.123, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.098', 'AMMO5': '0.007', 'weapon5': '0.010', 'weapon7': '0.010', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.135', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'ARMOR': '0.469', 'weapon4': '0.572', 'HITCOUNT': '0.750', 'WEAPON3': '0.800', 'weapon2': '0.864', 'weapon3': '2.106', 'DAMAGECOUNT': '2.607', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:02,630][2409407] DAMAGECOUNT value on done: 4744.0
[2023-02-25 13:00:02,634][2409407] Sum rewards: 7.412, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.775', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.036', 'weapon5': '0.102', 'AMMO3': '0.117', 'WEAPON5': '0.150', 'AMMO4': '0.182', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.446', 'HITCOUNT': '0.690', 'WEAPON3': '0.750', 'ARMOR': '1.251', 'weapon3': '1.346', 'weapon2': '1.720', 'DAMAGECOUNT': '3.126', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:00:02,722][2409076] DAMAGECOUNT value on done: 3436.0
[2023-02-25 13:00:02,723][2409076] Sum rewards: 5.406, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.034', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.030', 'AMMO3': '0.040', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'weapon7': '0.064', 'weapon5': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.222', 'HITCOUNT': '0.230', 'WEAPON3': '0.250', 'ARMOR': '0.475', 'weapon3': '0.830', 'DAMAGECOUNT': '1.035', 'weapon2': '1.234', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:02,789][2409103] DAMAGECOUNT value on done: 3297.0
[2023-02-25 13:00:02,790][2409103] Sum rewards: -0.467, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.381', 'AMMO2': '0.010', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.032', 'ARMOR': '0.048', 'AMMO4': '0.052', 'AMMO3': '0.134', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.362', 'HITCOUNT': '0.510', 'WEAPON3': '0.800', 'weapon2': '1.052', 'DAMAGECOUNT': '1.569', 'FRAGCOUNT': '2.000', 'weapon3': '2.062'}
[2023-02-25 13:00:03,075][2409355] DAMAGECOUNT value on done: 3304.0
[2023-02-25 13:00:03,078][2409355] Sum rewards: 4.717, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.270', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon7': '0.060', 'AMMO3': '0.061', 'AMMO4': '0.128', 'weapon5': '0.156', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'HITCOUNT': '0.380', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.400', 'weapon4': '0.496', 'weapon3': '1.168', 'weapon2': '1.582', 'DAMAGECOUNT': '1.857', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:03,217][2409548] DAMAGECOUNT value on done: 2642.0
[2023-02-25 13:00:03,218][2409548] Sum rewards: 4.066, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.353', 'AMMO2': '0.011', 'AMMO5': '0.014', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'AMMO4': '0.056', 'weapon4': '0.110', 'weapon5': '0.124', 'WEAPON4': '0.150', 'HITCOUNT': '0.280', 'WEAPON3': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.452', 'weapon3': '1.020', 'DAMAGECOUNT': '1.209', 'weapon2': '2.312', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:03,229][2409565] DAMAGECOUNT value on done: 2948.0
[2023-02-25 13:00:03,232][2409565] Sum rewards: 2.239, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.840', 'AMMO2': '0.003', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO4': '0.016', 'WEAPON1': '0.040', 'AMMO3': '0.056', 'weapon5': '0.172', 'WEAPON4': '0.200', 'weapon4': '0.202', 'HITCOUNT': '0.310', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'weapon3': '0.976', 'DAMAGECOUNT': '1.107', 'weapon2': '1.630', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:03,261][2409102] DAMAGECOUNT value on done: 3343.0
[2023-02-25 13:00:03,266][2409102] Sum rewards: 9.619, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.310', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.073', 'weapon5': '0.104', 'weapon4': '0.124', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '0.730', 'ARMOR': '1.310', 'weapon3': '1.382', 'weapon2': '2.114', 'DAMAGECOUNT': '2.817', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:00:03,282][2409406] DAMAGECOUNT value on done: 2981.0
[2023-02-25 13:00:03,284][2409406] Sum rewards: -0.105, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.960', 'AMMO2': '0.005', 'AMMO5': '0.020', 'AMMO4': '0.025', 'WEAPON1': '0.030', 'weapon4': '0.074', 'WEAPON4': '0.100', 'weapon5': '0.106', 'AMMO3': '0.119', 'WEAPON5': '0.350', 'HITCOUNT': '0.480', 'WEAPON3': '0.850', 'weapon2': '1.532', 'weapon3': '1.652', 'DAMAGECOUNT': '1.761', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:03,375][2409389] DAMAGECOUNT value on done: 2951.0
[2023-02-25 13:00:03,377][2409389] Sum rewards: 3.967, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.021', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.082', 'AMMO4': '0.095', 'AMMO3': '0.102', 'WEAPON5': '0.150', 'HITCOUNT': '0.270', 'WEAPON3': '0.550', 'ARMOR': '0.800', 'DAMAGECOUNT': '0.996', 'weapon2': '1.518', 'weapon3': '1.648', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:03,399][2409485] DAMAGECOUNT value on done: 3383.0
[2023-02-25 13:00:03,400][2409485] Sum rewards: 3.925, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.194', 'AMMO5': '0.003', 'AMMO2': '0.014', 'AMMO3': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.072', 'weapon7': '0.132', 'WEAPON4': '0.150', 'WEAPON3': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.440', 'weapon4': '0.460', 'weapon3': '0.482', 'weapon2': '1.134', 'DAMAGECOUNT': '1.566', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:03,456][2409074] Updated weights for policy 0, policy_version 15231 (0.0012)
[2023-02-25 13:00:03,470][2409077] DAMAGECOUNT value on done: 3554.0
[2023-02-25 13:00:03,473][2409077] Sum rewards: 4.407, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.336', 'AMMO5': '0.010', 'weapon5': '0.018', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'ARMOR': '0.048', 'weapon7': '0.052', 'AMMO3': '0.085', 'AMMO4': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon2': '0.186', 'WEAPON5': '0.200', 'HITCOUNT': '0.400', 'weapon4': '0.456', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.326', 'weapon3': '1.358', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:03,490][2409373] DAMAGECOUNT value on done: 4017.0
[2023-02-25 13:00:03,491][2409373] Sum rewards: 4.307, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.602', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.092', 'weapon5': '0.096', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.426', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'weapon2': '0.960', 'weapon3': '1.496', 'DAMAGECOUNT': '2.052', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:03,878][2409597] DAMAGECOUNT value on done: 4437.0
[2023-02-25 13:00:03,879][2409597] Sum rewards: 4.197, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.794', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon5': '0.086', 'AMMO3': '0.117', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'weapon4': '0.688', 'WEAPON3': '0.750', 'HITCOUNT': '0.820', 'ARMOR': '1.361', 'weapon3': '1.362', 'weapon2': '1.410', 'DAMAGECOUNT': '2.964', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:04,572][2409104] DAMAGECOUNT value on done: 2961.0
[2023-02-25 13:00:04,573][2409104] Sum rewards: 2.508, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.580', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon7': '0.050', 'WEAPON1': '0.070', 'AMMO3': '0.086', 'AMMO4': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.272', 'HITCOUNT': '0.470', 'WEAPON3': '0.650', 'ARMOR': '0.858', 'weapon3': '1.418', 'weapon2': '1.510', 'DAMAGECOUNT': '1.674', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:04,619][2409469] DAMAGECOUNT value on done: 3673.0
[2023-02-25 13:00:04,623][2409469] Sum rewards: 6.588, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.937', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.090', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'weapon5': '0.196', 'weapon4': '0.342', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.680', 'ARMOR': '0.851', 'weapon2': '1.336', 'weapon3': '1.456', 'DAMAGECOUNT': '2.685', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:00:04,629][2409105] DAMAGECOUNT value on done: 4054.0
[2023-02-25 13:00:04,630][2409105] Sum rewards: 6.582, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.834', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'AMMO3': '0.055', 'weapon7': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.246', 'WEAPON3': '0.400', 'ARMOR': '0.456', 'HITCOUNT': '0.560', 'weapon2': '1.092', 'weapon3': '1.096', 'DAMAGECOUNT': '1.680', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:04,675][2409596] DAMAGECOUNT value on done: 2201.0
[2023-02-25 13:00:04,675][2409596] Sum rewards: 5.176, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.036', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.010', 'WEAPON1': '0.030', 'weapon7': '0.046', 'AMMO4': '0.048', 'AMMO3': '0.076', 'weapon4': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.230', 'AMMO6': '0.320', 'AMMO7': '0.320', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.660', 'weapon2': '0.826', 'weapon3': '1.196', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:04,844][2409866] DAMAGECOUNT value on done: 3777.0
[2023-02-25 13:00:04,845][2409866] Sum rewards: 6.488, reward structure: {'DEATHCOUNT': '-7.500', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO5': '0.022', 'AMMO3': '0.071', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'weapon5': '0.154', 'weapon4': '0.310', 'WEAPON5': '0.400', 'ARMOR': '0.420', 'WEAPON3': '0.450', 'HITCOUNT': '0.510', 'HEALTH': '0.745', 'weapon3': '1.424', 'weapon2': '1.740', 'DAMAGECOUNT': '1.998', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:00:04,994][2409100] DAMAGECOUNT value on done: 3715.0
[2023-02-25 13:00:04,998][2409100] Sum rewards: 8.061, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.500', 'AMMO2': '0.001', 'AMMO4': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO3': '0.075', 'weapon5': '0.166', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'HITCOUNT': '0.640', 'ARMOR': '0.851', 'weapon3': '1.490', 'weapon2': '2.086', 'DAMAGECOUNT': '2.370', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:05,339][2409405] DAMAGECOUNT value on done: 2769.0
[2023-02-25 13:00:05,342][2409405] Sum rewards: 1.788, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.568', 'AMMO5': '0.003', 'AMMO3': '0.010', 'AMMO2': '0.016', 'weapon5': '0.050', 'weapon7': '0.050', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'WEAPON3': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.180', 'WEAPON7': '0.200', 'weapon3': '0.230', 'WEAPON4': '0.350', 'DAMAGECOUNT': '0.585', 'weapon4': '0.704', 'weapon2': '0.808', 'FRAGCOUNT': '1.000', 'ARMOR': '1.402'}
[2023-02-25 13:00:05,363][2409549] DAMAGECOUNT value on done: 4238.0
[2023-02-25 13:00:05,364][2409549] Sum rewards: 3.121, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.504', 'AMMO5': '0.019', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'weapon5': '0.076', 'weapon4': '0.084', 'AMMO4': '0.116', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.590', 'WEAPON3': '0.800', 'weapon3': '1.692', 'weapon2': '1.798', 'DAMAGECOUNT': '1.815', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:05,429][2409075] DAMAGECOUNT value on done: 3001.0
[2023-02-25 13:00:05,431][2409075] Sum rewards: 1.681, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.207', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.023', 'WEAPON1': '0.030', 'weapon7': '0.050', 'weapon5': '0.078', 'AMMO3': '0.081', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'weapon4': '0.470', 'ARMOR': '0.520', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.119', 'weapon3': '1.226', 'weapon2': '1.318', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:05,497][2409074] Updated weights for policy 0, policy_version 15241 (0.0012)
[2023-02-25 13:00:06,272][2409101] DAMAGECOUNT value on done: 2909.0
[2023-02-25 13:00:06,273][2409101] Sum rewards: 5.962, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.294', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'AMMO3': '0.067', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'HITCOUNT': '0.400', 'weapon4': '0.460', 'ARMOR': '0.535', 'WEAPON3': '0.550', 'weapon3': '1.316', 'DAMAGECOUNT': '1.542', 'weapon2': '1.568', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:06,307][2409076] DAMAGECOUNT value on done: 3001.0
[2023-02-25 13:00:06,308][2409076] Sum rewards: 3.468, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'AMMO2': '0.028', 'AMMO3': '0.043', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.142', 'weapon3': '0.164', 'HITCOUNT': '0.220', 'HEALTH': '0.235', 'WEAPON3': '0.250', 'weapon4': '0.454', 'ARMOR': '0.844', 'weapon2': '0.990', 'DAMAGECOUNT': '1.191', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:06,323][2409097] DAMAGECOUNT value on done: 2010.0
[2023-02-25 13:00:06,324][2409097] Sum rewards: 6.062, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.580', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'WEAPON1': '0.050', 'AMMO3': '0.060', 'weapon5': '0.104', 'WEAPON5': '0.200', 'HITCOUNT': '0.310', 'WEAPON3': '0.400', 'ARMOR': '1.038', 'weapon3': '1.040', 'DAMAGECOUNT': '1.155', 'weapon2': '2.058', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:06,337][2409103] DAMAGECOUNT value on done: 4369.0
[2023-02-25 13:00:06,341][2409103] Sum rewards: 2.456, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.778', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.047', 'weapon5': '0.136', 'AMMO3': '0.155', 'AMMO4': '0.233', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'HITCOUNT': '0.490', 'ARMOR': '0.502', 'weapon4': '0.638', 'WEAPON3': '1.000', 'weapon2': '1.104', 'DAMAGECOUNT': '1.794', 'weapon3': '1.796', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:06,617][2409074] Updated weights for policy 0, policy_version 15251 (0.0012)
[2023-02-25 13:00:06,643][2409407] DAMAGECOUNT value on done: 3029.0
[2023-02-25 13:00:06,644][2409407] Sum rewards: 3.912, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.330', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO3': '0.047', 'weapon7': '0.072', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.260', 'WEAPON3': '0.300', 'HITCOUNT': '0.360', 'weapon3': '0.636', 'weapon2': '0.928', 'DAMAGECOUNT': '1.098', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:06,849][2409355] DAMAGECOUNT value on done: 4141.0
[2023-02-25 13:00:06,850][2409355] Sum rewards: 6.402, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.242', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO2': '0.022', 'AMMO3': '0.050', 'weapon7': '0.104', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.350', 'ARMOR': '0.404', 'HITCOUNT': '0.510', 'weapon4': '0.528', 'weapon2': '0.830', 'weapon3': '0.892', 'DAMAGECOUNT': '1.830', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:06,982][2409485] DAMAGECOUNT value on done: 2968.0
[2023-02-25 13:00:06,985][2409485] Sum rewards: 5.535, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.459', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO3': '0.030', 'AMMO4': '0.045', 'weapon5': '0.070', 'weapon7': '0.078', 'HITCOUNT': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.272', 'WEAPON3': '0.300', 'weapon3': '0.772', 'weapon2': '0.822', 'ARMOR': '0.877', 'DAMAGECOUNT': '1.101', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:07,046][2409565] DAMAGECOUNT value on done: 3321.0
[2023-02-25 13:00:07,047][2409565] Sum rewards: 6.430, reward structure: {'DEATHCOUNT': '-8.250', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.092', 'WEAPON5': '0.200', 'weapon5': '0.204', 'WEAPON3': '0.500', 'HITCOUNT': '0.570', 'HEALTH': '1.114', 'ARMOR': '1.200', 'weapon3': '1.626', 'weapon2': '1.632', 'DAMAGECOUNT': '2.424', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:07,050][2409373] DAMAGECOUNT value on done: 3030.0
[2023-02-25 13:00:07,050][2409373] Sum rewards: 3.215, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.664', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.028', 'WEAPON1': '0.040', 'AMMO3': '0.058', 'WEAPON4': '0.200', 'HITCOUNT': '0.230', 'weapon5': '0.244', 'WEAPON5': '0.350', 'ARMOR': '0.445', 'WEAPON3': '0.450', 'weapon4': '0.474', 'DAMAGECOUNT': '0.981', 'weapon2': '1.018', 'weapon3': '1.090', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:07,063][2409102] DAMAGECOUNT value on done: 2725.0
[2023-02-25 13:00:07,064][2409102] Sum rewards: 3.717, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.742', 'WEAPON1': '0.010', 'AMMO5': '0.021', 'AMMO2': '0.028', 'AMMO3': '0.084', 'weapon5': '0.106', 'AMMO4': '0.139', 'WEAPON4': '0.200', 'weapon4': '0.318', 'HITCOUNT': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'ARMOR': '1.388', 'weapon3': '1.404', 'weapon2': '1.478', 'DAMAGECOUNT': '2.133', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:07,098][2409389] DAMAGECOUNT value on done: 3539.0
[2023-02-25 13:00:07,101][2409389] Sum rewards: 10.056, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.334', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'weapon4': '0.024', 'AMMO2': '0.026', 'AMMO3': '0.088', 'AMMO4': '0.130', 'weapon5': '0.156', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'HITCOUNT': '0.700', 'weapon3': '1.586', 'ARMOR': '1.646', 'weapon2': '1.926', 'DAMAGECOUNT': '3.237', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:00:07,186][2408954] Fps is (10 sec: 25395.2, 60 sec: 25531.7, 300 sec: 25534.0). Total num frames: 62472192. Throughput: 0: 6351.5. Samples: 15613068. Policy #0 lag: (min: 1.0, avg: 10.8, max: 23.0)
[2023-02-25 13:00:07,186][2408954] Avg episode reward: [(0, '4.278')]
[2023-02-25 13:00:07,202][2409548] DAMAGECOUNT value on done: 3855.0
[2023-02-25 13:00:07,204][2409548] Sum rewards: 2.942, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.037', 'AMMO3': '0.067', 'HEALTH': '0.094', 'WEAPON5': '0.150', 'weapon5': '0.156', 'AMMO4': '0.186', 'WEAPON4': '0.200', 'weapon4': '0.218', 'HITCOUNT': '0.350', 'WEAPON3': '0.400', 'weapon3': '0.952', 'ARMOR': '1.228', 'DAMAGECOUNT': '1.659', 'weapon2': '2.454', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:07,473][2409597] DAMAGECOUNT value on done: 3125.0
[2023-02-25 13:00:07,474][2409597] Sum rewards: 1.202, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.015', 'AMMO2': '0.018', 'weapon5': '0.032', 'ARMOR': '0.036', 'AMMO3': '0.068', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'HEALTH': '0.112', 'weapon4': '0.280', 'WEAPON5': '0.300', 'HITCOUNT': '0.320', 'WEAPON3': '0.400', 'weapon2': '0.676', 'weapon3': '0.948', 'DAMAGECOUNT': '1.056', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:07,566][2409406] DAMAGECOUNT value on done: 3361.0
[2023-02-25 13:00:07,567][2409406] Sum rewards: 7.877, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.013', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'HEALTH': '0.051', 'AMMO3': '0.070', 'WEAPON1': '0.070', 'AMMO4': '0.123', 'weapon4': '0.244', 'weapon5': '0.266', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.580', 'weapon2': '1.256', 'weapon3': '1.600', 'DAMAGECOUNT': '2.529', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:07,691][2409077] DAMAGECOUNT value on done: 2172.0
[2023-02-25 13:00:07,692][2409077] Sum rewards: -0.697, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.837', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'AMMO3': '0.050', 'weapon5': '0.056', 'weapon7': '0.070', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'weapon4': '0.406', 'DAMAGECOUNT': '0.936', 'ARMOR': '0.941', 'weapon3': '0.956', 'FRAGCOUNT': '1.000', 'weapon2': '1.282'}
[2023-02-25 13:00:08,198][2409074] Updated weights for policy 0, policy_version 15261 (0.0012)
[2023-02-25 13:00:08,244][2409105] DAMAGECOUNT value on done: 3525.0
[2023-02-25 13:00:08,245][2409105] Sum rewards: 10.923, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.720', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.005', 'weapon5': '0.006', 'AMMO3': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon7': '0.108', 'weapon4': '0.218', 'WEAPON3': '0.550', 'HITCOUNT': '0.690', 'ARMOR': '1.344', 'weapon2': '1.590', 'weapon3': '1.666', 'DAMAGECOUNT': '3.630', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:00:08,421][2409104] DAMAGECOUNT value on done: 3397.0
[2023-02-25 13:00:08,424][2409104] Sum rewards: 6.697, reward structure: {'DEATHCOUNT': '-7.500', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon7': '0.046', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'HEALTH': '0.146', 'AMMO4': '0.152', 'weapon4': '0.446', 'HITCOUNT': '0.610', 'WEAPON3': '0.650', 'ARMOR': '0.812', 'weapon2': '1.142', 'weapon3': '1.334', 'DAMAGECOUNT': '2.211', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:08,484][2409078] DAMAGECOUNT value on done: 2783.0
[2023-02-25 13:00:08,484][2409078] Sum rewards: 5.231, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.656', 'AMMO5': '0.008', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'AMMO3': '0.066', 'AMMO4': '0.082', 'WEAPON4': '0.150', 'weapon5': '0.172', 'weapon4': '0.220', 'WEAPON5': '0.300', 'HITCOUNT': '0.350', 'WEAPON3': '0.450', 'ARMOR': '0.552', 'weapon3': '0.966', 'weapon2': '1.826', 'DAMAGECOUNT': '1.938', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:08,508][2409596] DAMAGECOUNT value on done: 3806.0
[2023-02-25 13:00:08,512][2409596] Sum rewards: -0.133, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon7': '0.034', 'AMMO2': '0.045', 'AMMO3': '0.063', 'weapon5': '0.076', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'HEALTH': '0.188', 'WEAPON5': '0.200', 'AMMO4': '0.226', 'HITCOUNT': '0.240', 'WEAPON3': '0.350', 'WEAPON4': '0.350', 'ARMOR': '0.404', 'weapon4': '0.462', 'weapon3': '1.192', 'DAMAGECOUNT': '1.260', 'weapon2': '1.444', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:08,643][2409866] DAMAGECOUNT value on done: 1904.0
[2023-02-25 13:00:08,644][2409866] Sum rewards: 1.458, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.128', 'AMMO5': '0.020', 'AMMO2': '0.036', 'WEAPON1': '0.050', 'AMMO3': '0.114', 'weapon5': '0.158', 'AMMO4': '0.181', 'WEAPON4': '0.200', 'HITCOUNT': '0.360', 'WEAPON5': '0.400', 'weapon4': '0.476', 'WEAPON3': '0.700', 'ARMOR': '0.889', 'DAMAGECOUNT': '0.993', 'weapon2': '1.032', 'weapon3': '1.726', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:08,902][2409469] DAMAGECOUNT value on done: 2852.0
[2023-02-25 13:00:08,906][2409469] Sum rewards: 0.674, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.470', 'AMMO5': '0.024', 'WEAPON1': '0.030', 'AMMO2': '0.034', 'weapon7': '0.048', 'AMMO3': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.171', 'weapon5': '0.190', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'HITCOUNT': '0.420', 'WEAPON3': '0.450', 'weapon4': '0.452', 'WEAPON5': '0.500', 'ARMOR': '0.864', 'weapon3': '1.216', 'weapon2': '1.442', 'DAMAGECOUNT': '1.452', 'FRAGCOUNT': '1.500'}
[2023-02-25 13:00:08,909][2409549] DAMAGECOUNT value on done: 4696.0
[2023-02-25 13:00:08,911][2409549] Sum rewards: 8.560, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.490', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon5': '0.072', 'weapon4': '0.084', 'AMMO3': '0.107', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'WEAPON3': '0.650', 'HITCOUNT': '0.650', 'ARMOR': '0.660', 'weapon2': '1.448', 'weapon3': '1.842', 'DAMAGECOUNT': '3.240', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:00:08,934][2409100] DAMAGECOUNT value on done: 3207.0
[2023-02-25 13:00:08,937][2409100] Sum rewards: 6.006, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.740', 'AMMO5': '0.008', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'AMMO3': '0.083', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'weapon5': '0.184', 'WEAPON5': '0.250', 'HITCOUNT': '0.360', 'weapon4': '0.394', 'ARMOR': '0.448', 'WEAPON3': '0.500', 'weapon3': '1.062', 'weapon2': '1.954', 'DAMAGECOUNT': '1.962', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:09,008][2409405] DAMAGECOUNT value on done: 2872.0
[2023-02-25 13:00:09,009][2409405] Sum rewards: 3.704, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.977', 'AMMO5': '0.017', 'weapon7': '0.026', 'AMMO2': '0.030', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.102', 'weapon5': '0.112', 'AMMO4': '0.150', 'HITCOUNT': '0.330', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'ARMOR': '0.499', 'WEAPON3': '0.600', 'weapon2': '0.844', 'weapon4': '0.920', 'DAMAGECOUNT': '1.200', 'weapon3': '1.500', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:09,202][2409075] DAMAGECOUNT value on done: 3968.0
[2023-02-25 13:00:09,907][2409076] DAMAGECOUNT value on done: 2760.0
[2023-02-25 13:00:09,908][2409076] Sum rewards: 4.307, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.150', 'AMMO4': '-0.069', 'AMMO2': '-0.014', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'weapon7': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.152', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.420', 'ARMOR': '0.472', 'weapon3': '1.062', 'DAMAGECOUNT': '1.329', 'weapon2': '1.716', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:09,940][2409074] Updated weights for policy 0, policy_version 15271 (0.0012)
[2023-02-25 13:00:09,974][2409097] DAMAGECOUNT value on done: 3873.0
[2023-02-25 13:00:09,974][2409097] Sum rewards: 6.034, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.160', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon5': '0.070', 'AMMO3': '0.091', 'AMMO4': '0.140', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.396', 'WEAPON5': '0.450', 'ARMOR': '0.455', 'WEAPON3': '0.700', 'HITCOUNT': '0.830', 'weapon3': '1.530', 'weapon2': '1.688', 'DAMAGECOUNT': '3.126', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:10,002][2409101] DAMAGECOUNT value on done: 3640.0
[2023-02-25 13:00:10,002][2409101] Sum rewards: 2.735, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.906', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.015', 'WEAPON1': '0.070', 'AMMO3': '0.073', 'weapon5': '0.190', 'weapon4': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'weapon3': '1.106', 'ARMOR': '1.409', 'weapon2': '1.678', 'DAMAGECOUNT': '1.995', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:10,203][2409103] DAMAGECOUNT value on done: 4200.0
[2023-02-25 13:00:10,203][2409103] Sum rewards: 7.758, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.760', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.023', 'WEAPON1': '0.040', 'weapon5': '0.070', 'AMMO3': '0.079', 'WEAPON5': '0.250', 'HITCOUNT': '0.600', 'WEAPON3': '0.650', 'weapon3': '1.364', 'weapon2': '1.682', 'DAMAGECOUNT': '1.995', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:00:10,621][2409407] DAMAGECOUNT value on done: 3803.0
[2023-02-25 13:00:10,622][2409407] Sum rewards: 6.244, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.484', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.010', 'WEAPON1': '0.010', 'weapon7': '0.038', 'weapon5': '0.050', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.210', 'WEAPON3': '0.550', 'HITCOUNT': '0.630', 'weapon2': '1.250', 'weapon3': '1.732', 'DAMAGECOUNT': '2.424', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:10,643][2409373] DAMAGECOUNT value on done: 3443.0
[2023-02-25 13:00:10,644][2409373] Sum rewards: 2.972, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.809', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'weapon7': '0.060', 'weapon5': '0.086', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.258', 'HITCOUNT': '0.390', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.380', 'weapon3': '1.448', 'FRAGCOUNT': '1.500', 'weapon2': '1.768'}
[2023-02-25 13:00:10,644][2409102] DAMAGECOUNT value on done: 3626.0
[2023-02-25 13:00:10,645][2409102] Sum rewards: 3.053, reward structure: {'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO3': '0.010', 'weapon2': '0.036', 'weapon7': '0.062', 'HEALTH': '0.065', 'WEAPON4': '0.100', 'WEAPON3': '0.100', 'HITCOUNT': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.210', 'weapon3': '0.242', 'DAMAGECOUNT': '0.678', 'FRAGCOUNT': '1.000'}
[2023-02-25 13:00:10,650][2409565] DAMAGECOUNT value on done: 4076.0
[2023-02-25 13:00:10,653][2409565] Sum rewards: 7.078, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.210', 'AMMO5': '0.016', 'AMMO2': '0.026', 'WEAPON1': '0.070', 'AMMO3': '0.080', 'weapon4': '0.092', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'weapon5': '0.202', 'WEAPON5': '0.350', 'HITCOUNT': '0.550', 'WEAPON3': '0.550', 'ARMOR': '0.858', 'weapon2': '1.558', 'weapon3': '1.678', 'DAMAGECOUNT': '2.730', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:10,789][2409548] DAMAGECOUNT value on done: 3153.0
[2023-02-25 13:00:10,789][2409548] Sum rewards: 5.521, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.486', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.023', 'AMMO3': '0.072', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'weapon4': '0.190', 'weapon5': '0.282', 'HITCOUNT': '0.380', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon2': '0.646', 'weapon3': '1.458', 'DAMAGECOUNT': '2.313', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:10,839][2409355] DAMAGECOUNT value on done: 2897.0
[2023-02-25 13:00:10,840][2409355] Sum rewards: 2.229, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.580', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.031', 'AMMO3': '0.050', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.157', 'WEAPON3': '0.300', 'WEAPON4': '0.300', 'HITCOUNT': '0.300', 'weapon4': '0.724', 'DAMAGECOUNT': '0.831', 'weapon2': '1.142', 'weapon3': '1.316', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:10,850][2409485] DAMAGECOUNT value on done: 3374.0
[2023-02-25 13:00:10,853][2409485] Sum rewards: 6.384, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.346', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'weapon4': '0.216', 'weapon5': '0.216', 'WEAPON5': '0.350', 'HITCOUNT': '0.390', 'ARMOR': '0.488', 'WEAPON3': '0.550', 'weapon3': '1.184', 'weapon2': '1.458', 'DAMAGECOUNT': '2.673', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:11,131][2409389] DAMAGECOUNT value on done: 3291.0
[2023-02-25 13:00:11,132][2409389] Sum rewards: 5.721, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.129', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon7': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.118', 'AMMO3': '0.125', 'AMMO4': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.450', 'HITCOUNT': '0.680', 'WEAPON3': '0.800', 'weapon2': '1.014', 'weapon3': '1.880', 'DAMAGECOUNT': '2.703', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:11,233][2409597] DAMAGECOUNT value on done: 3337.0
[2023-02-25 13:00:11,234][2409597] Sum rewards: 11.084, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.108', 'AMMO2': '0.017', 'AMMO5': '0.017', 'weapon7': '0.048', 'AMMO4': '0.084', 'AMMO3': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.530', 'weapon4': '0.538', 'WEAPON3': '0.600', 'ARMOR': '0.832', 'weapon2': '1.088', 'weapon3': '1.370', 'DAMAGECOUNT': '2.904', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:00:11,318][2409406] DAMAGECOUNT value on done: 3721.0
[2023-02-25 13:00:11,319][2409406] Sum rewards: 3.893, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.494', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.126', 'weapon5': '0.146', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'HITCOUNT': '0.430', 'weapon4': '0.666', 'WEAPON3': '0.750', 'ARMOR': '0.888', 'weapon2': '0.898', 'DAMAGECOUNT': '1.755', 'weapon3': '1.834', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:11,404][2409077] DAMAGECOUNT value on done: 3502.0
[2023-02-25 13:00:11,407][2409077] Sum rewards: 7.503, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.072', 'HEALTH': '0.076', 'weapon5': '0.082', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.490', 'weapon3': '1.202', 'weapon2': '1.410', 'DAMAGECOUNT': '1.677', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:11,713][2409074] Updated weights for policy 0, policy_version 15281 (0.0013)
[2023-02-25 13:00:12,032][2409105] DAMAGECOUNT value on done: 3747.0
[2023-02-25 13:00:12,033][2409105] Sum rewards: 5.197, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.640', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'WEAPON1': '0.040', 'AMMO3': '0.060', 'weapon7': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.290', 'weapon4': '0.368', 'WEAPON3': '0.400', 'weapon3': '1.014', 'weapon2': '1.552', 'DAMAGECOUNT': '1.923', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:12,186][2408954] Fps is (10 sec: 24985.7, 60 sec: 25395.1, 300 sec: 25534.0). Total num frames: 62603264. Throughput: 0: 6353.3. Samples: 15651432. Policy #0 lag: (min: 0.0, avg: 13.4, max: 26.0)
[2023-02-25 13:00:12,187][2408954] Avg episode reward: [(0, '4.530')]
[2023-02-25 13:00:12,346][2409104] DAMAGECOUNT value on done: 3704.0
[2023-02-25 13:00:12,349][2409104] Sum rewards: 6.403, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.139', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.015', 'AMMO3': '0.057', 'WEAPON4': '0.100', 'weapon5': '0.148', 'weapon4': '0.226', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.490', 'weapon3': '1.070', 'ARMOR': '1.324', 'weapon2': '1.766', 'DAMAGECOUNT': '2.553', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:12,416][2409596] DAMAGECOUNT value on done: 3505.0
[2023-02-25 13:00:12,419][2409596] Sum rewards: 4.206, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'AMMO3': '0.040', 'ARMOR': '0.040', 'weapon7': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.106', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'WEAPON3': '0.250', 'HITCOUNT': '0.260', 'HEALTH': '0.467', 'weapon4': '0.500', 'weapon2': '0.838', 'weapon3': '0.950', 'DAMAGECOUNT': '1.452', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:12,449][2409100] DAMAGECOUNT value on done: 3025.0
[2023-02-25 13:00:12,450][2409100] Sum rewards: 5.838, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.306', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.027', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'weapon4': '0.196', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.790', 'ARMOR': '0.909', 'weapon3': '1.374', 'weapon2': '1.490', 'DAMAGECOUNT': '2.418', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:00:12,508][2409078] DAMAGECOUNT value on done: 3174.0
[2023-02-25 13:00:12,509][2409078] Sum rewards: 4.365, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.394', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO4': '0.037', 'AMMO3': '0.128', 'weapon5': '0.220', 'weapon4': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'HITCOUNT': '0.680', 'WEAPON3': '0.800', 'ARMOR': '1.371', 'weapon3': '1.418', 'weapon2': '1.506', 'DAMAGECOUNT': '3.243', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:00:12,551][2409469] DAMAGECOUNT value on done: 4324.0
[2023-02-25 13:00:12,552][2409469] Sum rewards: 6.523, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.141', 'AMMO5': '0.005', 'AMMO2': '0.013', 'ARMOR': '0.016', 'WEAPON1': '0.030', 'AMMO4': '0.064', 'AMMO3': '0.078', 'weapon5': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.484', 'WEAPON3': '0.550', 'HITCOUNT': '0.710', 'weapon2': '1.200', 'weapon3': '1.434', 'DAMAGECOUNT': '2.658', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:12,690][2409549] DAMAGECOUNT value on done: 3992.0
[2023-02-25 13:00:12,691][2409549] Sum rewards: 5.880, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.196', 'AMMO5': '0.010', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'AMMO3': '0.083', 'weapon5': '0.118', 'AMMO4': '0.140', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.360', 'ARMOR': '0.432', 'WEAPON3': '0.500', 'weapon4': '0.842', 'weapon2': '1.150', 'weapon3': '1.202', 'DAMAGECOUNT': '1.881', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:12,876][2409866] DAMAGECOUNT value on done: 3389.0
[2023-02-25 13:00:12,877][2409866] Sum rewards: 9.095, reward structure: {'DEATHCOUNT': '-6.750', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon7': '0.048', 'AMMO3': '0.095', 'AMMO4': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'HEALTH': '0.289', 'weapon4': '0.432', 'WEAPON3': '0.500', 'HITCOUNT': '0.640', 'ARMOR': '0.845', 'weapon3': '1.274', 'weapon2': '1.878', 'DAMAGECOUNT': '2.898', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:13,005][2409405] DAMAGECOUNT value on done: 2699.0
[2023-02-25 13:00:13,008][2409405] Sum rewards: 6.657, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.395', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.038', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO3': '0.073', 'weapon5': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'WEAPON3': '0.500', 'ARMOR': '0.540', 'weapon4': '0.592', 'HITCOUNT': '0.640', 'weapon2': '1.258', 'weapon3': '1.466', 'DAMAGECOUNT': '2.109', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:13,066][2409075] DAMAGECOUNT value on done: 3277.0
[2023-02-25 13:00:13,067][2409075] Sum rewards: 9.575, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.563', 'AMMO2': '0.007', 'AMMO5': '0.015', 'AMMO3': '0.020', 'AMMO4': '0.032', 'WEAPON4': '0.200', 'WEAPON3': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.296', 'HITCOUNT': '0.470', 'weapon3': '0.514', 'weapon4': '0.544', 'ARMOR': '0.924', 'weapon2': '0.930', 'DAMAGECOUNT': '2.736', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:13,438][2409074] Updated weights for policy 0, policy_version 15291 (0.0012)
[2023-02-25 13:00:13,489][2409096] DAMAGECOUNT value on done: 3829.0
[2023-02-25 13:00:13,491][2409096] Sum rewards: 6.261, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.915', 'AMMO5': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.060', 'AMMO4': '0.074', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'weapon5': '0.108', 'weapon4': '0.170', 'WEAPON5': '0.250', 'ARMOR': '0.455', 'HITCOUNT': '0.500', 'WEAPON3': '0.600', 'weapon3': '1.640', 'weapon2': '1.822', 'DAMAGECOUNT': '2.028', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:13,533][2409076] DAMAGECOUNT value on done: 3726.0
[2023-02-25 13:00:13,534][2409076] Sum rewards: 6.732, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.248', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'AMMO3': '0.085', 'weapon5': '0.116', 'weapon7': '0.126', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.430', 'weapon4': '0.494', 'WEAPON3': '0.550', 'weapon2': '1.276', 'weapon3': '1.460', 'DAMAGECOUNT': '2.538', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:13,635][2409101] DAMAGECOUNT value on done: 4708.0
[2023-02-25 13:00:13,638][2409101] Sum rewards: 10.298, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.732', 'AMMO5': '0.018', 'AMMO2': '0.025', 'weapon5': '0.056', 'AMMO3': '0.095', 'AMMO4': '0.126', 'WEAPON4': '0.250', 'weapon4': '0.306', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'HITCOUNT': '0.820', 'ARMOR': '0.888', 'weapon3': '1.576', 'weapon2': '1.632', 'DAMAGECOUNT': '2.988', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:00:13,863][2409103] DAMAGECOUNT value on done: 3079.0
[2023-02-25 13:00:13,866][2409103] Sum rewards: 3.207, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.100', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.028', 'AMMO3': '0.040', 'weapon7': '0.048', 'HITCOUNT': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'WEAPON3': '0.200', 'weapon5': '0.252', 'ARMOR': '0.456', 'weapon3': '0.528', 'weapon2': '0.652', 'DAMAGECOUNT': '0.780', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:14,204][2409102] DAMAGECOUNT value on done: 3231.0
[2023-02-25 13:00:14,205][2409102] Sum rewards: 5.491, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.938', 'AMMO2': '0.004', 'AMMO4': '0.019', 'weapon4': '0.050', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.144', 'WEAPON7': '0.200', 'ARMOR': '0.416', 'HITCOUNT': '0.530', 'WEAPON3': '0.600', 'weapon2': '1.264', 'weapon3': '1.574', 'DAMAGECOUNT': '1.695', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:14,223][2409373] DAMAGECOUNT value on done: 3212.0
[2023-02-25 13:00:14,227][2409373] Sum rewards: 3.947, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.208', 'AMMO5': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'AMMO3': '0.040', 'AMMO4': '0.073', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.262', 'weapon4': '0.298', 'WEAPON3': '0.300', 'ARMOR': '0.805', 'DAMAGECOUNT': '0.840', 'weapon3': '1.030', 'weapon2': '1.560', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:14,231][2409565] DAMAGECOUNT value on done: 4199.0
[2023-02-25 13:00:14,232][2409565] Sum rewards: 2.700, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.036', 'AMMO4': '-0.053', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'weapon5': '0.006', 'WEAPON1': '0.030', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'weapon4': '0.226', 'ARMOR': '0.478', 'HITCOUNT': '0.520', 'WEAPON3': '0.750', 'weapon2': '1.304', 'DAMAGECOUNT': '1.563', 'weapon3': '1.606', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:14,354][2409548] DAMAGECOUNT value on done: 2902.0
[2023-02-25 13:00:14,357][2409548] Sum rewards: 5.789, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.124', 'weapon7': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.068', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.238', 'HITCOUNT': '0.280', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.939', 'weapon3': '1.330', 'weapon2': '1.416', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:14,514][2409097] DAMAGECOUNT value on done: 3102.0
[2023-02-25 13:00:14,519][2409097] Sum rewards: 8.635, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.686', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'AMMO4': '0.082', 'WEAPON4': '0.150', 'weapon5': '0.232', 'WEAPON5': '0.300', 'weapon4': '0.380', 'WEAPON3': '0.450', 'HITCOUNT': '0.530', 'ARMOR': '0.856', 'weapon3': '1.052', 'weapon2': '1.366', 'DAMAGECOUNT': '2.307', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:14,584][2409485] DAMAGECOUNT value on done: 3170.0
[2023-02-25 13:00:14,584][2409485] Sum rewards: 4.293, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.031', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.048', 'WEAPON4': '0.200', 'weapon5': '0.208', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.350', 'weapon4': '0.488', 'weapon3': '0.812', 'ARMOR': '0.997', 'DAMAGECOUNT': '1.464', 'weapon2': '1.614', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:14,687][2409407] DAMAGECOUNT value on done: 3874.0
[2023-02-25 13:00:14,691][2409407] Sum rewards: 3.987, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.028', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'AMMO3': '0.077', 'weapon5': '0.098', 'WEAPON4': '0.100', 'AMMO4': '0.177', 'HITCOUNT': '0.190', 'WEAPON5': '0.300', 'weapon4': '0.440', 'ARMOR': '0.456', 'WEAPON3': '0.500', 'weapon2': '1.062', 'weapon3': '1.396', 'DAMAGECOUNT': '1.653', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:14,899][2409389] DAMAGECOUNT value on done: 3823.0
[2023-02-25 13:00:14,900][2409389] Sum rewards: 6.729, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.985', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'AMMO2': '0.025', 'AMMO3': '0.114', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'weapon5': '0.208', 'weapon4': '0.430', 'WEAPON5': '0.500', 'HITCOUNT': '0.700', 'WEAPON3': '0.750', 'ARMOR': '0.871', 'weapon2': '0.878', 'weapon3': '2.010', 'DAMAGECOUNT': '2.910', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:00:14,914][2409074] Updated weights for policy 0, policy_version 15301 (0.0013)
[2023-02-25 13:00:14,966][2409597] DAMAGECOUNT value on done: 3830.0
[2023-02-25 13:00:14,967][2409597] Sum rewards: 2.351, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.852', 'AMMO5': '0.007', 'weapon5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.043', 'AMMO3': '0.115', 'WEAPON5': '0.150', 'AMMO4': '0.213', 'WEAPON4': '0.350', 'weapon4': '0.600', 'HITCOUNT': '0.640', 'WEAPON3': '0.750', 'ARMOR': '0.852', 'weapon2': '1.030', 'weapon3': '1.488', 'DAMAGECOUNT': '2.172', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:15,002][2409406] DAMAGECOUNT value on done: 2869.0
[2023-02-25 13:00:15,005][2409406] Sum rewards: 2.058, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.750', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.047', 'weapon7': '0.048', 'weapon5': '0.054', 'AMMO3': '0.093', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.200', 'weapon4': '0.514', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.053', 'weapon2': '1.234', 'weapon3': '1.296', 'ARMOR': '1.342', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:15,101][2409077] DAMAGECOUNT value on done: 4101.0
[2023-02-25 13:00:15,101][2409077] Sum rewards: 10.068, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.584', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO3': '0.098', 'AMMO4': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.238', 'ARMOR': '0.400', 'HITCOUNT': '0.580', 'WEAPON3': '0.700', 'weapon2': '1.574', 'weapon3': '1.698', 'DAMAGECOUNT': '2.994', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:00:15,141][2409355] DAMAGECOUNT value on done: 3180.0
[2023-02-25 13:00:15,142][2409355] Sum rewards: 7.205, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.862', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.037', 'AMMO3': '0.051', 'weapon5': '0.072', 'weapon7': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.490', 'weapon4': '0.490', 'weapon2': '1.094', 'weapon3': '1.228', 'DAMAGECOUNT': '1.950', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:15,771][2409105] DAMAGECOUNT value on done: 3764.0
[2023-02-25 13:00:15,773][2409105] Sum rewards: 7.246, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.510', 'AMMO2': '0.013', 'AMMO5': '0.023', 'AMMO4': '0.065', 'WEAPON1': '0.070', 'AMMO3': '0.094', 'weapon5': '0.208', 'WEAPON4': '0.300', 'ARMOR': '0.512', 'WEAPON5': '0.550', 'weapon4': '0.584', 'HITCOUNT': '0.610', 'WEAPON3': '0.700', 'weapon2': '1.068', 'weapon3': '1.646', 'DAMAGECOUNT': '2.562', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:00:15,992][2409100] DAMAGECOUNT value on done: 3372.0
[2023-02-25 13:00:15,993][2409100] Sum rewards: 5.931, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.410', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.061', 'AMMO4': '0.075', 'weapon7': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.330', 'WEAPON3': '0.350', 'weapon4': '0.418', 'weapon3': '0.778', 'ARMOR': '0.899', 'DAMAGECOUNT': '1.044', 'weapon2': '1.418', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:16,230][2409549] DAMAGECOUNT value on done: 4388.0
[2023-02-25 13:00:16,228][2409078] DAMAGECOUNT value on done: 3123.0
[2023-02-25 13:00:16,232][2409078] Sum rewards: 7.743, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon7': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.115', 'weapon5': '0.134', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.288', 'WEAPON3': '0.750', 'HITCOUNT': '0.780', 'ARMOR': '0.851', 'weapon2': '1.418', 'weapon3': '1.878', 'DAMAGECOUNT': '2.745', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:00:16,231][2409549] Sum rewards: 6.573, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'AMMO2': '0.026', 'AMMO3': '0.066', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.132', 'WEAPON4': '0.200', 'HEALTH': '0.271', 'WEAPON3': '0.350', 'ARMOR': '0.434', 'HITCOUNT': '0.580', 'weapon4': '0.682', 'weapon2': '0.758', 'weapon3': '1.204', 'DAMAGECOUNT': '1.911', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:16,244][2409104] DAMAGECOUNT value on done: 2891.0
[2023-02-25 13:00:16,247][2409104] Sum rewards: 6.414, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.266', 'AMMO5': '0.007', 'AMMO2': '0.034', 'AMMO3': '0.051', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.100', 'weapon7': '0.118', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'HITCOUNT': '0.270', 'WEAPON3': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.412', 'weapon4': '0.804', 'ARMOR': '0.925', 'weapon3': '1.280', 'DAMAGECOUNT': '1.860', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:16,291][2409596] DAMAGECOUNT value on done: 3079.0
[2023-02-25 13:00:16,292][2409596] Sum rewards: 2.892, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.750', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon7': '0.016', 'AMMO4': '0.030', 'AMMO3': '0.083', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.272', 'HITCOUNT': '0.410', 'ARMOR': '0.450', 'WEAPON3': '0.550', 'weapon2': '1.046', 'weapon3': '1.088', 'DAMAGECOUNT': '1.911', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:16,439][2409469] DAMAGECOUNT value on done: 3463.0
[2023-02-25 13:00:16,442][2409469] Sum rewards: 5.916, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.090', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.138', 'WEAPON4': '0.150', 'weapon5': '0.170', 'WEAPON5': '0.300', 'weapon4': '0.358', 'HITCOUNT': '0.470', 'weapon2': '0.638', 'WEAPON3': '0.700', 'weapon3': '1.792', 'DAMAGECOUNT': '2.010', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:16,529][2409074] Updated weights for policy 0, policy_version 15311 (0.0012)
[2023-02-25 13:00:16,779][2409405] DAMAGECOUNT value on done: 3626.0
[2023-02-25 13:00:16,780][2409405] Sum rewards: 2.448, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.425', 'AMMO5': '0.006', 'AMMO2': '0.017', 'WEAPON1': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.098', 'weapon5': '0.110', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.410', 'weapon4': '0.664', 'WEAPON3': '0.700', 'weapon2': '0.836', 'DAMAGECOUNT': '1.485', 'weapon3': '1.510', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:17,017][2409075] DAMAGECOUNT value on done: 2480.0
[2023-02-25 13:00:17,018][2409075] Sum rewards: 4.948, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.392', 'AMMO2': '0.006', 'AMMO5': '0.013', 'AMMO4': '0.028', 'AMMO3': '0.060', 'weapon7': '0.098', 'weapon5': '0.132', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'HITCOUNT': '0.420', 'WEAPON3': '0.450', 'ARMOR': '0.902', 'weapon2': '1.320', 'weapon3': '1.330', 'DAMAGECOUNT': '1.851', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:17,186][2408954] Fps is (10 sec: 24985.6, 60 sec: 25258.7, 300 sec: 25506.3). Total num frames: 62722048. Throughput: 0: 6358.7. Samples: 15689844. Policy #0 lag: (min: 0.0, avg: 13.4, max: 26.0)
[2023-02-25 13:00:17,186][2408954] Avg episode reward: [(0, '5.020')]
[2023-02-25 13:00:17,232][2409033] Saving /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000015315_62730240.pth...
[2023-02-25 13:00:17,258][2409101] DAMAGECOUNT value on done: 3144.0
[2023-02-25 13:00:17,259][2409101] Sum rewards: 4.102, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.704', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.058', 'AMMO3': '0.060', 'WEAPON1': '0.060', 'weapon7': '0.074', 'AMMO4': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.280', 'weapon4': '0.312', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.266', 'weapon3': '1.266', 'weapon2': '1.504', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:17,323][2409033] Removing /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000013815_56586240.pth
[2023-02-25 13:00:17,329][2409033] Saving new best policy, reward=5.020!
[2023-02-25 13:00:17,344][2409096] DAMAGECOUNT value on done: 3041.0
[2023-02-25 13:00:17,349][2409096] Sum rewards: 3.728, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.783', 'AMMO2': '0.003', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.016', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.052', 'weapon5': '0.108', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'HITCOUNT': '0.360', 'ARMOR': '0.989', 'weapon3': '1.194', 'DAMAGECOUNT': '1.299', 'weapon2': '2.070', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:17,528][2409866] DAMAGECOUNT value on done: 3591.0
[2023-02-25 13:00:17,531][2409866] Sum rewards: 4.281, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.787', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.059', 'AMMO3': '0.081', 'weapon5': '0.108', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.304', 'ARMOR': '0.400', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'weapon3': '1.158', 'weapon2': '1.464', 'DAMAGECOUNT': '1.662', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:17,624][2409076] DAMAGECOUNT value on done: 3537.0
[2023-02-25 13:00:17,624][2409076] Sum rewards: 0.138, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.157', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.007', 'AMMO5': '0.022', 'AMMO4': '0.035', 'weapon5': '0.046', 'AMMO3': '0.073', 'WEAPON1': '0.080', 'WEAPON4': '0.200', 'weapon4': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.520', 'WEAPON3': '0.600', 'ARMOR': '0.916', 'weapon2': '1.324', 'weapon3': '1.612', 'DAMAGECOUNT': '1.710'}
[2023-02-25 13:00:17,870][2409074] Updated weights for policy 0, policy_version 15321 (0.0013)
[2023-02-25 13:00:17,963][2409102] DAMAGECOUNT value on done: 4179.0
[2023-02-25 13:00:17,964][2409102] Sum rewards: 6.216, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'weapon7': '0.070', 'AMMO3': '0.085', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.118', 'AMMO4': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HEALTH': '0.284', 'weapon4': '0.344', 'WEAPON3': '0.450', 'HITCOUNT': '0.550', 'ARMOR': '0.800', 'weapon2': '1.060', 'weapon3': '1.546', 'DAMAGECOUNT': '1.995', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:00:17,982][2409103] DAMAGECOUNT value on done: 2554.0
[2023-02-25 13:00:17,983][2409103] Sum rewards: 3.922, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.625', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.046', 'weapon7': '0.048', 'AMMO3': '0.060', 'AMMO4': '0.075', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'HITCOUNT': '0.450', 'ARMOR': '0.453', 'weapon4': '0.494', 'weapon3': '1.054', 'weapon2': '1.374', 'DAMAGECOUNT': '1.605', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:17,987][2409565] DAMAGECOUNT value on done: 3445.0
[2023-02-25 13:00:17,987][2409565] Sum rewards: 6.952, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.158', 'AMMO2': '0.008', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.040', 'AMMO3': '0.082', 'weapon5': '0.148', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.720', 'ARMOR': '0.849', 'weapon2': '1.604', 'weapon3': '1.800', 'DAMAGECOUNT': '2.973', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:00:18,190][2409548] DAMAGECOUNT value on done: 3080.0
[2023-02-25 13:00:18,191][2409548] Sum rewards: 1.402, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.723', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON1': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.103', 'weapon5': '0.128', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.358', 'HITCOUNT': '0.380', 'ARMOR': '0.487', 'WEAPON3': '0.600', 'weapon3': '1.206', 'DAMAGECOUNT': '1.401', 'weapon2': '1.734', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:18,309][2409097] DAMAGECOUNT value on done: 4064.0
[2023-02-25 13:00:18,310][2409097] Sum rewards: 3.542, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.860', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'weapon4': '0.154', 'weapon5': '0.192', 'WEAPON5': '0.350', 'ARMOR': '0.454', 'HITCOUNT': '0.560', 'WEAPON3': '0.650', 'weapon2': '1.556', 'DAMAGECOUNT': '1.650', 'weapon3': '1.672', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:18,382][2409373] DAMAGECOUNT value on done: 3616.0
[2023-02-25 13:00:18,385][2409373] Sum rewards: 3.207, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.675', 'AMMO5': '0.012', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'weapon5': '0.088', 'AMMO3': '0.094', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'weapon4': '0.178', 'WEAPON5': '0.300', 'HITCOUNT': '0.390', 'ARMOR': '0.463', 'WEAPON3': '0.650', 'weapon2': '1.362', 'DAMAGECOUNT': '1.485', 'weapon3': '1.552', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:18,521][2409597] DAMAGECOUNT value on done: 3426.0
[2023-02-25 13:00:18,522][2409597] Sum rewards: 8.839, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon7': '0.066', 'AMMO3': '0.069', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.104', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.260', 'HEALTH': '0.323', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.420', 'weapon3': '0.798', 'weapon2': '1.254', 'DAMAGECOUNT': '2.133', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:00:18,575][2409407] DAMAGECOUNT value on done: 4734.0
[2023-02-25 13:00:18,576][2409407] Sum rewards: 13.116, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.149', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon7': '0.046', 'WEAPON1': '0.060', 'AMMO3': '0.094', 'weapon5': '0.100', 'AMMO4': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.420', 'WEAPON3': '0.650', 'HITCOUNT': '0.850', 'ARMOR': '0.939', 'weapon2': '1.578', 'weapon3': '1.606', 'DAMAGECOUNT': '3.687', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:00:18,590][2409389] DAMAGECOUNT value on done: 3355.0
[2023-02-25 13:00:18,593][2409389] Sum rewards: 3.652, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.033', 'AMMO3': '0.052', 'weapon5': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.164', 'HEALTH': '0.285', 'weapon4': '0.290', 'WEAPON3': '0.300', 'HITCOUNT': '0.370', 'ARMOR': '0.832', 'weapon3': '1.106', 'DAMAGECOUNT': '1.419', 'weapon2': '1.696', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:18,823][2409406] DAMAGECOUNT value on done: 3422.0
[2023-02-25 13:00:18,824][2409406] Sum rewards: 6.578, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.728', 'AMMO5': '0.007', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'AMMO3': '0.077', 'AMMO4': '0.146', 'weapon5': '0.174', 'WEAPON5': '0.200', 'weapon4': '0.266', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.483', 'HITCOUNT': '0.520', 'weapon3': '1.114', 'weapon2': '1.686', 'DAMAGECOUNT': '2.073', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:18,925][2409077] DAMAGECOUNT value on done: 2991.0
[2023-02-25 13:00:18,927][2409077] Sum rewards: 5.053, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.205', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.014', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'weapon5': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.224', 'WEAPON3': '0.450', 'HITCOUNT': '0.510', 'ARMOR': '1.254', 'weapon3': '1.276', 'weapon2': '1.554', 'DAMAGECOUNT': '1.650', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:18,992][2409485] DAMAGECOUNT value on done: 3258.0
[2023-02-25 13:00:18,995][2409485] Sum rewards: 5.470, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.245', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'weapon5': '0.060', 'AMMO3': '0.078', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.190', 'HITCOUNT': '0.420', 'ARMOR': '0.491', 'WEAPON3': '0.500', 'weapon3': '1.458', 'weapon2': '1.590', 'DAMAGECOUNT': '1.782', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:19,338][2409105] DAMAGECOUNT value on done: 3645.0
[2023-02-25 13:00:19,341][2409105] Sum rewards: 1.431, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.029', 'AMMO5': '0.011', 'AMMO2': '0.012', 'WEAPON1': '0.050', 'AMMO4': '0.062', 'weapon5': '0.078', 'AMMO3': '0.092', 'HITCOUNT': '0.170', 'weapon4': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.492', 'WEAPON3': '0.650', 'ARMOR': '0.900', 'weapon3': '1.480', 'weapon2': '1.584', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:19,709][2409074] Updated weights for policy 0, policy_version 15331 (0.0012)
[2023-02-25 13:00:20,049][2409104] DAMAGECOUNT value on done: 2882.0
[2023-02-25 13:00:20,052][2409104] Sum rewards: 9.180, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.524', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'WEAPON1': '0.020', 'ARMOR': '0.052', 'weapon5': '0.058', 'AMMO3': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'WEAPON3': '0.450', 'HITCOUNT': '0.560', 'weapon4': '0.564', 'weapon2': '0.746', 'weapon3': '1.774', 'DAMAGECOUNT': '1.827', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:00:20,076][2409100] DAMAGECOUNT value on done: 3145.0
[2023-02-25 13:00:20,077][2409100] Sum rewards: 0.086, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.110', 'AMMO2': '0.015', 'WEAPON1': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.077', 'WEAPON4': '0.300', 'HITCOUNT': '0.370', 'weapon4': '0.446', 'ARMOR': '0.491', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.077', 'weapon3': '1.406', 'weapon2': '1.844', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:20,079][2409596] DAMAGECOUNT value on done: 2383.0
[2023-02-25 13:00:20,082][2409596] Sum rewards: 0.623, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.710', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.013', 'WEAPON1': '0.040', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'weapon5': '0.138', 'weapon4': '0.166', 'WEAPON5': '0.200', 'HITCOUNT': '0.260', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.816', 'FRAGCOUNT': '1.000', 'weapon2': '1.590', 'weapon3': '1.662'}
[2023-02-25 13:00:20,161][2409355] DAMAGECOUNT value on done: 3289.0
[2023-02-25 13:00:20,164][2409355] Sum rewards: 3.920, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.740', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.034', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.240', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'weapon3': '0.678', 'weapon2': '1.202', 'DAMAGECOUNT': '1.344', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:20,206][2409549] DAMAGECOUNT value on done: 3317.0
[2023-02-25 13:00:20,207][2409549] Sum rewards: 5.657, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.154', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon7': '0.046', 'AMMO3': '0.067', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.120', 'weapon5': '0.166', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'HITCOUNT': '0.430', 'WEAPON3': '0.450', 'weapon4': '0.494', 'ARMOR': '0.800', 'weapon2': '0.862', 'weapon3': '1.000', 'DAMAGECOUNT': '1.917', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:00:20,263][2409486] DAMAGECOUNT value on done: 3024.0
[2023-02-25 13:00:20,267][2409486] Sum rewards: 0.002, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.910', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.024', 'WEAPON5': '0.050', 'weapon7': '0.068', 'AMMO4': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.103', 'WEAPON4': '0.200', 'HITCOUNT': '0.270', 'weapon4': '0.578', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.777', 'weapon2': '0.936', 'weapon3': '1.518', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:20,329][2409469] DAMAGECOUNT value on done: 3176.0
[2023-02-25 13:00:20,332][2409469] Sum rewards: 6.408, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.050', 'AMMO3': '0.070', 'WEAPON5': '0.150', 'AMMO4': '0.208', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'weapon4': '0.420', 'HEALTH': '0.560', 'HITCOUNT': '0.660', 'ARMOR': '0.832', 'weapon3': '1.124', 'weapon2': '1.948', 'DAMAGECOUNT': '2.439', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:20,335][2409078] DAMAGECOUNT value on done: 3733.0
[2023-02-25 13:00:20,335][2409078] Sum rewards: 1.731, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.976', 'AMMO5': '0.020', 'AMMO2': '0.023', 'WEAPON1': '0.050', 'AMMO3': '0.103', 'AMMO4': '0.113', 'weapon5': '0.220', 'HITCOUNT': '0.260', 'WEAPON4': '0.400', 'ARMOR': '0.503', 'weapon4': '0.538', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'weapon2': '1.226', 'DAMAGECOUNT': '1.443', 'weapon3': '1.558', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:20,600][2409075] DAMAGECOUNT value on done: 2749.0
[2023-02-25 13:00:20,600][2409075] Sum rewards: 4.358, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.987', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.007', 'WEAPON1': '0.040', 'AMMO3': '0.058', 'weapon5': '0.076', 'WEAPON4': '0.100', 'weapon7': '0.100', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.248', 'HITCOUNT': '0.360', 'WEAPON7': '0.400', 'WEAPON3': '0.500', 'ARMOR': '0.918', 'weapon3': '1.114', 'DAMAGECOUNT': '2.055', 'weapon2': '2.212', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:20,638][2409389] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:00:20,845][2409405] DAMAGECOUNT value on done: 4061.0
[2023-02-25 13:00:20,849][2409405] Sum rewards: 5.549, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.520', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.015', 'weapon7': '0.030', 'weapon5': '0.050', 'AMMO3': '0.084', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.224', 'HITCOUNT': '0.350', 'ARMOR': '0.408', 'WEAPON3': '0.550', 'weapon3': '1.144', 'DAMAGECOUNT': '1.317', 'weapon2': '1.736', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:21,192][2409101] DAMAGECOUNT value on done: 2975.0
[2023-02-25 13:00:21,193][2409101] Sum rewards: 2.143, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.931', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.039', 'WEAPON1': '0.040', 'AMMO3': '0.094', 'WEAPON4': '0.150', 'weapon5': '0.208', 'HITCOUNT': '0.220', 'weapon4': '0.360', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'ARMOR': '0.870', 'weapon3': '1.268', 'weapon2': '1.598', 'DAMAGECOUNT': '1.704', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:21,249][2409096] DAMAGECOUNT value on done: 3117.0
[2023-02-25 13:00:21,252][2409096] Sum rewards: 8.470, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.796', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'WEAPON4': '0.050', 'AMMO3': '0.095', 'weapon4': '0.206', 'weapon5': '0.248', 'WEAPON5': '0.250', 'HITCOUNT': '0.410', 'WEAPON3': '0.550', 'weapon2': '1.202', 'weapon3': '1.570', 'ARMOR': '1.793', 'DAMAGECOUNT': '2.130', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:21,352][2409074] Updated weights for policy 0, policy_version 15341 (0.0012)
[2023-02-25 13:00:21,859][2409103] DAMAGECOUNT value on done: 2285.0
[2023-02-25 13:00:21,862][2409103] Sum rewards: 6.616, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.028', 'AMMO3': '0.050', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.080', 'weapon5': '0.130', 'WEAPON5': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.300', 'HEALTH': '0.673', 'DAMAGECOUNT': '0.960', 'weapon3': '1.264', 'weapon2': '2.318', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:21,863][2409866] DAMAGECOUNT value on done: 4191.0
[2023-02-25 13:00:21,866][2409866] Sum rewards: 1.349, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.242', 'AMMO2': '0.017', 'AMMO5': '0.021', 'WEAPON1': '0.060', 'weapon5': '0.062', 'AMMO4': '0.086', 'AMMO3': '0.103', 'WEAPON4': '0.250', 'ARMOR': '0.432', 'WEAPON5': '0.450', 'HITCOUNT': '0.570', 'weapon4': '0.596', 'WEAPON3': '0.700', 'weapon2': '1.012', 'weapon3': '1.454', 'DAMAGECOUNT': '2.028', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:21,913][2409097] DAMAGECOUNT value on done: 2654.0
[2023-02-25 13:00:21,914][2409097] Sum rewards: 5.537, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'AMMO3': '0.089', 'AMMO4': '0.122', 'weapon5': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.250', 'HEALTH': '0.350', 'WEAPON3': '0.500', 'weapon4': '0.598', 'ARMOR': '0.800', 'weapon2': '0.806', 'weapon3': '1.486', 'DAMAGECOUNT': '1.599', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:21,975][2409102] DAMAGECOUNT value on done: 3563.0
[2023-02-25 13:00:21,975][2409102] Sum rewards: 5.797, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.615', 'AMMO2': '0.007', 'AMMO5': '0.007', 'ARMOR': '0.032', 'AMMO4': '0.033', 'AMMO3': '0.040', 'WEAPON1': '0.040', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.320', 'WEAPON3': '0.350', 'HITCOUNT': '0.410', 'weapon3': '0.960', 'weapon2': '1.286', 'DAMAGECOUNT': '1.398', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:22,013][2409565] DAMAGECOUNT value on done: 2680.0
[2023-02-25 13:00:22,044][2409548] DAMAGECOUNT value on done: 4255.0
[2023-02-25 13:00:22,047][2409548] Sum rewards: 2.780, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.272', 'AMMO5': '0.010', 'AMMO2': '0.026', 'WEAPON1': '0.040', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.112', 'AMMO3': '0.116', 'AMMO4': '0.131', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.394', 'HITCOUNT': '0.590', 'WEAPON3': '0.750', 'ARMOR': '0.861', 'weapon2': '1.424', 'weapon3': '1.532', 'DAMAGECOUNT': '1.965', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:22,089][2409076] DAMAGECOUNT value on done: 3457.0
[2023-02-25 13:00:22,090][2409076] Sum rewards: 7.439, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.710', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.025', 'AMMO4': '0.054', 'weapon7': '0.066', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.202', 'WEAPON5': '0.500', 'HITCOUNT': '0.510', 'WEAPON3': '0.550', 'weapon3': '1.248', 'ARMOR': '1.305', 'weapon2': '1.824', 'DAMAGECOUNT': '3.114', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:00:22,174][2409389] DAMAGECOUNT value on done: 3427.0
[2023-02-25 13:00:22,174][2409389] Sum rewards: 2.939, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.586', 'AMMO4': '-0.008', 'AMMO2': '-0.001', 'AMMO5': '0.012', 'AMMO3': '0.040', 'weapon5': '0.206', 'WEAPON3': '0.300', 'WEAPON5': '0.300', 'HITCOUNT': '0.370', 'weapon3': '0.922', 'ARMOR': '0.952', 'weapon2': '1.356', 'DAMAGECOUNT': '1.575', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:22,186][2408954] Fps is (10 sec: 25804.8, 60 sec: 25600.0, 300 sec: 25575.7). Total num frames: 62861312. Throughput: 0: 6336.2. Samples: 15708144. Policy #0 lag: (min: 0.0, avg: 12.0, max: 24.0)
[2023-02-25 13:00:22,186][2408954] Avg episode reward: [(0, '4.999')]
[2023-02-25 13:00:22,232][2409597] DAMAGECOUNT value on done: 3491.0
[2023-02-25 13:00:22,233][2409597] Sum rewards: 5.087, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.882', 'AMMO2': '0.005', 'AMMO5': '0.007', 'weapon7': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.024', 'AMMO3': '0.079', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.134', 'WEAPON5': '0.200', 'HITCOUNT': '0.350', 'weapon4': '0.360', 'WEAPON3': '0.550', 'ARMOR': '0.991', 'DAMAGECOUNT': '1.392', 'weapon3': '1.450', 'weapon2': '1.490', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:22,321][2409407] DAMAGECOUNT value on done: 2981.0
[2023-02-25 13:00:22,322][2409407] Sum rewards: 4.443, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.521', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'weapon5': '0.048', 'weapon7': '0.048', 'AMMO3': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'AMMO4': '0.160', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.260', 'HITCOUNT': '0.410', 'WEAPON3': '0.450', 'ARMOR': '0.862', 'weapon3': '1.176', 'DAMAGECOUNT': '1.374', 'weapon2': '1.706', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:22,545][2409406] DAMAGECOUNT value on done: 3783.0
[2023-02-25 13:00:22,547][2409406] Sum rewards: 4.574, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.934', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'ARMOR': '0.008', 'AMMO5': '0.012', 'WEAPON1': '0.050', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'weapon5': '0.144', 'weapon4': '0.240', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.450', 'weapon3': '1.292', 'weapon2': '1.772', 'DAMAGECOUNT': '1.854', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:22,597][2409485] DAMAGECOUNT value on done: 3283.0
[2023-02-25 13:00:22,598][2409485] Sum rewards: 8.683, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.090', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO3': '0.061', 'WEAPON4': '0.100', 'weapon7': '0.128', 'WEAPON5': '0.200', 'weapon4': '0.238', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'ARMOR': '0.456', 'WEAPON3': '0.500', 'HITCOUNT': '0.530', 'weapon2': '1.292', 'weapon3': '1.428', 'DAMAGECOUNT': '2.478', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:22,627][2409079] DAMAGECOUNT value on done: 3177.0
[2023-02-25 13:00:22,628][2409079] Sum rewards: 6.739, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.034', 'weapon7': '0.052', 'AMMO3': '0.075', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.138', 'AMMO4': '0.170', 'HEALTH': '0.268', 'WEAPON5': '0.300', 'weapon4': '0.362', 'HITCOUNT': '0.380', 'WEAPON3': '0.450', 'ARMOR': '0.800', 'weapon3': '1.216', 'DAMAGECOUNT': '1.599', 'weapon2': '1.702', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:22,665][2409077] DAMAGECOUNT value on done: 2803.0
[2023-02-25 13:00:22,668][2409077] Sum rewards: 7.458, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO3': '0.040', 'weapon7': '0.090', 'AMMO4': '0.097', 'weapon5': '0.110', 'weapon4': '0.128', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON3': '0.250', 'AMMO6': '0.260', 'AMMO7': '0.260', 'WEAPON7': '0.300', 'HITCOUNT': '0.510', 'HEALTH': '0.604', 'ARMOR': '0.800', 'weapon3': '0.810', 'weapon2': '1.776', 'DAMAGECOUNT': '1.845', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:00:22,760][2409373] DAMAGECOUNT value on done: 2941.0
[2023-02-25 13:00:22,764][2409373] Sum rewards: 2.713, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.150', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO3': '0.025', 'weapon7': '0.064', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.200', 'HITCOUNT': '0.220', 'weapon3': '0.342', 'weapon4': '0.426', 'ARMOR': '0.460', 'DAMAGECOUNT': '0.624', 'weapon2': '0.900', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:22,992][2409074] Updated weights for policy 0, policy_version 15351 (0.0012)
[2023-02-25 13:00:23,209][2409105] DAMAGECOUNT value on done: 2947.0
[2023-02-25 13:00:23,225][2409105] Sum rewards: 3.450, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.130', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.031', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.166', 'weapon5': '0.170', 'AMMO3': '0.171', 'WEAPON5': '0.300', 'HITCOUNT': '0.360', 'WEAPON3': '0.950', 'weapon2': '1.104', 'ARMOR': '1.367', 'DAMAGECOUNT': '1.524', 'weapon3': '2.006', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:00:23,779][2409104] DAMAGECOUNT value on done: 2271.0
[2023-02-25 13:00:23,780][2409104] Sum rewards: 4.043, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.590', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO4': '0.041', 'AMMO3': '0.042', 'weapon5': '0.084', 'weapon4': '0.100', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.300', 'HITCOUNT': '0.390', 'ARMOR': '0.908', 'weapon3': '0.954', 'DAMAGECOUNT': '1.335', 'weapon2': '2.498', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:23,788][2409596] DAMAGECOUNT value on done: 2899.0
[2023-02-25 13:00:23,788][2409596] Sum rewards: 3.427, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.624', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO3': '0.030', 'weapon7': '0.048', 'AMMO4': '0.069', 'weapon5': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.250', 'weapon4': '0.270', 'WEAPON3': '0.300', 'ARMOR': '0.460', 'weapon3': '0.730', 'DAMAGECOUNT': '0.807', 'weapon2': '1.030', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:23,850][2409100] DAMAGECOUNT value on done: 3178.0
[2023-02-25 13:00:23,850][2409100] Sum rewards: 2.357, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.965', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'weapon5': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.262', 'HITCOUNT': '0.280', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.762', 'ARMOR': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.280', 'weapon2': '1.798'}
[2023-02-25 13:00:23,944][2409469] DAMAGECOUNT value on done: 4446.0
[2023-02-25 13:00:23,949][2409469] Sum rewards: 8.148, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.437', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon7': '0.038', 'AMMO3': '0.040', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.204', 'WEAPON3': '0.350', 'HITCOUNT': '0.410', 'weapon3': '1.064', 'weapon2': '1.550', 'DAMAGECOUNT': '2.028', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:24,060][2409549] DAMAGECOUNT value on done: 3932.0
[2023-02-25 13:00:24,063][2409549] Sum rewards: 5.767, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.050', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon5': '0.082', 'AMMO3': '0.104', 'AMMO4': '0.110', 'weapon4': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'HITCOUNT': '0.510', 'WEAPON3': '0.600', 'ARMOR': '0.907', 'weapon3': '1.166', 'weapon2': '1.932', 'DAMAGECOUNT': '2.394', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:00:24,169][2409486] DAMAGECOUNT value on done: 3797.0
[2023-02-25 13:00:24,170][2409486] Sum rewards: 6.022, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.072', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.067', 'weapon5': '0.180', 'WEAPON5': '0.200', 'weapon4': '0.224', 'HITCOUNT': '0.330', 'WEAPON3': '0.450', 'weapon3': '1.312', 'weapon2': '1.336', 'DAMAGECOUNT': '1.602', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:24,170][2409075] DAMAGECOUNT value on done: 3043.0
[2023-02-25 13:00:24,175][2409075] Sum rewards: 10.187, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.320', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO3': '0.044', 'AMMO2': '0.055', 'weapon7': '0.082', 'weapon5': '0.096', 'WEAPON5': '0.200', 'AMMO4': '0.276', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.300', 'WEAPON4': '0.400', 'HITCOUNT': '0.640', 'weapon2': '0.722', 'weapon4': '0.856', 'weapon3': '0.932', 'DAMAGECOUNT': '2.700', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:00:24,351][2409078] DAMAGECOUNT value on done: 3246.0
[2023-02-25 13:00:24,352][2409078] Sum rewards: 1.128, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.545', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.017', 'WEAPON1': '0.030', 'AMMO3': '0.084', 'weapon5': '0.206', 'HITCOUNT': '0.290', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.600', 'weapon4': '0.708', 'weapon3': '1.328', 'weapon2': '1.366', 'ARMOR': '1.371', 'DAMAGECOUNT': '1.506', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:24,403][2409355] DAMAGECOUNT value on done: 3858.0
[2023-02-25 13:00:24,407][2409355] Sum rewards: 5.341, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.816', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.017', 'weapon7': '0.072', 'AMMO4': '0.085', 'AMMO3': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.122', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.414', 'HITCOUNT': '0.500', 'WEAPON3': '0.700', 'weapon2': '0.872', 'ARMOR': '0.897', 'weapon3': '1.208', 'DAMAGECOUNT': '2.799', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:24,770][2409074] Updated weights for policy 0, policy_version 15361 (0.0012)
[2023-02-25 13:00:24,807][2409405] DAMAGECOUNT value on done: 3551.0
[2023-02-25 13:00:24,808][2409405] Sum rewards: 4.439, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.012', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO3': '0.069', 'AMMO4': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HEALTH': '0.132', 'weapon5': '0.132', 'WEAPON5': '0.300', 'HITCOUNT': '0.380', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon3': '1.298', 'weapon2': '1.508', 'DAMAGECOUNT': '1.755', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:25,107][2409096] DAMAGECOUNT value on done: 2763.0
[2023-02-25 13:00:25,108][2409096] Sum rewards: 6.096, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.416', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon5': '0.048', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.244', 'HITCOUNT': '0.560', 'WEAPON3': '0.650', 'ARMOR': '0.904', 'weapon3': '1.338', 'weapon2': '1.502', 'DAMAGECOUNT': '2.163', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:25,286][2409101] DAMAGECOUNT value on done: 3736.0
[2023-02-25 13:00:25,287][2409101] Sum rewards: 1.951, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.252', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.038', 'AMMO3': '0.050', 'weapon5': '0.054', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'HITCOUNT': '0.230', 'WEAPON3': '0.300', 'weapon4': '0.312', 'DAMAGECOUNT': '0.684', 'ARMOR': '0.698', 'weapon2': '0.790', 'weapon3': '1.214', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:25,373][2409103] DAMAGECOUNT value on done: 4199.0
[2023-02-25 13:00:25,374][2409103] Sum rewards: 1.237, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.405', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'ARMOR': '0.044', 'weapon5': '0.046', 'weapon7': '0.074', 'AMMO3': '0.085', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.350', 'weapon4': '0.434', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.227', 'weapon2': '1.308', 'weapon3': '1.362', 'FRAGCOUNT': '1.500'}
[2023-02-25 13:00:25,525][2409102] DAMAGECOUNT value on done: 3150.0
[2023-02-25 13:00:25,526][2409102] Sum rewards: 2.721, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.540', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.022', 'ARMOR': '0.024', 'weapon7': '0.048', 'AMMO3': '0.062', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.230', 'weapon4': '0.482', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.912', 'weapon2': '0.998', 'weapon3': '1.006', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:25,567][2409565] DAMAGECOUNT value on done: 3257.0
[2023-02-25 13:00:25,570][2409565] Sum rewards: 7.154, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.356', 'AMMO2': '0.009', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.045', 'AMMO3': '0.070', 'weapon5': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'ARMOR': '0.452', 'WEAPON3': '0.550', 'HITCOUNT': '0.580', 'weapon4': '0.616', 'weapon2': '1.286', 'weapon3': '1.396', 'DAMAGECOUNT': '2.277', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:00:25,631][2409076] DAMAGECOUNT value on done: 2969.0
[2023-02-25 13:00:25,636][2409076] Sum rewards: 1.659, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.920', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon5': '0.052', 'weapon4': '0.104', 'AMMO3': '0.116', 'AMMO4': '0.117', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.320', 'ARMOR': '0.580', 'WEAPON3': '0.600', 'weapon3': '0.958', 'DAMAGECOUNT': '1.002', 'FRAGCOUNT': '2.000', 'weapon2': '2.244'}
[2023-02-25 13:00:25,669][2409097] DAMAGECOUNT value on done: 4340.0
[2023-02-25 13:00:25,672][2409097] Sum rewards: 2.861, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.148', 'AMMO5': '0.015', 'AMMO2': '0.021', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO3': '0.086', 'weapon5': '0.098', 'AMMO4': '0.102', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'HITCOUNT': '0.500', 'weapon4': '0.578', 'WEAPON3': '0.600', 'ARMOR': '0.888', 'weapon3': '1.164', 'weapon2': '1.362', 'DAMAGECOUNT': '2.097', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:25,713][2409389] DAMAGECOUNT value on done: 3296.0
[2023-02-25 13:00:25,714][2409389] Sum rewards: 4.528, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.856', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.016', 'weapon4': '0.024', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.073', 'weapon5': '0.110', 'WEAPON5': '0.350', 'HITCOUNT': '0.500', 'WEAPON3': '0.650', 'ARMOR': '1.363', 'weapon2': '1.640', 'weapon3': '1.668', 'DAMAGECOUNT': '1.890', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:26,006][2409074] Updated weights for policy 0, policy_version 15371 (0.0013)
[2023-02-25 13:00:26,013][2409548] DAMAGECOUNT value on done: 3787.0
[2023-02-25 13:00:26,014][2409548] Sum rewards: 10.155, reward structure: {'DEATHCOUNT': '-8.250', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.034', 'AMMO3': '0.080', 'HEALTH': '0.090', 'weapon5': '0.120', 'AMMO4': '0.171', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.522', 'WEAPON3': '0.550', 'HITCOUNT': '0.780', 'weapon3': '1.148', 'weapon2': '1.916', 'DAMAGECOUNT': '3.369', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:00:26,059][2409407] DAMAGECOUNT value on done: 4275.0
[2023-02-25 13:00:26,062][2409407] Sum rewards: 4.476, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.772', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon7': '0.048', 'AMMO4': '0.053', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.460', 'weapon4': '0.542', 'WEAPON3': '0.550', 'weapon2': '0.822', 'ARMOR': '0.851', 'weapon3': '1.406', 'DAMAGECOUNT': '1.914', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:26,136][2409485] DAMAGECOUNT value on done: 3235.0
[2023-02-25 13:00:26,137][2409485] Sum rewards: 2.574, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.170', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.019', 'WEAPON1': '0.040', 'AMMO3': '0.041', 'weapon5': '0.062', 'ARMOR': '0.064', 'weapon7': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'HITCOUNT': '0.290', 'WEAPON3': '0.400', 'weapon4': '0.414', 'DAMAGECOUNT': '0.885', 'weapon3': '1.062', 'weapon2': '1.540', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:26,287][2409373] DAMAGECOUNT value on done: 4220.0
[2023-02-25 13:00:26,290][2409373] Sum rewards: 9.113, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.486', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon5': '0.020', 'AMMO2': '0.033', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.118', 'AMMO4': '0.167', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.554', 'WEAPON3': '0.650', 'HITCOUNT': '0.800', 'ARMOR': '0.853', 'weapon3': '1.426', 'weapon2': '1.498', 'DAMAGECOUNT': '3.351', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:00:26,315][2409597] DAMAGECOUNT value on done: 4113.0
[2023-02-25 13:00:26,316][2409597] Sum rewards: 4.442, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.574', 'AMMO2': '0.007', 'AMMO5': '0.019', 'AMMO4': '0.032', 'WEAPON1': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.103', 'weapon5': '0.110', 'WEAPON4': '0.150', 'weapon4': '0.256', 'WEAPON5': '0.400', 'HITCOUNT': '0.600', 'WEAPON3': '0.750', 'ARMOR': '1.200', 'weapon3': '1.510', 'weapon2': '1.950', 'DAMAGECOUNT': '2.829', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:00:26,429][2409079] DAMAGECOUNT value on done: 3127.0
[2023-02-25 13:00:26,434][2409079] Sum rewards: 6.952, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.602', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.102', 'weapon5': '0.112', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.372', 'ARMOR': '0.531', 'HITCOUNT': '0.590', 'WEAPON3': '0.650', 'weapon2': '1.432', 'weapon3': '1.830', 'DAMAGECOUNT': '2.151', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:26,753][2409866] DAMAGECOUNT value on done: 4263.0
[2023-02-25 13:00:26,756][2409866] Sum rewards: 9.210, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.366', 'AMMO5': '0.012', 'AMMO2': '0.026', 'WEAPON1': '0.050', 'AMMO3': '0.125', 'AMMO4': '0.128', 'weapon5': '0.214', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.332', 'HITCOUNT': '0.710', 'WEAPON3': '0.800', 'weapon2': '0.950', 'weapon3': '2.198', 'DAMAGECOUNT': '2.931', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:00:26,980][2409406] DAMAGECOUNT value on done: 2702.0
[2023-02-25 13:00:26,981][2409406] Sum rewards: 12.060, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.061', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.030', 'AMMO4': '0.049', 'weapon5': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'WEAPON3': '0.250', 'ARMOR': '0.424', 'weapon4': '0.430', 'HITCOUNT': '0.560', 'weapon3': '0.722', 'weapon2': '1.250', 'DAMAGECOUNT': '2.250', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:00:27,142][2409077] DAMAGECOUNT value on done: 3310.0
[2023-02-25 13:00:27,143][2409077] Sum rewards: 8.101, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.287', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'AMMO3': '0.040', 'weapon5': '0.050', 'weapon7': '0.052', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.280', 'weapon3': '0.472', 'ARMOR': '1.252', 'weapon2': '1.960', 'DAMAGECOUNT': '1.992', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:27,186][2408954] Fps is (10 sec: 25804.7, 60 sec: 25395.2, 300 sec: 25547.9). Total num frames: 62980096. Throughput: 0: 6337.9. Samples: 15746292. Policy #0 lag: (min: 0.0, avg: 12.0, max: 24.0)
[2023-02-25 13:00:27,186][2408954] Avg episode reward: [(0, '5.152')]
[2023-02-25 13:00:27,226][2409033] Saving new best policy, reward=5.152!
[2023-02-25 13:00:27,475][2409105] DAMAGECOUNT value on done: 4181.0
[2023-02-25 13:00:27,475][2409105] Sum rewards: 9.054, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.138', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.044', 'AMMO3': '0.095', 'weapon5': '0.102', 'AMMO4': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.710', 'ARMOR': '0.824', 'weapon2': '0.912', 'weapon4': '0.988', 'weapon3': '1.276', 'DAMAGECOUNT': '2.850', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:00:27,645][2409596] DAMAGECOUNT value on done: 3259.0
[2023-02-25 13:00:27,647][2409596] Sum rewards: 5.142, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.117', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO3': '0.030', 'AMMO4': '0.075', 'weapon7': '0.084', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.130', 'WEAPON3': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.290', 'ARMOR': '0.404', 'weapon3': '0.578', 'weapon2': '0.646', 'weapon4': '0.694', 'DAMAGECOUNT': '1.365', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:27,655][2409104] DAMAGECOUNT value on done: 3425.0
[2023-02-25 13:00:27,656][2409104] Sum rewards: 1.446, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.732', 'AMMO5': '0.003', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'weapon5': '0.030', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'weapon7': '0.066', 'AMMO3': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.236', 'HITCOUNT': '0.290', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.212', 'weapon2': '1.400', 'weapon3': '1.976', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:27,749][2409075] DAMAGECOUNT value on done: 2895.0
[2023-02-25 13:00:27,749][2409100] DAMAGECOUNT value on done: 3295.0
[2023-02-25 13:00:27,752][2409075] Sum rewards: -1.004, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.500', 'AMMO5': '0.013', 'weapon5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon7': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.159', 'WEAPON5': '0.250', 'HITCOUNT': '0.430', 'WEAPON4': '0.450', 'weapon2': '0.702', 'weapon4': '0.720', 'ARMOR': '0.944', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.428', 'weapon3': '1.852', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:27,752][2409100] Sum rewards: -0.436, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.406', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.134', 'WEAPON4': '0.200', 'weapon4': '0.354', 'HITCOUNT': '0.450', 'WEAPON3': '0.700', 'ARMOR': '0.870', 'weapon2': '1.240', 'DAMAGECOUNT': '1.296', 'weapon3': '1.726', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:27,772][2409486] DAMAGECOUNT value on done: 2822.0
[2023-02-25 13:00:28,003][2409078] DAMAGECOUNT value on done: 3342.0
[2023-02-25 13:00:28,004][2409078] Sum rewards: 3.821, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.645', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.018', 'weapon7': '0.066', 'AMMO4': '0.074', 'WEAPON1': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.358', 'HITCOUNT': '0.440', 'WEAPON3': '0.700', 'weapon2': '1.352', 'DAMAGECOUNT': '1.665', 'weapon3': '1.900', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:28,005][2409549] DAMAGECOUNT value on done: 3995.0
[2023-02-25 13:00:28,008][2409549] Sum rewards: 5.377, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.304', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.087', 'weapon7': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'HITCOUNT': '0.560', 'WEAPON3': '0.650', 'weapon2': '0.900', 'weapon3': '1.346', 'DAMAGECOUNT': '2.472', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:28,105][2409074] Updated weights for policy 0, policy_version 15381 (0.0014)
[2023-02-25 13:00:28,155][2409469] DAMAGECOUNT value on done: 4454.0
[2023-02-25 13:00:28,157][2409469] Sum rewards: 6.300, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.254', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon5': '0.066', 'WEAPON1': '0.070', 'AMMO3': '0.075', 'WEAPON5': '0.100', 'weapon7': '0.120', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HITCOUNT': '0.310', 'weapon4': '0.528', 'WEAPON3': '0.550', 'ARMOR': '0.955', 'weapon2': '1.010', 'weapon3': '1.122', 'DAMAGECOUNT': '2.163', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:00:28,399][2409405] DAMAGECOUNT value on done: 3830.0
[2023-02-25 13:00:28,417][2409405] Sum rewards: 10.651, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.491', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'weapon7': '0.058', 'weapon5': '0.060', 'AMMO3': '0.077', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.432', 'WEAPON3': '0.450', 'HITCOUNT': '0.630', 'ARMOR': '0.864', 'weapon2': '1.052', 'weapon3': '1.528', 'DAMAGECOUNT': '1.941', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:00:28,870][2409355] DAMAGECOUNT value on done: 3692.0
[2023-02-25 13:00:28,871][2409355] Sum rewards: 12.823, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.254', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO3': '0.126', 'weapon5': '0.160', 'AMMO4': '0.184', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.728', 'WEAPON3': '0.800', 'HITCOUNT': '0.830', 'ARMOR': '0.881', 'weapon2': '1.188', 'weapon3': '1.600', 'DAMAGECOUNT': '3.780', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:00:28,898][2409103] DAMAGECOUNT value on done: 3323.0
[2023-02-25 13:00:28,900][2409103] Sum rewards: 1.813, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.929', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.015', 'weapon7': '0.068', 'AMMO3': '0.069', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.138', 'WEAPON7': '0.200', 'HITCOUNT': '0.240', 'WEAPON5': '0.250', 'weapon4': '0.266', 'WEAPON3': '0.450', 'weapon2': '0.856', 'ARMOR': '0.870', 'weapon3': '1.298', 'DAMAGECOUNT': '1.416', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:29,045][2409102] DAMAGECOUNT value on done: 4217.0
[2023-02-25 13:00:29,048][2409102] Sum rewards: 8.525, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.313', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.010', 'WEAPON1': '0.060', 'weapon5': '0.066', 'AMMO3': '0.113', 'WEAPON5': '0.250', 'ARMOR': '0.448', 'WEAPON3': '0.850', 'HITCOUNT': '0.900', 'weapon2': '1.194', 'weapon3': '2.098', 'DAMAGECOUNT': '3.618', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:00:29,087][2409101] DAMAGECOUNT value on done: 3573.0
[2023-02-25 13:00:29,087][2409101] Sum rewards: 11.291, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon5': '0.054', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'HEALTH': '0.263', 'weapon4': '0.334', 'WEAPON3': '0.550', 'HITCOUNT': '0.740', 'ARMOR': '0.864', 'weapon2': '1.052', 'weapon3': '1.744', 'DAMAGECOUNT': '2.994', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:00:29,089][2409565] DAMAGECOUNT value on done: 3507.0
[2023-02-25 13:00:29,091][2409565] Sum rewards: 5.250, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.730', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'weapon4': '0.030', 'weapon5': '0.048', 'WEAPON4': '0.050', 'weapon7': '0.054', 'AMMO3': '0.060', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'weapon3': '1.442', 'weapon2': '1.490', 'DAMAGECOUNT': '1.686', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:29,118][2409096] DAMAGECOUNT value on done: 3088.0
[2023-02-25 13:00:29,119][2409096] Sum rewards: 5.478, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.008', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.039', 'HEALTH': '0.070', 'AMMO3': '0.119', 'weapon5': '0.154', 'WEAPON5': '0.250', 'HITCOUNT': '0.390', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.362', 'weapon3': '1.700', 'weapon2': '1.744', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:29,190][2409074] Updated weights for policy 0, policy_version 15391 (0.0012)
[2023-02-25 13:00:29,197][2409076] DAMAGECOUNT value on done: 3578.0
[2023-02-25 13:00:29,198][2409076] Sum rewards: 7.610, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.542', 'AMMO2': '0.015', 'AMMO5': '0.015', 'ARMOR': '0.016', 'WEAPON1': '0.030', 'AMMO4': '0.073', 'weapon5': '0.076', 'AMMO3': '0.081', 'WEAPON4': '0.150', 'WEAPON5': '0.350', 'weapon4': '0.458', 'WEAPON3': '0.550', 'HITCOUNT': '0.600', 'weapon2': '1.286', 'weapon3': '1.292', 'DAMAGECOUNT': '2.160', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:00:29,294][2409389] DAMAGECOUNT value on done: 3997.0
[2023-02-25 13:00:29,295][2409389] Sum rewards: 8.410, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.500', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.082', 'weapon4': '0.126', 'weapon5': '0.140', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'HITCOUNT': '0.670', 'weapon2': '1.374', 'weapon3': '2.006', 'DAMAGECOUNT': '3.474', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:29,642][2409097] DAMAGECOUNT value on done: 3631.0
[2023-02-25 13:00:29,646][2409097] Sum rewards: 5.089, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.619', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON1': '0.030', 'weapon5': '0.046', 'AMMO4': '0.052', 'AMMO3': '0.061', 'weapon7': '0.064', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.310', 'weapon4': '0.336', 'WEAPON3': '0.400', 'weapon3': '0.970', 'weapon2': '1.088', 'DAMAGECOUNT': '1.347', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:29,727][2409485] DAMAGECOUNT value on done: 2560.0
[2023-02-25 13:00:29,731][2409485] Sum rewards: 3.693, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.266', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.015', 'WEAPON1': '0.080', 'AMMO3': '0.100', 'weapon5': '0.240', 'HITCOUNT': '0.390', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'weapon2': '1.316', 'DAMAGECOUNT': '1.419', 'weapon3': '2.050', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:29,759][2409407] DAMAGECOUNT value on done: 3052.0
[2023-02-25 13:00:29,762][2409407] Sum rewards: 7.128, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.016', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.081', 'AMMO3': '0.085', 'WEAPON4': '0.150', 'weapon5': '0.168', 'WEAPON5': '0.250', 'HITCOUNT': '0.260', 'HEALTH': '0.376', 'WEAPON3': '0.400', 'weapon4': '0.410', 'ARMOR': '0.460', 'DAMAGECOUNT': '1.050', 'weapon2': '1.360', 'weapon3': '1.524', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:29,881][2409373] DAMAGECOUNT value on done: 4108.0
[2023-02-25 13:00:29,884][2409373] Sum rewards: 4.873, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon5': '0.070', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'weapon4': '0.238', 'WEAPON3': '0.350', 'HITCOUNT': '0.500', 'HEALTH': '0.703', 'weapon3': '1.242', 'DAMAGECOUNT': '1.545', 'weapon2': '1.632', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:30,098][2409548] DAMAGECOUNT value on done: 4702.0
[2023-02-25 13:00:30,101][2409548] Sum rewards: 10.834, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.430', 'AMMO2': '0.008', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.040', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'weapon4': '0.224', 'weapon5': '0.312', 'WEAPON5': '0.350', 'ARMOR': '0.483', 'WEAPON3': '0.500', 'HITCOUNT': '0.700', 'weapon2': '1.160', 'weapon3': '1.640', 'DAMAGECOUNT': '2.631', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:00:30,147][2409079] DAMAGECOUNT value on done: 3941.0
[2023-02-25 13:00:30,150][2409079] Sum rewards: 10.630, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.133', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO3': '0.066', 'AMMO4': '0.090', 'weapon7': '0.110', 'weapon5': '0.110', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'ARMOR': '0.432', 'weapon2': '0.480', 'WEAPON3': '0.550', 'HITCOUNT': '0.610', 'weapon4': '0.708', 'weapon3': '1.360', 'DAMAGECOUNT': '2.514', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:00:30,205][2409597] DAMAGECOUNT value on done: 4151.0
[2023-02-25 13:00:30,206][2409597] Sum rewards: 11.199, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.360', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.028', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.090', 'weapon5': '0.148', 'WEAPON5': '0.250', 'weapon4': '0.256', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.750', 'weapon2': '1.166', 'weapon3': '1.680', 'DAMAGECOUNT': '3.333', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:00:30,562][2409406] DAMAGECOUNT value on done: 2140.0
[2023-02-25 13:00:30,565][2409406] Sum rewards: 5.025, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.014', 'AMMO2': '0.023', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO3': '0.072', 'AMMO4': '0.112', 'weapon4': '0.208', 'weapon5': '0.236', 'HITCOUNT': '0.310', 'HEALTH': '0.314', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.215', 'weapon2': '1.366', 'weapon3': '1.584', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:30,575][2409866] DAMAGECOUNT value on done: 2998.0
[2023-02-25 13:00:30,576][2409866] Sum rewards: 5.653, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.102', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'AMMO3': '0.123', 'WEAPON4': '0.200', 'HITCOUNT': '0.440', 'weapon4': '0.464', 'WEAPON3': '0.750', 'ARMOR': '0.854', 'weapon3': '1.284', 'weapon2': '1.402', 'DAMAGECOUNT': '2.160', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:00:30,696][2409077] DAMAGECOUNT value on done: 4475.0
[2023-02-25 13:00:30,697][2409077] Sum rewards: 6.013, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.010', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'HEALTH': '0.090', 'AMMO3': '0.092', 'weapon5': '0.120', 'AMMO4': '0.128', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'HITCOUNT': '0.580', 'ARMOR': '1.656', 'weapon3': '1.736', 'weapon2': '1.952', 'DAMAGECOUNT': '2.043', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:30,996][2409074] Updated weights for policy 0, policy_version 15401 (0.0015)
[2023-02-25 13:00:31,121][2409105] DAMAGECOUNT value on done: 3693.0
[2023-02-25 13:00:31,123][2409105] Sum rewards: 10.617, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.568', 'AMMO5': '0.003', 'AMMO2': '0.018', 'ARMOR': '0.020', 'WEAPON1': '0.040', 'weapon7': '0.050', 'weapon5': '0.052', 'AMMO4': '0.089', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon4': '0.414', 'HITCOUNT': '0.540', 'WEAPON3': '0.650', 'weapon3': '1.356', 'weapon2': '1.572', 'DAMAGECOUNT': '2.781', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:00:31,373][2409075] DAMAGECOUNT value on done: 3005.0
[2023-02-25 13:00:31,376][2409075] Sum rewards: 1.470, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.690', 'AMMO5': '0.020', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'AMMO3': '0.085', 'weapon7': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.121', 'weapon5': '0.148', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'HITCOUNT': '0.350', 'ARMOR': '0.465', 'WEAPON3': '0.550', 'weapon4': '0.608', 'weapon2': '0.900', 'weapon3': '1.168', 'DAMAGECOUNT': '1.215', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:31,407][2409486] DAMAGECOUNT value on done: 3010.0
[2023-02-25 13:00:31,408][2409486] Sum rewards: 5.384, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.744', 'AMMO2': '0.013', 'AMMO5': '0.016', 'WEAPON1': '0.060', 'AMMO4': '0.065', 'weapon5': '0.066', 'AMMO3': '0.121', 'weapon4': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'HITCOUNT': '0.700', 'WEAPON3': '0.850', 'weapon2': '1.100', 'ARMOR': '1.378', 'weapon3': '1.990', 'DAMAGECOUNT': '2.922', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:00:31,690][2409549] DAMAGECOUNT value on done: 4614.0
[2023-02-25 13:00:31,691][2409549] Sum rewards: 10.223, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.457', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO3': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'weapon7': '0.132', 'weapon5': '0.158', 'WEAPON3': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'HITCOUNT': '0.290', 'WEAPON4': '0.350', 'WEAPON7': '0.400', 'weapon4': '0.632', 'weapon3': '0.802', 'ARMOR': '0.852', 'weapon2': '1.094', 'DAMAGECOUNT': '1.746', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:00:31,715][2409100] DAMAGECOUNT value on done: 3137.0
[2023-02-25 13:00:31,725][2409100] Sum rewards: 4.045, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.130', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'ARMOR': '0.020', 'WEAPON1': '0.080', 'AMMO3': '0.113', 'weapon5': '0.118', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.390', 'weapon4': '0.412', 'WEAPON3': '0.800', 'weapon2': '1.466', 'DAMAGECOUNT': '1.521', 'weapon3': '1.708', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:31,888][2409078] DAMAGECOUNT value on done: 3165.0
[2023-02-25 13:00:31,889][2409078] Sum rewards: 0.543, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.291', 'AMMO5': '0.026', 'WEAPON1': '0.030', 'AMMO2': '0.031', 'AMMO3': '0.128', 'AMMO4': '0.155', 'weapon5': '0.184', 'WEAPON4': '0.400', 'ARMOR': '0.428', 'weapon4': '0.620', 'HITCOUNT': '0.630', 'WEAPON5': '0.650', 'WEAPON3': '0.750', 'weapon2': '1.038', 'weapon3': '1.598', 'DAMAGECOUNT': '2.415', 'FRAGCOUNT': '2.500'}
[2023-02-25 13:00:31,978][2409596] DAMAGECOUNT value on done: 4066.0
[2023-02-25 13:00:31,982][2409596] Sum rewards: 3.797, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.047', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon7': '0.018', 'AMMO4': '0.036', 'weapon5': '0.048', 'AMMO3': '0.073', 'WEAPON5': '0.100', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.282', 'ARMOR': '0.400', 'HITCOUNT': '0.440', 'WEAPON3': '0.550', 'weapon3': '1.150', 'DAMAGECOUNT': '1.788', 'weapon2': '1.896', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:32,001][2409104] DAMAGECOUNT value on done: 4035.0
[2023-02-25 13:00:32,002][2409104] Sum rewards: 9.776, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.498', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'ARMOR': '0.040', 'AMMO3': '0.088', 'weapon5': '0.098', 'AMMO4': '0.138', 'WEAPON5': '0.200', 'weapon4': '0.234', 'WEAPON4': '0.250', 'WEAPON3': '0.550', 'HITCOUNT': '0.760', 'weapon3': '1.318', 'weapon2': '1.768', 'DAMAGECOUNT': '2.775', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:00:32,186][2408954] Fps is (10 sec: 24986.2, 60 sec: 25190.4, 300 sec: 25506.3). Total num frames: 63111168. Throughput: 0: 6345.4. Samples: 15784812. Policy #0 lag: (min: 2.0, avg: 11.3, max: 23.0)
[2023-02-25 13:00:32,186][2408954] Avg episode reward: [(0, '5.415')]
[2023-02-25 13:00:32,187][2409033] Saving new best policy, reward=5.415!
[2023-02-25 13:00:32,326][2409469] DAMAGECOUNT value on done: 4948.0
[2023-02-25 13:00:32,329][2409469] Sum rewards: 7.808, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.836', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.066', 'weapon7': '0.066', 'weapon5': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.453', 'HITCOUNT': '0.510', 'weapon4': '0.606', 'weapon3': '1.256', 'weapon2': '1.262', 'DAMAGECOUNT': '1.992', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:32,426][2409355] DAMAGECOUNT value on done: 2751.0
[2023-02-25 13:00:32,429][2409355] Sum rewards: 5.028, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.622', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon5': '0.030', 'AMMO3': '0.062', 'AMMO4': '0.102', 'weapon7': '0.162', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.280', 'WEAPON7': '0.300', 'WEAPON3': '0.500', 'weapon4': '0.678', 'weapon3': '1.282', 'DAMAGECOUNT': '1.347', 'ARMOR': '1.360', 'weapon2': '1.554', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:32,489][2409405] DAMAGECOUNT value on done: 3913.0
[2023-02-25 13:00:32,489][2409405] Sum rewards: 4.529, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.063', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.030', 'weapon5': '0.060', 'AMMO3': '0.096', 'AMMO4': '0.148', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.344', 'WEAPON3': '0.550', 'HITCOUNT': '0.740', 'ARMOR': '0.832', 'weapon3': '1.430', 'weapon2': '1.496', 'DAMAGECOUNT': '2.796', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:32,590][2409102] DAMAGECOUNT value on done: 2788.0
[2023-02-25 13:00:32,630][2409103] DAMAGECOUNT value on done: 4115.0
[2023-02-25 13:00:32,632][2409103] Sum rewards: 11.451, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.860', 'ARMOR': '0.005', 'AMMO2': '0.006', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.032', 'weapon7': '0.050', 'AMMO3': '0.095', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.254', 'WEAPON5': '0.350', 'weapon4': '0.412', 'WEAPON3': '0.600', 'HITCOUNT': '0.680', 'weapon2': '0.866', 'weapon3': '1.992', 'DAMAGECOUNT': '3.336', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:00:32,665][2409565] DAMAGECOUNT value on done: 2576.0
[2023-02-25 13:00:32,666][2409565] Sum rewards: 5.557, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.010', 'AMMO2': '0.015', 'HEALTH': '0.040', 'WEAPON1': '0.040', 'AMMO3': '0.044', 'WEAPON4': '0.050', 'weapon7': '0.070', 'AMMO4': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.134', 'HITCOUNT': '0.190', 'WEAPON5': '0.200', 'weapon4': '0.234', 'WEAPON3': '0.300', 'weapon3': '0.996', 'DAMAGECOUNT': '1.362', 'weapon2': '1.496', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:32,697][2409074] Updated weights for policy 0, policy_version 15411 (0.0014)
[2023-02-25 13:00:32,730][2409101] DAMAGECOUNT value on done: 3581.0
[2023-02-25 13:00:32,733][2409101] Sum rewards: 1.747, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.434', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO2': '0.045', 'AMMO3': '0.050', 'weapon5': '0.172', 'AMMO4': '0.224', 'WEAPON5': '0.300', 'HITCOUNT': '0.370', 'WEAPON3': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.764', 'weapon4': '0.792', 'ARMOR': '0.844', 'weapon3': '1.234', 'DAMAGECOUNT': '1.683', 'FRAGCOUNT': '2.500'}
[2023-02-25 13:00:32,913][2409389] DAMAGECOUNT value on done: 2333.0
[2023-02-25 13:00:32,914][2409389] Sum rewards: -1.686, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.086', 'AMMO2': '0.010', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.047', 'AMMO3': '0.069', 'weapon5': '0.116', 'HITCOUNT': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'FRAGCOUNT': '0.500', 'weapon4': '0.650', 'DAMAGECOUNT': '0.747', 'weapon3': '0.864', 'weapon2': '1.334', 'ARMOR': '1.381'}
[2023-02-25 13:00:33,270][2409076] DAMAGECOUNT value on done: 3409.0
[2023-02-25 13:00:33,271][2409076] Sum rewards: 3.292, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.835', 'AMMO4': '-0.038', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO3': '0.050', 'weapon5': '0.106', 'WEAPON5': '0.150', 'HITCOUNT': '0.400', 'WEAPON3': '0.400', 'ARMOR': '0.441', 'weapon3': '1.116', 'DAMAGECOUNT': '1.386', 'weapon2': '1.858', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:33,466][2409096] DAMAGECOUNT value on done: 3705.0
[2023-02-25 13:00:33,462][2409485] DAMAGECOUNT value on done: 3719.0
[2023-02-25 13:00:33,468][2409485] Sum rewards: 11.112, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.700', 'AMMO5': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'AMMO3': '0.075', 'AMMO4': '0.086', 'weapon4': '0.104', 'WEAPON4': '0.200', 'weapon5': '0.222', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'HITCOUNT': '0.530', 'ARMOR': '1.308', 'weapon3': '1.316', 'weapon2': '1.812', 'DAMAGECOUNT': '3.249', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:00:33,470][2409096] Sum rewards: 5.997, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.512', 'AMMO2': '0.006', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'weapon5': '0.070', 'AMMO3': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.406', 'ARMOR': '0.455', 'HITCOUNT': '0.710', 'WEAPON3': '0.800', 'weapon2': '1.082', 'weapon3': '2.018', 'DAMAGECOUNT': '2.535', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:00:33,505][2409407] DAMAGECOUNT value on done: 3886.0
[2023-02-25 13:00:33,508][2409407] Sum rewards: 4.908, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.166', 'AMMO2': '0.006', 'AMMO5': '0.013', 'WEAPON1': '0.030', 'AMMO4': '0.031', 'AMMO3': '0.056', 'weapon7': '0.058', 'weapon5': '0.058', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.190', 'WEAPON7': '0.200', 'weapon4': '0.234', 'WEAPON3': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.453', 'weapon2': '1.002', 'weapon3': '1.012', 'DAMAGECOUNT': '1.641', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:33,914][2409079] DAMAGECOUNT value on done: 3036.0
[2023-02-25 13:00:33,915][2409079] Sum rewards: 8.818, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.424', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.015', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon5': '0.070', 'weapon4': '0.096', 'WEAPON5': '0.100', 'WEAPON3': '0.400', 'ARMOR': '0.514', 'HITCOUNT': '0.540', 'weapon3': '1.300', 'weapon2': '1.812', 'DAMAGECOUNT': '1.989', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:33,919][2409548] DAMAGECOUNT value on done: 3085.0
[2023-02-25 13:00:33,920][2409548] Sum rewards: 3.268, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.812', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon5': '0.058', 'AMMO3': '0.087', 'weapon4': '0.088', 'AMMO4': '0.106', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.570', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'weapon3': '1.354', 'weapon2': '1.528', 'DAMAGECOUNT': '2.040', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:33,953][2409373] DAMAGECOUNT value on done: 4040.0
[2023-02-25 13:00:33,957][2409373] Sum rewards: 5.105, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.574', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.035', 'weapon5': '0.060', 'AMMO3': '0.063', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'weapon4': '0.450', 'HITCOUNT': '0.460', 'ARMOR': '0.541', 'weapon3': '1.272', 'weapon2': '1.500', 'DAMAGECOUNT': '1.968', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:34,018][2409406] DAMAGECOUNT value on done: 3816.0
[2023-02-25 13:00:34,019][2409406] Sum rewards: 10.446, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.056', 'AMMO2': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'AMMO3': '0.098', 'weapon5': '0.140', 'weapon4': '0.224', 'WEAPON5': '0.250', 'WEAPON3': '0.650', 'HITCOUNT': '0.750', 'ARMOR': '0.800', 'weapon3': '1.394', 'weapon2': '1.692', 'DAMAGECOUNT': '3.387', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:00:34,142][2409097] DAMAGECOUNT value on done: 3071.0
[2023-02-25 13:00:34,145][2409097] Sum rewards: 8.262, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.903', 'AMMO2': '0.005', 'AMMO5': '0.022', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'WEAPON1': '0.050', 'AMMO3': '0.092', 'weapon5': '0.152', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'HITCOUNT': '0.730', 'ARMOR': '1.257', 'weapon3': '1.550', 'weapon2': '1.738', 'DAMAGECOUNT': '2.745', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:00:34,153][2409077] DAMAGECOUNT value on done: 4089.0
[2023-02-25 13:00:34,156][2409077] Sum rewards: 5.223, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.111', 'AMMO5': '0.009', 'AMMO2': '0.025', 'AMMO3': '0.047', 'weapon5': '0.080', 'AMMO4': '0.124', 'weapon7': '0.178', 'WEAPON5': '0.250', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON3': '0.350', 'HITCOUNT': '0.390', 'ARMOR': '0.404', 'WEAPON4': '0.450', 'WEAPON7': '0.500', 'weapon2': '0.640', 'weapon3': '0.848', 'weapon4': '0.920', 'DAMAGECOUNT': '1.689', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:34,207][2409866] DAMAGECOUNT value on done: 2756.0
[2023-02-25 13:00:34,209][2409866] Sum rewards: 3.135, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.650', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.015', 'weapon4': '0.040', 'WEAPON1': '0.050', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon5': '0.234', 'HITCOUNT': '0.360', 'WEAPON5': '0.450', 'ARMOR': '0.458', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.305', 'weapon3': '1.572', 'weapon2': '1.660', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:34,354][2409597] DAMAGECOUNT value on done: 3110.0
[2023-02-25 13:00:34,354][2409597] Sum rewards: 5.772, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.168', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon7': '0.048', 'AMMO3': '0.056', 'weapon5': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'WEAPON4': '0.350', 'HITCOUNT': '0.530', 'weapon4': '0.766', 'ARMOR': '0.901', 'weapon3': '0.954', 'weapon2': '1.020', 'DAMAGECOUNT': '2.073', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:34,483][2409074] Updated weights for policy 0, policy_version 15421 (0.0012)
[2023-02-25 13:00:35,092][2409075] DAMAGECOUNT value on done: 3127.0
[2023-02-25 13:00:35,093][2409075] Sum rewards: 8.632, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.030', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.149', 'WEAPON4': '0.250', 'HEALTH': '0.250', 'weapon4': '0.312', 'WEAPON3': '0.350', 'ARMOR': '0.476', 'HITCOUNT': '0.580', 'weapon3': '1.372', 'weapon2': '1.762', 'DAMAGECOUNT': '1.935', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:00:35,261][2409105] DAMAGECOUNT value on done: 3425.0
[2023-02-25 13:00:35,262][2409105] Sum rewards: 4.481, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.418', 'AMMO2': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.048', 'weapon7': '0.050', 'weapon5': '0.064', 'AMMO3': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.560', 'HITCOUNT': '0.580', 'WEAPON3': '0.650', 'weapon3': '0.976', 'ARMOR': '1.429', 'weapon2': '1.504', 'DAMAGECOUNT': '2.529', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:35,290][2409549] DAMAGECOUNT value on done: 2470.0
[2023-02-25 13:00:35,294][2409549] Sum rewards: -0.189, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.210', 'AMMO2': '0.008', 'AMMO5': '0.020', 'AMMO4': '0.039', 'WEAPON1': '0.040', 'weapon5': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'HITCOUNT': '0.340', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'ARMOR': '0.873', 'DAMAGECOUNT': '1.005', 'weapon2': '1.592', 'weapon3': '1.812', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:35,345][2409486] DAMAGECOUNT value on done: 2864.0
[2023-02-25 13:00:35,348][2409486] Sum rewards: 4.672, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.944', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'weapon4': '0.050', 'weapon5': '0.060', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.300', 'HITCOUNT': '0.460', 'WEAPON3': '0.600', 'ARMOR': '0.856', 'weapon3': '1.612', 'DAMAGECOUNT': '1.662', 'weapon2': '2.010', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:35,369][2409100] DAMAGECOUNT value on done: 3904.0
[2023-02-25 13:00:35,370][2409100] Sum rewards: 3.693, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.094', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'AMMO3': '0.072', 'AMMO4': '0.073', 'weapon5': '0.098', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.360', 'ARMOR': '0.408', 'WEAPON3': '0.500', 'HITCOUNT': '0.560', 'weapon3': '1.490', 'weapon2': '1.542', 'DAMAGECOUNT': '1.872', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:35,788][2409074] Updated weights for policy 0, policy_version 15431 (0.0012)
[2023-02-25 13:00:35,915][2409596] DAMAGECOUNT value on done: 3664.0
[2023-02-25 13:00:35,918][2409596] Sum rewards: 7.033, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.321', 'AMMO2': '0.001', 'AMMO4': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'weapon7': '0.056', 'AMMO3': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.152', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'HITCOUNT': '0.560', 'ARMOR': '0.855', 'weapon3': '1.532', 'weapon2': '1.920', 'DAMAGECOUNT': '2.022', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:35,942][2409104] DAMAGECOUNT value on done: 3192.0
[2023-02-25 13:00:35,943][2409104] Sum rewards: 2.177, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO3': '0.035', 'weapon5': '0.044', 'weapon7': '0.066', 'HEALTH': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.123', 'WEAPON3': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.210', 'weapon3': '0.358', 'weapon4': '0.374', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.630', 'weapon2': '1.568', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:36,123][2409355] DAMAGECOUNT value on done: 3914.0
[2023-02-25 13:00:36,124][2409355] Sum rewards: -1.549, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.620', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.082', 'AMMO3': '0.120', 'weapon5': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'HITCOUNT': '0.540', 'weapon4': '0.582', 'WEAPON3': '0.800', 'weapon2': '1.258', 'weapon3': '1.362', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.232'}
[2023-02-25 13:00:36,133][2409102] DAMAGECOUNT value on done: 3579.0
[2023-02-25 13:00:36,136][2409102] Sum rewards: -1.660, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.459', 'AMMO5': '0.019', 'AMMO2': '0.033', 'WEAPON1': '0.040', 'weapon7': '0.066', 'AMMO3': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.163', 'weapon5': '0.188', 'WEAPON7': '0.200', 'HITCOUNT': '0.230', 'WEAPON4': '0.300', 'weapon4': '0.302', 'WEAPON5': '0.400', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.807', 'ARMOR': '1.328', 'weapon2': '1.492', 'weapon3': '1.580'}
[2023-02-25 13:00:36,239][2409565] DAMAGECOUNT value on done: 3199.0
[2023-02-25 13:00:36,240][2409565] Sum rewards: 6.696, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.236', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'weapon4': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.088', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.126', 'WEAPON5': '0.350', 'HITCOUNT': '0.500', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'weapon2': '1.722', 'weapon3': '1.788', 'DAMAGECOUNT': '2.688', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:00:36,254][2409078] DAMAGECOUNT value on done: 3625.0
[2023-02-25 13:00:36,257][2409078] Sum rewards: 6.463, reward structure: {'DEATHCOUNT': '-4.500', 'weapon7': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON1': '0.050', 'HEALTH': '0.076', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.196', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.200', 'HITCOUNT': '0.360', 'WEAPON3': '0.400', 'ARMOR': '0.454', 'weapon2': '1.210', 'DAMAGECOUNT': '1.470', 'weapon3': '1.550', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:36,349][2409103] DAMAGECOUNT value on done: 3608.0
[2023-02-25 13:00:36,366][2409101] DAMAGECOUNT value on done: 3880.0
[2023-02-25 13:00:36,369][2409101] Sum rewards: 5.196, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.702', 'AMMO5': '0.020', 'AMMO2': '0.021', 'weapon5': '0.028', 'weapon4': '0.042', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.150', 'WEAPON5': '0.400', 'HITCOUNT': '0.660', 'WEAPON3': '0.900', 'weapon2': '1.396', 'weapon3': '2.076', 'DAMAGECOUNT': '2.700', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:00:36,619][2409405] DAMAGECOUNT value on done: 3790.0
[2023-02-25 13:00:36,620][2409405] Sum rewards: 5.981, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.318', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO3': '0.076', 'weapon5': '0.114', 'AMMO4': '0.157', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.480', 'weapon4': '0.548', 'ARMOR': '0.922', 'weapon2': '1.126', 'weapon3': '1.326', 'DAMAGECOUNT': '3.045', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:36,854][2409389] DAMAGECOUNT value on done: 3481.0
[2023-02-25 13:00:36,857][2409389] Sum rewards: 6.130, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.314', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.081', 'weapon4': '0.154', 'weapon5': '0.158', 'WEAPON5': '0.350', 'HITCOUNT': '0.590', 'WEAPON3': '0.600', 'ARMOR': '0.857', 'weapon3': '1.482', 'weapon2': '1.766', 'DAMAGECOUNT': '2.793', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:36,946][2409469] DAMAGECOUNT value on done: 4711.0
[2023-02-25 13:00:36,949][2409469] Sum rewards: 10.880, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.602', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.060', 'AMMO3': '0.080', 'weapon5': '0.118', 'WEAPON4': '0.200', 'weapon4': '0.248', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.670', 'ARMOR': '0.887', 'weapon3': '1.434', 'weapon2': '1.860', 'DAMAGECOUNT': '3.531', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:00:37,143][2409074] Updated weights for policy 0, policy_version 15441 (0.0012)
[2023-02-25 13:00:37,186][2408954] Fps is (10 sec: 27033.7, 60 sec: 25668.3, 300 sec: 25603.5). Total num frames: 63250432. Throughput: 0: 6330.4. Samples: 15803256. Policy #0 lag: (min: 2.0, avg: 11.3, max: 23.0)
[2023-02-25 13:00:37,186][2408954] Avg episode reward: [(0, '5.459')]
[2023-02-25 13:00:37,191][2409033] Saving new best policy, reward=5.459!
[2023-02-25 13:00:37,250][2409076] DAMAGECOUNT value on done: 3895.0
[2023-02-25 13:00:37,251][2409076] Sum rewards: 6.928, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.224', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO2': '0.029', 'AMMO3': '0.144', 'AMMO4': '0.147', 'weapon5': '0.186', 'WEAPON4': '0.200', 'weapon4': '0.314', 'WEAPON5': '0.500', 'HITCOUNT': '0.700', 'WEAPON3': '0.900', 'weapon2': '1.352', 'weapon3': '1.778', 'ARMOR': '1.789', 'DAMAGECOUNT': '2.571', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:00:37,292][2409485] DAMAGECOUNT value on done: 3085.0
[2023-02-25 13:00:37,292][2409485] Sum rewards: 3.715, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.466', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'weapon7': '0.068', 'AMMO3': '0.071', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'weapon5': '0.228', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.460', 'weapon4': '0.462', 'weapon3': '0.982', 'ARMOR': '1.292', 'weapon2': '1.832', 'DAMAGECOUNT': '2.193', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:37,359][2409407] DAMAGECOUNT value on done: 3532.0
[2023-02-25 13:00:37,362][2409407] Sum rewards: 0.167, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.924', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'AMMO2': '0.046', 'weapon7': '0.094', 'AMMO3': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.156', 'AMMO4': '0.230', 'WEAPON5': '0.350', 'HITCOUNT': '0.570', 'WEAPON4': '0.600', 'WEAPON3': '0.650', 'weapon4': '0.784', 'weapon2': '0.790', 'ARMOR': '0.973', 'weapon3': '1.620', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.271'}
[2023-02-25 13:00:37,539][2409548] DAMAGECOUNT value on done: 3750.0
[2023-02-25 13:00:37,540][2409548] Sum rewards: 1.200, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.464', 'AMMO5': '0.012', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'weapon7': '0.072', 'AMMO3': '0.079', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.105', 'weapon5': '0.144', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'ARMOR': '0.424', 'HITCOUNT': '0.430', 'WEAPON3': '0.450', 'weapon4': '0.672', 'weapon2': '1.118', 'weapon3': '1.352', 'DAMAGECOUNT': '1.854', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:37,727][2409406] DAMAGECOUNT value on done: 2641.0
[2023-02-25 13:00:37,730][2409406] Sum rewards: 6.363, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.928', 'AMMO2': '0.011', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'weapon4': '0.178', 'weapon5': '0.288', 'HITCOUNT': '0.380', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'ARMOR': '1.304', 'weapon2': '1.472', 'weapon3': '1.576', 'DAMAGECOUNT': '1.950', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:37,784][2409866] DAMAGECOUNT value on done: 2965.0
[2023-02-25 13:00:37,786][2409866] Sum rewards: 2.029, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.595', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'AMMO3': '0.042', 'AMMO4': '0.097', 'weapon7': '0.136', 'HITCOUNT': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.300', 'WEAPON4': '0.300', 'WEAPON7': '0.400', 'weapon4': '0.416', 'ARMOR': '0.446', 'DAMAGECOUNT': '0.675', 'weapon3': '0.764', 'FRAGCOUNT': '1.000', 'weapon2': '1.088'}
[2023-02-25 13:00:37,790][2409079] DAMAGECOUNT value on done: 2593.0
[2023-02-25 13:00:37,793][2409079] Sum rewards: 4.282, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.776', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.025', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon5': '0.072', 'AMMO3': '0.117', 'WEAPON5': '0.150', 'weapon4': '0.250', 'HITCOUNT': '0.440', 'WEAPON3': '0.650', 'ARMOR': '0.870', 'weapon3': '1.492', 'weapon2': '1.804', 'DAMAGECOUNT': '1.845', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:37,856][2409077] DAMAGECOUNT value on done: 3201.0
[2023-02-25 13:00:37,860][2409077] Sum rewards: 6.610, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.066', 'AMMO4': '0.089', 'HEALTH': '0.094', 'AMMO3': '0.097', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.500', 'weapon4': '0.572', 'WEAPON3': '0.650', 'ARMOR': '0.863', 'weapon2': '1.214', 'weapon3': '1.760', 'DAMAGECOUNT': '2.229', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:37,896][2409597] DAMAGECOUNT value on done: 4234.0
[2023-02-25 13:00:37,899][2409597] Sum rewards: 3.038, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.480', 'AMMO2': '0.014', 'AMMO5': '0.015', 'WEAPON1': '0.050', 'AMMO4': '0.070', 'AMMO3': '0.134', 'weapon5': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.420', 'HITCOUNT': '0.460', 'WEAPON3': '0.850', 'weapon3': '1.332', 'weapon2': '1.390', 'DAMAGECOUNT': '2.391', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:37,909][2409373] DAMAGECOUNT value on done: 3303.0
[2023-02-25 13:00:37,912][2409373] Sum rewards: 7.681, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.017', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'weapon5': '0.052', 'weapon7': '0.068', 'weapon4': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'HEALTH': '0.114', 'AMMO4': '0.114', 'WEAPON5': '0.350', 'HITCOUNT': '0.490', 'WEAPON3': '0.650', 'ARMOR': '1.200', 'weapon3': '1.676', 'weapon2': '1.744', 'DAMAGECOUNT': '2.055', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:37,973][2409096] DAMAGECOUNT value on done: 3951.0
[2023-02-25 13:00:37,976][2409096] Sum rewards: 11.799, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.260', 'AMMO2': '0.015', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'weapon4': '0.058', 'weapon7': '0.066', 'AMMO3': '0.068', 'AMMO4': '0.073', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.244', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'HITCOUNT': '0.460', 'ARMOR': '0.800', 'weapon3': '1.158', 'weapon2': '1.754', 'DAMAGECOUNT': '3.108', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:00:38,032][2409097] DAMAGECOUNT value on done: 3318.0
[2023-02-25 13:00:38,033][2409097] Sum rewards: 6.216, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.902', 'AMMO5': '0.014', 'AMMO2': '0.027', 'WEAPON1': '0.040', 'AMMO3': '0.075', 'weapon5': '0.126', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.350', 'ARMOR': '0.404', 'weapon4': '0.478', 'HITCOUNT': '0.530', 'WEAPON3': '0.600', 'weapon2': '0.964', 'weapon3': '1.396', 'DAMAGECOUNT': '2.082', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:38,915][2409549] DAMAGECOUNT value on done: 3750.0
[2023-02-25 13:00:38,916][2409549] Sum rewards: 3.855, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.862', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'weapon7': '0.054', 'weapon5': '0.072', 'AMMO3': '0.075', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.336', 'HITCOUNT': '0.360', 'WEAPON3': '0.600', 'ARMOR': '0.937', 'weapon3': '1.158', 'weapon2': '1.604', 'DAMAGECOUNT': '1.659', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:38,996][2409105] DAMAGECOUNT value on done: 2724.0
[2023-02-25 13:00:39,000][2409105] Sum rewards: -2.732, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.060', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'weapon5': '0.116', 'AMMO3': '0.139', 'WEAPON5': '0.150', 'HITCOUNT': '0.260', 'weapon4': '0.278', 'ARMOR': '0.436', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.906', 'FRAGCOUNT': '1.000', 'weapon2': '1.328', 'weapon3': '1.636'}
[2023-02-25 13:00:39,192][2409074] Updated weights for policy 0, policy_version 15451 (0.0012)
[2023-02-25 13:00:39,212][2409075] DAMAGECOUNT value on done: 3854.0
[2023-02-25 13:00:39,213][2409075] Sum rewards: 4.189, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'AMMO2': '0.012', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.059', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon7': '0.102', 'HITCOUNT': '0.150', 'HEALTH': '0.156', 'WEAPON3': '0.300', 'weapon4': '0.336', 'ARMOR': '0.463', 'weapon2': '0.758', 'weapon3': '0.962', 'DAMAGECOUNT': '1.089', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:39,392][2409486] DAMAGECOUNT value on done: 3642.0
[2023-02-25 13:00:39,392][2409486] Sum rewards: 5.867, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.408', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.030', 'AMMO3': '0.064', 'weapon7': '0.110', 'AMMO4': '0.148', 'weapon5': '0.268', 'WEAPON5': '0.300', 'weapon4': '0.392', 'WEAPON4': '0.400', 'HITCOUNT': '0.440', 'WEAPON3': '0.450', 'ARMOR': '0.484', 'AMMO6': '0.520', 'AMMO7': '0.520', 'WEAPON7': '0.600', 'weapon3': '1.254', 'weapon2': '1.284', 'DAMAGECOUNT': '2.484', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:39,568][2409596] DAMAGECOUNT value on done: 2978.0
[2023-02-25 13:00:39,572][2409596] Sum rewards: 5.807, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.422', 'AMMO2': '0.003', 'AMMO4': '0.013', 'WEAPON4': '0.050', 'AMMO3': '0.056', 'weapon4': '0.176', 'WEAPON3': '0.450', 'ARMOR': '0.495', 'HITCOUNT': '0.540', 'weapon3': '0.906', 'weapon2': '1.408', 'DAMAGECOUNT': '1.632', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:39,597][2409104] DAMAGECOUNT value on done: 2882.0
[2023-02-25 13:00:39,598][2409104] Sum rewards: 4.094, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.104', 'AMMO5': '0.015', 'weapon7': '0.020', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.107', 'HITCOUNT': '0.170', 'weapon5': '0.262', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.396', 'DAMAGECOUNT': '0.792', 'ARMOR': '0.828', 'weapon2': '0.924', 'weapon3': '0.972', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:39,791][2409355] DAMAGECOUNT value on done: 3933.0
[2023-02-25 13:00:39,795][2409355] Sum rewards: 9.207, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.290', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon7': '0.026', 'weapon5': '0.058', 'AMMO4': '0.096', 'AMMO3': '0.104', 'WEAPON5': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'HITCOUNT': '0.520', 'weapon4': '0.524', 'WEAPON3': '0.700', 'ARMOR': '1.300', 'weapon3': '1.418', 'weapon2': '1.520', 'DAMAGECOUNT': '1.911', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:00:40,011][2409102] DAMAGECOUNT value on done: 3498.0
[2023-02-25 13:00:40,014][2409102] Sum rewards: 5.481, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.028', 'ARMOR': '0.004', 'AMMO2': '0.018', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.062', 'AMMO4': '0.088', 'AMMO3': '0.127', 'weapon4': '0.142', 'WEAPON5': '0.300', 'HITCOUNT': '0.780', 'WEAPON3': '0.800', 'weapon2': '1.550', 'weapon3': '1.676', 'DAMAGECOUNT': '2.373', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:40,067][2409101] DAMAGECOUNT value on done: 3736.0
[2023-02-25 13:00:40,068][2409101] Sum rewards: 4.978, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.152', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.056', 'weapon4': '0.058', 'weapon5': '0.072', 'weapon7': '0.114', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HITCOUNT': '0.330', 'WEAPON3': '0.450', 'ARMOR': '0.874', 'weapon3': '1.116', 'DAMAGECOUNT': '1.779', 'weapon2': '1.780', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:40,184][2409565] DAMAGECOUNT value on done: 3901.0
[2023-02-25 13:00:40,185][2409565] Sum rewards: 1.632, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.656', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'weapon7': '0.050', 'AMMO3': '0.074', 'weapon5': '0.084', 'AMMO4': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.318', 'HITCOUNT': '0.410', 'WEAPON3': '0.500', 'ARMOR': '0.854', 'weapon3': '0.952', 'weapon2': '1.268', 'DAMAGECOUNT': '1.542', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:40,238][2409078] DAMAGECOUNT value on done: 3585.0
[2023-02-25 13:00:40,238][2409078] Sum rewards: 1.670, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.004', 'AMMO2': '0.009', 'AMMO5': '0.011', 'weapon7': '0.032', 'WEAPON1': '0.040', 'AMMO4': '0.045', 'AMMO3': '0.107', 'weapon5': '0.130', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.328', 'ARMOR': '0.440', 'HITCOUNT': '0.490', 'WEAPON3': '0.750', 'weapon2': '1.144', 'DAMAGECOUNT': '1.737', 'weapon3': '2.010', 'FRAGCOUNT': '2.500'}
[2023-02-25 13:00:40,548][2409405] DAMAGECOUNT value on done: 3390.0
[2023-02-25 13:00:40,551][2409405] Sum rewards: 2.159, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.712', 'AMMO2': '0.009', 'AMMO5': '0.011', 'WEAPON1': '0.040', 'AMMO4': '0.043', 'AMMO3': '0.050', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.456', 'HITCOUNT': '0.480', 'weapon3': '1.028', 'ARMOR': '1.204', 'DAMAGECOUNT': '1.392', 'FRAGCOUNT': '2.000', 'weapon2': '2.012'}
[2023-02-25 13:00:40,557][2409469] DAMAGECOUNT value on done: 4230.0
[2023-02-25 13:00:40,557][2409469] Sum rewards: 7.508, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.854', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.080', 'weapon4': '0.218', 'weapon5': '0.230', 'WEAPON5': '0.350', 'HITCOUNT': '0.400', 'WEAPON3': '0.500', 'ARMOR': '0.508', 'weapon3': '1.290', 'weapon2': '1.750', 'DAMAGECOUNT': '2.391', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:40,639][2409389] DAMAGECOUNT value on done: 4591.0
[2023-02-25 13:00:40,645][2409389] Sum rewards: 0.848, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.708', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.013', 'WEAPON1': '0.040', 'AMMO3': '0.071', 'WEAPON4': '0.100', 'weapon4': '0.142', 'WEAPON5': '0.200', 'HITCOUNT': '0.400', 'WEAPON3': '0.550', 'ARMOR': '0.872', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.299', 'weapon3': '1.574', 'weapon2': '2.032'}
[2023-02-25 13:00:40,719][2409074] Updated weights for policy 0, policy_version 15461 (0.0012)
[2023-02-25 13:00:40,944][2409076] DAMAGECOUNT value on done: 4079.0
[2023-02-25 13:00:40,945][2409076] Sum rewards: 8.835, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.591', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.050', 'weapon7': '0.052', 'weapon5': '0.062', 'AMMO4': '0.073', 'AMMO3': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.670', 'weapon2': '1.208', 'weapon3': '1.642', 'DAMAGECOUNT': '2.532', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:00:41,080][2409100] Large shaping reward 2.592 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('weapon5', 0.002)]
[2023-02-25 13:00:41,221][2409407] DAMAGECOUNT value on done: 3797.0
[2023-02-25 13:00:41,224][2409407] Sum rewards: 1.589, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.094', 'AMMO5': '0.014', 'WEAPON1': '0.040', 'AMMO2': '0.044', 'AMMO3': '0.070', 'weapon7': '0.074', 'weapon5': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.200', 'AMMO4': '0.220', 'HITCOUNT': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.424', 'WEAPON3': '0.500', 'weapon4': '0.722', 'DAMAGECOUNT': '0.924', 'weapon2': '1.062', 'weapon3': '1.198', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:41,365][2409099] DAMAGECOUNT value on done: 3483.0
[2023-02-25 13:00:41,369][2409099] Sum rewards: 7.130, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.644', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'weapon7': '0.012', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.085', 'weapon4': '0.096', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.104', 'WEAPON5': '0.150', 'WEAPON3': '0.550', 'HITCOUNT': '0.620', 'ARMOR': '0.955', 'weapon3': '1.448', 'weapon2': '2.108', 'DAMAGECOUNT': '2.775', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:41,387][2409548] DAMAGECOUNT value on done: 3126.0
[2023-02-25 13:00:41,388][2409548] Sum rewards: 1.806, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.170', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon5': '0.036', 'AMMO3': '0.041', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.126', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.300', 'weapon4': '0.356', 'DAMAGECOUNT': '0.723', 'FRAGCOUNT': '1.000', 'weapon3': '1.016', 'weapon2': '1.206'}
[2023-02-25 13:00:41,473][2409866] DAMAGECOUNT value on done: 3636.0
[2023-02-25 13:00:41,477][2409866] Sum rewards: 4.590, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon7': '0.046', 'AMMO3': '0.063', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'weapon5': '0.202', 'HEALTH': '0.354', 'WEAPON3': '0.400', 'HITCOUNT': '0.400', 'ARMOR': '0.800', 'weapon3': '1.186', 'DAMAGECOUNT': '1.893', 'weapon2': '2.140', 'FRAGCOUNT': '2.500'}
[2023-02-25 13:00:41,574][2409485] DAMAGECOUNT value on done: 3171.0
[2023-02-25 13:00:41,574][2409485] Sum rewards: 2.965, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon5': '0.060', 'AMMO4': '0.080', 'AMMO3': '0.120', 'weapon4': '0.122', 'WEAPON5': '0.250', 'HITCOUNT': '0.360', 'ARMOR': '0.486', 'WEAPON3': '0.600', 'HEALTH': '0.965', 'DAMAGECOUNT': '1.239', 'weapon3': '1.520', 'weapon2': '1.554', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:41,611][2409096] DAMAGECOUNT value on done: 4097.0
[2023-02-25 13:00:41,614][2409096] Sum rewards: 2.625, reward structure: {'DEATHCOUNT': '-3.750', 'FRAGCOUNT': '0.000', 'AMMO5': '0.012', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.062', 'AMMO4': '0.103', 'weapon5': '0.200', 'weapon4': '0.224', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'HITCOUNT': '0.360', 'HEALTH': '0.389', 'weapon2': '0.818', 'weapon3': '1.600', 'DAMAGECOUNT': '1.905'}
[2023-02-25 13:00:41,619][2409597] DAMAGECOUNT value on done: 3486.0
[2023-02-25 13:00:41,620][2409597] Sum rewards: 0.531, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.044', 'AMMO2': '0.009', 'AMMO5': '0.016', 'AMMO4': '0.044', 'AMMO3': '0.062', 'WEAPON4': '0.150', 'HITCOUNT': '0.230', 'weapon5': '0.286', 'weapon4': '0.302', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'weapon3': '0.734', 'DAMAGECOUNT': '1.095', 'weapon2': '1.226', 'ARMOR': '1.421', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:41,645][2409355] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:00:41,718][2409373] DAMAGECOUNT value on done: 3430.0
[2023-02-25 13:00:41,721][2409373] Sum rewards: 2.719, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.318', 'AMMO5': '0.011', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.058', 'weapon7': '0.066', 'weapon5': '0.078', 'AMMO3': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.232', 'WEAPON5': '0.250', 'ARMOR': '0.466', 'HITCOUNT': '0.500', 'weapon2': '0.722', 'WEAPON3': '0.800', 'weapon3': '1.290', 'DAMAGECOUNT': '1.827', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:00:41,815][2409079] DAMAGECOUNT value on done: 3720.0
[2023-02-25 13:00:41,816][2409079] Sum rewards: 10.288, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'AMMO4': '0.124', 'ARMOR': '0.400', 'weapon4': '0.400', 'WEAPON3': '0.500', 'HEALTH': '0.513', 'HITCOUNT': '0.690', 'weapon2': '1.188', 'weapon3': '1.834', 'DAMAGECOUNT': '2.595', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:00:42,053][2409097] DAMAGECOUNT value on done: 2832.0
[2023-02-25 13:00:42,057][2409097] Sum rewards: 5.165, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'HEALTH': '0.032', 'WEAPON5': '0.050', 'weapon7': '0.068', 'AMMO3': '0.080', 'AMMO4': '0.091', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.320', 'ARMOR': '0.428', 'HITCOUNT': '0.430', 'WEAPON3': '0.450', 'weapon3': '1.022', 'DAMAGECOUNT': '1.395', 'weapon2': '2.168', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:42,161][2409406] DAMAGECOUNT value on done: 3543.0
[2023-02-25 13:00:42,163][2409406] Sum rewards: 4.014, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.912', 'AMMO2': '0.006', 'AMMO5': '0.009', 'AMMO4': '0.027', 'WEAPON1': '0.040', 'weapon7': '0.052', 'AMMO3': '0.056', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.130', 'WEAPON7': '0.200', 'HITCOUNT': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'weapon4': '0.434', 'ARMOR': '0.929', 'weapon3': '1.150', 'DAMAGECOUNT': '1.290', 'weapon2': '1.492', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:42,186][2408954] Fps is (10 sec: 25395.2, 60 sec: 25395.2, 300 sec: 25547.9). Total num frames: 63365120. Throughput: 0: 6333.1. Samples: 15841476. Policy #0 lag: (min: 0.0, avg: 12.2, max: 24.0)
[2023-02-25 13:00:42,186][2408954] Avg episode reward: [(0, '5.269')]
[2023-02-25 13:00:42,283][2409077] DAMAGECOUNT value on done: 4588.0
[2023-02-25 13:00:42,284][2409077] Sum rewards: 4.632, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.274', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO3': '0.074', 'AMMO4': '0.104', 'weapon5': '0.140', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.370', 'WEAPON3': '0.500', 'HITCOUNT': '0.500', 'ARMOR': '0.504', 'weapon2': '1.234', 'weapon3': '1.268', 'DAMAGECOUNT': '2.718', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:42,384][2409074] Updated weights for policy 0, policy_version 15471 (0.0012)
[2023-02-25 13:00:42,567][2409105] DAMAGECOUNT value on done: 3836.0
[2023-02-25 13:00:42,568][2409105] Sum rewards: 4.193, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.430', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'weapon5': '0.054', 'AMMO4': '0.078', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'weapon4': '0.280', 'WEAPON4': '0.300', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'weapon3': '1.322', 'weapon2': '1.714', 'DAMAGECOUNT': '1.842', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:42,630][2409549] DAMAGECOUNT value on done: 4754.0
[2023-02-25 13:00:42,631][2409549] Sum rewards: 8.906, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.328', 'AMMO5': '0.008', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.050', 'weapon5': '0.120', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'WEAPON4': '0.450', 'HITCOUNT': '0.780', 'ARMOR': '0.848', 'weapon4': '0.852', 'weapon2': '1.084', 'weapon3': '1.100', 'DAMAGECOUNT': '3.987', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:00:42,946][2409486] DAMAGECOUNT value on done: 3953.0
[2023-02-25 13:00:42,948][2409486] Sum rewards: 10.824, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.866', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon7': '0.050', 'AMMO3': '0.069', 'weapon5': '0.074', 'AMMO4': '0.085', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.650', 'HITCOUNT': '0.750', 'weapon3': '1.142', 'weapon2': '1.186', 'DAMAGECOUNT': '3.210', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:00:43,263][2409104] DAMAGECOUNT value on done: 2930.0
[2023-02-25 13:00:43,264][2409104] Sum rewards: 0.680, reward structure: {'DEATHCOUNT': '-3.750', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.279', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'WEAPON1': '0.030', 'AMMO3': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.052', 'weapon7': '0.066', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.244', 'WEAPON3': '0.300', 'ARMOR': '0.432', 'DAMAGECOUNT': '0.882', 'weapon3': '1.002', 'weapon2': '1.492'}
[2023-02-25 13:00:43,275][2409596] DAMAGECOUNT value on done: 4075.0
[2023-02-25 13:00:43,278][2409596] Sum rewards: 11.899, reward structure: {'DEATHCOUNT': '-6.750', 'weapon7': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'AMMO3': '0.072', 'AMMO4': '0.130', 'weapon5': '0.154', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.296', 'HEALTH': '0.438', 'WEAPON3': '0.450', 'HITCOUNT': '0.500', 'ARMOR': '0.884', 'weapon3': '1.476', 'weapon2': '1.682', 'DAMAGECOUNT': '2.445', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:00:43,322][2409075] DAMAGECOUNT value on done: 3411.0
[2023-02-25 13:00:43,330][2409075] Sum rewards: 6.345, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.744', 'AMMO2': '0.013', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.101', 'weapon5': '0.170', 'weapon4': '0.170', 'WEAPON5': '0.400', 'HITCOUNT': '0.620', 'WEAPON3': '0.650', 'ARMOR': '0.817', 'weapon2': '1.342', 'weapon3': '1.654', 'DAMAGECOUNT': '2.496', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:43,390][2409355] DAMAGECOUNT value on done: 3714.0
[2023-02-25 13:00:43,393][2409355] Sum rewards: 6.866, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.594', 'AMMO5': '0.005', 'AMMO2': '0.024', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'weapon5': '0.104', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'weapon4': '0.222', 'ARMOR': '0.400', 'HITCOUNT': '0.500', 'WEAPON3': '0.600', 'weapon3': '1.612', 'weapon2': '1.728', 'DAMAGECOUNT': '2.547', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:43,740][2409078] DAMAGECOUNT value on done: 3061.0
[2023-02-25 13:00:43,741][2409078] Sum rewards: 4.511, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.015', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon4': '0.072', 'AMMO4': '0.098', 'weapon5': '0.168', 'HITCOUNT': '0.250', 'HEALTH': '0.331', 'WEAPON5': '0.350', 'WEAPON3': '0.350', 'ARMOR': '0.862', 'DAMAGECOUNT': '1.305', 'weapon3': '1.448', 'weapon2': '2.112', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:43,769][2409102] DAMAGECOUNT value on done: 3051.0
[2023-02-25 13:00:43,769][2409102] Sum rewards: 6.509, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.344', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon7': '0.066', 'weapon5': '0.104', 'AMMO3': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.322', 'HITCOUNT': '0.410', 'WEAPON3': '0.650', 'weapon2': '1.308', 'weapon3': '1.718', 'DAMAGECOUNT': '1.740', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:00:43,834][2409101] DAMAGECOUNT value on done: 4290.0
[2023-02-25 13:00:43,835][2409101] Sum rewards: 6.988, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.013', 'AMMO5': '0.015', 'WEAPON4': '0.050', 'WEAPON1': '0.050', 'weapon5': '0.050', 'weapon4': '0.058', 'AMMO4': '0.063', 'AMMO3': '0.102', 'WEAPON5': '0.300', 'HEALTH': '0.450', 'HITCOUNT': '0.540', 'WEAPON3': '0.600', 'weapon2': '1.376', 'weapon3': '1.632', 'DAMAGECOUNT': '2.439', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:43,911][2409565] DAMAGECOUNT value on done: 2915.0
[2023-02-25 13:00:43,911][2409565] Sum rewards: 0.600, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.172', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'weapon7': '0.052', 'weapon5': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'WEAPON3': '0.300', 'weapon4': '0.354', 'DAMAGECOUNT': '0.546', 'weapon3': '0.734', 'ARMOR': '0.849', 'FRAGCOUNT': '1.000', 'weapon2': '1.988'}
[2023-02-25 13:00:44,036][2409405] DAMAGECOUNT value on done: 3178.0
[2023-02-25 13:00:44,041][2409405] Sum rewards: 1.533, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.352', 'AMMO5': '0.012', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'ARMOR': '0.036', 'AMMO4': '0.067', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon5': '0.156', 'HITCOUNT': '0.280', 'WEAPON5': '0.350', 'weapon4': '0.472', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.550', 'weapon2': '0.868', 'DAMAGECOUNT': '1.266', 'weapon3': '1.614'}
[2023-02-25 13:00:44,086][2409074] Updated weights for policy 0, policy_version 15481 (0.0012)
[2023-02-25 13:00:44,376][2409469] DAMAGECOUNT value on done: 2449.0
[2023-02-25 13:00:44,377][2409469] Sum rewards: 0.236, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.566', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.064', 'AMMO4': '0.092', 'weapon5': '0.094', 'weapon7': '0.132', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'weapon4': '0.556', 'weapon2': '0.716', 'weapon3': '0.918', 'DAMAGECOUNT': '1.281', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:44,750][2409389] DAMAGECOUNT value on done: 2605.0
[2023-02-25 13:00:44,750][2409389] Sum rewards: 4.912, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.792', 'AMMO2': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.027', 'weapon7': '0.062', 'AMMO3': '0.078', 'weapon5': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.308', 'ARMOR': '0.449', 'HITCOUNT': '0.500', 'WEAPON3': '0.550', 'weapon2': '1.474', 'weapon3': '1.584', 'DAMAGECOUNT': '1.938', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:44,840][2409076] DAMAGECOUNT value on done: 3341.0
[2023-02-25 13:00:44,841][2409076] Sum rewards: 8.813, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.011', 'AMMO2': '0.006', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.031', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.116', 'weapon4': '0.118', 'WEAPON5': '0.200', 'HITCOUNT': '0.310', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'weapon3': '1.216', 'DAMAGECOUNT': '1.827', 'weapon2': '1.830', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:45,000][2409099] DAMAGECOUNT value on done: 3617.0
[2023-02-25 13:00:45,004][2409099] Sum rewards: 5.248, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.906', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.027', 'weapon5': '0.048', 'AMMO3': '0.103', 'WEAPON4': '0.150', 'weapon4': '0.180', 'WEAPON5': '0.200', 'ARMOR': '0.484', 'HITCOUNT': '0.540', 'WEAPON3': '0.850', 'weapon2': '1.606', 'weapon3': '1.790', 'DAMAGECOUNT': '2.142', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:45,299][2409407] DAMAGECOUNT value on done: 3296.0
[2023-02-25 13:00:45,304][2409597] DAMAGECOUNT value on done: 2280.0
[2023-02-25 13:00:45,332][2409866] DAMAGECOUNT value on done: 3433.0
[2023-02-25 13:00:45,333][2409866] Sum rewards: 3.904, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.815', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO5': '0.027', 'AMMO4': '0.053', 'AMMO3': '0.067', 'WEAPON4': '0.100', 'weapon5': '0.132', 'weapon4': '0.234', 'HITCOUNT': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'weapon3': '1.048', 'weapon2': '1.438', 'DAMAGECOUNT': '1.671', 'ARMOR': '1.718', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:45,374][2409373] DAMAGECOUNT value on done: 4330.0
[2023-02-25 13:00:45,375][2409373] Sum rewards: 9.558, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.835', 'AMMO5': '0.012', 'AMMO2': '0.013', 'weapon7': '0.014', 'WEAPON1': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.147', 'weapon5': '0.166', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.348', 'HITCOUNT': '0.680', 'WEAPON3': '0.850', 'weapon2': '1.176', 'weapon3': '1.824', 'DAMAGECOUNT': '2.499', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:00:45,435][2409074] Updated weights for policy 0, policy_version 15491 (0.0013)
[2023-02-25 13:00:45,510][2409096] DAMAGECOUNT value on done: 3538.0
[2023-02-25 13:00:45,511][2409096] Sum rewards: 6.514, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'weapon5': '0.054', 'AMMO3': '0.070', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'weapon4': '0.216', 'WEAPON3': '0.350', 'ARMOR': '0.416', 'HITCOUNT': '0.610', 'weapon3': '1.314', 'HEALTH': '1.322', 'weapon2': '1.618', 'DAMAGECOUNT': '1.920', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:45,729][2409485] DAMAGECOUNT value on done: 3552.0
[2023-02-25 13:00:45,732][2409485] Sum rewards: 5.029, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.674', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.045', 'AMMO3': '0.074', 'weapon5': '0.126', 'HITCOUNT': '0.220', 'AMMO4': '0.223', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.266', 'WEAPON3': '0.500', 'ARMOR': '0.800', 'weapon3': '0.882', 'weapon2': '1.442', 'DAMAGECOUNT': '1.605', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:45,790][2409548] DAMAGECOUNT value on done: 3854.0
[2023-02-25 13:00:45,791][2409548] Sum rewards: 7.949, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.886', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO2': '0.033', 'weapon7': '0.052', 'AMMO3': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.140', 'AMMO4': '0.166', 'WEAPON7': '0.200', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '0.650', 'weapon4': '0.676', 'HITCOUNT': '0.700', 'weapon3': '1.286', 'ARMOR': '1.366', 'weapon2': '1.498', 'DAMAGECOUNT': '3.396', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:00:45,856][2409079] DAMAGECOUNT value on done: 3999.0
[2023-02-25 13:00:45,857][2409079] Sum rewards: 3.443, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.580', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO2': '0.042', 'weapon5': '0.104', 'AMMO3': '0.109', 'WEAPON5': '0.200', 'AMMO4': '0.210', 'WEAPON4': '0.400', 'HITCOUNT': '0.430', 'weapon4': '0.580', 'WEAPON3': '0.650', 'ARMOR': '0.828', 'weapon2': '1.246', 'weapon3': '1.478', 'DAMAGECOUNT': '1.695', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:46,054][2409406] DAMAGECOUNT value on done: 3954.0
[2023-02-25 13:00:46,055][2409406] Sum rewards: 4.647, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.618', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.074', 'AMMO4': '0.084', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'HITCOUNT': '0.380', 'weapon4': '0.404', 'ARMOR': '0.520', 'WEAPON3': '0.600', 'weapon3': '1.376', 'weapon2': '1.408', 'DAMAGECOUNT': '1.677', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:46,125][2409097] DAMAGECOUNT value on done: 3085.0
[2023-02-25 13:00:46,126][2409097] Sum rewards: 10.015, reward structure: {'DEATHCOUNT': '-6.750', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.090', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon7': '0.122', 'weapon5': '0.178', 'HEALTH': '0.246', 'WEAPON5': '0.250', 'HITCOUNT': '0.400', 'WEAPON3': '0.500', 'ARMOR': '1.200', 'weapon2': '1.510', 'weapon3': '1.742', 'DAMAGECOUNT': '3.135', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:00:46,166][2409077] DAMAGECOUNT value on done: 3398.0
[2023-02-25 13:00:46,167][2409077] Sum rewards: 3.948, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.003', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.014', 'ARMOR': '0.040', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.050', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.142', 'HEALTH': '0.164', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.480', 'weapon3': '1.230', 'DAMAGECOUNT': '1.716', 'FRAGCOUNT': '2.000', 'weapon2': '2.294'}
[2023-02-25 13:00:46,271][2409105] DAMAGECOUNT value on done: 3883.0
[2023-02-25 13:00:46,274][2409105] Sum rewards: -3.144, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.481', 'FRAGCOUNT': '0.000', 'AMMO5': '0.020', 'AMMO2': '0.029', 'WEAPON1': '0.040', 'AMMO3': '0.143', 'AMMO4': '0.146', 'weapon5': '0.156', 'WEAPON4': '0.250', 'weapon4': '0.308', 'WEAPON5': '0.400', 'ARMOR': '0.491', 'HITCOUNT': '0.610', 'weapon2': '0.690', 'WEAPON3': '0.850', 'weapon3': '2.162', 'DAMAGECOUNT': '2.292'}
[2023-02-25 13:00:46,410][2409549] DAMAGECOUNT value on done: 3683.0
[2023-02-25 13:00:46,413][2409549] Sum rewards: 5.688, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.222', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon7': '0.070', 'AMMO3': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.126', 'AMMO4': '0.155', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.460', 'WEAPON3': '0.600', 'HITCOUNT': '0.750', 'weapon2': '0.776', 'weapon3': '1.896', 'DAMAGECOUNT': '2.748', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:46,523][2409547] DAMAGECOUNT value on done: 2774.0
[2023-02-25 13:00:46,535][2409547] Sum rewards: 5.272, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.320', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'weapon7': '0.066', 'AMMO3': '0.072', 'AMMO4': '0.082', 'weapon5': '0.118', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO6': '0.260', 'AMMO7': '0.260', 'WEAPON7': '0.300', 'HITCOUNT': '0.320', 'WEAPON3': '0.450', 'ARMOR': '0.486', 'weapon4': '0.528', 'weapon2': '0.530', 'DAMAGECOUNT': '1.170', 'weapon3': '1.268', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:46,878][2409486] DAMAGECOUNT value on done: 4266.0
[2023-02-25 13:00:46,882][2409486] Sum rewards: 14.201, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.235', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.053', 'AMMO4': '0.116', 'WEAPON4': '0.250', 'weapon5': '0.308', 'WEAPON3': '0.400', 'weapon4': '0.458', 'WEAPON5': '0.500', 'HITCOUNT': '0.540', 'weapon2': '0.922', 'weapon3': '1.158', 'DAMAGECOUNT': '4.167', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:00:46,940][2409104] DAMAGECOUNT value on done: 3189.0
[2023-02-25 13:00:46,941][2409596] DAMAGECOUNT value on done: 2896.0
[2023-02-25 13:00:46,943][2409104] Sum rewards: 11.217, reward structure: {'DEATHCOUNT': '-6.000', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'HEALTH': '0.020', 'AMMO2': '0.030', 'AMMO3': '0.072', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.152', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'weapon4': '0.358', 'ARMOR': '0.457', 'HITCOUNT': '0.710', 'weapon2': '0.792', 'weapon3': '1.724', 'DAMAGECOUNT': '2.679', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:00:46,944][2409596] Sum rewards: 5.600, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.715', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'AMMO2': '0.030', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'AMMO4': '0.151', 'WEAPON4': '0.250', 'ARMOR': '0.471', 'HITCOUNT': '0.570', 'weapon4': '0.576', 'WEAPON3': '0.600', 'weapon2': '1.214', 'DAMAGECOUNT': '1.557', 'weapon3': '1.674', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:46,973][2409074] Updated weights for policy 0, policy_version 15501 (0.0013)
[2023-02-25 13:00:47,186][2408954] Fps is (10 sec: 24166.4, 60 sec: 25395.3, 300 sec: 25534.0). Total num frames: 63492096. Throughput: 0: 6338.2. Samples: 15879732. Policy #0 lag: (min: 0.0, avg: 12.2, max: 24.0)
[2023-02-25 13:00:47,186][2408954] Avg episode reward: [(0, '4.983')]
[2023-02-25 13:00:47,224][2409355] DAMAGECOUNT value on done: 4111.0
[2023-02-25 13:00:47,225][2409355] Sum rewards: 9.775, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.060', 'weapon5': '0.096', 'AMMO4': '0.122', 'WEAPON4': '0.200', 'weapon4': '0.240', 'WEAPON5': '0.250', 'HEALTH': '0.359', 'WEAPON3': '0.400', 'HITCOUNT': '0.520', 'weapon3': '1.198', 'ARMOR': '1.200', 'weapon2': '1.946', 'DAMAGECOUNT': '2.130', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:00:47,402][2409075] DAMAGECOUNT value on done: 3575.0
[2023-02-25 13:00:47,403][2409075] Sum rewards: 3.224, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.131', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.077', 'weapon5': '0.092', 'weapon4': '0.246', 'HITCOUNT': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'ARMOR': '0.901', 'DAMAGECOUNT': '1.071', 'weapon3': '1.354', 'weapon2': '1.660', 'FRAGCOUNT': '2.500'}
[2023-02-25 13:00:47,410][2409078] DAMAGECOUNT value on done: 3634.0
[2023-02-25 13:00:47,413][2409078] Sum rewards: 4.057, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.124', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.076', 'weapon5': '0.094', 'WEAPON5': '0.150', 'HITCOUNT': '0.440', 'ARMOR': '0.458', 'WEAPON3': '0.600', 'weapon3': '1.556', 'weapon2': '2.006', 'DAMAGECOUNT': '2.067', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:47,587][2409102] DAMAGECOUNT value on done: 3710.0
[2023-02-25 13:00:47,590][2409102] Sum rewards: 3.219, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.580', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.015', 'WEAPON1': '0.060', 'weapon5': '0.064', 'AMMO3': '0.119', 'WEAPON5': '0.300', 'ARMOR': '0.457', 'HITCOUNT': '0.700', 'WEAPON3': '0.850', 'weapon2': '1.506', 'weapon3': '1.820', 'DAMAGECOUNT': '2.406', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:47,697][2409405] DAMAGECOUNT value on done: 3882.0
[2023-02-25 13:00:47,699][2409405] Sum rewards: 5.798, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.410', 'AMMO5': '0.008', 'AMMO2': '0.013', 'weapon5': '0.030', 'weapon7': '0.050', 'AMMO3': '0.054', 'AMMO4': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'ARMOR': '0.472', 'weapon4': '0.520', 'HITCOUNT': '0.570', 'weapon3': '0.924', 'DAMAGECOUNT': '1.713', 'weapon2': '1.748', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:47,755][2409101] DAMAGECOUNT value on done: 4320.0
[2023-02-25 13:00:47,755][2409101] Sum rewards: 8.150, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.726', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO3': '0.050', 'AMMO4': '0.054', 'WEAPON4': '0.250', 'weapon5': '0.270', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.402', 'HITCOUNT': '0.470', 'weapon2': '0.950', 'weapon3': '1.036', 'ARMOR': '1.338', 'DAMAGECOUNT': '2.838', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:47,839][2409565] DAMAGECOUNT value on done: 3260.0
[2023-02-25 13:00:47,842][2409565] Sum rewards: 4.343, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.012', 'AMMO2': '0.021', 'ARMOR': '0.036', 'WEAPON1': '0.040', 'AMMO3': '0.062', 'AMMO4': '0.103', 'HEALTH': '0.137', 'weapon5': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'HITCOUNT': '0.380', 'weapon4': '0.444', 'weapon3': '0.980', 'DAMAGECOUNT': '1.290', 'weapon2': '1.444', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:48,152][2409469] DAMAGECOUNT value on done: 3219.0
[2023-02-25 13:00:48,153][2409469] Sum rewards: 6.685, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.702', 'AMMO2': '0.012', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.062', 'AMMO3': '0.099', 'WEAPON4': '0.300', 'weapon5': '0.330', 'weapon2': '0.360', 'weapon4': '0.368', 'ARMOR': '0.432', 'HITCOUNT': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'weapon3': '1.922', 'DAMAGECOUNT': '2.112', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:00:48,434][2409076] DAMAGECOUNT value on done: 2463.0
[2023-02-25 13:00:48,435][2409076] Sum rewards: -3.519, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.464', 'AMMO5': '0.010', 'weapon5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'AMMO3': '0.089', 'weapon7': '0.162', 'AMMO4': '0.166', 'HITCOUNT': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'weapon4': '0.526', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'DAMAGECOUNT': '0.942', 'weapon3': '1.214', 'weapon2': '1.228', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:48,804][2409389] DAMAGECOUNT value on done: 3714.0
[2023-02-25 13:00:48,805][2409389] Sum rewards: 9.121, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.158', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.058', 'AMMO4': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.140', 'weapon4': '0.248', 'HITCOUNT': '0.270', 'WEAPON3': '0.400', 'ARMOR': '0.452', 'DAMAGECOUNT': '1.182', 'weapon3': '1.280', 'weapon2': '1.392', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:00:48,833][2409074] Updated weights for policy 0, policy_version 15511 (0.0012)
[2023-02-25 13:00:48,895][2409099] DAMAGECOUNT value on done: 3871.0
[2023-02-25 13:00:48,896][2409099] Sum rewards: 5.620, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.034', 'AMMO3': '0.060', 'weapon7': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.240', 'HEALTH': '0.336', 'WEAPON3': '0.350', 'ARMOR': '0.448', 'weapon3': '1.280', 'DAMAGECOUNT': '1.395', 'weapon2': '2.110', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:48,908][2409866] DAMAGECOUNT value on done: 4461.0
[2023-02-25 13:00:48,911][2409866] Sum rewards: 10.062, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'weapon5': '0.072', 'AMMO3': '0.090', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'HEALTH': '0.155', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.466', 'HITCOUNT': '0.590', 'weapon2': '1.238', 'weapon3': '1.542', 'DAMAGECOUNT': '2.523', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:00:48,922][2409597] DAMAGECOUNT value on done: 3233.0
[2023-02-25 13:00:48,925][2409597] Sum rewards: 3.533, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'AMMO4': '0.157', 'weapon5': '0.178', 'WEAPON5': '0.250', 'weapon4': '0.326', 'HITCOUNT': '0.400', 'ARMOR': '0.416', 'WEAPON3': '0.450', 'HEALTH': '0.500', 'weapon2': '1.322', 'weapon3': '1.440', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.602'}
[2023-02-25 13:00:48,955][2409373] DAMAGECOUNT value on done: 4619.0
[2023-02-25 13:00:48,957][2409373] Sum rewards: 6.783, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.315', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'AMMO3': '0.073', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.177', 'WEAPON4': '0.300', 'ARMOR': '0.436', 'weapon4': '0.444', 'WEAPON3': '0.500', 'HITCOUNT': '0.660', 'weapon2': '1.308', 'weapon3': '1.570', 'DAMAGECOUNT': '2.394', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:49,184][2409407] DAMAGECOUNT value on done: 3283.0
[2023-02-25 13:00:49,187][2409407] Sum rewards: 3.209, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO3': '0.030', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.168', 'WEAPON3': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.300', 'weapon4': '0.406', 'HEALTH': '0.424', 'weapon3': '0.838', 'DAMAGECOUNT': '0.942', 'FRAGCOUNT': '1.000', 'weapon2': '1.004'}
[2023-02-25 13:00:49,269][2409096] DAMAGECOUNT value on done: 3179.0
[2023-02-25 13:00:49,269][2409096] Sum rewards: 6.161, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.686', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon5': '0.034', 'AMMO4': '0.078', 'AMMO3': '0.093', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.396', 'ARMOR': '0.485', 'HITCOUNT': '0.620', 'WEAPON3': '0.650', 'weapon2': '1.560', 'weapon3': '1.740', 'DAMAGECOUNT': '2.265', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:49,510][2409485] DAMAGECOUNT value on done: 3779.0
[2023-02-25 13:00:49,511][2409485] Sum rewards: 1.713, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.486', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon5': '0.070', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.115', 'AMMO4': '0.125', 'WEAPON5': '0.300', 'HITCOUNT': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '0.650', 'weapon4': '0.710', 'ARMOR': '0.838', 'weapon2': '1.080', 'weapon3': '1.148', 'DAMAGECOUNT': '1.605', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:49,828][2409079] DAMAGECOUNT value on done: 3504.0
[2023-02-25 13:00:49,832][2409079] Sum rewards: 5.273, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.851', 'AMMO2': '0.000', 'AMMO4': '0.001', 'weapon5': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.262', 'ARMOR': '0.440', 'WEAPON3': '0.550', 'HITCOUNT': '0.630', 'weapon3': '1.324', 'weapon2': '1.610', 'DAMAGECOUNT': '2.196', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:49,913][2409105] DAMAGECOUNT value on done: 3669.0
[2023-02-25 13:00:49,916][2409105] Sum rewards: 4.167, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.390', 'AMMO5': '0.005', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'AMMO3': '0.060', 'AMMO4': '0.080', 'weapon5': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.228', 'WEAPON3': '0.400', 'ARMOR': '0.400', 'HITCOUNT': '0.410', 'DAMAGECOUNT': '1.200', 'weapon3': '1.326', 'weapon2': '1.988', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:50,130][2409097] DAMAGECOUNT value on done: 2989.0
[2023-02-25 13:00:50,134][2409097] Sum rewards: 5.349, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.935', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.036', 'ARMOR': '0.040', 'weapon7': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.370', 'weapon4': '0.446', 'WEAPON3': '0.450', 'weapon2': '0.666', 'weapon3': '1.192', 'DAMAGECOUNT': '1.755', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:50,148][2409548] DAMAGECOUNT value on done: 3935.0
[2023-02-25 13:00:50,149][2409548] Sum rewards: -0.496, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.686', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.050', 'AMMO4': '0.063', 'weapon5': '0.084', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'WEAPON5': '0.200', 'HITCOUNT': '0.510', 'WEAPON3': '0.650', 'ARMOR': '0.900', 'weapon2': '1.230', 'weapon3': '1.524', 'DAMAGECOUNT': '1.665', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:50,449][2409486] DAMAGECOUNT value on done: 3436.0
[2023-02-25 13:00:50,450][2409486] Sum rewards: 5.138, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.465', 'AMMO5': '0.012', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'AMMO3': '0.062', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'weapon5': '0.176', 'weapon4': '0.208', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'HITCOUNT': '0.450', 'ARMOR': '0.890', 'weapon3': '1.218', 'DAMAGECOUNT': '1.665', 'weapon2': '1.912', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:50,484][2409547] DAMAGECOUNT value on done: 4005.0
[2023-02-25 13:00:50,488][2409547] Sum rewards: 8.865, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.696', 'AMMO2': '0.014', 'AMMO5': '0.015', 'WEAPON1': '0.070', 'weapon4': '0.070', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'weapon5': '0.182', 'WEAPON5': '0.450', 'HITCOUNT': '0.500', 'WEAPON3': '0.750', 'ARMOR': '0.800', 'weapon2': '1.032', 'weapon3': '2.298', 'DAMAGECOUNT': '2.340', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:00:50,543][2409406] DAMAGECOUNT value on done: 2808.0
[2023-02-25 13:00:50,543][2409406] Sum rewards: 1.296, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.848', 'AMMO2': '0.001', 'AMMO4': '0.005', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO3': '0.031', 'weapon5': '0.036', 'weapon7': '0.134', 'WEAPON3': '0.200', 'HITCOUNT': '0.200', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'weapon2': '0.308', 'weapon3': '0.370', 'WEAPON7': '0.400', 'ARMOR': '0.466', 'weapon4': '0.480', 'DAMAGECOUNT': '1.062', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:50,613][2409596] DAMAGECOUNT value on done: 3134.0
[2023-02-25 13:00:50,616][2409596] Sum rewards: 4.790, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.492', 'AMMO2': '0.012', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'weapon7': '0.048', 'weapon5': '0.048', 'AMMO4': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.124', 'weapon4': '0.186', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '0.750', 'weapon2': '1.392', 'weapon3': '1.474', 'DAMAGECOUNT': '2.751', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:50,633][2409104] DAMAGECOUNT value on done: 3073.0
[2023-02-25 13:00:50,634][2409104] Sum rewards: 1.098, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.386', 'AMMO5': '0.017', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO3': '0.134', 'weapon5': '0.140', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.590', 'WEAPON3': '0.900', 'weapon2': '1.318', 'DAMAGECOUNT': '1.950', 'weapon3': '2.082', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:50,650][2409074] Updated weights for policy 0, policy_version 15521 (0.0012)
[2023-02-25 13:00:50,670][2409077] DAMAGECOUNT value on done: 3343.0
[2023-02-25 13:00:50,671][2409077] Sum rewards: 1.044, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.322', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.029', 'WEAPON1': '0.030', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'weapon5': '0.192', 'weapon4': '0.250', 'HITCOUNT': '0.360', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'ARMOR': '0.900', 'weapon3': '1.186', 'DAMAGECOUNT': '1.197', 'weapon2': '1.538', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:50,786][2409355] DAMAGECOUNT value on done: 3733.0
[2023-02-25 13:00:50,786][2409355] Sum rewards: 3.227, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.594', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.050', 'AMMO4': '0.080', 'AMMO3': '0.085', 'WEAPON4': '0.150', 'weapon5': '0.168', 'WEAPON5': '0.300', 'HITCOUNT': '0.330', 'weapon4': '0.400', 'ARMOR': '0.471', 'WEAPON3': '0.600', 'weapon3': '1.084', 'DAMAGECOUNT': '1.230', 'weapon2': '1.846', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:50,915][2409075] DAMAGECOUNT value on done: 3627.0
[2023-02-25 13:00:50,916][2409075] Sum rewards: 4.995, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'AMMO3': '0.086', 'weapon7': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'weapon5': '0.172', 'HEALTH': '0.196', 'WEAPON4': '0.200', 'HITCOUNT': '0.430', 'WEAPON3': '0.450', 'weapon4': '0.494', 'weapon2': '1.046', 'weapon3': '1.302', 'DAMAGECOUNT': '1.869', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:51,780][2409074] Updated weights for policy 0, policy_version 15531 (0.0013)
[2023-02-25 13:00:51,794][2409469] DAMAGECOUNT value on done: 4245.0
[2023-02-25 13:00:51,795][2409469] Sum rewards: 5.215, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.704', 'AMMO2': '0.022', 'AMMO5': '0.023', 'WEAPON1': '0.030', 'weapon5': '0.074', 'WEAPON4': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.125', 'weapon7': '0.126', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'weapon4': '0.332', 'WEAPON5': '0.500', 'HITCOUNT': '0.690', 'WEAPON3': '0.850', 'weapon2': '1.012', 'ARMOR': '1.344', 'weapon3': '2.016', 'DAMAGECOUNT': '2.466', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:00:51,838][2409101] DAMAGECOUNT value on done: 2853.0
[2023-02-25 13:00:51,841][2409101] Sum rewards: 7.175, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon5': '0.066', 'AMMO3': '0.068', 'AMMO4': '0.109', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.144', 'WEAPON4': '0.150', 'HEALTH': '0.174', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.270', 'weapon4': '0.326', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'weapon2': '1.242', 'weapon3': '1.334', 'DAMAGECOUNT': '1.560', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:51,843][2409102] DAMAGECOUNT value on done: 3997.0
[2023-02-25 13:00:51,846][2409102] Sum rewards: 2.691, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.474', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon7': '0.048', 'AMMO3': '0.068', 'weapon5': '0.104', 'AMMO4': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.126', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.410', 'ARMOR': '0.480', 'WEAPON3': '0.500', 'weapon3': '1.230', 'weapon2': '1.580', 'DAMAGECOUNT': '1.620', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:51,990][2409078] DAMAGECOUNT value on done: 3272.0
[2023-02-25 13:00:51,993][2409078] Sum rewards: 2.448, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.918', 'AMMO2': '0.008', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'weapon5': '0.124', 'AMMO3': '0.128', 'WEAPON5': '0.350', 'HITCOUNT': '0.380', 'WEAPON3': '0.750', 'ARMOR': '1.246', 'weapon3': '1.368', 'DAMAGECOUNT': '1.635', 'weapon2': '1.744', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:52,048][2409565] DAMAGECOUNT value on done: 4632.0
[2023-02-25 13:00:52,050][2409565] Sum rewards: 10.764, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.669', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'weapon7': '0.056', 'AMMO3': '0.070', 'weapon5': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.488', 'WEAPON3': '0.600', 'HITCOUNT': '0.670', 'weapon2': '1.660', 'weapon3': '1.770', 'DAMAGECOUNT': '3.711', 'FRAGCOUNT': '8.500'}
[2023-02-25 13:00:52,113][2409076] DAMAGECOUNT value on done: 3914.0
[2023-02-25 13:00:52,114][2409076] Sum rewards: 4.765, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.903', 'AMMO2': '0.009', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.043', 'AMMO3': '0.060', 'weapon5': '0.066', 'weapon4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'HITCOUNT': '0.570', 'weapon3': '1.354', 'weapon2': '1.940', 'DAMAGECOUNT': '2.331', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:52,177][2409373] Large shaping reward 2.588 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.588, 196.0), ('HEALTH', -0.03, -10.0), ('ARMOR', -0.002, -2.0), ('weapon5', 0.002)]
[2023-02-25 13:00:52,186][2408954] Fps is (10 sec: 25804.8, 60 sec: 25395.3, 300 sec: 25547.9). Total num frames: 63623168. Throughput: 0: 6344.5. Samples: 15898572. Policy #0 lag: (min: 0.0, avg: 12.2, max: 24.0)
[2023-02-25 13:00:52,187][2408954] Avg episode reward: [(0, '4.979')]
[2023-02-25 13:00:52,255][2409405] DAMAGECOUNT value on done: 3567.0
[2023-02-25 13:00:52,258][2409405] Sum rewards: 0.800, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.815', 'AMMO5': '0.015', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'weapon5': '0.086', 'AMMO4': '0.122', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.314', 'HITCOUNT': '0.340', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.071', 'weapon2': '1.288', 'ARMOR': '1.308', 'weapon3': '1.970', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:52,317][2409389] DAMAGECOUNT value on done: 3451.0
[2023-02-25 13:00:52,320][2409389] Sum rewards: 5.941, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.998', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.015', 'WEAPON1': '0.020', 'weapon4': '0.056', 'AMMO3': '0.057', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.420', 'WEAPON3': '0.450', 'weapon3': '1.050', 'ARMOR': '1.307', 'DAMAGECOUNT': '1.572', 'weapon2': '2.104', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:52,511][2409099] DAMAGECOUNT value on done: 3742.0
[2023-02-25 13:00:52,514][2409099] Sum rewards: 15.933, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.009', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.030', 'AMMO3': '0.040', 'WEAPON4': '0.050', 'weapon7': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.134', 'WEAPON5': '0.150', 'weapon4': '0.220', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.920', 'weapon3': '0.960', 'weapon2': '1.608', 'DAMAGECOUNT': '3.978', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:00:52,520][2409597] DAMAGECOUNT value on done: 4322.0
[2023-02-25 13:00:52,520][2409597] Sum rewards: 3.733, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.016', 'AMMO5': '0.018', 'weapon4': '0.024', 'AMMO2': '0.031', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'AMMO4': '0.154', 'weapon5': '0.266', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.530', 'WEAPON3': '0.650', 'weapon2': '1.458', 'weapon3': '1.858', 'DAMAGECOUNT': '2.205', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:52,565][2409866] DAMAGECOUNT value on done: 3872.0
[2023-02-25 13:00:52,569][2409866] Sum rewards: 7.434, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.003', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'HEALTH': '0.021', 'AMMO4': '0.045', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.107', 'WEAPON4': '0.200', 'weapon4': '0.436', 'ARMOR': '0.476', 'HITCOUNT': '0.630', 'WEAPON3': '0.650', 'weapon2': '1.046', 'weapon3': '1.496', 'DAMAGECOUNT': '2.205', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:00:52,613][2409373] DAMAGECOUNT value on done: 5236.0
[2023-02-25 13:00:52,616][2409373] Sum rewards: 10.321, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.410', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.041', 'weapon7': '0.066', 'weapon5': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'AMMO4': '0.203', 'WEAPON4': '0.250', 'ARMOR': '0.424', 'weapon4': '0.528', 'WEAPON3': '0.650', 'HITCOUNT': '0.710', 'weapon2': '0.988', 'weapon3': '1.656', 'DAMAGECOUNT': '3.102', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:00:52,904][2409407] DAMAGECOUNT value on done: 3140.0
[2023-02-25 13:00:52,908][2409407] Sum rewards: 6.442, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.138', 'AMMO5': '0.028', 'AMMO2': '0.030', 'weapon5': '0.068', 'AMMO3': '0.085', 'AMMO4': '0.148', 'ARMOR': '0.452', 'HITCOUNT': '0.480', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon2': '0.652', 'weapon4': '1.110', 'weapon3': '1.208', 'DAMAGECOUNT': '2.220', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:00:53,166][2409096] DAMAGECOUNT value on done: 3539.0
[2023-02-25 13:00:53,167][2409096] Sum rewards: 6.904, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.490', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.012', 'weapon7': '0.050', 'AMMO3': '0.061', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.148', 'weapon4': '0.230', 'HITCOUNT': '0.370', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'weapon3': '0.906', 'weapon2': '1.156', 'DAMAGECOUNT': '2.013', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:53,327][2409485] DAMAGECOUNT value on done: 4149.0
[2023-02-25 13:00:53,330][2409485] Sum rewards: 8.824, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.906', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.024', 'AMMO3': '0.114', 'AMMO4': '0.120', 'weapon5': '0.218', 'weapon4': '0.242', 'WEAPON4': '0.300', 'ARMOR': '0.487', 'WEAPON5': '0.500', 'HITCOUNT': '0.570', 'WEAPON3': '0.850', 'weapon2': '1.436', 'weapon3': '1.786', 'DAMAGECOUNT': '2.790', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:00:53,519][2409074] Updated weights for policy 0, policy_version 15541 (0.0012)
[2023-02-25 13:00:53,529][2409079] DAMAGECOUNT value on done: 4245.0
[2023-02-25 13:00:53,533][2409079] Sum rewards: 4.655, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.308', 'AMMO5': '0.017', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'AMMO4': '0.093', 'AMMO3': '0.102', 'WEAPON4': '0.150', 'weapon5': '0.170', 'weapon4': '0.368', 'HITCOUNT': '0.380', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'ARMOR': '0.832', 'weapon3': '1.348', 'weapon2': '1.380', 'DAMAGECOUNT': '1.764', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:53,696][2409105] DAMAGECOUNT value on done: 3137.0
[2023-02-25 13:00:53,697][2409105] Sum rewards: 2.564, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.226', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO5': '0.017', 'ARMOR': '0.052', 'AMMO4': '0.081', 'weapon5': '0.088', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.476', 'HITCOUNT': '0.490', 'WEAPON3': '0.800', 'weapon2': '1.042', 'DAMAGECOUNT': '1.683', 'weapon3': '2.008', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:53,833][2409097] DAMAGECOUNT value on done: 3292.0
[2023-02-25 13:00:53,836][2409097] Sum rewards: 4.578, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.743', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.031', 'AMMO3': '0.045', 'weapon5': '0.090', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON3': '0.300', 'HITCOUNT': '0.360', 'weapon4': '0.498', 'ARMOR': '0.843', 'weapon3': '0.906', 'DAMAGECOUNT': '1.380', 'weapon2': '1.406', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:53,860][2409565] Large shaping reward 2.572 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.54, 180.0), ('weapon7', 0.002)]
[2023-02-25 13:00:53,965][2409548] DAMAGECOUNT value on done: 3556.0
[2023-02-25 13:00:53,966][2409548] Sum rewards: -1.218, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.142', 'AMMO5': '0.015', 'WEAPON1': '0.050', 'AMMO2': '0.071', 'AMMO3': '0.125', 'weapon5': '0.206', 'WEAPON5': '0.300', 'AMMO4': '0.356', 'weapon4': '0.450', 'ARMOR': '0.498', 'HITCOUNT': '0.520', 'WEAPON4': '0.600', 'WEAPON3': '0.850', 'weapon2': '1.228', 'weapon3': '1.720', 'DAMAGECOUNT': '2.685', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:54,127][2409406] DAMAGECOUNT value on done: 3492.0
[2023-02-25 13:00:54,130][2409406] Sum rewards: 5.626, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.976', 'AMMO2': '0.007', 'AMMO5': '0.012', 'weapon5': '0.020', 'AMMO4': '0.034', 'AMMO3': '0.076', 'weapon7': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.382', 'HITCOUNT': '0.640', 'WEAPON3': '0.650', 'ARMOR': '0.866', 'weapon2': '1.384', 'weapon3': '1.552', 'DAMAGECOUNT': '2.511', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:54,246][2409077] DAMAGECOUNT value on done: 3325.0
[2023-02-25 13:00:54,247][2409077] Sum rewards: -0.125, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.078', 'weapon7': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.017', 'weapon5': '0.054', 'AMMO4': '0.085', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.112', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.296', 'HITCOUNT': '0.360', 'WEAPON3': '0.650', 'ARMOR': '0.875', 'weapon2': '1.400', 'weapon3': '1.534', 'DAMAGECOUNT': '1.737', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:54,251][2409547] DAMAGECOUNT value on done: 3495.0
[2023-02-25 13:00:54,253][2409547] Sum rewards: 0.331, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.630', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO5': '0.019', 'weapon7': '0.062', 'weapon5': '0.072', 'AMMO3': '0.080', 'AMMO4': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.460', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.550', 'ARMOR': '0.904', 'weapon2': '1.348', 'weapon3': '1.534', 'DAMAGECOUNT': '1.575'}
[2023-02-25 13:00:54,410][2409596] DAMAGECOUNT value on done: 3766.0
[2023-02-25 13:00:54,414][2409596] Sum rewards: 8.579, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.270', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO3': '0.060', 'weapon7': '0.060', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.122', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.316', 'HITCOUNT': '0.350', 'WEAPON3': '0.450', 'ARMOR': '0.912', 'weapon3': '1.160', 'weapon2': '1.576', 'DAMAGECOUNT': '2.886', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:00:54,461][2409104] DAMAGECOUNT value on done: 4074.0
[2023-02-25 13:00:54,462][2409104] Sum rewards: 3.852, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.272', 'AMMO2': '0.012', 'AMMO5': '0.014', 'WEAPON1': '0.030', 'AMMO4': '0.060', 'AMMO3': '0.092', 'weapon5': '0.114', 'WEAPON5': '0.300', 'HITCOUNT': '0.470', 'WEAPON3': '0.650', 'ARMOR': '0.853', 'weapon3': '1.566', 'weapon2': '1.834', 'DAMAGECOUNT': '1.878', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:54,533][2409486] DAMAGECOUNT value on done: 3603.0
[2023-02-25 13:00:54,534][2409486] Sum rewards: 3.537, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.811', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO3': '0.040', 'AMMO2': '0.052', 'weapon7': '0.064', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'AMMO4': '0.259', 'HITCOUNT': '0.290', 'ARMOR': '0.480', 'WEAPON4': '0.550', 'weapon4': '0.722', 'weapon3': '0.838', 'weapon2': '1.234', 'DAMAGECOUNT': '1.452', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:54,790][2409355] DAMAGECOUNT value on done: 3873.0
[2023-02-25 13:00:54,794][2409355] Sum rewards: 7.309, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.146', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON1': '0.050', 'weapon4': '0.060', 'AMMO4': '0.083', 'AMMO3': '0.121', 'WEAPON4': '0.150', 'weapon5': '0.238', 'WEAPON5': '0.350', 'HITCOUNT': '0.450', 'WEAPON3': '0.750', 'weapon2': '1.600', 'weapon3': '1.698', 'DAMAGECOUNT': '2.373', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:00:55,278][2409075] DAMAGECOUNT value on done: 3504.0
[2023-02-25 13:00:55,281][2409075] Sum rewards: 7.714, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.332', 'AMMO5': '0.015', 'AMMO2': '0.037', 'WEAPON1': '0.050', 'AMMO3': '0.092', 'AMMO4': '0.186', 'WEAPON4': '0.250', 'weapon5': '0.280', 'WEAPON5': '0.300', 'HITCOUNT': '0.450', 'weapon4': '0.532', 'WEAPON3': '0.550', 'ARMOR': '0.808', 'weapon3': '1.218', 'weapon2': '1.326', 'DAMAGECOUNT': '1.701', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:00:55,287][2409074] Updated weights for policy 0, policy_version 15551 (0.0012)
[2023-02-25 13:00:55,346][2409101] DAMAGECOUNT value on done: 3719.0
[2023-02-25 13:00:55,347][2409101] Sum rewards: 3.970, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.389', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.004', 'WEAPON1': '0.020', 'AMMO3': '0.041', 'weapon5': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon7': '0.118', 'weapon4': '0.236', 'HITCOUNT': '0.240', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.729', 'ARMOR': '0.800', 'weapon3': '1.080', 'weapon2': '1.188', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:55,552][2409078] DAMAGECOUNT value on done: 3054.0
[2023-02-25 13:00:55,555][2409078] Sum rewards: 2.628, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.737', 'AMMO5': '0.015', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'AMMO4': '0.090', 'AMMO3': '0.092', 'WEAPON4': '0.150', 'weapon5': '0.156', 'weapon4': '0.286', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.670', 'ARMOR': '0.858', 'weapon3': '1.512', 'weapon2': '1.738', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.349'}
[2023-02-25 13:00:55,801][2409405] DAMAGECOUNT value on done: 3605.0
[2023-02-25 13:00:55,804][2409405] Sum rewards: 2.113, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.017', 'AMMO2': '0.019', 'HEALTH': '0.021', 'WEAPON1': '0.040', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'weapon4': '0.130', 'AMMO3': '0.147', 'weapon5': '0.160', 'WEAPON5': '0.350', 'HITCOUNT': '0.470', 'ARMOR': '0.800', 'WEAPON3': '0.850', 'weapon3': '1.494', 'weapon2': '1.830', 'DAMAGECOUNT': '1.842', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:55,828][2409469] DAMAGECOUNT value on done: 3907.0
[2023-02-25 13:00:55,832][2409469] Sum rewards: 5.262, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.054', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO3': '0.030', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.100', 'WEAPON3': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.200', 'weapon5': '0.230', 'weapon4': '0.310', 'weapon3': '0.586', 'ARMOR': '0.822', 'weapon2': '0.934', 'DAMAGECOUNT': '1.281', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:55,994][2409076] DAMAGECOUNT value on done: 3008.0
[2023-02-25 13:00:55,995][2409076] Sum rewards: 6.827, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.032', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.031', 'weapon7': '0.046', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.101', 'weapon5': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.298', 'HITCOUNT': '0.350', 'WEAPON3': '0.600', 'ARMOR': '1.269', 'weapon2': '1.448', 'weapon3': '1.688', 'DAMAGECOUNT': '1.776', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:00:56,191][2409597] DAMAGECOUNT value on done: 3637.0
[2023-02-25 13:00:56,194][2409597] Sum rewards: 2.440, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.282', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'AMMO4': '0.117', 'weapon5': '0.122', 'WEAPON5': '0.150', 'HITCOUNT': '0.310', 'ARMOR': '0.400', 'weapon4': '0.430', 'WEAPON3': '0.450', 'weapon2': '1.118', 'DAMAGECOUNT': '1.158', 'weapon3': '1.466', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:56,274][2409565] DAMAGECOUNT value on done: 2999.0
[2023-02-25 13:00:56,275][2409565] Sum rewards: 2.385, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.110', 'AMMO5': '0.012', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'weapon4': '0.134', 'weapon5': '0.162', 'WEAPON5': '0.350', 'HITCOUNT': '0.470', 'ARMOR': '0.484', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.575', 'weapon2': '1.596', 'weapon3': '1.832', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:56,444][2409407] DAMAGECOUNT value on done: 3229.0
[2023-02-25 13:00:56,445][2409407] Sum rewards: 8.545, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.252', 'AMMO2': '0.014', 'AMMO5': '0.014', 'WEAPON1': '0.040', 'AMMO4': '0.067', 'AMMO3': '0.075', 'weapon5': '0.118', 'WEAPON4': '0.150', 'weapon4': '0.256', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.560', 'ARMOR': '0.800', 'weapon3': '1.462', 'weapon2': '1.866', 'DAMAGECOUNT': '2.574', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:56,466][2409373] DAMAGECOUNT value on done: 3428.0
[2023-02-25 13:00:56,470][2409373] Sum rewards: 1.776, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.640', 'weapon7': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.016', 'weapon5': '0.018', 'WEAPON4': '0.050', 'weapon4': '0.068', 'AMMO4': '0.078', 'AMMO3': '0.094', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.250', 'HITCOUNT': '0.320', 'WEAPON3': '0.550', 'ARMOR': '0.919', 'weapon3': '1.232', 'DAMAGECOUNT': '1.368', 'weapon2': '1.874', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:56,531][2409866] DAMAGECOUNT value on done: 3879.0
[2023-02-25 13:00:56,534][2409866] Sum rewards: 9.673, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.630', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO3': '0.070', 'AMMO4': '0.106', 'weapon5': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.274', 'WEAPON5': '0.300', 'ARMOR': '0.438', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'weapon2': '1.002', 'weapon3': '1.740', 'DAMAGECOUNT': '3.066', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:00:56,770][2409389] DAMAGECOUNT value on done: 3334.0
[2023-02-25 13:00:56,770][2409389] Sum rewards: 3.029, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.685', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO3': '0.097', 'AMMO4': '0.109', 'WEAPON4': '0.150', 'weapon5': '0.150', 'HITCOUNT': '0.220', 'WEAPON5': '0.400', 'weapon4': '0.456', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.909', 'weapon2': '1.332', 'weapon3': '1.484', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:56,884][2409074] Updated weights for policy 0, policy_version 15561 (0.0012)
[2023-02-25 13:00:56,953][2409096] DAMAGECOUNT value on done: 3734.0
[2023-02-25 13:00:56,954][2409096] Sum rewards: 5.396, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.120', 'AMMO5': '0.008', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'weapon5': '0.026', 'AMMO4': '0.044', 'weapon7': '0.066', 'AMMO3': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'ARMOR': '0.455', 'WEAPON3': '0.500', 'HITCOUNT': '0.680', 'weapon3': '1.512', 'weapon2': '1.846', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.325'}
[2023-02-25 13:00:56,983][2409099] DAMAGECOUNT value on done: 3079.0
[2023-02-25 13:00:56,986][2409099] Sum rewards: 4.635, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.305', 'AMMO5': '0.003', 'AMMO2': '0.006', 'ARMOR': '0.008', 'AMMO3': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.031', 'weapon5': '0.050', 'weapon7': '0.068', 'HITCOUNT': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON3': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon3': '0.240', 'weapon4': '0.412', 'weapon2': '0.864', 'DAMAGECOUNT': '1.008', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:57,122][2409079] DAMAGECOUNT value on done: 3539.0
[2023-02-25 13:00:57,123][2409079] Sum rewards: 7.535, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.110', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.043', 'ARMOR': '0.048', 'weapon7': '0.060', 'AMMO3': '0.068', 'weapon5': '0.174', 'WEAPON5': '0.200', 'AMMO4': '0.215', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON4': '0.350', 'WEAPON7': '0.400', 'weapon2': '0.420', 'WEAPON3': '0.500', 'HITCOUNT': '0.520', 'weapon4': '1.046', 'weapon3': '1.130', 'DAMAGECOUNT': '2.811', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:00:57,186][2408954] Fps is (10 sec: 24985.7, 60 sec: 25395.2, 300 sec: 25534.1). Total num frames: 63741952. Throughput: 0: 6343.8. Samples: 15936900. Policy #0 lag: (min: 0.0, avg: 11.9, max: 25.0)
[2023-02-25 13:00:57,186][2408954] Avg episode reward: [(0, '5.104')]
[2023-02-25 13:00:57,269][2409105] DAMAGECOUNT value on done: 3040.0
[2023-02-25 13:00:57,270][2409105] Sum rewards: 3.284, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.470', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.030', 'weapon7': '0.052', 'weapon5': '0.054', 'AMMO3': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.150', 'weapon4': '0.332', 'HITCOUNT': '0.450', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.239', 'weapon2': '1.252', 'weapon3': '1.296', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:57,633][2409097] DAMAGECOUNT value on done: 3245.0
[2023-02-25 13:00:57,870][2409548] DAMAGECOUNT value on done: 3412.0
[2023-02-25 13:00:57,871][2409548] Sum rewards: 3.185, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.202', 'AMMO5': '0.008', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'weapon5': '0.054', 'AMMO3': '0.107', 'WEAPON5': '0.200', 'weapon4': '0.226', 'HITCOUNT': '0.380', 'ARMOR': '0.432', 'weapon2': '0.698', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.197', 'weapon3': '2.016', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:58,157][2409596] DAMAGECOUNT value on done: 3513.0
[2023-02-25 13:00:58,158][2409596] Sum rewards: 8.472, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.664', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO3': '0.042', 'weapon7': '0.056', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.144', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'HITCOUNT': '0.480', 'weapon3': '0.948', 'ARMOR': '0.950', 'weapon2': '1.870', 'DAMAGECOUNT': '2.505', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:00:58,178][2409406] DAMAGECOUNT value on done: 3259.0
[2023-02-25 13:00:58,187][2409406] Sum rewards: 4.354, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.736', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon5': '0.052', 'weapon7': '0.052', 'AMMO4': '0.064', 'AMMO3': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.230', 'HITCOUNT': '0.330', 'ARMOR': '0.468', 'WEAPON3': '0.550', 'weapon2': '0.838', 'DAMAGECOUNT': '1.554', 'weapon3': '1.578', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:00:58,234][2409104] DAMAGECOUNT value on done: 3563.0
[2023-02-25 13:00:58,237][2409104] Sum rewards: -0.226, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.170', 'AMMO5': '0.017', 'AMMO2': '0.021', 'WEAPON1': '0.050', 'AMMO3': '0.088', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.106', 'HITCOUNT': '0.180', 'WEAPON4': '0.250', 'weapon5': '0.254', 'WEAPON5': '0.400', 'weapon4': '0.442', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.765', 'FRAGCOUNT': '1.000', 'weapon2': '1.022', 'weapon3': '1.448'}
[2023-02-25 13:00:58,293][2409077] DAMAGECOUNT value on done: 3484.0
[2023-02-25 13:00:58,296][2409077] Sum rewards: 5.273, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.225', 'AMMO4': '-0.061', 'AMMO2': '-0.012', 'AMMO5': '0.007', 'AMMO3': '0.060', 'WEAPON1': '0.060', 'weapon7': '0.072', 'weapon5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.360', 'WEAPON3': '0.450', 'weapon3': '1.380', 'DAMAGECOUNT': '1.506', 'weapon2': '1.636', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:58,330][2409547] DAMAGECOUNT value on done: 3697.0
[2023-02-25 13:00:58,341][2409547] Sum rewards: 2.715, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.746', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.028', 'weapon7': '0.052', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon5': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.194', 'WEAPON7': '0.200', 'HITCOUNT': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.221', 'weapon3': '1.326', 'weapon2': '1.760', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:58,408][2409355] DAMAGECOUNT value on done: 3103.0
[2023-02-25 13:00:58,413][2409355] Sum rewards: 1.494, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.327', 'AMMO2': '0.026', 'AMMO3': '0.030', 'HITCOUNT': '0.110', 'weapon7': '0.118', 'AMMO4': '0.127', 'WEAPON3': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'weapon4': '0.312', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.564', 'weapon3': '0.662', 'weapon2': '1.532', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:58,462][2409074] Updated weights for policy 0, policy_version 15571 (0.0012)
[2023-02-25 13:00:58,513][2409486] DAMAGECOUNT value on done: 3960.0
[2023-02-25 13:00:58,514][2409486] Sum rewards: 5.837, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.008', 'AMMO5': '0.022', 'AMMO2': '0.027', 'WEAPON4': '0.050', 'AMMO3': '0.084', 'AMMO4': '0.132', 'weapon5': '0.164', 'weapon4': '0.214', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'HITCOUNT': '0.500', 'ARMOR': '0.885', 'weapon3': '1.126', 'weapon2': '1.810', 'DAMAGECOUNT': '2.130', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:59,003][2409075] DAMAGECOUNT value on done: 4242.0
[2023-02-25 13:00:59,004][2409075] Sum rewards: 11.996, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.425', 'AMMO5': '0.007', 'AMMO2': '0.019', 'ARMOR': '0.036', 'AMMO3': '0.070', 'weapon7': '0.072', 'AMMO4': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '0.730', 'weapon2': '0.804', 'weapon4': '0.864', 'weapon3': '1.772', 'DAMAGECOUNT': '2.610', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:00:59,168][2409078] DAMAGECOUNT value on done: 3108.0
[2023-02-25 13:00:59,169][2409078] Sum rewards: 3.595, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.358', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.006', 'WEAPON1': '0.030', 'weapon5': '0.052', 'AMMO3': '0.080', 'WEAPON5': '0.150', 'HITCOUNT': '0.290', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.795', 'weapon2': '1.476', 'weapon3': '1.668', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:59,374][2409405] DAMAGECOUNT value on done: 3594.0
[2023-02-25 13:00:59,376][2409405] Sum rewards: 1.198, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.551', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'weapon5': '0.018', 'AMMO4': '0.044', 'weapon7': '0.054', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.210', 'weapon4': '0.264', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.657', 'ARMOR': '0.855', 'weapon2': '1.208', 'weapon3': '1.248', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:59,536][2409076] DAMAGECOUNT value on done: 3035.0
[2023-02-25 13:00:59,540][2409076] Sum rewards: 4.413, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.820', 'AMMO4': '-0.080', 'AMMO2': '-0.016', 'WEAPON1': '0.020', 'AMMO3': '0.030', 'weapon7': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'HITCOUNT': '0.380', 'weapon3': '0.750', 'ARMOR': '0.898', 'DAMAGECOUNT': '1.080', 'weapon2': '1.604', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:00:59,562][2409469] DAMAGECOUNT value on done: 4118.0
[2023-02-25 13:00:59,565][2409469] Sum rewards: 16.231, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.030', 'AMMO3': '0.070', 'weapon5': '0.114', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON3': '0.400', 'weapon4': '0.628', 'HEALTH': '0.629', 'HITCOUNT': '0.650', 'ARMOR': '0.848', 'weapon2': '0.904', 'weapon3': '1.324', 'DAMAGECOUNT': '3.669', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:00:59,904][2409074] Updated weights for policy 0, policy_version 15581 (0.0012)
[2023-02-25 13:00:59,945][2409407] DAMAGECOUNT value on done: 4084.0
[2023-02-25 13:00:59,945][2409407] Sum rewards: 2.989, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.552', 'weapon7': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'AMMO3': '0.111', 'weapon5': '0.118', 'AMMO4': '0.138', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'HITCOUNT': '0.360', 'WEAPON3': '0.550', 'weapon3': '1.360', 'DAMAGECOUNT': '1.485', 'weapon2': '1.854', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:00:59,979][2409373] DAMAGECOUNT value on done: 3624.0
[2023-02-25 13:00:59,982][2409373] Sum rewards: 7.734, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.900', 'AMMO5': '0.013', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'AMMO3': '0.074', 'weapon7': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.101', 'weapon5': '0.106', 'WEAPON4': '0.150', 'weapon4': '0.286', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.650', 'weapon3': '1.556', 'weapon2': '1.622', 'DAMAGECOUNT': '2.730', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:01:00,147][2409866] DAMAGECOUNT value on done: 4086.0
[2023-02-25 13:01:00,147][2409866] Sum rewards: 9.699, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.015', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'HEALTH': '0.064', 'AMMO3': '0.070', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'weapon5': '0.136', 'weapon4': '0.214', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'HITCOUNT': '0.610', 'weapon2': '1.094', 'weapon3': '1.668', 'DAMAGECOUNT': '2.979', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:01:00,301][2409597] DAMAGECOUNT value on done: 3415.0
[2023-02-25 13:01:00,302][2409597] Sum rewards: 3.781, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.628', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon7': '0.056', 'AMMO3': '0.062', 'weapon5': '0.070', 'AMMO4': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.214', 'HITCOUNT': '0.260', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.837', 'ARMOR': '0.878', 'weapon3': '1.038', 'weapon2': '1.452', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:01:00,429][2409389] DAMAGECOUNT value on done: 3375.0
[2023-02-25 13:01:00,430][2409389] Sum rewards: 1.536, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.520', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon5': '0.018', 'WEAPON5': '0.050', 'weapon7': '0.052', 'AMMO3': '0.065', 'AMMO4': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.246', 'HITCOUNT': '0.270', 'WEAPON3': '0.350', 'weapon2': '0.784', 'weapon3': '0.872', 'DAMAGECOUNT': '1.107', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:01:00,469][2409565] DAMAGECOUNT value on done: 4412.0
[2023-02-25 13:01:00,471][2409565] Sum rewards: 5.651, reward structure: {'DEATHCOUNT': '-1.500', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.012', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'HEALTH': '0.122', 'weapon5': '0.126', 'WEAPON3': '0.200', 'HITCOUNT': '0.340', 'ARMOR': '0.400', 'DAMAGECOUNT': '1.197', 'weapon3': '1.258', 'weapon2': '1.358', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:01:00,647][2409079] DAMAGECOUNT value on done: 3748.0
[2023-02-25 13:01:00,648][2409079] Sum rewards: 4.847, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.366', 'AMMO5': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.048', 'weapon7': '0.066', 'AMMO4': '0.076', 'weapon5': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.204', 'WEAPON5': '0.250', 'HITCOUNT': '0.330', 'WEAPON3': '0.350', 'weapon3': '0.632', 'ARMOR': '0.800', 'weapon2': '1.320', 'DAMAGECOUNT': '1.665', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:01:00,911][2409096] DAMAGECOUNT value on done: 4486.0
[2023-02-25 13:01:00,912][2409096] Sum rewards: 1.339, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.166', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.029', 'ARMOR': '0.032', 'weapon5': '0.128', 'AMMO4': '0.145', 'AMMO3': '0.152', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.470', 'HITCOUNT': '0.540', 'weapon4': '0.650', 'WEAPON3': '1.000', 'weapon3': '2.268', 'DAMAGECOUNT': '2.415', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:01:00,921][2409099] DAMAGECOUNT value on done: 4119.0
[2023-02-25 13:01:00,924][2409099] Sum rewards: 13.873, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.168', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO3': '0.040', 'weapon7': '0.050', 'weapon5': '0.082', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'weapon4': '0.348', 'HITCOUNT': '0.590', 'weapon3': '0.968', 'ARMOR': '1.253', 'weapon2': '1.674', 'DAMAGECOUNT': '2.424', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:01:01,408][2409105] DAMAGECOUNT value on done: 3443.0
[2023-02-25 13:01:01,408][2409105] Sum rewards: 9.640, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.066', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon5': '0.062', 'AMMO3': '0.076', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.516', 'WEAPON3': '0.600', 'HITCOUNT': '0.630', 'weapon2': '1.240', 'weapon3': '1.366', 'ARMOR': '1.386', 'DAMAGECOUNT': '2.352', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:01:01,573][2409074] Updated weights for policy 0, policy_version 15591 (0.0012)
[2023-02-25 13:01:01,707][2409097] DAMAGECOUNT value on done: 4040.0
[2023-02-25 13:01:01,708][2409097] Sum rewards: 3.850, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.250', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.053', 'WEAPON1': '0.080', 'weapon5': '0.098', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'weapon4': '0.212', 'WEAPON5': '0.300', 'ARMOR': '0.455', 'HITCOUNT': '0.650', 'WEAPON3': '1.050', 'weapon2': '1.094', 'DAMAGECOUNT': '1.977', 'weapon3': '2.068', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:01:02,082][2409355] DAMAGECOUNT value on done: 3126.0
[2023-02-25 13:01:02,083][2409355] Sum rewards: 1.943, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.683', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.017', 'WEAPON1': '0.050', 'weapon7': '0.088', 'AMMO3': '0.118', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.260', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.236', 'weapon3': '1.556', 'weapon2': '1.678', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:01:02,088][2409596] DAMAGECOUNT value on done: 3294.0
[2023-02-25 13:01:02,091][2409596] Sum rewards: 4.968, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.092', 'AMMO2': '0.005', 'AMMO5': '0.019', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'weapon5': '0.088', 'AMMO3': '0.101', 'weapon4': '0.124', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'HITCOUNT': '0.630', 'WEAPON3': '0.750', 'weapon2': '1.342', 'weapon3': '1.878', 'DAMAGECOUNT': '1.890', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:01:02,186][2408954] Fps is (10 sec: 24985.3, 60 sec: 25327.0, 300 sec: 25575.7). Total num frames: 63873024. Throughput: 0: 6340.3. Samples: 15975156. Policy #0 lag: (min: 0.0, avg: 11.9, max: 25.0)
[2023-02-25 13:01:02,186][2408954] Avg episode reward: [(0, '5.042')]
[2023-02-25 13:01:02,199][2409548] DAMAGECOUNT value on done: 3060.0
[2023-02-25 13:01:02,200][2409548] Sum rewards: 3.698, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.320', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'WEAPON1': '0.040', 'weapon7': '0.080', 'AMMO3': '0.093', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.340', 'ARMOR': '0.467', 'weapon4': '0.620', 'WEAPON3': '0.700', 'weapon3': '1.150', 'DAMAGECOUNT': '1.212', 'weapon2': '1.632', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:01:02,207][2409104] DAMAGECOUNT value on done: 3542.0
[2023-02-25 13:01:02,210][2409406] DAMAGECOUNT value on done: 2697.0
[2023-02-25 13:01:02,210][2409104] Sum rewards: 5.050, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.200', 'AMMO5': '0.007', 'AMMO2': '0.035', 'WEAPON1': '0.040', 'weapon5': '0.078', 'AMMO3': '0.088', 'AMMO4': '0.177', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.468', 'HITCOUNT': '0.500', 'weapon4': '0.544', 'WEAPON3': '0.600', 'weapon3': '1.234', 'weapon2': '1.364', 'DAMAGECOUNT': '1.815', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:01:02,211][2409406] Sum rewards: 3.073, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.580', 'AMMO2': '0.010', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.051', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon5': '0.172', 'HITCOUNT': '0.330', 'WEAPON5': '0.350', 'weapon4': '0.472', 'WEAPON3': '0.550', 'weapon2': '1.036', 'DAMAGECOUNT': '1.377', 'weapon3': '1.582', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:01:02,260][2409547] DAMAGECOUNT value on done: 4453.0
[2023-02-25 13:01:02,262][2409547] Sum rewards: 8.505, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.929', 'AMMO2': '0.007', 'AMMO5': '0.018', 'AMMO4': '0.036', 'weapon5': '0.062', 'AMMO3': '0.101', 'weapon7': '0.196', 'WEAPON4': '0.250', 'weapon2': '0.298', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON5': '0.350', 'WEAPON7': '0.500', 'WEAPON3': '0.650', 'weapon4': '0.682', 'HITCOUNT': '0.890', 'weapon3': '1.402', 'DAMAGECOUNT': '3.312', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:01:02,310][2409077] DAMAGECOUNT value on done: 3464.0
[2023-02-25 13:01:02,311][2409077] Sum rewards: 5.774, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.890', 'AMMO5': '0.020', 'AMMO2': '0.032', 'WEAPON1': '0.050', 'AMMO3': '0.071', 'weapon5': '0.110', 'AMMO4': '0.160', 'WEAPON4': '0.250', 'weapon4': '0.350', 'HITCOUNT': '0.360', 'WEAPON5': '0.400', 'ARMOR': '0.408', 'WEAPON3': '0.550', 'weapon2': '1.302', 'DAMAGECOUNT': '1.800', 'weapon3': '1.800', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:01:02,490][2409486] DAMAGECOUNT value on done: 3127.0
[2023-02-25 13:01:02,494][2409486] Sum rewards: 7.509, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON1': '0.030', 'AMMO3': '0.040', 'weapon5': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'WEAPON5': '0.100', 'WEAPON3': '0.250', 'HEALTH': '0.266', 'weapon4': '0.282', 'HITCOUNT': '0.310', 'ARMOR': '0.800', 'weapon3': '1.056', 'weapon2': '1.566', 'DAMAGECOUNT': '1.641', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:01:02,693][2409078] DAMAGECOUNT value on done: 2846.0
[2023-02-25 13:01:02,696][2409078] Sum rewards: 0.730, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.478', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'weapon5': '0.044', 'weapon7': '0.050', 'AMMO3': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.176', 'WEAPON7': '0.200', 'HITCOUNT': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'WEAPON4': '0.500', 'weapon2': '0.604', 'weapon4': '0.820', 'DAMAGECOUNT': '1.212', 'weapon3': '1.356', 'ARMOR': '1.409', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:01:02,773][2409075] DAMAGECOUNT value on done: 3761.0
[2023-02-25 13:01:02,777][2409075] Sum rewards: 6.622, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.517', 'AMMO2': '0.011', 'AMMO5': '0.015', 'AMMO4': '0.055', 'AMMO3': '0.093', 'weapon5': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.334', 'HITCOUNT': '0.420', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'ARMOR': '0.918', 'weapon3': '1.412', 'weapon2': '1.668', 'DAMAGECOUNT': '1.992', 'FRAGCOUNT': '6.500'}
[2023-02-25 13:01:02,908][2409405] DAMAGECOUNT value on done: 3524.0
[2023-02-25 13:01:02,909][2409405] Sum rewards: 1.868, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.430', 'AMMO5': '0.011', 'AMMO2': '0.011', 'WEAPON1': '0.030', 'AMMO4': '0.056', 'weapon5': '0.086', 'AMMO3': '0.107', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.336', 'HITCOUNT': '0.430', 'WEAPON3': '0.650', 'weapon3': '1.294', 'DAMAGECOUNT': '1.776', 'weapon2': '1.810', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:01:03,354][2409074] Updated weights for policy 0, policy_version 15601 (0.0013)
[2023-02-25 13:01:03,397][2409469] DAMAGECOUNT value on done: 3751.0
[2023-02-25 13:01:03,397][2409469] Sum rewards: 4.802, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.940', 'weapon5': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO3': '0.094', 'AMMO4': '0.134', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.254', 'HITCOUNT': '0.430', 'ARMOR': '0.456', 'WEAPON3': '0.550', 'weapon3': '1.000', 'DAMAGECOUNT': '1.410', 'weapon2': '1.662', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:01:03,407][2409076] DAMAGECOUNT value on done: 4196.0
[2023-02-25 13:01:03,408][2409076] Sum rewards: 6.140, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.508', 'AMMO5': '0.005', 'AMMO2': '0.035', 'AMMO3': '0.081', 'weapon5': '0.096', 'weapon7': '0.114', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.330', 'ARMOR': '0.444', 'WEAPON3': '0.500', 'weapon4': '0.508', 'weapon3': '1.136', 'weapon2': '1.426', 'DAMAGECOUNT': '2.496', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:01:03,619][2409407] DAMAGECOUNT value on done: 3221.0
[2023-02-25 13:01:03,622][2409407] Sum rewards: 4.819, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.898', 'AMMO5': '0.012', 'AMMO2': '0.030', 'WEAPON1': '0.040', 'AMMO3': '0.091', 'weapon5': '0.118', 'AMMO4': '0.152', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'ARMOR': '0.408', 'WEAPON3': '0.600', 'HITCOUNT': '0.660', 'weapon2': '0.780', 'weapon4': '0.820', 'weapon3': '1.372', 'DAMAGECOUNT': '2.733', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:01:03,768][2409866] DAMAGECOUNT value on done: 4359.0
[2023-02-25 13:01:03,771][2409866] Sum rewards: 1.948, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.729', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.010', 'weapon7': '0.062', 'weapon5': '0.068', 'WEAPON1': '0.080', 'AMMO3': '0.124', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.310', 'ARMOR': '0.474', 'WEAPON3': '0.800', 'weapon2': '1.018', 'DAMAGECOUNT': '1.080', 'weapon3': '1.978', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:01:04,004][2409373] DAMAGECOUNT value on done: 2754.0
[2023-02-25 13:01:04,004][2409373] Sum rewards: 3.968, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.360', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'AMMO5': '0.007', 'WEAPON1': '0.040', 'weapon5': '0.072', 'AMMO3': '0.084', 'WEAPON5': '0.200', 'HITCOUNT': '0.280', 'WEAPON3': '0.600', 'ARMOR': '0.851', 'weapon3': '1.388', 'DAMAGECOUNT': '1.740', 'weapon2': '2.118', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:01:04,282][2409389] DAMAGECOUNT value on done: 3460.0
[2023-02-25 13:01:04,285][2409389] Sum rewards: 4.723, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.270', 'AMMO5': '0.017', 'AMMO2': '0.048', 'WEAPON1': '0.050', 'weapon5': '0.074', 'AMMO3': '0.119', 'AMMO4': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.453', 'weapon4': '0.456', 'HITCOUNT': '0.520', 'WEAPON3': '0.750', 'weapon2': '1.530', 'weapon3': '1.692', 'DAMAGECOUNT': '1.941', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:01:04,620][2409565] DAMAGECOUNT value on done: 3163.0
[2023-02-25 13:01:04,621][2409565] Sum rewards: -0.017, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.609', 'AMMO2': '0.006', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.030', 'weapon5': '0.082', 'AMMO3': '0.086', 'HITCOUNT': '0.150', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.466', 'DAMAGECOUNT': '0.486', 'ARMOR': '0.494', 'WEAPON3': '0.550', 'weapon2': '1.272', 'weapon3': '1.388', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:01:04,685][2409099] DAMAGECOUNT value on done: 3600.0
[2023-02-25 13:01:04,686][2409099] Sum rewards: 6.528, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.444', 'AMMO2': '0.011', 'AMMO5': '0.019', 'WEAPON1': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.103', 'weapon5': '0.202', 'WEAPON4': '0.250', 'weapon4': '0.416', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'HITCOUNT': '0.710', 'weapon2': '1.244', 'ARMOR': '1.361', 'weapon3': '1.626', 'DAMAGECOUNT': '2.724', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:01:04,742][2409096] DAMAGECOUNT value on done: 3776.0
[2023-02-25 13:01:04,742][2409096] Sum rewards: 8.507, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.415', 'AMMO2': '0.005', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.022', 'AMMO3': '0.061', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.388', 'ARMOR': '0.450', 'WEAPON3': '0.450', 'HITCOUNT': '0.530', 'weapon3': '1.236', 'weapon2': '1.656', 'DAMAGECOUNT': '1.941', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:01:04,762][2409079] DAMAGECOUNT value on done: 4518.0
[2023-02-25 13:01:04,766][2409079] Sum rewards: 7.130, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO3': '0.071', 'weapon5': '0.128', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.234', 'WEAPON3': '0.400', 'HEALTH': '0.570', 'HITCOUNT': '0.570', 'ARMOR': '0.957', 'weapon3': '1.408', 'weapon2': '1.500', 'DAMAGECOUNT': '2.025', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:01:04,951][2409105] DAMAGECOUNT value on done: 3712.0
[2023-02-25 13:01:04,951][2409105] Sum rewards: 5.476, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.574', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.020', 'WEAPON1': '0.050', 'weapon7': '0.056', 'AMMO3': '0.075', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.101', 'weapon5': '0.176', 'WEAPON4': '0.200', 'HITCOUNT': '0.250', 'weapon4': '0.270', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon2': '1.088', 'weapon3': '1.372', 'DAMAGECOUNT': '2.118', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:01:05,135][2409074] Updated weights for policy 0, policy_version 15611 (0.0012)
[2023-02-25 13:01:05,487][2409033] Signal inference workers to stop experience collection... (1900 times)
[2023-02-25 13:01:05,488][2409033] Signal inference workers to resume experience collection... (1900 times)
[2023-02-25 13:01:05,516][2409074] InferenceWorker_p0-w0: stopping experience collection (1900 times)
[2023-02-25 13:01:05,516][2409074] InferenceWorker_p0-w0: resuming experience collection (1900 times)
[2023-02-25 13:01:05,520][2409097] DAMAGECOUNT value on done: 3550.0
[2023-02-25 13:01:05,523][2409097] Sum rewards: 4.575, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.907', 'AMMO5': '0.010', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.051', 'AMMO3': '0.062', 'weapon5': '0.072', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'HITCOUNT': '0.380', 'ARMOR': '0.420', 'WEAPON3': '0.500', 'weapon4': '0.506', 'weapon2': '0.834', 'DAMAGECOUNT': '1.200', 'weapon3': '1.416', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:01:05,696][2409355] DAMAGECOUNT value on done: 3470.0
[2023-02-25 13:01:05,699][2409355] Sum rewards: 6.135, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.526', 'AMMO5': '0.003', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.039', 'AMMO3': '0.050', 'weapon5': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon7': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.420', 'weapon4': '0.498', 'weapon3': '0.650', 'ARMOR': '1.005', 'weapon2': '1.386', 'DAMAGECOUNT': '1.935', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:01:06,209][2409547] DAMAGECOUNT value on done: 2527.0
[2023-02-25 13:01:06,210][2409547] Sum rewards: 8.546, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.398', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.024', 'AMMO3': '0.040', 'WEAPON5': '0.100', 'weapon5': '0.112', 'WEAPON4': '0.150', 'WEAPON3': '0.250', 'HITCOUNT': '0.380', 'weapon4': '0.478', 'ARMOR': '0.494', 'weapon2': '0.636', 'weapon3': '1.000', 'DAMAGECOUNT': '1.518', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:01:06,227][2409596] DAMAGECOUNT value on done: 3508.0
[2023-02-25 13:01:06,230][2409596] Sum rewards: 2.479, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.313', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.018', 'AMMO4': '0.040', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.270', 'WEAPON3': '0.400', 'weapon4': '0.416', 'ARMOR': '0.455', 'DAMAGECOUNT': '0.888', 'weapon2': '0.932', 'weapon3': '1.580', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:01:06,242][2409078] DAMAGECOUNT value on done: 4125.0
[2023-02-25 13:01:06,246][2409078] Sum rewards: 7.147, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.380', 'AMMO2': '0.018', 'AMMO5': '0.018', 'WEAPON1': '0.030', 'weapon5': '0.052', 'AMMO4': '0.091', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon4': '0.248', 'WEAPON5': '0.300', 'ARMOR': '0.452', 'HITCOUNT': '0.600', 'WEAPON3': '0.650', 'weapon2': '0.788', 'weapon3': '2.016', 'DAMAGECOUNT': '2.568', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:01:06,298][2409406] DAMAGECOUNT value on done: 2528.0
[2023-02-25 13:01:06,358][2409104] DAMAGECOUNT value on done: 4931.0
[2023-02-25 13:01:06,360][2409104] Sum rewards: 5.593, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.002', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO4': '0.086', 'weapon5': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO3': '0.106', 'WEAPON5': '0.400', 'ARMOR': '0.408', 'HITCOUNT': '0.710', 'WEAPON3': '0.750', 'weapon2': '0.792', 'weapon3': '1.760', 'DAMAGECOUNT': '2.232', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:01:06,385][2409074] Updated weights for policy 0, policy_version 15621 (0.0013)
[2023-02-25 13:01:06,403][2409077] DAMAGECOUNT value on done: 3533.0
[2023-02-25 13:01:06,407][2409077] Sum rewards: 15.031, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.598', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.023', 'WEAPON1': '0.040', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'weapon5': '0.110', 'ARMOR': '0.448', 'WEAPON3': '0.650', 'HITCOUNT': '0.950', 'weapon2': '1.712', 'weapon3': '1.922', 'DAMAGECOUNT': '4.320', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:01:06,420][2409405] DAMAGECOUNT value on done: 4038.0
[2023-02-25 13:01:06,421][2409405] Sum rewards: 3.048, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.076', 'AMMO5': '0.015', 'AMMO3': '0.020', 'AMMO2': '0.023', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON3': '0.100', 'AMMO4': '0.114', 'weapon5': '0.138', 'WEAPON4': '0.150', 'weapon4': '0.170', 'HITCOUNT': '0.190', 'WEAPON5': '0.250', 'weapon3': '0.480', 'DAMAGECOUNT': '0.666', 'FRAGCOUNT': '1.000', 'weapon2': '1.180', 'ARMOR': '1.260'}
[2023-02-25 13:01:06,568][2409486] DAMAGECOUNT value on done: 3198.0
[2023-02-25 13:01:06,569][2409486] Sum rewards: 4.392, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.798', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.014', 'weapon7': '0.052', 'WEAPON1': '0.060', 'AMMO3': '0.081', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.122', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.270', 'WEAPON5': '0.350', 'weapon4': '0.442', 'ARMOR': '0.481', 'WEAPON3': '0.650', 'weapon2': '1.278', 'weapon3': '1.462', 'DAMAGECOUNT': '1.602', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:01:06,643][2409075] DAMAGECOUNT value on done: 3047.0
[2023-02-25 13:01:06,645][2409075] Sum rewards: 5.547, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.798', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.029', 'WEAPON1': '0.040', 'AMMO3': '0.079', 'WEAPON4': '0.150', 'weapon4': '0.262', 'weapon5': '0.350', 'HITCOUNT': '0.430', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'weapon3': '1.078', 'ARMOR': '1.311', 'weapon2': '1.670', 'DAMAGECOUNT': '2.625', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:01:07,186][2408954] Fps is (10 sec: 25804.5, 60 sec: 25463.4, 300 sec: 25534.0). Total num frames: 64000000. Throughput: 0: 6354.2. Samples: 15994080. Policy #0 lag: (min: 0.0, avg: 11.8, max: 25.0)
[2023-02-25 13:01:07,186][2408954] Avg episode reward: [(0, '5.141')]
[2023-02-25 13:01:07,192][2409469] DAMAGECOUNT value on done: 4185.0
[2023-02-25 13:01:07,193][2409469] Sum rewards: 1.172, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.556', 'AMMO5': '0.004', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.030', 'AMMO3': '0.035', 'weapon7': '0.058', 'AMMO4': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'weapon4': '0.220', 'WEAPON3': '0.250', 'ARMOR': '0.428', 'weapon3': '0.594', 'weapon2': '0.926', 'DAMAGECOUNT': '0.999', 'FRAGCOUNT': '1.000'}
[2023-02-25 13:01:07,366][2409866] DAMAGECOUNT value on done: 4017.0
[2023-02-25 13:01:07,369][2409866] Sum rewards: 0.070, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.951', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO3': '0.088', 'weapon5': '0.158', 'WEAPON4': '0.200', 'HITCOUNT': '0.370', 'weapon4': '0.462', 'ARMOR': '0.495', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.197', 'weapon3': '1.258', 'weapon2': '1.434', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:01:07,447][2409076] DAMAGECOUNT value on done: 3382.0
[2023-02-25 13:01:07,450][2409076] Sum rewards: 0.334, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.044', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.040', 'AMMO3': '0.074', 'weapon7': '0.090', 'weapon5': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.176', 'AMMO4': '0.199', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.320', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.885', 'FRAGCOUNT': '1.000', 'weapon3': '1.478', 'weapon2': '1.834'}
[2023-02-25 13:01:07,718][2409407] DAMAGECOUNT value on done: 2920.0
[2023-02-25 13:01:07,718][2409407] Sum rewards: 3.585, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'weapon7': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.112', 'weapon4': '0.280', 'WEAPON3': '0.300', 'HITCOUNT': '0.320', 'ARMOR': '0.400', 'weapon3': '0.600', 'HEALTH': '0.648', 'DAMAGECOUNT': '0.975', 'weapon2': '1.352', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:01:07,898][2409074] Updated weights for policy 0, policy_version 15631 (0.0012)
[2023-02-25 13:01:07,999][2409373] DAMAGECOUNT value on done: 3686.0
[2023-02-25 13:01:08,000][2409373] Sum rewards: 2.510, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.008', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'weapon5': '0.050', 'AMMO3': '0.057', 'AMMO4': '0.059', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.150', 'WEAPON3': '0.300', 'HITCOUNT': '0.410', 'weapon3': '0.792', 'ARMOR': '0.956', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.665', 'weapon2': '2.250'}
[2023-02-25 13:01:08,044][2409389] DAMAGECOUNT value on done: 3836.0
[2023-02-25 13:01:08,045][2409389] Sum rewards: 10.743, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.354', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.081', 'AMMO4': '0.105', 'weapon5': '0.162', 'weapon7': '0.190', 'WEAPON5': '0.200', 'AMMO6': '0.260', 'AMMO7': '0.260', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'HITCOUNT': '0.500', 'weapon4': '0.572', 'WEAPON3': '0.600', 'ARMOR': '0.852', 'weapon2': '1.130', 'weapon3': '1.400', 'DAMAGECOUNT': '2.586', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:01:08,393][2409565] DAMAGECOUNT value on done: 3822.0
[2023-02-25 13:01:08,396][2409565] Sum rewards: 5.331, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.608', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO5': '0.018', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.096', 'weapon5': '0.266', 'WEAPON3': '0.300', 'HITCOUNT': '0.390', 'WEAPON5': '0.400', 'ARMOR': '0.858', 'weapon3': '1.202', 'weapon2': '1.894', 'DAMAGECOUNT': '2.373', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:01:08,456][2409096] DAMAGECOUNT value on done: 3089.0
[2023-02-25 13:01:08,461][2409096] Sum rewards: 1.534, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.926', 'AMMO2': '0.008', 'AMMO4': '0.039', 'AMMO3': '0.039', 'weapon7': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.200', 'weapon4': '0.224', 'WEAPON3': '0.250', 'weapon3': '0.506', 'DAMAGECOUNT': '0.801', 'ARMOR': '0.849', 'FRAGCOUNT': '1.000', 'weapon2': '1.576'}
[2023-02-25 13:01:08,538][2409079] DAMAGECOUNT value on done: 3463.0
[2023-02-25 13:01:08,539][2409079] Sum rewards: 2.085, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.629', 'AMMO2': '0.006', 'AMMO5': '0.008', 'AMMO4': '0.028', 'WEAPON1': '0.040', 'AMMO3': '0.100', 'weapon5': '0.134', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.330', 'ARMOR': '0.466', 'weapon4': '0.516', 'WEAPON3': '0.550', 'weapon2': '0.928', 'DAMAGECOUNT': '1.017', 'weapon3': '1.890', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:01:08,698][2409099] DAMAGECOUNT value on done: 4740.0
[2023-02-25 13:01:08,699][2409099] Sum rewards: 3.649, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.656', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'ARMOR': '0.036', 'AMMO3': '0.051', 'weapon7': '0.062', 'AMMO4': '0.073', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.104', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.370', 'WEAPON3': '0.400', 'weapon4': '0.714', 'weapon2': '0.810', 'weapon3': '1.296', 'DAMAGECOUNT': '1.836', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:01:08,723][2409105] DAMAGECOUNT value on done: 4017.0
[2023-02-25 13:01:08,727][2409105] Sum rewards: 8.360, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.576', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon7': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'weapon5': '0.126', 'WEAPON5': '0.300', 'weapon4': '0.328', 'HITCOUNT': '0.600', 'WEAPON3': '0.700', 'weapon2': '1.382', 'weapon3': '1.662', 'DAMAGECOUNT': '2.655', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:01:09,311][2409355] DAMAGECOUNT value on done: 3808.0
[2023-02-25 13:01:09,314][2409355] Sum rewards: 2.074, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.634', 'AMMO2': '0.005', 'ARMOR': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.023', 'weapon5': '0.056', 'AMMO3': '0.091', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.310', 'WEAPON3': '0.550', 'weapon4': '0.568', 'weapon2': '0.882', 'DAMAGECOUNT': '1.245', 'weapon3': '1.450', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:01:09,510][2409074] Updated weights for policy 0, policy_version 15641 (0.0013)
[2023-02-25 13:01:09,585][2409097] DAMAGECOUNT value on done: 3566.0
[2023-02-25 13:01:09,586][2409097] Sum rewards: 10.157, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.342', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.056', 'WEAPON1': '0.060', 'weapon7': '0.082', 'AMMO3': '0.090', 'AMMO4': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.120', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.750', 'weapon3': '1.544', 'weapon2': '1.590', 'DAMAGECOUNT': '2.736', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:01:10,077][2409078] DAMAGECOUNT value on done: 3576.0
[2023-02-25 13:01:10,077][2409596] DAMAGECOUNT value on done: 3573.0
[2023-02-25 13:01:10,078][2409078] Sum rewards: 6.003, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.186', 'AMMO5': '0.012', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'AMMO4': '0.099', 'AMMO3': '0.103', 'weapon5': '0.228', 'WEAPON5': '0.300', 'HITCOUNT': '0.510', 'WEAPON3': '0.650', 'ARMOR': '1.200', 'weapon2': '1.434', 'weapon3': '1.764', 'DAMAGECOUNT': '2.079', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:01:10,151][2409486] DAMAGECOUNT value on done: 3382.0
[2023-02-25 13:01:10,154][2409486] Sum rewards: 7.211, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.605', 'AMMO2': '0.004', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.017', 'weapon5': '0.044', 'AMMO3': '0.068', 'weapon7': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.410', 'WEAPON3': '0.450', 'HITCOUNT': '0.780', 'weapon3': '1.130', 'weapon2': '1.558', 'DAMAGECOUNT': '2.970', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:01:10,227][2409104] DAMAGECOUNT value on done: 3539.0
[2023-02-25 13:01:10,228][2409104] Sum rewards: 4.797, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.770', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.032', 'WEAPON1': '0.050', 'AMMO3': '0.067', 'weapon7': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.300', 'weapon4': '0.416', 'WEAPON3': '0.450', 'ARMOR': '0.458', 'weapon3': '1.290', 'DAMAGECOUNT': '1.428', 'weapon2': '1.446', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:01:10,282][2409075] DAMAGECOUNT value on done: 3475.0
[2023-02-25 13:01:10,283][2409075] Sum rewards: 1.686, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.564', 'AMMO5': '0.012', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.093', 'AMMO3': '0.100', 'weapon5': '0.168', 'WEAPON4': '0.250', 'weapon4': '0.252', 'WEAPON5': '0.300', 'HITCOUNT': '0.470', 'WEAPON3': '0.700', 'ARMOR': '0.847', 'weapon2': '1.572', 'DAMAGECOUNT': '1.698', 'weapon3': '1.748', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:01:10,306][2409406] DAMAGECOUNT value on done: 3552.0
[2023-02-25 13:01:10,307][2409406] Sum rewards: 14.056, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.955', 'AMMO5': '0.003', 'AMMO2': '0.004', 'WEAPON1': '0.020', 'AMMO4': '0.020', 'weapon5': '0.048', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.322', 'HITCOUNT': '0.530', 'WEAPON3': '0.550', 'weapon3': '1.050', 'weapon2': '1.280', 'DAMAGECOUNT': '2.589', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:01:10,346][2409405] DAMAGECOUNT value on done: 2340.0
[2023-02-25 13:01:10,351][2409405] Sum rewards: 2.512, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.460', 'AMMO2': '0.003', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.016', 'weapon7': '0.050', 'AMMO3': '0.058', 'weapon5': '0.078', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.222', 'HITCOUNT': '0.280', 'WEAPON3': '0.400', 'ARMOR': '0.476', 'DAMAGECOUNT': '0.885', 'FRAGCOUNT': '1.000', 'weapon3': '1.110', 'weapon2': '1.436'}
[2023-02-25 13:01:10,397][2409547] DAMAGECOUNT value on done: 3301.0
[2023-02-25 13:01:10,401][2409547] Sum rewards: 3.262, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.831', 'AMMO2': '0.006', 'AMMO5': '0.013', 'AMMO4': '0.027', 'weapon7': '0.048', 'WEAPON4': '0.050', 'weapon5': '0.064', 'WEAPON1': '0.070', 'AMMO3': '0.073', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.240', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'HITCOUNT': '0.580', 'weapon2': '1.608', 'weapon3': '1.754', 'DAMAGECOUNT': '2.070', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:01:10,418][2409077] DAMAGECOUNT value on done: 3792.0
[2023-02-25 13:01:10,419][2409077] Sum rewards: 9.714, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.006', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'HEALTH': '0.025', 'AMMO3': '0.040', 'AMMO4': '0.056', 'weapon5': '0.092', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON3': '0.300', 'weapon4': '0.302', 'ARMOR': '0.420', 'HITCOUNT': '0.540', 'weapon3': '0.988', 'weapon2': '1.534', 'DAMAGECOUNT': '1.980', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:01:10,970][2409866] DAMAGECOUNT value on done: 3305.0
[2023-02-25 13:01:10,974][2409866] Sum rewards: -1.341, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.454', 'AMMO2': '0.019', 'AMMO5': '0.020', 'WEAPON1': '0.060', 'weapon5': '0.060', 'AMMO4': '0.095', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'weapon4': '0.268', 'HITCOUNT': '0.360', 'ARMOR': '0.412', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'DAMAGECOUNT': '1.119', 'weapon2': '1.218', 'weapon3': '1.616', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:01:11,199][2409469] DAMAGECOUNT value on done: 3285.0
[2023-02-25 13:01:11,201][2409469] Sum rewards: 7.116, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.592', 'AMMO5': '0.012', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.048', 'weapon7': '0.062', 'AMMO4': '0.096', 'weapon5': '0.138', 'WEAPON4': '0.250', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'HITCOUNT': '0.400', 'ARMOR': '0.408', 'weapon4': '0.484', 'weapon3': '0.812', 'weapon2': '1.256', 'DAMAGECOUNT': '2.352', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:01:11,282][2409407] DAMAGECOUNT value on done: 3596.0
[2023-02-25 13:01:11,283][2409407] Sum rewards: 2.715, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.652', 'weapon7': '0.002', 'AMMO5': '0.012', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.103', 'AMMO4': '0.106', 'weapon5': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.370', 'WEAPON3': '0.550', 'HITCOUNT': '0.740', 'ARMOR': '1.300', 'weapon3': '1.424', 'weapon2': '1.510', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.406'}
[2023-02-25 13:01:11,345][2409074] Updated weights for policy 0, policy_version 15651 (0.0012)
[2023-02-25 13:01:11,616][2409076] DAMAGECOUNT value on done: 3836.0
[2023-02-25 13:01:11,616][2409076] Sum rewards: 3.149, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'ARMOR': '0.032', 'AMMO3': '0.080', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'weapon5': '0.158', 'WEAPON5': '0.300', 'weapon4': '0.342', 'HITCOUNT': '0.400', 'WEAPON3': '0.500', 'HEALTH': '0.590', 'weapon2': '1.104', 'weapon3': '1.272', 'DAMAGECOUNT': '1.755', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:01:11,735][2409389] DAMAGECOUNT value on done: 4468.0
[2023-02-25 13:01:11,739][2409389] Sum rewards: 5.106, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.395', 'AMMO5': '0.010', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'weapon7': '0.052', 'weapon5': '0.054', 'AMMO3': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.330', 'HITCOUNT': '0.430', 'ARMOR': '0.475', 'WEAPON3': '0.550', 'weapon2': '1.402', 'weapon3': '1.606', 'DAMAGECOUNT': '1.671', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:01:11,992][2409373] DAMAGECOUNT value on done: 2758.0
[2023-02-25 13:01:11,994][2409373] Sum rewards: 0.898, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.606', 'AMMO5': '0.015', 'AMMO2': '0.018', 'AMMO3': '0.055', 'AMMO4': '0.089', 'weapon7': '0.116', 'HITCOUNT': '0.140', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon3': '0.294', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.300', 'weapon4': '0.346', 'DAMAGECOUNT': '0.441', 'FRAGCOUNT': '1.000', 'ARMOR': '1.314', 'weapon2': '1.386'}
[2023-02-25 13:01:12,174][2409079] DAMAGECOUNT value on done: 3965.0
[2023-02-25 13:01:12,176][2409079] Sum rewards: 9.205, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.964', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.076', 'weapon5': '0.114', 'WEAPON5': '0.250', 'HITCOUNT': '0.580', 'WEAPON3': '0.650', 'weapon3': '1.600', 'weapon2': '1.850', 'DAMAGECOUNT': '2.283', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:01:12,186][2408954] Fps is (10 sec: 25395.5, 60 sec: 25395.3, 300 sec: 25561.8). Total num frames: 64126976. Throughput: 0: 6353.9. Samples: 16032216. Policy #0 lag: (min: 0.0, avg: 11.8, max: 25.0)
[2023-02-25 13:01:12,186][2408954] Avg episode reward: [(0, '4.807')]
[2023-02-25 13:01:12,306][2409099] DAMAGECOUNT value on done: 3070.0
[2023-02-25 13:01:12,307][2409099] Sum rewards: 2.142, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.665', 'AMMO2': '0.010', 'AMMO5': '0.013', 'ARMOR': '0.040', 'WEAPON1': '0.040', 'AMMO4': '0.049', 'weapon5': '0.056', 'AMMO3': '0.092', 'weapon7': '0.106', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HITCOUNT': '0.290', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.650', 'weapon4': '0.806', 'weapon2': '0.854', 'weapon3': '1.138', 'DAMAGECOUNT': '1.323', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:01:12,602][2409096] DAMAGECOUNT value on done: 2669.0
[2023-02-25 13:01:12,603][2409096] Sum rewards: 0.111, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.946', 'AMMO5': '0.018', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.096', 'AMMO3': '0.137', 'weapon5': '0.232', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'HITCOUNT': '0.400', 'weapon4': '0.410', 'WEAPON3': '0.800', 'ARMOR': '0.832', 'weapon2': '0.864', 'DAMAGECOUNT': '1.395', 'FRAGCOUNT': '1.500', 'weapon3': '1.984'}
[2023-02-25 13:01:12,929][2409355] DAMAGECOUNT value on done: 3107.0
[2023-02-25 13:01:12,933][2409355] Sum rewards: 4.346, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.228', 'AMMO5': '0.012', 'AMMO2': '0.024', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'weapon5': '0.106', 'AMMO4': '0.118', 'AMMO3': '0.119', 'weapon4': '0.222', 'WEAPON5': '0.300', 'ARMOR': '0.457', 'HITCOUNT': '0.610', 'WEAPON3': '0.800', 'weapon2': '1.290', 'weapon3': '1.886', 'DAMAGECOUNT': '2.010', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:01:13,038][2409074] Updated weights for policy 0, policy_version 15661 (0.0012)
[2023-02-25 13:01:13,719][2409596] DAMAGECOUNT value on done: 3927.0
[2023-02-25 13:01:13,721][2409596] Sum rewards: 9.679, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.307', 'ARMOR': '0.004', 'AMMO2': '0.010', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'AMMO4': '0.050', 'WEAPON4': '0.250', 'weapon5': '0.278', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'weapon4': '0.460', 'HITCOUNT': '0.500', 'weapon3': '0.972', 'weapon2': '1.746', 'DAMAGECOUNT': '2.643', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:01:13,742][2409097] DAMAGECOUNT value on done: 2775.0
[2023-02-25 13:01:13,743][2409097] Sum rewards: 6.433, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.222', 'AMMO2': '0.011', 'AMMO5': '0.011', 'WEAPON1': '0.040', 'AMMO4': '0.055', 'weapon7': '0.070', 'AMMO3': '0.074', 'weapon5': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.570', 'weapon4': '0.594', 'weapon2': '0.922', 'weapon3': '1.650', 'DAMAGECOUNT': '2.409', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:01:13,900][2409104] DAMAGECOUNT value on done: 4339.0
[2023-02-25 13:01:13,901][2409104] Sum rewards: 14.283, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.257', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.060', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.122', 'weapon4': '0.198', 'WEAPON7': '0.200', 'WEAPON3': '0.450', 'HITCOUNT': '0.660', 'ARMOR': '0.964', 'weapon2': '1.444', 'weapon3': '1.532', 'DAMAGECOUNT': '3.123', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:01:13,934][2409406] DAMAGECOUNT value on done: 3872.0
[2023-02-25 13:01:13,938][2409406] Sum rewards: 2.251, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.373', 'AMMO2': '0.003', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.013', 'AMMO3': '0.047', 'weapon5': '0.050', 'weapon7': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.264', 'HITCOUNT': '0.290', 'WEAPON3': '0.350', 'weapon3': '0.824', 'weapon2': '0.830', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.230'}
[2023-02-25 13:01:14,049][2409486] DAMAGECOUNT value on done: 3245.0
[2023-02-25 13:01:14,050][2409486] Sum rewards: 4.078, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.980', 'AMMO2': '0.008', 'AMMO5': '0.012', 'AMMO4': '0.042', 'weapon7': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'weapon5': '0.210', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.310', 'WEAPON5': '0.350', 'weapon4': '0.400', 'WEAPON3': '0.600', 'ARMOR': '0.893', 'weapon2': '1.026', 'weapon3': '1.298', 'DAMAGECOUNT': '1.746', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:01:14,056][2409077] DAMAGECOUNT value on done: 4011.0
[2023-02-25 13:01:14,057][2409077] Sum rewards: 1.346, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.995', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO3': '0.106', 'AMMO4': '0.108', 'weapon4': '0.114', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'ARMOR': '0.431', 'HITCOUNT': '0.470', 'WEAPON3': '0.800', 'weapon2': '1.108', 'DAMAGECOUNT': '1.596', 'weapon3': '2.324', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:01:14,088][2409075] DAMAGECOUNT value on done: 3547.0
[2023-02-25 13:01:14,089][2409075] Sum rewards: 7.961, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.424', 'AMMO2': '0.004', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO4': '0.020', 'weapon7': '0.050', 'AMMO3': '0.080', 'weapon5': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'HITCOUNT': '0.460', 'WEAPON3': '0.550', 'weapon2': '0.690', 'weapon4': '0.758', 'weapon3': '0.968', 'DAMAGECOUNT': '2.097', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:01:14,378][2409078] DAMAGECOUNT value on done: 4090.0
[2023-02-25 13:01:14,382][2409078] Sum rewards: 9.025, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.762', 'AMMO5': '0.012', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'AMMO3': '0.079', 'AMMO4': '0.116', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon5': '0.300', 'weapon4': '0.374', 'WEAPON3': '0.550', 'HITCOUNT': '0.650', 'ARMOR': '1.200', 'weapon3': '1.364', 'weapon2': '1.522', 'DAMAGECOUNT': '3.216', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:01:14,511][2409547] DAMAGECOUNT value on done: 3682.0
[2023-02-25 13:01:14,512][2409547] Sum rewards: 3.760, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'AMMO3': '0.060', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'HITCOUNT': '0.310', 'WEAPON3': '0.350', 'HEALTH': '0.404', 'weapon4': '0.502', 'ARMOR': '0.800', 'weapon2': '0.808', 'weapon3': '1.214', 'DAMAGECOUNT': '1.335', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:01:14,559][2409405] DAMAGECOUNT value on done: 3541.0
[2023-02-25 13:01:14,563][2409405] Sum rewards: 4.473, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.054', 'AMMO5': '0.003', 'AMMO2': '0.013', 'AMMO3': '0.038', 'weapon7': '0.050', 'weapon4': '0.050', 'weapon5': '0.058', 'AMMO4': '0.065', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.200', 'WEAPON3': '0.250', 'ARMOR': '0.400', 'weapon2': '0.466', 'weapon3': '0.524', 'DAMAGECOUNT': '1.161', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:01:14,598][2409074] Updated weights for policy 0, policy_version 15671 (0.0013)
[2023-02-25 13:01:14,652][2409866] DAMAGECOUNT value on done: 3764.0
[2023-02-25 13:01:14,653][2409866] Sum rewards: 9.832, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon7': '0.046', 'AMMO3': '0.051', 'HEALTH': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'weapon5': '0.190', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.460', 'weapon4': '0.546', 'weapon3': '1.064', 'weapon2': '1.218', 'DAMAGECOUNT': '2.409', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:01:15,387][2409407] DAMAGECOUNT value on done: 3381.0
[2023-02-25 13:01:15,388][2409407] Sum rewards: 5.289, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.764', 'AMMO5': '0.012', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'AMMO3': '0.082', 'AMMO4': '0.092', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon4': '0.420', 'WEAPON3': '0.550', 'HITCOUNT': '0.660', 'weapon2': '1.378', 'weapon3': '1.424', 'DAMAGECOUNT': '2.607', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:01:15,511][2409389] DAMAGECOUNT value on done: 3481.0
[2023-02-25 13:01:15,511][2409389] Sum rewards: 1.189, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.392', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon5': '0.058', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon4': '0.102', 'AMMO4': '0.107', 'AMMO3': '0.125', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.620', 'WEAPON3': '0.800', 'weapon3': '1.630', 'weapon2': '1.730', 'DAMAGECOUNT': '1.905', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:01:15,597][2409469] DAMAGECOUNT value on done: 3135.0
[2023-02-25 13:01:15,599][2409469] Sum rewards: 4.554, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.049', 'AMMO3': '0.107', 'weapon5': '0.124', 'HEALTH': '0.164', 'WEAPON5': '0.300', 'HITCOUNT': '0.490', 'WEAPON3': '0.550', 'ARMOR': '0.851', 'weapon2': '1.692', 'weapon3': '1.844', 'DAMAGECOUNT': '1.860', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:01:15,732][2409076] DAMAGECOUNT value on done: 4121.0
[2023-02-25 13:01:15,733][2409076] Sum rewards: 5.652, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.709', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.056', 'AMMO3': '0.093', 'weapon5': '0.102', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.488', 'weapon4': '0.496', 'HITCOUNT': '0.530', 'WEAPON3': '0.650', 'weapon2': '0.970', 'weapon3': '1.544', 'DAMAGECOUNT': '2.040', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:01:16,242][2409079] DAMAGECOUNT value on done: 3832.0
[2023-02-25 13:01:16,243][2409079] Sum rewards: 12.144, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.151', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon7': '0.020', 'AMMO3': '0.057', 'AMMO4': '0.073', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.350', 'weapon4': '0.452', 'HITCOUNT': '0.850', 'weapon3': '1.006', 'weapon2': '1.290', 'DAMAGECOUNT': '2.916', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:01:16,245][2409373] DAMAGECOUNT value on done: 3895.0
[2023-02-25 13:01:16,247][2409373] Sum rewards: 10.644, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.064', 'AMMO4': '0.101', 'weapon5': '0.158', 'WEAPON5': '0.300', 'HEALTH': '0.354', 'WEAPON3': '0.400', 'weapon4': '0.418', 'ARMOR': '0.432', 'HITCOUNT': '0.540', 'weapon3': '1.060', 'weapon2': '1.444', 'DAMAGECOUNT': '2.523', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:01:16,278][2409099] DAMAGECOUNT value on done: 3537.0
[2023-02-25 13:01:16,279][2409099] Sum rewards: 5.678, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.056', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.029', 'weapon5': '0.054', 'AMMO3': '0.076', 'weapon7': '0.082', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.200', 'weapon2': '0.382', 'WEAPON3': '0.400', 'ARMOR': '0.489', 'weapon4': '0.862', 'weapon3': '1.452', 'DAMAGECOUNT': '1.557', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:01:16,353][2409074] Updated weights for policy 0, policy_version 15681 (0.0012)
[2023-02-25 13:01:16,629][2409355] DAMAGECOUNT value on done: 3703.0
[2023-02-25 13:01:16,630][2409355] Sum rewards: 2.779, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.028', 'AMMO5': '0.010', 'weapon4': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.078', 'weapon5': '0.090', 'AMMO3': '0.107', 'WEAPON5': '0.200', 'HITCOUNT': '0.440', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'weapon2': '1.640', 'DAMAGECOUNT': '1.668', 'weapon3': '1.948', 'FRAGCOUNT': '2.500'}
[2023-02-25 13:01:17,058][2409096] DAMAGECOUNT value on done: 4077.0
[2023-02-25 13:01:17,061][2409096] Sum rewards: 8.580, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.654', 'AMMO2': '0.013', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.062', 'weapon7': '0.064', 'AMMO3': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.164', 'WEAPON7': '0.200', 'weapon4': '0.332', 'WEAPON5': '0.400', 'HITCOUNT': '0.540', 'WEAPON3': '0.600', 'weapon2': '0.896', 'weapon3': '1.768', 'DAMAGECOUNT': '2.679', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:01:17,186][2408954] Fps is (10 sec: 25805.1, 60 sec: 25600.0, 300 sec: 25561.8). Total num frames: 64258048. Throughput: 0: 6352.5. Samples: 16070676. Policy #0 lag: (min: 0.0, avg: 12.7, max: 25.0)
[2023-02-25 13:01:17,186][2408954] Avg episode reward: [(0, '5.195')]
[2023-02-25 13:01:17,422][2409406] DAMAGECOUNT value on done: 3368.0
[2023-02-25 13:01:17,425][2409406] Sum rewards: 1.332, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.364', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.034', 'weapon5': '0.106', 'AMMO3': '0.108', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.470', 'ARMOR': '0.478', 'weapon4': '0.504', 'WEAPON3': '0.750', 'weapon2': '0.880', 'weapon3': '1.500', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.031'}
[2023-02-25 13:01:17,510][2409104] DAMAGECOUNT value on done: 2810.0
[2023-02-25 13:01:17,511][2409104] Sum rewards: 5.786, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.126', 'AMMO4': '-0.064', 'AMMO2': '-0.013', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'weapon7': '0.054', 'AMMO3': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.138', 'WEAPON5': '0.300', 'HITCOUNT': '0.380', 'WEAPON3': '0.500', 'ARMOR': '1.356', 'weapon3': '1.360', 'DAMAGECOUNT': '1.791', 'weapon2': '1.970', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:01:17,515][2409074] Updated weights for policy 0, policy_version 15691 (0.0012)
[2023-02-25 13:01:17,555][2409077] DAMAGECOUNT value on done: 2775.0
[2023-02-25 13:01:17,559][2409077] Sum rewards: 2.630, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.676', 'AMMO5': '0.008', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'weapon5': '0.050', 'AMMO4': '0.087', 'weapon7': '0.092', 'AMMO3': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.290', 'weapon4': '0.494', 'WEAPON3': '0.500', 'ARMOR': '0.870', 'weapon2': '1.152', 'DAMAGECOUNT': '1.218', 'weapon3': '1.314', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:01:17,606][2409097] DAMAGECOUNT value on done: 4038.0
[2023-02-25 13:01:17,609][2409097] Sum rewards: 9.410, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.658', 'AMMO5': '0.018', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'AMMO3': '0.088', 'AMMO4': '0.162', 'weapon5': '0.202', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.584', 'WEAPON3': '0.600', 'HITCOUNT': '0.660', 'ARMOR': '0.800', 'weapon3': '1.060', 'weapon2': '1.642', 'DAMAGECOUNT': '3.039', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:01:17,701][2409486] DAMAGECOUNT value on done: 4441.0
[2023-02-25 13:01:17,702][2409486] Sum rewards: 5.264, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.891', 'AMMO2': '0.006', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'AMMO3': '0.096', 'weapon5': '0.134', 'weapon4': '0.214', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.700', 'weapon3': '1.352', 'ARMOR': '1.738', 'weapon2': '1.974', 'FRAGCOUNT': '3.000', 'DAMAGECOUNT': '3.324'}
[2023-02-25 13:01:17,857][2409075] DAMAGECOUNT value on done: 2873.0
[2023-02-25 13:01:17,860][2409075] Sum rewards: 2.671, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.848', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO3': '0.072', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.151', 'weapon5': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.260', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.548', 'weapon2': '0.704', 'weapon3': '0.716', 'DAMAGECOUNT': '1.446', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:01:17,946][2409078] DAMAGECOUNT value on done: 3136.0
[2023-02-25 13:01:17,949][2409078] Sum rewards: 3.149, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.617', 'AMMO2': '0.012', 'AMMO5': '0.015', 'AMMO4': '0.059', 'AMMO3': '0.062', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'HITCOUNT': '0.360', 'weapon4': '0.428', 'WEAPON3': '0.450', 'ARMOR': '0.941', 'DAMAGECOUNT': '1.305', 'weapon3': '1.420', 'weapon2': '1.568', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:01:18,042][2409405] DAMAGECOUNT value on done: 4165.0
[2023-02-25 13:01:18,042][2409405] Sum rewards: 8.917, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.064', 'weapon7': '0.070', 'AMMO3': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HEALTH': '0.229', 'HITCOUNT': '0.450', 'weapon4': '0.478', 'WEAPON3': '0.550', 'ARMOR': '0.868', 'weapon2': '0.924', 'weapon3': '1.904', 'DAMAGECOUNT': '2.529', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:01:18,445][2409547] DAMAGECOUNT value on done: 3530.0
[2023-02-25 13:01:18,462][2409547] Sum rewards: 6.640, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.562', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'ARMOR': '0.032', 'AMMO3': '0.060', 'weapon7': '0.064', 'weapon5': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'HITCOUNT': '0.480', 'weapon2': '0.692', 'weapon4': '0.864', 'weapon3': '0.882', 'DAMAGECOUNT': '2.295', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:01:18,797][2409080] DAMAGECOUNT value on done: 4253.0
[2023-02-25 13:01:18,800][2409080] Sum rewards: 6.483, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO3': '0.040', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.079', 'HEALTH': '0.136', 'weapon4': '0.226', 'WEAPON3': '0.300', 'ARMOR': '0.441', 'HITCOUNT': '0.450', 'weapon3': '1.006', 'weapon2': '1.732', 'DAMAGECOUNT': '1.896', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:01:18,954][2409407] DAMAGECOUNT value on done: 3181.0
[2023-02-25 13:01:18,957][2409407] Sum rewards: 5.033, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.475', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'weapon7': '0.024', 'AMMO2': '0.026', 'AMMO3': '0.051', 'AMMO4': '0.127', 'weapon5': '0.176', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.520', 'weapon4': '0.776', 'ARMOR': '0.865', 'weapon2': '1.142', 'weapon3': '1.206', 'DAMAGECOUNT': '1.521', 'FRAGCOUNT': '3.500'}
[2023-02-25 13:01:19,154][2409389] DAMAGECOUNT value on done: 3338.0
[2023-02-25 13:01:19,157][2409389] Sum rewards: 6.668, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.012', 'HEALTH': '0.024', 'WEAPON5': '0.050', 'weapon7': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.380', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'weapon4': '0.412', 'weapon2': '0.514', 'weapon3': '1.082', 'DAMAGECOUNT': '1.515', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:01:19,399][2409469] DAMAGECOUNT value on done: 4377.0
[2023-02-25 13:01:19,400][2409469] Sum rewards: 0.193, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.306', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON1': '0.050', 'AMMO4': '0.103', 'AMMO3': '0.107', 'weapon5': '0.146', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'HITCOUNT': '0.380', 'weapon4': '0.448', 'ARMOR': '0.492', 'WEAPON3': '0.650', 'weapon2': '1.206', 'DAMAGECOUNT': '1.251', 'weapon3': '1.638', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:01:19,518][2409074] Updated weights for policy 0, policy_version 15701 (0.0012)
[2023-02-25 13:01:19,798][2409079] DAMAGECOUNT value on done: 3077.0
[2023-02-25 13:01:19,802][2409079] Sum rewards: 3.663, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.750', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.007', 'WEAPON1': '0.040', 'weapon5': '0.064', 'AMMO3': '0.084', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.398', 'HITCOUNT': '0.460', 'ARMOR': '0.496', 'WEAPON3': '0.700', 'weapon2': '1.322', 'weapon3': '1.410', 'DAMAGECOUNT': '1.431', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:01:20,148][2409099] DAMAGECOUNT value on done: 4219.0
[2023-02-25 13:01:20,151][2409099] Sum rewards: 2.035, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.120', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.060', 'AMMO3': '0.068', 'WEAPON5': '0.150', 'weapon5': '0.174', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.301', 'HITCOUNT': '0.310', 'WEAPON3': '0.350', 'weapon4': '0.370', 'WEAPON4': '0.400', 'weapon3': '1.138', 'weapon2': '1.536', 'DAMAGECOUNT': '1.920', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:01:20,687][2409074] Updated weights for policy 0, policy_version 15711 (0.0012)
[2023-02-25 13:01:20,885][2409096] DAMAGECOUNT value on done: 3225.0
[2023-02-25 13:01:20,886][2409096] Sum rewards: 5.675, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.184', 'AMMO4': '-0.054', 'AMMO2': '-0.011', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.143', 'weapon5': '0.182', 'weapon4': '0.228', 'WEAPON5': '0.300', 'HITCOUNT': '0.530', 'WEAPON3': '0.850', 'ARMOR': '0.898', 'weapon2': '1.264', 'DAMAGECOUNT': '1.806', 'weapon3': '1.820', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:01:20,996][2409076] DAMAGECOUNT value on done: 3370.0
[2023-02-25 13:01:20,997][2409076] Sum rewards: 6.710, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.211', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.015', 'AMMO3': '0.030', 'weapon5': '0.048', 'weapon7': '0.052', 'weapon4': '0.066', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.457', 'HITCOUNT': '0.510', 'weapon3': '0.716', 'weapon2': '1.374', 'DAMAGECOUNT': '2.754', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:01:21,360][2409097] DAMAGECOUNT value on done: 3422.0
[2023-02-25 13:01:21,360][2409097] Sum rewards: 1.865, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.665', 'AMMO2': '0.003', 'AMMO4': '0.012', 'AMMO5': '0.017', 'WEAPON4': '0.050', 'WEAPON1': '0.050', 'weapon4': '0.078', 'AMMO3': '0.117', 'weapon5': '0.228', 'HITCOUNT': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'ARMOR': '1.251', 'DAMAGECOUNT': '1.326', 'weapon3': '1.508', 'weapon2': '1.690', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:01:21,537][2409104] DAMAGECOUNT value on done: 3023.0
[2023-02-25 13:01:21,540][2409104] Sum rewards: 1.289, reward structure: {'DEATHCOUNT': '-6.000', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO3': '0.065', 'AMMO4': '0.070', 'HEALTH': '0.072', 'weapon4': '0.126', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'weapon5': '0.168', 'WEAPON5': '0.200', 'WEAPON3': '0.350', 'ARMOR': '0.451', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.038', 'weapon3': '1.214', 'weapon2': '2.218'}
[2023-02-25 13:01:21,631][2409078] DAMAGECOUNT value on done: 3248.0
[2023-02-25 13:01:21,632][2409078] Sum rewards: 1.987, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.699', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'AMMO3': '0.062', 'weapon5': '0.098', 'WEAPON5': '0.100', 'weapon7': '0.100', 'HITCOUNT': '0.110', 'AMMO4': '0.133', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'weapon4': '0.562', 'DAMAGECOUNT': '0.771', 'ARMOR': '0.880', 'weapon3': '0.944', 'weapon2': '1.476', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:01:21,727][2409405] DAMAGECOUNT value on done: 2880.0
[2023-02-25 13:01:21,728][2409405] Sum rewards: 5.389, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'AMMO2': '0.026', 'WEAPON1': '0.040', 'AMMO3': '0.065', 'WEAPON4': '0.100', 'AMMO4': '0.128', 'weapon5': '0.146', 'WEAPON5': '0.150', 'weapon4': '0.256', 'ARMOR': '0.400', 'HITCOUNT': '0.400', 'WEAPON3': '0.400', 'HEALTH': '0.520', 'weapon3': '1.420', 'weapon2': '1.530', 'DAMAGECOUNT': '1.800', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:01:21,748][2409486] DAMAGECOUNT value on done: 4154.0
[2023-02-25 13:01:21,748][2409486] Sum rewards: 8.836, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.266', 'AMMO5': '0.015', 'AMMO2': '0.018', 'AMMO4': '0.087', 'AMMO3': '0.109', 'weapon5': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'weapon4': '0.364', 'ARMOR': '0.455', 'HITCOUNT': '0.480', 'WEAPON3': '0.600', 'weapon2': '1.232', 'weapon3': '1.590', 'DAMAGECOUNT': '2.556', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:01:21,939][2409075] DAMAGECOUNT value on done: 3669.0
[2023-02-25 13:01:21,940][2409075] Sum rewards: 9.949, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.835', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO3': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.160', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'weapon4': '0.470', 'ARMOR': '0.471', 'weapon2': '0.546', 'HITCOUNT': '0.560', 'weapon3': '1.274', 'DAMAGECOUNT': '2.577', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:01:22,186][2408954] Fps is (10 sec: 25394.8, 60 sec: 25327.0, 300 sec: 25589.6). Total num frames: 64380928. Throughput: 0: 6369.8. Samples: 16089900. Policy #0 lag: (min: 0.0, avg: 12.7, max: 25.0)
[2023-02-25 13:01:22,186][2408954] Avg episode reward: [(0, '5.002')]
[2023-02-25 13:01:22,494][2409547] DAMAGECOUNT value on done: 3381.0
[2023-02-25 13:01:22,496][2409547] Sum rewards: 5.239, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.776', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.020', 'AMMO2': '0.028', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'weapon7': '0.110', 'AMMO4': '0.137', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.370', 'ARMOR': '0.456', 'weapon4': '0.478', 'WEAPON3': '0.550', 'weapon2': '0.734', 'weapon3': '1.294', 'DAMAGECOUNT': '1.824', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:01:22,614][2409074] Updated weights for policy 0, policy_version 15721 (0.0012)
[2023-02-25 13:01:22,760][2409080] DAMAGECOUNT value on done: 3260.0
[2023-02-25 13:01:22,763][2409080] Sum rewards: 3.650, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.876', 'AMMO4': '-0.013', 'AMMO2': '-0.002', 'AMMO5': '0.021', 'WEAPON1': '0.060', 'AMMO3': '0.068', 'weapon5': '0.170', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'WEAPON5': '0.550', 'ARMOR': '0.857', 'weapon3': '1.134', 'DAMAGECOUNT': '1.485', 'weapon2': '1.716', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:01:22,950][2409407] DAMAGECOUNT value on done: 3014.0
[2023-02-25 13:01:22,951][2409407] Sum rewards: -1.618, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.721', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.010', 'AMMO2': '0.030', 'WEAPON1': '0.040', 'ARMOR': '0.048', 'AMMO3': '0.050', 'weapon5': '0.072', 'AMMO4': '0.148', 'WEAPON5': '0.250', 'HITCOUNT': '0.280', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.564', 'weapon3': '1.052', 'DAMAGECOUNT': '1.161', 'weapon2': '1.198'}
[2023-02-25 13:01:23,344][2409469] DAMAGECOUNT value on done: 3782.0
[2023-02-25 13:01:23,348][2409469] Sum rewards: 0.786, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.291', 'ARMOR': '0.012', 'AMMO5': '0.020', 'AMMO2': '0.028', 'WEAPON1': '0.050', 'AMMO3': '0.091', 'AMMO4': '0.142', 'weapon4': '0.276', 'weapon5': '0.314', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'HITCOUNT': '0.470', 'WEAPON3': '0.550', 'weapon3': '1.304', 'FRAGCOUNT': '1.500', 'weapon2': '1.744', 'DAMAGECOUNT': '2.076'}
[2023-02-25 13:01:23,353][2409389] DAMAGECOUNT value on done: 3224.0
[2023-02-25 13:01:23,353][2409389] Sum rewards: 4.023, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.140', 'AMMO2': '0.005', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.023', 'weapon5': '0.056', 'weapon7': '0.058', 'AMMO3': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.320', 'ARMOR': '0.448', 'WEAPON3': '0.600', 'weapon4': '0.762', 'weapon2': '0.970', 'weapon3': '1.022', 'DAMAGECOUNT': '1.656', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:01:23,893][2409079] DAMAGECOUNT value on done: 3526.0
[2023-02-25 13:01:23,896][2409079] Sum rewards: 3.524, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.508', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO5': '0.020', 'AMMO4': '0.051', 'weapon5': '0.060', 'AMMO3': '0.106', 'WEAPON5': '0.400', 'HITCOUNT': '0.530', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'weapon3': '1.558', 'DAMAGECOUNT': '1.824', 'weapon2': '2.212', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:01:24,166][2409099] DAMAGECOUNT value on done: 2854.0
[2023-02-25 13:01:24,166][2409099] Sum rewards: 0.118, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.983', 'AMMO2': '0.004', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.021', 'weapon5': '0.082', 'AMMO3': '0.108', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'HITCOUNT': '0.450', 'weapon4': '0.542', 'WEAPON3': '0.750', 'ARMOR': '0.969', 'weapon2': '1.166', 'weapon3': '1.400', 'DAMAGECOUNT': '1.476', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:01:24,392][2409074] Updated weights for policy 0, policy_version 15731 (0.0012)
[2023-02-25 13:01:24,688][2409096] DAMAGECOUNT value on done: 4379.0
[2023-02-25 13:01:24,689][2409096] Sum rewards: 5.481, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.917', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'ARMOR': '0.020', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.114', 'AMMO3': '0.124', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.480', 'HITCOUNT': '0.610', 'WEAPON3': '0.700', 'weapon3': '1.332', 'weapon2': '1.400', 'DAMAGECOUNT': '2.019', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:01:25,173][2409078] DAMAGECOUNT value on done: 3753.0
[2023-02-25 13:01:25,174][2409078] Sum rewards: 1.310, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.320', 'AMMO5': '0.014', 'AMMO2': '0.022', 'WEAPON1': '0.070', 'AMMO3': '0.091', 'weapon5': '0.104', 'AMMO4': '0.108', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.410', 'HITCOUNT': '0.510', 'WEAPON3': '0.650', 'weapon2': '1.206', 'FRAGCOUNT': '1.500', 'weapon3': '1.660', 'DAMAGECOUNT': '1.785'}
[2023-02-25 13:01:25,311][2409097] DAMAGECOUNT value on done: 3757.0
[2023-02-25 13:01:25,312][2409097] Sum rewards: 2.029, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.090', 'AMMO2': '0.004', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.021', 'AMMO3': '0.102', 'weapon5': '0.106', 'WEAPON4': '0.200', 'weapon4': '0.330', 'WEAPON5': '0.400', 'HITCOUNT': '0.520', 'WEAPON3': '0.750', 'ARMOR': '0.898', 'weapon2': '1.352', 'weapon3': '1.446', 'DAMAGECOUNT': '1.704', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:01:25,462][2409076] DAMAGECOUNT value on done: 3308.0
[2023-02-25 13:01:25,463][2409076] Sum rewards: 5.026, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.020', 'AMMO2': '0.009', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.044', 'weapon4': '0.046', 'AMMO3': '0.062', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.340', 'WEAPON3': '0.550', 'ARMOR': '0.910', 'weapon3': '1.298', 'DAMAGECOUNT': '1.647', 'weapon2': '2.224', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:01:25,468][2409486] DAMAGECOUNT value on done: 3083.0
[2023-02-25 13:01:25,471][2409486] Sum rewards: 3.225, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.227', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'AMMO3': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.076', 'WEAPON3': '0.300', 'HITCOUNT': '0.340', 'ARMOR': '0.430', 'weapon3': '0.978', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.026', 'weapon2': '2.204'}
[2023-02-25 13:01:25,661][2409074] Updated weights for policy 0, policy_version 15741 (0.0012)
[2023-02-25 13:01:26,315][2409075] DAMAGECOUNT value on done: 3769.0
[2023-02-25 13:01:26,315][2409547] DAMAGECOUNT value on done: 4451.0
[2023-02-25 13:01:26,316][2409547] Sum rewards: 3.623, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.702', 'weapon7': '0.006', 'AMMO2': '0.014', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'weapon4': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.111', 'weapon5': '0.134', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.500', 'WEAPON3': '0.650', 'ARMOR': '1.253', 'weapon2': '1.366', 'weapon3': '1.698', 'DAMAGECOUNT': '2.250', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:01:26,316][2409075] Sum rewards: 7.160, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.584', 'AMMO2': '0.003', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.015', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'weapon4': '0.104', 'weapon5': '0.166', 'WEAPON5': '0.200', 'HITCOUNT': '0.430', 'ARMOR': '0.454', 'WEAPON3': '0.600', 'weapon3': '1.386', 'DAMAGECOUNT': '2.076', 'weapon2': '2.108', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:01:26,567][2409080] DAMAGECOUNT value on done: 3350.0
[2023-02-25 13:01:26,568][2409080] Sum rewards: 4.093, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.936', 'AMMO2': '0.008', 'AMMO5': '0.012', 'AMMO4': '0.038', 'weapon4': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.132', 'weapon5': '0.156', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.370', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'weapon3': '1.418', 'DAMAGECOUNT': '1.530', 'weapon2': '1.880', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:01:27,028][2409469] DAMAGECOUNT value on done: 3253.0
[2023-02-25 13:01:27,029][2409469] Sum rewards: 1.950, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.235', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.054', 'AMMO3': '0.055', 'weapon7': '0.064', 'AMMO4': '0.077', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.255', 'weapon4': '0.270', 'WEAPON3': '0.350', 'ARMOR': '0.418', 'weapon3': '1.100', 'weapon2': '1.424', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:01:27,186][2408954] Fps is (10 sec: 24575.9, 60 sec: 25395.2, 300 sec: 25534.0). Total num frames: 64503808. Throughput: 0: 6366.7. Samples: 16127976. Policy #0 lag: (min: 0.0, avg: 12.7, max: 25.0)
[2023-02-25 13:01:27,186][2408954] Avg episode reward: [(0, '4.758')]
[2023-02-25 13:01:27,480][2409074] Updated weights for policy 0, policy_version 15751 (0.0012)
[2023-02-25 13:01:27,783][2409079] DAMAGECOUNT value on done: 3866.0
[2023-02-25 13:01:27,784][2409079] Sum rewards: 2.570, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.015', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.060', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'weapon4': '0.164', 'HITCOUNT': '0.230', 'weapon5': '0.230', 'HEALTH': '0.251', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'ARMOR': '0.861', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.200', 'weapon3': '1.358', 'weapon2': '1.534'}
[2023-02-25 13:01:27,907][2409099] DAMAGECOUNT value on done: 2994.0
[2023-02-25 13:01:27,908][2409099] Sum rewards: 0.866, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.364', 'AMMO5': '0.020', 'AMMO2': '0.021', 'WEAPON1': '0.050', 'AMMO4': '0.104', 'AMMO3': '0.104', 'weapon5': '0.138', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.402', 'HITCOUNT': '0.540', 'WEAPON3': '0.600', 'ARMOR': '0.800', 'weapon2': '1.302', 'weapon3': '1.546', 'DAMAGECOUNT': '1.953', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:01:28,644][2409074] Updated weights for policy 0, policy_version 15761 (0.0012)
[2023-02-25 13:01:28,755][2409096] DAMAGECOUNT value on done: 3632.0
[2023-02-25 13:01:28,758][2409096] Sum rewards: 8.792, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.870', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO3': '0.040', 'WEAPON1': '0.040', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'weapon5': '0.222', 'WEAPON3': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.460', 'HITCOUNT': '0.710', 'weapon3': '0.980', 'weapon2': '2.118', 'DAMAGECOUNT': '2.532', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:01:29,254][2409076] DAMAGECOUNT value on done: 3456.0
[2023-02-25 13:01:29,257][2409076] Sum rewards: 4.520, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.435', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.014', 'AMMO5': '0.015', 'weapon5': '0.074', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'weapon4': '0.170', 'WEAPON5': '0.300', 'ARMOR': '0.456', 'WEAPON3': '0.500', 'HITCOUNT': '0.600', 'weapon3': '1.484', 'weapon2': '1.964', 'DAMAGECOUNT': '2.190', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:01:29,286][2409078] DAMAGECOUNT value on done: 3615.0
[2023-02-25 13:01:29,287][2409078] Sum rewards: 7.536, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.266', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.044', 'AMMO3': '0.046', 'weapon7': '0.056', 'weapon5': '0.108', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'HITCOUNT': '0.380', 'weapon4': '0.486', 'ARMOR': '0.851', 'weapon3': '0.872', 'weapon2': '1.332', 'DAMAGECOUNT': '1.548', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:01:29,353][2409486] DAMAGECOUNT value on done: 2211.0
[2023-02-25 13:01:29,353][2409486] Sum rewards: 5.597, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.295', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'weapon5': '0.050', 'WEAPON5': '0.100', 'WEAPON3': '0.300', 'HITCOUNT': '0.330', 'ARMOR': '0.900', 'weapon3': '0.962', 'DAMAGECOUNT': '1.032', 'weapon2': '2.176', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:01:29,455][2409097] DAMAGECOUNT value on done: 4082.0
[2023-02-25 13:01:29,458][2409097] Sum rewards: 4.954, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.884', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO4': '0.044', 'AMMO3': '0.081', 'weapon4': '0.126', 'WEAPON4': '0.150', 'weapon5': '0.232', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'ARMOR': '0.812', 'HITCOUNT': '0.880', 'weapon3': '1.470', 'weapon2': '1.564', 'FRAGCOUNT': '2.500', 'DAMAGECOUNT': '2.928'}
[2023-02-25 13:01:30,212][2409075] DAMAGECOUNT value on done: 4295.0
[2023-02-25 13:01:30,213][2409075] Sum rewards: 4.613, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.460', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.050', 'weapon7': '0.050', 'AMMO3': '0.064', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.388', 'HITCOUNT': '0.410', 'ARMOR': '0.466', 'WEAPON3': '0.550', 'weapon2': '0.928', 'weapon3': '1.206', 'DAMAGECOUNT': '1.506', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:01:30,298][2409080] DAMAGECOUNT value on done: 2871.0
[2023-02-25 13:01:30,302][2409080] Sum rewards: 2.698, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.760', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO3': '0.026', 'weapon7': '0.056', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.180', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'weapon3': '0.330', 'ARMOR': '0.457', 'weapon2': '0.478', 'DAMAGECOUNT': '0.825', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:01:30,482][2409547] DAMAGECOUNT value on done: 2751.0
[2023-02-25 13:01:30,483][2409547] Sum rewards: 3.800, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.390', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO3': '0.068', 'weapon7': '0.106', 'weapon5': '0.112', 'AMMO4': '0.145', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'AMMO6': '0.420', 'AMMO7': '0.420', 'HITCOUNT': '0.420', 'WEAPON3': '0.500', 'WEAPON7': '0.500', 'weapon4': '0.662', 'weapon2': '1.036', 'weapon3': '1.120', 'DAMAGECOUNT': '1.842', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:01:30,689][2409074] Updated weights for policy 0, policy_version 15771 (0.0012)
[2023-02-25 13:01:31,384][2409469] DAMAGECOUNT value on done: 2744.0
[2023-02-25 13:01:31,388][2409469] Sum rewards: 2.910, reward structure: {'DEATHCOUNT': '-5.250', 'ARMOR': '0.028', 'AMMO2': '0.029', 'AMMO3': '0.070', 'HEALTH': '0.096', 'AMMO4': '0.145', 'WEAPON4': '0.350', 'HITCOUNT': '0.370', 'WEAPON3': '0.400', 'weapon4': '0.546', 'DAMAGECOUNT': '1.224', 'weapon3': '1.388', 'weapon2': '1.514', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:01:31,652][2409079] DAMAGECOUNT value on done: 3992.0
[2023-02-25 13:01:31,655][2409079] Sum rewards: 4.902, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.029', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'WEAPON1': '0.040', 'weapon5': '0.066', 'AMMO3': '0.070', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.520', 'weapon4': '0.520', 'WEAPON3': '0.550', 'ARMOR': '0.910', 'weapon3': '1.250', 'weapon2': '1.312', 'DAMAGECOUNT': '2.202', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:01:32,002][2409099] DAMAGECOUNT value on done: 3218.0
[2023-02-25 13:01:32,006][2409099] Sum rewards: 4.986, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.022', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO3': '0.044', 'AMMO4': '0.045', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.254', 'HITCOUNT': '0.290', 'WEAPON3': '0.300', 'weapon3': '0.814', 'weapon2': '1.328', 'DAMAGECOUNT': '1.452', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:01:32,186][2408954] Fps is (10 sec: 25395.2, 60 sec: 25395.2, 300 sec: 25534.0). Total num frames: 64634880. Throughput: 0: 6368.8. Samples: 16166328. Policy #0 lag: (min: 0.0, avg: 11.2, max: 24.0)
[2023-02-25 13:01:32,186][2408954] Avg episode reward: [(0, '4.775')]
[2023-02-25 13:01:32,239][2409074] Updated weights for policy 0, policy_version 15781 (0.0013)
[2023-02-25 13:01:32,676][2409096] DAMAGECOUNT value on done: 3828.0
[2023-02-25 13:01:32,677][2409096] Sum rewards: 1.111, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.037', 'AMMO4': '-0.066', 'AMMO2': '-0.013', 'AMMO5': '0.015', 'AMMO3': '0.081', 'weapon5': '0.088', 'WEAPON5': '0.300', 'HITCOUNT': '0.380', 'ARMOR': '0.473', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.354', 'weapon2': '1.616', 'DAMAGECOUNT': '1.620'}
[2023-02-25 13:01:32,838][2409468] DAMAGECOUNT value on done: 3985.0
[2023-02-25 13:01:32,841][2409468] Sum rewards: 8.097, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.514', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.061', 'AMMO3': '0.081', 'weapon5': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.352', 'HITCOUNT': '0.550', 'WEAPON3': '0.600', 'ARMOR': '0.971', 'weapon3': '1.350', 'weapon2': '1.404', 'DAMAGECOUNT': '2.625', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:01:32,841][2409078] DAMAGECOUNT value on done: 2817.0
[2023-02-25 13:01:32,845][2409078] Sum rewards: 1.451, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.775', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'AMMO3': '0.090', 'weapon5': '0.100', 'weapon4': '0.124', 'WEAPON4': '0.150', 'AMMO4': '0.159', 'HITCOUNT': '0.290', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.098', 'weapon2': '1.324', 'weapon3': '1.812', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:01:33,047][2409097] DAMAGECOUNT value on done: 3569.0
[2023-02-25 13:01:33,051][2409097] Sum rewards: 5.296, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.174', 'AMMO5': '0.012', 'AMMO2': '0.012', 'WEAPON1': '0.040', 'weapon7': '0.052', 'AMMO4': '0.061', 'weapon5': '0.072', 'AMMO3': '0.079', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.372', 'ARMOR': '0.400', 'HITCOUNT': '0.500', 'WEAPON3': '0.600', 'weapon2': '1.336', 'weapon3': '1.532', 'DAMAGECOUNT': '2.511', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:01:33,216][2409076] DAMAGECOUNT value on done: 3245.0
[2023-02-25 13:01:33,218][2409486] DAMAGECOUNT value on done: 4299.0
[2023-02-25 13:01:33,220][2409486] Sum rewards: 5.588, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.008', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'weapon7': '0.028', 'AMMO3': '0.076', 'AMMO4': '0.083', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.420', 'WEAPON3': '0.600', 'HITCOUNT': '0.710', 'weapon4': '0.722', 'weapon2': '0.770', 'weapon3': '1.428', 'DAMAGECOUNT': '2.571', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:01:33,230][2409076] Sum rewards: 3.017, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.781', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'WEAPON1': '0.040', 'weapon5': '0.054', 'AMMO3': '0.056', 'WEAPON4': '0.100', 'weapon7': '0.134', 'HITCOUNT': '0.180', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.294', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'weapon3': '0.740', 'weapon2': '0.908', 'DAMAGECOUNT': '1.065', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:01:33,783][2409074] Updated weights for policy 0, policy_version 15791 (0.0012)
[2023-02-25 13:01:33,881][2409075] DAMAGECOUNT value on done: 3253.0
[2023-02-25 13:01:33,885][2409075] Sum rewards: 1.444, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.940', 'AMMO2': '0.009', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.043', 'weapon4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'weapon5': '0.188', 'WEAPON5': '0.300', 'HITCOUNT': '0.310', 'WEAPON3': '0.700', 'ARMOR': '1.308', 'DAMAGECOUNT': '1.587', 'weapon3': '1.588', 'weapon2': '1.754', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:01:34,060][2409080] DAMAGECOUNT value on done: 3214.0
[2023-02-25 13:01:34,061][2409080] Sum rewards: 7.009, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.262', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.017', 'weapon7': '0.052', 'WEAPON1': '0.060', 'AMMO3': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.182', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'HITCOUNT': '0.540', 'WEAPON3': '0.700', 'weapon3': '1.744', 'weapon2': '1.778', 'DAMAGECOUNT': '2.214', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:01:34,139][2409547] DAMAGECOUNT value on done: 3351.0
[2023-02-25 13:01:34,140][2409547] Sum rewards: 1.372, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.924', 'AMMO2': '0.014', 'AMMO5': '0.016', 'AMMO3': '0.041', 'WEAPON1': '0.060', 'AMMO4': '0.072', 'weapon7': '0.078', 'weapon5': '0.106', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.290', 'WEAPON5': '0.350', 'WEAPON3': '0.350', 'ARMOR': '0.408', 'weapon4': '0.462', 'weapon3': '0.974', 'DAMAGECOUNT': '1.038', 'weapon2': '1.766', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:01:35,611][2409074] Updated weights for policy 0, policy_version 15801 (0.0012)
[2023-02-25 13:01:35,653][2409079] DAMAGECOUNT value on done: 4112.0
[2023-02-25 13:01:35,656][2409079] Sum rewards: 7.405, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.851', 'AMMO2': '0.009', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.046', 'AMMO3': '0.075', 'WEAPON4': '0.150', 'weapon4': '0.176', 'weapon5': '0.190', 'WEAPON5': '0.300', 'HITCOUNT': '0.520', 'WEAPON3': '0.550', 'weapon3': '1.516', 'weapon2': '1.610', 'DAMAGECOUNT': '2.061', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:01:36,087][2409099] DAMAGECOUNT value on done: 4271.0
[2023-02-25 13:01:36,089][2409099] Sum rewards: 6.264, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.476', 'AMMO4': '-0.053', 'AMMO2': '-0.010', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'weapon7': '0.054', 'AMMO3': '0.070', 'weapon5': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.540', 'WEAPON3': '0.550', 'weapon2': '1.314', 'weapon3': '1.680', 'DAMAGECOUNT': '2.010', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:01:36,473][2409096] DAMAGECOUNT value on done: 2508.0
[2023-02-25 13:01:36,474][2409096] Sum rewards: 1.343, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.213', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'weapon5': '0.010', 'WEAPON1': '0.020', 'AMMO5': '0.028', 'WEAPON4': '0.050', 'weapon4': '0.054', 'AMMO3': '0.142', 'HITCOUNT': '0.330', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.203', 'ARMOR': '1.254', 'weapon2': '1.352', 'weapon3': '1.690', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:01:36,509][2409078] DAMAGECOUNT value on done: 3631.0
[2023-02-25 13:01:36,510][2409078] Sum rewards: 4.069, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.542', 'AMMO5': '0.015', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'weapon5': '0.112', 'AMMO4': '0.119', 'AMMO3': '0.146', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'weapon4': '0.474', 'HITCOUNT': '0.540', 'weapon2': '0.764', 'WEAPON3': '1.000', 'weapon3': '2.112', 'DAMAGECOUNT': '2.325', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:01:36,583][2409468] DAMAGECOUNT value on done: 2680.0
[2023-02-25 13:01:36,584][2409468] Sum rewards: 5.003, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.634', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO5': '0.014', 'AMMO3': '0.030', 'WEAPON1': '0.030', 'WEAPON4': '0.200', 'weapon5': '0.224', 'WEAPON3': '0.250', 'HITCOUNT': '0.260', 'weapon4': '0.284', 'WEAPON5': '0.400', 'weapon3': '0.766', 'ARMOR': '0.800', 'DAMAGECOUNT': '1.146', 'weapon2': '1.720', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:01:36,910][2409074] Updated weights for policy 0, policy_version 15811 (0.0013)
[2023-02-25 13:01:37,186][2408954] Fps is (10 sec: 26624.1, 60 sec: 25326.9, 300 sec: 25603.5). Total num frames: 64770048. Throughput: 0: 6380.5. Samples: 16185696. Policy #0 lag: (min: 0.0, avg: 11.2, max: 24.0)
[2023-02-25 13:01:37,186][2408954] Avg episode reward: [(0, '4.710')]
[2023-02-25 13:01:37,452][2409486] DAMAGECOUNT value on done: 2973.0
[2023-02-25 13:01:37,455][2409486] Sum rewards: 2.733, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.406', 'AMMO5': '0.012', 'AMMO2': '0.031', 'WEAPON1': '0.040', 'AMMO3': '0.075', 'AMMO4': '0.153', 'weapon5': '0.168', 'WEAPON4': '0.200', 'HITCOUNT': '0.290', 'WEAPON5': '0.300', 'weapon2': '0.410', 'WEAPON3': '0.500', 'weapon4': '0.654', 'DAMAGECOUNT': '0.870', 'ARMOR': '1.314', 'weapon3': '1.372', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:01:37,775][2409080] DAMAGECOUNT value on done: 3716.0
[2023-02-25 13:01:37,778][2409080] Sum rewards: 4.543, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.122', 'AMMO5': '0.015', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'AMMO4': '0.112', 'AMMO3': '0.120', 'weapon7': '0.128', 'weapon5': '0.134', 'WEAPON4': '0.200', 'weapon4': '0.204', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.540', 'WEAPON3': '0.700', 'weapon3': '1.192', 'ARMOR': '1.300', 'weapon2': '1.658', 'DAMAGECOUNT': '2.259', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:01:37,995][2409547] DAMAGECOUNT value on done: 3314.0
[2023-02-25 13:01:37,996][2409547] Sum rewards: 5.659, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.500', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'AMMO4': '0.050', 'weapon5': '0.056', 'AMMO3': '0.071', 'WEAPON5': '0.150', 'WEAPON3': '0.400', 'HITCOUNT': '0.430', 'ARMOR': '0.800', 'DAMAGECOUNT': '1.746', 'weapon3': '1.750', 'weapon2': '1.878', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:01:38,679][2409074] Updated weights for policy 0, policy_version 15821 (0.0012)
[2023-02-25 13:01:39,636][2409079] DAMAGECOUNT value on done: 3240.0
[2023-02-25 13:01:39,639][2409079] Sum rewards: 7.095, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO4': '0.090', 'weapon5': '0.110', 'AMMO3': '0.114', 'WEAPON4': '0.200', 'weapon4': '0.330', 'WEAPON5': '0.400', 'HEALTH': '0.405', 'ARMOR': '0.525', 'HITCOUNT': '0.610', 'WEAPON3': '0.650', 'weapon2': '0.992', 'weapon3': '2.068', 'DAMAGECOUNT': '2.790', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:01:40,115][2409099] DAMAGECOUNT value on done: 3780.0
[2023-02-25 13:01:40,116][2409099] Sum rewards: 2.077, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.211', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.033', 'AMMO3': '0.076', 'weapon5': '0.116', 'AMMO4': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.382', 'WEAPON3': '0.450', 'HITCOUNT': '0.490', 'ARMOR': '0.533', 'weapon3': '1.256', 'weapon2': '1.538', 'DAMAGECOUNT': '1.980', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:01:40,153][2409096] DAMAGECOUNT value on done: 3593.0
[2023-02-25 13:01:40,157][2409096] Sum rewards: 5.169, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.175', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.062', 'AMMO3': '0.090', 'weapon7': '0.098', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.232', 'HITCOUNT': '0.350', 'WEAPON3': '0.600', 'weapon2': '1.212', 'weapon3': '1.266', 'DAMAGECOUNT': '1.734', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:01:40,209][2409074] Updated weights for policy 0, policy_version 15831 (0.0013)
[2023-02-25 13:01:40,374][2409468] DAMAGECOUNT value on done: 4431.0
[2023-02-25 13:01:40,375][2409468] Sum rewards: 5.556, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.178', 'AMMO2': '0.007', 'AMMO5': '0.015', 'AMMO4': '0.034', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.124', 'weapon4': '0.238', 'WEAPON5': '0.300', 'ARMOR': '0.420', 'HITCOUNT': '0.680', 'WEAPON3': '0.750', 'weapon2': '1.366', 'weapon3': '1.746', 'DAMAGECOUNT': '2.604', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:01:41,237][2409486] DAMAGECOUNT value on done: 3712.0
[2023-02-25 13:01:41,238][2409486] Sum rewards: 3.437, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.150', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.037', 'weapon7': '0.048', 'AMMO3': '0.055', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.444', 'HITCOUNT': '0.470', 'ARMOR': '0.479', 'weapon3': '0.964', 'DAMAGECOUNT': '1.620', 'weapon2': '1.626', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:01:41,536][2409080] DAMAGECOUNT value on done: 3199.0
[2023-02-25 13:01:41,541][2409080] Sum rewards: -0.200, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.804', 'AMMO5': '0.010', 'ARMOR': '0.024', 'WEAPON1': '0.030', 'AMMO2': '0.049', 'AMMO3': '0.087', 'weapon5': '0.100', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.240', 'AMMO4': '0.245', 'WEAPON4': '0.450', 'weapon4': '0.488', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.930', 'weapon2': '1.310', 'weapon3': '1.540', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:01:41,702][2409547] DAMAGECOUNT value on done: 3647.0
[2023-02-25 13:01:41,705][2409547] Sum rewards: 8.843, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.774', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO3': '0.070', 'weapon5': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'ARMOR': '0.458', 'weapon4': '0.474', 'WEAPON3': '0.550', 'HITCOUNT': '0.650', 'weapon2': '1.206', 'weapon3': '1.584', 'DAMAGECOUNT': '2.421', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:01:41,816][2409074] Updated weights for policy 0, policy_version 15841 (0.0012)
[2023-02-25 13:01:42,186][2408954] Fps is (10 sec: 25395.3, 60 sec: 25395.2, 300 sec: 25547.9). Total num frames: 64888832. Throughput: 0: 6377.9. Samples: 16223904. Policy #0 lag: (min: 0.0, avg: 12.5, max: 28.0)
[2023-02-25 13:01:42,186][2408954] Avg episode reward: [(0, '4.687')]
[2023-02-25 13:01:43,258][2409074] Updated weights for policy 0, policy_version 15851 (0.0013)
[2023-02-25 13:01:43,623][2409079] DAMAGECOUNT value on done: 4612.0
[2023-02-25 13:01:43,625][2409079] Sum rewards: 3.892, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.465', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO2': '0.031', 'AMMO3': '0.083', 'weapon5': '0.112', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'weapon4': '0.452', 'WEAPON3': '0.500', 'HITCOUNT': '0.560', 'weapon2': '1.174', 'weapon3': '1.444', 'DAMAGECOUNT': '1.947', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:01:43,842][2409099] DAMAGECOUNT value on done: 3327.0
[2023-02-25 13:01:43,845][2409099] Sum rewards: 3.328, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.812', 'AMMO5': '0.009', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'AMMO3': '0.089', 'weapon5': '0.090', 'AMMO4': '0.090', 'weapon4': '0.126', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.350', 'ARMOR': '0.460', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.347', 'weapon3': '1.648', 'weapon2': '1.882', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:01:44,349][2409468] DAMAGECOUNT value on done: 2921.0
[2023-02-25 13:01:44,354][2409468] Sum rewards: 1.277, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.620', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon7': '0.054', 'AMMO3': '0.085', 'weapon5': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.400', 'weapon4': '0.476', 'WEAPON3': '0.600', 'weapon2': '0.964', 'DAMAGECOUNT': '1.176', 'weapon3': '1.184', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:01:44,519][2409096] DAMAGECOUNT value on done: 3988.0
[2023-02-25 13:01:44,522][2409096] Sum rewards: 11.529, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.202', 'AMMO5': '0.016', 'AMMO2': '0.036', 'AMMO3': '0.070', 'weapon5': '0.166', 'AMMO4': '0.178', 'WEAPON5': '0.350', 'ARMOR': '0.444', 'HITCOUNT': '0.530', 'WEAPON3': '0.550', 'WEAPON4': '0.600', 'weapon2': '0.622', 'weapon3': '0.984', 'weapon4': '1.116', 'DAMAGECOUNT': '2.319', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:01:44,861][2409074] Updated weights for policy 0, policy_version 15861 (0.0012)
[2023-02-25 13:01:45,307][2409486] DAMAGECOUNT value on done: 3029.0
[2023-02-25 13:01:45,308][2409486] Sum rewards: 2.810, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.380', 'AMMO4': '-0.069', 'AMMO2': '-0.014', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.034', 'weapon7': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.230', 'weapon4': '0.258', 'WEAPON3': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'ARMOR': '0.456', 'DAMAGECOUNT': '0.591', 'weapon3': '0.654', 'weapon2': '1.416', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:01:45,614][2409080] DAMAGECOUNT value on done: 3947.0
[2023-02-25 13:01:45,615][2409080] Sum rewards: 6.609, reward structure: {'DEATHCOUNT': '-6.000', 'weapon5': '0.002', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO3': '0.077', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'HEALTH': '0.186', 'weapon4': '0.214', 'WEAPON3': '0.450', 'ARMOR': '0.500', 'HITCOUNT': '0.630', 'weapon2': '1.518', 'weapon3': '1.518', 'DAMAGECOUNT': '2.205', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:01:45,734][2409547] DAMAGECOUNT value on done: 3649.0
[2023-02-25 13:01:45,737][2409547] Sum rewards: 2.986, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.900', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.040', 'WEAPON1': '0.060', 'AMMO3': '0.066', 'weapon5': '0.120', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'HITCOUNT': '0.410', 'WEAPON3': '0.600', 'ARMOR': '0.916', 'weapon3': '1.404', 'weapon2': '1.452', 'DAMAGECOUNT': '1.785', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:01:46,960][2409074] Updated weights for policy 0, policy_version 15871 (0.0012)
[2023-02-25 13:01:47,186][2408954] Fps is (10 sec: 24574.8, 60 sec: 25395.0, 300 sec: 25534.0). Total num frames: 65015808. Throughput: 0: 6373.8. Samples: 16261980. Policy #0 lag: (min: 0.0, avg: 12.5, max: 28.0)
[2023-02-25 13:01:47,187][2408954] Avg episode reward: [(0, '4.550')]
[2023-02-25 13:01:47,210][2409078] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:01:47,228][2409079] DAMAGECOUNT value on done: 3122.0
[2023-02-25 13:01:47,229][2409079] Sum rewards: 3.207, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.734', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO2': '0.025', 'weapon5': '0.098', 'WEAPON4': '0.100', 'AMMO4': '0.125', 'AMMO3': '0.134', 'weapon4': '0.260', 'ARMOR': '0.400', 'HITCOUNT': '0.460', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'weapon2': '1.390', 'weapon3': '1.636', 'DAMAGECOUNT': '1.968', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:01:47,929][2409074] Updated weights for policy 0, policy_version 15881 (0.0013)
[2023-02-25 13:01:48,497][2409468] DAMAGECOUNT value on done: 4061.0
[2023-02-25 13:01:48,498][2409468] Sum rewards: 8.656, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.678', 'AMMO5': '0.023', 'AMMO2': '0.024', 'weapon7': '0.028', 'WEAPON1': '0.030', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.121', 'WEAPON4': '0.150', 'weapon5': '0.176', 'weapon4': '0.376', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '0.830', 'weapon2': '1.148', 'weapon3': '1.698', 'ARMOR': '1.700', 'DAMAGECOUNT': '3.462', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:01:48,617][2409099] DAMAGECOUNT value on done: 3552.0
[2023-02-25 13:01:48,642][2409099] Sum rewards: 0.407, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.580', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO5': '0.022', 'AMMO3': '0.101', 'AMMO4': '0.104', 'weapon5': '0.158', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'weapon4': '0.268', 'WEAPON5': '0.450', 'ARMOR': '0.500', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.705', 'weapon2': '1.464', 'weapon3': '1.664', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:01:49,355][2409100] Large shaping reward 2.560 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.54, 180.0)]
[2023-02-25 13:01:49,433][2409547] DAMAGECOUNT value on done: 4158.0
[2023-02-25 13:01:49,434][2409547] Sum rewards: 5.878, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.180', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.030', 'AMMO3': '0.048', 'WEAPON5': '0.100', 'weapon5': '0.104', 'WEAPON3': '0.250', 'HITCOUNT': '0.350', 'ARMOR': '0.453', 'weapon3': '0.774', 'DAMAGECOUNT': '1.785', 'weapon2': '1.892', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:01:49,598][2409080] DAMAGECOUNT value on done: 3263.0
[2023-02-25 13:01:49,599][2409080] Sum rewards: -1.385, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.140', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon7': '0.046', 'weapon5': '0.050', 'HITCOUNT': '0.060', 'AMMO3': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.285', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon3': '0.488', 'weapon2': '0.868', 'FRAGCOUNT': '1.000'}
[2023-02-25 13:01:49,845][2409074] Updated weights for policy 0, policy_version 15891 (0.0012)
[2023-02-25 13:01:49,873][2409486] DAMAGECOUNT value on done: 4221.0
[2023-02-25 13:01:49,877][2409486] Sum rewards: 9.633, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.492', 'AMMO5': '0.017', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.066', 'weapon7': '0.090', 'AMMO4': '0.092', 'AMMO3': '0.109', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.264', 'WEAPON5': '0.350', 'ARMOR': '0.452', 'WEAPON3': '0.650', 'HITCOUNT': '0.680', 'weapon3': '1.486', 'weapon2': '1.572', 'DAMAGECOUNT': '3.567', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:01:51,055][2409079] DAMAGECOUNT value on done: 2603.0
[2023-02-25 13:01:51,056][2409079] Sum rewards: 5.532, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.080', 'AMMO5': '0.007', 'weapon5': '0.008', 'weapon7': '0.014', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'AMMO3': '0.118', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.418', 'ARMOR': '0.528', 'HITCOUNT': '0.550', 'WEAPON3': '0.700', 'weapon2': '1.066', 'weapon3': '1.626', 'DAMAGECOUNT': '1.881', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:01:51,376][2409074] Updated weights for policy 0, policy_version 15901 (0.0012)
[2023-02-25 13:01:52,186][2408954] Fps is (10 sec: 26214.2, 60 sec: 25463.4, 300 sec: 25589.6). Total num frames: 65150976. Throughput: 0: 6389.3. Samples: 16281600. Policy #0 lag: (min: 0.0, avg: 13.4, max: 26.0)
[2023-02-25 13:01:52,187][2408954] Avg episode reward: [(0, '4.540')]
[2023-02-25 13:01:52,202][2409468] DAMAGECOUNT value on done: 2855.0
[2023-02-25 13:01:52,679][2409099] DAMAGECOUNT value on done: 3343.0
[2023-02-25 13:01:52,682][2409099] Sum rewards: 6.103, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.362', 'AMMO5': '0.015', 'AMMO2': '0.019', 'WEAPON1': '0.050', 'AMMO4': '0.094', 'weapon5': '0.136', 'AMMO3': '0.151', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'ARMOR': '0.497', 'weapon4': '0.658', 'HITCOUNT': '0.790', 'WEAPON3': '1.000', 'weapon2': '1.076', 'weapon3': '1.788', 'DAMAGECOUNT': '2.691', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:01:53,224][2409547] DAMAGECOUNT value on done: 3711.0
[2023-02-25 13:01:53,230][2409547] Sum rewards: 1.851, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.402', 'AMMO2': '0.007', 'AMMO5': '0.013', 'AMMO4': '0.033', 'AMMO3': '0.050', 'weapon5': '0.096', 'weapon7': '0.106', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.350', 'HITCOUNT': '0.400', 'weapon4': '0.410', 'weapon3': '0.998', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.275', 'weapon2': '1.664'}
[2023-02-25 13:01:53,307][2409080] DAMAGECOUNT value on done: 4033.0
[2023-02-25 13:01:53,311][2409080] Sum rewards: 5.614, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.546', 'AMMO5': '0.017', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.182', 'weapon4': '0.290', 'ARMOR': '0.408', 'WEAPON5': '0.450', 'HITCOUNT': '0.520', 'WEAPON3': '0.650', 'weapon2': '1.222', 'weapon3': '1.654', 'DAMAGECOUNT': '1.908', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:01:53,418][2409074] Updated weights for policy 0, policy_version 15911 (0.0012)
[2023-02-25 13:01:54,899][2409074] Updated weights for policy 0, policy_version 15921 (0.0012)
[2023-02-25 13:01:56,133][2409074] Updated weights for policy 0, policy_version 15931 (0.0012)
[2023-02-25 13:01:56,239][2409468] DAMAGECOUNT value on done: 3440.0
[2023-02-25 13:01:56,240][2409468] Sum rewards: 2.596, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.674', 'AMMO2': '0.006', 'AMMO5': '0.018', 'weapon5': '0.018', 'AMMO4': '0.030', 'WEAPON1': '0.040', 'AMMO3': '0.111', 'WEAPON5': '0.350', 'HITCOUNT': '0.410', 'ARMOR': '0.456', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.425', 'weapon3': '1.698', 'weapon2': '1.708', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:01:56,547][2409099] DAMAGECOUNT value on done: 3756.0
[2023-02-25 13:01:56,548][2409099] Sum rewards: 4.096, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.194', 'weapon7': '0.002', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO5': '0.025', 'AMMO3': '0.093', 'AMMO4': '0.097', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.226', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.440', 'WEAPON5': '0.500', 'weapon4': '0.604', 'WEAPON3': '0.650', 'weapon2': '0.974', 'weapon3': '1.418', 'DAMAGECOUNT': '2.382', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:01:56,985][2409547] DAMAGECOUNT value on done: 2816.0
[2023-02-25 13:01:56,988][2409547] Sum rewards: 0.451, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.220', 'AMMO2': '0.007', 'AMMO4': '0.032', 'AMMO3': '0.084', 'HITCOUNT': '0.230', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'weapon4': '0.382', 'ARMOR': '0.475', 'weapon3': '0.842', 'DAMAGECOUNT': '0.855', 'FRAGCOUNT': '1.000', 'weapon2': '1.664'}
[2023-02-25 13:01:57,170][2409033] Signal inference workers to stop experience collection... (1950 times)
[2023-02-25 13:01:57,171][2409033] Signal inference workers to resume experience collection... (1950 times)
[2023-02-25 13:01:57,186][2408954] Fps is (10 sec: 25806.0, 60 sec: 25531.7, 300 sec: 25575.7). Total num frames: 65273856. Throughput: 0: 6390.7. Samples: 16319796. Policy #0 lag: (min: 0.0, avg: 13.4, max: 26.0)
[2023-02-25 13:01:57,186][2408954] Avg episode reward: [(0, '4.318')]
[2023-02-25 13:01:57,203][2409074] InferenceWorker_p0-w0: stopping experience collection (1950 times)
[2023-02-25 13:01:57,204][2409074] InferenceWorker_p0-w0: resuming experience collection (1950 times)
[2023-02-25 13:01:57,410][2409080] DAMAGECOUNT value on done: 3963.0
[2023-02-25 13:01:57,411][2409080] Sum rewards: 6.904, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.609', 'AMMO2': '0.006', 'AMMO4': '0.030', 'AMMO3': '0.064', 'WEAPON4': '0.200', 'WEAPON3': '0.350', 'weapon4': '0.416', 'HITCOUNT': '0.460', 'weapon2': '0.884', 'ARMOR': '1.352', 'DAMAGECOUNT': '1.449', 'weapon3': '1.552', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:01:57,862][2409074] Updated weights for policy 0, policy_version 15941 (0.0013)
[2023-02-25 13:01:59,360][2409074] Updated weights for policy 0, policy_version 15951 (0.0012)
[2023-02-25 13:02:00,288][2409468] DAMAGECOUNT value on done: 4623.0
[2023-02-25 13:02:00,289][2409468] Sum rewards: 5.890, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.224', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon7': '0.052', 'AMMO3': '0.091', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'AMMO4': '0.231', 'ARMOR': '0.400', 'WEAPON4': '0.450', 'HITCOUNT': '0.520', 'WEAPON3': '0.550', 'weapon4': '0.566', 'weapon3': '1.292', 'weapon2': '1.392', 'DAMAGECOUNT': '1.674', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:02:00,596][2409099] DAMAGECOUNT value on done: 3723.0
[2023-02-25 13:02:00,597][2409099] Sum rewards: 3.339, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.743', 'AMMO5': '0.017', 'AMMO2': '0.027', 'WEAPON1': '0.050', 'weapon5': '0.068', 'AMMO3': '0.109', 'AMMO4': '0.137', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.464', 'ARMOR': '0.472', 'HITCOUNT': '0.500', 'WEAPON3': '0.750', 'weapon2': '1.474', 'weapon3': '1.658', 'DAMAGECOUNT': '2.406', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:02:00,875][2409547] DAMAGECOUNT value on done: 3761.0
[2023-02-25 13:02:00,879][2409547] Sum rewards: 5.089, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.114', 'AMMO5': '0.010', 'AMMO2': '0.044', 'AMMO3': '0.074', 'weapon5': '0.168', 'AMMO4': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '0.620', 'weapon4': '0.820', 'weapon3': '0.832', 'ARMOR': '0.932', 'weapon2': '1.696', 'DAMAGECOUNT': '2.037', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:02:01,045][2409074] Updated weights for policy 0, policy_version 15961 (0.0012)
[2023-02-25 13:02:01,338][2409080] DAMAGECOUNT value on done: 3299.0
[2023-02-25 13:02:01,341][2409080] Sum rewards: 1.863, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.346', 'AMMO2': '0.005', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.022', 'AMMO3': '0.059', 'weapon7': '0.070', 'weapon5': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.298', 'HITCOUNT': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'weapon3': '1.046', 'DAMAGECOUNT': '1.203', 'weapon2': '1.206', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:02:02,186][2408954] Fps is (10 sec: 24986.0, 60 sec: 25463.5, 300 sec: 25520.2). Total num frames: 65400832. Throughput: 0: 6387.2. Samples: 16358100. Policy #0 lag: (min: 0.0, avg: 11.7, max: 23.0)
[2023-02-25 13:02:02,186][2408954] Avg episode reward: [(0, '4.258')]
[2023-02-25 13:02:02,707][2409074] Updated weights for policy 0, policy_version 15971 (0.0012)
[2023-02-25 13:02:04,075][2409468] DAMAGECOUNT value on done: 4339.0
[2023-02-25 13:02:04,076][2409468] Sum rewards: 7.372, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.555', 'AMMO5': '0.017', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'AMMO4': '0.088', 'AMMO3': '0.112', 'weapon5': '0.184', 'WEAPON4': '0.200', 'weapon4': '0.388', 'WEAPON5': '0.400', 'HITCOUNT': '0.610', 'WEAPON3': '0.800', 'ARMOR': '0.859', 'weapon2': '1.144', 'weapon3': '1.766', 'DAMAGECOUNT': '2.550', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:02:04,222][2409074] Updated weights for policy 0, policy_version 15981 (0.0012)
[2023-02-25 13:02:04,398][2409099] DAMAGECOUNT value on done: 3576.0
[2023-02-25 13:02:04,401][2409099] Sum rewards: 8.777, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.347', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO3': '0.050', 'AMMO4': '0.082', 'WEAPON5': '0.150', 'weapon5': '0.166', 'WEAPON4': '0.250', 'WEAPON3': '0.300', 'weapon4': '0.374', 'HITCOUNT': '0.540', 'ARMOR': '0.856', 'weapon3': '1.334', 'weapon2': '1.740', 'DAMAGECOUNT': '2.247', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:02:04,628][2409547] DAMAGECOUNT value on done: 3449.0
[2023-02-25 13:02:04,628][2409547] Sum rewards: 8.419, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.848', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'weapon7': '0.068', 'AMMO4': '0.089', 'AMMO3': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.196', 'weapon5': '0.244', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '0.640', 'ARMOR': '1.366', 'weapon3': '1.372', 'weapon2': '1.574', 'DAMAGECOUNT': '3.363', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:02:05,121][2409080] DAMAGECOUNT value on done: 2766.0
[2023-02-25 13:02:05,122][2409080] Sum rewards: 5.624, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.274', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.078', 'weapon5': '0.176', 'weapon4': '0.212', 'WEAPON5': '0.350', 'HITCOUNT': '0.380', 'WEAPON3': '0.600', 'ARMOR': '0.915', 'weapon3': '1.280', 'weapon2': '1.382', 'DAMAGECOUNT': '1.713', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:02:05,756][2409074] Updated weights for policy 0, policy_version 15991 (0.0012)
[2023-02-25 13:02:07,011][2409405] Large shaping reward -2.534 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 13:02:07,186][2408954] Fps is (10 sec: 26214.4, 60 sec: 25600.1, 300 sec: 25589.6). Total num frames: 65536000. Throughput: 0: 6394.7. Samples: 16377660. Policy #0 lag: (min: 0.0, avg: 11.7, max: 23.0)
[2023-02-25 13:02:07,186][2408954] Avg episode reward: [(0, '4.360')]
[2023-02-25 13:02:07,526][2409074] Updated weights for policy 0, policy_version 16001 (0.0012)
[2023-02-25 13:02:07,887][2409468] DAMAGECOUNT value on done: 3337.0
[2023-02-25 13:02:07,888][2409468] Sum rewards: 2.362, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.133', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO3': '0.063', 'weapon5': '0.106', 'AMMO4': '0.115', 'weapon7': '0.152', 'WEAPON5': '0.200', 'HITCOUNT': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.450', 'FRAGCOUNT': '0.500', 'weapon4': '0.502', 'weapon3': '0.886', 'DAMAGECOUNT': '1.455', 'ARMOR': '1.495', 'weapon2': '1.546'}
[2023-02-25 13:02:08,422][2409099] DAMAGECOUNT value on done: 4084.0
[2023-02-25 13:02:08,423][2409099] Sum rewards: 7.078, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.485', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO3': '0.055', 'AMMO4': '0.084', 'WEAPON5': '0.200', 'weapon5': '0.208', 'weapon4': '0.212', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'HITCOUNT': '0.460', 'weapon3': '0.900', 'ARMOR': '0.944', 'weapon2': '1.584', 'DAMAGECOUNT': '2.529', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:02:08,643][2409547] DAMAGECOUNT value on done: 3892.0
[2023-02-25 13:02:08,646][2409547] Sum rewards: 3.353, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.976', 'AMMO2': '0.011', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.054', 'weapon7': '0.064', 'AMMO3': '0.068', 'weapon5': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.270', 'weapon4': '0.348', 'WEAPON3': '0.400', 'ARMOR': '0.481', 'weapon3': '1.282', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.644', 'weapon2': '1.686'}
[2023-02-25 13:02:08,978][2409074] Updated weights for policy 0, policy_version 16011 (0.0012)
[2023-02-25 13:02:09,047][2409080] DAMAGECOUNT value on done: 3415.0
[2023-02-25 13:02:09,048][2409080] Sum rewards: 0.808, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.280', 'AMMO2': '0.009', 'AMMO5': '0.025', 'weapon4': '0.026', 'WEAPON1': '0.040', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'AMMO3': '0.077', 'HITCOUNT': '0.240', 'weapon5': '0.266', 'ARMOR': '0.457', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.174', 'DAMAGECOUNT': '1.260', 'weapon2': '1.618'}
[2023-02-25 13:02:10,931][2409074] Updated weights for policy 0, policy_version 16021 (0.0012)
[2023-02-25 13:02:12,064][2409074] Updated weights for policy 0, policy_version 16031 (0.0012)
[2023-02-25 13:02:12,074][2409099] DAMAGECOUNT value on done: 3499.0
[2023-02-25 13:02:12,075][2409099] Sum rewards: -2.288, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.708', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.061', 'AMMO3': '0.112', 'weapon5': '0.122', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.500', 'weapon4': '0.556', 'ARMOR': '0.836', 'WEAPON3': '0.850', 'weapon2': '1.138', 'DAMAGECOUNT': '1.647', 'weapon3': '1.856'}
[2023-02-25 13:02:12,186][2408954] Fps is (10 sec: 26214.5, 60 sec: 25600.0, 300 sec: 25603.5). Total num frames: 65662976. Throughput: 0: 6396.8. Samples: 16415832. Policy #0 lag: (min: 0.0, avg: 11.7, max: 23.0)
[2023-02-25 13:02:12,186][2408954] Avg episode reward: [(0, '4.171')]
[2023-02-25 13:02:12,291][2409468] DAMAGECOUNT value on done: 3738.0
[2023-02-25 13:02:12,292][2409468] Sum rewards: 7.654, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.580', 'weapon7': '0.002', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'weapon5': '0.062', 'weapon4': '0.164', 'AMMO3': '0.167', 'AMMO4': '0.172', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.350', 'HITCOUNT': '0.460', 'WEAPON3': '0.950', 'ARMOR': '1.200', 'weapon2': '1.280', 'weapon3': '1.650', 'DAMAGECOUNT': '2.655', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:02:12,377][2409469] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)]
[2023-02-25 13:02:12,409][2409547] DAMAGECOUNT value on done: 3130.0
[2023-02-25 13:02:12,410][2409547] Sum rewards: -1.379, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.488', 'AMMO5': '0.003', 'AMMO2': '0.040', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'AMMO4': '0.198', 'HITCOUNT': '0.340', 'ARMOR': '0.428', 'WEAPON4': '0.450', 'weapon4': '0.636', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.110', 'weapon2': '1.370', 'weapon3': '1.382', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:02:13,558][2409080] DAMAGECOUNT value on done: 3178.0
[2023-02-25 13:02:13,558][2409080] Sum rewards: 2.519, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.585', 'AMMO5': '0.014', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.086', 'AMMO3': '0.105', 'weapon7': '0.138', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'weapon2': '0.436', 'HITCOUNT': '0.450', 'WEAPON3': '0.650', 'weapon4': '0.724', 'weapon3': '1.588', 'DAMAGECOUNT': '1.635', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:02:13,940][2409074] Updated weights for policy 0, policy_version 16041 (0.0013)
[2023-02-25 13:02:15,390][2409074] Updated weights for policy 0, policy_version 16051 (0.0013)
[2023-02-25 13:02:16,184][2409547] DAMAGECOUNT value on done: 3321.0
[2023-02-25 13:02:16,186][2409547] Sum rewards: 1.359, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.360', 'AMMO2': '0.015', 'AMMO5': '0.021', 'AMMO4': '0.075', 'weapon7': '0.080', 'AMMO3': '0.081', 'weapon5': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.370', 'WEAPON3': '0.450', 'weapon4': '0.578', 'weapon3': '0.898', 'ARMOR': '1.301', 'FRAGCOUNT': '1.500', 'weapon2': '1.544', 'DAMAGECOUNT': '1.617'}
[2023-02-25 13:02:16,387][2409468] DAMAGECOUNT value on done: 3177.0
[2023-02-25 13:02:16,390][2409468] Sum rewards: 3.454, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.496', 'AMMO5': '0.010', 'AMMO2': '0.011', 'weapon7': '0.050', 'AMMO4': '0.052', 'WEAPON1': '0.060', 'AMMO3': '0.069', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.194', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.262', 'HITCOUNT': '0.270', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'weapon3': '1.124', 'weapon2': '1.382', 'DAMAGECOUNT': '1.626', 'FRAGCOUNT': '2.500'}
[2023-02-25 13:02:16,939][2409074] Updated weights for policy 0, policy_version 16061 (0.0013)
[2023-02-25 13:02:17,186][2408954] Fps is (10 sec: 25804.7, 60 sec: 25600.0, 300 sec: 25561.8). Total num frames: 65794048. Throughput: 0: 6392.8. Samples: 16454004. Policy #0 lag: (min: 0.0, avg: 12.8, max: 26.0)
[2023-02-25 13:02:17,186][2408954] Avg episode reward: [(0, '4.125')]
[2023-02-25 13:02:17,193][2409033] Saving /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000016063_65794048.pth...
[2023-02-25 13:02:17,295][2409033] Removing /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000014567_59666432.pth
[2023-02-25 13:02:17,458][2409080] DAMAGECOUNT value on done: 3504.0
[2023-02-25 13:02:17,460][2409080] Sum rewards: 9.096, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.738', 'AMMO5': '0.008', 'AMMO2': '0.016', 'AMMO3': '0.030', 'AMMO4': '0.079', 'weapon5': '0.164', 'WEAPON4': '0.250', 'WEAPON3': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.344', 'ARMOR': '0.432', 'HITCOUNT': '0.450', 'weapon3': '0.744', 'weapon2': '1.336', 'DAMAGECOUNT': '2.181', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:02:18,892][2409074] Updated weights for policy 0, policy_version 16071 (0.0013)
[2023-02-25 13:02:20,194][2409074] Updated weights for policy 0, policy_version 16081 (0.0012)
[2023-02-25 13:02:20,563][2409468] DAMAGECOUNT value on done: 4007.0
[2023-02-25 13:02:20,565][2409468] Sum rewards: 4.924, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.087', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO3': '0.103', 'AMMO4': '0.119', 'weapon5': '0.122', 'weapon4': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.455', 'HITCOUNT': '0.660', 'WEAPON3': '0.700', 'weapon3': '1.600', 'weapon2': '1.736', 'DAMAGECOUNT': '2.295', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:02:21,600][2409080] DAMAGECOUNT value on done: 3204.0
[2023-02-25 13:02:21,604][2409080] Sum rewards: 3.923, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.406', 'AMMO5': '0.006', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.042', 'weapon7': '0.062', 'AMMO3': '0.075', 'weapon5': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.200', 'HITCOUNT': '0.330', 'WEAPON3': '0.400', 'ARMOR': '0.819', 'weapon3': '1.082', 'DAMAGECOUNT': '1.155', 'weapon2': '1.250', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:02:22,186][2408954] Fps is (10 sec: 24166.4, 60 sec: 25395.3, 300 sec: 25547.9). Total num frames: 65904640. Throughput: 0: 6389.3. Samples: 16473216. Policy #0 lag: (min: 0.0, avg: 12.8, max: 26.0)
[2023-02-25 13:02:22,186][2408954] Avg episode reward: [(0, '4.205')]
[2023-02-25 13:02:22,252][2409074] Updated weights for policy 0, policy_version 16091 (0.0013)
[2023-02-25 13:02:23,414][2409074] Updated weights for policy 0, policy_version 16101 (0.0013)
[2023-02-25 13:02:24,758][2409468] DAMAGECOUNT value on done: 3447.0
[2023-02-25 13:02:24,759][2409468] Sum rewards: 5.482, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.988', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO3': '0.078', 'weapon5': '0.078', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.212', 'WEAPON5': '0.300', 'HITCOUNT': '0.580', 'WEAPON3': '0.600', 'ARMOR': '0.842', 'weapon3': '1.436', 'weapon2': '1.742', 'DAMAGECOUNT': '1.953', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:02:24,855][2409074] Updated weights for policy 0, policy_version 16111 (0.0012)
[2023-02-25 13:02:25,728][2409080] DAMAGECOUNT value on done: 3522.0
[2023-02-25 13:02:25,731][2409080] Sum rewards: 4.252, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.907', 'AMMO5': '0.025', 'AMMO2': '0.028', 'WEAPON1': '0.050', 'weapon7': '0.056', 'weapon5': '0.068', 'AMMO3': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.140', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.314', 'HITCOUNT': '0.370', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'weapon3': '1.474', 'ARMOR': '1.766', 'DAMAGECOUNT': '1.800', 'weapon2': '1.866', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:02:25,782][2409075] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 13:02:26,656][2409074] Updated weights for policy 0, policy_version 16121 (0.0012)
[2023-02-25 13:02:27,186][2408954] Fps is (10 sec: 25394.9, 60 sec: 25736.5, 300 sec: 25589.6). Total num frames: 66048000. Throughput: 0: 6393.1. Samples: 16511592. Policy #0 lag: (min: 1.0, avg: 12.9, max: 24.0)
[2023-02-25 13:02:27,186][2408954] Avg episode reward: [(0, '4.194')]
[2023-02-25 13:02:28,039][2409074] Updated weights for policy 0, policy_version 16131 (0.0012)
[2023-02-25 13:02:28,640][2409468] DAMAGECOUNT value on done: 2712.0
[2023-02-25 13:02:29,601][2409080] DAMAGECOUNT value on done: 3530.0
[2023-02-25 13:02:29,605][2409080] Sum rewards: 4.955, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.870', 'AMMO2': '0.005', 'AMMO5': '0.016', 'AMMO4': '0.027', 'WEAPON1': '0.060', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'weapon5': '0.110', 'weapon4': '0.136', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '0.640', 'weapon2': '1.402', 'weapon3': '1.898', 'DAMAGECOUNT': '2.394', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:02:29,925][2409074] Updated weights for policy 0, policy_version 16141 (0.0013)
[2023-02-25 13:02:31,361][2409074] Updated weights for policy 0, policy_version 16151 (0.0012)
[2023-02-25 13:02:32,186][2408954] Fps is (10 sec: 27033.5, 60 sec: 25668.3, 300 sec: 25575.7). Total num frames: 66174976. Throughput: 0: 6403.0. Samples: 16550112. Policy #0 lag: (min: 1.0, avg: 12.9, max: 24.0)
[2023-02-25 13:02:32,187][2408954] Avg episode reward: [(0, '4.117')]
[2023-02-25 13:02:32,485][2409468] DAMAGECOUNT value on done: 4507.0
[2023-02-25 13:02:32,489][2409468] Sum rewards: 11.840, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.758', 'AMMO2': '0.009', 'AMMO5': '0.012', 'AMMO4': '0.046', 'AMMO3': '0.062', 'weapon7': '0.104', 'WEAPON4': '0.150', 'weapon5': '0.156', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.420', 'weapon4': '0.478', 'ARMOR': '0.883', 'weapon3': '0.950', 'weapon2': '1.328', 'DAMAGECOUNT': '2.859', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:02:33,171][2409074] Updated weights for policy 0, policy_version 16161 (0.0012)
[2023-02-25 13:02:33,428][2409080] DAMAGECOUNT value on done: 4137.0
[2023-02-25 13:02:33,430][2409080] Sum rewards: 4.624, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.924', 'WEAPON1': '0.010', 'weapon5': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO3': '0.050', 'AMMO4': '0.119', 'weapon7': '0.156', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.350', 'HITCOUNT': '0.370', 'WEAPON7': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.772', 'weapon4': '0.992', 'weapon3': '1.060', 'ARMOR': '1.255', 'DAMAGECOUNT': '2.283', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:02:34,812][2409074] Updated weights for policy 0, policy_version 16171 (0.0012)
[2023-02-25 13:02:36,192][2409074] Updated weights for policy 0, policy_version 16181 (0.0012)
[2023-02-25 13:02:36,447][2409468] DAMAGECOUNT value on done: 3543.0
[2023-02-25 13:02:36,448][2409468] Sum rewards: 0.029, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.234', 'AMMO5': '0.016', 'AMMO2': '0.038', 'WEAPON1': '0.040', 'AMMO3': '0.097', 'weapon5': '0.172', 'AMMO4': '0.192', 'weapon4': '0.206', 'HITCOUNT': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'ARMOR': '0.828', 'DAMAGECOUNT': '1.179', 'weapon3': '1.436', 'weapon2': '1.798', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:02:37,186][2408954] Fps is (10 sec: 24986.0, 60 sec: 25463.5, 300 sec: 25561.8). Total num frames: 66297856. Throughput: 0: 6393.4. Samples: 16569300. Policy #0 lag: (min: 1.0, avg: 12.7, max: 25.0)
[2023-02-25 13:02:37,186][2408954] Avg episode reward: [(0, '4.209')]
[2023-02-25 13:02:37,191][2409099] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:02:37,394][2409080] DAMAGECOUNT value on done: 3777.0
[2023-02-25 13:02:37,397][2409080] Sum rewards: 5.790, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.052', 'AMMO4': '0.064', 'weapon7': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.122', 'WEAPON5': '0.200', 'HEALTH': '0.241', 'HITCOUNT': '0.270', 'weapon4': '0.298', 'WEAPON3': '0.350', 'weapon3': '1.256', 'DAMAGECOUNT': '1.431', 'weapon2': '1.772', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:02:37,697][2409074] Updated weights for policy 0, policy_version 16191 (0.0012)
[2023-02-25 13:02:39,484][2409074] Updated weights for policy 0, policy_version 16201 (0.0012)
[2023-02-25 13:02:40,434][2409468] DAMAGECOUNT value on done: 4489.0
[2023-02-25 13:02:40,435][2409468] Sum rewards: 5.873, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.223', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'weapon5': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.084', 'weapon4': '0.086', 'WEAPON5': '0.250', 'ARMOR': '0.444', 'WEAPON3': '0.600', 'HITCOUNT': '0.670', 'weapon3': '1.322', 'weapon2': '2.204', 'DAMAGECOUNT': '2.349', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:02:40,839][2409074] Updated weights for policy 0, policy_version 16211 (0.0012)
[2023-02-25 13:02:41,368][2409080] DAMAGECOUNT value on done: 3388.0
[2023-02-25 13:02:41,369][2409080] Sum rewards: 0.945, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.540', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.003', 'weapon5': '0.046', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.348', 'HITCOUNT': '0.390', 'WEAPON3': '0.600', 'ARMOR': '0.878', 'FRAGCOUNT': '1.000', 'weapon3': '1.164', 'DAMAGECOUNT': '1.284', 'weapon2': '1.676'}
[2023-02-25 13:02:42,186][2408954] Fps is (10 sec: 25395.4, 60 sec: 25668.3, 300 sec: 25547.9). Total num frames: 66428928. Throughput: 0: 6399.5. Samples: 16607772. Policy #0 lag: (min: 1.0, avg: 12.7, max: 25.0)
[2023-02-25 13:02:42,186][2408954] Avg episode reward: [(0, '4.252')]
[2023-02-25 13:02:42,576][2409074] Updated weights for policy 0, policy_version 16221 (0.0012)
[2023-02-25 13:02:43,417][2409102] Large shaping reward 2.571 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO2', -0.0001, -1.0), ('AMMO4', -0.0005, -1.0), ('weapon2', 0.002)]
[2023-02-25 13:02:44,372][2409468] DAMAGECOUNT value on done: 4326.0
[2023-02-25 13:02:44,372][2409468] Sum rewards: 6.820, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.774', 'AMMO5': '0.005', 'AMMO2': '0.032', 'WEAPON1': '0.050', 'AMMO3': '0.103', 'weapon5': '0.124', 'AMMO4': '0.159', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.354', 'ARMOR': '0.428', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'weapon2': '1.154', 'weapon3': '1.618', 'DAMAGECOUNT': '2.616', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:02:44,392][2409074] Updated weights for policy 0, policy_version 16231 (0.0012)
[2023-02-25 13:02:45,332][2409080] DAMAGECOUNT value on done: 3752.0
[2023-02-25 13:02:45,336][2409080] Sum rewards: 7.963, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.352', 'ARMOR': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'AMMO4': '0.065', 'weapon7': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.350', 'weapon4': '0.406', 'HITCOUNT': '0.590', 'weapon3': '1.156', 'weapon2': '1.206', 'DAMAGECOUNT': '2.430', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:02:45,668][2409074] Updated weights for policy 0, policy_version 16241 (0.0012)
[2023-02-25 13:02:47,186][2408954] Fps is (10 sec: 25804.1, 60 sec: 25668.4, 300 sec: 25547.9). Total num frames: 66555904. Throughput: 0: 6408.0. Samples: 16646460. Policy #0 lag: (min: 1.0, avg: 12.7, max: 25.0)
[2023-02-25 13:02:47,186][2408954] Avg episode reward: [(0, '4.343')]
[2023-02-25 13:02:47,467][2409074] Updated weights for policy 0, policy_version 16251 (0.0012)
[2023-02-25 13:02:48,347][2409468] DAMAGECOUNT value on done: 3349.0
[2023-02-25 13:02:48,351][2409468] Sum rewards: 6.645, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.270', 'AMMO2': '0.005', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.027', 'AMMO3': '0.104', 'weapon5': '0.138', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.510', 'weapon4': '0.562', 'WEAPON3': '0.650', 'weapon3': '0.904', 'ARMOR': '1.347', 'weapon2': '1.974', 'DAMAGECOUNT': '2.109', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:02:48,812][2409074] Updated weights for policy 0, policy_version 16261 (0.0013)
[2023-02-25 13:02:49,263][2409080] DAMAGECOUNT value on done: 2745.0
[2023-02-25 13:02:49,264][2409080] Sum rewards: 4.683, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.116', 'weapon7': '0.002', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.055', 'AMMO3': '0.081', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.158', 'WEAPON5': '0.250', 'AMMO4': '0.273', 'HITCOUNT': '0.370', 'WEAPON4': '0.450', 'WEAPON3': '0.450', 'weapon4': '0.686', 'ARMOR': '0.804', 'weapon3': '1.236', 'weapon2': '1.696', 'DAMAGECOUNT': '2.208', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:02:49,311][2409101] Large shaping reward 2.587 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.555, 185.0), ('weapon7', 0.002)]
[2023-02-25 13:02:50,920][2409074] Updated weights for policy 0, policy_version 16271 (0.0012)
[2023-02-25 13:02:51,984][2409074] Updated weights for policy 0, policy_version 16281 (0.0012)
[2023-02-25 13:02:52,186][2408954] Fps is (10 sec: 25804.3, 60 sec: 25600.0, 300 sec: 25561.8). Total num frames: 66686976. Throughput: 0: 6396.2. Samples: 16665492. Policy #0 lag: (min: 0.0, avg: 11.4, max: 27.0)
[2023-02-25 13:02:52,186][2408954] Avg episode reward: [(0, '4.423')]
[2023-02-25 13:02:52,212][2409468] DAMAGECOUNT value on done: 3798.0
[2023-02-25 13:02:52,216][2409468] Sum rewards: 6.344, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.616', 'AMMO5': '0.015', 'AMMO2': '0.027', 'WEAPON1': '0.040', 'AMMO3': '0.071', 'AMMO4': '0.135', 'WEAPON4': '0.250', 'weapon5': '0.276', 'WEAPON5': '0.400', 'weapon4': '0.464', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'ARMOR': '0.842', 'weapon2': '1.068', 'weapon3': '1.792', 'DAMAGECOUNT': '2.799', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:02:53,502][2409074] Updated weights for policy 0, policy_version 16291 (0.0012)
[2023-02-25 13:02:54,835][2409101] Large shaping reward 2.533 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.501, 167.0), ('weapon5', 0.002)]
[2023-02-25 13:02:55,279][2409074] Updated weights for policy 0, policy_version 16301 (0.0014)
[2023-02-25 13:02:55,967][2409468] DAMAGECOUNT value on done: 4117.0
[2023-02-25 13:02:55,969][2409468] Sum rewards: 8.230, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.184', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.060', 'AMMO3': '0.066', 'AMMO4': '0.085', 'weapon5': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'ARMOR': '0.524', 'weapon4': '0.572', 'HITCOUNT': '0.650', 'weapon2': '1.342', 'weapon3': '1.354', 'DAMAGECOUNT': '3.474', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:02:56,651][2409074] Updated weights for policy 0, policy_version 16311 (0.0013)
[2023-02-25 13:02:57,186][2408954] Fps is (10 sec: 26624.7, 60 sec: 25804.8, 300 sec: 25561.8). Total num frames: 66822144. Throughput: 0: 6416.8. Samples: 16704588. Policy #0 lag: (min: 0.0, avg: 11.4, max: 27.0)
[2023-02-25 13:02:57,186][2408954] Avg episode reward: [(0, '4.486')]
[2023-02-25 13:02:58,768][2409547] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:02:58,913][2409074] Updated weights for policy 0, policy_version 16321 (0.0012)
[2023-02-25 13:02:59,873][2409074] Updated weights for policy 0, policy_version 16331 (0.0014)
[2023-02-25 13:02:59,953][2409468] DAMAGECOUNT value on done: 3463.0
[2023-02-25 13:02:59,957][2409468] Sum rewards: 1.996, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.112', 'weapon5': '0.004', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO3': '0.032', 'AMMO4': '0.036', 'weapon7': '0.048', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.270', 'WEAPON3': '0.300', 'weapon4': '0.500', 'weapon3': '0.750', 'weapon2': '0.876', 'DAMAGECOUNT': '0.930', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:03:00,603][2409099] Large shaping reward 3.642 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:03:01,338][2409074] Updated weights for policy 0, policy_version 16341 (0.0012)
[2023-02-25 13:03:01,881][2409597] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:03:02,186][2408954] Fps is (10 sec: 24985.1, 60 sec: 25599.8, 300 sec: 25534.0). Total num frames: 66936832. Throughput: 0: 6428.2. Samples: 16743276. Policy #0 lag: (min: 0.0, avg: 9.0, max: 24.0)
[2023-02-25 13:03:02,186][2408954] Avg episode reward: [(0, '4.470')]
[2023-02-25 13:03:02,891][2409074] Updated weights for policy 0, policy_version 16351 (0.0012)
[2023-02-25 13:03:03,699][2409468] DAMAGECOUNT value on done: 4055.0
[2023-02-25 13:03:03,700][2409468] Sum rewards: 4.157, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.750', 'AMMO5': '0.004', 'AMMO2': '0.012', 'ARMOR': '0.020', 'weapon5': '0.032', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.078', 'WEAPON5': '0.100', 'weapon4': '0.138', 'WEAPON3': '0.600', 'HITCOUNT': '0.650', 'weapon3': '1.422', 'weapon2': '1.856', 'DAMAGECOUNT': '2.097', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:03:04,778][2409074] Updated weights for policy 0, policy_version 16361 (0.0012)
[2023-02-25 13:03:06,455][2409074] Updated weights for policy 0, policy_version 16371 (0.0014)
[2023-02-25 13:03:07,186][2408954] Fps is (10 sec: 25804.9, 60 sec: 25736.5, 300 sec: 25603.5). Total num frames: 67080192. Throughput: 0: 6430.4. Samples: 16762584. Policy #0 lag: (min: 0.0, avg: 9.0, max: 24.0)
[2023-02-25 13:03:07,186][2408954] Avg episode reward: [(0, '4.440')]
[2023-02-25 13:03:07,609][2409074] Updated weights for policy 0, policy_version 16381 (0.0012)
[2023-02-25 13:03:09,980][2409074] Updated weights for policy 0, policy_version 16391 (0.0013)
[2023-02-25 13:03:10,840][2409074] Updated weights for policy 0, policy_version 16401 (0.0012)
[2023-02-25 13:03:12,186][2408954] Fps is (10 sec: 26624.5, 60 sec: 25668.2, 300 sec: 25561.8). Total num frames: 67203072. Throughput: 0: 6444.5. Samples: 16801596. Policy #0 lag: (min: 1.0, avg: 13.3, max: 23.0)
[2023-02-25 13:03:12,186][2408954] Avg episode reward: [(0, '4.440')]
[2023-02-25 13:03:12,768][2409074] Updated weights for policy 0, policy_version 16411 (0.0012)
[2023-02-25 13:03:14,213][2409074] Updated weights for policy 0, policy_version 16421 (0.0012)
[2023-02-25 13:03:15,571][2409597] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:03:15,581][2409074] Updated weights for policy 0, policy_version 16431 (0.0012)
[2023-02-25 13:03:16,889][2409100] DAMAGECOUNT value on done: 4417.0
[2023-02-25 13:03:16,892][2409100] Sum rewards: 6.309, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.112', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.137', 'weapon5': '0.188', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.636', 'HITCOUNT': '0.690', 'WEAPON3': '0.900', 'weapon2': '0.940', 'weapon3': '1.604', 'DAMAGECOUNT': '2.055', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:03:17,186][2408954] Fps is (10 sec: 24166.3, 60 sec: 25463.5, 300 sec: 25520.2). Total num frames: 67321856. Throughput: 0: 6448.3. Samples: 16840284. Policy #0 lag: (min: 1.0, avg: 13.3, max: 23.0)
[2023-02-25 13:03:17,186][2408954] Avg episode reward: [(0, '4.462')]
[2023-02-25 13:03:17,691][2409074] Updated weights for policy 0, policy_version 16441 (0.0012)
[2023-02-25 13:03:17,700][2409033] Signal inference workers to stop experience collection... (2000 times)
[2023-02-25 13:03:17,707][2409033] Signal inference workers to resume experience collection... (2000 times)
[2023-02-25 13:03:17,746][2409074] InferenceWorker_p0-w0: stopping experience collection (2000 times)
[2023-02-25 13:03:17,747][2409074] InferenceWorker_p0-w0: resuming experience collection (2000 times)
[2023-02-25 13:03:18,598][2409103] DAMAGECOUNT value on done: 3296.0
[2023-02-25 13:03:18,601][2409103] Sum rewards: 2.497, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.976', 'AMMO5': '0.013', 'ARMOR': '0.016', 'AMMO2': '0.031', 'WEAPON1': '0.040', 'weapon7': '0.060', 'weapon5': '0.096', 'AMMO3': '0.139', 'AMMO4': '0.155', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.510', 'weapon4': '0.688', 'WEAPON3': '0.750', 'weapon3': '1.344', 'weapon2': '1.542', 'DAMAGECOUNT': '2.190', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:03:18,742][2409074] Updated weights for policy 0, policy_version 16451 (0.0014)
[2023-02-25 13:03:20,672][2409100] DAMAGECOUNT value on done: 4420.0
[2023-02-25 13:03:20,675][2409100] Sum rewards: 7.385, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.410', 'AMMO2': '0.022', 'AMMO5': '0.022', 'WEAPON1': '0.040', 'AMMO3': '0.068', 'AMMO4': '0.108', 'WEAPON4': '0.250', 'weapon5': '0.256', 'weapon4': '0.358', 'WEAPON3': '0.500', 'WEAPON5': '0.550', 'HITCOUNT': '0.650', 'ARMOR': '0.890', 'weapon2': '1.080', 'weapon3': '1.304', 'DAMAGECOUNT': '2.697', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:03:20,973][2409074] Updated weights for policy 0, policy_version 16461 (0.0012)
[2023-02-25 13:03:22,186][2408954] Fps is (10 sec: 25805.4, 60 sec: 25941.3, 300 sec: 25575.7). Total num frames: 67461120. Throughput: 0: 6449.1. Samples: 16859508. Policy #0 lag: (min: 1.0, avg: 13.3, max: 23.0)
[2023-02-25 13:03:22,186][2408954] Avg episode reward: [(0, '4.516')]
[2023-02-25 13:03:22,195][2409074] Updated weights for policy 0, policy_version 16471 (0.0012)
[2023-02-25 13:03:22,231][2409103] DAMAGECOUNT value on done: 5185.0
[2023-02-25 13:03:22,232][2409103] Sum rewards: 12.593, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.070', 'HEALTH': '0.146', 'weapon5': '0.210', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'HITCOUNT': '0.610', 'ARMOR': '0.958', 'weapon2': '1.586', 'weapon3': '1.602', 'DAMAGECOUNT': '3.738', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:03:23,802][2409074] Updated weights for policy 0, policy_version 16481 (0.0012)
[2023-02-25 13:03:24,241][2409100] DAMAGECOUNT value on done: 3777.0
[2023-02-25 13:03:24,242][2409100] Sum rewards: 4.891, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.216', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.020', 'weapon7': '0.046', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.104', 'WEAPON5': '0.150', 'weapon4': '0.164', 'HITCOUNT': '0.510', 'WEAPON3': '0.750', 'ARMOR': '1.302', 'weapon2': '1.360', 'weapon3': '1.438', 'DAMAGECOUNT': '2.352', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:03:25,462][2409074] Updated weights for policy 0, policy_version 16491 (0.0012)
[2023-02-25 13:03:25,811][2409103] DAMAGECOUNT value on done: 3417.0
[2023-02-25 13:03:25,815][2409103] Sum rewards: 4.824, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.702', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.015', 'WEAPON1': '0.050', 'AMMO3': '0.095', 'weapon5': '0.124', 'HITCOUNT': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.218', 'weapon3': '1.280', 'DAMAGECOUNT': '1.590', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:03:27,122][2409549] DAMAGECOUNT value on done: 3610.0
[2023-02-25 13:03:27,127][2409549] Sum rewards: 1.659, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.616', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO3': '0.058', 'weapon7': '0.084', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.400', 'WEAPON3': '0.400', 'WEAPON4': '0.450', 'weapon3': '0.768', 'weapon4': '0.974', 'weapon2': '1.074', 'DAMAGECOUNT': '1.167', 'ARMOR': '1.347', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:03:27,165][2409074] Updated weights for policy 0, policy_version 16501 (0.0012)
[2023-02-25 13:03:27,186][2408954] Fps is (10 sec: 26624.0, 60 sec: 25668.3, 300 sec: 25575.7). Total num frames: 67588096. Throughput: 0: 6457.1. Samples: 16898340. Policy #0 lag: (min: 0.0, avg: 14.4, max: 29.0)
[2023-02-25 13:03:27,186][2408954] Avg episode reward: [(0, '4.538')]
[2023-02-25 13:03:28,401][2409100] DAMAGECOUNT value on done: 3700.0
[2023-02-25 13:03:28,402][2409100] Sum rewards: 6.611, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.154', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'weapon5': '0.074', 'AMMO4': '0.085', 'AMMO3': '0.103', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.650', 'weapon4': '0.684', 'HITCOUNT': '0.850', 'ARMOR': '0.853', 'weapon2': '0.900', 'weapon3': '1.744', 'DAMAGECOUNT': '2.937', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:03:28,818][2409074] Updated weights for policy 0, policy_version 16511 (0.0012)
[2023-02-25 13:03:29,841][2409074] Updated weights for policy 0, policy_version 16521 (0.0012)
[2023-02-25 13:03:29,989][2409103] DAMAGECOUNT value on done: 3106.0
[2023-02-25 13:03:30,885][2409549] DAMAGECOUNT value on done: 4890.0
[2023-02-25 13:03:30,889][2409549] Sum rewards: 8.063, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.400', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO3': '0.091', 'WEAPON4': '0.150', 'weapon4': '0.206', 'ARMOR': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.700', 'weapon3': '1.234', 'weapon2': '1.952', 'DAMAGECOUNT': '2.595', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:03:31,405][2409102] DAMAGECOUNT value on done: 4981.0
[2023-02-25 13:03:31,407][2409102] Sum rewards: 17.244, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.926', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.015', 'AMMO3': '0.110', 'weapon5': '0.286', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'weapon2': '0.904', 'HITCOUNT': '0.910', 'weapon3': '2.262', 'DAMAGECOUNT': '4.857', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:03:32,047][2409074] Updated weights for policy 0, policy_version 16531 (0.0013)
[2023-02-25 13:03:32,134][2409100] DAMAGECOUNT value on done: 4207.0
[2023-02-25 13:03:32,135][2409100] Sum rewards: 6.445, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.321', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO3': '0.030', 'AMMO4': '0.034', 'weapon5': '0.078', 'weapon7': '0.090', 'WEAPON5': '0.150', 'WEAPON3': '0.200', 'WEAPON4': '0.200', 'AMMO6': '0.320', 'AMMO7': '0.320', 'HITCOUNT': '0.320', 'weapon4': '0.352', 'WEAPON7': '0.400', 'weapon3': '0.588', 'weapon2': '0.722', 'DAMAGECOUNT': '1.938', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:03:32,186][2408954] Fps is (10 sec: 24985.5, 60 sec: 25600.0, 300 sec: 25547.9). Total num frames: 67710976. Throughput: 0: 6462.2. Samples: 16937256. Policy #0 lag: (min: 0.0, avg: 14.4, max: 29.0)
[2023-02-25 13:03:32,186][2408954] Avg episode reward: [(0, '4.682')]
[2023-02-25 13:03:33,283][2409074] Updated weights for policy 0, policy_version 16541 (0.0013)
[2023-02-25 13:03:33,593][2409103] DAMAGECOUNT value on done: 3030.0
[2023-02-25 13:03:33,596][2409103] Sum rewards: 1.019, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.132', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'weapon5': '0.034', 'weapon7': '0.048', 'weapon4': '0.054', 'AMMO3': '0.060', 'AMMO4': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.190', 'WEAPON5': '0.200', 'WEAPON3': '0.350', 'weapon2': '0.600', 'weapon3': '0.756', 'ARMOR': '0.800', 'DAMAGECOUNT': '0.810', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:03:34,581][2409549] DAMAGECOUNT value on done: 3705.0
[2023-02-25 13:03:34,585][2409549] Sum rewards: 4.801, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.690', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.012', 'AMMO3': '0.057', 'weapon7': '0.062', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.146', 'WEAPON7': '0.200', 'HITCOUNT': '0.290', 'WEAPON5': '0.350', 'ARMOR': '0.444', 'WEAPON3': '0.450', 'weapon2': '0.838', 'weapon3': '1.114', 'DAMAGECOUNT': '1.317', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:03:34,999][2409102] DAMAGECOUNT value on done: 3878.0
[2023-02-25 13:03:35,002][2409102] Sum rewards: 12.265, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'HEALTH': '0.025', 'AMMO4': '0.054', 'weapon5': '0.088', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.620', 'weapon3': '1.524', 'weapon2': '1.552', 'DAMAGECOUNT': '2.526', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:03:35,089][2409074] Updated weights for policy 0, policy_version 16551 (0.0013)
[2023-02-25 13:03:35,644][2409485] DAMAGECOUNT value on done: 3667.0
[2023-02-25 13:03:35,647][2409485] Sum rewards: 6.532, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.072', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.042', 'AMMO3': '0.069', 'weapon7': '0.102', 'weapon5': '0.164', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'AMMO4': '0.211', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'ARMOR': '0.415', 'HITCOUNT': '0.440', 'weapon4': '0.840', 'weapon2': '1.126', 'weapon3': '1.252', 'DAMAGECOUNT': '2.073', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:03:35,800][2409100] DAMAGECOUNT value on done: 3707.0
[2023-02-25 13:03:35,801][2409100] Sum rewards: 5.240, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.659', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'AMMO3': '0.045', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO4': '0.105', 'weapon7': '0.116', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.410', 'weapon4': '0.580', 'weapon3': '0.672', 'ARMOR': '0.905', 'weapon2': '1.516', 'DAMAGECOUNT': '1.821', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:03:36,283][2409101] DAMAGECOUNT value on done: 2861.0
[2023-02-25 13:03:36,495][2409074] Updated weights for policy 0, policy_version 16561 (0.0013)
[2023-02-25 13:03:37,186][2408954] Fps is (10 sec: 27443.2, 60 sec: 26077.9, 300 sec: 25645.1). Total num frames: 67862528. Throughput: 0: 6464.8. Samples: 16956408. Policy #0 lag: (min: 0.0, avg: 15.4, max: 30.0)
[2023-02-25 13:03:37,187][2408954] Avg episode reward: [(0, '4.783')]
[2023-02-25 13:03:37,248][2409103] DAMAGECOUNT value on done: 3926.0
[2023-02-25 13:03:37,252][2409103] Sum rewards: 6.205, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.397', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'AMMO3': '0.067', 'weapon7': '0.068', 'AMMO4': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.184', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.264', 'HITCOUNT': '0.410', 'WEAPON3': '0.450', 'ARMOR': '0.459', 'weapon3': '1.362', 'DAMAGECOUNT': '1.800', 'weapon2': '1.824', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:03:37,845][2409074] Updated weights for policy 0, policy_version 16571 (0.0013)
[2023-02-25 13:03:38,178][2409549] DAMAGECOUNT value on done: 4100.0
[2023-02-25 13:03:38,179][2409549] Sum rewards: 10.972, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.400', 'AMMO2': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.022', 'weapon7': '0.050', 'AMMO3': '0.054', 'weapon5': '0.054', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'HITCOUNT': '0.630', 'weapon4': '0.710', 'weapon2': '0.942', 'weapon3': '1.146', 'DAMAGECOUNT': '2.892', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:03:38,606][2409102] DAMAGECOUNT value on done: 4549.0
[2023-02-25 13:03:38,607][2409102] Sum rewards: 6.274, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.033', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO2': '0.039', 'weapon5': '0.050', 'weapon7': '0.090', 'AMMO3': '0.137', 'AMMO4': '0.197', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.450', 'ARMOR': '0.492', 'WEAPON4': '0.550', 'HITCOUNT': '0.560', 'weapon2': '0.726', 'WEAPON3': '0.800', 'weapon4': '0.964', 'weapon3': '1.626', 'DAMAGECOUNT': '2.343', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:03:39,341][2409485] DAMAGECOUNT value on done: 4350.0
[2023-02-25 13:03:39,342][2409485] Sum rewards: 4.893, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.716', 'AMMO2': '0.004', 'AMMO4': '0.019', 'AMMO3': '0.030', 'ARMOR': '0.032', 'weapon7': '0.112', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.250', 'WEAPON3': '0.250', 'HITCOUNT': '0.250', 'WEAPON7': '0.400', 'weapon4': '0.484', 'weapon3': '0.656', 'DAMAGECOUNT': '1.296', 'weapon2': '1.346', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:03:39,498][2409100] DAMAGECOUNT value on done: 4248.0
[2023-02-25 13:03:39,499][2409100] Sum rewards: 4.694, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.255', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.069', 'AMMO4': '0.174', 'WEAPON4': '0.350', 'ARMOR': '0.447', 'WEAPON3': '0.450', 'HITCOUNT': '0.640', 'weapon4': '0.854', 'weapon2': '0.858', 'weapon3': '1.108', 'DAMAGECOUNT': '2.094', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:03:39,886][2409101] DAMAGECOUNT value on done: 4353.0
[2023-02-25 13:03:39,889][2409101] Sum rewards: 10.013, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.900', 'AMMO5': '0.015', 'AMMO2': '0.030', 'WEAPON1': '0.040', 'AMMO3': '0.072', 'weapon5': '0.078', 'weapon7': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.342', 'WEAPON5': '0.350', 'ARMOR': '0.444', 'WEAPON3': '0.550', 'HITCOUNT': '0.610', 'weapon2': '1.374', 'weapon3': '1.672', 'DAMAGECOUNT': '2.307', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:03:40,040][2409074] Updated weights for policy 0, policy_version 16581 (0.0013)
[2023-02-25 13:03:41,105][2409074] Updated weights for policy 0, policy_version 16591 (0.0012)
[2023-02-25 13:03:41,129][2409103] DAMAGECOUNT value on done: 3683.0
[2023-02-25 13:03:41,133][2409103] Sum rewards: 10.535, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.041', 'AMMO2': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.058', 'weapon5': '0.118', 'AMMO3': '0.123', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '1.020', 'weapon2': '1.608', 'weapon3': '2.002', 'DAMAGECOUNT': '4.380', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:03:42,186][2408954] Fps is (10 sec: 27033.3, 60 sec: 25873.0, 300 sec: 25589.6). Total num frames: 67981312. Throughput: 0: 6451.2. Samples: 16994892. Policy #0 lag: (min: 0.0, avg: 15.4, max: 30.0)
[2023-02-25 13:03:42,186][2408954] Avg episode reward: [(0, '5.008')]
[2023-02-25 13:03:42,218][2409102] DAMAGECOUNT value on done: 4416.0
[2023-02-25 13:03:42,218][2409102] Sum rewards: 4.710, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.786', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON1': '0.040', 'AMMO3': '0.078', 'weapon5': '0.110', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.290', 'HITCOUNT': '0.390', 'WEAPON3': '0.550', 'weapon3': '1.152', 'ARMOR': '1.298', 'DAMAGECOUNT': '1.827', 'weapon2': '2.024', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:03:42,265][2409549] DAMAGECOUNT value on done: 4180.0
[2023-02-25 13:03:42,269][2409549] Sum rewards: 0.771, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.008', 'AMMO5': '0.020', 'AMMO4': '0.038', 'WEAPON1': '0.060', 'AMMO3': '0.105', 'weapon5': '0.184', 'HITCOUNT': '0.300', 'WEAPON5': '0.400', 'HEALTH': '0.428', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.972', 'FRAGCOUNT': '1.000', 'weapon2': '1.338', 'weapon3': '2.018'}
[2023-02-25 13:03:42,899][2409074] Updated weights for policy 0, policy_version 16601 (0.0012)
[2023-02-25 13:03:43,175][2409485] DAMAGECOUNT value on done: 2737.0
[2023-02-25 13:03:43,178][2409485] Sum rewards: 8.371, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.012', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO2': '0.031', 'AMMO3': '0.097', 'weapon5': '0.130', 'WEAPON4': '0.150', 'AMMO4': '0.157', 'AMMO6': '0.168', 'AMMO7': '0.168', 'weapon6': '0.182', 'WEAPON5': '0.200', 'WEAPON6': '0.200', 'weapon4': '0.238', 'HITCOUNT': '0.380', 'ARMOR': '0.490', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.332', 'weapon3': '1.432', 'weapon2': '1.740', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:03:43,181][2409100] DAMAGECOUNT value on done: 4204.0
[2023-02-25 13:03:43,182][2409100] Sum rewards: 4.644, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.776', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon7': '0.078', 'AMMO3': '0.109', 'AMMO4': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.192', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.396', 'HITCOUNT': '0.570', 'WEAPON3': '0.700', 'weapon2': '0.758', 'weapon3': '2.088', 'DAMAGECOUNT': '2.367', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:03:43,193][2409548] DAMAGECOUNT value on done: 3170.0
[2023-02-25 13:03:43,199][2409548] Sum rewards: 6.191, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.779', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO3': '0.044', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon7': '0.064', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.270', 'WEAPON3': '0.350', 'weapon4': '0.356', 'ARMOR': '0.465', 'weapon3': '0.864', 'weapon2': '1.356', 'DAMAGECOUNT': '1.491', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:03:44,036][2409101] DAMAGECOUNT value on done: 4068.0
[2023-02-25 13:03:44,040][2409101] Sum rewards: 4.370, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.994', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.038', 'AMMO3': '0.094', 'weapon5': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.326', 'HITCOUNT': '0.340', 'WEAPON3': '0.650', 'ARMOR': '1.278', 'weapon2': '1.342', 'weapon3': '1.514', 'DAMAGECOUNT': '1.590', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:03:44,309][2409074] Updated weights for policy 0, policy_version 16611 (0.0012)
[2023-02-25 13:03:44,947][2409103] DAMAGECOUNT value on done: 4153.0
[2023-02-25 13:03:44,948][2409103] Sum rewards: 8.696, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.648', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO5': '0.014', 'WEAPON1': '0.040', 'AMMO3': '0.077', 'weapon5': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'HITCOUNT': '0.560', 'weapon3': '1.458', 'weapon2': '1.764', 'DAMAGECOUNT': '2.367', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:03:44,972][2409597] DAMAGECOUNT value on done: 3948.0
[2023-02-25 13:03:44,975][2409597] Sum rewards: 6.674, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.749', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO3': '0.040', 'WEAPON1': '0.040', 'AMMO4': '0.107', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.370', 'weapon4': '0.404', 'weapon3': '1.050', 'weapon2': '1.582', 'DAMAGECOUNT': '1.605', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:03:46,002][2409102] DAMAGECOUNT value on done: 3852.0
[2023-02-25 13:03:46,003][2409102] Sum rewards: 3.617, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.052', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon7': '0.080', 'weapon5': '0.088', 'AMMO3': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.298', 'WEAPON5': '0.300', 'ARMOR': '0.454', 'HITCOUNT': '0.570', 'WEAPON3': '0.600', 'weapon2': '1.102', 'weapon3': '1.268', 'DAMAGECOUNT': '1.881', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:03:46,063][2409074] Updated weights for policy 0, policy_version 16621 (0.0012)
[2023-02-25 13:03:46,068][2409549] DAMAGECOUNT value on done: 4323.0
[2023-02-25 13:03:46,069][2409549] Sum rewards: 11.774, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.916', 'AMMO2': '0.009', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.047', 'AMMO3': '0.050', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.244', 'weapon5': '0.286', 'WEAPON3': '0.400', 'WEAPON5': '0.450', 'HITCOUNT': '0.660', 'ARMOR': '0.904', 'weapon3': '1.260', 'weapon2': '1.720', 'DAMAGECOUNT': '4.074', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:03:46,331][2409549] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)]
[2023-02-25 13:03:47,101][2409485] DAMAGECOUNT value on done: 4869.0
[2023-02-25 13:03:47,102][2409485] Sum rewards: 9.717, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.076', 'AMMO3': '0.148', 'weapon5': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'HEALTH': '0.328', 'ARMOR': '0.440', 'weapon4': '0.518', 'weapon2': '0.710', 'HITCOUNT': '0.740', 'WEAPON3': '0.800', 'weapon3': '2.338', 'DAMAGECOUNT': '2.931', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:03:47,186][2408954] Fps is (10 sec: 24166.4, 60 sec: 25804.9, 300 sec: 25575.7). Total num frames: 68104192. Throughput: 0: 6459.0. Samples: 17033928. Policy #0 lag: (min: 0.0, avg: 12.8, max: 25.0)
[2023-02-25 13:03:47,186][2408954] Avg episode reward: [(0, '5.208')]
[2023-02-25 13:03:47,307][2409100] DAMAGECOUNT value on done: 4658.0
[2023-02-25 13:03:47,308][2409100] Sum rewards: 3.493, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.424', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.033', 'weapon7': '0.050', 'weapon5': '0.072', 'AMMO3': '0.073', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'WEAPON7': '0.200', 'HITCOUNT': '0.280', 'WEAPON3': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.794', 'ARMOR': '0.960', 'weapon3': '0.978', 'weapon2': '1.068', 'DAMAGECOUNT': '1.485', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:03:47,335][2409548] DAMAGECOUNT value on done: 3875.0
[2023-02-25 13:03:47,336][2409548] Sum rewards: 4.225, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.873', 'AMMO5': '0.017', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO3': '0.056', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.139', 'weapon5': '0.164', 'WEAPON7': '0.200', 'HITCOUNT': '0.230', 'weapon4': '0.242', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'DAMAGECOUNT': '0.810', 'weapon3': '1.024', 'weapon2': '1.758', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:03:47,389][2409565] DAMAGECOUNT value on done: 3858.0
[2023-02-25 13:03:47,393][2409565] Sum rewards: 5.978, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.344', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.024', 'weapon7': '0.058', 'AMMO3': '0.099', 'AMMO4': '0.119', 'weapon5': '0.216', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'HITCOUNT': '0.540', 'WEAPON3': '0.550', 'weapon4': '0.810', 'weapon2': '0.932', 'weapon3': '1.410', 'DAMAGECOUNT': '2.631', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:03:47,818][2409101] DAMAGECOUNT value on done: 3923.0
[2023-02-25 13:03:47,822][2409101] Sum rewards: 3.448, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.041', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO5': '0.020', 'WEAPON1': '0.060', 'AMMO3': '0.067', 'weapon5': '0.186', 'WEAPON5': '0.500', 'WEAPON3': '0.500', 'HITCOUNT': '0.520', 'weapon3': '1.390', 'weapon2': '1.710', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.079'}
[2023-02-25 13:03:47,891][2409074] Updated weights for policy 0, policy_version 16631 (0.0014)
[2023-02-25 13:03:48,687][2409103] DAMAGECOUNT value on done: 4075.0
[2023-02-25 13:03:48,688][2409103] Sum rewards: 8.917, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.148', 'AMMO5': '0.017', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'AMMO4': '0.112', 'AMMO3': '0.134', 'weapon5': '0.174', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.486', 'HITCOUNT': '0.690', 'WEAPON3': '0.700', 'ARMOR': '0.889', 'weapon2': '0.990', 'weapon3': '1.864', 'DAMAGECOUNT': '2.745', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:03:48,888][2409074] Updated weights for policy 0, policy_version 16641 (0.0012)
[2023-02-25 13:03:48,941][2409597] DAMAGECOUNT value on done: 4036.0
[2023-02-25 13:03:48,944][2409597] Sum rewards: 9.115, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.525', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.031', 'weapon7': '0.048', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.124', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.590', 'weapon3': '1.200', 'weapon2': '1.414', 'DAMAGECOUNT': '2.172', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:03:49,597][2409102] DAMAGECOUNT value on done: 3433.0
[2023-02-25 13:03:49,598][2409102] Sum rewards: 11.574, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.419', 'AMMO5': '0.015', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'weapon5': '0.050', 'AMMO4': '0.077', 'weapon7': '0.080', 'weapon4': '0.090', 'AMMO3': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.810', 'weapon3': '1.272', 'weapon2': '1.822', 'DAMAGECOUNT': '3.669', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:03:49,750][2409549] DAMAGECOUNT value on done: 3322.0
[2023-02-25 13:03:49,753][2409549] Sum rewards: 4.251, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.425', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'AMMO3': '0.060', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'weapon4': '0.170', 'weapon5': '0.204', 'HITCOUNT': '0.230', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.812', 'DAMAGECOUNT': '1.290', 'weapon3': '1.502', 'weapon2': '1.670', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:03:50,728][2409485] DAMAGECOUNT value on done: 4799.0
[2023-02-25 13:03:50,729][2409485] Sum rewards: 1.084, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.482', 'AMMO5': '0.012', 'ARMOR': '0.024', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'AMMO3': '0.086', 'weapon5': '0.106', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.330', 'weapon4': '0.412', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.083', 'weapon3': '1.368', 'weapon2': '1.690', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:03:51,007][2409565] DAMAGECOUNT value on done: 4048.0
[2023-02-25 13:03:51,008][2409565] Sum rewards: 10.191, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.438', 'AMMO5': '0.027', 'AMMO2': '0.039', 'WEAPON1': '0.050', 'AMMO3': '0.140', 'AMMO4': '0.196', 'weapon5': '0.202', 'weapon4': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.650', 'HITCOUNT': '0.770', 'ARMOR': '0.837', 'WEAPON3': '0.900', 'weapon2': '1.266', 'weapon3': '1.652', 'DAMAGECOUNT': '2.805', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:03:51,317][2409074] Updated weights for policy 0, policy_version 16651 (0.0013)
[2023-02-25 13:03:51,477][2409101] DAMAGECOUNT value on done: 4232.0
[2023-02-25 13:03:51,478][2409101] Sum rewards: 9.507, reward structure: {'DEATHCOUNT': '-7.500', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon5': '0.074', 'weapon4': '0.092', 'AMMO4': '0.096', 'HEALTH': '0.147', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'WEAPON3': '0.700', 'HITCOUNT': '0.820', 'weapon3': '1.546', 'weapon2': '1.862', 'DAMAGECOUNT': '3.078', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:03:51,645][2409100] DAMAGECOUNT value on done: 3802.0
[2023-02-25 13:03:51,646][2409100] Sum rewards: 6.227, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.063', 'AMMO3': '0.088', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.112', 'HEALTH': '0.118', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.360', 'ARMOR': '0.444', 'WEAPON3': '0.550', 'HITCOUNT': '0.630', 'weapon2': '1.360', 'weapon3': '1.482', 'DAMAGECOUNT': '2.079', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:03:51,722][2409548] DAMAGECOUNT value on done: 4535.0
[2023-02-25 13:03:51,723][2409548] Sum rewards: 10.150, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.312', 'AMMO5': '0.012', 'AMMO2': '0.013', 'ARMOR': '0.036', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.093', 'weapon4': '0.116', 'weapon5': '0.206', 'WEAPON5': '0.350', 'HITCOUNT': '0.590', 'WEAPON3': '0.600', 'weapon2': '1.448', 'weapon3': '1.726', 'DAMAGECOUNT': '2.367', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:03:52,186][2408954] Fps is (10 sec: 25804.9, 60 sec: 25873.1, 300 sec: 25589.6). Total num frames: 68239360. Throughput: 0: 6453.6. Samples: 17052996. Policy #0 lag: (min: 0.0, avg: 12.8, max: 25.0)
[2023-02-25 13:03:52,186][2408954] Avg episode reward: [(0, '5.522')]
[2023-02-25 13:03:52,188][2409033] Saving new best policy, reward=5.522!
[2023-02-25 13:03:52,288][2409103] DAMAGECOUNT value on done: 3353.0
[2023-02-25 13:03:52,290][2409103] Sum rewards: 2.574, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.204', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.095', 'weapon5': '0.108', 'AMMO4': '0.115', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.670', 'weapon4': '0.728', 'ARMOR': '0.926', 'weapon2': '0.928', 'weapon3': '1.840', 'DAMAGECOUNT': '2.214', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:03:52,354][2409074] Updated weights for policy 0, policy_version 16661 (0.0012)
[2023-02-25 13:03:52,677][2409597] DAMAGECOUNT value on done: 3308.0
[2023-02-25 13:03:52,680][2409597] Sum rewards: 1.490, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.520', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'weapon4': '0.016', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'weapon5': '0.060', 'AMMO3': '0.078', 'WEAPON5': '0.200', 'HITCOUNT': '0.250', 'WEAPON3': '0.500', 'ARMOR': '0.906', 'weapon3': '1.216', 'DAMAGECOUNT': '1.350', 'FRAGCOUNT': '2.000', 'weapon2': '2.054'}
[2023-02-25 13:03:53,185][2409102] DAMAGECOUNT value on done: 4724.0
[2023-02-25 13:03:53,189][2409102] Sum rewards: 0.719, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.918', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO5': '0.015', 'weapon7': '0.048', 'AMMO3': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.348', 'HITCOUNT': '0.370', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'weapon3': '1.134', 'weapon2': '1.278', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.800'}
[2023-02-25 13:03:53,292][2409549] DAMAGECOUNT value on done: 3905.0
[2023-02-25 13:03:53,295][2409549] Sum rewards: 7.040, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.326', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'AMMO4': '0.047', 'weapon7': '0.056', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.292', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.490', 'weapon3': '0.972', 'weapon2': '1.734', 'DAMAGECOUNT': '1.890', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:03:53,709][2409596] DAMAGECOUNT value on done: 4969.0
[2023-02-25 13:03:53,710][2409596] Sum rewards: 8.338, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.381', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'AMMO3': '0.083', 'weapon5': '0.118', 'AMMO4': '0.157', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.442', 'WEAPON3': '0.500', 'HITCOUNT': '0.650', 'weapon3': '1.312', 'weapon2': '1.666', 'ARMOR': '1.702', 'DAMAGECOUNT': '2.925', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:03:53,807][2409074] Updated weights for policy 0, policy_version 16671 (0.0012)
[2023-02-25 13:03:54,314][2409485] DAMAGECOUNT value on done: 5368.0
[2023-02-25 13:03:54,317][2409485] Sum rewards: 14.778, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.874', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'AMMO3': '0.124', 'AMMO4': '0.141', 'weapon4': '0.226', 'weapon5': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.810', 'ARMOR': '0.892', 'weapon2': '1.422', 'weapon3': '1.782', 'DAMAGECOUNT': '4.005', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:03:54,605][2409565] DAMAGECOUNT value on done: 4397.0
[2023-02-25 13:03:54,608][2409565] Sum rewards: 4.263, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.340', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.086', 'weapon7': '0.108', 'AMMO4': '0.120', 'weapon5': '0.154', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.440', 'WEAPON4': '0.450', 'ARMOR': '0.455', 'weapon4': '0.548', 'WEAPON3': '0.650', 'weapon2': '1.222', 'weapon3': '1.288', 'DAMAGECOUNT': '2.436', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:03:54,929][2409105] DAMAGECOUNT value on done: 3991.0
[2023-02-25 13:03:54,931][2409105] Sum rewards: 4.388, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.590', 'AMMO5': '0.009', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'weapon7': '0.050', 'AMMO4': '0.080', 'weapon5': '0.112', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.300', 'HITCOUNT': '0.330', 'weapon4': '0.552', 'weapon3': '0.940', 'weapon2': '1.294', 'DAMAGECOUNT': '1.584', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:03:55,065][2409101] DAMAGECOUNT value on done: 4238.0
[2023-02-25 13:03:55,776][2409074] Updated weights for policy 0, policy_version 16681 (0.0013)
[2023-02-25 13:03:55,845][2409100] DAMAGECOUNT value on done: 2717.0
[2023-02-25 13:03:55,846][2409100] Sum rewards: 9.666, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.644', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon7': '0.056', 'AMMO3': '0.073', 'weapon5': '0.148', 'AMMO4': '0.165', 'WEAPON5': '0.250', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.460', 'WEAPON3': '0.500', 'weapon4': '0.612', 'weapon3': '0.916', 'weapon2': '0.976', 'ARMOR': '1.745', 'DAMAGECOUNT': '2.160', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:03:55,935][2409103] DAMAGECOUNT value on done: 3223.0
[2023-02-25 13:03:55,989][2409548] DAMAGECOUNT value on done: 3188.0
[2023-02-25 13:03:55,990][2409548] Sum rewards: 0.302, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.034', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.096', 'AMMO3': '0.107', 'AMMO4': '0.137', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'HITCOUNT': '0.470', 'WEAPON3': '0.600', 'weapon4': '0.778', 'ARMOR': '0.857', 'FRAGCOUNT': '1.000', 'weapon2': '1.028', 'DAMAGECOUNT': '1.311', 'weapon3': '1.452'}
[2023-02-25 13:03:56,675][2409597] DAMAGECOUNT value on done: 4700.0
[2023-02-25 13:03:56,676][2409597] Sum rewards: 2.515, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.485', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.037', 'AMMO3': '0.099', 'weapon5': '0.118', 'WEAPON4': '0.200', 'HITCOUNT': '0.310', 'WEAPON5': '0.350', 'weapon4': '0.434', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.302', 'weapon2': '1.490', 'weapon3': '1.704', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:03:56,837][2409102] DAMAGECOUNT value on done: 4106.0
[2023-02-25 13:03:56,838][2409102] Sum rewards: 5.927, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.905', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO3': '0.032', 'weapon7': '0.090', 'weapon5': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.260', 'weapon3': '0.710', 'ARMOR': '1.336', 'DAMAGECOUNT': '1.428', 'weapon2': '2.402', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:03:56,866][2409549] DAMAGECOUNT value on done: 3884.0
[2023-02-25 13:03:56,869][2409549] Sum rewards: 6.217, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.552', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO5': '0.010', 'AMMO3': '0.030', 'WEAPON1': '0.030', 'weapon7': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.170', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.260', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'weapon3': '0.820', 'DAMAGECOUNT': '1.380', 'weapon2': '2.624', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:03:57,186][2408954] Fps is (10 sec: 25804.3, 60 sec: 25668.2, 300 sec: 25547.9). Total num frames: 68362240. Throughput: 0: 6436.5. Samples: 17091240. Policy #0 lag: (min: 0.0, avg: 12.8, max: 25.0)
[2023-02-25 13:03:57,186][2408954] Avg episode reward: [(0, '5.581')]
[2023-02-25 13:03:57,191][2409033] Saving new best policy, reward=5.581!
[2023-02-25 13:03:57,362][2409074] Updated weights for policy 0, policy_version 16691 (0.0012)
[2023-02-25 13:03:57,421][2409596] DAMAGECOUNT value on done: 4394.0
[2023-02-25 13:03:57,422][2409596] Sum rewards: 8.329, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.264', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'weapon5': '0.176', 'weapon4': '0.284', 'WEAPON5': '0.350', 'ARMOR': '0.484', 'WEAPON3': '0.500', 'HITCOUNT': '0.640', 'weapon3': '1.368', 'weapon2': '1.778', 'DAMAGECOUNT': '2.574', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:03:57,988][2409485] DAMAGECOUNT value on done: 3253.0
[2023-02-25 13:03:58,326][2409565] DAMAGECOUNT value on done: 5312.0
[2023-02-25 13:03:58,327][2409565] Sum rewards: 6.440, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.150', 'AMMO2': '0.020', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'weapon7': '0.060', 'AMMO4': '0.098', 'AMMO3': '0.119', 'weapon5': '0.140', 'WEAPON4': '0.150', 'weapon4': '0.200', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON5': '0.400', 'HITCOUNT': '0.570', 'WEAPON3': '0.650', 'weapon2': '1.378', 'weapon3': '1.690', 'DAMAGECOUNT': '2.415', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:03:58,459][2409866] DAMAGECOUNT value on done: 3373.0
[2023-02-25 13:03:58,460][2409866] Sum rewards: 1.002, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.322', 'AMMO5': '0.008', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.043', 'AMMO3': '0.049', 'WEAPON4': '0.050', 'weapon7': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.158', 'HITCOUNT': '0.190', 'WEAPON5': '0.250', 'weapon4': '0.250', 'WEAPON3': '0.300', 'FRAGCOUNT': '0.500', 'weapon3': '0.582', 'DAMAGECOUNT': '0.960', 'ARMOR': '1.269', 'weapon2': '1.560'}
[2023-02-25 13:03:58,476][2409077] DAMAGECOUNT value on done: 4818.0
[2023-02-25 13:03:58,477][2409077] Sum rewards: 4.487, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO4': '0.024', 'weapon7': '0.048', 'HEALTH': '0.072', 'AMMO3': '0.077', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.168', 'HITCOUNT': '0.210', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'ARMOR': '0.500', 'weapon2': '1.436', 'weapon3': '1.502', 'DAMAGECOUNT': '1.515', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:03:58,484][2409406] DAMAGECOUNT value on done: 3506.0
[2023-02-25 13:03:58,485][2409406] Sum rewards: 4.597, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.906', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.025', 'weapon7': '0.056', 'WEAPON1': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.121', 'weapon5': '0.158', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'WEAPON5': '0.550', 'HITCOUNT': '0.590', 'WEAPON3': '0.900', 'weapon2': '1.148', 'weapon3': '1.868', 'DAMAGECOUNT': '2.676', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:03:58,646][2409101] DAMAGECOUNT value on done: 3956.0
[2023-02-25 13:03:58,647][2409101] Sum rewards: 10.836, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.587', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.027', 'WEAPON1': '0.040', 'AMMO3': '0.073', 'weapon4': '0.104', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.214', 'WEAPON5': '0.350', 'ARMOR': '0.451', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'weapon2': '1.592', 'weapon3': '1.708', 'DAMAGECOUNT': '2.877', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:03:58,663][2409105] DAMAGECOUNT value on done: 3692.0
[2023-02-25 13:03:58,664][2409105] Sum rewards: 4.999, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.701', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'weapon4': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.087', 'weapon7': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.258', 'WEAPON5': '0.400', 'ARMOR': '0.460', 'HITCOUNT': '0.520', 'WEAPON3': '0.600', 'weapon2': '1.286', 'weapon3': '1.824', 'DAMAGECOUNT': '1.836', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:03:58,968][2409074] Updated weights for policy 0, policy_version 16701 (0.0012)
[2023-02-25 13:03:59,488][2409103] DAMAGECOUNT value on done: 4343.0
[2023-02-25 13:03:59,492][2409103] Sum rewards: 4.492, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.844', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.066', 'AMMO3': '0.067', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.104', 'weapon5': '0.150', 'AMMO4': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.430', 'WEAPON3': '0.450', 'ARMOR': '0.800', 'weapon2': '1.186', 'weapon3': '1.400', 'DAMAGECOUNT': '1.968', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:03:59,753][2409100] DAMAGECOUNT value on done: 4900.0
[2023-02-25 13:03:59,757][2409100] Sum rewards: 8.268, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.576', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon7': '0.074', 'AMMO3': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.118', 'AMMO4': '0.133', 'WEAPON4': '0.150', 'weapon4': '0.288', 'WEAPON5': '0.500', 'HITCOUNT': '0.500', 'WEAPON3': '0.550', 'ARMOR': '0.956', 'weapon3': '1.284', 'weapon2': '1.460', 'DAMAGECOUNT': '2.382', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:03:59,945][2409548] DAMAGECOUNT value on done: 4355.0
[2023-02-25 13:03:59,946][2409548] Sum rewards: 11.992, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.093', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.020', 'AMMO3': '0.096', 'AMMO4': '0.100', 'weapon5': '0.152', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.332', 'ARMOR': '0.456', 'WEAPON3': '0.550', 'HITCOUNT': '0.810', 'weapon3': '1.242', 'weapon2': '2.110', 'DAMAGECOUNT': '3.345', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:04:00,411][2409549] DAMAGECOUNT value on done: 3382.0
[2023-02-25 13:04:00,412][2409549] Sum rewards: 8.971, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.010', 'AMMO2': '0.029', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.066', 'weapon5': '0.074', 'HEALTH': '0.120', 'AMMO4': '0.145', 'weapon4': '0.226', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'HITCOUNT': '0.590', 'weapon2': '1.104', 'weapon3': '1.240', 'DAMAGECOUNT': '2.367', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:00,415][2409597] DAMAGECOUNT value on done: 5128.0
[2023-02-25 13:04:00,418][2409597] Sum rewards: 7.885, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.606', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon5': '0.050', 'weapon7': '0.066', 'AMMO4': '0.099', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.244', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'HITCOUNT': '0.720', 'ARMOR': '0.920', 'weapon2': '0.984', 'weapon3': '1.820', 'DAMAGECOUNT': '2.613', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:00,427][2409102] DAMAGECOUNT value on done: 4090.0
[2023-02-25 13:04:00,430][2409102] Sum rewards: 4.691, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'AMMO3': '0.050', 'weapon7': '0.056', 'weapon5': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'HEALTH': '0.201', 'WEAPON4': '0.250', 'WEAPON3': '0.300', 'ARMOR': '0.428', 'HITCOUNT': '0.530', 'weapon4': '0.562', 'weapon3': '0.746', 'weapon2': '1.244', 'DAMAGECOUNT': '2.226', 'FRAGCOUNT': '2.500'}
[2023-02-25 13:04:00,456][2409074] Updated weights for policy 0, policy_version 16711 (0.0012)
[2023-02-25 13:04:00,517][2409355] DAMAGECOUNT value on done: 4296.0
[2023-02-25 13:04:00,518][2409355] Sum rewards: 16.341, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.842', 'AMMO5': '0.005', 'AMMO2': '0.015', 'ARMOR': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.077', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'weapon5': '0.118', 'WEAPON4': '0.150', 'weapon4': '0.420', 'WEAPON3': '0.650', 'HITCOUNT': '0.950', 'weapon2': '1.556', 'weapon3': '1.606', 'DAMAGECOUNT': '4.650', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:04:01,207][2409596] DAMAGECOUNT value on done: 2838.0
[2023-02-25 13:04:01,211][2409596] Sum rewards: 6.594, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.550', 'AMMO5': '0.003', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.016', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'weapon7': '0.050', 'weapon5': '0.064', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.464', 'ARMOR': '0.472', 'HITCOUNT': '0.500', 'weapon3': '1.026', 'weapon2': '1.456', 'DAMAGECOUNT': '1.890', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:01,829][2409074] Updated weights for policy 0, policy_version 16721 (0.0013)
[2023-02-25 13:04:01,859][2409373] DAMAGECOUNT value on done: 4218.0
[2023-02-25 13:04:01,861][2409373] Sum rewards: 11.175, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.652', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO4': '0.022', 'AMMO3': '0.087', 'weapon5': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.278', 'WEAPON3': '0.600', 'ARMOR': '0.800', 'HITCOUNT': '0.840', 'weapon3': '1.646', 'weapon2': '1.664', 'DAMAGECOUNT': '3.498', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:04:01,954][2409565] DAMAGECOUNT value on done: 4961.0
[2023-02-25 13:04:01,955][2409565] Sum rewards: 2.065, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.800', 'AMMO4': '-0.057', 'AMMO2': '-0.011', 'AMMO5': '0.013', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'weapon5': '0.156', 'WEAPON5': '0.250', 'HITCOUNT': '0.360', 'WEAPON3': '0.400', 'weapon3': '1.346', 'DAMAGECOUNT': '1.434', 'FRAGCOUNT': '1.500', 'weapon2': '1.884'}
[2023-02-25 13:04:02,060][2409866] DAMAGECOUNT value on done: 4413.0
[2023-02-25 13:04:02,063][2409866] Sum rewards: 6.256, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.578', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.017', 'weapon5': '0.062', 'weapon7': '0.066', 'AMMO3': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.312', 'HITCOUNT': '0.680', 'WEAPON3': '0.800', 'ARMOR': '0.914', 'weapon2': '1.416', 'weapon3': '1.434', 'DAMAGECOUNT': '2.298', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:04:02,153][2409104] DAMAGECOUNT value on done: 4205.0
[2023-02-25 13:04:02,154][2409104] Sum rewards: 11.555, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.459', 'AMMO2': '0.007', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'weapon5': '0.116', 'weapon4': '0.274', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.630', 'ARMOR': '0.953', 'weapon2': '1.456', 'weapon3': '1.532', 'DAMAGECOUNT': '2.805', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:04:02,186][2408954] Fps is (10 sec: 24985.9, 60 sec: 25873.2, 300 sec: 25589.6). Total num frames: 68489216. Throughput: 0: 6437.9. Samples: 17129988. Policy #0 lag: (min: 0.0, avg: 13.6, max: 26.0)
[2023-02-25 13:04:02,186][2408954] Avg episode reward: [(0, '6.093')]
[2023-02-25 13:04:02,187][2409033] Saving new best policy, reward=6.093!
[2023-02-25 13:04:02,198][2409485] DAMAGECOUNT value on done: 4143.0
[2023-02-25 13:04:02,199][2409485] Sum rewards: 9.716, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.845', 'AMMO5': '0.003', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO4': '0.018', 'weapon5': '0.018', 'ARMOR': '0.024', 'WEAPON5': '0.050', 'AMMO3': '0.069', 'WEAPON4': '0.200', 'weapon7': '0.256', 'HITCOUNT': '0.290', 'WEAPON3': '0.450', 'AMMO6': '0.480', 'AMMO7': '0.480', 'weapon4': '0.498', 'weapon3': '0.750', 'WEAPON7': '0.800', 'weapon2': '0.810', 'DAMAGECOUNT': '2.352', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:02,337][2409101] DAMAGECOUNT value on done: 2850.0
[2023-02-25 13:04:02,371][2409105] DAMAGECOUNT value on done: 5370.0
[2023-02-25 13:04:02,374][2409105] Sum rewards: 11.002, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.352', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.015', 'weapon7': '0.048', 'AMMO4': '0.053', 'AMMO3': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.164', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.302', 'WEAPON3': '0.400', 'HITCOUNT': '0.620', 'weapon3': '1.008', 'ARMOR': '1.351', 'weapon2': '1.868', 'DAMAGECOUNT': '3.504', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:02,638][2409077] DAMAGECOUNT value on done: 4111.0
[2023-02-25 13:04:02,639][2409077] Sum rewards: 10.406, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.026', 'weapon7': '0.048', 'weapon5': '0.054', 'AMMO3': '0.055', 'HEALTH': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.350', 'weapon4': '0.368', 'HITCOUNT': '0.480', 'weapon2': '0.714', 'weapon3': '0.936', 'DAMAGECOUNT': '2.490', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:02,640][2409406] DAMAGECOUNT value on done: 4838.0
[2023-02-25 13:04:02,643][2409406] Sum rewards: 15.968, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.614', 'AMMO2': '0.010', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.052', 'AMMO3': '0.076', 'WEAPON4': '0.150', 'weapon5': '0.180', 'weapon4': '0.218', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'ARMOR': '0.575', 'HITCOUNT': '0.710', 'weapon2': '1.540', 'weapon3': '1.556', 'DAMAGECOUNT': '4.680', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:04:03,284][2409100] DAMAGECOUNT value on done: 4464.0
[2023-02-25 13:04:03,287][2409100] Sum rewards: 5.085, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.156', 'AMMO2': '0.011', 'AMMO5': '0.024', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO4': '0.054', 'weapon4': '0.066', 'AMMO3': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.196', 'WEAPON7': '0.200', 'ARMOR': '0.541', 'WEAPON5': '0.550', 'HITCOUNT': '0.560', 'WEAPON3': '0.600', 'weapon3': '1.312', 'weapon2': '1.826', 'DAMAGECOUNT': '3.000', 'FRAGCOUNT': '3.500'}
[2023-02-25 13:04:03,504][2409548] DAMAGECOUNT value on done: 4831.0
[2023-02-25 13:04:03,505][2409548] Sum rewards: 9.917, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.354', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO3': '0.032', 'weapon5': '0.056', 'AMMO4': '0.056', 'WEAPON5': '0.100', 'WEAPON3': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.400', 'ARMOR': '0.463', 'weapon4': '0.562', 'weapon2': '0.606', 'weapon3': '0.696', 'DAMAGECOUNT': '1.986', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:03,656][2409074] Updated weights for policy 0, policy_version 16731 (0.0012)
[2023-02-25 13:04:03,702][2409103] DAMAGECOUNT value on done: 3964.0
[2023-02-25 13:04:03,703][2409103] Sum rewards: 1.710, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.560', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.016', 'WEAPON1': '0.040', 'weapon7': '0.058', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'weapon5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.410', 'ARMOR': '0.448', 'WEAPON3': '0.600', 'weapon2': '1.424', 'weapon3': '1.428', 'DAMAGECOUNT': '1.917', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:04:04,013][2409102] DAMAGECOUNT value on done: 4602.0
[2023-02-25 13:04:04,016][2409102] Sum rewards: 2.722, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.596', 'AMMO5': '0.022', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'weapon5': '0.062', 'AMMO3': '0.071', 'weapon7': '0.098', 'AMMO4': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.440', 'WEAPON4': '0.450', 'ARMOR': '0.453', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'weapon4': '0.688', 'weapon2': '1.160', 'DAMAGECOUNT': '1.410', 'weapon3': '1.558', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:04,093][2409597] DAMAGECOUNT value on done: 4173.0
[2023-02-25 13:04:04,096][2409597] Sum rewards: 8.027, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.679', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.059', 'weapon5': '0.068', 'AMMO3': '0.084', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.384', 'HITCOUNT': '0.520', 'WEAPON3': '0.550', 'ARMOR': '0.900', 'weapon2': '1.312', 'weapon3': '1.488', 'DAMAGECOUNT': '1.539', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:04:04,107][2409549] DAMAGECOUNT value on done: 3819.0
[2023-02-25 13:04:04,110][2409549] Sum rewards: 8.088, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.490', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.090', 'weapon5': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'ARMOR': '0.452', 'weapon4': '0.472', 'WEAPON3': '0.650', 'HITCOUNT': '0.730', 'weapon2': '1.036', 'weapon3': '1.056', 'DAMAGECOUNT': '2.658', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:04,117][2409355] DAMAGECOUNT value on done: 3309.0
[2023-02-25 13:04:04,118][2409355] Sum rewards: 1.838, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.610', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.015', 'WEAPON1': '0.040', 'weapon5': '0.056', 'AMMO3': '0.071', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.154', 'WEAPON3': '0.500', 'HITCOUNT': '0.560', 'weapon3': '1.268', 'DAMAGECOUNT': '1.614', 'weapon2': '1.962', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:04,211][2409407] DAMAGECOUNT value on done: 3720.0
[2023-02-25 13:04:04,211][2409407] Sum rewards: 9.851, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.522', 'AMMO5': '0.010', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO4': '0.071', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.262', 'weapon5': '0.288', 'ARMOR': '0.428', 'WEAPON3': '0.500', 'HITCOUNT': '0.680', 'weapon3': '1.162', 'weapon2': '1.664', 'DAMAGECOUNT': '2.364', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:04:04,404][2409405] DAMAGECOUNT value on done: 4950.0
[2023-02-25 13:04:04,405][2409405] Sum rewards: 10.861, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.852', 'AMMO2': '0.019', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO3': '0.092', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'weapon4': '0.262', 'weapon5': '0.316', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.690', 'weapon2': '1.038', 'weapon3': '1.690', 'DAMAGECOUNT': '3.111', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:04:04,979][2409074] Updated weights for policy 0, policy_version 16741 (0.0013)
[2023-02-25 13:04:04,991][2409596] DAMAGECOUNT value on done: 3660.0
[2023-02-25 13:04:04,996][2409596] Sum rewards: 8.737, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.678', 'AMMO2': '0.007', 'weapon4': '0.010', 'AMMO5': '0.020', 'AMMO4': '0.033', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon7': '0.076', 'AMMO3': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.200', 'WEAPON5': '0.450', 'HITCOUNT': '0.480', 'WEAPON3': '0.750', 'weapon2': '1.468', 'ARMOR': '1.600', 'weapon3': '1.798', 'DAMAGECOUNT': '3.375', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:04:05,563][2409373] DAMAGECOUNT value on done: 3596.0
[2023-02-25 13:04:05,565][2409373] Sum rewards: 1.951, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.628', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.030', 'AMMO4': '0.043', 'weapon7': '0.052', 'weapon5': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.141', 'WEAPON5': '0.150', 'weapon4': '0.154', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.300', 'WEAPON3': '0.800', 'ARMOR': '0.854', 'weapon3': '1.468', 'weapon2': '1.608', 'DAMAGECOUNT': '1.737', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:05,626][2409565] DAMAGECOUNT value on done: 4210.0
[2023-02-25 13:04:05,627][2409565] Sum rewards: 9.945, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.052', 'AMMO2': '0.013', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.073', 'weapon7': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.168', 'weapon4': '0.226', 'WEAPON5': '0.300', 'ARMOR': '0.428', 'WEAPON3': '0.500', 'HITCOUNT': '0.570', 'weapon2': '1.390', 'weapon3': '1.740', 'DAMAGECOUNT': '2.550', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:05,641][2409866] DAMAGECOUNT value on done: 4513.0
[2023-02-25 13:04:05,642][2409866] Sum rewards: 2.917, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.205', 'AMMO5': '0.008', 'AMMO2': '0.010', 'weapon7': '0.046', 'weapon5': '0.048', 'AMMO4': '0.050', 'AMMO3': '0.066', 'WEAPON4': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon4': '0.178', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.750', 'weapon3': '1.290', 'weapon2': '1.442', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '3.213'}
[2023-02-25 13:04:05,838][2409485] DAMAGECOUNT value on done: 4551.0
[2023-02-25 13:04:05,842][2409485] Sum rewards: 11.074, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.080', 'AMMO2': '0.007', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.033', 'AMMO3': '0.090', 'WEAPON4': '0.200', 'weapon4': '0.276', 'weapon5': '0.320', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.840', 'weapon2': '1.394', 'weapon3': '1.622', 'DAMAGECOUNT': '3.477', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:04:05,887][2409104] DAMAGECOUNT value on done: 3715.0
[2023-02-25 13:04:05,888][2409104] Sum rewards: 5.506, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'ARMOR': '0.028', 'AMMO2': '0.037', 'weapon5': '0.054', 'HEALTH': '0.070', 'AMMO3': '0.085', 'AMMO4': '0.183', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.362', 'HITCOUNT': '0.440', 'WEAPON3': '0.500', 'weapon3': '1.320', 'weapon2': '1.486', 'DAMAGECOUNT': '1.671', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:05,969][2409101] DAMAGECOUNT value on done: 3477.0
[2023-02-25 13:04:05,970][2409101] Sum rewards: 2.602, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.720', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.073', 'AMMO3': '0.100', 'weapon5': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.376', 'HITCOUNT': '0.450', 'ARMOR': '0.459', 'WEAPON3': '0.600', 'weapon3': '1.504', 'weapon2': '1.534', 'DAMAGECOUNT': '1.857', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:05,973][2409105] DAMAGECOUNT value on done: 3909.0
[2023-02-25 13:04:05,975][2409105] Sum rewards: 6.719, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.058', 'AMMO3': '0.072', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.206', 'HEALTH': '0.284', 'WEAPON3': '0.400', 'HITCOUNT': '0.500', 'weapon3': '1.356', 'weapon2': '1.574', 'DAMAGECOUNT': '1.773', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:06,973][2409074] Updated weights for policy 0, policy_version 16751 (0.0018)
[2023-02-25 13:04:07,102][2409077] DAMAGECOUNT value on done: 4229.0
[2023-02-25 13:04:07,105][2409077] Sum rewards: 4.537, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.509', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.072', 'AMMO3': '0.076', 'AMMO4': '0.112', 'weapon7': '0.120', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON7': '0.400', 'ARMOR': '0.484', 'WEAPON3': '0.500', 'HITCOUNT': '0.520', 'weapon4': '0.598', 'weapon2': '0.798', 'weapon3': '0.922', 'DAMAGECOUNT': '1.581', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:07,106][2409406] DAMAGECOUNT value on done: 3626.0
[2023-02-25 13:04:07,111][2409406] Sum rewards: 7.405, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.612', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'weapon7': '0.054', 'AMMO3': '0.066', 'weapon5': '0.088', 'AMMO4': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.392', 'HITCOUNT': '0.450', 'WEAPON3': '0.500', 'weapon4': '0.900', 'weapon3': '1.400', 'DAMAGECOUNT': '2.163', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:07,140][2409100] DAMAGECOUNT value on done: 3838.0
[2023-02-25 13:04:07,141][2409100] Sum rewards: 5.225, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.880', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'weapon4': '0.056', 'AMMO4': '0.084', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.108', 'AMMO3': '0.137', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'HITCOUNT': '0.540', 'WEAPON3': '0.800', 'weapon3': '1.470', 'weapon2': '1.788', 'DAMAGECOUNT': '1.833', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:07,186][2408954] Fps is (10 sec: 25395.7, 60 sec: 25600.0, 300 sec: 25547.9). Total num frames: 68616192. Throughput: 0: 6433.9. Samples: 17149032. Policy #0 lag: (min: 0.0, avg: 13.6, max: 26.0)
[2023-02-25 13:04:07,186][2408954] Avg episode reward: [(0, '6.584')]
[2023-02-25 13:04:07,190][2409033] Saving new best policy, reward=6.584!
[2023-02-25 13:04:07,309][2409103] DAMAGECOUNT value on done: 3294.0
[2023-02-25 13:04:07,309][2409103] Sum rewards: 2.246, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.536', 'weapon7': '0.006', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'AMMO3': '0.092', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.110', 'AMMO4': '0.164', 'WEAPON4': '0.200', 'weapon4': '0.210', 'WEAPON5': '0.400', 'ARMOR': '0.432', 'HITCOUNT': '0.530', 'WEAPON3': '0.650', 'weapon2': '1.438', 'DAMAGECOUNT': '1.500', 'weapon3': '1.680', 'FRAGCOUNT': '2.500'}
[2023-02-25 13:04:07,440][2409548] DAMAGECOUNT value on done: 4891.0
[2023-02-25 13:04:07,443][2409548] Sum rewards: 7.694, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.043', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.007', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'weapon7': '0.070', 'AMMO3': '0.079', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.316', 'WEAPON3': '0.550', 'HITCOUNT': '0.570', 'weapon2': '1.356', 'weapon3': '1.840', 'DAMAGECOUNT': '3.120', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:07,697][2409597] DAMAGECOUNT value on done: 4748.0
[2023-02-25 13:04:07,697][2409597] Sum rewards: 4.845, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.188', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon7': '0.048', 'weapon5': '0.078', 'AMMO3': '0.081', 'weapon4': '0.096', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.390', 'ARMOR': '0.451', 'WEAPON3': '0.600', 'weapon2': '1.334', 'weapon3': '1.466', 'DAMAGECOUNT': '1.965', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:07,710][2409102] DAMAGECOUNT value on done: 4029.0
[2023-02-25 13:04:07,711][2409102] Sum rewards: 7.762, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.520', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.056', 'ARMOR': '0.056', 'AMMO3': '0.070', 'weapon7': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.390', 'weapon4': '0.430', 'WEAPON3': '0.500', 'weapon2': '1.152', 'weapon3': '1.526', 'DAMAGECOUNT': '2.058', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:07,712][2409549] DAMAGECOUNT value on done: 3592.0
[2023-02-25 13:04:07,717][2409549] Sum rewards: 2.166, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.000', 'AMMO2': '0.004', 'AMMO5': '0.009', 'AMMO4': '0.022', 'WEAPON1': '0.030', 'weapon7': '0.050', 'AMMO3': '0.063', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.282', 'HITCOUNT': '0.290', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.879', 'ARMOR': '0.957', 'FRAGCOUNT': '1.000', 'weapon3': '1.014', 'weapon2': '1.648'}
[2023-02-25 13:04:07,745][2409355] DAMAGECOUNT value on done: 5733.0
[2023-02-25 13:04:07,747][2409355] Sum rewards: 11.289, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.000', 'AMMO4': '0.002', 'HEALTH': '0.005', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon7': '0.048', 'AMMO3': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.114', 'WEAPON5': '0.200', 'WEAPON3': '0.400', 'HITCOUNT': '0.700', 'ARMOR': '0.800', 'weapon3': '1.198', 'weapon2': '1.954', 'DAMAGECOUNT': '2.250', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:07,791][2409407] DAMAGECOUNT value on done: 4250.0
[2023-02-25 13:04:07,792][2409407] Sum rewards: 14.058, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.014', 'AMMO2': '0.005', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.027', 'AMMO3': '0.060', 'weapon5': '0.200', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.440', 'WEAPON3': '0.450', 'weapon3': '1.518', 'weapon2': '2.040', 'DAMAGECOUNT': '3.249', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:04:08,312][2409033] Signal inference workers to stop experience collection... (2050 times)
[2023-02-25 13:04:08,332][2409033] Signal inference workers to resume experience collection... (2050 times)
[2023-02-25 13:04:08,348][2409074] Updated weights for policy 0, policy_version 16761 (0.0012)
[2023-02-25 13:04:08,358][2409074] InferenceWorker_p0-w0: stopping experience collection (2050 times)
[2023-02-25 13:04:08,373][2409074] InferenceWorker_p0-w0: resuming experience collection (2050 times)
[2023-02-25 13:04:08,496][2409405] DAMAGECOUNT value on done: 3399.0
[2023-02-25 13:04:08,499][2409405] Sum rewards: 2.774, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.914', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.018', 'WEAPON1': '0.070', 'weapon5': '0.122', 'AMMO3': '0.126', 'WEAPON5': '0.450', 'HITCOUNT': '0.670', 'WEAPON3': '0.900', 'weapon2': '1.520', 'weapon3': '1.924', 'DAMAGECOUNT': '2.673', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:08,571][2409389] DAMAGECOUNT value on done: 3503.0
[2023-02-25 13:04:08,571][2409389] Sum rewards: 6.459, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.222', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.005', 'AMMO3': '0.030', 'WEAPON4': '0.100', 'weapon5': '0.120', 'WEAPON5': '0.150', 'WEAPON3': '0.250', 'weapon4': '0.266', 'HITCOUNT': '0.270', 'weapon3': '0.740', 'ARMOR': '0.927', 'DAMAGECOUNT': '1.686', 'weapon2': '1.886', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:08,712][2409596] DAMAGECOUNT value on done: 4703.0
[2023-02-25 13:04:08,713][2409596] Sum rewards: 14.248, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.688', 'AMMO5': '0.013', 'AMMO2': '0.015', 'weapon5': '0.052', 'weapon7': '0.056', 'AMMO4': '0.077', 'AMMO3': '0.084', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'weapon4': '0.264', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '1.080', 'weapon3': '1.172', 'weapon2': '1.618', 'DAMAGECOUNT': '4.455', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:04:09,209][2409373] DAMAGECOUNT value on done: 3669.0
[2023-02-25 13:04:09,212][2409373] Sum rewards: 3.985, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.424', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon7': '0.060', 'AMMO3': '0.072', 'weapon5': '0.102', 'AMMO4': '0.123', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.300', 'ARMOR': '0.436', 'HITCOUNT': '0.440', 'weapon4': '0.482', 'WEAPON3': '0.500', 'weapon2': '1.096', 'weapon3': '1.302', 'DAMAGECOUNT': '2.004', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:09,227][2409565] DAMAGECOUNT value on done: 3616.0
[2023-02-25 13:04:09,228][2409565] Sum rewards: 6.576, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.496', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.052', 'AMMO3': '0.060', 'weapon7': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.178', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.520', 'WEAPON4': '0.600', 'weapon4': '0.966', 'weapon2': '1.264', 'weapon3': '1.270', 'ARMOR': '1.301', 'DAMAGECOUNT': '2.004', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:09,237][2409866] DAMAGECOUNT value on done: 4728.0
[2023-02-25 13:04:09,240][2409866] Sum rewards: 6.561, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.372', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.016', 'WEAPON1': '0.030', 'AMMO3': '0.081', 'weapon5': '0.084', 'WEAPON4': '0.100', 'weapon4': '0.150', 'WEAPON5': '0.250', 'HITCOUNT': '0.510', 'WEAPON3': '0.600', 'weapon3': '1.518', 'weapon2': '2.104', 'DAMAGECOUNT': '2.475', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:09,434][2409485] DAMAGECOUNT value on done: 4170.0
[2023-02-25 13:04:09,435][2409485] Sum rewards: 6.135, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.283', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO3': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.130', 'weapon4': '0.248', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.690', 'weapon2': '1.262', 'weapon3': '1.624', 'DAMAGECOUNT': '2.700', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:09,786][2409101] DAMAGECOUNT value on done: 6515.0
[2023-02-25 13:04:09,786][2409101] Sum rewards: 10.759, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.890', 'AMMO5': '0.012', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'AMMO3': '0.093', 'AMMO4': '0.094', 'weapon5': '0.146', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.694', 'WEAPON3': '0.700', 'weapon2': '0.710', 'HITCOUNT': '1.020', 'weapon3': '1.654', 'DAMAGECOUNT': '3.777', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:04:09,788][2409104] DAMAGECOUNT value on done: 5167.0
[2023-02-25 13:04:09,789][2409104] Sum rewards: 4.192, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.196', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'ARMOR': '0.032', 'AMMO3': '0.088', 'weapon5': '0.096', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.115', 'WEAPON5': '0.250', 'HITCOUNT': '0.410', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.371', 'weapon3': '1.562', 'weapon2': '1.812', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:09,973][2409074] Updated weights for policy 0, policy_version 16771 (0.0012)
[2023-02-25 13:04:10,272][2409105] DAMAGECOUNT value on done: 4172.0
[2023-02-25 13:04:10,273][2409105] Sum rewards: 10.808, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.186', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon7': '0.062', 'AMMO3': '0.067', 'weapon5': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'ARMOR': '0.428', 'WEAPON3': '0.450', 'HITCOUNT': '0.540', 'weapon2': '0.630', 'weapon4': '0.710', 'weapon3': '1.224', 'DAMAGECOUNT': '2.421', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:04:10,850][2409103] DAMAGECOUNT value on done: 3997.0
[2023-02-25 13:04:10,851][2409103] Sum rewards: 6.118, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.394', 'AMMO2': '0.007', 'AMMO5': '0.016', 'AMMO4': '0.035', 'AMMO3': '0.083', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.104', 'weapon5': '0.196', 'WEAPON5': '0.300', 'HITCOUNT': '0.500', 'WEAPON3': '0.550', 'ARMOR': '0.900', 'weapon3': '1.370', 'weapon2': '1.550', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:11,099][2409100] DAMAGECOUNT value on done: 3572.0
[2023-02-25 13:04:11,102][2409100] Sum rewards: 4.376, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.550', 'AMMO2': '0.006', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'AMMO4': '0.032', 'AMMO3': '0.072', 'weapon7': '0.110', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.222', 'WEAPON7': '0.300', 'WEAPON5': '0.400', 'ARMOR': '0.448', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'weapon3': '1.064', 'weapon2': '1.702', 'DAMAGECOUNT': '2.097', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:11,294][2409102] DAMAGECOUNT value on done: 3629.0
[2023-02-25 13:04:11,297][2409102] Sum rewards: 7.890, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.158', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO3': '0.085', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.230', 'WEAPON5': '0.400', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'ARMOR': '1.369', 'weapon3': '1.372', 'weapon2': '2.200', 'DAMAGECOUNT': '2.712', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:11,336][2409355] DAMAGECOUNT value on done: 3745.0
[2023-02-25 13:04:11,340][2409355] Sum rewards: 9.683, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.255', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.019', 'weapon4': '0.052', 'weapon7': '0.062', 'AMMO3': '0.077', 'AMMO4': '0.096', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.216', 'WEAPON5': '0.450', 'ARMOR': '0.522', 'HITCOUNT': '0.560', 'WEAPON3': '0.600', 'weapon2': '1.614', 'weapon3': '1.678', 'DAMAGECOUNT': '2.496', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:11,429][2409548] DAMAGECOUNT value on done: 4574.0
[2023-02-25 13:04:11,433][2409548] Sum rewards: 5.748, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.406', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.029', 'weapon7': '0.060', 'AMMO3': '0.069', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.284', 'WEAPON3': '0.400', 'HITCOUNT': '0.430', 'ARMOR': '0.933', 'weapon2': '1.014', 'weapon3': '1.066', 'DAMAGECOUNT': '2.133', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:11,492][2409407] DAMAGECOUNT value on done: 5479.0
[2023-02-25 13:04:11,492][2409407] Sum rewards: 5.766, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.647', 'AMMO5': '0.013', 'AMMO2': '0.036', 'AMMO3': '0.063', 'weapon5': '0.066', 'weapon7': '0.088', 'AMMO4': '0.180', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.580', 'weapon2': '0.648', 'weapon4': '0.872', 'weapon3': '1.138', 'ARMOR': '1.284', 'DAMAGECOUNT': '2.205', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:11,624][2409406] DAMAGECOUNT value on done: 4108.0
[2023-02-25 13:04:11,627][2409406] Sum rewards: 7.994, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.372', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.132', 'weapon7': '0.172', 'WEAPON3': '0.250', 'HITCOUNT': '0.400', 'AMMO6': '0.440', 'AMMO7': '0.440', 'WEAPON7': '0.600', 'weapon3': '0.758', 'ARMOR': '1.338', 'DAMAGECOUNT': '1.860', 'weapon2': '1.894', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:11,635][2409077] DAMAGECOUNT value on done: 2825.0
[2023-02-25 13:04:11,635][2409077] Sum rewards: 5.055, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.040', 'weapon5': '0.094', 'WEAPON5': '0.100', 'weapon7': '0.110', 'AMMO4': '0.172', 'HITCOUNT': '0.180', 'WEAPON3': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'weapon3': '0.388', 'DAMAGECOUNT': '0.744', 'HEALTH': '0.775', 'weapon4': '0.896', 'ARMOR': '1.021', 'weapon2': '1.196', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:11,824][2409549] DAMAGECOUNT value on done: 4956.0
[2023-02-25 13:04:11,825][2409549] Sum rewards: 5.109, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.823', 'AMMO5': '0.012', 'AMMO2': '0.018', 'ARMOR': '0.039', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO3': '0.076', 'AMMO4': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.220', 'WEAPON4': '0.350', 'weapon4': '0.380', 'WEAPON5': '0.400', 'HITCOUNT': '0.530', 'WEAPON3': '0.600', 'weapon2': '0.676', 'weapon3': '1.108', 'DAMAGECOUNT': '2.154', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:11,909][2409074] Updated weights for policy 0, policy_version 16781 (0.0012)
[2023-02-25 13:04:12,038][2409597] DAMAGECOUNT value on done: 3602.0
[2023-02-25 13:04:12,038][2409597] Sum rewards: 6.480, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.928', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO3': '0.053', 'weapon5': '0.180', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'HITCOUNT': '0.490', 'weapon3': '1.214', 'weapon2': '1.780', 'DAMAGECOUNT': '2.004', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:12,186][2408954] Fps is (10 sec: 25804.8, 60 sec: 25736.6, 300 sec: 25561.8). Total num frames: 68747264. Throughput: 0: 6419.2. Samples: 17187204. Policy #0 lag: (min: 0.0, avg: 12.7, max: 27.0)
[2023-02-25 13:04:12,186][2408954] Avg episode reward: [(0, '6.594')]
[2023-02-25 13:04:12,187][2409033] Saving new best policy, reward=6.594!
[2023-02-25 13:04:12,413][2409389] DAMAGECOUNT value on done: 3505.0
[2023-02-25 13:04:12,416][2409389] Sum rewards: 11.724, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.067', 'AMMO2': '0.010', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.049', 'AMMO3': '0.066', 'weapon7': '0.118', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.232', 'weapon4': '0.266', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '0.460', 'ARMOR': '0.800', 'weapon3': '1.062', 'weapon2': '1.068', 'DAMAGECOUNT': '3.222', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:04:12,522][2409405] DAMAGECOUNT value on done: 3506.0
[2023-02-25 13:04:12,526][2409405] Sum rewards: 5.421, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.614', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.064', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'weapon4': '0.198', 'WEAPON5': '0.200', 'HITCOUNT': '0.410', 'WEAPON3': '0.550', 'weapon2': '1.116', 'ARMOR': '1.332', 'weapon3': '1.338', 'DAMAGECOUNT': '1.902', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:12,552][2409596] DAMAGECOUNT value on done: 2925.0
[2023-02-25 13:04:12,555][2409596] Sum rewards: 6.567, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.036', 'weapon7': '0.048', 'AMMO3': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.114', 'HEALTH': '0.122', 'WEAPON4': '0.150', 'AMMO4': '0.179', 'WEAPON5': '0.250', 'HITCOUNT': '0.350', 'ARMOR': '0.432', 'WEAPON3': '0.450', 'weapon4': '0.598', 'weapon2': '0.864', 'weapon3': '1.382', 'DAMAGECOUNT': '2.172', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:12,798][2409373] DAMAGECOUNT value on done: 4291.0
[2023-02-25 13:04:12,799][2409373] Sum rewards: 5.273, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.108', 'AMMO3': '0.050', 'AMMO2': '0.055', 'AMMO4': '0.275', 'WEAPON3': '0.300', 'ARMOR': '0.428', 'WEAPON4': '0.500', 'HITCOUNT': '0.510', 'weapon2': '0.954', 'weapon3': '1.002', 'weapon4': '1.060', 'DAMAGECOUNT': '1.497', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:12,854][2409866] DAMAGECOUNT value on done: 4355.0
[2023-02-25 13:04:12,855][2409866] Sum rewards: 4.440, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.910', 'AMMO2': '0.001', 'AMMO4': '0.006', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'weapon4': '0.172', 'weapon5': '0.278', 'WEAPON5': '0.350', 'ARMOR': '0.455', 'HITCOUNT': '0.560', 'WEAPON3': '0.800', 'weapon2': '1.126', 'weapon3': '1.862', 'DAMAGECOUNT': '2.244', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:13,008][2409565] DAMAGECOUNT value on done: 4282.0
[2023-02-25 13:04:13,012][2409565] Sum rewards: 11.631, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.008', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'AMMO4': '0.057', 'weapon7': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.196', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'weapon4': '0.522', 'HITCOUNT': '0.630', 'weapon2': '1.016', 'weapon3': '1.324', 'DAMAGECOUNT': '2.883', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:04:13,029][2409485] DAMAGECOUNT value on done: 3892.0
[2023-02-25 13:04:13,029][2409485] Sum rewards: 4.189, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.356', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'ARMOR': '0.034', 'WEAPON1': '0.040', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'weapon5': '0.124', 'WEAPON5': '0.150', 'weapon4': '0.312', 'HITCOUNT': '0.320', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.527', 'weapon3': '1.564', 'weapon2': '1.610', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:04:13,130][2409074] Updated weights for policy 0, policy_version 16791 (0.0013)
[2023-02-25 13:04:13,420][2409104] DAMAGECOUNT value on done: 3954.0
[2023-02-25 13:04:13,421][2409104] Sum rewards: 7.657, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.720', 'AMMO2': '0.003', 'AMMO4': '0.012', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO3': '0.087', 'weapon5': '0.164', 'WEAPON4': '0.200', 'weapon4': '0.242', 'ARMOR': '0.456', 'HITCOUNT': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon3': '1.212', 'weapon2': '1.872', 'DAMAGECOUNT': '2.979', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:04:13,857][2409101] DAMAGECOUNT value on done: 3953.0
[2023-02-25 13:04:13,857][2409101] Sum rewards: 5.154, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.608', 'AMMO2': '0.014', 'AMMO5': '0.022', 'WEAPON1': '0.040', 'AMMO4': '0.069', 'AMMO3': '0.074', 'WEAPON4': '0.100', 'weapon4': '0.188', 'weapon5': '0.228', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.600', 'weapon3': '1.210', 'weapon2': '1.834', 'DAMAGECOUNT': '3.132', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:04:13,970][2409105] DAMAGECOUNT value on done: 3410.0
[2023-02-25 13:04:13,973][2409105] Sum rewards: 5.650, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.440', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.025', 'AMMO3': '0.086', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.468', 'WEAPON3': '0.550', 'HITCOUNT': '0.600', 'ARMOR': '0.907', 'weapon2': '1.402', 'weapon3': '1.538', 'DAMAGECOUNT': '1.968', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:14,410][2409103] DAMAGECOUNT value on done: 4826.0
[2023-02-25 13:04:14,411][2409103] Sum rewards: 6.784, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.028', 'AMMO5': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'ARMOR': '0.056', 'AMMO3': '0.058', 'AMMO4': '0.077', 'weapon4': '0.136', 'weapon5': '0.144', 'HITCOUNT': '0.290', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'weapon3': '1.044', 'DAMAGECOUNT': '1.371', 'weapon2': '1.628', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:14,891][2409100] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:04:14,966][2409074] Updated weights for policy 0, policy_version 16801 (0.0012)
[2023-02-25 13:04:15,008][2409102] DAMAGECOUNT value on done: 4361.0
[2023-02-25 13:04:15,010][2409102] Sum rewards: 8.684, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.028', 'HEALTH': '0.042', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.070', 'WEAPON5': '0.100', 'weapon4': '0.242', 'WEAPON3': '0.350', 'HITCOUNT': '0.650', 'weapon3': '1.060', 'weapon2': '1.566', 'DAMAGECOUNT': '2.205', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:15,063][2409100] DAMAGECOUNT value on done: 4547.0
[2023-02-25 13:04:15,064][2409100] Sum rewards: 5.648, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.720', 'AMMO2': '0.011', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.053', 'weapon5': '0.054', 'weapon7': '0.068', 'AMMO3': '0.128', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'weapon4': '0.314', 'HITCOUNT': '0.700', 'WEAPON3': '0.850', 'weapon2': '0.892', 'weapon3': '1.528', 'DAMAGECOUNT': '2.496', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:04:15,170][2409355] DAMAGECOUNT value on done: 3822.0
[2023-02-25 13:04:15,171][2409355] Sum rewards: 3.551, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.022', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO3': '0.068', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'weapon5': '0.104', 'weapon7': '0.120', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.270', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.460', 'weapon3': '1.040', 'weapon2': '1.298', 'DAMAGECOUNT': '1.554', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:04:15,430][2409548] DAMAGECOUNT value on done: 3191.0
[2023-02-25 13:04:15,433][2409548] Sum rewards: 0.964, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.994', 'AMMO5': '0.017', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'weapon5': '0.110', 'AMMO4': '0.112', 'AMMO3': '0.121', 'WEAPON4': '0.200', 'weapon4': '0.312', 'HITCOUNT': '0.340', 'WEAPON5': '0.400', 'weapon2': '0.552', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.647', 'weapon3': '1.834', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:15,540][2409549] DAMAGECOUNT value on done: 5522.0
[2023-02-25 13:04:15,553][2409549] Sum rewards: 6.351, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.388', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.022', 'weapon7': '0.046', 'AMMO4': '0.061', 'AMMO3': '0.068', 'weapon4': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.156', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.520', 'ARMOR': '0.855', 'weapon3': '1.232', 'weapon2': '2.258', 'DAMAGECOUNT': '2.478', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:15,605][2409406] DAMAGECOUNT value on done: 3962.0
[2023-02-25 13:04:15,606][2409406] Sum rewards: 8.929, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.010', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.018', 'weapon7': '0.052', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'weapon5': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.134', 'weapon4': '0.136', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'ARMOR': '0.451', 'HITCOUNT': '0.650', 'WEAPON3': '0.850', 'weapon2': '1.272', 'weapon3': '1.830', 'DAMAGECOUNT': '2.943', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:04:15,611][2409077] DAMAGECOUNT value on done: 4157.0
[2023-02-25 13:04:15,614][2409077] Sum rewards: 1.736, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.149', 'AMMO2': '0.019', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'AMMO4': '0.093', 'AMMO3': '0.096', 'weapon5': '0.214', 'WEAPON4': '0.250', 'HITCOUNT': '0.350', 'weapon4': '0.488', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'ARMOR': '0.894', 'weapon2': '1.156', 'weapon3': '1.706', 'DAMAGECOUNT': '1.809', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:04:15,668][2409597] DAMAGECOUNT value on done: 4949.0
[2023-02-25 13:04:15,668][2409597] Sum rewards: 5.414, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.150', 'AMMO2': '0.002', 'AMMO4': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO3': '0.053', 'weapon5': '0.074', 'WEAPON4': '0.150', 'weapon7': '0.182', 'WEAPON5': '0.300', 'weapon4': '0.334', 'AMMO6': '0.340', 'AMMO7': '0.340', 'HITCOUNT': '0.390', 'WEAPON3': '0.400', 'WEAPON7': '0.500', 'ARMOR': '0.856', 'weapon3': '1.012', 'weapon2': '1.278', 'DAMAGECOUNT': '1.536', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:15,732][2409097] DAMAGECOUNT value on done: 4827.0
[2023-02-25 13:04:15,737][2409097] Sum rewards: 8.912, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.461', 'AMMO5': '0.012', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'weapon7': '0.074', 'AMMO3': '0.084', 'AMMO4': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.180', 'WEAPON5': '0.300', 'weapon4': '0.306', 'WEAPON3': '0.450', 'HITCOUNT': '0.470', 'ARMOR': '0.858', 'weapon3': '1.378', 'weapon2': '1.588', 'DAMAGECOUNT': '2.385', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:15,906][2409407] DAMAGECOUNT value on done: 3952.0
[2023-02-25 13:04:15,907][2409407] Sum rewards: 11.725, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.320', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO3': '0.037', 'weapon7': '0.048', 'AMMO4': '0.056', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.236', 'HITCOUNT': '0.530', 'weapon3': '0.534', 'ARMOR': '0.906', 'weapon2': '1.926', 'DAMAGECOUNT': '2.769', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:16,223][2409074] Updated weights for policy 0, policy_version 16811 (0.0012)
[2023-02-25 13:04:16,272][2409389] DAMAGECOUNT value on done: 4084.0
[2023-02-25 13:04:16,273][2409389] Sum rewards: 7.804, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.998', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon7': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.087', 'weapon5': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.450', 'ARMOR': '0.458', 'WEAPON3': '0.600', 'weapon4': '0.686', 'HITCOUNT': '0.740', 'weapon2': '1.022', 'weapon3': '1.244', 'DAMAGECOUNT': '3.105', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:04:16,384][2409469] DAMAGECOUNT value on done: 3437.0
[2023-02-25 13:04:16,385][2409469] Sum rewards: 5.745, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.983', 'AMMO2': '0.012', 'AMMO5': '0.014', 'ARMOR': '0.016', 'weapon7': '0.030', 'WEAPON1': '0.040', 'AMMO4': '0.061', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.106', 'AMMO3': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.350', 'HITCOUNT': '0.390', 'weapon4': '0.550', 'WEAPON3': '0.700', 'weapon2': '1.116', 'DAMAGECOUNT': '1.734', 'weapon3': '1.796', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:16,393][2409596] DAMAGECOUNT value on done: 4580.0
[2023-02-25 13:04:16,394][2409596] Sum rewards: 3.170, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.620', 'AMMO2': '0.004', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO4': '0.019', 'AMMO3': '0.051', 'weapon7': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'weapon4': '0.530', 'weapon3': '0.550', 'weapon2': '0.668', 'ARMOR': '0.906', 'DAMAGECOUNT': '1.077', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:04:16,394][2409373] DAMAGECOUNT value on done: 4677.0
[2023-02-25 13:04:16,397][2409373] Sum rewards: 7.009, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.133', 'AMMO5': '0.007', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'weapon7': '0.046', 'AMMO3': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.127', 'weapon5': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'HITCOUNT': '0.410', 'weapon4': '0.478', 'ARMOR': '0.521', 'weapon2': '0.954', 'weapon3': '1.012', 'DAMAGECOUNT': '1.980', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:16,662][2409565] DAMAGECOUNT value on done: 4701.0
[2023-02-25 13:04:16,663][2409565] Sum rewards: 7.451, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.495', 'AMMO5': '0.007', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'AMMO3': '0.075', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'weapon5': '0.168', 'WEAPON4': '0.200', 'ARMOR': '0.404', 'WEAPON3': '0.500', 'HITCOUNT': '0.540', 'weapon4': '0.624', 'weapon2': '0.968', 'weapon3': '1.764', 'DAMAGECOUNT': '1.875', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:16,726][2409405] DAMAGECOUNT value on done: 2799.0
[2023-02-25 13:04:16,798][2409866] DAMAGECOUNT value on done: 4209.0
[2023-02-25 13:04:16,799][2409866] Sum rewards: 7.913, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.010', 'AMMO3': '0.031', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.050', 'weapon7': '0.058', 'HEALTH': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON3': '0.250', 'weapon4': '0.274', 'HITCOUNT': '0.370', 'ARMOR': '0.451', 'weapon3': '0.674', 'weapon2': '1.228', 'DAMAGECOUNT': '1.296', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:17,180][2409485] DAMAGECOUNT value on done: 3688.0
[2023-02-25 13:04:17,183][2409485] Sum rewards: 6.070, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.168', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO5': '0.017', 'weapon7': '0.068', 'weapon4': '0.068', 'weapon5': '0.080', 'AMMO4': '0.083', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.590', 'WEAPON3': '0.600', 'weapon3': '1.346', 'weapon2': '1.618', 'DAMAGECOUNT': '2.160', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:17,186][2408954] Fps is (10 sec: 26214.3, 60 sec: 25941.3, 300 sec: 25603.5). Total num frames: 68878336. Throughput: 0: 6417.6. Samples: 17226048. Policy #0 lag: (min: 0.0, avg: 12.7, max: 27.0)
[2023-02-25 13:04:17,186][2408954] Avg episode reward: [(0, '6.794')]
[2023-02-25 13:04:17,191][2409033] Saving /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000016816_68878336.pth...
[2023-02-25 13:04:17,252][2409076] DAMAGECOUNT value on done: 4196.0
[2023-02-25 13:04:17,253][2409076] Sum rewards: 8.006, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.870', 'AMMO2': '0.017', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'AMMO3': '0.081', 'AMMO4': '0.082', 'weapon5': '0.166', 'WEAPON4': '0.200', 'weapon4': '0.332', 'HITCOUNT': '0.440', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon3': '1.438', 'weapon2': '1.782', 'DAMAGECOUNT': '2.280', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:17,294][2409033] Removing /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000015315_62730240.pth
[2023-02-25 13:04:17,303][2409033] Saving new best policy, reward=6.794!
[2023-02-25 13:04:17,451][2409101] DAMAGECOUNT value on done: 4098.0
[2023-02-25 13:04:17,460][2409101] Sum rewards: 4.882, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.680', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.013', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'weapon5': '0.116', 'weapon7': '0.128', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'HITCOUNT': '0.330', 'weapon4': '0.352', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'ARMOR': '0.438', 'weapon3': '1.208', 'DAMAGECOUNT': '1.374', 'weapon2': '1.382', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:04:17,492][2409104] DAMAGECOUNT value on done: 3973.0
[2023-02-25 13:04:17,495][2409104] Sum rewards: 7.524, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.504', 'AMMO5': '0.014', 'AMMO2': '0.021', 'AMMO3': '0.069', 'WEAPON1': '0.070', 'AMMO4': '0.105', 'weapon5': '0.114', 'WEAPON4': '0.150', 'weapon7': '0.184', 'weapon4': '0.230', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON5': '0.350', 'HITCOUNT': '0.390', 'ARMOR': '0.400', 'WEAPON7': '0.500', 'WEAPON3': '0.550', 'weapon2': '1.232', 'weapon3': '1.330', 'DAMAGECOUNT': '1.638', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:17,954][2409105] DAMAGECOUNT value on done: 4663.0
[2023-02-25 13:04:17,955][2409105] Sum rewards: 3.779, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.536', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.072', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'weapon4': '0.226', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'ARMOR': '0.865', 'weapon2': '1.178', 'weapon3': '1.646', 'DAMAGECOUNT': '1.827', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:18,128][2409074] Updated weights for policy 0, policy_version 16821 (0.0012)
[2023-02-25 13:04:18,564][2409373] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)]
[2023-02-25 13:04:18,571][2409103] DAMAGECOUNT value on done: 4744.0
[2023-02-25 13:04:18,574][2409103] Sum rewards: 2.037, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.226', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'AMMO5': '0.007', 'WEAPON1': '0.100', 'AMMO3': '0.108', 'weapon5': '0.180', 'WEAPON5': '0.300', 'HITCOUNT': '0.370', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.632', 'weapon2': '1.658', 'weapon3': '1.858', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:18,664][2409102] DAMAGECOUNT value on done: 3780.0
[2023-02-25 13:04:18,667][2409102] Sum rewards: 1.804, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.558', 'weapon7': '0.006', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.056', 'AMMO3': '0.097', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.166', 'weapon5': '0.172', 'WEAPON5': '0.400', 'ARMOR': '0.412', 'HITCOUNT': '0.460', 'WEAPON3': '0.650', 'weapon2': '1.642', 'DAMAGECOUNT': '1.647', 'weapon3': '1.690', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:04:18,721][2409100] DAMAGECOUNT value on done: 3743.0
[2023-02-25 13:04:18,722][2409100] Sum rewards: 3.903, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.969', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.041', 'AMMO3': '0.060', 'WEAPON4': '0.150', 'weapon5': '0.170', 'WEAPON5': '0.200', 'weapon4': '0.314', 'WEAPON3': '0.450', 'HITCOUNT': '0.470', 'weapon3': '1.204', 'ARMOR': '1.297', 'weapon2': '1.390', 'DAMAGECOUNT': '1.608', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:18,908][2409355] DAMAGECOUNT value on done: 4850.0
[2023-02-25 13:04:18,909][2409355] Sum rewards: 5.967, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.450', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.025', 'weapon5': '0.090', 'AMMO3': '0.096', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.532', 'WEAPON3': '0.550', 'HITCOUNT': '0.590', 'weapon2': '1.252', 'weapon3': '1.532', 'ARMOR': '1.716', 'DAMAGECOUNT': '2.127', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:18,982][2409079] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:04:19,164][2409548] DAMAGECOUNT value on done: 4706.0
[2023-02-25 13:04:19,167][2409548] Sum rewards: 7.435, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.015', 'AMMO2': '0.022', 'AMMO3': '0.040', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'weapon4': '0.102', 'AMMO4': '0.110', 'HEALTH': '0.140', 'weapon5': '0.236', 'WEAPON3': '0.300', 'HITCOUNT': '0.360', 'WEAPON5': '0.400', 'weapon3': '0.846', 'ARMOR': '1.600', 'weapon2': '2.320', 'DAMAGECOUNT': '2.553', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:19,204][2409077] DAMAGECOUNT value on done: 2946.0
[2023-02-25 13:04:19,205][2409077] Sum rewards: 3.726, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.280', 'AMMO4': '-0.068', 'AMMO2': '-0.013', 'AMMO5': '0.005', 'WEAPON1': '0.060', 'weapon5': '0.106', 'AMMO3': '0.110', 'WEAPON5': '0.200', 'HITCOUNT': '0.550', 'WEAPON3': '0.850', 'weapon3': '1.762', 'weapon2': '1.872', 'DAMAGECOUNT': '2.322', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:19,207][2409406] DAMAGECOUNT value on done: 3980.0
[2023-02-25 13:04:19,208][2409406] Sum rewards: 4.456, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.270', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon7': '0.036', 'AMMO4': '0.087', 'AMMO3': '0.099', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.352', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'weapon3': '1.288', 'ARMOR': '1.713', 'weapon2': '1.736', 'DAMAGECOUNT': '1.857', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:19,380][2409097] DAMAGECOUNT value on done: 2995.0
[2023-02-25 13:04:19,381][2409097] Sum rewards: 11.358, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.186', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.007', 'WEAPON1': '0.020', 'weapon7': '0.054', 'weapon5': '0.072', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.220', 'HITCOUNT': '0.700', 'WEAPON3': '0.750', 'ARMOR': '1.323', 'weapon3': '1.452', 'weapon2': '1.898', 'DAMAGECOUNT': '2.955', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:04:19,412][2409075] DAMAGECOUNT value on done: 3577.0
[2023-02-25 13:04:19,415][2409075] Sum rewards: 8.101, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.585', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO5': '0.024', 'WEAPON4': '0.050', 'weapon4': '0.084', 'AMMO4': '0.086', 'AMMO3': '0.117', 'HITCOUNT': '0.350', 'weapon5': '0.356', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'weapon2': '1.138', 'ARMOR': '1.306', 'DAMAGECOUNT': '1.728', 'weapon3': '1.870', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:19,661][2409407] DAMAGECOUNT value on done: 4758.0
[2023-02-25 13:04:19,663][2409407] Sum rewards: 7.625, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.556', 'AMMO2': '0.011', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.053', 'AMMO3': '0.130', 'weapon5': '0.138', 'weapon7': '0.198', 'AMMO6': '0.280', 'AMMO7': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON7': '0.400', 'weapon4': '0.414', 'HITCOUNT': '0.620', 'WEAPON3': '0.800', 'weapon2': '1.122', 'weapon3': '1.618', 'ARMOR': '1.857', 'DAMAGECOUNT': '2.865', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:04:19,716][2409549] DAMAGECOUNT value on done: 4417.0
[2023-02-25 13:04:19,719][2409549] Sum rewards: 4.181, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.592', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO3': '0.047', 'AMMO4': '0.057', 'WEAPON5': '0.100', 'weapon7': '0.164', 'WEAPON4': '0.200', 'AMMO6': '0.320', 'AMMO7': '0.320', 'HITCOUNT': '0.340', 'WEAPON3': '0.350', 'WEAPON7': '0.400', 'ARMOR': '0.440', 'weapon4': '0.596', 'weapon2': '0.746', 'weapon3': '0.880', 'DAMAGECOUNT': '1.275', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:19,725][2409597] DAMAGECOUNT value on done: 3403.0
[2023-02-25 13:04:19,728][2409597] Sum rewards: 0.529, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.627', 'AMMO5': '0.010', 'weapon7': '0.022', 'AMMO2': '0.027', 'weapon5': '0.062', 'AMMO3': '0.088', 'AMMO4': '0.136', 'HITCOUNT': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.292', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.834', 'weapon3': '1.320', 'ARMOR': '1.524', 'weapon2': '1.740', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:04:19,782][2409074] Updated weights for policy 0, policy_version 16831 (0.0012)
[2023-02-25 13:04:20,049][2409469] DAMAGECOUNT value on done: 4268.0
[2023-02-25 13:04:20,050][2409469] Sum rewards: 5.458, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.057', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'weapon5': '0.054', 'weapon7': '0.060', 'AMMO3': '0.077', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'ARMOR': '0.456', 'weapon4': '0.472', 'HITCOUNT': '0.510', 'WEAPON3': '0.550', 'weapon2': '1.124', 'weapon3': '1.166', 'DAMAGECOUNT': '1.785', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:20,145][2409389] DAMAGECOUNT value on done: 4738.0
[2023-02-25 13:04:20,148][2409389] Sum rewards: 14.355, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.724', 'AMMO2': '0.009', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.045', 'AMMO3': '0.087', 'weapon5': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.450', 'WEAPON3': '0.600', 'weapon4': '0.680', 'HITCOUNT': '0.740', 'weapon2': '0.876', 'weapon3': '1.350', 'DAMAGECOUNT': '3.597', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:04:20,182][2409373] DAMAGECOUNT value on done: 3976.0
[2023-02-25 13:04:20,186][2409373] Sum rewards: 7.816, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.920', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon5': '0.070', 'AMMO3': '0.076', 'WEAPON5': '0.200', 'weapon4': '0.248', 'WEAPON3': '0.450', 'HITCOUNT': '0.770', 'weapon3': '1.106', 'weapon2': '1.650', 'DAMAGECOUNT': '2.838', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:20,297][2409565] DAMAGECOUNT value on done: 5336.0
[2023-02-25 13:04:20,300][2409565] Sum rewards: 9.068, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.040', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.026', 'weapon4': '0.110', 'AMMO3': '0.114', 'weapon5': '0.126', 'AMMO4': '0.130', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.840', 'weapon3': '1.538', 'weapon2': '1.638', 'DAMAGECOUNT': '3.303', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:04:20,439][2409866] DAMAGECOUNT value on done: 2093.0
[2023-02-25 13:04:20,556][2409405] DAMAGECOUNT value on done: 3282.0
[2023-02-25 13:04:20,571][2409405] Sum rewards: 4.203, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.727', 'AMMO5': '0.003', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO4': '0.044', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.067', 'weapon7': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.280', 'weapon4': '0.418', 'WEAPON3': '0.450', 'weapon2': '0.684', 'weapon3': '0.882', 'DAMAGECOUNT': '1.230', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:20,729][2409596] DAMAGECOUNT value on done: 4235.0
[2023-02-25 13:04:20,732][2409596] Sum rewards: 3.598, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.774', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'AMMO3': '0.051', 'weapon5': '0.058', 'weapon7': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.222', 'HITCOUNT': '0.300', 'ARMOR': '0.412', 'WEAPON3': '0.450', 'weapon3': '1.348', 'DAMAGECOUNT': '1.590', 'weapon2': '1.610', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:04:20,854][2409485] DAMAGECOUNT value on done: 3619.0
[2023-02-25 13:04:20,854][2409485] Sum rewards: 2.589, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.005', 'AMMO2': '0.024', 'AMMO3': '0.030', 'WEAPON1': '0.030', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.110', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'WEAPON3': '0.200', 'HEALTH': '0.205', 'HITCOUNT': '0.260', 'weapon4': '0.268', 'weapon2': '0.396', 'weapon3': '0.594', 'DAMAGECOUNT': '0.735', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:04:21,013][2409074] Updated weights for policy 0, policy_version 16841 (0.0014)
[2023-02-25 13:04:21,157][2409076] DAMAGECOUNT value on done: 4476.0
[2023-02-25 13:04:21,158][2409076] Sum rewards: 7.869, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.278', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.062', 'AMMO3': '0.070', 'weapon7': '0.084', 'weapon5': '0.166', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.440', 'AMMO6': '0.460', 'AMMO7': '0.460', 'weapon4': '0.478', 'WEAPON7': '0.500', 'ARMOR': '0.500', 'WEAPON3': '0.550', 'weapon2': '1.126', 'weapon3': '1.542', 'DAMAGECOUNT': '2.625', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:21,591][2409101] DAMAGECOUNT value on done: 5715.0
[2023-02-25 13:04:21,591][2409101] Sum rewards: 9.455, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.008', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.022', 'AMMO3': '0.053', 'weapon7': '0.076', 'AMMO4': '0.112', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '0.640', 'weapon4': '0.698', 'ARMOR': '0.858', 'weapon3': '0.890', 'weapon2': '1.514', 'DAMAGECOUNT': '3.021', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:21,642][2409104] DAMAGECOUNT value on done: 4442.0
[2023-02-25 13:04:21,645][2409104] Sum rewards: 6.842, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.014', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO3': '0.080', 'weapon7': '0.090', 'AMMO4': '0.110', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'ARMOR': '0.488', 'WEAPON3': '0.500', 'HITCOUNT': '0.630', 'weapon4': '0.776', 'weapon2': '1.196', 'weapon3': '1.370', 'DAMAGECOUNT': '2.214', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:21,701][2409078] DAMAGECOUNT value on done: 3053.0
[2023-02-25 13:04:21,703][2409078] Sum rewards: 1.120, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.620', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon7': '0.048', 'AMMO3': '0.054', 'AMMO4': '0.077', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'HITCOUNT': '0.250', 'WEAPON3': '0.350', 'weapon4': '0.358', 'weapon3': '0.644', 'DAMAGECOUNT': '0.810', 'FRAGCOUNT': '1.000', 'weapon2': '1.274'}
[2023-02-25 13:04:21,725][2409105] DAMAGECOUNT value on done: 3570.0
[2023-02-25 13:04:22,172][2409103] DAMAGECOUNT value on done: 3691.0
[2023-02-25 13:04:22,176][2409103] Sum rewards: 7.308, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.736', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'ARMOR': '0.036', 'AMMO4': '0.048', 'weapon7': '0.052', 'AMMO3': '0.083', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.388', 'HITCOUNT': '0.470', 'WEAPON3': '0.500', 'weapon3': '0.946', 'DAMAGECOUNT': '1.836', 'weapon2': '1.848', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:22,186][2408954] Fps is (10 sec: 24985.3, 60 sec: 25600.0, 300 sec: 25561.8). Total num frames: 68997120. Throughput: 0: 6409.6. Samples: 17244840. Policy #0 lag: (min: 0.0, avg: 13.5, max: 25.0)
[2023-02-25 13:04:22,186][2408954] Avg episode reward: [(0, '6.269')]
[2023-02-25 13:04:22,222][2409102] DAMAGECOUNT value on done: 4828.0
[2023-02-25 13:04:22,222][2409102] Sum rewards: 7.895, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.003', 'AMMO5': '0.010', 'HEALTH': '0.012', 'AMMO4': '0.017', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.061', 'weapon4': '0.138', 'WEAPON5': '0.250', 'weapon5': '0.264', 'WEAPON3': '0.450', 'HITCOUNT': '0.510', 'ARMOR': '0.889', 'weapon3': '1.492', 'weapon2': '1.532', 'DAMAGECOUNT': '1.947', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:22,410][2409100] DAMAGECOUNT value on done: 3667.0
[2023-02-25 13:04:22,413][2409100] Sum rewards: 7.008, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.582', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'AMMO3': '0.074', 'weapon7': '0.074', 'AMMO4': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'ARMOR': '0.451', 'weapon4': '0.502', 'HITCOUNT': '0.560', 'WEAPON3': '0.600', 'weapon2': '1.350', 'weapon3': '1.542', 'DAMAGECOUNT': '1.926', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:22,550][2409355] DAMAGECOUNT value on done: 3474.0
[2023-02-25 13:04:22,551][2409355] Sum rewards: 6.968, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.372', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.046', 'AMMO3': '0.053', 'weapon7': '0.078', 'AMMO4': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.370', 'WEAPON3': '0.400', 'ARMOR': '0.462', 'weapon4': '0.606', 'weapon2': '1.126', 'weapon3': '1.146', 'DAMAGECOUNT': '1.731', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:22,865][2409077] DAMAGECOUNT value on done: 4520.0
[2023-02-25 13:04:22,866][2409077] Sum rewards: 10.345, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.016', 'AMMO5': '0.010', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.103', 'weapon5': '0.104', 'AMMO3': '0.106', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.426', 'HITCOUNT': '0.680', 'WEAPON3': '0.700', 'ARMOR': '0.885', 'weapon3': '1.222', 'weapon2': '1.620', 'DAMAGECOUNT': '3.054', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:04:22,885][2409406] DAMAGECOUNT value on done: 4236.0
[2023-02-25 13:04:22,886][2409074] Updated weights for policy 0, policy_version 16851 (0.0012)
[2023-02-25 13:04:22,886][2409406] Sum rewards: 1.736, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.593', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'weapon7': '0.054', 'AMMO3': '0.112', 'AMMO4': '0.118', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.326', 'ARMOR': '0.400', 'HITCOUNT': '0.500', 'WEAPON3': '0.750', 'weapon2': '1.520', 'DAMAGECOUNT': '1.533', 'weapon3': '1.662', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:22,889][2409548] DAMAGECOUNT value on done: 3987.0
[2023-02-25 13:04:22,892][2409548] Sum rewards: 7.846, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.392', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO4': '0.030', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.075', 'weapon4': '0.132', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon5': '0.226', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.500', 'ARMOR': '0.858', 'weapon3': '1.546', 'weapon2': '1.722', 'DAMAGECOUNT': '2.502', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:04:23,145][2409097] DAMAGECOUNT value on done: 4479.0
[2023-02-25 13:04:23,148][2409097] Sum rewards: 5.864, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO2': '0.037', 'AMMO3': '0.040', 'WEAPON4': '0.100', 'AMMO4': '0.184', 'weapon5': '0.196', 'WEAPON3': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.252', 'HITCOUNT': '0.420', 'HEALTH': '0.632', 'weapon3': '0.936', 'DAMAGECOUNT': '1.818', 'weapon2': '2.312', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:23,238][2409075] DAMAGECOUNT value on done: 4527.0
[2023-02-25 13:04:23,239][2409075] Sum rewards: 5.794, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.846', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.058', 'AMMO3': '0.078', 'weapon7': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'HITCOUNT': '0.440', 'weapon4': '0.464', 'WEAPON3': '0.600', 'weapon2': '0.914', 'weapon3': '1.158', 'ARMOR': '1.449', 'DAMAGECOUNT': '1.677', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:23,407][2409597] DAMAGECOUNT value on done: 3674.0
[2023-02-25 13:04:23,408][2409597] Sum rewards: 3.880, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon7': '0.048', 'AMMO3': '0.053', 'weapon4': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'WEAPON4': '0.200', 'WEAPON3': '0.300', 'HITCOUNT': '0.360', 'ARMOR': '0.400', 'HEALTH': '0.468', 'weapon3': '0.900', 'DAMAGECOUNT': '1.011', 'weapon2': '1.036', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:04:23,525][2409407] DAMAGECOUNT value on done: 4926.0
[2023-02-25 13:04:23,526][2409407] Sum rewards: 10.180, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.800', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'AMMO3': '0.100', 'AMMO4': '0.102', 'weapon5': '0.118', 'weapon4': '0.134', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.740', 'weapon2': '1.324', 'weapon3': '1.898', 'DAMAGECOUNT': '3.156', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:04:23,851][2409549] DAMAGECOUNT value on done: 5033.0
[2023-02-25 13:04:23,852][2409549] Sum rewards: 5.005, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.779', 'AMMO2': '0.006', 'AMMO5': '0.006', 'WEAPON1': '0.030', 'AMMO4': '0.031', 'weapon5': '0.042', 'AMMO3': '0.102', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'HITCOUNT': '0.550', 'weapon4': '0.580', 'WEAPON3': '0.750', 'ARMOR': '0.935', 'weapon2': '1.170', 'weapon3': '1.746', 'DAMAGECOUNT': '1.935', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:23,874][2409389] DAMAGECOUNT value on done: 3691.0
[2023-02-25 13:04:23,876][2409389] Sum rewards: 4.894, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.560', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO3': '0.072', 'AMMO4': '0.081', 'weapon5': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.380', 'WEAPON3': '0.450', 'weapon3': '1.180', 'DAMAGECOUNT': '1.200', 'weapon2': '1.396', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:24,025][2409373] DAMAGECOUNT value on done: 4232.0
[2023-02-25 13:04:24,029][2409373] Sum rewards: 7.591, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.251', 'AMMO5': '0.003', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.053', 'weapon7': '0.136', 'AMMO4': '0.174', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.620', 'weapon4': '0.816', 'weapon3': '0.930', 'weapon2': '1.272', 'ARMOR': '1.287', 'DAMAGECOUNT': '2.367', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:24,172][2409866] DAMAGECOUNT value on done: 4142.0
[2023-02-25 13:04:24,173][2409866] Sum rewards: 4.883, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.026', 'AMMO5': '0.016', 'AMMO2': '0.027', 'weapon7': '0.052', 'AMMO3': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.136', 'weapon5': '0.146', 'WEAPON4': '0.150', 'WEAPON3': '0.350', 'HITCOUNT': '0.360', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.424', 'weapon2': '0.636', 'weapon3': '0.694', 'DAMAGECOUNT': '2.259', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:24,197][2409565] DAMAGECOUNT value on done: 4000.0
[2023-02-25 13:04:24,198][2409565] Sum rewards: 7.621, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.388', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon5': '0.058', 'weapon7': '0.062', 'AMMO4': '0.073', 'AMMO3': '0.077', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.220', 'ARMOR': '0.436', 'HITCOUNT': '0.490', 'WEAPON3': '0.500', 'weapon2': '1.488', 'weapon3': '1.628', 'DAMAGECOUNT': '1.665', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:24,210][2409469] DAMAGECOUNT value on done: 3933.0
[2023-02-25 13:04:24,211][2409469] Sum rewards: 7.258, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.224', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.028', 'weapon7': '0.052', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.210', 'weapon5': '0.324', 'ARMOR': '0.454', 'HITCOUNT': '0.620', 'WEAPON5': '0.650', 'weapon2': '0.658', 'WEAPON3': '0.700', 'weapon3': '2.074', 'DAMAGECOUNT': '3.243', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:24,437][2409074] Updated weights for policy 0, policy_version 16861 (0.0012)
[2023-02-25 13:04:24,550][2409596] DAMAGECOUNT value on done: 3974.0
[2023-02-25 13:04:24,551][2409596] Sum rewards: 4.576, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.192', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO5': '0.015', 'AMMO4': '0.069', 'AMMO3': '0.099', 'weapon5': '0.158', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.332', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'weapon3': '1.298', 'weapon2': '1.388', 'DAMAGECOUNT': '2.685', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:04:24,702][2409405] DAMAGECOUNT value on done: 3312.0
[2023-02-25 13:04:24,703][2409405] Sum rewards: 5.518, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.032', 'AMMO2': '0.011', 'AMMO5': '0.015', 'weapon7': '0.046', 'WEAPON1': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.073', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.206', 'WEAPON5': '0.300', 'weapon4': '0.466', 'WEAPON3': '0.500', 'HITCOUNT': '0.620', 'weapon2': '0.774', 'weapon3': '1.504', 'DAMAGECOUNT': '1.839', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:24,806][2409485] DAMAGECOUNT value on done: 3780.0
[2023-02-25 13:04:24,816][2409485] Sum rewards: 10.859, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.286', 'AMMO2': '0.005', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.026', 'AMMO3': '0.038', 'weapon7': '0.056', 'weapon5': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.200', 'HITCOUNT': '0.270', 'WEAPON3': '0.300', 'weapon3': '0.590', 'ARMOR': '0.800', 'weapon2': '1.620', 'DAMAGECOUNT': '1.830', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:04:24,819][2409076] DAMAGECOUNT value on done: 3839.0
[2023-02-25 13:04:24,820][2409076] Sum rewards: 5.769, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.390', 'AMMO5': '0.012', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.064', 'AMMO4': '0.094', 'AMMO3': '0.125', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.586', 'HITCOUNT': '0.900', 'weapon2': '0.928', 'WEAPON3': '0.950', 'weapon3': '1.824', 'DAMAGECOUNT': '3.237', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:25,455][2409104] DAMAGECOUNT value on done: 3606.0
[2023-02-25 13:04:25,456][2409104] Sum rewards: 8.666, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.554', 'AMMO2': '0.001', 'AMMO4': '0.007', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.224', 'HITCOUNT': '0.440', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'ARMOR': '0.854', 'weapon3': '1.556', 'weapon2': '1.920', 'DAMAGECOUNT': '2.145', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:25,510][2409078] DAMAGECOUNT value on done: 3789.0
[2023-02-25 13:04:25,511][2409078] Sum rewards: 7.252, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.970', 'AMMO5': '0.015', 'AMMO2': '0.028', 'WEAPON1': '0.050', 'AMMO3': '0.067', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.138', 'weapon5': '0.148', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'HITCOUNT': '0.490', 'ARMOR': '0.497', 'WEAPON3': '0.500', 'weapon2': '0.844', 'weapon4': '1.020', 'weapon3': '1.262', 'DAMAGECOUNT': '1.845', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:25,615][2409105] DAMAGECOUNT value on done: 4446.0
[2023-02-25 13:04:25,632][2409105] Sum rewards: 9.204, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.423', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.044', 'AMMO3': '0.070', 'weapon7': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.146', 'AMMO4': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'weapon4': '0.418', 'WEAPON3': '0.500', 'HITCOUNT': '0.600', 'weapon2': '1.254', 'weapon3': '1.652', 'DAMAGECOUNT': '2.097', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:04:25,664][2409101] DAMAGECOUNT value on done: 4393.0
[2023-02-25 13:04:25,665][2409101] Sum rewards: 8.973, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.640', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'AMMO3': '0.090', 'weapon5': '0.120', 'weapon4': '0.160', 'WEAPON5': '0.250', 'WEAPON3': '0.700', 'HITCOUNT': '0.780', 'ARMOR': '0.859', 'weapon2': '1.122', 'weapon3': '1.892', 'DAMAGECOUNT': '3.747', 'FRAGCOUNT': '6.500'}
[2023-02-25 13:04:25,687][2409405] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:04:26,116][2409100] DAMAGECOUNT value on done: 3727.0
[2023-02-25 13:04:26,117][2409100] Sum rewards: 4.975, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.431', 'weapon5': '0.002', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.076', 'weapon7': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.288', 'HITCOUNT': '0.380', 'ARMOR': '0.442', 'WEAPON3': '0.550', 'weapon2': '0.854', 'DAMAGECOUNT': '1.065', 'weapon3': '1.394', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:26,121][2409102] DAMAGECOUNT value on done: 4609.0
[2023-02-25 13:04:26,122][2409102] Sum rewards: 7.248, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.242', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.013', 'AMMO3': '0.068', 'weapon5': '0.102', 'weapon7': '0.144', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.258', 'WEAPON5': '0.300', 'WEAPON7': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.720', 'weapon3': '1.274', 'weapon2': '1.374', 'DAMAGECOUNT': '3.093', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:26,161][2409074] Updated weights for policy 0, policy_version 16871 (0.0013)
[2023-02-25 13:04:26,282][2409355] DAMAGECOUNT value on done: 3895.0
[2023-02-25 13:04:26,285][2409355] Sum rewards: 8.545, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.740', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.042', 'AMMO3': '0.049', 'weapon5': '0.066', 'weapon7': '0.080', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.286', 'WEAPON3': '0.300', 'HITCOUNT': '0.420', 'weapon3': '0.776', 'ARMOR': '0.858', 'weapon2': '1.102', 'DAMAGECOUNT': '2.052', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:26,310][2409103] DAMAGECOUNT value on done: 2909.0
[2023-02-25 13:04:26,313][2409103] Sum rewards: 1.472, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.970', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.059', 'weapon5': '0.064', 'weapon7': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.310', 'WEAPON3': '0.450', 'weapon4': '0.482', 'weapon2': '0.970', 'weapon3': '0.996', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.065'}
[2023-02-25 13:04:26,615][2409077] DAMAGECOUNT value on done: 4712.0
[2023-02-25 13:04:26,618][2409077] Sum rewards: 3.318, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.552', 'AMMO2': '0.004', 'AMMO5': '0.014', 'AMMO4': '0.018', 'AMMO3': '0.042', 'WEAPON1': '0.070', 'weapon7': '0.128', 'weapon5': '0.140', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'HITCOUNT': '0.270', 'weapon4': '0.304', 'WEAPON5': '0.400', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'ARMOR': '0.452', 'weapon3': '1.070', 'weapon2': '1.190', 'DAMAGECOUNT': '1.788', 'FRAGCOUNT': '3.500'}
[2023-02-25 13:04:26,626][2409406] DAMAGECOUNT value on done: 3606.0
[2023-02-25 13:04:26,627][2409406] Sum rewards: 0.932, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.652', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'weapon7': '0.026', 'AMMO2': '0.036', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.134', 'AMMO4': '0.179', 'weapon5': '0.198', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.510', 'weapon4': '0.642', 'WEAPON3': '0.700', 'weapon3': '1.224', 'ARMOR': '1.370', 'weapon2': '1.464', 'DAMAGECOUNT': '2.211', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:26,628][2409548] DAMAGECOUNT value on done: 3466.0
[2023-02-25 13:04:26,630][2409548] Sum rewards: 1.618, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.392', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.072', 'AMMO3': '0.093', 'WEAPON4': '0.200', 'AMMO4': '0.204', 'WEAPON5': '0.250', 'weapon4': '0.268', 'ARMOR': '0.400', 'HITCOUNT': '0.580', 'WEAPON3': '0.600', 'weapon3': '1.366', 'DAMAGECOUNT': '1.692', 'weapon2': '1.732', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:04:26,863][2409075] DAMAGECOUNT value on done: 3978.0
[2023-02-25 13:04:26,866][2409075] Sum rewards: 6.997, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.486', 'AMMO2': '0.014', 'AMMO5': '0.032', 'WEAPON1': '0.060', 'weapon7': '0.068', 'AMMO4': '0.069', 'AMMO3': '0.139', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon5': '0.220', 'WEAPON4': '0.250', 'weapon4': '0.430', 'HITCOUNT': '0.490', 'WEAPON5': '0.650', 'WEAPON3': '0.750', 'ARMOR': '0.899', 'weapon2': '0.978', 'weapon3': '1.810', 'DAMAGECOUNT': '2.103', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:04:26,913][2409097] DAMAGECOUNT value on done: 3619.0
[2023-02-25 13:04:26,913][2409097] Sum rewards: 5.725, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.400', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO3': '0.064', 'weapon7': '0.076', 'AMMO4': '0.085', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.174', 'HITCOUNT': '0.180', 'weapon4': '0.266', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'ARMOR': '0.451', 'weapon3': '0.704', 'weapon2': '1.230', 'DAMAGECOUNT': '1.551', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:27,186][2408954] Fps is (10 sec: 25395.3, 60 sec: 25736.5, 300 sec: 25534.1). Total num frames: 69132288. Throughput: 0: 6406.7. Samples: 17283192. Policy #0 lag: (min: 0.0, avg: 13.5, max: 25.0)
[2023-02-25 13:04:27,186][2408954] Avg episode reward: [(0, '6.103')]
[2023-02-25 13:04:27,287][2409407] DAMAGECOUNT value on done: 5867.0
[2023-02-25 13:04:27,288][2409407] Sum rewards: 8.437, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.504', 'AMMO5': '0.017', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'weapon7': '0.060', 'AMMO4': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'weapon4': '0.222', 'weapon5': '0.256', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.710', 'WEAPON3': '0.850', 'weapon2': '1.152', 'weapon3': '2.008', 'DAMAGECOUNT': '3.399', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:27,295][2409597] DAMAGECOUNT value on done: 4285.0
[2023-02-25 13:04:27,298][2409597] Sum rewards: 2.240, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.841', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.016', 'weapon7': '0.060', 'AMMO4': '0.077', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.118', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.350', 'HITCOUNT': '0.370', 'weapon4': '0.492', 'weapon2': '0.602', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.365', 'weapon3': '1.618', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:04:27,371][2409549] DAMAGECOUNT value on done: 3885.0
[2023-02-25 13:04:27,371][2409549] Sum rewards: 4.995, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.715', 'AMMO2': '0.014', 'AMMO5': '0.016', 'WEAPON1': '0.030', 'AMMO4': '0.070', 'AMMO3': '0.090', 'weapon7': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.254', 'weapon4': '0.306', 'HITCOUNT': '0.380', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon2': '0.762', 'ARMOR': '1.416', 'DAMAGECOUNT': '1.704', 'weapon3': '1.874', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:04:27,414][2409389] DAMAGECOUNT value on done: 4168.0
[2023-02-25 13:04:27,419][2409389] Sum rewards: 1.063, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.272', 'AMMO5': '0.009', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'AMMO3': '0.075', 'weapon5': '0.078', 'AMMO4': '0.099', 'weapon4': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.360', 'ARMOR': '0.445', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.035', 'weapon3': '1.492', 'weapon2': '1.592'}
[2023-02-25 13:04:27,504][2409074] Updated weights for policy 0, policy_version 16881 (0.0013)
[2023-02-25 13:04:27,773][2409866] DAMAGECOUNT value on done: 4144.0
[2023-02-25 13:04:27,774][2409866] Sum rewards: 5.705, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.736', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'weapon5': '0.178', 'weapon4': '0.238', 'WEAPON5': '0.300', 'HITCOUNT': '0.380', 'ARMOR': '0.420', 'WEAPON3': '0.450', 'weapon3': '1.090', 'DAMAGECOUNT': '1.659', 'weapon2': '2.006', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:27,961][2409565] DAMAGECOUNT value on done: 3940.0
[2023-02-25 13:04:27,963][2409565] Sum rewards: 12.767, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.240', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'weapon7': '0.138', 'weapon5': '0.190', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.252', 'WEAPON7': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'ARMOR': '0.500', 'HITCOUNT': '0.650', 'weapon3': '1.236', 'weapon2': '1.624', 'DAMAGECOUNT': '3.780', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:04:28,125][2409596] DAMAGECOUNT value on done: 3319.0
[2023-02-25 13:04:28,129][2409596] Sum rewards: 14.112, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.524', 'AMMO2': '0.010', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO4': '0.049', 'AMMO3': '0.055', 'WEAPON4': '0.150', 'weapon5': '0.230', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'weapon4': '0.462', 'HITCOUNT': '0.560', 'weapon3': '1.132', 'weapon2': '1.530', 'DAMAGECOUNT': '2.808', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:04:28,217][2409373] DAMAGECOUNT value on done: 4022.0
[2023-02-25 13:04:28,220][2409373] Sum rewards: 9.519, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.155', 'AMMO5': '0.007', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'AMMO3': '0.060', 'weapon5': '0.084', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.330', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.690', 'weapon3': '1.064', 'weapon2': '1.908', 'DAMAGECOUNT': '2.430', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:28,275][2409405] DAMAGECOUNT value on done: 4296.0
[2023-02-25 13:04:28,275][2409405] Sum rewards: 1.240, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.900', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon7': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.122', 'WEAPON7': '0.200', 'weapon4': '0.230', 'WEAPON4': '0.300', 'HITCOUNT': '0.470', 'WEAPON3': '0.600', 'ARMOR': '0.865', 'weapon2': '0.912', 'weapon3': '1.402', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.010'}
[2023-02-25 13:04:28,275][2409469] DAMAGECOUNT value on done: 4754.0
[2023-02-25 13:04:28,279][2409469] Sum rewards: 6.668, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.610', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon7': '0.058', 'AMMO3': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.137', 'weapon5': '0.168', 'HITCOUNT': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.388', 'ARMOR': '0.404', 'WEAPON3': '0.500', 'weapon2': '0.924', 'weapon3': '1.180', 'DAMAGECOUNT': '1.290', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:28,851][2409485] DAMAGECOUNT value on done: 3788.0
[2023-02-25 13:04:28,852][2409485] Sum rewards: 3.116, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.002', 'AMMO5': '0.017', 'AMMO2': '0.032', 'weapon5': '0.102', 'AMMO3': '0.127', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'weapon4': '0.218', 'WEAPON5': '0.400', 'HITCOUNT': '0.460', 'ARMOR': '0.800', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.590', 'weapon3': '1.684', 'weapon2': '1.730', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:29,011][2409076] DAMAGECOUNT value on done: 4499.0
[2023-02-25 13:04:29,014][2409076] Sum rewards: 8.250, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.040', 'AMMO2': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.037', 'AMMO3': '0.050', 'weapon7': '0.054', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.208', 'weapon4': '0.236', 'WEAPON3': '0.300', 'HITCOUNT': '0.580', 'weapon3': '0.946', 'ARMOR': '1.200', 'weapon2': '1.842', 'DAMAGECOUNT': '2.319', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:29,090][2409104] DAMAGECOUNT value on done: 3787.0
[2023-02-25 13:04:29,092][2409104] Sum rewards: 12.223, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'ARMOR': '0.036', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'weapon5': '0.116', 'AMMO4': '0.125', 'HEALTH': '0.196', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'HITCOUNT': '0.670', 'weapon4': '0.770', 'weapon2': '0.886', 'weapon3': '1.358', 'DAMAGECOUNT': '2.715', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:04:29,097][2409078] DAMAGECOUNT value on done: 3788.0
[2023-02-25 13:04:29,099][2409078] Sum rewards: 3.856, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.694', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'weapon7': '0.032', 'AMMO3': '0.088', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.126', 'AMMO4': '0.156', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'HITCOUNT': '0.420', 'weapon4': '0.450', 'WEAPON3': '0.700', 'ARMOR': '0.948', 'weapon3': '1.308', 'weapon2': '1.810', 'DAMAGECOUNT': '1.995', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:29,240][2409101] DAMAGECOUNT value on done: 3754.0
[2023-02-25 13:04:29,241][2409101] Sum rewards: 2.990, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.333', 'AMMO5': '0.017', 'AMMO2': '0.020', 'AMMO3': '0.060', 'AMMO4': '0.097', 'weapon5': '0.114', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.448', 'WEAPON3': '0.450', 'HITCOUNT': '0.630', 'weapon4': '0.700', 'weapon3': '1.138', 'weapon2': '1.412', 'DAMAGECOUNT': '2.337', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:29,344][2409105] DAMAGECOUNT value on done: 4938.0
[2023-02-25 13:04:29,347][2409105] Sum rewards: 16.849, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.285', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON4': '0.050', 'AMMO3': '0.051', 'AMMO4': '0.057', 'weapon7': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.134', 'weapon4': '0.224', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.610', 'weapon3': '1.208', 'ARMOR': '1.255', 'weapon2': '1.432', 'DAMAGECOUNT': '3.522', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:04:29,402][2409074] Updated weights for policy 0, policy_version 16891 (0.0012)
[2023-02-25 13:04:29,770][2409100] DAMAGECOUNT value on done: 3374.0
[2023-02-25 13:04:29,773][2409100] Sum rewards: 4.573, reward structure: {'DEATHCOUNT': '-0.750', 'AMMO3': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON3': '0.050', 'weapon2': '0.060', 'weapon7': '0.110', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'HEALTH': '0.162', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon3': '0.246', 'WEAPON7': '0.300', 'ARMOR': '0.412', 'weapon4': '0.506', 'DAMAGECOUNT': '0.687', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:04:29,839][2409102] DAMAGECOUNT value on done: 3977.0
[2023-02-25 13:04:29,842][2409102] Sum rewards: 5.571, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.411', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.078', 'weapon5': '0.078', 'AMMO4': '0.143', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '0.660', 'weapon2': '0.776', 'weapon4': '0.794', 'weapon3': '1.410', 'DAMAGECOUNT': '2.481', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:30,195][2409103] DAMAGECOUNT value on done: 2896.0
[2023-02-25 13:04:30,195][2409103] Sum rewards: 1.549, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.594', 'AMMO5': '0.025', 'AMMO2': '0.044', 'WEAPON1': '0.060', 'AMMO3': '0.098', 'weapon5': '0.188', 'AMMO4': '0.221', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.416', 'HITCOUNT': '0.440', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'weapon3': '1.494', 'weapon2': '1.574', 'DAMAGECOUNT': '1.833', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:30,225][2409355] DAMAGECOUNT value on done: 4310.0
[2023-02-25 13:04:30,226][2409355] Sum rewards: 9.354, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'weapon7': '0.050', 'weapon5': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'HEALTH': '0.268', 'HITCOUNT': '0.450', 'weapon3': '0.898', 'weapon2': '1.600', 'DAMAGECOUNT': '3.063', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:30,243][2409096] DAMAGECOUNT value on done: 4731.0
[2023-02-25 13:04:30,244][2409096] Sum rewards: 7.916, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.035', 'AMMO5': '0.016', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'AMMO3': '0.078', 'AMMO4': '0.134', 'weapon5': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'weapon4': '0.600', 'HITCOUNT': '0.710', 'weapon2': '0.886', 'weapon3': '1.404', 'DAMAGECOUNT': '2.706', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:30,288][2409077] DAMAGECOUNT value on done: 3811.0
[2023-02-25 13:04:30,290][2409406] DAMAGECOUNT value on done: 3776.0
[2023-02-25 13:04:30,291][2409077] Sum rewards: 7.224, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.816', 'AMMO5': '0.014', 'ARMOR': '0.028', 'AMMO2': '0.041', 'AMMO3': '0.097', 'AMMO4': '0.205', 'weapon5': '0.220', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.416', 'HITCOUNT': '0.620', 'WEAPON3': '0.750', 'weapon2': '1.124', 'weapon3': '1.814', 'DAMAGECOUNT': '2.460', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:04:30,292][2409406] Sum rewards: 3.910, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.156', 'AMMO2': '0.008', 'AMMO3': '0.029', 'AMMO4': '0.041', 'weapon7': '0.138', 'WEAPON3': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HITCOUNT': '0.220', 'WEAPON4': '0.250', 'weapon3': '0.254', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'weapon4': '0.572', 'DAMAGECOUNT': '1.062', 'weapon2': '1.152', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:04:30,350][2409548] DAMAGECOUNT value on done: 3577.0
[2023-02-25 13:04:30,351][2409548] Sum rewards: 5.285, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.445', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO3': '0.040', 'AMMO4': '0.062', 'weapon5': '0.088', 'weapon7': '0.102', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HITCOUNT': '0.300', 'weapon4': '0.348', 'WEAPON3': '0.350', 'ARMOR': '0.461', 'weapon3': '0.992', 'weapon2': '1.136', 'DAMAGECOUNT': '1.491', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:30,635][2409097] DAMAGECOUNT value on done: 5104.0
[2023-02-25 13:04:30,650][2409097] Sum rewards: 13.828, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.384', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon7': '0.026', 'AMMO4': '0.035', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.112', 'weapon5': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.326', 'WEAPON3': '0.800', 'HITCOUNT': '0.840', 'ARMOR': '0.946', 'weapon2': '1.002', 'weapon3': '1.960', 'DAMAGECOUNT': '3.120', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:04:30,859][2409407] DAMAGECOUNT value on done: 3304.0
[2023-02-25 13:04:30,860][2409407] Sum rewards: 0.560, reward structure: {'DEATHCOUNT': '-4.500', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.454', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO4': '0.033', 'AMMO3': '0.050', 'weapon7': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.230', 'WEAPON3': '0.300', 'ARMOR': '0.432', 'weapon4': '0.444', 'DAMAGECOUNT': '0.969', 'weapon3': '1.044', 'weapon2': '1.506'}
[2023-02-25 13:04:30,882][2409074] Updated weights for policy 0, policy_version 16901 (0.0012)
[2023-02-25 13:04:30,910][2409549] DAMAGECOUNT value on done: 4745.0
[2023-02-25 13:04:30,911][2409549] Sum rewards: 7.809, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO4': '0.070', 'weapon4': '0.146', 'HEALTH': '0.197', 'WEAPON3': '0.300', 'ARMOR': '0.440', 'HITCOUNT': '0.630', 'weapon3': '1.110', 'weapon2': '1.984', 'DAMAGECOUNT': '2.439', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:31,155][2409597] DAMAGECOUNT value on done: 4086.0
[2023-02-25 13:04:31,155][2409597] Sum rewards: 6.724, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.542', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.102', 'AMMO4': '0.144', 'weapon5': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.468', 'HITCOUNT': '0.530', 'WEAPON3': '0.600', 'ARMOR': '0.897', 'weapon2': '1.106', 'weapon3': '1.516', 'DAMAGECOUNT': '1.980', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:31,303][2409075] DAMAGECOUNT value on done: 3020.0
[2023-02-25 13:04:31,304][2409075] Sum rewards: 1.958, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.455', 'AMMO5': '0.010', 'weapon7': '0.014', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.073', 'AMMO4': '0.093', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.120', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.314', 'HITCOUNT': '0.410', 'WEAPON3': '0.550', 'ARMOR': '0.852', 'weapon3': '1.178', 'DAMAGECOUNT': '1.620', 'weapon2': '1.840', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:31,796][2409565] DAMAGECOUNT value on done: 3790.0
[2023-02-25 13:04:31,799][2409565] Sum rewards: 6.445, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.790', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.012', 'AMMO3': '0.050', 'AMMO4': '0.053', 'weapon5': '0.198', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'HITCOUNT': '0.420', 'WEAPON3': '0.450', 'weapon4': '0.634', 'ARMOR': '0.943', 'weapon2': '1.196', 'weapon3': '1.258', 'DAMAGECOUNT': '1.599', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:31,846][2409405] DAMAGECOUNT value on done: 4612.0
[2023-02-25 13:04:31,850][2409405] Sum rewards: 4.613, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.896', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.078', 'weapon7': '0.080', 'AMMO3': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.380', 'ARMOR': '0.444', 'WEAPON3': '0.600', 'weapon3': '1.284', 'weapon2': '1.558', 'DAMAGECOUNT': '1.653', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:31,889][2409389] DAMAGECOUNT value on done: 4313.0
[2023-02-25 13:04:31,891][2409389] Sum rewards: 11.867, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.308', 'AMMO2': '0.015', 'AMMO5': '0.016', 'WEAPON1': '0.040', 'AMMO4': '0.073', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'weapon5': '0.170', 'weapon4': '0.252', 'WEAPON5': '0.400', 'HITCOUNT': '0.570', 'WEAPON3': '0.600', 'ARMOR': '0.888', 'weapon3': '1.430', 'weapon2': '1.648', 'DAMAGECOUNT': '2.874', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:04:31,966][2409596] DAMAGECOUNT value on done: 4033.0
[2023-02-25 13:04:31,966][2409596] Sum rewards: 9.546, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.394', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO3': '0.073', 'AMMO4': '0.081', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.120', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'ARMOR': '0.454', 'weapon4': '0.484', 'HITCOUNT': '0.570', 'weapon2': '0.684', 'weapon3': '1.128', 'DAMAGECOUNT': '3.402', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:32,005][2409866] DAMAGECOUNT value on done: 4793.0
[2023-02-25 13:04:32,006][2409866] Sum rewards: 5.333, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.304', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO3': '0.050', 'weapon7': '0.068', 'weapon5': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.206', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.430', 'weapon3': '1.228', 'ARMOR': '1.245', 'DAMAGECOUNT': '1.806', 'weapon2': '1.836', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:32,047][2409373] DAMAGECOUNT value on done: 4202.0
[2023-02-25 13:04:32,048][2409373] Sum rewards: 5.787, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.572', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.008', 'WEAPON1': '0.020', 'AMMO3': '0.080', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.308', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'weapon3': '1.286', 'DAMAGECOUNT': '1.758', 'weapon2': '1.972', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:32,186][2408954] Fps is (10 sec: 26214.5, 60 sec: 25804.8, 300 sec: 25589.6). Total num frames: 69259264. Throughput: 0: 6401.1. Samples: 17321976. Policy #0 lag: (min: 0.0, avg: 13.5, max: 25.0)
[2023-02-25 13:04:32,186][2408954] Avg episode reward: [(0, '6.213')]
[2023-02-25 13:04:32,227][2409469] DAMAGECOUNT value on done: 4981.0
[2023-02-25 13:04:32,230][2409469] Sum rewards: 12.979, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.242', 'AMMO5': '0.010', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'AMMO3': '0.069', 'weapon7': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.141', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.220', 'weapon5': '0.296', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.620', 'weapon3': '1.204', 'weapon2': '1.324', 'DAMAGECOUNT': '4.554', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:04:32,405][2409074] Updated weights for policy 0, policy_version 16911 (0.0012)
[2023-02-25 13:04:32,669][2409078] DAMAGECOUNT value on done: 4100.0
[2023-02-25 13:04:32,673][2409078] Sum rewards: 2.075, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.562', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO5': '0.018', 'WEAPON1': '0.060', 'AMMO3': '0.084', 'weapon5': '0.104', 'HITCOUNT': '0.320', 'WEAPON5': '0.450', 'ARMOR': '0.500', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.101', 'weapon2': '1.384', 'weapon3': '1.896', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:32,796][2409101] DAMAGECOUNT value on done: 4451.0
[2023-02-25 13:04:32,797][2409101] Sum rewards: 3.421, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.230', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon5': '0.076', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'weapon4': '0.248', 'WEAPON5': '0.250', 'HITCOUNT': '0.570', 'WEAPON3': '0.600', 'weapon2': '1.276', 'weapon3': '1.538', 'DAMAGECOUNT': '2.145', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:32,832][2409486] DAMAGECOUNT value on done: 3978.0
[2023-02-25 13:04:32,832][2409486] Sum rewards: 7.663, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.495', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.089', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.106', 'AMMO4': '0.128', 'WEAPON4': '0.200', 'weapon5': '0.202', 'WEAPON5': '0.500', 'weapon4': '0.500', 'HITCOUNT': '0.640', 'WEAPON3': '0.700', 'weapon2': '1.114', 'weapon3': '1.506', 'DAMAGECOUNT': '2.862', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:32,888][2409104] DAMAGECOUNT value on done: 3434.0
[2023-02-25 13:04:32,889][2409104] Sum rewards: 8.038, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.111', 'AMMO5': '0.012', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'AMMO3': '0.082', 'AMMO4': '0.101', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.452', 'WEAPON3': '0.500', 'weapon4': '0.528', 'HITCOUNT': '0.910', 'weapon2': '1.116', 'weapon3': '1.772', 'DAMAGECOUNT': '3.489', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:32,921][2409076] DAMAGECOUNT value on done: 4689.0
[2023-02-25 13:04:32,926][2409076] Sum rewards: 7.644, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.892', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.017', 'weapon5': '0.030', 'weapon7': '0.052', 'AMMO4': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'weapon4': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '0.670', 'weapon2': '1.390', 'weapon3': '1.408', 'DAMAGECOUNT': '3.456', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:04:33,220][2409105] DAMAGECOUNT value on done: 4382.0
[2023-02-25 13:04:33,221][2409105] Sum rewards: 8.518, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '0.014', 'AMMO2': '0.018', 'AMMO5': '0.019', 'weapon7': '0.048', 'AMMO3': '0.055', 'AMMO4': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.110', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.400', 'WEAPON3': '0.400', 'ARMOR': '0.432', 'weapon2': '0.570', 'weapon4': '0.718', 'weapon3': '1.182', 'DAMAGECOUNT': '2.211', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:33,433][2409100] DAMAGECOUNT value on done: 3649.0
[2023-02-25 13:04:33,434][2409100] Sum rewards: 5.572, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.200', 'AMMO5': '0.003', 'AMMO2': '0.015', 'AMMO3': '0.020', 'weapon5': '0.050', 'AMMO4': '0.075', 'weapon7': '0.076', 'WEAPON5': '0.100', 'WEAPON3': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.340', 'ARMOR': '0.456', 'weapon3': '0.468', 'weapon2': '0.494', 'weapon4': '0.722', 'DAMAGECOUNT': '1.413', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:33,665][2409102] DAMAGECOUNT value on done: 4537.0
[2023-02-25 13:04:33,666][2409102] Sum rewards: 2.548, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.348', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO3': '0.037', 'weapon5': '0.050', 'weapon7': '0.052', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.314', 'HITCOUNT': '0.330', 'weapon3': '0.342', 'ARMOR': '0.424', 'weapon2': '0.940', 'DAMAGECOUNT': '0.960', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:04:33,733][2409079] DAMAGECOUNT value on done: 3479.0
[2023-02-25 13:04:33,734][2409079] Sum rewards: 3.902, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.686', 'AMMO2': '0.002', 'AMMO5': '0.009', 'AMMO4': '0.010', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.053', 'weapon5': '0.122', 'HITCOUNT': '0.220', 'WEAPON5': '0.250', 'weapon4': '0.274', 'WEAPON3': '0.350', 'ARMOR': '0.475', 'weapon3': '0.688', 'DAMAGECOUNT': '0.906', 'weapon2': '1.898', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:33,848][2409485] DAMAGECOUNT value on done: 3792.0
[2023-02-25 13:04:33,849][2409485] Sum rewards: 3.765, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.461', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO3': '0.021', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'weapon5': '0.100', 'weapon7': '0.142', 'WEAPON3': '0.150', 'AMMO4': '0.163', 'HITCOUNT': '0.190', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon3': '0.276', 'WEAPON7': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.702', 'ARMOR': '0.857', 'weapon2': '1.110', 'DAMAGECOUNT': '1.527', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:33,914][2409077] DAMAGECOUNT value on done: 3191.0
[2023-02-25 13:04:33,915][2409077] Sum rewards: 4.372, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'weapon7': '0.052', 'weapon4': '0.056', 'AMMO4': '0.096', 'weapon5': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'HEALTH': '0.228', 'HITCOUNT': '0.230', 'WEAPON3': '0.300', 'weapon3': '0.772', 'ARMOR': '0.816', 'DAMAGECOUNT': '1.164', 'weapon2': '1.488', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:33,924][2409406] DAMAGECOUNT value on done: 4452.0
[2023-02-25 13:04:33,925][2409406] Sum rewards: 4.169, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.981', 'AMMO5': '0.013', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'weapon5': '0.088', 'AMMO3': '0.105', 'AMMO4': '0.128', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'HITCOUNT': '0.390', 'weapon4': '0.468', 'WEAPON3': '0.750', 'ARMOR': '1.283', 'weapon3': '1.448', 'weapon2': '1.714', 'DAMAGECOUNT': '2.007', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:34,048][2409548] DAMAGECOUNT value on done: 4571.0
[2023-02-25 13:04:34,049][2409548] Sum rewards: 4.078, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.964', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.040', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'AMMO3': '0.087', 'weapon5': '0.130', 'WEAPON5': '0.200', 'weapon4': '0.232', 'HITCOUNT': '0.300', 'ARMOR': '0.536', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.948', 'weapon3': '1.604', 'weapon2': '1.760', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:34,221][2409096] DAMAGECOUNT value on done: 3674.0
[2023-02-25 13:04:34,222][2409096] Sum rewards: 3.902, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.130', 'AMMO5': '0.016', 'AMMO2': '0.033', 'weapon7': '0.048', 'AMMO3': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.167', 'weapon5': '0.194', 'WEAPON4': '0.250', 'HITCOUNT': '0.310', 'WEAPON5': '0.350', 'WEAPON3': '0.350', 'weapon4': '0.588', 'weapon3': '0.950', 'weapon2': '0.966', 'ARMOR': '1.300', 'DAMAGECOUNT': '1.899', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:34,232][2409074] Updated weights for policy 0, policy_version 16921 (0.0012)
[2023-02-25 13:04:34,446][2409549] DAMAGECOUNT value on done: 4465.0
[2023-02-25 13:04:34,447][2409549] Sum rewards: 3.026, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.408', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.012', 'AMMO3': '0.063', 'weapon5': '0.150', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.396', 'DAMAGECOUNT': '1.410', 'weapon2': '2.234'}
[2023-02-25 13:04:34,558][2409355] DAMAGECOUNT value on done: 4373.0
[2023-02-25 13:04:34,558][2409355] Sum rewards: 4.835, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.480', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.122', 'weapon4': '0.138', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.460', 'weapon3': '1.022', 'DAMAGECOUNT': '1.545', 'weapon2': '1.734', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:34,573][2409097] DAMAGECOUNT value on done: 3514.0
[2023-02-25 13:04:34,574][2409097] Sum rewards: 8.401, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.799', 'AMMO2': '0.013', 'AMMO5': '0.018', 'WEAPON1': '0.030', 'AMMO4': '0.064', 'AMMO3': '0.093', 'weapon5': '0.114', 'WEAPON4': '0.150', 'weapon4': '0.320', 'WEAPON5': '0.450', 'HITCOUNT': '0.520', 'WEAPON3': '0.550', 'weapon2': '0.838', 'ARMOR': '0.964', 'weapon3': '1.496', 'DAMAGECOUNT': '2.580', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:34,589][2409407] DAMAGECOUNT value on done: 5719.0
[2023-02-25 13:04:34,589][2409407] Sum rewards: 8.356, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.710', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.030', 'ARMOR': '0.036', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'weapon7': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.264', 'WEAPON3': '0.450', 'HITCOUNT': '0.450', 'weapon3': '1.288', 'weapon2': '1.584', 'DAMAGECOUNT': '3.132', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:34,967][2409075] DAMAGECOUNT value on done: 4201.0
[2023-02-25 13:04:34,970][2409075] Sum rewards: 13.282, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.995', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO3': '0.076', 'AMMO4': '0.140', 'weapon5': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.431', 'weapon2': '0.464', 'WEAPON4': '0.500', 'WEAPON3': '0.500', 'HITCOUNT': '0.890', 'weapon4': '1.002', 'weapon3': '1.432', 'DAMAGECOUNT': '4.356', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:04:35,063][2409103] DAMAGECOUNT value on done: 5276.0
[2023-02-25 13:04:35,064][2409103] Sum rewards: 14.265, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.837', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.071', 'weapon7': '0.110', 'AMMO4': '0.122', 'weapon5': '0.198', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.298', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.710', 'weapon3': '1.254', 'weapon2': '1.360', 'DAMAGECOUNT': '3.231', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:04:35,312][2409597] DAMAGECOUNT value on done: 4027.0
[2023-02-25 13:04:35,315][2409597] Sum rewards: 4.513, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.120', 'AMMO5': '0.011', 'WEAPON1': '0.030', 'AMMO2': '0.034', 'AMMO3': '0.040', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.169', 'weapon5': '0.176', 'WEAPON4': '0.300', 'WEAPON3': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.370', 'weapon4': '0.614', 'weapon3': '0.784', 'ARMOR': '0.948', 'weapon2': '1.548', 'DAMAGECOUNT': '1.608', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:35,453][2409565] DAMAGECOUNT value on done: 4729.0
[2023-02-25 13:04:35,456][2409565] Sum rewards: 10.608, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.100', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO3': '0.110', 'AMMO4': '0.119', 'weapon5': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.368', 'WEAPON3': '0.500', 'HITCOUNT': '0.840', 'weapon2': '0.926', 'ARMOR': '1.334', 'weapon3': '2.136', 'DAMAGECOUNT': '3.666', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:35,471][2409405] DAMAGECOUNT value on done: 3896.0
[2023-02-25 13:04:35,471][2409405] Sum rewards: 3.576, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.720', 'AMMO5': '0.003', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'weapon4': '0.018', 'AMMO3': '0.037', 'AMMO4': '0.041', 'WEAPON5': '0.050', 'weapon5': '0.066', 'weapon7': '0.074', 'WEAPON4': '0.100', 'HITCOUNT': '0.230', 'WEAPON3': '0.250', 'AMMO6': '0.280', 'AMMO7': '0.280', 'WEAPON7': '0.400', 'ARMOR': '0.476', 'weapon3': '0.584', 'DAMAGECOUNT': '1.035', 'weapon2': '1.354', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:04:35,516][2409389] DAMAGECOUNT value on done: 4341.0
[2023-02-25 13:04:35,519][2409389] Sum rewards: 7.627, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.032', 'AMMO5': '0.014', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'AMMO3': '0.080', 'AMMO4': '0.162', 'weapon5': '0.208', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.550', 'weapon4': '0.564', 'ARMOR': '0.800', 'weapon2': '1.048', 'weapon3': '1.478', 'DAMAGECOUNT': '2.742', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:04:35,607][2409596] DAMAGECOUNT value on done: 3719.0
[2023-02-25 13:04:35,608][2409596] Sum rewards: 7.523, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.412', 'AMMO2': '0.002', 'AMMO4': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'weapon5': '0.068', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.350', 'weapon4': '0.374', 'ARMOR': '0.992', 'weapon3': '1.166', 'DAMAGECOUNT': '1.380', 'weapon2': '1.678', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:35,691][2409373] DAMAGECOUNT value on done: 4158.0
[2023-02-25 13:04:35,692][2409373] Sum rewards: 8.146, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.632', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'AMMO3': '0.085', 'AMMO4': '0.153', 'weapon5': '0.202', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'ARMOR': '0.428', 'weapon4': '0.460', 'WEAPON3': '0.600', 'HITCOUNT': '0.710', 'weapon3': '1.228', 'weapon2': '1.700', 'DAMAGECOUNT': '3.651', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:04:35,861][2409074] Updated weights for policy 0, policy_version 16931 (0.0012)
[2023-02-25 13:04:35,859][2409469] DAMAGECOUNT value on done: 4164.0
[2023-02-25 13:04:35,862][2409469] Sum rewards: 12.689, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.640', 'AMMO5': '0.017', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'AMMO3': '0.073', 'AMMO4': '0.089', 'weapon5': '0.296', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.780', 'ARMOR': '1.318', 'weapon2': '1.630', 'weapon3': '1.754', 'DAMAGECOUNT': '2.964', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:04:36,268][2409866] DAMAGECOUNT value on done: 4458.0
[2023-02-25 13:04:36,308][2409078] DAMAGECOUNT value on done: 4045.0
[2023-02-25 13:04:36,311][2409078] Sum rewards: 7.501, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.030', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO3': '0.030', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'weapon4': '0.066', 'weapon5': '0.100', 'WEAPON5': '0.150', 'WEAPON3': '0.250', 'ARMOR': '0.445', 'HITCOUNT': '0.530', 'weapon3': '0.724', 'DAMAGECOUNT': '2.397', 'weapon2': '2.436', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:36,328][2409101] DAMAGECOUNT value on done: 3853.0
[2023-02-25 13:04:36,331][2409101] Sum rewards: -2.100, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.935', 'ARMOR': '0.012', 'AMMO5': '0.021', 'AMMO2': '0.037', 'WEAPON1': '0.050', 'weapon7': '0.076', 'weapon5': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.123', 'AMMO4': '0.187', 'WEAPON7': '0.200', 'HITCOUNT': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.444', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.840', 'FRAGCOUNT': '1.000', 'weapon2': '1.158', 'weapon3': '1.730'}
[2023-02-25 13:04:36,509][2409076] DAMAGECOUNT value on done: 4179.0
[2023-02-25 13:04:36,509][2409076] Sum rewards: 5.944, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.386', 'AMMO4': '-0.053', 'AMMO2': '-0.010', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO3': '0.067', 'weapon5': '0.174', 'ARMOR': '0.428', 'WEAPON5': '0.450', 'HITCOUNT': '0.460', 'WEAPON3': '0.600', 'weapon3': '1.322', 'DAMAGECOUNT': '2.166', 'weapon2': '2.188', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:36,594][2409104] DAMAGECOUNT value on done: 4306.0
[2023-02-25 13:04:36,595][2409104] Sum rewards: 7.123, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.276', 'AMMO2': '0.003', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.014', 'AMMO3': '0.073', 'weapon5': '0.178', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.660', 'weapon3': '1.346', 'weapon2': '2.162', 'DAMAGECOUNT': '2.643', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:36,617][2409486] DAMAGECOUNT value on done: 4300.0
[2023-02-25 13:04:36,618][2409486] Sum rewards: 5.549, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO3': '0.040', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.112', 'weapon5': '0.158', 'WEAPON3': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.350', 'HEALTH': '0.760', 'weapon3': '0.998', 'weapon2': '1.502', 'DAMAGECOUNT': '1.509', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:04:37,061][2409101] Large shaping reward 2.618 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.597, 199.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 13:04:37,069][2409074] Updated weights for policy 0, policy_version 16941 (0.0014)
[2023-02-25 13:04:37,127][2409100] DAMAGECOUNT value on done: 4328.0
[2023-02-25 13:04:37,130][2409100] Sum rewards: 5.886, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.386', 'WEAPON1': '0.010', 'AMMO5': '0.025', 'AMMO2': '0.035', 'weapon4': '0.066', 'weapon5': '0.084', 'AMMO3': '0.166', 'AMMO4': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.450', 'HITCOUNT': '0.810', 'WEAPON3': '0.850', 'ARMOR': '1.200', 'weapon3': '1.486', 'weapon2': '2.114', 'DAMAGECOUNT': '3.099', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:37,186][2408954] Fps is (10 sec: 26214.3, 60 sec: 25531.7, 300 sec: 25603.5). Total num frames: 69394432. Throughput: 0: 6405.1. Samples: 17341224. Policy #0 lag: (min: 0.0, avg: 12.5, max: 27.0)
[2023-02-25 13:04:37,186][2408954] Avg episode reward: [(0, '6.420')]
[2023-02-25 13:04:37,279][2409102] DAMAGECOUNT value on done: 3393.0
[2023-02-25 13:04:37,279][2409102] Sum rewards: 6.300, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.590', 'AMMO2': '0.005', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon7': '0.014', 'AMMO4': '0.027', 'weapon4': '0.056', 'AMMO3': '0.072', 'weapon5': '0.072', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'WEAPON3': '0.550', 'HITCOUNT': '0.570', 'ARMOR': '0.867', 'weapon3': '1.326', 'DAMAGECOUNT': '1.815', 'weapon2': '1.896', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:37,355][2409079] DAMAGECOUNT value on done: 4011.0
[2023-02-25 13:04:37,358][2409079] Sum rewards: 12.982, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'weapon7': '0.050', 'AMMO3': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.118', 'weapon5': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HEALTH': '0.293', 'WEAPON3': '0.300', 'HITCOUNT': '0.510', 'weapon4': '0.598', 'weapon3': '0.748', 'weapon2': '1.174', 'ARMOR': '1.311', 'DAMAGECOUNT': '2.652', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:04:37,424][2409485] DAMAGECOUNT value on done: 3929.0
[2023-02-25 13:04:37,424][2409485] Sum rewards: 4.779, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.070', 'AMMO5': '0.020', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.125', 'AMMO3': '0.136', 'weapon5': '0.142', 'weapon4': '0.208', 'ARMOR': '0.436', 'WEAPON5': '0.450', 'HITCOUNT': '0.600', 'WEAPON3': '0.850', 'weapon2': '1.286', 'weapon3': '1.898', 'DAMAGECOUNT': '2.082', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:37,468][2409105] DAMAGECOUNT value on done: 3850.0
[2023-02-25 13:04:37,469][2409105] Sum rewards: 7.992, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.436', 'AMMO2': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.034', 'AMMO3': '0.095', 'weapon7': '0.108', 'weapon5': '0.174', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.332', 'WEAPON5': '0.350', 'HITCOUNT': '0.490', 'WEAPON3': '0.650', 'ARMOR': '0.861', 'weapon2': '1.168', 'weapon3': '1.490', 'DAMAGECOUNT': '2.709', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:37,765][2409548] DAMAGECOUNT value on done: 4668.0
[2023-02-25 13:04:37,768][2409548] Sum rewards: 6.664, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.076', 'AMMO5': '0.015', 'AMMO2': '0.020', 'WEAPON1': '0.050', 'AMMO4': '0.099', 'AMMO3': '0.149', 'weapon5': '0.172', 'WEAPON5': '0.350', 'HITCOUNT': '0.640', 'WEAPON3': '0.850', 'weapon3': '1.456', 'weapon2': '1.796', 'DAMAGECOUNT': '2.643', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:37,906][2409096] DAMAGECOUNT value on done: 3347.0
[2023-02-25 13:04:37,910][2409096] Sum rewards: 2.923, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.035', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.022', 'AMMO3': '0.030', 'weapon7': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.140', 'weapon5': '0.170', 'WEAPON5': '0.200', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.690', 'weapon3': '0.770', 'ARMOR': '0.924', 'FRAGCOUNT': '1.000', 'weapon2': '2.050'}
[2023-02-25 13:04:37,948][2409549] DAMAGECOUNT value on done: 5184.0
[2023-02-25 13:04:37,951][2409549] Sum rewards: 1.432, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.554', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'weapon7': '0.050', 'AMMO3': '0.070', 'weapon5': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'HITCOUNT': '0.380', 'weapon4': '0.446', 'WEAPON3': '0.450', 'ARMOR': '0.487', 'weapon3': '0.766', 'weapon2': '1.624', 'DAMAGECOUNT': '1.710', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:38,033][2409406] DAMAGECOUNT value on done: 3007.0
[2023-02-25 13:04:38,034][2409406] Sum rewards: 0.507, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.422', 'AMMO5': '0.004', 'AMMO2': '0.008', 'weapon5': '0.032', 'AMMO4': '0.039', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.280', 'WEAPON3': '0.450', 'weapon4': '0.662', 'weapon3': '0.902', 'DAMAGECOUNT': '0.915', 'FRAGCOUNT': '1.000', 'weapon2': '1.286', 'ARMOR': '1.316'}
[2023-02-25 13:04:38,035][2409077] DAMAGECOUNT value on done: 3940.0
[2023-02-25 13:04:38,049][2409077] Sum rewards: 6.420, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.770', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.016', 'AMMO3': '0.054', 'AMMO4': '0.081', 'weapon4': '0.158', 'weapon5': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.350', 'HITCOUNT': '0.370', 'ARMOR': '0.918', 'weapon3': '0.976', 'weapon2': '1.870', 'DAMAGECOUNT': '1.890', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:38,139][2409407] DAMAGECOUNT value on done: 3557.0
[2023-02-25 13:04:38,139][2409407] Sum rewards: 3.372, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'AMMO4': '0.081', 'weapon5': '0.092', 'AMMO3': '0.102', 'HEALTH': '0.118', 'WEAPON5': '0.150', 'HITCOUNT': '0.360', 'WEAPON3': '0.600', 'weapon3': '1.500', 'DAMAGECOUNT': '1.515', 'weapon2': '1.800', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:38,449][2409355] DAMAGECOUNT value on done: 4209.0
[2023-02-25 13:04:38,452][2409355] Sum rewards: 6.538, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.370', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.048', 'weapon5': '0.060', 'weapon7': '0.078', 'AMMO3': '0.082', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.234', 'WEAPON7': '0.300', 'HITCOUNT': '0.490', 'WEAPON3': '0.500', 'weapon3': '1.412', 'DAMAGECOUNT': '1.551', 'weapon2': '1.636', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:38,629][2409097] DAMAGECOUNT value on done: 5176.0
[2023-02-25 13:04:38,630][2409097] Sum rewards: 3.484, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.733', 'AMMO2': '0.009', 'AMMO5': '0.013', 'WEAPON1': '0.030', 'AMMO4': '0.043', 'weapon7': '0.054', 'AMMO3': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.112', 'WEAPON4': '0.200', 'weapon4': '0.240', 'WEAPON5': '0.350', 'ARMOR': '0.460', 'WEAPON3': '0.700', 'HITCOUNT': '0.700', 'weapon2': '1.116', 'weapon3': '1.794', 'FRAGCOUNT': '2.500', 'DAMAGECOUNT': '2.508'}
[2023-02-25 13:04:38,699][2409074] Updated weights for policy 0, policy_version 16951 (0.0012)
[2023-02-25 13:04:38,720][2409103] DAMAGECOUNT value on done: 4171.0
[2023-02-25 13:04:38,720][2409103] Sum rewards: 5.656, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.892', 'AMMO5': '0.017', 'AMMO2': '0.020', 'WEAPON1': '0.060', 'AMMO3': '0.070', 'AMMO4': '0.099', 'weapon5': '0.112', 'WEAPON4': '0.150', 'weapon4': '0.306', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.610', 'weapon3': '1.274', 'weapon2': '1.386', 'DAMAGECOUNT': '2.544', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:38,770][2409075] DAMAGECOUNT value on done: 3660.0
[2023-02-25 13:04:38,771][2409075] Sum rewards: 7.880, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.843', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'weapon7': '0.066', 'weapon5': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.390', 'weapon4': '0.458', 'ARMOR': '0.500', 'weapon3': '1.012', 'weapon2': '1.250', 'DAMAGECOUNT': '1.851', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:39,028][2409405] DAMAGECOUNT value on done: 4422.0
[2023-02-25 13:04:39,031][2409405] Sum rewards: 7.459, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.722', 'AMMO2': '0.017', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.073', 'AMMO4': '0.083', 'weapon5': '0.146', 'weapon4': '0.294', 'WEAPON5': '0.450', 'HITCOUNT': '0.460', 'WEAPON3': '0.500', 'weapon3': '1.368', 'weapon2': '1.638', 'DAMAGECOUNT': '1.776', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:39,088][2409565] DAMAGECOUNT value on done: 3189.0
[2023-02-25 13:04:39,089][2409565] Sum rewards: 8.148, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.112', 'AMMO2': '0.010', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'weapon5': '0.122', 'WEAPON5': '0.200', 'weapon4': '0.250', 'HITCOUNT': '0.370', 'WEAPON3': '0.500', 'weapon2': '0.826', 'ARMOR': '0.839', 'weapon3': '1.616', 'DAMAGECOUNT': '1.839', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:39,311][2409389] DAMAGECOUNT value on done: 4921.0
[2023-02-25 13:04:39,312][2409389] Sum rewards: 14.373, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.193', 'AMMO2': '0.014', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'weapon7': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.089', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.188', 'WEAPON7': '0.200', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'ARMOR': '0.491', 'WEAPON3': '0.650', 'weapon4': '0.700', 'HITCOUNT': '0.780', 'weapon2': '1.016', 'weapon3': '1.318', 'DAMAGECOUNT': '4.575', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:04:39,462][2409597] DAMAGECOUNT value on done: 5142.0
[2023-02-25 13:04:39,465][2409597] Sum rewards: 6.876, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.554', 'weapon5': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO3': '0.082', 'AMMO4': '0.146', 'weapon7': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.470', 'WEAPON3': '0.500', 'weapon2': '0.688', 'weapon3': '0.720', 'weapon4': '0.860', 'DAMAGECOUNT': '2.865', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:39,465][2409596] DAMAGECOUNT value on done: 4606.0
[2023-02-25 13:04:39,466][2409596] Sum rewards: 5.002, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.246', 'AMMO5': '0.012', 'weapon7': '0.032', 'AMMO2': '0.055', 'AMMO3': '0.066', 'weapon5': '0.094', 'WEAPON5': '0.250', 'AMMO4': '0.276', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON3': '0.400', 'ARMOR': '0.416', 'HITCOUNT': '0.420', 'WEAPON4': '0.550', 'weapon2': '0.746', 'weapon4': '1.076', 'weapon3': '1.334', 'DAMAGECOUNT': '1.620', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:39,486][2409373] DAMAGECOUNT value on done: 5177.0
[2023-02-25 13:04:39,490][2409373] Sum rewards: 13.715, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.426', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO3': '0.083', 'AMMO4': '0.093', 'weapon5': '0.144', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.336', 'WEAPON3': '0.500', 'HITCOUNT': '0.560', 'weapon3': '1.134', 'ARMOR': '1.359', 'weapon2': '1.730', 'DAMAGECOUNT': '2.871', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:04:39,669][2409469] DAMAGECOUNT value on done: 5378.0
[2023-02-25 13:04:39,672][2409469] Sum rewards: 7.263, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.800', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon5': '0.122', 'weapon4': '0.216', 'WEAPON5': '0.250', 'HITCOUNT': '0.650', 'WEAPON3': '0.700', 'ARMOR': '1.406', 'weapon3': '1.516', 'weapon2': '1.908', 'DAMAGECOUNT': '2.796', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:39,846][2409101] DAMAGECOUNT value on done: 4378.0
[2023-02-25 13:04:39,848][2409101] Sum rewards: 2.605, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.974', 'AMMO2': '0.003', 'AMMO4': '0.017', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'weapon5': '0.090', 'AMMO3': '0.114', 'WEAPON4': '0.150', 'weapon4': '0.242', 'ARMOR': '0.400', 'WEAPON5': '0.550', 'HITCOUNT': '0.640', 'WEAPON3': '0.800', 'weapon3': '1.662', 'weapon2': '1.724', 'DAMAGECOUNT': '2.391', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:39,914][2409078] DAMAGECOUNT value on done: 3940.0
[2023-02-25 13:04:39,934][2409078] Sum rewards: 4.638, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.686', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.084', 'AMMO3': '0.099', 'weapon5': '0.234', 'weapon4': '0.258', 'WEAPON5': '0.350', 'HITCOUNT': '0.460', 'WEAPON3': '0.650', 'ARMOR': '0.863', 'weapon3': '1.520', 'weapon2': '1.670', 'DAMAGECOUNT': '1.794', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:40,129][2409074] Updated weights for policy 0, policy_version 16961 (0.0012)
[2023-02-25 13:04:40,304][2409866] DAMAGECOUNT value on done: 3756.0
[2023-02-25 13:04:40,307][2409866] Sum rewards: 7.130, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.118', 'AMMO2': '0.015', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO3': '0.066', 'AMMO4': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.164', 'WEAPON7': '0.200', 'weapon4': '0.232', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.620', 'ARMOR': '0.949', 'weapon3': '1.198', 'weapon2': '1.680', 'DAMAGECOUNT': '2.274', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:40,335][2409076] DAMAGECOUNT value on done: 4654.0
[2023-02-25 13:04:40,337][2409076] Sum rewards: 13.352, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.124', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon7': '0.054', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.128', 'AMMO4': '0.165', 'weapon5': '0.190', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'weapon2': '0.854', 'weapon4': '0.916', 'HITCOUNT': '0.950', 'ARMOR': '1.208', 'weapon3': '1.610', 'DAMAGECOUNT': '3.855', 'FRAGCOUNT': '11.500'}
[2023-02-25 13:04:40,439][2409104] DAMAGECOUNT value on done: 4819.0
[2023-02-25 13:04:40,442][2409104] Sum rewards: 4.919, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.932', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'AMMO3': '0.051', 'weapon5': '0.052', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'WEAPON3': '0.400', 'WEAPON4': '0.400', 'ARMOR': '0.451', 'HITCOUNT': '0.610', 'weapon4': '0.618', 'weapon3': '1.022', 'weapon2': '1.570', 'DAMAGECOUNT': '2.352', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:04:40,674][2409077] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:04:40,740][2409100] DAMAGECOUNT value on done: 3469.0
[2023-02-25 13:04:40,744][2409100] Sum rewards: 2.025, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.142', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.010', 'AMMO3': '0.043', 'weapon7': '0.050', 'weapon5': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.210', 'WEAPON3': '0.350', 'weapon3': '0.666', 'ARMOR': '0.877', 'DAMAGECOUNT': '0.996', 'weapon2': '1.030', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:04:40,769][2409486] DAMAGECOUNT value on done: 3559.0
[2023-02-25 13:04:40,770][2409486] Sum rewards: 7.787, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.087', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.040', 'AMMO4': '0.042', 'AMMO3': '0.051', 'weapon5': '0.066', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.322', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.610', 'weapon2': '0.842', 'weapon3': '1.224', 'DAMAGECOUNT': '2.211', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:40,903][2409102] DAMAGECOUNT value on done: 4241.0
[2023-02-25 13:04:40,904][2409102] Sum rewards: 4.262, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.610', 'AMMO2': '0.005', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.024', 'weapon7': '0.046', 'AMMO3': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.160', 'WEAPON7': '0.200', 'ARMOR': '0.404', 'weapon4': '0.420', 'WEAPON5': '0.500', 'HITCOUNT': '0.590', 'WEAPON3': '0.750', 'weapon2': '1.426', 'weapon3': '1.570', 'DAMAGECOUNT': '1.986', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:41,116][2409485] DAMAGECOUNT value on done: 3282.0
[2023-02-25 13:04:41,119][2409485] Sum rewards: 6.038, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.810', 'AMMO5': '0.005', 'AMMO2': '0.022', 'AMMO3': '0.080', 'AMMO4': '0.107', 'weapon5': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.226', 'ARMOR': '0.408', 'WEAPON3': '0.550', 'HITCOUNT': '0.580', 'weapon3': '1.340', 'weapon2': '1.904', 'DAMAGECOUNT': '2.166', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:41,187][2409079] DAMAGECOUNT value on done: 4348.0
[2023-02-25 13:04:41,190][2409079] Sum rewards: 1.052, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.658', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO3': '0.061', 'weapon7': '0.082', 'AMMO4': '0.091', 'weapon5': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.300', 'weapon4': '0.422', 'ARMOR': '0.473', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.000', 'DAMAGECOUNT': '1.221', 'weapon2': '1.770'}
[2023-02-25 13:04:41,423][2409548] DAMAGECOUNT value on done: 5254.0
[2023-02-25 13:04:41,427][2409548] Sum rewards: 6.291, reward structure: {'DEATHCOUNT': '-4.500', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO3': '0.065', 'AMMO4': '0.082', 'HEALTH': '0.122', 'weapon7': '0.130', 'WEAPON4': '0.150', 'weapon5': '0.154', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'weapon4': '0.368', 'HITCOUNT': '0.390', 'weapon2': '0.752', 'ARMOR': '0.800', 'weapon3': '1.242', 'DAMAGECOUNT': '1.656', 'FRAGCOUNT': '3.500'}
[2023-02-25 13:04:41,428][2409549] DAMAGECOUNT value on done: 3840.0
[2023-02-25 13:04:41,429][2409549] Sum rewards: 7.902, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.151', 'AMMO4': '-0.063', 'AMMO2': '-0.013', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO3': '0.055', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.410', 'ARMOR': '0.480', 'WEAPON3': '0.500', 'weapon3': '1.138', 'weapon2': '1.304', 'DAMAGECOUNT': '2.310', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:41,486][2409105] DAMAGECOUNT value on done: 5018.0
[2023-02-25 13:04:41,490][2409105] Sum rewards: 5.502, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.812', 'AMMO2': '0.015', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'weapon4': '0.068', 'AMMO4': '0.076', 'AMMO3': '0.110', 'weapon5': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'HITCOUNT': '0.660', 'WEAPON3': '0.800', 'weapon2': '1.414', 'weapon3': '1.624', 'DAMAGECOUNT': '2.496', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:41,935][2409407] DAMAGECOUNT value on done: 4486.0
[2023-02-25 13:04:41,938][2409407] Sum rewards: 5.236, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.908', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO5': '0.016', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO3': '0.063', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.202', 'weapon4': '0.256', 'weapon2': '0.332', 'HITCOUNT': '0.350', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'weapon3': '1.428', 'DAMAGECOUNT': '1.800', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:41,939][2409096] DAMAGECOUNT value on done: 3383.0
[2023-02-25 13:04:41,943][2409096] Sum rewards: 7.959, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.334', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'weapon7': '0.004', 'AMMO3': '0.050', 'weapon5': '0.052', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.350', 'ARMOR': '0.457', 'HITCOUNT': '0.520', 'weapon3': '1.224', 'weapon2': '1.662', 'DAMAGECOUNT': '1.860', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:41,999][2409074] Updated weights for policy 0, policy_version 16971 (0.0012)
[2023-02-25 13:04:42,186][2408954] Fps is (10 sec: 25395.0, 60 sec: 25531.7, 300 sec: 25575.7). Total num frames: 69513216. Throughput: 0: 6406.7. Samples: 17379540. Policy #0 lag: (min: 0.0, avg: 12.5, max: 27.0)
[2023-02-25 13:04:42,186][2408954] Avg episode reward: [(0, '6.476')]
[2023-02-25 13:04:42,264][2409103] DAMAGECOUNT value on done: 4927.0
[2023-02-25 13:04:42,267][2409103] Sum rewards: 2.148, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.066', 'AMMO2': '0.005', 'AMMO5': '0.017', 'AMMO4': '0.024', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon5': '0.120', 'weapon4': '0.196', 'WEAPON5': '0.300', 'HITCOUNT': '0.580', 'WEAPON3': '0.650', 'ARMOR': '1.357', 'weapon2': '1.462', 'weapon3': '1.614', 'DAMAGECOUNT': '2.436', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:42,417][2409406] DAMAGECOUNT value on done: 3323.0
[2023-02-25 13:04:42,418][2409406] Sum rewards: 8.891, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.770', 'AMMO5': '0.021', 'AMMO2': '0.040', 'WEAPON1': '0.070', 'AMMO3': '0.105', 'AMMO4': '0.199', 'WEAPON4': '0.200', 'weapon5': '0.212', 'weapon4': '0.268', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'ARMOR': '0.800', 'HITCOUNT': '0.900', 'weapon2': '0.946', 'weapon3': '2.000', 'DAMAGECOUNT': '3.549', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:04:42,423][2409077] DAMAGECOUNT value on done: 4839.0
[2023-02-25 13:04:42,424][2409077] Sum rewards: 3.043, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.158', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'AMMO3': '0.052', 'weapon5': '0.058', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.162', 'WEAPON5': '0.250', 'weapon4': '0.282', 'HITCOUNT': '0.290', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'weapon2': '1.050', 'DAMAGECOUNT': '1.092', 'weapon3': '1.126', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:04:42,446][2409075] DAMAGECOUNT value on done: 3373.0
[2023-02-25 13:04:42,447][2409075] Sum rewards: 5.759, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.157', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'AMMO3': '0.040', 'weapon7': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.128', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'WEAPON3': '0.300', 'HITCOUNT': '0.310', 'weapon2': '0.612', 'weapon4': '0.716', 'weapon3': '1.100', 'DAMAGECOUNT': '1.434', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:42,619][2409097] DAMAGECOUNT value on done: 4042.0
[2023-02-25 13:04:42,623][2409097] Sum rewards: 1.758, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.815', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO3': '0.066', 'weapon7': '0.080', 'AMMO4': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.148', 'WEAPON5': '0.250', 'HITCOUNT': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'weapon3': '0.830', 'weapon4': '0.846', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.233', 'weapon2': '1.292', 'ARMOR': '1.357'}
[2023-02-25 13:04:42,657][2409565] DAMAGECOUNT value on done: 3779.0
[2023-02-25 13:04:42,658][2409565] Sum rewards: 4.143, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.988', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.088', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'weapon4': '0.226', 'WEAPON4': '0.250', 'ARMOR': '0.452', 'HITCOUNT': '0.560', 'WEAPON3': '0.600', 'weapon3': '1.266', 'weapon2': '1.430', 'DAMAGECOUNT': '1.740', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:42,783][2409355] DAMAGECOUNT value on done: 3270.0
[2023-02-25 13:04:42,786][2409355] Sum rewards: 3.547, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.062', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.032', 'ARMOR': '0.036', 'AMMO4': '0.145', 'weapon5': '0.202', 'WEAPON3': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.410', 'WEAPON4': '0.450', 'weapon3': '0.698', 'weapon2': '0.918', 'weapon4': '1.104', 'DAMAGECOUNT': '1.557', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:42,944][2409389] DAMAGECOUNT value on done: 5033.0
[2023-02-25 13:04:42,950][2409389] Sum rewards: 7.695, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.948', 'AMMO5': '0.015', 'AMMO2': '0.018', 'WEAPON1': '0.060', 'weapon4': '0.076', 'weapon7': '0.086', 'AMMO4': '0.090', 'AMMO3': '0.113', 'WEAPON4': '0.200', 'weapon5': '0.232', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON5': '0.400', 'WEAPON7': '0.400', 'HITCOUNT': '0.480', 'WEAPON3': '0.800', 'ARMOR': '0.855', 'weapon3': '1.582', 'weapon2': '1.738', 'DAMAGECOUNT': '3.108', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:43,009][2409405] DAMAGECOUNT value on done: 4587.0
[2023-02-25 13:04:43,012][2409405] Sum rewards: 7.497, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.605', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO3': '0.074', 'weapon5': '0.114', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'HITCOUNT': '0.550', 'weapon3': '1.390', 'weapon2': '1.570', 'DAMAGECOUNT': '2.022', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:43,092][2409596] DAMAGECOUNT value on done: 4694.0
[2023-02-25 13:04:43,095][2409596] Sum rewards: 11.260, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.758', 'AMMO2': '0.006', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.031', 'weapon4': '0.034', 'WEAPON4': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.109', 'weapon5': '0.204', 'WEAPON5': '0.400', 'HITCOUNT': '0.680', 'WEAPON3': '0.700', 'weapon2': '1.630', 'weapon3': '1.760', 'DAMAGECOUNT': '3.090', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:04:43,104][2409373] DAMAGECOUNT value on done: 5438.0
[2023-02-25 13:04:43,108][2409373] Sum rewards: 12.060, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.129', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'AMMO5': '0.029', 'AMMO3': '0.103', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'weapon5': '0.368', 'weapon4': '0.468', 'WEAPON5': '0.550', 'HITCOUNT': '0.630', 'WEAPON3': '0.650', 'weapon2': '0.934', 'ARMOR': '1.200', 'weapon3': '1.724', 'DAMAGECOUNT': '3.990', 'FRAGCOUNT': '9.500'}
[2023-02-25 13:04:43,302][2409597] DAMAGECOUNT value on done: 4678.0
[2023-02-25 13:04:43,304][2409597] Sum rewards: 6.912, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.332', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'weapon7': '0.050', 'AMMO3': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.122', 'AMMO4': '0.159', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'HITCOUNT': '0.400', 'WEAPON3': '0.550', 'weapon4': '0.758', 'weapon2': '1.110', 'ARMOR': '1.409', 'weapon3': '1.518', 'DAMAGECOUNT': '1.581', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:43,394][2409101] DAMAGECOUNT value on done: 4908.0
[2023-02-25 13:04:43,398][2409101] Sum rewards: 7.134, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.560', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.094', 'AMMO4': '0.116', 'weapon5': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.463', 'weapon4': '0.494', 'WEAPON4': '0.500', 'HITCOUNT': '0.680', 'WEAPON3': '0.750', 'weapon2': '1.386', 'weapon3': '1.570', 'DAMAGECOUNT': '3.084', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:04:43,471][2409469] DAMAGECOUNT value on done: 5172.0
[2023-02-25 13:04:43,471][2409469] Sum rewards: 8.113, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.595', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon7': '0.074', 'AMMO3': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.122', 'AMMO4': '0.161', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'HITCOUNT': '0.460', 'weapon4': '0.538', 'WEAPON3': '0.550', 'ARMOR': '1.224', 'weapon3': '1.362', 'weapon2': '1.584', 'DAMAGECOUNT': '2.154', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:43,569][2409074] Updated weights for policy 0, policy_version 16981 (0.0012)
[2023-02-25 13:04:43,876][2409078] DAMAGECOUNT value on done: 4180.0
[2023-02-25 13:04:43,877][2409078] Sum rewards: 5.484, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.112', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.032', 'AMMO4': '0.050', 'weapon5': '0.148', 'WEAPON5': '0.150', 'weapon7': '0.170', 'HITCOUNT': '0.240', 'WEAPON3': '0.250', 'WEAPON4': '0.250', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON7': '0.500', 'weapon3': '0.652', 'weapon4': '0.756', 'ARMOR': '0.901', 'weapon2': '1.322', 'DAMAGECOUNT': '2.460', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:43,973][2409076] DAMAGECOUNT value on done: 4553.0
[2023-02-25 13:04:43,974][2409076] Sum rewards: 13.275, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'AMMO3': '0.040', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'HEALTH': '0.153', 'weapon5': '0.160', 'WEAPON3': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.660', 'weapon2': '0.692', 'weapon3': '0.794', 'ARMOR': '0.840', 'weapon4': '0.908', 'DAMAGECOUNT': '2.925', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:04:44,083][2409104] DAMAGECOUNT value on done: 3737.0
[2023-02-25 13:04:44,084][2409104] Sum rewards: 2.042, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.380', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'AMMO5': '0.026', 'WEAPON1': '0.060', 'AMMO3': '0.094', 'weapon5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.330', 'ARMOR': '0.448', 'weapon4': '0.482', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'weapon3': '1.232', 'weapon2': '1.518', 'DAMAGECOUNT': '1.635', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:44,393][2409100] DAMAGECOUNT value on done: 4419.0
[2023-02-25 13:04:44,396][2409100] Sum rewards: 3.272, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.510', 'AMMO5': '0.007', 'AMMO2': '0.035', 'AMMO3': '0.062', 'weapon5': '0.064', 'weapon7': '0.120', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.370', 'WEAPON3': '0.450', 'ARMOR': '0.490', 'weapon4': '0.516', 'weapon2': '0.770', 'weapon3': '0.940', 'DAMAGECOUNT': '1.545', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:44,489][2409102] DAMAGECOUNT value on done: 4236.0
[2023-02-25 13:04:44,491][2409102] Sum rewards: 5.900, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.012', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'weapon4': '0.164', 'WEAPON4': '0.250', 'HITCOUNT': '0.600', 'WEAPON3': '0.650', 'ARMOR': '0.853', 'weapon3': '1.532', 'weapon2': '1.818', 'DAMAGECOUNT': '2.214', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:44,733][2409485] DAMAGECOUNT value on done: 4596.0
[2023-02-25 13:04:44,739][2409866] DAMAGECOUNT value on done: 3900.0
[2023-02-25 13:04:44,737][2409485] Sum rewards: 9.534, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.154', 'AMMO2': '0.014', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon7': '0.058', 'AMMO4': '0.067', 'weapon4': '0.072', 'AMMO3': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.132', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.560', 'WEAPON3': '0.700', 'weapon2': '1.568', 'weapon3': '1.638', 'DAMAGECOUNT': '2.631', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:04:44,740][2409866] Sum rewards: 9.705, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.087', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'weapon5': '0.060', 'AMMO3': '0.087', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.444', 'WEAPON3': '0.750', 'ARMOR': '0.856', 'HITCOUNT': '1.030', 'weapon2': '1.114', 'weapon3': '1.882', 'DAMAGECOUNT': '3.432', 'FRAGCOUNT': '8.500'}
[2023-02-25 13:04:44,873][2409079] DAMAGECOUNT value on done: 4123.0
[2023-02-25 13:04:44,873][2409079] Sum rewards: 8.399, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.320', 'AMMO5': '0.017', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.085', 'AMMO3': '0.088', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.350', 'weapon4': '0.364', 'ARMOR': '0.404', 'WEAPON3': '0.650', 'HITCOUNT': '0.710', 'weapon2': '1.258', 'weapon3': '1.710', 'DAMAGECOUNT': '3.261', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:44,994][2409549] DAMAGECOUNT value on done: 4112.0
[2023-02-25 13:04:44,995][2409549] Sum rewards: 1.227, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.522', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'weapon5': '0.034', 'AMMO4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.081', 'weapon7': '0.102', 'AMMO6': '0.240', 'AMMO7': '0.240', 'HITCOUNT': '0.280', 'WEAPON4': '0.300', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'ARMOR': '0.465', 'weapon2': '0.474', 'weapon3': '0.510', 'weapon4': '0.714', 'DAMAGECOUNT': '1.086', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:45,119][2409548] DAMAGECOUNT value on done: 4000.0
[2023-02-25 13:04:45,120][2409548] Sum rewards: 3.789, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.794', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.040', 'weapon7': '0.058', 'AMMO3': '0.069', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.158', 'AMMO4': '0.202', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '0.450', 'ARMOR': '0.456', 'HITCOUNT': '0.560', 'weapon2': '0.650', 'weapon4': '0.744', 'weapon3': '0.916', 'DAMAGECOUNT': '2.445', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:45,135][2409486] DAMAGECOUNT value on done: 3669.0
[2023-02-25 13:04:45,136][2409486] Sum rewards: 6.240, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.755', 'AMMO2': '0.008', 'AMMO5': '0.014', 'WEAPON1': '0.030', 'AMMO4': '0.038', 'weapon7': '0.054', 'AMMO3': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.342', 'WEAPON5': '0.350', 'ARMOR': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'weapon2': '1.284', 'weapon3': '1.384', 'DAMAGECOUNT': '1.977', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:45,310][2409074] Updated weights for policy 0, policy_version 16991 (0.0013)
[2023-02-25 13:04:45,531][2409105] DAMAGECOUNT value on done: 4367.0
[2023-02-25 13:04:45,535][2409105] Sum rewards: 3.342, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.158', 'AMMO5': '0.006', 'AMMO2': '0.013', 'AMMO3': '0.048', 'AMMO4': '0.066', 'weapon5': '0.102', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.590', 'weapon4': '0.604', 'weapon3': '0.740', 'ARMOR': '0.870', 'weapon2': '1.588', 'DAMAGECOUNT': '2.022', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:45,608][2409407] DAMAGECOUNT value on done: 4518.0
[2023-02-25 13:04:45,612][2409407] Sum rewards: 6.733, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.048', 'AMMO5': '0.012', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'weapon7': '0.046', 'weapon4': '0.060', 'AMMO3': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.102', 'AMMO4': '0.102', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.810', 'weapon3': '1.492', 'weapon2': '1.916', 'DAMAGECOUNT': '2.958', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:45,821][2409096] DAMAGECOUNT value on done: 4312.0
[2023-02-25 13:04:45,823][2409096] Sum rewards: 9.266, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.110', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon7': '0.072', 'AMMO3': '0.075', 'WEAPON1': '0.080', 'AMMO4': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.218', 'WEAPON5': '0.350', 'weapon4': '0.366', 'WEAPON3': '0.600', 'weapon2': '0.738', 'HITCOUNT': '0.760', 'weapon3': '1.688', 'DAMAGECOUNT': '3.660', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:45,837][2409103] DAMAGECOUNT value on done: 4314.0
[2023-02-25 13:04:45,840][2409103] Sum rewards: 8.027, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.017', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'AMMO4': '0.086', 'AMMO3': '0.087', 'weapon7': '0.110', 'WEAPON4': '0.150', 'weapon5': '0.174', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'HEALTH': '0.264', 'weapon4': '0.416', 'HITCOUNT': '0.460', 'WEAPON3': '0.500', 'WEAPON5': '0.500', 'weapon2': '1.212', 'weapon3': '1.280', 'DAMAGECOUNT': '2.118', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:46,165][2409077] DAMAGECOUNT value on done: 4792.0
[2023-02-25 13:04:46,166][2409077] Sum rewards: 4.027, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.036', 'AMMO4': '-0.059', 'AMMO2': '-0.012', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.132', 'WEAPON4': '0.200', 'weapon4': '0.404', 'HITCOUNT': '0.570', 'WEAPON3': '0.900', 'ARMOR': '0.946', 'weapon2': '1.580', 'weapon3': '1.740', 'DAMAGECOUNT': '2.109', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:46,176][2409406] DAMAGECOUNT value on done: 4363.0
[2023-02-25 13:04:46,177][2409406] Sum rewards: 5.108, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.691', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.042', 'WEAPON1': '0.050', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'weapon5': '0.258', 'weapon4': '0.262', 'HITCOUNT': '0.330', 'WEAPON5': '0.350', 'ARMOR': '0.420', 'WEAPON3': '0.500', 'weapon2': '0.872', 'weapon3': '1.624', 'DAMAGECOUNT': '1.641', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:46,198][2409075] DAMAGECOUNT value on done: 3735.0
[2023-02-25 13:04:46,201][2409075] Sum rewards: 1.562, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.665', 'AMMO2': '0.022', 'weapon7': '0.026', 'AMMO5': '0.031', 'AMMO3': '0.078', 'AMMO4': '0.112', 'weapon5': '0.136', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'WEAPON3': '0.500', 'HITCOUNT': '0.580', 'weapon4': '0.610', 'WEAPON5': '0.700', 'weapon2': '1.232', 'ARMOR': '1.318', 'weapon3': '1.322', 'DAMAGECOUNT': '2.190', 'FRAGCOUNT': '2.500'}
[2023-02-25 13:04:46,332][2409565] DAMAGECOUNT value on done: 4896.0
[2023-02-25 13:04:46,333][2409565] Sum rewards: 8.226, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.093', 'AMMO2': '0.014', 'weapon7': '0.014', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'AMMO4': '0.069', 'AMMO3': '0.090', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon4': '0.186', 'WEAPON4': '0.200', 'weapon5': '0.318', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.760', 'ARMOR': '0.885', 'weapon2': '1.294', 'weapon3': '1.796', 'DAMAGECOUNT': '2.985', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:04:46,568][2409097] DAMAGECOUNT value on done: 3937.0
[2023-02-25 13:04:46,570][2409097] Sum rewards: 9.107, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.908', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO3': '0.059', 'weapon7': '0.066', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.240', 'WEAPON3': '0.400', 'HITCOUNT': '0.510', 'ARMOR': '0.854', 'weapon3': '1.046', 'weapon2': '1.636', 'DAMAGECOUNT': '2.598', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:46,684][2409373] DAMAGECOUNT value on done: 5602.0
[2023-02-25 13:04:46,684][2409373] Sum rewards: 19.624, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.610', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO3': '0.040', 'weapon7': '0.048', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.240', 'WEAPON3': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.490', 'ARMOR': '0.924', 'HITCOUNT': '0.930', 'weapon3': '1.012', 'weapon2': '1.850', 'DAMAGECOUNT': '4.686', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:04:46,706][2409596] DAMAGECOUNT value on done: 3401.0
[2023-02-25 13:04:46,709][2409596] Sum rewards: 5.297, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.320', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon7': '0.050', 'AMMO3': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.122', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.400', 'WEAPON3': '0.400', 'ARMOR': '0.900', 'weapon3': '1.140', 'DAMAGECOUNT': '1.269', 'weapon2': '2.012', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:46,753][2409389] DAMAGECOUNT value on done: 3795.0
[2023-02-25 13:04:46,754][2409389] Sum rewards: 13.509, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.277', 'AMMO2': '0.022', 'AMMO5': '0.023', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.105', 'AMMO4': '0.109', 'WEAPON4': '0.250', 'weapon5': '0.264', 'weapon4': '0.330', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '0.940', 'ARMOR': '0.959', 'weapon2': '1.274', 'weapon3': '1.324', 'DAMAGECOUNT': '4.386', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:04:46,817][2409074] Updated weights for policy 0, policy_version 17001 (0.0012)
[2023-02-25 13:04:47,004][2409355] DAMAGECOUNT value on done: 4646.0
[2023-02-25 13:04:47,007][2409355] Sum rewards: 8.484, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.210', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'AMMO3': '0.040', 'weapon7': '0.046', 'weapon5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'HITCOUNT': '0.410', 'ARMOR': '0.951', 'weapon3': '0.952', 'weapon2': '1.148', 'DAMAGECOUNT': '2.196', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:47,186][2408954] Fps is (10 sec: 24576.1, 60 sec: 25600.0, 300 sec: 25561.8). Total num frames: 69640192. Throughput: 0: 6402.4. Samples: 17418096. Policy #0 lag: (min: 1.0, avg: 12.4, max: 28.0)
[2023-02-25 13:04:47,186][2408954] Avg episode reward: [(0, '6.516')]
[2023-02-25 13:04:47,240][2409405] DAMAGECOUNT value on done: 4562.0
[2023-02-25 13:04:47,245][2409405] Sum rewards: 3.872, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.794', 'AMMO5': '0.018', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'AMMO3': '0.139', 'AMMO4': '0.146', 'weapon5': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.260', 'WEAPON5': '0.400', 'HITCOUNT': '0.740', 'WEAPON3': '0.850', 'ARMOR': '0.859', 'weapon2': '1.240', 'weapon3': '1.998', 'DAMAGECOUNT': '2.316', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:47,270][2409597] DAMAGECOUNT value on done: 3624.0
[2023-02-25 13:04:47,273][2409597] Sum rewards: 4.342, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.223', 'AMMO4': '-0.059', 'AMMO2': '-0.012', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon7': '0.046', 'AMMO3': '0.066', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.146', 'WEAPON7': '0.200', 'weapon4': '0.232', 'WEAPON5': '0.300', 'HITCOUNT': '0.340', 'WEAPON3': '0.450', 'weapon3': '0.856', 'ARMOR': '0.941', 'DAMAGECOUNT': '1.542', 'weapon2': '1.896', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:04:47,350][2409101] DAMAGECOUNT value on done: 4305.0
[2023-02-25 13:04:47,352][2409101] Sum rewards: 11.532, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.105', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO3': '0.030', 'AMMO4': '0.039', 'weapon7': '0.048', 'weapon5': '0.096', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.232', 'HITCOUNT': '0.420', 'weapon3': '0.716', 'weapon2': '0.936', 'DAMAGECOUNT': '1.707', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:04:47,623][2409076] DAMAGECOUNT value on done: 4003.0
[2023-02-25 13:04:47,627][2409076] Sum rewards: 6.157, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.803', 'AMMO5': '0.007', 'AMMO2': '0.018', 'ARMOR': '0.060', 'weapon5': '0.070', 'AMMO3': '0.078', 'AMMO4': '0.089', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'weapon4': '0.706', 'weapon2': '1.004', 'weapon3': '1.486', 'DAMAGECOUNT': '1.782', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:47,763][2409104] DAMAGECOUNT value on done: 3740.0
[2023-02-25 13:04:47,764][2409104] Sum rewards: 7.022, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.224', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'AMMO4': '0.130', 'weapon7': '0.152', 'weapon5': '0.160', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.380', 'ARMOR': '0.400', 'HITCOUNT': '0.420', 'WEAPON3': '0.550', 'weapon2': '1.128', 'weapon3': '1.210', 'DAMAGECOUNT': '2.574', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:47,803][2409469] DAMAGECOUNT value on done: 6019.0
[2023-02-25 13:04:47,806][2409469] Sum rewards: 8.837, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'AMMO2': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.066', 'HEALTH': '0.094', 'weapon7': '0.130', 'AMMO4': '0.151', 'weapon5': '0.168', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.242', 'WEAPON3': '0.400', 'ARMOR': '0.449', 'HITCOUNT': '0.680', 'weapon2': '1.066', 'weapon3': '1.288', 'DAMAGECOUNT': '3.213', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:48,172][2409078] DAMAGECOUNT value on done: 4349.0
[2023-02-25 13:04:48,173][2409078] Sum rewards: 5.566, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.544', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'weapon5': '0.016', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.076', 'weapon4': '0.142', 'WEAPON5': '0.300', 'ARMOR': '0.473', 'WEAPON3': '0.550', 'HITCOUNT': '0.650', 'weapon3': '1.170', 'weapon2': '1.702', 'DAMAGECOUNT': '2.172', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:48,187][2409102] DAMAGECOUNT value on done: 3960.0
[2023-02-25 13:04:48,187][2409102] Sum rewards: 7.755, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.474', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.124', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'weapon4': '0.236', 'WEAPON5': '0.250', 'HITCOUNT': '0.710', 'WEAPON3': '0.800', 'ARMOR': '0.800', 'weapon3': '1.552', 'weapon2': '1.882', 'DAMAGECOUNT': '2.727', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:48,327][2409074] Updated weights for policy 0, policy_version 17011 (0.0012)
[2023-02-25 13:04:48,469][2409485] DAMAGECOUNT value on done: 3445.0
[2023-02-25 13:04:48,470][2409485] Sum rewards: 2.491, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.538', 'AMMO5': '0.021', 'AMMO2': '0.034', 'WEAPON1': '0.050', 'AMMO3': '0.110', 'AMMO4': '0.171', 'weapon5': '0.232', 'WEAPON4': '0.250', 'HITCOUNT': '0.300', 'weapon4': '0.386', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'ARMOR': '0.860', 'DAMAGECOUNT': '1.080', 'weapon2': '1.130', 'weapon3': '1.754', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:48,512][2409866] DAMAGECOUNT value on done: 3497.0
[2023-02-25 13:04:48,513][2409866] Sum rewards: 6.737, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.544', 'AMMO2': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.035', 'weapon7': '0.064', 'AMMO3': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.340', 'WEAPON3': '0.450', 'ARMOR': '0.484', 'weapon4': '0.656', 'weapon2': '0.678', 'weapon3': '1.168', 'DAMAGECOUNT': '1.596', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:48,667][2409079] DAMAGECOUNT value on done: 3489.0
[2023-02-25 13:04:48,672][2409079] Sum rewards: 9.398, reward structure: {'DEATHCOUNT': '-4.500', 'WEAPON1': '0.010', 'weapon7': '0.010', 'AMMO2': '0.015', 'AMMO5': '0.015', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.074', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.250', 'weapon5': '0.256', 'WEAPON3': '0.300', 'HEALTH': '0.300', 'weapon4': '0.328', 'HITCOUNT': '0.360', 'ARMOR': '0.800', 'weapon3': '1.218', 'weapon2': '1.874', 'DAMAGECOUNT': '2.688', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:48,760][2409486] DAMAGECOUNT value on done: 3296.0
[2023-02-25 13:04:48,761][2409486] Sum rewards: 2.582, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.245', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.050', 'AMMO3': '0.053', 'AMMO4': '0.085', 'WEAPON5': '0.150', 'weapon7': '0.216', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HITCOUNT': '0.230', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'weapon4': '0.442', 'ARMOR': '0.449', 'WEAPON3': '0.450', 'weapon3': '1.080', 'DAMAGECOUNT': '1.278', 'weapon2': '1.312', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:49,042][2409548] DAMAGECOUNT value on done: 3950.0
[2023-02-25 13:04:49,043][2409548] Sum rewards: -0.681, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.698', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'weapon5': '0.004', 'AMMO5': '0.007', 'weapon7': '0.046', 'AMMO3': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'HITCOUNT': '0.170', 'WEAPON7': '0.200', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.600', 'weapon3': '0.640', 'weapon2': '0.790', 'ARMOR': '0.914', 'FRAGCOUNT': '1.000'}
[2023-02-25 13:04:49,108][2409549] DAMAGECOUNT value on done: 5224.0
[2023-02-25 13:04:49,109][2409549] Sum rewards: 5.463, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.395', 'AMMO5': '0.011', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'weapon4': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.068', 'weapon5': '0.082', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.440', 'WEAPON3': '0.500', 'ARMOR': '0.522', 'DAMAGECOUNT': '1.410', 'weapon3': '1.518', 'weapon2': '1.612', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:49,325][2409407] DAMAGECOUNT value on done: 4596.0
[2023-02-25 13:04:49,326][2409407] Sum rewards: 8.475, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.940', 'AMMO5': '0.025', 'AMMO2': '0.031', 'weapon7': '0.046', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.105', 'AMMO4': '0.153', 'weapon4': '0.224', 'weapon5': '0.228', 'ARMOR': '0.400', 'WEAPON5': '0.550', 'HITCOUNT': '0.590', 'WEAPON3': '0.700', 'weapon2': '1.370', 'weapon3': '1.426', 'DAMAGECOUNT': '2.397', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:04:49,441][2409105] DAMAGECOUNT value on done: 4294.0
[2023-02-25 13:04:49,442][2409105] Sum rewards: 7.595, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.774', 'AMMO5': '0.015', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.082', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon5': '0.252', 'weapon4': '0.412', 'HITCOUNT': '0.580', 'WEAPON3': '0.700', 'weapon2': '0.890', 'weapon3': '1.788', 'DAMAGECOUNT': '2.601', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:04:49,811][2409075] DAMAGECOUNT value on done: 3909.0
[2023-02-25 13:04:49,812][2409075] Sum rewards: 8.892, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.418', 'AMMO2': '0.002', 'AMMO4': '0.012', 'AMMO5': '0.019', 'WEAPON1': '0.060', 'AMMO3': '0.093', 'WEAPON4': '0.150', 'weapon5': '0.168', 'weapon4': '0.274', 'WEAPON5': '0.500', 'HITCOUNT': '0.570', 'WEAPON3': '0.700', 'ARMOR': '0.924', 'weapon2': '1.516', 'weapon3': '1.726', 'DAMAGECOUNT': '2.346', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:04:50,029][2409077] DAMAGECOUNT value on done: 3966.0
[2023-02-25 13:04:50,032][2409077] Sum rewards: 10.906, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.940', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO3': '0.067', 'weapon5': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.460', 'WEAPON3': '0.500', 'HITCOUNT': '0.550', 'weapon4': '0.738', 'weapon3': '1.304', 'weapon2': '1.312', 'DAMAGECOUNT': '2.295', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:04:50,040][2409406] DAMAGECOUNT value on done: 3091.0
[2023-02-25 13:04:50,040][2409406] Sum rewards: -0.070, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.510', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.102', 'weapon5': '0.206', 'weapon4': '0.272', 'HITCOUNT': '0.290', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'ARMOR': '0.892', 'FRAGCOUNT': '1.000', 'weapon3': '1.248', 'DAMAGECOUNT': '1.350', 'weapon2': '1.574'}
[2023-02-25 13:04:50,041][2409565] DAMAGECOUNT value on done: 4020.0
[2023-02-25 13:04:50,042][2409565] Sum rewards: 5.369, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.222', 'AMMO5': '0.017', 'AMMO2': '0.024', 'WEAPON1': '0.050', 'AMMO4': '0.120', 'weapon5': '0.132', 'AMMO3': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'weapon4': '0.344', 'ARMOR': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '0.890', 'weapon2': '1.314', 'weapon3': '1.800', 'DAMAGECOUNT': '3.315', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:04:50,059][2409074] Updated weights for policy 0, policy_version 17021 (0.0012)
[2023-02-25 13:04:50,300][2409096] DAMAGECOUNT value on done: 4385.0
[2023-02-25 13:04:50,303][2409096] Sum rewards: 5.767, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.394', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.022', 'AMMO4': '0.109', 'AMMO3': '0.115', 'weapon5': '0.116', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.300', 'ARMOR': '0.412', 'HITCOUNT': '0.480', 'WEAPON3': '0.750', 'weapon3': '1.596', 'weapon2': '1.700', 'DAMAGECOUNT': '2.040', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:50,306][2409097] DAMAGECOUNT value on done: 4078.0
[2023-02-25 13:04:50,309][2409097] Sum rewards: 10.476, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'AMMO3': '0.070', 'weapon5': '0.122', 'weapon4': '0.132', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'HEALTH': '0.314', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.660', 'weapon3': '1.708', 'weapon2': '1.790', 'DAMAGECOUNT': '2.280', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:04:50,320][2409373] DAMAGECOUNT value on done: 3828.0
[2023-02-25 13:04:50,321][2409373] Sum rewards: 1.775, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.782', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'AMMO3': '0.072', 'AMMO4': '0.076', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.102', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'HITCOUNT': '0.440', 'weapon4': '0.482', 'WEAPON3': '0.550', 'ARMOR': '0.883', 'weapon3': '1.512', 'DAMAGECOUNT': '1.575', 'weapon2': '1.610', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:04:50,347][2409389] DAMAGECOUNT value on done: 3876.0
[2023-02-25 13:04:50,351][2409389] Sum rewards: 2.500, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.946', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.046', 'WEAPON1': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.080', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'HITCOUNT': '0.310', 'weapon4': '0.386', 'ARMOR': '0.458', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.185', 'weapon3': '1.414', 'weapon2': '1.986', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:50,415][2409596] DAMAGECOUNT value on done: 4723.0
[2023-02-25 13:04:50,418][2409596] Sum rewards: 6.248, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.593', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'weapon7': '0.048', 'weapon5': '0.052', 'AMMO4': '0.057', 'AMMO3': '0.067', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'HITCOUNT': '0.420', 'ARMOR': '0.521', 'weapon4': '0.534', 'weapon3': '0.804', 'weapon2': '1.020', 'DAMAGECOUNT': '1.944', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:50,653][2409355] DAMAGECOUNT value on done: 4533.0
[2023-02-25 13:04:50,654][2409355] Sum rewards: 1.119, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.513', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.067', 'weapon7': '0.094', 'AMMO4': '0.127', 'weapon5': '0.156', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.460', 'WEAPON3': '0.500', 'weapon4': '0.636', 'weapon2': '0.906', 'weapon3': '0.932', 'DAMAGECOUNT': '1.800', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:50,918][2409405] DAMAGECOUNT value on done: 4179.0
[2023-02-25 13:04:50,921][2409405] Sum rewards: 7.136, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.005', 'AMMO5': '0.005', 'HEALTH': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.022', 'weapon5': '0.054', 'AMMO3': '0.065', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.244', 'WEAPON3': '0.400', 'ARMOR': '0.500', 'HITCOUNT': '0.660', 'weapon3': '1.380', 'weapon2': '1.714', 'DAMAGECOUNT': '2.367', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:51,030][2409597] DAMAGECOUNT value on done: 4809.0
[2023-02-25 13:04:51,031][2409597] Sum rewards: 4.753, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.544', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.050', 'AMMO3': '0.060', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.270', 'WEAPON3': '0.450', 'ARMOR': '0.477', 'weapon4': '0.744', 'weapon3': '1.132', 'weapon2': '1.314', 'DAMAGECOUNT': '1.725', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:51,117][2409101] DAMAGECOUNT value on done: 4952.0
[2023-02-25 13:04:51,120][2409101] Sum rewards: 7.309, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.426', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.012', 'ARMOR': '0.012', 'AMMO3': '0.030', 'weapon5': '0.060', 'weapon7': '0.072', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.390', 'weapon4': '0.420', 'weapon3': '0.718', 'weapon2': '1.090', 'DAMAGECOUNT': '1.986', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:51,268][2409074] Updated weights for policy 0, policy_version 17031 (0.0013)
[2023-02-25 13:04:51,402][2409076] DAMAGECOUNT value on done: 4576.0
[2023-02-25 13:04:51,406][2409076] Sum rewards: 6.892, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.288', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.012', 'weapon7': '0.048', 'AMMO3': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.142', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.440', 'weapon3': '0.848', 'ARMOR': '0.898', 'weapon2': '1.536', 'DAMAGECOUNT': '2.043', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:04:51,514][2409104] DAMAGECOUNT value on done: 3916.0
[2023-02-25 13:04:51,519][2409104] Sum rewards: 11.752, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.654', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO5': '0.015', 'weapon5': '0.048', 'AMMO4': '0.074', 'AMMO3': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.122', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.360', 'ARMOR': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.800', 'weapon2': '1.010', 'weapon3': '1.620', 'DAMAGECOUNT': '2.958', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:04:51,856][2409078] DAMAGECOUNT value on done: 4143.0
[2023-02-25 13:04:51,857][2409078] Sum rewards: 1.559, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO3': '0.047', 'weapon7': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.178', 'weapon4': '0.190', 'HITCOUNT': '0.230', 'WEAPON3': '0.300', 'FRAGCOUNT': '0.500', 'ARMOR': '0.800', 'weapon3': '0.848', 'weapon2': '1.192', 'DAMAGECOUNT': '1.674'}
[2023-02-25 13:04:52,062][2409485] DAMAGECOUNT value on done: 4200.0
[2023-02-25 13:04:52,063][2409485] Sum rewards: 10.245, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.031', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO2': '0.031', 'AMMO3': '0.070', 'AMMO4': '0.156', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'weapon5': '0.406', 'WEAPON3': '0.450', 'weapon2': '0.672', 'HITCOUNT': '0.790', 'weapon4': '0.816', 'weapon3': '1.750', 'DAMAGECOUNT': '3.087', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:52,078][2409469] DAMAGECOUNT value on done: 5248.0
[2023-02-25 13:04:52,081][2409469] Sum rewards: 5.779, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.919', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.014', 'AMMO3': '0.020', 'WEAPON1': '0.020', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.198', 'WEAPON3': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.360', 'weapon3': '0.486', 'weapon4': '0.542', 'ARMOR': '0.924', 'weapon2': '1.516', 'DAMAGECOUNT': '1.611', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:52,160][2409866] DAMAGECOUNT value on done: 4247.0
[2023-02-25 13:04:52,161][2409866] Sum rewards: 5.723, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.232', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon4': '0.088', 'WEAPON4': '0.100', 'weapon5': '0.104', 'AMMO3': '0.105', 'WEAPON5': '0.300', 'ARMOR': '0.452', 'HITCOUNT': '0.460', 'WEAPON3': '0.600', 'weapon3': '1.212', 'DAMAGECOUNT': '1.833', 'weapon2': '1.838', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:52,186][2408954] Fps is (10 sec: 26214.5, 60 sec: 25600.0, 300 sec: 25617.4). Total num frames: 69775360. Throughput: 0: 6411.2. Samples: 17437536. Policy #0 lag: (min: 1.0, avg: 12.4, max: 28.0)
[2023-02-25 13:04:52,186][2408954] Avg episode reward: [(0, '6.437')]
[2023-02-25 13:04:52,350][2409102] DAMAGECOUNT value on done: 4296.0
[2023-02-25 13:04:52,351][2409102] Sum rewards: 2.857, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.476', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO3': '0.063', 'weapon7': '0.074', 'AMMO4': '0.091', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.170', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.286', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'weapon3': '0.480', 'weapon2': '1.222', 'DAMAGECOUNT': '1.758', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:52,572][2409486] DAMAGECOUNT value on done: 4076.0
[2023-02-25 13:04:52,572][2409486] Sum rewards: 4.050, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.387', 'AMMO2': '0.017', 'weapon7': '0.050', 'AMMO3': '0.076', 'AMMO4': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.370', 'WEAPON3': '0.400', 'weapon4': '0.486', 'weapon3': '0.572', 'ARMOR': '0.852', 'weapon2': '1.140', 'DAMAGECOUNT': '1.302', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:52,670][2409548] DAMAGECOUNT value on done: 3653.0
[2023-02-25 13:04:52,673][2409548] Sum rewards: 2.294, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.076', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.102', 'AMMO4': '0.118', 'weapon5': '0.166', 'WEAPON4': '0.200', 'HITCOUNT': '0.340', 'WEAPON5': '0.350', 'weapon4': '0.428', 'WEAPON3': '0.550', 'ARMOR': '0.949', 'weapon3': '1.166', 'DAMAGECOUNT': '1.581', 'weapon2': '1.726', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:04:52,750][2409549] DAMAGECOUNT value on done: 3863.0
[2023-02-25 13:04:52,753][2409549] Sum rewards: 0.882, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.422', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'ARMOR': '0.032', 'weapon7': '0.050', 'AMMO3': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.140', 'weapon5': '0.144', 'HITCOUNT': '0.180', 'WEAPON5': '0.300', 'weapon4': '0.306', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.510', 'weapon2': '0.870', 'FRAGCOUNT': '1.000', 'weapon3': '1.296'}
[2023-02-25 13:04:52,879][2409079] DAMAGECOUNT value on done: 4517.0
[2023-02-25 13:04:52,883][2409079] Sum rewards: 1.174, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.101', 'AMMO2': '0.017', 'AMMO5': '0.017', 'weapon7': '0.038', 'AMMO4': '0.084', 'AMMO3': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.232', 'WEAPON4': '0.300', 'weapon4': '0.394', 'HITCOUNT': '0.460', 'WEAPON5': '0.500', 'ARMOR': '0.529', 'WEAPON3': '0.700', 'weapon3': '1.470', 'weapon2': '1.492', 'DAMAGECOUNT': '2.391', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:53,298][2409074] Updated weights for policy 0, policy_version 17041 (0.0012)
[2023-02-25 13:04:53,308][2409105] DAMAGECOUNT value on done: 3357.0
[2023-02-25 13:04:53,309][2409105] Sum rewards: 6.030, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.491', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.027', 'WEAPON1': '0.030', 'weapon7': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'weapon5': '0.156', 'weapon4': '0.288', 'HITCOUNT': '0.470', 'WEAPON5': '0.650', 'ARMOR': '0.800', 'WEAPON3': '0.850', 'weapon2': '1.206', 'weapon3': '1.794', 'DAMAGECOUNT': '1.899', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:53,478][2409407] DAMAGECOUNT value on done: 4036.0
[2023-02-25 13:04:53,481][2409407] Sum rewards: 3.576, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.068', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'weapon5': '0.078', 'AMMO4': '0.086', 'AMMO3': '0.088', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.376', 'ARMOR': '0.513', 'WEAPON3': '0.600', 'HITCOUNT': '0.670', 'weapon2': '1.252', 'weapon3': '1.348', 'DAMAGECOUNT': '2.220', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:53,668][2409075] DAMAGECOUNT value on done: 4070.0
[2023-02-25 13:04:53,669][2409075] Sum rewards: 2.607, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.540', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO3': '0.027', 'ARMOR': '0.036', 'weapon7': '0.146', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'WEAPON3': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon3': '0.302', 'weapon4': '0.388', 'WEAPON7': '0.400', 'DAMAGECOUNT': '0.648', 'weapon2': '0.660', 'FRAGCOUNT': '1.000'}
[2023-02-25 13:04:53,702][2409077] DAMAGECOUNT value on done: 6027.0
[2023-02-25 13:04:53,703][2409077] Sum rewards: 5.761, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.783', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.059', 'weapon7': '0.060', 'weapon5': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.262', 'HITCOUNT': '0.420', 'WEAPON3': '0.450', 'ARMOR': '0.456', 'weapon3': '0.792', 'weapon2': '1.598', 'DAMAGECOUNT': '2.517', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:53,725][2409406] DAMAGECOUNT value on done: 4200.0
[2023-02-25 13:04:53,726][2409406] Sum rewards: 7.591, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.011', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.055', 'AMMO3': '0.056', 'weapon5': '0.260', 'HITCOUNT': '0.350', 'WEAPON3': '0.350', 'HEALTH': '0.366', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'weapon3': '1.144', 'weapon2': '1.428', 'DAMAGECOUNT': '1.971', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:04:54,154][2409097] DAMAGECOUNT value on done: 3333.0
[2023-02-25 13:04:54,155][2409097] Sum rewards: 2.085, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.394', 'AMMO2': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.037', 'weapon5': '0.088', 'AMMO3': '0.090', 'weapon4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'HITCOUNT': '0.360', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.503', 'weapon2': '1.582', 'weapon3': '1.944', 'FRAGCOUNT': '2.500'}
[2023-02-25 13:04:54,169][2409373] DAMAGECOUNT value on done: 3894.0
[2023-02-25 13:04:54,170][2409373] Sum rewards: 2.066, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.838', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.060', 'AMMO3': '0.087', 'weapon7': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.420', 'weapon4': '0.494', 'WEAPON3': '0.650', 'ARMOR': '0.876', 'weapon2': '1.016', 'weapon3': '1.214', 'DAMAGECOUNT': '1.392', 'FRAGCOUNT': '2.500'}
[2023-02-25 13:04:54,184][2409389] DAMAGECOUNT value on done: 5778.0
[2023-02-25 13:04:54,184][2409389] Sum rewards: 8.426, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.162', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.061', 'weapon4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'weapon5': '0.188', 'WEAPON5': '0.250', 'HITCOUNT': '0.680', 'WEAPON3': '0.800', 'ARMOR': '0.907', 'weapon2': '1.474', 'weapon3': '1.840', 'DAMAGECOUNT': '3.561', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:54,215][2409096] DAMAGECOUNT value on done: 5007.0
[2023-02-25 13:04:54,227][2409096] Sum rewards: 10.112, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.510', 'weapon5': '0.014', 'AMMO5': '0.018', 'AMMO2': '0.023', 'weapon7': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.350', 'weapon4': '0.354', 'HITCOUNT': '0.710', 'ARMOR': '0.849', 'WEAPON3': '0.850', 'weapon2': '1.138', 'weapon3': '1.884', 'DAMAGECOUNT': '3.168', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:04:54,263][2409565] DAMAGECOUNT value on done: 4758.0
[2023-02-25 13:04:54,264][2409565] Sum rewards: 17.248, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.808', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO4': '0.027', 'AMMO3': '0.126', 'WEAPON4': '0.200', 'weapon5': '0.224', 'weapon4': '0.284', 'ARMOR': '0.461', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'HITCOUNT': '0.950', 'weapon2': '1.110', 'weapon3': '2.084', 'DAMAGECOUNT': '4.494', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:04:54,303][2409596] DAMAGECOUNT value on done: 3528.0
[2023-02-25 13:04:54,304][2409596] Sum rewards: 6.650, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.520', 'AMMO2': '0.014', 'AMMO5': '0.014', 'AMMO4': '0.069', 'weapon5': '0.134', 'AMMO3': '0.135', 'weapon4': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.350', 'HITCOUNT': '0.420', 'ARMOR': '0.453', 'WEAPON3': '0.750', 'weapon3': '1.428', 'weapon2': '1.716', 'DAMAGECOUNT': '1.896', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:04:54,387][2409355] DAMAGECOUNT value on done: 4584.0
[2023-02-25 13:04:54,390][2409355] Sum rewards: 7.075, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.357', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.015', 'weapon5': '0.024', 'weapon7': '0.048', 'AMMO4': '0.057', 'AMMO3': '0.091', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.204', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.580', 'WEAPON3': '0.650', 'weapon2': '1.520', 'weapon3': '1.822', 'DAMAGECOUNT': '2.610', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:54,490][2409405] DAMAGECOUNT value on done: 3878.0
[2023-02-25 13:04:54,493][2409405] Sum rewards: 5.494, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.044', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.051', 'AMMO3': '0.098', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.478', 'WEAPON3': '0.550', 'HITCOUNT': '0.580', 'ARMOR': '0.812', 'weapon2': '1.402', 'weapon3': '1.422', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:54,666][2409101] DAMAGECOUNT value on done: 5224.0
[2023-02-25 13:04:54,669][2409101] Sum rewards: 5.176, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.770', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.059', 'weapon5': '0.110', 'weapon7': '0.168', 'WEAPON4': '0.250', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'ARMOR': '0.456', 'HITCOUNT': '0.490', 'WEAPON7': '0.500', 'weapon4': '0.710', 'weapon3': '0.870', 'weapon2': '1.124', 'DAMAGECOUNT': '2.697', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:54,864][2409074] Updated weights for policy 0, policy_version 17051 (0.0012)
[2023-02-25 13:04:55,198][2409076] DAMAGECOUNT value on done: 4829.0
[2023-02-25 13:04:55,199][2409076] Sum rewards: 7.693, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.318', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.082', 'AMMO3': '0.095', 'weapon5': '0.202', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.540', 'WEAPON3': '0.650', 'weapon3': '1.686', 'weapon2': '1.694', 'DAMAGECOUNT': '2.250', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:55,258][2409597] DAMAGECOUNT value on done: 3996.0
[2023-02-25 13:04:55,268][2409597] Sum rewards: 5.442, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon5': '0.026', 'HEALTH': '0.050', 'AMMO3': '0.067', 'weapon7': '0.096', 'AMMO4': '0.126', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.410', 'ARMOR': '0.435', 'weapon2': '0.524', 'weapon4': '0.740', 'weapon3': '1.100', 'DAMAGECOUNT': '1.530', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:55,356][2409104] DAMAGECOUNT value on done: 3366.0
[2023-02-25 13:04:55,359][2409104] Sum rewards: 1.326, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.550', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO3': '0.030', 'WEAPON1': '0.030', 'weapon7': '0.050', 'AMMO4': '0.098', 'weapon5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON3': '0.200', 'HITCOUNT': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.358', 'ARMOR': '0.454', 'DAMAGECOUNT': '0.531', 'weapon3': '0.768', 'FRAGCOUNT': '1.000', 'weapon2': '1.642'}
[2023-02-25 13:04:55,419][2409078] DAMAGECOUNT value on done: 3756.0
[2023-02-25 13:04:55,420][2409078] Sum rewards: 8.341, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.450', 'AMMO2': '0.007', 'AMMO5': '0.012', 'AMMO3': '0.030', 'AMMO4': '0.033', 'weapon7': '0.048', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.170', 'WEAPON3': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.380', 'weapon3': '0.770', 'ARMOR': '1.237', 'DAMAGECOUNT': '1.779', 'weapon2': '1.884', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:55,636][2409485] DAMAGECOUNT value on done: 4156.0
[2023-02-25 13:04:55,637][2409485] Sum rewards: 2.000, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.625', 'AMMO2': '0.015', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO3': '0.068', 'AMMO4': '0.075', 'weapon4': '0.078', 'WEAPON4': '0.200', 'weapon5': '0.230', 'HITCOUNT': '0.380', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'ARMOR': '0.478', 'weapon3': '1.284', 'DAMAGECOUNT': '1.812', 'weapon2': '1.904', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:04:55,881][2409866] DAMAGECOUNT value on done: 4242.0
[2023-02-25 13:04:55,884][2409866] Sum rewards: 9.698, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.650', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.012', 'AMMO3': '0.043', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'weapon5': '0.182', 'weapon4': '0.222', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'HITCOUNT': '0.490', 'weapon3': '1.004', 'weapon2': '1.356', 'DAMAGECOUNT': '2.427', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:55,926][2409469] DAMAGECOUNT value on done: 4579.0
[2023-02-25 13:04:55,929][2409469] Sum rewards: 2.419, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.360', 'AMMO2': '0.005', 'AMMO4': '0.023', 'AMMO3': '0.030', 'WEAPON4': '0.050', 'weapon7': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.190', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.340', 'ARMOR': '0.400', 'weapon3': '0.552', 'weapon2': '0.634', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.047'}
[2023-02-25 13:04:56,081][2409102] DAMAGECOUNT value on done: 4424.0
[2023-02-25 13:04:56,082][2409102] Sum rewards: 4.666, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.816', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.074', 'weapon7': '0.076', 'AMMO3': '0.082', 'weapon5': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.350', 'weapon4': '0.448', 'ARMOR': '0.499', 'WEAPON3': '0.500', 'weapon3': '1.136', 'weapon2': '1.264', 'DAMAGECOUNT': '1.281', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:56,202][2409074] Updated weights for policy 0, policy_version 17061 (0.0012)
[2023-02-25 13:04:56,250][2409548] DAMAGECOUNT value on done: 5381.0
[2023-02-25 13:04:56,253][2409548] Sum rewards: 3.190, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.180', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO3': '0.079', 'AMMO4': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.300', 'ARMOR': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.640', 'weapon4': '0.698', 'weapon2': '0.888', 'weapon3': '1.284', 'DAMAGECOUNT': '2.781', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:56,375][2409486] DAMAGECOUNT value on done: 4623.0
[2023-02-25 13:04:56,376][2409486] Sum rewards: 6.454, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.010', 'AMMO2': '0.011', 'AMMO5': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'WEAPON1': '0.070', 'AMMO3': '0.080', 'weapon4': '0.142', 'weapon5': '0.224', 'WEAPON5': '0.450', 'HITCOUNT': '0.490', 'WEAPON3': '0.550', 'ARMOR': '0.800', 'weapon2': '1.408', 'weapon3': '1.608', 'DAMAGECOUNT': '2.010', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:04:56,461][2409079] DAMAGECOUNT value on done: 4636.0
[2023-02-25 13:04:56,463][2409079] Sum rewards: 5.412, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.744', 'AMMO5': '0.014', 'AMMO2': '0.035', 'AMMO3': '0.094', 'weapon5': '0.164', 'AMMO4': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'HITCOUNT': '0.450', 'ARMOR': '0.483', 'weapon4': '0.580', 'weapon2': '0.622', 'WEAPON3': '0.650', 'weapon3': '1.680', 'DAMAGECOUNT': '1.911', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:56,796][2409099] DAMAGECOUNT value on done: 4687.0
[2023-02-25 13:04:56,797][2409099] Sum rewards: 10.512, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.177', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon7': '0.052', 'AMMO4': '0.073', 'AMMO3': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.164', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.316', 'WEAPON3': '0.650', 'HITCOUNT': '0.840', 'ARMOR': '1.352', 'weapon2': '1.422', 'weapon3': '1.646', 'DAMAGECOUNT': '3.612', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:04:57,026][2409407] DAMAGECOUNT value on done: 3991.0
[2023-02-25 13:04:57,029][2409407] Sum rewards: 5.775, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.812', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO2': '0.043', 'AMMO3': '0.060', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.160', 'WEAPON5': '0.200', 'AMMO4': '0.214', 'WEAPON4': '0.250', 'ARMOR': '0.432', 'WEAPON3': '0.500', 'weapon4': '0.632', 'HITCOUNT': '0.730', 'weapon2': '1.168', 'weapon3': '1.486', 'DAMAGECOUNT': '2.124', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:57,186][2408954] Fps is (10 sec: 26624.0, 60 sec: 25736.6, 300 sec: 25603.5). Total num frames: 69906432. Throughput: 0: 6423.7. Samples: 17476272. Policy #0 lag: (min: 1.0, avg: 12.4, max: 28.0)
[2023-02-25 13:04:57,186][2408954] Avg episode reward: [(0, '6.249')]
[2023-02-25 13:04:57,260][2409077] DAMAGECOUNT value on done: 4704.0
[2023-02-25 13:04:57,263][2409077] Sum rewards: 10.103, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.626', 'AMMO5': '0.015', 'AMMO2': '0.020', 'WEAPON1': '0.050', 'AMMO4': '0.099', 'AMMO3': '0.103', 'weapon5': '0.124', 'weapon7': '0.148', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.360', 'WEAPON5': '0.400', 'HITCOUNT': '0.740', 'WEAPON3': '0.800', 'weapon2': '0.832', 'ARMOR': '0.900', 'weapon3': '2.080', 'DAMAGECOUNT': '3.918', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:04:57,286][2409406] DAMAGECOUNT value on done: 4934.0
[2023-02-25 13:04:57,287][2409406] Sum rewards: 8.186, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.772', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.154', 'weapon4': '0.272', 'WEAPON5': '0.300', 'HITCOUNT': '0.530', 'WEAPON3': '0.600', 'weapon2': '1.182', 'weapon3': '1.392', 'DAMAGECOUNT': '2.940', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:57,373][2409075] DAMAGECOUNT value on done: 4141.0
[2023-02-25 13:04:57,376][2409075] Sum rewards: 8.801, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.144', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO3': '0.079', 'AMMO4': '0.137', 'weapon5': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'HITCOUNT': '0.470', 'weapon4': '0.492', 'WEAPON3': '0.500', 'ARMOR': '1.268', 'weapon2': '1.298', 'weapon3': '1.404', 'DAMAGECOUNT': '2.190', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:57,608][2409105] DAMAGECOUNT value on done: 4478.0
[2023-02-25 13:04:57,609][2409105] Sum rewards: 3.215, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.640', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'AMMO4': '0.042', 'weapon5': '0.056', 'weapon7': '0.074', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.232', 'WEAPON5': '0.500', 'HITCOUNT': '0.570', 'WEAPON3': '0.700', 'ARMOR': '0.908', 'weapon2': '1.144', 'weapon3': '1.270', 'DAMAGECOUNT': '1.926', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:04:57,817][2409565] DAMAGECOUNT value on done: 5661.0
[2023-02-25 13:04:57,822][2409565] Sum rewards: 10.420, reward structure: {'DEATHCOUNT': '-5.250', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO3': '0.070', 'AMMO4': '0.090', 'weapon7': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.158', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.288', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HEALTH': '0.460', 'HITCOUNT': '0.560', 'weapon2': '1.554', 'weapon3': '1.578', 'DAMAGECOUNT': '3.087', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:57,829][2409373] DAMAGECOUNT value on done: 4817.0
[2023-02-25 13:04:57,830][2409373] Sum rewards: 6.408, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.482', 'AMMO2': '0.005', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.024', 'AMMO3': '0.040', 'weapon7': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.160', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.280', 'weapon4': '0.508', 'weapon2': '0.616', 'weapon3': '0.644', 'DAMAGECOUNT': '1.461', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:57,884][2409389] DAMAGECOUNT value on done: 3227.0
[2023-02-25 13:04:57,885][2409389] Sum rewards: 4.062, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.840', 'AMMO5': '0.008', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'weapon5': '0.032', 'AMMO3': '0.093', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.372', 'ARMOR': '0.400', 'HITCOUNT': '0.520', 'WEAPON3': '0.550', 'weapon3': '1.320', 'weapon2': '1.422', 'DAMAGECOUNT': '1.866', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:57,902][2409074] Updated weights for policy 0, policy_version 17071 (0.0012)
[2023-02-25 13:04:57,998][2409596] DAMAGECOUNT value on done: 3716.0
[2023-02-25 13:04:57,998][2409596] Sum rewards: 2.625, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.510', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.026', 'weapon5': '0.072', 'AMMO3': '0.088', 'AMMO4': '0.130', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'HITCOUNT': '0.430', 'weapon4': '0.430', 'WEAPON3': '0.500', 'ARMOR': '0.800', 'weapon3': '1.038', 'weapon2': '1.644', 'DAMAGECOUNT': '1.746', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:04:58,049][2409096] DAMAGECOUNT value on done: 4690.0
[2023-02-25 13:04:58,052][2409096] Sum rewards: 6.129, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.664', 'AMMO2': '0.009', 'AMMO5': '0.026', 'WEAPON1': '0.030', 'AMMO4': '0.043', 'weapon7': '0.060', 'AMMO3': '0.109', 'weapon5': '0.166', 'WEAPON4': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'HITCOUNT': '0.400', 'WEAPON7': '0.400', 'weapon4': '0.496', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'ARMOR': '0.823', 'weapon2': '0.974', 'weapon3': '1.588', 'DAMAGECOUNT': '1.779', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:04:58,088][2409355] DAMAGECOUNT value on done: 4666.0
[2023-02-25 13:04:58,091][2409355] Sum rewards: 2.687, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.430', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'weapon7': '0.054', 'weapon5': '0.070', 'AMMO3': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.360', 'HITCOUNT': '0.410', 'WEAPON3': '0.550', 'ARMOR': '1.300', 'weapon3': '1.356', 'weapon2': '1.546', 'DAMAGECOUNT': '1.665', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:04:58,344][2409101] DAMAGECOUNT value on done: 3776.0
[2023-02-25 13:04:58,348][2409101] Sum rewards: 8.770, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.036', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.076', 'weapon5': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'HEALTH': '0.166', 'weapon4': '0.234', 'WEAPON3': '0.300', 'ARMOR': '0.498', 'HITCOUNT': '0.550', 'weapon3': '1.060', 'weapon2': '1.668', 'DAMAGECOUNT': '2.769', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:04:58,570][2409097] DAMAGECOUNT value on done: 3702.0
[2023-02-25 13:04:58,570][2409097] Sum rewards: 4.306, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.015', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'AMMO3': '0.062', 'weapon7': '0.120', 'AMMO4': '0.137', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.226', 'WEAPON5': '0.350', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'weapon4': '0.608', 'weapon2': '0.716', 'weapon3': '1.424', 'DAMAGECOUNT': '1.851', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:58,888][2409076] DAMAGECOUNT value on done: 4142.0
[2023-02-25 13:04:58,891][2409076] Sum rewards: 3.908, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.266', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO3': '0.066', 'weapon7': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon5': '0.168', 'AMMO4': '0.191', 'WEAPON7': '0.200', 'WEAPON3': '0.450', 'HITCOUNT': '0.510', 'WEAPON4': '0.650', 'ARMOR': '0.816', 'weapon4': '0.862', 'weapon3': '0.866', 'weapon2': '0.980', 'DAMAGECOUNT': '2.403', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:59,057][2409405] DAMAGECOUNT value on done: 4546.0
[2023-02-25 13:04:59,059][2409405] Sum rewards: 8.257, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.003', 'HEALTH': '0.015', 'AMMO2': '0.019', 'AMMO3': '0.040', 'weapon5': '0.054', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon7': '0.110', 'WEAPON3': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.278', 'WEAPON7': '0.300', 'HITCOUNT': '0.430', 'weapon3': '0.734', 'weapon2': '1.434', 'DAMAGECOUNT': '1.905', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:59,070][2409104] DAMAGECOUNT value on done: 3799.0
[2023-02-25 13:04:59,071][2409104] Sum rewards: 5.014, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.526', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.032', 'weapon7': '0.050', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.142', 'WEAPON7': '0.200', 'weapon4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.550', 'weapon2': '0.674', 'weapon3': '1.458', 'DAMAGECOUNT': '2.178', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:04:59,223][2409485] DAMAGECOUNT value on done: 3829.0
[2023-02-25 13:04:59,224][2409485] Sum rewards: 2.469, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.070', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.004', 'AMMO3': '0.010', 'WEAPON1': '0.020', 'weapon5': '0.046', 'HITCOUNT': '0.050', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON3': '0.100', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.150', 'weapon3': '0.244', 'ARMOR': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.060'}
[2023-02-25 13:04:59,234][2409597] DAMAGECOUNT value on done: 2742.0
[2023-02-25 13:04:59,235][2409597] Sum rewards: 1.767, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.756', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'AMMO2': '0.048', 'AMMO3': '0.050', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO4': '0.238', 'WEAPON3': '0.350', 'HITCOUNT': '0.430', 'ARMOR': '0.482', 'WEAPON4': '0.500', 'weapon4': '0.752', 'weapon3': '1.332', 'DAMAGECOUNT': '1.386', 'weapon2': '1.412', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:04:59,509][2409074] Updated weights for policy 0, policy_version 17081 (0.0013)
[2023-02-25 13:04:59,687][2409469] DAMAGECOUNT value on done: 3188.0
[2023-02-25 13:04:59,690][2409469] Sum rewards: 7.027, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.122', 'AMMO2': '0.010', 'AMMO5': '0.022', 'weapon4': '0.026', 'WEAPON4': '0.050', 'AMMO4': '0.050', 'AMMO3': '0.089', 'weapon5': '0.152', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'HITCOUNT': '0.450', 'WEAPON3': '0.600', 'weapon3': '1.650', 'weapon2': '1.982', 'DAMAGECOUNT': '2.217', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:04:59,858][2409548] DAMAGECOUNT value on done: 4474.0
[2023-02-25 13:04:59,862][2409548] Sum rewards: 3.449, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.056', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO3': '0.040', 'AMMO4': '0.095', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon7': '0.202', 'WEAPON3': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'HITCOUNT': '0.440', 'weapon4': '0.650', 'ARMOR': '0.856', 'weapon3': '0.960', 'DAMAGECOUNT': '1.617', 'weapon2': '1.728', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:04:59,922][2409866] DAMAGECOUNT value on done: 5179.0
[2023-02-25 13:04:59,923][2409866] Sum rewards: 4.501, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.807', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO3': '0.062', 'weapon7': '0.062', 'weapon5': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.340', 'ARMOR': '0.400', 'weapon4': '0.496', 'WEAPON3': '0.500', 'weapon2': '1.334', 'weapon3': '1.500', 'DAMAGECOUNT': '1.854', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:05:00,089][2409079] DAMAGECOUNT value on done: 4240.0
[2023-02-25 13:05:00,090][2409079] Sum rewards: 0.627, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.774', 'AMMO5': '0.014', 'AMMO2': '0.025', 'AMMO3': '0.078', 'AMMO4': '0.125', 'weapon5': '0.164', 'weapon7': '0.224', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON5': '0.400', 'HITCOUNT': '0.450', 'WEAPON3': '0.450', 'WEAPON4': '0.500', 'WEAPON7': '0.500', 'weapon4': '0.702', 'weapon3': '0.782', 'ARMOR': '0.857', 'weapon2': '1.492', 'DAMAGECOUNT': '2.208', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:05:00,254][2409078] DAMAGECOUNT value on done: 4059.0
[2023-02-25 13:05:00,257][2409078] Sum rewards: 2.920, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.634', 'AMMO2': '0.008', 'AMMO5': '0.025', 'weapon4': '0.026', 'AMMO4': '0.042', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'weapon5': '0.138', 'HITCOUNT': '0.380', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.275', 'weapon2': '1.300', 'weapon3': '1.438', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:00,344][2409486] DAMAGECOUNT value on done: 5071.0
[2023-02-25 13:05:00,345][2409486] Sum rewards: 11.411, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.669', 'AMMO5': '0.009', 'AMMO2': '0.019', 'AMMO3': '0.057', 'weapon5': '0.070', 'AMMO4': '0.095', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'weapon4': '0.502', 'HITCOUNT': '0.660', 'ARMOR': '0.856', 'weapon3': '0.876', 'weapon2': '1.170', 'DAMAGECOUNT': '2.415', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:05:00,598][2409407] DAMAGECOUNT value on done: 3534.0
[2023-02-25 13:05:00,603][2409407] Sum rewards: 1.995, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.862', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO3': '0.069', 'weapon5': '0.088', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.260', 'weapon4': '0.260', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.182', 'weapon3': '1.294', 'ARMOR': '1.348', 'weapon2': '1.502', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:05:00,809][2409099] DAMAGECOUNT value on done: 4330.0
[2023-02-25 13:05:00,811][2409099] Sum rewards: 3.665, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.600', 'AMMO5': '0.014', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'weapon5': '0.070', 'weapon7': '0.074', 'AMMO3': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.158', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.500', 'HITCOUNT': '0.520', 'weapon4': '0.732', 'weapon2': '1.272', 'weapon3': '1.304', 'DAMAGECOUNT': '2.139', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:05:00,830][2409077] DAMAGECOUNT value on done: 4193.0
[2023-02-25 13:05:00,833][2409077] Sum rewards: 4.628, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.380', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.090', 'AMMO3': '0.102', 'AMMO4': '0.105', 'weapon5': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.550', 'HITCOUNT': '0.690', 'ARMOR': '0.853', 'weapon2': '1.488', 'weapon3': '2.038', 'DAMAGECOUNT': '2.550', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:00,872][2409074] Updated weights for policy 0, policy_version 17091 (0.0012)
[2023-02-25 13:05:00,876][2409406] DAMAGECOUNT value on done: 3274.0
[2023-02-25 13:05:00,877][2409406] Sum rewards: 8.530, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.232', 'AMMO2': '0.011', 'AMMO3': '0.045', 'AMMO4': '0.057', 'WEAPON4': '0.150', 'weapon7': '0.162', 'AMMO6': '0.320', 'AMMO7': '0.320', 'HITCOUNT': '0.330', 'WEAPON3': '0.350', 'WEAPON7': '0.400', 'weapon4': '0.470', 'ARMOR': '0.865', 'weapon3': '0.916', 'weapon2': '0.968', 'DAMAGECOUNT': '1.398', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:01,149][2409075] DAMAGECOUNT value on done: 4419.0
[2023-02-25 13:05:01,150][2409075] Sum rewards: 5.379, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.896', 'AMMO5': '0.006', 'AMMO2': '0.013', 'AMMO4': '0.063', 'AMMO3': '0.074', 'weapon7': '0.086', 'weapon5': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.455', 'HITCOUNT': '0.510', 'WEAPON3': '0.600', 'weapon2': '1.580', 'weapon3': '1.612', 'DAMAGECOUNT': '2.532', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:05:01,558][2409105] DAMAGECOUNT value on done: 4551.0
[2023-02-25 13:05:01,559][2409105] Sum rewards: 2.563, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.500', 'AMMO5': '0.017', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'weapon5': '0.082', 'AMMO3': '0.083', 'AMMO4': '0.108', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'HITCOUNT': '0.530', 'WEAPON3': '0.550', 'ARMOR': '0.863', 'weapon4': '0.934', 'weapon3': '1.178', 'weapon2': '1.252', 'DAMAGECOUNT': '2.004', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:05:01,582][2409373] DAMAGECOUNT value on done: 5553.0
[2023-02-25 13:05:01,583][2409373] Sum rewards: 10.931, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'weapon7': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.154', 'HEALTH': '0.170', 'weapon4': '0.232', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'HITCOUNT': '0.620', 'ARMOR': '0.900', 'weapon2': '1.242', 'weapon3': '1.524', 'DAMAGECOUNT': '2.802', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:05:01,646][2409565] DAMAGECOUNT value on done: 3830.0
[2023-02-25 13:05:01,647][2409565] Sum rewards: 9.550, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.805', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO3': '0.061', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.364', 'WEAPON3': '0.450', 'ARMOR': '0.487', 'HITCOUNT': '0.630', 'weapon3': '0.968', 'weapon2': '1.290', 'DAMAGECOUNT': '2.493', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:01,716][2409596] DAMAGECOUNT value on done: 4396.0
[2023-02-25 13:05:01,720][2409596] Sum rewards: 3.933, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.348', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO3': '0.070', 'AMMO4': '0.071', 'weapon5': '0.186', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'ARMOR': '0.408', 'HITCOUNT': '0.450', 'weapon4': '0.672', 'weapon3': '1.224', 'weapon2': '1.286', 'DAMAGECOUNT': '1.890', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:05:01,820][2409389] DAMAGECOUNT value on done: 4144.0
[2023-02-25 13:05:01,825][2409389] Sum rewards: 0.908, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.362', 'AMMO2': '0.011', 'AMMO5': '0.019', 'WEAPON1': '0.030', 'AMMO4': '0.056', 'AMMO3': '0.080', 'WEAPON4': '0.150', 'weapon5': '0.170', 'weapon4': '0.204', 'HITCOUNT': '0.390', 'WEAPON5': '0.400', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.550', 'ARMOR': '0.800', 'DAMAGECOUNT': '1.290', 'weapon3': '1.414', 'weapon2': '1.956'}
[2023-02-25 13:05:02,142][2409355] DAMAGECOUNT value on done: 4739.0
[2023-02-25 13:05:02,143][2409355] Sum rewards: 12.320, reward structure: {'DEATHCOUNT': '-6.750', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.012', 'HEALTH': '0.026', 'weapon7': '0.058', 'AMMO4': '0.061', 'weapon5': '0.064', 'AMMO3': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.324', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.890', 'weapon2': '1.172', 'weapon3': '1.540', 'DAMAGECOUNT': '3.018', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:05:02,190][2408954] Fps is (10 sec: 24565.1, 60 sec: 25529.8, 300 sec: 25589.2). Total num frames: 70021120. Throughput: 0: 6416.4. Samples: 17514816. Policy #0 lag: (min: 0.0, avg: 12.2, max: 25.0)
[2023-02-25 13:05:02,191][2408954] Avg episode reward: [(0, '5.645')]
[2023-02-25 13:05:02,217][2409101] DAMAGECOUNT value on done: 5152.0
[2023-02-25 13:05:02,220][2409101] Sum rewards: 4.466, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.185', 'AMMO5': '0.017', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'weapon7': '0.060', 'AMMO3': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.103', 'weapon5': '0.204', 'WEAPON4': '0.300', 'weapon4': '0.316', 'HITCOUNT': '0.450', 'ARMOR': '0.473', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'weapon2': '1.176', 'weapon3': '1.582', 'DAMAGECOUNT': '2.829', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:02,286][2409096] DAMAGECOUNT value on done: 4143.0
[2023-02-25 13:05:02,286][2409096] Sum rewards: 5.553, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.992', 'AMMO4': '-0.066', 'AMMO2': '-0.013', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO3': '0.070', 'weapon5': '0.172', 'WEAPON5': '0.300', 'HITCOUNT': '0.360', 'WEAPON3': '0.550', 'weapon3': '1.260', 'weapon2': '1.790', 'DAMAGECOUNT': '1.815', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:05:02,380][2409097] DAMAGECOUNT value on done: 3986.0
[2023-02-25 13:05:02,382][2409097] Sum rewards: 7.002, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '0.001', 'AMMO5': '0.012', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'AMMO3': '0.084', 'AMMO4': '0.097', 'weapon5': '0.142', 'WEAPON4': '0.150', 'weapon4': '0.180', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'HITCOUNT': '0.740', 'weapon2': '1.450', 'weapon3': '1.864', 'DAMAGECOUNT': '2.991', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:05:02,793][2409076] DAMAGECOUNT value on done: 2939.0
[2023-02-25 13:05:02,794][2409076] Sum rewards: 5.137, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.416', 'AMMO2': '0.005', 'AMMO5': '0.017', 'AMMO4': '0.026', 'WEAPON1': '0.040', 'AMMO3': '0.093', 'weapon5': '0.096', 'WEAPON5': '0.350', 'HITCOUNT': '0.430', 'WEAPON3': '0.650', 'ARMOR': '1.255', 'DAMAGECOUNT': '1.428', 'weapon2': '1.678', 'weapon3': '1.984', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:02,804][2409104] DAMAGECOUNT value on done: 4409.0
[2023-02-25 13:05:02,806][2409074] Updated weights for policy 0, policy_version 17101 (0.0012)
[2023-02-25 13:05:02,805][2409104] Sum rewards: 2.384, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.260', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.024', 'weapon7': '0.052', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.174', 'WEAPON7': '0.200', 'HITCOUNT': '0.250', 'WEAPON3': '0.450', 'WEAPON5': '0.450', 'ARMOR': '0.905', 'DAMAGECOUNT': '1.005', 'weapon3': '1.146', 'weapon2': '1.524', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:05:03,153][2409597] DAMAGECOUNT value on done: 4096.0
[2023-02-25 13:05:03,157][2409597] Sum rewards: 5.140, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.753', 'AMMO5': '0.006', 'WEAPON1': '0.030', 'AMMO2': '0.037', 'AMMO3': '0.043', 'weapon5': '0.074', 'weapon7': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.183', 'WEAPON7': '0.200', 'weapon4': '0.334', 'WEAPON3': '0.350', 'WEAPON4': '0.500', 'HITCOUNT': '0.520', 'weapon3': '0.942', 'ARMOR': '0.959', 'weapon2': '2.230', 'DAMAGECOUNT': '2.511', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:03,292][2409485] DAMAGECOUNT value on done: 5648.0
[2023-02-25 13:05:03,294][2409485] Sum rewards: 15.000, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.330', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.032', 'WEAPON1': '0.040', 'AMMO3': '0.107', 'weapon5': '0.214', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.790', 'ARMOR': '0.957', 'weapon3': '1.668', 'weapon2': '1.804', 'DAMAGECOUNT': '4.497', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:05:03,301][2409547] DAMAGECOUNT value on done: 3089.0
[2023-02-25 13:05:03,304][2409547] Sum rewards: 1.070, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.732', 'AMMO2': '0.007', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.034', 'weapon7': '0.050', 'AMMO3': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.258', 'HITCOUNT': '0.270', 'ARMOR': '0.442', 'WEAPON3': '0.550', 'weapon2': '0.590', 'DAMAGECOUNT': '0.945', 'weapon3': '0.974', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:05:03,307][2409405] DAMAGECOUNT value on done: 4194.0
[2023-02-25 13:05:03,310][2409405] Sum rewards: 5.574, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'weapon7': '0.054', 'AMMO3': '0.055', 'AMMO4': '0.061', 'weapon5': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HEALTH': '0.140', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.256', 'HITCOUNT': '0.380', 'WEAPON3': '0.400', 'weapon3': '0.920', 'ARMOR': '1.251', 'weapon2': '1.358', 'DAMAGECOUNT': '1.881', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:05:03,464][2409548] DAMAGECOUNT value on done: 3880.0
[2023-02-25 13:05:03,464][2409548] Sum rewards: -0.767, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.551', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'weapon5': '0.046', 'AMMO4': '0.072', 'AMMO3': '0.075', 'WEAPON5': '0.150', 'HITCOUNT': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.574', 'weapon3': '0.904', 'DAMAGECOUNT': '0.972', 'ARMOR': '0.983', 'FRAGCOUNT': '1.000', 'weapon2': '1.458'}
[2023-02-25 13:05:03,632][2409866] DAMAGECOUNT value on done: 4886.0
[2023-02-25 13:05:03,635][2409866] Sum rewards: 7.366, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.696', 'AMMO2': '0.010', 'AMMO5': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'weapon4': '0.066', 'AMMO3': '0.089', 'weapon5': '0.168', 'WEAPON5': '0.250', 'ARMOR': '0.456', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'weapon2': '1.486', 'weapon3': '1.606', 'DAMAGECOUNT': '3.042', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:05:03,744][2409079] DAMAGECOUNT value on done: 4769.0
[2023-02-25 13:05:03,748][2409079] Sum rewards: 4.471, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.797', 'AMMO5': '0.016', 'AMMO2': '0.028', 'WEAPON1': '0.050', 'AMMO3': '0.059', 'weapon7': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.138', 'HITCOUNT': '0.170', 'weapon5': '0.194', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.302', 'WEAPON3': '0.400', 'WEAPON5': '0.450', 'ARMOR': '0.800', 'weapon3': '1.008', 'weapon2': '1.310', 'DAMAGECOUNT': '1.572', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:05:03,906][2409469] DAMAGECOUNT value on done: 3786.0
[2023-02-25 13:05:03,908][2409469] Sum rewards: 4.843, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.050', 'AMMO5': '0.010', 'AMMO2': '0.040', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO3': '0.070', 'weapon5': '0.194', 'AMMO4': '0.198', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'weapon4': '0.456', 'HITCOUNT': '0.540', 'ARMOR': '0.854', 'weapon3': '1.170', 'DAMAGECOUNT': '1.701', 'weapon2': '1.820', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:05:03,948][2409486] DAMAGECOUNT value on done: 4292.0
[2023-02-25 13:05:03,949][2409486] Sum rewards: 7.918, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.110', 'AMMO5': '0.007', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.100', 'AMMO4': '0.125', 'weapon5': '0.184', 'weapon4': '0.236', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.540', 'weapon2': '0.994', 'weapon3': '1.548', 'DAMAGECOUNT': '2.568', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:04,225][2409407] DAMAGECOUNT value on done: 3811.0
[2023-02-25 13:05:04,227][2409407] Sum rewards: 4.510, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.538', 'AMMO2': '0.008', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.040', 'weapon5': '0.072', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.550', 'WEAPON3': '0.600', 'weapon3': '1.592', 'DAMAGECOUNT': '1.746', 'weapon2': '2.022', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:04,241][2409074] Updated weights for policy 0, policy_version 17111 (0.0012)
[2023-02-25 13:05:04,281][2409078] DAMAGECOUNT value on done: 4016.0
[2023-02-25 13:05:04,281][2409078] Sum rewards: 8.731, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.017', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.088', 'weapon4': '0.232', 'weapon5': '0.292', 'WEAPON3': '0.300', 'HITCOUNT': '0.300', 'WEAPON5': '0.400', 'HEALTH': '0.426', 'weapon3': '1.332', 'weapon2': '1.454', 'DAMAGECOUNT': '2.232', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:04,472][2409099] DAMAGECOUNT value on done: 4623.0
[2023-02-25 13:05:04,473][2409099] Sum rewards: 2.939, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.369', 'AMMO5': '0.008', 'AMMO2': '0.023', 'ARMOR': '0.032', 'weapon5': '0.056', 'AMMO3': '0.071', 'AMMO4': '0.115', 'WEAPON5': '0.200', 'weapon4': '0.212', 'WEAPON4': '0.350', 'WEAPON3': '0.500', 'HITCOUNT': '0.660', 'weapon3': '1.160', 'weapon2': '1.914', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.256'}
[2023-02-25 13:05:04,520][2409077] DAMAGECOUNT value on done: 4570.0
[2023-02-25 13:05:04,521][2409077] Sum rewards: 9.581, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.908', 'AMMO5': '0.013', 'AMMO2': '0.016', 'WEAPON1': '0.040', 'weapon4': '0.058', 'AMMO3': '0.077', 'AMMO4': '0.082', 'WEAPON4': '0.150', 'weapon5': '0.224', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'HITCOUNT': '0.750', 'weapon3': '1.474', 'weapon2': '1.896', 'DAMAGECOUNT': '3.609', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:05:04,571][2409406] DAMAGECOUNT value on done: 4395.0
[2023-02-25 13:05:04,574][2409406] Sum rewards: 5.997, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.576', 'AMMO5': '0.006', 'AMMO2': '0.041', 'weapon5': '0.074', 'AMMO3': '0.090', 'weapon7': '0.142', 'WEAPON5': '0.150', 'AMMO4': '0.206', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'WEAPON3': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.600', 'HITCOUNT': '0.730', 'weapon2': '1.212', 'weapon3': '1.632', 'DAMAGECOUNT': '2.709', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:05:05,205][2409075] DAMAGECOUNT value on done: 4332.0
[2023-02-25 13:05:05,208][2409075] Sum rewards: 6.487, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.013', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.053', 'AMMO3': '0.064', 'WEAPON4': '0.150', 'weapon5': '0.160', 'WEAPON5': '0.250', 'weapon4': '0.426', 'HITCOUNT': '0.450', 'ARMOR': '0.455', 'WEAPON3': '0.500', 'weapon3': '1.224', 'weapon2': '1.864', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:05,289][2409105] DAMAGECOUNT value on done: 4363.0
[2023-02-25 13:05:05,290][2409105] Sum rewards: 6.400, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.379', 'AMMO2': '0.008', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.037', 'weapon5': '0.056', 'AMMO3': '0.088', 'weapon7': '0.094', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.250', 'weapon4': '0.332', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'ARMOR': '0.857', 'weapon3': '1.020', 'weapon2': '1.114', 'DAMAGECOUNT': '2.067', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:05:05,421][2409565] DAMAGECOUNT value on done: 5479.0
[2023-02-25 13:05:05,424][2409565] Sum rewards: 4.989, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.428', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.027', 'weapon7': '0.058', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.130', 'AMMO3': '0.131', 'WEAPON7': '0.200', 'weapon4': '0.224', 'ARMOR': '0.400', 'HITCOUNT': '0.590', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'weapon2': '1.234', 'weapon3': '1.916', 'DAMAGECOUNT': '3.201', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:05:05,476][2409596] DAMAGECOUNT value on done: 4424.0
[2023-02-25 13:05:05,480][2409596] Sum rewards: 7.730, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.785', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.020', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.138', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.760', 'weapon4': '0.998', 'weapon3': '1.026', 'weapon2': '1.180', 'DAMAGECOUNT': '2.733', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:05:05,680][2409389] DAMAGECOUNT value on done: 4379.0
[2023-02-25 13:05:05,681][2409389] Sum rewards: 7.635, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.614', 'AMMO2': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'AMMO3': '0.092', 'weapon5': '0.128', 'weapon4': '0.154', 'WEAPON5': '0.250', 'ARMOR': '0.456', 'HITCOUNT': '0.570', 'WEAPON3': '0.600', 'weapon2': '1.392', 'weapon3': '1.708', 'DAMAGECOUNT': '2.784', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:05,701][2409373] DAMAGECOUNT value on done: 6014.0
[2023-02-25 13:05:05,704][2409373] Sum rewards: 9.052, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.235', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'AMMO4': '0.078', 'weapon7': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'HITCOUNT': '0.540', 'weapon2': '0.552', 'weapon4': '0.624', 'weapon3': '1.316', 'DAMAGECOUNT': '2.334', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:05,843][2409355] DAMAGECOUNT value on done: 4558.0
[2023-02-25 13:05:05,846][2409355] Sum rewards: 4.387, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.358', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO3': '0.061', 'AMMO4': '0.062', 'weapon7': '0.098', 'weapon5': '0.148', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.410', 'weapon4': '0.688', 'weapon2': '1.108', 'weapon3': '1.204', 'DAMAGECOUNT': '2.055', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:05:05,978][2409097] DAMAGECOUNT value on done: 3992.0
[2023-02-25 13:05:05,983][2409097] Sum rewards: 3.654, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.586', 'AMMO5': '0.012', 'AMMO2': '0.017', 'weapon5': '0.056', 'AMMO3': '0.060', 'weapon4': '0.076', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'HITCOUNT': '0.590', 'ARMOR': '0.906', 'weapon3': '1.302', 'weapon2': '2.088', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:05:06,129][2409074] Updated weights for policy 0, policy_version 17121 (0.0013)
[2023-02-25 13:05:06,602][2409104] DAMAGECOUNT value on done: 4143.0
[2023-02-25 13:05:06,603][2409104] Sum rewards: 6.159, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.478', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.022', 'AMMO4': '0.060', 'AMMO3': '0.072', 'WEAPON4': '0.150', 'weapon5': '0.172', 'weapon4': '0.328', 'HITCOUNT': '0.430', 'WEAPON3': '0.500', 'WEAPON5': '0.500', 'ARMOR': '0.904', 'weapon2': '0.978', 'weapon3': '1.276', 'DAMAGECOUNT': '1.722', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:05:06,672][2409096] DAMAGECOUNT value on done: 3881.0
[2023-02-25 13:05:06,676][2409096] Sum rewards: 3.553, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.778', 'AMMO5': '0.014', 'AMMO2': '0.026', 'weapon7': '0.048', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.106', 'AMMO4': '0.129', 'weapon5': '0.158', 'weapon4': '0.226', 'WEAPON5': '0.350', 'HITCOUNT': '0.370', 'WEAPON3': '0.700', 'weapon2': '0.718', 'weapon3': '1.720', 'DAMAGECOUNT': '2.106', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:05:06,777][2409597] DAMAGECOUNT value on done: 5259.0
[2023-02-25 13:05:06,778][2409597] Sum rewards: 7.414, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.706', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.063', 'weapon7': '0.078', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.108', 'AMMO4': '0.130', 'weapon4': '0.146', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.493', 'WEAPON3': '0.500', 'HITCOUNT': '0.610', 'weapon3': '1.456', 'weapon2': '1.818', 'DAMAGECOUNT': '2.811', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:07,039][2409547] DAMAGECOUNT value on done: 4726.0
[2023-02-25 13:05:07,040][2409547] Sum rewards: 7.067, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.820', 'AMMO5': '0.026', 'WEAPON1': '0.030', 'AMMO2': '0.036', 'AMMO3': '0.088', 'AMMO4': '0.180', 'WEAPON4': '0.250', 'weapon4': '0.250', 'weapon5': '0.342', 'HITCOUNT': '0.390', 'WEAPON3': '0.450', 'WEAPON5': '0.550', 'weapon2': '1.282', 'weapon3': '1.632', 'ARMOR': '1.717', 'DAMAGECOUNT': '2.163', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:07,093][2409076] DAMAGECOUNT value on done: 4454.0
[2023-02-25 13:05:07,094][2409076] Sum rewards: 1.511, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.490', 'AMMO2': '0.004', 'AMMO4': '0.017', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.204', 'HITCOUNT': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'weapon2': '1.036', 'weapon3': '1.196', 'DAMAGECOUNT': '1.620', 'FRAGCOUNT': '2.500'}
[2023-02-25 13:05:07,101][2409405] DAMAGECOUNT value on done: 4312.0
[2023-02-25 13:05:07,104][2409405] Sum rewards: 5.601, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.775', 'AMMO2': '0.003', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.013', 'weapon7': '0.048', 'weapon5': '0.052', 'AMMO3': '0.063', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.530', 'weapon3': '1.246', 'weapon2': '1.830', 'DAMAGECOUNT': '2.121', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:07,186][2408954] Fps is (10 sec: 24985.9, 60 sec: 25668.3, 300 sec: 25603.5). Total num frames: 70156288. Throughput: 0: 6424.6. Samples: 17533944. Policy #0 lag: (min: 0.0, avg: 12.2, max: 25.0)
[2023-02-25 13:05:07,186][2408954] Avg episode reward: [(0, '5.598')]
[2023-02-25 13:05:07,411][2409548] DAMAGECOUNT value on done: 3843.0
[2023-02-25 13:05:07,412][2409548] Sum rewards: 4.044, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.750', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.015', 'AMMO3': '0.056', 'weapon5': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.134', 'WEAPON7': '0.200', 'HITCOUNT': '0.320', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'weapon2': '0.566', 'weapon3': '1.122', 'DAMAGECOUNT': '1.293', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:05:07,583][2409866] DAMAGECOUNT value on done: 4629.0
[2023-02-25 13:05:07,586][2409866] Sum rewards: 5.650, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.090', 'AMMO2': '0.016', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.080', 'AMMO3': '0.088', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.380', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'weapon2': '1.220', 'weapon3': '1.334', 'DAMAGECOUNT': '2.250', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:05:07,661][2409079] DAMAGECOUNT value on done: 4494.0
[2023-02-25 13:05:07,664][2409079] Sum rewards: 5.984, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.718', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon7': '0.048', 'weapon5': '0.066', 'AMMO3': '0.099', 'AMMO4': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.464', 'HITCOUNT': '0.550', 'WEAPON3': '0.600', 'weapon2': '1.120', 'weapon3': '1.446', 'DAMAGECOUNT': '2.565', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:05:07,710][2409074] Updated weights for policy 0, policy_version 17131 (0.0013)
[2023-02-25 13:05:08,053][2409078] DAMAGECOUNT value on done: 4037.0
[2023-02-25 13:05:08,053][2409078] Sum rewards: 7.919, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.161', 'weapon7': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'weapon5': '0.028', 'WEAPON4': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon4': '0.240', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.750', 'weapon3': '1.152', 'weapon2': '1.368', 'DAMAGECOUNT': '2.949', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:08,089][2409486] DAMAGECOUNT value on done: 4615.0
[2023-02-25 13:05:08,090][2409486] Sum rewards: 10.904, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.128', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO3': '0.050', 'weapon5': '0.050', 'weapon7': '0.080', 'AMMO4': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'weapon4': '0.508', 'HITCOUNT': '0.640', 'weapon3': '1.196', 'weapon2': '1.564', 'DAMAGECOUNT': '2.718', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:05:08,110][2409077] DAMAGECOUNT value on done: 4216.0
[2023-02-25 13:05:08,112][2409077] Sum rewards: 6.181, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.680', 'AMMO2': '0.016', 'AMMO5': '0.022', 'WEAPON1': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.101', 'weapon5': '0.162', 'HITCOUNT': '0.310', 'WEAPON3': '0.550', 'WEAPON5': '0.550', 'weapon3': '1.604', 'weapon2': '1.722', 'DAMAGECOUNT': '2.196', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:05:08,144][2409406] DAMAGECOUNT value on done: 4863.0
[2023-02-25 13:05:08,145][2409407] DAMAGECOUNT value on done: 4569.0
[2023-02-25 13:05:08,149][2409406] Sum rewards: 9.689, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.605', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO5': '0.019', 'WEAPON1': '0.040', 'weapon7': '0.078', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.125', 'weapon5': '0.188', 'WEAPON7': '0.200', 'weapon4': '0.230', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'HITCOUNT': '0.610', 'WEAPON3': '0.850', 'weapon2': '1.508', 'weapon3': '1.528', 'DAMAGECOUNT': '3.912', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:05:08,147][2409407] Sum rewards: 5.584, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.100', 'AMMO2': '0.013', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'weapon7': '0.058', 'AMMO4': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.360', 'ARMOR': '0.478', 'weapon4': '0.696', 'weapon2': '1.046', 'weapon3': '1.148', 'DAMAGECOUNT': '1.455', 'FRAGCOUNT': '3.500'}
[2023-02-25 13:05:08,292][2409469] DAMAGECOUNT value on done: 5164.0
[2023-02-25 13:05:08,293][2409469] Sum rewards: 8.336, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.259', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.070', 'AMMO4': '0.129', 'weapon5': '0.184', 'weapon4': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'HITCOUNT': '0.480', 'ARMOR': '0.914', 'weapon3': '1.560', 'weapon2': '1.614', 'DAMAGECOUNT': '2.592', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:08,590][2409099] DAMAGECOUNT value on done: 4339.0
[2023-02-25 13:05:08,593][2409099] Sum rewards: 6.830, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.511', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO3': '0.020', 'weapon7': '0.064', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON3': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.370', 'weapon3': '0.466', 'weapon4': '0.596', 'weapon2': '0.940', 'DAMAGECOUNT': '1.791', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:08,835][2409074] Updated weights for policy 0, policy_version 17141 (0.0012)
[2023-02-25 13:05:09,088][2409105] DAMAGECOUNT value on done: 3954.0
[2023-02-25 13:05:09,091][2409105] Sum rewards: 5.670, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.845', 'AMMO5': '0.015', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'weapon5': '0.046', 'weapon7': '0.048', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.130', 'AMMO3': '0.133', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.518', 'HITCOUNT': '0.530', 'WEAPON3': '0.750', 'weapon2': '0.884', 'weapon3': '1.374', 'DAMAGECOUNT': '2.451', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:05:09,322][2409565] DAMAGECOUNT value on done: 4292.0
[2023-02-25 13:05:09,322][2409565] Sum rewards: 10.804, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.304', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.085', 'weapon5': '0.102', 'WEAPON5': '0.150', 'weapon4': '0.286', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.850', 'weapon2': '1.562', 'weapon3': '1.578', 'DAMAGECOUNT': '3.387', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:05:09,377][2409075] DAMAGECOUNT value on done: 4444.0
[2023-02-25 13:05:09,378][2409075] Sum rewards: 5.252, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.508', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.021', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.114', 'weapon5': '0.118', 'WEAPON4': '0.150', 'weapon4': '0.164', 'WEAPON5': '0.450', 'HITCOUNT': '0.480', 'WEAPON3': '0.650', 'ARMOR': '0.881', 'weapon3': '1.334', 'weapon2': '1.580', 'DAMAGECOUNT': '2.820', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:05:09,593][2409596] DAMAGECOUNT value on done: 3958.0
[2023-02-25 13:05:09,596][2409596] Sum rewards: 4.425, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.227', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon5': '0.078', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.100', 'weapon7': '0.122', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'weapon4': '0.174', 'WEAPON5': '0.250', 'HITCOUNT': '0.440', 'WEAPON3': '0.750', 'ARMOR': '0.832', 'weapon2': '1.210', 'weapon3': '1.864', 'DAMAGECOUNT': '1.953', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:05:09,771][2409373] DAMAGECOUNT value on done: 3730.0
[2023-02-25 13:05:09,772][2409373] Sum rewards: -1.051, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.470', 'AMMO2': '0.007', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.035', 'weapon7': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.125', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.250', 'WEAPON5': '0.500', 'weapon4': '0.502', 'WEAPON3': '0.850', 'weapon2': '0.858', 'DAMAGECOUNT': '0.906', 'weapon3': '1.278', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:05:09,821][2409389] DAMAGECOUNT value on done: 3844.0
[2023-02-25 13:05:09,825][2409389] Sum rewards: 6.316, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.928', 'AMMO5': '0.011', 'AMMO2': '0.020', 'weapon5': '0.084', 'AMMO4': '0.100', 'AMMO3': '0.104', 'weapon4': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.440', 'WEAPON3': '0.650', 'ARMOR': '0.986', 'DAMAGECOUNT': '1.530', 'weapon2': '1.586', 'weapon3': '1.860', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:10,095][2409097] DAMAGECOUNT value on done: 3961.0
[2023-02-25 13:05:10,099][2409097] Sum rewards: 3.778, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.270', 'AMMO2': '0.013', 'AMMO5': '0.017', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.109', 'weapon5': '0.214', 'WEAPON5': '0.450', 'HITCOUNT': '0.530', 'WEAPON3': '0.700', 'weapon2': '1.560', 'weapon3': '1.894', 'DAMAGECOUNT': '2.148', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:05:10,305][2409355] DAMAGECOUNT value on done: 3911.0
[2023-02-25 13:05:10,306][2409355] Sum rewards: 4.261, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.865', 'AMMO5': '0.017', 'AMMO2': '0.032', 'WEAPON1': '0.040', 'AMMO3': '0.128', 'AMMO4': '0.159', 'weapon5': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.450', 'HITCOUNT': '0.720', 'weapon4': '0.732', 'WEAPON3': '0.750', 'weapon2': '1.014', 'weapon3': '1.544', 'DAMAGECOUNT': '2.424', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:10,716][2409096] DAMAGECOUNT value on done: 3873.0
[2023-02-25 13:05:10,718][2409096] Sum rewards: -0.869, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.618', 'AMMO2': '0.008', 'AMMO5': '0.017', 'weapon5': '0.036', 'AMMO4': '0.040', 'weapon7': '0.068', 'AMMO3': '0.085', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.322', 'WEAPON5': '0.350', 'weapon4': '0.354', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'weapon3': '0.876', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.002'}
[2023-02-25 13:05:10,746][2409104] DAMAGECOUNT value on done: 3961.0
[2023-02-25 13:05:10,749][2409104] Sum rewards: -0.253, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.417', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.041', 'weapon5': '0.050', 'weapon7': '0.068', 'AMMO3': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.206', 'WEAPON5': '0.300', 'HITCOUNT': '0.320', 'WEAPON3': '0.500', 'WEAPON4': '0.500', 'weapon2': '0.640', 'weapon3': '0.760', 'weapon4': '0.760', 'ARMOR': '0.851', 'DAMAGECOUNT': '1.257', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:05:10,792][2409405] DAMAGECOUNT value on done: 4459.0
[2023-02-25 13:05:10,793][2409405] Sum rewards: 7.169, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.764', 'AMMO5': '0.019', 'WEAPON1': '0.030', 'AMMO2': '0.042', 'ARMOR': '0.056', 'weapon5': '0.066', 'AMMO3': '0.085', 'AMMO4': '0.209', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '0.600', 'weapon4': '0.678', 'HITCOUNT': '0.720', 'weapon2': '1.020', 'weapon3': '1.762', 'DAMAGECOUNT': '2.595', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:05:10,828][2409597] DAMAGECOUNT value on done: 4281.0
[2023-02-25 13:05:10,829][2409597] Sum rewards: 4.684, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.032', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.014', 'WEAPON1': '0.030', 'weapon5': '0.052', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'weapon4': '0.172', 'WEAPON5': '0.250', 'HITCOUNT': '0.640', 'WEAPON3': '0.650', 'weapon3': '1.544', 'DAMAGECOUNT': '1.932', 'weapon2': '1.976', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:10,907][2409076] DAMAGECOUNT value on done: 3993.0
[2023-02-25 13:05:10,911][2409076] Sum rewards: 11.823, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.114', 'weapon5': '0.116', 'HEALTH': '0.144', 'weapon4': '0.190', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'HITCOUNT': '0.510', 'weapon3': '0.964', 'weapon2': '0.994', 'ARMOR': '1.300', 'DAMAGECOUNT': '2.955', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:05:11,088][2409074] Updated weights for policy 0, policy_version 17151 (0.0012)
[2023-02-25 13:05:11,195][2409547] DAMAGECOUNT value on done: 3875.0
[2023-02-25 13:05:11,200][2409547] Sum rewards: 3.953, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.030', 'AMMO5': '0.003', 'AMMO2': '0.012', 'AMMO3': '0.024', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.060', 'weapon7': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON3': '0.150', 'weapon2': '0.290', 'weapon4': '0.296', 'HITCOUNT': '0.350', 'weapon3': '0.374', 'DAMAGECOUNT': '1.140', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:05:11,449][2409079] DAMAGECOUNT value on done: 4569.0
[2023-02-25 13:05:11,450][2409079] Sum rewards: 3.660, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.356', 'weapon7': '0.012', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'weapon5': '0.116', 'AMMO3': '0.117', 'AMMO4': '0.151', 'weapon4': '0.162', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'ARMOR': '0.455', 'HITCOUNT': '0.630', 'WEAPON3': '0.750', 'weapon2': '1.248', 'weapon3': '1.842', 'DAMAGECOUNT': '2.463', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:05:11,454][2409548] DAMAGECOUNT value on done: 3205.0
[2023-02-25 13:05:11,457][2409548] Sum rewards: 1.729, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.116', 'AMMO4': '-0.048', 'AMMO2': '-0.010', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon5': '0.060', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'HITCOUNT': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.242', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon2': '1.302', 'weapon3': '1.446'}
[2023-02-25 13:05:11,790][2409078] DAMAGECOUNT value on done: 3940.0
[2023-02-25 13:05:11,790][2409077] DAMAGECOUNT value on done: 5035.0
[2023-02-25 13:05:11,791][2409078] Sum rewards: 7.862, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.020', 'AMMO5': '0.020', 'WEAPON1': '0.050', 'AMMO3': '0.076', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'weapon5': '0.308', 'weapon4': '0.334', 'HITCOUNT': '0.400', 'WEAPON3': '0.400', 'WEAPON5': '0.450', 'HEALTH': '0.567', 'ARMOR': '0.864', 'weapon2': '1.436', 'weapon3': '1.494', 'DAMAGECOUNT': '2.496', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:05:11,791][2409077] Sum rewards: 15.488, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.196', 'AMMO2': '0.006', 'weapon7': '0.012', 'AMMO5': '0.024', 'AMMO4': '0.028', 'WEAPON1': '0.030', 'AMMO3': '0.128', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.248', 'weapon4': '0.330', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'HITCOUNT': '0.850', 'ARMOR': '0.900', 'weapon2': '1.086', 'weapon3': '1.694', 'DAMAGECOUNT': '4.698', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:05:11,821][2409486] DAMAGECOUNT value on done: 4812.0
[2023-02-25 13:05:11,822][2409486] Sum rewards: 8.619, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.960', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.013', 'WEAPON1': '0.020', 'weapon4': '0.050', 'weapon7': '0.060', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.105', 'WEAPON4': '0.150', 'weapon5': '0.156', 'WEAPON5': '0.250', 'HITCOUNT': '0.600', 'WEAPON3': '0.700', 'ARMOR': '0.900', 'weapon2': '1.520', 'weapon3': '1.686', 'DAMAGECOUNT': '2.556', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:05:11,838][2409406] DAMAGECOUNT value on done: 3532.0
[2023-02-25 13:05:11,841][2409406] Sum rewards: 8.472, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.646', 'AMMO2': '0.005', 'AMMO5': '0.019', 'AMMO4': '0.027', 'WEAPON1': '0.050', 'weapon5': '0.086', 'AMMO3': '0.138', 'WEAPON5': '0.400', 'ARMOR': '0.451', 'HITCOUNT': '0.650', 'WEAPON3': '0.900', 'weapon2': '1.580', 'weapon3': '2.056', 'DAMAGECOUNT': '2.505', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:05:11,930][2409407] DAMAGECOUNT value on done: 4349.0
[2023-02-25 13:05:11,931][2409407] Sum rewards: 9.344, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.104', 'AMMO5': '0.010', 'weapon7': '0.012', 'AMMO2': '0.038', 'WEAPON1': '0.040', 'AMMO3': '0.053', 'AMMO4': '0.191', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.208', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'WEAPON4': '0.500', 'HITCOUNT': '0.590', 'weapon4': '0.688', 'ARMOR': '0.850', 'weapon3': '1.006', 'weapon2': '1.528', 'DAMAGECOUNT': '3.384', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:05:12,186][2408954] Fps is (10 sec: 26226.3, 60 sec: 25600.0, 300 sec: 25631.2). Total num frames: 70283264. Throughput: 0: 6409.9. Samples: 17571636. Policy #0 lag: (min: 0.0, avg: 14.0, max: 26.0)
[2023-02-25 13:05:12,186][2408954] Avg episode reward: [(0, '5.886')]
[2023-02-25 13:05:12,274][2409866] DAMAGECOUNT value on done: 5283.0
[2023-02-25 13:05:12,274][2409866] Sum rewards: 13.525, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.080', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.018', 'weapon7': '0.048', 'weapon5': '0.054', 'AMMO3': '0.059', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'WEAPON3': '0.400', 'weapon4': '0.462', 'ARMOR': '0.468', 'HITCOUNT': '0.970', 'weapon3': '1.024', 'weapon2': '1.264', 'DAMAGECOUNT': '3.591', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:05:12,381][2409099] DAMAGECOUNT value on done: 3414.0
[2023-02-25 13:05:12,383][2409099] Sum rewards: 3.885, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.794', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.015', 'weapon5': '0.058', 'AMMO3': '0.071', 'WEAPON4': '0.100', 'weapon7': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.170', 'WEAPON7': '0.200', 'weapon4': '0.222', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'DAMAGECOUNT': '1.005', 'weapon2': '1.118', 'weapon3': '1.162', 'ARMOR': '1.329', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:05:12,421][2409074] Updated weights for policy 0, policy_version 17161 (0.0013)
[2023-02-25 13:05:12,572][2409469] DAMAGECOUNT value on done: 4584.0
[2023-02-25 13:05:12,573][2409469] Sum rewards: 5.263, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.262', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.012', 'weapon4': '0.016', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.084', 'weapon5': '0.218', 'WEAPON5': '0.300', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'weapon2': '1.572', 'weapon3': '1.862', 'DAMAGECOUNT': '2.031', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:12,992][2409075] DAMAGECOUNT value on done: 4649.0
[2023-02-25 13:05:12,993][2409075] Sum rewards: 5.005, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.268', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO3': '0.030', 'AMMO4': '0.037', 'weapon7': '0.056', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.260', 'weapon4': '0.464', 'weapon3': '0.720', 'ARMOR': '0.855', 'DAMAGECOUNT': '1.221', 'weapon2': '1.412', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:05:12,998][2409565] DAMAGECOUNT value on done: 4787.0
[2023-02-25 13:05:13,001][2409565] Sum rewards: 10.195, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.839', 'AMMO2': '0.013', 'AMMO5': '0.013', 'WEAPON1': '0.040', 'AMMO3': '0.060', 'AMMO4': '0.063', 'weapon5': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.528', 'HITCOUNT': '0.730', 'weapon3': '1.334', 'weapon2': '1.536', 'DAMAGECOUNT': '2.895', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:05:13,231][2409105] DAMAGECOUNT value on done: 3935.0
[2023-02-25 13:05:13,240][2409105] Sum rewards: 7.427, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.650', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'AMMO3': '0.078', 'weapon7': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.350', 'weapon4': '0.538', 'WEAPON3': '0.600', 'HITCOUNT': '0.830', 'weapon3': '1.052', 'weapon2': '1.628', 'DAMAGECOUNT': '2.685', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:13,279][2409596] DAMAGECOUNT value on done: 4202.0
[2023-02-25 13:05:13,281][2409596] Sum rewards: 7.079, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.059', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'weapon7': '0.076', 'AMMO4': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.186', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.420', 'WEAPON3': '0.450', 'ARMOR': '0.513', 'weapon4': '0.528', 'weapon2': '1.048', 'weapon3': '1.198', 'DAMAGECOUNT': '2.082', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:13,350][2409373] DAMAGECOUNT value on done: 3880.0
[2023-02-25 13:05:13,351][2409373] Sum rewards: 2.883, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.543', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO3': '0.030', 'AMMO4': '0.096', 'weapon5': '0.150', 'HITCOUNT': '0.160', 'WEAPON3': '0.200', 'WEAPON5': '0.200', 'weapon7': '0.208', 'WEAPON4': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'ARMOR': '0.487', 'weapon4': '0.558', 'DAMAGECOUNT': '0.768', 'weapon3': '0.788', 'FRAGCOUNT': '1.000', 'weapon2': '1.214'}
[2023-02-25 13:05:13,440][2409389] DAMAGECOUNT value on done: 4129.0
[2023-02-25 13:05:13,441][2409389] Sum rewards: 7.806, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.039', 'AMMO3': '0.061', 'weapon5': '0.138', 'AMMO4': '0.197', 'HEALTH': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'weapon4': '0.562', 'HITCOUNT': '0.690', 'weapon2': '1.296', 'weapon3': '1.406', 'DAMAGECOUNT': '2.262', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:13,745][2409097] DAMAGECOUNT value on done: 4849.0
[2023-02-25 13:05:13,746][2409097] Sum rewards: 9.714, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.700', 'AMMO2': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.041', 'weapon7': '0.056', 'AMMO3': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.230', 'WEAPON5': '0.300', 'weapon4': '0.304', 'HITCOUNT': '0.430', 'WEAPON3': '0.500', 'weapon2': '1.086', 'weapon3': '1.612', 'DAMAGECOUNT': '2.406', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:05:13,979][2409074] Updated weights for policy 0, policy_version 17171 (0.0012)
[2023-02-25 13:05:14,395][2409104] DAMAGECOUNT value on done: 5379.0
[2023-02-25 13:05:14,398][2409104] Sum rewards: 3.070, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.607', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon5': '0.046', 'AMMO3': '0.050', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'HITCOUNT': '0.430', 'ARMOR': '0.432', 'weapon2': '0.512', 'weapon4': '0.584', 'weapon3': '1.268', 'DAMAGECOUNT': '1.344', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:05:14,473][2409355] DAMAGECOUNT value on done: 3731.0
[2023-02-25 13:05:14,476][2409355] Sum rewards: 6.616, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.650', 'AMMO5': '0.017', 'AMMO2': '0.020', 'weapon5': '0.036', 'weapon7': '0.048', 'AMMO3': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'weapon4': '0.294', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'weapon2': '0.564', 'HITCOUNT': '0.570', 'weapon3': '1.426', 'DAMAGECOUNT': '1.815', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:05:14,558][2409076] DAMAGECOUNT value on done: 4137.0
[2023-02-25 13:05:14,559][2409076] Sum rewards: 8.924, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.158', 'ARMOR': '0.012', 'AMMO2': '0.016', 'AMMO5': '0.018', 'WEAPON1': '0.040', 'weapon5': '0.072', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon4': '0.262', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'HITCOUNT': '0.900', 'weapon2': '1.608', 'weapon3': '1.820', 'DAMAGECOUNT': '3.306', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:05:14,714][2409597] DAMAGECOUNT value on done: 4493.0
[2023-02-25 13:05:14,717][2409597] Sum rewards: 12.018, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.760', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO4': '0.037', 'AMMO3': '0.097', 'weapon5': '0.210', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '0.800', 'weapon2': '1.604', 'weapon3': '1.846', 'DAMAGECOUNT': '3.234', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:05:14,744][2409096] DAMAGECOUNT value on done: 4321.0
[2023-02-25 13:05:14,747][2409096] Sum rewards: 3.808, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.329', 'weapon4': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.055', 'weapon7': '0.088', 'AMMO3': '0.092', 'weapon5': '0.112', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.440', 'WEAPON3': '0.550', 'weapon3': '1.630', 'weapon2': '1.710', 'DAMAGECOUNT': '1.761', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:05:14,843][2409547] DAMAGECOUNT value on done: 5033.0
[2023-02-25 13:05:14,843][2409547] Sum rewards: 13.908, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.971', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon4': '0.028', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'AMMO4': '0.120', 'weapon5': '0.228', 'WEAPON5': '0.400', 'ARMOR': '0.491', 'WEAPON3': '0.600', 'HITCOUNT': '0.660', 'weapon3': '1.610', 'weapon2': '1.752', 'DAMAGECOUNT': '4.008', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:05:15,102][2409405] DAMAGECOUNT value on done: 4641.0
[2023-02-25 13:05:15,105][2409405] Sum rewards: 5.779, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.510', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO3': '0.030', 'WEAPON1': '0.040', 'weapon7': '0.052', 'AMMO4': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.170', 'WEAPON3': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.330', 'WEAPON4': '0.350', 'ARMOR': '0.472', 'weapon3': '0.776', 'weapon4': '0.948', 'weapon2': '1.292', 'DAMAGECOUNT': '2.151', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:15,603][2409079] DAMAGECOUNT value on done: 5256.0
[2023-02-25 13:05:15,607][2409079] Sum rewards: 3.794, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.925', 'AMMO2': '0.005', 'AMMO5': '0.010', 'weapon5': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.027', 'weapon7': '0.074', 'AMMO3': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.350', 'HITCOUNT': '0.390', 'WEAPON3': '0.550', 'ARMOR': '0.915', 'weapon3': '1.494', 'weapon2': '1.526', 'DAMAGECOUNT': '2.214', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:15,611][2409486] DAMAGECOUNT value on done: 3831.0
[2023-02-25 13:05:15,612][2409486] Sum rewards: 4.185, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.117', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.042', 'AMMO3': '0.086', 'AMMO4': '0.087', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'HITCOUNT': '0.500', 'WEAPON3': '0.550', 'weapon4': '0.810', 'weapon2': '0.892', 'ARMOR': '0.991', 'weapon3': '1.282', 'DAMAGECOUNT': '2.112', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:05:15,629][2409074] Updated weights for policy 0, policy_version 17181 (0.0014)
[2023-02-25 13:05:15,943][2409077] DAMAGECOUNT value on done: 4790.0
[2023-02-25 13:05:15,944][2409077] Sum rewards: 13.942, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.880', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.338', 'WEAPON3': '0.450', 'ARMOR': '0.460', 'HITCOUNT': '0.830', 'weapon3': '1.178', 'weapon2': '1.726', 'DAMAGECOUNT': '3.771', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:05:15,975][2409406] DAMAGECOUNT value on done: 3422.0
[2023-02-25 13:05:15,980][2409406] Sum rewards: 5.418, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.550', 'AMMO2': '0.014', 'AMMO5': '0.020', 'WEAPON1': '0.050', 'AMMO4': '0.069', 'weapon5': '0.114', 'AMMO3': '0.119', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.682', 'HITCOUNT': '0.710', 'weapon4': '0.762', 'WEAPON3': '0.850', 'weapon3': '1.546', 'DAMAGECOUNT': '2.682', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:05:16,045][2409407] DAMAGECOUNT value on done: 3943.0
[2023-02-25 13:05:16,045][2409407] Sum rewards: 7.939, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.070', 'AMMO2': '0.007', 'AMMO5': '0.016', 'WEAPON1': '0.030', 'AMMO4': '0.035', 'weapon7': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon5': '0.210', 'weapon4': '0.212', 'WEAPON5': '0.450', 'HITCOUNT': '0.710', 'WEAPON3': '0.750', 'ARMOR': '1.294', 'weapon3': '1.526', 'weapon2': '1.638', 'DAMAGECOUNT': '3.069', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:16,119][2409078] DAMAGECOUNT value on done: 3886.0
[2023-02-25 13:05:16,123][2409078] Sum rewards: 8.603, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.071', 'AMMO2': '0.012', 'AMMO5': '0.020', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.200', 'weapon5': '0.260', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'ARMOR': '0.820', 'HITCOUNT': '0.880', 'weapon3': '1.518', 'weapon2': '1.832', 'DAMAGECOUNT': '3.120', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:05:16,186][2409099] DAMAGECOUNT value on done: 4871.0
[2023-02-25 13:05:16,190][2409099] Sum rewards: 7.564, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.586', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'weapon7': '0.032', 'AMMO4': '0.068', 'weapon5': '0.082', 'AMMO3': '0.100', 'WEAPON5': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.590', 'WEAPON3': '0.600', 'weapon4': '0.698', 'ARMOR': '0.952', 'weapon3': '1.264', 'weapon2': '1.496', 'DAMAGECOUNT': '2.256', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:16,297][2409469] DAMAGECOUNT value on done: 5108.0
[2023-02-25 13:05:16,301][2409469] Sum rewards: 8.840, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.844', 'AMMO2': '0.018', 'AMMO5': '0.025', 'WEAPON1': '0.040', 'weapon7': '0.078', 'AMMO4': '0.091', 'AMMO3': '0.134', 'WEAPON4': '0.150', 'weapon5': '0.152', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'weapon4': '0.458', 'WEAPON5': '0.500', 'weapon2': '0.616', 'HITCOUNT': '0.800', 'WEAPON3': '0.850', 'weapon3': '1.912', 'DAMAGECOUNT': '2.970', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:05:16,433][2409866] DAMAGECOUNT value on done: 5138.0
[2023-02-25 13:05:16,434][2409866] Sum rewards: 3.765, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.940', 'AMMO2': '0.014', 'AMMO5': '0.016', 'WEAPON1': '0.030', 'weapon7': '0.050', 'AMMO3': '0.067', 'AMMO4': '0.069', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'HITCOUNT': '0.430', 'weapon4': '0.440', 'WEAPON3': '0.500', 'ARMOR': '0.905', 'weapon3': '1.158', 'weapon2': '1.826', 'DAMAGECOUNT': '2.337', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:05:16,852][2409105] DAMAGECOUNT value on done: 4024.0
[2023-02-25 13:05:16,855][2409105] Sum rewards: 2.725, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.985', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.009', 'AMMO3': '0.043', 'weapon5': '0.056', 'weapon7': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.590', 'weapon2': '0.624', 'weapon3': '0.924', 'FRAGCOUNT': '1.000', 'weapon4': '1.080', 'DAMAGECOUNT': '1.743'}
[2023-02-25 13:05:17,079][2409075] DAMAGECOUNT value on done: 4207.0
[2023-02-25 13:05:17,080][2409075] Sum rewards: 2.276, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.578', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO3': '0.040', 'weapon7': '0.052', 'AMMO2': '0.053', 'weapon5': '0.070', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'AMMO4': '0.264', 'WEAPON3': '0.300', 'HITCOUNT': '0.420', 'WEAPON4': '0.650', 'weapon3': '0.816', 'ARMOR': '0.883', 'weapon4': '0.944', 'DAMAGECOUNT': '1.338', 'weapon2': '1.454', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:05:17,143][2409596] DAMAGECOUNT value on done: 3991.0
[2023-02-25 13:05:17,144][2409596] Sum rewards: 4.366, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.175', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO3': '0.036', 'WEAPON4': '0.250', 'weapon7': '0.278', 'WEAPON3': '0.300', 'HITCOUNT': '0.350', 'ARMOR': '0.451', 'AMMO6': '0.460', 'AMMO7': '0.460', 'weapon3': '0.570', 'weapon4': '0.588', 'weapon2': '0.602', 'WEAPON7': '0.700', 'DAMAGECOUNT': '1.254', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:05:17,186][2408954] Fps is (10 sec: 25394.9, 60 sec: 25531.7, 300 sec: 25589.6). Total num frames: 70410240. Throughput: 0: 6381.6. Samples: 17609148. Policy #0 lag: (min: 0.0, avg: 14.0, max: 26.0)
[2023-02-25 13:05:17,186][2408954] Avg episode reward: [(0, '6.309')]
[2023-02-25 13:05:17,297][2409373] DAMAGECOUNT value on done: 3317.0
[2023-02-25 13:05:17,298][2409373] Sum rewards: 5.256, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.730', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon7': '0.050', 'AMMO3': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.330', 'WEAPON3': '0.350', 'HITCOUNT': '0.430', 'weapon3': '0.840', 'ARMOR': '0.956', 'DAMAGECOUNT': '1.689', 'weapon2': '1.984', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:17,440][2409074] Updated weights for policy 0, policy_version 17191 (0.0012)
[2023-02-25 13:05:17,509][2409389] DAMAGECOUNT value on done: 4376.0
[2023-02-25 13:05:17,512][2409389] Sum rewards: 10.363, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.015', 'AMMO2': '0.037', 'WEAPON1': '0.040', 'AMMO3': '0.125', 'weapon5': '0.132', 'WEAPON4': '0.150', 'AMMO4': '0.184', 'WEAPON5': '0.300', 'weapon4': '0.512', 'HEALTH': '0.608', 'WEAPON3': '0.700', 'HITCOUNT': '0.700', 'weapon2': '1.262', 'weapon3': '1.850', 'DAMAGECOUNT': '2.748', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:05:17,750][2409097] DAMAGECOUNT value on done: 4190.0
[2023-02-25 13:05:17,751][2409097] Sum rewards: 8.370, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.365', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.040', 'weapon7': '0.058', 'weapon5': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.123', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'HITCOUNT': '0.450', 'weapon4': '0.668', 'weapon2': '0.794', 'weapon3': '1.022', 'DAMAGECOUNT': '1.920', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:18,379][2409104] DAMAGECOUNT value on done: 4058.0
[2023-02-25 13:05:18,394][2409104] Sum rewards: 4.016, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.916', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon7': '0.072', 'weapon5': '0.074', 'AMMO3': '0.076', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.390', 'weapon4': '0.434', 'ARMOR': '0.456', 'WEAPON3': '0.500', 'weapon2': '0.858', 'weapon3': '1.018', 'DAMAGECOUNT': '1.557', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:05:18,490][2409096] DAMAGECOUNT value on done: 5190.0
[2023-02-25 13:05:18,491][2409096] Sum rewards: 6.425, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.820', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.032', 'weapon7': '0.048', 'AMMO3': '0.050', 'weapon5': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.344', 'WEAPON3': '0.350', 'HITCOUNT': '0.440', 'ARMOR': '0.455', 'weapon2': '0.960', 'weapon3': '1.122', 'DAMAGECOUNT': '2.112', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:18,580][2409076] DAMAGECOUNT value on done: 5077.0
[2023-02-25 13:05:18,581][2409076] Sum rewards: 6.849, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.010', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.040', 'AMMO3': '0.096', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.201', 'weapon4': '0.270', 'weapon5': '0.394', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'HITCOUNT': '0.640', 'weapon2': '1.244', 'weapon3': '1.652', 'DAMAGECOUNT': '2.643', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:18,593][2409355] DAMAGECOUNT value on done: 4372.0
[2023-02-25 13:05:18,594][2409355] Sum rewards: 8.615, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.302', 'AMMO2': '0.011', 'AMMO5': '0.020', 'AMMO4': '0.052', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'weapon5': '0.134', 'weapon4': '0.292', 'WEAPON5': '0.400', 'ARMOR': '0.500', 'WEAPON3': '0.700', 'HITCOUNT': '0.730', 'weapon2': '1.092', 'weapon3': '1.832', 'DAMAGECOUNT': '2.706', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:05:18,844][2409405] DAMAGECOUNT value on done: 5130.0
[2023-02-25 13:05:18,845][2409405] Sum rewards: 10.154, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.600', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.010', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO3': '0.049', 'WEAPON4': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.510', 'weapon3': '0.744', 'weapon2': '1.540', 'DAMAGECOUNT': '3.276', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:05:18,952][2409547] DAMAGECOUNT value on done: 5223.0
[2023-02-25 13:05:18,953][2409547] Sum rewards: 8.625, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.810', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.045', 'AMMO3': '0.081', 'WEAPON5': '0.100', 'weapon5': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.390', 'WEAPON3': '0.500', 'HITCOUNT': '0.680', 'ARMOR': '0.873', 'weapon3': '1.200', 'weapon2': '1.712', 'DAMAGECOUNT': '2.310', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:05:19,125][2409074] Updated weights for policy 0, policy_version 17201 (0.0012)
[2023-02-25 13:05:19,194][2409079] DAMAGECOUNT value on done: 4261.0
[2023-02-25 13:05:19,195][2409079] Sum rewards: 8.233, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.550', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.076', 'weapon5': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.350', 'weapon4': '0.426', 'WEAPON3': '0.450', 'ARMOR': '0.912', 'weapon3': '1.072', 'weapon2': '1.088', 'DAMAGECOUNT': '2.394', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:19,466][2409486] DAMAGECOUNT value on done: 4534.0
[2023-02-25 13:05:19,468][2409486] Sum rewards: 9.895, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.985', 'AMMO2': '0.011', 'AMMO5': '0.030', 'WEAPON1': '0.040', 'AMMO4': '0.052', 'AMMO3': '0.139', 'WEAPON4': '0.150', 'weapon4': '0.198', 'weapon5': '0.256', 'ARMOR': '0.452', 'weapon2': '0.726', 'WEAPON5': '0.750', 'HITCOUNT': '0.850', 'WEAPON3': '0.900', 'weapon3': '2.318', 'DAMAGECOUNT': '4.008', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:05:19,617][2409407] DAMAGECOUNT value on done: 4176.0
[2023-02-25 13:05:19,618][2409407] Sum rewards: 8.597, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.650', 'AMMO2': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.030', 'weapon7': '0.056', 'AMMO3': '0.058', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.122', 'WEAPON7': '0.200', 'weapon4': '0.224', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'HITCOUNT': '0.510', 'weapon3': '1.028', 'weapon2': '1.192', 'DAMAGECOUNT': '1.740', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:19,820][2409077] DAMAGECOUNT value on done: 5079.0
[2023-02-25 13:05:19,823][2409077] Sum rewards: 12.942, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.610', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'AMMO3': '0.066', 'AMMO4': '0.087', 'weapon7': '0.112', 'weapon5': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO6': '0.280', 'AMMO7': '0.280', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.542', 'HITCOUNT': '0.840', 'ARMOR': '0.915', 'weapon2': '1.094', 'weapon3': '1.338', 'DAMAGECOUNT': '3.861', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:05:19,855][2409078] DAMAGECOUNT value on done: 4872.0
[2023-02-25 13:05:19,856][2409078] Sum rewards: 9.930, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.728', 'AMMO2': '0.006', 'AMMO5': '0.014', 'AMMO4': '0.029', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'weapon5': '0.220', 'HITCOUNT': '0.380', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'WEAPON5': '0.450', 'weapon3': '1.266', 'weapon2': '1.862', 'DAMAGECOUNT': '2.241', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:05:19,864][2409406] DAMAGECOUNT value on done: 4185.0
[2023-02-25 13:05:19,865][2409406] Sum rewards: 3.698, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.190', 'AMMO5': '0.005', 'weapon7': '0.008', 'AMMO2': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.060', 'weapon5': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.272', 'WEAPON3': '0.400', 'FRAGCOUNT': '0.500', 'HITCOUNT': '0.580', 'ARMOR': '0.960', 'weapon3': '1.228', 'weapon2': '1.488', 'DAMAGECOUNT': '1.899'}
[2023-02-25 13:05:19,918][2409469] DAMAGECOUNT value on done: 4328.0
[2023-02-25 13:05:19,919][2409469] Sum rewards: 4.773, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.857', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'AMMO3': '0.067', 'AMMO4': '0.121', 'weapon5': '0.234', 'WEAPON4': '0.300', 'weapon4': '0.314', 'HITCOUNT': '0.380', 'WEAPON5': '0.500', 'WEAPON3': '0.500', 'weapon3': '1.400', 'DAMAGECOUNT': '1.731', 'weapon2': '1.748', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:20,138][2409866] DAMAGECOUNT value on done: 4486.0
[2023-02-25 13:05:20,138][2409866] Sum rewards: 5.701, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.894', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'weapon5': '0.136', 'weapon4': '0.170', 'HITCOUNT': '0.200', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'ARMOR': '0.889', 'weapon3': '1.326', 'DAMAGECOUNT': '1.389', 'weapon2': '1.716', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:05:20,151][2409099] DAMAGECOUNT value on done: 4353.0
[2023-02-25 13:05:20,152][2409099] Sum rewards: 1.158, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.308', 'AMMO4': '-0.054', 'AMMO2': '-0.011', 'AMMO5': '0.015', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'weapon4': '0.076', 'AMMO3': '0.097', 'weapon5': '0.134', 'WEAPON5': '0.350', 'HITCOUNT': '0.670', 'WEAPON3': '0.800', 'ARMOR': '0.857', 'FRAGCOUNT': '1.500', 'weapon3': '1.596', 'weapon2': '1.816', 'DAMAGECOUNT': '2.259'}
[2023-02-25 13:05:20,566][2409074] Updated weights for policy 0, policy_version 17211 (0.0012)
[2023-02-25 13:05:20,881][2409596] DAMAGECOUNT value on done: 5052.0
[2023-02-25 13:05:20,882][2409596] Sum rewards: 10.373, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.328', 'AMMO2': '0.007', 'AMMO5': '0.010', 'weapon7': '0.016', 'WEAPON1': '0.030', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'AMMO3': '0.097', 'weapon5': '0.126', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.236', 'WEAPON5': '0.250', 'WEAPON3': '0.650', 'HITCOUNT': '0.790', 'ARMOR': '0.800', 'weapon3': '1.518', 'weapon2': '1.612', 'DAMAGECOUNT': '3.375', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:05:21,022][2409075] DAMAGECOUNT value on done: 3758.0
[2023-02-25 13:05:21,023][2409075] Sum rewards: 6.950, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.025', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'weapon7': '0.048', 'AMMO3': '0.058', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.262', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.580', 'weapon2': '0.906', 'weapon3': '1.062', 'DAMAGECOUNT': '2.133', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:21,074][2409373] DAMAGECOUNT value on done: 4097.0
[2023-02-25 13:05:21,092][2409373] Sum rewards: -1.602, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.936', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'weapon4': '0.020', 'AMMO5': '0.025', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.137', 'weapon5': '0.224', 'HITCOUNT': '0.340', 'WEAPON5': '0.600', 'ARMOR': '0.856', 'WEAPON3': '0.900', 'weapon2': '1.170', 'DAMAGECOUNT': '1.233', 'FRAGCOUNT': '2.000', 'weapon3': '2.232'}
[2023-02-25 13:05:21,430][2409097] DAMAGECOUNT value on done: 4227.0
[2023-02-25 13:05:21,432][2409097] Sum rewards: 4.082, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.152', 'AMMO2': '0.004', 'AMMO4': '0.018', 'AMMO5': '0.020', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.113', 'weapon4': '0.184', 'weapon5': '0.198', 'HITCOUNT': '0.490', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'weapon2': '1.328', 'DAMAGECOUNT': '1.983', 'weapon3': '1.986', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:21,457][2409389] DAMAGECOUNT value on done: 4625.0
[2023-02-25 13:05:21,460][2409389] Sum rewards: 5.375, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.137', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'weapon5': '0.214', 'weapon4': '0.214', 'HITCOUNT': '0.430', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'weapon2': '0.880', 'weapon3': '1.326', 'DAMAGECOUNT': '2.367', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:21,785][2409105] DAMAGECOUNT value on done: 4282.0
[2023-02-25 13:05:21,788][2409105] Sum rewards: 3.979, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.194', 'AMMO5': '0.010', 'AMMO2': '0.043', 'AMMO3': '0.062', 'weapon5': '0.140', 'WEAPON5': '0.200', 'AMMO4': '0.216', 'HITCOUNT': '0.350', 'WEAPON3': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.544', 'weapon3': '1.314', 'weapon2': '1.480', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.710', 'ARMOR': '1.803'}
[2023-02-25 13:05:22,186][2408954] Fps is (10 sec: 24576.0, 60 sec: 25531.8, 300 sec: 25589.6). Total num frames: 70529024. Throughput: 0: 6379.5. Samples: 17628300. Policy #0 lag: (min: 0.0, avg: 12.8, max: 25.0)
[2023-02-25 13:05:22,186][2408954] Avg episode reward: [(0, '6.525')]
[2023-02-25 13:05:22,299][2409096] DAMAGECOUNT value on done: 4278.0
[2023-02-25 13:05:22,300][2409096] Sum rewards: 3.627, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.998', 'AMMO5': '0.016', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'AMMO3': '0.086', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'weapon4': '0.170', 'weapon5': '0.176', 'HITCOUNT': '0.390', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon3': '1.342', 'DAMAGECOUNT': '1.506', 'weapon2': '1.788', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:22,326][2409104] DAMAGECOUNT value on done: 5326.0
[2023-02-25 13:05:22,327][2409104] Sum rewards: 9.751, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.732', 'WEAPON1': '0.010', 'AMMO5': '0.021', 'AMMO2': '0.022', 'weapon7': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.065', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.111', 'weapon5': '0.200', 'weapon4': '0.282', 'HITCOUNT': '0.400', 'ARMOR': '0.428', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon2': '0.930', 'weapon3': '1.456', 'DAMAGECOUNT': '2.961', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:05:22,372][2409074] Updated weights for policy 0, policy_version 17221 (0.0012)
[2023-02-25 13:05:22,379][2409355] DAMAGECOUNT value on done: 4759.0
[2023-02-25 13:05:22,382][2409355] Sum rewards: 6.902, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.340', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon7': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.110', 'AMMO3': '0.111', 'weapon4': '0.216', 'AMMO4': '0.239', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.740', 'ARMOR': '0.800', 'weapon3': '1.484', 'weapon2': '1.518', 'DAMAGECOUNT': '2.853', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:22,604][2409405] DAMAGECOUNT value on done: 3039.0
[2023-02-25 13:05:22,605][2409405] Sum rewards: 4.921, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.079', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.033', 'AMMO3': '0.055', 'weapon5': '0.124', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.510', 'weapon3': '1.060', 'weapon2': '1.854', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.097'}
[2023-02-25 13:05:22,652][2409076] DAMAGECOUNT value on done: 3811.0
[2023-02-25 13:05:22,655][2409076] Sum rewards: 4.493, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.452', 'AMMO5': '0.017', 'AMMO2': '0.034', 'AMMO3': '0.066', 'weapon7': '0.138', 'WEAPON4': '0.150', 'AMMO4': '0.169', 'weapon5': '0.174', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.252', 'HITCOUNT': '0.310', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'ARMOR': '0.800', 'weapon3': '1.224', 'DAMAGECOUNT': '1.287', 'weapon2': '1.874', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:05:22,811][2409079] DAMAGECOUNT value on done: 4505.0
[2023-02-25 13:05:22,813][2409079] Sum rewards: 2.974, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.264', 'AMMO2': '0.016', 'AMMO5': '0.020', 'weapon4': '0.046', 'WEAPON4': '0.050', 'WEAPON1': '0.050', 'AMMO4': '0.081', 'AMMO3': '0.090', 'weapon5': '0.176', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.510', 'WEAPON3': '0.550', 'weapon2': '1.462', 'DAMAGECOUNT': '1.620', 'weapon3': '1.766', 'FRAGCOUNT': '3.500'}
[2023-02-25 13:05:22,919][2409547] DAMAGECOUNT value on done: 3572.0
[2023-02-25 13:05:22,922][2409547] Sum rewards: 8.551, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.960', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.059', 'AMMO3': '0.073', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.200', 'weapon5': '0.204', 'weapon4': '0.216', 'WEAPON4': '0.250', 'ARMOR': '0.463', 'WEAPON3': '0.600', 'HITCOUNT': '0.740', 'weapon2': '1.558', 'weapon3': '1.674', 'DAMAGECOUNT': '3.135', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:23,292][2409033] Signal inference workers to stop experience collection... (2100 times)
[2023-02-25 13:05:23,300][2409033] Signal inference workers to resume experience collection... (2100 times)
[2023-02-25 13:05:23,314][2409486] DAMAGECOUNT value on done: 4152.0
[2023-02-25 13:05:23,316][2409486] Sum rewards: 5.721, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.735', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO5': '0.019', 'AMMO4': '0.051', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.130', 'weapon4': '0.228', 'WEAPON5': '0.300', 'HITCOUNT': '0.460', 'WEAPON3': '0.500', 'ARMOR': '0.959', 'weapon3': '1.524', 'weapon2': '1.774', 'DAMAGECOUNT': '2.310', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:05:23,321][2409074] InferenceWorker_p0-w0: stopping experience collection (2100 times)
[2023-02-25 13:05:23,343][2409074] InferenceWorker_p0-w0: resuming experience collection (2100 times)
[2023-02-25 13:05:23,357][2409407] DAMAGECOUNT value on done: 4787.0
[2023-02-25 13:05:23,360][2409407] Sum rewards: 8.768, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.156', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.114', 'weapon5': '0.138', 'WEAPON4': '0.150', 'weapon4': '0.154', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'HITCOUNT': '0.640', 'WEAPON3': '0.750', 'weapon2': '1.640', 'weapon3': '1.646', 'DAMAGECOUNT': '3.618', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:05:23,714][2409074] Updated weights for policy 0, policy_version 17231 (0.0013)
[2023-02-25 13:05:23,831][2409078] DAMAGECOUNT value on done: 3975.0
[2023-02-25 13:05:23,835][2409078] Sum rewards: 5.073, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.053', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'ARMOR': '0.016', 'AMMO3': '0.040', 'weapon5': '0.044', 'AMMO4': '0.050', 'WEAPON5': '0.050', 'WEAPON4': '0.200', 'WEAPON3': '0.300', 'HITCOUNT': '0.370', 'weapon4': '0.404', 'weapon3': '0.934', 'DAMAGECOUNT': '1.197', 'weapon2': '1.498', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:05:23,839][2409469] DAMAGECOUNT value on done: 5194.0
[2023-02-25 13:05:23,840][2409469] Sum rewards: 14.735, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.040', 'AMMO3': '0.040', 'weapon7': '0.050', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'HEALTH': '0.194', 'WEAPON7': '0.200', 'weapon5': '0.238', 'weapon4': '0.238', 'WEAPON3': '0.250', 'HITCOUNT': '0.640', 'ARMOR': '0.904', 'weapon3': '1.018', 'weapon2': '1.378', 'DAMAGECOUNT': '3.027', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:05:23,857][2409077] DAMAGECOUNT value on done: 5006.0
[2023-02-25 13:05:23,857][2409077] Sum rewards: 8.318, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.790', 'AMMO2': '0.008', 'ARMOR': '0.008', 'AMMO5': '0.030', 'AMMO4': '0.038', 'WEAPON4': '0.100', 'weapon5': '0.122', 'AMMO3': '0.133', 'weapon4': '0.348', 'WEAPON5': '0.650', 'HITCOUNT': '0.730', 'WEAPON3': '0.900', 'weapon2': '1.204', 'weapon3': '1.602', 'DAMAGECOUNT': '2.985', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:05:23,908][2409406] DAMAGECOUNT value on done: 4322.0
[2023-02-25 13:05:23,911][2409406] Sum rewards: 5.738, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.772', 'AMMO5': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.054', 'AMMO4': '0.082', 'weapon5': '0.166', 'WEAPON4': '0.200', 'weapon4': '0.268', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '0.400', 'ARMOR': '0.800', 'weapon3': '1.196', 'DAMAGECOUNT': '1.350', 'weapon2': '1.444', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:23,929][2409099] DAMAGECOUNT value on done: 5539.0
[2023-02-25 13:05:23,930][2409099] Sum rewards: 7.677, reward structure: {'DEATHCOUNT': '-5.250', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.033', 'HEALTH': '0.040', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO3': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.162', 'weapon5': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.394', 'WEAPON3': '0.400', 'HITCOUNT': '0.550', 'weapon2': '0.690', 'weapon3': '1.158', 'DAMAGECOUNT': '2.397', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:24,015][2409866] DAMAGECOUNT value on done: 4581.0
[2023-02-25 13:05:24,015][2409866] Sum rewards: 7.307, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.526', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO5': '0.028', 'AMMO4': '0.077', 'AMMO3': '0.130', 'weapon4': '0.164', 'weapon5': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.650', 'WEAPON3': '0.850', 'ARMOR': '0.947', 'HITCOUNT': '0.980', 'weapon2': '1.314', 'weapon3': '1.960', 'DAMAGECOUNT': '3.828', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:05:25,057][2409373] DAMAGECOUNT value on done: 3511.0
[2023-02-25 13:05:25,059][2409373] Sum rewards: 6.732, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.964', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.031', 'WEAPON1': '0.040', 'weapon5': '0.084', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'weapon4': '0.106', 'WEAPON5': '0.250', 'ARMOR': '0.448', 'WEAPON3': '0.600', 'HITCOUNT': '0.670', 'weapon2': '1.206', 'weapon3': '1.792', 'DAMAGECOUNT': '2.259', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:25,334][2409075] DAMAGECOUNT value on done: 4379.0
[2023-02-25 13:05:25,335][2409075] Sum rewards: 14.338, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.423', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'weapon5': '0.060', 'AMMO3': '0.065', 'weapon7': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'ARMOR': '0.491', 'HITCOUNT': '0.770', 'weapon3': '1.336', 'weapon2': '1.594', 'DAMAGECOUNT': '2.712', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:05:25,404][2409105] DAMAGECOUNT value on done: 5176.0
[2023-02-25 13:05:25,407][2409105] Sum rewards: 7.997, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.080', 'HEALTH': '0.084', 'AMMO3': '0.098', 'weapon5': '0.152', 'WEAPON5': '0.200', 'weapon4': '0.238', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.730', 'weapon2': '1.104', 'weapon3': '1.960', 'DAMAGECOUNT': '3.477', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:05:25,615][2409074] Updated weights for policy 0, policy_version 17241 (0.0012)
[2023-02-25 13:05:25,711][2409389] DAMAGECOUNT value on done: 5519.0
[2023-02-25 13:05:25,712][2409389] Sum rewards: 10.073, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.353', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon7': '0.048', 'AMMO3': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.156', 'AMMO4': '0.213', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '0.540', 'weapon4': '0.652', 'ARMOR': '0.873', 'weapon3': '1.118', 'weapon2': '1.710', 'DAMAGECOUNT': '3.153', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:05:25,790][2409097] DAMAGECOUNT value on done: 3333.0
[2023-02-25 13:05:25,791][2409097] Sum rewards: 6.448, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.062', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon5': '0.062', 'AMMO3': '0.080', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'weapon7': '0.232', 'weapon4': '0.288', 'HITCOUNT': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'ARMOR': '0.448', 'WEAPON3': '0.550', 'weapon3': '1.018', 'weapon2': '1.122', 'DAMAGECOUNT': '1.674', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:26,180][2409096] DAMAGECOUNT value on done: 3659.0
[2023-02-25 13:05:26,183][2409096] Sum rewards: 3.966, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.685', 'AMMO2': '0.009', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.045', 'AMMO3': '0.060', 'WEAPON4': '0.150', 'weapon4': '0.160', 'weapon5': '0.182', 'WEAPON5': '0.300', 'HITCOUNT': '0.430', 'WEAPON3': '0.450', 'weapon3': '1.482', 'DAMAGECOUNT': '1.710', 'weapon2': '1.890', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:05:26,213][2409104] DAMAGECOUNT value on done: 3515.0
[2023-02-25 13:05:26,214][2409104] Sum rewards: 6.483, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.100', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.029', 'WEAPON1': '0.030', 'AMMO3': '0.082', 'weapon5': '0.182', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'ARMOR': '0.412', 'HITCOUNT': '0.430', 'weapon4': '0.536', 'WEAPON3': '0.550', 'weapon2': '1.136', 'weapon3': '1.562', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:26,315][2409076] DAMAGECOUNT value on done: 4198.0
[2023-02-25 13:05:26,316][2409076] Sum rewards: 3.413, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.314', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon5': '0.010', 'ARMOR': '0.020', 'AMMO4': '0.028', 'AMMO3': '0.066', 'weapon7': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.256', 'WEAPON7': '0.300', 'HITCOUNT': '0.310', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.086', 'weapon3': '1.100', 'weapon2': '1.462', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:05:26,396][2409405] DAMAGECOUNT value on done: 3827.0
[2023-02-25 13:05:26,477][2409355] DAMAGECOUNT value on done: 4040.0
[2023-02-25 13:05:26,481][2409355] Sum rewards: 11.120, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.408', 'AMMO2': '0.011', 'AMMO5': '0.017', 'AMMO4': '0.056', 'WEAPON1': '0.070', 'weapon7': '0.076', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.138', 'WEAPON7': '0.200', 'weapon5': '0.406', 'HITCOUNT': '0.440', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'ARMOR': '0.911', 'weapon2': '1.088', 'weapon3': '1.688', 'DAMAGECOUNT': '2.799', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:05:26,907][2409079] DAMAGECOUNT value on done: 5146.0
[2023-02-25 13:05:26,908][2409079] Sum rewards: 14.866, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.350', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO3': '0.055', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'weapon5': '0.104', 'WEAPON4': '0.150', 'weapon4': '0.294', 'WEAPON3': '0.400', 'HITCOUNT': '0.650', 'weapon3': '1.056', 'weapon2': '1.864', 'DAMAGECOUNT': '3.942', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:05:27,133][2409547] DAMAGECOUNT value on done: 4624.0
[2023-02-25 13:05:27,135][2409547] Sum rewards: 12.929, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.942', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO3': '0.094', 'weapon5': '0.156', 'AMMO4': '0.156', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'weapon4': '0.696', 'HITCOUNT': '0.990', 'weapon2': '1.180', 'weapon3': '1.438', 'DAMAGECOUNT': '3.969', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:05:27,186][2408954] Fps is (10 sec: 24985.6, 60 sec: 25463.5, 300 sec: 25589.6). Total num frames: 70660096. Throughput: 0: 6367.8. Samples: 17666088. Policy #0 lag: (min: 0.0, avg: 12.8, max: 25.0)
[2023-02-25 13:05:27,186][2408954] Avg episode reward: [(0, '6.759')]
[2023-02-25 13:05:27,198][2409074] Updated weights for policy 0, policy_version 17251 (0.0012)
[2023-02-25 13:05:27,289][2409407] DAMAGECOUNT value on done: 4245.0
[2023-02-25 13:05:27,290][2409407] Sum rewards: 9.152, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO5': '0.003', 'AMMO2': '0.015', 'AMMO3': '0.030', 'weapon5': '0.046', 'AMMO4': '0.075', 'HEALTH': '0.084', 'weapon7': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'WEAPON3': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HITCOUNT': '0.260', 'WEAPON7': '0.300', 'ARMOR': '0.453', 'weapon2': '0.690', 'weapon4': '0.704', 'weapon3': '0.730', 'DAMAGECOUNT': '1.974', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:27,386][2409077] DAMAGECOUNT value on done: 3626.0
[2023-02-25 13:05:27,387][2409077] Sum rewards: 11.088, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.274', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon5': '0.028', 'weapon7': '0.048', 'AMMO3': '0.050', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.280', 'WEAPON3': '0.350', 'ARMOR': '0.449', 'HITCOUNT': '0.650', 'weapon2': '0.916', 'weapon3': '1.086', 'DAMAGECOUNT': '2.553', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:05:27,423][2409406] DAMAGECOUNT value on done: 4363.0
[2023-02-25 13:05:27,426][2409406] Sum rewards: 9.807, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.936', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'weapon7': '0.048', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.154', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.258', 'WEAPON3': '0.300', 'HITCOUNT': '0.460', 'weapon3': '0.746', 'ARMOR': '1.327', 'weapon2': '2.434', 'DAMAGECOUNT': '2.985', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:27,447][2409078] DAMAGECOUNT value on done: 4781.0
[2023-02-25 13:05:27,450][2409078] Sum rewards: 7.888, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.841', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO3': '0.058', 'AMMO4': '0.089', 'weapon7': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.102', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.266', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.470', 'weapon3': '0.988', 'weapon2': '1.600', 'DAMAGECOUNT': '2.073', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:27,617][2409469] DAMAGECOUNT value on done: 4274.0
[2023-02-25 13:05:27,618][2409469] Sum rewards: 12.735, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.309', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.017', 'WEAPON1': '0.050', 'AMMO3': '0.072', 'weapon5': '0.274', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'HITCOUNT': '0.660', 'weapon3': '1.554', 'weapon2': '1.754', 'DAMAGECOUNT': '2.967', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:05:27,982][2409486] DAMAGECOUNT value on done: 4361.0
[2023-02-25 13:05:27,982][2409486] Sum rewards: 9.257, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.160', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO3': '0.107', 'AMMO4': '0.144', 'weapon5': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'weapon4': '0.484', 'WEAPON3': '0.700', 'HITCOUNT': '0.790', 'weapon2': '1.506', 'weapon3': '1.532', 'ARMOR': '1.738', 'DAMAGECOUNT': '3.348', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:05:28,187][2409866] DAMAGECOUNT value on done: 4840.0
[2023-02-25 13:05:28,188][2409866] Sum rewards: 12.522, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.568', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon4': '0.022', 'weapon7': '0.064', 'AMMO4': '0.080', 'weapon5': '0.088', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.780', 'ARMOR': '1.322', 'weapon2': '1.494', 'weapon3': '1.928', 'DAMAGECOUNT': '3.228', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:05:28,660][2409074] Updated weights for policy 0, policy_version 17261 (0.0012)
[2023-02-25 13:05:28,668][2409373] DAMAGECOUNT value on done: 4395.0
[2023-02-25 13:05:28,671][2409373] Sum rewards: 7.319, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.035', 'AMMO3': '0.036', 'weapon7': '0.074', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO4': '0.174', 'HEALTH': '0.182', 'HITCOUNT': '0.190', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.316', 'ARMOR': '0.400', 'weapon3': '0.724', 'weapon2': '1.340', 'DAMAGECOUNT': '1.500', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:05:28,884][2409099] DAMAGECOUNT value on done: 3875.0
[2023-02-25 13:05:28,887][2409099] Sum rewards: 8.939, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.030', 'weapon7': '0.058', 'AMMO3': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.132', 'AMMO4': '0.149', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'HITCOUNT': '0.370', 'WEAPON3': '0.400', 'weapon4': '0.414', 'weapon2': '0.690', 'HEALTH': '0.771', 'weapon3': '1.168', 'ARMOR': '1.200', 'DAMAGECOUNT': '2.415', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:05:29,024][2409075] DAMAGECOUNT value on done: 4000.0
[2023-02-25 13:05:29,024][2409075] Sum rewards: 7.002, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'AMMO2': '0.031', 'AMMO3': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.156', 'weapon7': '0.178', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'HEALTH': '0.256', 'HITCOUNT': '0.360', 'weapon4': '0.430', 'ARMOR': '0.812', 'weapon3': '0.880', 'weapon2': '1.086', 'DAMAGECOUNT': '1.359', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:05:29,486][2409389] DAMAGECOUNT value on done: 4009.0
[2023-02-25 13:05:29,489][2409389] Sum rewards: 1.414, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.310', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.024', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'weapon5': '0.054', 'weapon7': '0.140', 'WEAPON5': '0.150', 'HITCOUNT': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '0.400', 'AMMO6': '0.440', 'AMMO7': '0.440', 'WEAPON7': '0.600', 'weapon4': '0.656', 'weapon3': '0.926', 'ARMOR': '1.468', 'weapon2': '1.502', 'DAMAGECOUNT': '1.584', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:05:29,761][2409097] DAMAGECOUNT value on done: 4416.0
[2023-02-25 13:05:29,762][2409097] Sum rewards: -0.761, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.463', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon5': '0.062', 'weapon7': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.139', 'HITCOUNT': '0.310', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.600', 'weapon4': '0.708', 'ARMOR': '0.910', 'weapon3': '0.972', 'weapon2': '1.064', 'DAMAGECOUNT': '1.134', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:05:29,918][2409104] DAMAGECOUNT value on done: 3669.0
[2023-02-25 13:05:29,919][2409076] DAMAGECOUNT value on done: 5074.0
[2023-02-25 13:05:29,921][2409104] Sum rewards: 8.406, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.025', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.014', 'WEAPON1': '0.040', 'AMMO3': '0.074', 'WEAPON4': '0.100', 'weapon5': '0.106', 'weapon7': '0.112', 'WEAPON5': '0.200', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'weapon4': '0.442', 'HITCOUNT': '0.460', 'ARMOR': '0.467', 'WEAPON3': '0.600', 'weapon3': '1.420', 'weapon2': '1.550', 'DAMAGECOUNT': '1.938', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:05:29,921][2409076] Sum rewards: 8.197, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.052', 'AMMO3': '0.078', 'HEALTH': '0.086', 'AMMO4': '0.091', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.910', 'weapon3': '1.472', 'weapon2': '1.748', 'DAMAGECOUNT': '2.859', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:30,080][2409096] DAMAGECOUNT value on done: 3174.0
[2023-02-25 13:05:30,081][2409096] Sum rewards: 4.727, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.950', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO3': '0.076', 'weapon5': '0.260', 'WEAPON5': '0.350', 'HITCOUNT': '0.420', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.515', 'weapon3': '1.612', 'weapon2': '1.832', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:30,426][2409074] Updated weights for policy 0, policy_version 17271 (0.0013)
[2023-02-25 13:05:30,559][2409079] DAMAGECOUNT value on done: 4404.0
[2023-02-25 13:05:30,562][2409079] Sum rewards: 11.329, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.012', 'weapon5': '0.018', 'AMMO2': '0.031', 'HEALTH': '0.056', 'weapon7': '0.060', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.137', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'weapon4': '0.246', 'WEAPON5': '0.250', 'WEAPON3': '0.800', 'ARMOR': '0.800', 'HITCOUNT': '1.140', 'weapon2': '1.476', 'weapon3': '1.698', 'DAMAGECOUNT': '3.951', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:05:30,695][2409355] DAMAGECOUNT value on done: 4825.0
[2023-02-25 13:05:30,698][2409355] Sum rewards: 8.770, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.667', 'AMMO5': '0.015', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'AMMO4': '0.097', 'AMMO3': '0.114', 'weapon5': '0.130', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.404', 'WEAPON3': '0.800', 'HITCOUNT': '0.900', 'ARMOR': '1.306', 'weapon2': '1.398', 'weapon3': '1.698', 'DAMAGECOUNT': '3.366', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:05:30,750][2409405] DAMAGECOUNT value on done: 4951.0
[2023-02-25 13:05:30,751][2409405] Sum rewards: 2.848, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.394', 'AMMO4': '-0.054', 'AMMO2': '-0.011', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon4': '0.018', 'WEAPON4': '0.050', 'AMMO3': '0.098', 'weapon5': '0.116', 'WEAPON5': '0.250', 'HITCOUNT': '0.520', 'WEAPON3': '0.650', 'ARMOR': '0.902', 'weapon3': '1.188', 'weapon2': '1.886', 'DAMAGECOUNT': '2.358', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:05:30,876][2409407] DAMAGECOUNT value on done: 3504.0
[2023-02-25 13:05:30,877][2409407] Sum rewards: 4.087, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.050', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'AMMO3': '0.050', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'weapon4': '0.256', 'WEAPON3': '0.300', 'HITCOUNT': '0.470', 'ARMOR': '0.500', 'weapon2': '1.028', 'weapon3': '1.110', 'DAMAGECOUNT': '1.470', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:05:31,614][2409547] DAMAGECOUNT value on done: 4449.0
[2023-02-25 13:05:31,614][2409547] Sum rewards: 9.517, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.170', 'AMMO2': '0.017', 'AMMO5': '0.023', 'WEAPON1': '0.030', 'AMMO3': '0.084', 'AMMO4': '0.084', 'weapon5': '0.132', 'weapon4': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.450', 'HITCOUNT': '0.540', 'WEAPON3': '0.600', 'ARMOR': '1.355', 'weapon3': '1.420', 'weapon2': '2.032', 'DAMAGECOUNT': '2.301', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:05:31,853][2409078] DAMAGECOUNT value on done: 3892.0
[2023-02-25 13:05:31,854][2409078] Sum rewards: 8.173, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.764', 'AMMO5': '0.012', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'AMMO3': '0.060', 'weapon7': '0.062', 'AMMO4': '0.069', 'weapon5': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.258', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.600', 'weapon3': '1.338', 'weapon2': '1.970', 'DAMAGECOUNT': '2.268', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:31,913][2409469] DAMAGECOUNT value on done: 3430.0
[2023-02-25 13:05:32,009][2409075] Large shaping reward 2.614 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.582, 194.0), ('weapon7', 0.002)]
[2023-02-25 13:05:32,025][2409074] Updated weights for policy 0, policy_version 17281 (0.0013)
[2023-02-25 13:05:32,123][2409486] DAMAGECOUNT value on done: 5152.0
[2023-02-25 13:05:32,124][2409486] Sum rewards: 3.530, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.884', 'AMMO5': '0.013', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'weapon7': '0.076', 'AMMO3': '0.078', 'AMMO4': '0.089', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.180', 'weapon4': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'HITCOUNT': '0.520', 'WEAPON3': '0.600', 'weapon2': '1.558', 'weapon3': '1.572', 'DAMAGECOUNT': '2.133', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:05:32,186][2408954] Fps is (10 sec: 25804.8, 60 sec: 25463.5, 300 sec: 25547.9). Total num frames: 70787072. Throughput: 0: 6348.3. Samples: 17703768. Policy #0 lag: (min: 0.0, avg: 12.8, max: 25.0)
[2023-02-25 13:05:32,186][2408954] Avg episode reward: [(0, '7.116')]
[2023-02-25 13:05:32,208][2409033] Saving new best policy, reward=7.116!
[2023-02-25 13:05:32,764][2409099] DAMAGECOUNT value on done: 4195.0
[2023-02-25 13:05:32,765][2409099] Sum rewards: 6.811, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.280', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.042', 'weapon5': '0.048', 'weapon7': '0.050', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.310', 'WEAPON3': '0.350', 'HITCOUNT': '0.500', 'ARMOR': '0.932', 'weapon3': '1.428', 'weapon2': '1.684', 'DAMAGECOUNT': '1.974', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:33,402][2409075] DAMAGECOUNT value on done: 3859.0
[2023-02-25 13:05:33,405][2409075] Sum rewards: 8.771, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.573', 'AMMO5': '0.012', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'AMMO3': '0.080', 'AMMO4': '0.093', 'weapon5': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.408', 'HITCOUNT': '0.580', 'WEAPON3': '0.650', 'ARMOR': '0.886', 'weapon2': '1.240', 'weapon3': '1.592', 'DAMAGECOUNT': '2.958', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:05:33,454][2409074] Updated weights for policy 0, policy_version 17291 (0.0012)
[2023-02-25 13:05:33,536][2409076] DAMAGECOUNT value on done: 4214.0
[2023-02-25 13:05:33,539][2409076] Sum rewards: 3.617, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.586', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.010', 'AMMO3': '0.085', 'weapon5': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.384', 'WEAPON3': '0.650', 'HITCOUNT': '0.710', 'ARMOR': '0.870', 'weapon2': '1.504', 'weapon3': '1.584', 'DAMAGECOUNT': '2.532', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:05:33,745][2409389] DAMAGECOUNT value on done: 3651.0
[2023-02-25 13:05:33,745][2409389] Sum rewards: 2.318, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.433', 'AMMO2': '0.005', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.027', 'weapon7': '0.046', 'AMMO3': '0.079', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.124', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.270', 'ARMOR': '0.453', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.939', 'weapon3': '1.012', 'weapon2': '1.588', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:05:33,850][2409097] DAMAGECOUNT value on done: 3764.0
[2023-02-25 13:05:33,851][2409097] Sum rewards: 6.793, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.760', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'AMMO3': '0.030', 'weapon7': '0.118', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.250', 'HITCOUNT': '0.320', 'WEAPON7': '0.400', 'weapon4': '0.488', 'weapon2': '0.636', 'weapon3': '0.688', 'ARMOR': '0.935', 'DAMAGECOUNT': '1.026', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:34,241][2409079] DAMAGECOUNT value on done: 4201.0
[2023-02-25 13:05:34,242][2409079] Sum rewards: 8.229, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.008', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'AMMO4': '0.055', 'weapon7': '0.132', 'WEAPON4': '0.150', 'weapon5': '0.166', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HITCOUNT': '0.230', 'HEALTH': '0.245', 'WEAPON3': '0.250', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'weapon4': '0.486', 'weapon2': '0.704', 'weapon3': '0.866', 'DAMAGECOUNT': '2.025', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:34,356][2409405] DAMAGECOUNT value on done: 3942.0
[2023-02-25 13:05:34,358][2409405] Sum rewards: 6.560, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.880', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.119', 'AMMO4': '0.121', 'WEAPON4': '0.250', 'weapon4': '0.312', 'weapon5': '0.322', 'WEAPON5': '0.500', 'HITCOUNT': '0.610', 'weapon2': '0.794', 'WEAPON3': '0.850', 'weapon3': '1.816', 'DAMAGECOUNT': '3.186', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:05:34,396][2409096] DAMAGECOUNT value on done: 5333.0
[2023-02-25 13:05:34,398][2409096] Sum rewards: 14.115, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.538', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO3': '0.072', 'AMMO4': '0.097', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.266', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.730', 'weapon2': '1.020', 'weapon3': '1.470', 'DAMAGECOUNT': '3.768', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:05:35,282][2409074] Updated weights for policy 0, policy_version 17301 (0.0012)
[2023-02-25 13:05:35,407][2409080] DAMAGECOUNT value on done: 5274.0
[2023-02-25 13:05:35,411][2409080] Sum rewards: 6.217, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.363', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon7': '0.050', 'AMMO3': '0.077', 'AMMO4': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.146', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'ARMOR': '0.453', 'WEAPON3': '0.550', 'weapon4': '0.640', 'HITCOUNT': '0.810', 'weapon2': '0.822', 'weapon3': '1.518', 'DAMAGECOUNT': '3.063', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:35,455][2409078] DAMAGECOUNT value on done: 3567.0
[2023-02-25 13:05:35,456][2409078] Sum rewards: 3.795, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'AMMO3': '0.067', 'AMMO4': '0.090', 'weapon5': '0.124', 'WEAPON5': '0.250', 'HITCOUNT': '0.320', 'WEAPON3': '0.400', 'HEALTH': '0.488', 'DAMAGECOUNT': '0.957', 'weapon3': '1.208', 'FRAGCOUNT': '2.000', 'weapon2': '2.332'}
[2023-02-25 13:05:35,525][2409547] DAMAGECOUNT value on done: 4042.0
[2023-02-25 13:05:35,526][2409547] Sum rewards: -0.089, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.104', 'weapon7': '0.008', 'AMMO2': '0.025', 'AMMO5': '0.035', 'weapon4': '0.036', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'AMMO4': '0.122', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.292', 'HITCOUNT': '0.420', 'WEAPON5': '0.700', 'WEAPON3': '0.800', 'ARMOR': '0.851', 'weapon2': '1.534', 'DAMAGECOUNT': '1.536', 'weapon3': '1.794', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:05:35,761][2409486] DAMAGECOUNT value on done: 4695.0
[2023-02-25 13:05:35,764][2409486] Sum rewards: 1.727, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.528', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.022', 'weapon7': '0.050', 'weapon5': '0.072', 'AMMO3': '0.081', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.352', 'HITCOUNT': '0.400', 'WEAPON3': '0.500', 'ARMOR': '0.800', 'weapon2': '0.804', 'weapon3': '0.968', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.623'}
[2023-02-25 13:05:35,788][2409469] DAMAGECOUNT value on done: 5269.0
[2023-02-25 13:05:35,791][2409469] Sum rewards: 10.215, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.992', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.062', 'AMMO3': '0.097', 'weapon5': '0.176', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'HITCOUNT': '0.730', 'weapon2': '1.526', 'weapon3': '1.682', 'DAMAGECOUNT': '2.676', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:05:36,407][2409099] DAMAGECOUNT value on done: 4859.0
[2023-02-25 13:05:36,408][2409099] Sum rewards: 4.377, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.354', 'AMMO5': '0.010', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'weapon4': '0.046', 'weapon7': '0.054', 'AMMO3': '0.063', 'weapon5': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.550', 'weapon2': '1.254', 'weapon3': '1.388', 'DAMAGECOUNT': '1.920', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:05:36,650][2409074] Updated weights for policy 0, policy_version 17311 (0.0012)
[2023-02-25 13:05:37,006][2409075] DAMAGECOUNT value on done: 5093.0
[2023-02-25 13:05:37,008][2409075] Sum rewards: 11.111, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.262', 'AMMO5': '0.019', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'AMMO3': '0.100', 'AMMO4': '0.116', 'weapon5': '0.118', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'ARMOR': '0.411', 'weapon4': '0.668', 'WEAPON3': '0.750', 'weapon2': '1.148', 'HITCOUNT': '1.210', 'weapon3': '1.758', 'DAMAGECOUNT': '4.272', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:05:37,186][2408954] Fps is (10 sec: 25804.7, 60 sec: 25395.2, 300 sec: 25603.5). Total num frames: 70918144. Throughput: 0: 6344.0. Samples: 17723016. Policy #0 lag: (min: 0.0, avg: 13.0, max: 26.0)
[2023-02-25 13:05:37,186][2408954] Avg episode reward: [(0, '6.982')]
[2023-02-25 13:05:37,268][2409076] DAMAGECOUNT value on done: 4247.0
[2023-02-25 13:05:37,270][2409076] Sum rewards: 10.790, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.400', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.044', 'AMMO3': '0.066', 'weapon7': '0.106', 'weapon5': '0.160', 'AMMO4': '0.219', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.460', 'ARMOR': '0.800', 'weapon4': '0.828', 'weapon3': '0.878', 'weapon2': '0.990', 'DAMAGECOUNT': '2.817', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:05:37,395][2409389] DAMAGECOUNT value on done: 3464.0
[2023-02-25 13:05:37,396][2409389] Sum rewards: 4.427, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'weapon5': '0.026', 'AMMO3': '0.040', 'WEAPON5': '0.050', 'HEALTH': '0.086', 'WEAPON4': '0.100', 'weapon7': '0.114', 'HITCOUNT': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.242', 'WEAPON3': '0.250', 'WEAPON7': '0.300', 'DAMAGECOUNT': '0.720', 'ARMOR': '0.852', 'FRAGCOUNT': '1.000', 'weapon3': '1.102', 'weapon2': '1.154'}
[2023-02-25 13:05:37,929][2409097] DAMAGECOUNT value on done: 4744.0
[2023-02-25 13:05:37,930][2409097] Sum rewards: 9.089, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.055', 'AMMO2': '0.008', 'AMMO5': '0.012', 'AMMO4': '0.038', 'WEAPON1': '0.040', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'weapon5': '0.110', 'weapon4': '0.130', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.770', 'weapon2': '1.224', 'weapon3': '1.416', 'DAMAGECOUNT': '2.961', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:05:38,471][2409074] Updated weights for policy 0, policy_version 17321 (0.0012)
[2023-02-25 13:05:38,556][2409096] DAMAGECOUNT value on done: 3512.0
[2023-02-25 13:05:38,560][2409096] Sum rewards: 2.320, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.346', 'AMMO2': '0.007', 'AMMO5': '0.012', 'AMMO4': '0.033', 'WEAPON1': '0.040', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'weapon5': '0.152', 'WEAPON5': '0.200', 'weapon4': '0.202', 'HITCOUNT': '0.210', 'WEAPON3': '0.400', 'ARMOR': '0.459', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.861', 'weapon2': '1.200', 'weapon3': '1.956'}
[2023-02-25 13:05:38,573][2409079] DAMAGECOUNT value on done: 4924.0
[2023-02-25 13:05:38,577][2409079] Sum rewards: 7.802, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.008', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.039', 'AMMO3': '0.069', 'HEALTH': '0.208', 'weapon5': '0.230', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'HITCOUNT': '0.650', 'ARMOR': '0.848', 'weapon3': '1.224', 'weapon2': '2.420', 'DAMAGECOUNT': '3.174', 'FRAGCOUNT': '3.500'}
[2023-02-25 13:05:38,988][2409078] DAMAGECOUNT value on done: 4551.0
[2023-02-25 13:05:38,991][2409078] Sum rewards: 8.494, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.817', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO3': '0.071', 'weapon5': '0.164', 'WEAPON5': '0.200', 'WEAPON3': '0.500', 'HITCOUNT': '0.510', 'weapon3': '1.254', 'ARMOR': '1.384', 'weapon2': '2.078', 'DAMAGECOUNT': '2.394', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:39,411][2409547] DAMAGECOUNT value on done: 4206.0
[2023-02-25 13:05:39,412][2409547] Sum rewards: 7.941, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.502', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.037', 'AMMO3': '0.107', 'weapon5': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.318', 'HITCOUNT': '0.600', 'WEAPON3': '0.700', 'ARMOR': '0.887', 'weapon2': '1.056', 'weapon3': '1.672', 'DAMAGECOUNT': '2.475', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:39,444][2409486] DAMAGECOUNT value on done: 3731.0
[2023-02-25 13:05:39,449][2409486] Sum rewards: 7.833, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.476', 'AMMO5': '0.005', 'ARMOR': '0.028', 'AMMO2': '0.031', 'AMMO3': '0.048', 'weapon7': '0.050', 'weapon5': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'WEAPON4': '0.350', 'HITCOUNT': '0.530', 'weapon4': '0.726', 'weapon3': '0.752', 'weapon2': '1.150', 'DAMAGECOUNT': '1.944', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:39,479][2409080] DAMAGECOUNT value on done: 3564.0
[2023-02-25 13:05:39,481][2409080] Sum rewards: -0.289, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.570', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.015', 'WEAPON1': '0.040', 'weapon5': '0.050', 'weapon7': '0.066', 'AMMO3': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.220', 'WEAPON5': '0.300', 'weapon4': '0.320', 'WEAPON3': '0.500', 'weapon2': '0.528', 'weapon3': '0.842', 'DAMAGECOUNT': '0.912', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:05:39,968][2409469] DAMAGECOUNT value on done: 4221.0
[2023-02-25 13:05:39,970][2409469] Sum rewards: 2.342, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.714', 'AMMO5': '0.028', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'AMMO3': '0.135', 'AMMO4': '0.147', 'weapon5': '0.180', 'WEAPON4': '0.250', 'HITCOUNT': '0.340', 'weapon4': '0.412', 'WEAPON5': '0.650', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.317', 'weapon2': '1.442', 'weapon3': '1.464', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:39,992][2409074] Updated weights for policy 0, policy_version 17331 (0.0012)
[2023-02-25 13:05:40,139][2409099] DAMAGECOUNT value on done: 4109.0
[2023-02-25 13:05:40,143][2409099] Sum rewards: 12.766, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.644', 'AMMO2': '0.009', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.043', 'AMMO3': '0.077', 'weapon5': '0.214', 'WEAPON5': '0.400', 'ARMOR': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '0.840', 'weapon3': '1.558', 'weapon2': '1.956', 'DAMAGECOUNT': '3.765', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:05:40,902][2409075] DAMAGECOUNT value on done: 4725.0
[2023-02-25 13:05:40,903][2409075] Sum rewards: 9.602, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.041', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.080', 'weapon5': '0.228', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.570', 'ARMOR': '1.252', 'weapon3': '1.418', 'weapon2': '1.924', 'DAMAGECOUNT': '2.868', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:05:41,192][2409076] DAMAGECOUNT value on done: 3817.0
[2023-02-25 13:05:41,193][2409076] Sum rewards: 1.818, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.170', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'AMMO3': '0.058', 'weapon7': '0.084', 'weapon5': '0.128', 'AMMO4': '0.136', 'HITCOUNT': '0.240', 'WEAPON5': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.446', 'weapon3': '1.004', 'DAMAGECOUNT': '1.083', 'weapon2': '1.424', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:05:41,627][2409097] DAMAGECOUNT value on done: 4374.0
[2023-02-25 13:05:41,630][2409097] Sum rewards: 5.337, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.263', 'AMMO5': '0.009', 'WEAPON1': '0.030', 'AMMO2': '0.033', 'AMMO3': '0.039', 'WEAPON4': '0.050', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.110', 'weapon5': '0.124', 'AMMO4': '0.162', 'weapon4': '0.242', 'WEAPON5': '0.250', 'WEAPON3': '0.250', 'ARMOR': '0.455', 'weapon3': '0.636', 'DAMAGECOUNT': '0.876', 'weapon2': '1.980', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:05:41,734][2409074] Updated weights for policy 0, policy_version 17341 (0.0013)
[2023-02-25 13:05:42,186][2408954] Fps is (10 sec: 25394.7, 60 sec: 25463.4, 300 sec: 25589.6). Total num frames: 71041024. Throughput: 0: 6328.8. Samples: 17761068. Policy #0 lag: (min: 0.0, avg: 13.0, max: 26.0)
[2023-02-25 13:05:42,186][2408954] Avg episode reward: [(0, '6.948')]
[2023-02-25 13:05:42,272][2409079] DAMAGECOUNT value on done: 4472.0
[2023-02-25 13:05:42,275][2409079] Sum rewards: -0.041, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.332', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.072', 'weapon7': '0.100', 'AMMO3': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.340', 'weapon2': '0.534', 'WEAPON3': '0.650', 'weapon4': '0.830', 'ARMOR': '0.878', 'weapon3': '0.942', 'DAMAGECOUNT': '1.440', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:05:42,406][2409096] DAMAGECOUNT value on done: 4907.0
[2023-02-25 13:05:42,407][2409096] Sum rewards: 6.626, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.726', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO3': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.072', 'WEAPON3': '0.100', 'weapon5': '0.110', 'WEAPON5': '0.150', 'weapon7': '0.192', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON4': '0.350', 'HITCOUNT': '0.350', 'ARMOR': '0.453', 'WEAPON7': '0.500', 'weapon3': '0.518', 'weapon4': '0.834', 'weapon2': '0.890', 'DAMAGECOUNT': '1.584', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:42,568][2409078] DAMAGECOUNT value on done: 4334.0
[2023-02-25 13:05:42,569][2409078] Sum rewards: 6.573, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO2': '0.031', 'AMMO3': '0.089', 'WEAPON4': '0.150', 'AMMO4': '0.152', 'weapon5': '0.160', 'weapon4': '0.232', 'HEALTH': '0.340', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'HITCOUNT': '0.500', 'ARMOR': '0.800', 'weapon3': '1.514', 'weapon2': '1.852', 'DAMAGECOUNT': '2.157', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:05:43,199][2409547] DAMAGECOUNT value on done: 5534.0
[2023-02-25 13:05:43,200][2409547] Sum rewards: 10.881, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.014', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.071', 'AMMO3': '0.080', 'weapon4': '0.094', 'weapon7': '0.098', 'weapon5': '0.124', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'HEALTH': '0.552', 'HITCOUNT': '0.640', 'ARMOR': '1.251', 'weapon2': '1.258', 'weapon3': '1.522', 'DAMAGECOUNT': '3.249', 'FRAGCOUNT': '8.500'}
[2023-02-25 13:05:43,201][2409486] DAMAGECOUNT value on done: 3186.0
[2023-02-25 13:05:43,205][2409486] Sum rewards: 6.289, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.438', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.039', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon5': '0.138', 'WEAPON5': '0.150', 'weapon4': '0.244', 'WEAPON3': '0.500', 'HITCOUNT': '0.810', 'ARMOR': '0.908', 'weapon3': '1.608', 'weapon2': '1.700', 'DAMAGECOUNT': '2.925', 'FRAGCOUNT': '3.500'}
[2023-02-25 13:05:43,254][2409074] Updated weights for policy 0, policy_version 17351 (0.0012)
[2023-02-25 13:05:43,579][2409080] DAMAGECOUNT value on done: 4095.0
[2023-02-25 13:05:43,580][2409080] Sum rewards: 6.706, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.674', 'AMMO2': '0.007', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.035', 'weapon5': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'weapon4': '0.246', 'WEAPON5': '0.350', 'ARMOR': '0.482', 'HITCOUNT': '0.520', 'WEAPON3': '0.650', 'weapon2': '0.962', 'weapon3': '1.804', 'DAMAGECOUNT': '2.235', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:43,689][2409469] DAMAGECOUNT value on done: 3970.0
[2023-02-25 13:05:43,704][2409469] Sum rewards: 7.588, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.944', 'AMMO2': '0.009', 'AMMO5': '0.018', 'AMMO4': '0.045', 'AMMO3': '0.069', 'weapon7': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.162', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'HITCOUNT': '0.410', 'WEAPON3': '0.500', 'weapon4': '0.576', 'ARMOR': '0.973', 'weapon3': '1.154', 'weapon2': '1.336', 'DAMAGECOUNT': '2.151', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:43,909][2409099] DAMAGECOUNT value on done: 3752.0
[2023-02-25 13:05:43,913][2409099] Sum rewards: 7.340, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.155', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO3': '0.058', 'AMMO4': '0.088', 'WEAPON5': '0.150', 'weapon5': '0.154', 'WEAPON4': '0.200', 'WEAPON3': '0.400', 'weapon4': '0.520', 'HITCOUNT': '0.650', 'ARMOR': '0.897', 'weapon3': '1.000', 'weapon2': '1.578', 'DAMAGECOUNT': '2.274', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:05:44,528][2409075] DAMAGECOUNT value on done: 4424.0
[2023-02-25 13:05:44,532][2409075] Sum rewards: 2.616, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO2': '0.006', 'AMMO5': '0.010', 'HEALTH': '0.011', 'AMMO4': '0.032', 'AMMO3': '0.040', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'weapon5': '0.180', 'WEAPON5': '0.200', 'WEAPON3': '0.250', 'DAMAGECOUNT': '0.387', 'ARMOR': '0.400', 'weapon4': '0.428', 'weapon2': '0.710', 'weapon3': '0.992', 'FRAGCOUNT': '1.000'}
[2023-02-25 13:05:44,792][2409074] Updated weights for policy 0, policy_version 17361 (0.0012)
[2023-02-25 13:05:45,041][2409076] DAMAGECOUNT value on done: 4002.0
[2023-02-25 13:05:45,042][2409076] Sum rewards: 4.951, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.198', 'weapon7': '0.014', 'AMMO5': '0.026', 'AMMO2': '0.029', 'WEAPON1': '0.050', 'AMMO3': '0.109', 'weapon4': '0.114', 'weapon5': '0.142', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.600', 'HITCOUNT': '0.680', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'weapon3': '1.704', 'weapon2': '1.714', 'DAMAGECOUNT': '2.271', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:45,413][2409097] DAMAGECOUNT value on done: 4235.0
[2023-02-25 13:05:45,414][2409097] Sum rewards: 3.322, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.222', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.038', 'weapon7': '0.050', 'AMMO3': '0.092', 'weapon5': '0.098', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.222', 'ARMOR': '0.400', 'HITCOUNT': '0.460', 'WEAPON3': '0.500', 'weapon2': '0.866', 'weapon3': '1.062', 'DAMAGECOUNT': '1.998', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:05:46,103][2409079] DAMAGECOUNT value on done: 4986.0
[2023-02-25 13:05:46,103][2409079] Sum rewards: 13.120, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.137', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon7': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.103', 'weapon5': '0.114', 'WEAPON5': '0.150', 'weapon4': '0.260', 'WEAPON3': '0.450', 'HITCOUNT': '0.580', 'ARMOR': '0.800', 'weapon3': '1.466', 'weapon2': '1.684', 'DAMAGECOUNT': '2.622', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:05:46,297][2409078] DAMAGECOUNT value on done: 3529.0
[2023-02-25 13:05:46,298][2409078] Sum rewards: 8.433, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.412', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.022', 'AMMO3': '0.030', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.124', 'WEAPON5': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.470', 'weapon3': '0.744', 'ARMOR': '0.856', 'DAMAGECOUNT': '2.136', 'weapon2': '2.654', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:05:46,359][2409096] DAMAGECOUNT value on done: 4124.0
[2023-02-25 13:05:46,362][2409096] Sum rewards: 4.938, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.507', 'AMMO2': '0.004', 'AMMO5': '0.015', 'AMMO4': '0.018', 'WEAPON1': '0.030', 'AMMO3': '0.111', 'WEAPON4': '0.200', 'weapon5': '0.252', 'HITCOUNT': '0.420', 'weapon4': '0.420', 'WEAPON5': '0.450', 'ARMOR': '0.489', 'weapon2': '0.700', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.476', 'weapon3': '2.060', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:46,733][2409074] Updated weights for policy 0, policy_version 17371 (0.0012)
[2023-02-25 13:05:47,033][2409547] DAMAGECOUNT value on done: 3621.0
[2023-02-25 13:05:47,033][2409547] Sum rewards: 7.021, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.364', 'AMMO2': '0.006', 'AMMO5': '0.025', 'WEAPON1': '0.030', 'AMMO4': '0.032', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'weapon5': '0.164', 'weapon4': '0.300', 'WEAPON5': '0.550', 'HITCOUNT': '0.730', 'WEAPON3': '0.850', 'weapon2': '1.250', 'weapon3': '1.822', 'DAMAGECOUNT': '2.610', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:05:47,186][2408954] Fps is (10 sec: 24166.4, 60 sec: 25326.9, 300 sec: 25547.9). Total num frames: 71159808. Throughput: 0: 6317.7. Samples: 17799084. Policy #0 lag: (min: 0.0, avg: 13.1, max: 25.0)
[2023-02-25 13:05:47,187][2408954] Avg episode reward: [(0, '6.816')]
[2023-02-25 13:05:47,369][2409096] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:05:47,400][2409486] DAMAGECOUNT value on done: 5265.0
[2023-02-25 13:05:47,403][2409486] Sum rewards: 8.786, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.420', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'weapon4': '0.024', 'AMMO2': '0.031', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'AMMO4': '0.152', 'weapon5': '0.194', 'WEAPON5': '0.400', 'ARMOR': '0.456', 'HITCOUNT': '0.630', 'WEAPON3': '0.750', 'weapon2': '1.542', 'weapon3': '1.634', 'DAMAGECOUNT': '2.898', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:05:47,617][2409080] DAMAGECOUNT value on done: 3239.0
[2023-02-25 13:05:47,621][2409080] Sum rewards: 3.920, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.030', 'weapon5': '0.060', 'AMMO4': '0.079', 'HEALTH': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon7': '0.124', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.220', 'weapon4': '0.228', 'weapon3': '0.624', 'weapon2': '1.078', 'DAMAGECOUNT': '1.104', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:05:47,698][2409469] DAMAGECOUNT value on done: 3305.0
[2023-02-25 13:05:47,698][2409469] Sum rewards: 4.271, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO2': '0.051', 'AMMO3': '0.070', 'weapon7': '0.074', 'weapon5': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.255', 'WEAPON4': '0.350', 'WEAPON3': '0.350', 'ARMOR': '0.428', 'HITCOUNT': '0.440', 'HEALTH': '0.605', 'weapon4': '0.968', 'weapon3': '1.082', 'weapon2': '1.212', 'DAMAGECOUNT': '1.683', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:05:48,043][2409074] Updated weights for policy 0, policy_version 17381 (0.0013)
[2023-02-25 13:05:48,060][2409075] DAMAGECOUNT value on done: 4019.0
[2023-02-25 13:05:48,061][2409075] Sum rewards: 1.605, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.750', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'weapon7': '0.048', 'AMMO3': '0.057', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'weapon4': '0.440', 'ARMOR': '0.516', 'weapon2': '0.520', 'weapon3': '0.936', 'DAMAGECOUNT': '1.098', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:05:48,561][2409099] DAMAGECOUNT value on done: 4281.0
[2023-02-25 13:05:48,562][2409099] Sum rewards: 8.048, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.395', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO3': '0.065', 'weapon7': '0.106', 'weapon5': '0.118', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'HITCOUNT': '0.360', 'WEAPON5': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.400', 'weapon4': '0.454', 'ARMOR': '0.850', 'weapon3': '0.930', 'weapon2': '1.396', 'DAMAGECOUNT': '3.015', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:05:49,279][2409074] Updated weights for policy 0, policy_version 17391 (0.0012)
[2023-02-25 13:05:49,945][2409078] DAMAGECOUNT value on done: 4585.0
[2023-02-25 13:05:49,948][2409078] Sum rewards: 9.626, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.094', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.103', 'weapon5': '0.316', 'WEAPON5': '0.350', 'HEALTH': '0.370', 'ARMOR': '0.400', 'HITCOUNT': '0.520', 'WEAPON3': '0.550', 'weapon3': '1.490', 'weapon2': '1.962', 'DAMAGECOUNT': '2.862', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:05:50,122][2409096] DAMAGECOUNT value on done: 4425.0
[2023-02-25 13:05:50,125][2409096] Sum rewards: 8.995, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.343', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'weapon4': '0.032', 'AMMO4': '0.046', 'AMMO3': '0.073', 'weapon7': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.132', 'WEAPON7': '0.200', 'HITCOUNT': '0.350', 'ARMOR': '0.496', 'WEAPON3': '0.500', 'weapon3': '1.300', 'weapon2': '1.354', 'DAMAGECOUNT': '1.791', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:05:50,712][2409547] DAMAGECOUNT value on done: 4383.0
[2023-02-25 13:05:50,716][2409547] Sum rewards: 10.103, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.364', 'AMMO2': '0.010', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.052', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'weapon5': '0.132', 'WEAPON5': '0.350', 'weapon4': '0.422', 'WEAPON3': '0.550', 'HITCOUNT': '0.780', 'ARMOR': '0.856', 'weapon2': '1.124', 'weapon3': '1.382', 'DAMAGECOUNT': '3.096', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:50,787][2409079] DAMAGECOUNT value on done: 4254.0
[2023-02-25 13:05:50,788][2409079] Sum rewards: 9.758, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.050', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.021', 'WEAPON1': '0.050', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon7': '0.100', 'weapon5': '0.112', 'weapon4': '0.134', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'WEAPON7': '0.400', 'HITCOUNT': '0.430', 'ARMOR': '0.451', 'WEAPON3': '0.500', 'weapon2': '1.318', 'weapon3': '1.346', 'DAMAGECOUNT': '3.042', 'FRAGCOUNT': '6.500'}
[2023-02-25 13:05:51,330][2409074] Updated weights for policy 0, policy_version 17401 (0.0013)
[2023-02-25 13:05:51,491][2409486] DAMAGECOUNT value on done: 3574.0
[2023-02-25 13:05:51,494][2409486] Sum rewards: 6.905, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.370', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'AMMO3': '0.065', 'AMMO4': '0.112', 'weapon7': '0.112', 'weapon5': '0.154', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.390', 'WEAPON3': '0.400', 'ARMOR': '0.443', 'weapon2': '0.706', 'weapon4': '0.714', 'weapon3': '0.836', 'DAMAGECOUNT': '1.803', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:51,554][2409468] DAMAGECOUNT value on done: 4782.0
[2023-02-25 13:05:51,557][2409468] Sum rewards: 6.877, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.340', 'AMMO2': '0.011', 'AMMO5': '0.014', 'weapon7': '0.048', 'AMMO4': '0.054', 'WEAPON1': '0.060', 'AMMO3': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.160', 'WEAPON5': '0.400', 'weapon4': '0.428', 'ARMOR': '0.456', 'HITCOUNT': '0.580', 'WEAPON3': '0.700', 'weapon2': '1.346', 'weapon3': '1.532', 'DAMAGECOUNT': '2.391', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:05:51,664][2409080] DAMAGECOUNT value on done: 4287.0
[2023-02-25 13:05:51,668][2409080] Sum rewards: 5.776, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.364', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon7': '0.048', 'AMMO3': '0.081', 'weapon5': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.185', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.406', 'WEAPON3': '0.600', 'HITCOUNT': '0.640', 'ARMOR': '0.800', 'weapon2': '1.386', 'weapon3': '1.530', 'DAMAGECOUNT': '3.219', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:52,199][2408954] Fps is (10 sec: 25363.0, 60 sec: 25321.5, 300 sec: 25602.4). Total num frames: 71294976. Throughput: 0: 6317.1. Samples: 17818296. Policy #0 lag: (min: 0.0, avg: 13.1, max: 25.0)
[2023-02-25 13:05:52,199][2408954] Avg episode reward: [(0, '7.044')]
[2023-02-25 13:05:52,350][2409099] DAMAGECOUNT value on done: 5187.0
[2023-02-25 13:05:52,353][2409099] Sum rewards: 6.182, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.038', 'AMMO2': '0.021', 'AMMO5': '0.021', 'WEAPON1': '0.040', 'weapon4': '0.086', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'weapon5': '0.118', 'WEAPON5': '0.400', 'ARMOR': '0.456', 'HITCOUNT': '0.690', 'WEAPON3': '0.750', 'weapon3': '1.740', 'weapon2': '1.854', 'DAMAGECOUNT': '2.748', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:52,821][2409074] Updated weights for policy 0, policy_version 17411 (0.0012)
[2023-02-25 13:05:53,868][2409096] DAMAGECOUNT value on done: 3101.0
[2023-02-25 13:05:53,872][2409096] Sum rewards: 6.636, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.341', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'weapon7': '0.016', 'AMMO3': '0.066', 'weapon5': '0.098', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.222', 'WEAPON5': '0.350', 'HITCOUNT': '0.430', 'WEAPON3': '0.450', 'weapon3': '0.680', 'ARMOR': '1.282', 'DAMAGECOUNT': '1.779', 'weapon2': '1.862', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:54,546][2409547] DAMAGECOUNT value on done: 3741.0
[2023-02-25 13:05:54,549][2409547] Sum rewards: 0.467, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.986', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon7': '0.050', 'AMMO3': '0.077', 'weapon5': '0.120', 'AMMO4': '0.163', 'WEAPON4': '0.300', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.642', 'weapon3': '0.700', 'DAMAGECOUNT': '1.281', 'weapon2': '1.472', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:05:54,716][2409079] DAMAGECOUNT value on done: 5602.0
[2023-02-25 13:05:54,716][2409079] Sum rewards: 10.819, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.430', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.079', 'AMMO3': '0.081', 'weapon5': '0.094', 'weapon7': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.438', 'WEAPON3': '0.500', 'HITCOUNT': '0.610', 'ARMOR': '0.800', 'weapon3': '1.274', 'weapon2': '1.412', 'DAMAGECOUNT': '2.967', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:05:54,813][2409074] Updated weights for policy 0, policy_version 17421 (0.0012)
[2023-02-25 13:05:55,261][2409486] DAMAGECOUNT value on done: 4387.0
[2023-02-25 13:05:55,262][2409486] Sum rewards: 11.583, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.282', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO3': '0.050', 'weapon7': '0.050', 'AMMO4': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.170', 'WEAPON3': '0.400', 'weapon4': '0.426', 'HITCOUNT': '0.440', 'ARMOR': '0.895', 'weapon2': '1.222', 'weapon3': '1.254', 'DAMAGECOUNT': '2.025', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:05:55,916][2409468] DAMAGECOUNT value on done: 3564.0
[2023-02-25 13:05:55,917][2409468] Sum rewards: 7.433, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.622', 'AMMO5': '0.021', 'AMMO2': '0.040', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO3': '0.083', 'weapon5': '0.146', 'AMMO4': '0.199', 'WEAPON4': '0.250', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'weapon2': '0.398', 'ARMOR': '0.400', 'weapon4': '0.498', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.710', 'weapon3': '1.368', 'DAMAGECOUNT': '2.652', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:56,016][2409080] DAMAGECOUNT value on done: 4591.0
[2023-02-25 13:05:56,017][2409080] Sum rewards: 8.569, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.216', 'AMMO2': '0.011', 'AMMO5': '0.012', 'AMMO4': '0.052', 'AMMO3': '0.096', 'weapon5': '0.124', 'WEAPON4': '0.200', 'weapon4': '0.258', 'WEAPON5': '0.300', 'HITCOUNT': '0.640', 'WEAPON3': '0.650', 'ARMOR': '0.900', 'weapon2': '1.394', 'weapon3': '1.772', 'DAMAGECOUNT': '2.625', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:05:56,284][2409099] DAMAGECOUNT value on done: 4535.0
[2023-02-25 13:05:56,287][2409099] Sum rewards: 8.768, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.844', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'AMMO5': '0.003', 'AMMO3': '0.010', 'WEAPON1': '0.020', 'weapon5': '0.066', 'WEAPON3': '0.100', 'WEAPON5': '0.100', 'weapon7': '0.106', 'HITCOUNT': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon3': '0.286', 'WEAPON7': '0.400', 'ARMOR': '0.936', 'weapon2': '1.178', 'DAMAGECOUNT': '2.031', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:56,369][2409074] Updated weights for policy 0, policy_version 17431 (0.0012)
[2023-02-25 13:05:57,199][2408954] Fps is (10 sec: 26589.7, 60 sec: 25321.5, 300 sec: 25602.4). Total num frames: 71426048. Throughput: 0: 6327.0. Samples: 17856432. Policy #0 lag: (min: 0.0, avg: 13.1, max: 25.0)
[2023-02-25 13:05:57,199][2408954] Avg episode reward: [(0, '7.003')]
[2023-02-25 13:05:57,657][2409074] Updated weights for policy 0, policy_version 17441 (0.0012)
[2023-02-25 13:05:58,015][2409075] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:05:58,469][2409547] DAMAGECOUNT value on done: 4383.0
[2023-02-25 13:05:58,472][2409547] Sum rewards: 5.646, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.054', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO3': '0.057', 'weapon5': '0.062', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.105', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'HITCOUNT': '0.430', 'weapon4': '0.594', 'weapon2': '0.640', 'ARMOR': '0.800', 'weapon3': '1.034', 'DAMAGECOUNT': '2.166', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:05:58,502][2409079] DAMAGECOUNT value on done: 3881.0
[2023-02-25 13:05:58,503][2409079] Sum rewards: 1.817, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.723', 'AMMO2': '0.009', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.043', 'AMMO3': '0.100', 'weapon5': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.280', 'WEAPON5': '0.300', 'HITCOUNT': '0.540', 'WEAPON3': '0.700', 'weapon2': '1.292', 'weapon3': '1.846', 'DAMAGECOUNT': '2.277', 'FRAGCOUNT': '2.500'}
[2023-02-25 13:05:58,562][2409096] DAMAGECOUNT value on done: 4458.0
[2023-02-25 13:05:58,565][2409096] Sum rewards: 9.596, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.009', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'AMMO4': '0.130', 'weapon5': '0.132', 'weapon4': '0.178', 'WEAPON5': '0.200', 'HEALTH': '0.392', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.440', 'weapon2': '1.332', 'weapon3': '1.746', 'DAMAGECOUNT': '2.550', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:05:59,517][2409074] Updated weights for policy 0, policy_version 17451 (0.0012)
[2023-02-25 13:05:59,682][2409486] DAMAGECOUNT value on done: 3608.0
[2023-02-25 13:05:59,683][2409486] Sum rewards: 8.271, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.097', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.027', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.110', 'weapon5': '0.116', 'WEAPON5': '0.150', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.500', 'weapon3': '1.062', 'DAMAGECOUNT': '1.737', 'weapon2': '2.156', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:05:59,744][2409468] DAMAGECOUNT value on done: 4851.0
[2023-02-25 13:05:59,748][2409468] Sum rewards: 4.922, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.652', 'AMMO5': '0.006', 'AMMO2': '0.011', 'AMMO3': '0.020', 'AMMO4': '0.055', 'weapon7': '0.094', 'weapon5': '0.112', 'WEAPON3': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.272', 'WEAPON7': '0.300', 'HITCOUNT': '0.350', 'weapon3': '0.488', 'ARMOR': '0.855', 'DAMAGECOUNT': '1.260', 'weapon2': '1.560', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:05:59,792][2409080] DAMAGECOUNT value on done: 3749.0
[2023-02-25 13:05:59,793][2409080] Sum rewards: 2.621, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.992', 'AMMO5': '0.012', 'AMMO2': '0.019', 'ARMOR': '0.036', 'WEAPON1': '0.050', 'weapon5': '0.072', 'AMMO4': '0.093', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'weapon4': '0.184', 'WEAPON5': '0.300', 'HITCOUNT': '0.540', 'WEAPON3': '0.700', 'weapon2': '1.602', 'DAMAGECOUNT': '1.650', 'weapon3': '1.842', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:06:00,275][2409097] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)]
[2023-02-25 13:06:00,653][2409078] Large shaping reward 2.568 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.537, 179.0), ('AMMO2', -0.0001, -1.0), ('AMMO4', -0.0005, -1.0), ('weapon2', 0.002)]
[2023-02-25 13:06:00,680][2409099] DAMAGECOUNT value on done: 4251.0
[2023-02-25 13:06:00,681][2409099] Sum rewards: 11.572, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.550', 'AMMO5': '0.010', 'AMMO2': '0.024', 'WEAPON1': '0.060', 'AMMO3': '0.100', 'AMMO4': '0.119', 'weapon5': '0.122', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'ARMOR': '0.492', 'weapon4': '0.514', 'HITCOUNT': '0.530', 'WEAPON3': '0.650', 'weapon2': '1.188', 'weapon3': '1.706', 'DAMAGECOUNT': '2.757', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:06:00,791][2409074] Updated weights for policy 0, policy_version 17461 (0.0012)
[2023-02-25 13:06:02,186][2408954] Fps is (10 sec: 25017.7, 60 sec: 25397.1, 300 sec: 25575.7). Total num frames: 71544832. Throughput: 0: 6317.6. Samples: 17893440. Policy #0 lag: (min: 0.0, avg: 12.2, max: 26.0)
[2023-02-25 13:06:02,186][2408954] Avg episode reward: [(0, '6.879')]
[2023-02-25 13:06:02,229][2409547] DAMAGECOUNT value on done: 4424.0
[2023-02-25 13:06:02,233][2409547] Sum rewards: 9.978, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.204', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'AMMO2': '0.041', 'weapon7': '0.064', 'weapon5': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.207', 'WEAPON3': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.580', 'weapon4': '0.720', 'weapon2': '0.868', 'weapon3': '1.000', 'ARMOR': '1.300', 'DAMAGECOUNT': '2.325', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:06:02,333][2409079] DAMAGECOUNT value on done: 2988.0
[2023-02-25 13:06:02,337][2409079] Sum rewards: 1.986, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.672', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.016', 'weapon7': '0.048', 'weapon4': '0.068', 'AMMO4': '0.080', 'AMMO3': '0.085', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.174', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'HITCOUNT': '0.360', 'ARMOR': '0.495', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.155', 'weapon2': '1.180', 'weapon3': '1.184', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:06:02,540][2409096] DAMAGECOUNT value on done: 4420.0
[2023-02-25 13:06:02,543][2409096] Sum rewards: 2.412, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.872', 'AMMO5': '0.008', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'ARMOR': '0.024', 'AMMO4': '0.042', 'weapon7': '0.050', 'AMMO3': '0.063', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.350', 'WEAPON3': '0.450', 'weapon4': '0.612', 'weapon3': '1.122', 'weapon2': '1.158', 'DAMAGECOUNT': '1.296', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:06:02,608][2409074] Updated weights for policy 0, policy_version 17471 (0.0012)
[2023-02-25 13:06:03,468][2409486] DAMAGECOUNT value on done: 5106.0
[2023-02-25 13:06:03,469][2409486] Sum rewards: 10.552, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.334', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon7': '0.058', 'AMMO3': '0.066', 'weapon5': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'ARMOR': '0.400', 'weapon4': '0.430', 'WEAPON3': '0.450', 'HITCOUNT': '0.680', 'weapon3': '1.326', 'weapon2': '1.700', 'DAMAGECOUNT': '2.655', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:06:03,860][2409468] DAMAGECOUNT value on done: 3469.0
[2023-02-25 13:06:03,863][2409468] Sum rewards: 7.962, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.088', 'AMMO5': '0.003', 'weapon5': '0.020', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.108', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'HITCOUNT': '0.450', 'ARMOR': '0.903', 'weapon3': '0.976', 'weapon4': '0.988', 'weapon2': '1.426', 'DAMAGECOUNT': '1.644', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:06:03,875][2409080] DAMAGECOUNT value on done: 4614.0
[2023-02-25 13:06:03,879][2409080] Sum rewards: 4.205, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.304', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon5': '0.048', 'weapon7': '0.056', 'AMMO3': '0.074', 'weapon4': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'ARMOR': '0.845', 'weapon3': '1.098', 'weapon2': '1.826', 'DAMAGECOUNT': '2.001', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:06:04,297][2409099] DAMAGECOUNT value on done: 4348.0
[2023-02-25 13:06:04,301][2409099] Sum rewards: 7.869, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.879', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.007', 'WEAPON1': '0.050', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'weapon5': '0.150', 'weapon4': '0.228', 'WEAPON5': '0.300', 'HITCOUNT': '0.640', 'WEAPON3': '0.650', 'ARMOR': '0.944', 'weapon2': '1.610', 'weapon3': '1.628', 'DAMAGECOUNT': '2.388', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:06:04,436][2409074] Updated weights for policy 0, policy_version 17481 (0.0013)
[2023-02-25 13:06:05,431][2409549] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)]
[2023-02-25 13:06:06,111][2409074] Updated weights for policy 0, policy_version 17491 (0.0013)
[2023-02-25 13:06:06,263][2409547] DAMAGECOUNT value on done: 4853.0
[2023-02-25 13:06:06,264][2409547] Sum rewards: 5.847, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.056', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'weapon7': '0.048', 'AMMO3': '0.069', 'AMMO4': '0.093', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.282', 'WEAPON3': '0.450', 'HITCOUNT': '0.700', 'ARMOR': '0.883', 'weapon3': '1.230', 'weapon2': '1.394', 'DAMAGECOUNT': '2.085', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:06:07,186][2408954] Fps is (10 sec: 24197.6, 60 sec: 25190.3, 300 sec: 25561.8). Total num frames: 71667712. Throughput: 0: 6305.9. Samples: 17912064. Policy #0 lag: (min: 0.0, avg: 12.2, max: 26.0)
[2023-02-25 13:06:07,186][2408954] Avg episode reward: [(0, '6.679')]
[2023-02-25 13:06:08,097][2409080] DAMAGECOUNT value on done: 4315.0
[2023-02-25 13:06:08,100][2409468] DAMAGECOUNT value on done: 5225.0
[2023-02-25 13:06:08,098][2409080] Sum rewards: 9.611, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.556', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.034', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon7': '0.076', 'AMMO3': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.238', 'WEAPON4': '0.250', 'WEAPON3': '0.700', 'ARMOR': '0.907', 'HITCOUNT': '0.940', 'weapon2': '1.464', 'weapon3': '1.478', 'DAMAGECOUNT': '3.156', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:06:08,101][2409468] Sum rewards: 9.878, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.780', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO3': '0.048', 'AMMO4': '0.132', 'weapon7': '0.142', 'weapon5': '0.144', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'WEAPON4': '0.400', 'HITCOUNT': '0.500', 'weapon4': '0.656', 'weapon3': '0.780', 'weapon2': '1.240', 'DAMAGECOUNT': '3.492', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:06:08,276][2409074] Updated weights for policy 0, policy_version 17501 (0.0012)
[2023-02-25 13:06:08,581][2409099] DAMAGECOUNT value on done: 4295.0
[2023-02-25 13:06:08,584][2409099] Sum rewards: 8.754, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.220', 'AMMO2': '0.006', 'AMMO5': '0.019', 'AMMO4': '0.028', 'WEAPON1': '0.040', 'AMMO3': '0.106', 'weapon5': '0.274', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.750', 'ARMOR': '0.888', 'weapon2': '1.504', 'weapon3': '1.902', 'DAMAGECOUNT': '2.856', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:06:09,280][2409074] Updated weights for policy 0, policy_version 17511 (0.0013)
[2023-02-25 13:06:10,013][2409547] DAMAGECOUNT value on done: 4557.0
[2023-02-25 13:06:10,017][2409547] Sum rewards: 8.803, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.400', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO3': '0.062', 'WEAPON4': '0.100', 'AMMO4': '0.125', 'weapon5': '0.126', 'WEAPON5': '0.300', 'weapon4': '0.440', 'WEAPON3': '0.450', 'HITCOUNT': '0.650', 'weapon3': '1.298', 'weapon2': '1.560', 'DAMAGECOUNT': '2.538', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:06:10,880][2409074] Updated weights for policy 0, policy_version 17521 (0.0013)
[2023-02-25 13:06:12,186][2408954] Fps is (10 sec: 25395.4, 60 sec: 25258.7, 300 sec: 25561.8). Total num frames: 71798784. Throughput: 0: 6279.2. Samples: 17948652. Policy #0 lag: (min: 0.0, avg: 14.2, max: 30.0)
[2023-02-25 13:06:12,186][2408954] Avg episode reward: [(0, '6.653')]
[2023-02-25 13:06:12,353][2409099] DAMAGECOUNT value on done: 4625.0
[2023-02-25 13:06:12,356][2409099] Sum rewards: 8.600, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.782', 'AMMO5': '0.015', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO3': '0.070', 'AMMO4': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.196', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.390', 'WEAPON5': '0.400', 'ARMOR': '0.450', 'WEAPON3': '0.500', 'HITCOUNT': '0.610', 'weapon2': '0.962', 'weapon3': '1.578', 'DAMAGECOUNT': '2.607', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:06:12,410][2409080] DAMAGECOUNT value on done: 4741.0
[2023-02-25 13:06:12,414][2409080] Sum rewards: 4.256, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.594', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.079', 'AMMO3': '0.087', 'weapon4': '0.138', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'HITCOUNT': '0.640', 'ARMOR': '0.858', 'weapon3': '1.676', 'weapon2': '1.800', 'DAMAGECOUNT': '2.124', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:06:12,460][2409468] DAMAGECOUNT value on done: 3602.0
[2023-02-25 13:06:12,463][2409468] Sum rewards: 3.203, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.752', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.040', 'AMMO4': '0.041', 'weapon7': '0.050', 'weapon5': '0.062', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.125', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'HITCOUNT': '0.750', 'weapon4': '0.752', 'WEAPON3': '0.800', 'weapon2': '1.310', 'weapon3': '1.578', 'DAMAGECOUNT': '2.241', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:06:12,793][2409074] Updated weights for policy 0, policy_version 17531 (0.0012)
[2023-02-25 13:06:13,796][2409547] DAMAGECOUNT value on done: 3571.0
[2023-02-25 13:06:13,799][2409547] Sum rewards: 7.826, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.298', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO4': '0.033', 'weapon7': '0.088', 'weapon4': '0.094', 'AMMO3': '0.109', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.640', 'WEAPON3': '0.650', 'weapon3': '1.196', 'ARMOR': '1.764', 'weapon2': '2.088', 'DAMAGECOUNT': '2.265', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:06:14,370][2409074] Updated weights for policy 0, policy_version 17541 (0.0012)
[2023-02-25 13:06:16,043][2409074] Updated weights for policy 0, policy_version 17551 (0.0012)
[2023-02-25 13:06:16,095][2409033] Signal inference workers to stop experience collection... (2150 times)
[2023-02-25 13:06:16,109][2409033] Signal inference workers to resume experience collection... (2150 times)
[2023-02-25 13:06:16,127][2409074] InferenceWorker_p0-w0: stopping experience collection (2150 times)
[2023-02-25 13:06:16,151][2409074] InferenceWorker_p0-w0: resuming experience collection (2150 times)
[2023-02-25 13:06:16,461][2409080] DAMAGECOUNT value on done: 4713.0
[2023-02-25 13:06:16,464][2409080] Sum rewards: 8.061, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.360', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.040', 'AMMO3': '0.066', 'AMMO4': '0.199', 'WEAPON5': '0.200', 'weapon5': '0.210', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'weapon4': '0.546', 'HITCOUNT': '0.590', 'weapon3': '1.240', 'weapon2': '1.650', 'DAMAGECOUNT': '2.250', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:06:16,511][2409468] DAMAGECOUNT value on done: 4655.0
[2023-02-25 13:06:16,512][2409468] Sum rewards: 2.006, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.324', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'weapon5': '0.020', 'weapon7': '0.040', 'AMMO4': '0.043', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.122', 'WEAPON7': '0.200', 'WEAPON4': '0.500', 'HITCOUNT': '0.500', 'WEAPON3': '0.700', 'weapon2': '0.866', 'weapon4': '1.282', 'weapon3': '1.344', 'ARMOR': '1.404', 'DAMAGECOUNT': '2.445', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:06:16,555][2409099] DAMAGECOUNT value on done: 4532.0
[2023-02-25 13:06:16,556][2409099] Sum rewards: 7.616, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.370', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'weapon7': '0.010', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'weapon4': '0.030', 'AMMO3': '0.070', 'weapon5': '0.086', 'WEAPON4': '0.100', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.445', 'WEAPON3': '0.500', 'HITCOUNT': '0.740', 'weapon3': '1.284', 'weapon2': '2.140', 'DAMAGECOUNT': '2.427', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:06:17,186][2408954] Fps is (10 sec: 24985.6, 60 sec: 25122.1, 300 sec: 25547.9). Total num frames: 71917568. Throughput: 0: 6280.3. Samples: 17986380. Policy #0 lag: (min: 0.0, avg: 14.2, max: 30.0)
[2023-02-25 13:06:17,186][2408954] Avg episode reward: [(0, '6.622')]
[2023-02-25 13:06:17,193][2409033] Saving /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000017558_71917568.pth...
[2023-02-25 13:06:17,298][2409033] Removing /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000016063_65794048.pth
[2023-02-25 13:06:17,538][2409547] DAMAGECOUNT value on done: 4543.0
[2023-02-25 13:06:17,539][2409547] Sum rewards: 7.746, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.795', 'AMMO2': '0.006', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.078', 'weapon4': '0.088', 'weapon5': '0.122', 'WEAPON5': '0.350', 'HITCOUNT': '0.380', 'WEAPON3': '0.400', 'ARMOR': '0.490', 'weapon3': '1.348', 'weapon2': '2.318', 'DAMAGECOUNT': '2.346', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:06:17,818][2409074] Updated weights for policy 0, policy_version 17561 (0.0012)
[2023-02-25 13:06:19,216][2409074] Updated weights for policy 0, policy_version 17571 (0.0013)
[2023-02-25 13:06:20,343][2409080] DAMAGECOUNT value on done: 4179.0
[2023-02-25 13:06:20,343][2409080] Sum rewards: 12.244, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.092', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO3': '0.106', 'AMMO4': '0.109', 'weapon5': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'HITCOUNT': '0.420', 'WEAPON3': '0.500', 'weapon4': '0.540', 'ARMOR': '0.871', 'weapon2': '1.076', 'weapon3': '1.542', 'DAMAGECOUNT': '2.640', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:06:20,388][2409468] DAMAGECOUNT value on done: 4915.0
[2023-02-25 13:06:20,389][2409468] Sum rewards: 5.912, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.760', 'AMMO4': '-0.071', 'AMMO2': '-0.014', 'AMMO5': '0.003', 'AMMO3': '0.020', 'weapon5': '0.050', 'WEAPON5': '0.100', 'weapon7': '0.122', 'HITCOUNT': '0.190', 'WEAPON3': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'ARMOR': '0.452', 'weapon3': '0.512', 'DAMAGECOUNT': '0.876', 'weapon2': '1.852', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:06:21,061][2409074] Updated weights for policy 0, policy_version 17581 (0.0012)
[2023-02-25 13:06:21,065][2409099] DAMAGECOUNT value on done: 4151.0
[2023-02-25 13:06:21,066][2409099] Sum rewards: 5.622, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.544', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.030', 'weapon7': '0.050', 'AMMO4': '0.059', 'AMMO3': '0.078', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.130', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.450', 'WEAPON3': '0.550', 'weapon3': '1.316', 'DAMAGECOUNT': '1.725', 'weapon2': '1.834', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:06:21,348][2409547] DAMAGECOUNT value on done: 4204.0
[2023-02-25 13:06:21,351][2409547] Sum rewards: 6.671, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.986', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.082', 'weapon5': '0.142', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.560', 'WEAPON3': '0.700', 'weapon2': '1.274', 'weapon3': '1.840', 'DAMAGECOUNT': '2.265', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:06:22,186][2408954] Fps is (10 sec: 24166.4, 60 sec: 25190.4, 300 sec: 25547.9). Total num frames: 72040448. Throughput: 0: 6268.0. Samples: 18005076. Policy #0 lag: (min: 0.0, avg: 14.2, max: 30.0)
[2023-02-25 13:06:22,186][2408954] Avg episode reward: [(0, '6.643')]
[2023-02-25 13:06:22,361][2409074] Updated weights for policy 0, policy_version 17591 (0.0012)
[2023-02-25 13:06:23,950][2409074] Updated weights for policy 0, policy_version 17601 (0.0013)
[2023-02-25 13:06:24,622][2409080] DAMAGECOUNT value on done: 3486.0
[2023-02-25 13:06:24,625][2409080] Sum rewards: 5.346, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.824', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.032', 'AMMO3': '0.082', 'weapon7': '0.096', 'WEAPON4': '0.100', 'weapon5': '0.174', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.590', 'WEAPON3': '0.650', 'weapon3': '1.470', 'weapon2': '1.736', 'DAMAGECOUNT': '2.160', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:06:24,723][2409468] DAMAGECOUNT value on done: 4970.0
[2023-02-25 13:06:24,724][2409468] Sum rewards: 7.513, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.216', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.080', 'weapon7': '0.122', 'AMMO4': '0.123', 'weapon5': '0.128', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'HITCOUNT': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.466', 'weapon2': '1.090', 'weapon3': '1.520', 'DAMAGECOUNT': '1.893', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:06:25,214][2409099] DAMAGECOUNT value on done: 4317.0
[2023-02-25 13:06:25,216][2409099] Sum rewards: 1.330, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.879', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO3': '0.051', 'weapon7': '0.076', 'AMMO4': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.200', 'HITCOUNT': '0.240', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.699', 'FRAGCOUNT': '1.000', 'weapon3': '1.198', 'weapon2': '1.234'}
[2023-02-25 13:06:25,797][2409074] Updated weights for policy 0, policy_version 17611 (0.0012)
[2023-02-25 13:06:25,878][2409547] DAMAGECOUNT value on done: 4764.0
[2023-02-25 13:06:25,879][2409547] Sum rewards: 5.833, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.062', 'AMMO2': '0.011', 'AMMO5': '0.017', 'AMMO4': '0.055', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.172', 'weapon5': '0.214', 'WEAPON5': '0.350', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'ARMOR': '0.872', 'weapon2': '1.512', 'weapon3': '1.606', 'DAMAGECOUNT': '2.616', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:06:27,186][2408954] Fps is (10 sec: 25395.1, 60 sec: 25190.4, 300 sec: 25547.9). Total num frames: 72171520. Throughput: 0: 6269.6. Samples: 18043200. Policy #0 lag: (min: 0.0, avg: 12.7, max: 25.0)
[2023-02-25 13:06:27,186][2408954] Avg episode reward: [(0, '6.619')]
[2023-02-25 13:06:27,248][2409074] Updated weights for policy 0, policy_version 17621 (0.0012)
[2023-02-25 13:06:28,533][2409080] DAMAGECOUNT value on done: 4380.0
[2023-02-25 13:06:28,534][2409080] Sum rewards: 11.838, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.042', 'AMMO5': '0.005', 'AMMO2': '0.025', 'AMMO3': '0.080', 'weapon5': '0.106', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.640', 'weapon4': '0.776', 'weapon2': '1.070', 'ARMOR': '1.349', 'weapon3': '1.508', 'DAMAGECOUNT': '2.895', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:06:28,643][2409468] DAMAGECOUNT value on done: 4486.0
[2023-02-25 13:06:28,647][2409468] Sum rewards: 8.907, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.104', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO3': '0.069', 'AMMO4': '0.095', 'weapon5': '0.174', 'WEAPON4': '0.200', 'weapon4': '0.244', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.700', 'weapon3': '1.218', 'weapon2': '1.832', 'DAMAGECOUNT': '3.447', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:06:28,844][2409099] DAMAGECOUNT value on done: 4748.0
[2023-02-25 13:06:28,845][2409099] Sum rewards: 9.399, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.840', 'AMMO5': '0.032', 'ARMOR': '0.040', 'AMMO2': '0.042', 'weapon7': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.127', 'WEAPON7': '0.200', 'weapon5': '0.206', 'AMMO4': '0.211', 'WEAPON4': '0.450', 'weapon2': '0.458', 'weapon4': '0.596', 'WEAPON5': '0.750', 'HITCOUNT': '0.770', 'WEAPON3': '0.850', 'weapon3': '2.202', 'DAMAGECOUNT': '3.747', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:06:29,237][2409074] Updated weights for policy 0, policy_version 17631 (0.0012)
[2023-02-25 13:06:29,635][2409547] DAMAGECOUNT value on done: 4024.0
[2023-02-25 13:06:29,637][2409547] Sum rewards: 9.174, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.077', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.081', 'AMMO3': '0.092', 'weapon5': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.432', 'HITCOUNT': '0.590', 'WEAPON3': '0.650', 'ARMOR': '1.256', 'weapon3': '1.374', 'weapon2': '1.536', 'DAMAGECOUNT': '2.682', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:06:30,371][2409076] Large shaping reward 2.563 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.531, 177.0), ('weapon7', 0.002)]
[2023-02-25 13:06:30,591][2409074] Updated weights for policy 0, policy_version 17641 (0.0013)
[2023-02-25 13:06:31,555][2409102] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:06:32,137][2409074] Updated weights for policy 0, policy_version 17651 (0.0013)
[2023-02-25 13:06:32,186][2408954] Fps is (10 sec: 25804.8, 60 sec: 25190.4, 300 sec: 25520.2). Total num frames: 72298496. Throughput: 0: 6266.1. Samples: 18081060. Policy #0 lag: (min: 0.0, avg: 12.7, max: 25.0)
[2023-02-25 13:06:32,186][2408954] Avg episode reward: [(0, '6.785')]
[2023-02-25 13:06:33,123][2409080] DAMAGECOUNT value on done: 3984.0
[2023-02-25 13:06:33,124][2409080] Sum rewards: 8.775, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.286', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.019', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO3': '0.067', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.244', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'HITCOUNT': '0.410', 'ARMOR': '0.433', 'weapon3': '1.334', 'weapon2': '1.754', 'DAMAGECOUNT': '2.418', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:06:33,236][2409468] DAMAGECOUNT value on done: 4109.0
[2023-02-25 13:06:33,240][2409468] Sum rewards: 1.230, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.296', 'AMMO5': '0.007', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'weapon7': '0.072', 'AMMO3': '0.099', 'AMMO4': '0.109', 'weapon5': '0.122', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.230', 'ARMOR': '0.408', 'weapon4': '0.438', 'WEAPON3': '0.600', 'weapon2': '0.648', 'DAMAGECOUNT': '1.113', 'weapon3': '1.178', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:06:33,757][2409547] DAMAGECOUNT value on done: 4553.0
[2023-02-25 13:06:33,762][2409547] Sum rewards: 10.888, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.370', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'weapon7': '0.146', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'HITCOUNT': '0.410', 'weapon3': '1.270', 'ARMOR': '1.318', 'DAMAGECOUNT': '2.196', 'weapon2': '2.226', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:06:33,793][2409074] Updated weights for policy 0, policy_version 17661 (0.0013)
[2023-02-25 13:06:35,001][2409074] Updated weights for policy 0, policy_version 17671 (0.0015)
[2023-02-25 13:06:36,845][2409080] DAMAGECOUNT value on done: 3992.0
[2023-02-25 13:06:36,847][2409080] Sum rewards: 4.887, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.842', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'WEAPON4': '0.100', 'weapon5': '0.160', 'weapon4': '0.228', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'ARMOR': '0.464', 'HITCOUNT': '0.530', 'weapon3': '1.244', 'DAMAGECOUNT': '1.464', 'weapon2': '1.622', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:06:36,986][2409468] DAMAGECOUNT value on done: 3956.0
[2023-02-25 13:06:36,987][2409468] Sum rewards: 4.732, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.960', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO2': '0.036', 'AMMO3': '0.126', 'AMMO4': '0.182', 'weapon5': '0.196', 'weapon4': '0.240', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'HITCOUNT': '0.570', 'WEAPON3': '0.850', 'ARMOR': '0.904', 'weapon2': '1.256', 'weapon3': '1.802', 'DAMAGECOUNT': '2.337', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:06:37,186][2408954] Fps is (10 sec: 24576.1, 60 sec: 24985.6, 300 sec: 25520.2). Total num frames: 72417280. Throughput: 0: 6277.0. Samples: 18100680. Policy #0 lag: (min: 0.0, avg: 13.3, max: 24.0)
[2023-02-25 13:06:37,186][2408954] Avg episode reward: [(0, '6.710')]
[2023-02-25 13:06:37,213][2409074] Updated weights for policy 0, policy_version 17681 (0.0012)
[2023-02-25 13:06:38,545][2409074] Updated weights for policy 0, policy_version 17691 (0.0013)
[2023-02-25 13:06:40,120][2409074] Updated weights for policy 0, policy_version 17701 (0.0015)
[2023-02-25 13:06:41,024][2409080] DAMAGECOUNT value on done: 3714.0
[2023-02-25 13:06:41,027][2409080] Sum rewards: 2.136, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.040', 'weapon7': '0.048', 'AMMO3': '0.067', 'AMMO4': '0.085', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.118', 'WEAPON5': '0.150', 'WEAPON3': '0.350', 'ARMOR': '0.451', 'HITCOUNT': '0.460', 'FRAGCOUNT': '0.500', 'HEALTH': '0.512', 'weapon3': '1.194', 'weapon2': '1.456', 'DAMAGECOUNT': '1.530'}
[2023-02-25 13:06:41,199][2409468] DAMAGECOUNT value on done: 4798.0
[2023-02-25 13:06:41,204][2409468] Sum rewards: 10.515, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.760', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO5': '0.003', 'AMMO3': '0.020', 'weapon7': '0.048', 'weapon5': '0.050', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.318', 'weapon3': '0.472', 'HITCOUNT': '0.600', 'weapon2': '1.112', 'DAMAGECOUNT': '2.373', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:06:42,001][2409074] Updated weights for policy 0, policy_version 17711 (0.0012)
[2023-02-25 13:06:42,186][2408954] Fps is (10 sec: 24575.8, 60 sec: 25053.9, 300 sec: 25520.2). Total num frames: 72544256. Throughput: 0: 6277.3. Samples: 18138828. Policy #0 lag: (min: 0.0, avg: 13.3, max: 24.0)
[2023-02-25 13:06:42,186][2408954] Avg episode reward: [(0, '6.737')]
[2023-02-25 13:06:42,966][2409074] Updated weights for policy 0, policy_version 17721 (0.0012)
[2023-02-25 13:06:45,154][2409080] DAMAGECOUNT value on done: 4365.0
[2023-02-25 13:06:45,157][2409080] Sum rewards: 6.302, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.842', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.035', 'weapon7': '0.048', 'AMMO3': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.116', 'weapon5': '0.150', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'HITCOUNT': '0.460', 'WEAPON3': '0.550', 'weapon3': '1.144', 'weapon2': '1.736', 'DAMAGECOUNT': '2.529', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:06:45,352][2409468] DAMAGECOUNT value on done: 3877.0
[2023-02-25 13:06:45,356][2409468] Sum rewards: 2.626, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.919', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.012', 'weapon5': '0.018', 'WEAPON1': '0.040', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'HITCOUNT': '0.360', 'WEAPON3': '0.500', 'ARMOR': '0.520', 'DAMAGECOUNT': '1.290', 'FRAGCOUNT': '1.500', 'weapon3': '1.550', 'weapon2': '2.058'}
[2023-02-25 13:06:45,364][2409074] Updated weights for policy 0, policy_version 17731 (0.0013)
[2023-02-25 13:06:46,450][2409074] Updated weights for policy 0, policy_version 17741 (0.0013)
[2023-02-25 13:06:47,186][2408954] Fps is (10 sec: 26623.9, 60 sec: 25395.2, 300 sec: 25534.1). Total num frames: 72683520. Throughput: 0: 6294.9. Samples: 18176712. Policy #0 lag: (min: 0.0, avg: 13.3, max: 24.0)
[2023-02-25 13:06:47,186][2408954] Avg episode reward: [(0, '6.810')]
[2023-02-25 13:06:48,276][2409074] Updated weights for policy 0, policy_version 17751 (0.0012)
[2023-02-25 13:06:48,940][2409080] DAMAGECOUNT value on done: 4814.0
[2023-02-25 13:06:48,944][2409080] Sum rewards: 12.688, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.858', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.038', 'weapon5': '0.054', 'weapon7': '0.060', 'AMMO3': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.258', 'WEAPON3': '0.500', 'HITCOUNT': '1.040', 'weapon3': '1.174', 'ARMOR': '1.325', 'weapon2': '2.252', 'DAMAGECOUNT': '3.852', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:06:49,159][2409468] DAMAGECOUNT value on done: 3007.0
[2023-02-25 13:06:49,160][2409468] Sum rewards: 1.653, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.423', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon5': '0.046', 'weapon7': '0.050', 'AMMO3': '0.067', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.114', 'HITCOUNT': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.436', 'WEAPON3': '0.450', 'ARMOR': '0.460', 'weapon2': '0.590', 'DAMAGECOUNT': '0.885', 'weapon3': '0.972', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:06:49,600][2409389] Large shaping reward 2.652 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:06:50,105][2409074] Updated weights for policy 0, policy_version 17761 (0.0015)
[2023-02-25 13:06:51,283][2409074] Updated weights for policy 0, policy_version 17771 (0.0012)
[2023-02-25 13:06:52,186][2408954] Fps is (10 sec: 26214.2, 60 sec: 25195.8, 300 sec: 25534.0). Total num frames: 72806400. Throughput: 0: 6307.7. Samples: 18195912. Policy #0 lag: (min: 0.0, avg: 13.0, max: 25.0)
[2023-02-25 13:06:52,187][2408954] Avg episode reward: [(0, '6.807')]
[2023-02-25 13:06:53,018][2409080] DAMAGECOUNT value on done: 4952.0
[2023-02-25 13:06:53,019][2409080] Sum rewards: 7.643, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.894', 'AMMO4': '-0.013', 'AMMO2': '-0.002', 'AMMO5': '0.012', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO3': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.186', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.296', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.610', 'weapon3': '1.414', 'weapon2': '1.530', 'DAMAGECOUNT': '2.445', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:06:53,177][2409074] Updated weights for policy 0, policy_version 17781 (0.0012)
[2023-02-25 13:06:53,267][2409468] DAMAGECOUNT value on done: 5141.0
[2023-02-25 13:06:53,267][2409468] Sum rewards: 7.222, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.042', 'AMMO5': '0.013', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'AMMO3': '0.070', 'AMMO4': '0.121', 'WEAPON4': '0.200', 'weapon4': '0.262', 'weapon5': '0.278', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'ARMOR': '0.432', 'HITCOUNT': '0.440', 'weapon3': '1.214', 'weapon2': '1.328', 'DAMAGECOUNT': '1.902', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:06:54,479][2409074] Updated weights for policy 0, policy_version 17791 (0.0013)
[2023-02-25 13:06:56,562][2409074] Updated weights for policy 0, policy_version 17801 (0.0012)
[2023-02-25 13:06:57,186][2408954] Fps is (10 sec: 24576.1, 60 sec: 25059.3, 300 sec: 25520.2). Total num frames: 72929280. Throughput: 0: 6341.1. Samples: 18234000. Policy #0 lag: (min: 0.0, avg: 13.0, max: 25.0)
[2023-02-25 13:06:57,186][2408954] Avg episode reward: [(0, '6.737')]
[2023-02-25 13:06:57,390][2409080] DAMAGECOUNT value on done: 4104.0
[2023-02-25 13:06:57,390][2409080] Sum rewards: 4.522, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.204', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO3': '0.030', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'weapon5': '0.064', 'WEAPON5': '0.100', 'weapon7': '0.120', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.200', 'HITCOUNT': '0.210', 'WEAPON3': '0.250', 'weapon3': '0.724', 'DAMAGECOUNT': '0.981', 'ARMOR': '1.088', 'FRAGCOUNT': '2.000', 'weapon2': '2.008'}
[2023-02-25 13:06:57,639][2409468] DAMAGECOUNT value on done: 3991.0
[2023-02-25 13:06:57,642][2409468] Sum rewards: 8.290, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO3': '0.050', 'AMMO4': '0.053', 'HEALTH': '0.058', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.188', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'HITCOUNT': '0.350', 'ARMOR': '0.848', 'weapon3': '1.158', 'DAMAGECOUNT': '1.344', 'weapon2': '1.912', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:06:57,981][2409074] Updated weights for policy 0, policy_version 17811 (0.0012)
[2023-02-25 13:06:58,873][2409079] Large shaping reward 3.642 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:06:59,526][2409074] Updated weights for policy 0, policy_version 17821 (0.0012)
[2023-02-25 13:07:01,415][2409080] DAMAGECOUNT value on done: 4237.0
[2023-02-25 13:07:01,419][2409080] Sum rewards: 6.329, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.340', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO3': '0.101', 'AMMO4': '0.112', 'weapon5': '0.116', 'weapon4': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'HITCOUNT': '0.590', 'WEAPON3': '0.700', 'ARMOR': '0.926', 'weapon3': '1.494', 'weapon2': '1.748', 'DAMAGECOUNT': '2.547', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:07:01,471][2409074] Updated weights for policy 0, policy_version 17831 (0.0012)
[2023-02-25 13:07:01,696][2409468] DAMAGECOUNT value on done: 5004.0
[2023-02-25 13:07:01,711][2409468] Sum rewards: 5.898, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.012', 'AMMO2': '0.014', 'HEALTH': '0.036', 'WEAPON1': '0.050', 'AMMO4': '0.070', 'AMMO3': '0.094', 'weapon5': '0.232', 'WEAPON5': '0.250', 'HITCOUNT': '0.370', 'ARMOR': '0.500', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.545', 'weapon3': '1.654', 'weapon2': '1.770', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:07:02,186][2408954] Fps is (10 sec: 25805.1, 60 sec: 25326.9, 300 sec: 25520.2). Total num frames: 73064448. Throughput: 0: 6347.5. Samples: 18272016. Policy #0 lag: (min: 0.0, avg: 10.9, max: 24.0)
[2023-02-25 13:07:02,186][2408954] Avg episode reward: [(0, '6.751')]
[2023-02-25 13:07:02,458][2409074] Updated weights for policy 0, policy_version 17841 (0.0012)
[2023-02-25 13:07:04,765][2409074] Updated weights for policy 0, policy_version 17851 (0.0013)
[2023-02-25 13:07:05,097][2409080] DAMAGECOUNT value on done: 4671.0
[2023-02-25 13:07:05,098][2409080] Sum rewards: 6.476, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.253', 'AMMO5': '0.014', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO3': '0.074', 'AMMO4': '0.092', 'weapon5': '0.146', 'WEAPON4': '0.200', 'weapon4': '0.286', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '0.650', 'weapon2': '0.900', 'weapon3': '1.622', 'DAMAGECOUNT': '2.757', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:07:05,463][2409468] DAMAGECOUNT value on done: 5040.0
[2023-02-25 13:07:05,467][2409468] Sum rewards: 5.453, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.302', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.052', 'AMMO3': '0.110', 'AMMO4': '0.156', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.402', 'WEAPON3': '0.600', 'HITCOUNT': '0.700', 'ARMOR': '0.905', 'weapon2': '1.432', 'weapon3': '1.964', 'DAMAGECOUNT': '2.142', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:07:05,849][2409074] Updated weights for policy 0, policy_version 17861 (0.0013)
[2023-02-25 13:07:07,174][2409074] Updated weights for policy 0, policy_version 17871 (0.0012)
[2023-02-25 13:07:07,186][2408954] Fps is (10 sec: 27033.6, 60 sec: 25531.7, 300 sec: 25547.9). Total num frames: 73199616. Throughput: 0: 6357.3. Samples: 18291156. Policy #0 lag: (min: 0.0, avg: 10.9, max: 24.0)
[2023-02-25 13:07:07,186][2408954] Avg episode reward: [(0, '6.706')]
[2023-02-25 13:07:09,162][2409080] DAMAGECOUNT value on done: 3527.0
[2023-02-25 13:07:09,163][2409080] Sum rewards: 7.120, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.160', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO2': '0.040', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.100', 'AMMO3': '0.125', 'weapon5': '0.134', 'AMMO4': '0.199', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'ARMOR': '0.511', 'HITCOUNT': '0.660', 'weapon2': '0.664', 'WEAPON3': '0.800', 'weapon4': '1.010', 'weapon3': '1.546', 'DAMAGECOUNT': '2.346', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:07:09,509][2409074] Updated weights for policy 0, policy_version 17881 (0.0012)
[2023-02-25 13:07:09,549][2409468] DAMAGECOUNT value on done: 4351.0
[2023-02-25 13:07:09,552][2409468] Sum rewards: 7.172, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.452', 'AMMO5': '0.014', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'weapon7': '0.050', 'AMMO4': '0.101', 'AMMO3': '0.128', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.346', 'HITCOUNT': '0.540', 'WEAPON3': '0.800', 'weapon2': '1.176', 'ARMOR': '1.330', 'weapon3': '1.844', 'DAMAGECOUNT': '3.006', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:07:10,705][2409074] Updated weights for policy 0, policy_version 17891 (0.0012)
[2023-02-25 13:07:12,186][2408954] Fps is (10 sec: 24166.5, 60 sec: 25122.1, 300 sec: 25464.6). Total num frames: 73306112. Throughput: 0: 6342.7. Samples: 18328620. Policy #0 lag: (min: 0.0, avg: 10.9, max: 24.0)
[2023-02-25 13:07:12,186][2408954] Avg episode reward: [(0, '6.773')]
[2023-02-25 13:07:12,674][2409074] Updated weights for policy 0, policy_version 17901 (0.0012)
[2023-02-25 13:07:13,531][2409468] DAMAGECOUNT value on done: 4383.0
[2023-02-25 13:07:13,536][2409468] Sum rewards: 6.963, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.797', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.100', 'weapon5': '0.122', 'WEAPON5': '0.300', 'HITCOUNT': '0.500', 'WEAPON3': '0.550', 'weapon3': '1.214', 'DAMAGECOUNT': '1.755', 'weapon2': '2.244', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:07:14,326][2409074] Updated weights for policy 0, policy_version 17911 (0.0012)
[2023-02-25 13:07:15,933][2409074] Updated weights for policy 0, policy_version 17921 (0.0012)
[2023-02-25 13:07:17,186][2408954] Fps is (10 sec: 23347.2, 60 sec: 25258.7, 300 sec: 25520.2). Total num frames: 73433088. Throughput: 0: 6317.6. Samples: 18365352. Policy #0 lag: (min: 0.0, avg: 11.3, max: 27.0)
[2023-02-25 13:07:17,186][2408954] Avg episode reward: [(0, '6.819')]
[2023-02-25 13:07:17,708][2409074] Updated weights for policy 0, policy_version 17931 (0.0013)
[2023-02-25 13:07:17,721][2409468] DAMAGECOUNT value on done: 4792.0
[2023-02-25 13:07:17,722][2409468] Sum rewards: 6.714, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.519', 'AMMO5': '0.015', 'AMMO2': '0.027', 'WEAPON1': '0.040', 'weapon7': '0.054', 'AMMO3': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.135', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.352', 'HITCOUNT': '0.440', 'WEAPON3': '0.600', 'weapon2': '1.180', 'weapon3': '1.638', 'DAMAGECOUNT': '2.025', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:07:19,057][2409074] Updated weights for policy 0, policy_version 17941 (0.0012)
[2023-02-25 13:07:20,909][2409486] Large shaping reward 2.629 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.597, 199.0), ('weapon7', 0.002)]
[2023-02-25 13:07:21,151][2409074] Updated weights for policy 0, policy_version 17951 (0.0012)
[2023-02-25 13:07:21,627][2409468] DAMAGECOUNT value on done: 3886.0
[2023-02-25 13:07:21,632][2409468] Sum rewards: 4.354, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.148', 'AMMO2': '0.003', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.015', 'weapon7': '0.046', 'AMMO3': '0.100', 'weapon5': '0.118', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.269', 'weapon2': '1.480', 'weapon3': '2.050', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:07:22,186][2408954] Fps is (10 sec: 25394.0, 60 sec: 25326.7, 300 sec: 25464.6). Total num frames: 73560064. Throughput: 0: 6294.3. Samples: 18383928. Policy #0 lag: (min: 0.0, avg: 11.3, max: 27.0)
[2023-02-25 13:07:22,187][2408954] Avg episode reward: [(0, '6.706')]
[2023-02-25 13:07:22,364][2409074] Updated weights for policy 0, policy_version 17961 (0.0012)
[2023-02-25 13:07:24,632][2409074] Updated weights for policy 0, policy_version 17971 (0.0012)
[2023-02-25 13:07:25,753][2409074] Updated weights for policy 0, policy_version 17981 (0.0012)
[2023-02-25 13:07:25,986][2409468] DAMAGECOUNT value on done: 4993.0
[2023-02-25 13:07:25,987][2409468] Sum rewards: 8.472, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.210', 'AMMO2': '0.013', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.063', 'AMMO3': '0.136', 'weapon5': '0.228', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.488', 'HITCOUNT': '0.600', 'WEAPON3': '0.800', 'ARMOR': '0.916', 'weapon2': '0.982', 'weapon3': '1.504', 'DAMAGECOUNT': '2.814', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:07:26,904][2409100] DAMAGECOUNT value on done: 5280.0
[2023-02-25 13:07:26,909][2409100] Sum rewards: 4.945, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.000', 'AMMO2': '0.002', 'WEAPON1': '0.010', 'AMMO4': '0.011', 'AMMO5': '0.017', 'weapon7': '0.050', 'AMMO3': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'weapon4': '0.542', 'HITCOUNT': '0.620', 'WEAPON3': '0.750', 'weapon2': '0.936', 'weapon3': '1.654', 'DAMAGECOUNT': '2.589', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:07:27,186][2408954] Fps is (10 sec: 24985.0, 60 sec: 25190.3, 300 sec: 25450.7). Total num frames: 73682944. Throughput: 0: 6261.3. Samples: 18420588. Policy #0 lag: (min: 1.0, avg: 13.4, max: 28.0)
[2023-02-25 13:07:27,186][2408954] Avg episode reward: [(0, '6.769')]
[2023-02-25 13:07:27,332][2409074] Updated weights for policy 0, policy_version 17991 (0.0012)
[2023-02-25 13:07:28,657][2409103] DAMAGECOUNT value on done: 3895.0
[2023-02-25 13:07:28,658][2409103] Sum rewards: 4.514, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.134', 'AMMO2': '0.011', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO4': '0.056', 'AMMO3': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.200', 'weapon5': '0.202', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.418', 'HITCOUNT': '0.500', 'WEAPON3': '0.550', 'weapon3': '1.294', 'weapon2': '1.622', 'DAMAGECOUNT': '1.797', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:07:29,460][2409074] Updated weights for policy 0, policy_version 18001 (0.0015)
[2023-02-25 13:07:30,860][2409074] Updated weights for policy 0, policy_version 18011 (0.0015)
[2023-02-25 13:07:31,095][2409100] DAMAGECOUNT value on done: 4876.0
[2023-02-25 13:07:31,098][2409100] Sum rewards: 6.247, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.766', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.067', 'weapon5': '0.182', 'WEAPON5': '0.350', 'HITCOUNT': '0.390', 'WEAPON3': '0.500', 'ARMOR': '0.892', 'weapon3': '1.314', 'DAMAGECOUNT': '1.368', 'weapon2': '2.194', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:07:31,598][2409549] DAMAGECOUNT value on done: 4461.0
[2023-02-25 13:07:31,599][2409549] Sum rewards: 11.429, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'weapon7': '0.052', 'AMMO4': '0.060', 'AMMO3': '0.081', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.106', 'WEAPON5': '0.300', 'HEALTH': '0.304', 'WEAPON3': '0.450', 'HITCOUNT': '0.710', 'ARMOR': '0.800', 'weapon3': '1.366', 'weapon2': '1.790', 'DAMAGECOUNT': '2.553', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:07:32,186][2408954] Fps is (10 sec: 23757.1, 60 sec: 24985.5, 300 sec: 25422.9). Total num frames: 73797632. Throughput: 0: 6227.2. Samples: 18456936. Policy #0 lag: (min: 1.0, avg: 13.4, max: 28.0)
[2023-02-25 13:07:32,186][2408954] Avg episode reward: [(0, '6.859')]
[2023-02-25 13:07:32,416][2409103] DAMAGECOUNT value on done: 6450.0
[2023-02-25 13:07:32,418][2409103] Sum rewards: 14.486, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.160', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO3': '0.076', 'weapon7': '0.092', 'AMMO4': '0.155', 'weapon5': '0.196', 'WEAPON5': '0.250', 'AMMO6': '0.280', 'AMMO7': '0.280', 'WEAPON4': '0.350', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.636', 'ARMOR': '0.800', 'HITCOUNT': '0.850', 'weapon3': '1.190', 'weapon2': '1.542', 'DAMAGECOUNT': '3.795', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:07:33,020][2409074] Updated weights for policy 0, policy_version 18021 (0.0012)
[2023-02-25 13:07:34,202][2409074] Updated weights for policy 0, policy_version 18031 (0.0013)
[2023-02-25 13:07:35,366][2409549] DAMAGECOUNT value on done: 5637.0
[2023-02-25 13:07:35,367][2409549] Sum rewards: 4.913, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.087', 'AMMO2': '0.011', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO3': '0.046', 'AMMO4': '0.053', 'weapon7': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.122', 'HITCOUNT': '0.250', 'weapon4': '0.258', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'ARMOR': '0.484', 'weapon3': '0.688', 'weapon2': '0.878', 'DAMAGECOUNT': '2.235', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:07:35,990][2409074] Updated weights for policy 0, policy_version 18041 (0.0012)
[2023-02-25 13:07:36,101][2409100] DAMAGECOUNT value on done: 4341.0
[2023-02-25 13:07:36,102][2409100] Sum rewards: 3.806, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.288', 'AMMO2': '0.008', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'AMMO4': '0.040', 'weapon5': '0.044', 'weapon7': '0.100', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'HITCOUNT': '0.310', 'WEAPON3': '0.350', 'weapon4': '0.474', 'ARMOR': '0.848', 'weapon3': '1.044', 'DAMAGECOUNT': '1.425', 'weapon2': '1.488', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:07:36,839][2409103] DAMAGECOUNT value on done: 3700.0
[2023-02-25 13:07:36,840][2409103] Sum rewards: 1.493, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.670', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO3': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.056', 'ARMOR': '0.072', 'weapon7': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.300', 'weapon2': '0.480', 'weapon4': '0.566', 'weapon3': '0.784', 'DAMAGECOUNT': '0.849', 'FRAGCOUNT': '1.000'}
[2023-02-25 13:07:37,186][2408954] Fps is (10 sec: 23347.6, 60 sec: 24985.6, 300 sec: 25381.3). Total num frames: 73916416. Throughput: 0: 6215.2. Samples: 18475596. Policy #0 lag: (min: 1.0, avg: 13.4, max: 28.0)
[2023-02-25 13:07:37,186][2408954] Avg episode reward: [(0, '6.792')]
[2023-02-25 13:07:37,575][2409074] Updated weights for policy 0, policy_version 18051 (0.0012)
[2023-02-25 13:07:39,121][2409549] DAMAGECOUNT value on done: 4801.0
[2023-02-25 13:07:39,125][2409549] Sum rewards: 9.783, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.141', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO5': '0.026', 'AMMO4': '0.122', 'AMMO3': '0.125', 'weapon5': '0.158', 'WEAPON4': '0.250', 'weapon4': '0.316', 'ARMOR': '0.468', 'WEAPON5': '0.600', 'HITCOUNT': '0.770', 'WEAPON3': '0.900', 'weapon2': '1.330', 'weapon3': '1.776', 'DAMAGECOUNT': '3.288', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:07:39,594][2409074] Updated weights for policy 0, policy_version 18061 (0.0012)
[2023-02-25 13:07:39,813][2409100] DAMAGECOUNT value on done: 5366.0
[2023-02-25 13:07:39,814][2409100] Sum rewards: 11.731, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.274', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'weapon7': '0.052', 'AMMO3': '0.067', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.146', 'AMMO4': '0.159', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.402', 'HITCOUNT': '0.470', 'WEAPON3': '0.500', 'ARMOR': '0.857', 'weapon2': '1.198', 'weapon3': '1.290', 'DAMAGECOUNT': '3.198', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:07:40,395][2409102] DAMAGECOUNT value on done: 5869.0
[2023-02-25 13:07:40,395][2409102] Sum rewards: 8.049, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.880', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.052', 'AMMO3': '0.089', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.272', 'ARMOR': '0.455', 'WEAPON3': '0.550', 'HITCOUNT': '0.770', 'weapon3': '1.374', 'weapon2': '1.916', 'DAMAGECOUNT': '2.664', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:07:41,382][2409074] Updated weights for policy 0, policy_version 18071 (0.0012)
[2023-02-25 13:07:41,476][2409033] Signal inference workers to stop experience collection... (2200 times)
[2023-02-25 13:07:41,479][2409074] InferenceWorker_p0-w0: stopping experience collection (2200 times)
[2023-02-25 13:07:41,485][2409033] Signal inference workers to resume experience collection... (2200 times)
[2023-02-25 13:07:41,502][2409074] InferenceWorker_p0-w0: resuming experience collection (2200 times)
[2023-02-25 13:07:41,527][2409103] DAMAGECOUNT value on done: 3446.0
[2023-02-25 13:07:41,528][2409103] Sum rewards: 2.730, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.477', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon7': '0.048', 'AMMO3': '0.052', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.260', 'WEAPON3': '0.300', 'weapon4': '0.468', 'weapon2': '0.536', 'weapon3': '0.720', 'DAMAGECOUNT': '1.020', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:07:42,186][2408954] Fps is (10 sec: 24986.4, 60 sec: 25053.9, 300 sec: 25395.2). Total num frames: 74047488. Throughput: 0: 6178.7. Samples: 18512040. Policy #0 lag: (min: 0.0, avg: 13.6, max: 27.0)
[2023-02-25 13:07:42,186][2408954] Avg episode reward: [(0, '6.932')]
[2023-02-25 13:07:42,513][2409074] Updated weights for policy 0, policy_version 18081 (0.0013)
[2023-02-25 13:07:43,316][2409101] DAMAGECOUNT value on done: 4293.0
[2023-02-25 13:07:43,319][2409101] Sum rewards: 13.514, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.310', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO3': '0.064', 'AMMO4': '0.100', 'weapon5': '0.124', 'weapon7': '0.166', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'AMMO6': '0.380', 'AMMO7': '0.380', 'WEAPON3': '0.450', 'WEAPON7': '0.500', 'HITCOUNT': '0.640', 'weapon4': '0.878', 'weapon2': '0.932', 'weapon3': '1.236', 'DAMAGECOUNT': '3.696', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:07:43,513][2409100] DAMAGECOUNT value on done: 5013.0
[2023-02-25 13:07:43,515][2409100] Sum rewards: 7.825, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.192', 'AMMO2': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.039', 'weapon7': '0.050', 'AMMO3': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.146', 'weapon4': '0.348', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'ARMOR': '0.854', 'weapon2': '1.214', 'weapon3': '1.630', 'DAMAGECOUNT': '2.418', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:07:43,767][2409549] DAMAGECOUNT value on done: 5089.0
[2023-02-25 13:07:43,771][2409549] Sum rewards: 9.446, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.938', 'AMMO2': '0.018', 'AMMO5': '0.032', 'WEAPON1': '0.040', 'weapon4': '0.068', 'AMMO4': '0.088', 'weapon5': '0.112', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'ARMOR': '0.400', 'HITCOUNT': '0.640', 'WEAPON5': '0.650', 'WEAPON3': '0.900', 'weapon2': '1.152', 'weapon3': '1.972', 'DAMAGECOUNT': '2.790', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:07:44,547][2409074] Updated weights for policy 0, policy_version 18091 (0.0012)
[2023-02-25 13:07:44,568][2409102] DAMAGECOUNT value on done: 4618.0
[2023-02-25 13:07:44,569][2409102] Sum rewards: 5.032, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.068', 'WEAPON1': '0.010', 'AMMO5': '0.021', 'AMMO2': '0.028', 'AMMO3': '0.090', 'weapon7': '0.112', 'AMMO4': '0.142', 'WEAPON4': '0.250', 'weapon5': '0.278', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'weapon4': '0.468', 'HITCOUNT': '0.480', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'ARMOR': '1.284', 'weapon3': '1.312', 'weapon2': '1.514', 'DAMAGECOUNT': '2.220', 'FRAGCOUNT': '2.500'}
[2023-02-25 13:07:45,215][2409103] DAMAGECOUNT value on done: 3735.0
[2023-02-25 13:07:45,216][2409103] Sum rewards: 7.663, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.532', 'AMMO5': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon7': '0.030', 'AMMO3': '0.050', 'weapon5': '0.062', 'AMMO4': '0.083', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'HITCOUNT': '0.590', 'ARMOR': '0.970', 'weapon4': '1.102', 'weapon3': '1.222', 'weapon2': '1.402', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:07:46,047][2409074] Updated weights for policy 0, policy_version 18101 (0.0012)
[2023-02-25 13:07:47,186][2408954] Fps is (10 sec: 25395.1, 60 sec: 24780.8, 300 sec: 25367.4). Total num frames: 74170368. Throughput: 0: 6144.5. Samples: 18548520. Policy #0 lag: (min: 0.0, avg: 13.6, max: 27.0)
[2023-02-25 13:07:47,186][2408954] Avg episode reward: [(0, '6.944')]
[2023-02-25 13:07:47,669][2409101] DAMAGECOUNT value on done: 5570.0
[2023-02-25 13:07:47,673][2409101] Sum rewards: 8.588, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.710', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.083', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'weapon5': '0.174', 'weapon4': '0.208', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.830', 'weapon3': '1.496', 'weapon2': '1.680', 'DAMAGECOUNT': '3.651', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:07:48,007][2409074] Updated weights for policy 0, policy_version 18111 (0.0014)
[2023-02-25 13:07:48,167][2409549] DAMAGECOUNT value on done: 5449.0
[2023-02-25 13:07:48,171][2409549] Sum rewards: 11.535, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.218', 'AMMO5': '0.022', 'AMMO2': '0.025', 'WEAPON1': '0.050', 'weapon5': '0.090', 'AMMO4': '0.123', 'AMMO3': '0.126', 'weapon4': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'HITCOUNT': '0.760', 'WEAPON3': '0.850', 'ARMOR': '0.933', 'weapon2': '0.976', 'weapon3': '2.308', 'DAMAGECOUNT': '3.807', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:07:48,679][2409100] DAMAGECOUNT value on done: 4074.0
[2023-02-25 13:07:48,682][2409100] Sum rewards: 4.633, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-1.000', 'AMMO5': '0.008', 'AMMO2': '0.012', 'AMMO3': '0.027', 'AMMO4': '0.062', 'weapon5': '0.134', 'HITCOUNT': '0.140', 'weapon7': '0.170', 'WEAPON5': '0.200', 'WEAPON3': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'weapon2': '0.358', 'weapon3': '0.388', 'WEAPON7': '0.400', 'ARMOR': '0.450', 'weapon4': '0.452', 'DAMAGECOUNT': '1.101', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:07:48,927][2409102] DAMAGECOUNT value on done: 5664.0
[2023-02-25 13:07:48,933][2409103] DAMAGECOUNT value on done: 4451.0
[2023-02-25 13:07:48,934][2409103] Sum rewards: 5.210, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.330', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon7': '0.056', 'AMMO3': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.111', 'weapon5': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.262', 'HITCOUNT': '0.410', 'WEAPON3': '0.650', 'ARMOR': '0.896', 'weapon3': '1.542', 'DAMAGECOUNT': '1.575', 'weapon2': '1.732', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:07:48,939][2409102] Sum rewards: 13.624, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'weapon5': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'AMMO4': '0.138', 'weapon4': '0.146', 'WEAPON5': '0.200', 'WEAPON3': '0.550', 'HEALTH': '0.698', 'HITCOUNT': '0.770', 'ARMOR': '0.912', 'weapon3': '1.394', 'weapon2': '1.628', 'DAMAGECOUNT': '3.345', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:07:48,977][2409485] DAMAGECOUNT value on done: 4759.0
[2023-02-25 13:07:48,980][2409485] Sum rewards: 11.891, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.608', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.073', 'weapon7': '0.082', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.402', 'ARMOR': '0.451', 'WEAPON3': '0.550', 'HITCOUNT': '0.670', 'weapon2': '1.522', 'weapon3': '1.680', 'DAMAGECOUNT': '3.276', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:07:49,467][2409074] Updated weights for policy 0, policy_version 18121 (0.0012)
[2023-02-25 13:07:50,993][2409074] Updated weights for policy 0, policy_version 18131 (0.0012)
[2023-02-25 13:07:51,130][2409407] Large shaping reward 2.614 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.582, 194.0), ('weapon7', 0.002)]
[2023-02-25 13:07:52,024][2409101] DAMAGECOUNT value on done: 4766.0
[2023-02-25 13:07:52,027][2409101] Sum rewards: 5.466, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.144', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'weapon5': '0.018', 'AMMO3': '0.030', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon7': '0.098', 'WEAPON3': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.224', 'WEAPON7': '0.300', 'HITCOUNT': '0.470', 'weapon3': '0.506', 'weapon2': '1.164', 'DAMAGECOUNT': '2.052', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:07:52,186][2408954] Fps is (10 sec: 23756.9, 60 sec: 24644.3, 300 sec: 25298.0). Total num frames: 74285056. Throughput: 0: 6132.5. Samples: 18567120. Policy #0 lag: (min: 0.0, avg: 12.0, max: 28.0)
[2023-02-25 13:07:52,187][2408954] Avg episode reward: [(0, '7.088')]
[2023-02-25 13:07:52,259][2409100] DAMAGECOUNT value on done: 5239.0
[2023-02-25 13:07:52,263][2409100] Sum rewards: 9.716, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.906', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon7': '0.074', 'AMMO3': '0.075', 'weapon5': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.584', 'WEAPON3': '0.600', 'ARMOR': '0.933', 'HITCOUNT': '0.980', 'weapon2': '1.298', 'weapon3': '1.362', 'DAMAGECOUNT': '2.973', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:07:52,531][2409549] DAMAGECOUNT value on done: 5589.0
[2023-02-25 13:07:52,534][2409549] Sum rewards: 16.584, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.568', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO3': '0.088', 'AMMO4': '0.107', 'weapon5': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.534', 'WEAPON3': '0.550', 'HITCOUNT': '0.810', 'ARMOR': '1.279', 'weapon3': '1.336', 'weapon2': '1.594', 'DAMAGECOUNT': '3.798', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:07:52,648][2409103] DAMAGECOUNT value on done: 4364.0
[2023-02-25 13:07:52,653][2409103] Sum rewards: 7.015, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.370', 'AMMO5': '0.007', 'AMMO3': '0.030', 'AMMO2': '0.037', 'weapon7': '0.048', 'weapon5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.182', 'WEAPON7': '0.200', 'HITCOUNT': '0.230', 'WEAPON3': '0.250', 'WEAPON4': '0.350', 'weapon3': '0.764', 'ARMOR': '0.925', 'weapon4': '0.946', 'weapon2': '1.132', 'DAMAGECOUNT': '2.043', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:07:52,730][2409485] DAMAGECOUNT value on done: 5541.0
[2023-02-25 13:07:52,732][2409485] Sum rewards: 9.192, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.146', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.083', 'AMMO4': '0.146', 'weapon5': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'weapon4': '0.518', 'WEAPON3': '0.550', 'HITCOUNT': '0.870', 'weapon2': '1.070', 'weapon3': '1.964', 'DAMAGECOUNT': '3.573', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:07:52,877][2409074] Updated weights for policy 0, policy_version 18141 (0.0013)
[2023-02-25 13:07:52,915][2409102] DAMAGECOUNT value on done: 5347.0
[2023-02-25 13:07:52,918][2409102] Sum rewards: 8.410, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.430', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO3': '0.030', 'weapon7': '0.046', 'AMMO4': '0.070', 'weapon5': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.200', 'ARMOR': '0.484', 'HITCOUNT': '0.540', 'weapon3': '0.724', 'weapon2': '2.174', 'DAMAGECOUNT': '2.793', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:07:54,522][2409074] Updated weights for policy 0, policy_version 18151 (0.0012)
[2023-02-25 13:07:54,600][2409596] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0)]
[2023-02-25 13:07:55,986][2409074] Updated weights for policy 0, policy_version 18161 (0.0012)
[2023-02-25 13:07:56,209][2409100] DAMAGECOUNT value on done: 4974.0
[2023-02-25 13:07:56,213][2409100] Sum rewards: 4.800, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.164', 'AMMO2': '0.025', 'AMMO5': '0.026', 'WEAPON1': '0.060', 'AMMO3': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.110', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'weapon5': '0.194', 'weapon4': '0.334', 'HITCOUNT': '0.470', 'WEAPON5': '0.600', 'weapon2': '0.654', 'WEAPON3': '0.700', 'weapon3': '1.560', 'DAMAGECOUNT': '2.310', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:07:56,298][2409101] DAMAGECOUNT value on done: 5121.0
[2023-02-25 13:07:56,299][2409101] Sum rewards: 8.989, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.767', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon7': '0.068', 'AMMO3': '0.080', 'AMMO4': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.124', 'weapon5': '0.132', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.460', 'WEAPON3': '0.550', 'HITCOUNT': '0.750', 'weapon2': '1.516', 'weapon3': '1.782', 'DAMAGECOUNT': '3.594', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:07:56,525][2409103] DAMAGECOUNT value on done: 4743.0
[2023-02-25 13:07:56,525][2409103] Sum rewards: 4.463, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.620', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'weapon7': '0.056', 'AMMO3': '0.073', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.122', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'HITCOUNT': '0.400', 'WEAPON3': '0.450', 'ARMOR': '0.865', 'weapon3': '1.366', 'DAMAGECOUNT': '1.770', 'weapon2': '1.890', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:07:56,691][2409485] DAMAGECOUNT value on done: 3451.0
[2023-02-25 13:07:56,694][2409485] Sum rewards: 5.375, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.855', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO2': '0.029', 'weapon7': '0.046', 'AMMO3': '0.062', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.130', 'AMMO4': '0.143', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.380', 'WEAPON3': '0.500', 'WEAPON4': '0.600', 'weapon2': '0.960', 'weapon3': '0.994', 'weapon4': '1.200', 'DAMAGECOUNT': '2.142', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:07:56,695][2409549] DAMAGECOUNT value on done: 4574.0
[2023-02-25 13:07:56,699][2409549] Sum rewards: 10.876, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.411', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO3': '0.040', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.106', 'weapon7': '0.132', 'WEAPON5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.300', 'WEAPON7': '0.300', 'weapon4': '0.342', 'ARMOR': '0.400', 'HITCOUNT': '0.690', 'weapon3': '0.952', 'weapon2': '1.326', 'DAMAGECOUNT': '3.681', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:07:57,186][2408954] Fps is (10 sec: 23347.1, 60 sec: 24575.9, 300 sec: 25311.9). Total num frames: 74403840. Throughput: 0: 6112.2. Samples: 18603672. Policy #0 lag: (min: 0.0, avg: 12.0, max: 28.0)
[2023-02-25 13:07:57,186][2408954] Avg episode reward: [(0, '7.218')]
[2023-02-25 13:07:57,192][2409033] Saving new best policy, reward=7.218!
[2023-02-25 13:07:57,804][2409102] DAMAGECOUNT value on done: 5073.0
[2023-02-25 13:07:57,807][2409102] Sum rewards: 11.944, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.667', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.076', 'WEAPON4': '0.250', 'weapon5': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'weapon4': '0.658', 'weapon2': '0.694', 'ARMOR': '0.826', 'HITCOUNT': '0.850', 'weapon3': '1.602', 'DAMAGECOUNT': '3.663', 'FRAGCOUNT': '9.500'}
[2023-02-25 13:07:57,849][2409074] Updated weights for policy 0, policy_version 18171 (0.0012)
[2023-02-25 13:07:59,387][2409548] DAMAGECOUNT value on done: 4454.0
[2023-02-25 13:07:59,388][2409548] Sum rewards: 16.300, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.368', 'AMMO2': '0.012', 'AMMO5': '0.012', 'AMMO4': '0.061', 'AMMO3': '0.084', 'weapon5': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'weapon4': '0.482', 'WEAPON3': '0.600', 'HITCOUNT': '0.930', 'weapon2': '1.038', 'weapon3': '1.528', 'DAMAGECOUNT': '3.852', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:07:59,699][2409074] Updated weights for policy 0, policy_version 18181 (0.0013)
[2023-02-25 13:08:00,006][2409101] DAMAGECOUNT value on done: 5946.0
[2023-02-25 13:08:00,007][2409101] Sum rewards: 15.208, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.838', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO2': '0.035', 'AMMO3': '0.162', 'AMMO4': '0.175', 'weapon5': '0.224', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'weapon4': '0.758', 'weapon2': '0.802', 'ARMOR': '0.854', 'WEAPON3': '0.950', 'HITCOUNT': '1.090', 'weapon3': '1.860', 'DAMAGECOUNT': '5.142', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:08:00,314][2409103] DAMAGECOUNT value on done: 4373.0
[2023-02-25 13:08:00,316][2409103] Sum rewards: 3.384, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.925', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.055', 'AMMO3': '0.063', 'weapon7': '0.074', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.310', 'weapon4': '0.358', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.894', 'weapon3': '0.950', 'ARMOR': '1.279', 'weapon2': '1.544', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:08:00,387][2409549] DAMAGECOUNT value on done: 4894.0
[2023-02-25 13:08:00,391][2409549] Sum rewards: 13.425, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.093', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.030', 'WEAPON1': '0.030', 'AMMO3': '0.076', 'weapon5': '0.208', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.670', 'weapon3': '1.616', 'weapon2': '1.900', 'DAMAGECOUNT': '2.967', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:08:00,495][2409485] DAMAGECOUNT value on done: 5394.0
[2023-02-25 13:08:00,496][2409485] Sum rewards: 6.096, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.297', 'AMMO2': '0.012', 'AMMO5': '0.012', 'AMMO3': '0.040', 'AMMO4': '0.060', 'weapon7': '0.106', 'weapon5': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.246', 'WEAPON3': '0.250', 'HITCOUNT': '0.280', 'AMMO6': '0.280', 'AMMO7': '0.280', 'WEAPON7': '0.400', 'ARMOR': '0.853', 'weapon3': '0.880', 'DAMAGECOUNT': '1.575', 'weapon2': '1.946', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:08:00,940][2409100] DAMAGECOUNT value on done: 5541.0
[2023-02-25 13:08:00,942][2409100] Sum rewards: 8.427, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.430', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon7': '0.050', 'AMMO3': '0.067', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.101', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.306', 'WEAPON3': '0.350', 'ARMOR': '0.500', 'HITCOUNT': '0.670', 'weapon3': '1.314', 'weapon2': '1.336', 'DAMAGECOUNT': '2.649', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:01,309][2409074] Updated weights for policy 0, policy_version 18191 (0.0012)
[2023-02-25 13:08:01,519][2409597] DAMAGECOUNT value on done: 4811.0
[2023-02-25 13:08:01,522][2409597] Sum rewards: 4.961, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.596', 'AMMO2': '0.004', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.020', 'AMMO3': '0.121', 'weapon5': '0.136', 'weapon7': '0.138', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'weapon4': '0.290', 'WEAPON7': '0.300', 'HITCOUNT': '0.440', 'WEAPON3': '0.750', 'ARMOR': '0.904', 'weapon3': '1.304', 'weapon2': '1.668', 'DAMAGECOUNT': '2.073', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:02,022][2409565] DAMAGECOUNT value on done: 4725.0
[2023-02-25 13:08:02,023][2409565] Sum rewards: 8.652, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.812', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'weapon7': '0.052', 'AMMO3': '0.055', 'AMMO4': '0.064', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.122', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'ARMOR': '0.455', 'HITCOUNT': '0.670', 'weapon3': '1.150', 'weapon2': '2.388', 'DAMAGECOUNT': '2.601', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:08:02,186][2408954] Fps is (10 sec: 24576.0, 60 sec: 24439.5, 300 sec: 25256.4). Total num frames: 74530816. Throughput: 0: 6105.1. Samples: 18640080. Policy #0 lag: (min: 0.0, avg: 12.0, max: 28.0)
[2023-02-25 13:08:02,186][2408954] Avg episode reward: [(0, '7.484')]
[2023-02-25 13:08:02,187][2409033] Saving new best policy, reward=7.484!
[2023-02-25 13:08:02,707][2409074] Updated weights for policy 0, policy_version 18201 (0.0013)
[2023-02-25 13:08:03,286][2409102] DAMAGECOUNT value on done: 4771.0
[2023-02-25 13:08:03,289][2409102] Sum rewards: 12.171, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.060', 'weapon7': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.129', 'weapon5': '0.272', 'HEALTH': '0.297', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'weapon4': '0.474', 'HITCOUNT': '0.600', 'weapon3': '1.208', 'weapon2': '1.518', 'DAMAGECOUNT': '4.014', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:08:03,547][2409548] DAMAGECOUNT value on done: 4244.0
[2023-02-25 13:08:03,549][2409548] Sum rewards: 0.521, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.821', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO3': '0.050', 'weapon7': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.108', 'weapon5': '0.208', 'HITCOUNT': '0.290', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.514', 'weapon3': '0.770', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.107', 'weapon4': '1.112'}
[2023-02-25 13:08:03,756][2409101] DAMAGECOUNT value on done: 5498.0
[2023-02-25 13:08:03,759][2409101] Sum rewards: 15.811, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.991', 'AMMO2': '0.015', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.073', 'AMMO3': '0.080', 'WEAPON4': '0.150', 'weapon5': '0.164', 'weapon4': '0.180', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '1.020', 'weapon2': '1.588', 'weapon3': '1.814', 'DAMAGECOUNT': '3.780', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:08:04,164][2409549] DAMAGECOUNT value on done: 4339.0
[2023-02-25 13:08:04,167][2409549] Sum rewards: 2.534, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.502', 'AMMO2': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.020', 'weapon4': '0.024', 'weapon7': '0.076', 'AMMO3': '0.082', 'weapon5': '0.096', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.440', 'ARMOR': '0.474', 'WEAPON3': '0.550', 'weapon3': '1.320', 'DAMAGECOUNT': '1.365', 'weapon2': '1.814', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:08:04,385][2409103] DAMAGECOUNT value on done: 4224.0
[2023-02-25 13:08:04,385][2409103] Sum rewards: 6.661, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.960', 'AMMO5': '0.022', 'AMMO2': '0.033', 'weapon5': '0.054', 'AMMO3': '0.099', 'AMMO4': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'ARMOR': '0.471', 'weapon4': '0.620', 'WEAPON3': '0.650', 'HITCOUNT': '0.720', 'weapon2': '1.378', 'weapon3': '1.444', 'DAMAGECOUNT': '2.613', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:08:04,618][2409100] DAMAGECOUNT value on done: 4420.0
[2023-02-25 13:08:04,622][2409100] Sum rewards: 7.623, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.026', 'AMMO2': '0.009', 'AMMO5': '0.014', 'ARMOR': '0.020', 'AMMO4': '0.043', 'weapon7': '0.078', 'AMMO3': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.252', 'weapon4': '0.252', 'WEAPON5': '0.400', 'HITCOUNT': '0.480', 'WEAPON3': '0.600', 'weapon3': '1.548', 'weapon2': '1.628', 'DAMAGECOUNT': '1.854', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:04,701][2409485] DAMAGECOUNT value on done: 5492.0
[2023-02-25 13:08:04,702][2409485] Sum rewards: 4.626, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.602', 'AMMO5': '0.017', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO4': '0.108', 'weapon5': '0.114', 'AMMO3': '0.127', 'weapon4': '0.154', 'WEAPON5': '0.300', 'HITCOUNT': '0.490', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'weapon2': '1.164', 'DAMAGECOUNT': '2.079', 'weapon3': '2.262', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:04,856][2409074] Updated weights for policy 0, policy_version 18211 (0.0013)
[2023-02-25 13:08:05,192][2409597] DAMAGECOUNT value on done: 5263.0
[2023-02-25 13:08:05,193][2409597] Sum rewards: 11.843, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.970', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.022', 'AMMO3': '0.087', 'AMMO4': '0.110', 'weapon5': '0.118', 'weapon4': '0.164', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'ARMOR': '0.451', 'WEAPON3': '0.650', 'HITCOUNT': '0.980', 'weapon2': '1.494', 'weapon3': '1.528', 'DAMAGECOUNT': '3.681', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:08:06,243][2409074] Updated weights for policy 0, policy_version 18221 (0.0012)
[2023-02-25 13:08:06,345][2409565] DAMAGECOUNT value on done: 5162.0
[2023-02-25 13:08:06,346][2409565] Sum rewards: 10.206, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.712', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'weapon7': '0.126', 'AMMO3': '0.131', 'weapon5': '0.138', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.474', 'weapon2': '0.676', 'WEAPON3': '0.900', 'HITCOUNT': '0.920', 'weapon3': '1.898', 'DAMAGECOUNT': '3.342', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:08:07,186][2408954] Fps is (10 sec: 24985.8, 60 sec: 24234.6, 300 sec: 25256.4). Total num frames: 74653696. Throughput: 0: 6097.4. Samples: 18658308. Policy #0 lag: (min: 0.0, avg: 12.2, max: 28.0)
[2023-02-25 13:08:07,186][2408954] Avg episode reward: [(0, '7.597')]
[2023-02-25 13:08:07,198][2409033] Saving new best policy, reward=7.597!
[2023-02-25 13:08:07,205][2409102] DAMAGECOUNT value on done: 5349.0
[2023-02-25 13:08:07,206][2409102] Sum rewards: 8.104, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.975', 'AMMO2': '0.005', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.023', 'AMMO3': '0.053', 'weapon5': '0.054', 'weapon7': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'ARMOR': '0.453', 'weapon4': '0.484', 'HITCOUNT': '0.500', 'weapon3': '1.056', 'weapon2': '1.854', 'DAMAGECOUNT': '1.875', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:07,682][2409548] DAMAGECOUNT value on done: 5664.0
[2023-02-25 13:08:07,683][2409548] Sum rewards: 12.061, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.674', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon7': '0.066', 'AMMO4': '0.068', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.288', 'ARMOR': '0.484', 'WEAPON3': '0.650', 'HITCOUNT': '0.760', 'weapon2': '1.076', 'weapon3': '1.800', 'DAMAGECOUNT': '3.387', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:08:07,697][2409074] Updated weights for policy 0, policy_version 18231 (0.0014)
[2023-02-25 13:08:07,704][2409101] DAMAGECOUNT value on done: 4732.0
[2023-02-25 13:08:07,705][2409101] Sum rewards: 8.230, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.196', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.282', 'WEAPON5': '0.350', 'HITCOUNT': '0.680', 'WEAPON3': '0.750', 'ARMOR': '1.381', 'weapon3': '1.434', 'weapon2': '1.644', 'DAMAGECOUNT': '2.328', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:08:08,100][2409549] DAMAGECOUNT value on done: 4404.0
[2023-02-25 13:08:08,103][2409549] Sum rewards: 10.796, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.750', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon4': '0.068', 'AMMO3': '0.077', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.166', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'HITCOUNT': '0.720', 'ARMOR': '1.299', 'weapon3': '1.438', 'weapon2': '1.910', 'DAMAGECOUNT': '3.066', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:08:08,597][2409103] DAMAGECOUNT value on done: 4176.0
[2023-02-25 13:08:08,599][2409103] Sum rewards: 7.343, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.910', 'AMMO2': '0.014', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO4': '0.070', 'AMMO3': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.350', 'weapon4': '0.390', 'ARMOR': '0.412', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'weapon2': '1.340', 'weapon3': '1.366', 'DAMAGECOUNT': '2.859', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:08:08,796][2409485] DAMAGECOUNT value on done: 5839.0
[2023-02-25 13:08:08,800][2409485] Sum rewards: 4.999, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.760', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'weapon5': '0.036', 'AMMO3': '0.047', 'weapon7': '0.048', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.254', 'HITCOUNT': '0.290', 'WEAPON3': '0.350', 'ARMOR': '0.445', 'weapon3': '0.666', 'DAMAGECOUNT': '1.398', 'weapon2': '1.452', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:08:08,921][2409100] DAMAGECOUNT value on done: 4057.0
[2023-02-25 13:08:08,925][2409100] Sum rewards: 13.593, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO2': '0.044', 'weapon7': '0.048', 'AMMO3': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.222', 'HEALTH': '0.250', 'weapon5': '0.276', 'ARMOR': '0.400', 'weapon4': '0.410', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '0.730', 'weapon2': '1.202', 'weapon3': '1.594', 'DAMAGECOUNT': '4.020', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:08:08,929][2409597] DAMAGECOUNT value on done: 3954.0
[2023-02-25 13:08:08,930][2409597] Sum rewards: 6.840, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.240', 'AMMO5': '0.013', 'WEAPON1': '0.030', 'AMMO2': '0.031', 'AMMO3': '0.070', 'weapon5': '0.102', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'weapon4': '0.256', 'WEAPON5': '0.350', 'ARMOR': '0.468', 'WEAPON3': '0.500', 'HITCOUNT': '0.550', 'weapon3': '1.332', 'weapon2': '1.334', 'DAMAGECOUNT': '1.938', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:09,844][2409074] Updated weights for policy 0, policy_version 18241 (0.0019)
[2023-02-25 13:08:10,405][2409565] DAMAGECOUNT value on done: 5374.0
[2023-02-25 13:08:10,406][2409565] Sum rewards: 13.120, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.148', 'AMMO5': '0.015', 'AMMO2': '0.019', 'weapon7': '0.046', 'AMMO4': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'weapon5': '0.180', 'weapon4': '0.288', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'HITCOUNT': '0.800', 'weapon2': '1.336', 'weapon3': '1.694', 'DAMAGECOUNT': '2.931', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:08:10,781][2409596] DAMAGECOUNT value on done: 6151.0
[2023-02-25 13:08:10,782][2409596] Sum rewards: 8.645, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.250', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.042', 'AMMO3': '0.059', 'WEAPON5': '0.100', 'weapon5': '0.102', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'weapon4': '0.486', 'HITCOUNT': '0.730', 'ARMOR': '0.904', 'weapon3': '1.008', 'weapon2': '1.354', 'DAMAGECOUNT': '3.546', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:11,112][2409074] Updated weights for policy 0, policy_version 18251 (0.0014)
[2023-02-25 13:08:11,255][2409102] DAMAGECOUNT value on done: 4701.0
[2023-02-25 13:08:11,255][2409102] Sum rewards: 8.746, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon7': '0.048', 'AMMO3': '0.085', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.102', 'HEALTH': '0.108', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.500', 'weapon4': '0.506', 'HITCOUNT': '0.600', 'ARMOR': '1.220', 'weapon3': '1.302', 'weapon2': '1.676', 'DAMAGECOUNT': '1.785', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:11,664][2409548] DAMAGECOUNT value on done: 4103.0
[2023-02-25 13:08:11,668][2409548] Sum rewards: 4.274, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.078', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon5': '0.068', 'AMMO3': '0.073', 'weapon7': '0.112', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.250', 'HITCOUNT': '0.350', 'WEAPON7': '0.400', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.610', 'weapon2': '0.972', 'weapon3': '0.988', 'DAMAGECOUNT': '2.445', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:12,082][2409105] DAMAGECOUNT value on done: 5021.0
[2023-02-25 13:08:12,085][2409105] Sum rewards: 5.804, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.981', 'AMMO2': '0.007', 'weapon5': '0.018', 'AMMO5': '0.020', 'AMMO4': '0.034', 'WEAPON1': '0.040', 'weapon7': '0.046', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.130', 'WEAPON7': '0.200', 'weapon4': '0.388', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.810', 'WEAPON3': '0.850', 'weapon2': '1.074', 'weapon3': '1.938', 'DAMAGECOUNT': '3.090', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:12,186][2408954] Fps is (10 sec: 24166.5, 60 sec: 24439.5, 300 sec: 25256.4). Total num frames: 74772480. Throughput: 0: 6092.6. Samples: 18694752. Policy #0 lag: (min: 0.0, avg: 12.2, max: 28.0)
[2023-02-25 13:08:12,186][2408954] Avg episode reward: [(0, '7.776')]
[2023-02-25 13:08:12,188][2409101] DAMAGECOUNT value on done: 3420.0
[2023-02-25 13:08:12,191][2409101] Sum rewards: 4.505, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.585', 'AMMO2': '0.019', 'AMMO5': '0.020', 'weapon4': '0.044', 'AMMO3': '0.085', 'AMMO4': '0.093', 'WEAPON4': '0.200', 'weapon5': '0.324', 'HITCOUNT': '0.430', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'ARMOR': '0.897', 'weapon3': '1.424', 'weapon2': '1.494', 'DAMAGECOUNT': '1.710', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:12,219][2409033] Saving new best policy, reward=7.776!
[2023-02-25 13:08:12,596][2409549] DAMAGECOUNT value on done: 4285.0
[2023-02-25 13:08:12,597][2409549] Sum rewards: 5.206, reward structure: {'DEATHCOUNT': '-4.500', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.068', 'weapon7': '0.076', 'weapon5': '0.078', 'AMMO3': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.250', 'HITCOUNT': '0.260', 'weapon4': '0.398', 'WEAPON3': '0.400', 'HEALTH': '0.439', 'weapon2': '0.700', 'weapon3': '1.164', 'DAMAGECOUNT': '1.398', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:08:12,630][2409100] DAMAGECOUNT value on done: 5870.0
[2023-02-25 13:08:12,634][2409100] Sum rewards: 11.131, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.444', 'AMMO5': '0.012', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'weapon7': '0.066', 'weapon5': '0.070', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.130', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.314', 'WEAPON3': '0.550', 'HITCOUNT': '0.820', 'ARMOR': '0.928', 'weapon2': '1.342', 'weapon3': '1.494', 'DAMAGECOUNT': '2.910', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:08:12,935][2409597] DAMAGECOUNT value on done: 4858.0
[2023-02-25 13:08:12,978][2409103] DAMAGECOUNT value on done: 5612.0
[2023-02-25 13:08:12,978][2409103] Sum rewards: 9.112, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'AMMO3': '0.059', 'weapon7': '0.100', 'weapon5': '0.120', 'WEAPON4': '0.150', 'AMMO4': '0.168', 'HEALTH': '0.198', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.400', 'weapon4': '0.664', 'weapon2': '0.702', 'weapon3': '1.128', 'DAMAGECOUNT': '2.307', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:08:13,135][2409074] Updated weights for policy 0, policy_version 18261 (0.0012)
[2023-02-25 13:08:13,504][2409485] DAMAGECOUNT value on done: 4429.0
[2023-02-25 13:08:13,505][2409485] Sum rewards: 8.159, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.760', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'AMMO3': '0.099', 'WEAPON4': '0.150', 'weapon5': '0.156', 'AMMO4': '0.191', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'weapon4': '0.664', 'HITCOUNT': '0.790', 'ARMOR': '0.856', 'weapon2': '1.162', 'weapon3': '1.494', 'DAMAGECOUNT': '3.528', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:08:14,444][2409596] DAMAGECOUNT value on done: 4890.0
[2023-02-25 13:08:14,445][2409596] Sum rewards: 0.424, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.974', 'AMMO2': '0.014', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'weapon7': '0.048', 'weapon4': '0.050', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.350', 'WEAPON5': '0.400', 'ARMOR': '0.453', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.933', 'weapon3': '1.036', 'weapon2': '1.078'}
[2023-02-25 13:08:14,641][2409074] Updated weights for policy 0, policy_version 18271 (0.0012)
[2023-02-25 13:08:14,816][2409565] DAMAGECOUNT value on done: 6640.0
[2023-02-25 13:08:14,817][2409565] Sum rewards: 14.087, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.864', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon7': '0.078', 'AMMO3': '0.096', 'AMMO4': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.272', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.730', 'weapon4': '0.908', 'weapon3': '1.108', 'weapon2': '1.110', 'DAMAGECOUNT': '3.984', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:08:15,333][2409548] DAMAGECOUNT value on done: 4764.0
[2023-02-25 13:08:15,337][2409548] Sum rewards: 1.801, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.790', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.072', 'weapon5': '0.072', 'AMMO4': '0.104', 'weapon7': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO6': '0.260', 'AMMO7': '0.260', 'HITCOUNT': '0.260', 'WEAPON7': '0.300', 'weapon4': '0.338', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.227', 'weapon3': '1.314', 'weapon2': '1.624'}
[2023-02-25 13:08:15,763][2409101] DAMAGECOUNT value on done: 4466.0
[2023-02-25 13:08:15,765][2409101] Sum rewards: 6.226, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.276', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon5': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.112', 'weapon4': '0.152', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.760', 'WEAPON3': '0.800', 'weapon2': '1.260', 'weapon3': '1.788', 'DAMAGECOUNT': '2.967', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:15,803][2409102] DAMAGECOUNT value on done: 5575.0
[2023-02-25 13:08:15,807][2409102] Sum rewards: 9.487, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.010', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'weapon7': '0.090', 'AMMO3': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.156', 'weapon5': '0.162', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'WEAPON3': '0.500', 'weapon2': '0.722', 'HITCOUNT': '0.740', 'weapon4': '0.890', 'weapon3': '1.444', 'DAMAGECOUNT': '4.455', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:08:16,154][2409549] DAMAGECOUNT value on done: 4764.0
[2023-02-25 13:08:16,158][2409549] Sum rewards: 8.904, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.251', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO2': '0.025', 'weapon7': '0.076', 'weapon5': '0.112', 'AMMO3': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.123', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.486', 'WEAPON3': '0.800', 'HITCOUNT': '0.840', 'weapon2': '0.872', 'weapon3': '2.094', 'DAMAGECOUNT': '3.516', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:08:16,354][2409105] DAMAGECOUNT value on done: 4500.0
[2023-02-25 13:08:16,355][2409105] Sum rewards: 7.187, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.322', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'AMMO3': '0.086', 'AMMO4': '0.140', 'weapon4': '0.156', 'weapon5': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'ARMOR': '0.854', 'weapon3': '1.304', 'weapon2': '1.794', 'DAMAGECOUNT': '2.424', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:08:16,454][2409074] Updated weights for policy 0, policy_version 18281 (0.0012)
[2023-02-25 13:08:16,856][2409100] DAMAGECOUNT value on done: 5393.0
[2023-02-25 13:08:16,857][2409100] Sum rewards: 10.750, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.128', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'WEAPON4': '0.050', 'weapon5': '0.066', 'AMMO3': '0.067', 'weapon7': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'weapon4': '0.344', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.630', 'weapon3': '1.266', 'weapon2': '1.682', 'DAMAGECOUNT': '2.787', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:08:17,023][2409866] DAMAGECOUNT value on done: 3698.0
[2023-02-25 13:08:17,024][2409866] Sum rewards: 1.393, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.185', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO3': '0.041', 'WEAPON4': '0.100', 'weapon4': '0.108', 'AMMO4': '0.156', 'weapon5': '0.178', 'HITCOUNT': '0.260', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'ARMOR': '0.940', 'DAMAGECOUNT': '0.975', 'weapon3': '1.034', 'FRAGCOUNT': '2.000', 'weapon2': '2.092'}
[2023-02-25 13:08:17,134][2409103] DAMAGECOUNT value on done: 5050.0
[2023-02-25 13:08:17,137][2409103] Sum rewards: 11.516, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.105', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.010', 'weapon4': '0.042', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'weapon5': '0.218', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '0.680', 'weapon2': '1.648', 'weapon3': '1.880', 'DAMAGECOUNT': '3.258', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:08:17,186][2408954] Fps is (10 sec: 23347.2, 60 sec: 24234.6, 300 sec: 25173.0). Total num frames: 74887168. Throughput: 0: 6096.0. Samples: 18731256. Policy #0 lag: (min: 0.0, avg: 11.5, max: 24.0)
[2023-02-25 13:08:17,186][2408954] Avg episode reward: [(0, '7.856')]
[2023-02-25 13:08:17,188][2409597] DAMAGECOUNT value on done: 5635.0
[2023-02-25 13:08:17,189][2409597] Sum rewards: 6.250, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.182', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'weapon5': '0.076', 'weapon7': '0.116', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'HITCOUNT': '0.350', 'WEAPON3': '0.350', 'weapon4': '0.708', 'weapon3': '1.064', 'weapon2': '1.512', 'DAMAGECOUNT': '1.521', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:08:17,225][2409033] Saving /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000018284_74891264.pth...
[2023-02-25 13:08:17,340][2409033] Removing /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000016816_68878336.pth
[2023-02-25 13:08:17,351][2409033] Saving new best policy, reward=7.856!
[2023-02-25 13:08:17,391][2409077] DAMAGECOUNT value on done: 5924.0
[2023-02-25 13:08:17,392][2409077] Sum rewards: 9.298, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.626', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO3': '0.084', 'AMMO4': '0.164', 'weapon5': '0.204', 'weapon4': '0.316', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'ARMOR': '0.480', 'WEAPON3': '0.500', 'HITCOUNT': '0.840', 'weapon3': '1.404', 'weapon2': '1.606', 'DAMAGECOUNT': '3.318', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:08:17,453][2409485] DAMAGECOUNT value on done: 5118.0
[2023-02-25 13:08:17,453][2409485] Sum rewards: 10.347, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.339', 'AMMO2': '0.006', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.031', 'AMMO3': '0.071', 'WEAPON4': '0.100', 'weapon5': '0.214', 'WEAPON5': '0.250', 'weapon4': '0.292', 'WEAPON3': '0.500', 'HITCOUNT': '0.650', 'weapon2': '1.294', 'weapon3': '1.570', 'DAMAGECOUNT': '2.925', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:08:17,543][2409406] DAMAGECOUNT value on done: 3981.0
[2023-02-25 13:08:17,544][2409406] Sum rewards: 7.082, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.489', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'AMMO3': '0.049', 'weapon7': '0.050', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.290', 'WEAPON3': '0.300', 'weapon3': '0.766', 'ARMOR': '0.939', 'DAMAGECOUNT': '1.425', 'weapon2': '2.000', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:08:18,156][2409405] DAMAGECOUNT value on done: 5648.0
[2023-02-25 13:08:18,160][2409405] Sum rewards: 4.413, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.190', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO2': '0.027', 'weapon4': '0.126', 'AMMO3': '0.134', 'AMMO4': '0.134', 'weapon5': '0.138', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'HITCOUNT': '0.530', 'WEAPON3': '0.850', 'weapon3': '1.618', 'weapon2': '1.810', 'DAMAGECOUNT': '2.094', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:18,211][2409596] DAMAGECOUNT value on done: 3531.0
[2023-02-25 13:08:18,214][2409596] Sum rewards: 7.720, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.210', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.038', 'weapon7': '0.054', 'AMMO3': '0.078', 'weapon4': '0.078', 'weapon5': '0.082', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'HITCOUNT': '0.590', 'weapon3': '1.310', 'weapon2': '1.600', 'DAMAGECOUNT': '2.079', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:18,346][2409074] Updated weights for policy 0, policy_version 18291 (0.0012)
[2023-02-25 13:08:18,918][2409407] DAMAGECOUNT value on done: 4796.0
[2023-02-25 13:08:18,921][2409407] Sum rewards: 11.142, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.838', 'AMMO2': '0.016', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'weapon7': '0.070', 'AMMO4': '0.081', 'AMMO3': '0.085', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.292', 'weapon5': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '0.760', 'ARMOR': '1.393', 'weapon3': '1.416', 'weapon2': '1.502', 'DAMAGECOUNT': '3.228', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:08:19,195][2409373] DAMAGECOUNT value on done: 5052.0
[2023-02-25 13:08:19,198][2409373] Sum rewards: 3.585, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.030', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO3': '0.118', 'weapon5': '0.126', 'AMMO4': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'weapon4': '0.452', 'HITCOUNT': '0.470', 'WEAPON3': '0.600', 'weapon2': '1.218', 'weapon3': '1.962', 'DAMAGECOUNT': '2.502', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:19,441][2409355] DAMAGECOUNT value on done: 5023.0
[2023-02-25 13:08:19,445][2409355] Sum rewards: 8.681, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.610', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'weapon7': '0.018', 'AMMO4': '0.085', 'AMMO3': '0.111', 'weapon5': '0.112', 'weapon4': '0.132', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.530', 'WEAPON3': '0.700', 'weapon3': '1.478', 'weapon2': '1.708', 'ARMOR': '1.749', 'DAMAGECOUNT': '2.181', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:08:19,599][2409565] DAMAGECOUNT value on done: 6046.0
[2023-02-25 13:08:19,600][2409565] Sum rewards: 10.328, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.495', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO3': '0.089', 'weapon5': '0.158', 'WEAPON4': '0.200', 'weapon4': '0.246', 'WEAPON5': '0.300', 'ARMOR': '0.475', 'WEAPON3': '0.650', 'HITCOUNT': '0.710', 'weapon3': '1.298', 'weapon2': '1.926', 'DAMAGECOUNT': '3.255', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:08:19,752][2409074] Updated weights for policy 0, policy_version 18301 (0.0012)
[2023-02-25 13:08:20,137][2409101] DAMAGECOUNT value on done: 6787.0
[2023-02-25 13:08:20,141][2409101] Sum rewards: 4.513, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO3': '0.055', 'WEAPON4': '0.100', 'AMMO4': '0.107', 'weapon7': '0.136', 'weapon5': '0.164', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HEALTH': '0.242', 'HITCOUNT': '0.280', 'WEAPON7': '0.300', 'WEAPON3': '0.300', 'ARMOR': '0.490', 'weapon4': '0.506', 'DAMAGECOUNT': '0.804', 'weapon2': '1.050', 'weapon3': '1.054', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:08:20,369][2409102] DAMAGECOUNT value on done: 5181.0
[2023-02-25 13:08:20,370][2409102] Sum rewards: 3.815, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.824', 'AMMO2': '0.000', 'AMMO4': '0.001', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'weapon5': '0.154', 'AMMO3': '0.163', 'WEAPON5': '0.300', 'HITCOUNT': '0.440', 'ARMOR': '0.915', 'WEAPON3': '0.950', 'weapon2': '1.474', 'DAMAGECOUNT': '1.737', 'weapon3': '1.982', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:20,409][2409105] DAMAGECOUNT value on done: 5874.0
[2023-02-25 13:08:20,412][2409105] Sum rewards: 7.682, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.404', 'AMMO2': '0.010', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'AMMO4': '0.049', 'WEAPON3': '0.300', 'weapon5': '0.328', 'HITCOUNT': '0.340', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'weapon3': '1.068', 'DAMAGECOUNT': '1.512', 'weapon2': '2.356', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:20,491][2409549] DAMAGECOUNT value on done: 5824.0
[2023-02-25 13:08:20,492][2409549] Sum rewards: 10.115, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.115', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO4': '0.052', 'AMMO3': '0.062', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'ARMOR': '0.467', 'HITCOUNT': '0.510', 'weapon2': '0.518', 'weapon4': '0.684', 'weapon3': '1.546', 'DAMAGECOUNT': '2.604', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:08:20,501][2409104] DAMAGECOUNT value on done: 5343.0
[2023-02-25 13:08:20,504][2409104] Sum rewards: 14.342, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.262', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO3': '0.098', 'weapon5': '0.128', 'AMMO4': '0.153', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.442', 'WEAPON3': '0.550', 'HITCOUNT': '0.840', 'weapon2': '0.960', 'ARMOR': '1.011', 'weapon3': '1.664', 'DAMAGECOUNT': '3.414', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:08:20,690][2409866] DAMAGECOUNT value on done: 5739.0
[2023-02-25 13:08:20,694][2409866] Sum rewards: 13.767, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.230', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO3': '0.129', 'AMMO4': '0.164', 'weapon5': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.500', 'weapon2': '0.742', 'WEAPON3': '0.850', 'HITCOUNT': '0.970', 'weapon3': '2.030', 'DAMAGECOUNT': '3.978', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:08:20,713][2409103] DAMAGECOUNT value on done: 4317.0
[2023-02-25 13:08:20,716][2409103] Sum rewards: 5.431, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.822', 'WEAPON1': '0.020', 'AMMO5': '0.027', 'AMMO2': '0.038', 'AMMO3': '0.118', 'AMMO4': '0.189', 'weapon5': '0.282', 'WEAPON4': '0.450', 'HITCOUNT': '0.480', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon2': '0.862', 'weapon4': '0.900', 'ARMOR': '1.204', 'weapon3': '1.614', 'DAMAGECOUNT': '3.069', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:08:21,114][2409597] DAMAGECOUNT value on done: 5111.0
[2023-02-25 13:08:21,115][2409597] Sum rewards: 8.137, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.632', 'AMMO5': '0.018', 'AMMO2': '0.041', 'ARMOR': '0.050', 'AMMO3': '0.085', 'weapon5': '0.120', 'AMMO4': '0.207', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.442', 'WEAPON3': '0.600', 'HITCOUNT': '0.710', 'weapon2': '0.844', 'weapon3': '1.888', 'DAMAGECOUNT': '2.814', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:08:21,223][2409548] DAMAGECOUNT value on done: 5516.0
[2023-02-25 13:08:21,223][2409548] Sum rewards: 7.293, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.630', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon7': '0.048', 'AMMO3': '0.065', 'AMMO4': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.156', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.388', 'WEAPON3': '0.400', 'ARMOR': '0.453', 'HITCOUNT': '0.460', 'weapon3': '1.364', 'weapon2': '1.798', 'DAMAGECOUNT': '2.055', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:21,332][2409485] DAMAGECOUNT value on done: 4891.0
[2023-02-25 13:08:21,524][2409074] Updated weights for policy 0, policy_version 18311 (0.0012)
[2023-02-25 13:08:21,623][2409077] DAMAGECOUNT value on done: 5010.0
[2023-02-25 13:08:21,624][2409077] Sum rewards: 7.014, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.638', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.026', 'weapon5': '0.094', 'AMMO3': '0.096', 'weapon7': '0.112', 'AMMO4': '0.132', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'weapon4': '0.458', 'ARMOR': '0.474', 'HITCOUNT': '0.530', 'WEAPON3': '0.650', 'weapon3': '1.494', 'weapon2': '1.574', 'DAMAGECOUNT': '2.697', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:08:21,760][2409406] DAMAGECOUNT value on done: 5806.0
[2023-02-25 13:08:21,761][2409406] Sum rewards: 7.308, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.250', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.049', 'weapon7': '0.050', 'AMMO3': '0.061', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.243', 'weapon5': '0.282', 'weapon4': '0.424', 'WEAPON4': '0.450', 'HITCOUNT': '0.510', 'WEAPON3': '0.550', 'WEAPON5': '0.550', 'ARMOR': '0.853', 'weapon2': '1.166', 'weapon3': '1.460', 'DAMAGECOUNT': '2.823', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:08:21,890][2409596] DAMAGECOUNT value on done: 4583.0
[2023-02-25 13:08:21,894][2409596] Sum rewards: 8.296, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.804', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon7': '0.060', 'AMMO3': '0.083', 'AMMO4': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.320', 'ARMOR': '0.483', 'WEAPON3': '0.500', 'HITCOUNT': '0.620', 'weapon3': '1.500', 'weapon2': '1.590', 'DAMAGECOUNT': '2.769', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:21,926][2409405] DAMAGECOUNT value on done: 4187.0
[2023-02-25 13:08:21,927][2409405] Sum rewards: 5.979, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.304', 'AMMO2': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.035', 'AMMO3': '0.080', 'weapon5': '0.122', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.512', 'HITCOUNT': '0.590', 'WEAPON3': '0.650', 'ARMOR': '0.905', 'weapon2': '1.422', 'weapon3': '1.716', 'DAMAGECOUNT': '2.364', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:22,087][2409100] DAMAGECOUNT value on done: 4768.0
[2023-02-25 13:08:22,087][2409100] Sum rewards: 8.298, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.048', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.023', 'AMMO3': '0.092', 'weapon5': '0.108', 'AMMO4': '0.114', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.416', 'WEAPON3': '0.450', 'weapon4': '0.702', 'HITCOUNT': '0.820', 'weapon2': '0.932', 'weapon3': '1.824', 'DAMAGECOUNT': '2.790', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:08:22,186][2408954] Fps is (10 sec: 23347.1, 60 sec: 24098.3, 300 sec: 25145.3). Total num frames: 75005952. Throughput: 0: 6076.5. Samples: 18749040. Policy #0 lag: (min: 0.0, avg: 11.5, max: 24.0)
[2023-02-25 13:08:22,186][2408954] Avg episode reward: [(0, '8.039')]
[2023-02-25 13:08:22,187][2409033] Saving new best policy, reward=8.039!
[2023-02-25 13:08:22,690][2409407] DAMAGECOUNT value on done: 5716.0
[2023-02-25 13:08:22,691][2409407] Sum rewards: 12.734, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.192', 'AMMO5': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.116', 'AMMO4': '0.125', 'weapon5': '0.142', 'WEAPON4': '0.250', 'weapon4': '0.408', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'HITCOUNT': '1.120', 'weapon2': '1.150', 'ARMOR': '1.654', 'weapon3': '1.868', 'DAMAGECOUNT': '4.398', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:08:23,014][2409074] Updated weights for policy 0, policy_version 18321 (0.0012)
[2023-02-25 13:08:23,112][2409355] DAMAGECOUNT value on done: 4373.0
[2023-02-25 13:08:23,115][2409355] Sum rewards: 7.891, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.812', 'WEAPON1': '0.020', 'AMMO5': '0.027', 'AMMO2': '0.027', 'AMMO3': '0.069', 'weapon4': '0.078', 'AMMO4': '0.136', 'weapon5': '0.272', 'WEAPON4': '0.300', 'ARMOR': '0.404', 'HITCOUNT': '0.490', 'WEAPON3': '0.500', 'WEAPON5': '0.600', 'weapon3': '1.292', 'weapon2': '1.296', 'DAMAGECOUNT': '3.192', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:23,287][2409565] DAMAGECOUNT value on done: 5413.0
[2023-02-25 13:08:23,290][2409565] Sum rewards: 6.135, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.834', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.038', 'WEAPON4': '0.050', 'weapon7': '0.096', 'weapon5': '0.176', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'weapon4': '0.294', 'WEAPON3': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.310', 'ARMOR': '0.468', 'weapon3': '0.582', 'weapon2': '1.260', 'DAMAGECOUNT': '2.109', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:08:23,360][2409373] DAMAGECOUNT value on done: 4397.0
[2023-02-25 13:08:23,363][2409373] Sum rewards: 8.838, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.561', 'AMMO5': '0.009', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'AMMO3': '0.042', 'weapon7': '0.110', 'AMMO4': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.300', 'weapon4': '0.378', 'HITCOUNT': '0.410', 'weapon3': '0.964', 'weapon2': '1.222', 'DAMAGECOUNT': '2.403', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:24,045][2409102] DAMAGECOUNT value on done: 5241.0
[2023-02-25 13:08:24,046][2409102] Sum rewards: 12.529, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.008', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.046', 'AMMO3': '0.080', 'AMMO4': '0.096', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.400', 'weapon4': '0.456', 'ARMOR': '0.800', 'HITCOUNT': '0.830', 'weapon2': '1.112', 'weapon3': '1.956', 'DAMAGECOUNT': '3.636', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:08:24,351][2409866] DAMAGECOUNT value on done: 5460.0
[2023-02-25 13:08:24,354][2409866] Sum rewards: 7.396, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.276', 'AMMO2': '0.014', 'AMMO5': '0.022', 'WEAPON1': '0.060', 'AMMO4': '0.070', 'AMMO3': '0.109', 'weapon5': '0.162', 'weapon4': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.550', 'HITCOUNT': '0.610', 'WEAPON3': '0.800', 'weapon2': '1.228', 'weapon3': '2.062', 'DAMAGECOUNT': '2.841', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:08:24,379][2409389] DAMAGECOUNT value on done: 4450.0
[2023-02-25 13:08:24,383][2409389] Sum rewards: 7.006, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.171', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'AMMO3': '0.107', 'AMMO4': '0.153', 'weapon5': '0.224', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'ARMOR': '0.468', 'weapon4': '0.468', 'HITCOUNT': '0.740', 'WEAPON3': '0.750', 'weapon2': '1.028', 'weapon3': '1.982', 'DAMAGECOUNT': '2.841', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:08:24,589][2409105] DAMAGECOUNT value on done: 4765.0
[2023-02-25 13:08:24,592][2409105] Sum rewards: 6.597, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.148', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO3': '0.064', 'AMMO4': '0.065', 'weapon7': '0.068', 'weapon5': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.310', 'WEAPON3': '0.400', 'weapon4': '0.436', 'ARMOR': '0.837', 'weapon3': '0.920', 'weapon2': '1.908', 'DAMAGECOUNT': '2.568', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:08:24,774][2409103] DAMAGECOUNT value on done: 4609.0
[2023-02-25 13:08:24,775][2409103] Sum rewards: 5.741, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.370', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO3': '0.045', 'weapon7': '0.046', 'weapon5': '0.074', 'AMMO4': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.300', 'weapon4': '0.416', 'ARMOR': '0.455', 'HITCOUNT': '0.580', 'weapon3': '0.874', 'weapon2': '1.202', 'DAMAGECOUNT': '1.836', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:08:24,816][2409548] DAMAGECOUNT value on done: 5886.0
[2023-02-25 13:08:24,817][2409548] Sum rewards: 8.795, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.038', 'AMMO5': '0.017', 'AMMO2': '0.027', 'AMMO3': '0.059', 'AMMO4': '0.133', 'weapon5': '0.150', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.570', 'ARMOR': '0.854', 'weapon2': '0.922', 'weapon3': '1.034', 'weapon4': '1.182', 'DAMAGECOUNT': '2.985', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:24,905][2409101] DAMAGECOUNT value on done: 4286.0
[2023-02-25 13:08:24,908][2409101] Sum rewards: -1.320, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.344', 'AMMO2': '0.009', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.047', 'AMMO3': '0.108', 'weapon5': '0.154', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon4': '0.782', 'ARMOR': '0.800', 'weapon2': '0.934', 'DAMAGECOUNT': '0.999', 'weapon3': '1.746', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:08:25,153][2409485] DAMAGECOUNT value on done: 5057.0
[2023-02-25 13:08:25,154][2409074] Updated weights for policy 0, policy_version 18331 (0.0012)
[2023-02-25 13:08:25,154][2409485] Sum rewards: 5.224, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.512', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon7': '0.048', 'weapon5': '0.094', 'AMMO4': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.125', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'HITCOUNT': '0.610', 'weapon4': '0.670', 'ARMOR': '0.893', 'WEAPON3': '0.900', 'weapon2': '1.258', 'weapon3': '1.634', 'DAMAGECOUNT': '2.661', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:08:25,315][2409597] DAMAGECOUNT value on done: 5866.0
[2023-02-25 13:08:25,319][2409597] Sum rewards: 13.090, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.082', 'AMMO2': '0.016', 'AMMO5': '0.020', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'weapon5': '0.248', 'weapon4': '0.346', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.690', 'ARMOR': '0.800', 'weapon2': '1.318', 'weapon3': '1.744', 'DAMAGECOUNT': '3.354', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:08:25,329][2409549] DAMAGECOUNT value on done: 6416.0
[2023-02-25 13:08:25,330][2409549] Sum rewards: 8.064, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO3': '0.083', 'weapon7': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.111', 'HEALTH': '0.136', 'WEAPON4': '0.150', 'weapon5': '0.208', 'weapon4': '0.228', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'HITCOUNT': '0.630', 'weapon3': '1.448', 'ARMOR': '1.699', 'weapon2': '1.720', 'DAMAGECOUNT': '2.682', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:25,461][2409077] DAMAGECOUNT value on done: 4958.0
[2023-02-25 13:08:25,464][2409077] Sum rewards: 3.120, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.110', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO2': '0.043', 'weapon7': '0.058', 'AMMO3': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.152', 'AMMO4': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'HITCOUNT': '0.470', 'ARMOR': '0.486', 'WEAPON3': '0.600', 'weapon2': '0.732', 'weapon4': '0.906', 'weapon3': '1.492', 'DAMAGECOUNT': '2.187', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:08:25,479][2409104] DAMAGECOUNT value on done: 4433.0
[2023-02-25 13:08:25,479][2409104] Sum rewards: 8.567, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.355', 'AMMO2': '0.014', 'weapon7': '0.014', 'AMMO5': '0.015', 'weapon4': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.091', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.276', 'WEAPON5': '0.350', 'HITCOUNT': '0.430', 'WEAPON3': '0.650', 'weapon2': '1.158', 'weapon3': '2.004', 'DAMAGECOUNT': '2.154', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:08:25,612][2409406] DAMAGECOUNT value on done: 5352.0
[2023-02-25 13:08:25,621][2409406] Sum rewards: 15.674, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.332', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO5': '0.020', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'weapon4': '0.242', 'weapon5': '0.316', 'ARMOR': '0.442', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'HITCOUNT': '1.020', 'weapon2': '1.108', 'weapon3': '1.696', 'DAMAGECOUNT': '5.178', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:08:25,747][2409100] DAMAGECOUNT value on done: 4349.0
[2023-02-25 13:08:25,750][2409100] Sum rewards: 2.554, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.366', 'AMMO2': '0.016', 'AMMO5': '0.025', 'weapon7': '0.068', 'AMMO4': '0.079', 'AMMO3': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.200', 'weapon5': '0.206', 'weapon4': '0.254', 'WEAPON5': '0.400', 'HITCOUNT': '0.520', 'WEAPON3': '0.650', 'weapon3': '1.184', 'ARMOR': '1.265', 'weapon2': '2.072', 'DAMAGECOUNT': '2.331', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:08:25,879][2409405] DAMAGECOUNT value on done: 4069.0
[2023-02-25 13:08:25,882][2409405] Sum rewards: 2.769, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.288', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO5': '0.030', 'weapon7': '0.048', 'AMMO3': '0.094', 'AMMO4': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.146', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'HITCOUNT': '0.410', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'weapon4': '0.788', 'ARMOR': '0.882', 'weapon2': '0.972', 'weapon3': '1.306', 'DAMAGECOUNT': '1.689', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:08:26,668][2409074] Updated weights for policy 0, policy_version 18341 (0.0012)
[2023-02-25 13:08:26,686][2409355] DAMAGECOUNT value on done: 6115.0
[2023-02-25 13:08:26,687][2409355] Sum rewards: 5.612, reward structure: {'DEATHCOUNT': '-3.000', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO3': '0.057', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'weapon7': '0.158', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.224', 'HEALTH': '0.244', 'HITCOUNT': '0.250', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'weapon2': '0.752', 'DAMAGECOUNT': '1.146', 'weapon3': '1.172', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:08:26,749][2409407] DAMAGECOUNT value on done: 6222.0
[2023-02-25 13:08:26,764][2409407] Sum rewards: 9.092, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.748', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon7': '0.050', 'weapon5': '0.056', 'AMMO4': '0.059', 'AMMO3': '0.087', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.490', 'weapon4': '0.688', 'ARMOR': '0.857', 'weapon2': '0.904', 'weapon3': '1.808', 'DAMAGECOUNT': '2.229', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:26,933][2409565] DAMAGECOUNT value on done: 4086.0
[2023-02-25 13:08:26,934][2409565] Sum rewards: 4.332, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.405', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'AMMO4': '0.045', 'weapon7': '0.116', 'weapon5': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'HITCOUNT': '0.310', 'WEAPON3': '0.350', 'weapon4': '0.350', 'AMMO6': '0.420', 'AMMO7': '0.420', 'ARMOR': '0.463', 'WEAPON7': '0.500', 'weapon3': '0.838', 'DAMAGECOUNT': '1.410', 'weapon2': '1.868', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:08:27,117][2409373] DAMAGECOUNT value on done: 5456.0
[2023-02-25 13:08:27,121][2409373] Sum rewards: 14.879, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.276', 'AMMO5': '0.016', 'AMMO2': '0.020', 'AMMO3': '0.050', 'AMMO4': '0.097', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.280', 'WEAPON5': '0.350', 'WEAPON3': '0.350', 'weapon4': '0.592', 'HITCOUNT': '0.810', 'ARMOR': '0.851', 'weapon3': '0.994', 'weapon2': '1.764', 'DAMAGECOUNT': '5.130', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:08:27,186][2408954] Fps is (10 sec: 24985.8, 60 sec: 24234.8, 300 sec: 25173.0). Total num frames: 75137024. Throughput: 0: 6072.0. Samples: 18785280. Policy #0 lag: (min: 0.0, avg: 11.5, max: 24.0)
[2023-02-25 13:08:27,186][2408954] Avg episode reward: [(0, '7.863')]
[2023-02-25 13:08:27,623][2409596] DAMAGECOUNT value on done: 5111.0
[2023-02-25 13:08:27,625][2409596] Sum rewards: 3.789, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.084', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.068', 'ARMOR': '0.076', 'weapon5': '0.100', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON3': '0.400', 'HITCOUNT': '0.430', 'weapon4': '0.790', 'weapon3': '0.866', 'weapon2': '1.220', 'DAMAGECOUNT': '1.224', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:08:27,691][2409102] DAMAGECOUNT value on done: 4556.0
[2023-02-25 13:08:27,692][2409102] Sum rewards: 13.287, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.022', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO3': '0.040', 'AMMO4': '0.095', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.176', 'WEAPON3': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'ARMOR': '0.400', 'weapon4': '0.412', 'HITCOUNT': '0.690', 'weapon3': '1.016', 'weapon2': '1.322', 'DAMAGECOUNT': '2.781', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:08:27,919][2409866] DAMAGECOUNT value on done: 5255.0
[2023-02-25 13:08:27,923][2409866] Sum rewards: 9.023, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.925', 'AMMO5': '0.011', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'AMMO3': '0.040', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'weapon4': '0.220', 'weapon5': '0.254', 'WEAPON5': '0.350', 'WEAPON3': '0.350', 'HITCOUNT': '0.440', 'ARMOR': '0.453', 'weapon3': '1.122', 'DAMAGECOUNT': '1.581', 'weapon2': '1.912', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:27,977][2409074] Updated weights for policy 0, policy_version 18351 (0.0012)
[2023-02-25 13:08:28,043][2409102] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:08:28,137][2409389] DAMAGECOUNT value on done: 4153.0
[2023-02-25 13:08:28,140][2409389] Sum rewards: 7.827, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.026', 'AMMO5': '0.011', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon7': '0.056', 'AMMO3': '0.058', 'AMMO4': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.134', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'HITCOUNT': '0.330', 'WEAPON3': '0.350', 'ARMOR': '0.483', 'weapon4': '0.520', 'weapon2': '0.778', 'weapon3': '0.890', 'DAMAGECOUNT': '1.944', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:28,348][2409103] DAMAGECOUNT value on done: 5781.0
[2023-02-25 13:08:28,351][2409103] Sum rewards: 8.063, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.298', 'AMMO4': '-0.061', 'AMMO2': '-0.012', 'AMMO5': '0.005', 'AMMO3': '0.070', 'weapon5': '0.080', 'WEAPON5': '0.100', 'WEAPON3': '0.550', 'HITCOUNT': '0.720', 'ARMOR': '0.856', 'weapon3': '1.438', 'weapon2': '2.000', 'DAMAGECOUNT': '2.865', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:28,444][2409105] DAMAGECOUNT value on done: 5062.0
[2023-02-25 13:08:28,445][2409105] Sum rewards: 11.884, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.915', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'AMMO5': '0.020', 'AMMO3': '0.106', 'weapon5': '0.134', 'WEAPON5': '0.450', 'ARMOR': '0.455', 'HITCOUNT': '0.650', 'WEAPON3': '0.850', 'weapon2': '1.584', 'weapon3': '1.942', 'DAMAGECOUNT': '2.670', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:08:28,712][2409548] DAMAGECOUNT value on done: 5679.0
[2023-02-25 13:08:28,713][2409548] Sum rewards: 4.835, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.084', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO3': '0.064', 'weapon7': '0.104', 'weapon4': '0.118', 'AMMO4': '0.120', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'HITCOUNT': '0.370', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'ARMOR': '0.905', 'weapon3': '0.906', 'weapon2': '1.650', 'DAMAGECOUNT': '1.815', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:28,759][2409485] DAMAGECOUNT value on done: 4694.0
[2023-02-25 13:08:28,760][2409485] Sum rewards: 8.772, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.683', 'AMMO5': '0.019', 'AMMO2': '0.023', 'AMMO3': '0.080', 'WEAPON1': '0.080', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'weapon5': '0.194', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'HITCOUNT': '0.550', 'WEAPON3': '0.600', 'weapon4': '0.758', 'weapon3': '1.232', 'weapon2': '1.350', 'DAMAGECOUNT': '2.406', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:08:28,774][2409099] Large shaping reward 2.617 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.585, 195.0), ('weapon7', 0.002)]
[2023-02-25 13:08:29,149][2409077] DAMAGECOUNT value on done: 3806.0
[2023-02-25 13:08:29,152][2409077] Sum rewards: 9.525, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.683', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO3': '0.086', 'weapon5': '0.144', 'WEAPON5': '0.200', 'WEAPON3': '0.600', 'HITCOUNT': '0.630', 'ARMOR': '1.354', 'weapon2': '1.666', 'weapon3': '1.804', 'DAMAGECOUNT': '2.937', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:29,229][2409597] DAMAGECOUNT value on done: 4121.0
[2023-02-25 13:08:29,232][2409597] Sum rewards: 5.103, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '0.000', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO3': '0.040', 'weapon7': '0.106', 'AMMO4': '0.111', 'weapon5': '0.124', 'WEAPON5': '0.150', 'WEAPON3': '0.200', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.356', 'HITCOUNT': '0.400', 'weapon3': '0.974', 'weapon2': '1.362', 'DAMAGECOUNT': '1.557', 'FRAGCOUNT': '2.500'}
[2023-02-25 13:08:29,279][2409406] DAMAGECOUNT value on done: 5018.0
[2023-02-25 13:08:29,279][2409406] Sum rewards: 7.087, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.149', 'AMMO5': '0.032', 'AMMO2': '0.045', 'WEAPON1': '0.050', 'AMMO3': '0.115', 'weapon5': '0.196', 'WEAPON4': '0.200', 'AMMO4': '0.227', 'ARMOR': '0.436', 'weapon4': '0.608', 'weapon2': '0.618', 'HITCOUNT': '0.620', 'WEAPON5': '0.700', 'WEAPON3': '0.800', 'weapon3': '2.108', 'DAMAGECOUNT': '2.730', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:08:29,433][2409405] DAMAGECOUNT value on done: 4359.0
[2023-02-25 13:08:29,434][2409405] Sum rewards: 14.171, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.134', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'weapon7': '0.050', 'weapon5': '0.078', 'AMMO3': '0.134', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.314', 'WEAPON5': '0.450', 'ARMOR': '0.455', 'WEAPON3': '0.850', 'HITCOUNT': '1.040', 'weapon2': '1.436', 'weapon3': '1.836', 'DAMAGECOUNT': '4.680', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:08:29,530][2409100] DAMAGECOUNT value on done: 5214.0
[2023-02-25 13:08:29,534][2409100] Sum rewards: 4.998, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.078', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.032', 'AMMO3': '0.101', 'AMMO4': '0.160', 'weapon5': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'HITCOUNT': '0.480', 'weapon4': '0.512', 'WEAPON3': '0.700', 'ARMOR': '0.887', 'weapon2': '1.332', 'weapon3': '1.606', 'DAMAGECOUNT': '2.001', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:08:29,553][2409101] DAMAGECOUNT value on done: 4588.0
[2023-02-25 13:08:29,554][2409101] Sum rewards: 4.545, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.814', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO5': '0.015', 'weapon7': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.087', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'HITCOUNT': '0.420', 'WEAPON3': '0.550', 'ARMOR': '0.862', 'weapon3': '1.058', 'DAMAGECOUNT': '1.470', 'weapon2': '1.770', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:08:29,859][2409549] DAMAGECOUNT value on done: 5532.0
[2023-02-25 13:08:29,859][2409549] Sum rewards: 13.812, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.630', 'AMMO2': '0.012', 'AMMO5': '0.015', 'weapon7': '0.052', 'AMMO4': '0.057', 'AMMO3': '0.075', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.134', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.600', 'weapon2': '0.766', 'weapon4': '0.866', 'weapon3': '1.242', 'DAMAGECOUNT': '3.333', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:08:30,066][2409104] DAMAGECOUNT value on done: 5796.0
[2023-02-25 13:08:30,067][2409104] Sum rewards: 2.609, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.270', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.052', 'weapon5': '0.072', 'AMMO3': '0.125', 'AMMO4': '0.260', 'WEAPON5': '0.350', 'weapon4': '0.428', 'HITCOUNT': '0.460', 'WEAPON4': '0.600', 'WEAPON3': '0.850', 'weapon2': '1.350', 'ARMOR': '1.401', 'weapon3': '1.758', 'DAMAGECOUNT': '1.887', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:30,235][2409074] Updated weights for policy 0, policy_version 18361 (0.0012)
[2023-02-25 13:08:30,451][2409355] DAMAGECOUNT value on done: 4088.0
[2023-02-25 13:08:30,452][2409355] Sum rewards: 3.247, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.450', 'AMMO5': '0.013', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO3': '0.060', 'weapon7': '0.072', 'AMMO4': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.180', 'WEAPON4': '0.200', 'HITCOUNT': '0.230', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'ARMOR': '0.444', 'weapon4': '0.600', 'weapon2': '0.922', 'DAMAGECOUNT': '1.029', 'weapon3': '1.070', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:08:30,474][2409407] DAMAGECOUNT value on done: 5064.0
[2023-02-25 13:08:30,476][2409407] Sum rewards: 12.814, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.616', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO3': '0.097', 'weapon4': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.154', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.700', 'HITCOUNT': '0.790', 'weapon3': '1.476', 'weapon2': '1.954', 'DAMAGECOUNT': '3.336', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:08:30,697][2409096] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO2', -0.0001, -1.0), ('AMMO4', -0.0005, -1.0), ('weapon4', 0.002)]
[2023-02-25 13:08:30,745][2409565] DAMAGECOUNT value on done: 4862.0
[2023-02-25 13:08:30,746][2409565] Sum rewards: 0.994, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.130', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.021', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.102', 'weapon5': '0.232', 'HITCOUNT': '0.390', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'ARMOR': '1.295', 'weapon2': '1.486', 'weapon3': '1.726', 'DAMAGECOUNT': '1.740', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:08:30,980][2409373] DAMAGECOUNT value on done: 4969.0
[2023-02-25 13:08:30,981][2409373] Sum rewards: 6.760, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'ARMOR': '0.032', 'weapon5': '0.068', 'weapon7': '0.074', 'AMMO3': '0.075', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.131', 'HEALTH': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.330', 'HITCOUNT': '0.460', 'WEAPON3': '0.500', 'weapon2': '0.864', 'weapon3': '1.612', 'DAMAGECOUNT': '2.034', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:31,506][2409596] DAMAGECOUNT value on done: 3655.0
[2023-02-25 13:08:31,509][2409596] Sum rewards: 5.043, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.237', 'AMMO2': '0.022', 'AMMO5': '0.022', 'WEAPON1': '0.060', 'weapon4': '0.084', 'WEAPON4': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.132', 'weapon5': '0.222', 'WEAPON5': '0.500', 'HITCOUNT': '0.530', 'ARMOR': '0.846', 'WEAPON3': '0.850', 'weapon2': '1.496', 'weapon3': '1.868', 'DAMAGECOUNT': '2.190', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:31,526][2409074] Updated weights for policy 0, policy_version 18371 (0.0012)
[2023-02-25 13:08:31,533][2409097] DAMAGECOUNT value on done: 5483.0
[2023-02-25 13:08:31,534][2409097] Sum rewards: 9.007, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.643', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.046', 'weapon7': '0.048', 'weapon5': '0.056', 'AMMO3': '0.061', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.224', 'WEAPON3': '0.450', 'ARMOR': '0.541', 'HITCOUNT': '0.560', 'weapon3': '1.576', 'weapon2': '1.860', 'DAMAGECOUNT': '1.968', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:31,622][2409102] DAMAGECOUNT value on done: 4848.0
[2023-02-25 13:08:31,624][2409102] Sum rewards: 5.236, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.547', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.034', 'WEAPON1': '0.040', 'weapon7': '0.052', 'AMMO3': '0.062', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.450', 'ARMOR': '0.456', 'HITCOUNT': '0.460', 'weapon2': '1.184', 'weapon3': '1.312', 'DAMAGECOUNT': '1.461', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:08:31,687][2409866] DAMAGECOUNT value on done: 5040.0
[2023-02-25 13:08:31,688][2409866] Sum rewards: 6.535, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.110', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.062', 'AMMO3': '0.073', 'weapon7': '0.094', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON7': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.580', 'ARMOR': '0.919', 'weapon3': '1.056', 'weapon4': '1.114', 'weapon2': '1.136', 'DAMAGECOUNT': '2.055', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:32,186][2408954] Fps is (10 sec: 25804.8, 60 sec: 24439.6, 300 sec: 25089.7). Total num frames: 75264000. Throughput: 0: 6078.4. Samples: 18822048. Policy #0 lag: (min: 0.0, avg: 12.3, max: 24.0)
[2023-02-25 13:08:32,186][2408954] Avg episode reward: [(0, '7.623')]
[2023-02-25 13:08:32,218][2409103] DAMAGECOUNT value on done: 5119.0
[2023-02-25 13:08:32,222][2409103] Sum rewards: 4.550, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.011', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'ARMOR': '0.040', 'AMMO3': '0.060', 'weapon5': '0.062', 'weapon7': '0.068', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.380', 'WEAPON3': '0.400', 'weapon4': '0.564', 'DAMAGECOUNT': '1.125', 'weapon2': '1.272', 'weapon3': '1.348', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:08:32,463][2409105] DAMAGECOUNT value on done: 3975.0
[2023-02-25 13:08:32,464][2409105] Sum rewards: 2.129, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.806', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.100', 'AMMO3': '0.104', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'weapon4': '0.166', 'WEAPON4': '0.250', 'ARMOR': '0.428', 'HITCOUNT': '0.480', 'WEAPON3': '0.600', 'weapon3': '1.558', 'DAMAGECOUNT': '1.695', 'weapon2': '1.720', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:08:32,470][2409389] DAMAGECOUNT value on done: 5043.0
[2023-02-25 13:08:32,473][2409389] Sum rewards: 9.998, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.030', 'weapon5': '0.062', 'AMMO4': '0.082', 'weapon7': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'WEAPON3': '0.200', 'HEALTH': '0.200', 'HITCOUNT': '0.580', 'weapon3': '0.764', 'weapon2': '1.202', 'DAMAGECOUNT': '2.592', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:32,584][2409548] DAMAGECOUNT value on done: 3897.0
[2023-02-25 13:08:32,587][2409548] Sum rewards: 6.600, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.362', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.016', 'AMMO3': '0.052', 'AMMO4': '0.078', 'weapon7': '0.092', 'weapon5': '0.174', 'WEAPON4': '0.250', 'AMMO6': '0.260', 'AMMO7': '0.260', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.490', 'weapon4': '0.682', 'ARMOR': '0.947', 'weapon3': '1.018', 'weapon2': '1.250', 'DAMAGECOUNT': '2.118', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:32,650][2409485] DAMAGECOUNT value on done: 4670.0
[2023-02-25 13:08:32,653][2409485] Sum rewards: 7.757, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.810', 'AMMO2': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'AMMO3': '0.133', 'weapon5': '0.246', 'weapon4': '0.306', 'WEAPON5': '0.450', 'ARMOR': '0.452', 'HITCOUNT': '0.610', 'WEAPON3': '0.750', 'weapon2': '1.314', 'weapon3': '1.684', 'DAMAGECOUNT': '2.946', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:08:32,921][2409077] DAMAGECOUNT value on done: 4892.0
[2023-02-25 13:08:32,922][2409077] Sum rewards: 9.800, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'weapon7': '0.052', 'AMMO4': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.138', 'WEAPON5': '0.150', 'HEALTH': '0.249', 'weapon4': '0.282', 'WEAPON3': '0.350', 'HITCOUNT': '0.550', 'weapon3': '1.236', 'ARMOR': '1.255', 'weapon2': '2.024', 'DAMAGECOUNT': '2.205', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:33,079][2409406] DAMAGECOUNT value on done: 4780.0
[2023-02-25 13:08:33,080][2409406] Sum rewards: 10.673, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.696', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'weapon7': '0.054', 'AMMO3': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.148', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'ARMOR': '0.408', 'weapon4': '0.440', 'HITCOUNT': '0.540', 'WEAPON3': '0.600', 'weapon2': '1.184', 'weapon3': '1.442', 'DAMAGECOUNT': '2.454', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:08:33,124][2409597] DAMAGECOUNT value on done: 5981.0
[2023-02-25 13:08:33,128][2409597] Sum rewards: 10.201, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.264', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon7': '0.096', 'AMMO4': '0.111', 'AMMO3': '0.127', 'weapon4': '0.134', 'WEAPON5': '0.150', 'weapon5': '0.182', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'HITCOUNT': '0.650', 'WEAPON3': '0.800', 'weapon2': '1.144', 'ARMOR': '1.279', 'weapon3': '2.174', 'DAMAGECOUNT': '3.096', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:08:33,359][2409101] DAMAGECOUNT value on done: 6199.0
[2023-02-25 13:08:33,363][2409101] Sum rewards: 2.280, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.288', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO4': '0.057', 'AMMO3': '0.061', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.128', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.260', 'weapon5': '0.310', 'WEAPON3': '0.350', 'weapon3': '1.102', 'ARMOR': '1.200', 'DAMAGECOUNT': '1.452', 'weapon2': '2.016', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:08:33,451][2409100] DAMAGECOUNT value on done: 4568.0
[2023-02-25 13:08:33,454][2409100] Sum rewards: 7.195, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.250', 'AMMO2': '0.010', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.049', 'AMMO3': '0.080', 'WEAPON4': '0.150', 'weapon5': '0.162', 'weapon4': '0.266', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'HITCOUNT': '0.660', 'weapon3': '1.536', 'weapon2': '1.654', 'DAMAGECOUNT': '2.475', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:08:33,586][2409074] Updated weights for policy 0, policy_version 18381 (0.0013)
[2023-02-25 13:08:33,685][2409549] DAMAGECOUNT value on done: 5525.0
[2023-02-25 13:08:33,687][2409549] Sum rewards: 4.543, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.930', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'weapon7': '0.126', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HITCOUNT': '0.400', 'WEAPON3': '0.450', 'ARMOR': '0.900', 'weapon3': '0.982', 'DAMAGECOUNT': '1.476', 'weapon2': '1.998', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:08:34,005][2409405] DAMAGECOUNT value on done: 4343.0
[2023-02-25 13:08:34,006][2409405] Sum rewards: 10.771, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.348', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.061', 'AMMO3': '0.082', 'WEAPON5': '0.200', 'weapon5': '0.218', 'WEAPON3': '0.450', 'HITCOUNT': '0.610', 'ARMOR': '0.819', 'weapon3': '1.462', 'weapon2': '2.012', 'DAMAGECOUNT': '3.183', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:08:34,067][2409104] DAMAGECOUNT value on done: 5462.0
[2023-02-25 13:08:34,068][2409104] Sum rewards: 14.644, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.630', 'AMMO2': '0.013', 'AMMO5': '0.017', 'weapon7': '0.046', 'AMMO4': '0.067', 'AMMO3': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.346', 'WEAPON5': '0.350', 'weapon4': '0.422', 'WEAPON3': '0.750', 'HITCOUNT': '0.760', 'ARMOR': '0.900', 'weapon2': '1.082', 'weapon3': '1.700', 'DAMAGECOUNT': '4.524', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:08:34,125][2409355] DAMAGECOUNT value on done: 4683.0
[2023-02-25 13:08:34,125][2409355] Sum rewards: 5.767, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.550', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.088', 'weapon5': '0.222', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'ARMOR': '0.449', 'weapon4': '0.514', 'HITCOUNT': '0.570', 'WEAPON3': '0.700', 'weapon2': '0.894', 'weapon3': '1.592', 'DAMAGECOUNT': '2.583', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:34,630][2409407] DAMAGECOUNT value on done: 6300.0
[2023-02-25 13:08:34,631][2409407] Sum rewards: 13.614, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.309', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon7': '0.052', 'AMMO4': '0.074', 'AMMO3': '0.084', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.288', 'AMMO6': '0.320', 'AMMO7': '0.320', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.590', 'weapon3': '1.218', 'weapon2': '1.848', 'DAMAGECOUNT': '3.426', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:08:34,692][2409866] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:08:34,770][2409373] DAMAGECOUNT value on done: 5552.0
[2023-02-25 13:08:34,771][2409373] Sum rewards: 11.001, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.608', 'AMMO5': '0.012', 'AMMO2': '0.023', 'WEAPON4': '0.050', 'weapon7': '0.052', 'AMMO3': '0.054', 'AMMO4': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.218', 'weapon5': '0.240', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'ARMOR': '0.453', 'HITCOUNT': '0.610', 'weapon3': '1.116', 'weapon2': '1.450', 'DAMAGECOUNT': '2.625', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:08:34,820][2409565] DAMAGECOUNT value on done: 5579.0
[2023-02-25 13:08:34,821][2409565] Sum rewards: 3.777, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.382', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.025', 'AMMO3': '0.054', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.122', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.470', 'weapon4': '0.764', 'weapon2': '1.038', 'weapon3': '1.070', 'FRAGCOUNT': '2.500', 'DAMAGECOUNT': '2.634'}
[2023-02-25 13:08:34,860][2409074] Updated weights for policy 0, policy_version 18391 (0.0012)
[2023-02-25 13:08:35,355][2409097] DAMAGECOUNT value on done: 4396.0
[2023-02-25 13:08:35,356][2409097] Sum rewards: 18.584, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.934', 'AMMO2': '0.017', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'weapon7': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.146', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.740', 'weapon2': '0.880', 'ARMOR': '0.884', 'weapon4': '0.958', 'weapon3': '1.458', 'DAMAGECOUNT': '4.203', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:08:35,400][2409866] DAMAGECOUNT value on done: 5319.0
[2023-02-25 13:08:35,401][2409866] Sum rewards: 11.619, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.193', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO3': '0.070', 'weapon5': '0.110', 'AMMO4': '0.159', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.372', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.880', 'weapon2': '1.488', 'weapon3': '1.508', 'DAMAGECOUNT': '3.330', 'FRAGCOUNT': '8.500'}
[2023-02-25 13:08:35,492][2409102] DAMAGECOUNT value on done: 4235.0
[2023-02-25 13:08:35,493][2409102] Sum rewards: 3.957, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.252', 'AMMO5': '0.017', 'AMMO2': '0.023', 'AMMO3': '0.050', 'weapon7': '0.100', 'HITCOUNT': '0.110', 'AMMO4': '0.116', 'weapon5': '0.126', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON3': '0.250', 'WEAPON7': '0.300', 'weapon4': '0.368', 'weapon3': '0.776', 'ARMOR': '1.271', 'DAMAGECOUNT': '1.305', 'weapon2': '1.556', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:08:35,530][2409596] DAMAGECOUNT value on done: 5122.0
[2023-02-25 13:08:35,533][2409596] Sum rewards: 5.210, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.460', 'AMMO2': '0.014', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.069', 'AMMO3': '0.074', 'weapon5': '0.198', 'WEAPON4': '0.250', 'weapon4': '0.316', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'ARMOR': '0.500', 'HITCOUNT': '0.510', 'weapon2': '1.396', 'DAMAGECOUNT': '1.626', 'weapon3': '1.712', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:36,043][2409105] DAMAGECOUNT value on done: 5599.0
[2023-02-25 13:08:36,046][2409105] Sum rewards: 7.286, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.402', 'AMMO5': '0.015', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.076', 'weapon5': '0.100', 'AMMO4': '0.103', 'weapon4': '0.254', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.650', 'ARMOR': '0.857', 'weapon2': '1.372', 'weapon3': '1.552', 'DAMAGECOUNT': '2.808', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:36,245][2409078] DAMAGECOUNT value on done: 4280.0
[2023-02-25 13:08:36,248][2409078] Sum rewards: 13.944, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.495', 'AMMO2': '0.026', 'AMMO5': '0.029', 'WEAPON1': '0.030', 'AMMO3': '0.090', 'AMMO4': '0.127', 'WEAPON4': '0.300', 'ARMOR': '0.459', 'weapon5': '0.472', 'weapon4': '0.586', 'WEAPON3': '0.700', 'HITCOUNT': '0.710', 'WEAPON5': '0.750', 'weapon2': '0.810', 'weapon3': '1.668', 'DAMAGECOUNT': '3.681', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:08:36,302][2409103] DAMAGECOUNT value on done: 4356.0
[2023-02-25 13:08:36,305][2409103] Sum rewards: 5.385, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.207', 'AMMO5': '0.017', 'AMMO2': '0.020', 'AMMO3': '0.077', 'AMMO4': '0.100', 'weapon7': '0.112', 'WEAPON4': '0.150', 'weapon5': '0.192', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.372', 'WEAPON7': '0.400', 'HITCOUNT': '0.430', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'ARMOR': '0.906', 'weapon3': '1.062', 'weapon2': '1.578', 'DAMAGECOUNT': '1.995', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:08:36,392][2409469] DAMAGECOUNT value on done: 4553.0
[2023-02-25 13:08:36,395][2409469] Sum rewards: 11.891, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.722', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO3': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.170', 'weapon5': '0.172', 'WEAPON5': '0.400', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.730', 'weapon3': '1.552', 'weapon2': '1.742', 'DAMAGECOUNT': '3.348', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:08:36,433][2409389] DAMAGECOUNT value on done: 5763.0
[2023-02-25 13:08:36,434][2409389] Sum rewards: 11.782, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.336', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.007', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.110', 'WEAPON5': '0.200', 'weapon4': '0.236', 'WEAPON3': '0.500', 'HITCOUNT': '0.660', 'ARMOR': '0.906', 'weapon3': '1.042', 'weapon2': '1.450', 'DAMAGECOUNT': '3.075', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:08:36,513][2409074] Updated weights for policy 0, policy_version 18401 (0.0012)
[2023-02-25 13:08:36,522][2409548] DAMAGECOUNT value on done: 5170.0
[2023-02-25 13:08:36,523][2409548] Sum rewards: 5.378, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.314', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon7': '0.048', 'AMMO3': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.340', 'WEAPON3': '0.350', 'weapon4': '0.368', 'ARMOR': '0.444', 'weapon3': '1.256', 'DAMAGECOUNT': '1.392', 'weapon2': '2.016', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:08:36,695][2409597] DAMAGECOUNT value on done: 3979.0
[2023-02-25 13:08:36,699][2409597] Sum rewards: 5.015, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.871', 'AMMO5': '0.007', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO3': '0.064', 'AMMO4': '0.097', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.138', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'HITCOUNT': '0.470', 'weapon4': '0.640', 'ARMOR': '0.997', 'weapon2': '1.080', 'weapon3': '1.376', 'DAMAGECOUNT': '1.728', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:08:36,738][2409075] DAMAGECOUNT value on done: 4586.0
[2023-02-25 13:08:36,742][2409075] Sum rewards: 5.053, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.729', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO5': '0.025', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.137', 'weapon5': '0.166', 'WEAPON4': '0.200', 'weapon4': '0.364', 'HITCOUNT': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'ARMOR': '0.924', 'weapon2': '1.028', 'weapon3': '1.862', 'DAMAGECOUNT': '2.757', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:36,744][2409077] DAMAGECOUNT value on done: 3476.0
[2023-02-25 13:08:36,747][2409077] Sum rewards: 3.239, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.848', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.030', 'weapon7': '0.050', 'AMMO3': '0.078', 'weapon5': '0.098', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.306', 'WEAPON5': '0.350', 'HITCOUNT': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.106', 'ARMOR': '1.282', 'weapon3': '1.586', 'DAMAGECOUNT': '1.590', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:08:36,771][2409485] DAMAGECOUNT value on done: 4465.0
[2023-02-25 13:08:36,772][2409485] Sum rewards: 5.691, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.970', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.041', 'AMMO3': '0.066', 'weapon5': '0.128', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.450', 'weapon4': '0.744', 'weapon3': '0.834', 'weapon2': '1.542', 'DAMAGECOUNT': '2.538', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:36,897][2409406] DAMAGECOUNT value on done: 4274.0
[2023-02-25 13:08:36,898][2409406] Sum rewards: 3.243, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.076', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'AMMO3': '0.020', 'weapon7': '0.048', 'weapon5': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.150', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'weapon3': '0.496', 'DAMAGECOUNT': '0.882', 'FRAGCOUNT': '1.000', 'weapon2': '1.034'}
[2023-02-25 13:08:37,026][2409101] DAMAGECOUNT value on done: 5668.0
[2023-02-25 13:08:37,027][2409101] Sum rewards: 9.217, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.234', 'AMMO5': '0.003', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.028', 'weapon5': '0.028', 'weapon7': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.054', 'WEAPON4': '0.250', 'AMMO6': '0.360', 'AMMO7': '0.360', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'HITCOUNT': '0.640', 'weapon4': '0.784', 'ARMOR': '0.901', 'weapon3': '1.124', 'weapon2': '1.354', 'DAMAGECOUNT': '2.910', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:37,186][2408954] Fps is (10 sec: 24166.5, 60 sec: 24371.2, 300 sec: 25075.9). Total num frames: 75378688. Throughput: 0: 6078.1. Samples: 18840636. Policy #0 lag: (min: 0.0, avg: 12.3, max: 24.0)
[2023-02-25 13:08:37,186][2408954] Avg episode reward: [(0, '7.699')]
[2023-02-25 13:08:37,247][2409100] DAMAGECOUNT value on done: 4657.0
[2023-02-25 13:08:37,250][2409100] Sum rewards: 10.578, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.186', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.074', 'AMMO3': '0.084', 'WEAPON4': '0.200', 'weapon5': '0.202', 'weapon4': '0.204', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.720', 'weapon3': '1.448', 'weapon2': '1.706', 'DAMAGECOUNT': '2.970', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:08:37,317][2409549] DAMAGECOUNT value on done: 4688.0
[2023-02-25 13:08:37,320][2409549] Sum rewards: 9.160, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.514', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.027', 'weapon7': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.122', 'weapon5': '0.124', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.330', 'HITCOUNT': '0.630', 'WEAPON3': '0.700', 'weapon3': '1.442', 'weapon2': '1.488', 'ARMOR': '1.803', 'DAMAGECOUNT': '2.409', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:08:37,538][2409076] DAMAGECOUNT value on done: 4669.0
[2023-02-25 13:08:37,539][2409076] Sum rewards: 1.568, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.430', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO3': '0.035', 'AMMO2': '0.045', 'weapon5': '0.046', 'weapon7': '0.058', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'AMMO4': '0.225', 'HITCOUNT': '0.230', 'WEAPON3': '0.250', 'weapon2': '0.272', 'WEAPON4': '0.550', 'weapon3': '0.658', 'weapon4': '1.042', 'DAMAGECOUNT': '1.419', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:08:37,627][2409405] DAMAGECOUNT value on done: 4102.0
[2023-02-25 13:08:37,628][2409405] Sum rewards: 3.811, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.563', 'AMMO2': '0.010', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.050', 'AMMO3': '0.069', 'WEAPON4': '0.150', 'weapon5': '0.168', 'weapon7': '0.208', 'WEAPON5': '0.250', 'AMMO6': '0.340', 'AMMO7': '0.340', 'HITCOUNT': '0.380', 'WEAPON3': '0.400', 'WEAPON7': '0.500', 'weapon4': '0.676', 'ARMOR': '0.946', 'weapon3': '1.186', 'weapon2': '1.288', 'DAMAGECOUNT': '2.370', 'FRAGCOUNT': '2.500'}
[2023-02-25 13:08:37,867][2409355] DAMAGECOUNT value on done: 6001.0
[2023-02-25 13:08:37,870][2409355] Sum rewards: 10.353, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.665', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.062', 'AMMO4': '0.124', 'weapon5': '0.272', 'weapon4': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.450', 'ARMOR': '0.457', 'HITCOUNT': '0.670', 'weapon2': '1.372', 'weapon3': '1.404', 'DAMAGECOUNT': '3.453', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:08:37,952][2409104] DAMAGECOUNT value on done: 4475.0
[2023-02-25 13:08:37,955][2409104] Sum rewards: 4.219, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.695', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.012', 'AMMO3': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'WEAPON3': '0.100', 'weapon7': '0.102', 'WEAPON4': '0.200', 'HITCOUNT': '0.220', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.302', 'WEAPON7': '0.400', 'weapon3': '0.784', 'ARMOR': '0.923', 'weapon2': '1.488', 'DAMAGECOUNT': '1.500', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:08:38,403][2409407] DAMAGECOUNT value on done: 5757.0
[2023-02-25 13:08:38,406][2409407] Sum rewards: 7.724, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.058', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.072', 'weapon4': '0.098', 'weapon5': '0.106', 'AMMO3': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.650', 'HITCOUNT': '0.680', 'ARMOR': '1.310', 'weapon3': '1.584', 'weapon2': '1.806', 'DAMAGECOUNT': '2.493', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:08:38,441][2409074] Updated weights for policy 0, policy_version 18411 (0.0013)
[2023-02-25 13:08:38,570][2409373] DAMAGECOUNT value on done: 4999.0
[2023-02-25 13:08:38,574][2409373] Sum rewards: 13.797, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.336', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon7': '0.052', 'AMMO3': '0.067', 'AMMO4': '0.093', 'weapon5': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.500', 'weapon4': '0.530', 'HITCOUNT': '0.750', 'weapon2': '1.082', 'weapon3': '1.308', 'DAMAGECOUNT': '3.069', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:08:38,898][2409565] DAMAGECOUNT value on done: 5988.0
[2023-02-25 13:08:38,901][2409565] Sum rewards: 9.283, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.456', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO3': '0.044', 'weapon7': '0.066', 'WEAPON4': '0.150', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON3': '0.350', 'WEAPON7': '0.400', 'weapon4': '0.462', 'ARMOR': '0.501', 'HITCOUNT': '0.550', 'weapon3': '0.890', 'weapon2': '0.956', 'DAMAGECOUNT': '1.956', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:39,166][2409097] DAMAGECOUNT value on done: 5001.0
[2023-02-25 13:08:39,166][2409097] Sum rewards: 2.508, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.534', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.008', 'WEAPON1': '0.020', 'weapon5': '0.060', 'AMMO3': '0.073', 'WEAPON5': '0.200', 'ARMOR': '0.437', 'HITCOUNT': '0.460', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.182', 'weapon2': '1.276', 'DAMAGECOUNT': '1.566'}
[2023-02-25 13:08:39,180][2409866] DAMAGECOUNT value on done: 3053.0
[2023-02-25 13:08:39,181][2409866] Sum rewards: 9.876, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.382', 'weapon4': '0.012', 'AMMO2': '0.012', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'weapon5': '0.194', 'WEAPON5': '0.450', 'HITCOUNT': '0.650', 'WEAPON3': '0.750', 'ARMOR': '0.800', 'weapon3': '1.664', 'weapon2': '1.784', 'DAMAGECOUNT': '2.880', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:08:39,350][2409596] DAMAGECOUNT value on done: 5010.0
[2023-02-25 13:08:39,354][2409596] Sum rewards: 4.176, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.110', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.029', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'weapon4': '0.150', 'weapon5': '0.246', 'HITCOUNT': '0.560', 'WEAPON5': '0.700', 'WEAPON3': '0.850', 'weapon2': '1.294', 'ARMOR': '1.414', 'weapon3': '1.776', 'DAMAGECOUNT': '2.025', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:08:39,419][2409074] Updated weights for policy 0, policy_version 18421 (0.0012)
[2023-02-25 13:08:39,566][2409102] DAMAGECOUNT value on done: 5314.0
[2023-02-25 13:08:39,569][2409102] Sum rewards: 3.212, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.810', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO3': '0.089', 'weapon7': '0.098', 'AMMO4': '0.131', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.430', 'weapon4': '0.446', 'WEAPON3': '0.550', 'ARMOR': '0.887', 'weapon3': '1.006', 'DAMAGECOUNT': '1.458', 'weapon2': '1.892', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:40,113][2409105] DAMAGECOUNT value on done: 4357.0
[2023-02-25 13:08:40,114][2409105] Sum rewards: 6.158, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.997', 'AMMO2': '0.016', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO3': '0.058', 'AMMO4': '0.081', 'weapon5': '0.116', 'weapon4': '0.288', 'WEAPON3': '0.300', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.650', 'ARMOR': '0.930', 'weapon3': '1.048', 'DAMAGECOUNT': '2.361', 'weapon2': '2.368', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:40,201][2409103] DAMAGECOUNT value on done: 3414.0
[2023-02-25 13:08:40,202][2409103] Sum rewards: 8.755, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO3': '0.031', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO4': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.112', 'HEALTH': '0.166', 'weapon4': '0.238', 'WEAPON3': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.300', 'ARMOR': '0.400', 'weapon3': '0.794', 'weapon2': '1.382', 'DAMAGECOUNT': '1.515', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:40,295][2409548] DAMAGECOUNT value on done: 4695.0
[2023-02-25 13:08:40,296][2409548] Sum rewards: 4.794, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.737', 'AMMO5': '0.003', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.067', 'weapon5': '0.074', 'weapon7': '0.120', 'AMMO4': '0.139', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.530', 'weapon4': '0.730', 'ARMOR': '0.890', 'weapon3': '1.226', 'weapon2': '1.560', 'DAMAGECOUNT': '2.124', 'FRAGCOUNT': '2.500'}
[2023-02-25 13:08:40,505][2409077] DAMAGECOUNT value on done: 5504.0
[2023-02-25 13:08:40,509][2409077] Sum rewards: 8.949, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.603', 'AMMO5': '0.014', 'AMMO2': '0.030', 'WEAPON1': '0.030', 'weapon5': '0.084', 'AMMO3': '0.096', 'AMMO4': '0.149', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'ARMOR': '0.412', 'weapon4': '0.422', 'WEAPON3': '0.600', 'HITCOUNT': '0.760', 'weapon2': '0.902', 'weapon3': '1.896', 'DAMAGECOUNT': '2.907', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:40,567][2409389] DAMAGECOUNT value on done: 4166.0
[2023-02-25 13:08:40,571][2409389] Sum rewards: 5.950, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '0.000', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.059', 'AMMO3': '0.064', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.310', 'HITCOUNT': '0.340', 'WEAPON3': '0.450', 'weapon2': '0.826', 'weapon3': '1.300', 'DAMAGECOUNT': '1.425', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:40,654][2409406] DAMAGECOUNT value on done: 5690.0
[2023-02-25 13:08:40,655][2409406] Sum rewards: 12.638, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'HEALTH': '0.056', 'AMMO4': '0.088', 'AMMO3': '0.098', 'weapon5': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.310', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.660', 'weapon3': '1.494', 'weapon2': '1.648', 'DAMAGECOUNT': '4.362', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:08:40,696][2409485] DAMAGECOUNT value on done: 4946.0
[2023-02-25 13:08:40,699][2409485] Sum rewards: 11.115, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.864', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'AMMO4': '0.081', 'weapon5': '0.112', 'WEAPON4': '0.200', 'weapon4': '0.226', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'HITCOUNT': '0.750', 'weapon3': '1.226', 'weapon2': '1.642', 'DAMAGECOUNT': '3.498', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:08:40,712][2409078] DAMAGECOUNT value on done: 4614.0
[2023-02-25 13:08:40,713][2409078] Sum rewards: 6.422, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.376', 'AMMO2': '0.015', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'weapon7': '0.060', 'AMMO4': '0.073', 'AMMO3': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.118', 'WEAPON4': '0.150', 'weapon4': '0.336', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '0.700', 'ARMOR': '0.908', 'weapon2': '1.298', 'weapon3': '1.690', 'DAMAGECOUNT': '2.475', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:40,757][2409597] DAMAGECOUNT value on done: 4819.0
[2023-02-25 13:08:40,758][2409597] Sum rewards: 9.645, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.642', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO3': '0.083', 'AMMO4': '0.087', 'weapon5': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.584', 'WEAPON3': '0.600', 'HITCOUNT': '0.680', 'weapon3': '1.186', 'ARMOR': '1.259', 'weapon2': '1.660', 'DAMAGECOUNT': '3.435', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:08:40,804][2409469] DAMAGECOUNT value on done: 5130.0
[2023-02-25 13:08:40,808][2409469] Sum rewards: 6.130, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.161', 'AMMO2': '0.006', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'weapon7': '0.020', 'AMMO4': '0.029', 'AMMO3': '0.098', 'weapon5': '0.152', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.406', 'WEAPON5': '0.450', 'HITCOUNT': '0.640', 'WEAPON3': '0.650', 'weapon2': '1.136', 'weapon3': '1.858', 'DAMAGECOUNT': '2.586', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:40,891][2409075] DAMAGECOUNT value on done: 5073.0
[2023-02-25 13:08:40,895][2409075] Sum rewards: 5.492, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.180', 'AMMO2': '0.002', 'AMMO5': '0.009', 'AMMO4': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.084', 'weapon5': '0.094', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.246', 'WEAPON5': '0.250', 'HITCOUNT': '0.480', 'ARMOR': '0.481', 'WEAPON3': '0.650', 'weapon3': '1.424', 'weapon2': '1.534', 'DAMAGECOUNT': '1.638', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:40,963][2409100] DAMAGECOUNT value on done: 4461.0
[2023-02-25 13:08:40,963][2409100] Sum rewards: 7.829, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.066', 'AMMO2': '0.009', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.046', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'weapon5': '0.276', 'weapon4': '0.390', 'WEAPON5': '0.450', 'HITCOUNT': '0.480', 'WEAPON3': '0.750', 'ARMOR': '0.848', 'weapon2': '1.194', 'weapon3': '1.754', 'DAMAGECOUNT': '2.202', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:08:40,978][2409101] DAMAGECOUNT value on done: 4397.0
[2023-02-25 13:08:40,981][2409101] Sum rewards: 6.609, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.064', 'AMMO5': '0.005', 'AMMO2': '0.029', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.064', 'weapon5': '0.114', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'weapon4': '0.262', 'WEAPON3': '0.450', 'HITCOUNT': '0.450', 'weapon2': '1.178', 'weapon3': '1.528', 'DAMAGECOUNT': '1.929', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:08:41,303][2409549] DAMAGECOUNT value on done: 6217.0
[2023-02-25 13:08:41,307][2409549] Sum rewards: 12.674, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.240', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'AMMO3': '0.092', 'AMMO4': '0.180', 'weapon5': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.418', 'WEAPON3': '0.600', 'ARMOR': '0.833', 'HITCOUNT': '0.860', 'weapon3': '1.264', 'weapon2': '1.364', 'DAMAGECOUNT': '4.416', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:08:41,752][2409104] DAMAGECOUNT value on done: 5534.0
[2023-02-25 13:08:41,770][2409104] Sum rewards: 12.958, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.220', 'AMMO5': '0.017', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'weapon7': '0.088', 'AMMO4': '0.091', 'AMMO3': '0.093', 'weapon5': '0.174', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.400', 'weapon4': '0.440', 'WEAPON3': '0.600', 'HITCOUNT': '0.820', 'weapon2': '1.306', 'weapon3': '1.524', 'DAMAGECOUNT': '3.276', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:08:41,804][2409355] DAMAGECOUNT value on done: 4799.0
[2023-02-25 13:08:41,805][2409355] Sum rewards: 15.206, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.575', 'AMMO2': '0.002', 'AMMO4': '0.010', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'WEAPON4': '0.050', 'AMMO3': '0.109', 'weapon5': '0.178', 'weapon4': '0.262', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'ARMOR': '0.846', 'HITCOUNT': '0.850', 'weapon2': '1.192', 'weapon3': '2.082', 'DAMAGECOUNT': '3.975', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:08:41,906][2409076] DAMAGECOUNT value on done: 5216.0
[2023-02-25 13:08:41,910][2409076] Sum rewards: 10.802, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.026', 'weapon5': '0.028', 'AMMO3': '0.069', 'weapon7': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HEALTH': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.530', 'weapon3': '1.176', 'weapon2': '1.744', 'DAMAGECOUNT': '2.220', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:08:42,014][2409407] DAMAGECOUNT value on done: 7851.0
[2023-02-25 13:08:42,015][2409407] Sum rewards: 15.948, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.450', 'AMMO2': '0.008', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.042', 'weapon7': '0.050', 'AMMO3': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'weapon4': '0.612', 'HITCOUNT': '1.030', 'weapon2': '1.104', 'weapon3': '1.396', 'DAMAGECOUNT': '4.752', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:08:42,139][2409074] Updated weights for policy 0, policy_version 18431 (0.0012)
[2023-02-25 13:08:42,151][2409405] DAMAGECOUNT value on done: 5437.0
[2023-02-25 13:08:42,153][2409405] Sum rewards: 10.955, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'weapon7': '0.052', 'AMMO3': '0.079', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.128', 'weapon5': '0.166', 'WEAPON5': '0.200', 'weapon4': '0.348', 'HEALTH': '0.376', 'WEAPON3': '0.450', 'HITCOUNT': '0.660', 'ARMOR': '0.800', 'weapon3': '1.216', 'weapon2': '1.632', 'DAMAGECOUNT': '3.402', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:08:42,186][2408954] Fps is (10 sec: 23347.3, 60 sec: 24166.4, 300 sec: 25062.0). Total num frames: 75497472. Throughput: 0: 6100.8. Samples: 18878208. Policy #0 lag: (min: 0.0, avg: 8.9, max: 24.0)
[2023-02-25 13:08:42,186][2408954] Avg episode reward: [(0, '7.921')]
[2023-02-25 13:08:42,536][2409565] DAMAGECOUNT value on done: 4858.0
[2023-02-25 13:08:42,539][2409565] Sum rewards: 6.738, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.038', 'AMMO2': '0.015', 'AMMO5': '0.020', 'AMMO4': '0.076', 'AMMO3': '0.102', 'WEAPON4': '0.200', 'weapon4': '0.204', 'weapon5': '0.326', 'WEAPON5': '0.600', 'HITCOUNT': '0.600', 'WEAPON3': '0.750', 'weapon2': '0.982', 'weapon3': '2.076', 'DAMAGECOUNT': '2.574', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:42,800][2409074] Updated weights for policy 0, policy_version 18441 (0.0013)
[2023-02-25 13:08:42,857][2409097] DAMAGECOUNT value on done: 5024.0
[2023-02-25 13:08:42,858][2409097] Sum rewards: 7.965, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.376', 'AMMO2': '0.020', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'weapon5': '0.136', 'weapon4': '0.156', 'AMMO3': '0.203', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'weapon2': '1.102', 'HITCOUNT': '1.140', 'WEAPON3': '1.200', 'weapon3': '2.266', 'DAMAGECOUNT': '4.215', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:08:42,976][2409373] DAMAGECOUNT value on done: 5204.0
[2023-02-25 13:08:42,979][2409373] Sum rewards: 7.173, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.957', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.011', 'WEAPON1': '0.030', 'AMMO3': '0.122', 'weapon5': '0.184', 'WEAPON5': '0.300', 'HITCOUNT': '0.670', 'WEAPON3': '0.850', 'weapon2': '1.300', 'weapon3': '2.244', 'DAMAGECOUNT': '2.916', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:08:43,066][2409596] DAMAGECOUNT value on done: 4977.0
[2023-02-25 13:08:43,070][2409596] Sum rewards: 12.453, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.045', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.028', 'weapon7': '0.064', 'AMMO3': '0.081', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.190', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.360', 'WEAPON3': '0.450', 'ARMOR': '0.474', 'HITCOUNT': '0.580', 'weapon3': '1.146', 'weapon2': '1.410', 'DAMAGECOUNT': '3.009', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:08:43,180][2409102] DAMAGECOUNT value on done: 5323.0
[2023-02-25 13:08:43,181][2409102] Sum rewards: 9.033, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.297', 'AMMO5': '0.012', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'weapon7': '0.022', 'AMMO4': '0.068', 'AMMO3': '0.078', 'weapon5': '0.166', 'WEAPON4': '0.250', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'weapon4': '0.340', 'WEAPON5': '0.350', 'HITCOUNT': '0.430', 'WEAPON3': '0.550', 'weapon3': '1.286', 'weapon2': '1.908', 'DAMAGECOUNT': '2.142', 'ARMOR': '2.294', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:08:43,240][2409866] DAMAGECOUNT value on done: 5082.0
[2023-02-25 13:08:43,244][2409866] Sum rewards: 8.152, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.170', 'AMMO5': '0.005', 'AMMO2': '0.032', 'AMMO3': '0.055', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.158', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'ARMOR': '0.500', 'HITCOUNT': '0.800', 'weapon4': '0.856', 'weapon3': '1.042', 'weapon2': '1.494', 'DAMAGECOUNT': '2.820', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:43,748][2409103] DAMAGECOUNT value on done: 3773.0
[2023-02-25 13:08:43,749][2409103] Sum rewards: 8.421, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.955', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'weapon7': '0.052', 'weapon5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'weapon4': '0.430', 'HITCOUNT': '0.730', 'weapon3': '0.782', 'weapon2': '1.190', 'DAMAGECOUNT': '2.631', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:44,053][2409077] DAMAGECOUNT value on done: 5052.0
[2023-02-25 13:08:44,054][2409077] Sum rewards: 0.908, reward structure: {'DEATHCOUNT': '-5.250', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.435', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'AMMO3': '0.058', 'AMMO4': '0.097', 'weapon7': '0.104', 'weapon5': '0.114', 'WEAPON5': '0.150', 'HITCOUNT': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.300', 'WEAPON4': '0.350', 'WEAPON7': '0.400', 'weapon3': '0.462', 'weapon4': '0.594', 'ARMOR': '0.892', 'DAMAGECOUNT': '1.020', 'weapon2': '1.834'}
[2023-02-25 13:08:44,150][2409548] DAMAGECOUNT value on done: 4330.0
[2023-02-25 13:08:44,153][2409548] Sum rewards: 6.911, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.519', 'AMMO5': '0.012', 'weapon7': '0.024', 'AMMO2': '0.031', 'AMMO3': '0.079', 'AMMO4': '0.153', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon5': '0.174', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.530', 'ARMOR': '0.800', 'weapon4': '0.864', 'weapon2': '0.956', 'weapon3': '1.394', 'DAMAGECOUNT': '2.592', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:44,177][2409406] DAMAGECOUNT value on done: 5009.0
[2023-02-25 13:08:44,181][2409406] Sum rewards: 17.195, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.116', 'AMMO2': '0.011', 'AMMO5': '0.015', 'AMMO4': '0.056', 'AMMO3': '0.071', 'weapon5': '0.320', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'ARMOR': '0.800', 'HITCOUNT': '0.990', 'weapon2': '1.706', 'weapon3': '1.732', 'DAMAGECOUNT': '4.209', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:08:44,275][2409485] DAMAGECOUNT value on done: 4466.0
[2023-02-25 13:08:44,276][2409485] Sum rewards: 4.920, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.088', 'AMMO2': '0.019', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'AMMO4': '0.093', 'AMMO3': '0.133', 'weapon5': '0.182', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'HITCOUNT': '0.570', 'WEAPON3': '0.850', 'weapon2': '1.290', 'DAMAGECOUNT': '2.034', 'weapon3': '2.134', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:44,466][2409389] DAMAGECOUNT value on done: 4966.0
[2023-02-25 13:08:44,468][2409389] Sum rewards: 5.253, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.933', 'AMMO5': '0.014', 'AMMO2': '0.022', 'weapon7': '0.048', 'AMMO3': '0.093', 'AMMO4': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.470', 'weapon4': '0.494', 'WEAPON3': '0.650', 'ARMOR': '0.879', 'weapon3': '1.172', 'weapon2': '1.512', 'DAMAGECOUNT': '2.394', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:08:44,535][2409105] DAMAGECOUNT value on done: 5059.0
[2023-02-25 13:08:44,538][2409105] Sum rewards: 8.500, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO3': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'weapon5': '0.064', 'HEALTH': '0.132', 'weapon7': '0.132', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.270', 'weapon4': '0.286', 'WEAPON3': '0.300', 'ARMOR': '0.923', 'weapon3': '1.144', 'weapon2': '1.602', 'DAMAGECOUNT': '1.839', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:08:44,654][2409078] DAMAGECOUNT value on done: 5363.0
[2023-02-25 13:08:44,655][2409078] Sum rewards: 13.761, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.049', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon7': '0.048', 'AMMO3': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'weapon5': '0.186', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'weapon4': '0.538', 'WEAPON3': '0.600', 'weapon2': '0.902', 'HITCOUNT': '1.040', 'weapon3': '1.900', 'DAMAGECOUNT': '4.725', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:08:44,703][2409074] Updated weights for policy 0, policy_version 18451 (0.0012)
[2023-02-25 13:08:44,797][2409075] DAMAGECOUNT value on done: 5346.0
[2023-02-25 13:08:44,800][2409075] Sum rewards: 14.514, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.232', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'AMMO5': '0.027', 'AMMO3': '0.113', 'AMMO4': '0.135', 'weapon4': '0.150', 'WEAPON4': '0.200', 'weapon5': '0.336', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'HITCOUNT': '0.700', 'weapon3': '1.174', 'ARMOR': '1.253', 'weapon2': '1.706', 'DAMAGECOUNT': '4.104', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:08:44,844][2409100] DAMAGECOUNT value on done: 4316.0
[2023-02-25 13:08:44,845][2409100] Sum rewards: 12.565, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.289', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.016', 'AMMO3': '0.040', 'weapon7': '0.052', 'AMMO4': '0.079', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon5': '0.274', 'WEAPON3': '0.300', 'HITCOUNT': '0.520', 'weapon4': '0.676', 'ARMOR': '0.920', 'weapon3': '1.012', 'weapon2': '1.164', 'DAMAGECOUNT': '2.826', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:08:44,901][2409101] DAMAGECOUNT value on done: 5331.0
[2023-02-25 13:08:44,902][2409101] Sum rewards: 6.419, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.535', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO3': '0.087', 'weapon5': '0.180', 'ARMOR': '0.450', 'WEAPON5': '0.450', 'HITCOUNT': '0.580', 'WEAPON3': '0.600', 'weapon2': '1.540', 'weapon3': '1.874', 'DAMAGECOUNT': '2.640', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:08:45,006][2409469] DAMAGECOUNT value on done: 4543.0
[2023-02-25 13:08:45,007][2409469] Sum rewards: 6.488, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.822', 'weapon4': '0.004', 'AMMO2': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.059', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'weapon5': '0.216', 'HITCOUNT': '0.360', 'WEAPON5': '0.400', 'ARMOR': '0.446', 'WEAPON3': '0.550', 'weapon3': '1.592', 'DAMAGECOUNT': '1.830', 'weapon2': '1.840', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:45,127][2409549] DAMAGECOUNT value on done: 5159.0
[2023-02-25 13:08:45,130][2409549] Sum rewards: 5.307, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.768', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO3': '0.098', 'AMMO4': '0.144', 'weapon5': '0.274', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.500', 'HITCOUNT': '0.580', 'WEAPON3': '0.700', 'weapon2': '1.228', 'ARMOR': '1.257', 'weapon3': '1.360', 'DAMAGECOUNT': '2.082', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:08:45,171][2409597] DAMAGECOUNT value on done: 5372.0
[2023-02-25 13:08:45,174][2409597] Sum rewards: 6.203, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.451', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO2': '0.060', 'AMMO3': '0.071', 'weapon5': '0.128', 'AMMO4': '0.298', 'ARMOR': '0.412', 'weapon4': '0.440', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'WEAPON4': '0.650', 'HITCOUNT': '0.810', 'weapon2': '1.338', 'weapon3': '1.686', 'DAMAGECOUNT': '3.261', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:08:45,481][2409104] DAMAGECOUNT value on done: 4241.0
[2023-02-25 13:08:45,482][2409104] Sum rewards: 7.089, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.535', 'AMMO5': '0.014', 'AMMO2': '0.024', 'weapon7': '0.066', 'AMMO3': '0.079', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.121', 'weapon5': '0.122', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'HITCOUNT': '0.570', 'weapon2': '0.930', 'weapon4': '0.942', 'weapon3': '1.010', 'DAMAGECOUNT': '1.905', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:08:45,606][2409407] DAMAGECOUNT value on done: 4131.0
[2023-02-25 13:08:45,610][2409407] Sum rewards: 7.622, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.107', 'AMMO2': '0.017', 'AMMO5': '0.017', 'WEAPON4': '0.050', 'weapon7': '0.068', 'AMMO3': '0.076', 'AMMO4': '0.085', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.212', 'weapon5': '0.224', 'WEAPON5': '0.500', 'HITCOUNT': '0.570', 'WEAPON3': '0.600', 'weapon3': '1.460', 'weapon2': '1.818', 'DAMAGECOUNT': '2.481', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:08:45,646][2409355] DAMAGECOUNT value on done: 4356.0
[2023-02-25 13:08:45,647][2409355] Sum rewards: 8.383, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.101', 'AMMO5': '0.003', 'AMMO2': '0.028', 'AMMO3': '0.050', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'WEAPON4': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.400', 'ARMOR': '0.404', 'weapon4': '0.436', 'DAMAGECOUNT': '1.383', 'weapon3': '1.442', 'weapon2': '1.574', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:46,044][2409076] DAMAGECOUNT value on done: 4802.0
[2023-02-25 13:08:46,044][2409076] Sum rewards: 8.340, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.590', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.079', 'weapon5': '0.118', 'AMMO4': '0.124', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.426', 'WEAPON3': '0.550', 'HITCOUNT': '0.710', 'ARMOR': '0.950', 'weapon3': '1.480', 'weapon2': '1.500', 'DAMAGECOUNT': '2.889', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:08:46,056][2409405] DAMAGECOUNT value on done: 5459.0
[2023-02-25 13:08:46,057][2409405] Sum rewards: 5.649, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.604', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO5': '0.017', 'AMMO4': '0.073', 'AMMO3': '0.088', 'weapon5': '0.190', 'WEAPON4': '0.250', 'weapon4': '0.372', 'WEAPON5': '0.450', 'ARMOR': '0.486', 'HITCOUNT': '0.530', 'WEAPON3': '0.650', 'weapon2': '1.424', 'weapon3': '1.656', 'DAMAGECOUNT': '2.541', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:46,105][2409565] DAMAGECOUNT value on done: 5244.0
[2023-02-25 13:08:46,106][2409565] Sum rewards: 14.166, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.022', 'AMMO2': '0.033', 'HEALTH': '0.064', 'AMMO3': '0.102', 'AMMO4': '0.164', 'WEAPON4': '0.250', 'weapon5': '0.278', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'weapon4': '0.550', 'HITCOUNT': '0.640', 'ARMOR': '0.800', 'weapon2': '0.920', 'weapon3': '1.380', 'DAMAGECOUNT': '3.912', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:08:46,446][2409074] Updated weights for policy 0, policy_version 18461 (0.0012)
[2023-02-25 13:08:46,561][2409097] DAMAGECOUNT value on done: 5538.0
[2023-02-25 13:08:46,571][2409097] Sum rewards: 2.831, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO4': '-0.021', 'HEALTH': '-0.017', 'AMMO2': '-0.004', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO3': '0.070', 'weapon5': '0.072', 'weapon4': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.340', 'ARMOR': '0.447', 'WEAPON3': '0.450', 'weapon3': '1.124', 'weapon2': '1.264', 'DAMAGECOUNT': '1.302', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:08:46,781][2409596] DAMAGECOUNT value on done: 3653.0
[2023-02-25 13:08:46,794][2409596] Sum rewards: 1.779, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.094', 'AMMO5': '0.010', 'AMMO2': '0.010', 'weapon5': '0.012', 'AMMO3': '0.044', 'AMMO4': '0.050', 'weapon7': '0.104', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'HITCOUNT': '0.260', 'WEAPON4': '0.300', 'WEAPON3': '0.300', 'WEAPON7': '0.400', 'ARMOR': '0.400', 'weapon4': '0.560', 'weapon3': '0.746', 'DAMAGECOUNT': '1.002', 'weapon2': '1.244', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:08:46,904][2409866] DAMAGECOUNT value on done: 5221.0
[2023-02-25 13:08:46,905][2409866] Sum rewards: 7.421, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.010', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.097', 'AMMO3': '0.113', 'weapon5': '0.152', 'weapon4': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.453', 'WEAPON3': '0.750', 'HITCOUNT': '0.930', 'weapon2': '1.286', 'weapon3': '1.816', 'DAMAGECOUNT': '3.216', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:08:46,939][2409102] DAMAGECOUNT value on done: 5162.0
[2023-02-25 13:08:46,943][2409102] Sum rewards: 12.008, reward structure: {'DEATHCOUNT': '-7.500', 'weapon4': '0.008', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'WEAPON4': '0.050', 'HEALTH': '0.052', 'weapon7': '0.066', 'AMMO4': '0.079', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.102', 'weapon5': '0.158', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'weapon2': '1.576', 'weapon3': '1.616', 'DAMAGECOUNT': '3.555', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:08:47,186][2408954] Fps is (10 sec: 26214.1, 60 sec: 24507.7, 300 sec: 25089.7). Total num frames: 75640832. Throughput: 0: 6137.1. Samples: 18916248. Policy #0 lag: (min: 0.0, avg: 8.9, max: 24.0)
[2023-02-25 13:08:47,186][2408954] Avg episode reward: [(0, '8.078')]
[2023-02-25 13:08:47,192][2409033] Saving new best policy, reward=8.078!
[2023-02-25 13:08:47,199][2409596] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:08:47,281][2409373] DAMAGECOUNT value on done: 4720.0
[2023-02-25 13:08:47,284][2409373] Sum rewards: 6.468, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.780', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.022', 'AMMO3': '0.040', 'weapon7': '0.050', 'weapon5': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.400', 'HITCOUNT': '0.550', 'weapon4': '0.692', 'weapon2': '0.700', 'weapon3': '1.082', 'DAMAGECOUNT': '2.094', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:08:47,537][2409549] Large shaping reward 2.533 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.501, 167.0), ('weapon7', 0.002)]
[2023-02-25 13:08:47,766][2409103] DAMAGECOUNT value on done: 6544.0
[2023-02-25 13:08:47,765][2409077] DAMAGECOUNT value on done: 4769.0
[2023-02-25 13:08:47,768][2409103] Sum rewards: 9.570, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.260', 'AMMO2': '0.009', 'AMMO5': '0.016', 'AMMO4': '0.045', 'weapon7': '0.050', 'weapon4': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'weapon5': '0.178', 'WEAPON7': '0.200', 'ARMOR': '0.408', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'HITCOUNT': '0.820', 'weapon3': '1.442', 'weapon2': '1.992', 'DAMAGECOUNT': '3.804', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:08:47,768][2409077] Sum rewards: 9.740, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.340', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'AMMO5': '0.022', 'AMMO3': '0.048', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.101', 'weapon5': '0.102', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'WEAPON5': '0.450', 'HITCOUNT': '0.570', 'weapon3': '0.824', 'weapon4': '0.912', 'weapon2': '1.186', 'ARMOR': '1.261', 'DAMAGECOUNT': '2.715', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:08:47,778][2409074] Updated weights for policy 0, policy_version 18471 (0.0012)
[2023-02-25 13:08:47,894][2409406] DAMAGECOUNT value on done: 4245.0
[2023-02-25 13:08:47,897][2409406] Sum rewards: 6.209, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.266', 'AMMO5': '0.022', 'AMMO2': '0.026', 'WEAPON1': '0.040', 'weapon4': '0.056', 'AMMO3': '0.072', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'HITCOUNT': '0.290', 'weapon5': '0.298', 'WEAPON3': '0.500', 'WEAPON5': '0.600', 'weapon2': '1.370', 'DAMAGECOUNT': '1.407', 'weapon3': '1.716', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:48,192][2409105] DAMAGECOUNT value on done: 5468.0
[2023-02-25 13:08:48,195][2409105] Sum rewards: 5.235, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.007', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.030', 'AMMO3': '0.047', 'weapon7': '0.072', 'weapon5': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.440', 'weapon4': '0.662', 'weapon3': '0.860', 'ARMOR': '0.869', 'DAMAGECOUNT': '1.590', 'weapon2': '1.972', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:08:48,422][2409548] DAMAGECOUNT value on done: 4896.0
[2023-02-25 13:08:48,423][2409548] Sum rewards: 14.316, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.608', 'AMMO2': '0.004', 'AMMO5': '0.015', 'AMMO4': '0.019', 'AMMO3': '0.081', 'weapon5': '0.106', 'WEAPON4': '0.250', 'weapon4': '0.332', 'WEAPON5': '0.350', 'ARMOR': '0.458', 'WEAPON3': '0.650', 'HITCOUNT': '0.960', 'weapon2': '1.250', 'weapon3': '1.492', 'DAMAGECOUNT': '3.957', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:08:48,426][2409389] DAMAGECOUNT value on done: 5569.0
[2023-02-25 13:08:48,428][2409389] Sum rewards: 14.151, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.270', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO3': '0.089', 'AMMO4': '0.103', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.280', 'weapon4': '0.352', 'WEAPON3': '0.500', 'HITCOUNT': '1.140', 'weapon2': '1.496', 'weapon3': '1.662', 'DAMAGECOUNT': '3.768', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:08:48,440][2409485] DAMAGECOUNT value on done: 5548.0
[2023-02-25 13:08:48,445][2409485] Sum rewards: 17.517, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO3': '0.080', 'weapon7': '0.090', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'weapon5': '0.158', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.420', 'WEAPON3': '0.450', 'HEALTH': '0.764', 'HITCOUNT': '0.870', 'ARMOR': '1.251', 'weapon3': '1.324', 'weapon2': '1.606', 'DAMAGECOUNT': '4.068', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:08:48,588][2409078] DAMAGECOUNT value on done: 5181.0
[2023-02-25 13:08:48,590][2409078] Sum rewards: 9.734, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'AMMO3': '0.097', 'AMMO4': '0.155', 'weapon5': '0.184', 'WEAPON4': '0.200', 'weapon4': '0.266', 'HEALTH': '0.316', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '0.730', 'ARMOR': '0.839', 'weapon3': '1.560', 'weapon2': '1.572', 'DAMAGECOUNT': '3.243', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:08:48,661][2409101] DAMAGECOUNT value on done: 4502.0
[2023-02-25 13:08:48,663][2409101] Sum rewards: 5.244, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.404', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.021', 'weapon5': '0.054', 'AMMO3': '0.058', 'weapon7': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.260', 'WEAPON3': '0.350', 'weapon4': '0.494', 'weapon2': '0.580', 'weapon3': '0.672', 'DAMAGECOUNT': '1.935', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:08:48,795][2409597] DAMAGECOUNT value on done: 5001.0
[2023-02-25 13:08:48,796][2409597] Sum rewards: 6.976, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.332', 'weapon7': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.063', 'weapon5': '0.098', 'AMMO4': '0.170', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.328', 'WEAPON3': '0.350', 'HITCOUNT': '0.570', 'weapon3': '1.406', 'weapon2': '1.728', 'DAMAGECOUNT': '2.745', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:08:48,797][2409075] DAMAGECOUNT value on done: 3788.0
[2023-02-25 13:08:48,800][2409075] Sum rewards: 7.011, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.709', 'AMMO4': '-0.008', 'AMMO2': '-0.001', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'weapon7': '0.064', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.244', 'WEAPON5': '0.300', 'weapon4': '0.336', 'WEAPON3': '0.400', 'HITCOUNT': '0.430', 'ARMOR': '0.800', 'weapon3': '1.088', 'weapon2': '1.320', 'DAMAGECOUNT': '2.304', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:48,904][2409549] DAMAGECOUNT value on done: 5859.0
[2023-02-25 13:08:48,908][2409549] Sum rewards: 10.185, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.830', 'AMMO4': '-0.072', 'AMMO2': '-0.014', 'AMMO5': '0.007', 'AMMO3': '0.050', 'weapon7': '0.052', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'HITCOUNT': '0.390', 'ARMOR': '0.449', 'weapon3': '1.280', 'DAMAGECOUNT': '2.025', 'weapon2': '2.204', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:49,057][2409100] DAMAGECOUNT value on done: 4776.0
[2023-02-25 13:08:49,060][2409100] Sum rewards: 12.776, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.725', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'WEAPON4': '0.050', 'weapon7': '0.072', 'AMMO3': '0.079', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.102', 'AMMO4': '0.166', 'weapon4': '0.258', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.840', 'weapon2': '0.844', 'weapon3': '1.588', 'DAMAGECOUNT': '3.381', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:08:49,173][2409469] DAMAGECOUNT value on done: 6081.0
[2023-02-25 13:08:49,179][2409469] Sum rewards: 11.493, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.816', 'AMMO2': '0.008', 'AMMO5': '0.018', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'AMMO3': '0.076', 'weapon5': '0.188', 'weapon4': '0.244', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.890', 'weapon2': '1.478', 'weapon3': '1.534', 'DAMAGECOUNT': '3.981', 'FRAGCOUNT': '8.500'}
[2023-02-25 13:08:49,274][2409104] DAMAGECOUNT value on done: 4583.0
[2023-02-25 13:08:49,277][2409104] Sum rewards: 8.063, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.000', 'AMMO5': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.062', 'AMMO3': '0.063', 'weapon7': '0.080', 'AMMO4': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.300', 'weapon4': '0.446', 'WEAPON3': '0.550', 'HITCOUNT': '0.570', 'weapon2': '0.856', 'weapon3': '1.462', 'DAMAGECOUNT': '2.388', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:08:49,576][2409407] DAMAGECOUNT value on done: 6701.0
[2023-02-25 13:08:49,581][2409407] Sum rewards: 7.868, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.639', 'AMMO2': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.060', 'AMMO3': '0.071', 'WEAPON4': '0.100', 'weapon7': '0.122', 'weapon5': '0.166', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.312', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'HITCOUNT': '0.540', 'weapon3': '1.014', 'ARMOR': '1.256', 'weapon2': '1.312', 'DAMAGECOUNT': '2.946', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:49,823][2409355] DAMAGECOUNT value on done: 5396.0
[2023-02-25 13:08:49,825][2409355] Sum rewards: 9.298, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.880', 'AMMO2': '0.009', 'AMMO5': '0.015', 'AMMO4': '0.047', 'AMMO3': '0.093', 'weapon7': '0.136', 'weapon5': '0.176', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.414', 'WEAPON3': '0.650', 'weapon2': '0.756', 'HITCOUNT': '0.950', 'weapon3': '1.944', 'DAMAGECOUNT': '3.258', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:08:49,852][2409405] DAMAGECOUNT value on done: 4628.0
[2023-02-25 13:08:49,852][2409405] Sum rewards: 10.104, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.020', 'AMMO3': '0.050', 'weapon5': '0.056', 'weapon7': '0.088', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'ARMOR': '0.475', 'HITCOUNT': '0.540', 'HEALTH': '0.585', 'weapon3': '1.018', 'weapon2': '1.226', 'DAMAGECOUNT': '2.196', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:49,860][2409074] Updated weights for policy 0, policy_version 18481 (0.0013)
[2023-02-25 13:08:50,013][2409565] DAMAGECOUNT value on done: 5306.0
[2023-02-25 13:08:50,014][2409565] Sum rewards: 13.865, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.070', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.024', 'AMMO4': '0.036', 'AMMO3': '0.091', 'weapon4': '0.118', 'WEAPON4': '0.150', 'weapon5': '0.262', 'ARMOR': '0.400', 'WEAPON5': '0.650', 'WEAPON3': '0.800', 'HITCOUNT': '1.040', 'weapon2': '1.242', 'weapon3': '2.056', 'DAMAGECOUNT': '4.548', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:08:50,171][2409076] DAMAGECOUNT value on done: 5242.0
[2023-02-25 13:08:50,172][2409076] Sum rewards: 6.466, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.995', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'ARMOR': '0.040', 'AMMO3': '0.064', 'AMMO4': '0.089', 'weapon5': '0.094', 'WEAPON5': '0.150', 'WEAPON4': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.650', 'weapon4': '0.834', 'weapon2': '1.052', 'weapon3': '1.526', 'DAMAGECOUNT': '2.229', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:50,390][2409097] DAMAGECOUNT value on done: 4216.0
[2023-02-25 13:08:50,391][2409097] Sum rewards: 7.369, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.158', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'weapon7': '0.046', 'AMMO4': '0.081', 'weapon5': '0.086', 'AMMO3': '0.113', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.200', 'ARMOR': '0.446', 'WEAPON5': '0.450', 'HITCOUNT': '0.460', 'weapon4': '0.538', 'WEAPON3': '0.700', 'weapon2': '0.872', 'weapon3': '1.768', 'DAMAGECOUNT': '2.106', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:50,547][2409596] DAMAGECOUNT value on done: 5464.0
[2023-02-25 13:08:50,550][2409596] Sum rewards: 11.678, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.948', 'AMMO2': '0.018', 'AMMO5': '0.022', 'AMMO4': '0.091', 'weapon5': '0.116', 'AMMO3': '0.131', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'weapon4': '0.548', 'weapon2': '0.714', 'WEAPON3': '0.800', 'HITCOUNT': '1.030', 'weapon3': '1.762', 'DAMAGECOUNT': '4.293', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:08:50,618][2409102] DAMAGECOUNT value on done: 5266.0
[2023-02-25 13:08:50,621][2409102] Sum rewards: 7.791, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.318', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'AMMO3': '0.043', 'weapon5': '0.046', 'weapon7': '0.070', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.280', 'WEAPON3': '0.400', 'HITCOUNT': '0.580', 'weapon3': '0.896', 'ARMOR': '0.918', 'weapon2': '0.948', 'DAMAGECOUNT': '2.187', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:51,130][2409074] Updated weights for policy 0, policy_version 18491 (0.0012)
[2023-02-25 13:08:51,154][2409373] DAMAGECOUNT value on done: 5159.0
[2023-02-25 13:08:51,155][2409373] Sum rewards: 7.703, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.270', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon7': '0.048', 'weapon5': '0.058', 'AMMO3': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'HITCOUNT': '0.660', 'weapon4': '0.698', 'weapon2': '0.970', 'weapon3': '1.300', 'DAMAGECOUNT': '2.871', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:51,179][2409866] DAMAGECOUNT value on done: 5871.0
[2023-02-25 13:08:51,180][2409866] Sum rewards: 5.174, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.060', 'AMMO2': '0.011', 'AMMO5': '0.023', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'weapon4': '0.292', 'weapon5': '0.292', 'WEAPON5': '0.600', 'HITCOUNT': '0.760', 'WEAPON3': '0.800', 'ARMOR': '0.863', 'weapon2': '1.260', 'weapon3': '1.834', 'DAMAGECOUNT': '3.234', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:51,529][2409077] DAMAGECOUNT value on done: 4072.0
[2023-02-25 13:08:51,531][2409077] Sum rewards: 0.593, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.120', 'AMMO5': '0.020', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'AMMO3': '0.080', 'weapon5': '0.114', 'AMMO4': '0.140', 'weapon4': '0.162', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'ARMOR': '0.453', 'WEAPON3': '0.650', 'HITCOUNT': '0.680', 'weapon3': '1.502', 'weapon2': '1.710', 'DAMAGECOUNT': '2.643', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:51,591][2409079] DAMAGECOUNT value on done: 4476.0
[2023-02-25 13:08:51,592][2409079] Sum rewards: 11.410, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.621', 'AMMO2': '0.013', 'AMMO5': '0.015', 'weapon7': '0.048', 'AMMO3': '0.053', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.122', 'weapon4': '0.192', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '0.640', 'ARMOR': '0.852', 'weapon3': '1.098', 'weapon2': '1.900', 'DAMAGECOUNT': '2.991', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:08:51,675][2409406] DAMAGECOUNT value on done: 4672.0
[2023-02-25 13:08:51,676][2409406] Sum rewards: 6.448, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.069', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.126', 'HITCOUNT': '0.160', 'weapon5': '0.166', 'HEALTH': '0.176', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.660', 'weapon3': '0.836', 'ARMOR': '1.741', 'FRAGCOUNT': '2.000', 'weapon2': '2.572'}
[2023-02-25 13:08:51,785][2409103] DAMAGECOUNT value on done: 5643.0
[2023-02-25 13:08:51,796][2409103] Sum rewards: 14.648, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.407', 'AMMO2': '0.008', 'AMMO5': '0.021', 'AMMO4': '0.041', 'AMMO3': '0.096', 'weapon7': '0.106', 'weapon5': '0.198', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.276', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.750', 'weapon2': '1.328', 'weapon3': '1.434', 'DAMAGECOUNT': '3.816', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:08:52,009][2409486] DAMAGECOUNT value on done: 4290.0
[2023-02-25 13:08:52,010][2409486] Sum rewards: 3.787, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.007', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO3': '0.059', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'HEALTH': '0.110', 'WEAPON5': '0.200', 'weapon5': '0.206', 'HITCOUNT': '0.300', 'WEAPON3': '0.350', 'weapon4': '0.516', 'DAMAGECOUNT': '0.936', 'weapon2': '1.112', 'weapon3': '1.140', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:08:52,050][2409389] DAMAGECOUNT value on done: 5392.0
[2023-02-25 13:08:52,054][2409389] Sum rewards: 12.159, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.882', 'AMMO5': '0.014', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.082', 'AMMO3': '0.145', 'weapon5': '0.172', 'weapon4': '0.232', 'WEAPON5': '0.300', 'HITCOUNT': '0.740', 'WEAPON3': '0.800', 'ARMOR': '0.944', 'weapon2': '1.180', 'weapon3': '1.962', 'DAMAGECOUNT': '3.153', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:08:52,186][2408954] Fps is (10 sec: 27033.6, 60 sec: 24712.5, 300 sec: 25103.6). Total num frames: 75767808. Throughput: 0: 6141.9. Samples: 18934692. Policy #0 lag: (min: 0.0, avg: 8.9, max: 24.0)
[2023-02-25 13:08:52,186][2408954] Avg episode reward: [(0, '8.360')]
[2023-02-25 13:08:52,187][2409033] Saving new best policy, reward=8.360!
[2023-02-25 13:08:52,363][2409096] DAMAGECOUNT value on done: 5841.0
[2023-02-25 13:08:52,367][2409096] Sum rewards: 7.887, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.010', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.008', 'WEAPON1': '0.010', 'weapon4': '0.046', 'WEAPON4': '0.050', 'weapon5': '0.060', 'AMMO3': '0.108', 'WEAPON5': '0.150', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.900', 'weapon3': '1.470', 'weapon2': '2.206', 'DAMAGECOUNT': '3.330', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:52,389][2409101] DAMAGECOUNT value on done: 5555.0
[2023-02-25 13:08:52,390][2409101] Sum rewards: 11.354, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.233', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.030', 'weapon5': '0.056', 'AMMO3': '0.075', 'weapon7': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'weapon4': '0.574', 'HITCOUNT': '0.840', 'ARMOR': '0.873', 'weapon2': '1.314', 'weapon3': '1.442', 'DAMAGECOUNT': '3.531', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:08:52,428][2409078] DAMAGECOUNT value on done: 4859.0
[2023-02-25 13:08:52,431][2409078] Sum rewards: 12.211, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.045', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO3': '0.040', 'weapon4': '0.074', 'WEAPON4': '0.100', 'weapon5': '0.140', 'WEAPON5': '0.150', 'weapon7': '0.194', 'WEAPON3': '0.350', 'AMMO6': '0.360', 'AMMO7': '0.360', 'HITCOUNT': '0.490', 'WEAPON7': '0.600', 'weapon3': '0.998', 'weapon2': '1.954', 'DAMAGECOUNT': '2.442', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:08:52,436][2409075] DAMAGECOUNT value on done: 4974.0
[2023-02-25 13:08:52,440][2409075] Sum rewards: 6.160, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.740', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO3': '0.069', 'AMMO4': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.154', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.360', 'WEAPON4': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.616', 'weapon3': '0.814', 'weapon2': '1.328', 'DAMAGECOUNT': '2.232', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:52,493][2409548] DAMAGECOUNT value on done: 5156.0
[2023-02-25 13:08:52,494][2409548] Sum rewards: 5.864, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.695', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.012', 'AMMO3': '0.040', 'WEAPON4': '0.100', 'weapon7': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.156', 'WEAPON7': '0.200', 'weapon4': '0.224', 'HITCOUNT': '0.330', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'ARMOR': '0.876', 'weapon3': '0.958', 'weapon2': '1.640', 'DAMAGECOUNT': '1.755', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:08:52,574][2409074] Updated weights for policy 0, policy_version 18501 (0.0012)
[2023-02-25 13:08:52,582][2409105] DAMAGECOUNT value on done: 5136.0
[2023-02-25 13:08:52,583][2409105] Sum rewards: 8.371, reward structure: {'DEATHCOUNT': '-6.750', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO5': '0.017', 'AMMO4': '0.076', 'AMMO3': '0.110', 'weapon5': '0.128', 'WEAPON5': '0.350', 'HEALTH': '0.364', 'ARMOR': '0.400', 'HITCOUNT': '0.570', 'WEAPON3': '0.650', 'weapon2': '1.076', 'weapon3': '2.092', 'DAMAGECOUNT': '2.262', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:08:52,637][2409549] DAMAGECOUNT value on done: 4205.0
[2023-02-25 13:08:52,640][2409549] Sum rewards: 5.110, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.030', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon5': '0.012', 'AMMO4': '0.020', 'AMMO3': '0.031', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.076', 'weapon7': '0.114', 'WEAPON3': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HITCOUNT': '0.290', 'WEAPON7': '0.300', 'ARMOR': '0.445', 'weapon3': '0.724', 'DAMAGECOUNT': '1.095', 'weapon2': '1.286', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:08:52,691][2409485] DAMAGECOUNT value on done: 4701.0
[2023-02-25 13:08:52,692][2409485] Sum rewards: 9.555, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.080', 'AMMO2': '0.004', 'AMMO5': '0.008', 'AMMO4': '0.018', 'weapon7': '0.058', 'AMMO3': '0.076', 'weapon5': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'ARMOR': '0.449', 'weapon4': '0.456', 'WEAPON3': '0.500', 'HITCOUNT': '0.630', 'weapon2': '1.398', 'weapon3': '1.602', 'DAMAGECOUNT': '2.316', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:52,902][2409469] DAMAGECOUNT value on done: 5925.0
[2023-02-25 13:08:52,903][2409469] Sum rewards: 12.937, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.170', 'AMMO2': '0.010', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.051', 'AMMO3': '0.068', 'weapon7': '0.134', 'WEAPON4': '0.200', 'weapon5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.314', 'WEAPON7': '0.400', 'WEAPON5': '0.400', 'ARMOR': '0.443', 'HITCOUNT': '0.460', 'WEAPON3': '0.500', 'weapon3': '1.208', 'weapon2': '1.604', 'DAMAGECOUNT': '2.832', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:08:52,986][2409104] DAMAGECOUNT value on done: 4064.0
[2023-02-25 13:08:52,989][2409104] Sum rewards: 4.181, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.769', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon7': '0.048', 'weapon5': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.101', 'WEAPON5': '0.300', 'HITCOUNT': '0.460', 'WEAPON3': '0.750', 'ARMOR': '1.219', 'weapon2': '1.680', 'weapon3': '1.830', 'DAMAGECOUNT': '1.890', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:08:53,094][2409100] DAMAGECOUNT value on done: 5337.0
[2023-02-25 13:08:53,097][2409100] Sum rewards: 12.271, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.186', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO3': '0.067', 'AMMO4': '0.135', 'WEAPON4': '0.200', 'weapon5': '0.272', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.470', 'weapon4': '0.484', 'weapon3': '1.230', 'weapon2': '1.572', 'DAMAGECOUNT': '3.027', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:08:53,148][2409597] DAMAGECOUNT value on done: 4823.0
[2023-02-25 13:08:53,149][2409597] Sum rewards: 4.828, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.854', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO4': '0.032', 'AMMO3': '0.132', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.202', 'HITCOUNT': '0.430', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'ARMOR': '0.909', 'weapon3': '1.718', 'weapon2': '1.770', 'DAMAGECOUNT': '2.388', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:53,200][2409407] DAMAGECOUNT value on done: 5027.0
[2023-02-25 13:08:53,201][2409407] Sum rewards: 15.027, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.890', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.036', 'weapon7': '0.048', 'weapon5': '0.056', 'AMMO3': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.179', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'weapon4': '0.672', 'weapon2': '0.852', 'ARMOR': '0.955', 'HITCOUNT': '1.020', 'weapon3': '1.888', 'DAMAGECOUNT': '4.410', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:08:53,581][2409565] DAMAGECOUNT value on done: 4996.0
[2023-02-25 13:08:53,583][2409565] Sum rewards: 2.420, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.762', 'AMMO5': '0.011', 'AMMO2': '0.020', 'AMMO3': '0.056', 'AMMO4': '0.100', 'HITCOUNT': '0.110', 'weapon7': '0.112', 'weapon5': '0.150', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.206', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.801', 'weapon2': '1.068', 'weapon3': '1.108', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:08:53,626][2409355] DAMAGECOUNT value on done: 5481.0
[2023-02-25 13:08:53,627][2409355] Sum rewards: 14.985, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.708', 'WEAPON1': '0.010', 'weapon7': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO3': '0.062', 'AMMO4': '0.151', 'weapon4': '0.152', 'weapon5': '0.160', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.850', 'ARMOR': '1.320', 'weapon3': '1.458', 'weapon2': '1.500', 'DAMAGECOUNT': '3.324', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:08:53,650][2409405] DAMAGECOUNT value on done: 5497.0
[2023-02-25 13:08:53,651][2409405] Sum rewards: 10.780, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.782', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO3': '0.069', 'weapon5': '0.096', 'AMMO4': '0.152', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.388', 'WEAPON3': '0.500', 'ARMOR': '0.870', 'HITCOUNT': '0.900', 'weapon2': '1.570', 'weapon3': '1.698', 'DAMAGECOUNT': '3.225', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:08:53,848][2409105] Large shaping reward 2.623 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.591, 197.0), ('weapon7', 0.002)]
[2023-02-25 13:08:53,962][2409076] DAMAGECOUNT value on done: 5521.0
[2023-02-25 13:08:53,963][2409076] Sum rewards: 9.414, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.251', 'AMMO5': '0.005', 'AMMO2': '0.022', 'ARMOR': '0.032', 'AMMO3': '0.076', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'weapon5': '0.172', 'WEAPON4': '0.200', 'WEAPON3': '0.450', 'weapon4': '0.522', 'HITCOUNT': '0.750', 'weapon2': '1.060', 'weapon3': '1.372', 'DAMAGECOUNT': '2.496', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:54,090][2409097] DAMAGECOUNT value on done: 5651.0
[2023-02-25 13:08:54,091][2409097] Sum rewards: 3.099, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.408', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'weapon7': '0.100', 'weapon5': '0.246', 'AMMO6': '0.280', 'AMMO7': '0.280', 'weapon4': '0.286', 'HITCOUNT': '0.300', 'WEAPON5': '0.300', 'WEAPON7': '0.400', 'WEAPON3': '0.500', 'weapon3': '1.216', 'ARMOR': '1.255', 'DAMAGECOUNT': '1.425', 'weapon2': '1.442', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:08:54,184][2409102] DAMAGECOUNT value on done: 4194.0
[2023-02-25 13:08:54,187][2409102] Sum rewards: 8.273, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.764', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'weapon4': '0.040', 'AMMO4': '0.064', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon5': '0.134', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'HITCOUNT': '0.630', 'WEAPON3': '0.700', 'weapon2': '1.494', 'weapon3': '1.694', 'DAMAGECOUNT': '2.403', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:08:54,207][2409596] DAMAGECOUNT value on done: 4319.0
[2023-02-25 13:08:54,208][2409596] Sum rewards: 6.901, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.188', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO3': '0.068', 'weapon4': '0.126', 'AMMO4': '0.143', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon5': '0.250', 'WEAPON3': '0.400', 'HITCOUNT': '0.600', 'ARMOR': '0.844', 'weapon3': '1.092', 'DAMAGECOUNT': '1.800', 'weapon2': '2.324', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:54,474][2409074] Updated weights for policy 0, policy_version 18511 (0.0013)
[2023-02-25 13:08:55,039][2409866] DAMAGECOUNT value on done: 5199.0
[2023-02-25 13:08:55,040][2409866] Sum rewards: 8.719, reward structure: {'DEATHCOUNT': '-6.750', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.039', 'AMMO3': '0.078', 'weapon5': '0.142', 'HEALTH': '0.186', 'AMMO4': '0.194', 'WEAPON4': '0.200', 'weapon4': '0.222', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'ARMOR': '0.453', 'HITCOUNT': '0.650', 'weapon3': '1.458', 'weapon2': '1.794', 'DAMAGECOUNT': '2.223', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:08:55,252][2409373] DAMAGECOUNT value on done: 5089.0
[2023-02-25 13:08:55,255][2409373] Sum rewards: 9.402, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.270', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.020', 'AMMO3': '0.050', 'weapon5': '0.126', 'WEAPON4': '0.150', 'weapon4': '0.244', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.457', 'HITCOUNT': '0.660', 'weapon3': '1.224', 'weapon2': '1.684', 'DAMAGECOUNT': '2.793', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:08:55,368][2409079] DAMAGECOUNT value on done: 4881.0
[2023-02-25 13:08:55,369][2409079] Sum rewards: 5.738, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.606', 'AMMO2': '0.009', 'AMMO5': '0.016', 'AMMO4': '0.043', 'AMMO3': '0.050', 'weapon5': '0.122', 'WEAPON4': '0.150', 'weapon7': '0.168', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'ARMOR': '0.458', 'HITCOUNT': '0.510', 'weapon4': '0.514', 'weapon3': '1.240', 'weapon2': '1.404', 'DAMAGECOUNT': '2.610', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:08:55,733][2409389] DAMAGECOUNT value on done: 6031.0
[2023-02-25 13:08:55,734][2409389] Sum rewards: 7.991, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.385', 'AMMO5': '0.009', 'AMMO2': '0.011', 'AMMO3': '0.040', 'weapon7': '0.046', 'AMMO4': '0.055', 'weapon5': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.252', 'WEAPON3': '0.300', 'WEAPON4': '0.300', 'HITCOUNT': '0.430', 'ARMOR': '0.480', 'weapon3': '0.930', 'weapon4': '1.186', 'DAMAGECOUNT': '2.130', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:08:55,776][2409077] DAMAGECOUNT value on done: 5022.0
[2023-02-25 13:08:55,786][2409077] Sum rewards: 7.609, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.856', 'AMMO2': '0.019', 'AMMO5': '0.020', 'AMMO4': '0.097', 'AMMO3': '0.113', 'weapon5': '0.148', 'WEAPON4': '0.300', 'weapon4': '0.358', 'WEAPON5': '0.400', 'ARMOR': '0.400', 'HITCOUNT': '0.650', 'WEAPON3': '0.700', 'weapon2': '1.332', 'weapon3': '1.432', 'DAMAGECOUNT': '3.246', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:55,790][2409074] Updated weights for policy 0, policy_version 18521 (0.0012)
[2023-02-25 13:08:55,926][2409406] DAMAGECOUNT value on done: 3607.0
[2023-02-25 13:08:55,927][2409406] Sum rewards: 3.113, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'HEALTH': '0.020', 'AMMO2': '0.030', 'weapon7': '0.048', 'AMMO3': '0.060', 'weapon5': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'WEAPON3': '0.400', 'WEAPON4': '0.400', 'HITCOUNT': '0.440', 'weapon4': '0.720', 'weapon2': '1.026', 'weapon3': '1.150', 'DAMAGECOUNT': '1.800', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:08:55,937][2409103] DAMAGECOUNT value on done: 5858.0
[2023-02-25 13:08:55,940][2409103] Sum rewards: 9.560, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.789', 'AMMO2': '0.011', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.057', 'AMMO3': '0.082', 'weapon5': '0.220', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.600', 'weapon3': '1.304', 'weapon2': '1.782', 'DAMAGECOUNT': '2.793', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:08:56,058][2409548] DAMAGECOUNT value on done: 5932.0
[2023-02-25 13:08:56,061][2409548] Sum rewards: 12.213, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.829', 'AMMO2': '0.020', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'weapon7': '0.056', 'weapon4': '0.076', 'AMMO4': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.112', 'weapon5': '0.170', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '0.800', 'weapon2': '1.294', 'weapon3': '1.770', 'DAMAGECOUNT': '3.792', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:08:56,285][2409486] DAMAGECOUNT value on done: 5699.0
[2023-02-25 13:08:56,286][2409486] Sum rewards: 14.889, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.372', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO3': '0.121', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'weapon5': '0.158', 'weapon4': '0.178', 'WEAPON5': '0.250', 'WEAPON3': '0.650', 'HITCOUNT': '0.810', 'weapon2': '0.866', 'weapon3': '2.472', 'DAMAGECOUNT': '4.185', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:08:56,297][2409078] DAMAGECOUNT value on done: 4890.0
[2023-02-25 13:08:56,300][2409078] Sum rewards: 5.075, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.270', 'AMMO5': '0.023', 'AMMO2': '0.024', 'weapon5': '0.044', 'weapon7': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'weapon2': '0.282', 'WEAPON5': '0.450', 'ARMOR': '0.473', 'HITCOUNT': '0.730', 'weapon4': '0.878', 'WEAPON3': '0.950', 'weapon3': '1.788', 'DAMAGECOUNT': '2.850', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:56,306][2409075] DAMAGECOUNT value on done: 4671.0
[2023-02-25 13:08:56,309][2409075] Sum rewards: 10.626, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.374', 'AMMO2': '0.018', 'AMMO5': '0.020', 'weapon7': '0.058', 'AMMO3': '0.064', 'weapon5': '0.084', 'AMMO4': '0.089', 'WEAPON4': '0.200', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.530', 'weapon4': '0.646', 'weapon2': '1.028', 'weapon3': '1.130', 'DAMAGECOUNT': '3.033', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:08:56,591][2409485] DAMAGECOUNT value on done: 3761.0
[2023-02-25 13:08:56,593][2409485] Sum rewards: 3.187, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.948', 'AMMO2': '0.017', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.083', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'weapon5': '0.180', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.354', 'HITCOUNT': '0.410', 'WEAPON3': '0.650', 'weapon2': '0.808', 'ARMOR': '0.928', 'DAMAGECOUNT': '1.437', 'weapon3': '1.772', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:08:56,611][2409096] DAMAGECOUNT value on done: 4357.0
[2023-02-25 13:08:56,614][2409096] Sum rewards: 8.268, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.288', 'AMMO5': '0.005', 'AMMO2': '0.014', 'ARMOR': '0.016', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.071', 'weapon5': '0.110', 'WEAPON5': '0.150', 'weapon4': '0.162', 'HITCOUNT': '0.430', 'WEAPON3': '0.500', 'weapon3': '1.632', 'weapon2': '1.756', 'DAMAGECOUNT': '2.049', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:56,636][2409104] DAMAGECOUNT value on done: 5694.0
[2023-02-25 13:08:56,637][2409104] Sum rewards: 10.123, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.428', 'AMMO5': '0.007', 'AMMO2': '0.011', 'ARMOR': '0.032', 'weapon7': '0.048', 'AMMO4': '0.055', 'AMMO3': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.128', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.620', 'weapon4': '0.668', 'weapon2': '0.708', 'weapon3': '1.434', 'DAMAGECOUNT': '2.889', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:08:56,648][2409100] DAMAGECOUNT value on done: 4644.0
[2023-02-25 13:08:56,649][2409100] Sum rewards: 13.371, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.195', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO5': '0.022', 'weapon7': '0.058', 'AMMO3': '0.085', 'AMMO4': '0.095', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.244', 'WEAPON5': '0.500', 'ARMOR': '0.510', 'WEAPON3': '0.600', 'weapon4': '0.698', 'HITCOUNT': '0.730', 'weapon2': '1.136', 'weapon3': '1.444', 'DAMAGECOUNT': '3.525', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:08:56,683][2409105] DAMAGECOUNT value on done: 4288.0
[2023-02-25 13:08:56,686][2409105] Sum rewards: 5.857, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.375', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO3': '0.044', 'AMMO4': '0.070', 'weapon7': '0.078', 'WEAPON5': '0.100', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.300', 'HITCOUNT': '0.310', 'weapon2': '0.392', 'weapon4': '0.562', 'weapon3': '0.750', 'DAMAGECOUNT': '1.314', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:56,843][2409101] DAMAGECOUNT value on done: 5494.0
[2023-02-25 13:08:56,844][2409101] Sum rewards: 3.280, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.582', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.025', 'AMMO3': '0.112', 'weapon7': '0.128', 'WEAPON4': '0.150', 'weapon5': '0.182', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.250', 'HITCOUNT': '0.390', 'WEAPON7': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'weapon2': '1.116', 'DAMAGECOUNT': '1.758', 'weapon3': '1.826', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:56,937][2409407] DAMAGECOUNT value on done: 4811.0
[2023-02-25 13:08:56,939][2409407] Sum rewards: 2.892, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.284', 'AMMO5': '0.003', 'AMMO3': '0.027', 'AMMO2': '0.031', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon7': '0.100', 'WEAPON3': '0.150', 'AMMO4': '0.156', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HITCOUNT': '0.250', 'WEAPON7': '0.300', 'weapon3': '0.366', 'WEAPON4': '0.400', 'weapon2': '0.652', 'ARMOR': '0.852', 'weapon4': '0.878', 'DAMAGECOUNT': '0.975', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:08:57,031][2409549] DAMAGECOUNT value on done: 4707.0
[2023-02-25 13:08:57,033][2409549] Sum rewards: 6.699, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.156', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'AMMO3': '0.030', 'weapon7': '0.066', 'AMMO4': '0.116', 'weapon5': '0.122', 'WEAPON5': '0.150', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.372', 'ARMOR': '0.416', 'HITCOUNT': '0.500', 'weapon3': '0.656', 'DAMAGECOUNT': '1.785', 'weapon2': '2.054', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:08:57,176][2409469] DAMAGECOUNT value on done: 5040.0
[2023-02-25 13:08:57,177][2409469] Sum rewards: 10.354, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.887', 'AMMO5': '0.015', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'AMMO3': '0.060', 'AMMO4': '0.093', 'weapon7': '0.100', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.232', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.612', 'ARMOR': '1.256', 'weapon2': '1.340', 'weapon3': '1.356', 'DAMAGECOUNT': '2.628', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:08:57,186][2408954] Fps is (10 sec: 24166.7, 60 sec: 24644.3, 300 sec: 25062.0). Total num frames: 75882496. Throughput: 0: 6175.5. Samples: 18972648. Policy #0 lag: (min: 0.0, avg: 12.0, max: 23.0)
[2023-02-25 13:08:57,186][2408954] Avg episode reward: [(0, '8.487')]
[2023-02-25 13:08:57,190][2409033] Saving new best policy, reward=8.487!
[2023-02-25 13:08:57,333][2409597] DAMAGECOUNT value on done: 6119.0
[2023-02-25 13:08:57,334][2409597] Sum rewards: 9.783, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.865', 'AMMO5': '0.005', 'AMMO2': '0.023', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'weapon5': '0.178', 'weapon4': '0.274', 'WEAPON3': '0.600', 'HITCOUNT': '0.730', 'ARMOR': '0.863', 'weapon3': '1.538', 'weapon2': '1.552', 'DAMAGECOUNT': '2.931', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:08:57,357][2409565] DAMAGECOUNT value on done: 4117.0
[2023-02-25 13:08:57,365][2409565] Sum rewards: 7.801, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.476', 'AMMO2': '0.007', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.033', 'AMMO3': '0.040', 'WEAPON4': '0.100', 'weapon5': '0.216', 'weapon4': '0.228', 'WEAPON5': '0.300', 'WEAPON3': '0.300', 'HITCOUNT': '0.600', 'weapon3': '0.992', 'weapon2': '1.644', 'DAMAGECOUNT': '2.784', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:08:57,650][2409355] DAMAGECOUNT value on done: 5325.0
[2023-02-25 13:08:57,652][2409355] Sum rewards: 15.182, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.583', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.062', 'AMMO3': '0.079', 'WEAPON4': '0.150', 'weapon4': '0.190', 'weapon5': '0.302', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '0.650', 'ARMOR': '0.800', 'weapon3': '1.548', 'weapon2': '1.660', 'DAMAGECOUNT': '3.348', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:08:57,668][2409405] DAMAGECOUNT value on done: 5058.0
[2023-02-25 13:08:57,672][2409405] Sum rewards: 4.280, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.860', 'AMMO2': '0.009', 'AMMO5': '0.015', 'AMMO4': '0.046', 'weapon7': '0.070', 'AMMO3': '0.071', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.106', 'WEAPON4': '0.150', 'HITCOUNT': '0.240', 'WEAPON5': '0.400', 'weapon2': '0.430', 'WEAPON3': '0.550', 'weapon4': '0.562', 'weapon3': '1.278', 'DAMAGECOUNT': '1.413', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:08:57,842][2409097] DAMAGECOUNT value on done: 5244.0
[2023-02-25 13:08:57,845][2409097] Sum rewards: 11.922, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.848', 'AMMO2': '0.008', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.039', 'AMMO3': '0.050', 'WEAPON4': '0.200', 'weapon5': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.696', 'HITCOUNT': '0.960', 'weapon3': '1.290', 'weapon2': '1.332', 'DAMAGECOUNT': '3.606', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:08:57,908][2409596] DAMAGECOUNT value on done: 5563.0
[2023-02-25 13:08:57,909][2409596] Sum rewards: 6.665, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.120', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.063', 'weapon5': '0.064', 'weapon7': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'WEAPON5': '0.200', 'WEAPON3': '0.400', 'ARMOR': '0.400', 'weapon4': '0.438', 'HITCOUNT': '0.840', 'weapon3': '1.442', 'weapon2': '1.698', 'DAMAGECOUNT': '2.871', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:08:58,046][2409076] DAMAGECOUNT value on done: 4864.0
[2023-02-25 13:08:58,049][2409076] Sum rewards: 5.404, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.824', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon7': '0.040', 'AMMO4': '0.100', 'AMMO3': '0.102', 'weapon5': '0.126', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.430', 'HITCOUNT': '0.640', 'WEAPON3': '0.650', 'ARMOR': '0.856', 'weapon3': '1.262', 'weapon2': '1.454', 'DAMAGECOUNT': '2.055', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:58,082][2409074] Updated weights for policy 0, policy_version 18531 (0.0012)
[2023-02-25 13:08:58,145][2409102] DAMAGECOUNT value on done: 4810.0
[2023-02-25 13:08:58,146][2409102] Sum rewards: 6.877, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.216', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'weapon7': '0.054', 'AMMO4': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.260', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'weapon4': '0.438', 'HITCOUNT': '0.560', 'weapon2': '1.256', 'weapon3': '1.270', 'DAMAGECOUNT': '1.707', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:08:58,951][2409866] DAMAGECOUNT value on done: 4305.0
[2023-02-25 13:08:58,953][2409866] Sum rewards: 7.960, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.681', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO3': '0.041', 'WEAPON4': '0.050', 'weapon7': '0.050', 'weapon5': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.388', 'WEAPON3': '0.400', 'HITCOUNT': '0.450', 'ARMOR': '0.451', 'weapon3': '0.960', 'DAMAGECOUNT': '1.647', 'weapon2': '1.718', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:59,002][2409373] DAMAGECOUNT value on done: 5837.0
[2023-02-25 13:08:59,003][2409373] Sum rewards: 7.933, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.034', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.030', 'AMMO3': '0.060', 'weapon5': '0.250', 'WEAPON5': '0.350', 'HITCOUNT': '0.350', 'WEAPON3': '0.400', 'weapon3': '1.366', 'weapon2': '1.910', 'DAMAGECOUNT': '1.980', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:08:59,060][2409079] DAMAGECOUNT value on done: 4808.0
[2023-02-25 13:08:59,063][2409079] Sum rewards: 3.847, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.128', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO3': '0.040', 'weapon7': '0.050', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.330', 'WEAPON3': '0.400', 'weapon4': '0.508', 'ARMOR': '0.614', 'weapon3': '0.990', 'DAMAGECOUNT': '1.380', 'weapon2': '1.420', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:08:59,110][2409074] Updated weights for policy 0, policy_version 18541 (0.0012)
[2023-02-25 13:08:59,482][2409103] DAMAGECOUNT value on done: 4978.0
[2023-02-25 13:08:59,483][2409103] Sum rewards: 9.813, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.268', 'AMMO2': '0.000', 'AMMO4': '0.001', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO3': '0.060', 'weapon5': '0.144', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'ARMOR': '0.448', 'HITCOUNT': '0.540', 'weapon3': '0.970', 'DAMAGECOUNT': '1.992', 'weapon2': '2.254', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:59,651][2409077] DAMAGECOUNT value on done: 5690.0
[2023-02-25 13:08:59,653][2409077] Sum rewards: 10.516, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.005', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.023', 'AMMO3': '0.040', 'HEALTH': '0.042', 'weapon7': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.126', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'weapon4': '0.366', 'ARMOR': '0.400', 'HITCOUNT': '0.540', 'weapon3': '0.968', 'weapon2': '1.498', 'DAMAGECOUNT': '2.553', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:08:59,778][2409406] DAMAGECOUNT value on done: 3951.0
[2023-02-25 13:08:59,779][2409406] Sum rewards: 6.140, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.003', 'AMMO2': '0.003', 'AMMO4': '0.017', 'AMMO5': '0.026', 'WEAPON1': '0.050', 'AMMO3': '0.099', 'weapon5': '0.288', 'ARMOR': '0.452', 'HITCOUNT': '0.470', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'weapon2': '1.306', 'DAMAGECOUNT': '1.884', 'weapon3': '1.998', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:00,020][2409486] DAMAGECOUNT value on done: 4584.0
[2023-02-25 13:09:00,024][2409486] Sum rewards: 11.946, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.300', 'AMMO5': '0.024', 'AMMO2': '0.027', 'weapon4': '0.106', 'AMMO3': '0.135', 'AMMO4': '0.135', 'weapon5': '0.150', 'WEAPON4': '0.250', 'WEAPON5': '0.500', 'HITCOUNT': '0.630', 'WEAPON3': '0.750', 'weapon2': '1.354', 'ARMOR': '1.740', 'weapon3': '1.870', 'DAMAGECOUNT': '3.075', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:09:00,120][2409548] DAMAGECOUNT value on done: 6382.0
[2023-02-25 13:09:00,122][2409548] Sum rewards: 7.924, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.568', 'AMMO2': '0.022', 'AMMO5': '0.025', 'WEAPON1': '0.040', 'AMMO4': '0.109', 'AMMO3': '0.128', 'weapon5': '0.254', 'WEAPON4': '0.300', 'ARMOR': '0.468', 'weapon4': '0.588', 'WEAPON5': '0.600', 'HITCOUNT': '0.600', 'weapon2': '0.690', 'WEAPON3': '0.800', 'weapon3': '1.984', 'DAMAGECOUNT': '3.384', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:09:00,206][2409485] DAMAGECOUNT value on done: 5566.0
[2023-02-25 13:09:00,207][2409485] Sum rewards: 10.308, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.210', 'AMMO2': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.047', 'WEAPON1': '0.060', 'weapon5': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'weapon4': '0.254', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.750', 'WEAPON3': '0.850', 'weapon2': '1.080', 'weapon3': '2.044', 'DAMAGECOUNT': '2.910', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:09:00,235][2409389] DAMAGECOUNT value on done: 5668.0
[2023-02-25 13:09:00,240][2409389] Sum rewards: 0.736, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.280', 'AMMO5': '0.020', 'AMMO2': '0.039', 'AMMO3': '0.111', 'weapon7': '0.132', 'AMMO4': '0.194', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.226', 'WEAPON7': '0.300', 'HITCOUNT': '0.330', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.508', 'WEAPON3': '0.650', 'weapon3': '0.690', 'weapon2': '1.276', 'ARMOR': '1.295', 'DAMAGECOUNT': '1.905', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:09:00,287][2409101] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:09:00,379][2409078] DAMAGECOUNT value on done: 4915.0
[2023-02-25 13:09:00,380][2409078] Sum rewards: 5.539, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.003', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.064', 'WEAPON4': '0.100', 'weapon5': '0.114', 'weapon4': '0.172', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.670', 'weapon3': '1.386', 'weapon2': '1.906', 'DAMAGECOUNT': '2.205', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:09:00,472][2409096] DAMAGECOUNT value on done: 3758.0
[2023-02-25 13:09:00,473][2409096] Sum rewards: 5.333, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.866', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO3': '0.020', 'AMMO4': '0.023', 'weapon7': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.300', 'weapon4': '0.562', 'weapon3': '0.592', 'weapon2': '0.750', 'ARMOR': '0.931', 'DAMAGECOUNT': '1.233', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:09:00,556][2409104] DAMAGECOUNT value on done: 6169.0
[2023-02-25 13:09:00,557][2409104] Sum rewards: 14.108, reward structure: {'DEATHCOUNT': '-6.750', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO5': '0.022', 'AMMO4': '0.088', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'HEALTH': '0.222', 'weapon4': '0.240', 'weapon5': '0.252', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.640', 'weapon2': '1.242', 'ARMOR': '1.247', 'weapon3': '1.630', 'DAMAGECOUNT': '4.050', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:09:00,635][2409075] DAMAGECOUNT value on done: 4763.0
[2023-02-25 13:09:00,636][2409075] Sum rewards: 12.569, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.502', 'AMMO2': '0.009', 'AMMO5': '0.025', 'WEAPON1': '0.030', 'AMMO4': '0.042', 'weapon4': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon5': '0.274', 'WEAPON5': '0.550', 'HITCOUNT': '0.560', 'WEAPON3': '0.700', 'ARMOR': '0.900', 'weapon2': '1.386', 'weapon3': '1.876', 'DAMAGECOUNT': '4.170', 'FRAGCOUNT': '10.500'}
[2023-02-25 13:09:00,665][2409100] DAMAGECOUNT value on done: 5262.0
[2023-02-25 13:09:00,665][2409100] Sum rewards: 8.116, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.186', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.068', 'weapon5': '0.118', 'WEAPON5': '0.300', 'ARMOR': '0.424', 'WEAPON3': '0.550', 'HITCOUNT': '0.630', 'weapon3': '1.186', 'weapon2': '2.228', 'DAMAGECOUNT': '2.529', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:00,704][2409105] DAMAGECOUNT value on done: 6100.0
[2023-02-25 13:09:00,705][2409105] Sum rewards: 10.869, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.415', 'AMMO2': '0.010', 'AMMO5': '0.011', 'AMMO4': '0.051', 'AMMO3': '0.079', 'weapon4': '0.164', 'WEAPON4': '0.200', 'weapon5': '0.310', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.850', 'weapon2': '1.502', 'weapon3': '1.510', 'DAMAGECOUNT': '3.246', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:09:00,711][2409407] DAMAGECOUNT value on done: 5021.0
[2023-02-25 13:09:00,712][2409407] Sum rewards: 3.443, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.280', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'AMMO3': '0.040', 'weapon7': '0.076', 'WEAPON4': '0.100', 'weapon5': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON3': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.290', 'HITCOUNT': '0.300', 'weapon3': '0.476', 'weapon2': '1.110', 'DAMAGECOUNT': '1.509', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:09:00,897][2409101] DAMAGECOUNT value on done: 6115.0
[2023-02-25 13:09:00,901][2409101] Sum rewards: 7.747, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.690', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'weapon7': '0.052', 'AMMO4': '0.060', 'AMMO3': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.138', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.366', 'WEAPON3': '0.400', 'ARMOR': '0.441', 'HITCOUNT': '0.860', 'weapon3': '1.300', 'weapon2': '1.708', 'DAMAGECOUNT': '3.630', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:00,997][2409469] DAMAGECOUNT value on done: 5854.0
[2023-02-25 13:09:00,999][2409469] Sum rewards: 3.931, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.017', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.069', 'AMMO3': '0.078', 'weapon5': '0.148', 'weapon7': '0.154', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'HITCOUNT': '0.330', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'weapon3': '0.574', 'weapon4': '0.576', 'ARMOR': '0.853', 'weapon2': '1.084', 'DAMAGECOUNT': '1.428', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:09:01,088][2409549] DAMAGECOUNT value on done: 6139.0
[2023-02-25 13:09:01,089][2409549] Sum rewards: 10.351, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.339', 'AMMO2': '0.013', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'weapon4': '0.042', 'AMMO4': '0.062', 'weapon5': '0.076', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'WEAPON5': '0.400', 'HITCOUNT': '0.530', 'WEAPON3': '0.550', 'ARMOR': '1.252', 'weapon3': '1.482', 'weapon2': '1.562', 'DAMAGECOUNT': '2.745', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:09:01,112][2409074] Updated weights for policy 0, policy_version 18551 (0.0012)
[2023-02-25 13:09:01,235][2409597] DAMAGECOUNT value on done: 6129.0
[2023-02-25 13:09:01,236][2409597] Sum rewards: 10.875, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.314', 'AMMO5': '0.012', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO3': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.130', 'AMMO4': '0.141', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.254', 'WEAPON5': '0.300', 'HITCOUNT': '0.590', 'WEAPON3': '0.750', 'weapon2': '1.128', 'weapon3': '2.116', 'DAMAGECOUNT': '3.153', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:09:01,282][2409565] DAMAGECOUNT value on done: 4399.0
[2023-02-25 13:09:01,286][2409565] Sum rewards: 6.367, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.003', 'AMMO3': '0.010', 'weapon5': '0.016', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'WEAPON3': '0.050', 'HEALTH': '0.088', 'weapon7': '0.098', 'AMMO4': '0.135', 'HITCOUNT': '0.190', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.232', 'WEAPON4': '0.250', 'weapon3': '0.258', 'WEAPON7': '0.300', 'ARMOR': '0.800', 'weapon2': '1.360', 'DAMAGECOUNT': '1.560', 'FRAGCOUNT': '3.500'}
[2023-02-25 13:09:01,461][2409355] DAMAGECOUNT value on done: 3936.0
[2023-02-25 13:09:01,468][2409355] Sum rewards: 2.712, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.188', 'AMMO5': '0.014', 'AMMO2': '0.019', 'weapon5': '0.038', 'weapon7': '0.070', 'AMMO3': '0.073', 'AMMO4': '0.095', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.580', 'weapon4': '0.716', 'weapon2': '1.116', 'ARMOR': '1.300', 'weapon3': '1.540', 'DAMAGECOUNT': '1.998', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:09:01,621][2409405] DAMAGECOUNT value on done: 5497.0
[2023-02-25 13:09:01,621][2409405] Sum rewards: 15.081, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon7': '0.044', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.093', 'weapon4': '0.096', 'weapon5': '0.118', 'WEAPON3': '0.250', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'HEALTH': '0.315', 'ARMOR': '0.460', 'HITCOUNT': '0.860', 'weapon3': '1.040', 'weapon2': '1.676', 'DAMAGECOUNT': '2.805', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:09:01,812][2409097] DAMAGECOUNT value on done: 5114.0
[2023-02-25 13:09:01,818][2409097] Sum rewards: 11.238, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.396', 'AMMO5': '0.022', 'AMMO2': '0.026', 'weapon7': '0.084', 'AMMO3': '0.089', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.131', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.286', 'WEAPON5': '0.450', 'weapon4': '0.458', 'WEAPON3': '0.500', 'HITCOUNT': '0.690', 'ARMOR': '1.352', 'weapon2': '1.380', 'weapon3': '1.444', 'DAMAGECOUNT': '3.531', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:09:01,942][2409596] DAMAGECOUNT value on done: 5540.0
[2023-02-25 13:09:01,944][2409596] Sum rewards: 8.358, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.753', 'AMMO2': '0.009', 'AMMO5': '0.019', 'WEAPON1': '0.030', 'AMMO4': '0.046', 'weapon7': '0.052', 'AMMO3': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.306', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.710', 'weapon2': '1.158', 'weapon3': '1.808', 'DAMAGECOUNT': '2.538', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:09:01,945][2409076] DAMAGECOUNT value on done: 5102.0
[2023-02-25 13:09:01,948][2409076] Sum rewards: 4.662, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.210', 'AMMO5': '0.010', 'weapon7': '0.016', 'WEAPON1': '0.030', 'AMMO2': '0.042', 'AMMO3': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.194', 'WEAPON5': '0.200', 'AMMO4': '0.211', 'WEAPON3': '0.350', 'weapon4': '0.354', 'HITCOUNT': '0.430', 'ARMOR': '0.453', 'weapon3': '1.188', 'DAMAGECOUNT': '1.344', 'weapon2': '1.800', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:09:02,106][2409102] DAMAGECOUNT value on done: 5171.0
[2023-02-25 13:09:02,108][2409102] Sum rewards: 9.506, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.259', 'AMMO5': '0.018', 'AMMO2': '0.019', 'ARMOR': '0.040', 'AMMO3': '0.050', 'weapon7': '0.076', 'AMMO4': '0.095', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.172', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'HITCOUNT': '0.410', 'weapon4': '0.596', 'weapon2': '0.762', 'weapon3': '1.218', 'DAMAGECOUNT': '2.718', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:02,186][2408954] Fps is (10 sec: 23756.9, 60 sec: 24576.0, 300 sec: 25048.1). Total num frames: 76005376. Throughput: 0: 6202.2. Samples: 19010352. Policy #0 lag: (min: 0.0, avg: 12.0, max: 23.0)
[2023-02-25 13:09:02,186][2408954] Avg episode reward: [(0, '8.343')]
[2023-02-25 13:09:02,737][2409074] Updated weights for policy 0, policy_version 18561 (0.0013)
[2023-02-25 13:09:02,758][2409866] DAMAGECOUNT value on done: 4770.0
[2023-02-25 13:09:02,759][2409866] Sum rewards: 8.365, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO3': '0.061', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'weapon5': '0.158', 'WEAPON5': '0.200', 'HEALTH': '0.244', 'weapon4': '0.284', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.580', 'weapon3': '1.302', 'weapon2': '1.342', 'DAMAGECOUNT': '2.610', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:02,878][2409373] DAMAGECOUNT value on done: 6111.0
[2023-02-25 13:09:02,879][2409373] Sum rewards: 6.037, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon7': '0.050', 'AMMO3': '0.055', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.127', 'HEALTH': '0.190', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'weapon4': '0.382', 'HITCOUNT': '0.500', 'weapon3': '0.994', 'weapon2': '1.136', 'ARMOR': '1.300', 'DAMAGECOUNT': '2.019', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:09:03,249][2409079] DAMAGECOUNT value on done: 4643.0
[2023-02-25 13:09:03,250][2409079] Sum rewards: 4.556, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.154', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO3': '0.060', 'AMMO4': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.138', 'WEAPON4': '0.150', 'weapon4': '0.278', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.490', 'ARMOR': '0.900', 'weapon3': '1.208', 'DAMAGECOUNT': '1.560', 'weapon2': '1.754', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:09:03,466][2409077] DAMAGECOUNT value on done: 5590.0
[2023-02-25 13:09:03,468][2409077] Sum rewards: 9.157, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.500', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon4': '0.034', 'WEAPON4': '0.050', 'weapon5': '0.058', 'AMMO3': '0.081', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'HITCOUNT': '0.580', 'WEAPON3': '0.600', 'weapon3': '1.408', 'weapon2': '2.080', 'DAMAGECOUNT': '2.394', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:09:03,584][2409406] DAMAGECOUNT value on done: 5038.0
[2023-02-25 13:09:03,587][2409406] Sum rewards: 7.073, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.292', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.035', 'weapon7': '0.056', 'AMMO3': '0.085', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.176', 'WEAPON4': '0.200', 'weapon5': '0.220', 'WEAPON5': '0.250', 'weapon4': '0.432', 'WEAPON3': '0.500', 'HITCOUNT': '0.530', 'weapon2': '1.286', 'ARMOR': '1.357', 'weapon3': '1.622', 'DAMAGECOUNT': '2.025', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:03,938][2409548] DAMAGECOUNT value on done: 4894.0
[2023-02-25 13:09:03,942][2409548] Sum rewards: 8.649, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.682', 'AMMO5': '0.019', 'AMMO2': '0.037', 'weapon7': '0.050', 'AMMO3': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.176', 'AMMO4': '0.186', 'WEAPON4': '0.300', 'ARMOR': '0.432', 'WEAPON5': '0.450', 'HITCOUNT': '0.510', 'weapon4': '0.556', 'WEAPON3': '0.600', 'weapon3': '1.324', 'weapon2': '1.368', 'DAMAGECOUNT': '2.682', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:09:04,050][2409486] DAMAGECOUNT value on done: 4260.0
[2023-02-25 13:09:04,053][2409486] Sum rewards: 6.729, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.848', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'AMMO3': '0.067', 'AMMO4': '0.079', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.102', 'weapon5': '0.172', 'HITCOUNT': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'weapon3': '1.506', 'DAMAGECOUNT': '1.773', 'weapon2': '1.920', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:04,076][2409074] Updated weights for policy 0, policy_version 18571 (0.0012)
[2023-02-25 13:09:04,237][2409096] DAMAGECOUNT value on done: 3990.0
[2023-02-25 13:09:04,241][2409096] Sum rewards: 5.179, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.241', 'AMMO5': '0.006', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'weapon4': '0.034', 'weapon7': '0.050', 'AMMO3': '0.053', 'weapon5': '0.066', 'AMMO4': '0.071', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.400', 'WEAPON3': '0.400', 'weapon3': '1.088', 'ARMOR': '1.692', 'DAMAGECOUNT': '1.821', 'weapon2': '2.454', 'FRAGCOUNT': '2.500'}
[2023-02-25 13:09:04,369][2409105] DAMAGECOUNT value on done: 5332.0
[2023-02-25 13:09:04,370][2409105] Sum rewards: 7.225, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.468', 'weapon7': '0.002', 'AMMO2': '0.013', 'AMMO5': '0.025', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'weapon4': '0.072', 'AMMO3': '0.093', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.176', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.620', 'ARMOR': '0.852', 'weapon2': '1.314', 'weapon3': '1.634', 'DAMAGECOUNT': '2.895', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:04,397][2409101] DAMAGECOUNT value on done: 5526.0
[2023-02-25 13:09:04,398][2409101] Sum rewards: 5.223, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.520', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'weapon4': '0.126', 'weapon5': '0.168', 'WEAPON5': '0.300', 'HITCOUNT': '0.460', 'WEAPON3': '0.700', 'ARMOR': '1.345', 'weapon3': '1.698', 'DAMAGECOUNT': '1.722', 'weapon2': '1.750', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:04,459][2409078] DAMAGECOUNT value on done: 5465.0
[2023-02-25 13:09:04,460][2409078] Sum rewards: 11.007, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.507', 'AMMO5': '0.019', 'AMMO2': '0.021', 'AMMO3': '0.070', 'AMMO4': '0.107', 'weapon5': '0.188', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.860', 'weapon4': '0.860', 'weapon2': '1.188', 'weapon3': '1.278', 'ARMOR': '1.374', 'DAMAGECOUNT': '3.348', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:09:04,553][2409549] DAMAGECOUNT value on done: 4538.0
[2023-02-25 13:09:04,556][2409549] Sum rewards: 5.317, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.142', 'AMMO2': '0.009', 'AMMO5': '0.015', 'AMMO4': '0.045', 'AMMO3': '0.057', 'weapon5': '0.064', 'weapon7': '0.140', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'weapon4': '0.316', 'WEAPON3': '0.450', 'HITCOUNT': '0.500', 'ARMOR': '0.849', 'weapon3': '1.072', 'weapon2': '1.476', 'DAMAGECOUNT': '2.025', 'FRAGCOUNT': '3.500'}
[2023-02-25 13:09:04,561][2409104] DAMAGECOUNT value on done: 4413.0
[2023-02-25 13:09:04,563][2409104] Sum rewards: 6.280, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.769', 'AMMO2': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.022', 'AMMO3': '0.044', 'weapon7': '0.072', 'WEAPON4': '0.100', 'weapon5': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.222', 'WEAPON3': '0.300', 'ARMOR': '0.454', 'HITCOUNT': '0.550', 'weapon3': '1.052', 'DAMAGECOUNT': '2.028', 'weapon2': '2.232', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:09:04,678][2409389] DAMAGECOUNT value on done: 4650.0
[2023-02-25 13:09:04,681][2409485] DAMAGECOUNT value on done: 4473.0
[2023-02-25 13:09:04,681][2409389] Sum rewards: 6.493, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.385', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.034', 'weapon7': '0.054', 'AMMO3': '0.060', 'weapon5': '0.158', 'AMMO4': '0.172', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'WEAPON4': '0.550', 'HITCOUNT': '0.600', 'weapon4': '0.690', 'weapon3': '1.188', 'weapon2': '1.246', 'DAMAGECOUNT': '2.565', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:09:04,682][2409469] DAMAGECOUNT value on done: 6197.0
[2023-02-25 13:09:04,683][2409485] Sum rewards: 10.932, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.015', 'AMMO2': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.126', 'AMMO4': '0.150', 'HEALTH': '0.166', 'weapon5': '0.168', 'weapon4': '0.258', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'weapon2': '0.676', 'HITCOUNT': '0.760', 'weapon3': '1.948', 'DAMAGECOUNT': '3.084', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:09:04,685][2409469] Sum rewards: 7.966, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.589', 'AMMO2': '0.003', 'AMMO4': '0.013', 'WEAPON1': '0.020', 'AMMO5': '0.027', 'AMMO3': '0.082', 'WEAPON4': '0.200', 'weapon4': '0.246', 'weapon5': '0.386', 'WEAPON3': '0.500', 'WEAPON5': '0.700', 'HITCOUNT': '0.770', 'weapon3': '1.234', 'ARMOR': '1.351', 'weapon2': '1.948', 'DAMAGECOUNT': '3.075', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:09:04,810][2409407] DAMAGECOUNT value on done: 5074.0
[2023-02-25 13:09:04,811][2409407] Sum rewards: 5.941, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.510', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.020', 'AMMO3': '0.050', 'WEAPON4': '0.100', 'weapon5': '0.112', 'WEAPON5': '0.150', 'WEAPON3': '0.400', 'ARMOR': '0.467', 'HITCOUNT': '0.480', 'weapon3': '1.296', 'DAMAGECOUNT': '1.434', 'weapon2': '1.928', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:09:04,855][2409597] DAMAGECOUNT value on done: 3948.0
[2023-02-25 13:09:04,858][2409597] Sum rewards: 4.072, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.562', 'AMMO5': '0.009', 'AMMO2': '0.030', 'AMMO3': '0.045', 'weapon7': '0.048', 'ARMOR': '0.080', 'weapon5': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'HITCOUNT': '0.310', 'WEAPON4': '0.450', 'weapon2': '0.744', 'DAMAGECOUNT': '0.972', 'weapon3': '0.998', 'weapon4': '1.008', 'FRAGCOUNT': '2.500'}
[2023-02-25 13:09:05,091][2409355] DAMAGECOUNT value on done: 5676.0
[2023-02-25 13:09:05,092][2409355] Sum rewards: 9.586, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.702', 'AMMO2': '0.011', 'AMMO5': '0.015', 'weapon7': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.160', 'WEAPON5': '0.300', 'ARMOR': '0.428', 'weapon4': '0.464', 'HITCOUNT': '0.500', 'WEAPON3': '0.500', 'weapon2': '1.472', 'weapon3': '1.584', 'DAMAGECOUNT': '2.490', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:09:05,171][2409075] DAMAGECOUNT value on done: 4074.0
[2023-02-25 13:09:05,172][2409075] Sum rewards: 3.240, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.355', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'AMMO3': '0.010', 'weapon5': '0.046', 'weapon7': '0.048', 'WEAPON3': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.200', 'weapon3': '0.274', 'weapon4': '0.296', 'ARMOR': '0.500', 'weapon2': '0.912', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.017'}
[2023-02-25 13:09:05,242][2409565] DAMAGECOUNT value on done: 5671.0
[2023-02-25 13:09:05,243][2409565] Sum rewards: 6.774, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.932', 'AMMO5': '0.015', 'AMMO2': '0.023', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.106', 'weapon4': '0.106', 'AMMO4': '0.114', 'weapon5': '0.224', 'ARMOR': '0.453', 'WEAPON5': '0.500', 'HITCOUNT': '0.610', 'WEAPON3': '0.650', 'weapon2': '1.438', 'weapon3': '1.792', 'DAMAGECOUNT': '2.325', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:09:05,712][2409405] DAMAGECOUNT value on done: 4619.0
[2023-02-25 13:09:05,713][2409405] Sum rewards: 3.422, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.420', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.042', 'WEAPON5': '0.050', 'weapon7': '0.050', 'AMMO3': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.163', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'HITCOUNT': '0.430', 'ARMOR': '0.463', 'WEAPON4': '0.500', 'weapon2': '0.954', 'weapon3': '0.966', 'weapon4': '1.208', 'DAMAGECOUNT': '1.320', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:05,756][2409102] DAMAGECOUNT value on done: 4781.0
[2023-02-25 13:09:05,757][2409102] Sum rewards: 9.809, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.010', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO5': '0.012', 'weapon7': '0.054', 'AMMO3': '0.062', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.164', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'weapon4': '0.436', 'WEAPON3': '0.450', 'HITCOUNT': '0.620', 'ARMOR': '0.949', 'weapon3': '1.264', 'weapon2': '1.652', 'DAMAGECOUNT': '2.463', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:09:05,781][2409596] DAMAGECOUNT value on done: 4378.0
[2023-02-25 13:09:05,782][2409596] Sum rewards: 5.207, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.708', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.027', 'AMMO3': '0.080', 'AMMO4': '0.135', 'WEAPON4': '0.350', 'weapon5': '0.444', 'WEAPON5': '0.450', 'weapon4': '0.544', 'WEAPON3': '0.600', 'ARMOR': '0.800', 'HITCOUNT': '0.850', 'weapon2': '0.966', 'weapon3': '1.708', 'DAMAGECOUNT': '2.931', 'FRAGCOUNT': '3.500'}
[2023-02-25 13:09:05,842][2409076] DAMAGECOUNT value on done: 5130.0
[2023-02-25 13:09:05,843][2409076] Sum rewards: 6.115, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.195', 'AMMO2': '0.009', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'AMMO4': '0.044', 'weapon7': '0.048', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.198', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.400', 'weapon4': '0.526', 'weapon3': '0.818', 'weapon2': '1.024', 'DAMAGECOUNT': '1.731', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:09:06,132][2409097] DAMAGECOUNT value on done: 5388.0
[2023-02-25 13:09:06,133][2409097] Sum rewards: 9.217, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.142', 'AMMO2': '0.013', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.063', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon7': '0.100', 'weapon5': '0.172', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.338', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.430', 'WEAPON3': '0.550', 'weapon2': '1.262', 'weapon3': '1.544', 'DAMAGECOUNT': '2.430', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:09:06,296][2409074] Updated weights for policy 0, policy_version 18581 (0.0014)
[2023-02-25 13:09:06,387][2409866] DAMAGECOUNT value on done: 5094.0
[2023-02-25 13:09:06,388][2409866] Sum rewards: 15.741, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.446', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.020', 'AMMO3': '0.070', 'weapon7': '0.108', 'weapon5': '0.222', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'WEAPON7': '0.400', 'ARMOR': '0.450', 'WEAPON3': '0.450', 'weapon4': '0.534', 'HITCOUNT': '0.620', 'weapon2': '1.054', 'weapon3': '1.456', 'DAMAGECOUNT': '4.644', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:09:06,687][2409373] DAMAGECOUNT value on done: 6537.0
[2023-02-25 13:09:06,688][2409373] Sum rewards: 11.010, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.111', 'AMMO5': '0.013', 'AMMO2': '0.017', 'AMMO3': '0.076', 'AMMO4': '0.086', 'weapon5': '0.164', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'ARMOR': '0.448', 'WEAPON3': '0.550', 'weapon4': '0.746', 'HITCOUNT': '0.840', 'weapon2': '1.084', 'weapon3': '1.092', 'DAMAGECOUNT': '2.805', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:09:07,084][2409079] DAMAGECOUNT value on done: 4370.0
[2023-02-25 13:09:07,085][2409079] Sum rewards: 6.444, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.666', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO4': '0.035', 'AMMO3': '0.064', 'weapon7': '0.064', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.250', 'WEAPON5': '0.450', 'weapon4': '0.456', 'WEAPON3': '0.500', 'HITCOUNT': '0.620', 'ARMOR': '0.914', 'weapon2': '1.208', 'weapon3': '1.226', 'DAMAGECOUNT': '2.643', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:07,155][2409074] Updated weights for policy 0, policy_version 18591 (0.0012)
[2023-02-25 13:09:07,186][2408954] Fps is (10 sec: 26623.9, 60 sec: 24917.3, 300 sec: 25089.7). Total num frames: 76148736. Throughput: 0: 6215.7. Samples: 19028748. Policy #0 lag: (min: 0.0, avg: 12.0, max: 23.0)
[2023-02-25 13:09:07,186][2408954] Avg episode reward: [(0, '7.957')]
[2023-02-25 13:09:07,418][2409077] DAMAGECOUNT value on done: 4671.0
[2023-02-25 13:09:07,419][2409077] Sum rewards: 8.461, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.455', 'AMMO5': '0.004', 'AMMO2': '0.009', 'AMMO3': '0.034', 'AMMO4': '0.046', 'weapon5': '0.076', 'weapon7': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.250', 'WEAPON7': '0.300', 'ARMOR': '0.451', 'HITCOUNT': '0.590', 'weapon3': '0.606', 'weapon4': '0.654', 'weapon2': '1.068', 'DAMAGECOUNT': '2.040', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:07,494][2409548] DAMAGECOUNT value on done: 4483.0
[2023-02-25 13:09:07,495][2409548] Sum rewards: 4.847, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.051', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon7': '0.048', 'AMMO3': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.108', 'AMMO4': '0.113', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.310', 'WEAPON3': '0.350', 'HITCOUNT': '0.440', 'ARMOR': '0.445', 'weapon2': '0.866', 'weapon3': '1.074', 'DAMAGECOUNT': '1.599', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:09:07,537][2409406] DAMAGECOUNT value on done: 4220.0
[2023-02-25 13:09:07,541][2409406] Sum rewards: 14.309, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.988', 'AMMO5': '0.003', 'AMMO2': '0.009', 'ARMOR': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.046', 'weapon5': '0.050', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.392', 'WEAPON3': '0.600', 'HITCOUNT': '0.950', 'weapon2': '1.348', 'weapon3': '1.626', 'DAMAGECOUNT': '3.387', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:09:07,972][2409486] DAMAGECOUNT value on done: 4069.0
[2023-02-25 13:09:07,976][2409486] Sum rewards: 8.230, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.798', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO5': '0.017', 'weapon7': '0.048', 'AMMO4': '0.074', 'AMMO3': '0.081', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.448', 'WEAPON3': '0.550', 'HITCOUNT': '0.580', 'weapon2': '1.054', 'weapon3': '1.542', 'DAMAGECOUNT': '2.319', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:09:08,085][2409096] DAMAGECOUNT value on done: 5233.0
[2023-02-25 13:09:08,089][2409096] Sum rewards: 8.350, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.162', 'AMMO2': '0.006', 'AMMO5': '0.025', 'AMMO4': '0.031', 'weapon7': '0.058', 'AMMO3': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.202', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.650', 'weapon3': '1.092', 'ARMOR': '1.332', 'weapon2': '2.354', 'DAMAGECOUNT': '2.763', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:09:08,172][2409105] DAMAGECOUNT value on done: 5259.0
[2023-02-25 13:09:08,173][2409105] Sum rewards: 8.018, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.631', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon7': '0.048', 'AMMO3': '0.060', 'AMMO4': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.200', 'weapon5': '0.240', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'ARMOR': '0.450', 'weapon4': '0.524', 'HITCOUNT': '0.630', 'weapon3': '1.338', 'weapon2': '1.438', 'DAMAGECOUNT': '2.895', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:08,266][2409104] DAMAGECOUNT value on done: 4680.0
[2023-02-25 13:09:08,267][2409104] Sum rewards: 10.829, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.470', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO5': '0.015', 'weapon7': '0.062', 'AMMO4': '0.065', 'AMMO3': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.192', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'weapon4': '0.652', 'HITCOUNT': '0.750', 'weapon2': '1.130', 'weapon3': '1.262', 'DAMAGECOUNT': '2.820', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:09:08,480][2409469] DAMAGECOUNT value on done: 6652.0
[2023-02-25 13:09:08,481][2409469] Sum rewards: 7.515, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.628', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO2': '0.036', 'AMMO3': '0.069', 'AMMO4': '0.180', 'weapon5': '0.232', 'WEAPON4': '0.250', 'weapon4': '0.384', 'WEAPON5': '0.400', 'HITCOUNT': '0.420', 'ARMOR': '0.424', 'WEAPON3': '0.450', 'weapon3': '1.268', 'weapon2': '1.830', 'DAMAGECOUNT': '1.899', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:09:08,502][2409407] DAMAGECOUNT value on done: 4949.0
[2023-02-25 13:09:08,503][2409407] Sum rewards: 9.946, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.352', 'AMMO5': '0.022', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'weapon7': '0.060', 'AMMO3': '0.090', 'AMMO4': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.206', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'ARMOR': '0.455', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'weapon2': '0.728', 'weapon4': '0.732', 'weapon3': '1.826', 'DAMAGECOUNT': '2.739', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:09:08,558][2409101] DAMAGECOUNT value on done: 6298.0
[2023-02-25 13:09:08,559][2409101] Sum rewards: 10.567, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.540', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'AMMO5': '0.033', 'AMMO3': '0.076', 'AMMO4': '0.114', 'weapon5': '0.186', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.262', 'ARMOR': '0.453', 'HITCOUNT': '0.610', 'WEAPON3': '0.650', 'WEAPON5': '0.700', 'weapon2': '1.498', 'weapon3': '1.720', 'DAMAGECOUNT': '3.222', 'FRAGCOUNT': '8.500'}
[2023-02-25 13:09:08,600][2409485] DAMAGECOUNT value on done: 5145.0
[2023-02-25 13:09:08,601][2409485] Sum rewards: 8.639, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.109', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'AMMO3': '0.076', 'AMMO4': '0.126', 'weapon5': '0.142', 'weapon4': '0.200', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.510', 'weapon2': '1.326', 'weapon3': '1.480', 'DAMAGECOUNT': '2.835', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:08,651][2409597] DAMAGECOUNT value on done: 5392.0
[2023-02-25 13:09:08,652][2409597] Sum rewards: 8.443, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.097', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.048', 'weapon7': '0.048', 'AMMO3': '0.071', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'HITCOUNT': '0.370', 'WEAPON3': '0.400', 'ARMOR': '0.587', 'weapon2': '0.616', 'weapon4': '1.056', 'weapon3': '1.066', 'DAMAGECOUNT': '1.749', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:08,685][2409355] DAMAGECOUNT value on done: 5310.0
[2023-02-25 13:09:08,686][2409355] Sum rewards: 5.288, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.152', 'ARMOR': '0.004', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.032', 'weapon7': '0.050', 'AMMO3': '0.079', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'WEAPON4': '0.250', 'weapon4': '0.422', 'WEAPON3': '0.500', 'HITCOUNT': '0.750', 'weapon3': '1.268', 'weapon2': '1.492', 'DAMAGECOUNT': '2.331', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:08,724][2409389] DAMAGECOUNT value on done: 4777.0
[2023-02-25 13:09:08,727][2409389] Sum rewards: 5.989, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.290', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO4': '0.094', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'weapon4': '0.264', 'weapon5': '0.298', 'ARMOR': '0.456', 'WEAPON5': '0.500', 'HITCOUNT': '0.500', 'WEAPON3': '0.800', 'weapon2': '1.200', 'weapon3': '1.624', 'DAMAGECOUNT': '2.703', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:08,979][2409078] DAMAGECOUNT value on done: 4893.0
[2023-02-25 13:09:08,980][2409078] Sum rewards: 4.052, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.212', 'AMMO5': '0.018', 'AMMO2': '0.019', 'weapon5': '0.050', 'AMMO4': '0.093', 'AMMO3': '0.098', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'ARMOR': '0.400', 'HITCOUNT': '0.550', 'WEAPON3': '0.750', 'weapon4': '0.826', 'weapon2': '1.168', 'weapon3': '1.710', 'DAMAGECOUNT': '1.881', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:09:09,013][2409565] DAMAGECOUNT value on done: 4500.0
[2023-02-25 13:09:09,014][2409565] Sum rewards: 6.645, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.349', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO3': '0.020', 'weapon5': '0.050', 'AMMO4': '0.053', 'weapon7': '0.054', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON3': '0.150', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.360', 'weapon3': '0.382', 'ARMOR': '0.453', 'weapon4': '0.760', 'weapon2': '1.316', 'DAMAGECOUNT': '1.440', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:09,130][2409075] DAMAGECOUNT value on done: 4769.0
[2023-02-25 13:09:09,131][2409075] Sum rewards: 9.944, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.427', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon7': '0.048', 'AMMO3': '0.052', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO4': '0.109', 'weapon5': '0.110', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.630', 'weapon3': '1.160', 'ARMOR': '1.237', 'weapon2': '1.674', 'DAMAGECOUNT': '2.580', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:09,494][2409074] Updated weights for policy 0, policy_version 18601 (0.0012)
[2023-02-25 13:09:09,576][2409102] DAMAGECOUNT value on done: 5246.0
[2023-02-25 13:09:09,580][2409102] Sum rewards: 7.630, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.149', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.116', 'weapon5': '0.124', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'HITCOUNT': '0.760', 'ARMOR': '0.859', 'weapon2': '1.674', 'weapon3': '2.082', 'DAMAGECOUNT': '2.850', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:09,628][2409076] DAMAGECOUNT value on done: 5741.0
[2023-02-25 13:09:09,629][2409076] Sum rewards: 17.868, reward structure: {'DEATHCOUNT': '-6.000', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.033', 'AMMO3': '0.081', 'AMMO4': '0.163', 'WEAPON4': '0.200', 'weapon5': '0.212', 'HEALTH': '0.249', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.630', 'weapon2': '0.734', 'HITCOUNT': '1.150', 'weapon3': '1.872', 'DAMAGECOUNT': '5.214', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:09:09,736][2409596] DAMAGECOUNT value on done: 5271.0
[2023-02-25 13:09:09,737][2409596] Sum rewards: 8.687, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'AMMO4': '0.064', 'HEALTH': '0.100', 'weapon7': '0.104', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HITCOUNT': '0.230', 'weapon5': '0.244', 'WEAPON3': '0.250', 'WEAPON7': '0.300', 'ARMOR': '0.800', 'weapon3': '0.894', 'DAMAGECOUNT': '1.644', 'weapon2': '2.084', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:10,006][2409866] DAMAGECOUNT value on done: 5359.0
[2023-02-25 13:09:10,010][2409866] Sum rewards: 10.886, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.714', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'weapon7': '0.072', 'AMMO3': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.136', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.450', 'HITCOUNT': '0.560', 'WEAPON3': '0.700', 'weapon3': '1.590', 'weapon2': '1.850', 'DAMAGECOUNT': '3.117', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:09:10,187][2409097] DAMAGECOUNT value on done: 4702.0
[2023-02-25 13:09:10,188][2409097] Sum rewards: 11.638, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.357', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.007', 'weapon7': '0.052', 'AMMO3': '0.067', 'weapon5': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.228', 'WEAPON3': '0.550', 'HITCOUNT': '0.890', 'weapon3': '1.224', 'weapon2': '1.478', 'DAMAGECOUNT': '4.107', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:09:10,262][2409405] DAMAGECOUNT value on done: 4238.0
[2023-02-25 13:09:10,262][2409405] Sum rewards: 6.505, reward structure: {'DEATHCOUNT': '-0.750', 'HEALTH': '-0.147', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.003', 'AMMO3': '0.029', 'weapon5': '0.054', 'weapon7': '0.058', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON3': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.220', 'HITCOUNT': '0.340', 'ARMOR': '0.444', 'weapon3': '0.522', 'weapon2': '0.862', 'DAMAGECOUNT': '1.080', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:09:10,381][2409373] DAMAGECOUNT value on done: 4727.0
[2023-02-25 13:09:10,383][2409373] Sum rewards: 10.494, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.616', 'AMMO2': '0.013', 'AMMO5': '0.015', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'weapon5': '0.296', 'WEAPON5': '0.450', 'weapon4': '0.482', 'WEAPON3': '0.500', 'HITCOUNT': '0.580', 'weapon2': '1.076', 'ARMOR': '1.377', 'weapon3': '1.840', 'DAMAGECOUNT': '2.697', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:09:10,683][2409033] Signal inference workers to stop experience collection... (2250 times)
[2023-02-25 13:09:10,697][2409033] Signal inference workers to resume experience collection... (2250 times)
[2023-02-25 13:09:10,726][2409074] InferenceWorker_p0-w0: stopping experience collection (2250 times)
[2023-02-25 13:09:10,729][2409074] InferenceWorker_p0-w0: resuming experience collection (2250 times)
[2023-02-25 13:09:10,760][2409074] Updated weights for policy 0, policy_version 18611 (0.0012)
[2023-02-25 13:09:10,913][2409079] DAMAGECOUNT value on done: 4908.0
[2023-02-25 13:09:10,914][2409079] Sum rewards: 2.793, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.813', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.007', 'AMMO3': '0.021', 'weapon5': '0.058', 'weapon7': '0.120', 'WEAPON3': '0.200', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HITCOUNT': '0.250', 'WEAPON7': '0.300', 'weapon3': '0.514', 'ARMOR': '0.800', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.173', 'weapon2': '2.268'}
[2023-02-25 13:09:11,291][2409077] DAMAGECOUNT value on done: 6266.0
[2023-02-25 13:09:11,292][2409077] Sum rewards: 3.851, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.056', 'AMMO5': '0.003', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.024', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.068', 'ARMOR': '0.072', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.300', 'weapon4': '0.680', 'DAMAGECOUNT': '0.717', 'FRAGCOUNT': '1.000', 'weapon2': '1.090', 'weapon3': '1.098'}
[2023-02-25 13:09:11,419][2409406] DAMAGECOUNT value on done: 4993.0
[2023-02-25 13:09:11,421][2409406] Sum rewards: 5.964, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.788', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.046', 'weapon7': '0.070', 'AMMO3': '0.075', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.176', 'WEAPON7': '0.200', 'AMMO4': '0.229', 'WEAPON5': '0.300', 'HITCOUNT': '0.490', 'weapon4': '0.492', 'WEAPON3': '0.550', 'WEAPON4': '0.600', 'weapon2': '0.882', 'weapon3': '1.524', 'DAMAGECOUNT': '2.358', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:09:11,519][2409548] DAMAGECOUNT value on done: 4320.0
[2023-02-25 13:09:11,522][2409548] Sum rewards: 7.105, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.576', 'AMMO2': '0.013', 'AMMO5': '0.025', 'weapon7': '0.052', 'AMMO4': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'weapon4': '0.130', 'weapon5': '0.184', 'WEAPON5': '0.250', 'HITCOUNT': '0.460', 'WEAPON3': '0.700', 'weapon2': '1.622', 'ARMOR': '1.657', 'weapon3': '1.766', 'DAMAGECOUNT': '2.001', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:12,036][2409096] DAMAGECOUNT value on done: 5153.0
[2023-02-25 13:09:12,039][2409096] Sum rewards: 3.754, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.120', 'AMMO5': '0.015', 'AMMO2': '0.015', 'WEAPON1': '0.050', 'weapon4': '0.058', 'AMMO4': '0.076', 'weapon5': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.149', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.630', 'WEAPON3': '0.950', 'weapon2': '1.682', 'weapon3': '1.814', 'DAMAGECOUNT': '2.304', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:12,069][2409486] DAMAGECOUNT value on done: 4461.0
[2023-02-25 13:09:12,069][2409486] Sum rewards: 5.732, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.110', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.027', 'AMMO3': '0.030', 'weapon7': '0.048', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.132', 'WEAPON3': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.280', 'weapon4': '0.336', 'weapon2': '0.346', 'weapon3': '0.774', 'DAMAGECOUNT': '1.155', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:09:12,168][2409105] DAMAGECOUNT value on done: 4151.0
[2023-02-25 13:09:12,169][2409105] Sum rewards: 6.893, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.340', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.014', 'ARMOR': '0.024', 'AMMO4': '0.068', 'AMMO3': '0.092', 'weapon5': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.414', 'WEAPON3': '0.600', 'HITCOUNT': '0.700', 'weapon2': '1.248', 'weapon3': '1.510', 'DAMAGECOUNT': '2.382', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:09:12,186][2408954] Fps is (10 sec: 26214.0, 60 sec: 24917.3, 300 sec: 25048.1). Total num frames: 76267520. Throughput: 0: 6250.7. Samples: 19066560. Policy #0 lag: (min: 1.0, avg: 13.4, max: 23.0)
[2023-02-25 13:09:12,186][2408954] Avg episode reward: [(0, '7.807')]
[2023-02-25 13:09:12,312][2409407] DAMAGECOUNT value on done: 5447.0
[2023-02-25 13:09:12,313][2409407] Sum rewards: 16.303, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.644', 'AMMO2': '0.013', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.115', 'weapon5': '0.178', 'weapon4': '0.222', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'weapon2': '0.738', 'ARMOR': '0.859', 'HITCOUNT': '0.950', 'weapon3': '1.750', 'DAMAGECOUNT': '4.368', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:09:12,317][2409485] DAMAGECOUNT value on done: 4802.0
[2023-02-25 13:09:12,318][2409485] Sum rewards: 5.940, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.923', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.014', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.156', 'weapon4': '0.268', 'WEAPON5': '0.400', 'HITCOUNT': '0.420', 'WEAPON3': '0.450', 'ARMOR': '0.880', 'weapon3': '1.094', 'weapon2': '1.250', 'DAMAGECOUNT': '1.938', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:09:12,351][2409104] DAMAGECOUNT value on done: 4968.0
[2023-02-25 13:09:12,355][2409104] Sum rewards: 5.581, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.310', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO3': '0.098', 'weapon4': '0.124', 'weapon5': '0.148', 'AMMO4': '0.167', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '0.650', 'HITCOUNT': '0.850', 'weapon3': '1.564', 'weapon2': '1.638', 'DAMAGECOUNT': '3.156', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:12,393][2409101] DAMAGECOUNT value on done: 4591.0
[2023-02-25 13:09:12,396][2409101] Sum rewards: 9.686, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.608', 'AMMO5': '0.020', 'AMMO2': '0.028', 'weapon4': '0.036', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'weapon5': '0.130', 'AMMO4': '0.139', 'WEAPON5': '0.350', 'ARMOR': '0.454', 'WEAPON3': '0.600', 'HITCOUNT': '0.680', 'weapon2': '1.060', 'weapon3': '1.400', 'DAMAGECOUNT': '2.445', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:09:12,413][2409469] DAMAGECOUNT value on done: 6323.0
[2023-02-25 13:09:12,415][2409074] Updated weights for policy 0, policy_version 18621 (0.0012)
[2023-02-25 13:09:12,414][2409469] Sum rewards: 6.527, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.835', 'AMMO2': '0.017', 'AMMO5': '0.022', 'AMMO4': '0.086', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.114', 'AMMO3': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'ARMOR': '0.436', 'weapon4': '0.494', 'WEAPON3': '0.700', 'HITCOUNT': '0.760', 'weapon3': '1.424', 'weapon2': '1.566', 'DAMAGECOUNT': '3.225', 'FRAGCOUNT': '6.500'}
[2023-02-25 13:09:12,571][2409389] DAMAGECOUNT value on done: 6686.0
[2023-02-25 13:09:12,575][2409389] Sum rewards: 9.694, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.328', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon7': '0.064', 'AMMO4': '0.074', 'AMMO3': '0.106', 'weapon5': '0.146', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'ARMOR': '0.420', 'WEAPON3': '0.500', 'weapon4': '0.670', 'HITCOUNT': '0.710', 'weapon2': '1.018', 'weapon3': '1.758', 'DAMAGECOUNT': '2.724', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:09:12,689][2409078] DAMAGECOUNT value on done: 4518.0
[2023-02-25 13:09:12,690][2409078] Sum rewards: 7.023, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.432', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.015', 'weapon7': '0.052', 'AMMO3': '0.053', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.170', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.394', 'WEAPON3': '0.450', 'ARMOR': '0.455', 'HITCOUNT': '0.650', 'weapon2': '0.832', 'weapon3': '1.116', 'DAMAGECOUNT': '2.286', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:09:12,898][2409565] DAMAGECOUNT value on done: 5960.0
[2023-02-25 13:09:12,899][2409565] Sum rewards: 10.803, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.882', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO5': '0.036', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'weapon4': '0.068', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.134', 'weapon5': '0.278', 'ARMOR': '0.460', 'HITCOUNT': '0.670', 'WEAPON3': '0.750', 'WEAPON5': '0.800', 'weapon2': '1.578', 'weapon3': '1.638', 'DAMAGECOUNT': '3.606', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:09:12,939][2409597] DAMAGECOUNT value on done: 4558.0
[2023-02-25 13:09:12,940][2409597] Sum rewards: 5.696, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.470', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.038', 'AMMO3': '0.046', 'WEAPON4': '0.050', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.266', 'WEAPON3': '0.350', 'HITCOUNT': '0.500', 'ARMOR': '0.800', 'weapon3': '0.828', 'weapon2': '1.618', 'DAMAGECOUNT': '1.686', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:09:13,034][2409355] DAMAGECOUNT value on done: 5605.0
[2023-02-25 13:09:13,037][2409355] Sum rewards: 12.778, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon7': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.128', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HEALTH': '0.252', 'WEAPON3': '0.400', 'weapon4': '0.406', 'HITCOUNT': '0.620', 'ARMOR': '0.975', 'weapon2': '1.358', 'weapon3': '1.680', 'DAMAGECOUNT': '3.063', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:09:13,041][2409075] DAMAGECOUNT value on done: 4740.0
[2023-02-25 13:09:13,042][2409075] Sum rewards: 5.563, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.070', 'HEALTH': '0.115', 'WEAPON4': '0.150', 'weapon5': '0.162', 'WEAPON5': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.400', 'ARMOR': '0.464', 'weapon4': '0.544', 'weapon2': '0.818', 'weapon3': '1.456', 'DAMAGECOUNT': '2.010', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:09:13,375][2409102] DAMAGECOUNT value on done: 5133.0
[2023-02-25 13:09:13,376][2409102] Sum rewards: 3.432, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.025', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO3': '0.060', 'AMMO4': '0.130', 'weapon5': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'weapon4': '0.404', 'ARMOR': '0.434', 'HITCOUNT': '0.560', 'FRAGCOUNT': '1.500', 'weapon3': '1.502', 'weapon2': '1.750', 'DAMAGECOUNT': '2.127'}
[2023-02-25 13:09:13,726][2409596] DAMAGECOUNT value on done: 3664.0
[2023-02-25 13:09:13,727][2409596] Sum rewards: 1.993, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '0.000', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'weapon7': '0.048', 'AMMO3': '0.052', 'HITCOUNT': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.130', 'AMMO4': '0.138', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.408', 'weapon4': '0.430', 'weapon3': '0.526', 'ARMOR': '0.900', 'weapon2': '0.928', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:09:13,739][2409405] DAMAGECOUNT value on done: 5618.0
[2023-02-25 13:09:13,743][2409405] Sum rewards: 7.499, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.458', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon7': '0.038', 'AMMO3': '0.101', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon5': '0.166', 'AMMO4': '0.166', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.396', 'WEAPON3': '0.550', 'HITCOUNT': '0.870', 'weapon3': '1.506', 'weapon2': '1.582', 'DAMAGECOUNT': '3.216', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:13,878][2409097] DAMAGECOUNT value on done: 5088.0
[2023-02-25 13:09:13,881][2409097] Sum rewards: 10.841, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.792', 'AMMO5': '0.015', 'AMMO2': '0.048', 'AMMO3': '0.090', 'weapon5': '0.116', 'AMMO4': '0.238', 'weapon4': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'ARMOR': '0.804', 'HITCOUNT': '0.860', 'weapon3': '1.532', 'weapon2': '1.774', 'DAMAGECOUNT': '4.158', 'FRAGCOUNT': '9.500'}
[2023-02-25 13:09:13,908][2409076] DAMAGECOUNT value on done: 5405.0
[2023-02-25 13:09:13,911][2409076] Sum rewards: 7.797, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.318', 'AMMO5': '0.020', 'AMMO2': '0.022', 'AMMO3': '0.081', 'AMMO4': '0.110', 'WEAPON4': '0.200', 'weapon5': '0.348', 'WEAPON5': '0.450', 'weapon4': '0.466', 'WEAPON3': '0.500', 'HITCOUNT': '0.580', 'ARMOR': '0.891', 'weapon2': '1.466', 'weapon3': '1.494', 'DAMAGECOUNT': '2.487', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:14,278][2409074] Updated weights for policy 0, policy_version 18631 (0.0012)
[2023-02-25 13:09:14,576][2409079] DAMAGECOUNT value on done: 5353.0
[2023-02-25 13:09:14,577][2409079] Sum rewards: 9.586, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.878', 'AMMO5': '0.003', 'AMMO2': '0.017', 'AMMO3': '0.045', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'weapon7': '0.202', 'WEAPON4': '0.300', 'WEAPON3': '0.300', 'HITCOUNT': '0.340', 'AMMO6': '0.600', 'AMMO7': '0.600', 'weapon3': '0.798', 'WEAPON7': '0.800', 'weapon4': '1.032', 'ARMOR': '1.333', 'weapon2': '1.460', 'DAMAGECOUNT': '2.001', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:09:14,715][2409866] DAMAGECOUNT value on done: 5442.0
[2023-02-25 13:09:14,718][2409866] Sum rewards: 10.893, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.509', 'AMMO2': '0.012', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.057', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.250', 'weapon5': '0.274', 'weapon4': '0.398', 'WEAPON3': '0.450', 'HITCOUNT': '0.620', 'ARMOR': '1.320', 'weapon3': '1.420', 'weapon2': '1.552', 'DAMAGECOUNT': '3.600', 'FRAGCOUNT': '6.500'}
[2023-02-25 13:09:14,877][2409373] DAMAGECOUNT value on done: 4760.0
[2023-02-25 13:09:14,880][2409373] Sum rewards: 12.374, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.506', 'AMMO2': '0.005', 'AMMO5': '0.017', 'AMMO4': '0.024', 'WEAPON1': '0.030', 'AMMO3': '0.091', 'weapon7': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.450', 'ARMOR': '0.457', 'weapon4': '0.516', 'HITCOUNT': '0.670', 'WEAPON3': '0.700', 'weapon2': '1.152', 'weapon3': '1.546', 'DAMAGECOUNT': '2.598', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:09:14,884][2409077] DAMAGECOUNT value on done: 6211.0
[2023-02-25 13:09:14,885][2409077] Sum rewards: 14.803, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.465', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO5': '0.010', 'AMMO3': '0.088', 'weapon7': '0.098', 'WEAPON4': '0.100', 'weapon5': '0.180', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'weapon4': '0.344', 'WEAPON7': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.810', 'ARMOR': '1.295', 'weapon3': '1.330', 'weapon2': '1.804', 'DAMAGECOUNT': '4.521', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:09:15,017][2409406] DAMAGECOUNT value on done: 5644.0
[2023-02-25 13:09:15,018][2409406] Sum rewards: 6.652, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.298', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.027', 'AMMO3': '0.106', 'AMMO4': '0.133', 'weapon5': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.424', 'weapon4': '0.520', 'HITCOUNT': '0.610', 'WEAPON3': '0.700', 'weapon2': '1.174', 'weapon3': '1.760', 'DAMAGECOUNT': '2.130', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:09:15,107][2409548] DAMAGECOUNT value on done: 6757.0
[2023-02-25 13:09:15,110][2409548] Sum rewards: 13.486, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.588', 'AMMO2': '0.015', 'AMMO5': '0.020', 'AMMO3': '0.070', 'AMMO4': '0.073', 'weapon5': '0.290', 'weapon2': '0.320', 'WEAPON4': '0.350', 'ARMOR': '0.450', 'WEAPON3': '0.550', 'WEAPON5': '0.600', 'HITCOUNT': '0.930', 'weapon4': '1.106', 'weapon3': '1.422', 'DAMAGECOUNT': '4.128', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:09:15,570][2409074] Updated weights for policy 0, policy_version 18641 (0.0013)
[2023-02-25 13:09:15,908][2409101] DAMAGECOUNT value on done: 6010.0
[2023-02-25 13:09:15,908][2409101] Sum rewards: 5.679, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.220', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO5': '0.022', 'weapon4': '0.026', 'AMMO4': '0.066', 'AMMO3': '0.097', 'weapon5': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.450', 'HITCOUNT': '0.610', 'WEAPON3': '0.700', 'ARMOR': '0.900', 'weapon3': '1.472', 'weapon2': '2.094', 'DAMAGECOUNT': '2.574', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:15,933][2409407] DAMAGECOUNT value on done: 4508.0
[2023-02-25 13:09:15,936][2409407] Sum rewards: 9.721, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.564', 'AMMO5': '0.019', 'AMMO2': '0.049', 'WEAPON1': '0.060', 'AMMO3': '0.098', 'weapon5': '0.120', 'AMMO4': '0.243', 'WEAPON4': '0.300', 'weapon2': '0.408', 'WEAPON5': '0.450', 'weapon4': '0.664', 'WEAPON3': '0.700', 'HITCOUNT': '0.880', 'weapon3': '1.872', 'DAMAGECOUNT': '2.922', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:09:16,013][2409486] DAMAGECOUNT value on done: 5274.0
[2023-02-25 13:09:16,014][2409486] Sum rewards: 8.625, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.224', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.055', 'weapon7': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.110', 'weapon4': '0.142', 'HITCOUNT': '0.320', 'WEAPON3': '0.350', 'ARMOR': '0.480', 'weapon3': '0.680', 'weapon2': '1.138', 'DAMAGECOUNT': '1.953', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:16,038][2409485] DAMAGECOUNT value on done: 4766.0
[2023-02-25 13:09:16,039][2409485] Sum rewards: 12.090, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.484', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon7': '0.050', 'AMMO3': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.153', 'weapon5': '0.182', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'HITCOUNT': '0.710', 'weapon2': '0.908', 'weapon4': '0.948', 'weapon3': '1.192', 'DAMAGECOUNT': '2.811', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:09:16,146][2409096] DAMAGECOUNT value on done: 5800.0
[2023-02-25 13:09:16,148][2409096] Sum rewards: 6.577, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.010', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon7': '0.046', 'AMMO3': '0.077', 'AMMO4': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.176', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.410', 'ARMOR': '0.461', 'WEAPON3': '0.600', 'weapon4': '0.646', 'weapon2': '0.926', 'weapon3': '1.486', 'DAMAGECOUNT': '2.379', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:16,255][2409078] DAMAGECOUNT value on done: 5364.0
[2023-02-25 13:09:16,255][2409078] Sum rewards: 11.582, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.097', 'AMMO5': '0.005', 'AMMO2': '0.007', 'ARMOR': '0.032', 'AMMO4': '0.035', 'weapon7': '0.058', 'weapon5': '0.058', 'AMMO3': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.344', 'WEAPON3': '0.600', 'HITCOUNT': '0.630', 'weapon2': '0.950', 'weapon3': '1.430', 'DAMAGECOUNT': '3.600', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:09:16,348][2409104] DAMAGECOUNT value on done: 4223.0
[2023-02-25 13:09:16,351][2409104] Sum rewards: 9.927, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.356', 'AMMO5': '0.007', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'weapon7': '0.066', 'AMMO3': '0.075', 'weapon5': '0.090', 'AMMO4': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.276', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.530', 'weapon3': '1.022', 'weapon2': '1.578', 'DAMAGECOUNT': '2.571', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:09:16,405][2409105] DAMAGECOUNT value on done: 6091.0
[2023-02-25 13:09:16,406][2409105] Sum rewards: 16.583, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.042', 'AMMO2': '0.010', 'AMMO5': '0.015', 'AMMO3': '0.050', 'AMMO4': '0.051', 'weapon7': '0.058', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.216', 'weapon4': '0.306', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'ARMOR': '0.454', 'HITCOUNT': '0.780', 'weapon3': '1.240', 'weapon2': '1.466', 'DAMAGECOUNT': '4.839', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:09:16,492][2409469] DAMAGECOUNT value on done: 5503.0
[2023-02-25 13:09:16,493][2409469] Sum rewards: 6.831, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.783', 'AMMO5': '0.018', 'AMMO2': '0.028', 'AMMO3': '0.109', 'weapon4': '0.126', 'AMMO4': '0.139', 'weapon5': '0.196', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'HITCOUNT': '0.740', 'WEAPON3': '0.750', 'ARMOR': '0.800', 'weapon3': '1.408', 'weapon2': '1.928', 'DAMAGECOUNT': '2.772', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:09:16,564][2409565] DAMAGECOUNT value on done: 5971.0
[2023-02-25 13:09:16,567][2409389] DAMAGECOUNT value on done: 4442.0
[2023-02-25 13:09:16,568][2409389] Sum rewards: 10.800, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.006', 'AMMO2': '0.022', 'AMMO5': '0.026', 'AMMO4': '0.112', 'weapon5': '0.118', 'AMMO3': '0.171', 'weapon4': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.550', 'ARMOR': '0.816', 'HITCOUNT': '0.920', 'WEAPON3': '1.100', 'weapon2': '1.352', 'weapon3': '2.034', 'DAMAGECOUNT': '3.645', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:09:16,859][2409597] DAMAGECOUNT value on done: 3735.0
[2023-02-25 13:09:16,860][2409597] Sum rewards: 8.404, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.640', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.114', 'weapon5': '0.286', 'WEAPON5': '0.300', 'weapon4': '0.304', 'WEAPON3': '0.500', 'HITCOUNT': '0.570', 'weapon2': '1.388', 'weapon3': '1.690', 'DAMAGECOUNT': '2.979', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:17,142][2409075] DAMAGECOUNT value on done: 4769.0
[2023-02-25 13:09:17,143][2409075] Sum rewards: 7.375, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.754', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'AMMO3': '0.096', 'weapon5': '0.110', 'AMMO4': '0.141', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.440', 'WEAPON3': '0.650', 'weapon4': '0.694', 'ARMOR': '0.853', 'weapon2': '1.336', 'weapon3': '1.614', 'DAMAGECOUNT': '1.884', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:17,186][2408954] Fps is (10 sec: 24166.5, 60 sec: 25053.9, 300 sec: 25062.0). Total num frames: 76390400. Throughput: 0: 6273.6. Samples: 19104360. Policy #0 lag: (min: 1.0, avg: 13.4, max: 23.0)
[2023-02-25 13:09:17,186][2408954] Avg episode reward: [(0, '8.163')]
[2023-02-25 13:09:17,265][2409405] DAMAGECOUNT value on done: 5155.0
[2023-02-25 13:09:17,266][2409405] Sum rewards: 10.879, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.010', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'weapon5': '0.074', 'AMMO4': '0.127', 'weapon7': '0.140', 'HEALTH': '0.150', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON3': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'HITCOUNT': '0.720', 'weapon4': '0.790', 'weapon2': '1.110', 'weapon3': '1.280', 'DAMAGECOUNT': '2.883', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:09:17,310][2409074] Updated weights for policy 0, policy_version 18651 (0.0012)
[2023-02-25 13:09:17,492][2409355] DAMAGECOUNT value on done: 5645.0
[2023-02-25 13:09:17,493][2409355] Sum rewards: 9.897, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.111', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon7': '0.054', 'ARMOR': '0.068', 'AMMO3': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.124', 'AMMO4': '0.158', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.578', 'HITCOUNT': '0.580', 'weapon4': '1.124', 'weapon3': '1.480', 'DAMAGECOUNT': '2.937', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:09:17,787][2409596] DAMAGECOUNT value on done: 4668.0
[2023-02-25 13:09:17,790][2409596] Sum rewards: 12.969, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.395', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO3': '0.054', 'weapon5': '0.104', 'AMMO4': '0.109', 'weapon7': '0.130', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'ARMOR': '0.480', 'HITCOUNT': '0.590', 'weapon4': '0.736', 'weapon3': '1.138', 'weapon2': '1.232', 'DAMAGECOUNT': '2.856', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:09:18,184][2409099] DAMAGECOUNT value on done: 5028.0
[2023-02-25 13:09:18,187][2409099] Sum rewards: 2.428, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.358', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.012', 'WEAPON1': '0.020', 'weapon7': '0.050', 'AMMO3': '0.086', 'weapon5': '0.096', 'weapon4': '0.140', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'HITCOUNT': '0.360', 'WEAPON3': '0.650', 'ARMOR': '0.938', 'DAMAGECOUNT': '1.023', 'weapon3': '1.322', 'weapon2': '1.636', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:09:18,190][2409076] DAMAGECOUNT value on done: 5758.0
[2023-02-25 13:09:18,191][2409076] Sum rewards: 8.616, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.696', 'AMMO5': '0.009', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.094', 'weapon5': '0.144', 'WEAPON5': '0.250', 'weapon4': '0.332', 'WEAPON3': '0.550', 'HITCOUNT': '0.660', 'weapon2': '1.668', 'weapon3': '1.676', 'DAMAGECOUNT': '2.787', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:09:18,197][2409097] DAMAGECOUNT value on done: 4932.0
[2023-02-25 13:09:18,207][2409097] Sum rewards: 11.153, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.169', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon7': '0.048', 'AMMO3': '0.050', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'weapon4': '0.608', 'HITCOUNT': '0.610', 'weapon2': '1.046', 'weapon3': '1.212', 'DAMAGECOUNT': '2.838', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:09:18,597][2409077] DAMAGECOUNT value on done: 4980.0
[2023-02-25 13:09:18,598][2409077] Sum rewards: 8.581, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.300', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'weapon7': '0.050', 'AMMO3': '0.074', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.140', 'WEAPON7': '0.200', 'weapon4': '0.296', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.570', 'weapon3': '1.160', 'weapon2': '1.260', 'DAMAGECOUNT': '2.361', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:09:18,598][2409079] DAMAGECOUNT value on done: 5227.0
[2023-02-25 13:09:18,599][2409079] Sum rewards: 5.895, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.391', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO5': '0.017', 'weapon7': '0.056', 'AMMO3': '0.075', 'AMMO4': '0.081', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.244', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon4': '0.614', 'HITCOUNT': '0.640', 'ARMOR': '0.913', 'weapon2': '1.174', 'weapon3': '1.544', 'DAMAGECOUNT': '2.961', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:09:18,710][2409548] DAMAGECOUNT value on done: 5220.0
[2023-02-25 13:09:18,714][2409548] Sum rewards: 5.722, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.042', 'AMMO5': '0.015', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'AMMO4': '0.078', 'weapon7': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.144', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.300', 'HITCOUNT': '0.520', 'weapon4': '0.620', 'ARMOR': '0.909', 'weapon3': '1.100', 'weapon2': '1.172', 'DAMAGECOUNT': '2.238', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:18,727][2409406] DAMAGECOUNT value on done: 3888.0
[2023-02-25 13:09:18,731][2409406] Sum rewards: 6.529, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.850', 'AMMO5': '0.017', 'AMMO2': '0.020', 'AMMO4': '0.099', 'AMMO3': '0.107', 'WEAPON4': '0.250', 'weapon5': '0.256', 'weapon4': '0.276', 'WEAPON5': '0.400', 'ARMOR': '0.500', 'HITCOUNT': '0.500', 'WEAPON3': '0.650', 'weapon2': '1.342', 'weapon3': '1.620', 'DAMAGECOUNT': '1.842', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:09:18,832][2409074] Updated weights for policy 0, policy_version 18661 (0.0013)
[2023-02-25 13:09:19,010][2409373] DAMAGECOUNT value on done: 5711.0
[2023-02-25 13:09:19,013][2409373] Sum rewards: 4.603, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.862', 'AMMO5': '0.024', 'AMMO2': '0.048', 'weapon7': '0.052', 'AMMO3': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.182', 'WEAPON7': '0.200', 'AMMO4': '0.241', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'weapon2': '0.506', 'WEAPON4': '0.550', 'HITCOUNT': '0.870', 'weapon3': '1.212', 'weapon4': '1.336', 'DAMAGECOUNT': '2.682', 'FRAGCOUNT': '3.500'}
[2023-02-25 13:09:19,313][2409866] DAMAGECOUNT value on done: 5827.0
[2023-02-25 13:09:19,314][2409866] Sum rewards: 9.987, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.136', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'weapon7': '0.018', 'WEAPON4': '0.050', 'AMMO3': '0.072', 'AMMO4': '0.086', 'weapon5': '0.092', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.316', 'WEAPON3': '0.500', 'HITCOUNT': '0.560', 'ARMOR': '0.816', 'weapon3': '1.430', 'DAMAGECOUNT': '1.944', 'weapon2': '1.954', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:09:19,677][2409486] DAMAGECOUNT value on done: 6180.0
[2023-02-25 13:09:19,678][2409486] Sum rewards: 13.100, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.131', 'AMMO2': '0.009', 'AMMO5': '0.020', 'AMMO4': '0.047', 'weapon7': '0.056', 'AMMO3': '0.084', 'WEAPON4': '0.150', 'weapon5': '0.242', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'ARMOR': '0.430', 'weapon4': '0.434', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.670', 'weapon2': '1.044', 'weapon3': '1.518', 'DAMAGECOUNT': '3.327', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:09:19,800][2409078] DAMAGECOUNT value on done: 4813.0
[2023-02-25 13:09:19,804][2409078] Sum rewards: 4.852, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.690', 'AMMO2': '0.019', 'AMMO5': '0.020', 'WEAPON1': '0.050', 'AMMO4': '0.093', 'AMMO3': '0.103', 'WEAPON4': '0.150', 'weapon5': '0.192', 'weapon4': '0.226', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.750', 'weapon2': '1.170', 'weapon3': '1.778', 'DAMAGECOUNT': '2.391', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:19,899][2409407] DAMAGECOUNT value on done: 4102.0
[2023-02-25 13:09:19,902][2409407] Sum rewards: 1.905, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.265', 'AMMO2': '0.010', 'AMMO5': '0.012', 'AMMO3': '0.027', 'AMMO4': '0.050', 'weapon5': '0.076', 'weapon7': '0.104', 'HITCOUNT': '0.110', 'WEAPON3': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.314', 'WEAPON4': '0.350', 'weapon3': '0.374', 'AMMO6': '0.440', 'AMMO7': '0.440', 'WEAPON7': '0.600', 'weapon4': '0.740', 'DAMAGECOUNT': '0.873', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:09:19,908][2409096] DAMAGECOUNT value on done: 5862.0
[2023-02-25 13:09:19,909][2409096] Sum rewards: 11.968, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.851', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.040', 'AMMO3': '0.060', 'weapon7': '0.070', 'weapon5': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.455', 'WEAPON3': '0.500', 'weapon4': '0.574', 'HITCOUNT': '0.790', 'weapon2': '0.908', 'weapon3': '1.298', 'DAMAGECOUNT': '3.516', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:09:19,959][2409485] DAMAGECOUNT value on done: 7114.0
[2023-02-25 13:09:19,960][2409485] Sum rewards: 11.782, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.746', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'AMMO3': '0.096', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.140', 'WEAPON4': '0.300', 'weapon5': '0.316', 'weapon4': '0.328', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.950', 'weapon2': '1.222', 'weapon3': '1.614', 'DAMAGECOUNT': '4.398', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:09:20,210][2409565] DAMAGECOUNT value on done: 4241.0
[2023-02-25 13:09:20,211][2409565] Sum rewards: 4.940, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.644', 'AMMO2': '0.006', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.030', 'AMMO3': '0.040', 'weapon7': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.186', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'HITCOUNT': '0.320', 'ARMOR': '0.400', 'weapon3': '0.820', 'DAMAGECOUNT': '1.233', 'weapon2': '1.682', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:09:20,226][2409105] DAMAGECOUNT value on done: 5405.0
[2023-02-25 13:09:20,227][2409105] Sum rewards: 7.607, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.954', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.026', 'AMMO3': '0.081', 'weapon5': '0.100', 'AMMO4': '0.128', 'weapon7': '0.158', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'HITCOUNT': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.488', 'WEAPON3': '0.500', 'weapon3': '1.024', 'ARMOR': '1.279', 'weapon2': '1.504', 'DAMAGECOUNT': '2.556', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:20,236][2409469] DAMAGECOUNT value on done: 3881.0
[2023-02-25 13:09:20,239][2409469] Sum rewards: 7.143, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.480', 'AMMO2': '0.018', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.051', 'AMMO4': '0.092', 'weapon7': '0.128', 'weapon5': '0.144', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.390', 'weapon4': '0.612', 'ARMOR': '0.916', 'weapon3': '1.284', 'weapon2': '1.580', 'DAMAGECOUNT': '2.079', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:09:20,328][2409104] DAMAGECOUNT value on done: 4941.0
[2023-02-25 13:09:20,329][2409104] Sum rewards: 10.944, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.134', 'AMMO2': '0.006', 'AMMO5': '0.025', 'AMMO4': '0.027', 'WEAPON1': '0.040', 'weapon4': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.094', 'weapon5': '0.112', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '0.860', 'weapon2': '0.988', 'weapon3': '2.010', 'DAMAGECOUNT': '3.426', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:09:20,423][2409389] DAMAGECOUNT value on done: 4807.0
[2023-02-25 13:09:20,425][2409389] Sum rewards: 5.534, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.416', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.014', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.084', 'weapon5': '0.278', 'WEAPON3': '0.400', 'HITCOUNT': '0.420', 'WEAPON5': '0.450', 'ARMOR': '0.500', 'weapon3': '1.242', 'weapon2': '1.918', 'DAMAGECOUNT': '1.989', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:09:20,666][2409597] DAMAGECOUNT value on done: 4398.0
[2023-02-25 13:09:20,669][2409597] Sum rewards: 0.458, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.006', 'AMMO2': '0.004', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO4': '0.020', 'AMMO3': '0.066', 'weapon7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'HITCOUNT': '0.300', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'weapon4': '0.628', 'weapon2': '0.632', 'weapon3': '0.642', 'DAMAGECOUNT': '0.906', 'FRAGCOUNT': '1.000'}
[2023-02-25 13:09:20,721][2409074] Updated weights for policy 0, policy_version 18671 (0.0012)
[2023-02-25 13:09:20,851][2409075] DAMAGECOUNT value on done: 5442.0
[2023-02-25 13:09:20,852][2409075] Sum rewards: 10.664, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.687', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO3': '0.072', 'weapon7': '0.074', 'AMMO4': '0.079', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.394', 'WEAPON3': '0.500', 'HITCOUNT': '0.600', 'weapon3': '1.036', 'weapon2': '1.212', 'DAMAGECOUNT': '3.069', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:09:20,950][2409405] DAMAGECOUNT value on done: 5640.0
[2023-02-25 13:09:20,951][2409405] Sum rewards: 14.847, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.088', 'WEAPON1': '0.010', 'AMMO5': '0.024', 'AMMO2': '0.030', 'weapon4': '0.044', 'AMMO3': '0.107', 'AMMO4': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.316', 'ARMOR': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '0.720', 'weapon2': '1.506', 'weapon3': '1.794', 'DAMAGECOUNT': '3.984', 'FRAGCOUNT': '10.500'}
[2023-02-25 13:09:21,482][2409596] DAMAGECOUNT value on done: 5334.0
[2023-02-25 13:09:21,485][2409596] Sum rewards: 10.593, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.103', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO5': '0.017', 'WEAPON4': '0.050', 'weapon4': '0.062', 'AMMO3': '0.068', 'AMMO4': '0.080', 'weapon5': '0.214', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'ARMOR': '0.404', 'HITCOUNT': '0.630', 'weapon3': '1.320', 'weapon2': '1.710', 'DAMAGECOUNT': '2.814', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:09:21,980][2409076] DAMAGECOUNT value on done: 5273.0
[2023-02-25 13:09:21,981][2409076] Sum rewards: 10.994, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.899', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'ARMOR': '0.036', 'weapon7': '0.074', 'AMMO3': '0.091', 'weapon5': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.139', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.354', 'WEAPON3': '0.600', 'HITCOUNT': '0.840', 'weapon2': '1.394', 'weapon3': '1.776', 'DAMAGECOUNT': '3.393', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:09:22,028][2409099] DAMAGECOUNT value on done: 4854.0
[2023-02-25 13:09:22,029][2409099] Sum rewards: 5.740, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.365', 'AMMO2': '0.020', 'AMMO3': '0.024', 'weapon7': '0.096', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'WEAPON3': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.270', 'weapon2': '0.396', 'weapon3': '0.408', 'ARMOR': '0.453', 'weapon4': '0.616', 'DAMAGECOUNT': '1.572', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:22,128][2409355] DAMAGECOUNT value on done: 5603.0
[2023-02-25 13:09:22,130][2409355] Sum rewards: 5.405, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.908', 'AMMO2': '0.003', 'AMMO5': '0.009', 'AMMO4': '0.016', 'weapon5': '0.038', 'AMMO3': '0.071', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.500', 'ARMOR': '0.511', 'weapon4': '0.602', 'HITCOUNT': '0.720', 'weapon2': '1.272', 'weapon3': '1.578', 'DAMAGECOUNT': '2.592', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:09:22,186][2408954] Fps is (10 sec: 24576.1, 60 sec: 25122.1, 300 sec: 25020.3). Total num frames: 76513280. Throughput: 0: 6273.1. Samples: 19122924. Policy #0 lag: (min: 1.0, avg: 11.3, max: 25.0)
[2023-02-25 13:09:22,186][2408954] Avg episode reward: [(0, '8.481')]
[2023-02-25 13:09:22,196][2409074] Updated weights for policy 0, policy_version 18681 (0.0012)
[2023-02-25 13:09:22,303][2409079] DAMAGECOUNT value on done: 6348.0
[2023-02-25 13:09:22,304][2409079] Sum rewards: 7.629, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.764', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon7': '0.048', 'AMMO3': '0.079', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.119', 'weapon5': '0.122', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.402', 'WEAPON3': '0.550', 'HITCOUNT': '0.680', 'weapon3': '1.318', 'weapon2': '1.652', 'DAMAGECOUNT': '3.237', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:22,354][2409097] DAMAGECOUNT value on done: 4883.0
[2023-02-25 13:09:22,358][2409097] Sum rewards: 9.779, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.299', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.039', 'AMMO3': '0.040', 'weapon5': '0.060', 'weapon7': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.300', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.490', 'weapon4': '0.586', 'weapon3': '0.954', 'weapon2': '1.190', 'DAMAGECOUNT': '2.673', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:22,504][2409548] DAMAGECOUNT value on done: 4632.0
[2023-02-25 13:09:22,505][2409548] Sum rewards: 7.091, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.026', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO2': '0.025', 'weapon7': '0.056', 'AMMO3': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.125', 'weapon5': '0.194', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'HITCOUNT': '0.550', 'weapon2': '0.594', 'WEAPON3': '0.600', 'weapon4': '0.774', 'weapon3': '1.648', 'DAMAGECOUNT': '2.256', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:22,521][2409077] DAMAGECOUNT value on done: 5106.0
[2023-02-25 13:09:22,523][2409077] Sum rewards: 5.571, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.112', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'weapon4': '0.024', 'AMMO4': '0.081', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.136', 'HITCOUNT': '0.380', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon3': '1.474', 'weapon2': '1.562', 'DAMAGECOUNT': '1.608', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:09:22,537][2409104] Large shaping reward 2.535 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.513, 171.0), ('weapon5', 0.002)]
[2023-02-25 13:09:22,609][2409373] DAMAGECOUNT value on done: 6668.0
[2023-02-25 13:09:22,612][2409373] Sum rewards: 9.734, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.015', 'AMMO2': '0.040', 'WEAPON1': '0.060', 'AMMO3': '0.082', 'AMMO4': '0.201', 'weapon5': '0.206', 'WEAPON4': '0.250', 'HEALTH': '0.280', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'weapon4': '0.444', 'WEAPON3': '0.500', 'HITCOUNT': '0.990', 'weapon2': '1.286', 'weapon3': '1.584', 'DAMAGECOUNT': '3.345', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:09:22,643][2409406] DAMAGECOUNT value on done: 4795.0
[2023-02-25 13:09:22,646][2409406] Sum rewards: 3.498, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.150', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.024', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'weapon5': '0.120', 'AMMO4': '0.120', 'weapon4': '0.336', 'HITCOUNT': '0.370', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'ARMOR': '0.808', 'DAMAGECOUNT': '1.200', 'weapon3': '1.390', 'weapon2': '1.688', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:09:23,096][2409866] Large shaping reward 2.652 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:09:23,447][2409866] DAMAGECOUNT value on done: 5461.0
[2023-02-25 13:09:23,451][2409866] Sum rewards: 5.898, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.806', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.015', 'AMMO4': '0.060', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'weapon5': '0.206', 'weapon4': '0.248', 'WEAPON5': '0.300', 'ARMOR': '0.455', 'HITCOUNT': '0.480', 'WEAPON3': '0.600', 'weapon3': '1.322', 'DAMAGECOUNT': '1.725', 'weapon2': '1.828', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:23,452][2409078] DAMAGECOUNT value on done: 5261.0
[2023-02-25 13:09:23,453][2409078] Sum rewards: 7.347, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.852', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO5': '0.017', 'weapon4': '0.032', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.097', 'weapon5': '0.186', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '0.790', 'weapon2': '1.596', 'weapon3': '1.952', 'DAMAGECOUNT': '3.672', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:23,462][2409096] DAMAGECOUNT value on done: 4529.0
[2023-02-25 13:09:23,463][2409096] Sum rewards: 4.119, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.430', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO3': '0.053', 'weapon5': '0.184', 'WEAPON5': '0.350', 'HITCOUNT': '0.350', 'WEAPON3': '0.350', 'weapon3': '0.742', 'DAMAGECOUNT': '1.158', 'weapon2': '2.062', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:09:23,669][2409407] DAMAGECOUNT value on done: 5659.0
[2023-02-25 13:09:23,670][2409407] Sum rewards: 5.963, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.070', 'AMMO5': '0.014', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon7': '0.050', 'AMMO3': '0.056', 'AMMO4': '0.083', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.394', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.510', 'weapon3': '0.888', 'weapon2': '1.096', 'DAMAGECOUNT': '2.385', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:23,804][2409469] DAMAGECOUNT value on done: 5280.0
[2023-02-25 13:09:23,807][2409469] Sum rewards: 14.793, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.127', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.032', 'AMMO3': '0.091', 'WEAPON4': '0.250', 'weapon4': '0.378', 'WEAPON3': '0.700', 'HITCOUNT': '1.220', 'weapon2': '1.220', 'ARMOR': '1.330', 'weapon3': '1.940', 'DAMAGECOUNT': '4.482', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:09:23,827][2409105] DAMAGECOUNT value on done: 5539.0
[2023-02-25 13:09:23,828][2409105] Sum rewards: 10.573, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.648', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO5': '0.028', 'weapon5': '0.058', 'AMMO4': '0.066', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'weapon4': '0.284', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'HITCOUNT': '0.840', 'ARMOR': '0.899', 'weapon2': '1.356', 'weapon3': '2.006', 'DAMAGECOUNT': '3.528', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:09:23,861][2409486] DAMAGECOUNT value on done: 4789.0
[2023-02-25 13:09:23,862][2409486] Sum rewards: 4.933, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.037', 'AMMO3': '0.060', 'weapon7': '0.140', 'WEAPON5': '0.150', 'HEALTH': '0.184', 'AMMO4': '0.185', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'HITCOUNT': '0.310', 'WEAPON3': '0.350', 'ARMOR': '0.428', 'weapon4': '0.706', 'weapon2': '0.710', 'weapon3': '1.162', 'DAMAGECOUNT': '1.491', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:09:23,946][2409547] DAMAGECOUNT value on done: 3787.0
[2023-02-25 13:09:23,949][2409547] Sum rewards: 8.257, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.362', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO3': '0.067', 'weapon7': '0.124', 'WEAPON4': '0.150', 'AMMO4': '0.184', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.282', 'WEAPON7': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.580', 'weapon4': '0.596', 'weapon2': '1.016', 'weapon3': '1.374', 'DAMAGECOUNT': '2.094', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:24,023][2409104] DAMAGECOUNT value on done: 5753.0
[2023-02-25 13:09:24,024][2409104] Sum rewards: 13.007, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.678', 'AMMO5': '0.007', 'weapon7': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.122', 'AMMO3': '0.124', 'weapon5': '0.132', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.422', 'WEAPON3': '0.900', 'HITCOUNT': '0.930', 'ARMOR': '0.979', 'weapon2': '1.386', 'weapon3': '1.718', 'DAMAGECOUNT': '4.032', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:09:24,230][2409597] DAMAGECOUNT value on done: 5554.0
[2023-02-25 13:09:24,231][2409597] Sum rewards: 2.130, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.560', 'AMMO2': '0.004', 'AMMO5': '0.013', 'AMMO4': '0.022', 'weapon5': '0.034', 'weapon4': '0.076', 'AMMO3': '0.078', 'weapon7': '0.096', 'WEAPON4': '0.150', 'HITCOUNT': '0.220', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'WEAPON7': '0.400', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.885', 'weapon3': '0.946', 'ARMOR': '1.354', 'weapon2': '1.932', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:09:24,259][2409389] DAMAGECOUNT value on done: 5126.0
[2023-02-25 13:09:24,260][2409389] Sum rewards: 6.361, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.120', 'AMMO4': '-0.018', 'AMMO2': '-0.003', 'AMMO5': '0.012', 'weapon4': '0.032', 'WEAPON1': '0.040', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.134', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'HITCOUNT': '0.380', 'WEAPON3': '0.500', 'weapon3': '1.578', 'weapon2': '1.886', 'DAMAGECOUNT': '2.241', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:24,267][2409074] Updated weights for policy 0, policy_version 18691 (0.0012)
[2023-02-25 13:09:24,415][2409565] DAMAGECOUNT value on done: 6731.0
[2023-02-25 13:09:24,415][2409565] Sum rewards: 15.788, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.041', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.116', 'AMMO4': '0.124', 'weapon5': '0.180', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'ARMOR': '0.493', 'weapon2': '0.748', 'WEAPON3': '0.800', 'weapon4': '0.862', 'HITCOUNT': '1.020', 'weapon3': '1.720', 'DAMAGECOUNT': '3.756', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:09:24,655][2409405] DAMAGECOUNT value on done: 4520.0
[2023-02-25 13:09:24,655][2409405] Sum rewards: 3.779, reward structure: {'DEATHCOUNT': '-0.750', 'HEALTH': '-0.314', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'HITCOUNT': '0.050', 'AMMO3': '0.080', 'weapon2': '0.096', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.183', 'WEAPON3': '0.200', 'weapon4': '0.454', 'ARMOR': '0.493', 'FRAGCOUNT': '1.000', 'weapon3': '2.188'}
[2023-02-25 13:09:25,079][2409075] DAMAGECOUNT value on done: 4977.0
[2023-02-25 13:09:25,080][2409075] Sum rewards: 4.505, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.446', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'AMMO3': '0.053', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.356', 'WEAPON3': '0.400', 'HITCOUNT': '0.470', 'weapon3': '0.954', 'weapon2': '1.700', 'DAMAGECOUNT': '1.935', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:09:25,600][2409596] DAMAGECOUNT value on done: 5384.0
[2023-02-25 13:09:25,603][2409596] Sum rewards: 12.253, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.255', 'AMMO5': '0.010', 'AMMO2': '0.026', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.127', 'weapon4': '0.222', 'weapon5': '0.236', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'ARMOR': '0.449', 'HITCOUNT': '0.610', 'weapon3': '1.202', 'weapon2': '1.656', 'DAMAGECOUNT': '2.880', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:09:25,673][2409074] Updated weights for policy 0, policy_version 18701 (0.0013)
[2023-02-25 13:09:25,745][2409076] DAMAGECOUNT value on done: 4064.0
[2023-02-25 13:09:25,746][2409076] Sum rewards: 8.454, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.381', 'AMMO5': '0.020', 'AMMO2': '0.030', 'WEAPON1': '0.030', 'weapon7': '0.052', 'AMMO3': '0.083', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.149', 'weapon5': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.660', 'ARMOR': '0.830', 'weapon4': '1.046', 'weapon3': '1.102', 'weapon2': '1.174', 'DAMAGECOUNT': '3.375', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:25,965][2409355] DAMAGECOUNT value on done: 5417.0
[2023-02-25 13:09:25,966][2409355] Sum rewards: 9.214, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.116', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.027', 'AMMO3': '0.098', 'weapon5': '0.210', 'WEAPON5': '0.350', 'HITCOUNT': '0.590', 'WEAPON3': '0.600', 'ARMOR': '0.800', 'weapon3': '1.562', 'weapon2': '1.736', 'DAMAGECOUNT': '2.577', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:26,036][2409548] DAMAGECOUNT value on done: 4389.0
[2023-02-25 13:09:26,039][2409548] Sum rewards: 6.865, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.038', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'weapon7': '0.112', 'AMMO6': '0.240', 'AMMO7': '0.240', 'HITCOUNT': '0.350', 'WEAPON3': '0.350', 'WEAPON7': '0.400', 'weapon3': '1.142', 'ARMOR': '1.252', 'DAMAGECOUNT': '1.638', 'weapon2': '2.330', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:09:26,233][2409077] DAMAGECOUNT value on done: 4761.0
[2023-02-25 13:09:26,236][2409077] Sum rewards: 3.147, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.736', 'AMMO2': '0.013', 'AMMO5': '0.017', 'weapon7': '0.028', 'WEAPON1': '0.030', 'AMMO4': '0.065', 'AMMO3': '0.119', 'weapon5': '0.146', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.320', 'WEAPON5': '0.400', 'weapon4': '0.420', 'WEAPON3': '0.750', 'weapon2': '1.298', 'ARMOR': '1.360', 'weapon3': '1.512', 'DAMAGECOUNT': '1.635', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:26,260][2409079] DAMAGECOUNT value on done: 5429.0
[2023-02-25 13:09:26,261][2409079] Sum rewards: 8.084, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.812', 'AMMO2': '0.012', 'weapon5': '0.018', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.060', 'AMMO3': '0.111', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.734', 'HITCOUNT': '0.750', 'WEAPON3': '0.800', 'weapon4': '0.834', 'weapon3': '1.682', 'DAMAGECOUNT': '2.805', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:09:26,373][2409373] DAMAGECOUNT value on done: 6739.0
[2023-02-25 13:09:26,374][2409373] Sum rewards: 8.216, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.257', 'AMMO5': '0.015', 'AMMO2': '0.022', 'AMMO3': '0.078', 'AMMO4': '0.111', 'weapon5': '0.140', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '0.550', 'weapon4': '0.582', 'HITCOUNT': '0.670', 'ARMOR': '0.974', 'weapon2': '1.032', 'weapon3': '1.524', 'DAMAGECOUNT': '2.175', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:09:26,384][2409406] DAMAGECOUNT value on done: 5427.0
[2023-02-25 13:09:26,385][2409406] Sum rewards: 6.922, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.422', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO3': '0.048', 'weapon7': '0.050', 'AMMO4': '0.063', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.450', 'weapon2': '0.614', 'weapon3': '0.798', 'weapon4': '0.942', 'DAMAGECOUNT': '1.692', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:09:26,859][2409099] DAMAGECOUNT value on done: 6017.0
[2023-02-25 13:09:26,860][2409099] Sum rewards: 12.407, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.350', 'WEAPON1': '0.010', 'AMMO5': '0.027', 'AMMO2': '0.043', 'AMMO3': '0.141', 'weapon5': '0.186', 'AMMO4': '0.216', 'weapon4': '0.488', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'ARMOR': '0.888', 'WEAPON3': '0.900', 'weapon2': '1.058', 'HITCOUNT': '1.140', 'weapon3': '1.828', 'DAMAGECOUNT': '4.182', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:09:26,880][2409097] DAMAGECOUNT value on done: 4871.0
[2023-02-25 13:09:26,883][2409097] Sum rewards: 2.742, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.780', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO5': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'AMMO4': '0.113', 'weapon5': '0.182', 'weapon4': '0.374', 'ARMOR': '0.444', 'WEAPON5': '0.650', 'HITCOUNT': '0.680', 'WEAPON3': '0.800', 'weapon2': '1.118', 'weapon3': '1.906', 'DAMAGECOUNT': '2.730', 'FRAGCOUNT': '3.500'}
[2023-02-25 13:09:26,999][2409074] Updated weights for policy 0, policy_version 18711 (0.0013)
[2023-02-25 13:09:27,007][2409096] DAMAGECOUNT value on done: 5759.0
[2023-02-25 13:09:27,008][2409096] Sum rewards: 21.532, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.701', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon5': '0.050', 'weapon7': '0.068', 'AMMO4': '0.075', 'AMMO3': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'WEAPON3': '0.500', 'weapon4': '0.718', 'weapon2': '0.796', 'ARMOR': '0.857', 'HITCOUNT': '1.290', 'weapon3': '1.560', 'DAMAGECOUNT': '5.562', 'FRAGCOUNT': '16.000'}
[2023-02-25 13:09:27,186][2408954] Fps is (10 sec: 24985.4, 60 sec: 25053.8, 300 sec: 25020.3). Total num frames: 76640256. Throughput: 0: 6276.5. Samples: 19160652. Policy #0 lag: (min: 1.0, avg: 11.3, max: 25.0)
[2023-02-25 13:09:27,186][2408954] Avg episode reward: [(0, '8.253')]
[2023-02-25 13:09:27,308][2409866] DAMAGECOUNT value on done: 5483.0
[2023-02-25 13:09:27,312][2409866] Sum rewards: 2.973, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.510', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'AMMO5': '0.033', 'AMMO4': '0.136', 'weapon5': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.158', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.356', 'ARMOR': '0.455', 'HITCOUNT': '0.650', 'WEAPON5': '0.700', 'weapon2': '0.850', 'WEAPON3': '0.950', 'weapon3': '2.198', 'DAMAGECOUNT': '2.562', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:27,322][2409469] DAMAGECOUNT value on done: 6300.0
[2023-02-25 13:09:27,323][2409078] DAMAGECOUNT value on done: 4700.0
[2023-02-25 13:09:27,325][2409469] Sum rewards: 8.225, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.290', 'AMMO2': '0.021', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'AMMO3': '0.097', 'AMMO4': '0.105', 'WEAPON4': '0.250', 'weapon5': '0.258', 'weapon4': '0.286', 'ARMOR': '0.449', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'HITCOUNT': '0.750', 'weapon2': '1.238', 'weapon3': '1.650', 'DAMAGECOUNT': '3.408', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:09:27,326][2409078] Sum rewards: -0.502, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.120', 'AMMO5': '0.015', 'weapon7': '0.030', 'AMMO2': '0.034', 'weapon5': '0.090', 'AMMO4': '0.169', 'AMMO3': '0.170', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'HITCOUNT': '0.510', 'weapon4': '0.522', 'ARMOR': '0.910', 'WEAPON3': '1.050', 'weapon2': '1.168', 'FRAGCOUNT': '1.500', 'weapon3': '1.620', 'DAMAGECOUNT': '2.280'}
[2023-02-25 13:09:27,618][2409105] DAMAGECOUNT value on done: 4524.0
[2023-02-25 13:09:27,619][2409105] Sum rewards: 5.635, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.410', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO3': '0.030', 'AMMO4': '0.036', 'weapon7': '0.048', 'weapon5': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'weapon4': '0.396', 'ARMOR': '0.400', 'HITCOUNT': '0.400', 'weapon3': '0.718', 'weapon2': '1.164', 'DAMAGECOUNT': '1.710', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:09:27,649][2409407] DAMAGECOUNT value on done: 5045.0
[2023-02-25 13:09:27,649][2409407] Sum rewards: 4.743, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.563', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.012', 'AMMO3': '0.053', 'AMMO4': '0.057', 'WEAPON5': '0.100', 'weapon7': '0.136', 'WEAPON3': '0.350', 'WEAPON4': '0.400', 'AMMO6': '0.440', 'AMMO7': '0.440', 'HITCOUNT': '0.480', 'WEAPON7': '0.600', 'weapon3': '0.674', 'weapon4': '0.720', 'weapon2': '0.854', 'ARMOR': '0.887', 'DAMAGECOUNT': '2.088', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:09:28,045][2409597] DAMAGECOUNT value on done: 4766.0
[2023-02-25 13:09:28,048][2409597] Sum rewards: 6.053, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.325', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.030', 'AMMO4': '0.059', 'WEAPON4': '0.150', 'weapon5': '0.184', 'WEAPON3': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.380', 'weapon3': '0.508', 'ARMOR': '0.800', 'weapon4': '0.858', 'DAMAGECOUNT': '1.455', 'weapon2': '2.162', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:09:28,311][2409565] DAMAGECOUNT value on done: 5901.0
[2023-02-25 13:09:28,321][2409565] Sum rewards: 19.097, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.331', 'AMMO5': '0.014', 'AMMO2': '0.023', 'weapon5': '0.070', 'weapon7': '0.070', 'AMMO4': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.121', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'weapon4': '0.840', 'weapon2': '0.866', 'HITCOUNT': '1.040', 'weapon3': '1.800', 'DAMAGECOUNT': '4.827', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:09:28,333][2409405] DAMAGECOUNT value on done: 5897.0
[2023-02-25 13:09:28,334][2409405] Sum rewards: 11.779, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.700', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.050', 'weapon7': '0.058', 'AMMO4': '0.059', 'AMMO3': '0.068', 'weapon5': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'weapon4': '0.486', 'HITCOUNT': '0.860', 'weapon2': '1.012', 'weapon3': '1.296', 'DAMAGECOUNT': '3.768', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:09:28,422][2409104] DAMAGECOUNT value on done: 6187.0
[2023-02-25 13:09:28,424][2409104] Sum rewards: 17.608, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.151', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'AMMO3': '0.054', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'weapon7': '0.176', 'WEAPON3': '0.300', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON4': '0.350', 'WEAPON7': '0.500', 'HITCOUNT': '0.680', 'ARMOR': '0.800', 'weapon3': '0.986', 'weapon4': '1.050', 'weapon2': '1.296', 'DAMAGECOUNT': '4.659', 'FRAGCOUNT': '12.500'}
[2023-02-25 13:09:28,542][2409547] DAMAGECOUNT value on done: 5498.0
[2023-02-25 13:09:28,543][2409547] Sum rewards: 1.879, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.518', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO5': '0.023', 'weapon4': '0.084', 'AMMO3': '0.108', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'weapon5': '0.190', 'ARMOR': '0.437', 'WEAPON5': '0.550', 'HITCOUNT': '0.620', 'WEAPON3': '0.800', 'weapon2': '1.382', 'FRAGCOUNT': '1.500', 'weapon3': '1.826', 'DAMAGECOUNT': '2.316'}
[2023-02-25 13:09:28,608][2409486] DAMAGECOUNT value on done: 5782.0
[2023-02-25 13:09:28,613][2409486] Sum rewards: 11.185, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.518', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO4': '0.069', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'weapon4': '0.244', 'weapon5': '0.278', 'ARMOR': '0.462', 'WEAPON5': '0.600', 'HITCOUNT': '0.640', 'WEAPON3': '0.750', 'weapon2': '0.850', 'weapon3': '1.810', 'DAMAGECOUNT': '3.501', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:09:28,809][2409074] Updated weights for policy 0, policy_version 18721 (0.0013)
[2023-02-25 13:09:28,853][2409389] DAMAGECOUNT value on done: 4248.0
[2023-02-25 13:09:28,854][2409389] Sum rewards: 0.050, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.840', 'AMMO5': '0.013', 'WEAPON1': '0.030', 'AMMO2': '0.046', 'AMMO3': '0.080', 'weapon5': '0.168', 'AMMO4': '0.227', 'WEAPON4': '0.250', 'weapon4': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.320', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.212', 'weapon3': '1.420', 'weapon2': '1.974', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:09:29,325][2409075] DAMAGECOUNT value on done: 5521.0
[2023-02-25 13:09:29,329][2409075] Sum rewards: 13.230, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'HEALTH': '0.036', 'weapon7': '0.048', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.067', 'AMMO4': '0.081', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'ARMOR': '0.412', 'weapon4': '0.568', 'HITCOUNT': '0.750', 'weapon3': '1.170', 'weapon2': '1.244', 'DAMAGECOUNT': '3.231', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:09:29,588][2409548] DAMAGECOUNT value on done: 3934.0
[2023-02-25 13:09:29,591][2409548] Sum rewards: 3.267, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.587', 'AMMO5': '0.010', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'weapon7': '0.064', 'weapon5': '0.108', 'AMMO4': '0.110', 'AMMO3': '0.128', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.485', 'weapon4': '0.506', 'HITCOUNT': '0.540', 'WEAPON3': '0.800', 'weapon2': '1.046', 'weapon3': '1.738', 'DAMAGECOUNT': '2.187', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:29,626][2409076] DAMAGECOUNT value on done: 5408.0
[2023-02-25 13:09:29,627][2409076] Sum rewards: 5.918, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.184', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon5': '0.048', 'AMMO4': '0.057', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.670', 'WEAPON3': '0.700', 'HITCOUNT': '0.770', 'weapon2': '1.058', 'weapon3': '1.522', 'DAMAGECOUNT': '2.862', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:29,642][2409596] DAMAGECOUNT value on done: 4947.0
[2023-02-25 13:09:29,643][2409596] Sum rewards: 10.507, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.540', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.101', 'weapon5': '0.154', 'WEAPON5': '0.350', 'ARMOR': '0.456', 'HITCOUNT': '0.670', 'WEAPON3': '0.700', 'weapon2': '1.542', 'weapon3': '2.088', 'DAMAGECOUNT': '2.967', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:09:29,855][2409077] DAMAGECOUNT value on done: 6388.0
[2023-02-25 13:09:29,858][2409077] Sum rewards: 11.894, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.563', 'weapon7': '0.002', 'AMMO2': '0.020', 'AMMO5': '0.028', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'AMMO3': '0.171', 'weapon5': '0.198', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.500', 'weapon4': '0.636', 'HITCOUNT': '0.660', 'weapon2': '0.774', 'WEAPON3': '1.050', 'ARMOR': '1.312', 'weapon3': '1.698', 'DAMAGECOUNT': '4.059', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:09:30,029][2409406] DAMAGECOUNT value on done: 4575.0
[2023-02-25 13:09:30,030][2409406] Sum rewards: 9.382, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.806', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.062', 'weapon7': '0.076', 'WEAPON4': '0.100', 'weapon4': '0.100', 'weapon5': '0.124', 'AMMO3': '0.134', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'HITCOUNT': '0.840', 'ARMOR': '0.890', 'weapon2': '1.208', 'weapon3': '1.960', 'DAMAGECOUNT': '3.129', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:30,044][2409405] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 13:09:30,161][2409079] DAMAGECOUNT value on done: 5067.0
[2023-02-25 13:09:30,161][2409079] Sum rewards: 9.028, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.292', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO3': '0.020', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON3': '0.200', 'ARMOR': '0.400', 'HITCOUNT': '0.430', 'weapon3': '0.460', 'weapon2': '1.490', 'DAMAGECOUNT': '1.494', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:30,243][2409373] DAMAGECOUNT value on done: 4622.0
[2023-02-25 13:09:30,243][2409373] Sum rewards: 2.865, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.292', 'WEAPON1': '0.010', 'AMMO5': '0.027', 'AMMO2': '0.027', 'weapon5': '0.082', 'WEAPON4': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.136', 'weapon4': '0.194', 'WEAPON5': '0.550', 'HITCOUNT': '0.560', 'WEAPON3': '0.650', 'ARMOR': '0.851', 'weapon2': '1.222', 'weapon3': '2.186', 'DAMAGECOUNT': '2.676', 'FRAGCOUNT': '3.500'}
[2023-02-25 13:09:30,250][2409355] DAMAGECOUNT value on done: 4911.0
[2023-02-25 13:09:30,253][2409355] Sum rewards: 5.282, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.580', 'weapon7': '0.010', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO3': '0.093', 'AMMO4': '0.148', 'weapon5': '0.190', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.455', 'WEAPON3': '0.650', 'HITCOUNT': '0.780', 'weapon3': '1.360', 'weapon2': '1.816', 'DAMAGECOUNT': '3.000', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:30,501][2409074] Updated weights for policy 0, policy_version 18731 (0.0012)
[2023-02-25 13:09:30,594][2409097] DAMAGECOUNT value on done: 5624.0
[2023-02-25 13:09:30,598][2409097] Sum rewards: 9.222, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.484', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon7': '0.050', 'AMMO3': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.114', 'weapon5': '0.146', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.550', 'weapon2': '0.954', 'weapon3': '1.152', 'DAMAGECOUNT': '2.325', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:09:30,753][2409096] DAMAGECOUNT value on done: 5033.0
[2023-02-25 13:09:30,754][2409096] Sum rewards: 10.929, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.010', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'weapon4': '0.246', 'weapon5': '0.280', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'HITCOUNT': '0.780', 'ARMOR': '0.856', 'weapon2': '1.028', 'weapon3': '1.890', 'DAMAGECOUNT': '3.480', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:09:31,052][2409469] DAMAGECOUNT value on done: 5459.0
[2023-02-25 13:09:31,055][2409469] Sum rewards: 11.365, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.640', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon7': '0.060', 'AMMO3': '0.105', 'weapon5': '0.184', 'AMMO4': '0.216', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'weapon4': '0.336', 'WEAPON4': '0.350', 'ARMOR': '0.404', 'WEAPON3': '0.600', 'HITCOUNT': '0.660', 'weapon3': '1.376', 'weapon2': '1.494', 'DAMAGECOUNT': '2.625', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:09:31,059][2409099] DAMAGECOUNT value on done: 5353.0
[2023-02-25 13:09:31,062][2409099] Sum rewards: 11.647, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.382', 'AMMO5': '0.005', 'AMMO2': '0.033', 'AMMO3': '0.050', 'weapon5': '0.114', 'AMMO4': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'weapon4': '0.616', 'HITCOUNT': '0.800', 'weapon3': '1.202', 'weapon2': '1.600', 'DAMAGECOUNT': '3.042', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:09:31,114][2409078] DAMAGECOUNT value on done: 4661.0
[2023-02-25 13:09:31,117][2409078] Sum rewards: 8.749, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.981', 'AMMO5': '0.008', 'AMMO2': '0.028', 'AMMO3': '0.089', 'weapon5': '0.104', 'weapon7': '0.110', 'AMMO4': '0.141', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.232', 'WEAPON7': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.550', 'ARMOR': '0.862', 'weapon3': '1.334', 'weapon2': '1.956', 'DAMAGECOUNT': '2.325', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:09:31,287][2409105] DAMAGECOUNT value on done: 6477.0
[2023-02-25 13:09:31,288][2409105] Sum rewards: 21.126, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.280', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'WEAPON4': '0.050', 'weapon7': '0.080', 'AMMO3': '0.087', 'weapon5': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.116', 'weapon4': '0.256', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'HITCOUNT': '1.020', 'weapon2': '1.460', 'weapon3': '1.604', 'DAMAGECOUNT': '5.529', 'FRAGCOUNT': '16.000'}
[2023-02-25 13:09:31,417][2409407] DAMAGECOUNT value on done: 5061.0
[2023-02-25 13:09:31,419][2409407] Sum rewards: 14.018, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.500', 'AMMO5': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO3': '0.064', 'AMMO4': '0.073', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.148', 'weapon5': '0.248', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'HITCOUNT': '0.760', 'weapon3': '1.428', 'weapon2': '1.626', 'DAMAGECOUNT': '3.354', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:09:31,497][2409866] DAMAGECOUNT value on done: 6678.0
[2023-02-25 13:09:31,498][2409866] Sum rewards: 13.834, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.502', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.041', 'AMMO3': '0.064', 'weapon5': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.496', 'HITCOUNT': '0.780', 'weapon3': '1.266', 'weapon2': '1.382', 'DAMAGECOUNT': '4.185', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:09:31,676][2409597] DAMAGECOUNT value on done: 5406.0
[2023-02-25 13:09:31,677][2409597] Sum rewards: 6.568, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.340', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.020', 'AMMO3': '0.064', 'AMMO4': '0.101', 'weapon7': '0.118', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.450', 'weapon2': '0.578', 'HITCOUNT': '0.640', 'weapon4': '1.088', 'weapon3': '1.254', 'DAMAGECOUNT': '2.739', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:09:32,141][2409405] DAMAGECOUNT value on done: 6241.0
[2023-02-25 13:09:32,143][2409405] Sum rewards: 8.429, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.752', 'AMMO5': '0.023', 'AMMO2': '0.054', 'AMMO3': '0.080', 'weapon5': '0.164', 'AMMO4': '0.268', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.766', 'HITCOUNT': '0.900', 'weapon2': '1.144', 'ARMOR': '1.275', 'weapon3': '1.624', 'DAMAGECOUNT': '3.333', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:09:32,182][2409074] Updated weights for policy 0, policy_version 18741 (0.0012)
[2023-02-25 13:09:32,186][2408954] Fps is (10 sec: 24985.7, 60 sec: 24985.6, 300 sec: 24978.7). Total num frames: 76763136. Throughput: 0: 6272.0. Samples: 19198488. Policy #0 lag: (min: 1.0, avg: 11.3, max: 25.0)
[2023-02-25 13:09:32,186][2408954] Avg episode reward: [(0, '8.444')]
[2023-02-25 13:09:32,227][2409104] DAMAGECOUNT value on done: 4763.0
[2023-02-25 13:09:32,228][2409104] Sum rewards: 2.299, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.716', 'AMMO5': '0.013', 'weapon5': '0.016', 'AMMO2': '0.051', 'weapon7': '0.076', 'AMMO3': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.250', 'AMMO4': '0.253', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.650', 'weapon4': '1.066', 'weapon2': '1.094', 'weapon3': '1.344', 'DAMAGECOUNT': '2.406', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:09:32,325][2409547] DAMAGECOUNT value on done: 4641.0
[2023-02-25 13:09:32,325][2409547] Sum rewards: 10.058, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO3': '0.038', 'weapon7': '0.054', 'AMMO4': '0.082', 'weapon5': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'WEAPON3': '0.200', 'HITCOUNT': '0.290', 'HEALTH': '0.316', 'weapon4': '0.382', 'weapon3': '0.514', 'ARMOR': '0.855', 'weapon2': '1.060', 'DAMAGECOUNT': '2.298', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:09:32,463][2409565] DAMAGECOUNT value on done: 5515.0
[2023-02-25 13:09:32,465][2409486] DAMAGECOUNT value on done: 5783.0
[2023-02-25 13:09:32,466][2409486] Sum rewards: 13.700, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.050', 'weapon7': '0.096', 'AMMO4': '0.128', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.252', 'HEALTH': '0.289', 'WEAPON3': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'HITCOUNT': '0.580', 'weapon4': '0.742', 'weapon3': '1.044', 'weapon2': '1.308', 'DAMAGECOUNT': '2.913', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:09:32,466][2409565] Sum rewards: 5.005, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.265', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'AMMO2': '0.042', 'weapon7': '0.068', 'AMMO3': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.164', 'WEAPON7': '0.200', 'AMMO4': '0.210', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'HITCOUNT': '0.580', 'WEAPON3': '0.600', 'weapon2': '0.886', 'weapon4': '0.908', 'weapon3': '1.448', 'DAMAGECOUNT': '2.184', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:32,937][2409389] DAMAGECOUNT value on done: 4705.0
[2023-02-25 13:09:32,940][2409389] Sum rewards: 7.987, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.410', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'weapon5': '0.060', 'weapon4': '0.060', 'AMMO3': '0.075', 'WEAPON5': '0.150', 'WEAPON3': '0.400', 'HITCOUNT': '0.450', 'weapon2': '1.362', 'DAMAGECOUNT': '1.728', 'weapon3': '1.772', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:33,256][2409076] DAMAGECOUNT value on done: 4473.0
[2023-02-25 13:09:33,269][2409076] Sum rewards: 5.479, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.244', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'weapon7': '0.070', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.206', 'HITCOUNT': '0.220', 'weapon4': '0.276', 'WEAPON3': '0.300', 'WEAPON5': '0.300', 'weapon3': '1.028', 'weapon2': '1.262', 'DAMAGECOUNT': '1.440', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:09:33,451][2409075] DAMAGECOUNT value on done: 5438.0
[2023-02-25 13:09:33,452][2409075] Sum rewards: 6.309, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.364', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.045', 'weapon5': '0.064', 'AMMO3': '0.089', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.348', 'WEAPON3': '0.500', 'HITCOUNT': '0.630', 'weapon3': '1.062', 'weapon2': '1.388', 'DAMAGECOUNT': '2.367', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:33,612][2409596] DAMAGECOUNT value on done: 4932.0
[2023-02-25 13:09:33,613][2409596] Sum rewards: 7.052, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.002', 'AMMO4': '0.010', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'weapon5': '0.054', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'HEALTH': '0.138', 'WEAPON5': '0.300', 'weapon4': '0.304', 'WEAPON3': '0.500', 'HITCOUNT': '0.670', 'weapon2': '1.438', 'weapon3': '1.488', 'DAMAGECOUNT': '2.190', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:33,662][2409074] Updated weights for policy 0, policy_version 18751 (0.0012)
[2023-02-25 13:09:33,871][2409355] DAMAGECOUNT value on done: 4151.0
[2023-02-25 13:09:33,872][2409355] Sum rewards: 5.518, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.552', 'AMMO2': '0.005', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.024', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.154', 'HITCOUNT': '0.410', 'weapon4': '0.496', 'WEAPON3': '0.500', 'ARMOR': '0.850', 'weapon3': '1.192', 'DAMAGECOUNT': '1.260', 'weapon2': '1.354', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:09:33,938][2409373] DAMAGECOUNT value on done: 4509.0
[2023-02-25 13:09:33,942][2409373] Sum rewards: 0.998, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.298', 'AMMO2': '0.015', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.073', 'AMMO3': '0.085', 'weapon5': '0.230', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.400', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.500', 'weapon3': '1.404', 'DAMAGECOUNT': '1.887', 'weapon2': '2.166'}
[2023-02-25 13:09:33,976][2409079] DAMAGECOUNT value on done: 6010.0
[2023-02-25 13:09:33,977][2409079] Sum rewards: 7.212, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.502', 'AMMO2': '0.008', 'AMMO5': '0.012', 'AMMO4': '0.041', 'weapon5': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'WEAPON5': '0.300', 'HITCOUNT': '0.580', 'WEAPON3': '0.800', 'weapon4': '0.848', 'ARMOR': '0.905', 'weapon2': '1.204', 'weapon3': '1.474', 'DAMAGECOUNT': '2.262', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:09:34,108][2409077] DAMAGECOUNT value on done: 5781.0
[2023-02-25 13:09:34,109][2409077] Sum rewards: 15.539, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.007', 'AMMO2': '0.035', 'AMMO3': '0.050', 'weapon7': '0.104', 'AMMO4': '0.173', 'weapon5': '0.190', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'HEALTH': '0.270', 'WEAPON7': '0.300', 'WEAPON3': '0.300', 'ARMOR': '0.471', 'HITCOUNT': '0.560', 'weapon4': '0.566', 'weapon2': '1.088', 'weapon3': '1.312', 'DAMAGECOUNT': '2.973', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:09:34,250][2409406] DAMAGECOUNT value on done: 4241.0
[2023-02-25 13:09:34,251][2409406] Sum rewards: 8.071, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.656', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon7': '0.066', 'AMMO3': '0.079', 'weapon5': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.200', 'AMMO4': '0.272', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.630', 'weapon4': '0.816', 'ARMOR': '0.856', 'weapon2': '0.944', 'weapon3': '1.534', 'DAMAGECOUNT': '2.457', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:09:34,272][2409097] DAMAGECOUNT value on done: 4812.0
[2023-02-25 13:09:34,273][2409097] Sum rewards: 8.729, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.066', 'AMMO5': '0.005', 'AMMO2': '0.019', 'ARMOR': '0.040', 'AMMO3': '0.049', 'weapon7': '0.050', 'weapon5': '0.084', 'AMMO4': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.540', 'weapon3': '0.720', 'weapon4': '0.910', 'weapon2': '1.216', 'DAMAGECOUNT': '1.866', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:35,040][2409407] DAMAGECOUNT value on done: 5597.0
[2023-02-25 13:09:35,042][2409407] Sum rewards: 11.806, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.448', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'AMMO3': '0.103', 'AMMO4': '0.177', 'weapon5': '0.178', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.586', 'WEAPON3': '0.700', 'ARMOR': '0.876', 'HITCOUNT': '1.000', 'weapon2': '1.140', 'weapon3': '1.508', 'DAMAGECOUNT': '4.263', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:09:35,062][2409096] DAMAGECOUNT value on done: 4863.0
[2023-02-25 13:09:35,063][2409096] Sum rewards: 4.601, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.010', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'HEALTH': '0.075', 'weapon4': '0.088', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'AMMO4': '0.134', 'weapon5': '0.160', 'WEAPON5': '0.250', 'HITCOUNT': '0.500', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.626', 'weapon2': '1.648', 'weapon3': '1.756', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:35,111][2409099] DAMAGECOUNT value on done: 4204.0
[2023-02-25 13:09:35,111][2409099] Sum rewards: 5.574, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.974', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.039', 'AMMO3': '0.063', 'AMMO4': '0.195', 'weapon5': '0.240', 'weapon4': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '0.350', 'WEAPON5': '0.400', 'HITCOUNT': '0.430', 'weapon3': '1.340', 'ARMOR': '1.383', 'weapon2': '1.770', 'DAMAGECOUNT': '2.370', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:09:35,126][2409078] DAMAGECOUNT value on done: 6216.0
[2023-02-25 13:09:35,127][2409078] Sum rewards: 12.957, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.543', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO5': '0.018', 'AMMO3': '0.052', 'weapon4': '0.130', 'WEAPON4': '0.150', 'weapon5': '0.206', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'HITCOUNT': '0.780', 'ARMOR': '0.905', 'weapon3': '1.334', 'weapon2': '2.076', 'DAMAGECOUNT': '4.032', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:09:35,129][2409866] DAMAGECOUNT value on done: 6421.0
[2023-02-25 13:09:35,129][2409866] Sum rewards: 12.435, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.445', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO5': '0.020', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.069', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.108', 'weapon4': '0.308', 'WEAPON5': '0.450', 'WEAPON3': '0.450', 'HITCOUNT': '0.870', 'weapon3': '1.282', 'weapon2': '1.516', 'DAMAGECOUNT': '3.567', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:09:35,331][2409469] DAMAGECOUNT value on done: 5976.0
[2023-02-25 13:09:35,334][2409469] Sum rewards: 10.845, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.058', 'ARMOR': '0.060', 'AMMO3': '0.070', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.300', 'HEALTH': '0.350', 'weapon4': '0.420', 'HITCOUNT': '0.670', 'weapon2': '1.150', 'weapon3': '1.852', 'DAMAGECOUNT': '2.604', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:35,430][2409074] Updated weights for policy 0, policy_version 18761 (0.0012)
[2023-02-25 13:09:35,482][2409105] DAMAGECOUNT value on done: 4950.0
[2023-02-25 13:09:35,483][2409105] Sum rewards: 9.201, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.410', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'weapon7': '0.046', 'AMMO3': '0.055', 'AMMO4': '0.156', 'weapon5': '0.166', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.450', 'weapon4': '0.620', 'ARMOR': '0.800', 'weapon2': '0.998', 'weapon3': '1.028', 'DAMAGECOUNT': '2.778', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:09:36,101][2409547] DAMAGECOUNT value on done: 5737.0
[2023-02-25 13:09:36,104][2409547] Sum rewards: 4.817, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.376', 'AMMO5': '0.015', 'AMMO2': '0.040', 'ARMOR': '0.052', 'weapon5': '0.066', 'weapon7': '0.090', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.125', 'weapon4': '0.170', 'AMMO4': '0.199', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.470', 'WEAPON3': '0.700', 'weapon2': '1.210', 'weapon3': '1.744', 'DAMAGECOUNT': '2.112', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:09:36,237][2409405] DAMAGECOUNT value on done: 3644.0
[2023-02-25 13:09:36,240][2409405] Sum rewards: 6.449, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.275', 'AMMO5': '0.008', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.030', 'weapon7': '0.056', 'AMMO4': '0.095', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.170', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.306', 'HITCOUNT': '0.370', 'weapon3': '0.730', 'weapon2': '1.414', 'DAMAGECOUNT': '1.815', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:36,314][2409104] DAMAGECOUNT value on done: 6339.0
[2023-02-25 13:09:36,315][2409104] Sum rewards: 13.416, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.896', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO3': '0.066', 'weapon5': '0.206', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.700', 'weapon3': '1.350', 'weapon2': '1.968', 'DAMAGECOUNT': '2.880', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:09:36,658][2409486] DAMAGECOUNT value on done: 5156.0
[2023-02-25 13:09:36,661][2409486] Sum rewards: 11.121, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.650', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'weapon7': '0.068', 'AMMO3': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'weapon4': '0.534', 'WEAPON3': '0.550', 'HITCOUNT': '0.740', 'weapon2': '1.214', 'weapon3': '1.464', 'DAMAGECOUNT': '3.675', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:09:37,005][2409076] DAMAGECOUNT value on done: 5099.0
[2023-02-25 13:09:37,006][2409076] Sum rewards: 9.246, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.888', 'AMMO2': '0.017', 'AMMO5': '0.018', 'AMMO3': '0.076', 'AMMO4': '0.086', 'weapon7': '0.116', 'weapon5': '0.116', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON7': '0.400', 'ARMOR': '0.456', 'weapon4': '0.578', 'WEAPON3': '0.600', 'HITCOUNT': '0.790', 'weapon2': '1.026', 'weapon3': '1.438', 'DAMAGECOUNT': '2.886', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:09:37,056][2409389] DAMAGECOUNT value on done: 5146.0
[2023-02-25 13:09:37,057][2409389] Sum rewards: 7.336, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.416', 'weapon7': '0.002', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.018', 'AMMO4': '0.054', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'weapon5': '0.194', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.450', 'weapon4': '0.546', 'HITCOUNT': '0.560', 'WEAPON3': '0.650', 'ARMOR': '0.825', 'weapon2': '1.274', 'weapon3': '1.300', 'DAMAGECOUNT': '2.007', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:09:37,073][2409074] Updated weights for policy 0, policy_version 18771 (0.0012)
[2023-02-25 13:09:37,186][2408954] Fps is (10 sec: 24985.1, 60 sec: 25190.3, 300 sec: 25006.4). Total num frames: 76890112. Throughput: 0: 6269.8. Samples: 19216836. Policy #0 lag: (min: 1.0, avg: 13.4, max: 25.0)
[2023-02-25 13:09:37,186][2408954] Avg episode reward: [(0, '8.403')]
[2023-02-25 13:09:37,400][2409596] DAMAGECOUNT value on done: 5102.0
[2023-02-25 13:09:37,404][2409596] Sum rewards: 9.834, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.040', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.020', 'weapon7': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.097', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.126', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'ARMOR': '0.482', 'HITCOUNT': '0.610', 'weapon4': '0.844', 'weapon2': '0.906', 'weapon3': '1.168', 'DAMAGECOUNT': '3.333', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:09:37,432][2409355] DAMAGECOUNT value on done: 5264.0
[2023-02-25 13:09:37,434][2409355] Sum rewards: 5.547, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.017', 'AMMO2': '0.026', 'AMMO3': '0.070', 'AMMO4': '0.131', 'weapon5': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'HEALTH': '0.354', 'WEAPON3': '0.450', 'weapon4': '0.674', 'HITCOUNT': '0.690', 'ARMOR': '0.828', 'weapon3': '1.322', 'weapon2': '1.510', 'DAMAGECOUNT': '2.676', 'FRAGCOUNT': '3.500'}
[2023-02-25 13:09:37,556][2409373] DAMAGECOUNT value on done: 4478.0
[2023-02-25 13:09:37,557][2409373] Sum rewards: 10.606, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.112', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.039', 'weapon7': '0.064', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.140', 'AMMO4': '0.193', 'weapon5': '0.214', 'WEAPON4': '0.350', 'weapon4': '0.438', 'WEAPON5': '0.450', 'HITCOUNT': '0.740', 'WEAPON3': '0.900', 'weapon2': '1.088', 'weapon3': '1.786', 'DAMAGECOUNT': '3.483', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:09:37,588][2409079] DAMAGECOUNT value on done: 5002.0
[2023-02-25 13:09:37,588][2409079] Sum rewards: 6.430, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.935', 'AMMO5': '0.010', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'AMMO3': '0.060', 'weapon7': '0.098', 'AMMO4': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.160', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'weapon4': '0.594', 'weapon2': '0.600', 'weapon3': '1.458', 'DAMAGECOUNT': '2.223', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:09:37,695][2409075] DAMAGECOUNT value on done: 5019.0
[2023-02-25 13:09:37,698][2409075] Sum rewards: 6.421, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.197', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO3': '0.104', 'weapon5': '0.174', 'WEAPON5': '0.350', 'HITCOUNT': '0.660', 'WEAPON3': '0.800', 'ARMOR': '0.945', 'weapon3': '1.470', 'weapon2': '2.188', 'DAMAGECOUNT': '2.436', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:09:37,759][2409080] Large shaping reward 2.626 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.594, 198.0), ('weapon7', 0.002)]
[2023-02-25 13:09:37,976][2409097] DAMAGECOUNT value on done: 4587.0
[2023-02-25 13:09:37,977][2409097] Sum rewards: 3.429, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.988', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'AMMO3': '0.057', 'weapon5': '0.058', 'WEAPON5': '0.100', 'HITCOUNT': '0.240', 'weapon4': '0.366', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.080', 'weapon3': '1.092', 'weapon2': '1.218', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:09:38,000][2409077] DAMAGECOUNT value on done: 5935.0
[2023-02-25 13:09:38,001][2409077] Sum rewards: 8.412, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.256', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.039', 'WEAPON1': '0.060', 'AMMO3': '0.104', 'WEAPON4': '0.150', 'weapon7': '0.182', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'weapon5': '0.228', 'weapon4': '0.244', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'HITCOUNT': '0.710', 'ARMOR': '0.900', 'weapon2': '1.094', 'weapon3': '1.716', 'DAMAGECOUNT': '2.568', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:09:38,193][2409406] DAMAGECOUNT value on done: 5004.0
[2023-02-25 13:09:38,194][2409406] Sum rewards: 5.050, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.900', 'AMMO2': '0.004', 'AMMO5': '0.012', 'AMMO4': '0.017', 'AMMO3': '0.060', 'weapon7': '0.138', 'weapon5': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO6': '0.280', 'AMMO7': '0.280', 'WEAPON7': '0.400', 'ARMOR': '0.450', 'WEAPON3': '0.450', 'HITCOUNT': '0.560', 'weapon4': '0.648', 'weapon2': '1.026', 'weapon3': '1.328', 'DAMAGECOUNT': '2.457', 'FRAGCOUNT': '2.500'}
[2023-02-25 13:09:38,442][2409074] Updated weights for policy 0, policy_version 18781 (0.0012)
[2023-02-25 13:09:38,610][2409407] DAMAGECOUNT value on done: 5113.0
[2023-02-25 13:09:38,611][2409407] Sum rewards: 3.815, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.610', 'AMMO5': '0.003', 'AMMO3': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.078', 'weapon7': '0.098', 'WEAPON3': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.140', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon3': '0.278', 'WEAPON7': '0.400', 'weapon4': '0.612', 'ARMOR': '0.840', 'DAMAGECOUNT': '0.978', 'weapon2': '1.048', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:09:38,674][2409866] DAMAGECOUNT value on done: 5422.0
[2023-02-25 13:09:38,677][2409866] Sum rewards: 8.436, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.970', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'weapon4': '0.110', 'weapon5': '0.182', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'HITCOUNT': '0.770', 'weapon2': '1.526', 'weapon3': '1.848', 'DAMAGECOUNT': '2.808', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:09:38,778][2409096] DAMAGECOUNT value on done: 6144.0
[2023-02-25 13:09:38,781][2409096] Sum rewards: 6.657, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.760', 'AMMO2': '0.010', 'AMMO5': '0.024', 'WEAPON1': '0.030', 'AMMO4': '0.049', 'weapon7': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.135', 'weapon5': '0.188', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.328', 'HITCOUNT': '0.440', 'ARMOR': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'weapon2': '0.942', 'weapon3': '1.820', 'DAMAGECOUNT': '2.862', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:09:38,896][2409078] DAMAGECOUNT value on done: 5086.0
[2023-02-25 13:09:38,899][2409078] Sum rewards: 12.118, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.410', 'AMMO5': '0.009', 'AMMO2': '0.028', 'AMMO3': '0.074', 'weapon7': '0.124', 'AMMO4': '0.138', 'weapon5': '0.178', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon2': '0.326', 'WEAPON4': '0.550', 'WEAPON3': '0.550', 'HITCOUNT': '0.870', 'weapon3': '1.308', 'weapon4': '1.350', 'DAMAGECOUNT': '3.333', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:09:38,967][2409099] DAMAGECOUNT value on done: 5792.0
[2023-02-25 13:09:38,967][2409099] Sum rewards: 8.380, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.511', 'AMMO2': '0.011', 'AMMO5': '0.013', 'AMMO3': '0.048', 'AMMO4': '0.057', 'weapon5': '0.106', 'weapon7': '0.106', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.400', 'weapon4': '0.460', 'weapon3': '0.730', 'weapon2': '1.570', 'DAMAGECOUNT': '2.700', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:39,045][2409469] DAMAGECOUNT value on done: 4769.0
[2023-02-25 13:09:39,046][2409469] Sum rewards: 3.782, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.282', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.106', 'weapon5': '0.116', 'AMMO3': '0.123', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.290', 'WEAPON3': '0.700', 'weapon4': '0.706', 'weapon2': '0.774', 'ARMOR': '0.893', 'DAMAGECOUNT': '1.323', 'weapon3': '1.536', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:39,171][2409105] DAMAGECOUNT value on done: 4538.0
[2023-02-25 13:09:39,172][2409105] Sum rewards: -1.164, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.465', 'AMMO5': '0.013', 'AMMO2': '0.031', 'WEAPON1': '0.040', 'weapon7': '0.064', 'AMMO3': '0.073', 'AMMO4': '0.153', 'weapon5': '0.164', 'HITCOUNT': '0.260', 'WEAPON4': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON5': '0.400', 'WEAPON7': '0.400', 'ARMOR': '0.457', 'weapon4': '0.484', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.768', 'weapon3': '1.090', 'weapon2': '1.714', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:09:40,007][2409547] DAMAGECOUNT value on done: 6414.0
[2023-02-25 13:09:40,008][2409547] Sum rewards: 11.611, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.081', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'weapon7': '0.072', 'AMMO3': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.194', 'weapon4': '0.240', 'WEAPON5': '0.400', 'ARMOR': '0.440', 'WEAPON3': '0.550', 'HITCOUNT': '0.900', 'weapon2': '1.500', 'weapon3': '1.796', 'DAMAGECOUNT': '3.573', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:09:40,086][2409405] DAMAGECOUNT value on done: 4796.0
[2023-02-25 13:09:40,087][2409405] Sum rewards: 13.766, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.118', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO3': '0.030', 'AMMO4': '0.046', 'weapon5': '0.094', 'weapon7': '0.102', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON3': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HITCOUNT': '0.330', 'weapon4': '0.482', 'weapon3': '0.616', 'ARMOR': '0.847', 'weapon2': '1.176', 'DAMAGECOUNT': '2.907', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:09:40,162][2409074] Updated weights for policy 0, policy_version 18791 (0.0012)
[2023-02-25 13:09:40,188][2409104] DAMAGECOUNT value on done: 4791.0
[2023-02-25 13:09:40,189][2409104] Sum rewards: 7.095, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '0.000', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.042', 'AMMO3': '0.060', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.170', 'WEAPON3': '0.350', 'HITCOUNT': '0.690', 'ARMOR': '0.900', 'weapon3': '1.240', 'weapon2': '1.954', 'DAMAGECOUNT': '2.199', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:09:40,638][2409486] DAMAGECOUNT value on done: 4965.0
[2023-02-25 13:09:40,641][2409486] Sum rewards: 5.354, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.435', 'AMMO2': '0.013', 'AMMO3': '0.030', 'AMMO4': '0.063', 'weapon7': '0.144', 'HITCOUNT': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON3': '0.250', 'WEAPON7': '0.300', 'weapon2': '0.308', 'weapon3': '0.536', 'weapon4': '0.962', 'DAMAGECOUNT': '1.293', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:09:41,115][2409076] DAMAGECOUNT value on done: 6003.0
[2023-02-25 13:09:41,119][2409076] Sum rewards: 9.336, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.557', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon7': '0.054', 'AMMO3': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.144', 'AMMO4': '0.153', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'HITCOUNT': '0.450', 'WEAPON3': '0.550', 'weapon4': '0.708', 'ARMOR': '1.257', 'weapon2': '1.302', 'weapon3': '1.318', 'DAMAGECOUNT': '2.721', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:09:41,274][2409596] DAMAGECOUNT value on done: 5650.0
[2023-02-25 13:09:41,275][2409389] DAMAGECOUNT value on done: 5225.0
[2023-02-25 13:09:41,275][2409355] DAMAGECOUNT value on done: 5971.0
[2023-02-25 13:09:41,278][2409389] Sum rewards: 6.995, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.600', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon4': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.055', 'weapon7': '0.058', 'weapon5': '0.116', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.460', 'ARMOR': '0.500', 'weapon3': '1.104', 'DAMAGECOUNT': '1.800', 'weapon2': '2.522', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:09:41,275][2409596] Sum rewards: 2.838, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.238', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.042', 'AMMO3': '0.072', 'weapon4': '0.154', 'weapon5': '0.176', 'AMMO4': '0.210', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'HITCOUNT': '0.390', 'WEAPON3': '0.400', 'ARMOR': '0.408', 'weapon3': '0.978', 'DAMAGECOUNT': '1.794', 'weapon2': '2.068', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:09:41,278][2409355] Sum rewards: 10.930, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.340', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.050', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'weapon5': '0.110', 'weapon4': '0.114', 'AMMO3': '0.118', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'HITCOUNT': '0.870', 'weapon2': '1.384', 'weapon3': '2.048', 'DAMAGECOUNT': '3.636', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:09:41,393][2409079] DAMAGECOUNT value on done: 5127.0
[2023-02-25 13:09:41,393][2409079] Sum rewards: 7.575, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.064', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO3': '0.070', 'AMMO4': '0.099', 'weapon5': '0.114', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.400', 'HITCOUNT': '0.560', 'weapon4': '0.638', 'weapon2': '1.118', 'ARMOR': '1.136', 'weapon3': '1.258', 'DAMAGECOUNT': '1.866', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:41,650][2409373] DAMAGECOUNT value on done: 5757.0
[2023-02-25 13:09:41,653][2409373] Sum rewards: 13.618, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.213', 'AMMO5': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.125', 'weapon5': '0.230', 'WEAPON4': '0.300', 'weapon4': '0.352', 'WEAPON5': '0.550', 'ARMOR': '0.883', 'WEAPON3': '0.950', 'weapon2': '1.060', 'HITCOUNT': '1.190', 'weapon3': '2.066', 'DAMAGECOUNT': '4.980', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:09:41,810][2409075] DAMAGECOUNT value on done: 4415.0
[2023-02-25 13:09:41,813][2409075] Sum rewards: 4.220, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.195', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO5': '0.019', 'weapon7': '0.052', 'AMMO3': '0.073', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.178', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.450', 'HITCOUNT': '0.490', 'WEAPON3': '0.550', 'weapon4': '0.584', 'weapon2': '0.976', 'weapon3': '1.412', 'DAMAGECOUNT': '1.971', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:09:41,944][2409074] Updated weights for policy 0, policy_version 18801 (0.0013)
[2023-02-25 13:09:42,035][2409077] DAMAGECOUNT value on done: 6131.0
[2023-02-25 13:09:42,039][2409077] Sum rewards: 15.948, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.369', 'AMMO2': '0.003', 'AMMO5': '0.015', 'AMMO4': '0.017', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'weapon4': '0.154', 'weapon5': '0.238', 'WEAPON5': '0.450', 'WEAPON3': '0.450', 'HITCOUNT': '0.670', 'ARMOR': '0.931', 'weapon2': '1.460', 'weapon3': '1.664', 'DAMAGECOUNT': '3.375', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:09:42,133][2409097] DAMAGECOUNT value on done: 3956.0
[2023-02-25 13:09:42,136][2409097] Sum rewards: 7.208, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.567', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.030', 'weapon7': '0.052', 'AMMO4': '0.073', 'weapon5': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'ARMOR': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.380', 'weapon2': '0.536', 'weapon3': '0.832', 'weapon4': '0.948', 'DAMAGECOUNT': '1.869', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:09:42,186][2408954] Fps is (10 sec: 24985.6, 60 sec: 25258.7, 300 sec: 24992.5). Total num frames: 77012992. Throughput: 0: 6270.1. Samples: 19254804. Policy #0 lag: (min: 1.0, avg: 13.4, max: 25.0)
[2023-02-25 13:09:42,186][2408954] Avg episode reward: [(0, '8.371')]
[2023-02-25 13:09:42,192][2409406] DAMAGECOUNT value on done: 5580.0
[2023-02-25 13:09:42,194][2409406] Sum rewards: 8.837, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.875', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.017', 'weapon7': '0.048', 'AMMO3': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.236', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.420', 'WEAPON3': '0.450', 'weapon4': '0.598', 'weapon2': '0.846', 'weapon3': '1.696', 'DAMAGECOUNT': '3.174', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:42,398][2409407] DAMAGECOUNT value on done: 5018.0
[2023-02-25 13:09:42,400][2409407] Sum rewards: 7.914, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.656', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO4': '0.025', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.274', 'WEAPON5': '0.300', 'weapon4': '0.330', 'WEAPON3': '0.400', 'ARMOR': '0.468', 'HITCOUNT': '0.570', 'weapon2': '0.668', 'weapon3': '1.026', 'DAMAGECOUNT': '2.319', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:42,734][2409078] DAMAGECOUNT value on done: 6210.0
[2023-02-25 13:09:42,735][2409078] Sum rewards: 9.295, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.078', 'weapon7': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.036', 'weapon5': '0.096', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.114', 'AMMO4': '0.179', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.752', 'WEAPON3': '0.800', 'ARMOR': '0.849', 'HITCOUNT': '0.980', 'weapon2': '1.124', 'weapon3': '1.676', 'DAMAGECOUNT': '4.287', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:09:42,783][2409866] DAMAGECOUNT value on done: 5453.0
[2023-02-25 13:09:42,784][2409866] Sum rewards: 10.689, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.554', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.022', 'weapon5': '0.060', 'AMMO3': '0.061', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.214', 'WEAPON3': '0.500', 'HITCOUNT': '0.640', 'ARMOR': '1.062', 'weapon3': '1.442', 'weapon2': '2.114', 'DAMAGECOUNT': '2.616', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:42,815][2409105] DAMAGECOUNT value on done: 6229.0
[2023-02-25 13:09:42,817][2409096] DAMAGECOUNT value on done: 4418.0
[2023-02-25 13:09:42,818][2409105] Sum rewards: 3.922, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'AMMO5': '0.035', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.128', 'weapon4': '0.130', 'weapon5': '0.320', 'HEALTH': '0.572', 'HITCOUNT': '0.590', 'WEAPON5': '0.650', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'weapon2': '0.822', 'weapon3': '2.260', 'DAMAGECOUNT': '3.159', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:09:42,820][2409096] Sum rewards: 4.347, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.365', 'AMMO5': '0.003', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.025', 'AMMO3': '0.033', 'weapon7': '0.048', 'WEAPON5': '0.050', 'weapon5': '0.072', 'HITCOUNT': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'DAMAGECOUNT': '0.420', 'ARMOR': '0.456', 'weapon3': '0.676', 'weapon2': '1.634', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:09:43,137][2409469] DAMAGECOUNT value on done: 6236.0
[2023-02-25 13:09:43,140][2409469] Sum rewards: 11.778, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.100', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO3': '0.064', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'weapon5': '0.166', 'WEAPON5': '0.200', 'WEAPON3': '0.400', 'weapon4': '0.432', 'HITCOUNT': '0.790', 'weapon3': '1.186', 'weapon2': '1.800', 'DAMAGECOUNT': '3.126', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:09:43,221][2409099] DAMAGECOUNT value on done: 5155.0
[2023-02-25 13:09:43,222][2409099] Sum rewards: 5.206, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.634', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'weapon7': '0.050', 'AMMO2': '0.054', 'AMMO3': '0.079', 'weapon5': '0.146', 'AMMO4': '0.271', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON5': '0.500', 'HITCOUNT': '0.540', 'WEAPON4': '0.550', 'WEAPON3': '0.550', 'weapon4': '0.844', 'ARMOR': '0.931', 'weapon2': '1.134', 'weapon3': '1.452', 'DAMAGECOUNT': '2.406', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:09:43,597][2409074] Updated weights for policy 0, policy_version 18811 (0.0012)
[2023-02-25 13:09:43,685][2409405] DAMAGECOUNT value on done: 5532.0
[2023-02-25 13:09:43,686][2409405] Sum rewards: 2.268, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.130', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon7': '0.076', 'AMMO3': '0.086', 'weapon5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.125', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.416', 'WEAPON3': '0.550', 'HITCOUNT': '0.570', 'weapon2': '1.094', 'weapon3': '1.390', 'DAMAGECOUNT': '1.743', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:09:44,076][2409547] DAMAGECOUNT value on done: 4100.0
[2023-02-25 13:09:44,079][2409547] Sum rewards: 4.199, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.439', 'AMMO5': '0.005', 'AMMO3': '0.010', 'AMMO2': '0.032', 'WEAPON3': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.132', 'weapon7': '0.138', 'AMMO4': '0.162', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HITCOUNT': '0.220', 'weapon3': '0.230', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'weapon4': '0.558', 'ARMOR': '0.856', 'weapon2': '1.070', 'DAMAGECOUNT': '1.584', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:09:44,143][2409104] DAMAGECOUNT value on done: 6787.0
[2023-02-25 13:09:44,146][2409104] Sum rewards: 15.894, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.511', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'weapon7': '0.048', 'AMMO4': '0.052', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.124', 'WEAPON7': '0.200', 'weapon5': '0.202', 'WEAPON4': '0.300', 'weapon4': '0.470', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'weapon2': '1.088', 'HITCOUNT': '1.110', 'weapon3': '1.734', 'DAMAGECOUNT': '4.383', 'FRAGCOUNT': '13.500'}
[2023-02-25 13:09:44,543][2409486] DAMAGECOUNT value on done: 4929.0
[2023-02-25 13:09:44,546][2409486] Sum rewards: 4.077, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.712', 'AMMO5': '0.011', 'AMMO2': '0.016', 'AMMO4': '0.081', 'AMMO3': '0.086', 'WEAPON5': '0.200', 'weapon5': '0.288', 'WEAPON4': '0.300', 'HITCOUNT': '0.530', 'WEAPON3': '0.650', 'weapon4': '0.684', 'ARMOR': '0.913', 'weapon2': '1.100', 'weapon3': '1.598', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.331'}
[2023-02-25 13:09:45,110][2409074] Updated weights for policy 0, policy_version 18821 (0.0012)
[2023-02-25 13:09:45,110][2409079] DAMAGECOUNT value on done: 5738.0
[2023-02-25 13:09:45,124][2409079] Sum rewards: 5.483, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.384', 'AMMO5': '0.005', 'AMMO3': '0.030', 'AMMO2': '0.034', 'ARMOR': '0.052', 'weapon5': '0.066', 'weapon7': '0.132', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'WEAPON3': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'HITCOUNT': '0.370', 'weapon2': '0.728', 'weapon3': '0.738', 'weapon4': '0.826', 'DAMAGECOUNT': '1.776', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:09:45,174][2409076] DAMAGECOUNT value on done: 4846.0
[2023-02-25 13:09:45,178][2409076] Sum rewards: 9.453, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.314', 'AMMO5': '0.013', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'weapon5': '0.066', 'AMMO4': '0.084', 'AMMO3': '0.088', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.314', 'WEAPON3': '0.550', 'HITCOUNT': '0.800', 'weapon2': '1.156', 'weapon3': '1.554', 'DAMAGECOUNT': '3.105', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:45,306][2409355] DAMAGECOUNT value on done: 4219.0
[2023-02-25 13:09:45,314][2409355] Sum rewards: 1.241, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.318', 'AMMO3': '0.020', 'AMMO2': '0.024', 'ARMOR': '0.036', 'WEAPON3': '0.100', 'AMMO4': '0.122', 'weapon7': '0.148', 'HITCOUNT': '0.180', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon2': '0.240', 'WEAPON4': '0.400', 'WEAPON7': '0.400', 'DAMAGECOUNT': '0.537', 'weapon3': '0.558', 'FRAGCOUNT': '1.000', 'weapon4': '1.064'}
[2023-02-25 13:09:45,448][2409389] DAMAGECOUNT value on done: 6335.0
[2023-02-25 13:09:45,450][2409389] Sum rewards: 10.236, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.392', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'weapon4': '0.072', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'weapon5': '0.148', 'AMMO4': '0.158', 'WEAPON5': '0.350', 'ARMOR': '0.487', 'WEAPON3': '0.550', 'HITCOUNT': '0.640', 'weapon3': '1.686', 'weapon2': '1.820', 'DAMAGECOUNT': '2.448', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:09:45,684][2409373] DAMAGECOUNT value on done: 4730.0
[2023-02-25 13:09:45,688][2409373] Sum rewards: 10.487, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.297', 'AMMO5': '0.005', 'AMMO2': '0.023', 'ARMOR': '0.032', 'AMMO3': '0.060', 'weapon7': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO4': '0.116', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'weapon2': '0.536', 'weapon4': '0.598', 'HITCOUNT': '0.770', 'weapon3': '0.994', 'DAMAGECOUNT': '3.657', 'FRAGCOUNT': '6.500'}
[2023-02-25 13:09:45,781][2409077] DAMAGECOUNT value on done: 4726.0
[2023-02-25 13:09:45,785][2409077] Sum rewards: 12.673, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.642', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon5': '0.034', 'AMMO3': '0.071', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.338', 'WEAPON3': '0.450', 'ARMOR': '0.800', 'HITCOUNT': '0.830', 'weapon3': '1.190', 'weapon2': '1.576', 'DAMAGECOUNT': '3.300', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:09:45,923][2409406] DAMAGECOUNT value on done: 5028.0
[2023-02-25 13:09:45,924][2409406] Sum rewards: 8.931, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.366', 'AMMO2': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.027', 'weapon7': '0.046', 'AMMO3': '0.059', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.162', 'WEAPON7': '0.200', 'weapon5': '0.214', 'WEAPON5': '0.300', 'HITCOUNT': '0.300', 'WEAPON3': '0.350', 'ARMOR': '0.800', 'weapon3': '0.838', 'DAMAGECOUNT': '1.995', 'weapon2': '2.380', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:46,059][2409075] DAMAGECOUNT value on done: 5437.0
[2023-02-25 13:09:46,060][2409075] Sum rewards: 7.828, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.053', 'AMMO2': '0.021', 'AMMO5': '0.024', 'AMMO4': '0.104', 'AMMO3': '0.112', 'weapon5': '0.268', 'WEAPON4': '0.350', 'HITCOUNT': '0.550', 'WEAPON5': '0.600', 'weapon4': '0.628', 'WEAPON3': '0.700', 'weapon2': '0.890', 'ARMOR': '0.950', 'weapon3': '1.760', 'DAMAGECOUNT': '3.174', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:09:46,175][2409097] DAMAGECOUNT value on done: 5665.0
[2023-02-25 13:09:46,179][2409097] Sum rewards: 15.095, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.308', 'AMMO2': '0.009', 'AMMO5': '0.013', 'AMMO4': '0.044', 'AMMO3': '0.060', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.200', 'weapon5': '0.242', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'ARMOR': '0.476', 'weapon4': '0.634', 'HITCOUNT': '0.770', 'weapon2': '1.028', 'weapon3': '1.330', 'DAMAGECOUNT': '3.747', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:09:46,391][2409407] DAMAGECOUNT value on done: 4052.0
[2023-02-25 13:09:46,394][2409407] Sum rewards: 3.682, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.490', 'AMMO5': '0.009', 'AMMO2': '0.018', 'weapon7': '0.046', 'AMMO3': '0.050', 'weapon5': '0.068', 'AMMO4': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'HITCOUNT': '0.330', 'WEAPON3': '0.400', 'weapon4': '0.434', 'weapon3': '1.118', 'weapon2': '1.262', 'DAMAGECOUNT': '1.644', 'FRAGCOUNT': '2.500'}
[2023-02-25 13:09:46,647][2409078] DAMAGECOUNT value on done: 4484.0
[2023-02-25 13:09:46,647][2409078] Sum rewards: 5.630, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.894', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.017', 'WEAPON1': '0.050', 'AMMO3': '0.076', 'weapon5': '0.222', 'HITCOUNT': '0.320', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon3': '1.556', 'DAMAGECOUNT': '1.776', 'weapon2': '1.920', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:09:46,739][2409866] DAMAGECOUNT value on done: 5920.0
[2023-02-25 13:09:46,743][2409866] Sum rewards: 12.071, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.719', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'weapon5': '0.108', 'WEAPON5': '0.250', 'weapon4': '0.280', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'ARMOR': '0.907', 'weapon2': '1.332', 'weapon3': '1.562', 'DAMAGECOUNT': '3.240', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:09:46,892][2409099] DAMAGECOUNT value on done: 6555.0
[2023-02-25 13:09:46,894][2409099] Sum rewards: 13.136, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.056', 'weapon7': '0.056', 'AMMO4': '0.101', 'weapon5': '0.166', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'HEALTH': '0.254', 'WEAPON3': '0.350', 'weapon4': '0.442', 'HITCOUNT': '0.730', 'weapon3': '1.094', 'ARMOR': '1.200', 'weapon2': '1.708', 'DAMAGECOUNT': '3.048', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:09:46,904][2409096] DAMAGECOUNT value on done: 4327.0
[2023-02-25 13:09:46,905][2409096] Sum rewards: 7.689, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.836', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'AMMO3': '0.062', 'weapon5': '0.084', 'AMMO4': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon7': '0.234', 'weapon4': '0.306', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON3': '0.400', 'ARMOR': '0.459', 'HITCOUNT': '0.470', 'WEAPON7': '0.500', 'weapon3': '0.812', 'weapon2': '1.166', 'DAMAGECOUNT': '2.004', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:47,113][2409074] Updated weights for policy 0, policy_version 18831 (0.0012)
[2023-02-25 13:09:47,186][2408954] Fps is (10 sec: 24576.6, 60 sec: 24917.4, 300 sec: 24950.9). Total num frames: 77135872. Throughput: 0: 6272.0. Samples: 19292592. Policy #0 lag: (min: 0.0, avg: 10.7, max: 25.0)
[2023-02-25 13:09:47,186][2408954] Avg episode reward: [(0, '8.373')]
[2023-02-25 13:09:47,229][2409469] DAMAGECOUNT value on done: 4784.0
[2023-02-25 13:09:47,230][2409469] Sum rewards: 5.722, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.128', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO3': '0.055', 'weapon7': '0.056', 'AMMO4': '0.081', 'weapon5': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.350', 'HITCOUNT': '0.370', 'weapon3': '1.294', 'ARMOR': '1.354', 'DAMAGECOUNT': '1.530', 'weapon2': '1.742', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:09:47,574][2409405] DAMAGECOUNT value on done: 5621.0
[2023-02-25 13:09:47,575][2409405] Sum rewards: 11.183, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.480', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon7': '0.058', 'AMMO3': '0.089', 'weapon5': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.151', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.650', 'weapon4': '0.732', 'weapon2': '0.886', 'ARMOR': '0.931', 'HITCOUNT': '1.290', 'weapon3': '1.714', 'DAMAGECOUNT': '5.037', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:09:47,850][2409104] DAMAGECOUNT value on done: 3987.0
[2023-02-25 13:09:47,851][2409104] Sum rewards: 6.652, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.460', 'AMMO2': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.022', 'AMMO3': '0.075', 'weapon5': '0.128', 'WEAPON5': '0.150', 'HITCOUNT': '0.370', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.416', 'weapon2': '1.570', 'weapon3': '1.662', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:48,359][2409486] DAMAGECOUNT value on done: 4947.0
[2023-02-25 13:09:48,362][2409486] Sum rewards: 4.640, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.388', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'weapon7': '0.052', 'weapon5': '0.056', 'AMMO3': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.101', 'WEAPON4': '0.250', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'weapon4': '0.680', 'weapon2': '1.058', 'weapon3': '1.104', 'DAMAGECOUNT': '1.758', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:09:48,449][2409074] Updated weights for policy 0, policy_version 18841 (0.0013)
[2023-02-25 13:09:48,486][2409547] DAMAGECOUNT value on done: 5787.0
[2023-02-25 13:09:48,487][2409547] Sum rewards: 12.807, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.510', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.026', 'WEAPON1': '0.040', 'AMMO3': '0.062', 'weapon7': '0.076', 'WEAPON4': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon4': '0.312', 'weapon5': '0.340', 'HITCOUNT': '0.460', 'WEAPON5': '0.550', 'WEAPON3': '0.550', 'weapon2': '1.370', 'ARMOR': '1.422', 'weapon3': '1.514', 'DAMAGECOUNT': '3.489', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:09:48,994][2409076] DAMAGECOUNT value on done: 5503.0
[2023-02-25 13:09:48,998][2409076] Sum rewards: 11.595, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.169', 'AMMO2': '0.014', 'AMMO5': '0.017', 'AMMO4': '0.072', 'AMMO3': '0.091', 'weapon5': '0.122', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.456', 'WEAPON3': '0.650', 'HITCOUNT': '0.880', 'weapon2': '1.534', 'weapon3': '1.662', 'DAMAGECOUNT': '3.915', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:09:49,146][2409079] DAMAGECOUNT value on done: 5663.0
[2023-02-25 13:09:49,148][2409079] Sum rewards: 14.291, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.032', 'AMMO5': '0.013', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon5': '0.046', 'weapon7': '0.050', 'AMMO4': '0.081', 'AMMO3': '0.085', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.250', 'weapon4': '0.494', 'WEAPON3': '0.550', 'ARMOR': '0.841', 'HITCOUNT': '1.030', 'weapon2': '1.270', 'weapon3': '1.650', 'DAMAGECOUNT': '3.777', 'FRAGCOUNT': '10.500'}
[2023-02-25 13:09:49,420][2409355] DAMAGECOUNT value on done: 5564.0
[2023-02-25 13:09:49,421][2409355] Sum rewards: 6.172, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.208', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO3': '0.060', 'weapon7': '0.070', 'AMMO4': '0.091', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.122', 'WEAPON4': '0.150', 'weapon5': '0.152', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.350', 'ARMOR': '0.800', 'weapon3': '1.056', 'weapon2': '1.294', 'DAMAGECOUNT': '2.217', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:49,444][2409389] DAMAGECOUNT value on done: 5072.0
[2023-02-25 13:09:49,447][2409389] Sum rewards: 18.154, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.324', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO3': '0.078', 'AMMO4': '0.129', 'weapon5': '0.162', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.730', 'weapon4': '0.812', 'weapon3': '1.276', 'weapon2': '1.316', 'DAMAGECOUNT': '3.189', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:09:49,602][2409373] DAMAGECOUNT value on done: 5344.0
[2023-02-25 13:09:49,603][2409373] Sum rewards: 11.878, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.586', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'AMMO3': '0.064', 'AMMO4': '0.078', 'WEAPON4': '0.200', 'weapon4': '0.222', 'weapon5': '0.224', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'ARMOR': '0.453', 'HITCOUNT': '0.610', 'weapon3': '1.260', 'weapon2': '1.750', 'DAMAGECOUNT': '2.847', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:09:50,040][2409075] DAMAGECOUNT value on done: 4575.0
[2023-02-25 13:09:50,041][2409075] Sum rewards: 4.668, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.710', 'AMMO5': '0.009', 'AMMO2': '0.014', 'weapon7': '0.032', 'WEAPON1': '0.040', 'AMMO3': '0.060', 'AMMO4': '0.070', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon5': '0.180', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.456', 'ARMOR': '0.484', 'WEAPON3': '0.550', 'HITCOUNT': '0.550', 'weapon2': '1.514', 'weapon3': '1.524', 'DAMAGECOUNT': '1.725', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:09:50,124][2409097] DAMAGECOUNT value on done: 5058.0
[2023-02-25 13:09:50,127][2409097] Sum rewards: 9.716, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.160', 'AMMO2': '0.010', 'AMMO5': '0.015', 'weapon5': '0.022', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'AMMO3': '0.138', 'weapon4': '0.242', 'WEAPON5': '0.300', 'WEAPON3': '0.850', 'HITCOUNT': '1.030', 'weapon2': '1.686', 'weapon3': '1.802', 'DAMAGECOUNT': '3.882', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:09:50,152][2409074] Updated weights for policy 0, policy_version 18851 (0.0012)
[2023-02-25 13:09:50,256][2409078] DAMAGECOUNT value on done: 4356.0
[2023-02-25 13:09:50,257][2409078] Sum rewards: 4.608, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.872', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.030', 'AMMO3': '0.068', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'WEAPON4': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.580', 'weapon4': '0.720', 'weapon2': '1.098', 'weapon3': '1.150', 'DAMAGECOUNT': '2.367', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:50,973][2409096] DAMAGECOUNT value on done: 4079.0
[2023-02-25 13:09:50,978][2409096] Sum rewards: 9.998, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.498', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.047', 'weapon7': '0.074', 'AMMO3': '0.075', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.448', 'HITCOUNT': '0.520', 'WEAPON3': '0.550', 'weapon4': '0.588', 'weapon3': '1.078', 'weapon2': '1.298', 'DAMAGECOUNT': '2.715', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:09:51,097][2409099] DAMAGECOUNT value on done: 4153.0
[2023-02-25 13:09:51,101][2409099] Sum rewards: 3.143, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.850', 'AMMO5': '0.016', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'AMMO3': '0.054', 'weapon7': '0.066', 'weapon5': '0.098', 'AMMO4': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.210', 'weapon2': '0.238', 'weapon4': '0.318', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'weapon3': '0.664', 'DAMAGECOUNT': '0.834', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:09:51,223][2409469] DAMAGECOUNT value on done: 4003.0
[2023-02-25 13:09:51,226][2409469] Sum rewards: 4.642, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.861', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'AMMO5': '0.038', 'AMMO4': '0.102', 'AMMO3': '0.120', 'WEAPON4': '0.200', 'weapon5': '0.200', 'weapon4': '0.268', 'HITCOUNT': '0.580', 'WEAPON5': '0.700', 'WEAPON3': '0.850', 'ARMOR': '1.052', 'weapon2': '1.088', 'weapon3': '1.546', 'DAMAGECOUNT': '1.719', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:09:51,674][2409074] Updated weights for policy 0, policy_version 18861 (0.0012)
[2023-02-25 13:09:52,139][2409104] DAMAGECOUNT value on done: 4219.0
[2023-02-25 13:09:52,140][2409104] Sum rewards: 6.063, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.848', 'AMMO5': '0.012', 'AMMO2': '0.015', 'ARMOR': '0.036', 'WEAPON1': '0.040', 'AMMO4': '0.076', 'AMMO3': '0.081', 'weapon5': '0.102', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.450', 'WEAPON3': '0.550', 'weapon2': '0.964', 'weapon4': '0.988', 'weapon3': '1.646', 'DAMAGECOUNT': '1.650', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:52,186][2408954] Fps is (10 sec: 25395.0, 60 sec: 24985.6, 300 sec: 24950.9). Total num frames: 77266944. Throughput: 0: 6272.5. Samples: 19311012. Policy #0 lag: (min: 0.0, avg: 10.7, max: 25.0)
[2023-02-25 13:09:52,186][2408954] Avg episode reward: [(0, '8.188')]
[2023-02-25 13:09:52,190][2409547] DAMAGECOUNT value on done: 5237.0
[2023-02-25 13:09:52,191][2409547] Sum rewards: 9.801, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.236', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO3': '0.054', 'AMMO4': '0.056', 'weapon7': '0.120', 'weapon5': '0.168', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.454', 'weapon4': '0.518', 'HITCOUNT': '0.650', 'weapon3': '1.142', 'weapon2': '1.302', 'DAMAGECOUNT': '2.364', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:09:52,338][2409486] DAMAGECOUNT value on done: 6041.0
[2023-02-25 13:09:52,339][2409486] Sum rewards: 13.818, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.513', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'WEAPON4': '0.050', 'weapon7': '0.070', 'weapon4': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.236', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'ARMOR': '0.459', 'HITCOUNT': '0.630', 'weapon3': '0.996', 'weapon2': '2.114', 'DAMAGECOUNT': '2.667', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:09:52,986][2409074] Updated weights for policy 0, policy_version 18871 (0.0013)
[2023-02-25 13:09:53,058][2409389] DAMAGECOUNT value on done: 4859.0
[2023-02-25 13:09:53,061][2409389] Sum rewards: 7.150, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.194', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.070', 'AMMO3': '0.107', 'weapon5': '0.334', 'AMMO4': '0.349', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'HITCOUNT': '0.670', 'weapon4': '0.696', 'WEAPON3': '0.700', 'ARMOR': '0.804', 'weapon2': '0.948', 'weapon3': '1.702', 'DAMAGECOUNT': '3.624', 'FRAGCOUNT': '6.500'}
[2023-02-25 13:09:53,189][2409076] DAMAGECOUNT value on done: 5789.0
[2023-02-25 13:09:53,190][2409076] Sum rewards: 5.215, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.986', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.032', 'weapon7': '0.066', 'weapon5': '0.074', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.620', 'weapon4': '0.756', 'weapon2': '1.086', 'weapon3': '1.286', 'ARMOR': '1.357', 'DAMAGECOUNT': '2.145', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:09:53,683][2409075] DAMAGECOUNT value on done: 5292.0
[2023-02-25 13:09:53,684][2409075] Sum rewards: 14.259, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.499', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.094', 'weapon5': '0.110', 'weapon7': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.500', 'weapon4': '0.578', 'weapon2': '0.680', 'HITCOUNT': '0.720', 'ARMOR': '0.853', 'weapon3': '1.734', 'DAMAGECOUNT': '3.399', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:09:53,776][2409097] DAMAGECOUNT value on done: 5523.0
[2023-02-25 13:09:53,777][2409097] Sum rewards: 6.612, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.189', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.057', 'AMMO3': '0.081', 'weapon5': '0.102', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.278', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'weapon2': '1.558', 'weapon3': '1.626', 'DAMAGECOUNT': '2.337', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:53,851][2409079] DAMAGECOUNT value on done: 4593.0
[2023-02-25 13:09:53,852][2409079] Sum rewards: 0.896, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.369', 'AMMO4': '-0.055', 'AMMO2': '-0.011', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.089', 'weapon5': '0.138', 'HITCOUNT': '0.270', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'ARMOR': '0.853', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.176', 'weapon3': '1.758', 'weapon2': '1.912'}
[2023-02-25 13:09:53,887][2409078] DAMAGECOUNT value on done: 5266.0
[2023-02-25 13:09:53,890][2409078] Sum rewards: 8.431, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.298', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.063', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.112', 'WEAPON5': '0.200', 'weapon4': '0.346', 'WEAPON3': '0.400', 'ARMOR': '0.436', 'HITCOUNT': '0.490', 'weapon2': '1.318', 'weapon3': '1.468', 'DAMAGECOUNT': '2.145', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:54,735][2409096] DAMAGECOUNT value on done: 6076.0
[2023-02-25 13:09:54,736][2409096] Sum rewards: 9.522, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.003', 'AMMO2': '0.016', 'AMMO3': '0.040', 'WEAPON5': '0.050', 'weapon7': '0.066', 'weapon5': '0.078', 'AMMO4': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON3': '0.250', 'HEALTH': '0.390', 'HITCOUNT': '0.540', 'weapon4': '0.700', 'weapon2': '0.716', 'weapon3': '0.962', 'DAMAGECOUNT': '2.229', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:54,872][2409099] DAMAGECOUNT value on done: 5565.0
[2023-02-25 13:09:54,873][2409099] Sum rewards: 7.971, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.837', 'AMMO2': '0.024', 'AMMO5': '0.027', 'WEAPON1': '0.030', 'AMMO4': '0.121', 'AMMO3': '0.162', 'weapon5': '0.194', 'WEAPON4': '0.200', 'weapon4': '0.296', 'WEAPON5': '0.600', 'ARMOR': '0.907', 'HITCOUNT': '0.940', 'WEAPON3': '1.000', 'weapon2': '1.024', 'weapon3': '2.172', 'DAMAGECOUNT': '4.110', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:09:55,022][2409469] DAMAGECOUNT value on done: 6041.0
[2023-02-25 13:09:55,023][2409469] Sum rewards: 9.959, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.246', 'AMMO2': '0.013', 'AMMO5': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.076', 'weapon4': '0.226', 'weapon5': '0.234', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'ARMOR': '0.500', 'HITCOUNT': '0.710', 'weapon2': '0.960', 'weapon3': '1.542', 'DAMAGECOUNT': '2.316', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:09:55,129][2409074] Updated weights for policy 0, policy_version 18881 (0.0012)
[2023-02-25 13:09:56,103][2409547] DAMAGECOUNT value on done: 4726.0
[2023-02-25 13:09:56,105][2409547] Sum rewards: 9.386, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.104', 'AMMO5': '0.003', 'AMMO2': '0.018', 'ARMOR': '0.044', 'weapon5': '0.070', 'AMMO3': '0.085', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.416', 'WEAPON3': '0.500', 'HITCOUNT': '0.640', 'weapon2': '1.394', 'weapon3': '1.478', 'DAMAGECOUNT': '2.052', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:09:56,159][2409486] DAMAGECOUNT value on done: 5169.0
[2023-02-25 13:09:56,163][2409486] Sum rewards: 5.986, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.946', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.015', 'AMMO3': '0.034', 'weapon7': '0.052', 'weapon5': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.300', 'weapon4': '0.364', 'weapon3': '0.454', 'ARMOR': '0.455', 'weapon2': '0.612', 'DAMAGECOUNT': '1.422', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:56,294][2409074] Updated weights for policy 0, policy_version 18891 (0.0012)
[2023-02-25 13:09:56,899][2409389] DAMAGECOUNT value on done: 4662.0
[2023-02-25 13:09:56,901][2409389] Sum rewards: 9.701, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.828', 'AMMO5': '0.018', 'AMMO2': '0.020', 'weapon5': '0.026', 'AMMO4': '0.097', 'AMMO3': '0.143', 'weapon7': '0.162', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'ARMOR': '0.449', 'weapon4': '0.608', 'WEAPON3': '0.800', 'weapon2': '0.894', 'HITCOUNT': '0.950', 'weapon3': '1.828', 'DAMAGECOUNT': '3.594', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:09:57,186][2408954] Fps is (10 sec: 26624.1, 60 sec: 25326.9, 300 sec: 25020.7). Total num frames: 77402112. Throughput: 0: 6282.7. Samples: 19349280. Policy #0 lag: (min: 0.0, avg: 10.7, max: 25.0)
[2023-02-25 13:09:57,186][2408954] Avg episode reward: [(0, '8.275')]
[2023-02-25 13:09:57,359][2409076] DAMAGECOUNT value on done: 4938.0
[2023-02-25 13:09:57,362][2409076] Sum rewards: 7.441, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.060', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.040', 'AMMO3': '0.042', 'weapon5': '0.056', 'AMMO4': '0.064', 'weapon7': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.274', 'WEAPON3': '0.400', 'HITCOUNT': '0.470', 'weapon3': '0.934', 'weapon2': '1.758', 'DAMAGECOUNT': '2.172', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:57,622][2409075] DAMAGECOUNT value on done: 6184.0
[2023-02-25 13:09:57,625][2409075] Sum rewards: 10.291, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.894', 'AMMO2': '0.017', 'AMMO5': '0.019', 'AMMO4': '0.084', 'AMMO3': '0.114', 'weapon5': '0.204', 'WEAPON5': '0.400', 'HITCOUNT': '0.730', 'WEAPON3': '0.750', 'weapon2': '1.382', 'weapon3': '1.962', 'DAMAGECOUNT': '3.273', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:09:57,715][2409078] DAMAGECOUNT value on done: 5244.0
[2023-02-25 13:09:57,716][2409078] Sum rewards: 10.153, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.479', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.015', 'AMMO3': '0.063', 'weapon7': '0.076', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.336', 'WEAPON3': '0.450', 'ARMOR': '0.456', 'HITCOUNT': '0.730', 'weapon3': '1.198', 'weapon2': '1.380', 'DAMAGECOUNT': '2.730', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:09:57,910][2409097] DAMAGECOUNT value on done: 5427.0
[2023-02-25 13:09:57,914][2409097] Sum rewards: 11.088, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.996', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'weapon5': '0.056', 'AMMO3': '0.109', 'AMMO4': '0.145', 'weapon7': '0.184', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'ARMOR': '0.428', 'weapon2': '0.510', 'HITCOUNT': '0.560', 'WEAPON3': '0.700', 'weapon4': '1.098', 'weapon3': '1.486', 'DAMAGECOUNT': '3.159', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:09:58,121][2409079] DAMAGECOUNT value on done: 6397.0
[2023-02-25 13:09:58,124][2409079] Sum rewards: 15.269, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.251', 'AMMO5': '0.017', 'AMMO2': '0.026', 'weapon7': '0.048', 'AMMO3': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.130', 'weapon5': '0.198', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'ARMOR': '0.453', 'WEAPON3': '0.500', 'weapon2': '0.730', 'weapon4': '0.774', 'HITCOUNT': '1.050', 'weapon3': '1.368', 'DAMAGECOUNT': '4.419', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:09:58,504][2409074] Updated weights for policy 0, policy_version 18901 (0.0012)
[2023-02-25 13:09:58,753][2409096] DAMAGECOUNT value on done: 4654.0
[2023-02-25 13:09:58,757][2409096] Sum rewards: 8.589, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.070', 'AMMO5': '0.005', 'weapon5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon7': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.126', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.500', 'weapon4': '0.622', 'weapon2': '0.732', 'WEAPON3': '0.800', 'HITCOUNT': '0.970', 'weapon3': '1.726', 'DAMAGECOUNT': '3.426', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:09:58,954][2409469] DAMAGECOUNT value on done: 5060.0
[2023-02-25 13:09:58,957][2409469] Sum rewards: 9.865, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.098', 'AMMO5': '0.015', 'AMMO2': '0.041', 'WEAPON4': '0.050', 'weapon7': '0.068', 'AMMO3': '0.073', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.203', 'weapon5': '0.220', 'weapon4': '0.310', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.610', 'ARMOR': '0.800', 'weapon2': '1.418', 'weapon3': '1.688', 'DAMAGECOUNT': '2.517', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:09:59,259][2409099] DAMAGECOUNT value on done: 5472.0
[2023-02-25 13:09:59,264][2409099] Sum rewards: 5.443, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.209', 'AMMO2': '0.017', 'AMMO5': '0.017', 'AMMO3': '0.062', 'AMMO4': '0.086', 'weapon5': '0.202', 'WEAPON4': '0.250', 'weapon4': '0.394', 'HITCOUNT': '0.480', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'ARMOR': '0.848', 'weapon3': '1.504', 'weapon2': '1.652', 'DAMAGECOUNT': '1.839', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:09:59,779][2409074] Updated weights for policy 0, policy_version 18911 (0.0012)
[2023-02-25 13:10:00,149][2409547] DAMAGECOUNT value on done: 4891.0
[2023-02-25 13:10:00,151][2409547] Sum rewards: 9.827, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.240', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon7': '0.052', 'AMMO3': '0.060', 'AMMO4': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.450', 'WEAPON3': '0.450', 'weapon4': '0.600', 'ARMOR': '0.916', 'weapon3': '1.414', 'weapon2': '1.550', 'DAMAGECOUNT': '2.055', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:10:00,630][2409486] DAMAGECOUNT value on done: 4871.0
[2023-02-25 13:10:00,631][2409486] Sum rewards: 5.895, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.952', 'AMMO2': '0.013', 'AMMO5': '0.032', 'weapon4': '0.040', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'weapon5': '0.204', 'HITCOUNT': '0.670', 'WEAPON5': '0.700', 'WEAPON3': '0.850', 'weapon3': '1.582', 'ARMOR': '1.712', 'weapon2': '1.834', 'DAMAGECOUNT': '3.420', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:10:00,959][2409074] Updated weights for policy 0, policy_version 18921 (0.0012)
[2023-02-25 13:10:01,219][2409076] DAMAGECOUNT value on done: 5457.0
[2023-02-25 13:10:01,223][2409076] Sum rewards: 9.787, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.427', 'AMMO2': '0.001', 'AMMO4': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'weapon5': '0.022', 'AMMO3': '0.103', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.270', 'ARMOR': '0.487', 'WEAPON3': '0.800', 'HITCOUNT': '0.950', 'weapon2': '1.640', 'weapon3': '1.884', 'DAMAGECOUNT': '3.630', 'FRAGCOUNT': '8.500'}
[2023-02-25 13:10:01,409][2409078] DAMAGECOUNT value on done: 5069.0
[2023-02-25 13:10:01,418][2409078] Sum rewards: 5.707, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.078', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.046', 'AMMO3': '0.093', 'weapon7': '0.138', 'AMMO4': '0.165', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '0.500', 'HITCOUNT': '0.570', 'weapon4': '0.764', 'weapon2': '0.814', 'weapon3': '1.442', 'DAMAGECOUNT': '2.820', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:10:01,473][2409080] DAMAGECOUNT value on done: 6433.0
[2023-02-25 13:10:01,474][2409080] Sum rewards: 10.182, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.490', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon7': '0.054', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.156', 'weapon5': '0.160', 'AMMO4': '0.199', 'WEAPON5': '0.400', 'weapon4': '0.452', 'WEAPON4': '0.550', 'HITCOUNT': '0.860', 'WEAPON3': '0.950', 'weapon2': '1.086', 'ARMOR': '1.402', 'weapon3': '1.810', 'DAMAGECOUNT': '3.477', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:10:01,537][2409097] DAMAGECOUNT value on done: 4908.0
[2023-02-25 13:10:01,539][2409097] Sum rewards: 7.930, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.640', 'AMMO2': '0.015', 'AMMO5': '0.020', 'AMMO4': '0.076', 'AMMO3': '0.079', 'weapon4': '0.082', 'WEAPON4': '0.100', 'weapon5': '0.130', 'WEAPON5': '0.500', 'HITCOUNT': '0.540', 'WEAPON3': '0.650', 'ARMOR': '0.922', 'weapon3': '1.570', 'weapon2': '1.616', 'DAMAGECOUNT': '2.019', 'FRAGCOUNT': '6.500'}
[2023-02-25 13:10:01,936][2409075] DAMAGECOUNT value on done: 4985.0
[2023-02-25 13:10:01,941][2409075] Sum rewards: 2.602, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.160', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon5': '0.028', 'weapon7': '0.050', 'AMMO3': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'HITCOUNT': '0.270', 'weapon4': '0.448', 'WEAPON3': '0.450', 'ARMOR': '0.453', 'DAMAGECOUNT': '0.780', 'weapon2': '0.970', 'weapon3': '1.028', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:10:02,186][2408954] Fps is (10 sec: 24985.9, 60 sec: 25190.4, 300 sec: 24950.9). Total num frames: 77516800. Throughput: 0: 6277.1. Samples: 19386828. Policy #0 lag: (min: 1.0, avg: 14.1, max: 27.0)
[2023-02-25 13:10:02,186][2408954] Avg episode reward: [(0, '8.210')]
[2023-02-25 13:10:02,374][2409096] DAMAGECOUNT value on done: 5425.0
[2023-02-25 13:10:02,374][2409096] Sum rewards: 7.515, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'HEALTH': '0.019', 'AMMO3': '0.050', 'AMMO4': '0.092', 'weapon7': '0.094', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'ARMOR': '0.448', 'HITCOUNT': '0.480', 'weapon4': '0.986', 'weapon2': '1.124', 'weapon3': '1.246', 'DAMAGECOUNT': '1.554', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:10:02,693][2409469] DAMAGECOUNT value on done: 4730.0
[2023-02-25 13:10:02,694][2409469] Sum rewards: 4.305, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.890', 'AMMO5': '0.017', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'AMMO3': '0.087', 'AMMO4': '0.123', 'weapon4': '0.162', 'weapon5': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'HITCOUNT': '0.470', 'WEAPON3': '0.600', 'weapon2': '1.400', 'weapon3': '1.722', 'DAMAGECOUNT': '2.280', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:10:02,894][2409079] DAMAGECOUNT value on done: 6319.0
[2023-02-25 13:10:02,895][2409079] Sum rewards: 21.594, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.838', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.008', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'weapon4': '0.150', 'weapon5': '0.190', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '1.250', 'weapon2': '1.438', 'weapon3': '1.714', 'DAMAGECOUNT': '5.541', 'FRAGCOUNT': '16.000'}
[2023-02-25 13:10:03,273][2409074] Updated weights for policy 0, policy_version 18931 (0.0012)
[2023-02-25 13:10:03,427][2409099] DAMAGECOUNT value on done: 5168.0
[2023-02-25 13:10:03,430][2409099] Sum rewards: 13.491, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.960', 'AMMO5': '0.017', 'AMMO2': '0.030', 'weapon7': '0.052', 'AMMO3': '0.069', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.147', 'weapon5': '0.174', 'WEAPON4': '0.250', 'weapon4': '0.286', 'WEAPON5': '0.450', 'ARMOR': '0.453', 'WEAPON3': '0.500', 'HITCOUNT': '0.550', 'weapon3': '1.224', 'weapon2': '2.022', 'DAMAGECOUNT': '3.177', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:10:04,059][2409547] DAMAGECOUNT value on done: 6324.0
[2023-02-25 13:10:04,060][2409547] Sum rewards: 6.133, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.457', 'AMMO5': '0.028', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'weapon7': '0.040', 'AMMO3': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.141', 'WEAPON4': '0.250', 'weapon5': '0.278', 'weapon4': '0.478', 'WEAPON5': '0.500', 'HITCOUNT': '0.600', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'weapon2': '0.888', 'weapon3': '1.350', 'DAMAGECOUNT': '2.370', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:10:04,438][2409074] Updated weights for policy 0, policy_version 18941 (0.0012)
[2023-02-25 13:10:04,683][2409486] DAMAGECOUNT value on done: 3496.0
[2023-02-25 13:10:04,684][2409486] Sum rewards: 2.307, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.762', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'ARMOR': '0.032', 'AMMO3': '0.043', 'weapon7': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.136', 'weapon5': '0.194', 'WEAPON4': '0.250', 'HITCOUNT': '0.250', 'WEAPON3': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.414', 'weapon4': '0.576', 'weapon3': '0.726', 'DAMAGECOUNT': '0.930', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:10:04,873][2409076] DAMAGECOUNT value on done: 4478.0
[2023-02-25 13:10:04,876][2409076] Sum rewards: 3.204, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.050', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.020', 'ARMOR': '0.036', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.125', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.234', 'weapon4': '0.296', 'HITCOUNT': '0.460', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'weapon2': '1.182', 'weapon3': '1.878', 'DAMAGECOUNT': '1.983', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:10:05,169][2409078] DAMAGECOUNT value on done: 5072.0
[2023-02-25 13:10:05,169][2409078] Sum rewards: 4.980, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.955', 'AMMO5': '0.017', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'weapon5': '0.054', 'AMMO3': '0.083', 'weapon7': '0.118', 'AMMO4': '0.128', 'WEAPON4': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'HITCOUNT': '0.460', 'WEAPON3': '0.500', 'weapon4': '0.726', 'weapon3': '1.328', 'weapon2': '1.364', 'DAMAGECOUNT': '1.461', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:10:05,541][2409080] DAMAGECOUNT value on done: 3854.0
[2023-02-25 13:10:05,543][2409080] Sum rewards: 2.152, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.778', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.005', 'weapon5': '0.046', 'weapon7': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.290', 'WEAPON3': '0.550', 'weapon3': '0.554', 'ARMOR': '0.826', 'DAMAGECOUNT': '0.870', 'weapon2': '1.792', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:10:05,754][2409075] DAMAGECOUNT value on done: 5138.0
[2023-02-25 13:10:05,756][2409075] Sum rewards: 7.940, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.489', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.058', 'AMMO3': '0.083', 'WEAPON4': '0.150', 'weapon5': '0.212', 'WEAPON5': '0.350', 'HITCOUNT': '0.460', 'weapon4': '0.466', 'WEAPON3': '0.550', 'ARMOR': '0.844', 'weapon2': '1.280', 'weapon3': '1.290', 'DAMAGECOUNT': '2.142', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:10:06,521][2409074] Updated weights for policy 0, policy_version 18951 (0.0013)
[2023-02-25 13:10:06,654][2409096] DAMAGECOUNT value on done: 4803.0
[2023-02-25 13:10:06,654][2409096] Sum rewards: 6.074, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.603', 'AMMO5': '0.016', 'AMMO2': '0.031', 'weapon7': '0.048', 'AMMO3': '0.115', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'weapon5': '0.218', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.418', 'ARMOR': '0.488', 'HITCOUNT': '0.530', 'WEAPON3': '0.700', 'weapon2': '0.966', 'weapon3': '1.756', 'DAMAGECOUNT': '2.037', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:10:06,816][2409469] DAMAGECOUNT value on done: 4690.0
[2023-02-25 13:10:06,817][2409469] Sum rewards: 10.087, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.080', 'AMMO5': '0.015', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'AMMO4': '0.118', 'weapon4': '0.120', 'AMMO3': '0.134', 'weapon5': '0.272', 'WEAPON4': '0.300', 'ARMOR': '0.445', 'WEAPON5': '0.450', 'WEAPON3': '0.900', 'HITCOUNT': '0.980', 'weapon2': '1.366', 'weapon3': '1.858', 'DAMAGECOUNT': '4.155', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:10:07,186][2408954] Fps is (10 sec: 24166.3, 60 sec: 24917.3, 300 sec: 24950.9). Total num frames: 77643776. Throughput: 0: 6273.6. Samples: 19405236. Policy #0 lag: (min: 1.0, avg: 14.1, max: 27.0)
[2023-02-25 13:10:07,186][2408954] Avg episode reward: [(0, '8.240')]
[2023-02-25 13:10:07,202][2409099] DAMAGECOUNT value on done: 4327.0
[2023-02-25 13:10:07,203][2409099] Sum rewards: 7.740, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.380', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.030', 'AMMO4': '0.039', 'AMMO3': '0.040', 'weapon7': '0.084', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.226', 'weapon4': '0.246', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'HITCOUNT': '0.370', 'ARMOR': '0.400', 'weapon3': '1.018', 'weapon2': '1.586', 'DAMAGECOUNT': '1.725', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:10:07,288][2409079] DAMAGECOUNT value on done: 6443.0
[2023-02-25 13:10:07,292][2409079] Sum rewards: 15.180, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.730', 'AMMO5': '0.019', 'AMMO2': '0.024', 'AMMO3': '0.072', 'AMMO4': '0.118', 'WEAPON4': '0.250', 'weapon5': '0.300', 'ARMOR': '0.400', 'weapon4': '0.440', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '0.960', 'weapon2': '1.316', 'weapon3': '1.640', 'DAMAGECOUNT': '4.371', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:10:07,676][2409547] DAMAGECOUNT value on done: 4233.0
[2023-02-25 13:10:07,679][2409547] Sum rewards: 1.218, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.188', 'AMMO2': '0.010', 'AMMO5': '0.012', 'weapon7': '0.048', 'AMMO4': '0.048', 'AMMO3': '0.067', 'weapon5': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'ARMOR': '0.400', 'HITCOUNT': '0.420', 'weapon3': '0.610', 'weapon4': '0.966', 'FRAGCOUNT': '1.500', 'weapon2': '1.632', 'DAMAGECOUNT': '1.836'}
[2023-02-25 13:10:07,896][2409074] Updated weights for policy 0, policy_version 18961 (0.0012)
[2023-02-25 13:10:08,271][2409373] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 13:10:08,559][2409486] DAMAGECOUNT value on done: 6010.0
[2023-02-25 13:10:08,562][2409486] Sum rewards: 2.493, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.623', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'weapon5': '0.018', 'AMMO2': '0.034', 'AMMO3': '0.078', 'WEAPON5': '0.150', 'AMMO4': '0.172', 'weapon4': '0.312', 'WEAPON4': '0.350', 'WEAPON3': '0.500', 'HITCOUNT': '0.680', 'weapon3': '1.364', 'weapon2': '1.954', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.235'}
[2023-02-25 13:10:08,631][2409076] DAMAGECOUNT value on done: 4691.0
[2023-02-25 13:10:08,631][2409076] Sum rewards: 10.884, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.199', 'AMMO2': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.020', 'AMMO3': '0.030', 'WEAPON4': '0.050', 'weapon7': '0.098', 'WEAPON5': '0.100', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.240', 'WEAPON3': '0.250', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.610', 'weapon3': '0.754', 'weapon2': '0.944', 'DAMAGECOUNT': '2.067', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:10:09,310][2409075] DAMAGECOUNT value on done: 5270.0
[2023-02-25 13:10:09,311][2409075] Sum rewards: 13.887, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.949', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'AMMO3': '0.086', 'AMMO4': '0.137', 'weapon5': '0.140', 'weapon7': '0.148', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.550', 'weapon4': '0.592', 'HITCOUNT': '0.750', 'ARMOR': '0.849', 'weapon2': '1.354', 'weapon3': '1.424', 'DAMAGECOUNT': '3.753', 'FRAGCOUNT': '10.500'}
[2023-02-25 13:10:09,866][2409074] Updated weights for policy 0, policy_version 18971 (0.0012)
[2023-02-25 13:10:10,350][2409096] DAMAGECOUNT value on done: 4710.0
[2023-02-25 13:10:10,355][2409096] Sum rewards: 3.561, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.118', 'AMMO2': '0.002', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO4': '0.009', 'AMMO3': '0.050', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon7': '0.172', 'AMMO6': '0.240', 'AMMO7': '0.240', 'HITCOUNT': '0.240', 'WEAPON3': '0.300', 'weapon4': '0.318', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'weapon3': '0.804', 'DAMAGECOUNT': '0.855', 'weapon2': '1.138', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:10:10,724][2409080] DAMAGECOUNT value on done: 5074.0
[2023-02-25 13:10:10,727][2409080] Sum rewards: 8.568, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.230', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.038', 'weapon4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon5': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.700', 'ARMOR': '0.851', 'weapon3': '1.448', 'weapon2': '1.916', 'DAMAGECOUNT': '2.937', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:10:10,913][2409074] Updated weights for policy 0, policy_version 18981 (0.0012)
[2023-02-25 13:10:11,113][2409079] DAMAGECOUNT value on done: 5020.0
[2023-02-25 13:10:11,116][2409079] Sum rewards: 6.594, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.233', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon7': '0.022', 'AMMO2': '0.031', 'ARMOR': '0.032', 'AMMO3': '0.062', 'weapon5': '0.108', 'AMMO4': '0.155', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.570', 'weapon4': '0.790', 'weapon2': '1.130', 'weapon3': '1.348', 'DAMAGECOUNT': '2.298', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:10:11,385][2409099] DAMAGECOUNT value on done: 5265.0
[2023-02-25 13:10:11,386][2409099] Sum rewards: 10.084, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO3': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.070', 'weapon7': '0.098', 'weapon5': '0.114', 'WEAPON5': '0.150', 'weapon4': '0.186', 'WEAPON3': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HEALTH': '0.465', 'HITCOUNT': '0.570', 'ARMOR': '0.873', 'weapon3': '0.908', 'weapon2': '2.494', 'DAMAGECOUNT': '2.847', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:10:11,396][2409547] DAMAGECOUNT value on done: 5063.0
[2023-02-25 13:10:11,397][2409547] Sum rewards: 7.124, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.138', 'AMMO5': '0.005', 'AMMO2': '0.024', 'AMMO3': '0.030', 'weapon5': '0.106', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon7': '0.150', 'weapon4': '0.198', 'WEAPON3': '0.200', 'AMMO6': '0.320', 'AMMO7': '0.320', 'HITCOUNT': '0.330', 'WEAPON7': '0.400', 'weapon3': '0.722', 'ARMOR': '1.284', 'weapon2': '1.966', 'DAMAGECOUNT': '2.040', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:10:12,186][2408954] Fps is (10 sec: 25804.4, 60 sec: 25122.1, 300 sec: 24964.8). Total num frames: 77774848. Throughput: 0: 6284.0. Samples: 19443432. Policy #0 lag: (min: 1.0, avg: 14.1, max: 27.0)
[2023-02-25 13:10:12,186][2408954] Avg episode reward: [(0, '8.324')]
[2023-02-25 13:10:12,500][2409486] DAMAGECOUNT value on done: 4279.0
[2023-02-25 13:10:12,501][2409486] Sum rewards: 7.148, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.510', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO3': '0.058', 'weapon7': '0.102', 'AMMO4': '0.108', 'weapon5': '0.116', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'HITCOUNT': '0.490', 'weapon4': '0.578', 'weapon2': '0.776', 'weapon3': '0.878', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:10:12,784][2409074] Updated weights for policy 0, policy_version 18991 (0.0012)
[2023-02-25 13:10:14,402][2409096] DAMAGECOUNT value on done: 4201.0
[2023-02-25 13:10:14,405][2409096] Sum rewards: 10.876, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.760', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO5': '0.025', 'weapon4': '0.042', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'weapon5': '0.314', 'ARMOR': '0.488', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.670', 'weapon3': '1.606', 'weapon2': '1.754', 'DAMAGECOUNT': '3.300', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:10:14,499][2409074] Updated weights for policy 0, policy_version 19001 (0.0012)
[2023-02-25 13:10:14,709][2409080] DAMAGECOUNT value on done: 3510.0
[2023-02-25 13:10:14,710][2409080] Sum rewards: 2.127, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.447', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO3': '0.020', 'ARMOR': '0.032', 'AMMO4': '0.073', 'weapon5': '0.074', 'weapon7': '0.124', 'WEAPON3': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.438', 'weapon3': '0.462', 'DAMAGECOUNT': '0.813', 'weapon2': '0.868', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:10:14,856][2409079] DAMAGECOUNT value on done: 6581.0
[2023-02-25 13:10:14,859][2409079] Sum rewards: 11.595, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.002', 'AMMO5': '0.003', 'HEALTH': '0.006', 'AMMO4': '0.009', 'ARMOR': '0.036', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.058', 'weapon7': '0.066', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'weapon4': '0.466', 'HITCOUNT': '0.480', 'weapon3': '1.258', 'weapon2': '1.284', 'DAMAGECOUNT': '2.937', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:10:15,400][2409547] DAMAGECOUNT value on done: 4706.0
[2023-02-25 13:10:15,401][2409547] Sum rewards: 13.125, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.034', 'weapon7': '0.068', 'AMMO3': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO4': '0.169', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'HEALTH': '0.436', 'weapon4': '0.704', 'HITCOUNT': '0.820', 'weapon2': '1.054', 'weapon3': '1.096', 'DAMAGECOUNT': '2.895', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:10:15,504][2409099] DAMAGECOUNT value on done: 5779.0
[2023-02-25 13:10:15,506][2409099] Sum rewards: 6.726, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.973', 'AMMO5': '0.012', 'AMMO2': '0.013', 'ARMOR': '0.040', 'AMMO4': '0.063', 'AMMO3': '0.079', 'weapon7': '0.084', 'weapon5': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.262', 'WEAPON5': '0.350', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'weapon2': '1.202', 'weapon3': '1.478', 'DAMAGECOUNT': '1.776', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:10:15,648][2409074] Updated weights for policy 0, policy_version 19011 (0.0012)
[2023-02-25 13:10:16,653][2409486] DAMAGECOUNT value on done: 5122.0
[2023-02-25 13:10:16,654][2409486] Sum rewards: 2.479, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.740', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'AMMO3': '0.048', 'WEAPON5': '0.100', 'weapon7': '0.130', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'HITCOUNT': '0.410', 'weapon4': '0.592', 'weapon3': '0.750', 'weapon2': '0.900', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.205'}
[2023-02-25 13:10:17,186][2408954] Fps is (10 sec: 24576.0, 60 sec: 24985.6, 300 sec: 24950.9). Total num frames: 77889536. Throughput: 0: 6283.7. Samples: 19481256. Policy #0 lag: (min: 0.0, avg: 12.2, max: 27.0)
[2023-02-25 13:10:17,186][2408954] Avg episode reward: [(0, '8.212')]
[2023-02-25 13:10:17,200][2409033] Saving /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000019016_77889536.pth...
[2023-02-25 13:10:17,309][2409033] Removing /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000017558_71917568.pth
[2023-02-25 13:10:17,762][2409074] Updated weights for policy 0, policy_version 19021 (0.0012)
[2023-02-25 13:10:18,496][2409096] DAMAGECOUNT value on done: 4990.0
[2023-02-25 13:10:18,497][2409096] Sum rewards: 6.266, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.404', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.041', 'AMMO3': '0.055', 'WEAPON4': '0.100', 'weapon7': '0.106', 'weapon5': '0.160', 'weapon4': '0.186', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.390', 'WEAPON3': '0.400', 'ARMOR': '0.846', 'weapon3': '0.950', 'DAMAGECOUNT': '1.596', 'weapon2': '1.982', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:10:18,873][2409079] DAMAGECOUNT value on done: 4885.0
[2023-02-25 13:10:18,876][2409079] Sum rewards: 6.135, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.879', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO5': '0.017', 'weapon7': '0.060', 'AMMO3': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.144', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'weapon4': '0.480', 'WEAPON3': '0.650', 'HITCOUNT': '0.660', 'ARMOR': '0.861', 'weapon2': '1.310', 'weapon3': '1.648', 'DAMAGECOUNT': '3.012', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:10:19,186][2409074] Updated weights for policy 0, policy_version 19031 (0.0013)
[2023-02-25 13:10:19,204][2409080] DAMAGECOUNT value on done: 4776.0
[2023-02-25 13:10:19,228][2409080] Sum rewards: 2.856, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'AMMO2': '0.026', 'AMMO3': '0.038', 'WEAPON5': '0.050', 'HEALTH': '0.079', 'weapon7': '0.112', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.350', 'weapon3': '0.370', 'ARMOR': '0.400', 'weapon4': '0.544', 'weapon2': '0.738', 'DAMAGECOUNT': '1.467', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:10:19,300][2409547] DAMAGECOUNT value on done: 5330.0
[2023-02-25 13:10:19,301][2409547] Sum rewards: 9.030, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '0.004', 'AMMO5': '0.017', 'weapon4': '0.020', 'AMMO2': '0.033', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'weapon5': '0.156', 'AMMO4': '0.163', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'HITCOUNT': '0.560', 'ARMOR': '0.836', 'weapon2': '1.386', 'weapon3': '1.586', 'DAMAGECOUNT': '2.790', 'FRAGCOUNT': '6.500'}
[2023-02-25 13:10:19,857][2409099] DAMAGECOUNT value on done: 5113.0
[2023-02-25 13:10:19,858][2409099] Sum rewards: 5.963, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.178', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.066', 'weapon7': '0.078', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.344', 'HITCOUNT': '0.390', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'weapon3': '0.812', 'weapon2': '0.980', 'DAMAGECOUNT': '1.734', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:10:20,419][2409468] DAMAGECOUNT value on done: 5935.0
[2023-02-25 13:10:20,420][2409468] Sum rewards: 4.698, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.317', 'AMMO2': '0.017', 'AMMO5': '0.028', 'WEAPON1': '0.030', 'AMMO4': '0.083', 'AMMO3': '0.127', 'weapon7': '0.148', 'WEAPON4': '0.150', 'weapon5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'weapon4': '0.434', 'HITCOUNT': '0.510', 'WEAPON5': '0.650', 'WEAPON3': '0.800', 'weapon2': '1.236', 'weapon3': '1.504', 'DAMAGECOUNT': '3.459', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:10:20,927][2409486] DAMAGECOUNT value on done: 4821.0
[2023-02-25 13:10:20,930][2409486] Sum rewards: 10.794, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.534', 'weapon7': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.030', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.113', 'AMMO4': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.212', 'WEAPON5': '0.300', 'weapon4': '0.302', 'ARMOR': '0.452', 'WEAPON3': '0.750', 'HITCOUNT': '0.770', 'weapon2': '1.342', 'weapon3': '1.796', 'DAMAGECOUNT': '3.639', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:10:21,244][2409355] Large shaping reward 2.545 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.513, 171.0), ('weapon7', 0.002)]
[2023-02-25 13:10:21,320][2409074] Updated weights for policy 0, policy_version 19041 (0.0012)
[2023-02-25 13:10:22,128][2409096] DAMAGECOUNT value on done: 5075.0
[2023-02-25 13:10:22,131][2409096] Sum rewards: 9.765, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.377', 'AMMO5': '0.007', 'AMMO2': '0.050', 'AMMO3': '0.095', 'weapon5': '0.168', 'WEAPON5': '0.200', 'AMMO4': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.344', 'HITCOUNT': '0.540', 'WEAPON3': '0.600', 'weapon2': '1.174', 'weapon3': '1.698', 'DAMAGECOUNT': '1.965', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:10:22,186][2408954] Fps is (10 sec: 24166.7, 60 sec: 25053.9, 300 sec: 24937.0). Total num frames: 78016512. Throughput: 0: 6291.8. Samples: 19499964. Policy #0 lag: (min: 0.0, avg: 12.2, max: 27.0)
[2023-02-25 13:10:22,186][2408954] Avg episode reward: [(0, '8.194')]
[2023-02-25 13:10:22,359][2409074] Updated weights for policy 0, policy_version 19051 (0.0012)
[2023-02-25 13:10:23,000][2409079] DAMAGECOUNT value on done: 3703.0
[2023-02-25 13:10:23,003][2409079] Sum rewards: 8.003, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.136', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'weapon5': '0.020', 'AMMO4': '0.031', 'AMMO3': '0.070', 'weapon7': '0.088', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'WEAPON3': '0.450', 'weapon4': '0.488', 'HITCOUNT': '0.500', 'weapon3': '1.350', 'weapon2': '1.528', 'DAMAGECOUNT': '2.145', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:10:23,121][2409080] DAMAGECOUNT value on done: 5446.0
[2023-02-25 13:10:23,132][2409080] Sum rewards: 9.175, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.598', 'AMMO2': '0.002', 'AMMO5': '0.010', 'AMMO4': '0.011', 'AMMO3': '0.093', 'WEAPON5': '0.250', 'weapon5': '0.294', 'ARMOR': '0.440', 'HITCOUNT': '0.610', 'WEAPON3': '0.650', 'weapon2': '0.992', 'weapon3': '2.106', 'DAMAGECOUNT': '2.565', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:10:23,380][2409547] DAMAGECOUNT value on done: 5295.0
[2023-02-25 13:10:23,385][2409547] Sum rewards: 10.692, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.230', 'AMMO5': '0.010', 'AMMO2': '0.027', 'ARMOR': '0.036', 'AMMO3': '0.040', 'weapon7': '0.060', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.136', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'WEAPON4': '0.300', 'weapon5': '0.326', 'weapon4': '0.412', 'HITCOUNT': '0.540', 'weapon3': '0.794', 'weapon2': '1.588', 'DAMAGECOUNT': '2.613', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:10:23,536][2409074] Updated weights for policy 0, policy_version 19061 (0.0012)
[2023-02-25 13:10:23,746][2409099] DAMAGECOUNT value on done: 4953.0
[2023-02-25 13:10:23,746][2409099] Sum rewards: 10.553, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.004', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO3': '0.068', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'weapon7': '0.112', 'weapon5': '0.118', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.560', 'HITCOUNT': '0.690', 'weapon3': '1.102', 'weapon2': '1.214', 'ARMOR': '1.307', 'DAMAGECOUNT': '2.106', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:10:24,269][2409468] DAMAGECOUNT value on done: 4519.0
[2023-02-25 13:10:24,270][2409468] Sum rewards: 7.363, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.012', 'AMMO2': '0.005', 'AMMO5': '0.017', 'AMMO4': '0.022', 'AMMO3': '0.090', 'weapon5': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'weapon4': '0.436', 'WEAPON3': '0.600', 'HITCOUNT': '0.780', 'ARMOR': '1.249', 'weapon3': '1.392', 'weapon2': '1.628', 'DAMAGECOUNT': '2.865', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:10:24,766][2409486] DAMAGECOUNT value on done: 5768.0
[2023-02-25 13:10:24,770][2409486] Sum rewards: 7.670, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.902', 'AMMO5': '0.014', 'AMMO2': '0.026', 'weapon7': '0.046', 'AMMO3': '0.065', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.130', 'weapon5': '0.184', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.390', 'WEAPON3': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.650', 'ARMOR': '0.844', 'weapon3': '1.312', 'weapon4': '1.334', 'DAMAGECOUNT': '1.986', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:10:26,042][2409074] Updated weights for policy 0, policy_version 19071 (0.0013)
[2023-02-25 13:10:27,083][2409074] Updated weights for policy 0, policy_version 19081 (0.0012)
[2023-02-25 13:10:27,140][2409547] DAMAGECOUNT value on done: 6136.0
[2023-02-25 13:10:27,141][2409547] Sum rewards: 13.196, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.575', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO2': '0.023', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'AMMO4': '0.114', 'weapon5': '0.206', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon4': '0.666', 'HITCOUNT': '0.960', 'weapon2': '1.186', 'ARMOR': '1.297', 'weapon3': '1.642', 'DAMAGECOUNT': '3.849', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:10:27,186][2408954] Fps is (10 sec: 27033.7, 60 sec: 25327.0, 300 sec: 24992.5). Total num frames: 78159872. Throughput: 0: 6298.4. Samples: 19538232. Policy #0 lag: (min: 1.0, avg: 12.1, max: 25.0)
[2023-02-25 13:10:27,186][2408954] Avg episode reward: [(0, '8.321')]
[2023-02-25 13:10:27,429][2409080] DAMAGECOUNT value on done: 4283.0
[2023-02-25 13:10:27,430][2409080] Sum rewards: 6.319, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.404', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'weapon5': '0.148', 'WEAPON5': '0.250', 'HITCOUNT': '0.340', 'WEAPON3': '0.350', 'ARMOR': '0.444', 'weapon3': '1.018', 'DAMAGECOUNT': '1.602', 'weapon2': '1.808', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:10:27,670][2409099] DAMAGECOUNT value on done: 4940.0
[2023-02-25 13:10:27,671][2409099] Sum rewards: 7.740, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.695', 'AMMO2': '0.017', 'AMMO3': '0.020', 'AMMO4': '0.083', 'WEAPON3': '0.100', 'weapon7': '0.176', 'WEAPON4': '0.250', 'HITCOUNT': '0.310', 'weapon3': '0.338', 'AMMO6': '0.360', 'AMMO7': '0.360', 'WEAPON7': '0.600', 'weapon4': '0.736', 'ARMOR': '0.873', 'weapon2': '1.186', 'DAMAGECOUNT': '1.776', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:10:28,485][2409468] DAMAGECOUNT value on done: 5908.0
[2023-02-25 13:10:28,488][2409468] Sum rewards: 5.606, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.096', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'AMMO3': '0.060', 'AMMO4': '0.103', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.400', 'ARMOR': '0.445', 'weapon4': '0.502', 'HITCOUNT': '0.800', 'weapon3': '1.242', 'weapon2': '1.522', 'FRAGCOUNT': '3.000', 'DAMAGECOUNT': '3.171'}
[2023-02-25 13:10:29,424][2409074] Updated weights for policy 0, policy_version 19091 (0.0013)
[2023-02-25 13:10:30,530][2409074] Updated weights for policy 0, policy_version 19101 (0.0012)
[2023-02-25 13:10:30,975][2409547] DAMAGECOUNT value on done: 5247.0
[2023-02-25 13:10:30,975][2409547] Sum rewards: 5.567, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.181', 'AMMO4': '-0.081', 'AMMO2': '-0.016', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO3': '0.060', 'weapon5': '0.210', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'ARMOR': '0.569', 'HITCOUNT': '0.580', 'weapon3': '1.348', 'DAMAGECOUNT': '2.070', 'weapon2': '2.118', 'FRAGCOUNT': '3.500'}
[2023-02-25 13:10:31,195][2409080] DAMAGECOUNT value on done: 5264.0
[2023-02-25 13:10:31,196][2409080] Sum rewards: 3.155, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.276', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.019', 'weapon5': '0.034', 'AMMO3': '0.119', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.510', 'weapon4': '0.544', 'WEAPON3': '0.750', 'ARMOR': '0.856', 'weapon3': '1.246', 'weapon2': '1.542', 'DAMAGECOUNT': '1.950', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:10:31,289][2409099] DAMAGECOUNT value on done: 5448.0
[2023-02-25 13:10:31,292][2409099] Sum rewards: 12.451, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.856', 'AMMO2': '0.010', 'AMMO5': '0.017', 'weapon5': '0.034', 'AMMO4': '0.050', 'AMMO3': '0.114', 'weapon4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'HITCOUNT': '0.940', 'ARMOR': '0.988', 'weapon2': '1.612', 'weapon3': '1.994', 'DAMAGECOUNT': '3.459', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:10:32,186][2408954] Fps is (10 sec: 25804.2, 60 sec: 25190.3, 300 sec: 24937.0). Total num frames: 78274560. Throughput: 0: 6302.4. Samples: 19576200. Policy #0 lag: (min: 1.0, avg: 12.1, max: 25.0)
[2023-02-25 13:10:32,186][2408954] Avg episode reward: [(0, '8.218')]
[2023-02-25 13:10:32,223][2409468] DAMAGECOUNT value on done: 4361.0
[2023-02-25 13:10:32,223][2409468] Sum rewards: 7.140, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.726', 'AMMO2': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.051', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.120', 'weapon5': '0.182', 'WEAPON4': '0.200', 'weapon4': '0.268', 'WEAPON5': '0.400', 'HITCOUNT': '0.520', 'WEAPON3': '0.700', 'weapon2': '1.082', 'ARMOR': '1.687', 'weapon3': '2.088', 'DAMAGECOUNT': '2.676', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:10:32,596][2409074] Updated weights for policy 0, policy_version 19111 (0.0012)
[2023-02-25 13:10:34,165][2409074] Updated weights for policy 0, policy_version 19121 (0.0012)
[2023-02-25 13:10:34,735][2409547] DAMAGECOUNT value on done: 4707.0
[2023-02-25 13:10:34,736][2409547] Sum rewards: 13.423, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.308', 'AMMO2': '0.008', 'AMMO5': '0.009', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'AMMO3': '0.067', 'weapon5': '0.132', 'WEAPON5': '0.200', 'weapon4': '0.256', 'WEAPON3': '0.450', 'HITCOUNT': '0.730', 'ARMOR': '0.849', 'weapon2': '1.174', 'weapon3': '1.356', 'DAMAGECOUNT': '3.408', 'FRAGCOUNT': '9.500'}
[2023-02-25 13:10:34,970][2409074] Updated weights for policy 0, policy_version 19131 (0.0012)
[2023-02-25 13:10:35,193][2409080] DAMAGECOUNT value on done: 4959.0
[2023-02-25 13:10:35,194][2409080] Sum rewards: 5.824, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.368', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.030', 'weapon7': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.130', 'AMMO4': '0.131', 'WEAPON4': '0.250', 'WEAPON3': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.370', 'weapon4': '0.384', 'weapon3': '0.766', 'weapon2': '1.724', 'DAMAGECOUNT': '1.932', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:10:35,235][2409099] DAMAGECOUNT value on done: 5980.0
[2023-02-25 13:10:35,238][2409099] Sum rewards: 12.047, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.710', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO3': '0.073', 'AMMO4': '0.083', 'weapon5': '0.180', 'weapon4': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'ARMOR': '0.447', 'WEAPON3': '0.550', 'HITCOUNT': '0.940', 'weapon3': '1.642', 'weapon2': '1.750', 'DAMAGECOUNT': '4.065', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:10:36,260][2409468] DAMAGECOUNT value on done: 6203.0
[2023-02-25 13:10:36,263][2409468] Sum rewards: 10.596, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.080', 'AMMO5': '0.003', 'AMMO2': '0.030', 'AMMO3': '0.041', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'weapon7': '0.156', 'WEAPON3': '0.300', 'WEAPON4': '0.350', 'AMMO6': '0.440', 'AMMO7': '0.440', 'HITCOUNT': '0.560', 'WEAPON7': '0.600', 'weapon2': '0.908', 'weapon3': '0.952', 'weapon4': '1.148', 'DAMAGECOUNT': '2.934', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:10:36,690][2409033] Signal inference workers to stop experience collection... (2300 times)
[2023-02-25 13:10:36,691][2409033] Signal inference workers to resume experience collection... (2300 times)
[2023-02-25 13:10:36,718][2409074] InferenceWorker_p0-w0: stopping experience collection (2300 times)
[2023-02-25 13:10:36,718][2409074] InferenceWorker_p0-w0: resuming experience collection (2300 times)
[2023-02-25 13:10:37,088][2409074] Updated weights for policy 0, policy_version 19141 (0.0013)
[2023-02-25 13:10:37,186][2408954] Fps is (10 sec: 24166.4, 60 sec: 25190.5, 300 sec: 24950.9). Total num frames: 78401536. Throughput: 0: 6323.2. Samples: 19595556. Policy #0 lag: (min: 1.0, avg: 12.1, max: 25.0)
[2023-02-25 13:10:37,186][2408954] Avg episode reward: [(0, '8.210')]
[2023-02-25 13:10:38,479][2409547] DAMAGECOUNT value on done: 6644.0
[2023-02-25 13:10:38,480][2409547] Sum rewards: 21.641, reward structure: {'DEATHCOUNT': '-6.000', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.031', 'HEALTH': '0.034', 'AMMO3': '0.087', 'AMMO4': '0.155', 'weapon5': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.485', 'WEAPON3': '0.500', 'weapon4': '0.820', 'weapon2': '0.922', 'HITCOUNT': '1.100', 'weapon3': '1.260', 'DAMAGECOUNT': '6.303', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:10:38,589][2409074] Updated weights for policy 0, policy_version 19151 (0.0012)
[2023-02-25 13:10:38,929][2409080] DAMAGECOUNT value on done: 5789.0
[2023-02-25 13:10:38,930][2409080] Sum rewards: 12.569, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.774', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO5': '0.003', 'AMMO3': '0.030', 'weapon5': '0.046', 'weapon7': '0.078', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'ARMOR': '0.430', 'weapon4': '0.534', 'weapon3': '0.558', 'HITCOUNT': '0.660', 'weapon2': '0.910', 'DAMAGECOUNT': '3.144', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:10:39,737][2409099] DAMAGECOUNT value on done: 4899.0
[2023-02-25 13:10:39,738][2409099] Sum rewards: 4.165, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-1.118', 'AMMO2': '0.007', 'AMMO3': '0.020', 'AMMO4': '0.033', 'weapon7': '0.056', 'WEAPON3': '0.200', 'HITCOUNT': '0.260', 'WEAPON4': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'weapon3': '0.460', 'weapon4': '0.506', 'weapon2': '0.550', 'DAMAGECOUNT': '1.101', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:10:40,006][2409468] DAMAGECOUNT value on done: 4204.0
[2023-02-25 13:10:40,006][2409468] Sum rewards: 5.418, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.916', 'AMMO2': '0.002', 'AMMO4': '0.007', 'AMMO5': '0.010', 'WEAPON4': '0.050', 'AMMO3': '0.073', 'weapon7': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.192', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.450', 'HITCOUNT': '0.480', 'ARMOR': '0.938', 'weapon3': '1.104', 'weapon2': '1.750', 'DAMAGECOUNT': '1.806', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:10:40,405][2409074] Updated weights for policy 0, policy_version 19161 (0.0012)
[2023-02-25 13:10:42,107][2409074] Updated weights for policy 0, policy_version 19171 (0.0012)
[2023-02-25 13:10:42,186][2408954] Fps is (10 sec: 24986.1, 60 sec: 25190.4, 300 sec: 24964.8). Total num frames: 78524416. Throughput: 0: 6329.9. Samples: 19634124. Policy #0 lag: (min: 0.0, avg: 13.4, max: 24.0)
[2023-02-25 13:10:42,186][2408954] Avg episode reward: [(0, '8.291')]
[2023-02-25 13:10:42,191][2409547] DAMAGECOUNT value on done: 4630.0
[2023-02-25 13:10:42,192][2409547] Sum rewards: 5.603, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.450', 'AMMO2': '0.005', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.025', 'AMMO3': '0.064', 'weapon7': '0.106', 'weapon5': '0.142', 'WEAPON4': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'HITCOUNT': '0.320', 'WEAPON5': '0.400', 'WEAPON7': '0.400', 'weapon4': '0.412', 'WEAPON3': '0.450', 'ARMOR': '0.570', 'DAMAGECOUNT': '1.278', 'weapon2': '1.308', 'weapon3': '1.406', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:10:42,504][2409469] Large shaping reward 2.539 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.507, 169.0), ('weapon7', 0.002)]
[2023-02-25 13:10:42,822][2409074] Updated weights for policy 0, policy_version 19181 (0.0012)
[2023-02-25 13:10:43,028][2409080] DAMAGECOUNT value on done: 5805.0
[2023-02-25 13:10:43,029][2409080] Sum rewards: 9.350, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.875', 'AMMO2': '0.019', 'AMMO5': '0.041', 'weapon4': '0.082', 'AMMO4': '0.094', 'AMMO3': '0.110', 'WEAPON4': '0.200', 'ARMOR': '0.453', 'weapon5': '0.478', 'HITCOUNT': '0.740', 'WEAPON3': '0.750', 'WEAPON5': '0.900', 'weapon2': '1.354', 'weapon3': '1.728', 'DAMAGECOUNT': '3.276', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:10:43,753][2409099] DAMAGECOUNT value on done: 5023.0
[2023-02-25 13:10:43,756][2409099] Sum rewards: 6.369, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.716', 'AMMO5': '0.014', 'AMMO2': '0.022', 'AMMO3': '0.070', 'AMMO4': '0.110', 'weapon5': '0.148', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'weapon4': '0.576', 'HITCOUNT': '0.660', 'weapon2': '1.138', 'weapon3': '1.530', 'DAMAGECOUNT': '2.616', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:10:44,202][2409468] DAMAGECOUNT value on done: 5636.0
[2023-02-25 13:10:44,206][2409468] Sum rewards: 7.311, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.380', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.010', 'WEAPON4': '0.050', 'AMMO3': '0.072', 'weapon7': '0.120', 'weapon5': '0.130', 'weapon4': '0.218', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.780', 'ARMOR': '0.897', 'weapon3': '1.178', 'weapon2': '1.278', 'DAMAGECOUNT': '2.943', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:10:44,978][2409074] Updated weights for policy 0, policy_version 19191 (0.0012)
[2023-02-25 13:10:45,938][2409547] DAMAGECOUNT value on done: 5667.0
[2023-02-25 13:10:45,939][2409547] Sum rewards: 13.782, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.642', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.018', 'AMMO4': '0.029', 'weapon7': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'HITCOUNT': '0.680', 'weapon4': '0.854', 'weapon2': '0.958', 'weapon3': '1.540', 'DAMAGECOUNT': '2.679', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:10:46,355][2409074] Updated weights for policy 0, policy_version 19201 (0.0013)
[2023-02-25 13:10:47,133][2409080] DAMAGECOUNT value on done: 5185.0
[2023-02-25 13:10:47,134][2409080] Sum rewards: 12.123, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.141', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'AMMO3': '0.124', 'AMMO4': '0.153', 'weapon5': '0.166', 'weapon4': '0.262', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'HITCOUNT': '0.720', 'ARMOR': '0.873', 'WEAPON3': '0.900', 'weapon2': '1.266', 'weapon3': '2.018', 'DAMAGECOUNT': '3.018', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:10:47,186][2408954] Fps is (10 sec: 26624.1, 60 sec: 25531.8, 300 sec: 24993.6). Total num frames: 78667776. Throughput: 0: 6348.5. Samples: 19672512. Policy #0 lag: (min: 0.0, avg: 13.4, max: 24.0)
[2023-02-25 13:10:47,186][2408954] Avg episode reward: [(0, '8.164')]
[2023-02-25 13:10:47,934][2409099] DAMAGECOUNT value on done: 5076.0
[2023-02-25 13:10:47,937][2409099] Sum rewards: 6.686, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.270', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO3': '0.094', 'weapon5': '0.130', 'AMMO4': '0.173', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.710', 'weapon4': '0.772', 'weapon2': '0.888', 'ARMOR': '0.953', 'weapon3': '1.714', 'DAMAGECOUNT': '2.277', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:10:48,208][2409074] Updated weights for policy 0, policy_version 19211 (0.0013)
[2023-02-25 13:10:48,269][2409468] DAMAGECOUNT value on done: 6221.0
[2023-02-25 13:10:48,272][2409468] Sum rewards: 15.046, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.010', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.105', 'weapon4': '0.106', 'weapon5': '0.190', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'HEALTH': '0.489', 'ARMOR': '0.856', 'HITCOUNT': '0.900', 'weapon3': '1.342', 'weapon2': '2.088', 'DAMAGECOUNT': '3.918', 'FRAGCOUNT': '9.500'}
[2023-02-25 13:10:49,828][2409074] Updated weights for policy 0, policy_version 19221 (0.0013)
[2023-02-25 13:10:50,342][2409547] DAMAGECOUNT value on done: 4982.0
[2023-02-25 13:10:50,344][2409547] Sum rewards: 6.268, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.993', 'AMMO5': '0.014', 'AMMO2': '0.040', 'WEAPON1': '0.040', 'weapon5': '0.064', 'AMMO3': '0.098', 'weapon7': '0.098', 'AMMO4': '0.199', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.374', 'ARMOR': '0.400', 'HITCOUNT': '0.730', 'WEAPON3': '0.750', 'weapon2': '1.414', 'weapon3': '1.526', 'DAMAGECOUNT': '2.874', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:10:50,849][2409080] DAMAGECOUNT value on done: 4568.0
[2023-02-25 13:10:50,853][2409080] Sum rewards: 8.847, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.197', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.030', 'AMMO4': '0.046', 'AMMO3': '0.080', 'weapon5': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.306', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.940', 'weapon2': '1.278', 'weapon3': '1.824', 'DAMAGECOUNT': '3.246', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:10:51,445][2409074] Updated weights for policy 0, policy_version 19231 (0.0013)
[2023-02-25 13:10:51,728][2409099] DAMAGECOUNT value on done: 6059.0
[2023-02-25 13:10:51,732][2409099] Sum rewards: 13.268, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.090', 'AMMO5': '0.017', 'AMMO2': '0.033', 'AMMO3': '0.072', 'weapon7': '0.100', 'AMMO4': '0.166', 'weapon5': '0.174', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '0.500', 'weapon4': '0.636', 'weapon2': '0.886', 'HITCOUNT': '0.970', 'weapon3': '1.430', 'DAMAGECOUNT': '3.933', 'FRAGCOUNT': '11.500'}
[2023-02-25 13:10:52,176][2409468] DAMAGECOUNT value on done: 6060.0
[2023-02-25 13:10:52,186][2408954] Fps is (10 sec: 25395.3, 60 sec: 25190.4, 300 sec: 24924.2). Total num frames: 78778368. Throughput: 0: 6368.5. Samples: 19691820. Policy #0 lag: (min: 0.0, avg: 13.4, max: 24.0)
[2023-02-25 13:10:52,177][2409468] Sum rewards: 10.339, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.672', 'WEAPON1': '0.020', 'AMMO5': '0.032', 'AMMO2': '0.040', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.123', 'AMMO4': '0.199', 'weapon5': '0.336', 'weapon4': '0.364', 'WEAPON4': '0.400', 'HITCOUNT': '0.700', 'WEAPON5': '0.800', 'WEAPON3': '0.850', 'weapon2': '1.318', 'weapon3': '1.462', 'DAMAGECOUNT': '3.270', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:10:52,188][2408954] Avg episode reward: [(0, '8.404')]
[2023-02-25 13:10:53,132][2409074] Updated weights for policy 0, policy_version 19241 (0.0012)
[2023-02-25 13:10:54,266][2409074] Updated weights for policy 0, policy_version 19251 (0.0012)
[2023-02-25 13:10:54,343][2409547] DAMAGECOUNT value on done: 5106.0
[2023-02-25 13:10:54,344][2409547] Sum rewards: 8.414, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.039', 'AMMO3': '0.077', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO4': '0.196', 'WEAPON4': '0.200', 'HEALTH': '0.408', 'WEAPON3': '0.450', 'HITCOUNT': '0.530', 'weapon4': '0.540', 'ARMOR': '0.870', 'weapon2': '1.012', 'weapon3': '1.386', 'DAMAGECOUNT': '1.659', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:10:54,870][2409080] DAMAGECOUNT value on done: 5638.0
[2023-02-25 13:10:54,873][2409080] Sum rewards: 15.208, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.947', 'AMMO2': '0.008', 'AMMO5': '0.013', 'AMMO4': '0.040', 'AMMO3': '0.082', 'weapon7': '0.182', 'WEAPON4': '0.200', 'weapon5': '0.222', 'weapon4': '0.332', 'AMMO6': '0.360', 'AMMO7': '0.360', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'WEAPON7': '0.600', 'HITCOUNT': '0.670', 'ARMOR': '0.929', 'weapon2': '1.374', 'weapon3': '1.508', 'DAMAGECOUNT': '3.774', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:10:55,283][2409596] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:10:56,031][2409468] DAMAGECOUNT value on done: 5573.0
[2023-02-25 13:10:56,035][2409468] Sum rewards: 8.652, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.525', 'AMMO2': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'weapon7': '0.074', 'AMMO3': '0.089', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.168', 'WEAPON5': '0.250', 'weapon4': '0.442', 'WEAPON3': '0.550', 'weapon2': '0.700', 'HITCOUNT': '0.800', 'weapon3': '1.686', 'DAMAGECOUNT': '3.261', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:10:56,385][2409074] Updated weights for policy 0, policy_version 19261 (0.0012)
[2023-02-25 13:10:57,186][2408954] Fps is (10 sec: 24985.6, 60 sec: 25258.7, 300 sec: 24992.5). Total num frames: 78917632. Throughput: 0: 6366.7. Samples: 19729932. Policy #0 lag: (min: 0.0, avg: 12.6, max: 25.0)
[2023-02-25 13:10:57,186][2408954] Avg episode reward: [(0, '8.471')]
[2023-02-25 13:10:57,880][2409074] Updated weights for policy 0, policy_version 19271 (0.0012)
[2023-02-25 13:10:58,824][2409080] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon3', 0.002)]
[2023-02-25 13:10:58,850][2409080] DAMAGECOUNT value on done: 5004.0
[2023-02-25 13:10:58,852][2409080] Sum rewards: 8.259, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.934', 'AMMO5': '0.015', 'AMMO2': '0.017', 'weapon7': '0.056', 'AMMO4': '0.082', 'AMMO3': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.150', 'weapon4': '0.286', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'weapon2': '0.808', 'HITCOUNT': '0.810', 'weapon3': '1.466', 'DAMAGECOUNT': '3.060', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:10:59,600][2409074] Updated weights for policy 0, policy_version 19281 (0.0012)
[2023-02-25 13:11:00,031][2409468] DAMAGECOUNT value on done: 5209.0
[2023-02-25 13:11:00,032][2409468] Sum rewards: 8.439, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.246', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon5': '0.094', 'weapon7': '0.106', 'AMMO3': '0.116', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '0.650', 'HITCOUNT': '0.750', 'weapon4': '0.792', 'ARMOR': '0.850', 'weapon2': '0.946', 'weapon3': '1.146', 'DAMAGECOUNT': '3.300', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:11:01,120][2409074] Updated weights for policy 0, policy_version 19291 (0.0012)
[2023-02-25 13:11:02,186][2408954] Fps is (10 sec: 27033.7, 60 sec: 25531.7, 300 sec: 25020.3). Total num frames: 79048704. Throughput: 0: 6366.9. Samples: 19767768. Policy #0 lag: (min: 0.0, avg: 12.6, max: 25.0)
[2023-02-25 13:11:02,186][2408954] Avg episode reward: [(0, '8.429')]
[2023-02-25 13:11:02,333][2409074] Updated weights for policy 0, policy_version 19301 (0.0012)
[2023-02-25 13:11:02,726][2409080] DAMAGECOUNT value on done: 4615.0
[2023-02-25 13:11:02,729][2409080] Sum rewards: 2.531, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.934', 'AMMO5': '0.013', 'weapon5': '0.024', 'AMMO2': '0.031', 'weapon7': '0.066', 'AMMO3': '0.089', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.155', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon4': '0.440', 'HITCOUNT': '0.450', 'WEAPON3': '0.550', 'weapon2': '1.296', 'weapon3': '1.592', 'DAMAGECOUNT': '1.869', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:11:04,016][2409468] DAMAGECOUNT value on done: 4959.0
[2023-02-25 13:11:04,017][2409468] Sum rewards: 12.899, reward structure: {'DEATHCOUNT': '-6.750', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon7': '0.036', 'AMMO3': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.146', 'weapon5': '0.166', 'WEAPON5': '0.300', 'HEALTH': '0.318', 'WEAPON3': '0.600', 'weapon4': '0.616', 'weapon2': '0.640', 'ARMOR': '0.800', 'HITCOUNT': '0.820', 'weapon3': '1.644', 'DAMAGECOUNT': '3.009', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:11:04,186][2409074] Updated weights for policy 0, policy_version 19311 (0.0012)
[2023-02-25 13:11:05,836][2409074] Updated weights for policy 0, policy_version 19321 (0.0012)
[2023-02-25 13:11:06,577][2409080] DAMAGECOUNT value on done: 4467.0
[2023-02-25 13:11:06,580][2409080] Sum rewards: 7.615, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.206', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO5': '0.030', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'weapon7': '0.056', 'weapon5': '0.098', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.560', 'WEAPON5': '0.650', 'WEAPON3': '0.650', 'ARMOR': '0.897', 'weapon3': '1.288', 'weapon2': '2.176', 'DAMAGECOUNT': '2.259', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:11:07,186][2408954] Fps is (10 sec: 24985.1, 60 sec: 25395.1, 300 sec: 24978.6). Total num frames: 79167488. Throughput: 0: 6380.0. Samples: 19787064. Policy #0 lag: (min: 0.0, avg: 11.6, max: 24.0)
[2023-02-25 13:11:07,187][2408954] Avg episode reward: [(0, '8.471')]
[2023-02-25 13:11:07,734][2409074] Updated weights for policy 0, policy_version 19331 (0.0013)
[2023-02-25 13:11:07,833][2409468] DAMAGECOUNT value on done: 5999.0
[2023-02-25 13:11:07,836][2409468] Sum rewards: 8.578, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.820', 'AMMO2': '0.011', 'AMMO5': '0.022', 'WEAPON4': '0.050', 'weapon4': '0.052', 'AMMO4': '0.054', 'AMMO3': '0.124', 'weapon5': '0.262', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'ARMOR': '0.851', 'HITCOUNT': '0.890', 'weapon2': '1.394', 'weapon3': '2.034', 'DAMAGECOUNT': '3.603', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:11:08,394][2409076] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 13:11:09,137][2409074] Updated weights for policy 0, policy_version 19341 (0.0013)
[2023-02-25 13:11:10,675][2409074] Updated weights for policy 0, policy_version 19351 (0.0013)
[2023-02-25 13:11:10,694][2409080] DAMAGECOUNT value on done: 5386.0
[2023-02-25 13:11:10,696][2409080] Sum rewards: 9.600, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.448', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO3': '0.070', 'weapon4': '0.094', 'weapon5': '0.108', 'AMMO4': '0.111', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'ARMOR': '0.454', 'WEAPON3': '0.500', 'HITCOUNT': '0.820', 'weapon3': '1.434', 'weapon2': '1.944', 'DAMAGECOUNT': '3.063', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:11:12,029][2409468] DAMAGECOUNT value on done: 4895.0
[2023-02-25 13:11:12,030][2409468] Sum rewards: 6.194, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.356', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon5': '0.066', 'weapon7': '0.066', 'AMMO3': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.396', 'WEAPON3': '0.550', 'ARMOR': '0.800', 'HITCOUNT': '0.810', 'weapon2': '1.270', 'weapon3': '1.822', 'DAMAGECOUNT': '3.054', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:11:12,126][2409079] Large shaping reward 2.625 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.594, 198.0), ('AMMO2', -0.0001, -1.0), ('AMMO4', -0.0005, -1.0), ('weapon4', 0.002)]
[2023-02-25 13:11:12,186][2408954] Fps is (10 sec: 24165.8, 60 sec: 25258.6, 300 sec: 24992.5). Total num frames: 79290368. Throughput: 0: 6383.7. Samples: 19825500. Policy #0 lag: (min: 0.0, avg: 11.6, max: 24.0)
[2023-02-25 13:11:12,186][2408954] Avg episode reward: [(0, '8.441')]
[2023-02-25 13:11:12,522][2409074] Updated weights for policy 0, policy_version 19361 (0.0012)
[2023-02-25 13:11:13,446][2409074] Updated weights for policy 0, policy_version 19371 (0.0012)
[2023-02-25 13:11:14,626][2409080] DAMAGECOUNT value on done: 6108.0
[2023-02-25 13:11:14,629][2409080] Sum rewards: 13.253, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.209', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.038', 'weapon7': '0.054', 'AMMO3': '0.055', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.168', 'AMMO4': '0.190', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.680', 'HITCOUNT': '0.840', 'ARMOR': '0.864', 'weapon4': '1.096', 'weapon3': '1.140', 'DAMAGECOUNT': '3.867', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:11:15,713][2409074] Updated weights for policy 0, policy_version 19381 (0.0012)
[2023-02-25 13:11:15,857][2409468] DAMAGECOUNT value on done: 4204.0
[2023-02-25 13:11:15,858][2409468] Sum rewards: 12.817, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.967', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon7': '0.052', 'AMMO3': '0.070', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.187', 'WEAPON3': '0.400', 'AMMO6': '0.420', 'AMMO7': '0.420', 'WEAPON7': '0.500', 'WEAPON4': '0.550', 'HITCOUNT': '0.980', 'weapon4': '1.050', 'weapon2': '1.054', 'weapon3': '1.536', 'DAMAGECOUNT': '3.591', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:11:16,652][2409076] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)]
[2023-02-25 13:11:16,886][2409074] Updated weights for policy 0, policy_version 19391 (0.0012)
[2023-02-25 13:11:17,186][2408954] Fps is (10 sec: 26624.6, 60 sec: 25736.6, 300 sec: 25062.0). Total num frames: 79433728. Throughput: 0: 6391.2. Samples: 19863804. Policy #0 lag: (min: 0.0, avg: 11.6, max: 24.0)
[2023-02-25 13:11:17,187][2408954] Avg episode reward: [(0, '8.545')]
[2023-02-25 13:11:17,192][2409033] Saving new best policy, reward=8.545!
[2023-02-25 13:11:18,367][2409080] DAMAGECOUNT value on done: 5931.0
[2023-02-25 13:11:18,369][2409080] Sum rewards: 8.715, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.102', 'AMMO2': '0.012', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.061', 'weapon7': '0.066', 'weapon4': '0.080', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.340', 'WEAPON5': '0.400', 'ARMOR': '0.458', 'WEAPON3': '0.550', 'HITCOUNT': '0.760', 'weapon3': '1.284', 'weapon2': '1.954', 'DAMAGECOUNT': '2.937', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:11:18,632][2409074] Updated weights for policy 0, policy_version 19401 (0.0012)
[2023-02-25 13:11:19,756][2409468] DAMAGECOUNT value on done: 6317.0
[2023-02-25 13:11:19,760][2409468] Sum rewards: 7.961, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.526', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO5': '0.013', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.110', 'weapon5': '0.208', 'weapon4': '0.224', 'WEAPON5': '0.350', 'ARMOR': '0.454', 'WEAPON3': '0.800', 'HITCOUNT': '0.920', 'weapon2': '1.148', 'weapon3': '2.112', 'DAMAGECOUNT': '3.528', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:11:20,505][2409074] Updated weights for policy 0, policy_version 19411 (0.0012)
[2023-02-25 13:11:21,544][2409074] Updated weights for policy 0, policy_version 19421 (0.0013)
[2023-02-25 13:11:22,186][2408954] Fps is (10 sec: 26215.1, 60 sec: 25600.0, 300 sec: 25020.3). Total num frames: 79552512. Throughput: 0: 6385.1. Samples: 19882884. Policy #0 lag: (min: 1.0, avg: 10.1, max: 27.0)
[2023-02-25 13:11:22,186][2408954] Avg episode reward: [(0, '8.535')]
[2023-02-25 13:11:22,188][2409080] DAMAGECOUNT value on done: 5049.0
[2023-02-25 13:11:22,191][2409080] Sum rewards: 8.660, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.315', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO3': '0.072', 'weapon5': '0.080', 'weapon7': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.173', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.458', 'weapon4': '0.540', 'WEAPON3': '0.550', 'weapon2': '0.720', 'HITCOUNT': '0.770', 'weapon3': '1.334', 'DAMAGECOUNT': '2.802', 'FRAGCOUNT': '6.500'}
[2023-02-25 13:11:23,481][2409468] DAMAGECOUNT value on done: 5664.0
[2023-02-25 13:11:23,485][2409468] Sum rewards: 19.532, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.507', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'AMMO3': '0.084', 'weapon5': '0.296', 'weapon4': '0.326', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'weapon2': '1.120', 'HITCOUNT': '1.120', 'ARMOR': '1.243', 'weapon3': '1.710', 'DAMAGECOUNT': '5.019', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:11:23,853][2409074] Updated weights for policy 0, policy_version 19431 (0.0012)
[2023-02-25 13:11:25,001][2409074] Updated weights for policy 0, policy_version 19441 (0.0012)
[2023-02-25 13:11:26,024][2409080] DAMAGECOUNT value on done: 4948.0
[2023-02-25 13:11:26,028][2409080] Sum rewards: 7.353, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.285', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon7': '0.048', 'AMMO3': '0.053', 'weapon5': '0.178', 'WEAPON5': '0.200', 'AMMO4': '0.212', 'WEAPON3': '0.300', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.400', 'AMMO6': '0.420', 'AMMO7': '0.420', 'WEAPON7': '0.500', 'weapon3': '0.710', 'weapon2': '0.952', 'weapon4': '1.106', 'DAMAGECOUNT': '2.133', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:11:26,916][2409074] Updated weights for policy 0, policy_version 19451 (0.0012)
[2023-02-25 13:11:27,186][2408954] Fps is (10 sec: 23756.8, 60 sec: 25190.4, 300 sec: 24992.5). Total num frames: 79671296. Throughput: 0: 6369.9. Samples: 19920768. Policy #0 lag: (min: 1.0, avg: 10.1, max: 27.0)
[2023-02-25 13:11:27,187][2408954] Avg episode reward: [(0, '8.525')]
[2023-02-25 13:11:27,639][2409468] DAMAGECOUNT value on done: 5799.0
[2023-02-25 13:11:27,643][2409468] Sum rewards: 10.816, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.976', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO3': '0.051', 'weapon7': '0.056', 'weapon5': '0.058', 'AMMO4': '0.065', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.610', 'weapon3': '1.164', 'weapon2': '1.440', 'DAMAGECOUNT': '2.385', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:11:28,372][2409074] Updated weights for policy 0, policy_version 19461 (0.0012)
[2023-02-25 13:11:30,062][2409074] Updated weights for policy 0, policy_version 19471 (0.0013)
[2023-02-25 13:11:30,584][2409080] DAMAGECOUNT value on done: 6474.0
[2023-02-25 13:11:30,585][2409080] Sum rewards: 14.671, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.777', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.028', 'AMMO4': '0.045', 'AMMO3': '0.112', 'WEAPON4': '0.150', 'weapon4': '0.186', 'weapon5': '0.236', 'ARMOR': '0.496', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'HITCOUNT': '0.880', 'weapon3': '1.536', 'weapon2': '1.550', 'DAMAGECOUNT': '5.409', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:11:31,676][2409074] Updated weights for policy 0, policy_version 19481 (0.0012)
[2023-02-25 13:11:31,913][2409468] DAMAGECOUNT value on done: 5700.0
[2023-02-25 13:11:31,914][2409468] Sum rewards: 8.907, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.184', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO3': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.079', 'weapon7': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'WEAPON4': '0.300', 'HITCOUNT': '0.600', 'weapon3': '0.822', 'weapon4': '1.084', 'weapon2': '1.218', 'DAMAGECOUNT': '1.980', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:11:32,187][2408954] Fps is (10 sec: 25392.2, 60 sec: 25531.3, 300 sec: 25048.0). Total num frames: 79806464. Throughput: 0: 6360.9. Samples: 19958760. Policy #0 lag: (min: 1.0, avg: 10.1, max: 27.0)
[2023-02-25 13:11:32,187][2408954] Avg episode reward: [(0, '8.630')]
[2023-02-25 13:11:32,188][2409033] Saving new best policy, reward=8.630!
[2023-02-25 13:11:33,032][2409074] Updated weights for policy 0, policy_version 19491 (0.0012)
[2023-02-25 13:11:34,341][2409080] DAMAGECOUNT value on done: 4741.0
[2023-02-25 13:11:34,342][2409080] Sum rewards: 12.029, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.328', 'AMMO5': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.092', 'AMMO4': '0.123', 'WEAPON4': '0.250', 'weapon5': '0.268', 'WEAPON5': '0.400', 'ARMOR': '0.447', 'weapon4': '0.498', 'WEAPON3': '0.500', 'HITCOUNT': '0.800', 'weapon3': '1.204', 'weapon2': '1.338', 'DAMAGECOUNT': '3.642', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:11:35,078][2409074] Updated weights for policy 0, policy_version 19501 (0.0013)
[2023-02-25 13:11:35,693][2409468] DAMAGECOUNT value on done: 4881.0
[2023-02-25 13:11:35,694][2409468] Sum rewards: 2.185, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.195', 'AMMO5': '0.016', 'AMMO2': '0.030', 'weapon7': '0.066', 'AMMO3': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.126', 'AMMO4': '0.148', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'HITCOUNT': '0.460', 'ARMOR': '0.478', 'weapon4': '0.632', 'weapon2': '0.708', 'WEAPON3': '0.750', 'weapon3': '1.566', 'DAMAGECOUNT': '1.590', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:11:36,334][2409074] Updated weights for policy 0, policy_version 19511 (0.0013)
[2023-02-25 13:11:37,186][2408954] Fps is (10 sec: 26214.4, 60 sec: 25531.7, 300 sec: 25048.1). Total num frames: 79933440. Throughput: 0: 6354.4. Samples: 19977768. Policy #0 lag: (min: 0.0, avg: 13.9, max: 27.0)
[2023-02-25 13:11:37,186][2408954] Avg episode reward: [(0, '8.615')]
[2023-02-25 13:11:37,964][2409074] Updated weights for policy 0, policy_version 19521 (0.0012)
[2023-02-25 13:11:39,656][2409468] DAMAGECOUNT value on done: 5120.0
[2023-02-25 13:11:39,660][2409468] Sum rewards: 6.326, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.293', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'weapon7': '0.048', 'AMMO3': '0.060', 'AMMO4': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.220', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'weapon4': '0.456', 'HITCOUNT': '0.460', 'ARMOR': '0.471', 'weapon3': '1.478', 'weapon2': '1.532', 'DAMAGECOUNT': '2.211', 'FRAGCOUNT': '3.500'}
[2023-02-25 13:11:39,763][2409074] Updated weights for policy 0, policy_version 19531 (0.0012)
[2023-02-25 13:11:40,891][2409096] Large shaping reward 2.517 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.495, 165.0), ('weapon5', 0.002)]
[2023-02-25 13:11:41,116][2409100] DAMAGECOUNT value on done: 5876.0
[2023-02-25 13:11:41,116][2409100] Sum rewards: 6.256, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.958', 'AMMO2': '0.009', 'AMMO5': '0.012', 'AMMO4': '0.045', 'AMMO3': '0.058', 'weapon7': '0.116', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.410', 'WEAPON3': '0.450', 'weapon2': '0.548', 'weapon3': '0.996', 'weapon4': '1.182', 'ARMOR': '1.333', 'DAMAGECOUNT': '1.776', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:11:41,166][2409074] Updated weights for policy 0, policy_version 19541 (0.0012)
[2023-02-25 13:11:42,186][2408954] Fps is (10 sec: 24988.6, 60 sec: 25531.8, 300 sec: 24992.5). Total num frames: 80056320. Throughput: 0: 6355.5. Samples: 20015928. Policy #0 lag: (min: 0.0, avg: 13.9, max: 27.0)
[2023-02-25 13:11:42,186][2408954] Avg episode reward: [(0, '8.586')]
[2023-02-25 13:11:43,176][2409103] DAMAGECOUNT value on done: 4645.0
[2023-02-25 13:11:43,179][2409103] Sum rewards: 6.912, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.868', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'weapon7': '0.092', 'AMMO3': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.128', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.590', 'WEAPON3': '0.850', 'weapon2': '1.332', 'weapon3': '1.638', 'DAMAGECOUNT': '2.250', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:11:43,218][2409074] Updated weights for policy 0, policy_version 19551 (0.0012)
[2023-02-25 13:11:44,029][2409468] DAMAGECOUNT value on done: 5103.0
[2023-02-25 13:11:44,034][2409468] Sum rewards: 2.163, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.110', 'AMMO5': '0.012', 'AMMO2': '0.017', 'weapon5': '0.064', 'AMMO3': '0.073', 'weapon7': '0.076', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HITCOUNT': '0.250', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.790', 'ARMOR': '0.800', 'weapon2': '0.806', 'DAMAGECOUNT': '0.933', 'FRAGCOUNT': '1.000', 'weapon3': '1.026'}
[2023-02-25 13:11:44,280][2409074] Updated weights for policy 0, policy_version 19561 (0.0012)
[2023-02-25 13:11:44,716][2409100] DAMAGECOUNT value on done: 6089.0
[2023-02-25 13:11:44,719][2409100] Sum rewards: 11.195, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'AMMO3': '0.070', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'weapon4': '0.130', 'weapon5': '0.170', 'WEAPON5': '0.200', 'HEALTH': '0.325', 'WEAPON3': '0.450', 'HITCOUNT': '1.030', 'weapon2': '1.650', 'weapon3': '1.772', 'DAMAGECOUNT': '3.639', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:11:45,588][2409549] DAMAGECOUNT value on done: 5681.0
[2023-02-25 13:11:45,592][2409549] Sum rewards: 16.581, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.009', 'AMMO5': '0.017', 'AMMO4': '0.045', 'WEAPON1': '0.050', 'weapon7': '0.076', 'AMMO3': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HEALTH': '0.559', 'HITCOUNT': '0.880', 'weapon2': '1.478', 'weapon3': '1.966', 'DAMAGECOUNT': '3.660', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:11:46,409][2409074] Updated weights for policy 0, policy_version 19571 (0.0012)
[2023-02-25 13:11:47,082][2409103] DAMAGECOUNT value on done: 7347.0
[2023-02-25 13:11:47,083][2409103] Sum rewards: 11.924, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.794', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'weapon7': '0.050', 'AMMO3': '0.063', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.204', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.680', 'ARMOR': '0.856', 'weapon3': '1.484', 'weapon2': '2.090', 'DAMAGECOUNT': '2.691', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:11:47,186][2408954] Fps is (10 sec: 24575.2, 60 sec: 25190.2, 300 sec: 24992.5). Total num frames: 80179200. Throughput: 0: 6355.4. Samples: 20053764. Policy #0 lag: (min: 0.0, avg: 13.9, max: 27.0)
[2023-02-25 13:11:47,187][2408954] Avg episode reward: [(0, '8.748')]
[2023-02-25 13:11:47,242][2409033] Saving new best policy, reward=8.748!
[2023-02-25 13:11:47,623][2409033] Signal inference workers to stop experience collection... (2350 times)
[2023-02-25 13:11:47,629][2409033] Signal inference workers to resume experience collection... (2350 times)
[2023-02-25 13:11:47,662][2409074] InferenceWorker_p0-w0: stopping experience collection (2350 times)
[2023-02-25 13:11:47,667][2409074] InferenceWorker_p0-w0: resuming experience collection (2350 times)
[2023-02-25 13:11:47,669][2409074] Updated weights for policy 0, policy_version 19581 (0.0012)
[2023-02-25 13:11:48,126][2409468] DAMAGECOUNT value on done: 5273.0
[2023-02-25 13:11:48,129][2409468] Sum rewards: 14.310, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.700', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'WEAPON1': '0.020', 'AMMO5': '0.026', 'AMMO3': '0.180', 'weapon5': '0.180', 'WEAPON5': '0.450', 'HITCOUNT': '1.020', 'WEAPON3': '1.100', 'weapon2': '1.224', 'ARMOR': '1.789', 'weapon3': '2.368', 'DAMAGECOUNT': '4.161', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:11:48,342][2409100] DAMAGECOUNT value on done: 4724.0
[2023-02-25 13:11:48,343][2409100] Sum rewards: 5.016, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.210', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO3': '0.070', 'AMMO4': '0.096', 'weapon7': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.158', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.262', 'WEAPON5': '0.300', 'HITCOUNT': '0.430', 'WEAPON3': '0.500', 'ARMOR': '0.894', 'DAMAGECOUNT': '1.149', 'weapon2': '1.442', 'weapon3': '1.636', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:11:49,199][2409549] DAMAGECOUNT value on done: 6662.0
[2023-02-25 13:11:49,200][2409549] Sum rewards: 11.419, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.148', 'AMMO2': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.036', 'ARMOR': '0.036', 'AMMO3': '0.053', 'weapon7': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.800', 'weapon2': '0.868', 'weapon4': '1.206', 'weapon3': '1.254', 'DAMAGECOUNT': '3.075', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:11:49,555][2409074] Updated weights for policy 0, policy_version 19591 (0.0014)
[2023-02-25 13:11:49,897][2409405] Large shaping reward 2.641 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO2', -0.0001, -1.0), ('AMMO4', -0.0005, -1.0), ('weapon2', 0.002)]
[2023-02-25 13:11:50,709][2409103] DAMAGECOUNT value on done: 4562.0
[2023-02-25 13:11:50,710][2409103] Sum rewards: 4.598, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.296', 'AMMO5': '0.017', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'weapon4': '0.064', 'weapon5': '0.094', 'AMMO4': '0.096', 'AMMO3': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'HITCOUNT': '0.750', 'WEAPON3': '0.850', 'weapon2': '1.172', 'ARMOR': '1.328', 'weapon3': '2.204', 'DAMAGECOUNT': '2.586', 'FRAGCOUNT': '3.500'}
[2023-02-25 13:11:51,271][2409074] Updated weights for policy 0, policy_version 19601 (0.0014)
[2023-02-25 13:11:52,186][2408954] Fps is (10 sec: 26623.9, 60 sec: 25736.5, 300 sec: 25062.0). Total num frames: 80322560. Throughput: 0: 6351.8. Samples: 20072892. Policy #0 lag: (min: 3.0, avg: 11.4, max: 27.0)
[2023-02-25 13:11:52,186][2408954] Avg episode reward: [(0, '8.666')]
[2023-02-25 13:11:52,254][2409074] Updated weights for policy 0, policy_version 19611 (0.0016)
[2023-02-25 13:11:52,485][2409100] DAMAGECOUNT value on done: 5721.0
[2023-02-25 13:11:52,488][2409100] Sum rewards: 5.327, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.520', 'AMMO5': '0.007', 'AMMO3': '0.020', 'AMMO2': '0.023', 'weapon5': '0.064', 'weapon7': '0.096', 'AMMO4': '0.115', 'WEAPON3': '0.150', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.368', 'ARMOR': '0.456', 'weapon3': '0.502', 'DAMAGECOUNT': '1.065', 'weapon2': '1.400', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:11:52,535][2409468] DAMAGECOUNT value on done: 5964.0
[2023-02-25 13:11:52,538][2409468] Sum rewards: 10.191, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.496', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.028', 'AMMO3': '0.080', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.212', 'WEAPON5': '0.350', 'ARMOR': '0.455', 'WEAPON3': '0.500', 'HITCOUNT': '0.740', 'weapon2': '1.514', 'weapon3': '1.514', 'DAMAGECOUNT': '2.913', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:11:53,099][2409549] DAMAGECOUNT value on done: 5361.0
[2023-02-25 13:11:53,099][2409549] Sum rewards: 4.786, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.454', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'AMMO4': '0.087', 'weapon7': '0.104', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'weapon4': '0.468', 'HITCOUNT': '0.510', 'weapon2': '0.916', 'weapon3': '1.042', 'DAMAGECOUNT': '1.680', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:11:54,319][2409103] DAMAGECOUNT value on done: 4481.0
[2023-02-25 13:11:54,320][2409103] Sum rewards: 11.894, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.587', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.039', 'AMMO3': '0.060', 'weapon5': '0.072', 'weapon4': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'HITCOUNT': '0.750', 'ARMOR': '0.854', 'weapon2': '1.288', 'weapon3': '1.688', 'DAMAGECOUNT': '3.105', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:11:54,619][2409074] Updated weights for policy 0, policy_version 19621 (0.0012)
[2023-02-25 13:11:55,568][2409074] Updated weights for policy 0, policy_version 19631 (0.0012)
[2023-02-25 13:11:56,298][2409100] DAMAGECOUNT value on done: 5962.0
[2023-02-25 13:11:56,302][2409100] Sum rewards: 12.264, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.659', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'WEAPON3': '0.400', 'weapon4': '0.442', 'HITCOUNT': '0.670', 'weapon2': '1.126', 'ARMOR': '1.313', 'weapon3': '1.606', 'DAMAGECOUNT': '2.847', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:11:56,789][2409549] DAMAGECOUNT value on done: 5481.0
[2023-02-25 13:11:56,792][2409549] Sum rewards: 5.866, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.970', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO3': '0.048', 'weapon7': '0.056', 'HITCOUNT': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.586', 'weapon3': '1.018', 'DAMAGECOUNT': '1.176', 'weapon2': '1.312', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:11:57,186][2408954] Fps is (10 sec: 26215.3, 60 sec: 25395.2, 300 sec: 25006.4). Total num frames: 80441344. Throughput: 0: 6338.4. Samples: 20110728. Policy #0 lag: (min: 3.0, avg: 11.4, max: 27.0)
[2023-02-25 13:11:57,186][2408954] Avg episode reward: [(0, '8.825')]
[2023-02-25 13:11:57,191][2409033] Saving new best policy, reward=8.825!
[2023-02-25 13:11:57,581][2409101] DAMAGECOUNT value on done: 4830.0
[2023-02-25 13:11:57,582][2409101] Sum rewards: 4.735, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.060', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO3': '0.076', 'weapon7': '0.076', 'weapon5': '0.112', 'AMMO4': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.408', 'WEAPON3': '0.500', 'weapon4': '1.104', 'weapon3': '1.390', 'DAMAGECOUNT': '1.611', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:11:57,919][2409074] Updated weights for policy 0, policy_version 19641 (0.0013)
[2023-02-25 13:11:58,355][2409103] DAMAGECOUNT value on done: 4980.0
[2023-02-25 13:11:58,358][2409103] Sum rewards: 12.345, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.730', 'AMMO5': '0.013', 'WEAPON1': '0.030', 'AMMO2': '0.033', 'AMMO3': '0.102', 'WEAPON4': '0.150', 'AMMO4': '0.165', 'weapon5': '0.228', 'weapon4': '0.252', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.930', 'weapon2': '1.278', 'weapon3': '1.758', 'DAMAGECOUNT': '3.735', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:11:58,925][2409074] Updated weights for policy 0, policy_version 19651 (0.0012)
[2023-02-25 13:11:59,946][2409102] DAMAGECOUNT value on done: 6790.0
[2023-02-25 13:11:59,956][2409102] Sum rewards: 11.535, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.484', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.071', 'AMMO4': '0.114', 'weapon7': '0.116', 'weapon5': '0.116', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO6': '0.260', 'AMMO7': '0.260', 'WEAPON7': '0.300', 'weapon4': '0.464', 'WEAPON3': '0.500', 'HITCOUNT': '0.640', 'ARMOR': '0.850', 'weapon3': '1.372', 'weapon2': '1.490', 'DAMAGECOUNT': '2.763', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:12:00,274][2409100] DAMAGECOUNT value on done: 5076.0
[2023-02-25 13:12:00,277][2409100] Sum rewards: 8.137, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.150', 'AMMO5': '0.015', 'AMMO2': '0.049', 'AMMO3': '0.073', 'weapon5': '0.202', 'AMMO4': '0.247', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.500', 'HITCOUNT': '0.620', 'weapon4': '0.688', 'weapon2': '1.104', 'weapon3': '1.532', 'DAMAGECOUNT': '3.006', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:12:00,354][2409074] Updated weights for policy 0, policy_version 19661 (0.0013)
[2023-02-25 13:12:00,582][2409549] DAMAGECOUNT value on done: 6681.0
[2023-02-25 13:12:00,583][2409549] Sum rewards: 14.099, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.200', 'AMMO2': '0.009', 'AMMO5': '0.020', 'AMMO4': '0.046', 'weapon7': '0.074', 'AMMO3': '0.097', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.286', 'WEAPON7': '0.300', 'weapon4': '0.340', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '0.740', 'weapon3': '1.390', 'weapon2': '1.552', 'ARMOR': '1.758', 'DAMAGECOUNT': '3.696', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:12:01,512][2409101] DAMAGECOUNT value on done: 6278.0
[2023-02-25 13:12:01,514][2409101] Sum rewards: 5.034, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.368', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'weapon4': '0.024', 'AMMO3': '0.044', 'weapon7': '0.048', 'WEAPON4': '0.050', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.230', 'WEAPON3': '0.300', 'weapon3': '0.650', 'ARMOR': '0.861', 'weapon2': '1.060', 'DAMAGECOUNT': '1.524', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:12:02,186][2408954] Fps is (10 sec: 22937.4, 60 sec: 25053.8, 300 sec: 24923.1). Total num frames: 80551936. Throughput: 0: 6323.7. Samples: 20148372. Policy #0 lag: (min: 0.0, avg: 12.4, max: 25.0)
[2023-02-25 13:12:02,186][2408954] Avg episode reward: [(0, '8.870')]
[2023-02-25 13:12:02,187][2409033] Saving new best policy, reward=8.870!
[2023-02-25 13:12:02,217][2409103] DAMAGECOUNT value on done: 5100.0
[2023-02-25 13:12:02,217][2409103] Sum rewards: 5.066, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.997', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.062', 'weapon4': '0.190', 'weapon5': '0.198', 'WEAPON5': '0.400', 'ARMOR': '0.400', 'HITCOUNT': '0.510', 'WEAPON3': '0.550', 'weapon3': '1.400', 'weapon2': '1.810', 'DAMAGECOUNT': '1.947', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:12:02,581][2409074] Updated weights for policy 0, policy_version 19671 (0.0012)
[2023-02-25 13:12:03,676][2409102] DAMAGECOUNT value on done: 5805.0
[2023-02-25 13:12:03,679][2409102] Sum rewards: 11.003, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.676', 'AMMO5': '0.017', 'AMMO2': '0.026', 'weapon7': '0.050', 'weapon5': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.126', 'AMMO4': '0.129', 'WEAPON5': '0.350', 'ARMOR': '0.404', 'weapon4': '0.542', 'HITCOUNT': '0.730', 'WEAPON3': '0.800', 'weapon2': '0.944', 'weapon3': '1.762', 'DAMAGECOUNT': '3.561', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:12:03,691][2409074] Updated weights for policy 0, policy_version 19681 (0.0012)
[2023-02-25 13:12:03,900][2409100] DAMAGECOUNT value on done: 6149.0
[2023-02-25 13:12:03,904][2409100] Sum rewards: 8.967, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.097', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO3': '0.109', 'AMMO4': '0.132', 'weapon7': '0.140', 'weapon5': '0.194', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'ARMOR': '0.452', 'weapon4': '0.704', 'HITCOUNT': '0.720', 'WEAPON3': '0.750', 'weapon2': '1.126', 'weapon3': '1.178', 'DAMAGECOUNT': '2.730', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:12:04,341][2409485] DAMAGECOUNT value on done: 5697.0
[2023-02-25 13:12:04,344][2409485] Sum rewards: 5.014, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.840', 'AMMO2': '0.008', 'AMMO5': '0.017', 'AMMO4': '0.039', 'WEAPON1': '0.060', 'AMMO3': '0.111', 'WEAPON4': '0.200', 'weapon4': '0.236', 'weapon5': '0.294', 'WEAPON5': '0.500', 'HITCOUNT': '0.520', 'WEAPON3': '0.750', 'ARMOR': '0.909', 'weapon2': '1.550', 'weapon3': '1.596', 'DAMAGECOUNT': '2.814', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:12:04,394][2409549] DAMAGECOUNT value on done: 6531.0
[2023-02-25 13:12:04,397][2409549] Sum rewards: 9.629, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.170', 'AMMO5': '0.010', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO3': '0.067', 'AMMO4': '0.068', 'weapon7': '0.146', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.236', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.420', 'WEAPON3': '0.450', 'weapon4': '0.524', 'weapon3': '0.830', 'ARMOR': '0.900', 'weapon2': '2.048', 'DAMAGECOUNT': '2.826', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:12:05,176][2409101] DAMAGECOUNT value on done: 7166.0
[2023-02-25 13:12:05,177][2409101] Sum rewards: 19.998, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.104', 'AMMO2': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'AMMO3': '0.082', 'weapon5': '0.120', 'WEAPON4': '0.150', 'weapon7': '0.196', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'WEAPON7': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.622', 'ARMOR': '0.848', 'HITCOUNT': '1.020', 'weapon2': '1.078', 'weapon3': '1.342', 'DAMAGECOUNT': '5.700', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:12:05,837][2409103] DAMAGECOUNT value on done: 5139.0
[2023-02-25 13:12:05,840][2409103] Sum rewards: 9.696, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.880', 'AMMO2': '0.002', 'AMMO4': '0.012', 'AMMO5': '0.016', 'WEAPON1': '0.030', 'weapon7': '0.064', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.210', 'weapon4': '0.296', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.690', 'ARMOR': '0.855', 'weapon2': '1.336', 'weapon3': '1.472', 'DAMAGECOUNT': '2.325', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:12:06,108][2409074] Updated weights for policy 0, policy_version 19691 (0.0012)
[2023-02-25 13:12:06,376][2409103] Large shaping reward 3.637 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.015, -5.0), ('weapon7', 0.002)]
[2023-02-25 13:12:07,149][2409074] Updated weights for policy 0, policy_version 19701 (0.0012)
[2023-02-25 13:12:07,187][2408954] Fps is (10 sec: 25802.8, 60 sec: 25531.5, 300 sec: 25061.9). Total num frames: 80699392. Throughput: 0: 6321.8. Samples: 20167368. Policy #0 lag: (min: 0.0, avg: 12.4, max: 25.0)
[2023-02-25 13:12:07,187][2408954] Avg episode reward: [(0, '9.024')]
[2023-02-25 13:12:07,194][2409033] Saving new best policy, reward=9.024!
[2023-02-25 13:12:07,596][2409102] DAMAGECOUNT value on done: 6475.0
[2023-02-25 13:12:07,596][2409102] Sum rewards: 5.716, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.936', 'AMMO2': '0.026', 'weapon4': '0.028', 'AMMO5': '0.030', 'WEAPON1': '0.040', 'AMMO4': '0.127', 'AMMO3': '0.130', 'WEAPON4': '0.150', 'weapon5': '0.304', 'ARMOR': '0.400', 'HITCOUNT': '0.530', 'WEAPON5': '0.650', 'WEAPON3': '0.750', 'weapon3': '1.648', 'weapon2': '1.656', 'DAMAGECOUNT': '2.433', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:12:07,621][2409100] DAMAGECOUNT value on done: 5627.0
[2023-02-25 13:12:07,622][2409100] Sum rewards: 1.294, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.836', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.016', 'AMMO3': '0.074', 'weapon5': '0.078', 'AMMO4': '0.082', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'weapon4': '0.626', 'HITCOUNT': '0.640', 'ARMOR': '0.936', 'weapon3': '1.114', 'weapon2': '1.530', 'DAMAGECOUNT': '1.959', 'FRAGCOUNT': '2.500'}
[2023-02-25 13:12:08,027][2409549] DAMAGECOUNT value on done: 5756.0
[2023-02-25 13:12:08,028][2409549] Sum rewards: 10.796, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.378', 'AMMO5': '0.012', 'AMMO2': '0.030', 'WEAPON1': '0.060', 'weapon5': '0.092', 'AMMO3': '0.137', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'weapon4': '0.218', 'WEAPON5': '0.250', 'ARMOR': '0.420', 'HITCOUNT': '0.770', 'WEAPON3': '0.800', 'weapon2': '1.204', 'weapon3': '1.836', 'DAMAGECOUNT': '3.546', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:12:08,474][2409485] DAMAGECOUNT value on done: 6679.0
[2023-02-25 13:12:08,475][2409485] Sum rewards: 11.002, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.133', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO3': '0.105', 'WEAPON4': '0.150', 'weapon5': '0.152', 'weapon4': '0.298', 'WEAPON5': '0.400', 'HITCOUNT': '0.730', 'WEAPON3': '0.750', 'weapon2': '1.258', 'weapon3': '1.872', 'DAMAGECOUNT': '3.414', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:12:08,860][2409101] DAMAGECOUNT value on done: 6231.0
[2023-02-25 13:12:08,862][2409101] Sum rewards: 13.882, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.545', 'AMMO2': '0.005', 'AMMO5': '0.009', 'AMMO4': '0.024', 'AMMO3': '0.040', 'weapon7': '0.058', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.174', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'weapon4': '0.578', 'HITCOUNT': '0.680', 'ARMOR': '0.955', 'weapon3': '0.974', 'weapon2': '1.110', 'DAMAGECOUNT': '3.330', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:12:08,899][2409074] Updated weights for policy 0, policy_version 19711 (0.0012)
[2023-02-25 13:12:09,937][2409103] DAMAGECOUNT value on done: 5853.0
[2023-02-25 13:12:09,940][2409103] Sum rewards: 12.558, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.611', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO3': '0.070', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.453', 'WEAPON3': '0.550', 'weapon4': '0.634', 'HITCOUNT': '0.850', 'weapon2': '0.860', 'weapon3': '1.334', 'DAMAGECOUNT': '3.330', 'FRAGCOUNT': '8.500'}
[2023-02-25 13:12:10,770][2409074] Updated weights for policy 0, policy_version 19721 (0.0013)
[2023-02-25 13:12:10,836][2409077] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)]
[2023-02-25 13:12:11,290][2409102] DAMAGECOUNT value on done: 6465.0
[2023-02-25 13:12:11,290][2409102] Sum rewards: 14.735, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.671', 'AMMO2': '0.005', 'AMMO5': '0.015', 'AMMO4': '0.026', 'weapon7': '0.058', 'AMMO3': '0.077', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.194', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.680', 'ARMOR': '0.856', 'weapon3': '1.534', 'weapon2': '1.556', 'DAMAGECOUNT': '3.354', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:12:11,718][2409549] DAMAGECOUNT value on done: 5601.0
[2023-02-25 13:12:11,719][2409074] Updated weights for policy 0, policy_version 19731 (0.0012)
[2023-02-25 13:12:11,718][2409549] Sum rewards: 1.534, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.033', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'AMMO5': '0.028', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.108', 'AMMO4': '0.118', 'AMMO3': '0.142', 'WEAPON4': '0.400', 'ARMOR': '0.453', 'HITCOUNT': '0.540', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon2': '1.018', 'weapon4': '1.112', 'weapon3': '1.344', 'DAMAGECOUNT': '2.121', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:12:12,160][2409485] DAMAGECOUNT value on done: 4821.0
[2023-02-25 13:12:12,165][2409485] Sum rewards: 10.239, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.053', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.043', 'AMMO3': '0.063', 'weapon5': '0.108', 'weapon7': '0.162', 'AMMO4': '0.213', 'WEAPON4': '0.300', 'weapon4': '0.310', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.590', 'weapon2': '1.158', 'weapon3': '1.432', 'DAMAGECOUNT': '3.240', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:12:12,186][2408954] Fps is (10 sec: 27852.9, 60 sec: 25668.4, 300 sec: 25075.8). Total num frames: 80830464. Throughput: 0: 6323.7. Samples: 20205336. Policy #0 lag: (min: 0.0, avg: 12.4, max: 25.0)
[2023-02-25 13:12:12,186][2408954] Avg episode reward: [(0, '9.226')]
[2023-02-25 13:12:12,187][2409033] Saving new best policy, reward=9.226!
[2023-02-25 13:12:12,521][2409100] DAMAGECOUNT value on done: 6609.0
[2023-02-25 13:12:12,521][2409100] Sum rewards: 8.953, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.243', 'AMMO5': '0.010', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'weapon7': '0.050', 'AMMO4': '0.051', 'weapon5': '0.106', 'AMMO3': '0.125', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'weapon4': '0.518', 'HITCOUNT': '0.660', 'WEAPON3': '0.850', 'ARMOR': '0.853', 'weapon2': '1.002', 'weapon3': '1.876', 'DAMAGECOUNT': '3.174', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:12:12,557][2409101] DAMAGECOUNT value on done: 6551.0
[2023-02-25 13:12:12,558][2409101] Sum rewards: -0.276, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.542', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.034', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'weapon5': '0.126', 'weapon4': '0.140', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.492', 'weapon3': '1.628', 'DAMAGECOUNT': '1.815'}
[2023-02-25 13:12:13,683][2409103] DAMAGECOUNT value on done: 5121.0
[2023-02-25 13:12:13,686][2409103] Sum rewards: 7.331, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.327', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.008', 'WEAPON1': '0.020', 'weapon7': '0.052', 'weapon5': '0.082', 'AMMO3': '0.089', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.386', 'HITCOUNT': '0.570', 'WEAPON3': '0.600', 'weapon2': '0.852', 'weapon3': '1.156', 'DAMAGECOUNT': '2.244', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:12:14,094][2409074] Updated weights for policy 0, policy_version 19741 (0.0013)
[2023-02-25 13:12:14,362][2409079] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:12:14,396][2409548] DAMAGECOUNT value on done: 5243.0
[2023-02-25 13:12:14,397][2409548] Sum rewards: 5.431, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.762', 'AMMO2': '0.005', 'AMMO5': '0.023', 'AMMO4': '0.026', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.134', 'weapon4': '0.316', 'weapon5': '0.340', 'ARMOR': '0.446', 'WEAPON5': '0.550', 'HITCOUNT': '0.630', 'weapon2': '0.694', 'WEAPON3': '0.950', 'weapon3': '2.062', 'DAMAGECOUNT': '2.367', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:12:14,935][2409102] DAMAGECOUNT value on done: 5890.0
[2023-02-25 13:12:14,936][2409102] Sum rewards: 4.881, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.526', 'AMMO2': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.036', 'AMMO3': '0.077', 'weapon5': '0.116', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.455', 'weapon4': '0.556', 'WEAPON3': '0.600', 'HITCOUNT': '0.740', 'weapon3': '1.386', 'weapon2': '1.442', 'DAMAGECOUNT': '2.451', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:12:15,101][2409597] DAMAGECOUNT value on done: 5818.0
[2023-02-25 13:12:15,102][2409597] Sum rewards: 10.855, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.952', 'AMMO5': '0.025', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'weapon4': '0.060', 'weapon7': '0.090', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'AMMO4': '0.133', 'weapon5': '0.248', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.650', 'ARMOR': '0.800', 'weapon2': '1.450', 'weapon3': '1.832', 'DAMAGECOUNT': '3.021', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:12:15,132][2409074] Updated weights for policy 0, policy_version 19751 (0.0012)
[2023-02-25 13:12:15,665][2409549] DAMAGECOUNT value on done: 5149.0
[2023-02-25 13:12:15,669][2409549] Sum rewards: 10.828, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO3': '0.050', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'weapon5': '0.130', 'HEALTH': '0.264', 'WEAPON3': '0.300', 'HITCOUNT': '0.620', 'weapon3': '1.344', 'weapon2': '1.482', 'DAMAGECOUNT': '2.430', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:12:16,595][2409485] DAMAGECOUNT value on done: 6345.0
[2023-02-25 13:12:16,596][2409485] Sum rewards: 6.296, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.748', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO5': '0.020', 'AMMO4': '0.079', 'AMMO3': '0.080', 'WEAPON4': '0.200', 'weapon5': '0.268', 'HITCOUNT': '0.330', 'ARMOR': '0.458', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'weapon4': '0.586', 'weapon3': '1.264', 'weapon2': '1.580', 'DAMAGECOUNT': '2.853', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:12:16,632][2409101] DAMAGECOUNT value on done: 6005.0
[2023-02-25 13:12:16,633][2409101] Sum rewards: 2.627, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.194', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon7': '0.058', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.131', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.296', 'ARMOR': '0.400', 'weapon4': '0.408', 'WEAPON3': '0.450', 'HITCOUNT': '0.460', 'FRAGCOUNT': '0.500', 'weapon2': '1.404', 'DAMAGECOUNT': '1.521', 'weapon3': '1.526'}
[2023-02-25 13:12:16,842][2409100] DAMAGECOUNT value on done: 4915.0
[2023-02-25 13:12:16,842][2409100] Sum rewards: 6.657, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.350', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon7': '0.052', 'AMMO3': '0.064', 'weapon5': '0.074', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.400', 'WEAPON3': '0.550', 'weapon4': '0.636', 'weapon2': '1.106', 'weapon3': '1.370', 'DAMAGECOUNT': '1.485', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:12:17,186][2408954] Fps is (10 sec: 23758.6, 60 sec: 25053.8, 300 sec: 25006.5). Total num frames: 80936960. Throughput: 0: 6307.1. Samples: 20242572. Policy #0 lag: (min: 1.0, avg: 11.6, max: 24.0)
[2023-02-25 13:12:17,186][2408954] Avg episode reward: [(0, '9.028')]
[2023-02-25 13:12:17,193][2409033] Saving /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000019760_80936960.pth...
[2023-02-25 13:12:17,294][2409033] Removing /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000018284_74891264.pth
[2023-02-25 13:12:17,364][2409074] Updated weights for policy 0, policy_version 19761 (0.0012)
[2023-02-25 13:12:18,171][2409103] DAMAGECOUNT value on done: 4832.0
[2023-02-25 13:12:18,175][2409103] Sum rewards: 7.289, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.248', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO3': '0.078', 'weapon7': '0.080', 'AMMO4': '0.160', 'weapon5': '0.224', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'AMMO6': '0.500', 'WEAPON7': '0.500', 'AMMO7': '0.500', 'HITCOUNT': '0.560', 'weapon4': '0.936', 'weapon3': '1.036', 'weapon2': '1.138', 'ARMOR': '1.254', 'DAMAGECOUNT': '1.824', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:12:18,208][2409548] DAMAGECOUNT value on done: 4820.0
[2023-02-25 13:12:18,212][2409548] Sum rewards: 3.452, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.356', 'weapon5': '0.004', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon7': '0.056', 'AMMO3': '0.103', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.310', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.572', 'WEAPON3': '0.600', 'weapon4': '0.892', 'weapon3': '1.288', 'DAMAGECOUNT': '1.728', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:12:18,584][2409074] Updated weights for policy 0, policy_version 19771 (0.0012)
[2023-02-25 13:12:18,718][2409102] DAMAGECOUNT value on done: 5616.0
[2023-02-25 13:12:18,719][2409102] Sum rewards: 5.663, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.370', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.102', 'AMMO3': '0.112', 'AMMO4': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.324', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '0.750', 'weapon2': '1.322', 'weapon3': '1.538', 'DAMAGECOUNT': '2.535', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:12:18,804][2409597] DAMAGECOUNT value on done: 6765.0
[2023-02-25 13:12:18,806][2409597] Sum rewards: 18.609, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.147', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO3': '0.070', 'WEAPON5': '0.200', 'weapon5': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.950', 'weapon2': '1.612', 'weapon3': '1.804', 'DAMAGECOUNT': '4.506', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:12:19,082][2409565] DAMAGECOUNT value on done: 5710.0
[2023-02-25 13:12:19,086][2409565] Sum rewards: 5.729, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.256', 'AMMO2': '0.018', 'AMMO5': '0.029', 'weapon7': '0.050', 'weapon5': '0.072', 'AMMO4': '0.088', 'AMMO3': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.450', 'HITCOUNT': '0.620', 'weapon4': '0.630', 'WEAPON5': '0.650', 'WEAPON3': '0.700', 'ARMOR': '0.946', 'weapon3': '0.968', 'DAMAGECOUNT': '2.955', 'FRAGCOUNT': '6.500'}
[2023-02-25 13:12:19,157][2409548] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:12:19,909][2409549] DAMAGECOUNT value on done: 5623.0
[2023-02-25 13:12:19,910][2409549] Sum rewards: 14.502, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.620', 'AMMO5': '0.010', 'AMMO2': '0.014', 'WEAPON1': '0.040', 'AMMO4': '0.067', 'AMMO3': '0.076', 'weapon5': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'weapon4': '0.520', 'HITCOUNT': '0.810', 'ARMOR': '0.910', 'weapon2': '1.240', 'weapon3': '1.644', 'DAMAGECOUNT': '3.657', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:12:20,327][2409074] Updated weights for policy 0, policy_version 19781 (0.0013)
[2023-02-25 13:12:20,393][2409485] DAMAGECOUNT value on done: 6843.0
[2023-02-25 13:12:20,397][2409485] Sum rewards: 12.777, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.586', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.031', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'weapon5': '0.222', 'weapon4': '0.306', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '0.940', 'weapon2': '1.138', 'weapon3': '1.752', 'DAMAGECOUNT': '4.053', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:12:20,701][2409100] DAMAGECOUNT value on done: 5151.0
[2023-02-25 13:12:20,705][2409100] Sum rewards: 11.207, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.295', 'AMMO2': '0.010', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'AMMO3': '0.125', 'weapon4': '0.164', 'weapon5': '0.218', 'WEAPON5': '0.500', 'HITCOUNT': '0.750', 'WEAPON3': '0.800', 'ARMOR': '0.950', 'weapon2': '1.504', 'weapon3': '1.750', 'DAMAGECOUNT': '3.282', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:12:20,894][2409101] DAMAGECOUNT value on done: 4965.0
[2023-02-25 13:12:20,897][2409101] Sum rewards: 2.129, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.885', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.016', 'WEAPON5': '0.050', 'AMMO3': '0.066', 'weapon7': '0.132', 'HITCOUNT': '0.160', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.250', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.630', 'DAMAGECOUNT': '0.699', 'weapon3': '0.768', 'FRAGCOUNT': '1.000', 'ARMOR': '1.364', 'weapon2': '1.788'}
[2023-02-25 13:12:21,766][2409103] DAMAGECOUNT value on done: 5093.0
[2023-02-25 13:12:21,767][2409103] Sum rewards: 10.748, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.589', 'AMMO5': '0.009', 'AMMO2': '0.018', 'AMMO3': '0.040', 'weapon7': '0.048', 'AMMO4': '0.090', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.560', 'weapon3': '0.980', 'weapon4': '1.018', 'weapon2': '1.468', 'DAMAGECOUNT': '2.751', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:12:21,839][2409074] Updated weights for policy 0, policy_version 19791 (0.0012)
[2023-02-25 13:12:22,076][2409548] DAMAGECOUNT value on done: 6603.0
[2023-02-25 13:12:22,079][2409548] Sum rewards: 10.467, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.005', 'AMMO2': '0.007', 'AMMO5': '0.020', 'AMMO4': '0.034', 'AMMO3': '0.076', 'weapon5': '0.102', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.820', 'weapon3': '1.594', 'weapon2': '1.602', 'DAMAGECOUNT': '2.817', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:12:22,186][2408954] Fps is (10 sec: 24166.4, 60 sec: 25326.9, 300 sec: 25048.1). Total num frames: 81072128. Throughput: 0: 6310.1. Samples: 20261724. Policy #0 lag: (min: 1.0, avg: 11.6, max: 24.0)
[2023-02-25 13:12:22,186][2408954] Avg episode reward: [(0, '9.129')]
[2023-02-25 13:12:22,588][2409597] DAMAGECOUNT value on done: 4866.0
[2023-02-25 13:12:22,588][2409102] DAMAGECOUNT value on done: 6244.0
[2023-02-25 13:12:22,588][2409597] Sum rewards: 8.903, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.220', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'weapon7': '0.052', 'AMMO3': '0.080', 'AMMO4': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.455', 'WEAPON3': '0.550', 'HITCOUNT': '0.600', 'weapon4': '0.918', 'weapon2': '1.140', 'weapon3': '1.256', 'DAMAGECOUNT': '2.736', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:12:22,589][2409102] Sum rewards: 7.348, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.839', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO5': '0.003', 'weapon5': '0.044', 'WEAPON4': '0.050', 'AMMO3': '0.067', 'WEAPON5': '0.100', 'weapon4': '0.102', 'WEAPON3': '0.500', 'HITCOUNT': '0.600', 'ARMOR': '0.898', 'weapon3': '1.208', 'weapon2': '2.220', 'DAMAGECOUNT': '2.685', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:12:23,218][2409565] DAMAGECOUNT value on done: 5944.0
[2023-02-25 13:12:23,218][2409565] Sum rewards: 5.718, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.017', 'AMMO2': '0.031', 'AMMO3': '0.096', 'weapon4': '0.098', 'weapon5': '0.126', 'WEAPON4': '0.150', 'AMMO4': '0.155', 'WEAPON5': '0.400', 'HEALTH': '0.410', 'WEAPON3': '0.550', 'HITCOUNT': '0.710', 'ARMOR': '1.258', 'weapon3': '1.470', 'weapon2': '1.900', 'DAMAGECOUNT': '2.346', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:12:23,624][2409074] Updated weights for policy 0, policy_version 19801 (0.0012)
[2023-02-25 13:12:24,004][2409549] DAMAGECOUNT value on done: 4904.0
[2023-02-25 13:12:24,005][2409549] Sum rewards: 4.148, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.886', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon7': '0.058', 'AMMO3': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.464', 'WEAPON3': '0.500', 'HITCOUNT': '0.580', 'weapon4': '1.106', 'weapon2': '1.272', 'weapon3': '1.294', 'DAMAGECOUNT': '1.857', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:12:24,061][2409485] DAMAGECOUNT value on done: 6818.0
[2023-02-25 13:12:24,062][2409485] Sum rewards: 8.168, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.279', 'AMMO2': '0.002', 'WEAPON1': '0.010', 'AMMO4': '0.011', 'AMMO5': '0.015', 'AMMO3': '0.085', 'WEAPON4': '0.150', 'weapon5': '0.158', 'weapon4': '0.232', 'WEAPON5': '0.400', 'HITCOUNT': '0.650', 'WEAPON3': '0.700', 'ARMOR': '0.959', 'weapon3': '1.658', 'weapon2': '1.730', 'DAMAGECOUNT': '2.937', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:12:24,749][2409100] DAMAGECOUNT value on done: 6577.0
[2023-02-25 13:12:24,750][2409100] Sum rewards: 7.089, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'HEALTH': '0.026', 'AMMO3': '0.030', 'AMMO4': '0.036', 'WEAPON5': '0.050', 'weapon5': '0.072', 'weapon7': '0.132', 'WEAPON4': '0.150', 'WEAPON3': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HITCOUNT': '0.420', 'weapon3': '0.736', 'weapon2': '1.166', 'weapon4': '1.190', 'DAMAGECOUNT': '2.121', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:12:24,831][2409101] DAMAGECOUNT value on done: 4073.0
[2023-02-25 13:12:24,832][2409101] Sum rewards: 6.857, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.755', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.047', 'weapon7': '0.052', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.124', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.356', 'HITCOUNT': '0.440', 'WEAPON3': '0.450', 'weapon3': '0.748', 'DAMAGECOUNT': '1.959', 'weapon2': '2.082', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:12:25,371][2409103] DAMAGECOUNT value on done: 6790.0
[2023-02-25 13:12:25,375][2409103] Sum rewards: 14.167, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.445', 'AMMO2': '0.015', 'AMMO5': '0.017', 'WEAPON1': '0.050', 'weapon7': '0.062', 'AMMO3': '0.074', 'AMMO4': '0.077', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'weapon4': '0.454', 'WEAPON3': '0.500', 'HITCOUNT': '0.930', 'weapon2': '1.410', 'weapon3': '1.568', 'DAMAGECOUNT': '3.534', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:12:25,540][2409074] Updated weights for policy 0, policy_version 19811 (0.0012)
[2023-02-25 13:12:26,000][2409548] DAMAGECOUNT value on done: 5047.0
[2023-02-25 13:12:26,001][2409548] Sum rewards: 11.215, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.295', 'AMMO2': '0.018', 'AMMO5': '0.022', 'AMMO3': '0.075', 'AMMO4': '0.087', 'weapon7': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.324', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.614', 'HITCOUNT': '0.670', 'ARMOR': '0.855', 'weapon3': '1.338', 'weapon2': '1.340', 'DAMAGECOUNT': '2.832', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:12:26,118][2409596] DAMAGECOUNT value on done: 6723.0
[2023-02-25 13:12:26,121][2409596] Sum rewards: 7.154, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.192', 'AMMO5': '0.005', 'AMMO2': '0.031', 'AMMO3': '0.040', 'weapon5': '0.070', 'WEAPON5': '0.100', 'weapon7': '0.118', 'AMMO4': '0.156', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.250', 'WEAPON4': '0.300', 'WEAPON7': '0.400', 'HITCOUNT': '0.400', 'ARMOR': '0.488', 'weapon2': '0.656', 'weapon4': '0.814', 'weapon3': '1.072', 'DAMAGECOUNT': '1.716', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:12:26,236][2409597] DAMAGECOUNT value on done: 5923.0
[2023-02-25 13:12:26,237][2409597] Sum rewards: 15.280, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.111', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.080', 'weapon5': '0.122', 'WEAPON5': '0.250', 'weapon4': '0.254', 'ARMOR': '0.451', 'WEAPON3': '0.500', 'HITCOUNT': '0.810', 'weapon2': '1.406', 'weapon3': '1.654', 'DAMAGECOUNT': '3.195', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:12:26,361][2409074] Updated weights for policy 0, policy_version 19821 (0.0013)
[2023-02-25 13:12:26,535][2409102] DAMAGECOUNT value on done: 5469.0
[2023-02-25 13:12:26,536][2409102] Sum rewards: 10.829, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.241', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.016', 'AMMO4': '0.057', 'AMMO3': '0.070', 'weapon5': '0.344', 'ARMOR': '0.424', 'WEAPON3': '0.450', 'WEAPON5': '0.450', 'HITCOUNT': '0.520', 'weapon2': '1.446', 'weapon3': '1.718', 'DAMAGECOUNT': '2.304', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:12:26,744][2409105] DAMAGECOUNT value on done: 5416.0
[2023-02-25 13:12:26,745][2409105] Sum rewards: 5.888, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.442', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon7': '0.050', 'AMMO3': '0.091', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.121', 'weapon5': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.380', 'ARMOR': '0.428', 'weapon2': '0.496', 'weapon4': '0.516', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.185', 'weapon3': '1.614', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:12:26,968][2409565] DAMAGECOUNT value on done: 6296.0
[2023-02-25 13:12:26,971][2409565] Sum rewards: 10.020, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.439', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO3': '0.020', 'AMMO4': '0.081', 'weapon7': '0.134', 'weapon5': '0.188', 'WEAPON3': '0.200', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.410', 'weapon3': '0.514', 'weapon4': '0.864', 'weapon2': '1.366', 'DAMAGECOUNT': '2.766', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:12:27,186][2408954] Fps is (10 sec: 26214.5, 60 sec: 25463.5, 300 sec: 25089.8). Total num frames: 81199104. Throughput: 0: 6298.9. Samples: 20299380. Policy #0 lag: (min: 1.0, avg: 11.6, max: 24.0)
[2023-02-25 13:12:27,186][2408954] Avg episode reward: [(0, '8.987')]
[2023-02-25 13:12:27,684][2409549] DAMAGECOUNT value on done: 5309.0
[2023-02-25 13:12:27,688][2409549] Sum rewards: 4.458, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.844', 'AMMO5': '0.020', 'AMMO2': '0.036', 'weapon7': '0.050', 'AMMO3': '0.061', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'AMMO4': '0.177', 'WEAPON7': '0.200', 'HITCOUNT': '0.270', 'weapon5': '0.316', 'weapon4': '0.330', 'WEAPON3': '0.450', 'WEAPON5': '0.450', 'ARMOR': '0.843', 'weapon3': '1.352', 'DAMAGECOUNT': '1.635', 'weapon2': '1.722', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:12:28,160][2409485] DAMAGECOUNT value on done: 5015.0
[2023-02-25 13:12:28,169][2409485] Sum rewards: 9.762, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.041', 'AMMO5': '0.003', 'AMMO2': '0.026', 'AMMO3': '0.041', 'weapon5': '0.062', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon7': '0.102', 'AMMO4': '0.131', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.276', 'WEAPON3': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.440', 'ARMOR': '0.800', 'weapon3': '0.958', 'DAMAGECOUNT': '1.758', 'weapon2': '2.466', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:12:28,314][2409100] DAMAGECOUNT value on done: 6379.0
[2023-02-25 13:12:28,317][2409100] Sum rewards: 12.479, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.026', 'HEALTH': '0.038', 'AMMO3': '0.050', 'weapon7': '0.052', 'AMMO4': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.154', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.630', 'weapon3': '1.202', 'weapon2': '1.926', 'DAMAGECOUNT': '2.952', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:12:28,533][2409101] DAMAGECOUNT value on done: 5286.0
[2023-02-25 13:12:28,536][2409101] Sum rewards: 7.099, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.844', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO3': '0.044', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO4': '0.060', 'weapon5': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'WEAPON3': '0.350', 'HITCOUNT': '0.460', 'ARMOR': '0.500', 'weapon4': '0.834', 'weapon3': '0.918', 'weapon2': '1.228', 'DAMAGECOUNT': '2.460', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:12:28,806][2409074] Updated weights for policy 0, policy_version 19831 (0.0012)
[2023-02-25 13:12:29,570][2409103] DAMAGECOUNT value on done: 6262.0
[2023-02-25 13:12:29,573][2409103] Sum rewards: 12.403, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.778', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO5': '0.029', 'AMMO4': '0.032', 'AMMO3': '0.072', 'WEAPON4': '0.150', 'weapon5': '0.318', 'weapon4': '0.480', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'ARMOR': '0.804', 'HITCOUNT': '0.820', 'weapon2': '1.294', 'weapon3': '1.620', 'DAMAGECOUNT': '3.636', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:12:29,734][2409548] DAMAGECOUNT value on done: 6291.0
[2023-02-25 13:12:29,737][2409548] Sum rewards: 15.878, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.558', 'weapon5': '0.002', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.028', 'weapon7': '0.062', 'AMMO3': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '1.080', 'weapon3': '1.514', 'weapon2': '2.034', 'DAMAGECOUNT': '4.581', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:12:29,824][2409074] Updated weights for policy 0, policy_version 19841 (0.0012)
[2023-02-25 13:12:29,940][2409597] DAMAGECOUNT value on done: 6506.0
[2023-02-25 13:12:29,944][2409597] Sum rewards: 12.648, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.540', 'AMMO2': '0.008', 'AMMO5': '0.009', 'weapon4': '0.014', 'AMMO4': '0.040', 'AMMO3': '0.046', 'WEAPON4': '0.100', 'weapon7': '0.108', 'weapon5': '0.156', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.440', 'ARMOR': '0.841', 'weapon3': '1.074', 'weapon2': '1.398', 'DAMAGECOUNT': '2.613', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:12:29,983][2409077] DAMAGECOUNT value on done: 7771.0
[2023-02-25 13:12:29,986][2409077] Sum rewards: 9.108, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.208', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon5': '0.026', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.104', 'AMMO4': '0.106', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.390', 'WEAPON3': '0.700', 'HITCOUNT': '0.790', 'ARMOR': '1.383', 'weapon3': '1.572', 'weapon2': '1.806', 'DAMAGECOUNT': '3.741', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:12:30,066][2409596] DAMAGECOUNT value on done: 5799.0
[2023-02-25 13:12:30,069][2409596] Sum rewards: 11.352, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.562', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.012', 'weapon5': '0.024', 'AMMO3': '0.070', 'weapon7': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'HITCOUNT': '0.600', 'weapon2': '1.204', 'weapon3': '1.886', 'DAMAGECOUNT': '2.598', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:12:30,095][2409406] DAMAGECOUNT value on done: 4760.0
[2023-02-25 13:12:30,098][2409406] Sum rewards: 5.347, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.607', 'AMMO5': '0.008', 'AMMO2': '0.014', 'AMMO3': '0.037', 'weapon5': '0.052', 'AMMO4': '0.070', 'weapon7': '0.150', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.300', 'weapon3': '0.376', 'WEAPON7': '0.400', 'weapon4': '0.416', 'ARMOR': '0.869', 'weapon2': '0.944', 'DAMAGECOUNT': '2.337', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:12:30,198][2409866] DAMAGECOUNT value on done: 4053.0
[2023-02-25 13:12:30,201][2409866] Sum rewards: 5.983, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.096', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.076', 'weapon4': '0.090', 'weapon7': '0.148', 'AMMO4': '0.160', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'HITCOUNT': '0.290', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'weapon3': '0.584', 'DAMAGECOUNT': '1.065', 'ARMOR': '1.256', 'weapon2': '2.670', 'FRAGCOUNT': '3.500'}
[2023-02-25 13:12:30,415][2409105] DAMAGECOUNT value on done: 5928.0
[2023-02-25 13:12:30,418][2409105] Sum rewards: 21.621, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.890', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon7': '0.054', 'weapon5': '0.064', 'AMMO4': '0.071', 'AMMO3': '0.085', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.550', 'weapon4': '0.624', 'weapon2': '0.648', 'HITCOUNT': '1.110', 'weapon3': '1.356', 'DAMAGECOUNT': '4.284', 'FRAGCOUNT': '18.000'}
[2023-02-25 13:12:30,475][2409102] DAMAGECOUNT value on done: 6812.0
[2023-02-25 13:12:30,478][2409102] Sum rewards: 12.544, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.162', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.013', 'WEAPON4': '0.050', 'AMMO3': '0.068', 'weapon4': '0.182', 'weapon5': '0.348', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'ARMOR': '0.862', 'HITCOUNT': '0.940', 'weapon3': '1.288', 'weapon2': '1.610', 'DAMAGECOUNT': '3.711', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:12:30,962][2409565] DAMAGECOUNT value on done: 6924.0
[2023-02-25 13:12:30,966][2409565] Sum rewards: 1.563, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.340', 'AMMO5': '0.005', 'AMMO2': '0.027', 'AMMO3': '0.046', 'WEAPON5': '0.100', 'weapon7': '0.104', 'AMMO4': '0.135', 'HITCOUNT': '0.210', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.250', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'weapon3': '0.352', 'weapon2': '0.434', 'DAMAGECOUNT': '0.852', 'FRAGCOUNT': '1.000', 'weapon4': '1.098'}
[2023-02-25 13:12:31,481][2409549] DAMAGECOUNT value on done: 6992.0
[2023-02-25 13:12:31,484][2409549] Sum rewards: 12.556, reward structure: {'DEATHCOUNT': '-6.000', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.014', 'weapon4': '0.038', 'WEAPON4': '0.050', 'AMMO4': '0.070', 'weapon7': '0.072', 'AMMO3': '0.077', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.106', 'HEALTH': '0.172', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.950', 'weapon3': '1.610', 'weapon2': '1.820', 'DAMAGECOUNT': '3.504', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:12:31,751][2409074] Updated weights for policy 0, policy_version 19851 (0.0014)
[2023-02-25 13:12:32,060][2409100] DAMAGECOUNT value on done: 6097.0
[2023-02-25 13:12:32,061][2409100] Sum rewards: 14.419, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.020', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.052', 'AMMO3': '0.056', 'weapon7': '0.062', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.173', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.300', 'weapon4': '0.946', 'HITCOUNT': '1.030', 'weapon3': '1.034', 'weapon2': '1.166', 'DAMAGECOUNT': '3.987', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:12:32,132][2409485] DAMAGECOUNT value on done: 6423.0
[2023-02-25 13:12:32,133][2409485] Sum rewards: 16.014, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.666', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.064', 'AMMO3': '0.107', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'ARMOR': '0.412', 'weapon4': '0.486', 'WEAPON3': '0.750', 'HITCOUNT': '1.040', 'weapon2': '1.336', 'weapon3': '1.796', 'DAMAGECOUNT': '3.915', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:12:32,186][2408954] Fps is (10 sec: 24985.6, 60 sec: 25259.2, 300 sec: 25103.6). Total num frames: 81321984. Throughput: 0: 6291.0. Samples: 20336856. Policy #0 lag: (min: 1.0, avg: 12.0, max: 25.0)
[2023-02-25 13:12:32,186][2408954] Avg episode reward: [(0, '9.130')]
[2023-02-25 13:12:32,354][2409405] DAMAGECOUNT value on done: 6684.0
[2023-02-25 13:12:32,355][2409405] Sum rewards: 6.538, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.181', 'AMMO2': '0.006', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'weapon4': '0.082', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'weapon5': '0.252', 'WEAPON5': '0.300', 'HITCOUNT': '0.720', 'WEAPON3': '0.800', 'ARMOR': '0.945', 'weapon2': '1.240', 'weapon3': '1.442', 'DAMAGECOUNT': '3.108', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:12:32,360][2409101] DAMAGECOUNT value on done: 9007.0
[2023-02-25 13:12:32,361][2409101] Sum rewards: 19.001, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.940', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon5': '0.078', 'weapon7': '0.082', 'AMMO3': '0.083', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.119', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.600', 'weapon4': '0.780', 'weapon2': '0.844', 'HITCOUNT': '0.920', 'weapon3': '1.428', 'DAMAGECOUNT': '5.205', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:12:33,095][2409355] DAMAGECOUNT value on done: 6040.0
[2023-02-25 13:12:33,096][2409355] Sum rewards: 10.559, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.008', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.041', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.170', 'weapon5': '0.182', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'HEALTH': '0.412', 'HITCOUNT': '0.630', 'weapon3': '1.254', 'weapon2': '1.476', 'DAMAGECOUNT': '3.051', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:12:33,317][2409074] Updated weights for policy 0, policy_version 19861 (0.0014)
[2023-02-25 13:12:33,367][2409548] DAMAGECOUNT value on done: 6654.0
[2023-02-25 13:12:33,368][2409548] Sum rewards: 10.089, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.317', 'AMMO5': '0.022', 'AMMO2': '0.023', 'AMMO3': '0.091', 'AMMO4': '0.113', 'weapon5': '0.124', 'WEAPON4': '0.250', 'weapon4': '0.328', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.890', 'weapon3': '1.218', 'weapon2': '2.182', 'DAMAGECOUNT': '3.414', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:12:33,391][2409407] DAMAGECOUNT value on done: 5822.0
[2023-02-25 13:12:33,391][2409407] Sum rewards: 8.678, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'HEALTH': '0.036', 'AMMO2': '0.065', 'AMMO3': '0.080', 'weapon5': '0.218', 'WEAPON5': '0.250', 'AMMO4': '0.323', 'ARMOR': '0.424', 'WEAPON4': '0.450', 'WEAPON3': '0.450', 'HITCOUNT': '0.620', 'weapon4': '0.632', 'weapon2': '0.828', 'weapon3': '1.442', 'DAMAGECOUNT': '3.078', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:12:33,526][2409077] DAMAGECOUNT value on done: 5619.0
[2023-02-25 13:12:33,527][2409077] Sum rewards: 6.421, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.159', 'AMMO2': '0.018', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon7': '0.052', 'AMMO3': '0.073', 'AMMO4': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.118', 'ARMOR': '0.400', 'HITCOUNT': '0.470', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'weapon4': '0.676', 'weapon2': '0.894', 'weapon3': '1.508', 'DAMAGECOUNT': '1.827', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:12:33,565][2409103] DAMAGECOUNT value on done: 5086.0
[2023-02-25 13:12:33,566][2409103] Sum rewards: 12.521, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.015', 'AMMO4': '0.059', 'AMMO3': '0.082', 'weapon5': '0.204', 'WEAPON5': '0.350', 'ARMOR': '0.440', 'WEAPON3': '0.500', 'HITCOUNT': '0.670', 'weapon3': '1.410', 'weapon2': '1.954', 'DAMAGECOUNT': '2.307', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:12:33,629][2409406] DAMAGECOUNT value on done: 6832.0
[2023-02-25 13:12:33,630][2409406] Sum rewards: 11.565, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.074', 'AMMO5': '0.009', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'weapon7': '0.048', 'weapon5': '0.068', 'AMMO4': '0.069', 'AMMO3': '0.097', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.730', 'ARMOR': '1.200', 'weapon3': '1.606', 'weapon2': '1.760', 'DAMAGECOUNT': '3.078', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:12:33,915][2409866] DAMAGECOUNT value on done: 6466.0
[2023-02-25 13:12:33,918][2409866] Sum rewards: 7.476, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.015', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'AMMO3': '0.096', 'AMMO4': '0.112', 'HEALTH': '0.140', 'weapon5': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.550', 'WEAPON3': '0.550', 'weapon2': '1.542', 'weapon3': '1.580', 'DAMAGECOUNT': '2.181', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:12:34,018][2409596] DAMAGECOUNT value on done: 4516.0
[2023-02-25 13:12:34,021][2409596] Sum rewards: 9.073, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.933', 'AMMO5': '0.016', 'AMMO2': '0.027', 'weapon7': '0.052', 'AMMO3': '0.055', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.134', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.214', 'weapon5': '0.252', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.460', 'ARMOR': '0.927', 'weapon3': '1.188', 'weapon2': '1.386', 'DAMAGECOUNT': '2.955', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:12:34,103][2409597] DAMAGECOUNT value on done: 6050.0
[2023-02-25 13:12:34,104][2409597] Sum rewards: 7.476, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.084', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO5': '0.025', 'AMMO4': '0.117', 'weapon5': '0.124', 'weapon7': '0.124', 'AMMO3': '0.125', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.608', 'WEAPON3': '0.700', 'HITCOUNT': '0.810', 'ARMOR': '0.888', 'weapon2': '1.180', 'weapon3': '1.208', 'DAMAGECOUNT': '2.817', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:12:34,590][2409105] DAMAGECOUNT value on done: 7316.0
[2023-02-25 13:12:34,591][2409105] Sum rewards: 11.478, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.420', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO5': '0.024', 'AMMO4': '0.074', 'AMMO3': '0.119', 'weapon5': '0.202', 'WEAPON4': '0.300', 'weapon4': '0.368', 'ARMOR': '0.453', 'WEAPON5': '0.550', 'weapon2': '0.648', 'WEAPON3': '0.850', 'HITCOUNT': '1.110', 'weapon3': '2.098', 'DAMAGECOUNT': '4.326', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:12:34,754][2409074] Updated weights for policy 0, policy_version 19871 (0.0012)
[2023-02-25 13:12:34,844][2409373] DAMAGECOUNT value on done: 6220.0
[2023-02-25 13:12:34,845][2409373] Sum rewards: 14.401, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.739', 'AMMO5': '0.005', 'weapon7': '0.006', 'AMMO2': '0.007', 'AMMO4': '0.036', 'AMMO3': '0.077', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.176', 'weapon4': '0.284', 'ARMOR': '0.452', 'WEAPON3': '0.500', 'HITCOUNT': '0.790', 'weapon3': '1.606', 'weapon2': '1.646', 'DAMAGECOUNT': '3.504', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:12:35,122][2409102] DAMAGECOUNT value on done: 6715.0
[2023-02-25 13:12:35,123][2409102] Sum rewards: 13.532, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.632', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon7': '0.108', 'AMMO3': '0.123', 'weapon5': '0.162', 'WEAPON4': '0.250', 'AMMO6': '0.260', 'AMMO7': '0.260', 'WEAPON7': '0.300', 'WEAPON5': '0.400', 'HITCOUNT': '0.820', 'WEAPON3': '0.850', 'ARMOR': '0.905', 'weapon4': '0.924', 'weapon2': '1.024', 'weapon3': '1.276', 'DAMAGECOUNT': '4.602', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:12:35,255][2409549] DAMAGECOUNT value on done: 7619.0
[2023-02-25 13:12:35,259][2409549] Sum rewards: 17.171, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.473', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'AMMO3': '0.070', 'AMMO4': '0.099', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.382', 'WEAPON3': '0.550', 'ARMOR': '0.899', 'HITCOUNT': '0.960', 'weapon3': '1.470', 'weapon2': '1.580', 'DAMAGECOUNT': '3.609', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:12:35,540][2409565] DAMAGECOUNT value on done: 6868.0
[2023-02-25 13:12:35,541][2409565] Sum rewards: 6.051, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.101', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO5': '0.030', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'weapon7': '0.100', 'AMMO3': '0.108', 'weapon4': '0.120', 'weapon5': '0.130', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'ARMOR': '0.451', 'WEAPON5': '0.600', 'HITCOUNT': '0.610', 'WEAPON3': '0.750', 'weapon2': '1.256', 'weapon3': '1.704', 'DAMAGECOUNT': '2.466', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:12:35,635][2409100] DAMAGECOUNT value on done: 5347.0
[2023-02-25 13:12:35,637][2409100] Sum rewards: 9.289, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.579', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.015', 'weapon7': '0.048', 'AMMO4': '0.054', 'AMMO3': '0.072', 'weapon5': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.446', 'WEAPON3': '0.450', 'HITCOUNT': '0.660', 'ARMOR': '0.800', 'weapon4': '0.830', 'weapon3': '1.294', 'DAMAGECOUNT': '2.994', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:12:36,037][2409485] DAMAGECOUNT value on done: 6059.0
[2023-02-25 13:12:36,040][2409485] Sum rewards: 12.009, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.226', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.046', 'weapon7': '0.048', 'AMMO3': '0.050', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.142', 'weapon4': '0.146', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.740', 'weapon3': '1.282', 'weapon2': '1.508', 'DAMAGECOUNT': '3.504', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:12:36,449][2409405] DAMAGECOUNT value on done: 4607.0
[2023-02-25 13:12:36,450][2409101] DAMAGECOUNT value on done: 6227.0
[2023-02-25 13:12:36,452][2409405] Sum rewards: 4.925, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.624', 'AMMO5': '0.015', 'AMMO2': '0.019', 'weapon7': '0.020', 'WEAPON1': '0.040', 'AMMO3': '0.080', 'AMMO4': '0.097', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.260', 'weapon5': '0.312', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'ARMOR': '0.853', 'DAMAGECOUNT': '1.245', 'weapon2': '1.406', 'weapon3': '1.702', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:12:36,454][2409101] Sum rewards: 15.871, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.295', 'AMMO2': '0.014', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.070', 'AMMO3': '0.124', 'weapon5': '0.146', 'weapon4': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.850', 'weapon2': '1.020', 'HITCOUNT': '1.240', 'weapon3': '2.154', 'DAMAGECOUNT': '5.823', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:12:36,760][2409355] DAMAGECOUNT value on done: 5807.0
[2023-02-25 13:12:36,761][2409355] Sum rewards: 12.658, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.080', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.074', 'weapon4': '0.232', 'weapon5': '0.262', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.830', 'weapon2': '1.094', 'weapon3': '1.466', 'DAMAGECOUNT': '3.942', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:12:36,883][2409074] Updated weights for policy 0, policy_version 19881 (0.0012)
[2023-02-25 13:12:36,997][2409548] DAMAGECOUNT value on done: 6440.0
[2023-02-25 13:12:37,000][2409548] Sum rewards: 9.254, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.108', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon7': '0.068', 'weapon4': '0.070', 'weapon5': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.380', 'WEAPON3': '0.400', 'ARMOR': '0.904', 'weapon3': '1.556', 'DAMAGECOUNT': '1.662', 'weapon2': '2.040', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:12:37,186][2408954] Fps is (10 sec: 24985.5, 60 sec: 25258.6, 300 sec: 25089.7). Total num frames: 81448960. Throughput: 0: 6290.7. Samples: 20355972. Policy #0 lag: (min: 1.0, avg: 12.0, max: 25.0)
[2023-02-25 13:12:37,186][2408954] Avg episode reward: [(0, '9.520')]
[2023-02-25 13:12:37,191][2409033] Saving new best policy, reward=9.520!
[2023-02-25 13:12:37,282][2409103] DAMAGECOUNT value on done: 5547.0
[2023-02-25 13:12:37,283][2409103] Sum rewards: 5.450, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.435', 'AMMO2': '0.014', 'AMMO5': '0.023', 'AMMO4': '0.069', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'weapon5': '0.222', 'weapon4': '0.282', 'WEAPON5': '0.400', 'ARMOR': '0.456', 'HITCOUNT': '0.700', 'weapon2': '0.728', 'WEAPON3': '0.850', 'weapon3': '1.542', 'DAMAGECOUNT': '2.814', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:12:37,399][2409407] DAMAGECOUNT value on done: 7253.0
[2023-02-25 13:12:37,400][2409407] Sum rewards: 11.905, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.946', 'AMMO5': '0.023', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'weapon5': '0.102', 'AMMO4': '0.113', 'AMMO3': '0.152', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon2': '1.136', 'HITCOUNT': '1.170', 'weapon3': '2.292', 'DAMAGECOUNT': '4.611', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:12:37,466][2409077] DAMAGECOUNT value on done: 6311.0
[2023-02-25 13:12:37,468][2409104] DAMAGECOUNT value on done: 6002.0
[2023-02-25 13:12:37,468][2409077] Sum rewards: 8.250, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.158', 'AMMO2': '0.025', 'AMMO5': '0.030', 'weapon5': '0.084', 'AMMO4': '0.124', 'AMMO3': '0.138', 'WEAPON4': '0.250', 'weapon4': '0.336', 'WEAPON5': '0.450', 'WEAPON3': '0.900', 'HITCOUNT': '1.100', 'weapon3': '1.614', 'weapon2': '1.732', 'ARMOR': '1.816', 'DAMAGECOUNT': '4.059', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:12:37,471][2409104] Sum rewards: 6.448, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.645', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.027', 'ARMOR': '0.040', 'AMMO3': '0.056', 'weapon5': '0.058', 'weapon7': '0.068', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.390', 'WEAPON3': '0.400', 'weapon2': '0.484', 'weapon4': '0.582', 'weapon3': '1.062', 'DAMAGECOUNT': '1.977', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:12:37,589][2409866] DAMAGECOUNT value on done: 7131.0
[2023-02-25 13:12:37,593][2409866] Sum rewards: 17.018, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.378', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.087', 'AMMO3': '0.120', 'weapon5': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.282', 'WEAPON3': '0.850', 'ARMOR': '0.854', 'weapon2': '1.080', 'HITCOUNT': '1.240', 'weapon3': '1.982', 'DAMAGECOUNT': '5.013', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:12:37,619][2409406] DAMAGECOUNT value on done: 6214.0
[2023-02-25 13:12:37,621][2409406] Sum rewards: 10.943, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon7': '0.046', 'weapon5': '0.056', 'AMMO3': '0.065', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.115', 'HEALTH': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'ARMOR': '0.481', 'HITCOUNT': '0.580', 'weapon4': '0.698', 'weapon3': '1.402', 'weapon2': '1.490', 'DAMAGECOUNT': '2.586', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:12:37,736][2409597] DAMAGECOUNT value on done: 6719.0
[2023-02-25 13:12:37,737][2409597] Sum rewards: 12.804, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.604', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'weapon7': '0.048', 'AMMO3': '0.068', 'weapon4': '0.078', 'AMMO4': '0.101', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.550', 'weapon3': '1.156', 'weapon2': '2.254', 'DAMAGECOUNT': '2.559', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:12:37,779][2409596] DAMAGECOUNT value on done: 6046.0
[2023-02-25 13:12:37,780][2409596] Sum rewards: 13.072, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.553', 'AMMO2': '0.010', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.048', 'AMMO3': '0.060', 'WEAPON4': '0.200', 'weapon5': '0.252', 'WEAPON5': '0.350', 'weapon4': '0.362', 'WEAPON3': '0.500', 'HITCOUNT': '0.800', 'weapon3': '1.406', 'weapon2': '1.456', 'DAMAGECOUNT': '4.389', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:12:38,180][2409074] Updated weights for policy 0, policy_version 19891 (0.0012)
[2023-02-25 13:12:38,247][2409105] DAMAGECOUNT value on done: 5560.0
[2023-02-25 13:12:38,248][2409105] Sum rewards: 2.756, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.716', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.023', 'ARMOR': '0.036', 'weapon7': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.103', 'AMMO4': '0.113', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.330', 'weapon4': '0.520', 'WEAPON3': '0.650', 'weapon2': '0.938', 'DAMAGECOUNT': '1.485', 'weapon3': '1.742', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:12:38,649][2409373] DAMAGECOUNT value on done: 5292.0
[2023-02-25 13:12:38,650][2409373] Sum rewards: 12.518, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.526', 'AMMO2': '0.004', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.022', 'AMMO3': '0.097', 'weapon5': '0.104', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.670', 'weapon3': '1.486', 'weapon2': '1.992', 'DAMAGECOUNT': '2.685', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:12:39,050][2409102] DAMAGECOUNT value on done: 6857.0
[2023-02-25 13:12:39,054][2409102] Sum rewards: 12.985, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.890', 'AMMO2': '0.007', 'AMMO5': '0.007', 'weapon7': '0.012', 'AMMO4': '0.034', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.101', 'weapon5': '0.106', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.584', 'WEAPON3': '0.750', 'ARMOR': '0.856', 'HITCOUNT': '1.160', 'weapon2': '1.268', 'weapon3': '1.642', 'DAMAGECOUNT': '4.848', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:12:39,306][2409100] DAMAGECOUNT value on done: 6373.0
[2023-02-25 13:12:39,309][2409100] Sum rewards: 17.262, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.090', 'AMMO4': '0.121', 'HEALTH': '0.186', 'WEAPON4': '0.200', 'weapon5': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'weapon2': '0.906', 'HITCOUNT': '0.920', 'weapon4': '0.930', 'weapon3': '1.428', 'DAMAGECOUNT': '3.477', 'FRAGCOUNT': '13.500'}
[2023-02-25 13:12:39,537][2409549] DAMAGECOUNT value on done: 6817.0
[2023-02-25 13:12:39,540][2409549] Sum rewards: 13.424, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.348', 'AMMO2': '0.012', 'AMMO5': '0.012', 'weapon5': '0.026', 'AMMO4': '0.057', 'weapon4': '0.058', 'AMMO3': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.600', 'ARMOR': '0.908', 'HITCOUNT': '0.950', 'weapon3': '1.286', 'weapon2': '1.886', 'DAMAGECOUNT': '3.855', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:12:39,599][2409565] DAMAGECOUNT value on done: 6863.0
[2023-02-25 13:12:39,600][2409565] Sum rewards: 12.662, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.026', 'WEAPON1': '0.030', 'AMMO2': '0.039', 'weapon5': '0.060', 'AMMO3': '0.097', 'WEAPON4': '0.150', 'AMMO4': '0.196', 'HEALTH': '0.211', 'weapon4': '0.270', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'ARMOR': '0.800', 'HITCOUNT': '1.070', 'weapon2': '1.572', 'weapon3': '1.640', 'DAMAGECOUNT': '4.350', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:12:40,140][2409074] Updated weights for policy 0, policy_version 19901 (0.0012)
[2023-02-25 13:12:40,197][2409485] DAMAGECOUNT value on done: 6231.0
[2023-02-25 13:12:40,198][2409485] Sum rewards: 11.250, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'AMMO2': '0.034', 'AMMO3': '0.078', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'WEAPON4': '0.350', 'HEALTH': '0.442', 'ARMOR': '0.445', 'WEAPON3': '0.450', 'weapon2': '0.622', 'HITCOUNT': '1.030', 'weapon3': '1.208', 'weapon4': '1.378', 'DAMAGECOUNT': '3.522', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:12:40,304][2409597] Large shaping reward 3.642 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:12:40,506][2409101] DAMAGECOUNT value on done: 5571.0
[2023-02-25 13:12:40,507][2409101] Sum rewards: 10.635, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.580', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.029', 'weapon7': '0.052', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.166', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.346', 'WEAPON3': '0.450', 'ARMOR': '0.452', 'HITCOUNT': '0.500', 'weapon3': '1.184', 'weapon2': '1.750', 'DAMAGECOUNT': '2.949', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:12:40,610][2409405] DAMAGECOUNT value on done: 4649.0
[2023-02-25 13:12:40,611][2409405] Sum rewards: 9.982, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.003', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.023', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.064', 'weapon7': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HEALTH': '0.151', 'WEAPON3': '0.350', 'HITCOUNT': '0.540', 'ARMOR': '0.856', 'weapon3': '1.324', 'DAMAGECOUNT': '1.740', 'weapon2': '2.380', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:12:40,679][2409355] DAMAGECOUNT value on done: 6986.0
[2023-02-25 13:12:40,680][2409355] Sum rewards: 2.470, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.022', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.034', 'AMMO3': '0.140', 'weapon4': '0.160', 'AMMO4': '0.171', 'weapon5': '0.220', 'WEAPON4': '0.300', 'ARMOR': '0.462', 'WEAPON5': '0.550', 'HITCOUNT': '0.730', 'WEAPON3': '0.950', 'weapon2': '1.120', 'weapon3': '2.010', 'DAMAGECOUNT': '2.613', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:12:40,995][2409548] DAMAGECOUNT value on done: 7155.0
[2023-02-25 13:12:40,997][2409548] Sum rewards: 21.844, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.665', 'AMMO4': '-0.053', 'AMMO2': '-0.010', 'AMMO5': '0.015', 'AMMO3': '0.074', 'weapon5': '0.220', 'WEAPON5': '0.400', 'ARMOR': '0.453', 'WEAPON3': '0.650', 'HITCOUNT': '1.100', 'weapon3': '1.642', 'weapon2': '1.840', 'DAMAGECOUNT': '4.428', 'FRAGCOUNT': '18.000'}
[2023-02-25 13:12:41,172][2409104] DAMAGECOUNT value on done: 5374.0
[2023-02-25 13:12:41,172][2409407] DAMAGECOUNT value on done: 6838.0
[2023-02-25 13:12:41,175][2409104] Sum rewards: 5.569, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.487', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO3': '0.100', 'weapon7': '0.108', 'AMMO4': '0.142', 'weapon5': '0.144', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'ARMOR': '0.478', 'weapon2': '0.584', 'HITCOUNT': '0.640', 'WEAPON3': '0.650', 'weapon4': '0.702', 'weapon3': '2.034', 'DAMAGECOUNT': '2.631', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:12:41,175][2409407] Sum rewards: 6.972, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.226', 'AMMO5': '0.005', 'AMMO2': '0.025', 'AMMO3': '0.030', 'weapon5': '0.054', 'weapon7': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'WEAPON3': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'HITCOUNT': '0.600', 'weapon3': '0.730', 'ARMOR': '1.254', 'weapon4': '1.306', 'weapon2': '1.582', 'DAMAGECOUNT': '1.848', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:12:41,372][2409103] DAMAGECOUNT value on done: 6669.0
[2023-02-25 13:12:41,373][2409103] Sum rewards: 7.389, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.311', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.012', 'AMMO3': '0.066', 'weapon5': '0.102', 'weapon7': '0.124', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'ARMOR': '0.425', 'WEAPON3': '0.500', 'weapon4': '0.646', 'HITCOUNT': '0.650', 'weapon3': '1.108', 'weapon2': '1.186', 'DAMAGECOUNT': '2.664', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:12:41,379][2409074] Updated weights for policy 0, policy_version 19911 (0.0012)
[2023-02-25 13:12:41,437][2409597] DAMAGECOUNT value on done: 5169.0
[2023-02-25 13:12:41,438][2409597] Sum rewards: 8.159, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.142', 'weapon5': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon7': '0.114', 'AMMO3': '0.115', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.652', 'WEAPON3': '0.700', 'HITCOUNT': '0.850', 'ARMOR': '0.857', 'weapon4': '1.038', 'weapon3': '1.490', 'DAMAGECOUNT': '3.144', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:12:41,499][2409866] DAMAGECOUNT value on done: 6334.0
[2023-02-25 13:12:41,500][2409866] Sum rewards: 12.861, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.710', 'AMMO2': '0.007', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.034', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon5': '0.264', 'weapon4': '0.314', 'WEAPON5': '0.400', 'ARMOR': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '0.860', 'weapon2': '1.304', 'weapon3': '1.764', 'DAMAGECOUNT': '3.237', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:12:41,508][2409596] DAMAGECOUNT value on done: 6191.0
[2023-02-25 13:12:41,510][2409596] Sum rewards: 7.743, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.316', 'AMMO5': '0.007', 'AMMO2': '0.044', 'AMMO3': '0.104', 'weapon5': '0.144', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.218', 'WEAPON5': '0.300', 'weapon4': '0.526', 'WEAPON4': '0.550', 'WEAPON3': '0.600', 'HITCOUNT': '0.830', 'weapon3': '1.150', 'ARMOR': '1.514', 'weapon2': '1.732', 'DAMAGECOUNT': '3.240', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:12:41,693][2409077] DAMAGECOUNT value on done: 4488.0
[2023-02-25 13:12:41,698][2409077] Sum rewards: 8.224, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.523', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO5': '0.020', 'AMMO3': '0.077', 'AMMO4': '0.092', 'weapon5': '0.246', 'WEAPON5': '0.400', 'ARMOR': '0.471', 'HITCOUNT': '0.540', 'WEAPON3': '0.550', 'weapon3': '1.594', 'weapon2': '1.932', 'DAMAGECOUNT': '2.046', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:12:41,739][2409389] DAMAGECOUNT value on done: 5327.0
[2023-02-25 13:12:41,739][2409389] Sum rewards: 8.578, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.394', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.018', 'AMMO3': '0.083', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'weapon5': '0.136', 'WEAPON5': '0.350', 'weapon4': '0.354', 'ARMOR': '0.452', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'weapon2': '1.508', 'weapon3': '1.756', 'DAMAGECOUNT': '2.631', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:12:41,788][2409406] DAMAGECOUNT value on done: 5864.0
[2023-02-25 13:12:41,803][2409406] Sum rewards: 6.194, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.608', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO3': '0.085', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.216', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.560', 'ARMOR': '1.255', 'weapon3': '1.390', 'weapon2': '2.186', 'DAMAGECOUNT': '2.538', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:12:41,985][2409105] DAMAGECOUNT value on done: 6708.0
[2023-02-25 13:12:41,986][2409105] Sum rewards: 10.907, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.812', 'AMMO2': '0.011', 'AMMO5': '0.012', 'weapon4': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.053', 'weapon5': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'WEAPON5': '0.300', 'ARMOR': '0.454', 'WEAPON3': '0.900', 'HITCOUNT': '1.240', 'weapon2': '1.618', 'weapon3': '1.866', 'DAMAGECOUNT': '4.938', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:12:42,186][2408954] Fps is (10 sec: 24985.5, 60 sec: 25258.6, 300 sec: 25089.7). Total num frames: 81571840. Throughput: 0: 6277.1. Samples: 20393196. Policy #0 lag: (min: 1.0, avg: 15.3, max: 26.0)
[2023-02-25 13:12:42,187][2408954] Avg episode reward: [(0, '9.905')]
[2023-02-25 13:12:42,216][2409033] Saving new best policy, reward=9.905!
[2023-02-25 13:12:42,713][2409373] DAMAGECOUNT value on done: 7121.0
[2023-02-25 13:12:42,714][2409373] Sum rewards: 20.279, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.114', 'AMMO2': '0.016', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.077', 'AMMO3': '0.088', 'weapon5': '0.184', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon4': '0.436', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'weapon2': '1.028', 'HITCOUNT': '1.220', 'weapon3': '1.760', 'DAMAGECOUNT': '4.995', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:12:42,745][2409547] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:12:43,159][2409100] DAMAGECOUNT value on done: 5576.0
[2023-02-25 13:12:43,161][2409100] Sum rewards: 10.764, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.082', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'weapon7': '0.048', 'AMMO4': '0.053', 'AMMO3': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.168', 'WEAPON7': '0.200', 'weapon4': '0.390', 'WEAPON3': '0.500', 'HITCOUNT': '0.520', 'weapon2': '1.194', 'weapon3': '1.594', 'DAMAGECOUNT': '3.024', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:12:43,182][2409549] DAMAGECOUNT value on done: 6714.0
[2023-02-25 13:12:43,185][2409549] Sum rewards: 10.599, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.150', 'AMMO5': '0.018', 'AMMO2': '0.031', 'weapon7': '0.074', 'weapon5': '0.080', 'AMMO3': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.153', 'weapon4': '0.172', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.850', 'ARMOR': '0.909', 'weapon3': '1.416', 'weapon2': '1.882', 'DAMAGECOUNT': '3.567', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:12:43,285][2409074] Updated weights for policy 0, policy_version 19921 (0.0012)
[2023-02-25 13:12:43,790][2409485] DAMAGECOUNT value on done: 5848.0
[2023-02-25 13:12:43,791][2409485] Sum rewards: 8.823, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.668', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon7': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.122', 'AMMO4': '0.126', 'weapon5': '0.176', 'WEAPON4': '0.200', 'weapon4': '0.480', 'WEAPON5': '0.500', 'HITCOUNT': '0.610', 'WEAPON3': '0.700', 'weapon2': '1.252', 'weapon3': '1.652', 'DAMAGECOUNT': '3.462', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:12:43,854][2409102] DAMAGECOUNT value on done: 5329.0
[2023-02-25 13:12:43,855][2409102] Sum rewards: 6.799, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.814', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.023', 'weapon7': '0.050', 'AMMO3': '0.088', 'AMMO4': '0.114', 'weapon5': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'HITCOUNT': '0.520', 'WEAPON3': '0.550', 'weapon4': '0.788', 'weapon2': '0.918', 'weapon3': '1.312', 'DAMAGECOUNT': '2.319', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:12:44,182][2409101] DAMAGECOUNT value on done: 6907.0
[2023-02-25 13:12:44,188][2409101] Sum rewards: 5.156, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.974', 'AMMO5': '0.003', 'AMMO2': '0.009', 'ARMOR': '0.040', 'AMMO4': '0.045', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.069', 'weapon7': '0.182', 'WEAPON4': '0.350', 'AMMO6': '0.400', 'AMMO7': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.490', 'WEAPON7': '0.600', 'weapon2': '0.982', 'weapon4': '1.026', 'weapon3': '1.110', 'DAMAGECOUNT': '2.124', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:12:44,237][2409405] DAMAGECOUNT value on done: 5077.0
[2023-02-25 13:12:44,237][2409405] Sum rewards: 8.901, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.458', 'AMMO2': '0.007', 'AMMO5': '0.012', 'AMMO4': '0.034', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'weapon5': '0.198', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.650', 'weapon3': '1.306', 'weapon2': '1.858', 'DAMAGECOUNT': '2.154', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:12:44,311][2409565] DAMAGECOUNT value on done: 4946.0
[2023-02-25 13:12:44,312][2409565] Sum rewards: 7.162, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.111', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO3': '0.050', 'AMMO4': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.132', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.400', 'WEAPON4': '0.450', 'HITCOUNT': '0.600', 'weapon4': '0.938', 'weapon2': '1.084', 'weapon3': '1.436', 'DAMAGECOUNT': '2.580', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:12:44,365][2409355] DAMAGECOUNT value on done: 4768.0
[2023-02-25 13:12:44,366][2409355] Sum rewards: 7.101, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.346', 'AMMO5': '0.008', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'AMMO3': '0.054', 'weapon5': '0.074', 'weapon7': '0.118', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.378', 'WEAPON3': '0.450', 'HITCOUNT': '0.560', 'ARMOR': '0.856', 'weapon3': '1.346', 'weapon2': '1.642', 'DAMAGECOUNT': '2.040', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:12:44,758][2409074] Updated weights for policy 0, policy_version 19931 (0.0020)
[2023-02-25 13:12:44,882][2409104] DAMAGECOUNT value on done: 7104.0
[2023-02-25 13:12:44,885][2409104] Sum rewards: 7.505, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.276', 'weapon7': '0.008', 'AMMO2': '0.008', 'AMMO5': '0.017', 'AMMO4': '0.042', 'AMMO3': '0.083', 'WEAPON4': '0.150', 'weapon5': '0.158', 'weapon4': '0.224', 'WEAPON5': '0.300', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.780', 'ARMOR': '0.848', 'weapon3': '0.852', 'weapon2': '1.686', 'DAMAGECOUNT': '3.924', 'FRAGCOUNT': '6.500'}
[2023-02-25 13:12:44,971][2409103] DAMAGECOUNT value on done: 5470.0
[2023-02-25 13:12:44,971][2409103] Sum rewards: 2.499, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.117', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.028', 'AMMO3': '0.055', 'weapon7': '0.074', 'weapon5': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.170', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'weapon4': '0.744', 'weapon2': '0.928', 'DAMAGECOUNT': '1.053', 'weapon3': '1.154', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:12:45,057][2409407] DAMAGECOUNT value on done: 5792.0
[2023-02-25 13:12:45,057][2409407] Sum rewards: 9.229, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.635', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.023', 'AMMO3': '0.060', 'AMMO4': '0.116', 'weapon4': '0.180', 'weapon5': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.700', 'ARMOR': '0.849', 'weapon3': '1.274', 'weapon2': '2.064', 'DAMAGECOUNT': '2.184', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:12:45,159][2409596] DAMAGECOUNT value on done: 4830.0
[2023-02-25 13:12:45,160][2409596] Sum rewards: 15.068, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO3': '0.072', 'AMMO4': '0.090', 'HEALTH': '0.122', 'WEAPON4': '0.150', 'weapon5': '0.234', 'weapon4': '0.242', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.720', 'weapon3': '1.398', 'weapon2': '1.614', 'DAMAGECOUNT': '3.525', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:12:45,182][2409597] DAMAGECOUNT value on done: 6807.0
[2023-02-25 13:12:45,184][2409597] Sum rewards: 5.866, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.718', 'AMMO2': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.042', 'weapon7': '0.048', 'weapon5': '0.074', 'AMMO3': '0.085', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.479', 'HITCOUNT': '0.520', 'WEAPON3': '0.550', 'weapon4': '0.776', 'weapon2': '1.212', 'weapon3': '1.352', 'DAMAGECOUNT': '2.478', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:12:45,205][2409548] DAMAGECOUNT value on done: 5349.0
[2023-02-25 13:12:45,207][2409548] Sum rewards: 17.094, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.600', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO3': '0.055', 'weapon7': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.112', 'weapon5': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'weapon4': '0.622', 'HITCOUNT': '0.810', 'weapon2': '0.818', 'weapon3': '1.168', 'DAMAGECOUNT': '4.356', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:12:45,402][2409866] DAMAGECOUNT value on done: 5740.0
[2023-02-25 13:12:45,403][2409866] Sum rewards: 4.066, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.746', 'AMMO2': '0.017', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'weapon7': '0.044', 'AMMO4': '0.087', 'AMMO3': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.154', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.256', 'WEAPON5': '0.500', 'HITCOUNT': '0.520', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'weapon2': '1.300', 'weapon3': '1.742', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:12:45,721][2409105] DAMAGECOUNT value on done: 4466.0
[2023-02-25 13:12:45,722][2409105] Sum rewards: 2.925, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.310', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO3': '0.014', 'AMMO4': '0.041', 'weapon5': '0.044', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'WEAPON3': '0.100', 'weapon3': '0.132', 'HITCOUNT': '0.150', 'weapon2': '0.372', 'weapon4': '0.430', 'ARMOR': '0.461', 'DAMAGECOUNT': '1.230', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:12:45,788][2409077] DAMAGECOUNT value on done: 5837.0
[2023-02-25 13:12:45,789][2409077] Sum rewards: 10.281, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.024', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.015', 'AMMO3': '0.051', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.196', 'weapon5': '0.234', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'HITCOUNT': '0.790', 'weapon3': '1.218', 'ARMOR': '1.321', 'weapon2': '1.916', 'DAMAGECOUNT': '2.835', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:12:45,830][2409389] DAMAGECOUNT value on done: 4977.0
[2023-02-25 13:12:45,831][2409389] Sum rewards: 8.219, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.010', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'weapon7': '0.072', 'AMMO4': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.138', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.454', 'HITCOUNT': '0.560', 'weapon2': '0.600', 'weapon4': '0.912', 'weapon3': '0.960', 'DAMAGECOUNT': '2.472', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:12:45,942][2409406] DAMAGECOUNT value on done: 5830.0
[2023-02-25 13:12:45,945][2409406] Sum rewards: 10.383, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.308', 'AMMO2': '0.006', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.031', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'weapon5': '0.234', 'weapon4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'HITCOUNT': '0.810', 'weapon3': '1.106', 'ARMOR': '1.306', 'weapon2': '1.788', 'DAMAGECOUNT': '3.150', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:12:46,192][2409074] Updated weights for policy 0, policy_version 19941 (0.0012)
[2023-02-25 13:12:46,274][2409097] DAMAGECOUNT value on done: 6442.0
[2023-02-25 13:12:46,278][2409097] Sum rewards: 8.136, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.517', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO2': '0.032', 'AMMO3': '0.089', 'weapon4': '0.140', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'WEAPON4': '0.250', 'ARMOR': '0.458', 'WEAPON3': '0.500', 'HITCOUNT': '0.840', 'weapon3': '1.244', 'weapon2': '1.636', 'DAMAGECOUNT': '2.877', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:12:46,420][2409373] DAMAGECOUNT value on done: 6193.0
[2023-02-25 13:12:46,420][2409373] Sum rewards: 18.655, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.266', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON1': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.082', 'weapon5': '0.082', 'weapon7': '0.108', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'weapon4': '0.354', 'WEAPON7': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.790', 'ARMOR': '0.856', 'weapon2': '1.494', 'weapon3': '1.674', 'DAMAGECOUNT': '3.672', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:12:47,186][2408954] Fps is (10 sec: 24166.6, 60 sec: 25190.6, 300 sec: 25103.6). Total num frames: 81690624. Throughput: 0: 6272.0. Samples: 20430612. Policy #0 lag: (min: 1.0, avg: 15.3, max: 26.0)
[2023-02-25 13:12:47,186][2408954] Avg episode reward: [(0, '10.197')]
[2023-02-25 13:12:47,191][2409033] Saving new best policy, reward=10.197!
[2023-02-25 13:12:47,507][2409549] DAMAGECOUNT value on done: 5908.0
[2023-02-25 13:12:47,508][2409549] Sum rewards: 14.558, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.798', 'AMMO5': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.110', 'AMMO4': '0.113', 'weapon5': '0.118', 'WEAPON4': '0.200', 'weapon4': '0.262', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'HITCOUNT': '0.940', 'weapon2': '1.030', 'ARMOR': '1.412', 'weapon3': '2.218', 'DAMAGECOUNT': '3.660', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:12:47,647][2409485] DAMAGECOUNT value on done: 5507.0
[2023-02-25 13:12:47,648][2409485] Sum rewards: 12.442, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'AMMO2': '0.009', 'HEALTH': '0.028', 'AMMO4': '0.044', 'weapon7': '0.074', 'AMMO3': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.122', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'ARMOR': '1.255', 'weapon3': '1.390', 'weapon2': '2.038', 'DAMAGECOUNT': '2.511', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:12:47,689][2409102] DAMAGECOUNT value on done: 6237.0
[2023-02-25 13:12:47,689][2409102] Sum rewards: 11.550, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.146', 'AMMO4': '-0.053', 'AMMO2': '-0.011', 'weapon7': '0.012', 'AMMO5': '0.015', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'weapon5': '0.156', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.248', 'WEAPON5': '0.450', 'ARMOR': '0.457', 'HITCOUNT': '0.850', 'WEAPON3': '0.900', 'weapon2': '1.382', 'weapon3': '1.804', 'DAMAGECOUNT': '4.167', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:12:47,910][2409100] DAMAGECOUNT value on done: 5236.0
[2023-02-25 13:12:47,911][2409100] Sum rewards: 7.580, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.095', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'weapon4': '0.054', 'AMMO3': '0.060', 'AMMO4': '0.078', 'weapon7': '0.168', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.226', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'HITCOUNT': '0.330', 'WEAPON3': '0.400', 'weapon3': '1.346', 'DAMAGECOUNT': '1.737', 'weapon2': '1.960', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:12:48,236][2409565] DAMAGECOUNT value on done: 6147.0
[2023-02-25 13:12:48,236][2409565] Sum rewards: 9.460, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.428', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.022', 'AMMO5': '0.025', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'weapon5': '0.156', 'weapon4': '0.246', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'HITCOUNT': '0.840', 'WEAPON3': '0.900', 'weapon2': '1.408', 'weapon3': '1.790', 'DAMAGECOUNT': '3.855', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:12:48,238][2409074] Updated weights for policy 0, policy_version 19951 (0.0012)
[2023-02-25 13:12:48,263][2409405] DAMAGECOUNT value on done: 5874.0
[2023-02-25 13:12:48,266][2409405] Sum rewards: 8.017, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.102', 'AMMO2': '0.028', 'AMMO5': '0.032', 'weapon7': '0.048', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.123', 'AMMO4': '0.138', 'weapon5': '0.198', 'WEAPON4': '0.200', 'weapon4': '0.312', 'WEAPON5': '0.700', 'HITCOUNT': '0.820', 'WEAPON3': '0.850', 'weapon2': '1.218', 'ARMOR': '1.256', 'weapon3': '1.852', 'DAMAGECOUNT': '4.293', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:12:48,489][2409104] DAMAGECOUNT value on done: 6406.0
[2023-02-25 13:12:48,493][2409104] Sum rewards: 10.724, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.043', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO3': '0.054', 'weapon5': '0.070', 'AMMO4': '0.087', 'weapon7': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.650', 'weapon4': '0.910', 'weapon3': '0.986', 'weapon2': '1.028', 'DAMAGECOUNT': '2.832', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:12:48,615][2409355] DAMAGECOUNT value on done: 5498.0
[2023-02-25 13:12:48,619][2409355] Sum rewards: 9.235, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.278', 'AMMO2': '0.002', 'AMMO4': '0.007', 'AMMO5': '0.018', 'WEAPON1': '0.040', 'AMMO3': '0.087', 'weapon5': '0.200', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.690', 'weapon3': '1.364', 'weapon2': '2.160', 'DAMAGECOUNT': '2.445', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:12:48,679][2409101] DAMAGECOUNT value on done: 6488.0
[2023-02-25 13:12:48,680][2409101] Sum rewards: 9.475, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.016', 'WEAPON1': '0.020', 'weapon7': '0.050', 'weapon5': '0.072', 'AMMO3': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HEALTH': '0.102', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.600', 'weapon3': '1.600', 'weapon2': '2.012', 'DAMAGECOUNT': '2.460', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:12:48,760][2409596] DAMAGECOUNT value on done: 6712.0
[2023-02-25 13:12:48,763][2409596] Sum rewards: 13.421, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.914', 'AMMO5': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.052', 'AMMO4': '0.087', 'weapon7': '0.136', 'weapon5': '0.144', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.830', 'weapon2': '0.968', 'weapon4': '1.108', 'weapon3': '1.180', 'DAMAGECOUNT': '4.650', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:12:48,781][2409407] DAMAGECOUNT value on done: 7252.0
[2023-02-25 13:12:48,782][2409407] Sum rewards: 10.731, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.570', 'weapon4': '0.018', 'AMMO5': '0.020', 'AMMO2': '0.020', 'WEAPON1': '0.050', 'weapon7': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.100', 'AMMO3': '0.112', 'weapon5': '0.158', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'HITCOUNT': '0.750', 'weapon2': '1.418', 'weapon3': '2.016', 'DAMAGECOUNT': '2.856', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:12:48,872][2409103] DAMAGECOUNT value on done: 4925.0
[2023-02-25 13:12:48,873][2409103] Sum rewards: 5.293, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.658', 'AMMO5': '0.011', 'AMMO2': '0.014', 'AMMO3': '0.067', 'AMMO4': '0.067', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.102', 'weapon5': '0.200', 'WEAPON5': '0.350', 'HITCOUNT': '0.410', 'WEAPON3': '0.500', 'ARMOR': '1.262', 'weapon3': '1.460', 'DAMAGECOUNT': '1.707', 'weapon2': '1.750', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:12:49,294][2409597] DAMAGECOUNT value on done: 3986.0
[2023-02-25 13:12:49,366][2409548] DAMAGECOUNT value on done: 6036.0
[2023-02-25 13:12:49,367][2409548] Sum rewards: 10.590, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.022', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO3': '0.092', 'AMMO4': '0.106', 'weapon7': '0.106', 'weapon5': '0.250', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'HITCOUNT': '0.520', 'WEAPON3': '0.600', 'weapon4': '0.698', 'weapon2': '0.874', 'weapon3': '1.344', 'DAMAGECOUNT': '2.598', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:12:49,418][2409866] DAMAGECOUNT value on done: 6181.0
[2023-02-25 13:12:49,419][2409866] Sum rewards: 5.550, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.916', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.078', 'AMMO3': '0.079', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'weapon7': '0.128', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.460', 'WEAPON3': '0.550', 'weapon3': '0.848', 'weapon2': '0.974', 'weapon4': '1.094', 'DAMAGECOUNT': '2.586', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:12:49,649][2409074] Updated weights for policy 0, policy_version 19961 (0.0013)
[2023-02-25 13:12:49,821][2409389] DAMAGECOUNT value on done: 6024.0
[2023-02-25 13:12:49,824][2409389] Sum rewards: 11.349, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.161', 'weapon5': '0.016', 'AMMO5': '0.017', 'AMMO2': '0.025', 'weapon7': '0.060', 'AMMO3': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'HITCOUNT': '0.750', 'weapon3': '1.058', 'ARMOR': '1.249', 'weapon2': '1.762', 'DAMAGECOUNT': '2.943', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:12:49,862][2409105] DAMAGECOUNT value on done: 6704.0
[2023-02-25 13:12:49,865][2409105] Sum rewards: 11.264, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.835', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.014', 'AMMO5': '0.015', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon5': '0.174', 'weapon4': '0.236', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'ARMOR': '0.848', 'HITCOUNT': '0.850', 'weapon2': '1.320', 'weapon3': '1.844', 'DAMAGECOUNT': '3.315', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:12:49,956][2409097] DAMAGECOUNT value on done: 5694.0
[2023-02-25 13:12:49,960][2409097] Sum rewards: 14.719, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.410', 'AMMO5': '0.007', 'AMMO2': '0.028', 'ARMOR': '0.040', 'AMMO3': '0.053', 'AMMO4': '0.138', 'weapon5': '0.196', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.750', 'weapon2': '0.838', 'HITCOUNT': '0.950', 'weapon3': '1.234', 'DAMAGECOUNT': '3.894', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:12:50,055][2409077] DAMAGECOUNT value on done: 4212.0
[2023-02-25 13:12:50,059][2409077] Sum rewards: 6.125, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.391', 'AMMO5': '0.011', 'AMMO2': '0.037', 'AMMO3': '0.094', 'weapon7': '0.156', 'AMMO4': '0.183', 'weapon5': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.304', 'AMMO6': '0.360', 'AMMO7': '0.360', 'WEAPON7': '0.400', 'HITCOUNT': '0.550', 'WEAPON3': '0.600', 'weapon2': '0.602', 'weapon3': '2.142', 'DAMAGECOUNT': '2.208', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:12:50,190][2409406] DAMAGECOUNT value on done: 5909.0
[2023-02-25 13:12:50,191][2409406] Sum rewards: 21.074, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.579', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'AMMO3': '0.070', 'AMMO4': '0.100', 'weapon5': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.464', 'WEAPON3': '0.550', 'weapon2': '1.192', 'HITCOUNT': '1.340', 'weapon3': '1.478', 'DAMAGECOUNT': '4.905', 'FRAGCOUNT': '16.000'}
[2023-02-25 13:12:50,711][2409373] DAMAGECOUNT value on done: 6215.0
[2023-02-25 13:12:50,712][2409373] Sum rewards: 6.246, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.680', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon7': '0.112', 'AMMO3': '0.118', 'weapon5': '0.150', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'AMMO4': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'HITCOUNT': '0.440', 'ARMOR': '0.455', 'weapon2': '0.630', 'WEAPON3': '0.700', 'weapon3': '1.062', 'weapon4': '1.062', 'DAMAGECOUNT': '1.989', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:12:51,435][2409100] DAMAGECOUNT value on done: 5115.0
[2023-02-25 13:12:51,439][2409100] Sum rewards: 9.999, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.456', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'weapon5': '0.052', 'AMMO3': '0.064', 'weapon7': '0.102', 'WEAPON5': '0.150', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.430', 'WEAPON3': '0.500', 'ARMOR': '0.850', 'weapon3': '1.438', 'weapon2': '1.796', 'DAMAGECOUNT': '1.962', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:12:51,525][2409549] DAMAGECOUNT value on done: 7578.0
[2023-02-25 13:12:51,528][2409549] Sum rewards: 12.089, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.895', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO3': '0.042', 'weapon7': '0.048', 'weapon5': '0.062', 'AMMO4': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'weapon4': '0.616', 'HITCOUNT': '0.660', 'weapon2': '0.882', 'weapon3': '0.946', 'DAMAGECOUNT': '3.483', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:12:51,672][2409485] DAMAGECOUNT value on done: 5769.0
[2023-02-25 13:12:51,672][2409074] Updated weights for policy 0, policy_version 19971 (0.0012)
[2023-02-25 13:12:51,672][2409485] Sum rewards: 13.210, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.044', 'AMMO2': '0.011', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.054', 'AMMO3': '0.086', 'weapon5': '0.222', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'HITCOUNT': '0.700', 'weapon2': '1.350', 'weapon3': '2.024', 'DAMAGECOUNT': '3.912', 'FRAGCOUNT': '8.500'}
[2023-02-25 13:12:51,801][2409102] DAMAGECOUNT value on done: 5469.0
[2023-02-25 13:12:51,804][2409102] Sum rewards: 11.323, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.684', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'AMMO3': '0.082', 'weapon5': '0.250', 'WEAPON5': '0.450', 'ARMOR': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.830', 'weapon2': '1.656', 'weapon3': '1.866', 'DAMAGECOUNT': '3.702', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:12:52,186][2408954] Fps is (10 sec: 24576.1, 60 sec: 24917.3, 300 sec: 25131.4). Total num frames: 81817600. Throughput: 0: 6264.9. Samples: 20449284. Policy #0 lag: (min: 1.0, avg: 15.3, max: 26.0)
[2023-02-25 13:12:52,186][2408954] Avg episode reward: [(0, '10.250')]
[2023-02-25 13:12:52,192][2409078] DAMAGECOUNT value on done: 5638.0
[2023-02-25 13:12:52,192][2409078] Sum rewards: 12.566, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.746', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.009', 'weapon7': '0.010', 'weapon4': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.162', 'WEAPON5': '0.200', 'WEAPON3': '0.550', 'HITCOUNT': '0.810', 'ARMOR': '0.925', 'weapon3': '1.630', 'weapon2': '1.920', 'DAMAGECOUNT': '3.885', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:12:52,197][2409033] Saving new best policy, reward=10.250!
[2023-02-25 13:12:52,273][2409355] DAMAGECOUNT value on done: 6466.0
[2023-02-25 13:12:52,276][2409355] Sum rewards: 2.801, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.741', 'AMMO2': '0.011', 'AMMO5': '0.017', 'AMMO3': '0.050', 'AMMO4': '0.053', 'weapon7': '0.058', 'weapon4': '0.060', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.210', 'WEAPON5': '0.350', 'WEAPON3': '0.350', 'HITCOUNT': '0.380', 'weapon3': '1.250', 'DAMAGECOUNT': '1.395', 'FRAGCOUNT': '2.000', 'weapon2': '2.068'}
[2023-02-25 13:12:52,302][2409565] DAMAGECOUNT value on done: 6306.0
[2023-02-25 13:12:52,306][2409565] Sum rewards: 3.797, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.604', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon7': '0.050', 'AMMO3': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.138', 'AMMO4': '0.139', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.348', 'WEAPON3': '0.400', 'HITCOUNT': '0.440', 'ARMOR': '0.500', 'weapon3': '0.942', 'weapon2': '1.306', 'DAMAGECOUNT': '2.181', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:12:52,381][2409104] DAMAGECOUNT value on done: 5163.0
[2023-02-25 13:12:52,384][2409104] Sum rewards: 4.151, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.159', 'AMMO2': '0.010', 'AMMO5': '0.026', 'WEAPON1': '0.030', 'AMMO4': '0.050', 'AMMO3': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.202', 'weapon4': '0.284', 'WEAPON5': '0.500', 'HITCOUNT': '0.630', 'WEAPON3': '0.650', 'ARMOR': '0.861', 'weapon3': '1.188', 'weapon2': '1.814', 'DAMAGECOUNT': '2.064', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:12:52,421][2409405] DAMAGECOUNT value on done: 4904.0
[2023-02-25 13:12:52,425][2409405] Sum rewards: 4.734, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.260', 'AMMO2': '0.008', 'AMMO5': '0.020', 'AMMO4': '0.039', 'weapon7': '0.066', 'AMMO3': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.158', 'WEAPON4': '0.200', 'weapon4': '0.292', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.600', 'weapon3': '1.228', 'weapon2': '1.428', 'ARMOR': '1.779', 'DAMAGECOUNT': '2.406', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:12:52,528][2409101] DAMAGECOUNT value on done: 5455.0
[2023-02-25 13:12:52,529][2409101] Sum rewards: 11.541, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.893', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.012', 'AMMO3': '0.060', 'WEAPON4': '0.150', 'weapon4': '0.180', 'weapon5': '0.258', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.730', 'weapon3': '1.252', 'ARMOR': '1.345', 'weapon2': '1.778', 'DAMAGECOUNT': '3.174', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:12:52,629][2409407] DAMAGECOUNT value on done: 7267.0
[2023-02-25 13:12:52,632][2409407] Sum rewards: 15.668, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.006', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'HEALTH': '0.060', 'AMMO3': '0.068', 'AMMO4': '0.093', 'WEAPON5': '0.150', 'weapon5': '0.336', 'WEAPON3': '0.450', 'HITCOUNT': '0.830', 'weapon3': '1.270', 'weapon2': '1.586', 'DAMAGECOUNT': '4.530', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:12:52,666][2409469] DAMAGECOUNT value on done: 5852.0
[2023-02-25 13:12:52,667][2409469] Sum rewards: 11.986, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.491', 'AMMO5': '0.006', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO3': '0.057', 'WEAPON4': '0.100', 'weapon5': '0.104', 'AMMO4': '0.109', 'weapon7': '0.134', 'WEAPON5': '0.200', 'weapon4': '0.214', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HITCOUNT': '0.290', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'weapon3': '1.122', 'ARMOR': '1.200', 'weapon2': '1.574', 'DAMAGECOUNT': '2.685', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:12:52,708][2409596] DAMAGECOUNT value on done: 5544.0
[2023-02-25 13:12:52,709][2409596] Sum rewards: 4.247, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.905', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO3': '0.030', 'AMMO2': '0.048', 'weapon7': '0.062', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.148', 'WEAPON3': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'AMMO4': '0.240', 'HITCOUNT': '0.390', 'WEAPON4': '0.450', 'weapon4': '0.732', 'weapon3': '0.772', 'weapon2': '1.068', 'DAMAGECOUNT': '1.602', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:12:52,832][2409103] DAMAGECOUNT value on done: 4049.0
[2023-02-25 13:12:52,836][2409103] Sum rewards: 5.910, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.326', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.025', 'AMMO3': '0.040', 'weapon5': '0.082', 'WEAPON4': '0.100', 'weapon7': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.224', 'WEAPON3': '0.250', 'ARMOR': '0.453', 'HITCOUNT': '0.500', 'weapon3': '0.818', 'weapon2': '1.880', 'DAMAGECOUNT': '1.905', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:12:52,947][2409074] Updated weights for policy 0, policy_version 19981 (0.0012)
[2023-02-25 13:12:53,044][2409866] DAMAGECOUNT value on done: 4110.0
[2023-02-25 13:12:53,047][2409866] Sum rewards: 7.807, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.735', 'AMMO2': '0.012', 'weapon4': '0.014', 'AMMO5': '0.026', 'AMMO4': '0.061', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'weapon5': '0.190', 'ARMOR': '0.493', 'WEAPON5': '0.550', 'HITCOUNT': '0.630', 'WEAPON3': '0.700', 'weapon2': '1.542', 'weapon3': '1.968', 'DAMAGECOUNT': '3.171', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:12:53,054][2409597] DAMAGECOUNT value on done: 6400.0
[2023-02-25 13:12:53,055][2409597] Sum rewards: 13.310, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.836', 'AMMO5': '0.021', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'weapon5': '0.116', 'AMMO3': '0.128', 'AMMO4': '0.160', 'WEAPON4': '0.200', 'weapon4': '0.366', 'WEAPON5': '0.450', 'ARMOR': '0.453', 'weapon2': '0.644', 'WEAPON3': '0.900', 'HITCOUNT': '1.140', 'weapon3': '2.522', 'DAMAGECOUNT': '4.734', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:12:53,174][2409033] Signal inference workers to stop experience collection... (2400 times)
[2023-02-25 13:12:53,186][2409033] Signal inference workers to resume experience collection... (2400 times)
[2023-02-25 13:12:53,214][2409074] InferenceWorker_p0-w0: stopping experience collection (2400 times)
[2023-02-25 13:12:53,214][2409074] InferenceWorker_p0-w0: resuming experience collection (2400 times)
[2023-02-25 13:12:53,222][2409548] DAMAGECOUNT value on done: 5800.0
[2023-02-25 13:12:53,225][2409548] Sum rewards: 11.962, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.607', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.012', 'WEAPON4': '0.100', 'weapon7': '0.114', 'AMMO3': '0.121', 'weapon5': '0.154', 'AMMO6': '0.280', 'AMMO7': '0.280', 'WEAPON5': '0.300', 'WEAPON7': '0.400', 'HITCOUNT': '0.550', 'weapon4': '0.584', 'WEAPON3': '0.750', 'weapon2': '0.862', 'weapon3': '2.020', 'DAMAGECOUNT': '3.294', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:12:53,629][2409105] DAMAGECOUNT value on done: 5630.0
[2023-02-25 13:12:53,632][2409105] Sum rewards: 10.624, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.119', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon7': '0.050', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.134', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'weapon4': '0.534', 'WEAPON3': '0.550', 'HITCOUNT': '0.690', 'weapon2': '1.012', 'weapon3': '1.476', 'DAMAGECOUNT': '3.819', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:12:53,722][2409077] DAMAGECOUNT value on done: 5991.0
[2023-02-25 13:12:53,726][2409077] Sum rewards: 6.895, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon5': '0.052', 'weapon7': '0.062', 'AMMO4': '0.063', 'AMMO3': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.190', 'HEALTH': '0.250', 'HITCOUNT': '0.340', 'WEAPON3': '0.400', 'ARMOR': '0.800', 'weapon3': '1.290', 'DAMAGECOUNT': '1.461', 'weapon2': '1.904', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:12:53,902][2409406] DAMAGECOUNT value on done: 6977.0
[2023-02-25 13:12:53,904][2409406] Sum rewards: 14.729, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.086', 'AMMO2': '0.006', 'AMMO5': '0.014', 'AMMO4': '0.027', 'AMMO3': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.106', 'weapon5': '0.174', 'weapon4': '0.222', 'WEAPON5': '0.400', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.950', 'weapon3': '1.418', 'weapon2': '1.464', 'DAMAGECOUNT': '3.861', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:12:53,973][2409097] DAMAGECOUNT value on done: 6410.0
[2023-02-25 13:12:53,975][2409097] Sum rewards: 15.772, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.077', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'weapon5': '0.178', 'WEAPON5': '0.250', 'HEALTH': '0.254', 'weapon4': '0.346', 'WEAPON3': '0.550', 'ARMOR': '0.800', 'HITCOUNT': '0.980', 'weapon2': '1.032', 'weapon3': '1.868', 'DAMAGECOUNT': '4.227', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:12:54,116][2409389] DAMAGECOUNT value on done: 7124.0
[2023-02-25 13:12:54,117][2409389] Sum rewards: 13.549, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.580', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.023', 'AMMO3': '0.051', 'weapon7': '0.066', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.436', 'WEAPON3': '0.450', 'HITCOUNT': '0.950', 'weapon3': '1.166', 'weapon2': '1.404', 'DAMAGECOUNT': '4.083', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:12:54,741][2409373] DAMAGECOUNT value on done: 6484.0
[2023-02-25 13:12:54,742][2409373] Sum rewards: 13.055, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.528', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'weapon5': '0.116', 'AMMO3': '0.128', 'weapon4': '0.176', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '1.130', 'weapon2': '1.144', 'weapon3': '2.110', 'DAMAGECOUNT': '4.455', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:12:55,032][2409074] Updated weights for policy 0, policy_version 19991 (0.0012)
[2023-02-25 13:12:55,267][2409549] DAMAGECOUNT value on done: 6198.0
[2023-02-25 13:12:55,271][2409549] Sum rewards: 12.272, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.952', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.027', 'AMMO3': '0.099', 'weapon5': '0.274', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.620', 'ARMOR': '0.851', 'weapon2': '1.488', 'weapon3': '2.080', 'DAMAGECOUNT': '3.117', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:12:55,383][2409100] DAMAGECOUNT value on done: 5343.0
[2023-02-25 13:12:55,384][2409100] Sum rewards: 12.457, reward structure: {'DEATHCOUNT': '-6.000', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO5': '0.025', 'WEAPON4': '0.050', 'AMMO3': '0.098', 'AMMO4': '0.115', 'weapon4': '0.150', 'HEALTH': '0.396', 'weapon5': '0.446', 'ARMOR': '0.447', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.700', 'weapon2': '1.142', 'weapon3': '1.664', 'DAMAGECOUNT': '3.081', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:12:55,434][2409075] DAMAGECOUNT value on done: 5467.0
[2023-02-25 13:12:55,435][2409075] Sum rewards: 8.633, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.065', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.060', 'weapon7': '0.062', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.542', 'WEAPON3': '0.550', 'weapon2': '0.614', 'HITCOUNT': '0.690', 'ARMOR': '0.871', 'weapon3': '1.396', 'DAMAGECOUNT': '2.643', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:12:55,468][2409102] DAMAGECOUNT value on done: 6258.0
[2023-02-25 13:12:55,469][2409102] Sum rewards: 8.935, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.686', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon7': '0.054', 'AMMO4': '0.120', 'AMMO3': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.144', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.530', 'HITCOUNT': '0.630', 'weapon2': '0.692', 'WEAPON3': '0.800', 'ARMOR': '0.820', 'weapon3': '1.978', 'DAMAGECOUNT': '2.832', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:12:55,765][2409485] DAMAGECOUNT value on done: 5969.0
[2023-02-25 13:12:55,776][2409485] Sum rewards: 10.819, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.010', 'AMMO2': '0.008', 'AMMO5': '0.019', 'AMMO4': '0.040', 'AMMO3': '0.062', 'WEAPON4': '0.100', 'weapon5': '0.132', 'weapon4': '0.208', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'ARMOR': '0.453', 'HITCOUNT': '0.840', 'weapon3': '1.052', 'weapon2': '1.296', 'DAMAGECOUNT': '3.069', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:12:55,780][2409076] DAMAGECOUNT value on done: 5942.0
[2023-02-25 13:12:55,787][2409076] Sum rewards: 8.664, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.722', 'AMMO5': '0.023', 'AMMO2': '0.034', 'WEAPON1': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.106', 'AMMO3': '0.110', 'AMMO4': '0.169', 'weapon5': '0.214', 'WEAPON4': '0.250', 'ARMOR': '0.453', 'WEAPON5': '0.600', 'weapon4': '0.610', 'weapon2': '0.696', 'WEAPON3': '0.800', 'HITCOUNT': '0.800', 'weapon3': '1.602', 'DAMAGECOUNT': '3.819', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:12:56,037][2409565] DAMAGECOUNT value on done: 7019.0
[2023-02-25 13:12:56,041][2409565] Sum rewards: 14.068, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.230', 'AMMO2': '0.017', 'AMMO5': '0.019', 'weapon7': '0.052', 'AMMO3': '0.074', 'AMMO4': '0.083', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.712', 'HITCOUNT': '0.790', 'weapon2': '0.916', 'weapon3': '1.436', 'DAMAGECOUNT': '3.093', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:12:56,192][2409101] DAMAGECOUNT value on done: 5847.0
[2023-02-25 13:12:56,195][2409101] Sum rewards: 4.910, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.909', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.030', 'ARMOR': '0.044', 'AMMO3': '0.067', 'weapon4': '0.100', 'weapon7': '0.116', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.460', 'weapon3': '1.410', 'DAMAGECOUNT': '1.548', 'weapon2': '1.964', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:12:56,318][2409078] DAMAGECOUNT value on done: 4934.0
[2023-02-25 13:12:56,350][2409469] DAMAGECOUNT value on done: 5420.0
[2023-02-25 13:12:56,351][2409469] Sum rewards: 4.366, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.270', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO3': '0.027', 'AMMO4': '0.047', 'weapon7': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.162', 'HITCOUNT': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon3': '0.334', 'DAMAGECOUNT': '0.870', 'ARMOR': '0.916', 'weapon4': '1.174', 'weapon2': '1.662', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:12:56,463][2409074] Updated weights for policy 0, policy_version 20001 (0.0013)
[2023-02-25 13:12:56,564][2409405] DAMAGECOUNT value on done: 5909.0
[2023-02-25 13:12:56,565][2409405] Sum rewards: 3.265, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.658', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO3': '0.061', 'AMMO4': '0.071', 'weapon7': '0.072', 'weapon5': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.388', 'ARMOR': '0.400', 'HITCOUNT': '0.410', 'WEAPON3': '0.450', 'weapon3': '1.010', 'DAMAGECOUNT': '1.416', 'weapon2': '1.884', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:12:56,661][2409104] DAMAGECOUNT value on done: 6264.0
[2023-02-25 13:12:56,662][2409104] Sum rewards: 8.510, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.060', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.029', 'WEAPON1': '0.070', 'weapon7': '0.084', 'AMMO3': '0.089', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.146', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.478', 'HITCOUNT': '0.510', 'WEAPON5': '0.550', 'weapon4': '0.640', 'WEAPON3': '0.650', 'weapon2': '1.182', 'weapon3': '1.312', 'DAMAGECOUNT': '2.190', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:12:56,807][2409407] DAMAGECOUNT value on done: 8917.0
[2023-02-25 13:12:56,807][2409407] Sum rewards: 6.902, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.414', 'AMMO5': '0.023', 'WEAPON1': '0.030', 'AMMO2': '0.034', 'AMMO3': '0.085', 'AMMO4': '0.170', 'weapon5': '0.194', 'WEAPON4': '0.250', 'weapon4': '0.300', 'WEAPON5': '0.450', 'ARMOR': '0.495', 'WEAPON3': '0.500', 'HITCOUNT': '0.750', 'weapon2': '1.106', 'weapon3': '1.776', 'DAMAGECOUNT': '3.153', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:12:56,876][2409596] DAMAGECOUNT value on done: 5490.0
[2023-02-25 13:12:56,879][2409596] Sum rewards: 5.495, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.596', 'AMMO5': '0.014', 'ARMOR': '0.040', 'AMMO2': '0.045', 'AMMO3': '0.090', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.222', 'weapon5': '0.238', 'WEAPON5': '0.300', 'HITCOUNT': '0.440', 'WEAPON4': '0.500', 'WEAPON3': '0.600', 'weapon2': '0.700', 'weapon4': '0.858', 'DAMAGECOUNT': '1.539', 'weapon3': '1.654', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:12:56,889][2409103] DAMAGECOUNT value on done: 4500.0
[2023-02-25 13:12:56,894][2409103] Sum rewards: 8.224, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.794', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO4': '0.035', 'AMMO3': '0.085', 'weapon7': '0.096', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.156', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.332', 'ARMOR': '0.400', 'HITCOUNT': '0.430', 'WEAPON3': '0.550', 'weapon3': '1.388', 'weapon2': '1.780', 'DAMAGECOUNT': '2.181', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:12:56,944][2409597] DAMAGECOUNT value on done: 6240.0
[2023-02-25 13:12:56,947][2409597] Sum rewards: 6.264, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.168', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO3': '0.065', 'weapon7': '0.074', 'weapon5': '0.078', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON3': '0.350', 'WEAPON7': '0.400', 'weapon2': '0.552', 'HITCOUNT': '0.630', 'ARMOR': '0.856', 'weapon4': '0.992', 'weapon3': '1.348', 'DAMAGECOUNT': '2.604', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:12:57,075][2409548] DAMAGECOUNT value on done: 5412.0
[2023-02-25 13:12:57,077][2409548] Sum rewards: 13.836, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.616', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'AMMO3': '0.066', 'WEAPON4': '0.100', 'weapon5': '0.234', 'WEAPON5': '0.300', 'weapon4': '0.310', 'WEAPON3': '0.500', 'HITCOUNT': '0.670', 'weapon3': '1.336', 'weapon2': '1.380', 'DAMAGECOUNT': '3.246', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:12:57,186][2408954] Fps is (10 sec: 25804.7, 60 sec: 25122.1, 300 sec: 25145.3). Total num frames: 81948672. Throughput: 0: 6248.3. Samples: 20486508. Policy #0 lag: (min: 1.0, avg: 12.2, max: 27.0)
[2023-02-25 13:12:57,187][2408954] Avg episode reward: [(0, '9.529')]
[2023-02-25 13:12:57,187][2409355] DAMAGECOUNT value on done: 5837.0
[2023-02-25 13:12:57,190][2409355] Sum rewards: 7.407, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.360', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'weapon4': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.072', 'weapon7': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.138', 'AMMO4': '0.146', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'HITCOUNT': '0.800', 'weapon2': '1.260', 'weapon3': '1.722', 'DAMAGECOUNT': '3.114', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:12:57,429][2409077] DAMAGECOUNT value on done: 5252.0
[2023-02-25 13:12:57,430][2409077] Sum rewards: 5.447, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.322', 'AMMO5': '0.003', 'AMMO3': '0.010', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'weapon5': '0.058', 'AMMO4': '0.074', 'WEAPON3': '0.100', 'WEAPON5': '0.100', 'weapon7': '0.120', 'HITCOUNT': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon3': '0.244', 'WEAPON7': '0.300', 'ARMOR': '0.459', 'DAMAGECOUNT': '0.600', 'weapon4': '0.646', 'weapon2': '1.900', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:12:57,519][2409078] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:12:57,547][2409105] DAMAGECOUNT value on done: 5809.0
[2023-02-25 13:12:57,550][2409105] Sum rewards: 6.259, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.382', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.096', 'AMMO4': '0.130', 'weapon5': '0.218', 'WEAPON4': '0.250', 'weapon4': '0.274', 'HITCOUNT': '0.410', 'WEAPON5': '0.450', 'ARMOR': '0.536', 'WEAPON3': '0.700', 'weapon3': '1.508', 'weapon2': '1.760', 'DAMAGECOUNT': '2.250', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:12:57,584][2409406] DAMAGECOUNT value on done: 5532.0
[2023-02-25 13:12:57,586][2409406] Sum rewards: 5.830, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.752', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'AMMO3': '0.087', 'weapon7': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.132', 'AMMO4': '0.161', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'HITCOUNT': '0.460', 'WEAPON3': '0.550', 'weapon2': '0.926', 'weapon3': '1.138', 'weapon4': '1.194', 'DAMAGECOUNT': '1.569', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:12:57,640][2409074] Updated weights for policy 0, policy_version 20011 (0.0013)
[2023-02-25 13:12:57,936][2409389] DAMAGECOUNT value on done: 4819.0
[2023-02-25 13:12:57,937][2409389] Sum rewards: 5.654, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.020', 'AMMO5': '0.005', 'ARMOR': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO3': '0.030', 'AMMO4': '0.042', 'weapon7': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON3': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.154', 'WEAPON7': '0.200', 'HITCOUNT': '0.310', 'weapon4': '0.424', 'weapon3': '0.564', 'weapon2': '1.212', 'DAMAGECOUNT': '1.959', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:12:57,942][2409097] DAMAGECOUNT value on done: 6055.0
[2023-02-25 13:12:57,947][2409097] Sum rewards: 8.192, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.510', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon7': '0.080', 'AMMO3': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.116', 'weapon4': '0.422', 'WEAPON5': '0.450', 'HITCOUNT': '0.660', 'WEAPON3': '0.750', 'weapon2': '0.888', 'weapon3': '1.750', 'DAMAGECOUNT': '3.093', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:12:58,009][2409866] DAMAGECOUNT value on done: 5916.0
[2023-02-25 13:12:58,009][2409866] Sum rewards: 9.854, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.040', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON3': '0.350', 'HITCOUNT': '0.760', 'ARMOR': '0.930', 'weapon3': '1.044', 'DAMAGECOUNT': '2.502', 'weapon2': '2.686', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:12:58,775][2409373] DAMAGECOUNT value on done: 6304.0
[2023-02-25 13:12:58,776][2409373] Sum rewards: 11.355, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.654', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'weapon7': '0.110', 'AMMO3': '0.122', 'weapon5': '0.160', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.500', 'HITCOUNT': '0.700', 'WEAPON3': '0.900', 'ARMOR': '1.249', 'weapon3': '1.668', 'weapon2': '1.676', 'DAMAGECOUNT': '3.300', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:12:59,060][2409102] DAMAGECOUNT value on done: 6707.0
[2023-02-25 13:12:59,062][2409102] Sum rewards: 17.504, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.125', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.073', 'AMMO3': '0.088', 'weapon5': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.370', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '1.030', 'weapon2': '1.262', 'weapon3': '1.626', 'DAMAGECOUNT': '4.152', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:12:59,233][2409549] DAMAGECOUNT value on done: 6687.0
[2023-02-25 13:12:59,236][2409549] Sum rewards: 7.229, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.676', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.023', 'weapon5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'WEAPON5': '0.200', 'weapon4': '0.210', 'WEAPON3': '0.700', 'HITCOUNT': '0.760', 'ARMOR': '0.853', 'weapon2': '1.454', 'weapon3': '1.704', 'DAMAGECOUNT': '2.484', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:12:59,259][2409075] DAMAGECOUNT value on done: 6165.0
[2023-02-25 13:12:59,260][2409075] Sum rewards: 11.725, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.534', 'AMMO5': '0.015', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.075', 'AMMO4': '0.079', 'weapon4': '0.126', 'WEAPON4': '0.150', 'weapon5': '0.184', 'WEAPON5': '0.300', 'ARMOR': '0.496', 'WEAPON3': '0.550', 'HITCOUNT': '0.800', 'weapon2': '1.460', 'weapon3': '1.712', 'DAMAGECOUNT': '3.276', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:12:59,382][2409100] DAMAGECOUNT value on done: 5355.0
[2023-02-25 13:12:59,383][2409100] Sum rewards: 5.997, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.340', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.038', 'AMMO3': '0.058', 'weapon7': '0.072', 'weapon5': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.390', 'WEAPON3': '0.400', 'HITCOUNT': '0.420', 'weapon2': '0.768', 'weapon3': '1.038', 'DAMAGECOUNT': '1.737', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:12:59,401][2409485] DAMAGECOUNT value on done: 5569.0
[2023-02-25 13:12:59,402][2409485] Sum rewards: 12.755, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.348', 'AMMO5': '0.011', 'AMMO2': '0.017', 'weapon7': '0.034', 'AMMO3': '0.069', 'AMMO4': '0.082', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon2': '0.530', 'HITCOUNT': '0.780', 'weapon4': '1.120', 'weapon3': '1.460', 'DAMAGECOUNT': '3.309', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:12:59,634][2409565] DAMAGECOUNT value on done: 6183.0
[2023-02-25 13:12:59,637][2409565] Sum rewards: 8.184, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.738', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.021', 'weapon5': '0.024', 'ARMOR': '0.040', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'AMMO3': '0.155', 'weapon4': '0.282', 'WEAPON5': '0.350', 'weapon2': '0.884', 'HITCOUNT': '1.010', 'WEAPON3': '1.050', 'weapon3': '2.346', 'DAMAGECOUNT': '3.975', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:12:59,672][2409076] DAMAGECOUNT value on done: 6227.0
[2023-02-25 13:12:59,672][2409076] Sum rewards: 8.686, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.250', 'AMMO2': '0.016', 'AMMO5': '0.017', 'AMMO4': '0.079', 'AMMO3': '0.093', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.214', 'WEAPON5': '0.450', 'weapon5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.810', 'ARMOR': '0.853', 'weapon2': '1.328', 'weapon3': '1.642', 'DAMAGECOUNT': '3.033', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:12:59,772][2409074] Updated weights for policy 0, policy_version 20021 (0.0014)
[2023-02-25 13:12:59,989][2409078] DAMAGECOUNT value on done: 6184.0
[2023-02-25 13:12:59,992][2409078] Sum rewards: 7.375, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.872', 'AMMO5': '0.013', 'AMMO2': '0.016', 'weapon4': '0.032', 'WEAPON4': '0.050', 'AMMO4': '0.082', 'AMMO3': '0.083', 'weapon5': '0.174', 'WEAPON5': '0.200', 'WEAPON3': '0.600', 'HITCOUNT': '0.630', 'ARMOR': '0.900', 'weapon2': '1.376', 'weapon3': '1.378', 'DAMAGECOUNT': '2.463', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:13:00,014][2409469] DAMAGECOUNT value on done: 5544.0
[2023-02-25 13:13:00,015][2409469] Sum rewards: 12.039, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.036', 'AMMO3': '0.040', 'weapon5': '0.050', 'weapon7': '0.076', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HEALTH': '0.174', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.700', 'weapon3': '0.976', 'weapon2': '1.734', 'DAMAGECOUNT': '3.003', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:00,119][2409405] DAMAGECOUNT value on done: 6255.0
[2023-02-25 13:13:00,120][2409405] Sum rewards: 3.926, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.839', 'AMMO2': '0.005', 'AMMO5': '0.014', 'AMMO4': '0.025', 'WEAPON1': '0.040', 'weapon4': '0.066', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'weapon5': '0.112', 'WEAPON5': '0.400', 'HITCOUNT': '0.570', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'weapon3': '1.460', 'weapon2': '2.046', 'DAMAGECOUNT': '2.388', 'FRAGCOUNT': '3.500'}
[2023-02-25 13:13:00,368][2409101] DAMAGECOUNT value on done: 4906.0
[2023-02-25 13:13:00,369][2409101] Sum rewards: 4.580, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.320', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.029', 'AMMO3': '0.048', 'weapon7': '0.094', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'HITCOUNT': '0.330', 'weapon4': '0.340', 'ARMOR': '0.400', 'weapon2': '0.544', 'weapon3': '0.792', 'DAMAGECOUNT': '1.212', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:13:00,588][2409103] DAMAGECOUNT value on done: 6982.0
[2023-02-25 13:13:00,591][2409103] Sum rewards: 7.352, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO3': '0.030', 'AMMO4': '0.031', 'weapon7': '0.054', 'HEALTH': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.118', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.360', 'weapon4': '0.588', 'weapon3': '0.764', 'ARMOR': '0.844', 'weapon2': '1.114', 'DAMAGECOUNT': '1.314', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:13:00,605][2409104] DAMAGECOUNT value on done: 5316.0
[2023-02-25 13:13:00,606][2409104] Sum rewards: 12.423, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.006', 'AMMO5': '0.009', 'WEAPON1': '0.030', 'AMMO4': '0.031', 'AMMO3': '0.050', 'weapon5': '0.112', 'HEALTH': '0.197', 'WEAPON5': '0.200', 'WEAPON3': '0.350', 'ARMOR': '0.800', 'HITCOUNT': '0.810', 'weapon3': '1.268', 'weapon2': '1.834', 'DAMAGECOUNT': '3.225', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:00,794][2409407] DAMAGECOUNT value on done: 4900.0
[2023-02-25 13:13:00,798][2409407] Sum rewards: 7.546, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.145', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'weapon7': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.178', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.480', 'weapon3': '1.036', 'weapon2': '1.564', 'DAMAGECOUNT': '2.307', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:13:00,830][2409596] DAMAGECOUNT value on done: 4936.0
[2023-02-25 13:13:00,833][2409596] Sum rewards: 13.352, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.010', 'AMMO5': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'weapon4': '0.060', 'AMMO3': '0.073', 'weapon5': '0.246', 'WEAPON5': '0.350', 'HEALTH': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.710', 'weapon2': '1.154', 'weapon3': '1.578', 'DAMAGECOUNT': '3.849', 'FRAGCOUNT': '8.500'}
[2023-02-25 13:13:00,844][2409597] DAMAGECOUNT value on done: 5710.0
[2023-02-25 13:13:00,845][2409597] Sum rewards: 5.363, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.158', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'weapon7': '0.052', 'AMMO3': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.108', 'AMMO4': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.268', 'HITCOUNT': '0.380', 'WEAPON3': '0.400', 'ARMOR': '0.460', 'weapon3': '0.968', 'weapon2': '1.494', 'DAMAGECOUNT': '2.127', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:13:00,913][2409548] DAMAGECOUNT value on done: 5643.0
[2023-02-25 13:13:00,916][2409548] Sum rewards: 4.691, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.596', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.123', 'weapon5': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.288', 'HITCOUNT': '0.540', 'WEAPON3': '0.750', 'weapon3': '1.504', 'weapon2': '1.530', 'ARMOR': '1.767', 'DAMAGECOUNT': '2.241', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:13:01,045][2409077] DAMAGECOUNT value on done: 5821.0
[2023-02-25 13:13:01,045][2409077] Sum rewards: 9.049, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.614', 'AMMO2': '0.013', 'AMMO5': '0.017', 'AMMO4': '0.064', 'AMMO3': '0.109', 'weapon5': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.544', 'HITCOUNT': '0.670', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'weapon2': '1.256', 'weapon3': '1.376', 'DAMAGECOUNT': '3.156', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:13:01,151][2409074] Updated weights for policy 0, policy_version 20031 (0.0012)
[2023-02-25 13:13:01,201][2409406] DAMAGECOUNT value on done: 4716.0
[2023-02-25 13:13:01,201][2409406] Sum rewards: 6.730, reward structure: {'DEATHCOUNT': '-6.000', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO5': '0.020', 'weapon4': '0.054', 'HEALTH': '0.072', 'AMMO4': '0.078', 'AMMO3': '0.085', 'WEAPON4': '0.150', 'weapon5': '0.374', 'HITCOUNT': '0.390', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.413', 'weapon2': '1.550', 'weapon3': '1.564', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:01,508][2409105] DAMAGECOUNT value on done: 6359.0
[2023-02-25 13:13:01,508][2409105] Sum rewards: 8.213, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.210', 'AMMO2': '0.016', 'AMMO5': '0.025', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.079', 'AMMO3': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.198', 'HITCOUNT': '0.310', 'weapon4': '0.340', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'ARMOR': '0.855', 'weapon2': '1.352', 'weapon3': '1.634', 'DAMAGECOUNT': '2.673', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:01,683][2409389] DAMAGECOUNT value on done: 6007.0
[2023-02-25 13:13:01,684][2409389] Sum rewards: 9.825, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.310', 'AMMO5': '0.015', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'weapon7': '0.044', 'AMMO4': '0.076', 'AMMO3': '0.096', 'weapon4': '0.154', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.228', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'HITCOUNT': '0.780', 'weapon2': '1.420', 'weapon3': '1.674', 'DAMAGECOUNT': '3.123', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:13:01,904][2409355] DAMAGECOUNT value on done: 6199.0
[2023-02-25 13:13:01,930][2409355] Sum rewards: 14.053, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.870', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.013', 'AMMO3': '0.055', 'WEAPON5': '0.150', 'weapon5': '0.158', 'weapon7': '0.158', 'WEAPON4': '0.200', 'WEAPON3': '0.400', 'ARMOR': '0.400', 'AMMO6': '0.440', 'AMMO7': '0.440', 'WEAPON7': '0.600', 'HITCOUNT': '0.610', 'weapon2': '0.702', 'weapon4': '0.812', 'weapon3': '0.924', 'DAMAGECOUNT': '4.353', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:13:02,001][2409866] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:13:02,186][2408954] Fps is (10 sec: 24575.5, 60 sec: 25190.3, 300 sec: 25117.5). Total num frames: 82063360. Throughput: 0: 6260.2. Samples: 20524284. Policy #0 lag: (min: 1.0, avg: 12.2, max: 27.0)
[2023-02-25 13:13:02,187][2408954] Avg episode reward: [(0, '9.268')]
[2023-02-25 13:13:02,300][2409097] DAMAGECOUNT value on done: 6970.0
[2023-02-25 13:13:02,304][2409097] Sum rewards: 11.837, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.085', 'AMMO2': '0.013', 'AMMO5': '0.025', 'weapon7': '0.048', 'AMMO4': '0.067', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.145', 'WEAPON7': '0.200', 'weapon5': '0.224', 'WEAPON4': '0.300', 'weapon4': '0.398', 'WEAPON5': '0.650', 'WEAPON3': '0.950', 'HITCOUNT': '0.970', 'weapon2': '1.134', 'weapon3': '1.512', 'DAMAGECOUNT': '4.296', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:13:02,829][2409866] DAMAGECOUNT value on done: 6349.0
[2023-02-25 13:13:02,832][2409866] Sum rewards: 7.582, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.940', 'AMMO2': '0.018', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.054', 'weapon7': '0.074', 'AMMO4': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.232', 'WEAPON5': '0.400', 'HITCOUNT': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.604', 'ARMOR': '0.885', 'weapon3': '1.212', 'weapon2': '1.682', 'DAMAGECOUNT': '2.184', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:13:02,875][2409102] DAMAGECOUNT value on done: 5986.0
[2023-02-25 13:13:02,881][2409373] DAMAGECOUNT value on done: 5720.0
[2023-02-25 13:13:02,879][2409102] Sum rewards: 4.300, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.630', 'AMMO5': '0.015', 'AMMO2': '0.039', 'WEAPON1': '0.040', 'weapon7': '0.054', 'AMMO3': '0.112', 'weapon5': '0.134', 'AMMO4': '0.196', 'WEAPON4': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'weapon4': '0.322', 'WEAPON5': '0.400', 'WEAPON7': '0.400', 'HITCOUNT': '0.570', 'WEAPON3': '0.700', 'weapon2': '1.156', 'weapon3': '1.380', 'DAMAGECOUNT': '2.472', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:13:02,882][2409373] Sum rewards: 7.724, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.388', 'AMMO2': '0.008', 'AMMO5': '0.013', 'AMMO4': '0.041', 'weapon7': '0.048', 'AMMO3': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.142', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.442', 'WEAPON3': '0.750', 'HITCOUNT': '0.790', 'ARMOR': '0.845', 'weapon2': '1.470', 'weapon3': '1.718', 'DAMAGECOUNT': '3.000', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:02,896][2409100] DAMAGECOUNT value on done: 6246.0
[2023-02-25 13:13:02,899][2409100] Sum rewards: 6.788, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.155', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'weapon7': '0.046', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.222', 'WEAPON5': '0.500', 'HITCOUNT': '0.570', 'WEAPON3': '0.800', 'ARMOR': '0.908', 'weapon3': '1.608', 'weapon2': '1.714', 'DAMAGECOUNT': '2.727', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:03,016][2409075] DAMAGECOUNT value on done: 6582.0
[2023-02-25 13:13:03,021][2409075] Sum rewards: 7.353, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.920', 'AMMO5': '0.022', 'AMMO2': '0.027', 'weapon4': '0.086', 'AMMO3': '0.110', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'weapon5': '0.220', 'WEAPON5': '0.600', 'HITCOUNT': '0.600', 'WEAPON3': '0.800', 'weapon2': '1.542', 'weapon3': '1.770', 'DAMAGECOUNT': '3.708', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:03,084][2409074] Updated weights for policy 0, policy_version 20041 (0.0012)
[2023-02-25 13:13:03,138][2409485] DAMAGECOUNT value on done: 6298.0
[2023-02-25 13:13:03,139][2409485] Sum rewards: 7.807, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.664', 'AMMO5': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'AMMO3': '0.065', 'AMMO4': '0.074', 'weapon4': '0.180', 'WEAPON4': '0.200', 'weapon5': '0.210', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.620', 'ARMOR': '0.866', 'weapon3': '1.376', 'weapon2': '1.762', 'DAMAGECOUNT': '2.250', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:03,145][2409549] DAMAGECOUNT value on done: 5290.0
[2023-02-25 13:13:03,145][2409549] Sum rewards: 12.241, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.019', 'AMMO5': '0.019', 'WEAPON1': '0.030', 'weapon7': '0.062', 'weapon5': '0.076', 'AMMO4': '0.094', 'AMMO3': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HEALTH': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon4': '0.684', 'HITCOUNT': '0.880', 'weapon2': '0.972', 'weapon3': '1.902', 'DAMAGECOUNT': '3.255', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:13:03,494][2409565] DAMAGECOUNT value on done: 6278.0
[2023-02-25 13:13:03,499][2409565] Sum rewards: 7.497, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.480', 'AMMO5': '0.019', 'AMMO2': '0.030', 'AMMO3': '0.063', 'AMMO4': '0.151', 'weapon5': '0.202', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'WEAPON5': '0.450', 'ARMOR': '0.500', 'weapon4': '0.614', 'HITCOUNT': '0.910', 'weapon2': '0.956', 'weapon3': '1.430', 'DAMAGECOUNT': '3.102', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:13:03,725][2409469] DAMAGECOUNT value on done: 7124.0
[2023-02-25 13:13:03,741][2409469] Sum rewards: 7.201, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.062', 'AMMO2': '0.006', 'AMMO5': '0.020', 'AMMO4': '0.029', 'AMMO3': '0.068', 'weapon5': '0.246', 'WEAPON4': '0.250', 'weapon4': '0.418', 'WEAPON3': '0.500', 'WEAPON5': '0.500', 'HITCOUNT': '0.810', 'weapon2': '1.152', 'ARMOR': '1.311', 'weapon3': '1.324', 'DAMAGECOUNT': '3.129', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:13:03,812][2409076] DAMAGECOUNT value on done: 6062.0
[2023-02-25 13:13:03,812][2409076] Sum rewards: 11.066, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.672', 'AMMO2': '0.009', 'AMMO5': '0.015', 'AMMO4': '0.044', 'weapon7': '0.056', 'AMMO3': '0.109', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.174', 'WEAPON7': '0.200', 'weapon4': '0.284', 'WEAPON5': '0.350', 'HITCOUNT': '0.630', 'WEAPON3': '0.650', 'ARMOR': '1.389', 'weapon3': '1.410', 'weapon2': '1.748', 'DAMAGECOUNT': '3.780', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:13:03,957][2409078] DAMAGECOUNT value on done: 5983.0
[2023-02-25 13:13:03,958][2409078] Sum rewards: 7.723, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.190', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO3': '0.076', 'weapon5': '0.090', 'AMMO4': '0.101', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.730', 'weapon4': '0.838', 'weapon2': '1.396', 'weapon3': '1.450', 'DAMAGECOUNT': '2.406', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:04,091][2409405] DAMAGECOUNT value on done: 5255.0
[2023-02-25 13:13:04,091][2409405] Sum rewards: 4.845, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.060', 'HEALTH': '0.098', 'weapon5': '0.108', 'weapon7': '0.142', 'WEAPON5': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'WEAPON7': '0.400', 'ARMOR': '0.400', 'HITCOUNT': '0.460', 'weapon2': '0.742', 'weapon4': '0.884', 'weapon3': '1.062', 'DAMAGECOUNT': '1.881', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:13:04,243][2409103] DAMAGECOUNT value on done: 6540.0
[2023-02-25 13:13:04,244][2409103] Sum rewards: 8.887, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.348', 'AMMO5': '0.009', 'WEAPON1': '0.030', 'AMMO2': '0.042', 'AMMO3': '0.050', 'weapon5': '0.170', 'AMMO4': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'weapon4': '0.400', 'HITCOUNT': '0.590', 'weapon2': '1.240', 'weapon3': '1.470', 'DAMAGECOUNT': '2.676', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:04,410][2409074] Updated weights for policy 0, policy_version 20051 (0.0012)
[2023-02-25 13:13:04,450][2409548] DAMAGECOUNT value on done: 5987.0
[2023-02-25 13:13:04,451][2409548] Sum rewards: 11.941, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.170', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'WEAPON4': '0.050', 'AMMO3': '0.079', 'weapon4': '0.080', 'AMMO4': '0.084', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.194', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'HITCOUNT': '0.700', 'weapon2': '1.188', 'weapon3': '1.434', 'DAMAGECOUNT': '2.493', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:13:04,590][2409597] DAMAGECOUNT value on done: 5759.0
[2023-02-25 13:13:04,593][2409597] Sum rewards: 9.155, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.103', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.038', 'AMMO3': '0.068', 'weapon5': '0.070', 'weapon7': '0.096', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'WEAPON3': '0.500', 'weapon4': '0.574', 'HITCOUNT': '0.840', 'weapon2': '1.004', 'weapon3': '1.252', 'DAMAGECOUNT': '2.808', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:04,596][2409101] DAMAGECOUNT value on done: 6948.0
[2023-02-25 13:13:04,601][2409104] DAMAGECOUNT value on done: 5460.0
[2023-02-25 13:13:04,600][2409101] Sum rewards: 18.938, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.350', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO3': '0.088', 'AMMO4': '0.148', 'weapon5': '0.156', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'weapon4': '0.680', 'ARMOR': '0.855', 'HITCOUNT': '0.860', 'weapon2': '1.116', 'weapon3': '1.348', 'DAMAGECOUNT': '4.179', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:13:04,601][2409104] Sum rewards: 9.374, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.108', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon7': '0.048', 'AMMO3': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.114', 'AMMO4': '0.175', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.800', 'HITCOUNT': '0.870', 'weapon3': '1.142', 'weapon2': '2.030', 'DAMAGECOUNT': '2.631', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:13:04,678][2409077] DAMAGECOUNT value on done: 5578.0
[2023-02-25 13:13:04,681][2409077] Sum rewards: 16.615, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.837', 'AMMO2': '0.014', 'AMMO5': '0.024', 'AMMO4': '0.070', 'AMMO3': '0.081', 'weapon4': '0.192', 'WEAPON4': '0.300', 'weapon5': '0.320', 'ARMOR': '0.453', 'WEAPON3': '0.650', 'WEAPON5': '0.650', 'HITCOUNT': '1.020', 'weapon3': '1.568', 'weapon2': '1.592', 'DAMAGECOUNT': '4.518', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:13:04,760][2409596] DAMAGECOUNT value on done: 5909.0
[2023-02-25 13:13:04,764][2409596] Sum rewards: 5.885, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.760', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.048', 'weapon7': '0.052', 'AMMO3': '0.061', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.360', 'WEAPON3': '0.400', 'ARMOR': '0.453', 'weapon3': '1.008', 'DAMAGECOUNT': '1.335', 'weapon2': '2.012', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:13:04,834][2409406] DAMAGECOUNT value on done: 5440.0
[2023-02-25 13:13:04,839][2409406] Sum rewards: 7.305, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.251', 'AMMO2': '0.015', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon7': '0.054', 'AMMO3': '0.063', 'AMMO4': '0.073', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.132', 'weapon4': '0.270', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.670', 'ARMOR': '0.800', 'weapon3': '1.354', 'weapon2': '1.436', 'DAMAGECOUNT': '2.304', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:13:05,076][2409407] DAMAGECOUNT value on done: 7252.0
[2023-02-25 13:13:05,079][2409407] Sum rewards: 3.783, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.543', 'AMMO5': '0.015', 'AMMO2': '0.022', 'AMMO3': '0.070', 'AMMO4': '0.108', 'weapon5': '0.176', 'WEAPON4': '0.250', 'weapon4': '0.300', 'HITCOUNT': '0.370', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'weapon2': '1.060', 'weapon3': '1.402', 'DAMAGECOUNT': '1.653', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:13:05,271][2409105] DAMAGECOUNT value on done: 6037.0
[2023-02-25 13:13:05,274][2409105] Sum rewards: 10.605, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'weapon4': '0.058', 'AMMO3': '0.061', 'weapon7': '0.064', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HEALTH': '0.158', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.212', 'WEAPON3': '0.400', 'HITCOUNT': '0.600', 'ARMOR': '1.200', 'weapon3': '1.264', 'weapon2': '2.110', 'DAMAGECOUNT': '2.703', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:05,418][2409389] DAMAGECOUNT value on done: 6464.0
[2023-02-25 13:13:05,421][2409389] Sum rewards: 7.833, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.642', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon5': '0.046', 'weapon7': '0.054', 'AMMO3': '0.090', 'AMMO4': '0.188', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.454', 'WEAPON3': '0.600', 'HITCOUNT': '0.780', 'ARMOR': '0.854', 'weapon4': '1.012', 'weapon3': '1.610', 'DAMAGECOUNT': '2.685', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:06,104][2409355] DAMAGECOUNT value on done: 6349.0
[2023-02-25 13:13:06,107][2409355] Sum rewards: 5.787, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.360', 'AMMO5': '0.019', 'AMMO2': '0.031', 'AMMO3': '0.093', 'AMMO4': '0.152', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon5': '0.356', 'weapon4': '0.372', 'ARMOR': '0.453', 'WEAPON3': '0.700', 'HITCOUNT': '0.750', 'weapon2': '0.880', 'weapon3': '2.082', 'DAMAGECOUNT': '2.859', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:06,228][2409074] Updated weights for policy 0, policy_version 20061 (0.0012)
[2023-02-25 13:13:06,429][2409100] DAMAGECOUNT value on done: 5904.0
[2023-02-25 13:13:06,432][2409100] Sum rewards: 9.755, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.206', 'AMMO5': '0.022', 'AMMO2': '0.043', 'AMMO3': '0.100', 'AMMO4': '0.213', 'WEAPON4': '0.300', 'weapon4': '0.400', 'ARMOR': '0.443', 'weapon5': '0.472', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '0.890', 'weapon2': '1.198', 'weapon3': '1.650', 'DAMAGECOUNT': '3.780', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:13:06,438][2409102] DAMAGECOUNT value on done: 6022.0
[2023-02-25 13:13:06,439][2409102] Sum rewards: 8.455, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.815', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.025', 'AMMO3': '0.047', 'weapon5': '0.048', 'WEAPON5': '0.200', 'weapon7': '0.226', 'WEAPON4': '0.300', 'AMMO6': '0.360', 'AMMO7': '0.360', 'WEAPON3': '0.400', 'HITCOUNT': '0.410', 'ARMOR': '0.451', 'WEAPON7': '0.600', 'weapon3': '0.840', 'weapon2': '1.046', 'weapon4': '1.176', 'DAMAGECOUNT': '2.268', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:06,658][2409097] DAMAGECOUNT value on done: 5644.0
[2023-02-25 13:13:06,662][2409097] Sum rewards: 13.398, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.202', 'AMMO2': '0.019', 'AMMO5': '0.022', 'AMMO4': '0.093', 'weapon7': '0.112', 'AMMO3': '0.137', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.242', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'weapon4': '0.440', 'WEAPON5': '0.550', 'weapon2': '0.742', 'HITCOUNT': '0.870', 'WEAPON3': '0.900', 'ARMOR': '1.419', 'weapon3': '2.030', 'DAMAGECOUNT': '4.284', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:13:06,662][2409373] DAMAGECOUNT value on done: 6120.0
[2023-02-25 13:13:06,666][2409373] Sum rewards: 12.075, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon7': '0.052', 'AMMO3': '0.054', 'AMMO4': '0.085', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.158', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HEALTH': '0.250', 'WEAPON3': '0.300', 'weapon4': '0.636', 'weapon2': '0.750', 'HITCOUNT': '0.810', 'weapon3': '1.030', 'DAMAGECOUNT': '2.883', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:06,797][2409075] DAMAGECOUNT value on done: 5286.0
[2023-02-25 13:13:06,798][2409075] Sum rewards: 16.935, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.262', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO3': '0.040', 'AMMO4': '0.048', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.204', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'weapon4': '0.476', 'HITCOUNT': '0.950', 'weapon3': '0.960', 'weapon2': '1.710', 'DAMAGECOUNT': '4.494', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:13:06,827][2409101] Large shaping reward 2.575 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.543, 181.0), ('weapon7', 0.002)]
[2023-02-25 13:13:06,955][2409866] DAMAGECOUNT value on done: 6961.0
[2023-02-25 13:13:06,958][2409866] Sum rewards: 9.788, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.012', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO4': '0.075', 'AMMO3': '0.099', 'weapon5': '0.170', 'WEAPON4': '0.250', 'weapon4': '0.262', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'HITCOUNT': '0.860', 'ARMOR': '1.255', 'weapon2': '1.470', 'weapon3': '1.882', 'DAMAGECOUNT': '3.270', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:13:07,037][2409565] DAMAGECOUNT value on done: 6264.0
[2023-02-25 13:13:07,039][2409565] Sum rewards: 9.359, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.925', 'AMMO5': '0.015', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'AMMO3': '0.051', 'AMMO4': '0.104', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.364', 'WEAPON3': '0.400', 'HITCOUNT': '0.590', 'ARMOR': '0.851', 'weapon3': '1.268', 'weapon2': '1.536', 'DAMAGECOUNT': '2.874', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:07,186][2408954] Fps is (10 sec: 24575.8, 60 sec: 24917.6, 300 sec: 25159.1). Total num frames: 82194432. Throughput: 0: 6241.1. Samples: 20542572. Policy #0 lag: (min: 1.0, avg: 12.2, max: 27.0)
[2023-02-25 13:13:07,187][2408954] Avg episode reward: [(0, '9.088')]
[2023-02-25 13:13:07,298][2409485] DAMAGECOUNT value on done: 5981.0
[2023-02-25 13:13:07,300][2409485] Sum rewards: 10.164, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.970', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon7': '0.046', 'AMMO3': '0.086', 'AMMO4': '0.089', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.438', 'ARMOR': '0.455', 'WEAPON3': '0.600', 'HITCOUNT': '0.770', 'weapon3': '1.162', 'weapon2': '1.520', 'DAMAGECOUNT': '3.840', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:07,478][2409549] DAMAGECOUNT value on done: 5591.0
[2023-02-25 13:13:07,481][2409549] Sum rewards: 8.542, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.655', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon7': '0.048', 'AMMO3': '0.068', 'AMMO4': '0.091', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'HITCOUNT': '0.540', 'weapon4': '0.658', 'ARMOR': '0.861', 'weapon3': '1.042', 'weapon2': '1.784', 'DAMAGECOUNT': '2.652', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:07,651][2409469] DAMAGECOUNT value on done: 6958.0
[2023-02-25 13:13:07,664][2409469] Sum rewards: 9.433, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.843', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.087', 'weapon5': '0.110', 'WEAPON5': '0.250', 'HITCOUNT': '0.620', 'WEAPON3': '0.650', 'weapon3': '1.668', 'weapon2': '2.048', 'DAMAGECOUNT': '3.099', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:07,690][2409076] DAMAGECOUNT value on done: 6048.0
[2023-02-25 13:13:07,690][2409076] Sum rewards: 12.086, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon7': '0.054', 'AMMO3': '0.057', 'WEAPON5': '0.150', 'weapon5': '0.160', 'HEALTH': '0.194', 'AMMO4': '0.221', 'WEAPON4': '0.300', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON3': '0.300', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.560', 'weapon2': '0.802', 'weapon4': '0.876', 'weapon3': '0.892', 'DAMAGECOUNT': '2.418', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:13:07,761][2409078] DAMAGECOUNT value on done: 5642.0
[2023-02-25 13:13:07,761][2409078] Sum rewards: 7.685, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.424', 'weapon7': '0.006', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon5': '0.060', 'AMMO3': '0.108', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'WEAPON4': '0.300', 'AMMO6': '0.400', 'WEAPON7': '0.400', 'AMMO7': '0.400', 'weapon4': '0.596', 'WEAPON3': '0.700', 'HITCOUNT': '0.720', 'weapon3': '1.246', 'weapon2': '1.336', 'ARMOR': '1.386', 'DAMAGECOUNT': '2.349', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:07,830][2409405] DAMAGECOUNT value on done: 6787.0
[2023-02-25 13:13:07,834][2409405] Sum rewards: 16.261, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.035', 'AMMO5': '0.003', 'AMMO2': '0.012', 'AMMO3': '0.040', 'weapon5': '0.046', 'weapon7': '0.058', 'AMMO4': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.212', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.780', 'weapon3': '0.954', 'weapon2': '2.062', 'DAMAGECOUNT': '3.870', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:13:07,854][2409074] Updated weights for policy 0, policy_version 20071 (0.0012)
[2023-02-25 13:13:08,049][2409548] DAMAGECOUNT value on done: 7410.0
[2023-02-25 13:13:08,049][2409548] Sum rewards: 9.629, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.392', 'AMMO5': '0.007', 'AMMO2': '0.030', 'WEAPON1': '0.030', 'weapon5': '0.088', 'AMMO3': '0.093', 'weapon7': '0.104', 'AMMO4': '0.150', 'WEAPON5': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'weapon4': '0.556', 'HITCOUNT': '0.570', 'WEAPON3': '0.600', 'weapon2': '1.360', 'weapon3': '1.668', 'DAMAGECOUNT': '3.234', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:13:08,198][2409104] DAMAGECOUNT value on done: 5613.0
[2023-02-25 13:13:08,201][2409104] Sum rewards: 2.969, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.430', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'weapon7': '0.054', 'AMMO3': '0.085', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.180', 'WEAPON7': '0.200', 'weapon5': '0.200', 'WEAPON5': '0.350', 'ARMOR': '0.404', 'WEAPON4': '0.500', 'HITCOUNT': '0.570', 'WEAPON3': '0.600', 'weapon2': '0.736', 'weapon4': '1.024', 'weapon3': '1.336', 'DAMAGECOUNT': '2.847', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:13:08,219][2409597] DAMAGECOUNT value on done: 7241.0
[2023-02-25 13:13:08,220][2409597] Sum rewards: 10.718, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.146', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO5': '0.022', 'AMMO4': '0.105', 'AMMO3': '0.107', 'weapon5': '0.234', 'WEAPON4': '0.350', 'weapon4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'ARMOR': '0.856', 'HITCOUNT': '0.940', 'weapon2': '1.054', 'weapon3': '1.838', 'DAMAGECOUNT': '3.366', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:08,385][2409596] DAMAGECOUNT value on done: 5217.0
[2023-02-25 13:13:08,388][2409596] Sum rewards: 10.861, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.192', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.007', 'AMMO3': '0.040', 'weapon7': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.190', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.300', 'weapon4': '0.334', 'ARMOR': '0.494', 'HITCOUNT': '0.550', 'weapon3': '1.030', 'weapon2': '1.554', 'DAMAGECOUNT': '2.694', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:08,481][2409096] DAMAGECOUNT value on done: 7038.0
[2023-02-25 13:13:08,482][2409096] Sum rewards: 14.456, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.485', 'AMMO5': '0.018', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'AMMO3': '0.101', 'AMMO4': '0.103', 'weapon4': '0.180', 'weapon5': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'weapon2': '0.844', 'HITCOUNT': '0.880', 'weapon3': '2.482', 'DAMAGECOUNT': '3.591', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:13:08,498][2409101] DAMAGECOUNT value on done: 6224.0
[2023-02-25 13:13:08,501][2409101] Sum rewards: 8.613, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.578', 'AMMO5': '0.007', 'AMMO2': '0.031', 'AMMO3': '0.050', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'weapon7': '0.202', 'WEAPON4': '0.350', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'weapon4': '0.420', 'AMMO6': '0.440', 'AMMO7': '0.440', 'HITCOUNT': '0.520', 'WEAPON7': '0.600', 'weapon3': '1.130', 'weapon2': '1.648', 'DAMAGECOUNT': '2.190', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:08,565][2409077] DAMAGECOUNT value on done: 5781.0
[2023-02-25 13:13:08,570][2409077] Sum rewards: 7.769, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.058', 'HEALTH': '0.070', 'AMMO3': '0.076', 'weapon5': '0.142', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.490', 'weapon3': '1.674', 'weapon2': '1.678', 'DAMAGECOUNT': '2.277', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:13:08,696][2409407] DAMAGECOUNT value on done: 5929.0
[2023-02-25 13:13:08,700][2409407] Sum rewards: 14.509, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO3': '0.030', 'weapon7': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.141', 'weapon5': '0.186', 'WEAPON3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HEALTH': '0.323', 'ARMOR': '0.400', 'HITCOUNT': '0.690', 'weapon4': '0.796', 'weapon3': '0.798', 'weapon2': '1.638', 'DAMAGECOUNT': '2.706', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:08,761][2409406] DAMAGECOUNT value on done: 4396.0
[2023-02-25 13:13:08,778][2409406] Sum rewards: 12.666, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.019', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'AMMO4': '0.132', 'weapon5': '0.176', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'weapon4': '0.570', 'HITCOUNT': '0.740', 'ARMOR': '0.872', 'weapon2': '1.252', 'weapon3': '1.412', 'DAMAGECOUNT': '2.367', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:08,872][2409105] DAMAGECOUNT value on done: 5584.0
[2023-02-25 13:13:08,873][2409105] Sum rewards: 13.958, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.115', 'AMMO2': '0.005', 'AMMO4': '0.023', 'AMMO5': '0.025', 'AMMO3': '0.122', 'weapon5': '0.124', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'weapon2': '1.196', 'HITCOUNT': '1.220', 'weapon3': '2.170', 'DAMAGECOUNT': '3.888', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:13:08,986][2409103] DAMAGECOUNT value on done: 6646.0
[2023-02-25 13:13:08,987][2409103] Sum rewards: 11.209, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.660', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.057', 'weapon7': '0.114', 'weapon5': '0.142', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.300', 'HITCOUNT': '0.330', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'ARMOR': '0.452', 'weapon3': '0.608', 'DAMAGECOUNT': '2.364', 'weapon2': '2.964', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:09,249][2409389] DAMAGECOUNT value on done: 5797.0
[2023-02-25 13:13:09,254][2409389] Sum rewards: 2.562, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.619', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'AMMO3': '0.046', 'weapon7': '0.074', 'AMMO4': '0.101', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.300', 'WEAPON5': '0.300', 'HITCOUNT': '0.350', 'weapon3': '0.712', 'weapon4': '0.814', 'weapon2': '0.908', 'DAMAGECOUNT': '1.215', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:13:09,642][2409074] Updated weights for policy 0, policy_version 20081 (0.0013)
[2023-02-25 13:13:09,944][2409100] DAMAGECOUNT value on done: 6634.0
[2023-02-25 13:13:09,947][2409100] Sum rewards: 18.926, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.020', 'AMMO2': '0.033', 'AMMO3': '0.062', 'weapon7': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.167', 'weapon5': '0.250', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.536', 'HITCOUNT': '0.940', 'HEALTH': '1.102', 'weapon3': '1.128', 'weapon2': '1.156', 'DAMAGECOUNT': '4.116', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:13:09,985][2409102] DAMAGECOUNT value on done: 5264.0
[2023-02-25 13:13:09,986][2409102] Sum rewards: 8.912, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.746', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon7': '0.064', 'weapon5': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.121', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.366', 'WEAPON3': '0.700', 'HITCOUNT': '0.920', 'ARMOR': '1.311', 'weapon3': '1.414', 'weapon2': '1.594', 'DAMAGECOUNT': '3.210', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:10,051][2409079] DAMAGECOUNT value on done: 5535.0
[2023-02-25 13:13:10,055][2409079] Sum rewards: 10.662, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.690', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'AMMO3': '0.077', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'weapon5': '0.110', 'weapon7': '0.168', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.710', 'weapon4': '0.760', 'ARMOR': '0.800', 'weapon2': '0.944', 'weapon3': '1.542', 'DAMAGECOUNT': '3.177', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:10,078][2409355] DAMAGECOUNT value on done: 6362.0
[2023-02-25 13:13:10,079][2409355] Sum rewards: 7.102, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.689', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.017', 'AMMO4': '0.056', 'AMMO3': '0.101', 'weapon7': '0.106', 'weapon5': '0.144', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'weapon4': '0.696', 'weapon2': '1.038', 'weapon3': '1.778', 'DAMAGECOUNT': '2.643', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:10,563][2409486] DAMAGECOUNT value on done: 4420.0
[2023-02-25 13:13:10,564][2409486] Sum rewards: 5.693, reward structure: {'DEATHCOUNT': '-0.750', 'HEALTH': '-0.307', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO5': '0.003', 'AMMO3': '0.020', 'weapon5': '0.062', 'WEAPON5': '0.100', 'weapon7': '0.122', 'HITCOUNT': '0.130', 'WEAPON3': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'DAMAGECOUNT': '0.390', 'WEAPON7': '0.400', 'weapon3': '0.492', 'ARMOR': '0.929', 'weapon2': '1.482', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:13:10,604][2409565] DAMAGECOUNT value on done: 6339.0
[2023-02-25 13:13:10,605][2409565] Sum rewards: 16.471, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO2': '0.050', 'AMMO3': '0.056', 'weapon5': '0.068', 'weapon7': '0.172', 'HEALTH': '0.222', 'AMMO4': '0.251', 'weapon2': '0.286', 'WEAPON3': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'WEAPON7': '0.400', 'HITCOUNT': '0.700', 'weapon3': '0.930', 'weapon4': '1.880', 'DAMAGECOUNT': '3.663', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:13:10,644][2409075] DAMAGECOUNT value on done: 6103.0
[2023-02-25 13:13:10,645][2409075] Sum rewards: 13.335, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.381', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'weapon5': '0.086', 'AMMO3': '0.092', 'AMMO4': '0.177', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'weapon4': '0.704', 'weapon2': '0.784', 'ARMOR': '0.876', 'HITCOUNT': '0.930', 'weapon3': '1.662', 'DAMAGECOUNT': '3.387', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:13:10,716][2409373] DAMAGECOUNT value on done: 6210.0
[2023-02-25 13:13:10,717][2409373] Sum rewards: 9.857, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.033', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.106', 'weapon5': '0.122', 'weapon7': '0.124', 'AMMO4': '0.167', 'HEALTH': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.457', 'weapon4': '0.490', 'WEAPON3': '0.600', 'HITCOUNT': '0.770', 'weapon2': '1.270', 'weapon3': '1.586', 'DAMAGECOUNT': '3.363', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:10,831][2409866] DAMAGECOUNT value on done: 6122.0
[2023-02-25 13:13:10,837][2409866] Sum rewards: 6.783, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.948', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO2': '0.026', 'weapon7': '0.118', 'AMMO3': '0.119', 'AMMO4': '0.130', 'weapon5': '0.148', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.400', 'HITCOUNT': '0.480', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon2': '0.938', 'weapon4': '1.078', 'weapon3': '1.236', 'ARMOR': '1.290', 'DAMAGECOUNT': '2.682', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:10,883][2409097] DAMAGECOUNT value on done: 6191.0
[2023-02-25 13:13:10,892][2409097] Sum rewards: 6.065, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.050', 'AMMO3': '0.079', 'weapon5': '0.188', 'WEAPON5': '0.200', 'HEALTH': '0.316', 'WEAPON3': '0.450', 'HITCOUNT': '0.530', 'weapon3': '1.418', 'DAMAGECOUNT': '1.620', 'weapon2': '1.666', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:13:11,027][2409549] DAMAGECOUNT value on done: 6830.0
[2023-02-25 13:13:11,031][2409549] Sum rewards: 7.116, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.346', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.035', 'AMMO3': '0.061', 'weapon7': '0.080', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.176', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'WEAPON4': '0.350', 'ARMOR': '0.486', 'HITCOUNT': '0.550', 'weapon4': '0.588', 'weapon3': '0.910', 'weapon2': '1.656', 'DAMAGECOUNT': '2.073', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:11,131][2409074] Updated weights for policy 0, policy_version 20091 (0.0012)
[2023-02-25 13:13:11,448][2409078] DAMAGECOUNT value on done: 5606.0
[2023-02-25 13:13:11,451][2409078] Sum rewards: 6.543, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.564', 'AMMO5': '0.007', 'AMMO2': '0.031', 'AMMO3': '0.072', 'AMMO4': '0.154', 'weapon5': '0.166', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.538', 'HITCOUNT': '0.660', 'weapon2': '1.086', 'weapon3': '1.494', 'DAMAGECOUNT': '2.148', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:11,478][2409405] DAMAGECOUNT value on done: 5938.0
[2023-02-25 13:13:11,479][2409405] Sum rewards: 8.827, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.513', 'AMMO5': '0.014', 'AMMO2': '0.021', 'AMMO3': '0.050', 'weapon5': '0.072', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'WEAPON4': '0.450', 'WEAPON3': '0.450', 'HITCOUNT': '0.740', 'weapon2': '0.882', 'weapon4': '0.924', 'weapon3': '1.144', 'ARMOR': '1.200', 'DAMAGECOUNT': '2.640', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:13:11,578][2409548] DAMAGECOUNT value on done: 7205.0
[2023-02-25 13:13:11,579][2409548] Sum rewards: 8.202, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.058', 'AMMO5': '0.003', 'weapon5': '0.022', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon7': '0.050', 'AMMO3': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.150', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.780', 'ARMOR': '0.808', 'weapon2': '0.834', 'weapon4': '1.248', 'weapon3': '1.314', 'DAMAGECOUNT': '2.469', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:13:11,896][2409485] DAMAGECOUNT value on done: 4745.0
[2023-02-25 13:13:11,897][2409485] Sum rewards: 5.831, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.962', 'AMMO5': '0.015', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'weapon7': '0.052', 'AMMO3': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.102', 'AMMO4': '0.123', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '0.700', 'weapon2': '0.702', 'HITCOUNT': '0.770', 'weapon4': '1.004', 'ARMOR': '1.252', 'weapon3': '1.616', 'DAMAGECOUNT': '2.952', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:11,926][2409597] DAMAGECOUNT value on done: 7399.0
[2023-02-25 13:13:11,930][2409597] Sum rewards: 12.030, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.700', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO4': '0.085', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.112', 'weapon5': '0.120', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'ARMOR': '0.859', 'HITCOUNT': '0.890', 'weapon3': '1.344', 'weapon2': '2.206', 'DAMAGECOUNT': '3.810', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:13:12,029][2409076] DAMAGECOUNT value on done: 6365.0
[2023-02-25 13:13:12,030][2409101] DAMAGECOUNT value on done: 6812.0
[2023-02-25 13:13:12,032][2409076] Sum rewards: 7.303, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.752', 'AMMO5': '0.018', 'AMMO2': '0.028', 'AMMO3': '0.063', 'AMMO4': '0.138', 'weapon7': '0.146', 'weapon5': '0.204', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'HITCOUNT': '0.570', 'ARMOR': '0.800', 'weapon3': '0.910', 'weapon2': '0.984', 'weapon4': '1.332', 'DAMAGECOUNT': '2.532', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:13:12,033][2409101] Sum rewards: 11.308, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.430', 'AMMO2': '0.009', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.043', 'weapon4': '0.056', 'AMMO3': '0.060', 'weapon7': '0.070', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.292', 'WEAPON3': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.390', 'ARMOR': '0.800', 'weapon3': '0.884', 'DAMAGECOUNT': '2.091', 'weapon2': '2.318', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:12,186][2408954] Fps is (10 sec: 25395.9, 60 sec: 24780.8, 300 sec: 25186.9). Total num frames: 82317312. Throughput: 0: 6246.1. Samples: 20580456. Policy #0 lag: (min: 0.0, avg: 12.9, max: 25.0)
[2023-02-25 13:13:12,186][2408954] Avg episode reward: [(0, '9.336')]
[2023-02-25 13:13:12,198][2409104] DAMAGECOUNT value on done: 6390.0
[2023-02-25 13:13:12,199][2409104] Sum rewards: 11.054, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO3': '0.030', 'AMMO4': '0.084', 'weapon5': '0.116', 'weapon7': '0.148', 'WEAPON3': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HEALTH': '0.289', 'WEAPON7': '0.300', 'HITCOUNT': '0.420', 'weapon4': '0.722', 'ARMOR': '0.800', 'weapon3': '0.912', 'weapon2': '0.976', 'DAMAGECOUNT': '2.088', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:12,351][2409596] DAMAGECOUNT value on done: 6471.0
[2023-02-25 13:13:12,352][2409596] Sum rewards: 11.399, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.420', 'AMMO2': '0.012', 'AMMO5': '0.015', 'weapon4': '0.016', 'WEAPON1': '0.030', 'AMMO4': '0.061', 'AMMO3': '0.081', 'WEAPON4': '0.150', 'weapon5': '0.166', 'WEAPON5': '0.350', 'ARMOR': '0.457', 'WEAPON3': '0.550', 'HITCOUNT': '0.600', 'weapon2': '1.376', 'weapon3': '1.480', 'DAMAGECOUNT': '2.724', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:13:12,357][2409469] DAMAGECOUNT value on done: 5726.0
[2023-02-25 13:13:12,360][2409469] Sum rewards: 8.349, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.066', 'AMMO5': '0.009', 'AMMO2': '0.041', 'AMMO3': '0.069', 'weapon7': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.152', 'AMMO4': '0.204', 'WEAPON5': '0.250', 'HITCOUNT': '0.520', 'WEAPON3': '0.550', 'weapon2': '0.584', 'ARMOR': '0.852', 'weapon3': '1.258', 'weapon4': '1.342', 'DAMAGECOUNT': '2.058', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:12,572][2409407] DAMAGECOUNT value on done: 5674.0
[2023-02-25 13:13:12,573][2409407] Sum rewards: 11.883, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.529', 'AMMO2': '0.009', 'AMMO5': '0.011', 'weapon4': '0.018', 'AMMO4': '0.045', 'AMMO3': '0.067', 'weapon7': '0.070', 'WEAPON4': '0.100', 'weapon5': '0.148', 'WEAPON5': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.450', 'ARMOR': '0.468', 'weapon3': '1.234', 'weapon2': '1.962', 'DAMAGECOUNT': '2.589', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:12,634][2409105] DAMAGECOUNT value on done: 6888.0
[2023-02-25 13:13:12,638][2409105] Sum rewards: 10.056, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.374', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.030', 'weapon7': '0.046', 'AMMO4': '0.051', 'AMMO3': '0.056', 'weapon5': '0.056', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'ARMOR': '0.455', 'HITCOUNT': '0.480', 'weapon4': '0.628', 'weapon3': '1.114', 'weapon2': '1.592', 'DAMAGECOUNT': '2.364', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:12,728][2409074] Updated weights for policy 0, policy_version 20101 (0.0014)
[2023-02-25 13:13:12,933][2409077] DAMAGECOUNT value on done: 7036.0
[2023-02-25 13:13:12,934][2409077] Sum rewards: 18.609, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.880', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO3': '0.074', 'weapon5': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.438', 'ARMOR': '0.445', 'WEAPON3': '0.600', 'weapon2': '1.086', 'HITCOUNT': '1.140', 'weapon3': '1.572', 'DAMAGECOUNT': '4.038', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:13:12,998][2409096] DAMAGECOUNT value on done: 5553.0
[2023-02-25 13:13:13,001][2409096] Sum rewards: 11.687, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.590', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'AMMO5': '0.029', 'AMMO3': '0.095', 'AMMO4': '0.111', 'weapon5': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'weapon4': '0.762', 'HITCOUNT': '0.840', 'weapon2': '1.158', 'weapon3': '1.608', 'ARMOR': '1.758', 'DAMAGECOUNT': '3.588', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:13:13,070][2409103] DAMAGECOUNT value on done: 6068.0
[2023-02-25 13:13:13,072][2409103] Sum rewards: 10.089, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.049', 'AMMO5': '0.007', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO3': '0.050', 'weapon4': '0.076', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'weapon5': '0.116', 'WEAPON5': '0.150', 'WEAPON3': '0.300', 'HITCOUNT': '0.800', 'weapon3': '1.236', 'weapon2': '1.670', 'DAMAGECOUNT': '3.270', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:13,141][2409389] DAMAGECOUNT value on done: 6639.0
[2023-02-25 13:13:13,141][2409389] Sum rewards: 8.959, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.072', 'AMMO2': '0.005', 'weapon5': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.024', 'weapon7': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'WEAPON5': '0.300', 'weapon4': '0.406', 'ARMOR': '0.455', 'HITCOUNT': '0.590', 'WEAPON3': '0.650', 'weapon3': '1.032', 'weapon2': '1.144', 'DAMAGECOUNT': '1.824', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:13:13,166][2409406] DAMAGECOUNT value on done: 4609.0
[2023-02-25 13:13:13,169][2409406] Sum rewards: 2.445, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.068', 'AMMO5': '0.009', 'AMMO2': '0.042', 'AMMO3': '0.079', 'weapon7': '0.138', 'weapon5': '0.186', 'WEAPON5': '0.200', 'AMMO4': '0.212', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.390', 'WEAPON3': '0.450', 'ARMOR': '0.856', 'weapon4': '0.972', 'weapon2': '1.108', 'weapon3': '1.356', 'DAMAGECOUNT': '1.974', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:13:13,770][2409355] DAMAGECOUNT value on done: 6020.0
[2023-02-25 13:13:13,784][2409355] Sum rewards: 9.304, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.176', 'AMMO5': '0.015', 'AMMO3': '0.040', 'ARMOR': '0.040', 'AMMO2': '0.051', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON3': '0.250', 'AMMO4': '0.256', 'weapon5': '0.266', 'HITCOUNT': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.718', 'weapon3': '0.946', 'weapon2': '1.628', 'DAMAGECOUNT': '2.085', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:13,819][2409102] DAMAGECOUNT value on done: 5495.0
[2023-02-25 13:13:13,820][2409102] Sum rewards: 8.251, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.216', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO3': '0.060', 'WEAPON1': '0.060', 'AMMO4': '0.156', 'weapon5': '0.334', 'HITCOUNT': '0.400', 'WEAPON3': '0.450', 'WEAPON5': '0.450', 'weapon2': '1.544', 'weapon3': '1.662', 'DAMAGECOUNT': '2.055', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:13:13,895][2409079] DAMAGECOUNT value on done: 5670.0
[2023-02-25 13:13:13,899][2409079] Sum rewards: 5.069, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.824', 'AMMO2': '0.007', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'weapon7': '0.058', 'weapon4': '0.060', 'AMMO3': '0.109', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.176', 'WEAPON7': '0.200', 'WEAPON5': '0.450', 'HITCOUNT': '0.480', 'WEAPON3': '0.800', 'weapon3': '1.616', 'weapon2': '1.708', 'DAMAGECOUNT': '2.367', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:14,326][2409074] Updated weights for policy 0, policy_version 20111 (0.0012)
[2023-02-25 13:13:14,369][2409075] DAMAGECOUNT value on done: 6023.0
[2023-02-25 13:13:14,369][2409075] Sum rewards: 12.767, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.724', 'AMMO4': '-0.056', 'AMMO2': '-0.011', 'AMMO5': '0.020', 'AMMO3': '0.068', 'WEAPON4': '0.150', 'weapon4': '0.256', 'weapon5': '0.268', 'WEAPON3': '0.550', 'WEAPON5': '0.550', 'ARMOR': '0.914', 'HITCOUNT': '0.980', 'weapon3': '1.274', 'weapon2': '1.722', 'DAMAGECOUNT': '4.056', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:13:14,461][2409486] DAMAGECOUNT value on done: 6643.0
[2023-02-25 13:13:14,462][2409486] Sum rewards: 10.435, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.649', 'AMMO2': '0.009', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.101', 'weapon5': '0.210', 'weapon4': '0.240', 'WEAPON5': '0.400', 'ARMOR': '0.456', 'WEAPON3': '0.650', 'HITCOUNT': '0.760', 'weapon2': '1.490', 'weapon3': '1.544', 'DAMAGECOUNT': '2.832', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:13:14,511][2409866] DAMAGECOUNT value on done: 5704.0
[2023-02-25 13:13:14,514][2409866] Sum rewards: 13.788, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.822', 'AMMO5': '0.011', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.068', 'weapon5': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'ARMOR': '0.495', 'WEAPON3': '0.500', 'weapon4': '0.560', 'weapon3': '1.190', 'weapon2': '1.262', 'HITCOUNT': '1.270', 'DAMAGECOUNT': '4.197', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:13:14,647][2409373] DAMAGECOUNT value on done: 6642.0
[2023-02-25 13:13:14,650][2409373] Sum rewards: 6.043, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.670', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'weapon7': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.112', 'AMMO3': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.226', 'WEAPON5': '0.300', 'HITCOUNT': '0.610', 'WEAPON3': '0.800', 'weapon2': '1.224', 'weapon3': '1.308', 'DAMAGECOUNT': '2.415', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:14,892][2409565] DAMAGECOUNT value on done: 5057.0
[2023-02-25 13:13:14,892][2409565] Sum rewards: 9.626, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.092', 'AMMO2': '0.015', 'AMMO5': '0.021', 'WEAPON1': '0.030', 'AMMO4': '0.075', 'weapon7': '0.102', 'AMMO3': '0.112', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.250', 'WEAPON7': '0.300', 'weapon4': '0.310', 'ARMOR': '0.450', 'WEAPON5': '0.500', 'HITCOUNT': '0.680', 'WEAPON3': '0.750', 'weapon2': '1.150', 'weapon3': '1.812', 'DAMAGECOUNT': '2.820', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:13:15,078][2409097] DAMAGECOUNT value on done: 6001.0
[2023-02-25 13:13:15,079][2409097] Sum rewards: 6.674, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.686', 'AMMO5': '0.010', 'weapon7': '0.022', 'AMMO2': '0.025', 'AMMO3': '0.080', 'weapon5': '0.096', 'AMMO4': '0.123', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'AMMO6': '0.400', 'WEAPON7': '0.400', 'AMMO7': '0.400', 'WEAPON3': '0.450', 'ARMOR': '0.457', 'weapon4': '0.502', 'HITCOUNT': '0.570', 'weapon3': '1.366', 'weapon2': '1.388', 'DAMAGECOUNT': '2.271', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:13:15,135][2409549] DAMAGECOUNT value on done: 5343.0
[2023-02-25 13:13:15,144][2409549] Sum rewards: 7.288, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.128', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO3': '0.058', 'weapon7': '0.074', 'AMMO4': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.162', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'weapon4': '0.368', 'HITCOUNT': '0.610', 'weapon3': '1.122', 'weapon2': '1.922', 'DAMAGECOUNT': '2.415', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:13:15,212][2409548] DAMAGECOUNT value on done: 5739.0
[2023-02-25 13:13:15,212][2409548] Sum rewards: 6.228, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.146', 'AMMO2': '0.009', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.042', 'AMMO3': '0.102', 'weapon5': '0.140', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'weapon4': '0.580', 'WEAPON3': '0.750', 'weapon2': '0.754', 'HITCOUNT': '0.820', 'weapon3': '1.652', 'DAMAGECOUNT': '2.535', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:15,441][2409078] DAMAGECOUNT value on done: 6350.0
[2023-02-25 13:13:15,442][2409078] Sum rewards: 14.868, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.084', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'WEAPON4': '0.050', 'weapon4': '0.076', 'AMMO3': '0.134', 'weapon5': '0.226', 'WEAPON5': '0.500', 'ARMOR': '0.831', 'WEAPON3': '0.850', 'HITCOUNT': '1.120', 'weapon3': '1.660', 'weapon2': '1.662', 'DAMAGECOUNT': '4.305', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:13:15,451][2409405] DAMAGECOUNT value on done: 5841.0
[2023-02-25 13:13:15,452][2409405] Sum rewards: 2.352, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.090', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.006', 'WEAPON1': '0.010', 'weapon5': '0.022', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'weapon7': '0.068', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON3': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.224', 'HITCOUNT': '0.330', 'weapon2': '0.340', 'weapon3': '0.616', 'DAMAGECOUNT': '1.032', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:13:15,615][2409076] DAMAGECOUNT value on done: 5626.0
[2023-02-25 13:13:15,618][2409076] Sum rewards: 4.846, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.430', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.021', 'weapon7': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.122', 'weapon5': '0.188', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'HITCOUNT': '0.450', 'weapon4': '0.636', 'WEAPON3': '0.650', 'weapon2': '0.724', 'weapon3': '1.532', 'DAMAGECOUNT': '2.286', 'FRAGCOUNT': '3.500'}
[2023-02-25 13:13:15,658][2409485] DAMAGECOUNT value on done: 6701.0
[2023-02-25 13:13:15,662][2409485] Sum rewards: 12.124, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.668', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'weapon5': '0.050', 'AMMO4': '0.064', 'weapon7': '0.066', 'weapon4': '0.094', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.700', 'HITCOUNT': '0.830', 'ARMOR': '1.284', 'weapon2': '1.608', 'weapon3': '1.918', 'DAMAGECOUNT': '3.405', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:15,748][2409597] DAMAGECOUNT value on done: 4807.0
[2023-02-25 13:13:15,750][2409597] Sum rewards: 6.628, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.748', 'AMMO5': '0.008', 'AMMO2': '0.015', 'WEAPON1': '0.060', 'AMMO4': '0.073', 'AMMO3': '0.090', 'weapon7': '0.126', 'weapon5': '0.170', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'weapon4': '0.302', 'WEAPON7': '0.400', 'ARMOR': '0.416', 'HITCOUNT': '0.510', 'WEAPON3': '0.600', 'weapon3': '1.476', 'weapon2': '1.612', 'DAMAGECOUNT': '2.337', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:13:15,877][2409074] Updated weights for policy 0, policy_version 20121 (0.0012)
[2023-02-25 13:13:16,009][2409104] DAMAGECOUNT value on done: 6804.0
[2023-02-25 13:13:16,010][2409104] Sum rewards: 7.472, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.425', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.062', 'weapon7': '0.072', 'AMMO4': '0.075', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.122', 'WEAPON5': '0.200', 'WEAPON3': '0.450', 'HITCOUNT': '0.550', 'weapon3': '1.356', 'weapon2': '1.512', 'DAMAGECOUNT': '1.905', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:13:16,167][2409596] DAMAGECOUNT value on done: 6210.0
[2023-02-25 13:13:16,169][2409596] Sum rewards: 7.860, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.680', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.058', 'AMMO3': '0.074', 'WEAPON4': '0.100', 'weapon7': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.158', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.350', 'weapon4': '0.400', 'WEAPON3': '0.500', 'weapon3': '1.388', 'weapon2': '1.418', 'DAMAGECOUNT': '2.010', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:13:16,173][2409101] DAMAGECOUNT value on done: 6987.0
[2023-02-25 13:13:16,177][2409101] Sum rewards: 12.330, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.036', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO2': '0.034', 'weapon7': '0.064', 'AMMO3': '0.101', 'AMMO4': '0.170', 'weapon5': '0.220', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'weapon4': '0.338', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.730', 'weapon2': '1.366', 'weapon3': '1.708', 'ARMOR': '1.811', 'DAMAGECOUNT': '4.383', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:13:16,200][2409407] DAMAGECOUNT value on done: 5959.0
[2023-02-25 13:13:16,201][2409407] Sum rewards: 8.937, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.188', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'weapon4': '0.066', 'AMMO4': '0.077', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'weapon5': '0.232', 'WEAPON5': '0.550', 'HITCOUNT': '0.580', 'WEAPON3': '0.650', 'ARMOR': '0.853', 'weapon2': '1.246', 'weapon3': '1.804', 'DAMAGECOUNT': '2.814', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:16,565][2409105] DAMAGECOUNT value on done: 6414.0
[2023-02-25 13:13:16,566][2409105] Sum rewards: 8.691, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.510', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO3': '0.086', 'AMMO4': '0.093', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.158', 'ARMOR': '0.400', 'weapon4': '0.452', 'WEAPON3': '0.650', 'HITCOUNT': '0.880', 'weapon2': '1.142', 'weapon3': '1.758', 'DAMAGECOUNT': '3.246', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:16,630][2409469] DAMAGECOUNT value on done: 7533.0
[2023-02-25 13:13:16,630][2409469] Sum rewards: 16.218, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.071', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.097', 'weapon4': '0.126', 'weapon5': '0.244', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'ARMOR': '0.430', 'HITCOUNT': '0.810', 'weapon3': '1.458', 'weapon2': '1.800', 'DAMAGECOUNT': '5.037', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:13:16,951][2409389] DAMAGECOUNT value on done: 6535.0
[2023-02-25 13:13:16,954][2409389] Sum rewards: 10.243, reward structure: {'DEATHCOUNT': '-0.750', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO3': '0.020', 'AMMO4': '0.025', 'HEALTH': '0.070', 'WEAPON4': '0.100', 'weapon7': '0.136', 'WEAPON5': '0.150', 'WEAPON3': '0.150', 'weapon5': '0.162', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.430', 'weapon3': '0.466', 'weapon4': '0.622', 'weapon2': '0.908', 'DAMAGECOUNT': '2.601', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:13:17,144][2409077] DAMAGECOUNT value on done: 6693.0
[2023-02-25 13:13:17,145][2409077] Sum rewards: 14.366, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '0.018', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO3': '0.100', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'weapon5': '0.212', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon4': '0.580', 'HITCOUNT': '0.670', 'weapon2': '1.178', 'weapon3': '1.826', 'DAMAGECOUNT': '3.309', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:13:17,186][2408954] Fps is (10 sec: 25805.1, 60 sec: 25258.7, 300 sec: 25242.5). Total num frames: 82452480. Throughput: 0: 6247.7. Samples: 20618004. Policy #0 lag: (min: 0.0, avg: 12.9, max: 25.0)
[2023-02-25 13:13:17,186][2408954] Avg episode reward: [(0, '9.624')]
[2023-02-25 13:13:17,321][2409406] DAMAGECOUNT value on done: 6348.0
[2023-02-25 13:13:17,321][2409406] Sum rewards: 9.475, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.632', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.090', 'AMMO4': '0.119', 'weapon4': '0.194', 'weapon5': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'ARMOR': '0.915', 'HITCOUNT': '0.920', 'weapon2': '1.584', 'weapon3': '1.748', 'DAMAGECOUNT': '3.930', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:13:17,352][2409096] DAMAGECOUNT value on done: 4991.0
[2023-02-25 13:13:17,352][2409096] Sum rewards: 11.343, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.351', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.017', 'AMMO4': '0.056', 'AMMO3': '0.094', 'WEAPON4': '0.150', 'weapon5': '0.262', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.488', 'weapon2': '0.598', 'WEAPON3': '0.650', 'HITCOUNT': '0.840', 'weapon3': '1.968', 'DAMAGECOUNT': '3.699', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:17,482][2409079] DAMAGECOUNT value on done: 5728.0
[2023-02-25 13:13:17,486][2409079] Sum rewards: 8.896, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.112', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.045', 'AMMO3': '0.050', 'weapon5': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.108', 'WEAPON5': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.560', 'weapon2': '1.070', 'weapon3': '1.210', 'DAMAGECOUNT': '2.760', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:17,500][2409355] DAMAGECOUNT value on done: 4777.0
[2023-02-25 13:13:17,501][2409355] Sum rewards: 10.875, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.076', 'weapon7': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.131', 'weapon5': '0.136', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.630', 'weapon4': '0.650', 'HEALTH': '0.890', 'weapon2': '1.096', 'weapon3': '1.260', 'ARMOR': '1.292', 'DAMAGECOUNT': '2.523', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:17,778][2409074] Updated weights for policy 0, policy_version 20131 (0.0012)
[2023-02-25 13:13:18,109][2409102] DAMAGECOUNT value on done: 5749.0
[2023-02-25 13:13:18,110][2409102] Sum rewards: 6.315, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.649', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO3': '0.056', 'weapon7': '0.056', 'AMMO4': '0.062', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.232', 'WEAPON5': '0.250', 'HITCOUNT': '0.330', 'ARMOR': '0.457', 'WEAPON3': '0.500', 'weapon4': '0.554', 'weapon3': '1.088', 'weapon2': '1.232', 'DAMAGECOUNT': '1.734', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:18,199][2409075] DAMAGECOUNT value on done: 5649.0
[2023-02-25 13:13:18,202][2409075] Sum rewards: 9.736, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.654', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.066', 'weapon5': '0.094', 'WEAPON4': '0.250', 'ARMOR': '0.436', 'WEAPON3': '0.500', 'HITCOUNT': '0.700', 'weapon4': '0.782', 'weapon2': '1.214', 'weapon3': '1.310', 'DAMAGECOUNT': '2.658', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:18,287][2409866] DAMAGECOUNT value on done: 5848.0
[2023-02-25 13:13:18,289][2409866] Sum rewards: 11.400, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.910', 'AMMO2': '0.003', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.017', 'weapon5': '0.032', 'WEAPON4': '0.050', 'weapon7': '0.078', 'AMMO3': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.430', 'WEAPON3': '0.500', 'HITCOUNT': '0.900', 'weapon3': '1.162', 'weapon2': '1.594', 'DAMAGECOUNT': '3.234', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:13:18,472][2409486] DAMAGECOUNT value on done: 5483.0
[2023-02-25 13:13:18,475][2409486] Sum rewards: 9.554, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.650', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO5': '0.014', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.065', 'weapon4': '0.234', 'weapon5': '0.246', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.790', 'weapon3': '1.420', 'weapon2': '1.468', 'DAMAGECOUNT': '2.697', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:18,769][2409565] DAMAGECOUNT value on done: 5684.0
[2023-02-25 13:13:18,772][2409565] Sum rewards: 14.117, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.580', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'weapon5': '0.056', 'AMMO4': '0.056', 'AMMO3': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.500', 'weapon4': '0.540', 'WEAPON3': '0.850', 'HITCOUNT': '0.960', 'weapon2': '1.486', 'weapon3': '1.580', 'ARMOR': '1.695', 'DAMAGECOUNT': '3.855', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:13:18,776][2409097] DAMAGECOUNT value on done: 6686.0
[2023-02-25 13:13:18,788][2409097] Sum rewards: 18.018, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.815', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO5': '0.015', 'weapon5': '0.040', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.222', 'ARMOR': '0.480', 'WEAPON3': '0.650', 'HITCOUNT': '1.300', 'weapon2': '1.488', 'weapon3': '1.882', 'DAMAGECOUNT': '4.716', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:13:18,933][2409373] DAMAGECOUNT value on done: 7591.0
[2023-02-25 13:13:18,934][2409373] Sum rewards: 11.890, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.549', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO5': '0.025', 'weapon7': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.112', 'AMMO4': '0.123', 'weapon5': '0.166', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'ARMOR': '0.800', 'HITCOUNT': '1.000', 'weapon3': '1.560', 'weapon2': '1.940', 'DAMAGECOUNT': '4.440', 'FRAGCOUNT': '9.500'}
[2023-02-25 13:13:19,275][2409405] DAMAGECOUNT value on done: 5149.0
[2023-02-25 13:13:19,276][2409405] Sum rewards: 6.974, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.060', 'AMMO5': '0.005', 'AMMO2': '0.028', 'AMMO3': '0.073', 'weapon5': '0.088', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon7': '0.150', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.730', 'weapon3': '0.846', 'weapon2': '1.536', 'DAMAGECOUNT': '1.590', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:13:19,296][2409078] DAMAGECOUNT value on done: 6555.0
[2023-02-25 13:13:19,297][2409078] Sum rewards: 9.222, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.926', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.080', 'AMMO4': '0.142', 'weapon5': '0.280', 'WEAPON4': '0.350', 'weapon4': '0.422', 'WEAPON5': '0.450', 'ARMOR': '0.499', 'WEAPON3': '0.600', 'HITCOUNT': '0.650', 'weapon2': '1.106', 'weapon3': '1.730', 'DAMAGECOUNT': '3.270', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:19,418][2409548] DAMAGECOUNT value on done: 5509.0
[2023-02-25 13:13:19,419][2409548] Sum rewards: 9.424, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.229', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.046', 'weapon7': '0.048', 'AMMO3': '0.099', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'weapon4': '0.532', 'WEAPON3': '0.650', 'HITCOUNT': '0.800', 'weapon3': '1.372', 'weapon2': '1.576', 'DAMAGECOUNT': '3.078', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:19,510][2409074] Updated weights for policy 0, policy_version 20141 (0.0012)
[2023-02-25 13:13:19,637][2409485] DAMAGECOUNT value on done: 5717.0
[2023-02-25 13:13:19,638][2409485] Sum rewards: 10.980, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.713', 'weapon7': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.067', 'AMMO3': '0.086', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.282', 'AMMO4': '0.334', 'WEAPON5': '0.350', 'ARMOR': '0.455', 'WEAPON3': '0.550', 'WEAPON4': '0.750', 'HITCOUNT': '0.750', 'weapon4': '0.796', 'weapon2': '1.030', 'weapon3': '1.140', 'DAMAGECOUNT': '3.732', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:13:19,913][2409076] DAMAGECOUNT value on done: 6499.0
[2023-02-25 13:13:19,917][2409076] Sum rewards: 11.477, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.367', 'AMMO2': '0.006', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'weapon4': '0.062', 'AMMO3': '0.100', 'weapon5': '0.124', 'WEAPON5': '0.200', 'WEAPON3': '0.650', 'HITCOUNT': '1.040', 'ARMOR': '1.304', 'weapon3': '1.646', 'weapon2': '1.656', 'DAMAGECOUNT': '4.191', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:13:19,940][2409101] DAMAGECOUNT value on done: 6970.0
[2023-02-25 13:13:19,943][2409101] Sum rewards: 8.351, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.535', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.041', 'weapon7': '0.052', 'weapon5': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'HITCOUNT': '0.450', 'ARMOR': '0.497', 'weapon4': '0.510', 'weapon3': '1.036', 'weapon2': '1.686', 'DAMAGECOUNT': '2.016', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:19,956][2409407] DAMAGECOUNT value on done: 6434.0
[2023-02-25 13:13:19,959][2409407] Sum rewards: 13.665, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.815', 'AMMO2': '0.008', 'weapon7': '0.012', 'AMMO5': '0.017', 'AMMO4': '0.039', 'AMMO3': '0.102', 'weapon5': '0.132', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.450', 'weapon4': '0.468', 'WEAPON3': '0.750', 'HITCOUNT': '0.770', 'ARMOR': '1.325', 'weapon2': '1.368', 'weapon3': '1.658', 'DAMAGECOUNT': '4.080', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:13:20,195][2409104] DAMAGECOUNT value on done: 5936.0
[2023-02-25 13:13:20,196][2409104] Sum rewards: 13.256, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.516', 'AMMO2': '0.010', 'AMMO5': '0.016', 'AMMO4': '0.047', 'weapon7': '0.064', 'AMMO3': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.168', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'weapon4': '0.748', 'ARMOR': '0.852', 'HITCOUNT': '0.970', 'weapon2': '0.986', 'weapon3': '1.800', 'DAMAGECOUNT': '4.569', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:13:20,209][2409597] DAMAGECOUNT value on done: 6354.0
[2023-02-25 13:13:20,212][2409597] Sum rewards: 10.213, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.909', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.032', 'AMMO3': '0.055', 'WEAPON1': '0.060', 'AMMO4': '0.065', 'weapon7': '0.076', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.208', 'WEAPON5': '0.350', 'HITCOUNT': '0.440', 'WEAPON3': '0.450', 'ARMOR': '0.452', 'weapon3': '1.182', 'weapon2': '1.302', 'DAMAGECOUNT': '2.886', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:20,326][2409596] DAMAGECOUNT value on done: 5562.0
[2023-02-25 13:13:20,330][2409596] Sum rewards: 9.802, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.583', 'AMMO2': '0.013', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.064', 'weapon4': '0.066', 'AMMO3': '0.101', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.350', 'ARMOR': '0.456', 'WEAPON3': '0.750', 'HITCOUNT': '0.840', 'weapon2': '1.494', 'weapon3': '1.896', 'DAMAGECOUNT': '3.552', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:13:20,391][2409469] DAMAGECOUNT value on done: 7224.0
[2023-02-25 13:13:20,396][2409469] Sum rewards: 8.153, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.775', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.106', 'AMMO3': '0.107', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.288', 'HITCOUNT': '0.650', 'WEAPON3': '0.750', 'weapon3': '1.528', 'ARMOR': '1.737', 'weapon2': '1.886', 'DAMAGECOUNT': '3.054', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:20,784][2409389] DAMAGECOUNT value on done: 6239.0
[2023-02-25 13:13:20,787][2409389] Sum rewards: 15.209, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO3': '0.072', 'weapon5': '0.072', 'AMMO4': '0.098', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.196', 'weapon7': '0.208', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.400', 'HEALTH': '0.405', 'HITCOUNT': '0.580', 'ARMOR': '0.828', 'weapon3': '1.452', 'weapon2': '1.664', 'DAMAGECOUNT': '3.867', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:13:20,819][2409074] Updated weights for policy 0, policy_version 20151 (0.0012)
[2023-02-25 13:13:20,926][2409105] DAMAGECOUNT value on done: 6076.0
[2023-02-25 13:13:20,929][2409105] Sum rewards: 2.334, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.334', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO5': '0.025', 'AMMO4': '0.080', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'weapon5': '0.172', 'weapon4': '0.214', 'ARMOR': '0.500', 'WEAPON5': '0.550', 'HITCOUNT': '0.630', 'WEAPON3': '0.650', 'weapon2': '1.132', 'weapon3': '1.790', 'DAMAGECOUNT': '2.451', 'FRAGCOUNT': '2.500'}
[2023-02-25 13:13:21,056][2409096] DAMAGECOUNT value on done: 4359.0
[2023-02-25 13:13:21,057][2409096] Sum rewards: 7.198, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.309', 'AMMO5': '0.008', 'AMMO2': '0.009', 'AMMO4': '0.043', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.050', 'weapon7': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.240', 'weapon4': '0.350', 'WEAPON3': '0.400', 'DAMAGECOUNT': '1.107', 'ARMOR': '1.243', 'weapon3': '1.402', 'weapon2': '1.840', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:13:21,081][2409077] DAMAGECOUNT value on done: 5316.0
[2023-02-25 13:13:21,084][2409077] Sum rewards: 9.319, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.488', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.104', 'AMMO4': '0.118', 'weapon5': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.500', 'HITCOUNT': '0.600', 'WEAPON3': '0.600', 'weapon4': '0.778', 'weapon3': '1.232', 'weapon2': '1.286', 'DAMAGECOUNT': '1.935', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:21,291][2409406] DAMAGECOUNT value on done: 5240.0
[2023-02-25 13:13:21,292][2409406] Sum rewards: 10.094, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.789', 'weapon5': '0.014', 'AMMO5': '0.022', 'AMMO2': '0.039', 'WEAPON1': '0.050', 'weapon7': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.130', 'AMMO4': '0.193', 'WEAPON4': '0.200', 'weapon4': '0.408', 'WEAPON5': '0.450', 'weapon2': '0.548', 'WEAPON3': '0.800', 'ARMOR': '0.836', 'HITCOUNT': '0.910', 'weapon3': '1.606', 'DAMAGECOUNT': '3.060', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:13:21,318][2409079] DAMAGECOUNT value on done: 5255.0
[2023-02-25 13:13:21,319][2409079] Sum rewards: 8.101, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.582', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO3': '0.050', 'weapon7': '0.106', 'AMMO4': '0.111', 'weapon5': '0.142', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '0.450', 'ARMOR': '0.453', 'HITCOUNT': '0.490', 'weapon2': '0.598', 'weapon3': '1.040', 'DAMAGECOUNT': '1.836', 'weapon4': '1.914', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:21,469][2409355] DAMAGECOUNT value on done: 6993.0
[2023-02-25 13:13:21,472][2409355] Sum rewards: 11.288, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.540', 'AMMO5': '0.018', 'AMMO2': '0.020', 'WEAPON1': '0.060', 'AMMO4': '0.097', 'AMMO3': '0.109', 'weapon7': '0.112', 'weapon5': '0.144', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'weapon4': '0.356', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'HITCOUNT': '0.630', 'WEAPON3': '0.850', 'weapon2': '1.298', 'weapon3': '1.542', 'DAMAGECOUNT': '3.951', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:13:21,663][2409102] DAMAGECOUNT value on done: 5830.0
[2023-02-25 13:13:21,664][2409102] Sum rewards: 14.124, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.007', 'HEALTH': '0.013', 'AMMO2': '0.030', 'AMMO3': '0.040', 'weapon7': '0.076', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'weapon5': '0.266', 'ARMOR': '0.400', 'weapon4': '0.416', 'HITCOUNT': '0.890', 'weapon3': '1.016', 'weapon2': '1.432', 'DAMAGECOUNT': '3.147', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:13:22,160][2409866] DAMAGECOUNT value on done: 5958.0
[2023-02-25 13:13:22,160][2409486] DAMAGECOUNT value on done: 4785.0
[2023-02-25 13:13:22,163][2409486] Sum rewards: 2.816, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.830', 'AMMO2': '0.026', 'AMMO5': '0.028', 'WEAPON1': '0.050', 'weapon4': '0.070', 'AMMO3': '0.130', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'weapon5': '0.202', 'HITCOUNT': '0.450', 'ARMOR': '0.455', 'WEAPON5': '0.600', 'WEAPON3': '0.900', 'weapon2': '1.446', 'DAMAGECOUNT': '1.575', 'weapon3': '1.934', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:13:22,163][2409866] Sum rewards: 6.267, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.588', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO5': '0.022', 'AMMO4': '0.079', 'weapon5': '0.098', 'AMMO3': '0.112', 'WEAPON5': '0.250', 'weapon4': '0.274', 'WEAPON4': '0.300', 'HITCOUNT': '0.640', 'WEAPON3': '0.850', 'ARMOR': '0.855', 'weapon2': '0.966', 'weapon3': '2.290', 'DAMAGECOUNT': '2.592', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:22,186][2408954] Fps is (10 sec: 25394.6, 60 sec: 24985.5, 300 sec: 25200.8). Total num frames: 82571264. Throughput: 0: 6232.5. Samples: 20636436. Policy #0 lag: (min: 0.0, avg: 12.9, max: 25.0)
[2023-02-25 13:13:22,186][2408954] Avg episode reward: [(0, '9.928')]
[2023-02-25 13:13:22,222][2409075] DAMAGECOUNT value on done: 5260.0
[2023-02-25 13:13:22,225][2409075] Sum rewards: 12.032, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.024', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'AMMO3': '0.090', 'AMMO4': '0.132', 'WEAPON4': '0.200', 'weapon5': '0.212', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'weapon4': '0.482', 'WEAPON3': '0.550', 'HITCOUNT': '0.710', 'weapon2': '1.014', 'weapon3': '1.596', 'DAMAGECOUNT': '3.558', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:22,386][2409565] DAMAGECOUNT value on done: 6811.0
[2023-02-25 13:13:22,389][2409565] Sum rewards: 11.928, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.230', 'AMMO5': '0.012', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'weapon7': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.097', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.160', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.449', 'WEAPON3': '0.500', 'HITCOUNT': '0.690', 'weapon4': '0.832', 'weapon3': '1.316', 'weapon2': '1.372', 'DAMAGECOUNT': '3.420', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:13:22,616][2409097] DAMAGECOUNT value on done: 6892.0
[2023-02-25 13:13:22,619][2409097] Sum rewards: 17.685, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.695', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'weapon7': '0.052', 'weapon5': '0.056', 'AMMO3': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'WEAPON3': '0.500', 'weapon4': '0.772', 'HITCOUNT': '0.890', 'weapon2': '1.146', 'weapon3': '1.368', 'DAMAGECOUNT': '4.512', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:13:22,717][2409074] Updated weights for policy 0, policy_version 20161 (0.0012)
[2023-02-25 13:13:23,081][2409405] DAMAGECOUNT value on done: 5150.0
[2023-02-25 13:13:23,082][2409405] Sum rewards: 4.861, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.000', 'AMMO5': '0.006', 'AMMO2': '0.020', 'AMMO3': '0.050', 'weapon7': '0.050', 'AMMO4': '0.099', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.126', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.500', 'weapon4': '0.742', 'HITCOUNT': '0.820', 'weapon2': '1.220', 'weapon3': '1.242', 'DAMAGECOUNT': '2.736', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:13:23,119][2409078] DAMAGECOUNT value on done: 6390.0
[2023-02-25 13:13:23,120][2409078] Sum rewards: 14.839, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.857', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.015', 'weapon7': '0.056', 'AMMO4': '0.061', 'AMMO3': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.184', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'weapon4': '0.820', 'weapon2': '0.848', 'HITCOUNT': '1.030', 'weapon3': '1.824', 'DAMAGECOUNT': '4.455', 'FRAGCOUNT': '12.500'}
[2023-02-25 13:13:23,382][2409373] DAMAGECOUNT value on done: 6740.0
[2023-02-25 13:13:23,383][2409373] Sum rewards: 4.772, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO3': '0.035', 'WEAPON4': '0.050', 'weapon7': '0.060', 'weapon5': '0.066', 'AMMO4': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.150', 'WEAPON3': '0.200', 'HEALTH': '0.340', 'weapon2': '0.428', 'weapon4': '0.452', 'ARMOR': '0.494', 'DAMAGECOUNT': '0.609', 'weapon3': '0.626', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:13:23,508][2409407] DAMAGECOUNT value on done: 5848.0
[2023-02-25 13:13:23,509][2409407] Sum rewards: 5.411, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.820', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.013', 'WEAPON1': '0.020', 'AMMO3': '0.056', 'weapon7': '0.122', 'WEAPON4': '0.150', 'weapon5': '0.186', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'weapon4': '0.426', 'WEAPON3': '0.450', 'HITCOUNT': '0.590', 'ARMOR': '0.916', 'weapon3': '1.056', 'weapon2': '2.054', 'DAMAGECOUNT': '2.697', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:13:23,623][2409101] DAMAGECOUNT value on done: 5821.0
[2023-02-25 13:13:23,626][2409101] Sum rewards: 12.794, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.561', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.040', 'AMMO3': '0.101', 'weapon5': '0.184', 'AMMO4': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.302', 'WEAPON3': '0.700', 'HITCOUNT': '0.770', 'weapon2': '1.278', 'weapon3': '1.962', 'DAMAGECOUNT': '3.690', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:13:23,732][2409485] DAMAGECOUNT value on done: 5623.0
[2023-02-25 13:13:23,733][2409485] Sum rewards: 4.583, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.067', 'AMMO2': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.039', 'AMMO3': '0.043', 'ARMOR': '0.092', 'weapon5': '0.100', 'weapon7': '0.152', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'HITCOUNT': '0.330', 'WEAPON3': '0.350', 'weapon3': '0.998', 'weapon4': '1.168', 'weapon2': '1.176', 'DAMAGECOUNT': '1.434', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:13:23,820][2409104] DAMAGECOUNT value on done: 5083.0
[2023-02-25 13:13:23,821][2409104] Sum rewards: 5.195, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.026', 'weapon7': '0.066', 'AMMO3': '0.073', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'weapon4': '0.386', 'WEAPON3': '0.400', 'HITCOUNT': '0.410', 'HEALTH': '0.441', 'ARMOR': '0.800', 'DAMAGECOUNT': '1.209', 'weapon3': '1.358', 'weapon2': '1.670', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:13:23,923][2409548] DAMAGECOUNT value on done: 5056.0
[2023-02-25 13:13:23,926][2409548] Sum rewards: 7.781, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.380', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.051', 'weapon7': '0.052', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.230', 'weapon5': '0.274', 'WEAPON5': '0.400', 'ARMOR': '0.460', 'WEAPON3': '0.500', 'HITCOUNT': '0.630', 'weapon2': '1.282', 'weapon3': '1.292', 'DAMAGECOUNT': '2.208', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:13:23,952][2409596] DAMAGECOUNT value on done: 6048.0
[2023-02-25 13:13:23,953][2409596] Sum rewards: 7.795, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.987', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.034', 'AMMO3': '0.050', 'weapon4': '0.056', 'WEAPON4': '0.150', 'weapon5': '0.230', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'HITCOUNT': '0.590', 'weapon3': '1.230', 'weapon2': '1.794', 'DAMAGECOUNT': '2.331', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:24,112][2409597] DAMAGECOUNT value on done: 5841.0
[2023-02-25 13:13:24,113][2409597] Sum rewards: 13.978, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.126', 'AMMO5': '0.015', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.080', 'AMMO3': '0.092', 'weapon5': '0.094', 'WEAPON4': '0.200', 'weapon4': '0.366', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '1.190', 'weapon2': '1.428', 'weapon3': '1.704', 'DAMAGECOUNT': '3.849', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:13:24,349][2409469] DAMAGECOUNT value on done: 8693.0
[2023-02-25 13:13:24,351][2409469] Sum rewards: 17.914, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.316', 'AMMO5': '0.017', 'AMMO2': '0.023', 'weapon4': '0.034', 'WEAPON4': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.124', 'weapon5': '0.374', 'ARMOR': '0.439', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'HITCOUNT': '0.840', 'weapon2': '1.548', 'weapon3': '1.742', 'DAMAGECOUNT': '6.123', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:13:24,394][2409074] Updated weights for policy 0, policy_version 20171 (0.0012)
[2023-02-25 13:13:24,666][2409389] DAMAGECOUNT value on done: 5744.0
[2023-02-25 13:13:24,669][2409389] Sum rewards: 8.102, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.906', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO2': '0.033', 'AMMO3': '0.077', 'weapon7': '0.098', 'AMMO4': '0.163', 'weapon5': '0.172', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '0.550', 'weapon4': '0.616', 'HITCOUNT': '0.710', 'weapon2': '1.222', 'weapon3': '1.570', 'DAMAGECOUNT': '2.901', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:24,695][2409076] DAMAGECOUNT value on done: 6271.0
[2023-02-25 13:13:24,698][2409076] Sum rewards: 11.935, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.961', 'AMMO5': '0.012', 'weapon4': '0.014', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon7': '0.058', 'AMMO4': '0.093', 'AMMO3': '0.096', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon5': '0.168', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.455', 'WEAPON3': '0.650', 'HITCOUNT': '0.750', 'weapon2': '1.620', 'weapon3': '1.648', 'DAMAGECOUNT': '3.423', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:13:24,801][2409105] DAMAGECOUNT value on done: 5835.0
[2023-02-25 13:13:24,804][2409105] Sum rewards: 16.149, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.664', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'ARMOR': '0.040', 'AMMO3': '0.089', 'weapon5': '0.154', 'AMMO4': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'weapon2': '0.984', 'HITCOUNT': '1.100', 'weapon3': '1.702', 'DAMAGECOUNT': '5.052', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:13:24,900][2409077] DAMAGECOUNT value on done: 7354.0
[2023-02-25 13:13:24,902][2409077] Sum rewards: 10.657, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.047', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'AMMO5': '0.025', 'weapon7': '0.046', 'AMMO4': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.126', 'weapon5': '0.134', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'ARMOR': '0.455', 'WEAPON5': '0.550', 'HITCOUNT': '0.640', 'WEAPON3': '0.800', 'weapon4': '0.952', 'weapon2': '1.116', 'weapon3': '1.358', 'DAMAGECOUNT': '3.264', 'FRAGCOUNT': '10.500'}
[2023-02-25 13:13:24,966][2409079] DAMAGECOUNT value on done: 5115.0
[2023-02-25 13:13:24,969][2409079] Sum rewards: 8.721, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.013', 'AMMO3': '0.040', 'WEAPON5': '0.050', 'weapon7': '0.064', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'HEALTH': '0.312', 'HITCOUNT': '0.430', 'weapon4': '0.696', 'weapon3': '0.964', 'weapon2': '1.352', 'DAMAGECOUNT': '1.983', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:13:25,104][2409406] DAMAGECOUNT value on done: 5595.0
[2023-02-25 13:13:25,107][2409406] Sum rewards: 8.654, reward structure: {'DEATHCOUNT': '-4.500', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon7': '0.050', 'AMMO3': '0.057', 'AMMO4': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.184', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'HEALTH': '0.438', 'HITCOUNT': '0.450', 'ARMOR': '0.540', 'weapon3': '1.000', 'weapon4': '1.220', 'weapon2': '1.268', 'DAMAGECOUNT': '1.806', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:13:25,139][2409096] DAMAGECOUNT value on done: 6002.0
[2023-02-25 13:13:25,142][2409096] Sum rewards: 11.987, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.620', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon7': '0.062', 'AMMO3': '0.079', 'AMMO4': '0.117', 'weapon5': '0.198', 'WEAPON4': '0.250', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.442', 'HITCOUNT': '0.500', 'WEAPON3': '0.550', 'ARMOR': '0.936', 'weapon3': '1.350', 'weapon2': '1.530', 'DAMAGECOUNT': '2.307', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:13:25,359][2409102] DAMAGECOUNT value on done: 5681.0
[2023-02-25 13:13:25,362][2409102] Sum rewards: 4.181, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.244', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'weapon7': '0.050', 'AMMO3': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'HITCOUNT': '0.320', 'WEAPON3': '0.350', 'ARMOR': '0.500', 'weapon4': '0.660', 'weapon3': '0.818', 'DAMAGECOUNT': '1.305', 'weapon2': '1.876', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:13:25,408][2409355] DAMAGECOUNT value on done: 5962.0
[2023-02-25 13:13:25,408][2409355] Sum rewards: 2.556, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.160', 'AMMO5': '0.018', 'weapon5': '0.040', 'AMMO2': '0.040', 'AMMO3': '0.104', 'AMMO4': '0.202', 'weapon7': '0.236', 'HITCOUNT': '0.260', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'weapon4': '0.338', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.190', 'weapon3': '1.220', 'ARMOR': '1.291', 'DAMAGECOUNT': '1.476', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:13:25,763][2409074] Updated weights for policy 0, policy_version 20181 (0.0012)
[2023-02-25 13:13:26,078][2409565] DAMAGECOUNT value on done: 5910.0
[2023-02-25 13:13:26,081][2409565] Sum rewards: 15.064, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.206', 'AMMO2': '0.004', 'AMMO5': '0.009', 'AMMO4': '0.019', 'WEAPON1': '0.020', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.134', 'WEAPON5': '0.250', 'weapon4': '0.336', 'WEAPON3': '0.450', 'ARMOR': '0.482', 'HITCOUNT': '0.840', 'weapon2': '1.368', 'weapon3': '1.470', 'DAMAGECOUNT': '3.930', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:13:26,119][2409486] DAMAGECOUNT value on done: 5148.0
[2023-02-25 13:13:26,122][2409486] Sum rewards: 11.242, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.536', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.017', 'AMMO5': '0.017', 'weapon7': '0.070', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.214', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'weapon4': '0.460', 'HITCOUNT': '0.740', 'ARMOR': '0.843', 'weapon2': '1.046', 'weapon3': '1.206', 'DAMAGECOUNT': '3.237', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:26,120][2409866] DAMAGECOUNT value on done: 5867.0
[2023-02-25 13:13:26,123][2409866] Sum rewards: 6.438, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.844', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.015', 'AMMO3': '0.048', 'weapon7': '0.144', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HITCOUNT': '0.330', 'WEAPON3': '0.350', 'weapon3': '0.744', 'ARMOR': '0.852', 'DAMAGECOUNT': '1.524', 'weapon2': '2.836', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:13:26,235][2409075] DAMAGECOUNT value on done: 5533.0
[2023-02-25 13:13:26,236][2409075] Sum rewards: 8.948, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.356', 'AMMO5': '0.015', 'AMMO2': '0.027', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'AMMO4': '0.135', 'weapon4': '0.226', 'weapon5': '0.242', 'WEAPON5': '0.400', 'HITCOUNT': '0.520', 'WEAPON3': '0.650', 'ARMOR': '0.924', 'weapon2': '1.420', 'weapon3': '1.740', 'DAMAGECOUNT': '2.292', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:13:26,641][2409097] DAMAGECOUNT value on done: 5231.0
[2023-02-25 13:13:26,644][2409097] Sum rewards: 7.130, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.220', 'AMMO5': '0.009', 'AMMO2': '0.011', 'weapon5': '0.024', 'AMMO3': '0.031', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'weapon7': '0.102', 'WEAPON3': '0.200', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HITCOUNT': '0.370', 'weapon4': '0.474', 'weapon3': '0.484', 'ARMOR': '0.943', 'weapon2': '1.018', 'DAMAGECOUNT': '1.587', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:13:27,004][2409405] DAMAGECOUNT value on done: 7281.0
[2023-02-25 13:13:27,005][2409405] Sum rewards: 15.989, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.702', 'AMMO2': '0.008', 'AMMO5': '0.019', 'AMMO4': '0.039', 'AMMO3': '0.071', 'weapon7': '0.088', 'weapon5': '0.180', 'WEAPON4': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'weapon4': '0.438', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'ARMOR': '0.851', 'HITCOUNT': '1.000', 'weapon2': '1.210', 'weapon3': '1.308', 'DAMAGECOUNT': '4.989', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:13:27,058][2409078] DAMAGECOUNT value on done: 5472.0
[2023-02-25 13:13:27,060][2409078] Sum rewards: 2.910, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.310', 'AMMO5': '0.026', 'AMMO2': '0.045', 'AMMO3': '0.090', 'weapon5': '0.200', 'AMMO4': '0.223', 'weapon4': '0.332', 'WEAPON4': '0.500', 'WEAPON5': '0.650', 'HITCOUNT': '0.650', 'WEAPON3': '0.700', 'weapon2': '1.136', 'weapon3': '1.806', 'DAMAGECOUNT': '2.862', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:13:27,186][2408954] Fps is (10 sec: 23756.8, 60 sec: 24849.1, 300 sec: 25173.0). Total num frames: 82690048. Throughput: 0: 6246.1. Samples: 20674272. Policy #0 lag: (min: 0.0, avg: 11.3, max: 25.0)
[2023-02-25 13:13:27,186][2408954] Avg episode reward: [(0, '9.755')]
[2023-02-25 13:13:27,243][2409407] DAMAGECOUNT value on done: 6387.0
[2023-02-25 13:13:27,244][2409407] Sum rewards: 9.603, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.060', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO2': '0.042', 'AMMO3': '0.077', 'weapon5': '0.140', 'WEAPON4': '0.150', 'weapon7': '0.188', 'AMMO4': '0.211', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'HITCOUNT': '0.340', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'weapon4': '1.024', 'weapon3': '1.182', 'weapon2': '1.198', 'DAMAGECOUNT': '2.520', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:27,470][2409074] Updated weights for policy 0, policy_version 20191 (0.0014)
[2023-02-25 13:13:27,547][2409548] DAMAGECOUNT value on done: 7629.0
[2023-02-25 13:13:27,548][2409548] Sum rewards: 8.689, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.015', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.031', 'AMMO3': '0.086', 'weapon5': '0.108', 'WEAPON5': '0.150', 'weapon7': '0.162', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.250', 'WEAPON7': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.640', 'weapon2': '0.936', 'weapon4': '1.058', 'weapon3': '1.256', 'DAMAGECOUNT': '2.616', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:27,610][2409565] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)]
[2023-02-25 13:13:27,648][2409373] DAMAGECOUNT value on done: 5675.0
[2023-02-25 13:13:27,651][2409373] Sum rewards: 9.505, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.660', 'AMMO2': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.051', 'weapon4': '0.072', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'weapon5': '0.362', 'WEAPON5': '0.400', 'HITCOUNT': '0.610', 'WEAPON3': '0.650', 'ARMOR': '0.890', 'weapon2': '1.428', 'weapon3': '1.670', 'DAMAGECOUNT': '2.817', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:27,715][2409104] DAMAGECOUNT value on done: 6167.0
[2023-02-25 13:13:27,717][2409485] DAMAGECOUNT value on done: 5326.0
[2023-02-25 13:13:27,718][2409104] Sum rewards: 15.101, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'HEALTH': '0.042', 'AMMO3': '0.069', 'weapon7': '0.074', 'AMMO4': '0.085', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.138', 'WEAPON5': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.660', 'ARMOR': '0.857', 'weapon3': '1.230', 'weapon2': '2.008', 'DAMAGECOUNT': '3.540', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:13:27,718][2409485] Sum rewards: 7.442, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.012', 'AMMO2': '0.021', 'AMMO3': '0.044', 'WEAPON5': '0.050', 'HEALTH': '0.064', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'weapon7': '0.138', 'WEAPON3': '0.250', 'HITCOUNT': '0.300', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'weapon3': '0.396', 'ARMOR': '0.400', 'weapon4': '0.680', 'DAMAGECOUNT': '1.572', 'weapon2': '1.650', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:13:27,751][2409597] DAMAGECOUNT value on done: 4593.0
[2023-02-25 13:13:27,752][2409597] Sum rewards: 9.260, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.221', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.030', 'AMMO3': '0.070', 'WEAPON5': '0.250', 'weapon5': '0.268', 'WEAPON3': '0.400', 'HITCOUNT': '0.720', 'weapon3': '1.134', 'ARMOR': '1.226', 'weapon2': '2.292', 'DAMAGECOUNT': '2.574', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:13:27,825][2409596] DAMAGECOUNT value on done: 4557.0
[2023-02-25 13:13:27,826][2409596] Sum rewards: 11.888, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.303', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.043', 'weapon5': '0.066', 'AMMO3': '0.070', 'weapon7': '0.080', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'weapon4': '0.428', 'HITCOUNT': '0.600', 'weapon2': '0.698', 'weapon3': '1.008', 'DAMAGECOUNT': '2.679', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:13:28,166][2409101] DAMAGECOUNT value on done: 7134.0
[2023-02-25 13:13:28,167][2409101] Sum rewards: 11.829, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.432', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO2': '0.031', 'weapon7': '0.094', 'AMMO3': '0.109', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'AMMO4': '0.156', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.272', 'WEAPON3': '0.700', 'ARMOR': '0.907', 'HITCOUNT': '0.930', 'weapon3': '1.530', 'weapon2': '1.660', 'DAMAGECOUNT': '3.372', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:13:28,346][2409469] DAMAGECOUNT value on done: 7185.0
[2023-02-25 13:13:28,349][2409469] Sum rewards: 7.191, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.726', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'weapon7': '0.060', 'AMMO3': '0.087', 'AMMO4': '0.160', 'weapon5': '0.162', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'ARMOR': '0.454', 'WEAPON3': '0.650', 'HITCOUNT': '0.690', 'weapon2': '0.846', 'weapon4': '0.922', 'weapon3': '1.386', 'DAMAGECOUNT': '2.586', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:28,478][2409105] DAMAGECOUNT value on done: 7716.0
[2023-02-25 13:13:28,481][2409105] Sum rewards: 20.293, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.964', 'AMMO5': '0.015', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO4': '0.077', 'AMMO3': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.146', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.378', 'ARMOR': '0.457', 'WEAPON3': '0.700', 'weapon2': '1.276', 'HITCOUNT': '1.290', 'weapon3': '1.662', 'DAMAGECOUNT': '4.875', 'FRAGCOUNT': '16.000'}
[2023-02-25 13:13:28,643][2409389] DAMAGECOUNT value on done: 7381.0
[2023-02-25 13:13:28,646][2409389] Sum rewards: 2.846, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.700', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'weapon5': '0.054', 'weapon4': '0.086', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'HITCOUNT': '0.520', 'WEAPON3': '0.700', 'ARMOR': '1.400', 'weapon3': '1.532', 'weapon2': '2.006', 'DAMAGECOUNT': '2.085', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:13:28,655][2409074] Updated weights for policy 0, policy_version 20201 (0.0014)
[2023-02-25 13:13:28,699][2409079] DAMAGECOUNT value on done: 6019.0
[2023-02-25 13:13:28,700][2409079] Sum rewards: 14.533, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.475', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon4': '0.068', 'weapon7': '0.106', 'weapon5': '0.158', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.447', 'WEAPON3': '0.500', 'HITCOUNT': '0.700', 'weapon2': '1.648', 'weapon3': '1.664', 'DAMAGECOUNT': '3.333', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:13:28,813][2409077] DAMAGECOUNT value on done: 7201.0
[2023-02-25 13:13:28,814][2409077] Sum rewards: 14.142, reward structure: {'DEATHCOUNT': '-5.250', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.012', 'AMMO4': '0.056', 'AMMO3': '0.077', 'WEAPON4': '0.150', 'weapon5': '0.232', 'WEAPON5': '0.250', 'weapon4': '0.312', 'HEALTH': '0.379', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon2': '0.750', 'HITCOUNT': '0.780', 'weapon3': '1.552', 'DAMAGECOUNT': '2.970', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:13:28,866][2409102] DAMAGECOUNT value on done: 5513.0
[2023-02-25 13:13:28,884][2409102] Sum rewards: 1.394, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.660', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO3': '0.048', 'weapon7': '0.070', 'AMMO4': '0.077', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.370', 'weapon4': '0.542', 'weapon3': '0.608', 'weapon2': '0.666', 'DAMAGECOUNT': '1.140', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:13:28,958][2409406] DAMAGECOUNT value on done: 6967.0
[2023-02-25 13:13:28,958][2409406] Sum rewards: 12.986, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.768', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.097', 'WEAPON4': '0.150', 'weapon5': '0.244', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon4': '0.510', 'WEAPON3': '0.650', 'HITCOUNT': '0.820', 'weapon2': '1.214', 'weapon3': '1.750', 'DAMAGECOUNT': '3.969', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:13:29,013][2409076] DAMAGECOUNT value on done: 6682.0
[2023-02-25 13:13:29,014][2409076] Sum rewards: 10.969, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.090', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.007', 'weapon7': '0.048', 'AMMO3': '0.067', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'ARMOR': '0.418', 'WEAPON3': '0.550', 'HITCOUNT': '0.780', 'weapon4': '0.868', 'weapon2': '1.098', 'weapon3': '1.116', 'DAMAGECOUNT': '2.823', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:29,063][2409096] DAMAGECOUNT value on done: 5687.0
[2023-02-25 13:13:29,064][2409096] Sum rewards: 9.448, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.281', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.008', 'AMMO3': '0.048', 'weapon7': '0.070', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'HITCOUNT': '0.370', 'ARMOR': '0.400', 'weapon3': '0.842', 'DAMAGECOUNT': '1.602', 'weapon2': '2.374', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:29,075][2409355] DAMAGECOUNT value on done: 6963.0
[2023-02-25 13:13:29,078][2409355] Sum rewards: 10.746, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.882', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'weapon7': '0.046', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.220', 'weapon4': '0.252', 'WEAPON5': '0.400', 'ARMOR': '0.448', 'WEAPON3': '0.700', 'HITCOUNT': '0.730', 'weapon2': '1.346', 'weapon3': '1.770', 'DAMAGECOUNT': '4.074', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:29,701][2409565] DAMAGECOUNT value on done: 7121.0
[2023-02-25 13:13:29,705][2409565] Sum rewards: 14.594, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.286', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.035', 'AMMO3': '0.050', 'weapon5': '0.160', 'WEAPON5': '0.200', 'WEAPON3': '0.400', 'ARMOR': '0.453', 'HITCOUNT': '0.890', 'weapon3': '1.208', 'weapon2': '1.966', 'DAMAGECOUNT': '3.483', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:13:29,762][2409486] DAMAGECOUNT value on done: 5217.0
[2023-02-25 13:13:29,763][2409486] Sum rewards: 7.183, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.544', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO2': '0.041', 'AMMO3': '0.081', 'weapon7': '0.116', 'AMMO4': '0.205', 'weapon5': '0.228', 'WEAPON4': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.450', 'WEAPON3': '0.500', 'weapon4': '0.770', 'weapon2': '0.898', 'weapon3': '1.532', 'DAMAGECOUNT': '2.268', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:29,780][2409866] DAMAGECOUNT value on done: 6810.0
[2023-02-25 13:13:29,780][2409866] Sum rewards: 12.450, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.274', 'AMMO2': '0.008', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.042', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'weapon4': '0.210', 'weapon5': '0.270', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '1.250', 'weapon2': '1.482', 'weapon3': '1.718', 'DAMAGECOUNT': '4.104', 'FRAGCOUNT': '8.500'}
[2023-02-25 13:13:30,036][2409075] DAMAGECOUNT value on done: 5885.0
[2023-02-25 13:13:30,037][2409075] Sum rewards: 7.212, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.934', 'AMMO5': '0.017', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'AMMO3': '0.089', 'AMMO4': '0.109', 'weapon5': '0.178', 'weapon4': '0.204', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.930', 'weapon2': '1.676', 'weapon3': '1.706', 'DAMAGECOUNT': '3.435', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:30,426][2409097] DAMAGECOUNT value on done: 5941.0
[2023-02-25 13:13:30,430][2409097] Sum rewards: 10.390, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.338', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO3': '0.061', 'AMMO4': '0.118', 'weapon4': '0.140', 'weapon5': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'HITCOUNT': '0.580', 'ARMOR': '1.200', 'weapon3': '1.586', 'weapon2': '1.688', 'DAMAGECOUNT': '2.559', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:30,644][2409405] DAMAGECOUNT value on done: 6040.0
[2023-02-25 13:13:30,645][2409405] Sum rewards: 8.211, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.003', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.017', 'weapon5': '0.060', 'AMMO3': '0.080', 'WEAPON5': '0.150', 'HEALTH': '0.319', 'WEAPON3': '0.350', 'HITCOUNT': '0.810', 'ARMOR': '0.849', 'weapon3': '1.402', 'weapon2': '1.998', 'DAMAGECOUNT': '2.655', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:13:30,716][2409078] DAMAGECOUNT value on done: 6164.0
[2023-02-25 13:13:30,717][2409078] Sum rewards: 7.967, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.255', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'AMMO3': '0.040', 'weapon5': '0.062', 'AMMO4': '0.103', 'weapon7': '0.148', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'weapon2': '0.598', 'HITCOUNT': '0.750', 'weapon4': '0.772', 'weapon3': '0.908', 'DAMAGECOUNT': '2.400', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:13:30,854][2409407] DAMAGECOUNT value on done: 5237.0
[2023-02-25 13:13:30,855][2409407] Sum rewards: 7.145, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.109', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO5': '0.015', 'AMMO4': '0.066', 'AMMO3': '0.070', 'weapon4': '0.094', 'WEAPON4': '0.100', 'weapon5': '0.148', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.600', 'weapon3': '1.748', 'weapon2': '1.752', 'DAMAGECOUNT': '2.187', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:31,018][2409074] Updated weights for policy 0, policy_version 20211 (0.0013)
[2023-02-25 13:13:31,353][2409597] DAMAGECOUNT value on done: 6159.0
[2023-02-25 13:13:31,355][2409597] Sum rewards: 15.004, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.742', 'AMMO2': '0.014', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.071', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'weapon5': '0.282', 'weapon4': '0.296', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'HITCOUNT': '0.950', 'weapon2': '1.148', 'weapon3': '1.622', 'DAMAGECOUNT': '5.283', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:13:31,432][2409548] DAMAGECOUNT value on done: 6185.0
[2023-02-25 13:13:31,435][2409548] Sum rewards: 11.042, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.482', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon7': '0.050', 'AMMO3': '0.059', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.149', 'weapon5': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.244', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.810', 'weapon3': '0.966', 'weapon4': '1.230', 'DAMAGECOUNT': '2.895', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:31,440][2409485] DAMAGECOUNT value on done: 6304.0
[2023-02-25 13:13:31,443][2409485] Sum rewards: 17.898, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.726', 'AMMO5': '0.020', 'AMMO2': '0.033', 'WEAPON1': '0.040', 'weapon7': '0.052', 'AMMO3': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.165', 'WEAPON4': '0.300', 'weapon5': '0.312', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'WEAPON5': '0.500', 'HITCOUNT': '0.780', 'weapon4': '0.916', 'weapon2': '1.048', 'weapon3': '1.384', 'DAMAGECOUNT': '4.614', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:13:31,542][2409373] DAMAGECOUNT value on done: 5086.0
[2023-02-25 13:13:31,543][2409373] Sum rewards: 5.191, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.770', 'AMMO2': '0.003', 'AMMO5': '0.006', 'AMMO4': '0.015', 'AMMO3': '0.030', 'weapon5': '0.082', 'weapon7': '0.114', 'WEAPON4': '0.150', 'WEAPON3': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.230', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon3': '0.254', 'WEAPON7': '0.400', 'weapon4': '0.590', 'ARMOR': '0.900', 'DAMAGECOUNT': '0.978', 'weapon2': '1.328', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:13:31,973][2409104] DAMAGECOUNT value on done: 6075.0
[2023-02-25 13:13:31,977][2409104] Sum rewards: 22.792, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.952', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.224', 'weapon5': '0.388', 'WEAPON5': '0.500', 'WEAPON3': '0.500', 'HITCOUNT': '0.860', 'weapon2': '1.500', 'weapon3': '1.550', 'DAMAGECOUNT': '5.556', 'FRAGCOUNT': '17.000'}
[2023-02-25 13:13:32,088][2409596] DAMAGECOUNT value on done: 6098.0
[2023-02-25 13:13:32,089][2409469] DAMAGECOUNT value on done: 6399.0
[2023-02-25 13:13:32,089][2409596] Sum rewards: 14.682, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.292', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.031', 'AMMO3': '0.070', 'weapon7': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.226', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'HITCOUNT': '0.790', 'ARMOR': '1.342', 'weapon3': '1.548', 'weapon2': '1.878', 'DAMAGECOUNT': '4.290', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:13:32,092][2409469] Sum rewards: 11.969, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO3': '0.040', 'weapon5': '0.104', 'AMMO4': '0.139', 'weapon7': '0.158', 'HEALTH': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.250', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.740', 'weapon2': '0.848', 'weapon3': '0.968', 'weapon4': '1.028', 'DAMAGECOUNT': '2.688', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:32,111][2409105] DAMAGECOUNT value on done: 6257.0
[2023-02-25 13:13:32,112][2409105] Sum rewards: 12.917, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.004', 'AMMO5': '0.012', 'AMMO4': '0.022', 'HEALTH': '0.035', 'weapon7': '0.046', 'AMMO3': '0.060', 'WEAPON1': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'weapon5': '0.380', 'HITCOUNT': '0.540', 'ARMOR': '0.800', 'weapon3': '1.420', 'weapon2': '1.840', 'DAMAGECOUNT': '2.556', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:32,186][2408954] Fps is (10 sec: 24986.2, 60 sec: 24985.6, 300 sec: 25228.6). Total num frames: 82821120. Throughput: 0: 6265.6. Samples: 20712564. Policy #0 lag: (min: 0.0, avg: 11.3, max: 25.0)
[2023-02-25 13:13:32,186][2408954] Avg episode reward: [(0, '10.361')]
[2023-02-25 13:13:32,196][2409033] Saving new best policy, reward=10.361!
[2023-02-25 13:13:32,203][2409074] Updated weights for policy 0, policy_version 20221 (0.0012)
[2023-02-25 13:13:32,313][2409389] DAMAGECOUNT value on done: 5170.0
[2023-02-25 13:13:32,314][2409389] Sum rewards: 7.657, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO2': '0.040', 'AMMO3': '0.069', 'weapon7': '0.100', 'weapon5': '0.160', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'AMMO4': '0.201', 'WEAPON5': '0.250', 'HEALTH': '0.374', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.420', 'weapon4': '0.984', 'weapon3': '1.142', 'weapon2': '1.332', 'DAMAGECOUNT': '2.184', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:13:32,370][2409079] DAMAGECOUNT value on done: 6092.0
[2023-02-25 13:13:32,374][2409079] Sum rewards: 4.364, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.061', 'AMMO2': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.034', 'AMMO3': '0.064', 'weapon5': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.450', 'WEAPON3': '0.500', 'HITCOUNT': '0.560', 'ARMOR': '0.855', 'weapon2': '1.138', 'weapon3': '1.274', 'DAMAGECOUNT': '2.217', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:32,508][2409077] DAMAGECOUNT value on done: 6453.0
[2023-02-25 13:13:32,511][2409077] Sum rewards: 15.208, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.346', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO3': '0.054', 'weapon5': '0.134', 'AMMO4': '0.176', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'weapon4': '0.686', 'weapon2': '0.822', 'ARMOR': '0.856', 'HITCOUNT': '0.920', 'weapon3': '1.158', 'DAMAGECOUNT': '4.047', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:13:32,611][2409076] DAMAGECOUNT value on done: 6429.0
[2023-02-25 13:13:32,615][2409076] Sum rewards: 4.627, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.016', 'AMMO2': '0.025', 'AMMO5': '0.027', 'AMMO3': '0.084', 'AMMO4': '0.127', 'weapon5': '0.232', 'WEAPON4': '0.350', 'weapon4': '0.530', 'WEAPON3': '0.600', 'WEAPON5': '0.600', 'HITCOUNT': '0.830', 'ARMOR': '0.853', 'weapon3': '1.344', 'weapon2': '1.468', 'DAMAGECOUNT': '3.072', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:13:32,678][2409406] DAMAGECOUNT value on done: 4624.0
[2023-02-25 13:13:32,679][2409406] Sum rewards: 8.162, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.119', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'weapon5': '0.022', 'AMMO3': '0.065', 'AMMO4': '0.084', 'weapon7': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.350', 'WEAPON7': '0.400', 'HITCOUNT': '0.500', 'weapon4': '0.516', 'weapon3': '1.212', 'ARMOR': '1.251', 'weapon2': '1.360', 'DAMAGECOUNT': '2.208', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:32,775][2409355] DAMAGECOUNT value on done: 6811.0
[2023-02-25 13:13:32,775][2409355] Sum rewards: 11.512, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.351', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon4': '0.022', 'weapon7': '0.052', 'AMMO3': '0.077', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.104', 'AMMO4': '0.107', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.740', 'weapon2': '1.412', 'weapon3': '1.646', 'DAMAGECOUNT': '3.498', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:13:32,836][2409096] DAMAGECOUNT value on done: 6830.0
[2023-02-25 13:13:32,839][2409096] Sum rewards: 10.343, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.386', 'AMMO2': '0.016', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.080', 'weapon4': '0.080', 'AMMO3': '0.114', 'WEAPON4': '0.150', 'weapon5': '0.264', 'WEAPON5': '0.450', 'HITCOUNT': '0.650', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'weapon2': '1.110', 'weapon3': '2.188', 'DAMAGECOUNT': '3.090', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:13:33,581][2409486] DAMAGECOUNT value on done: 6303.0
[2023-02-25 13:13:33,582][2409486] Sum rewards: 8.291, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.934', 'AMMO2': '0.010', 'AMMO5': '0.025', 'WEAPON1': '0.030', 'weapon4': '0.034', 'weapon7': '0.050', 'AMMO4': '0.051', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.134', 'weapon5': '0.268', 'ARMOR': '0.400', 'WEAPON5': '0.600', 'HITCOUNT': '0.600', 'WEAPON3': '0.800', 'weapon2': '1.342', 'weapon3': '1.894', 'DAMAGECOUNT': '3.087', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:33,585][2409866] DAMAGECOUNT value on done: 7429.0
[2023-02-25 13:13:33,586][2409866] Sum rewards: 17.606, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.571', 'AMMO5': '0.015', 'AMMO2': '0.016', 'AMMO4': '0.081', 'AMMO3': '0.084', 'WEAPON4': '0.200', 'weapon5': '0.220', 'weapon4': '0.234', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'ARMOR': '0.850', 'HITCOUNT': '1.290', 'weapon3': '1.410', 'weapon2': '1.520', 'DAMAGECOUNT': '4.806', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:13:33,619][2409075] DAMAGECOUNT value on done: 5559.0
[2023-02-25 13:13:33,622][2409075] Sum rewards: 3.215, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.160', 'AMMO5': '0.023', 'WEAPON1': '0.040', 'AMMO2': '0.045', 'weapon7': '0.084', 'AMMO3': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.154', 'WEAPON7': '0.200', 'AMMO4': '0.226', 'WEAPON5': '0.450', 'ARMOR': '0.456', 'WEAPON4': '0.550', 'HITCOUNT': '0.610', 'weapon4': '0.642', 'weapon2': '0.718', 'WEAPON3': '0.750', 'weapon3': '1.704', 'DAMAGECOUNT': '2.370', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:13:33,824][2409074] Updated weights for policy 0, policy_version 20231 (0.0012)
[2023-02-25 13:13:34,010][2409565] DAMAGECOUNT value on done: 7424.0
[2023-02-25 13:13:34,010][2409565] Sum rewards: 17.328, reward structure: {'DEATHCOUNT': '-6.000', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon7': '0.060', 'AMMO3': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.137', 'weapon4': '0.210', 'weapon5': '0.248', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'ARMOR': '0.900', 'HITCOUNT': '1.000', 'HEALTH': '1.076', 'weapon2': '1.522', 'weapon3': '1.696', 'DAMAGECOUNT': '4.359', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:13:34,173][2409097] DAMAGECOUNT value on done: 5506.0
[2023-02-25 13:13:34,177][2409097] Sum rewards: 6.376, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.676', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.062', 'weapon7': '0.132', 'WEAPON5': '0.150', 'weapon4': '0.156', 'WEAPON4': '0.200', 'HITCOUNT': '0.320', 'ARMOR': '0.400', 'AMMO6': '0.420', 'AMMO7': '0.420', 'WEAPON3': '0.450', 'WEAPON7': '0.500', 'weapon3': '1.342', 'DAMAGECOUNT': '1.722', 'weapon2': '1.940', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:13:34,605][2409407] DAMAGECOUNT value on done: 4781.0
[2023-02-25 13:13:34,608][2409407] Sum rewards: 7.179, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.935', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.012', 'weapon7': '0.048', 'weapon5': '0.082', 'AMMO3': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'HITCOUNT': '0.580', 'ARMOR': '1.313', 'weapon3': '1.600', 'DAMAGECOUNT': '2.037', 'weapon2': '2.104', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:13:35,156][2409548] DAMAGECOUNT value on done: 5200.0
[2023-02-25 13:13:35,156][2409548] Sum rewards: 3.770, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.830', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'AMMO5': '0.023', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'AMMO3': '0.105', 'weapon5': '0.238', 'weapon4': '0.270', 'HITCOUNT': '0.380', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'ARMOR': '0.912', 'weapon2': '1.008', 'weapon3': '1.390', 'DAMAGECOUNT': '1.704', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:13:35,244][2409597] DAMAGECOUNT value on done: 6409.0
[2023-02-25 13:13:35,245][2409597] Sum rewards: 7.117, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.642', 'AMMO5': '0.017', 'AMMO2': '0.036', 'AMMO3': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.144', 'weapon7': '0.144', 'AMMO4': '0.179', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.424', 'WEAPON3': '0.500', 'HITCOUNT': '0.540', 'weapon2': '0.628', 'ARMOR': '0.891', 'weapon3': '1.050', 'DAMAGECOUNT': '2.526', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:13:35,391][2409405] DAMAGECOUNT value on done: 7345.0
[2023-02-25 13:13:35,394][2409405] Sum rewards: 15.135, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.294', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.079', 'AMMO4': '0.103', 'weapon5': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'weapon2': '0.692', 'ARMOR': '0.857', 'HITCOUNT': '1.100', 'weapon4': '1.166', 'weapon3': '1.416', 'DAMAGECOUNT': '5.115', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:13:35,435][2409373] DAMAGECOUNT value on done: 7104.0
[2023-02-25 13:13:35,436][2409373] Sum rewards: 13.105, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.849', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon5': '0.066', 'AMMO3': '0.084', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'weapon4': '0.170', 'WEAPON5': '0.200', 'WEAPON3': '0.600', 'HITCOUNT': '1.130', 'weapon3': '1.354', 'weapon2': '1.364', 'DAMAGECOUNT': '4.179', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:13:35,473][2409078] DAMAGECOUNT value on done: 5549.0
[2023-02-25 13:13:35,475][2409078] Sum rewards: 6.649, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.037', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO3': '0.040', 'weapon7': '0.070', 'AMMO4': '0.111', 'WEAPON5': '0.200', 'weapon5': '0.200', 'WEAPON3': '0.250', 'WEAPON4': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'HITCOUNT': '0.390', 'WEAPON7': '0.400', 'ARMOR': '0.455', 'weapon3': '0.856', 'weapon2': '0.874', 'weapon4': '1.412', 'DAMAGECOUNT': '2.208', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:35,545][2409485] DAMAGECOUNT value on done: 8124.0
[2023-02-25 13:13:35,546][2409485] Sum rewards: 13.729, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.261', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.070', 'WEAPON3': '0.350', 'HITCOUNT': '0.930', 'weapon3': '1.214', 'weapon2': '2.042', 'DAMAGECOUNT': '3.030', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:13:35,658][2409077] Large shaping reward 2.599 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5670000000000001, 189.0), ('weapon7', 0.002)]
[2023-02-25 13:13:35,729][2409074] Updated weights for policy 0, policy_version 20241 (0.0012)
[2023-02-25 13:13:35,956][2409389] DAMAGECOUNT value on done: 5674.0
[2023-02-25 13:13:35,956][2409389] Sum rewards: 8.122, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.372', 'AMMO2': '0.007', 'AMMO5': '0.025', 'AMMO4': '0.035', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.050', 'AMMO3': '0.136', 'weapon5': '0.140', 'ARMOR': '0.457', 'WEAPON5': '0.600', 'HITCOUNT': '0.700', 'WEAPON3': '0.900', 'weapon2': '1.490', 'weapon3': '1.762', 'DAMAGECOUNT': '2.601', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:36,038][2409104] DAMAGECOUNT value on done: 6011.0
[2023-02-25 13:13:36,041][2409104] Sum rewards: 10.786, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.382', 'AMMO2': '0.011', 'AMMO5': '0.025', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.116', 'weapon4': '0.124', 'weapon5': '0.160', 'ARMOR': '0.470', 'WEAPON5': '0.600', 'HITCOUNT': '0.630', 'weapon2': '0.682', 'WEAPON3': '0.900', 'weapon3': '2.586', 'DAMAGECOUNT': '3.210', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:13:36,053][2409105] DAMAGECOUNT value on done: 6747.0
[2023-02-25 13:13:36,056][2409105] Sum rewards: 14.962, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.462', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO5': '0.012', 'AMMO3': '0.060', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.170', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'HITCOUNT': '0.840', 'ARMOR': '0.847', 'weapon3': '1.366', 'weapon2': '1.858', 'DAMAGECOUNT': '3.624', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:13:36,148][2409596] DAMAGECOUNT value on done: 5707.0
[2023-02-25 13:13:36,146][2409469] DAMAGECOUNT value on done: 4988.0
[2023-02-25 13:13:36,150][2409469] Sum rewards: 7.057, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.000', 'AMMO5': '0.012', 'weapon7': '0.014', 'AMMO2': '0.015', 'ARMOR': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.074', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.118', 'AMMO3': '0.129', 'weapon4': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.830', 'WEAPON3': '0.850', 'weapon2': '1.048', 'weapon3': '2.146', 'DAMAGECOUNT': '3.321', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:36,150][2409596] Sum rewards: 9.670, reward structure: {'DEATHCOUNT': '-1.500', 'AMMO5': '0.003', 'AMMO2': '0.004', 'HEALTH': '0.012', 'AMMO4': '0.019', 'AMMO3': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.060', 'weapon7': '0.104', 'HITCOUNT': '0.150', 'WEAPON3': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon3': '0.520', 'ARMOR': '0.878', 'DAMAGECOUNT': '1.119', 'weapon2': '2.342', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:13:36,205][2409079] DAMAGECOUNT value on done: 6129.0
[2023-02-25 13:13:36,206][2409079] Sum rewards: 10.586, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.430', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'AMMO3': '0.079', 'weapon5': '0.126', 'WEAPON4': '0.150', 'AMMO4': '0.155', 'WEAPON5': '0.250', 'weapon4': '0.386', 'WEAPON3': '0.550', 'weapon2': '0.744', 'HITCOUNT': '0.760', 'weapon3': '1.558', 'DAMAGECOUNT': '2.706', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:36,390][2409077] DAMAGECOUNT value on done: 6374.0
[2023-02-25 13:13:36,391][2409077] Sum rewards: 14.698, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.650', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO3': '0.052', 'AMMO4': '0.061', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.244', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'weapon4': '0.470', 'HITCOUNT': '0.590', 'weapon3': '1.226', 'ARMOR': '1.300', 'weapon2': '1.830', 'DAMAGECOUNT': '3.732', 'FRAGCOUNT': '10.500'}
[2023-02-25 13:13:36,511][2409355] DAMAGECOUNT value on done: 6819.0
[2023-02-25 13:13:36,515][2409355] Sum rewards: 14.886, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.720', 'AMMO5': '0.006', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'AMMO4': '0.044', 'weapon7': '0.060', 'weapon5': '0.080', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'ARMOR': '0.490', 'weapon4': '0.516', 'HITCOUNT': '0.690', 'weapon3': '0.994', 'weapon2': '1.268', 'DAMAGECOUNT': '3.648', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:13:36,522][2409406] DAMAGECOUNT value on done: 5895.0
[2023-02-25 13:13:36,523][2409406] Sum rewards: 9.356, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.563', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.023', 'WEAPON1': '0.040', 'AMMO3': '0.062', 'weapon7': '0.064', 'weapon5': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.850', 'ARMOR': '0.899', 'weapon3': '1.492', 'weapon2': '1.780', 'DAMAGECOUNT': '3.300', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:36,652][2409565] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:13:36,863][2409074] Updated weights for policy 0, policy_version 20251 (0.0012)
[2023-02-25 13:13:36,907][2409096] DAMAGECOUNT value on done: 7085.0
[2023-02-25 13:13:36,910][2409096] Sum rewards: 10.724, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.606', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO5': '0.020', 'AMMO4': '0.096', 'AMMO3': '0.119', 'weapon4': '0.148', 'WEAPON4': '0.150', 'weapon5': '0.212', 'WEAPON5': '0.300', 'HITCOUNT': '0.640', 'WEAPON3': '0.700', 'weapon2': '1.264', 'ARMOR': '1.600', 'weapon3': '2.132', 'DAMAGECOUNT': '3.669', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:13:37,186][2408954] Fps is (10 sec: 26623.9, 60 sec: 25122.2, 300 sec: 25284.1). Total num frames: 82956288. Throughput: 0: 6264.0. Samples: 20731164. Policy #0 lag: (min: 0.0, avg: 11.3, max: 25.0)
[2023-02-25 13:13:37,186][2408954] Avg episode reward: [(0, '10.210')]
[2023-02-25 13:13:37,185][2409076] DAMAGECOUNT value on done: 6907.0
[2023-02-25 13:13:37,188][2409076] Sum rewards: 9.464, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.830', 'AMMO5': '0.017', 'AMMO2': '0.038', 'WEAPON1': '0.040', 'AMMO3': '0.105', 'weapon5': '0.132', 'weapon4': '0.158', 'AMMO4': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '0.680', 'ARMOR': '0.868', 'weapon3': '1.162', 'weapon2': '2.254', 'DAMAGECOUNT': '3.447', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:13:37,195][2409866] DAMAGECOUNT value on done: 6603.0
[2023-02-25 13:13:37,198][2409866] Sum rewards: 14.298, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.398', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.073', 'weapon5': '0.088', 'AMMO4': '0.114', 'weapon7': '0.170', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.568', 'HITCOUNT': '0.590', 'weapon2': '0.916', 'weapon3': '1.328', 'DAMAGECOUNT': '3.399', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:13:37,293][2409099] DAMAGECOUNT value on done: 5935.0
[2023-02-25 13:13:37,293][2409099] Sum rewards: 7.975, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.452', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.084', 'AMMO3': '0.120', 'AMMO4': '0.162', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.730', 'WEAPON3': '0.750', 'weapon4': '0.768', 'ARMOR': '0.800', 'weapon2': '1.206', 'weapon3': '1.744', 'DAMAGECOUNT': '2.721', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:37,311][2409486] DAMAGECOUNT value on done: 6708.0
[2023-02-25 13:13:37,312][2409486] Sum rewards: -0.209, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.242', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.087', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'weapon7': '0.216', 'weapon5': '0.242', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON5': '0.350', 'HITCOUNT': '0.360', 'WEAPON7': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.506', 'ARMOR': '0.906', 'weapon3': '1.194', 'weapon2': '1.492', 'DAMAGECOUNT': '1.584'}
[2023-02-25 13:13:37,385][2409075] DAMAGECOUNT value on done: 6730.0
[2023-02-25 13:13:37,388][2409075] Sum rewards: 12.668, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.910', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.090', 'WEAPON4': '0.150', 'weapon4': '0.154', 'weapon5': '0.178', 'WEAPON5': '0.350', 'ARMOR': '0.455', 'WEAPON3': '0.600', 'HITCOUNT': '0.970', 'weapon3': '1.584', 'weapon2': '1.816', 'DAMAGECOUNT': '3.864', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:13:37,810][2409407] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.531, 177.0)]
[2023-02-25 13:13:37,825][2409097] DAMAGECOUNT value on done: 5832.0
[2023-02-25 13:13:37,826][2409097] Sum rewards: 9.900, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.226', 'AMMO5': '0.022', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'weapon7': '0.072', 'AMMO3': '0.097', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'weapon4': '0.176', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'weapon5': '0.340', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'WEAPON5': '0.550', 'HITCOUNT': '0.620', 'weapon2': '1.328', 'weapon3': '1.642', 'DAMAGECOUNT': '2.847', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:38,286][2409407] DAMAGECOUNT value on done: 6749.0
[2023-02-25 13:13:38,288][2409407] Sum rewards: 10.011, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.893', 'AMMO2': '0.005', 'AMMO5': '0.022', 'AMMO4': '0.024', 'WEAPON1': '0.030', 'AMMO3': '0.091', 'WEAPON4': '0.150', 'weapon4': '0.162', 'weapon5': '0.334', 'WEAPON5': '0.600', 'HITCOUNT': '0.610', 'WEAPON3': '0.650', 'ARMOR': '1.344', 'weapon2': '1.430', 'weapon3': '1.682', 'DAMAGECOUNT': '3.270', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:38,293][2409565] DAMAGECOUNT value on done: 5649.0
[2023-02-25 13:13:38,293][2409565] Sum rewards: 17.954, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.130', 'AMMO2': '0.011', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'weapon7': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.088', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.238', 'WEAPON5': '0.450', 'weapon4': '0.454', 'ARMOR': '0.455', 'WEAPON3': '0.700', 'HITCOUNT': '1.010', 'weapon2': '1.080', 'weapon3': '1.784', 'DAMAGECOUNT': '4.224', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:13:38,778][2409548] DAMAGECOUNT value on done: 5160.0
[2023-02-25 13:13:38,781][2409548] Sum rewards: 9.770, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.000', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO3': '0.060', 'weapon5': '0.254', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.570', 'weapon3': '1.520', 'weapon2': '1.884', 'DAMAGECOUNT': '2.313', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:38,916][2409597] DAMAGECOUNT value on done: 5646.0
[2023-02-25 13:13:38,917][2409597] Sum rewards: 5.345, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.506', 'AMMO4': '-0.063', 'AMMO2': '-0.012', 'AMMO5': '0.015', 'weapon5': '0.056', 'AMMO3': '0.078', 'weapon7': '0.116', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.730', 'ARMOR': '1.289', 'weapon3': '1.488', 'weapon2': '1.634', 'DAMAGECOUNT': '2.640', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:13:38,931][2409405] DAMAGECOUNT value on done: 5681.0
[2023-02-25 13:13:38,932][2409405] Sum rewards: 11.461, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.757', 'AMMO2': '0.010', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.047', 'weapon7': '0.076', 'AMMO3': '0.082', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'ARMOR': '0.429', 'weapon4': '0.518', 'WEAPON3': '0.550', 'HITCOUNT': '0.650', 'weapon2': '1.320', 'weapon3': '1.738', 'DAMAGECOUNT': '3.411', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:13:39,029][2409078] DAMAGECOUNT value on done: 6220.0
[2023-02-25 13:13:39,033][2409078] Sum rewards: 8.161, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.634', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.016', 'weapon5': '0.020', 'weapon4': '0.074', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.930', 'weapon3': '1.672', 'weapon2': '1.850', 'DAMAGECOUNT': '2.877', 'FRAGCOUNT': '6.500'}
[2023-02-25 13:13:39,313][2409074] Updated weights for policy 0, policy_version 20261 (0.0012)
[2023-02-25 13:13:39,687][2409104] DAMAGECOUNT value on done: 6314.0
[2023-02-25 13:13:39,688][2409104] Sum rewards: 0.083, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.050', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon5': '0.044', 'AMMO3': '0.063', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'ARMOR': '0.456', 'HITCOUNT': '0.560', 'weapon4': '0.792', 'weapon3': '0.822', 'FRAGCOUNT': '1.000', 'weapon2': '1.148', 'DAMAGECOUNT': '1.683'}
[2023-02-25 13:13:39,706][2409373] DAMAGECOUNT value on done: 7532.0
[2023-02-25 13:13:39,709][2409373] Sum rewards: 10.799, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.049', 'AMMO2': '0.007', 'AMMO5': '0.015', 'AMMO4': '0.035', 'weapon7': '0.058', 'AMMO3': '0.104', 'weapon5': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.376', 'HITCOUNT': '0.570', 'WEAPON3': '0.750', 'ARMOR': '0.851', 'weapon2': '1.200', 'weapon3': '1.744', 'DAMAGECOUNT': '2.592', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:13:39,715][2409105] DAMAGECOUNT value on done: 5338.0
[2023-02-25 13:13:39,717][2409105] Sum rewards: 7.942, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.970', 'weapon4': '0.004', 'AMMO2': '0.005', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.026', 'AMMO3': '0.057', 'WEAPON4': '0.100', 'weapon5': '0.188', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'ARMOR': '0.454', 'HITCOUNT': '0.580', 'weapon2': '1.016', 'weapon3': '1.072', 'DAMAGECOUNT': '2.442', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:39,734][2409469] DAMAGECOUNT value on done: 5834.0
[2023-02-25 13:13:39,736][2409469] Sum rewards: 5.551, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.990', 'AMMO5': '0.007', 'AMMO2': '0.029', 'ARMOR': '0.032', 'AMMO3': '0.047', 'weapon5': '0.084', 'weapon7': '0.124', 'AMMO4': '0.143', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'HITCOUNT': '0.340', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.640', 'weapon3': '0.822', 'DAMAGECOUNT': '1.662', 'weapon4': '2.130', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:13:39,784][2409389] DAMAGECOUNT value on done: 6516.0
[2023-02-25 13:13:39,787][2409389] Sum rewards: 11.919, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.042', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.037', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'weapon5': '0.152', 'weapon4': '0.186', 'AMMO4': '0.186', 'WEAPON5': '0.450', 'ARMOR': '0.841', 'WEAPON3': '0.850', 'HITCOUNT': '0.950', 'weapon2': '1.208', 'weapon3': '2.104', 'DAMAGECOUNT': '4.170', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:13:39,789][2409596] DAMAGECOUNT value on done: 6056.0
[2023-02-25 13:13:39,807][2409596] Sum rewards: 9.120, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.726', 'AMMO4': '-0.023', 'AMMO2': '-0.004', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.057', 'weapon7': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.258', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '0.450', 'weapon3': '0.796', 'ARMOR': '0.915', 'weapon2': '1.834', 'DAMAGECOUNT': '2.016', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:39,910][2409074] Updated weights for policy 0, policy_version 20271 (0.0012)
[2023-02-25 13:13:40,054][2409079] DAMAGECOUNT value on done: 6808.0
[2023-02-25 13:13:40,055][2409079] Sum rewards: 6.285, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.880', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO3': '0.037', 'weapon5': '0.052', 'weapon7': '0.082', 'AMMO4': '0.097', 'HITCOUNT': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON3': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'weapon3': '0.546', 'ARMOR': '0.823', 'weapon4': '1.092', 'weapon2': '1.158', 'DAMAGECOUNT': '1.380', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:13:40,099][2409077] DAMAGECOUNT value on done: 6145.0
[2023-02-25 13:13:40,100][2409077] Sum rewards: 13.240, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.350', 'AMMO2': '0.011', 'AMMO5': '0.027', 'AMMO4': '0.055', 'AMMO3': '0.142', 'WEAPON4': '0.200', 'weapon5': '0.254', 'weapon4': '0.322', 'WEAPON5': '0.600', 'HITCOUNT': '0.810', 'WEAPON3': '0.850', 'ARMOR': '1.340', 'weapon3': '1.372', 'weapon2': '1.454', 'DAMAGECOUNT': '4.152', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:13:40,166][2409355] DAMAGECOUNT value on done: 6576.0
[2023-02-25 13:13:40,167][2409355] Sum rewards: 10.259, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.043', 'weapon7': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'AMMO3': '0.092', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.119', 'weapon5': '0.242', 'WEAPON5': '0.400', 'weapon4': '0.464', 'WEAPON3': '0.550', 'HITCOUNT': '0.740', 'ARMOR': '0.872', 'weapon2': '1.084', 'weapon3': '1.780', 'DAMAGECOUNT': '3.477', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:40,220][2409406] DAMAGECOUNT value on done: 6852.0
[2023-02-25 13:13:40,221][2409406] Sum rewards: 12.027, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.109', 'weapon4': '0.164', 'weapon5': '0.366', 'HEALTH': '0.423', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'weapon2': '1.076', 'HITCOUNT': '1.100', 'ARMOR': '1.253', 'weapon3': '1.956', 'DAMAGECOUNT': '4.275', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:13:40,607][2409096] DAMAGECOUNT value on done: 5678.0
[2023-02-25 13:13:40,608][2409096] Sum rewards: 11.544, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.530', 'AMMO2': '0.009', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.047', 'AMMO3': '0.128', 'WEAPON4': '0.200', 'weapon5': '0.200', 'weapon4': '0.262', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'HITCOUNT': '0.840', 'weapon2': '1.300', 'weapon3': '1.686', 'DAMAGECOUNT': '3.447', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:13:40,825][2409866] DAMAGECOUNT value on done: 6467.0
[2023-02-25 13:13:40,828][2409076] DAMAGECOUNT value on done: 6032.0
[2023-02-25 13:13:40,828][2409866] Sum rewards: 11.345, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO3': '0.040', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.071', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.140', 'weapon4': '0.148', 'WEAPON5': '0.150', 'HEALTH': '0.225', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.880', 'weapon3': '0.948', 'weapon2': '1.418', 'DAMAGECOUNT': '2.952', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:40,831][2409076] Sum rewards: 10.435, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.043', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO3': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HEALTH': '0.117', 'weapon5': '0.164', 'WEAPON5': '0.200', 'WEAPON3': '0.500', 'weapon4': '0.538', 'HITCOUNT': '0.670', 'ARMOR': '0.800', 'weapon2': '0.950', 'weapon3': '1.616', 'DAMAGECOUNT': '2.277', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:41,158][2409075] DAMAGECOUNT value on done: 5907.0
[2023-02-25 13:13:41,158][2409075] Sum rewards: 7.953, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.404', 'AMMO2': '0.007', 'AMMO5': '0.015', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'AMMO3': '0.111', 'weapon4': '0.164', 'weapon5': '0.208', 'ARMOR': '0.376', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.710', 'weapon2': '1.308', 'weapon3': '1.984', 'DAMAGECOUNT': '2.790', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:41,501][2409097] DAMAGECOUNT value on done: 5551.0
[2023-02-25 13:13:41,504][2409097] Sum rewards: 4.726, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.660', 'AMMO5': '0.007', 'AMMO2': '0.008', 'ARMOR': '0.012', 'weapon4': '0.040', 'AMMO4': '0.042', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.106', 'weapon5': '0.112', 'WEAPON5': '0.150', 'HITCOUNT': '0.480', 'WEAPON3': '0.700', 'weapon2': '1.050', 'weapon3': '1.538', 'DAMAGECOUNT': '2.040', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:13:41,581][2409486] DAMAGECOUNT value on done: 5838.0
[2023-02-25 13:13:41,584][2409486] Sum rewards: 12.267, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.391', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.042', 'AMMO3': '0.050', 'weapon7': '0.084', 'WEAPON4': '0.100', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.260', 'weapon4': '0.292', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.830', 'weapon3': '0.988', 'weapon2': '1.736', 'DAMAGECOUNT': '3.147', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:41,605][2409099] DAMAGECOUNT value on done: 5409.0
[2023-02-25 13:13:41,606][2409099] Sum rewards: 5.714, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.280', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'weapon4': '0.126', 'weapon5': '0.210', 'WEAPON5': '0.300', 'HITCOUNT': '0.310', 'WEAPON3': '0.550', 'ARMOR': '0.855', 'weapon3': '1.088', 'DAMAGECOUNT': '1.665', 'weapon2': '1.962', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:13:42,186][2408954] Fps is (10 sec: 24575.9, 60 sec: 24917.3, 300 sec: 25173.1). Total num frames: 83066880. Throughput: 0: 6288.8. Samples: 20769504. Policy #0 lag: (min: 0.0, avg: 15.7, max: 28.0)
[2023-02-25 13:13:42,186][2408954] Avg episode reward: [(0, '10.050')]
[2023-02-25 13:13:42,228][2409407] DAMAGECOUNT value on done: 5875.0
[2023-02-25 13:13:42,232][2409407] Sum rewards: 9.725, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.890', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'WEAPON4': '0.050', 'weapon5': '0.050', 'AMMO3': '0.082', 'weapon7': '0.106', 'AMMO4': '0.160', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.312', 'WEAPON3': '0.550', 'HITCOUNT': '0.580', 'weapon2': '0.834', 'weapon3': '0.936', 'DAMAGECOUNT': '2.490', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:42,327][2409548] DAMAGECOUNT value on done: 4697.0
[2023-02-25 13:13:42,327][2409548] Sum rewards: 4.831, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.196', 'AMMO5': '0.015', 'AMMO2': '0.023', 'weapon7': '0.048', 'AMMO3': '0.056', 'AMMO4': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.228', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.646', 'HITCOUNT': '0.680', 'ARMOR': '0.800', 'weapon3': '1.070', 'weapon2': '1.616', 'DAMAGECOUNT': '2.289', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:13:42,344][2409074] Updated weights for policy 0, policy_version 20281 (0.0012)
[2023-02-25 13:13:42,808][2409565] DAMAGECOUNT value on done: 7916.0
[2023-02-25 13:13:42,809][2409565] Sum rewards: 12.203, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.654', 'AMMO2': '0.002', 'WEAPON1': '0.010', 'AMMO4': '0.012', 'weapon4': '0.014', 'AMMO5': '0.015', 'WEAPON4': '0.050', 'AMMO3': '0.123', 'weapon5': '0.208', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'ARMOR': '0.853', 'HITCOUNT': '0.980', 'weapon3': '1.672', 'weapon2': '1.862', 'DAMAGECOUNT': '3.555', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:13:42,972][2409405] DAMAGECOUNT value on done: 7242.0
[2023-02-25 13:13:42,986][2409405] Sum rewards: 20.479, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.012', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'AMMO4': '0.097', 'weapon4': '0.158', 'weapon5': '0.182', 'HEALTH': '0.212', 'WEAPON5': '0.250', 'ARMOR': '0.428', 'WEAPON3': '0.500', 'HITCOUNT': '0.910', 'weapon2': '1.296', 'weapon3': '1.978', 'DAMAGECOUNT': '4.035', 'FRAGCOUNT': '15.500'}
[2023-02-25 13:13:43,109][2409078] DAMAGECOUNT value on done: 5825.0
[2023-02-25 13:13:43,111][2409078] Sum rewards: 11.570, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.376', 'AMMO5': '0.015', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'weapon7': '0.052', 'AMMO3': '0.083', 'AMMO4': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.188', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.660', 'ARMOR': '0.896', 'weapon4': '0.912', 'weapon2': '1.230', 'weapon3': '1.328', 'DAMAGECOUNT': '3.375', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:13:43,527][2409074] Updated weights for policy 0, policy_version 20291 (0.0013)
[2023-02-25 13:13:43,527][2409389] DAMAGECOUNT value on done: 5214.0
[2023-02-25 13:13:43,528][2409389] Sum rewards: 9.142, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.736', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO3': '0.070', 'weapon7': '0.070', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.220', 'weapon4': '0.282', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.740', 'weapon2': '1.442', 'weapon3': '1.698', 'DAMAGECOUNT': '2.898', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:43,542][2409597] DAMAGECOUNT value on done: 7219.0
[2023-02-25 13:13:43,551][2409597] Sum rewards: 18.519, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.355', 'AMMO5': '0.011', 'AMMO2': '0.036', 'AMMO3': '0.067', 'weapon5': '0.142', 'weapon7': '0.156', 'AMMO4': '0.180', 'WEAPON5': '0.300', 'AMMO6': '0.340', 'AMMO7': '0.340', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'WEAPON7': '0.500', 'WEAPON4': '0.550', 'HITCOUNT': '0.690', 'weapon2': '0.704', 'weapon3': '1.314', 'weapon4': '1.404', 'DAMAGECOUNT': '4.839', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:13:43,660][2409104] DAMAGECOUNT value on done: 7954.0
[2023-02-25 13:13:43,663][2409104] Sum rewards: 12.966, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.742', 'AMMO2': '0.006', 'AMMO5': '0.009', 'AMMO4': '0.029', 'weapon7': '0.048', 'AMMO3': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.174', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'ARMOR': '0.467', 'HITCOUNT': '0.790', 'weapon4': '0.796', 'weapon2': '0.962', 'weapon3': '1.122', 'DAMAGECOUNT': '3.501', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:13:43,668][2409373] DAMAGECOUNT value on done: 7776.0
[2023-02-25 13:13:43,669][2409373] Sum rewards: 15.308, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.521', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'AMMO3': '0.050', 'weapon7': '0.058', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.274', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON3': '0.350', 'weapon4': '0.392', 'WEAPON7': '0.400', 'ARMOR': '0.479', 'HITCOUNT': '0.710', 'weapon3': '1.246', 'weapon2': '1.762', 'DAMAGECOUNT': '3.111', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:13:43,692][2409355] DAMAGECOUNT value on done: 5915.0
[2023-02-25 13:13:43,693][2409355] Sum rewards: 13.139, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.093', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon7': '0.046', 'AMMO3': '0.077', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.125', 'weapon5': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'weapon2': '0.744', 'HITCOUNT': '0.770', 'weapon4': '0.926', 'weapon3': '1.488', 'DAMAGECOUNT': '3.012', 'FRAGCOUNT': '10.500'}
[2023-02-25 13:13:43,788][2409596] DAMAGECOUNT value on done: 6798.0
[2023-02-25 13:13:43,791][2409596] Sum rewards: 12.792, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.749', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.052', 'AMMO3': '0.053', 'weapon7': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.104', 'weapon4': '0.214', 'WEAPON5': '0.250', 'AMMO6': '0.280', 'AMMO7': '0.280', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'ARMOR': '0.400', 'HITCOUNT': '0.660', 'weapon3': '1.100', 'weapon2': '1.114', 'DAMAGECOUNT': '3.753', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:43,795][2409547] DAMAGECOUNT value on done: 5058.0
[2023-02-25 13:13:43,795][2409547] Sum rewards: 15.567, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.243', 'AMMO5': '0.017', 'AMMO2': '0.029', 'weapon7': '0.050', 'AMMO3': '0.069', 'weapon5': '0.130', 'AMMO4': '0.142', 'weapon4': '0.200', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '0.840', 'weapon3': '1.294', 'ARMOR': '1.301', 'weapon2': '1.724', 'DAMAGECOUNT': '3.813', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:13:43,853][2409469] DAMAGECOUNT value on done: 6983.0
[2023-02-25 13:13:43,858][2409469] Sum rewards: 7.284, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.964', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'AMMO3': '0.041', 'weapon7': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.126', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'HITCOUNT': '0.590', 'weapon3': '1.024', 'weapon2': '1.556', 'DAMAGECOUNT': '2.049', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:13:43,908][2409079] DAMAGECOUNT value on done: 6539.0
[2023-02-25 13:13:43,911][2409079] Sum rewards: 14.403, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'HEALTH': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO3': '0.076', 'WEAPON5': '0.250', 'weapon5': '0.258', 'WEAPON3': '0.450', 'HITCOUNT': '0.750', 'ARMOR': '0.843', 'weapon2': '1.460', 'weapon3': '1.466', 'DAMAGECOUNT': '3.330', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:13:43,993][2409077] DAMAGECOUNT value on done: 7192.0
[2023-02-25 13:13:43,994][2409077] Sum rewards: 7.180, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.150', 'AMMO2': '0.004', 'AMMO5': '0.018', 'AMMO4': '0.019', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.064', 'AMMO3': '0.075', 'weapon5': '0.374', 'ARMOR': '0.400', 'HITCOUNT': '0.480', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon3': '1.564', 'weapon2': '1.750', 'DAMAGECOUNT': '2.412', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:44,102][2409406] DAMAGECOUNT value on done: 5311.0
[2023-02-25 13:13:44,103][2409406] Sum rewards: 2.922, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.600', 'AMMO5': '0.016', 'weapon7': '0.026', 'WEAPON1': '0.030', 'AMMO2': '0.046', 'AMMO3': '0.069', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.156', 'AMMO4': '0.231', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.526', 'HITCOUNT': '0.560', 'ARMOR': '0.948', 'weapon3': '1.296', 'weapon2': '1.510', 'DAMAGECOUNT': '2.208', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:13:44,359][2409866] DAMAGECOUNT value on done: 7436.0
[2023-02-25 13:13:44,360][2409866] Sum rewards: 10.415, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.245', 'AMMO5': '0.013', 'AMMO2': '0.013', 'AMMO3': '0.032', 'AMMO4': '0.063', 'weapon5': '0.064', 'WEAPON4': '0.150', 'weapon7': '0.186', 'WEAPON5': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'weapon2': '0.856', 'weapon3': '0.902', 'weapon4': '1.668', 'DAMAGECOUNT': '2.274', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:44,683][2409096] DAMAGECOUNT value on done: 6029.0
[2023-02-25 13:13:44,687][2409096] Sum rewards: 3.970, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.308', 'AMMO2': '0.004', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.019', 'AMMO3': '0.040', 'weapon7': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.132', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.300', 'weapon3': '0.602', 'DAMAGECOUNT': '0.810', 'weapon2': '0.824', 'weapon4': '1.350', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:13:44,795][2409076] DAMAGECOUNT value on done: 4404.0
[2023-02-25 13:13:44,796][2409076] Sum rewards: 4.425, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.545', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.009', 'ARMOR': '0.012', 'weapon5': '0.012', 'AMMO3': '0.020', 'weapon7': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.200', 'weapon4': '0.280', 'HITCOUNT': '0.290', 'weapon3': '0.462', 'weapon2': '0.492', 'DAMAGECOUNT': '1.020', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:13:44,882][2409105] DAMAGECOUNT value on done: 7540.0
[2023-02-25 13:13:44,883][2409105] Sum rewards: 8.826, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.908', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.012', 'AMMO3': '0.051', 'WEAPON4': '0.100', 'weapon4': '0.134', 'weapon7': '0.140', 'weapon5': '0.196', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.840', 'weapon3': '1.076', 'weapon2': '1.808', 'DAMAGECOUNT': '3.189', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:44,973][2409074] Updated weights for policy 0, policy_version 20301 (0.0012)
[2023-02-25 13:13:45,030][2409075] DAMAGECOUNT value on done: 6336.0
[2023-02-25 13:13:45,033][2409075] Sum rewards: 6.216, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.625', 'AMMO5': '0.017', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'weapon7': '0.074', 'AMMO3': '0.094', 'AMMO4': '0.099', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.176', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.430', 'WEAPON3': '0.550', 'weapon4': '0.664', 'weapon2': '0.716', 'ARMOR': '0.856', 'weapon3': '1.240', 'DAMAGECOUNT': '2.445', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:13:45,117][2409097] DAMAGECOUNT value on done: 6434.0
[2023-02-25 13:13:45,120][2409097] Sum rewards: 10.323, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.607', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.070', 'AMMO3': '0.071', 'weapon7': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.210', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.610', 'weapon3': '1.564', 'weapon2': '1.656', 'DAMAGECOUNT': '2.430', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:45,299][2409486] DAMAGECOUNT value on done: 6355.0
[2023-02-25 13:13:45,300][2409486] Sum rewards: 4.927, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.576', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon5': '0.064', 'AMMO3': '0.075', 'AMMO4': '0.114', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.490', 'weapon4': '0.554', 'weapon2': '0.952', 'DAMAGECOUNT': '1.719', 'weapon3': '1.840', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:13:45,313][2409389] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:13:45,360][2409099] DAMAGECOUNT value on done: 6936.0
[2023-02-25 13:13:45,364][2409099] Sum rewards: 10.764, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.768', 'AMMO2': '0.005', 'weapon5': '0.012', 'AMMO5': '0.015', 'AMMO4': '0.024', 'WEAPON1': '0.050', 'weapon7': '0.062', 'AMMO3': '0.083', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.760', 'weapon4': '0.932', 'weapon2': '0.952', 'ARMOR': '0.956', 'weapon3': '1.434', 'DAMAGECOUNT': '2.757', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:13:46,051][2409407] DAMAGECOUNT value on done: 5568.0
[2023-02-25 13:13:46,052][2409407] Sum rewards: 6.614, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.164', 'AMMO2': '0.014', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'weapon7': '0.052', 'AMMO4': '0.070', 'AMMO3': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.134', 'WEAPON4': '0.200', 'weapon4': '0.262', 'ARMOR': '0.400', 'HITCOUNT': '0.420', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon3': '1.162', 'DAMAGECOUNT': '1.521', 'weapon2': '2.120', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:46,841][2409565] DAMAGECOUNT value on done: 7137.0
[2023-02-25 13:13:46,846][2409565] Sum rewards: 15.685, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.250', 'AMMO2': '0.017', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.083', 'weapon5': '0.084', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO3': '0.110', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'HITCOUNT': '1.090', 'weapon2': '1.360', 'weapon3': '1.840', 'DAMAGECOUNT': '3.708', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:13:47,037][2409074] Updated weights for policy 0, policy_version 20311 (0.0013)
[2023-02-25 13:13:47,059][2409405] DAMAGECOUNT value on done: 6326.0
[2023-02-25 13:13:47,073][2409405] Sum rewards: 0.979, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.274', 'AMMO2': '0.020', 'AMMO3': '0.030', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'HITCOUNT': '0.050', 'weapon7': '0.064', 'weapon2': '0.070', 'AMMO4': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON3': '0.200', 'DAMAGECOUNT': '0.255', 'weapon4': '0.286', 'weapon3': '0.288', 'FRAGCOUNT': '1.000'}
[2023-02-25 13:13:47,186][2408954] Fps is (10 sec: 24575.4, 60 sec: 25190.3, 300 sec: 25200.8). Total num frames: 83202048. Throughput: 0: 6281.6. Samples: 20806956. Policy #0 lag: (min: 0.0, avg: 15.7, max: 28.0)
[2023-02-25 13:13:47,187][2408954] Avg episode reward: [(0, '10.035')]
[2023-02-25 13:13:47,249][2409355] DAMAGECOUNT value on done: 4586.0
[2023-02-25 13:13:47,255][2409078] DAMAGECOUNT value on done: 5440.0
[2023-02-25 13:13:47,253][2409355] Sum rewards: 1.967, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.322', 'AMMO2': '0.014', 'AMMO5': '0.016', 'AMMO4': '0.069', 'weapon7': '0.074', 'weapon5': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.125', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.392', 'HITCOUNT': '0.400', 'ARMOR': '0.452', 'weapon4': '0.806', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.305', 'weapon3': '1.880', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:13:47,256][2409078] Sum rewards: 6.963, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.850', 'AMMO5': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.066', 'weapon7': '0.106', 'weapon5': '0.114', 'AMMO4': '0.120', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.450', 'ARMOR': '0.460', 'HITCOUNT': '0.620', 'weapon4': '0.776', 'weapon2': '0.862', 'weapon3': '1.378', 'DAMAGECOUNT': '2.337', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:47,262][2409373] DAMAGECOUNT value on done: 5211.0
[2023-02-25 13:13:47,265][2409373] Sum rewards: 2.976, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.794', 'AMMO2': '0.003', 'AMMO4': '0.017', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.160', 'weapon4': '0.166', 'WEAPON5': '0.350', 'HITCOUNT': '0.430', 'WEAPON3': '0.650', 'ARMOR': '0.905', 'weapon2': '1.322', 'weapon3': '1.532', 'DAMAGECOUNT': '1.767', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:13:47,276][2409104] DAMAGECOUNT value on done: 6746.0
[2023-02-25 13:13:47,278][2409104] Sum rewards: 18.619, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO2': '0.023', 'AMMO5': '0.027', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.117', 'AMMO3': '0.140', 'weapon5': '0.146', 'weapon4': '0.224', 'HEALTH': '0.266', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'ARMOR': '0.800', 'weapon2': '0.830', 'HITCOUNT': '1.460', 'weapon3': '2.256', 'DAMAGECOUNT': '5.949', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:13:47,330][2409389] DAMAGECOUNT value on done: 5771.0
[2023-02-25 13:13:47,332][2409389] Sum rewards: 13.787, reward structure: {'DEATHCOUNT': '-5.250', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.031', 'WEAPON4': '0.050', 'AMMO3': '0.079', 'AMMO4': '0.154', 'HEALTH': '0.170', 'weapon5': '0.170', 'weapon4': '0.228', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'ARMOR': '0.452', 'HITCOUNT': '0.780', 'weapon3': '1.416', 'weapon2': '1.426', 'DAMAGECOUNT': '3.198', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:13:47,404][2409596] DAMAGECOUNT value on done: 5928.0
[2023-02-25 13:13:47,407][2409596] Sum rewards: 9.108, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.659', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'AMMO3': '0.114', 'weapon4': '0.130', 'AMMO4': '0.188', 'WEAPON4': '0.200', 'weapon5': '0.216', 'WEAPON5': '0.450', 'HITCOUNT': '0.680', 'WEAPON3': '0.750', 'weapon2': '1.338', 'ARMOR': '1.357', 'weapon3': '2.028', 'DAMAGECOUNT': '2.988', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:47,446][2409469] DAMAGECOUNT value on done: 6387.0
[2023-02-25 13:13:47,449][2409469] Sum rewards: 7.022, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.170', 'AMMO5': '0.021', 'AMMO2': '0.030', 'AMMO3': '0.106', 'weapon5': '0.120', 'WEAPON4': '0.150', 'AMMO4': '0.151', 'ARMOR': '0.452', 'weapon4': '0.468', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '0.800', 'weapon2': '1.350', 'weapon3': '1.360', 'DAMAGECOUNT': '2.784', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:47,685][2409077] DAMAGECOUNT value on done: 6420.0
[2023-02-25 13:13:47,689][2409077] Sum rewards: 6.042, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.030', 'AMMO2': '0.021', 'AMMO5': '0.032', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.125', 'weapon5': '0.368', 'HITCOUNT': '0.440', 'weapon4': '0.626', 'WEAPON5': '0.700', 'WEAPON3': '0.800', 'weapon2': '1.038', 'weapon3': '1.548', 'DAMAGECOUNT': '1.917', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:47,747][2409547] DAMAGECOUNT value on done: 6709.0
[2023-02-25 13:13:47,748][2409547] Sum rewards: 10.596, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.280', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.144', 'WEAPON4': '0.150', 'weapon4': '0.150', 'weapon7': '0.166', 'AMMO3': '0.167', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.670', 'ARMOR': '0.908', 'WEAPON3': '1.050', 'weapon2': '1.254', 'weapon3': '2.064', 'DAMAGECOUNT': '3.414', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:13:47,854][2409406] DAMAGECOUNT value on done: 5136.0
[2023-02-25 13:13:47,855][2409406] Sum rewards: 2.323, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.058', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO5': '0.024', 'AMMO4': '0.113', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'weapon5': '0.202', 'weapon4': '0.326', 'WEAPON5': '0.550', 'HITCOUNT': '0.660', 'WEAPON3': '0.900', 'weapon2': '1.090', 'weapon3': '1.936', 'DAMAGECOUNT': '2.685', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:13:47,986][2409079] DAMAGECOUNT value on done: 6297.0
[2023-02-25 13:13:47,987][2409079] Sum rewards: 12.665, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.661', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'weapon4': '0.030', 'AMMO5': '0.032', 'WEAPON4': '0.050', 'AMMO4': '0.116', 'AMMO3': '0.130', 'weapon5': '0.178', 'WEAPON5': '0.650', 'WEAPON3': '0.850', 'ARMOR': '0.852', 'HITCOUNT': '0.890', 'weapon2': '1.414', 'weapon3': '1.910', 'DAMAGECOUNT': '3.690', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:13:47,990][2409866] DAMAGECOUNT value on done: 7234.0
[2023-02-25 13:13:47,992][2409866] Sum rewards: 2.341, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.132', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'AMMO5': '0.030', 'WEAPON1': '0.030', 'AMMO3': '0.102', 'weapon5': '0.188', 'WEAPON5': '0.550', 'HITCOUNT': '0.590', 'WEAPON3': '0.700', 'weapon2': '0.802', 'ARMOR': '0.833', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.439', 'weapon3': '2.710'}
[2023-02-25 13:13:48,090][2409074] Updated weights for policy 0, policy_version 20321 (0.0021)
[2023-02-25 13:13:48,380][2409096] DAMAGECOUNT value on done: 5905.0
[2023-02-25 13:13:48,382][2409096] Sum rewards: 12.199, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.010', 'AMMO3': '0.030', 'AMMO2': '0.031', 'weapon7': '0.050', 'AMMO4': '0.154', 'WEAPON3': '0.200', 'WEAPON5': '0.200', 'HEALTH': '0.228', 'weapon5': '0.230', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.670', 'weapon2': '0.696', 'weapon3': '0.726', 'weapon4': '1.508', 'DAMAGECOUNT': '2.616', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:48,406][2409076] DAMAGECOUNT value on done: 6078.0
[2023-02-25 13:13:48,409][2409076] Sum rewards: 10.633, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.836', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.012', 'weapon5': '0.060', 'AMMO3': '0.083', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'weapon2': '1.084', 'weapon3': '1.420', 'ARMOR': '1.819', 'DAMAGECOUNT': '2.010', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:48,990][2409075] DAMAGECOUNT value on done: 6766.0
[2023-02-25 13:13:48,990][2409075] Sum rewards: 10.319, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.425', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO2': '0.027', 'weapon7': '0.036', 'AMMO3': '0.068', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.133', 'weapon5': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.542', 'WEAPON3': '0.550', 'ARMOR': '0.626', 'weapon4': '0.716', 'HITCOUNT': '0.900', 'weapon3': '1.158', 'DAMAGECOUNT': '3.984', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:13:49,020][2409097] DAMAGECOUNT value on done: 5776.0
[2023-02-25 13:13:49,021][2409097] Sum rewards: 11.460, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.574', 'AMMO4': '-0.054', 'AMMO2': '-0.011', 'AMMO5': '0.017', 'WEAPON1': '0.060', 'AMMO3': '0.071', 'weapon5': '0.252', 'WEAPON5': '0.550', 'HITCOUNT': '0.640', 'WEAPON3': '0.650', 'ARMOR': '0.850', 'weapon2': '1.346', 'weapon3': '2.020', 'DAMAGECOUNT': '2.892', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:13:49,026][2409105] DAMAGECOUNT value on done: 5946.0
[2023-02-25 13:13:49,029][2409105] Sum rewards: 8.460, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.591', 'AMMO2': '0.013', 'AMMO5': '0.018', 'weapon5': '0.032', 'AMMO3': '0.058', 'AMMO4': '0.066', 'weapon7': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'AMMO6': '0.380', 'AMMO7': '0.380', 'ARMOR': '0.446', 'WEAPON3': '0.450', 'WEAPON7': '0.500', 'weapon4': '0.696', 'HITCOUNT': '0.710', 'weapon3': '1.066', 'weapon2': '1.166', 'DAMAGECOUNT': '2.988', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:49,395][2409486] DAMAGECOUNT value on done: 6294.0
[2023-02-25 13:13:49,398][2409486] Sum rewards: 4.326, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon7': '0.046', 'AMMO3': '0.090', 'weapon5': '0.172', 'AMMO4': '0.183', 'WEAPON5': '0.200', 'HEALTH': '0.270', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'HITCOUNT': '0.360', 'ARMOR': '0.459', 'WEAPON3': '0.500', 'weapon4': '0.592', 'weapon3': '1.384', 'weapon2': '1.490', 'DAMAGECOUNT': '1.533', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:13:49,486][2409099] DAMAGECOUNT value on done: 5951.0
[2023-02-25 13:13:49,489][2409099] Sum rewards: 4.484, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.555', 'AMMO2': '0.005', 'AMMO5': '0.016', 'AMMO4': '0.023', 'weapon7': '0.070', 'AMMO3': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.122', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.256', 'HITCOUNT': '0.290', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'weapon3': '1.352', 'ARMOR': '1.709', 'DAMAGECOUNT': '1.794', 'weapon2': '1.882', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:13:49,974][2409407] DAMAGECOUNT value on done: 6117.0
[2023-02-25 13:13:49,975][2409407] Sum rewards: 4.604, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.016', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO3': '0.048', 'AMMO4': '0.057', 'weapon5': '0.068', 'weapon7': '0.134', 'WEAPON5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON3': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.430', 'ARMOR': '0.447', 'weapon2': '0.532', 'weapon3': '0.712', 'weapon4': '1.412', 'DAMAGECOUNT': '1.560', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:13:50,712][2409074] Updated weights for policy 0, policy_version 20331 (0.0012)
[2023-02-25 13:13:50,865][2409104] DAMAGECOUNT value on done: 7148.0
[2023-02-25 13:13:50,866][2409104] Sum rewards: 9.198, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.040', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.060', 'AMMO4': '0.105', 'weapon5': '0.160', 'weapon7': '0.178', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON7': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.510', 'weapon4': '0.824', 'weapon3': '0.880', 'weapon2': '1.194', 'ARMOR': '1.271', 'DAMAGECOUNT': '2.427', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:50,998][2409596] DAMAGECOUNT value on done: 5870.0
[2023-02-25 13:13:50,999][2409596] Sum rewards: 10.002, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.862', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'AMMO5': '0.025', 'weapon7': '0.058', 'AMMO3': '0.090', 'AMMO4': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.124', 'WEAPON5': '0.400', 'HITCOUNT': '0.530', 'WEAPON3': '0.600', 'ARMOR': '0.944', 'weapon3': '1.362', 'weapon2': '1.498', 'DAMAGECOUNT': '2.304', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:51,111][2409565] DAMAGECOUNT value on done: 7226.0
[2023-02-25 13:13:51,112][2409565] Sum rewards: 16.265, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.618', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO2': '0.044', 'weapon7': '0.060', 'AMMO3': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.220', 'weapon5': '0.278', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'WEAPON5': '0.600', 'weapon4': '0.822', 'HITCOUNT': '0.830', 'weapon2': '0.972', 'weapon3': '1.400', 'DAMAGECOUNT': '5.121', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:13:51,161][2409389] DAMAGECOUNT value on done: 6671.0
[2023-02-25 13:13:51,162][2409389] Sum rewards: 22.377, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.344', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'AMMO3': '0.068', 'weapon7': '0.084', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'weapon5': '0.172', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.450', 'weapon2': '0.502', 'ARMOR': '0.800', 'HITCOUNT': '0.990', 'weapon3': '1.402', 'weapon4': '1.408', 'DAMAGECOUNT': '4.575', 'FRAGCOUNT': '16.000'}
[2023-02-25 13:13:51,172][2409355] DAMAGECOUNT value on done: 7170.0
[2023-02-25 13:13:51,175][2409355] Sum rewards: 19.853, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.526', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.102', 'AMMO4': '0.122', 'WEAPON4': '0.250', 'weapon5': '0.330', 'weapon4': '0.340', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'ARMOR': '0.820', 'weapon2': '1.072', 'HITCOUNT': '1.160', 'weapon3': '1.750', 'DAMAGECOUNT': '5.718', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:13:51,358][2409373] DAMAGECOUNT value on done: 5309.0
[2023-02-25 13:13:51,360][2409373] Sum rewards: 8.094, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.439', 'AMMO2': '0.015', 'AMMO5': '0.025', 'AMMO4': '0.074', 'AMMO3': '0.093', 'WEAPON4': '0.150', 'weapon5': '0.192', 'weapon4': '0.214', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '0.700', 'weapon2': '1.208', 'ARMOR': '1.252', 'weapon3': '2.060', 'DAMAGECOUNT': '2.400', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:13:51,427][2409547] DAMAGECOUNT value on done: 5367.0
[2023-02-25 13:13:51,428][2409547] Sum rewards: 8.153, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.896', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'AMMO3': '0.040', 'weapon7': '0.074', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'weapon2': '0.408', 'weapon4': '0.558', 'HITCOUNT': '0.560', 'weapon3': '0.758', 'DAMAGECOUNT': '2.178', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:51,519][2409074] Updated weights for policy 0, policy_version 20341 (0.0012)
[2023-02-25 13:13:51,557][2409469] DAMAGECOUNT value on done: 7372.0
[2023-02-25 13:13:51,560][2409469] Sum rewards: 12.750, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.454', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon4': '0.056', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.198', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '1.030', 'ARMOR': '1.200', 'weapon3': '1.680', 'weapon2': '1.932', 'DAMAGECOUNT': '4.188', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:13:51,659][2409405] DAMAGECOUNT value on done: 4446.0
[2023-02-25 13:13:51,660][2409405] Sum rewards: 9.946, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.816', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.016', 'AMMO3': '0.050', 'weapon7': '0.118', 'weapon5': '0.198', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.350', 'weapon4': '0.356', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'HITCOUNT': '0.400', 'ARMOR': '0.921', 'weapon3': '1.052', 'weapon2': '1.152', 'DAMAGECOUNT': '2.406', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:51,700][2409077] DAMAGECOUNT value on done: 6836.0
[2023-02-25 13:13:51,703][2409077] Sum rewards: 4.579, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.154', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.029', 'weapon5': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'WEAPON5': '0.150', 'weapon4': '0.208', 'ARMOR': '0.470', 'WEAPON3': '0.700', 'HITCOUNT': '0.850', 'weapon2': '1.586', 'weapon3': '1.718', 'DAMAGECOUNT': '2.703', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:51,791][2409406] DAMAGECOUNT value on done: 5943.0
[2023-02-25 13:13:51,793][2409406] Sum rewards: 10.911, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.040', 'AMMO2': '0.017', 'AMMO5': '0.020', 'AMMO3': '0.082', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'weapon5': '0.180', 'weapon4': '0.312', 'WEAPON5': '0.450', 'ARMOR': '0.453', 'HITCOUNT': '0.620', 'WEAPON3': '0.650', 'weapon2': '1.126', 'weapon3': '2.038', 'DAMAGECOUNT': '2.817', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:13:51,818][2409079] DAMAGECOUNT value on done: 6810.0
[2023-02-25 13:13:51,819][2409079] Sum rewards: 7.715, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.579', 'AMMO5': '0.022', 'AMMO2': '0.030', 'weapon7': '0.048', 'AMMO3': '0.115', 'weapon5': '0.132', 'AMMO4': '0.151', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.700', 'weapon4': '0.702', 'HITCOUNT': '0.780', 'ARMOR': '1.251', 'weapon2': '1.368', 'weapon3': '1.554', 'DAMAGECOUNT': '2.400', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:51,832][2409078] DAMAGECOUNT value on done: 7301.0
[2023-02-25 13:13:51,836][2409078] Sum rewards: 5.078, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.268', 'AMMO2': '0.014', 'AMMO5': '0.015', 'AMMO4': '0.070', 'weapon5': '0.104', 'AMMO3': '0.137', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.458', 'weapon4': '0.620', 'WEAPON3': '0.850', 'HITCOUNT': '0.910', 'weapon2': '1.068', 'weapon3': '1.694', 'DAMAGECOUNT': '3.255', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:13:51,990][2409866] DAMAGECOUNT value on done: 7133.0
[2023-02-25 13:13:51,993][2409866] Sum rewards: 18.098, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.422', 'AMMO5': '0.012', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.068', 'AMMO3': '0.071', 'WEAPON5': '0.250', 'weapon5': '0.276', 'WEAPON3': '0.450', 'HITCOUNT': '0.980', 'weapon2': '1.662', 'ARMOR': '1.751', 'weapon3': '1.832', 'DAMAGECOUNT': '5.133', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:13:52,186][2408954] Fps is (10 sec: 25804.3, 60 sec: 25122.1, 300 sec: 25228.6). Total num frames: 83324928. Throughput: 0: 6288.3. Samples: 20825544. Policy #0 lag: (min: 0.0, avg: 13.1, max: 31.0)
[2023-02-25 13:13:52,187][2408954] Avg episode reward: [(0, '9.739')]
[2023-02-25 13:13:52,596][2409096] DAMAGECOUNT value on done: 6131.0
[2023-02-25 13:13:52,599][2409096] Sum rewards: 10.727, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.278', 'AMMO2': '0.025', 'AMMO5': '0.027', 'WEAPON1': '0.030', 'AMMO4': '0.125', 'weapon5': '0.136', 'AMMO3': '0.148', 'weapon4': '0.176', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'ARMOR': '0.454', 'WEAPON5': '0.600', 'WEAPON3': '0.900', 'HITCOUNT': '0.960', 'weapon2': '1.282', 'weapon3': '2.038', 'DAMAGECOUNT': '3.804', 'FRAGCOUNT': '9.500'}
[2023-02-25 13:13:52,627][2409075] DAMAGECOUNT value on done: 6289.0
[2023-02-25 13:13:52,631][2409075] Sum rewards: 9.457, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.669', 'AMMO2': '0.020', 'AMMO5': '0.030', 'weapon7': '0.048', 'AMMO4': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.117', 'WEAPON4': '0.150', 'weapon5': '0.204', 'weapon4': '0.526', 'WEAPON5': '0.550', 'HITCOUNT': '0.690', 'WEAPON3': '0.800', 'weapon2': '1.208', 'ARMOR': '1.408', 'weapon3': '1.732', 'DAMAGECOUNT': '3.495', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:52,664][2409097] DAMAGECOUNT value on done: 5783.0
[2023-02-25 13:13:52,665][2409097] Sum rewards: 8.611, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.417', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'AMMO3': '0.099', 'AMMO4': '0.135', 'weapon5': '0.188', 'WEAPON4': '0.200', 'weapon4': '0.228', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '0.860', 'ARMOR': '0.876', 'weapon3': '1.636', 'weapon2': '1.706', 'DAMAGECOUNT': '3.588', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:52,692][2409105] DAMAGECOUNT value on done: 6222.0
[2023-02-25 13:13:52,693][2409105] Sum rewards: 14.169, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.410', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'AMMO2': '0.031', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.104', 'AMMO4': '0.154', 'weapon2': '0.376', 'weapon5': '0.396', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'ARMOR': '0.454', 'WEAPON3': '0.700', 'HITCOUNT': '0.870', 'weapon3': '1.258', 'weapon4': '1.440', 'DAMAGECOUNT': '5.052', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:13:52,871][2409076] DAMAGECOUNT value on done: 5723.0
[2023-02-25 13:13:52,874][2409076] Sum rewards: 16.794, reward structure: {'DEATHCOUNT': '-9.750', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.070', 'AMMO4': '0.148', 'AMMO3': '0.153', 'HEALTH': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.404', 'weapon4': '0.484', 'WEAPON3': '0.800', 'HITCOUNT': '0.910', 'weapon2': '1.278', 'weapon3': '1.870', 'DAMAGECOUNT': '3.750', 'FRAGCOUNT': '16.000'}
[2023-02-25 13:13:53,327][2409074] Updated weights for policy 0, policy_version 20351 (0.0012)
[2023-02-25 13:13:53,499][2409486] DAMAGECOUNT value on done: 6480.0
[2023-02-25 13:13:53,502][2409486] Sum rewards: 10.214, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.256', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.053', 'AMMO4': '0.083', 'weapon5': '0.112', 'weapon7': '0.150', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.442', 'WEAPON3': '0.500', 'HITCOUNT': '0.850', 'weapon3': '1.184', 'weapon2': '1.732', 'DAMAGECOUNT': '3.972', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:53,623][2409099] DAMAGECOUNT value on done: 4532.0
[2023-02-25 13:13:53,626][2409099] Sum rewards: 5.361, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.525', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.006', 'AMMO3': '0.020', 'weapon7': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON3': '0.150', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.240', 'ARMOR': '0.459', 'weapon3': '0.542', 'DAMAGECOUNT': '0.984', 'weapon4': '1.280', 'weapon2': '1.582', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:13:53,723][2409407] DAMAGECOUNT value on done: 6133.0
[2023-02-25 13:13:53,738][2409407] Sum rewards: 12.548, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.239', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO3': '0.086', 'AMMO4': '0.109', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon7': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'ARMOR': '0.474', 'weapon4': '0.594', 'WEAPON3': '0.600', 'HITCOUNT': '0.720', 'weapon2': '1.172', 'weapon3': '1.648', 'DAMAGECOUNT': '3.060', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:13:54,572][2409104] DAMAGECOUNT value on done: 5798.0
[2023-02-25 13:13:54,573][2409104] Sum rewards: 7.795, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.292', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.068', 'AMMO3': '0.087', 'AMMO4': '0.117', 'weapon7': '0.134', 'WEAPON5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.494', 'WEAPON3': '0.550', 'HITCOUNT': '0.760', 'weapon4': '0.816', 'weapon2': '1.128', 'weapon3': '1.140', 'DAMAGECOUNT': '3.021', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:54,684][2409596] DAMAGECOUNT value on done: 6563.0
[2023-02-25 13:13:54,685][2409596] Sum rewards: 9.679, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.180', 'AMMO4': '-0.008', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'AMMO3': '0.044', 'weapon4': '0.046', 'weapon7': '0.062', 'weapon5': '0.094', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.380', 'WEAPON3': '0.400', 'weapon3': '0.862', 'weapon2': '1.496', 'DAMAGECOUNT': '2.739', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:13:54,814][2409389] DAMAGECOUNT value on done: 5760.0
[2023-02-25 13:13:54,814][2409389] Sum rewards: 2.510, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.622', 'WEAPON1': '0.010', 'AMMO5': '0.026', 'AMMO2': '0.035', 'AMMO3': '0.087', 'weapon7': '0.140', 'AMMO4': '0.175', 'weapon5': '0.196', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'HITCOUNT': '0.460', 'WEAPON3': '0.600', 'weapon4': '0.782', 'ARMOR': '0.855', 'weapon2': '1.098', 'weapon3': '1.422', 'DAMAGECOUNT': '1.605', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:13:55,013][2409355] DAMAGECOUNT value on done: 7090.0
[2023-02-25 13:13:55,014][2409355] Sum rewards: 13.503, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.864', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.070', 'weapon7': '0.088', 'WEAPON4': '0.100', 'weapon4': '0.142', 'weapon5': '0.192', 'AMMO6': '0.260', 'AMMO7': '0.260', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.455', 'WEAPON3': '0.550', 'HITCOUNT': '0.810', 'weapon3': '1.354', 'weapon2': '1.778', 'DAMAGECOUNT': '3.357', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:55,158][2409074] Updated weights for policy 0, policy_version 20361 (0.0012)
[2023-02-25 13:13:55,162][2409547] DAMAGECOUNT value on done: 7108.0
[2023-02-25 13:13:55,164][2409547] Sum rewards: 13.096, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.603', 'AMMO2': '0.004', 'AMMO4': '0.018', 'AMMO5': '0.022', 'weapon7': '0.050', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.244', 'weapon4': '0.310', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '0.840', 'ARMOR': '0.847', 'weapon3': '1.478', 'weapon2': '1.656', 'DAMAGECOUNT': '4.113', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:13:55,477][2409077] DAMAGECOUNT value on done: 7287.0
[2023-02-25 13:13:55,478][2409077] Sum rewards: 14.216, reward structure: {'DEATHCOUNT': '-5.250', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.013', 'HEALTH': '0.037', 'AMMO4': '0.053', 'AMMO3': '0.076', 'weapon5': '0.130', 'weapon7': '0.136', 'WEAPON4': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.324', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'HITCOUNT': '0.540', 'weapon3': '0.972', 'weapon2': '1.516', 'DAMAGECOUNT': '3.468', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:13:55,544][2409405] DAMAGECOUNT value on done: 5805.0
[2023-02-25 13:13:55,547][2409405] Sum rewards: 15.437, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.122', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.058', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'weapon7': '0.122', 'WEAPON4': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'ARMOR': '0.400', 'weapon4': '0.408', 'WEAPON3': '0.450', 'weapon2': '0.688', 'HITCOUNT': '0.780', 'weapon3': '1.600', 'DAMAGECOUNT': '3.027', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:13:55,567][2409406] DAMAGECOUNT value on done: 6468.0
[2023-02-25 13:13:55,572][2409406] Sum rewards: 8.757, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.760', 'AMMO2': '0.003', 'AMMO5': '0.013', 'AMMO4': '0.016', 'weapon7': '0.054', 'AMMO3': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.447', 'weapon4': '0.580', 'WEAPON3': '0.800', 'HITCOUNT': '0.850', 'weapon2': '1.088', 'weapon3': '1.636', 'DAMAGECOUNT': '2.664', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:55,697][2409469] DAMAGECOUNT value on done: 5635.0
[2023-02-25 13:13:55,701][2409469] Sum rewards: 10.855, reward structure: {'DEATHCOUNT': '-3.750', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.014', 'weapon7': '0.014', 'AMMO4': '0.067', 'AMMO3': '0.076', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.158', 'WEAPON5': '0.250', 'HEALTH': '0.322', 'WEAPON3': '0.400', 'ARMOR': '0.516', 'HITCOUNT': '0.580', 'weapon3': '1.146', 'weapon2': '2.142', 'DAMAGECOUNT': '2.598', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:55,743][2409078] DAMAGECOUNT value on done: 6090.0
[2023-02-25 13:13:55,744][2409078] Sum rewards: 9.335, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.786', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.031', 'AMMO3': '0.087', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.126', 'AMMO4': '0.153', 'weapon5': '0.156', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.450', 'weapon4': '0.516', 'HITCOUNT': '0.840', 'weapon2': '1.398', 'weapon3': '1.530', 'DAMAGECOUNT': '3.012', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:55,835][2409079] DAMAGECOUNT value on done: 6013.0
[2023-02-25 13:13:55,838][2409079] Sum rewards: 11.938, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.022', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.076', 'AMMO3': '0.078', 'WEAPON4': '0.150', 'weapon5': '0.152', 'WEAPON5': '0.200', 'weapon4': '0.264', 'WEAPON3': '0.500', 'ARMOR': '0.897', 'HITCOUNT': '0.920', 'weapon3': '1.376', 'weapon2': '1.538', 'DAMAGECOUNT': '3.033', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:55,876][2409866] DAMAGECOUNT value on done: 6442.0
[2023-02-25 13:13:55,889][2409866] Sum rewards: 8.719, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.580', 'AMMO5': '0.024', 'AMMO2': '0.034', 'weapon7': '0.054', 'AMMO3': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.152', 'AMMO4': '0.169', 'WEAPON7': '0.200', 'WEAPON4': '0.450', 'ARMOR': '0.456', 'WEAPON3': '0.500', 'weapon2': '0.526', 'WEAPON5': '0.550', 'HITCOUNT': '0.780', 'weapon4': '1.250', 'weapon3': '1.380', 'DAMAGECOUNT': '2.967', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:55,973][2409407] Large shaping reward 2.593 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.561, 187.0), ('weapon7', 0.002)]
[2023-02-25 13:13:56,305][2409373] DAMAGECOUNT value on done: 5282.0
[2023-02-25 13:13:56,313][2409373] Sum rewards: 5.945, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.990', 'AMMO2': '0.011', 'AMMO5': '0.018', 'AMMO3': '0.043', 'weapon7': '0.048', 'AMMO4': '0.053', 'weapon5': '0.054', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'WEAPON4': '0.450', 'HITCOUNT': '0.720', 'weapon3': '0.906', 'weapon2': '0.924', 'weapon4': '1.156', 'DAMAGECOUNT': '2.412', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:56,339][2409097] DAMAGECOUNT value on done: 5271.0
[2023-02-25 13:13:56,340][2409097] Sum rewards: 13.169, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.829', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon7': '0.048', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.216', 'WEAPON5': '0.300', 'weapon5': '0.302', 'ARMOR': '0.455', 'WEAPON3': '0.550', 'HITCOUNT': '0.860', 'weapon2': '1.382', 'weapon3': '1.622', 'DAMAGECOUNT': '3.945', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:13:56,365][2409105] DAMAGECOUNT value on done: 6872.0
[2023-02-25 13:13:56,366][2409105] Sum rewards: 5.433, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.860', 'weapon5': '0.014', 'AMMO5': '0.015', 'AMMO2': '0.016', 'AMMO3': '0.060', 'AMMO4': '0.079', 'weapon7': '0.116', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.270', 'WEAPON7': '0.300', 'HITCOUNT': '0.450', 'weapon3': '0.864', 'weapon4': '1.290', 'DAMAGECOUNT': '1.929', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:13:56,562][2409075] DAMAGECOUNT value on done: 5761.0
[2023-02-25 13:13:56,565][2409075] Sum rewards: 13.629, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.440', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'AMMO3': '0.088', 'WEAPON4': '0.150', 'weapon4': '0.306', 'weapon5': '0.350', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '0.840', 'weapon2': '1.268', 'weapon3': '1.764', 'DAMAGECOUNT': '4.038', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:13:56,635][2409074] Updated weights for policy 0, policy_version 20371 (0.0012)
[2023-02-25 13:13:56,667][2409096] DAMAGECOUNT value on done: 7140.0
[2023-02-25 13:13:56,671][2409096] Sum rewards: 13.232, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.772', 'AMMO2': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.050', 'AMMO3': '0.062', 'weapon7': '0.102', 'weapon5': '0.104', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'weapon4': '0.304', 'WEAPON3': '0.450', 'HITCOUNT': '0.650', 'ARMOR': '0.852', 'weapon3': '1.042', 'weapon2': '2.184', 'DAMAGECOUNT': '2.988', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:13:57,186][2408954] Fps is (10 sec: 24166.9, 60 sec: 24917.3, 300 sec: 25214.7). Total num frames: 83443712. Throughput: 0: 6288.3. Samples: 20863428. Policy #0 lag: (min: 0.0, avg: 13.1, max: 31.0)
[2023-02-25 13:13:57,186][2408954] Avg episode reward: [(0, '9.950')]
[2023-02-25 13:13:57,604][2409486] DAMAGECOUNT value on done: 6449.0
[2023-02-25 13:13:57,605][2409486] Sum rewards: 10.814, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.093', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO5': '0.022', 'AMMO4': '0.065', 'weapon4': '0.068', 'AMMO3': '0.103', 'WEAPON4': '0.200', 'weapon5': '0.346', 'WEAPON5': '0.650', 'HITCOUNT': '0.680', 'WEAPON3': '0.700', 'ARMOR': '1.327', 'weapon2': '1.582', 'weapon3': '1.688', 'DAMAGECOUNT': '4.452', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:13:57,719][2409076] DAMAGECOUNT value on done: 5755.0
[2023-02-25 13:13:57,720][2409076] Sum rewards: 5.706, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.698', 'AMMO2': '0.016', 'AMMO5': '0.020', 'WEAPON1': '0.060', 'weapon4': '0.066', 'AMMO4': '0.082', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'weapon5': '0.354', 'WEAPON5': '0.500', 'HITCOUNT': '0.530', 'WEAPON3': '0.650', 'ARMOR': '0.921', 'weapon2': '1.548', 'weapon3': '1.740', 'DAMAGECOUNT': '1.968', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:57,732][2409099] DAMAGECOUNT value on done: 7240.0
[2023-02-25 13:13:57,735][2409099] Sum rewards: 14.326, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.096', 'AMMO2': '0.013', 'AMMO5': '0.020', 'AMMO4': '0.065', 'AMMO3': '0.094', 'weapon7': '0.094', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.172', 'WEAPON7': '0.200', 'weapon5': '0.234', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'ARMOR': '0.841', 'HITCOUNT': '0.860', 'weapon2': '1.496', 'weapon3': '1.598', 'DAMAGECOUNT': '4.344', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:13:57,834][2409407] DAMAGECOUNT value on done: 5893.0
[2023-02-25 13:13:57,838][2409407] Sum rewards: 10.099, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.294', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.030', 'AMMO3': '0.107', 'AMMO4': '0.152', 'weapon5': '0.338', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '0.650', 'weapon4': '0.658', 'weapon3': '1.292', 'weapon2': '1.352', 'ARMOR': '1.358', 'DAMAGECOUNT': '2.625', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:58,212][2409104] DAMAGECOUNT value on done: 7467.0
[2023-02-25 13:13:58,215][2409104] Sum rewards: 8.778, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.452', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.030', 'AMMO3': '0.055', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.102', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'weapon5': '0.224', 'HITCOUNT': '0.330', 'WEAPON3': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.712', 'weapon4': '0.866', 'weapon3': '0.964', 'ARMOR': '0.978', 'DAMAGECOUNT': '2.040', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:58,456][2409074] Updated weights for policy 0, policy_version 20381 (0.0012)
[2023-02-25 13:13:58,794][2409389] DAMAGECOUNT value on done: 7204.0
[2023-02-25 13:13:58,796][2409389] Sum rewards: 10.629, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.270', 'AMMO5': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'AMMO3': '0.072', 'weapon5': '0.084', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.452', 'WEAPON3': '0.500', 'HITCOUNT': '0.700', 'weapon2': '0.818', 'weapon3': '1.620', 'DAMAGECOUNT': '2.607', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:58,931][2409033] Signal inference workers to stop experience collection... (2450 times)
[2023-02-25 13:13:58,933][2409033] Signal inference workers to resume experience collection... (2450 times)
[2023-02-25 13:13:58,957][2409074] InferenceWorker_p0-w0: stopping experience collection (2450 times)
[2023-02-25 13:13:58,958][2409074] InferenceWorker_p0-w0: resuming experience collection (2450 times)
[2023-02-25 13:13:59,419][2409547] DAMAGECOUNT value on done: 7231.0
[2023-02-25 13:13:59,422][2409547] Sum rewards: 4.597, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.099', 'weapon7': '0.010', 'AMMO5': '0.021', 'AMMO2': '0.037', 'AMMO3': '0.073', 'weapon5': '0.152', 'AMMO4': '0.185', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'HITCOUNT': '0.470', 'WEAPON3': '0.550', 'ARMOR': '0.869', 'weapon2': '1.424', 'weapon3': '1.578', 'DAMAGECOUNT': '2.451', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:13:59,466][2409355] DAMAGECOUNT value on done: 5537.0
[2023-02-25 13:13:59,470][2409355] Sum rewards: 14.856, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.661', 'AMMO5': '0.019', 'AMMO2': '0.026', 'AMMO3': '0.075', 'weapon5': '0.088', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.346', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'ARMOR': '0.855', 'HITCOUNT': '1.090', 'weapon2': '1.530', 'weapon3': '1.604', 'DAMAGECOUNT': '3.954', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:13:59,549][2409405] DAMAGECOUNT value on done: 6922.0
[2023-02-25 13:13:59,550][2409405] Sum rewards: 7.807, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.025', 'AMMO5': '0.028', 'AMMO2': '0.032', 'AMMO3': '0.102', 'AMMO4': '0.159', 'weapon5': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'weapon4': '0.714', 'weapon2': '0.806', 'HITCOUNT': '0.870', 'ARMOR': '0.952', 'weapon3': '1.870', 'DAMAGECOUNT': '4.170', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:13:59,715][2409077] DAMAGECOUNT value on done: 5750.0
[2023-02-25 13:13:59,715][2409077] Sum rewards: 7.563, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.864', 'AMMO2': '0.012', 'weapon5': '0.014', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO4': '0.059', 'weapon7': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'HITCOUNT': '0.580', 'weapon2': '0.642', 'WEAPON3': '0.800', 'ARMOR': '0.854', 'weapon4': '1.016', 'weapon3': '1.818', 'DAMAGECOUNT': '3.072', 'FRAGCOUNT': '6.500'}
[2023-02-25 13:13:59,779][2409078] DAMAGECOUNT value on done: 6951.0
[2023-02-25 13:13:59,782][2409078] Sum rewards: 9.432, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.070', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.020', 'WEAPON1': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon4': '0.132', 'WEAPON5': '0.150', 'weapon5': '0.218', 'HITCOUNT': '0.640', 'WEAPON3': '0.700', 'ARMOR': '0.897', 'weapon3': '1.628', 'weapon2': '1.648', 'DAMAGECOUNT': '2.223', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:13:59,783][2409079] DAMAGECOUNT value on done: 5874.0
[2023-02-25 13:13:59,784][2409079] Sum rewards: 10.248, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO3': '0.040', 'weapon7': '0.052', 'AMMO4': '0.077', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon2': '0.164', 'WEAPON4': '0.200', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.236', 'HITCOUNT': '0.460', 'HEALTH': '0.465', 'weapon3': '0.680', 'ARMOR': '0.800', 'weapon4': '1.018', 'DAMAGECOUNT': '2.241', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:13:59,818][2409406] DAMAGECOUNT value on done: 6202.0
[2023-02-25 13:13:59,820][2409406] Sum rewards: 12.358, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.428', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO4': '0.040', 'AMMO3': '0.086', 'WEAPON4': '0.150', 'weapon4': '0.236', 'weapon5': '0.388', 'WEAPON5': '0.650', 'WEAPON3': '0.750', 'HITCOUNT': '0.770', 'weapon2': '1.316', 'weapon3': '1.708', 'ARMOR': '1.866', 'DAMAGECOUNT': '3.522', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:13:59,994][2409074] Updated weights for policy 0, policy_version 20391 (0.0012)
[2023-02-25 13:14:00,089][2409373] DAMAGECOUNT value on done: 6342.0
[2023-02-25 13:14:00,090][2409373] Sum rewards: 7.115, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.313', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO5': '0.015', 'weapon7': '0.062', 'AMMO3': '0.064', 'AMMO4': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.204', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '0.530', 'weapon2': '0.586', 'weapon4': '0.750', 'weapon3': '1.522', 'DAMAGECOUNT': '1.755', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:14:00,333][2409469] DAMAGECOUNT value on done: 7039.0
[2023-02-25 13:14:00,336][2409469] Sum rewards: 5.412, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.684', 'AMMO2': '0.013', 'AMMO5': '0.015', 'AMMO4': '0.065', 'AMMO3': '0.110', 'weapon4': '0.120', 'weapon5': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'HITCOUNT': '0.620', 'WEAPON3': '0.800', 'weapon2': '1.184', 'ARMOR': '1.301', 'weapon3': '1.964', 'DAMAGECOUNT': '2.409', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:14:00,410][2409866] DAMAGECOUNT value on done: 7298.0
[2023-02-25 13:14:00,411][2409866] Sum rewards: 19.508, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.614', 'weapon7': '0.006', 'AMMO2': '0.011', 'AMMO5': '0.021', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.124', 'weapon5': '0.144', 'weapon4': '0.186', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '0.840', 'ARMOR': '0.874', 'weapon3': '1.660', 'weapon2': '1.818', 'DAMAGECOUNT': '4.134', 'FRAGCOUNT': '17.000'}
[2023-02-25 13:14:00,441][2409373] Large shaping reward 3.563 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.531, 177.0), ('weapon7', 0.002)]
[2023-02-25 13:14:00,443][2409075] DAMAGECOUNT value on done: 6675.0
[2023-02-25 13:14:00,445][2409075] Sum rewards: 17.043, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.011', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.080', 'weapon4': '0.194', 'WEAPON5': '0.250', 'weapon5': '0.326', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HEALTH': '0.562', 'HITCOUNT': '0.840', 'weapon2': '1.400', 'weapon3': '1.674', 'DAMAGECOUNT': '3.714', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:14:00,617][2409097] DAMAGECOUNT value on done: 6736.0
[2023-02-25 13:14:00,618][2409097] Sum rewards: 11.822, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.287', 'AMMO2': '0.008', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.041', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.067', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.262', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'weapon4': '0.476', 'HITCOUNT': '0.530', 'ARMOR': '0.886', 'weapon3': '1.078', 'weapon2': '1.112', 'DAMAGECOUNT': '3.213', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:14:01,237][2409096] DAMAGECOUNT value on done: 5415.0
[2023-02-25 13:14:01,239][2409096] Sum rewards: 11.385, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.543', 'ARMOR': '0.012', 'AMMO2': '0.012', 'AMMO5': '0.014', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'AMMO4': '0.060', 'weapon7': '0.130', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.224', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '0.640', 'weapon4': '0.872', 'weapon2': '1.232', 'weapon3': '1.260', 'DAMAGECOUNT': '2.991', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:14:01,328][2409076] DAMAGECOUNT value on done: 7310.0
[2023-02-25 13:14:01,332][2409076] Sum rewards: 16.522, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.930', 'AMMO5': '0.018', 'WEAPON1': '0.030', 'AMMO2': '0.031', 'weapon5': '0.076', 'AMMO3': '0.077', 'AMMO4': '0.153', 'weapon7': '0.156', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.550', 'weapon4': '0.894', 'weapon2': '1.006', 'HITCOUNT': '1.060', 'weapon3': '1.550', 'DAMAGECOUNT': '3.921', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:14:01,516][2409486] DAMAGECOUNT value on done: 6721.0
[2023-02-25 13:14:01,517][2409486] Sum rewards: 17.769, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.826', 'AMMO2': '0.013', 'AMMO5': '0.017', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.099', 'weapon5': '0.256', 'weapon4': '0.344', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'HITCOUNT': '0.950', 'weapon2': '1.190', 'ARMOR': '1.254', 'weapon3': '1.530', 'DAMAGECOUNT': '5.376', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:14:01,517][2409407] DAMAGECOUNT value on done: 4832.0
[2023-02-25 13:14:01,522][2409407] Sum rewards: 8.734, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.410', 'AMMO5': '0.009', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'weapon7': '0.052', 'AMMO3': '0.064', 'AMMO4': '0.087', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.128', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.413', 'WEAPON3': '0.450', 'HITCOUNT': '0.570', 'weapon3': '1.018', 'weapon2': '1.132', 'weapon4': '1.144', 'DAMAGECOUNT': '2.340', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:14:01,548][2409074] Updated weights for policy 0, policy_version 20401 (0.0013)
[2023-02-25 13:14:01,650][2409099] DAMAGECOUNT value on done: 6265.0
[2023-02-25 13:14:01,651][2409099] Sum rewards: 10.270, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.914', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'AMMO3': '0.062', 'weapon7': '0.086', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.138', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.450', 'ARMOR': '0.456', 'WEAPON3': '0.550', 'weapon4': '0.610', 'HITCOUNT': '0.700', 'weapon2': '1.262', 'weapon3': '1.470', 'DAMAGECOUNT': '3.330', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:14:01,901][2409104] DAMAGECOUNT value on done: 5235.0
[2023-02-25 13:14:01,905][2409104] Sum rewards: 11.921, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.145', 'AMMO5': '0.019', 'AMMO2': '0.024', 'AMMO3': '0.088', 'AMMO4': '0.118', 'weapon7': '0.124', 'weapon4': '0.148', 'weapon5': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'AMMO6': '0.420', 'AMMO7': '0.420', 'WEAPON3': '0.450', 'WEAPON7': '0.500', 'HITCOUNT': '0.550', 'ARMOR': '0.854', 'weapon2': '1.134', 'weapon3': '1.520', 'DAMAGECOUNT': '3.423', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:14:02,186][2408954] Fps is (10 sec: 24986.2, 60 sec: 25190.5, 300 sec: 25173.0). Total num frames: 83574784. Throughput: 0: 6284.5. Samples: 20900808. Policy #0 lag: (min: 0.0, avg: 13.1, max: 31.0)
[2023-02-25 13:14:02,186][2408954] Avg episode reward: [(0, '9.970')]
[2023-02-25 13:14:02,758][2409389] DAMAGECOUNT value on done: 6288.0
[2023-02-25 13:14:02,761][2409389] Sum rewards: 13.905, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.149', 'AMMO5': '0.017', 'AMMO2': '0.031', 'AMMO3': '0.099', 'AMMO4': '0.156', 'WEAPON4': '0.200', 'weapon4': '0.338', 'weapon5': '0.354', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'HITCOUNT': '0.710', 'weapon2': '1.306', 'weapon3': '1.644', 'DAMAGECOUNT': '3.648', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:14:03,042][2409405] DAMAGECOUNT value on done: 6744.0
[2023-02-25 13:14:03,043][2409405] Sum rewards: 11.382, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.955', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.063', 'AMMO4': '0.113', 'weapon4': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon5': '0.534', 'HITCOUNT': '0.710', 'weapon2': '1.318', 'weapon3': '1.402', 'DAMAGECOUNT': '3.369', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:14:03,229][2409074] Updated weights for policy 0, policy_version 20411 (0.0012)
[2023-02-25 13:14:03,295][2409078] DAMAGECOUNT value on done: 5745.0
[2023-02-25 13:14:03,299][2409078] Sum rewards: 11.491, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.012', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO4': '0.018', 'AMMO5': '0.020', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.143', 'weapon5': '0.174', 'ARMOR': '0.461', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'HITCOUNT': '0.950', 'weapon2': '1.504', 'weapon3': '1.896', 'DAMAGECOUNT': '3.783', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:14:03,519][2409547] DAMAGECOUNT value on done: 5690.0
[2023-02-25 13:14:03,520][2409547] Sum rewards: 10.622, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.407', 'AMMO2': '0.007', 'AMMO5': '0.013', 'AMMO4': '0.033', 'AMMO3': '0.064', 'weapon7': '0.104', 'WEAPON4': '0.150', 'weapon5': '0.178', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.680', 'weapon2': '0.878', 'ARMOR': '0.936', 'weapon3': '1.166', 'weapon4': '1.310', 'DAMAGECOUNT': '3.870', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:14:03,669][2409373] DAMAGECOUNT value on done: 5943.0
[2023-02-25 13:14:03,672][2409373] Sum rewards: 7.330, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.512', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.039', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.102', 'AMMO3': '0.141', 'weapon5': '0.164', 'AMMO4': '0.195', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon4': '0.454', 'ARMOR': '0.458', 'weapon2': '0.686', 'HITCOUNT': '0.800', 'WEAPON3': '0.900', 'weapon3': '1.926', 'DAMAGECOUNT': '3.639', 'FRAGCOUNT': '6.500'}
[2023-02-25 13:14:03,681][2409079] DAMAGECOUNT value on done: 6901.0
[2023-02-25 13:14:03,684][2409079] Sum rewards: 11.951, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.880', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.012', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.080', 'AMMO3': '0.127', 'weapon5': '0.206', 'WEAPON5': '0.350', 'HITCOUNT': '0.690', 'ARMOR': '0.800', 'WEAPON3': '0.800', 'weapon2': '1.560', 'weapon3': '1.866', 'DAMAGECOUNT': '3.489', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:14:03,784][2409355] DAMAGECOUNT value on done: 6900.0
[2023-02-25 13:14:03,787][2409355] Sum rewards: 15.312, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.334', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO3': '0.073', 'AMMO4': '0.079', 'weapon4': '0.090', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.280', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.940', 'weapon2': '1.440', 'weapon3': '1.560', 'DAMAGECOUNT': '4.008', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:14:04,129][2409389] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:14:04,404][2409075] DAMAGECOUNT value on done: 5635.0
[2023-02-25 13:14:04,407][2409075] Sum rewards: 12.425, reward structure: {'DEATHCOUNT': '-6.750', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.032', 'weapon7': '0.050', 'weapon5': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'AMMO4': '0.161', 'HEALTH': '0.332', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon2': '0.874', 'weapon4': '0.922', 'HITCOUNT': '0.940', 'weapon3': '1.614', 'DAMAGECOUNT': '3.180', 'FRAGCOUNT': '9.500'}
[2023-02-25 13:14:04,408][2409469] DAMAGECOUNT value on done: 5957.0
[2023-02-25 13:14:04,411][2409469] Sum rewards: 7.704, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.962', 'weapon7': '0.018', 'AMMO5': '0.025', 'AMMO2': '0.029', 'AMMO3': '0.103', 'AMMO4': '0.143', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.328', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon4': '0.614', 'WEAPON3': '0.650', 'HITCOUNT': '0.780', 'ARMOR': '0.895', 'weapon2': '1.180', 'weapon3': '1.232', 'DAMAGECOUNT': '3.519', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:14:04,722][2409074] Updated weights for policy 0, policy_version 20421 (0.0012)
[2023-02-25 13:14:04,750][2409097] DAMAGECOUNT value on done: 6192.0
[2023-02-25 13:14:04,753][2409097] Sum rewards: 11.092, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.042', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO2': '0.051', 'AMMO3': '0.058', 'weapon5': '0.102', 'weapon7': '0.200', 'AMMO4': '0.256', 'AMMO6': '0.360', 'AMMO7': '0.360', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'ARMOR': '0.400', 'HITCOUNT': '0.520', 'WEAPON4': '0.600', 'WEAPON7': '0.600', 'weapon2': '0.816', 'weapon3': '1.064', 'weapon4': '1.504', 'DAMAGECOUNT': '3.402', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:14:04,974][2409076] DAMAGECOUNT value on done: 5947.0
[2023-02-25 13:14:04,975][2409076] Sum rewards: 17.102, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.753', 'AMMO5': '0.014', 'AMMO2': '0.018', 'weapon7': '0.072', 'AMMO3': '0.085', 'AMMO4': '0.088', 'weapon5': '0.126', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.352', 'WEAPON3': '0.600', 'HITCOUNT': '0.790', 'ARMOR': '0.845', 'weapon3': '1.404', 'weapon2': '1.458', 'DAMAGECOUNT': '3.303', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:14:05,538][2409096] DAMAGECOUNT value on done: 5354.0
[2023-02-25 13:14:05,540][2409096] Sum rewards: 12.052, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.840', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon5': '0.050', 'AMMO3': '0.088', 'AMMO4': '0.111', 'weapon7': '0.140', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.570', 'weapon4': '0.628', 'weapon2': '0.682', 'weapon3': '1.372', 'DAMAGECOUNT': '3.081', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:14:05,955][2409486] DAMAGECOUNT value on done: 6102.0
[2023-02-25 13:14:05,956][2409486] Sum rewards: 9.619, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.146', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO4': '0.037', 'WEAPON4': '0.100', 'AMMO3': '0.134', 'WEAPON5': '0.250', 'weapon4': '0.292', 'WEAPON3': '0.900', 'HITCOUNT': '0.950', 'weapon2': '1.176', 'weapon3': '1.930', 'DAMAGECOUNT': '3.465', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:14:05,987][2409104] DAMAGECOUNT value on done: 5121.0
[2023-02-25 13:14:05,990][2409104] Sum rewards: 8.066, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.973', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon7': '0.052', 'AMMO4': '0.075', 'AMMO3': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.196', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.510', 'WEAPON3': '0.550', 'weapon4': '0.564', 'weapon2': '0.742', 'weapon3': '0.746', 'ARMOR': '0.938', 'DAMAGECOUNT': '2.706', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:14:06,097][2409099] DAMAGECOUNT value on done: 8213.0
[2023-02-25 13:14:06,098][2409099] Sum rewards: 15.501, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.322', 'AMMO5': '0.022', 'AMMO2': '0.034', 'WEAPON1': '0.040', 'AMMO3': '0.126', 'AMMO4': '0.168', 'weapon5': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.632', 'weapon2': '0.750', 'WEAPON3': '0.800', 'ARMOR': '0.812', 'HITCOUNT': '1.250', 'weapon3': '1.786', 'DAMAGECOUNT': '4.929', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:14:06,388][2409389] DAMAGECOUNT value on done: 5045.0
[2023-02-25 13:14:06,389][2409389] Sum rewards: 1.968, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.620', 'AMMO5': '0.007', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'weapon4': '0.026', 'weapon5': '0.052', 'AMMO3': '0.075', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.180', 'weapon7': '0.186', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.558', 'weapon3': '0.662', 'FRAGCOUNT': '1.000', 'weapon2': '1.262'}
[2023-02-25 13:14:06,480][2409074] Updated weights for policy 0, policy_version 20431 (0.0012)
[2023-02-25 13:14:07,150][2409078] DAMAGECOUNT value on done: 5222.0
[2023-02-25 13:14:07,154][2409078] Sum rewards: 7.797, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.952', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO3': '0.047', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'weapon7': '0.146', 'weapon2': '0.186', 'AMMO6': '0.240', 'AMMO7': '0.240', 'HITCOUNT': '0.290', 'WEAPON4': '0.350', 'WEAPON3': '0.350', 'WEAPON7': '0.400', 'weapon3': '0.808', 'ARMOR': '0.904', 'weapon4': '1.594', 'DAMAGECOUNT': '1.998', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:14:07,186][2408954] Fps is (10 sec: 24575.8, 60 sec: 24917.3, 300 sec: 25159.2). Total num frames: 83689472. Throughput: 0: 6297.1. Samples: 20919804. Policy #0 lag: (min: 0.0, avg: 11.7, max: 26.0)
[2023-02-25 13:14:07,186][2408954] Avg episode reward: [(0, '10.323')]
[2023-02-25 13:14:07,635][2409547] DAMAGECOUNT value on done: 7156.0
[2023-02-25 13:14:07,639][2409547] Sum rewards: 15.598, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.602', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.019', 'weapon7': '0.062', 'AMMO4': '0.093', 'AMMO3': '0.100', 'weapon4': '0.134', 'WEAPON4': '0.200', 'weapon5': '0.230', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON5': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.680', 'ARMOR': '0.924', 'weapon2': '1.422', 'weapon3': '1.864', 'DAMAGECOUNT': '4.107', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:14:07,722][2409079] DAMAGECOUNT value on done: 6580.0
[2023-02-25 13:14:07,723][2409079] Sum rewards: 9.781, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.509', 'WEAPON1': '0.010', 'AMMO5': '0.025', 'AMMO2': '0.031', 'AMMO3': '0.106', 'weapon5': '0.110', 'AMMO4': '0.153', 'weapon7': '0.186', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'weapon4': '0.430', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '0.860', 'weapon2': '0.956', 'weapon3': '1.572', 'DAMAGECOUNT': '2.751', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:14:07,726][2409373] DAMAGECOUNT value on done: 5876.0
[2023-02-25 13:14:07,726][2409373] Sum rewards: 1.267, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.345', 'AMMO5': '0.011', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.059', 'weapon7': '0.064', 'AMMO4': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.250', 'weapon5': '0.276', 'HITCOUNT': '0.340', 'WEAPON5': '0.400', 'WEAPON3': '0.400', 'weapon3': '0.548', 'weapon2': '0.560', 'FRAGCOUNT': '1.000', 'weapon4': '1.176', 'DAMAGECOUNT': '1.596'}
[2023-02-25 13:14:07,982][2409075] DAMAGECOUNT value on done: 6358.0
[2023-02-25 13:14:07,983][2409075] Sum rewards: 10.597, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.814', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO5': '0.015', 'AMMO4': '0.065', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon5': '0.280', 'weapon4': '0.480', 'WEAPON3': '0.600', 'HITCOUNT': '0.840', 'ARMOR': '0.853', 'weapon2': '1.140', 'weapon3': '1.600', 'DAMAGECOUNT': '3.198', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:14:08,277][2409074] Updated weights for policy 0, policy_version 20441 (0.0012)
[2023-02-25 13:14:08,389][2409469] DAMAGECOUNT value on done: 5189.0
[2023-02-25 13:14:08,390][2409469] Sum rewards: 10.152, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.430', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.020', 'weapon7': '0.066', 'AMMO3': '0.080', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'weapon4': '0.330', 'WEAPON7': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '1.030', 'weapon2': '1.370', 'weapon3': '1.518', 'DAMAGECOUNT': '3.558', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:14:08,640][2409097] DAMAGECOUNT value on done: 6252.0
[2023-02-25 13:14:08,641][2409097] Sum rewards: 4.122, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.963', 'AMMO5': '0.017', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'weapon4': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.118', 'AMMO4': '0.123', 'AMMO3': '0.144', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.580', 'WEAPON3': '0.950', 'weapon2': '1.144', 'DAMAGECOUNT': '2.187', 'weapon3': '2.306', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:14:09,360][2409096] DAMAGECOUNT value on done: 5188.0
[2023-02-25 13:14:09,361][2409096] Sum rewards: 12.046, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.097', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO5': '0.015', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'weapon4': '0.220', 'weapon5': '0.232', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.920', 'weapon3': '1.534', 'weapon2': '1.614', 'DAMAGECOUNT': '3.327', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:14:09,456][2409076] DAMAGECOUNT value on done: 6725.0
[2023-02-25 13:14:09,457][2409076] Sum rewards: 9.943, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.850', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'weapon7': '0.074', 'AMMO3': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.159', 'WEAPON7': '0.200', 'weapon5': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'HITCOUNT': '0.520', 'weapon4': '0.616', 'WEAPON3': '0.750', 'weapon2': '0.796', 'ARMOR': '0.905', 'weapon3': '1.678', 'DAMAGECOUNT': '3.666', 'FRAGCOUNT': '8.500'}
[2023-02-25 13:14:09,613][2409074] Updated weights for policy 0, policy_version 20451 (0.0012)
[2023-02-25 13:14:09,630][2409486] DAMAGECOUNT value on done: 6910.0
[2023-02-25 13:14:09,631][2409486] Sum rewards: 6.839, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.002', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.073', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'weapon5': '0.278', 'WEAPON5': '0.300', 'weapon4': '0.330', 'WEAPON3': '0.450', 'HITCOUNT': '0.680', 'ARMOR': '0.800', 'weapon2': '1.182', 'weapon3': '1.482', 'DAMAGECOUNT': '2.607', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:14:09,787][2409099] DAMAGECOUNT value on done: 5201.0
[2023-02-25 13:14:09,793][2409099] Sum rewards: 10.631, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.240', 'AMMO5': '0.017', 'AMMO2': '0.049', 'AMMO3': '0.078', 'weapon7': '0.212', 'AMMO4': '0.244', 'weapon5': '0.274', 'AMMO6': '0.360', 'AMMO7': '0.360', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'weapon2': '0.454', 'ARMOR': '0.458', 'WEAPON4': '0.500', 'WEAPON7': '0.600', 'HITCOUNT': '0.660', 'weapon3': '0.958', 'weapon4': '1.402', 'DAMAGECOUNT': '3.144', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:14:09,989][2409389] DAMAGECOUNT value on done: 6305.0
[2023-02-25 13:14:09,992][2409389] Sum rewards: 15.887, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.554', 'AMMO5': '0.015', 'AMMO2': '0.016', 'WEAPON1': '0.040', 'AMMO3': '0.076', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'weapon5': '0.248', 'WEAPON5': '0.350', 'weapon4': '0.544', 'WEAPON3': '0.600', 'ARMOR': '0.861', 'HITCOUNT': '0.910', 'weapon2': '0.930', 'weapon3': '1.690', 'DAMAGECOUNT': '4.929', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:14:11,124][2409078] DAMAGECOUNT value on done: 6117.0
[2023-02-25 13:14:11,127][2409078] Sum rewards: 5.917, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.490', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO5': '0.022', 'weapon4': '0.058', 'AMMO4': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.125', 'weapon5': '0.132', 'weapon7': '0.138', 'WEAPON5': '0.450', 'HITCOUNT': '0.520', 'WEAPON3': '0.550', 'ARMOR': '0.855', 'weapon2': '1.346', 'weapon3': '1.642', 'DAMAGECOUNT': '2.553', 'FRAGCOUNT': '3.500'}
[2023-02-25 13:14:11,455][2409547] DAMAGECOUNT value on done: 6353.0
[2023-02-25 13:14:11,459][2409547] Sum rewards: 9.974, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.500', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon7': '0.076', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.158', 'WEAPON7': '0.200', 'weapon4': '0.238', 'WEAPON5': '0.350', 'ARMOR': '0.454', 'WEAPON3': '0.700', 'HITCOUNT': '0.920', 'weapon2': '1.220', 'weapon3': '1.344', 'DAMAGECOUNT': '3.348', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:14:11,515][2409074] Updated weights for policy 0, policy_version 20461 (0.0012)
[2023-02-25 13:14:11,712][2409075] DAMAGECOUNT value on done: 7635.0
[2023-02-25 13:14:11,724][2409075] Sum rewards: 20.180, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.015', 'AMMO2': '0.017', 'weapon5': '0.068', 'AMMO4': '0.082', 'AMMO3': '0.099', 'WEAPON5': '0.300', 'HEALTH': '0.443', 'WEAPON3': '0.500', 'ARMOR': '0.879', 'HITCOUNT': '1.090', 'weapon2': '1.704', 'weapon3': '1.880', 'DAMAGECOUNT': '4.353', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:14:11,828][2409099] Large shaping reward 2.641 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO2', -0.0001, -1.0), ('AMMO4', -0.0005, -1.0), ('weapon4', 0.002)]
[2023-02-25 13:14:12,142][2409469] DAMAGECOUNT value on done: 7129.0
[2023-02-25 13:14:12,142][2409469] Sum rewards: 6.358, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.396', 'AMMO2': '0.012', 'weapon5': '0.016', 'AMMO5': '0.025', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'weapon4': '0.348', 'ARMOR': '0.459', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'HITCOUNT': '0.950', 'weapon2': '1.088', 'weapon3': '1.966', 'DAMAGECOUNT': '3.264', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:14:12,186][2408954] Fps is (10 sec: 25804.8, 60 sec: 25258.6, 300 sec: 25228.6). Total num frames: 83832832. Throughput: 0: 6291.5. Samples: 20957388. Policy #0 lag: (min: 0.0, avg: 11.7, max: 26.0)
[2023-02-25 13:14:12,186][2408954] Avg episode reward: [(0, '10.648')]
[2023-02-25 13:14:12,187][2409033] Saving new best policy, reward=10.648!
[2023-02-25 13:14:12,197][2409079] DAMAGECOUNT value on done: 5575.0
[2023-02-25 13:14:12,200][2409079] Sum rewards: 8.232, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.820', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon7': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.148', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.374', 'WEAPON3': '0.550', 'HITCOUNT': '0.650', 'weapon2': '1.186', 'weapon3': '1.400', 'DAMAGECOUNT': '2.946', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:14:12,419][2409097] DAMAGECOUNT value on done: 6766.0
[2023-02-25 13:14:12,423][2409097] Sum rewards: 12.300, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.281', 'AMMO5': '0.017', 'AMMO2': '0.021', 'WEAPON1': '0.050', 'weapon4': '0.060', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'AMMO4': '0.107', 'weapon5': '0.382', 'WEAPON3': '0.600', 'WEAPON5': '0.600', 'HITCOUNT': '0.650', 'weapon2': '1.336', 'weapon3': '1.820', 'DAMAGECOUNT': '4.017', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:14:13,080][2409074] Updated weights for policy 0, policy_version 20471 (0.0012)
[2023-02-25 13:14:13,181][2409096] DAMAGECOUNT value on done: 7723.0
[2023-02-25 13:14:13,185][2409096] Sum rewards: 14.853, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.970', 'AMMO2': '0.015', 'AMMO5': '0.018', 'AMMO3': '0.076', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'weapon5': '0.234', 'weapon4': '0.238', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '1.080', 'weapon2': '1.162', 'weapon3': '1.632', 'DAMAGECOUNT': '4.941', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:14:13,297][2409076] DAMAGECOUNT value on done: 7071.0
[2023-02-25 13:14:13,297][2409076] Sum rewards: 11.477, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.502', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon7': '0.066', 'AMMO3': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.154', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'weapon4': '0.404', 'WEAPON3': '0.500', 'HITCOUNT': '0.900', 'weapon2': '1.434', 'weapon3': '1.652', 'DAMAGECOUNT': '3.846', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:14:13,660][2409486] DAMAGECOUNT value on done: 6567.0
[2023-02-25 13:14:13,661][2409486] Sum rewards: 12.494, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.645', 'AMMO5': '0.019', 'AMMO2': '0.022', 'weapon4': '0.048', 'AMMO3': '0.090', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'weapon5': '0.234', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'ARMOR': '0.860', 'HITCOUNT': '1.150', 'weapon2': '1.742', 'weapon3': '1.772', 'DAMAGECOUNT': '4.194', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:14:13,854][2409099] DAMAGECOUNT value on done: 6263.0
[2023-02-25 13:14:13,857][2409099] Sum rewards: 11.321, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.007', 'HEALTH': '0.010', 'AMMO3': '0.030', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon7': '0.052', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.284', 'ARMOR': '0.464', 'HITCOUNT': '0.490', 'weapon3': '0.632', 'weapon2': '1.422', 'DAMAGECOUNT': '2.094', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:14:14,939][2409074] Updated weights for policy 0, policy_version 20481 (0.0012)
[2023-02-25 13:14:15,331][2409078] DAMAGECOUNT value on done: 6399.0
[2023-02-25 13:14:15,332][2409078] Sum rewards: 13.778, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.230', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.072', 'weapon4': '0.170', 'weapon5': '0.274', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.880', 'weapon2': '1.394', 'weapon3': '1.598', 'DAMAGECOUNT': '3.465', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:14:15,736][2409079] DAMAGECOUNT value on done: 7126.0
[2023-02-25 13:14:15,740][2409079] Sum rewards: 8.736, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.005', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO3': '0.050', 'AMMO4': '0.080', 'weapon7': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'weapon5': '0.260', 'WEAPON5': '0.350', 'ARMOR': '0.460', 'HITCOUNT': '0.480', 'weapon2': '0.838', 'weapon4': '0.954', 'weapon3': '1.086', 'DAMAGECOUNT': '2.187', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:14:15,784][2409547] DAMAGECOUNT value on done: 5707.0
[2023-02-25 13:14:15,784][2409547] Sum rewards: 9.932, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.288', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.068', 'AMMO3': '0.080', 'AMMO4': '0.080', 'weapon7': '0.102', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.232', 'WEAPON7': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.730', 'ARMOR': '0.849', 'weapon2': '1.316', 'weapon3': '1.858', 'DAMAGECOUNT': '2.943', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:14:15,860][2409075] DAMAGECOUNT value on done: 6562.0
[2023-02-25 13:14:15,862][2409075] Sum rewards: 16.899, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.360', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'AMMO5': '0.011', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'weapon4': '0.170', 'weapon5': '0.252', 'WEAPON5': '0.350', 'ARMOR': '0.455', 'WEAPON3': '0.650', 'HITCOUNT': '0.880', 'weapon3': '1.544', 'weapon2': '1.588', 'DAMAGECOUNT': '4.731', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:14:15,889][2409469] DAMAGECOUNT value on done: 6416.0
[2023-02-25 13:14:15,890][2409469] Sum rewards: 15.076, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.020', 'AMMO2': '0.010', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'weapon7': '0.068', 'AMMO3': '0.095', 'weapon4': '0.120', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'weapon5': '0.276', 'WEAPON7': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.780', 'weapon3': '1.118', 'weapon2': '1.770', 'ARMOR': '1.814', 'DAMAGECOUNT': '4.068', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:14:16,326][2409074] Updated weights for policy 0, policy_version 20491 (0.0012)
[2023-02-25 13:14:16,756][2409597] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)]
[2023-02-25 13:14:16,759][2409097] DAMAGECOUNT value on done: 5900.0
[2023-02-25 13:14:16,759][2409097] Sum rewards: 9.480, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.930', 'AMMO5': '0.007', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'weapon5': '0.062', 'AMMO4': '0.114', 'AMMO3': '0.121', 'weapon4': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.750', 'HITCOUNT': '0.820', 'weapon2': '1.290', 'ARMOR': '1.371', 'weapon3': '2.070', 'DAMAGECOUNT': '2.976', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:14:16,951][2409096] DAMAGECOUNT value on done: 6018.0
[2023-02-25 13:14:16,952][2409096] Sum rewards: 13.279, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.500', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon5': '0.046', 'weapon7': '0.048', 'AMMO3': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.500', 'WEAPON3': '0.600', 'weapon4': '0.924', 'HITCOUNT': '0.970', 'weapon3': '1.874', 'DAMAGECOUNT': '4.092', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:14:17,186][2408954] Fps is (10 sec: 26624.3, 60 sec: 25053.8, 300 sec: 25228.6). Total num frames: 83955712. Throughput: 0: 6279.5. Samples: 20995140. Policy #0 lag: (min: 0.0, avg: 11.7, max: 26.0)
[2023-02-25 13:14:17,187][2408954] Avg episode reward: [(0, '10.786')]
[2023-02-25 13:14:17,192][2409033] Saving /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000020497_83955712.pth...
[2023-02-25 13:14:17,288][2409033] Removing /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000019016_77889536.pth
[2023-02-25 13:14:17,297][2409033] Saving new best policy, reward=10.786!
[2023-02-25 13:14:17,492][2409076] DAMAGECOUNT value on done: 6128.0
[2023-02-25 13:14:17,493][2409076] Sum rewards: 13.795, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.321', 'AMMO2': '0.013', 'AMMO5': '0.018', 'weapon7': '0.052', 'AMMO3': '0.065', 'AMMO4': '0.067', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon5': '0.406', 'WEAPON3': '0.450', 'HITCOUNT': '0.630', 'ARMOR': '0.855', 'weapon3': '0.884', 'weapon4': '1.044', 'weapon2': '1.202', 'DAMAGECOUNT': '3.540', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:14:17,592][2409486] DAMAGECOUNT value on done: 5783.0
[2023-02-25 13:14:17,593][2409486] Sum rewards: 10.574, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.644', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'weapon5': '0.198', 'WEAPON5': '0.200', 'weapon4': '0.256', 'ARMOR': '0.458', 'HITCOUNT': '0.610', 'WEAPON3': '0.700', 'weapon2': '1.342', 'weapon3': '1.856', 'DAMAGECOUNT': '2.736', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:14:17,795][2409099] DAMAGECOUNT value on done: 6886.0
[2023-02-25 13:14:17,796][2409099] Sum rewards: 9.457, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.878', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon4': '0.020', 'WEAPON4': '0.050', 'weapon7': '0.084', 'AMMO3': '0.088', 'weapon5': '0.170', 'WEAPON5': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.850', 'weapon3': '1.386', 'weapon2': '1.436', 'DAMAGECOUNT': '4.233', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:14:18,039][2409074] Updated weights for policy 0, policy_version 20501 (0.0012)
[2023-02-25 13:14:18,886][2409078] DAMAGECOUNT value on done: 6059.0
[2023-02-25 13:14:18,889][2409078] Sum rewards: 13.303, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.257', 'AMMO2': '0.007', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.033', 'weapon7': '0.044', 'AMMO3': '0.088', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.216', 'weapon4': '0.330', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'ARMOR': '0.846', 'HITCOUNT': '0.860', 'weapon2': '1.408', 'weapon3': '1.726', 'DAMAGECOUNT': '2.970', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:14:19,523][2409079] DAMAGECOUNT value on done: 7145.0
[2023-02-25 13:14:19,527][2409079] Sum rewards: 1.500, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.124', 'AMMO2': '0.007', 'ARMOR': '0.012', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.037', 'weapon7': '0.054', 'AMMO3': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.168', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.500', 'HITCOUNT': '0.640', 'weapon4': '0.710', 'WEAPON3': '0.800', 'weapon2': '0.944', 'weapon3': '1.696', 'DAMAGECOUNT': '2.478', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:14:19,550][2409074] Updated weights for policy 0, policy_version 20511 (0.0012)
[2023-02-25 13:14:19,552][2409078] Large shaping reward 3.650 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5.0), ('DAMAGECOUNT', 0.6, 200)]
[2023-02-25 13:14:19,582][2409469] DAMAGECOUNT value on done: 5347.0
[2023-02-25 13:14:19,583][2409469] Sum rewards: 3.562, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.019', 'AMMO5': '0.015', 'AMMO2': '0.053', 'AMMO3': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.104', 'weapon7': '0.114', 'AMMO4': '0.263', 'WEAPON5': '0.350', 'HITCOUNT': '0.380', 'WEAPON3': '0.600', 'WEAPON4': '0.650', 'weapon3': '0.996', 'weapon4': '1.056', 'weapon2': '1.236', 'ARMOR': '1.273', 'DAMAGECOUNT': '1.851', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:14:19,698][2409103] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 13:14:19,754][2409075] DAMAGECOUNT value on done: 6075.0
[2023-02-25 13:14:19,756][2409075] Sum rewards: 12.978, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.128', 'weapon7': '0.008', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO2': '0.028', 'AMMO3': '0.086', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'weapon4': '0.150', 'weapon5': '0.332', 'HITCOUNT': '0.420', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'ARMOR': '1.256', 'weapon3': '1.434', 'weapon2': '1.696', 'DAMAGECOUNT': '2.811', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:14:19,823][2409547] DAMAGECOUNT value on done: 5837.0
[2023-02-25 13:14:19,848][2409547] Sum rewards: 9.807, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.971', 'AMMO2': '0.004', 'AMMO5': '0.018', 'AMMO4': '0.021', 'WEAPON1': '0.040', 'weapon7': '0.072', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.202', 'WEAPON5': '0.350', 'HITCOUNT': '0.540', 'WEAPON3': '0.550', 'weapon4': '0.784', 'ARMOR': '0.863', 'weapon2': '1.174', 'weapon3': '1.448', 'DAMAGECOUNT': '2.838', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:14:20,672][2409096] DAMAGECOUNT value on done: 6064.0
[2023-02-25 13:14:20,676][2409096] Sum rewards: 6.711, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.810', 'AMMO2': '0.005', 'AMMO5': '0.007', 'weapon7': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.023', 'weapon5': '0.078', 'AMMO3': '0.094', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'ARMOR': '0.453', 'WEAPON3': '0.650', 'HITCOUNT': '0.660', 'weapon2': '1.484', 'weapon3': '1.562', 'DAMAGECOUNT': '1.917', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:14:21,221][2409074] Updated weights for policy 0, policy_version 20521 (0.0012)
[2023-02-25 13:14:21,411][2409486] DAMAGECOUNT value on done: 4444.0
[2023-02-25 13:14:21,414][2409486] Sum rewards: 9.256, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.018', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.026', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO3': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.174', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.436', 'WEAPON3': '0.600', 'HITCOUNT': '0.700', 'weapon2': '1.260', 'weapon3': '1.796', 'DAMAGECOUNT': '2.844', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:14:21,603][2409076] DAMAGECOUNT value on done: 5923.0
[2023-02-25 13:14:21,604][2409076] Sum rewards: 7.486, reward structure: {'DEATHCOUNT': '-3.000', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.026', 'AMMO3': '0.041', 'weapon7': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'WEAPON3': '0.250', 'HEALTH': '0.278', 'HITCOUNT': '0.380', 'weapon4': '0.522', 'weapon3': '1.032', 'weapon2': '1.034', 'ARMOR': '1.280', 'DAMAGECOUNT': '1.377', 'FRAGCOUNT': '3.500'}
[2023-02-25 13:14:21,636][2409099] DAMAGECOUNT value on done: 6251.0
[2023-02-25 13:14:21,638][2409099] Sum rewards: 13.146, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.056', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.115', 'weapon5': '0.224', 'weapon4': '0.262', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'ARMOR': '0.812', 'HITCOUNT': '0.820', 'weapon2': '1.436', 'weapon3': '1.456', 'DAMAGECOUNT': '3.249', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:14:22,186][2408954] Fps is (10 sec: 24575.2, 60 sec: 25122.1, 300 sec: 25214.7). Total num frames: 84078592. Throughput: 0: 6292.5. Samples: 21014328. Policy #0 lag: (min: 1.0, avg: 13.0, max: 27.0)
[2023-02-25 13:14:22,187][2408954] Avg episode reward: [(0, '10.639')]
[2023-02-25 13:14:22,641][2409079] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 13:14:22,870][2409078] DAMAGECOUNT value on done: 6189.0
[2023-02-25 13:14:22,871][2409078] Sum rewards: 9.682, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.398', 'weapon4': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.020', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'weapon5': '0.138', 'WEAPON5': '0.500', 'HITCOUNT': '0.730', 'WEAPON3': '0.800', 'ARMOR': '0.832', 'weapon2': '1.350', 'weapon3': '2.050', 'DAMAGECOUNT': '3.351', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:14:23,001][2409074] Updated weights for policy 0, policy_version 20531 (0.0012)
[2023-02-25 13:14:23,352][2409469] DAMAGECOUNT value on done: 5830.0
[2023-02-25 13:14:23,353][2409469] Sum rewards: 14.618, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.182', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.027', 'AMMO3': '0.081', 'weapon5': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'weapon4': '0.336', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.950', 'weapon2': '1.020', 'weapon3': '1.640', 'DAMAGECOUNT': '3.420', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:14:23,493][2409079] DAMAGECOUNT value on done: 7325.0
[2023-02-25 13:14:23,497][2409079] Sum rewards: 11.738, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.439', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO3': '0.040', 'AMMO4': '0.063', 'weapon5': '0.068', 'weapon7': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'weapon4': '0.416', 'HITCOUNT': '0.800', 'weapon3': '0.890', 'weapon2': '2.180', 'DAMAGECOUNT': '2.646', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:14:24,074][2409547] DAMAGECOUNT value on done: 7284.0
[2023-02-25 13:14:24,074][2409547] Sum rewards: 9.348, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.006', 'AMMO5': '0.014', 'AMMO2': '0.024', 'weapon7': '0.048', 'AMMO3': '0.077', 'AMMO4': '0.121', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon5': '0.304', 'WEAPON5': '0.350', 'ARMOR': '0.413', 'WEAPON4': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.880', 'weapon4': '0.970', 'weapon2': '0.996', 'weapon3': '1.236', 'DAMAGECOUNT': '2.880', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:14:24,081][2409075] DAMAGECOUNT value on done: 5828.0
[2023-02-25 13:14:24,083][2409075] Sum rewards: 3.585, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.219', 'AMMO2': '0.010', 'AMMO5': '0.020', 'AMMO4': '0.048', 'AMMO3': '0.069', 'weapon7': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.164', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.260', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'ARMOR': '0.479', 'weapon2': '0.480', 'weapon3': '0.610', 'weapon4': '1.124', 'DAMAGECOUNT': '1.674', 'FRAGCOUNT': '3.500'}
[2023-02-25 13:14:24,198][2409074] Updated weights for policy 0, policy_version 20541 (0.0013)
[2023-02-25 13:14:24,513][2409096] DAMAGECOUNT value on done: 5757.0
[2023-02-25 13:14:24,515][2409096] Sum rewards: 10.987, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.052', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'weapon7': '0.052', 'weapon5': '0.060', 'AMMO3': '0.081', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.112', 'WEAPON3': '0.500', 'HITCOUNT': '0.580', 'weapon4': '0.840', 'ARMOR': '0.900', 'weapon2': '1.034', 'weapon3': '1.460', 'DAMAGECOUNT': '2.862', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:14:25,202][2409076] DAMAGECOUNT value on done: 5536.0
[2023-02-25 13:14:25,203][2409076] Sum rewards: 10.719, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.656', 'AMMO2': '0.004', 'AMMO5': '0.017', 'AMMO4': '0.021', 'weapon7': '0.052', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.260', 'weapon5': '0.298', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'weapon2': '1.352', 'weapon3': '1.638', 'DAMAGECOUNT': '3.168', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:14:25,330][2409486] DAMAGECOUNT value on done: 6842.0
[2023-02-25 13:14:25,331][2409486] Sum rewards: 5.005, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.924', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO5': '0.022', 'AMMO3': '0.056', 'weapon7': '0.064', 'weapon5': '0.080', 'AMMO4': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.400', 'WEAPON5': '0.500', 'HITCOUNT': '0.520', 'weapon4': '0.606', 'ARMOR': '0.899', 'weapon3': '1.104', 'weapon2': '1.374', 'DAMAGECOUNT': '2.496', 'FRAGCOUNT': '2.500'}
[2023-02-25 13:14:25,620][2409099] DAMAGECOUNT value on done: 5270.0
[2023-02-25 13:14:25,623][2409099] Sum rewards: 6.366, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.797', 'AMMO2': '0.007', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.035', 'AMMO3': '0.096', 'WEAPON4': '0.200', 'weapon5': '0.220', 'weapon4': '0.320', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '0.800', 'ARMOR': '0.856', 'weapon2': '1.448', 'weapon3': '1.666', 'DAMAGECOUNT': '2.829', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:14:26,116][2409074] Updated weights for policy 0, policy_version 20551 (0.0012)
[2023-02-25 13:14:27,186][2408954] Fps is (10 sec: 24575.6, 60 sec: 25190.3, 300 sec: 25214.7). Total num frames: 84201472. Throughput: 0: 6276.8. Samples: 21051960. Policy #0 lag: (min: 1.0, avg: 13.0, max: 27.0)
[2023-02-25 13:14:27,186][2408954] Avg episode reward: [(0, '10.518')]
[2023-02-25 13:14:27,328][2409079] DAMAGECOUNT value on done: 6109.0
[2023-02-25 13:14:27,329][2409079] Sum rewards: 10.355, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.511', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO3': '0.040', 'weapon7': '0.084', 'AMMO4': '0.087', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.208', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'HITCOUNT': '0.680', 'weapon4': '0.922', 'weapon3': '0.996', 'weapon2': '1.566', 'DAMAGECOUNT': '3.267', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:14:27,363][2409080] DAMAGECOUNT value on done: 7476.0
[2023-02-25 13:14:27,366][2409080] Sum rewards: 10.196, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.374', 'AMMO5': '0.011', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.083', 'weapon7': '0.094', 'AMMO4': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.208', 'weapon5': '0.248', 'WEAPON5': '0.300', 'ARMOR': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.780', 'weapon2': '1.294', 'weapon3': '1.384', 'DAMAGECOUNT': '3.129', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:14:27,611][2409074] Updated weights for policy 0, policy_version 20561 (0.0012)
[2023-02-25 13:14:27,832][2409547] DAMAGECOUNT value on done: 5247.0
[2023-02-25 13:14:27,833][2409547] Sum rewards: 13.068, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.539', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO4': '0.065', 'weapon4': '0.074', 'AMMO3': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.178', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '0.720', 'weapon2': '1.498', 'weapon3': '1.734', 'DAMAGECOUNT': '3.042', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:14:28,286][2409096] DAMAGECOUNT value on done: 5690.0
[2023-02-25 13:14:28,287][2409096] Sum rewards: -1.616, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.736', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.030', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'weapon4': '0.088', 'AMMO3': '0.169', 'weapon5': '0.230', 'HITCOUNT': '0.610', 'WEAPON5': '0.650', 'WEAPON3': '1.050', 'weapon2': '1.298', 'ARMOR': '1.657', 'FRAGCOUNT': '2.000', 'weapon3': '2.048', 'DAMAGECOUNT': '2.940'}
[2023-02-25 13:14:29,153][2409486] DAMAGECOUNT value on done: 5250.0
[2023-02-25 13:14:29,156][2409486] Sum rewards: 6.463, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.195', 'AMMO5': '0.017', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'AMMO3': '0.074', 'AMMO4': '0.109', 'weapon5': '0.178', 'weapon4': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '0.900', 'weapon2': '1.230', 'weapon3': '1.580', 'DAMAGECOUNT': '2.913', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:14:29,170][2409074] Updated weights for policy 0, policy_version 20571 (0.0012)
[2023-02-25 13:14:29,431][2409099] DAMAGECOUNT value on done: 6434.0
[2023-02-25 13:14:29,434][2409099] Sum rewards: 10.813, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.890', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.073', 'AMMO4': '0.124', 'weapon7': '0.126', 'weapon5': '0.160', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.650', 'weapon4': '1.062', 'weapon3': '1.062', 'weapon2': '1.144', 'DAMAGECOUNT': '3.507', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:14:29,782][2409076] DAMAGECOUNT value on done: 5890.0
[2023-02-25 13:14:29,783][2409076] Sum rewards: 12.996, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.056', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon7': '0.068', 'AMMO3': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'weapon5': '0.176', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'weapon4': '0.682', 'HITCOUNT': '0.780', 'ARMOR': '0.853', 'weapon2': '1.246', 'weapon3': '1.500', 'DAMAGECOUNT': '3.597', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:14:30,023][2409355] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:14:31,094][2409074] Updated weights for policy 0, policy_version 20581 (0.0013)
[2023-02-25 13:14:31,443][2409096] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:14:31,536][2409079] DAMAGECOUNT value on done: 7455.0
[2023-02-25 13:14:31,539][2409079] Sum rewards: 7.834, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.011', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.055', 'weapon4': '0.100', 'AMMO3': '0.115', 'weapon5': '0.222', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'HITCOUNT': '0.590', 'HEALTH': '0.628', 'ARMOR': '0.904', 'weapon2': '1.274', 'weapon3': '2.128', 'DAMAGECOUNT': '2.622', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:14:31,637][2409080] DAMAGECOUNT value on done: 5119.0
[2023-02-25 13:14:31,642][2409080] Sum rewards: 14.706, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.145', 'AMMO5': '0.010', 'AMMO2': '0.019', 'ARMOR': '0.040', 'weapon5': '0.058', 'AMMO3': '0.070', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.524', 'WEAPON3': '0.550', 'weapon2': '0.890', 'HITCOUNT': '0.980', 'weapon3': '1.722', 'DAMAGECOUNT': '3.795', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:14:31,722][2409547] DAMAGECOUNT value on done: 6161.0
[2023-02-25 13:14:31,723][2409547] Sum rewards: 11.089, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.664', 'AMMO2': '0.010', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'AMMO3': '0.093', 'weapon4': '0.228', 'weapon5': '0.324', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.690', 'weapon2': '1.020', 'weapon3': '1.694', 'DAMAGECOUNT': '3.294', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:14:31,986][2409074] Updated weights for policy 0, policy_version 20591 (0.0015)
[2023-02-25 13:14:31,995][2409096] DAMAGECOUNT value on done: 5284.0
[2023-02-25 13:14:31,999][2409096] Sum rewards: 12.361, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.176', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.010', 'AMMO3': '0.050', 'weapon7': '0.086', 'WEAPON4': '0.100', 'weapon5': '0.116', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.396', 'WEAPON3': '0.450', 'HITCOUNT': '0.900', 'ARMOR': '0.935', 'weapon3': '1.212', 'weapon2': '1.592', 'DAMAGECOUNT': '3.249', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:14:32,186][2408954] Fps is (10 sec: 26215.3, 60 sec: 25326.9, 300 sec: 25256.4). Total num frames: 84340736. Throughput: 0: 6288.3. Samples: 21089928. Policy #0 lag: (min: 1.0, avg: 13.0, max: 27.0)
[2023-02-25 13:14:32,186][2408954] Avg episode reward: [(0, '10.482')]
[2023-02-25 13:14:32,895][2409486] DAMAGECOUNT value on done: 6036.0
[2023-02-25 13:14:32,900][2409486] Sum rewards: 10.298, reward structure: {'DEATHCOUNT': '-5.250', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.029', 'ARMOR': '0.036', 'weapon5': '0.066', 'AMMO3': '0.074', 'weapon7': '0.102', 'AMMO4': '0.144', 'HEALTH': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.640', 'weapon2': '0.650', 'weapon4': '0.786', 'weapon3': '1.554', 'DAMAGECOUNT': '2.742', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:14:33,234][2409099] DAMAGECOUNT value on done: 6516.0
[2023-02-25 13:14:33,236][2409099] Sum rewards: 8.976, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.027', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'weapon7': '0.060', 'AMMO4': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.104', 'WEAPON4': '0.150', 'weapon4': '0.384', 'WEAPON3': '0.400', 'ARMOR': '0.454', 'HITCOUNT': '0.570', 'weapon3': '1.044', 'weapon2': '1.360', 'DAMAGECOUNT': '2.211', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:14:34,183][2409074] Updated weights for policy 0, policy_version 20601 (0.0012)
[2023-02-25 13:14:35,352][2409074] Updated weights for policy 0, policy_version 20611 (0.0012)
[2023-02-25 13:14:35,539][2409547] DAMAGECOUNT value on done: 5750.0
[2023-02-25 13:14:35,540][2409547] Sum rewards: 12.111, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.714', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'weapon7': '0.122', 'weapon5': '0.162', 'AMMO6': '0.280', 'AMMO7': '0.280', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'weapon4': '0.444', 'HITCOUNT': '0.570', 'WEAPON3': '0.650', 'ARMOR': '0.884', 'weapon2': '1.274', 'weapon3': '1.322', 'DAMAGECOUNT': '3.132', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:14:35,552][2409080] DAMAGECOUNT value on done: 6095.0
[2023-02-25 13:14:35,573][2409080] Sum rewards: 6.002, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.246', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO3': '0.104', 'weapon5': '0.110', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.900', 'weapon3': '1.638', 'weapon2': '1.650', 'DAMAGECOUNT': '3.063', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:14:35,755][2409096] DAMAGECOUNT value on done: 6069.0
[2023-02-25 13:14:35,756][2409096] Sum rewards: 11.671, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO2': '0.033', 'weapon4': '0.054', 'weapon7': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.108', 'AMMO3': '0.113', 'AMMO4': '0.166', 'HEALTH': '0.168', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.710', 'ARMOR': '1.230', 'weapon3': '1.542', 'weapon2': '1.952', 'DAMAGECOUNT': '3.237', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:14:36,503][2409079] DAMAGECOUNT value on done: 6722.0
[2023-02-25 13:14:36,506][2409079] Sum rewards: 14.261, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.980', 'AMMO2': '0.027', 'AMMO5': '0.030', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'weapon5': '0.288', 'WEAPON5': '0.650', 'weapon4': '0.686', 'WEAPON3': '0.700', 'HITCOUNT': '0.750', 'ARMOR': '0.800', 'weapon2': '1.316', 'weapon3': '1.340', 'DAMAGECOUNT': '4.611', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:14:36,574][2409486] DAMAGECOUNT value on done: 6601.0
[2023-02-25 13:14:36,579][2409486] Sum rewards: 18.060, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.539', 'AMMO2': '0.005', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.027', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.164', 'weapon5': '0.264', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '1.100', 'weapon3': '1.518', 'weapon2': '1.674', 'DAMAGECOUNT': '5.340', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:14:37,103][2409099] DAMAGECOUNT value on done: 5889.0
[2023-02-25 13:14:37,107][2409099] Sum rewards: 5.635, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.464', 'AMMO2': '0.012', 'AMMO5': '0.015', 'AMMO4': '0.059', 'weapon7': '0.066', 'weapon5': '0.088', 'AMMO3': '0.089', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.330', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.770', 'weapon2': '1.428', 'weapon3': '1.514', 'DAMAGECOUNT': '2.328', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:14:37,186][2408954] Fps is (10 sec: 24985.8, 60 sec: 24917.3, 300 sec: 25214.7). Total num frames: 84451328. Throughput: 0: 6301.6. Samples: 21109116. Policy #0 lag: (min: 0.0, avg: 10.9, max: 25.0)
[2023-02-25 13:14:37,186][2408954] Avg episode reward: [(0, '10.585')]
[2023-02-25 13:14:37,473][2409596] Large shaping reward 5.652 for [('FRAGCOUNT', 5.0, 5.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:14:37,673][2409074] Updated weights for policy 0, policy_version 20621 (0.0012)
[2023-02-25 13:14:39,021][2409074] Updated weights for policy 0, policy_version 20631 (0.0013)
[2023-02-25 13:14:39,576][2409096] DAMAGECOUNT value on done: 6189.0
[2023-02-25 13:14:39,578][2409096] Sum rewards: 15.678, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.086', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.030', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon4': '0.184', 'weapon5': '0.190', 'WEAPON5': '0.350', 'WEAPON3': '0.350', 'HITCOUNT': '0.630', 'weapon3': '1.196', 'weapon2': '1.570', 'DAMAGECOUNT': '3.342', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:14:39,888][2409547] DAMAGECOUNT value on done: 5723.0
[2023-02-25 13:14:39,891][2409547] Sum rewards: 3.600, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.545', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO3': '0.022', 'weapon7': '0.048', 'weapon2': '0.080', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.200', 'HITCOUNT': '0.280', 'weapon3': '0.412', 'weapon4': '0.884', 'DAMAGECOUNT': '1.179', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:14:39,942][2409080] DAMAGECOUNT value on done: 4511.0
[2023-02-25 13:14:39,946][2409080] Sum rewards: 5.474, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.860', 'AMMO5': '0.012', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'weapon4': '0.066', 'AMMO4': '0.100', 'AMMO3': '0.114', 'WEAPON4': '0.150', 'weapon5': '0.216', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'HITCOUNT': '0.740', 'weapon2': '1.464', 'weapon3': '1.918', 'DAMAGECOUNT': '3.003', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:14:40,142][2409079] DAMAGECOUNT value on done: 4928.0
[2023-02-25 13:14:40,143][2409079] Sum rewards: 10.896, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.697', 'AMMO5': '0.017', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.072', 'AMMO3': '0.095', 'AMMO4': '0.099', 'weapon5': '0.138', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'ARMOR': '0.881', 'HITCOUNT': '1.020', 'weapon2': '1.268', 'weapon3': '2.118', 'DAMAGECOUNT': '3.675', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:14:40,713][2409074] Updated weights for policy 0, policy_version 20641 (0.0012)
[2023-02-25 13:14:40,741][2409486] DAMAGECOUNT value on done: 6981.0
[2023-02-25 13:14:40,743][2409486] Sum rewards: 9.049, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.910', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.008', 'AMMO3': '0.030', 'weapon5': '0.054', 'WEAPON5': '0.100', 'weapon7': '0.124', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.300', 'WEAPON7': '0.300', 'ARMOR': '0.456', 'HITCOUNT': '0.700', 'weapon3': '0.708', 'weapon2': '0.802', 'weapon4': '1.488', 'DAMAGECOUNT': '3.294', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:14:41,129][2409099] DAMAGECOUNT value on done: 5781.0
[2023-02-25 13:14:41,133][2409099] Sum rewards: 7.137, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.780', 'AMMO2': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.046', 'AMMO4': '0.057', 'AMMO3': '0.067', 'weapon7': '0.126', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'ARMOR': '0.448', 'WEAPON3': '0.450', 'HITCOUNT': '0.520', 'weapon2': '0.708', 'weapon3': '1.038', 'weapon4': '1.214', 'DAMAGECOUNT': '2.256', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:14:42,057][2409074] Updated weights for policy 0, policy_version 20651 (0.0013)
[2023-02-25 13:14:42,186][2408954] Fps is (10 sec: 24985.4, 60 sec: 25395.2, 300 sec: 25270.2). Total num frames: 84590592. Throughput: 0: 6299.5. Samples: 21146904. Policy #0 lag: (min: 0.0, avg: 10.9, max: 25.0)
[2023-02-25 13:14:42,186][2408954] Avg episode reward: [(0, '10.582')]
[2023-02-25 13:14:43,563][2409074] Updated weights for policy 0, policy_version 20661 (0.0012)
[2023-02-25 13:14:43,829][2409547] DAMAGECOUNT value on done: 6437.0
[2023-02-25 13:14:43,833][2409547] Sum rewards: 6.423, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.704', 'AMMO2': '0.017', 'AMMO5': '0.024', 'WEAPON1': '0.060', 'AMMO4': '0.084', 'AMMO3': '0.112', 'WEAPON4': '0.150', 'weapon5': '0.178', 'weapon4': '0.254', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'HITCOUNT': '0.900', 'ARMOR': '1.295', 'weapon2': '1.518', 'weapon3': '1.758', 'DAMAGECOUNT': '3.426', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:14:44,011][2409080] DAMAGECOUNT value on done: 5949.0
[2023-02-25 13:14:44,016][2409080] Sum rewards: 13.763, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.430', 'AMMO2': '0.006', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.030', 'AMMO3': '0.070', 'weapon5': '0.230', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.810', 'ARMOR': '0.855', 'weapon3': '1.508', 'weapon2': '1.832', 'DAMAGECOUNT': '3.519', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:14:44,984][2409099] DAMAGECOUNT value on done: 6426.0
[2023-02-25 13:14:44,985][2409099] Sum rewards: 13.908, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.988', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO4': '0.055', 'weapon7': '0.062', 'AMMO3': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.214', 'WEAPON4': '0.250', 'ARMOR': '0.441', 'WEAPON5': '0.600', 'weapon4': '0.648', 'HITCOUNT': '0.700', 'WEAPON3': '0.750', 'weapon3': '1.308', 'weapon2': '1.454', 'DAMAGECOUNT': '4.458', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:14:45,672][2409074] Updated weights for policy 0, policy_version 20671 (0.0013)
[2023-02-25 13:14:46,648][2409468] DAMAGECOUNT value on done: 6514.0
[2023-02-25 13:14:46,653][2409468] Sum rewards: 3.615, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.448', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'AMMO3': '0.040', 'WEAPON5': '0.150', 'weapon5': '0.152', 'weapon7': '0.172', 'AMMO4': '0.189', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.460', 'WEAPON4': '0.550', 'weapon2': '0.806', 'weapon3': '1.040', 'weapon4': '1.294', 'DAMAGECOUNT': '1.707', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:14:46,980][2409074] Updated weights for policy 0, policy_version 20681 (0.0013)
[2023-02-25 13:14:47,186][2408954] Fps is (10 sec: 26623.9, 60 sec: 25258.7, 300 sec: 25256.3). Total num frames: 84717568. Throughput: 0: 6317.6. Samples: 21185100. Policy #0 lag: (min: 0.0, avg: 10.9, max: 25.0)
[2023-02-25 13:14:47,186][2408954] Avg episode reward: [(0, '10.361')]
[2023-02-25 13:14:48,190][2409547] DAMAGECOUNT value on done: 7235.0
[2023-02-25 13:14:48,194][2409547] Sum rewards: 11.508, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.316', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'AMMO4': '0.133', 'weapon5': '0.208', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'HITCOUNT': '0.770', 'ARMOR': '0.854', 'weapon3': '1.486', 'weapon2': '1.696', 'DAMAGECOUNT': '3.297', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:14:48,419][2409080] DAMAGECOUNT value on done: 7062.0
[2023-02-25 13:14:48,421][2409080] Sum rewards: 13.621, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.578', 'AMMO2': '0.008', 'AMMO5': '0.012', 'AMMO4': '0.039', 'AMMO3': '0.086', 'weapon5': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'weapon4': '0.478', 'WEAPON3': '0.600', 'weapon2': '1.130', 'HITCOUNT': '1.140', 'weapon3': '1.690', 'DAMAGECOUNT': '4.848', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:14:48,643][2409074] Updated weights for policy 0, policy_version 20691 (0.0012)
[2023-02-25 13:14:48,673][2409099] DAMAGECOUNT value on done: 6621.0
[2023-02-25 13:14:48,677][2409099] Sum rewards: 11.265, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.134', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO5': '0.028', 'AMMO3': '0.092', 'weapon5': '0.166', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '0.860', 'weapon2': '1.248', 'weapon3': '1.956', 'DAMAGECOUNT': '3.519', 'FRAGCOUNT': '8.500'}
[2023-02-25 13:14:50,180][2409074] Updated weights for policy 0, policy_version 20701 (0.0012)
[2023-02-25 13:14:50,941][2409468] DAMAGECOUNT value on done: 5363.0
[2023-02-25 13:14:50,942][2409468] Sum rewards: 6.136, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO3': '0.038', 'AMMO2': '0.040', 'weapon5': '0.060', 'weapon7': '0.098', 'AMMO4': '0.200', 'WEAPON3': '0.200', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon3': '0.442', 'weapon2': '0.546', 'HITCOUNT': '0.650', 'HEALTH': '0.756', 'ARMOR': '0.800', 'FRAGCOUNT': '1.500', 'weapon4': '1.754', 'DAMAGECOUNT': '2.532'}
[2023-02-25 13:14:51,553][2409407] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)]
[2023-02-25 13:14:52,044][2409074] Updated weights for policy 0, policy_version 20711 (0.0012)
[2023-02-25 13:14:52,079][2409547] DAMAGECOUNT value on done: 6460.0
[2023-02-25 13:14:52,080][2409547] Sum rewards: 15.255, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.379', 'AMMO2': '0.013', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'AMMO4': '0.062', 'WEAPON4': '0.150', 'weapon5': '0.198', 'weapon4': '0.270', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'ARMOR': '0.400', 'HITCOUNT': '0.640', 'weapon3': '1.278', 'weapon2': '1.346', 'DAMAGECOUNT': '3.639', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:14:52,186][2408954] Fps is (10 sec: 24166.5, 60 sec: 25122.2, 300 sec: 25186.9). Total num frames: 84832256. Throughput: 0: 6324.6. Samples: 21204408. Policy #0 lag: (min: 0.0, avg: 13.2, max: 25.0)
[2023-02-25 13:14:52,186][2408954] Avg episode reward: [(0, '10.287')]
[2023-02-25 13:14:52,532][2409099] DAMAGECOUNT value on done: 6911.0
[2023-02-25 13:14:52,537][2409099] Sum rewards: 3.912, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.710', 'WEAPON1': '0.020', 'AMMO5': '0.027', 'AMMO2': '0.032', 'AMMO3': '0.118', 'weapon4': '0.136', 'weapon5': '0.148', 'AMMO4': '0.157', 'WEAPON4': '0.400', 'ARMOR': '0.455', 'WEAPON5': '0.600', 'HITCOUNT': '0.730', 'WEAPON3': '0.800', 'weapon2': '1.116', 'weapon3': '1.840', 'DAMAGECOUNT': '2.793', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:14:52,744][2409080] DAMAGECOUNT value on done: 5357.0
[2023-02-25 13:14:52,747][2409080] Sum rewards: 10.826, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.276', 'AMMO2': '0.008', 'AMMO5': '0.012', 'AMMO4': '0.038', 'WEAPON1': '0.040', 'AMMO3': '0.078', 'weapon7': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.182', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'weapon4': '0.814', 'weapon2': '1.238', 'weapon3': '1.308', 'DAMAGECOUNT': '3.222', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:14:53,338][2409074] Updated weights for policy 0, policy_version 20721 (0.0012)
[2023-02-25 13:14:54,980][2409074] Updated weights for policy 0, policy_version 20731 (0.0012)
[2023-02-25 13:14:55,252][2409468] DAMAGECOUNT value on done: 6781.0
[2023-02-25 13:14:55,255][2409468] Sum rewards: 6.368, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.108', 'AMMO2': '0.018', 'AMMO5': '0.018', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.088', 'weapon5': '0.276', 'weapon4': '0.276', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '0.520', 'ARMOR': '0.800', 'weapon3': '1.180', 'weapon2': '1.820', 'DAMAGECOUNT': '2.619', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:14:55,746][2409547] DAMAGECOUNT value on done: 5388.0
[2023-02-25 13:14:55,747][2409547] Sum rewards: 8.291, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.015', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO3': '0.050', 'AMMO4': '0.065', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.170', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.430', 'ARMOR': '0.457', 'weapon3': '0.832', 'weapon4': '0.856', 'weapon2': '1.914', 'DAMAGECOUNT': '2.043', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:14:56,399][2409099] DAMAGECOUNT value on done: 5632.0
[2023-02-25 13:14:56,400][2409099] Sum rewards: 5.908, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.222', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'weapon5': '0.056', 'AMMO3': '0.062', 'WEAPON4': '0.100', 'weapon7': '0.134', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'WEAPON3': '0.400', 'ARMOR': '0.450', 'HITCOUNT': '0.540', 'weapon4': '0.700', 'weapon2': '0.828', 'weapon3': '1.078', 'DAMAGECOUNT': '2.199', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:14:56,759][2409074] Updated weights for policy 0, policy_version 20741 (0.0013)
[2023-02-25 13:14:56,806][2409080] DAMAGECOUNT value on done: 6534.0
[2023-02-25 13:14:56,807][2409080] Sum rewards: 15.390, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.135', 'AMMO5': '0.016', 'AMMO2': '0.017', 'AMMO3': '0.054', 'weapon7': '0.054', 'AMMO4': '0.082', 'WEAPON4': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon5': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '0.650', 'weapon4': '0.790', 'weapon2': '0.990', 'weapon3': '1.192', 'DAMAGECOUNT': '3.810', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:14:57,114][2409105] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)]
[2023-02-25 13:14:57,186][2408954] Fps is (10 sec: 25394.9, 60 sec: 25463.4, 300 sec: 25270.2). Total num frames: 84971520. Throughput: 0: 6330.4. Samples: 21242256. Policy #0 lag: (min: 0.0, avg: 13.2, max: 25.0)
[2023-02-25 13:14:57,186][2408954] Avg episode reward: [(0, '10.127')]
[2023-02-25 13:14:58,058][2409075] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:14:58,259][2409033] Signal inference workers to stop experience collection... (2500 times)
[2023-02-25 13:14:58,259][2409033] Signal inference workers to resume experience collection... (2500 times)
[2023-02-25 13:14:58,295][2409074] InferenceWorker_p0-w0: stopping experience collection (2500 times)
[2023-02-25 13:14:58,296][2409074] InferenceWorker_p0-w0: resuming experience collection (2500 times)
[2023-02-25 13:14:58,332][2409074] Updated weights for policy 0, policy_version 20751 (0.0012)
[2023-02-25 13:14:59,342][2409468] DAMAGECOUNT value on done: 5025.0
[2023-02-25 13:14:59,343][2409468] Sum rewards: 6.490, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.174', 'AMMO5': '0.013', 'AMMO2': '0.026', 'AMMO3': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.100', 'AMMO4': '0.128', 'weapon7': '0.134', 'WEAPON4': '0.150', 'weapon5': '0.196', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.470', 'WEAPON3': '0.550', 'weapon2': '1.144', 'weapon3': '1.920', 'DAMAGECOUNT': '1.992', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:14:59,694][2409547] DAMAGECOUNT value on done: 6910.0
[2023-02-25 13:14:59,697][2409547] Sum rewards: 2.627, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.620', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'AMMO3': '0.010', 'WEAPON1': '0.020', 'weapon5': '0.048', 'HITCOUNT': '0.050', 'weapon7': '0.080', 'WEAPON4': '0.100', 'WEAPON3': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon3': '0.250', 'weapon2': '0.350', 'weapon4': '0.410', 'DAMAGECOUNT': '0.798', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:14:59,891][2409074] Updated weights for policy 0, policy_version 20761 (0.0013)
[2023-02-25 13:15:00,155][2409099] DAMAGECOUNT value on done: 6216.0
[2023-02-25 13:15:00,156][2409099] Sum rewards: 11.118, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.268', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'WEAPON1': '0.020', 'AMMO5': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.096', 'weapon4': '0.100', 'weapon5': '0.266', 'ARMOR': '0.458', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '1.020', 'weapon3': '1.418', 'weapon2': '1.922', 'DAMAGECOUNT': '3.579', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:15:00,913][2409080] DAMAGECOUNT value on done: 5768.0
[2023-02-25 13:15:00,916][2409080] Sum rewards: 8.695, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.553', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.047', 'AMMO3': '0.075', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.110', 'weapon5': '0.114', 'weapon7': '0.126', 'WEAPON5': '0.200', 'ARMOR': '0.450', 'WEAPON3': '0.500', 'HITCOUNT': '0.580', 'weapon3': '1.238', 'weapon2': '1.696', 'DAMAGECOUNT': '2.427', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:15:01,674][2409074] Updated weights for policy 0, policy_version 20771 (0.0012)
[2023-02-25 13:15:02,186][2408954] Fps is (10 sec: 26214.5, 60 sec: 25326.9, 300 sec: 25256.4). Total num frames: 85094400. Throughput: 0: 6332.0. Samples: 21280080. Policy #0 lag: (min: 0.0, avg: 11.0, max: 25.0)
[2023-02-25 13:15:02,186][2408954] Avg episode reward: [(0, '9.951')]
[2023-02-25 13:15:03,095][2409074] Updated weights for policy 0, policy_version 20781 (0.0012)
[2023-02-25 13:15:03,421][2409547] DAMAGECOUNT value on done: 5336.0
[2023-02-25 13:15:03,421][2409547] Sum rewards: 6.098, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.594', 'AMMO2': '0.015', 'AMMO5': '0.020', 'AMMO3': '0.052', 'AMMO4': '0.074', 'weapon7': '0.156', 'weapon5': '0.194', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'WEAPON3': '0.300', 'HITCOUNT': '0.360', 'WEAPON5': '0.400', 'weapon4': '0.574', 'ARMOR': '0.957', 'weapon3': '1.050', 'weapon2': '1.182', 'DAMAGECOUNT': '2.118', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:15:03,861][2409099] DAMAGECOUNT value on done: 5960.0
[2023-02-25 13:15:03,864][2409099] Sum rewards: 9.333, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.610', 'AMMO5': '0.003', 'AMMO2': '0.022', 'AMMO3': '0.040', 'weapon5': '0.072', 'weapon7': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'WEAPON4': '0.250', 'WEAPON3': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'weapon4': '0.644', 'HITCOUNT': '0.720', 'weapon3': '0.958', 'weapon2': '1.698', 'DAMAGECOUNT': '2.652', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:15:04,412][2409468] DAMAGECOUNT value on done: 7786.0
[2023-02-25 13:15:04,415][2409468] Sum rewards: 18.241, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.664', 'AMMO2': '0.008', 'AMMO5': '0.012', 'AMMO4': '0.039', 'AMMO3': '0.091', 'WEAPON4': '0.200', 'weapon4': '0.254', 'weapon5': '0.290', 'WEAPON5': '0.350', 'ARMOR': '0.452', 'WEAPON3': '0.600', 'HITCOUNT': '0.950', 'weapon3': '1.236', 'weapon2': '1.674', 'DAMAGECOUNT': '4.749', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:15:04,954][2409074] Updated weights for policy 0, policy_version 20791 (0.0012)
[2023-02-25 13:15:05,779][2409080] DAMAGECOUNT value on done: 6962.0
[2023-02-25 13:15:05,783][2409080] Sum rewards: 8.208, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.672', 'weapon4': '0.012', 'AMMO5': '0.019', 'AMMO2': '0.026', 'weapon7': '0.058', 'AMMO3': '0.071', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.132', 'weapon5': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.850', 'ARMOR': '0.851', 'weapon2': '1.548', 'weapon3': '1.724', 'DAMAGECOUNT': '3.519', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:15:06,321][2409074] Updated weights for policy 0, policy_version 20801 (0.0012)
[2023-02-25 13:15:07,186][2408954] Fps is (10 sec: 24986.2, 60 sec: 25531.8, 300 sec: 25242.5). Total num frames: 85221376. Throughput: 0: 6331.0. Samples: 21299220. Policy #0 lag: (min: 0.0, avg: 11.0, max: 25.0)
[2023-02-25 13:15:07,186][2408954] Avg episode reward: [(0, '9.901')]
[2023-02-25 13:15:07,512][2409547] DAMAGECOUNT value on done: 7050.0
[2023-02-25 13:15:07,513][2409547] Sum rewards: 7.170, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.832', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.082', 'WEAPON5': '0.200', 'weapon5': '0.230', 'WEAPON3': '0.600', 'ARMOR': '0.850', 'HITCOUNT': '1.060', 'weapon2': '1.556', 'weapon3': '2.000', 'FRAGCOUNT': '4.000', 'DAMAGECOUNT': '4.149'}
[2023-02-25 13:15:07,821][2409099] DAMAGECOUNT value on done: 7561.0
[2023-02-25 13:15:07,822][2409099] Sum rewards: 14.774, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.284', 'AMMO2': '0.022', 'AMMO5': '0.022', 'weapon7': '0.050', 'AMMO3': '0.107', 'AMMO4': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.152', 'WEAPON7': '0.200', 'weapon4': '0.222', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'ARMOR': '0.820', 'HITCOUNT': '1.030', 'weapon2': '1.166', 'weapon3': '1.660', 'DAMAGECOUNT': '4.506', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:15:07,833][2409074] Updated weights for policy 0, policy_version 20811 (0.0012)
[2023-02-25 13:15:08,421][2409468] DAMAGECOUNT value on done: 5044.0
[2023-02-25 13:15:08,423][2409468] Sum rewards: 4.763, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.250', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO5': '0.017', 'weapon7': '0.072', 'AMMO4': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.129', 'weapon5': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.496', 'HITCOUNT': '0.630', 'WEAPON3': '0.800', 'weapon2': '1.288', 'ARMOR': '1.304', 'weapon3': '1.564', 'DAMAGECOUNT': '2.520', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:15:09,689][2409074] Updated weights for policy 0, policy_version 20821 (0.0013)
[2023-02-25 13:15:10,122][2409080] DAMAGECOUNT value on done: 7025.0
[2023-02-25 13:15:10,123][2409080] Sum rewards: 8.812, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.213', 'AMMO2': '0.002', 'AMMO4': '0.010', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'weapon4': '0.056', 'weapon7': '0.074', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.278', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'HITCOUNT': '0.580', 'weapon3': '1.012', 'ARMOR': '1.256', 'weapon2': '2.244', 'DAMAGECOUNT': '3.660', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:15:11,425][2409074] Updated weights for policy 0, policy_version 20831 (0.0012)
[2023-02-25 13:15:11,840][2409547] DAMAGECOUNT value on done: 5370.0
[2023-02-25 13:15:11,841][2409547] Sum rewards: 5.829, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.994', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.008', 'weapon4': '0.030', 'AMMO3': '0.048', 'WEAPON4': '0.050', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.148', 'WEAPON5': '0.200', 'HITCOUNT': '0.230', 'WEAPON3': '0.400', 'weapon3': '0.772', 'DAMAGECOUNT': '1.164', 'ARMOR': '1.309', 'weapon2': '2.848', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:15:12,186][2408954] Fps is (10 sec: 24575.9, 60 sec: 25122.1, 300 sec: 25256.4). Total num frames: 85340160. Throughput: 0: 6334.7. Samples: 21337020. Policy #0 lag: (min: 0.0, avg: 11.0, max: 25.0)
[2023-02-25 13:15:12,186][2408954] Avg episode reward: [(0, '9.808')]
[2023-02-25 13:15:12,579][2409468] DAMAGECOUNT value on done: 6382.0
[2023-02-25 13:15:12,583][2409468] Sum rewards: 8.964, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.756', 'AMMO2': '0.003', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.017', 'AMMO3': '0.051', 'weapon7': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.124', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.510', 'weapon4': '0.892', 'weapon2': '0.958', 'weapon3': '1.212', 'DAMAGECOUNT': '2.238', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:15:13,174][2409074] Updated weights for policy 0, policy_version 20841 (0.0012)
[2023-02-25 13:15:14,097][2409080] DAMAGECOUNT value on done: 6193.0
[2023-02-25 13:15:14,101][2409080] Sum rewards: 6.163, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.088', 'AMMO2': '0.020', 'AMMO5': '0.023', 'weapon5': '0.096', 'AMMO4': '0.101', 'AMMO3': '0.139', 'WEAPON4': '0.200', 'weapon4': '0.378', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'ARMOR': '0.800', 'HITCOUNT': '0.930', 'weapon2': '1.026', 'weapon3': '1.814', 'DAMAGECOUNT': '3.024', 'FRAGCOUNT': '6.500'}
[2023-02-25 13:15:14,207][2409074] Updated weights for policy 0, policy_version 20851 (0.0013)
[2023-02-25 13:15:16,113][2409547] DAMAGECOUNT value on done: 5721.0
[2023-02-25 13:15:16,114][2409547] Sum rewards: 6.672, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.716', 'AMMO2': '0.011', 'AMMO5': '0.014', 'WEAPON1': '0.040', 'AMMO4': '0.055', 'weapon5': '0.086', 'AMMO3': '0.088', 'weapon7': '0.138', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.450', 'ARMOR': '0.492', 'weapon2': '0.530', 'WEAPON3': '0.600', 'weapon4': '1.246', 'weapon3': '1.252', 'DAMAGECOUNT': '1.845', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:15:16,329][2409074] Updated weights for policy 0, policy_version 20861 (0.0012)
[2023-02-25 13:15:16,640][2409468] DAMAGECOUNT value on done: 8046.0
[2023-02-25 13:15:16,641][2409468] Sum rewards: 18.602, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.095', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'AMMO5': '0.012', 'weapon4': '0.024', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon5': '0.208', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'HITCOUNT': '0.920', 'weapon3': '1.356', 'weapon2': '1.686', 'DAMAGECOUNT': '5.475', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:15:16,845][2409373] Large shaping reward 3.652 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:15:17,186][2408954] Fps is (10 sec: 25804.7, 60 sec: 25395.2, 300 sec: 25298.0). Total num frames: 85479424. Throughput: 0: 6346.4. Samples: 21375516. Policy #0 lag: (min: 0.0, avg: 10.9, max: 24.0)
[2023-02-25 13:15:17,186][2408954] Avg episode reward: [(0, '9.951')]
[2023-02-25 13:15:17,497][2409074] Updated weights for policy 0, policy_version 20871 (0.0013)
[2023-02-25 13:15:18,078][2409080] DAMAGECOUNT value on done: 5453.0
[2023-02-25 13:15:18,079][2409080] Sum rewards: 7.531, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.256', 'AMMO2': '0.019', 'AMMO5': '0.027', 'weapon7': '0.058', 'AMMO3': '0.092', 'AMMO4': '0.094', 'weapon4': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.156', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.620', 'WEAPON3': '0.650', 'WEAPON5': '0.650', 'weapon3': '1.460', 'weapon2': '2.006', 'DAMAGECOUNT': '2.655', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:15:19,524][2409074] Updated weights for policy 0, policy_version 20881 (0.0012)
[2023-02-25 13:15:20,576][2409468] DAMAGECOUNT value on done: 7304.0
[2023-02-25 13:15:20,577][2409468] Sum rewards: 7.223, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.010', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.015', 'weapon4': '0.044', 'AMMO4': '0.055', 'AMMO3': '0.108', 'weapon5': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'HITCOUNT': '0.880', 'weapon2': '1.534', 'weapon3': '1.726', 'DAMAGECOUNT': '3.732', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:15:20,815][2409074] Updated weights for policy 0, policy_version 20891 (0.0014)
[2023-02-25 13:15:21,936][2409080] DAMAGECOUNT value on done: 6936.0
[2023-02-25 13:15:21,940][2409080] Sum rewards: 13.255, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.404', 'AMMO5': '0.012', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'weapon7': '0.056', 'AMMO3': '0.079', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'weapon5': '0.212', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'weapon4': '0.514', 'HITCOUNT': '0.680', 'weapon2': '1.186', 'weapon3': '1.594', 'DAMAGECOUNT': '3.882', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:15:22,186][2408954] Fps is (10 sec: 26623.4, 60 sec: 25463.5, 300 sec: 25242.4). Total num frames: 85606400. Throughput: 0: 6336.8. Samples: 21394272. Policy #0 lag: (min: 0.0, avg: 10.9, max: 24.0)
[2023-02-25 13:15:22,187][2408954] Avg episode reward: [(0, '9.943')]
[2023-02-25 13:15:22,201][2409074] Updated weights for policy 0, policy_version 20901 (0.0012)
[2023-02-25 13:15:24,587][2409074] Updated weights for policy 0, policy_version 20911 (0.0012)
[2023-02-25 13:15:24,595][2409468] DAMAGECOUNT value on done: 6083.0
[2023-02-25 13:15:24,598][2409468] Sum rewards: 3.904, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.165', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO4': '0.041', 'weapon7': '0.046', 'AMMO3': '0.057', 'weapon5': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.290', 'weapon3': '0.586', 'weapon2': '0.862', 'weapon4': '1.166', 'DAMAGECOUNT': '1.530', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:15:25,315][2409074] Updated weights for policy 0, policy_version 20921 (0.0012)
[2023-02-25 13:15:26,003][2409080] DAMAGECOUNT value on done: 6168.0
[2023-02-25 13:15:26,007][2409080] Sum rewards: 11.022, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.190', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon7': '0.018', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'AMMO3': '0.110', 'weapon5': '0.118', 'WEAPON5': '0.150', 'weapon4': '0.198', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON3': '0.700', 'HITCOUNT': '0.880', 'weapon2': '1.306', 'weapon3': '1.812', 'DAMAGECOUNT': '3.492', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:15:26,403][2409565] Large shaping reward 2.514 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.492, 164.0), ('weapon5', 0.002)]
[2023-02-25 13:15:27,186][2408954] Fps is (10 sec: 24165.9, 60 sec: 25326.9, 300 sec: 25242.5). Total num frames: 85721088. Throughput: 0: 6341.6. Samples: 21432276. Policy #0 lag: (min: 0.0, avg: 10.9, max: 24.0)
[2023-02-25 13:15:27,186][2408954] Avg episode reward: [(0, '9.827')]
[2023-02-25 13:15:27,644][2409074] Updated weights for policy 0, policy_version 20931 (0.0012)
[2023-02-25 13:15:28,564][2409468] DAMAGECOUNT value on done: 5969.0
[2023-02-25 13:15:28,567][2409468] Sum rewards: 5.127, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.668', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.039', 'weapon5': '0.078', 'weapon7': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.132', 'AMMO4': '0.195', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.590', 'HITCOUNT': '0.670', 'WEAPON3': '0.800', 'weapon2': '1.110', 'weapon3': '1.638', 'DAMAGECOUNT': '2.280', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:15:28,951][2409074] Updated weights for policy 0, policy_version 20941 (0.0013)
[2023-02-25 13:15:30,082][2409080] DAMAGECOUNT value on done: 6065.0
[2023-02-25 13:15:30,082][2409080] Sum rewards: 17.139, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.950', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.020', 'AMMO4': '0.083', 'AMMO3': '0.099', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'ARMOR': '0.448', 'WEAPON4': '0.500', 'WEAPON3': '0.750', 'weapon4': '0.842', 'HITCOUNT': '1.150', 'weapon2': '1.442', 'weapon3': '1.484', 'DAMAGECOUNT': '4.350', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:15:30,687][2409074] Updated weights for policy 0, policy_version 20951 (0.0012)
[2023-02-25 13:15:32,186][2408954] Fps is (10 sec: 24167.1, 60 sec: 25122.1, 300 sec: 25242.5). Total num frames: 85848064. Throughput: 0: 6344.8. Samples: 21470616. Policy #0 lag: (min: 0.0, avg: 13.5, max: 25.0)
[2023-02-25 13:15:32,186][2408954] Avg episode reward: [(0, '9.891')]
[2023-02-25 13:15:32,318][2409074] Updated weights for policy 0, policy_version 20961 (0.0013)
[2023-02-25 13:15:32,681][2409468] DAMAGECOUNT value on done: 5635.0
[2023-02-25 13:15:32,682][2409468] Sum rewards: 8.166, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.483', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.036', 'AMMO3': '0.083', 'weapon4': '0.088', 'WEAPON4': '0.100', 'WEAPON3': '0.450', 'HITCOUNT': '0.640', 'ARMOR': '0.800', 'weapon3': '1.462', 'weapon2': '1.482', 'DAMAGECOUNT': '1.998', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:15:33,650][2409074] Updated weights for policy 0, policy_version 20971 (0.0014)
[2023-02-25 13:15:34,157][2409080] DAMAGECOUNT value on done: 5747.0
[2023-02-25 13:15:34,158][2409080] Sum rewards: 9.838, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.864', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'AMMO5': '0.025', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.107', 'weapon5': '0.162', 'WEAPON4': '0.250', 'weapon4': '0.418', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'HITCOUNT': '0.800', 'ARMOR': '0.853', 'weapon2': '1.026', 'weapon3': '1.870', 'DAMAGECOUNT': '3.840', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:15:35,757][2409074] Updated weights for policy 0, policy_version 20981 (0.0013)
[2023-02-25 13:15:36,648][2409074] Updated weights for policy 0, policy_version 20991 (0.0013)
[2023-02-25 13:15:36,759][2409468] DAMAGECOUNT value on done: 8386.0
[2023-02-25 13:15:36,763][2409468] Sum rewards: 25.768, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.747', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.015', 'weapon4': '0.038', 'WEAPON4': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.095', 'weapon5': '0.226', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'ARMOR': '0.855', 'HITCOUNT': '1.230', 'weapon2': '1.526', 'weapon3': '1.848', 'DAMAGECOUNT': '7.149', 'FRAGCOUNT': '19.000'}
[2023-02-25 13:15:37,186][2408954] Fps is (10 sec: 27034.5, 60 sec: 25668.3, 300 sec: 25311.9). Total num frames: 85991424. Throughput: 0: 6333.9. Samples: 21489432. Policy #0 lag: (min: 0.0, avg: 13.5, max: 25.0)
[2023-02-25 13:15:37,186][2408954] Avg episode reward: [(0, '9.981')]
[2023-02-25 13:15:38,047][2409080] DAMAGECOUNT value on done: 6660.0
[2023-02-25 13:15:38,050][2409080] Sum rewards: 14.528, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.141', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.012', 'AMMO3': '0.030', 'weapon7': '0.060', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'weapon5': '0.282', 'weapon4': '0.546', 'HITCOUNT': '0.600', 'weapon3': '0.724', 'weapon2': '1.098', 'ARMOR': '1.750', 'DAMAGECOUNT': '3.822', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:15:38,721][2409074] Updated weights for policy 0, policy_version 21001 (0.0012)
[2023-02-25 13:15:40,331][2409074] Updated weights for policy 0, policy_version 21011 (0.0012)
[2023-02-25 13:15:40,953][2409468] DAMAGECOUNT value on done: 5775.0
[2023-02-25 13:15:40,957][2409468] Sum rewards: 8.841, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.716', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'weapon4': '0.072', 'AMMO3': '0.089', 'AMMO4': '0.188', 'WEAPON4': '0.200', 'weapon5': '0.242', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.600', 'weapon2': '1.590', 'weapon3': '1.714', 'DAMAGECOUNT': '2.640', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:15:41,855][2409074] Updated weights for policy 0, policy_version 21021 (0.0012)
[2023-02-25 13:15:42,186][2408954] Fps is (10 sec: 25804.3, 60 sec: 25258.6, 300 sec: 25214.7). Total num frames: 86106112. Throughput: 0: 6338.7. Samples: 21527496. Policy #0 lag: (min: 0.0, avg: 13.5, max: 25.0)
[2023-02-25 13:15:42,186][2408954] Avg episode reward: [(0, '9.943')]
[2023-02-25 13:15:42,222][2409080] DAMAGECOUNT value on done: 7107.0
[2023-02-25 13:15:42,227][2409080] Sum rewards: 10.640, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.015', 'AMMO2': '0.023', 'AMMO3': '0.060', 'AMMO4': '0.112', 'weapon7': '0.134', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'HEALTH': '0.233', 'weapon5': '0.244', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.442', 'ARMOR': '0.497', 'HITCOUNT': '0.610', 'weapon3': '1.188', 'weapon4': '1.434', 'DAMAGECOUNT': '2.997', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:15:44,067][2409074] Updated weights for policy 0, policy_version 21031 (0.0012)
[2023-02-25 13:15:44,769][2409468] DAMAGECOUNT value on done: 5093.0
[2023-02-25 13:15:44,770][2409468] Sum rewards: 5.935, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.526', 'AMMO5': '0.017', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'AMMO4': '0.116', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'weapon4': '0.204', 'weapon5': '0.296', 'WEAPON5': '0.400', 'HITCOUNT': '0.640', 'WEAPON3': '0.700', 'weapon2': '1.144', 'weapon3': '1.946', 'DAMAGECOUNT': '2.667', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:15:44,962][2409074] Updated weights for policy 0, policy_version 21041 (0.0018)
[2023-02-25 13:15:46,126][2409080] DAMAGECOUNT value on done: 6327.0
[2023-02-25 13:15:46,130][2409080] Sum rewards: 4.213, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.177', 'AMMO2': '0.011', 'AMMO5': '0.020', 'AMMO3': '0.055', 'AMMO4': '0.055', 'weapon5': '0.164', 'weapon7': '0.186', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'HITCOUNT': '0.340', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'weapon3': '0.686', 'weapon2': '0.876', 'DAMAGECOUNT': '1.188', 'weapon4': '1.368', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:15:46,951][2409074] Updated weights for policy 0, policy_version 21051 (0.0012)
[2023-02-25 13:15:47,186][2408954] Fps is (10 sec: 23347.1, 60 sec: 25122.2, 300 sec: 25242.5). Total num frames: 86224896. Throughput: 0: 6337.1. Samples: 21565248. Policy #0 lag: (min: 0.0, avg: 15.2, max: 30.0)
[2023-02-25 13:15:47,186][2408954] Avg episode reward: [(0, '9.798')]
[2023-02-25 13:15:47,539][2409565] Large shaping reward -2.506 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0)]
[2023-02-25 13:15:48,205][2409033] Signal inference workers to stop experience collection... (2550 times)
[2023-02-25 13:15:48,228][2409033] Signal inference workers to resume experience collection... (2550 times)
[2023-02-25 13:15:48,249][2409074] InferenceWorker_p0-w0: stopping experience collection (2550 times)
[2023-02-25 13:15:48,261][2409074] InferenceWorker_p0-w0: resuming experience collection (2550 times)
[2023-02-25 13:15:48,291][2409074] Updated weights for policy 0, policy_version 21061 (0.0012)
[2023-02-25 13:15:49,044][2409468] DAMAGECOUNT value on done: 7227.0
[2023-02-25 13:15:49,045][2409468] Sum rewards: 13.449, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.122', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon7': '0.080', 'AMMO4': '0.094', 'AMMO3': '0.095', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.176', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.462', 'WEAPON3': '0.650', 'HITCOUNT': '0.700', 'weapon2': '1.324', 'weapon3': '1.528', 'ARMOR': '1.763', 'DAMAGECOUNT': '2.730', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:15:49,887][2409074] Updated weights for policy 0, policy_version 21071 (0.0012)
[2023-02-25 13:15:50,199][2409080] DAMAGECOUNT value on done: 5970.0
[2023-02-25 13:15:50,202][2409080] Sum rewards: 10.898, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.336', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon4': '0.032', 'AMMO3': '0.080', 'weapon7': '0.084', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.234', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'HITCOUNT': '0.510', 'ARMOR': '0.844', 'weapon3': '1.540', 'weapon2': '1.882', 'DAMAGECOUNT': '2.763', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:15:51,017][2409100] DAMAGECOUNT value on done: 6608.0
[2023-02-25 13:15:51,018][2409100] Sum rewards: 5.247, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.676', 'AMMO5': '0.030', 'AMMO2': '0.031', 'AMMO3': '0.105', 'AMMO4': '0.155', 'WEAPON4': '0.250', 'weapon5': '0.250', 'weapon4': '0.344', 'HITCOUNT': '0.460', 'WEAPON5': '0.600', 'WEAPON3': '0.650', 'weapon2': '1.006', 'ARMOR': '1.360', 'weapon3': '1.986', 'DAMAGECOUNT': '2.196', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:15:51,834][2409105] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:15:51,986][2409074] Updated weights for policy 0, policy_version 21081 (0.0015)
[2023-02-25 13:15:52,186][2408954] Fps is (10 sec: 25394.9, 60 sec: 25463.4, 300 sec: 25228.6). Total num frames: 86360064. Throughput: 0: 6323.2. Samples: 21583764. Policy #0 lag: (min: 0.0, avg: 15.2, max: 30.0)
[2023-02-25 13:15:52,186][2408954] Avg episode reward: [(0, '9.769')]
[2023-02-25 13:15:52,968][2409468] DAMAGECOUNT value on done: 6851.0
[2023-02-25 13:15:52,973][2409468] Sum rewards: 6.831, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.418', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO4': '0.073', 'weapon4': '0.086', 'AMMO3': '0.100', 'WEAPON4': '0.250', 'weapon5': '0.264', 'WEAPON5': '0.650', 'HITCOUNT': '0.670', 'WEAPON3': '0.700', 'weapon2': '1.296', 'ARMOR': '1.314', 'weapon3': '1.974', 'DAMAGECOUNT': '3.561', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:15:53,469][2409074] Updated weights for policy 0, policy_version 21091 (0.0013)
[2023-02-25 13:15:54,259][2409080] DAMAGECOUNT value on done: 6459.0
[2023-02-25 13:15:54,262][2409080] Sum rewards: 14.269, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.596', 'AMMO5': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.094', 'AMMO4': '0.122', 'WEAPON4': '0.200', 'weapon5': '0.256', 'weapon4': '0.342', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'HITCOUNT': '0.960', 'weapon3': '1.418', 'weapon2': '1.596', 'DAMAGECOUNT': '4.533', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:15:54,684][2409100] DAMAGECOUNT value on done: 6552.0
[2023-02-25 13:15:54,686][2409100] Sum rewards: 8.533, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.105', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.014', 'AMMO3': '0.060', 'weapon7': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.108', 'WEAPON5': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.350', 'ARMOR': '0.400', 'DAMAGECOUNT': '1.389', 'weapon3': '1.554', 'weapon2': '1.810', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:15:55,505][2409074] Updated weights for policy 0, policy_version 21101 (0.0012)
[2023-02-25 13:15:55,565][2409103] DAMAGECOUNT value on done: 5710.0
[2023-02-25 13:15:55,566][2409103] Sum rewards: 10.655, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.734', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO3': '0.083', 'weapon7': '0.088', 'AMMO4': '0.135', 'weapon5': '0.160', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'AMMO6': '0.360', 'AMMO7': '0.360', 'WEAPON7': '0.400', 'ARMOR': '0.452', 'HITCOUNT': '0.520', 'WEAPON3': '0.550', 'weapon4': '0.580', 'weapon2': '1.198', 'weapon3': '1.418', 'DAMAGECOUNT': '3.195', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:15:56,671][2409074] Updated weights for policy 0, policy_version 21111 (0.0012)
[2023-02-25 13:15:57,186][2408954] Fps is (10 sec: 25804.1, 60 sec: 25190.4, 300 sec: 25200.8). Total num frames: 86482944. Throughput: 0: 6302.6. Samples: 21620640. Policy #0 lag: (min: 0.0, avg: 15.2, max: 30.0)
[2023-02-25 13:15:57,186][2408954] Avg episode reward: [(0, '9.625')]
[2023-02-25 13:15:57,230][2409468] DAMAGECOUNT value on done: 6524.0
[2023-02-25 13:15:57,233][2409468] Sum rewards: 8.419, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.725', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'AMMO3': '0.077', 'weapon7': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.150', 'AMMO4': '0.163', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.330', 'WEAPON5': '0.500', 'HITCOUNT': '0.530', 'WEAPON3': '0.600', 'weapon2': '1.282', 'weapon3': '1.442', 'DAMAGECOUNT': '2.175', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:15:58,456][2409549] DAMAGECOUNT value on done: 6700.0
[2023-02-25 13:15:58,457][2409549] Sum rewards: 8.872, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.654', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO4': '0.084', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'weapon5': '0.240', 'weapon4': '0.268', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.660', 'weapon2': '0.698', 'weapon3': '1.768', 'DAMAGECOUNT': '3.057', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:15:58,493][2409080] DAMAGECOUNT value on done: 7396.0
[2023-02-25 13:15:58,497][2409080] Sum rewards: 7.264, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.416', 'AMMO5': '0.017', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'weapon4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'AMMO4': '0.123', 'weapon5': '0.236', 'WEAPON5': '0.450', 'HITCOUNT': '0.680', 'WEAPON3': '0.700', 'weapon3': '1.538', 'weapon2': '1.842', 'DAMAGECOUNT': '2.766', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:15:58,583][2409074] Updated weights for policy 0, policy_version 21121 (0.0012)
[2023-02-25 13:15:58,806][2409100] DAMAGECOUNT value on done: 6089.0
[2023-02-25 13:15:58,809][2409100] Sum rewards: 10.463, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.650', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO4': '0.032', 'weapon4': '0.074', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'weapon5': '0.312', 'ARMOR': '0.439', 'WEAPON5': '0.700', 'WEAPON3': '0.800', 'HITCOUNT': '0.880', 'weapon2': '1.564', 'weapon3': '1.726', 'DAMAGECOUNT': '4.095', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:15:59,599][2409103] DAMAGECOUNT value on done: 8600.0
[2023-02-25 13:15:59,604][2409103] Sum rewards: 13.167, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'AMMO3': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'weapon5': '0.234', 'HEALTH': '0.266', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'weapon4': '0.428', 'HITCOUNT': '0.810', 'weapon2': '1.038', 'weapon3': '1.228', 'DAMAGECOUNT': '3.759', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:16:00,118][2409074] Updated weights for policy 0, policy_version 21131 (0.0012)
[2023-02-25 13:16:01,270][2409468] DAMAGECOUNT value on done: 6726.0
[2023-02-25 13:16:01,274][2409468] Sum rewards: 12.740, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.334', 'AMMO5': '0.017', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.084', 'AMMO4': '0.097', 'weapon5': '0.228', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'HITCOUNT': '0.500', 'WEAPON3': '0.650', 'weapon4': '0.968', 'weapon2': '1.062', 'ARMOR': '1.328', 'weapon3': '1.422', 'DAMAGECOUNT': '3.078', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:16:01,595][2409074] Updated weights for policy 0, policy_version 21141 (0.0012)
[2023-02-25 13:16:02,186][2408954] Fps is (10 sec: 24576.6, 60 sec: 25190.4, 300 sec: 25214.7). Total num frames: 86605824. Throughput: 0: 6256.5. Samples: 21657060. Policy #0 lag: (min: 1.0, avg: 10.6, max: 25.0)
[2023-02-25 13:16:02,186][2408954] Avg episode reward: [(0, '9.712')]
[2023-02-25 13:16:02,421][2409549] DAMAGECOUNT value on done: 8038.0
[2023-02-25 13:16:02,424][2409549] Sum rewards: 10.700, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.854', 'AMMO5': '0.017', 'AMMO2': '0.019', 'weapon7': '0.048', 'AMMO3': '0.092', 'AMMO4': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.160', 'WEAPON5': '0.400', 'ARMOR': '0.415', 'WEAPON3': '0.600', 'HITCOUNT': '0.740', 'weapon2': '0.910', 'weapon4': '1.032', 'weapon3': '1.200', 'DAMAGECOUNT': '4.128', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:16:02,423][2409080] DAMAGECOUNT value on done: 5429.0
[2023-02-25 13:16:02,427][2409080] Sum rewards: 5.392, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.889', 'AMMO5': '0.012', 'AMMO2': '0.016', 'weapon7': '0.048', 'weapon5': '0.072', 'AMMO4': '0.077', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.524', 'WEAPON3': '0.700', 'HITCOUNT': '0.730', 'ARMOR': '0.905', 'weapon3': '1.378', 'weapon2': '1.462', 'DAMAGECOUNT': '2.064', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:16:02,585][2409100] DAMAGECOUNT value on done: 6816.0
[2023-02-25 13:16:02,586][2409100] Sum rewards: 6.033, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.300', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'AMMO3': '0.076', 'weapon5': '0.092', 'AMMO4': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.420', 'WEAPON3': '0.650', 'HITCOUNT': '0.910', 'weapon2': '1.490', 'weapon3': '1.514', 'DAMAGECOUNT': '3.285', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:16:03,765][2409074] Updated weights for policy 0, policy_version 21151 (0.0012)
[2023-02-25 13:16:04,686][2409103] DAMAGECOUNT value on done: 5597.0
[2023-02-25 13:16:04,688][2409103] Sum rewards: 6.649, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.310', 'AMMO2': '0.006', 'AMMO5': '0.014', 'AMMO4': '0.029', 'weapon5': '0.060', 'AMMO3': '0.068', 'weapon7': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.482', 'ARMOR': '0.501', 'WEAPON3': '0.550', 'HITCOUNT': '0.690', 'weapon3': '1.040', 'weapon2': '1.650', 'DAMAGECOUNT': '3.105', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:16:05,201][2409074] Updated weights for policy 0, policy_version 21161 (0.0013)
[2023-02-25 13:16:05,570][2409468] DAMAGECOUNT value on done: 5919.0
[2023-02-25 13:16:05,574][2409468] Sum rewards: 10.232, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.495', 'AMMO2': '0.002', 'AMMO4': '0.008', 'WEAPON1': '0.010', 'weapon7': '0.012', 'AMMO5': '0.022', 'weapon4': '0.074', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.254', 'ARMOR': '0.400', 'WEAPON5': '0.600', 'HITCOUNT': '0.620', 'WEAPON3': '0.750', 'weapon2': '1.288', 'weapon3': '2.026', 'DAMAGECOUNT': '3.114', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:16:05,904][2409547] Large shaping reward 2.511 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.489, 163.0), ('weapon5', 0.002)]
[2023-02-25 13:16:06,139][2409549] DAMAGECOUNT value on done: 6593.0
[2023-02-25 13:16:06,140][2409549] Sum rewards: 8.281, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.519', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.100', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.460', 'WEAPON3': '0.650', 'HITCOUNT': '1.050', 'weapon3': '1.232', 'weapon2': '1.504', 'ARMOR': '1.768', 'DAMAGECOUNT': '3.696', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:16:06,507][2409100] DAMAGECOUNT value on done: 7121.0
[2023-02-25 13:16:06,511][2409100] Sum rewards: 17.886, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.216', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'AMMO3': '0.050', 'weapon7': '0.052', 'AMMO4': '0.106', 'weapon5': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.300', 'ARMOR': '0.492', 'HITCOUNT': '0.760', 'weapon4': '1.022', 'weapon3': '1.028', 'weapon2': '1.330', 'DAMAGECOUNT': '3.477', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:16:07,162][2409074] Updated weights for policy 0, policy_version 21171 (0.0012)
[2023-02-25 13:16:07,186][2408954] Fps is (10 sec: 23347.3, 60 sec: 24917.2, 300 sec: 25173.0). Total num frames: 86716416. Throughput: 0: 6242.7. Samples: 21675192. Policy #0 lag: (min: 1.0, avg: 10.6, max: 25.0)
[2023-02-25 13:16:07,186][2408954] Avg episode reward: [(0, '9.673')]
[2023-02-25 13:16:08,433][2409074] Updated weights for policy 0, policy_version 21181 (0.0012)
[2023-02-25 13:16:08,920][2409103] DAMAGECOUNT value on done: 6304.0
[2023-02-25 13:16:08,923][2409103] Sum rewards: 13.587, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.194', 'AMMO5': '0.016', 'AMMO2': '0.018', 'weapon7': '0.064', 'AMMO3': '0.085', 'AMMO4': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.112', 'weapon4': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'ARMOR': '0.851', 'HITCOUNT': '0.990', 'weapon3': '1.172', 'weapon2': '1.372', 'DAMAGECOUNT': '4.569', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:16:10,044][2409549] DAMAGECOUNT value on done: 7250.0
[2023-02-25 13:16:10,045][2409549] Sum rewards: 17.304, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.534', 'AMMO5': '0.018', 'AMMO2': '0.024', 'weapon7': '0.048', 'AMMO3': '0.083', 'AMMO4': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.192', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon2': '0.852', 'ARMOR': '0.853', 'HITCOUNT': '0.930', 'weapon4': '1.048', 'weapon3': '1.426', 'DAMAGECOUNT': '5.307', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:16:10,117][2409074] Updated weights for policy 0, policy_version 21191 (0.0012)
[2023-02-25 13:16:10,262][2409100] DAMAGECOUNT value on done: 6008.0
[2023-02-25 13:16:10,263][2409100] Sum rewards: 7.141, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.190', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO2': '0.033', 'weapon7': '0.082', 'AMMO3': '0.085', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.124', 'AMMO4': '0.166', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.890', 'weapon4': '0.896', 'weapon2': '1.156', 'weapon3': '1.262', 'DAMAGECOUNT': '2.796', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:16:10,650][2409468] DAMAGECOUNT value on done: 6394.0
[2023-02-25 13:16:10,650][2409468] Sum rewards: 9.638, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.635', 'AMMO2': '0.018', 'AMMO5': '0.020', 'AMMO4': '0.087', 'AMMO3': '0.110', 'weapon4': '0.146', 'WEAPON4': '0.150', 'weapon5': '0.180', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.840', 'ARMOR': '1.200', 'weapon2': '1.404', 'weapon3': '1.696', 'DAMAGECOUNT': '3.822', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:16:12,186][2408954] Fps is (10 sec: 23346.6, 60 sec: 24985.5, 300 sec: 25103.6). Total num frames: 86839296. Throughput: 0: 6224.5. Samples: 21712380. Policy #0 lag: (min: 1.0, avg: 10.6, max: 25.0)
[2023-02-25 13:16:12,186][2408954] Avg episode reward: [(0, '9.757')]
[2023-02-25 13:16:12,195][2409074] Updated weights for policy 0, policy_version 21201 (0.0012)
[2023-02-25 13:16:12,243][2409101] DAMAGECOUNT value on done: 5711.0
[2023-02-25 13:16:12,244][2409101] Sum rewards: 8.872, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.845', 'AMMO2': '0.003', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.014', 'WEAPON4': '0.050', 'AMMO3': '0.096', 'weapon5': '0.142', 'weapon4': '0.236', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.660', 'weapon3': '1.378', 'weapon2': '1.428', 'DAMAGECOUNT': '2.643', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:16:12,495][2409103] DAMAGECOUNT value on done: 6249.0
[2023-02-25 13:16:12,496][2409103] Sum rewards: 12.525, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'AMMO2': '0.023', 'AMMO3': '0.040', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.113', 'weapon7': '0.130', 'HEALTH': '0.182', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.250', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.700', 'weapon3': '0.770', 'weapon4': '0.814', 'weapon2': '1.410', 'DAMAGECOUNT': '3.156', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:16:12,919][2409102] DAMAGECOUNT value on done: 7569.0
[2023-02-25 13:16:12,923][2409102] Sum rewards: 5.107, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.551', 'AMMO2': '0.010', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.048', 'weapon7': '0.048', 'AMMO3': '0.065', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.192', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.620', 'weapon4': '0.860', 'weapon2': '1.122', 'weapon3': '1.216', 'DAMAGECOUNT': '2.337', 'FRAGCOUNT': '2.500'}
[2023-02-25 13:16:13,460][2409074] Updated weights for policy 0, policy_version 21211 (0.0013)
[2023-02-25 13:16:13,954][2409104] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:16:14,265][2409565] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 13:16:14,456][2409549] DAMAGECOUNT value on done: 8301.0
[2023-02-25 13:16:14,457][2409549] Sum rewards: 19.381, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.522', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.047', 'AMMO3': '0.062', 'weapon7': '0.112', 'weapon5': '0.196', 'AMMO6': '0.220', 'AMMO7': '0.220', 'AMMO4': '0.234', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'WEAPON4': '0.550', 'weapon2': '0.754', 'HITCOUNT': '0.980', 'weapon4': '1.236', 'weapon3': '1.454', 'DAMAGECOUNT': '4.860', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:16:14,501][2409100] DAMAGECOUNT value on done: 6996.0
[2023-02-25 13:16:14,503][2409100] Sum rewards: 9.114, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.417', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO3': '0.056', 'weapon5': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.134', 'weapon7': '0.170', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'weapon4': '0.564', 'HITCOUNT': '0.610', 'weapon3': '1.082', 'ARMOR': '1.341', 'weapon2': '1.744', 'DAMAGECOUNT': '2.541', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:16:14,720][2409468] DAMAGECOUNT value on done: 6209.0
[2023-02-25 13:16:14,721][2409468] Sum rewards: 9.435, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.493', 'AMMO2': '0.017', 'AMMO5': '0.019', 'AMMO4': '0.086', 'AMMO3': '0.092', 'weapon7': '0.130', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.232', 'WEAPON7': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.590', 'weapon4': '0.690', 'weapon2': '0.940', 'ARMOR': '1.369', 'weapon3': '1.628', 'DAMAGECOUNT': '3.294', 'FRAGCOUNT': '6.500'}
[2023-02-25 13:16:15,623][2409074] Updated weights for policy 0, policy_version 21221 (0.0013)
[2023-02-25 13:16:16,420][2409101] DAMAGECOUNT value on done: 7875.0
[2023-02-25 13:16:16,421][2409101] Sum rewards: 17.599, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.040', 'AMMO2': '0.012', 'AMMO5': '0.013', 'AMMO4': '0.062', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.178', 'weapon5': '0.240', 'WEAPON5': '0.450', 'ARMOR': '0.460', 'WEAPON3': '0.700', 'HITCOUNT': '1.060', 'weapon2': '1.292', 'weapon3': '1.940', 'DAMAGECOUNT': '4.791', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:16:16,468][2409103] DAMAGECOUNT value on done: 6444.0
[2023-02-25 13:16:16,469][2409103] Sum rewards: 16.376, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.372', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.028', 'AMMO3': '0.067', 'weapon7': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.137', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon5': '0.334', 'WEAPON3': '0.400', 'WEAPON5': '0.450', 'ARMOR': '0.454', 'HITCOUNT': '0.900', 'weapon4': '0.942', 'weapon2': '1.042', 'weapon3': '1.102', 'DAMAGECOUNT': '4.032', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:16:16,599][2409102] DAMAGECOUNT value on done: 6802.0
[2023-02-25 13:16:16,603][2409102] Sum rewards: 7.931, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.474', 'AMMO2': '0.008', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.038', 'weapon7': '0.052', 'AMMO3': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.112', 'weapon5': '0.148', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'HITCOUNT': '0.810', 'weapon2': '1.242', 'weapon3': '1.622', 'DAMAGECOUNT': '2.991', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:16:16,907][2409074] Updated weights for policy 0, policy_version 21231 (0.0012)
[2023-02-25 13:16:17,186][2408954] Fps is (10 sec: 24576.5, 60 sec: 24712.5, 300 sec: 25117.5). Total num frames: 86962176. Throughput: 0: 6177.1. Samples: 21748584. Policy #0 lag: (min: 1.0, avg: 13.0, max: 25.0)
[2023-02-25 13:16:17,186][2408954] Avg episode reward: [(0, '10.105')]
[2023-02-25 13:16:17,191][2409033] Saving /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000021231_86962176.pth...
[2023-02-25 13:16:17,287][2409033] Removing /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000019760_80936960.pth
[2023-02-25 13:16:18,186][2409549] DAMAGECOUNT value on done: 8207.0
[2023-02-25 13:16:18,187][2409549] Sum rewards: 14.475, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.008', 'AMMO2': '0.005', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.025', 'weapon7': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.272', 'WEAPON5': '0.500', 'weapon4': '0.632', 'WEAPON3': '0.750', 'ARMOR': '0.806', 'HITCOUNT': '0.990', 'weapon2': '1.104', 'weapon3': '1.612', 'DAMAGECOUNT': '5.028', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:16:18,503][2409468] DAMAGECOUNT value on done: 5996.0
[2023-02-25 13:16:18,506][2409468] Sum rewards: 7.176, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.250', 'AMMO2': '0.004', 'AMMO5': '0.015', 'AMMO4': '0.022', 'weapon4': '0.072', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'weapon5': '0.120', 'WEAPON5': '0.200', 'HITCOUNT': '0.540', 'WEAPON3': '0.600', 'ARMOR': '0.924', 'weapon3': '1.398', 'weapon2': '2.166', 'DAMAGECOUNT': '2.169', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:16:18,537][2409100] DAMAGECOUNT value on done: 6959.0
[2023-02-25 13:16:18,538][2409100] Sum rewards: 9.876, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.062', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.030', 'AMMO3': '0.097', 'AMMO4': '0.151', 'weapon5': '0.186', 'weapon4': '0.202', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '1.050', 'weapon2': '1.570', 'weapon3': '1.764', 'DAMAGECOUNT': '3.996', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:16:18,864][2409074] Updated weights for policy 0, policy_version 21241 (0.0014)
[2023-02-25 13:16:20,082][2409074] Updated weights for policy 0, policy_version 21251 (0.0012)
[2023-02-25 13:16:20,232][2409101] DAMAGECOUNT value on done: 7891.0
[2023-02-25 13:16:20,235][2409101] Sum rewards: 4.695, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.576', 'AMMO5': '0.017', 'AMMO2': '0.033', 'AMMO3': '0.065', 'weapon5': '0.072', 'weapon7': '0.160', 'AMMO4': '0.165', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'ARMOR': '0.453', 'HITCOUNT': '0.470', 'weapon4': '0.600', 'weapon2': '0.690', 'weapon3': '1.420', 'DAMAGECOUNT': '2.175', 'FRAGCOUNT': '2.500'}
[2023-02-25 13:16:20,411][2409102] DAMAGECOUNT value on done: 7909.0
[2023-02-25 13:16:20,412][2409102] Sum rewards: 9.033, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.026', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO5': '0.017', 'weapon5': '0.026', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'weapon7': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.530', 'WEAPON3': '0.600', 'ARMOR': '0.853', 'weapon3': '1.304', 'weapon2': '2.118', 'DAMAGECOUNT': '2.172', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:16:20,445][2409406] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:16:20,505][2409405] Large shaping reward 2.575 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.543, 181.0), ('weapon7', 0.002)]
[2023-02-25 13:16:20,525][2409103] DAMAGECOUNT value on done: 6253.0
[2023-02-25 13:16:20,526][2409103] Sum rewards: 8.720, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '0.003', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO3': '0.071', 'AMMO4': '0.084', 'weapon5': '0.142', 'weapon4': '0.238', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.900', 'weapon2': '1.204', 'weapon3': '1.694', 'DAMAGECOUNT': '3.342', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:16:20,762][2409485] DAMAGECOUNT value on done: 6598.0
[2023-02-25 13:16:20,763][2409485] Sum rewards: 15.487, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.010', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'HEALTH': '0.049', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'weapon7': '0.052', 'AMMO3': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.206', 'weapon4': '0.222', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'HITCOUNT': '0.540', 'ARMOR': '0.868', 'weapon2': '1.054', 'weapon3': '1.342', 'DAMAGECOUNT': '2.703', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:16:21,643][2409103] Large shaping reward 2.560 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.54, 180.0)]
[2023-02-25 13:16:21,652][2409074] Updated weights for policy 0, policy_version 21261 (0.0012)
[2023-02-25 13:16:21,953][2409549] DAMAGECOUNT value on done: 7388.0
[2023-02-25 13:16:21,957][2409549] Sum rewards: 19.986, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.055', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.070', 'AMMO3': '0.080', 'weapon7': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'WEAPON3': '0.550', 'ARMOR': '0.891', 'HITCOUNT': '1.090', 'weapon2': '1.296', 'weapon3': '1.874', 'DAMAGECOUNT': '4.896', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:16:22,186][2408954] Fps is (10 sec: 25396.0, 60 sec: 24780.9, 300 sec: 25159.2). Total num frames: 87093248. Throughput: 0: 6177.6. Samples: 21767424. Policy #0 lag: (min: 1.0, avg: 13.0, max: 25.0)
[2023-02-25 13:16:22,186][2408954] Avg episode reward: [(0, '10.109')]
[2023-02-25 13:16:22,533][2409468] DAMAGECOUNT value on done: 6607.0
[2023-02-25 13:16:22,533][2409468] Sum rewards: 7.229, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.440', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.041', 'AMMO3': '0.049', 'WEAPON5': '0.100', 'weapon7': '0.106', 'weapon5': '0.112', 'WEAPON4': '0.200', 'WEAPON3': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'HITCOUNT': '0.350', 'WEAPON7': '0.400', 'weapon3': '0.808', 'weapon2': '0.972', 'weapon4': '1.188', 'DAMAGECOUNT': '1.929', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:16:22,779][2409100] DAMAGECOUNT value on done: 7630.0
[2023-02-25 13:16:22,780][2409100] Sum rewards: 10.097, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.004', 'AMMO5': '0.015', 'weapon7': '0.020', 'AMMO4': '0.022', 'WEAPON1': '0.030', 'HEALTH': '0.036', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'weapon4': '0.288', 'weapon5': '0.298', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.790', 'weapon2': '1.152', 'ARMOR': '1.348', 'weapon3': '1.868', 'DAMAGECOUNT': '3.063', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:16:23,502][2409547] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:16:23,730][2409074] Updated weights for policy 0, policy_version 21271 (0.0012)
[2023-02-25 13:16:23,867][2409101] DAMAGECOUNT value on done: 6741.0
[2023-02-25 13:16:23,882][2409101] Sum rewards: 6.343, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'AMMO2': '0.025', 'AMMO3': '0.036', 'WEAPON5': '0.100', 'weapon5': '0.120', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'weapon7': '0.164', 'WEAPON3': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'HEALTH': '0.296', 'weapon2': '0.382', 'HITCOUNT': '0.430', 'ARMOR': '0.454', 'weapon3': '0.576', 'weapon4': '0.902', 'DAMAGECOUNT': '1.530', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:16:24,057][2409102] DAMAGECOUNT value on done: 7640.0
[2023-02-25 13:16:24,058][2409102] Sum rewards: 10.802, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.374', 'AMMO2': '0.005', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.024', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'weapon5': '0.304', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon4': '0.668', 'HITCOUNT': '0.670', 'weapon2': '0.948', 'weapon3': '1.714', 'ARMOR': '1.802', 'DAMAGECOUNT': '3.525', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:16:24,383][2409103] DAMAGECOUNT value on done: 7061.0
[2023-02-25 13:16:24,384][2409103] Sum rewards: 13.197, reward structure: {'DEATHCOUNT': '-7.500', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon7': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.104', 'AMMO4': '0.115', 'AMMO3': '0.119', 'weapon4': '0.244', 'WEAPON5': '0.250', 'HEALTH': '0.396', 'WEAPON3': '0.650', 'HITCOUNT': '0.830', 'weapon2': '1.370', 'weapon3': '1.698', 'DAMAGECOUNT': '3.417', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:16:24,527][2409485] DAMAGECOUNT value on done: 8168.0
[2023-02-25 13:16:24,528][2409485] Sum rewards: 19.509, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.222', 'AMMO2': '0.003', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.014', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'weapon5': '0.138', 'weapon4': '0.220', 'WEAPON5': '0.250', 'WEAPON3': '0.650', 'weapon2': '1.112', 'HITCOUNT': '1.210', 'weapon3': '1.956', 'DAMAGECOUNT': '4.467', 'FRAGCOUNT': '15.500'}
[2023-02-25 13:16:25,209][2409074] Updated weights for policy 0, policy_version 21281 (0.0014)
[2023-02-25 13:16:25,484][2409373] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 13:16:25,869][2409549] DAMAGECOUNT value on done: 6443.0
[2023-02-25 13:16:25,872][2409549] Sum rewards: 6.878, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.400', 'AMMO2': '0.019', 'AMMO5': '0.026', 'weapon7': '0.046', 'WEAPON1': '0.060', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.137', 'WEAPON7': '0.200', 'weapon4': '0.216', 'weapon5': '0.260', 'ARMOR': '0.454', 'WEAPON5': '0.600', 'HITCOUNT': '0.710', 'weapon2': '0.784', 'WEAPON3': '1.000', 'weapon3': '2.056', 'DAMAGECOUNT': '2.526', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:16:26,932][2409074] Updated weights for policy 0, policy_version 21291 (0.0012)
[2023-02-25 13:16:27,051][2409548] DAMAGECOUNT value on done: 6963.0
[2023-02-25 13:16:27,054][2409548] Sum rewards: 12.780, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.700', 'AMMO5': '0.025', 'AMMO2': '0.027', 'AMMO3': '0.087', 'AMMO4': '0.134', 'weapon5': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'ARMOR': '0.453', 'WEAPON3': '0.600', 'weapon4': '0.640', 'HITCOUNT': '0.980', 'weapon2': '1.096', 'weapon3': '1.548', 'DAMAGECOUNT': '5.160', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:16:27,098][2409100] DAMAGECOUNT value on done: 6456.0
[2023-02-25 13:16:27,101][2409100] Sum rewards: 16.710, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.449', 'AMMO2': '0.007', 'AMMO5': '0.020', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.088', 'weapon4': '0.160', 'weapon5': '0.354', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '0.830', 'ARMOR': '0.841', 'weapon3': '1.330', 'weapon2': '1.670', 'DAMAGECOUNT': '4.623', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:16:27,186][2408954] Fps is (10 sec: 24575.5, 60 sec: 24780.8, 300 sec: 25089.8). Total num frames: 87207936. Throughput: 0: 6162.9. Samples: 21804828. Policy #0 lag: (min: 1.0, avg: 13.0, max: 25.0)
[2023-02-25 13:16:27,186][2408954] Avg episode reward: [(0, '10.107')]
[2023-02-25 13:16:27,691][2409102] DAMAGECOUNT value on done: 7145.0
[2023-02-25 13:16:27,694][2409102] Sum rewards: 11.642, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.725', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.015', 'weapon7': '0.052', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.190', 'WEAPON7': '0.200', 'weapon4': '0.292', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'HITCOUNT': '0.640', 'weapon3': '1.080', 'ARMOR': '1.312', 'weapon2': '1.502', 'DAMAGECOUNT': '3.750', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:16:27,989][2409101] DAMAGECOUNT value on done: 7432.0
[2023-02-25 13:16:27,993][2409101] Sum rewards: 8.061, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.276', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO4': '0.044', 'weapon7': '0.048', 'weapon5': '0.062', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon4': '0.638', 'HITCOUNT': '0.720', 'weapon2': '0.806', 'weapon3': '1.758', 'DAMAGECOUNT': '2.643', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:16:28,194][2409103] DAMAGECOUNT value on done: 7117.0
[2023-02-25 13:16:28,194][2409103] Sum rewards: 16.128, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.730', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.024', 'AMMO3': '0.079', 'weapon7': '0.082', 'AMMO4': '0.118', 'weapon5': '0.206', 'AMMO6': '0.260', 'AMMO7': '0.260', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon4': '0.612', 'HITCOUNT': '0.910', 'weapon2': '1.208', 'weapon3': '1.318', 'DAMAGECOUNT': '4.488', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:16:28,428][2409485] DAMAGECOUNT value on done: 5066.0
[2023-02-25 13:16:28,430][2409485] Sum rewards: 2.945, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.950', 'AMMO5': '0.003', 'AMMO2': '0.015', 'AMMO3': '0.046', 'weapon7': '0.060', 'weapon5': '0.066', 'AMMO4': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.200', 'WEAPON3': '0.400', 'weapon2': '0.708', 'DAMAGECOUNT': '0.735', 'weapon3': '0.880', 'ARMOR': '0.910', 'weapon4': '0.998', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:16:28,519][2409074] Updated weights for policy 0, policy_version 21301 (0.0012)
[2023-02-25 13:16:29,109][2409597] DAMAGECOUNT value on done: 6913.0
[2023-02-25 13:16:29,113][2409597] Sum rewards: 13.881, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.595', 'AMMO2': '0.011', 'AMMO5': '0.017', 'AMMO4': '0.057', 'AMMO3': '0.085', 'weapon4': '0.184', 'weapon5': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'ARMOR': '0.448', 'WEAPON3': '0.750', 'HITCOUNT': '1.050', 'weapon2': '1.058', 'weapon3': '1.984', 'DAMAGECOUNT': '3.285', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:16:30,233][2409549] DAMAGECOUNT value on done: 6296.0
[2023-02-25 13:16:30,234][2409549] Sum rewards: 14.173, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.123', 'AMMO5': '0.013', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO3': '0.064', 'AMMO4': '0.067', 'weapon5': '0.074', 'weapon7': '0.100', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.800', 'HITCOUNT': '0.840', 'weapon2': '0.878', 'weapon4': '0.894', 'weapon3': '1.352', 'DAMAGECOUNT': '3.441', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:16:30,325][2409074] Updated weights for policy 0, policy_version 21311 (0.0012)
[2023-02-25 13:16:31,314][2409102] DAMAGECOUNT value on done: 6640.0
[2023-02-25 13:16:31,315][2409102] Sum rewards: 11.263, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.880', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.012', 'weapon7': '0.068', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.216', 'weapon4': '0.266', 'WEAPON5': '0.300', 'ARMOR': '0.453', 'WEAPON3': '0.550', 'HITCOUNT': '0.990', 'weapon2': '1.460', 'weapon3': '1.474', 'DAMAGECOUNT': '2.982', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:16:31,848][2409548] DAMAGECOUNT value on done: 5828.0
[2023-02-25 13:16:31,849][2409548] Sum rewards: 5.584, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.974', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'weapon7': '0.030', 'AMMO2': '0.052', 'AMMO3': '0.077', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.222', 'AMMO4': '0.260', 'weapon4': '0.368', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '0.500', 'WEAPON5': '0.550', 'HITCOUNT': '0.700', 'weapon2': '1.466', 'weapon3': '1.618', 'DAMAGECOUNT': '3.024', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:16:31,871][2409100] DAMAGECOUNT value on done: 6391.0
[2023-02-25 13:16:31,871][2409100] Sum rewards: 10.634, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.576', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.015', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'weapon4': '0.228', 'weapon5': '0.280', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.810', 'ARMOR': '0.842', 'weapon2': '0.860', 'weapon3': '1.644', 'DAMAGECOUNT': '3.720', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:16:32,171][2409103] DAMAGECOUNT value on done: 6052.0
[2023-02-25 13:16:32,172][2409103] Sum rewards: 12.720, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.345', 'AMMO2': '0.007', 'AMMO5': '0.025', 'AMMO4': '0.035', 'weapon5': '0.072', 'AMMO3': '0.074', 'WEAPON4': '0.100', 'weapon4': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'WEAPON5': '0.500', 'HITCOUNT': '1.090', 'weapon2': '1.446', 'weapon3': '1.706', 'DAMAGECOUNT': '3.660', 'FRAGCOUNT': '8.500'}
[2023-02-25 13:16:32,186][2408954] Fps is (10 sec: 23346.7, 60 sec: 24644.2, 300 sec: 25062.0). Total num frames: 87326720. Throughput: 0: 6121.6. Samples: 21840720. Policy #0 lag: (min: 0.0, avg: 11.4, max: 26.0)
[2023-02-25 13:16:32,186][2408954] Avg episode reward: [(0, '10.263')]
[2023-02-25 13:16:32,272][2409074] Updated weights for policy 0, policy_version 21321 (0.0012)
[2023-02-25 13:16:32,418][2409485] DAMAGECOUNT value on done: 7465.0
[2023-02-25 13:16:32,421][2409485] Sum rewards: 11.801, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.414', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.050', 'weapon7': '0.056', 'AMMO4': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.242', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'ARMOR': '0.451', 'HITCOUNT': '0.520', 'weapon4': '0.660', 'weapon3': '1.204', 'weapon2': '1.356', 'DAMAGECOUNT': '3.360', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:16:32,553][2409101] DAMAGECOUNT value on done: 7404.0
[2023-02-25 13:16:32,557][2409101] Sum rewards: 16.014, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.454', 'AMMO2': '0.019', 'AMMO5': '0.022', 'weapon4': '0.072', 'AMMO4': '0.095', 'AMMO3': '0.101', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.930', 'weapon2': '1.248', 'ARMOR': '1.675', 'weapon3': '1.758', 'DAMAGECOUNT': '4.197', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:16:32,839][2409597] DAMAGECOUNT value on done: 8477.0
[2023-02-25 13:16:32,842][2409597] Sum rewards: 16.385, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.180', 'AMMO2': '0.004', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.022', 'WEAPON4': '0.100', 'weapon4': '0.106', 'weapon5': '0.108', 'AMMO3': '0.116', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '1.070', 'ARMOR': '1.358', 'weapon2': '1.426', 'weapon3': '2.084', 'DAMAGECOUNT': '5.136', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:16:33,504][2409074] Updated weights for policy 0, policy_version 21331 (0.0012)
[2023-02-25 13:16:33,538][2409565] DAMAGECOUNT value on done: 7417.0
[2023-02-25 13:16:33,542][2409565] Sum rewards: 16.596, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.334', 'AMMO5': '0.015', 'AMMO2': '0.020', 'AMMO3': '0.096', 'AMMO4': '0.098', 'weapon5': '0.170', 'WEAPON4': '0.250', 'weapon4': '0.322', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'ARMOR': '0.948', 'weapon2': '1.176', 'HITCOUNT': '1.200', 'weapon3': '1.664', 'DAMAGECOUNT': '5.121', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:16:34,181][2409549] DAMAGECOUNT value on done: 6714.0
[2023-02-25 13:16:34,182][2409549] Sum rewards: 5.732, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.916', 'AMMO5': '0.012', 'AMMO2': '0.038', 'WEAPON1': '0.040', 'AMMO3': '0.104', 'weapon5': '0.110', 'AMMO4': '0.187', 'weapon4': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.720', 'ARMOR': '0.878', 'weapon2': '1.594', 'weapon3': '1.786', 'DAMAGECOUNT': '3.273', 'FRAGCOUNT': '6.500'}
[2023-02-25 13:16:35,203][2409074] Updated weights for policy 0, policy_version 21341 (0.0012)
[2023-02-25 13:16:35,500][2409548] DAMAGECOUNT value on done: 7713.0
[2023-02-25 13:16:35,501][2409548] Sum rewards: 10.921, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.312', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon7': '0.040', 'weapon5': '0.086', 'AMMO3': '0.110', 'AMMO4': '0.119', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.286', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'ARMOR': '0.893', 'HITCOUNT': '0.960', 'weapon2': '1.536', 'weapon3': '1.814', 'DAMAGECOUNT': '3.330', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:16:35,511][2409100] DAMAGECOUNT value on done: 7416.0
[2023-02-25 13:16:35,512][2409100] Sum rewards: 12.680, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.674', 'AMMO2': '0.007', 'AMMO5': '0.017', 'AMMO4': '0.036', 'AMMO3': '0.050', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.760', 'weapon2': '0.798', 'weapon3': '0.982', 'weapon4': '1.070', 'DAMAGECOUNT': '2.517', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:16:35,728][2409102] DAMAGECOUNT value on done: 7486.0
[2023-02-25 13:16:35,729][2409102] Sum rewards: 15.971, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.019', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.065', 'weapon7': '0.088', 'AMMO4': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.136', 'HEALTH': '0.149', 'weapon5': '0.202', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.710', 'weapon3': '1.308', 'weapon2': '1.468', 'DAMAGECOUNT': '3.726', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:16:36,019][2409103] DAMAGECOUNT value on done: 6255.0
[2023-02-25 13:16:36,022][2409103] Sum rewards: 12.317, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.160', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO3': '0.101', 'weapon7': '0.136', 'AMMO4': '0.149', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.248', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.436', 'WEAPON3': '0.600', 'HITCOUNT': '0.630', 'weapon2': '0.724', 'weapon4': '1.102', 'weapon3': '1.412', 'DAMAGECOUNT': '3.486', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:16:36,100][2409101] DAMAGECOUNT value on done: 6093.0
[2023-02-25 13:16:36,102][2409101] Sum rewards: 10.066, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.814', 'AMMO2': '0.017', 'AMMO5': '0.024', 'WEAPON1': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.091', 'WEAPON4': '0.300', 'weapon5': '0.390', 'ARMOR': '0.451', 'weapon4': '0.486', 'WEAPON3': '0.650', 'weapon2': '0.682', 'WEAPON5': '0.700', 'HITCOUNT': '0.700', 'weapon3': '1.868', 'DAMAGECOUNT': '3.384', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:16:36,309][2409485] DAMAGECOUNT value on done: 7755.0
[2023-02-25 13:16:36,327][2409485] Sum rewards: 10.457, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.220', 'weapon5': '0.004', 'AMMO2': '0.017', 'AMMO5': '0.020', 'weapon7': '0.070', 'AMMO3': '0.085', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.690', 'weapon4': '1.118', 'weapon2': '1.122', 'weapon3': '1.438', 'DAMAGECOUNT': '2.736', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:16:36,611][2409105] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:16:36,955][2409597] DAMAGECOUNT value on done: 5949.0
[2023-02-25 13:16:36,955][2409597] Sum rewards: 11.415, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.037', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.068', 'AMMO3': '0.095', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.590', 'WEAPON3': '0.650', 'weapon2': '0.708', 'HITCOUNT': '0.770', 'ARMOR': '0.858', 'weapon3': '1.732', 'DAMAGECOUNT': '3.249', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:16:37,186][2408954] Fps is (10 sec: 24166.9, 60 sec: 24302.9, 300 sec: 25062.0). Total num frames: 87449600. Throughput: 0: 6119.8. Samples: 21859152. Policy #0 lag: (min: 0.0, avg: 11.4, max: 26.0)
[2023-02-25 13:16:37,186][2408954] Avg episode reward: [(0, '10.771')]
[2023-02-25 13:16:37,294][2409074] Updated weights for policy 0, policy_version 21351 (0.0013)
[2023-02-25 13:16:37,958][2409549] DAMAGECOUNT value on done: 5939.0
[2023-02-25 13:16:37,961][2409549] Sum rewards: 7.233, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.402', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.080', 'WEAPON4': '0.150', 'weapon5': '0.178', 'WEAPON5': '0.200', 'weapon4': '0.234', 'WEAPON3': '0.550', 'HITCOUNT': '0.800', 'weapon2': '1.494', 'weapon3': '1.744', 'DAMAGECOUNT': '3.105', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:16:38,448][2409565] DAMAGECOUNT value on done: 6986.0
[2023-02-25 13:16:38,449][2409565] Sum rewards: 13.511, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.240', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'weapon7': '0.050', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.224', 'WEAPON5': '0.350', 'weapon4': '0.424', 'ARMOR': '0.453', 'HITCOUNT': '0.540', 'WEAPON3': '0.650', 'weapon2': '0.960', 'weapon3': '1.974', 'DAMAGECOUNT': '3.126', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:16:38,947][2409074] Updated weights for policy 0, policy_version 21361 (0.0012)
[2023-02-25 13:16:39,514][2409100] DAMAGECOUNT value on done: 6814.0
[2023-02-25 13:16:39,516][2409100] Sum rewards: 5.066, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.008', 'AMMO5': '0.012', 'AMMO4': '0.041', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.076', 'weapon5': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.250', 'HEALTH': '0.325', 'WEAPON3': '0.350', 'HITCOUNT': '0.450', 'ARMOR': '0.850', 'weapon3': '1.076', 'weapon4': '1.216', 'DAMAGECOUNT': '1.305', 'weapon2': '1.358', 'FRAGCOUNT': '2.500'}
[2023-02-25 13:16:39,544][2409548] DAMAGECOUNT value on done: 5696.0
[2023-02-25 13:16:39,545][2409548] Sum rewards: 5.148, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.258', 'AMMO5': '0.007', 'ARMOR': '0.032', 'AMMO2': '0.036', 'AMMO3': '0.040', 'weapon5': '0.110', 'weapon7': '0.132', 'WEAPON5': '0.150', 'AMMO4': '0.179', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.250', 'WEAPON7': '0.400', 'HITCOUNT': '0.430', 'WEAPON4': '0.550', 'weapon3': '0.894', 'weapon2': '0.910', 'weapon4': '1.608', 'DAMAGECOUNT': '1.947', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:16:39,935][2409101] DAMAGECOUNT value on done: 5124.0
[2023-02-25 13:16:39,937][2409101] Sum rewards: 13.178, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.438', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO3': '0.081', 'AMMO4': '0.146', 'weapon5': '0.180', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.488', 'WEAPON3': '0.550', 'ARMOR': '0.800', 'HITCOUNT': '0.800', 'weapon2': '1.000', 'weapon3': '1.776', 'DAMAGECOUNT': '3.153', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:16:40,433][2409102] DAMAGECOUNT value on done: 6651.0
[2023-02-25 13:16:40,434][2409102] Sum rewards: 15.743, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.350', 'AMMO2': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.034', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.222', 'weapon5': '0.308', 'WEAPON3': '0.400', 'HITCOUNT': '0.710', 'weapon3': '1.014', 'weapon2': '1.472', 'DAMAGECOUNT': '3.546', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:16:40,486][2409074] Updated weights for policy 0, policy_version 21371 (0.0012)
[2023-02-25 13:16:40,491][2409103] DAMAGECOUNT value on done: 7492.0
[2023-02-25 13:16:40,494][2409103] Sum rewards: 2.939, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.330', 'AMMO2': '0.011', 'AMMO5': '0.019', 'AMMO4': '0.056', 'AMMO3': '0.073', 'weapon5': '0.234', 'weapon4': '0.244', 'WEAPON4': '0.250', 'HITCOUNT': '0.470', 'WEAPON3': '0.550', 'WEAPON5': '0.550', 'ARMOR': '1.309', 'weapon3': '1.470', 'weapon2': '1.676', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.106'}
[2023-02-25 13:16:40,534][2409597] DAMAGECOUNT value on done: 7066.0
[2023-02-25 13:16:40,549][2409597] Sum rewards: 16.181, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.040', 'HEALTH': '0.109', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'weapon5': '0.198', 'WEAPON5': '0.200', 'weapon7': '0.206', 'WEAPON3': '0.250', 'HITCOUNT': '0.440', 'AMMO6': '0.520', 'AMMO7': '0.520', 'weapon4': '0.588', 'WEAPON7': '0.600', 'ARMOR': '0.871', 'weapon2': '1.188', 'weapon3': '1.198', 'DAMAGECOUNT': '3.177', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:16:40,742][2409485] DAMAGECOUNT value on done: 8099.0
[2023-02-25 13:16:40,743][2409485] Sum rewards: 11.689, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.665', 'AMMO2': '0.007', 'AMMO5': '0.022', 'AMMO4': '0.034', 'weapon7': '0.046', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.121', 'WEAPON7': '0.200', 'weapon5': '0.306', 'weapon4': '0.344', 'ARMOR': '0.453', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'HITCOUNT': '1.040', 'weapon2': '1.100', 'weapon3': '1.848', 'DAMAGECOUNT': '3.843', 'FRAGCOUNT': '10.500'}
[2023-02-25 13:16:41,460][2409099] Large shaping reward 3.381 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.33, 110.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)]
[2023-02-25 13:16:41,564][2409549] DAMAGECOUNT value on done: 6176.0
[2023-02-25 13:16:41,568][2409549] Sum rewards: 8.717, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.934', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.044', 'AMMO3': '0.076', 'weapon5': '0.214', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'HITCOUNT': '0.810', 'ARMOR': '0.855', 'weapon3': '1.532', 'weapon2': '1.952', 'DAMAGECOUNT': '2.601', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:16:41,942][2409074] Updated weights for policy 0, policy_version 21381 (0.0012)
[2023-02-25 13:16:42,186][2408954] Fps is (10 sec: 24986.1, 60 sec: 24507.8, 300 sec: 25075.9). Total num frames: 87576576. Throughput: 0: 6095.0. Samples: 21894912. Policy #0 lag: (min: 0.0, avg: 11.4, max: 26.0)
[2023-02-25 13:16:42,187][2408954] Avg episode reward: [(0, '10.843')]
[2023-02-25 13:16:42,188][2409033] Saving new best policy, reward=10.843!
[2023-02-25 13:16:42,255][2409105] DAMAGECOUNT value on done: 6336.0
[2023-02-25 13:16:42,258][2409105] Sum rewards: 6.260, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.017', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'weapon5': '0.056', 'AMMO4': '0.099', 'weapon4': '0.124', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.350', 'HEALTH': '0.364', 'WEAPON3': '0.750', 'HITCOUNT': '0.810', 'ARMOR': '0.849', 'weapon2': '1.538', 'weapon3': '1.960', 'DAMAGECOUNT': '2.760', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:16:42,592][2409565] DAMAGECOUNT value on done: 7089.0
[2023-02-25 13:16:42,597][2409565] Sum rewards: 7.723, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.365', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.020', 'weapon5': '0.032', 'AMMO3': '0.060', 'weapon7': '0.080', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.148', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.400', 'ARMOR': '0.457', 'HITCOUNT': '0.660', 'weapon3': '1.148', 'weapon2': '1.200', 'DAMAGECOUNT': '2.379', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:16:42,795][2409596] DAMAGECOUNT value on done: 8207.0
[2023-02-25 13:16:42,797][2409596] Sum rewards: 13.778, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.440', 'AMMO2': '0.016', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'AMMO4': '0.082', 'AMMO3': '0.083', 'weapon7': '0.160', 'WEAPON4': '0.200', 'weapon5': '0.228', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'ARMOR': '0.450', 'WEAPON3': '0.550', 'weapon2': '0.666', 'HITCOUNT': '0.760', 'weapon4': '1.130', 'weapon3': '1.458', 'DAMAGECOUNT': '3.738', 'FRAGCOUNT': '11.500'}
[2023-02-25 13:16:43,079][2409100] DAMAGECOUNT value on done: 7757.0
[2023-02-25 13:16:43,080][2409100] Sum rewards: 13.589, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.262', 'AMMO2': '0.031', 'AMMO5': '0.038', 'weapon4': '0.100', 'AMMO3': '0.111', 'AMMO4': '0.153', 'WEAPON4': '0.300', 'weapon5': '0.310', 'WEAPON3': '0.800', 'ARMOR': '0.800', 'HITCOUNT': '0.880', 'WEAPON5': '0.950', 'weapon2': '1.192', 'weapon3': '1.956', 'DAMAGECOUNT': '4.980', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:16:43,150][2409548] DAMAGECOUNT value on done: 7683.0
[2023-02-25 13:16:43,155][2409548] Sum rewards: 12.688, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.456', 'AMMO2': '0.026', 'AMMO5': '0.033', 'weapon5': '0.112', 'AMMO4': '0.129', 'AMMO3': '0.131', 'WEAPON4': '0.250', 'weapon4': '0.422', 'WEAPON5': '0.700', 'ARMOR': '0.850', 'WEAPON3': '0.850', 'weapon2': '0.962', 'HITCOUNT': '1.110', 'weapon3': '2.144', 'DAMAGECOUNT': '4.176', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:16:43,626][2409101] DAMAGECOUNT value on done: 5650.0
[2023-02-25 13:16:43,627][2409101] Sum rewards: 6.550, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.300', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO3': '0.040', 'AMMO4': '0.044', 'weapon5': '0.116', 'weapon7': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.300', 'HITCOUNT': '0.310', 'AMMO6': '0.420', 'AMMO7': '0.420', 'ARMOR': '0.424', 'WEAPON7': '0.500', 'weapon3': '1.028', 'DAMAGECOUNT': '1.092', 'weapon2': '1.094', 'weapon4': '1.176', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:16:44,005][2409074] Updated weights for policy 0, policy_version 21391 (0.0012)
[2023-02-25 13:16:44,585][2409102] DAMAGECOUNT value on done: 8097.0
[2023-02-25 13:16:44,586][2409102] Sum rewards: 12.773, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.161', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'AMMO3': '0.102', 'AMMO4': '0.161', 'weapon5': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'ARMOR': '0.400', 'weapon4': '0.406', 'WEAPON3': '0.700', 'HITCOUNT': '0.940', 'weapon2': '1.160', 'weapon3': '1.650', 'DAMAGECOUNT': '3.855', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:16:44,706][2409103] DAMAGECOUNT value on done: 7304.0
[2023-02-25 13:16:44,709][2409103] Sum rewards: 7.500, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.676', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.015', 'AMMO3': '0.054', 'AMMO4': '0.075', 'weapon4': '0.090', 'weapon7': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.262', 'HITCOUNT': '0.320', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'ARMOR': '0.619', 'weapon3': '1.250', 'DAMAGECOUNT': '1.926', 'weapon2': '1.992', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:16:44,979][2409485] DAMAGECOUNT value on done: 5922.0
[2023-02-25 13:16:44,984][2409485] Sum rewards: 5.076, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.877', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO2': '0.026', 'weapon7': '0.076', 'AMMO3': '0.079', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.128', 'AMMO4': '0.129', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'ARMOR': '0.455', 'HITCOUNT': '0.530', 'WEAPON3': '0.600', 'weapon2': '0.926', 'weapon4': '1.078', 'weapon3': '1.522', 'DAMAGECOUNT': '2.721', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:16:45,098][2409597] DAMAGECOUNT value on done: 8064.0
[2023-02-25 13:16:45,098][2409597] Sum rewards: 16.989, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.168', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon7': '0.048', 'AMMO3': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'weapon5': '0.172', 'WEAPON5': '0.250', 'weapon4': '0.420', 'WEAPON3': '0.450', 'HITCOUNT': '0.670', 'ARMOR': '0.899', 'weapon2': '1.384', 'weapon3': '1.570', 'DAMAGECOUNT': '4.617', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:16:45,298][2409549] DAMAGECOUNT value on done: 7955.0
[2023-02-25 13:16:45,299][2409549] Sum rewards: 5.551, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.890', 'AMMO2': '0.018', 'AMMO5': '0.035', 'weapon7': '0.074', 'AMMO4': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.125', 'weapon5': '0.144', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.650', 'weapon2': '0.732', 'WEAPON5': '0.800', 'WEAPON3': '0.850', 'weapon4': '0.856', 'ARMOR': '1.405', 'weapon3': '1.786', 'DAMAGECOUNT': '2.889', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:16:45,718][2409101] Large shaping reward 2.652 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:16:45,798][2409074] Updated weights for policy 0, policy_version 21401 (0.0012)
[2023-02-25 13:16:46,872][2409596] DAMAGECOUNT value on done: 6294.0
[2023-02-25 13:16:46,873][2409596] Sum rewards: 5.096, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.495', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'AMMO3': '0.040', 'weapon7': '0.088', 'WEAPON4': '0.100', 'weapon5': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.530', 'weapon4': '0.604', 'weapon3': '0.984', 'weapon2': '0.992', 'DAMAGECOUNT': '1.485', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:16:46,922][2409565] DAMAGECOUNT value on done: 7273.0
[2023-02-25 13:16:46,923][2409565] Sum rewards: 3.073, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.460', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO3': '0.049', 'weapon5': '0.054', 'weapon7': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.400', 'ARMOR': '0.501', 'weapon2': '0.578', 'weapon4': '0.698', 'weapon3': '0.798', 'DAMAGECOUNT': '1.047', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:16:46,930][2409100] DAMAGECOUNT value on done: 6397.0
[2023-02-25 13:16:46,931][2409100] Sum rewards: 11.384, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.130', 'AMMO5': '0.017', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'AMMO3': '0.065', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'weapon5': '0.226', 'weapon4': '0.364', 'WEAPON3': '0.450', 'WEAPON5': '0.450', 'HITCOUNT': '0.750', 'weapon2': '0.918', 'weapon3': '1.496', 'DAMAGECOUNT': '3.150', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:16:46,954][2409105] DAMAGECOUNT value on done: 7425.0
[2023-02-25 13:16:46,955][2409105] Sum rewards: 15.558, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.248', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO3': '0.070', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'weapon4': '0.152', 'weapon5': '0.208', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.970', 'weapon2': '1.652', 'weapon3': '1.800', 'DAMAGECOUNT': '4.491', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:16:47,110][2409548] DAMAGECOUNT value on done: 7399.0
[2023-02-25 13:16:47,111][2409548] Sum rewards: 5.958, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.510', 'AMMO5': '0.015', 'AMMO2': '0.016', 'AMMO3': '0.063', 'AMMO4': '0.081', 'weapon7': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.248', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.530', 'weapon3': '1.292', 'weapon2': '1.316', 'DAMAGECOUNT': '2.235', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:16:47,186][2408954] Fps is (10 sec: 24575.7, 60 sec: 24507.7, 300 sec: 24992.5). Total num frames: 87695360. Throughput: 0: 6088.8. Samples: 21931056. Policy #0 lag: (min: 0.0, avg: 10.8, max: 24.0)
[2023-02-25 13:16:47,187][2408954] Avg episode reward: [(0, '10.595')]
[2023-02-25 13:16:47,235][2409074] Updated weights for policy 0, policy_version 21411 (0.0012)
[2023-02-25 13:16:47,343][2409406] Large shaping reward 2.563 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.531, 177.0), ('weapon7', 0.002)]
[2023-02-25 13:16:47,667][2409101] DAMAGECOUNT value on done: 9486.0
[2023-02-25 13:16:47,668][2409101] Sum rewards: 3.021, reward structure: {'DEATHCOUNT': '-7.500', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO5': '0.025', 'weapon7': '0.048', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.228', 'HITCOUNT': '0.390', 'WEAPON5': '0.400', 'HEALTH': '0.409', 'weapon2': '0.494', 'WEAPON3': '0.600', 'ARMOR': '0.800', 'weapon4': '1.152', 'DAMAGECOUNT': '1.437', 'weapon3': '1.794', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:16:47,674][2409866] DAMAGECOUNT value on done: 5188.0
[2023-02-25 13:16:47,677][2409866] Sum rewards: 12.035, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.088', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO3': '0.093', 'WEAPON5': '0.200', 'weapon5': '0.224', 'WEAPON3': '0.650', 'HITCOUNT': '0.690', 'ARMOR': '0.903', 'weapon3': '1.534', 'weapon2': '1.698', 'DAMAGECOUNT': '3.405', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:16:48,659][2409074] Updated weights for policy 0, policy_version 21421 (0.0014)
[2023-02-25 13:16:48,710][2409103] DAMAGECOUNT value on done: 5916.0
[2023-02-25 13:16:48,713][2409103] Sum rewards: 7.926, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.057', 'weapon7': '0.084', 'AMMO4': '0.118', 'HEALTH': '0.141', 'WEAPON4': '0.250', 'AMMO6': '0.280', 'AMMO7': '0.280', 'weapon5': '0.294', 'WEAPON3': '0.300', 'WEAPON5': '0.300', 'WEAPON7': '0.400', 'HITCOUNT': '0.480', 'weapon2': '0.936', 'weapon4': '1.000', 'weapon3': '1.210', 'ARMOR': '1.245', 'DAMAGECOUNT': '2.490', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:16:48,806][2409405] DAMAGECOUNT value on done: 7629.0
[2023-02-25 13:16:48,810][2409405] Sum rewards: 9.347, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.122', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO5': '0.027', 'AMMO4': '0.029', 'AMMO3': '0.077', 'WEAPON4': '0.150', 'weapon4': '0.250', 'weapon5': '0.344', 'WEAPON3': '0.600', 'WEAPON5': '0.600', 'HITCOUNT': '0.680', 'ARMOR': '1.247', 'weapon3': '1.446', 'weapon2': '1.668', 'DAMAGECOUNT': '2.835', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:16:48,852][2409102] DAMAGECOUNT value on done: 8017.0
[2023-02-25 13:16:48,853][2409102] Sum rewards: 13.096, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.017', 'AMMO2': '0.024', 'weapon7': '0.050', 'AMMO3': '0.058', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'weapon5': '0.338', 'HEALTH': '0.576', 'HITCOUNT': '0.670', 'weapon4': '0.762', 'ARMOR': '0.800', 'weapon3': '1.066', 'weapon2': '1.318', 'DAMAGECOUNT': '3.906', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:16:49,013][2409485] DAMAGECOUNT value on done: 7242.0
[2023-02-25 13:16:49,013][2409485] Sum rewards: 8.070, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.904', 'AMMO5': '0.021', 'AMMO2': '0.024', 'weapon7': '0.048', 'weapon5': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.122', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.620', 'WEAPON3': '0.750', 'weapon4': '0.930', 'weapon2': '0.960', 'weapon3': '1.402', 'ARMOR': '1.747', 'DAMAGECOUNT': '2.457', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:16:49,148][2409597] DAMAGECOUNT value on done: 7559.0
[2023-02-25 13:16:49,150][2409597] Sum rewards: 16.033, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.550', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'AMMO5': '0.025', 'weapon4': '0.054', 'AMMO3': '0.087', 'AMMO4': '0.099', 'WEAPON4': '0.200', 'weapon5': '0.262', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'ARMOR': '0.925', 'HITCOUNT': '0.990', 'weapon2': '1.460', 'weapon3': '1.874', 'DAMAGECOUNT': '4.527', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:16:49,379][2409549] DAMAGECOUNT value on done: 8806.0
[2023-02-25 13:16:49,380][2409549] Sum rewards: 12.542, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.567', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'weapon4': '0.050', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon5': '0.164', 'ARMOR': '0.424', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'HITCOUNT': '0.720', 'weapon2': '1.390', 'weapon3': '2.086', 'DAMAGECOUNT': '3.561', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:16:49,552][2409080] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:16:49,596][2409077] DAMAGECOUNT value on done: 8657.0
[2023-02-25 13:16:49,597][2409077] Sum rewards: 12.461, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.625', 'AMMO2': '0.006', 'AMMO5': '0.017', 'AMMO4': '0.031', 'AMMO3': '0.074', 'WEAPON4': '0.150', 'weapon5': '0.340', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.590', 'weapon4': '0.702', 'ARMOR': '0.863', 'weapon2': '0.948', 'weapon3': '1.256', 'DAMAGECOUNT': '2.658', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:16:49,609][2409406] DAMAGECOUNT value on done: 6397.0
[2023-02-25 13:16:49,610][2409406] Sum rewards: 16.661, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.728', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon7': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.136', 'weapon5': '0.176', 'WEAPON7': '0.200', 'weapon4': '0.312', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'HITCOUNT': '1.090', 'weapon2': '1.344', 'weapon3': '1.814', 'DAMAGECOUNT': '4.911', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:16:50,433][2409096] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:16:50,519][2409407] DAMAGECOUNT value on done: 7145.0
[2023-02-25 13:16:50,521][2409407] Sum rewards: 11.243, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.104', 'AMMO2': '0.005', 'AMMO5': '0.022', 'AMMO4': '0.027', 'AMMO3': '0.072', 'weapon5': '0.312', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.680', 'ARMOR': '0.914', 'weapon3': '1.358', 'weapon2': '1.738', 'DAMAGECOUNT': '3.669', 'FRAGCOUNT': '8.500'}
[2023-02-25 13:16:50,613][2409105] DAMAGECOUNT value on done: 7813.0
[2023-02-25 13:16:50,616][2409105] Sum rewards: 8.650, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO3': '0.070', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'weapon7': '0.108', 'weapon5': '0.170', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.330', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HEALTH': '0.526', 'weapon4': '0.992', 'weapon2': '1.168', 'weapon3': '1.216', 'DAMAGECOUNT': '1.491', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:16:50,699][2409074] Updated weights for policy 0, policy_version 21431 (0.0012)
[2023-02-25 13:16:50,857][2409100] DAMAGECOUNT value on done: 7186.0
[2023-02-25 13:16:50,858][2409100] Sum rewards: 7.467, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.090', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.018', 'weapon7': '0.048', 'AMMO3': '0.057', 'AMMO4': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.200', 'weapon5': '0.286', 'WEAPON3': '0.400', 'ARMOR': '0.451', 'HITCOUNT': '0.480', 'weapon4': '0.506', 'WEAPON5': '0.550', 'weapon2': '0.720', 'weapon3': '0.982', 'DAMAGECOUNT': '2.439', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:16:50,861][2409565] DAMAGECOUNT value on done: 8241.0
[2023-02-25 13:16:50,871][2409565] Sum rewards: 8.442, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.230', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'ARMOR': '0.036', 'AMMO3': '0.094', 'AMMO4': '0.126', 'weapon5': '0.156', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'weapon2': '0.810', 'weapon4': '0.934', 'HITCOUNT': '1.270', 'weapon3': '1.764', 'DAMAGECOUNT': '4.119', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:16:51,046][2409355] DAMAGECOUNT value on done: 6791.0
[2023-02-25 13:16:51,047][2409355] Sum rewards: 2.893, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.920', 'AMMO2': '0.011', 'AMMO5': '0.015', 'AMMO4': '0.057', 'AMMO3': '0.096', 'weapon5': '0.142', 'weapon4': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.455', 'HITCOUNT': '0.630', 'WEAPON3': '0.750', 'weapon3': '1.624', 'weapon2': '1.770', 'DAMAGECOUNT': '2.253', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:16:51,051][2409548] DAMAGECOUNT value on done: 7712.0
[2023-02-25 13:16:51,054][2409548] Sum rewards: 13.751, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.975', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'AMMO3': '0.060', 'AMMO4': '0.135', 'weapon5': '0.186', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '0.500', 'weapon2': '0.920', 'ARMOR': '0.939', 'HITCOUNT': '1.000', 'weapon4': '1.114', 'weapon3': '1.294', 'DAMAGECOUNT': '3.816', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:16:51,339][2409596] DAMAGECOUNT value on done: 5986.0
[2023-02-25 13:16:51,340][2409596] Sum rewards: 14.010, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.745', 'AMMO2': '0.024', 'AMMO5': '0.031', 'AMMO3': '0.091', 'AMMO4': '0.120', 'weapon4': '0.236', 'WEAPON4': '0.250', 'weapon5': '0.324', 'WEAPON3': '0.600', 'WEAPON5': '0.600', 'HITCOUNT': '0.880', 'ARMOR': '1.326', 'weapon2': '1.438', 'weapon3': '1.724', 'DAMAGECOUNT': '4.110', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:16:51,366][2409101] DAMAGECOUNT value on done: 6581.0
[2023-02-25 13:16:51,367][2409101] Sum rewards: -0.143, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.940', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.024', 'weapon7': '0.076', 'AMMO3': '0.098', 'AMMO4': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.124', 'WEAPON7': '0.200', 'HITCOUNT': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.600', 'ARMOR': '0.952', 'DAMAGECOUNT': '1.062', 'weapon3': '1.094', 'weapon4': '1.216', 'weapon2': '1.264'}
[2023-02-25 13:16:51,644][2409866] DAMAGECOUNT value on done: 7517.0
[2023-02-25 13:16:51,645][2409866] Sum rewards: 14.859, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.545', 'AMMO5': '0.014', 'AMMO2': '0.030', 'AMMO3': '0.084', 'AMMO4': '0.149', 'weapon5': '0.218', 'weapon4': '0.284', 'WEAPON5': '0.300', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.453', 'WEAPON3': '0.500', 'HITCOUNT': '0.760', 'weapon2': '1.448', 'weapon3': '1.760', 'DAMAGECOUNT': '3.153', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:16:52,174][2409074] Updated weights for policy 0, policy_version 21441 (0.0013)
[2023-02-25 13:16:52,186][2408954] Fps is (10 sec: 24576.0, 60 sec: 24371.3, 300 sec: 25020.3). Total num frames: 87822336. Throughput: 0: 6091.0. Samples: 21949284. Policy #0 lag: (min: 0.0, avg: 10.8, max: 24.0)
[2023-02-25 13:16:52,186][2408954] Avg episode reward: [(0, '10.821')]
[2023-02-25 13:16:52,441][2409102] DAMAGECOUNT value on done: 7928.0
[2023-02-25 13:16:52,443][2409102] Sum rewards: 10.760, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.012', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'HEALTH': '0.058', 'AMMO4': '0.059', 'AMMO3': '0.060', 'weapon5': '0.178', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '0.890', 'weapon3': '1.380', 'weapon2': '1.624', 'DAMAGECOUNT': '3.213', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:16:52,534][2409405] DAMAGECOUNT value on done: 5284.0
[2023-02-25 13:16:52,539][2409405] Sum rewards: 5.881, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.770', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO3': '0.030', 'weapon5': '0.060', 'weapon7': '0.106', 'AMMO4': '0.106', 'WEAPON3': '0.250', 'HITCOUNT': '0.250', 'WEAPON5': '0.300', 'AMMO6': '0.440', 'AMMO7': '0.440', 'WEAPON4': '0.450', 'WEAPON7': '0.600', 'weapon3': '0.756', 'weapon2': '0.836', 'weapon4': '1.962', 'DAMAGECOUNT': '2.031', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:16:52,905][2409597] DAMAGECOUNT value on done: 7926.0
[2023-02-25 13:16:52,909][2409597] Sum rewards: 13.397, reward structure: {'DEATHCOUNT': '-6.000', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.028', 'AMMO3': '0.082', 'AMMO4': '0.138', 'weapon5': '0.196', 'WEAPON4': '0.200', 'HEALTH': '0.308', 'WEAPON5': '0.350', 'weapon4': '0.398', 'WEAPON3': '0.450', 'weapon2': '0.854', 'ARMOR': '0.900', 'HITCOUNT': '0.960', 'weapon3': '1.882', 'DAMAGECOUNT': '3.621', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:16:53,023][2409103] DAMAGECOUNT value on done: 6795.0
[2023-02-25 13:16:53,023][2409103] Sum rewards: 13.646, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'HEALTH': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'AMMO3': '0.075', 'weapon5': '0.102', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'weapon4': '0.222', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.980', 'weapon2': '1.182', 'weapon3': '1.388', 'DAMAGECOUNT': '3.744', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:16:53,103][2409549] DAMAGECOUNT value on done: 8110.0
[2023-02-25 13:16:53,104][2409549] Sum rewards: 9.764, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.616', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO5': '0.019', 'AMMO4': '0.052', 'AMMO3': '0.066', 'weapon7': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'HITCOUNT': '0.650', 'weapon2': '0.798', 'ARMOR': '0.871', 'weapon4': '0.996', 'weapon3': '1.264', 'DAMAGECOUNT': '3.879', 'FRAGCOUNT': '6.500'}
[2023-02-25 13:16:53,183][2409468] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)]
[2023-02-25 13:16:53,191][2409077] DAMAGECOUNT value on done: 6399.0
[2023-02-25 13:16:53,192][2409077] Sum rewards: 6.907, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.370', 'AMMO2': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.033', 'AMMO3': '0.060', 'weapon7': '0.144', 'weapon5': '0.172', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.300', 'WEAPON7': '0.400', 'HITCOUNT': '0.430', 'WEAPON3': '0.450', 'weapon4': '0.768', 'ARMOR': '0.913', 'weapon3': '1.048', 'weapon2': '1.252', 'DAMAGECOUNT': '2.340', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:16:53,211][2409406] DAMAGECOUNT value on done: 7767.0
[2023-02-25 13:16:53,212][2409406] Sum rewards: 9.248, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.479', 'AMMO2': '0.015', 'AMMO5': '0.020', 'weapon7': '0.064', 'AMMO3': '0.073', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.174', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.386', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.680', 'weapon2': '1.272', 'weapon3': '1.624', 'DAMAGECOUNT': '2.805', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:16:53,527][2409485] DAMAGECOUNT value on done: 7048.0
[2023-02-25 13:16:53,528][2409485] Sum rewards: 10.679, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.216', 'AMMO2': '0.016', 'AMMO5': '0.017', 'weapon7': '0.066', 'AMMO4': '0.079', 'AMMO3': '0.093', 'weapon5': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.502', 'HITCOUNT': '0.570', 'weapon2': '1.532', 'weapon3': '1.554', 'DAMAGECOUNT': '2.967', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:16:54,174][2409074] Updated weights for policy 0, policy_version 21451 (0.0012)
[2023-02-25 13:16:54,494][2409565] DAMAGECOUNT value on done: 8466.0
[2023-02-25 13:16:54,495][2409565] Sum rewards: 13.343, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.511', 'AMMO2': '0.013', 'AMMO5': '0.020', 'AMMO4': '0.064', 'AMMO3': '0.088', 'weapon7': '0.132', 'weapon5': '0.184', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.440', 'WEAPON5': '0.450', 'HITCOUNT': '0.640', 'WEAPON3': '0.650', 'ARMOR': '0.906', 'weapon3': '1.244', 'weapon2': '1.624', 'DAMAGECOUNT': '4.209', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:16:54,505][2409105] DAMAGECOUNT value on done: 6312.0
[2023-02-25 13:16:54,505][2409105] Sum rewards: 2.080, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.113', 'weapon5': '0.010', 'AMMO2': '0.019', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO3': '0.073', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'weapon7': '0.170', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.400', 'HITCOUNT': '0.460', 'WEAPON3': '0.500', 'weapon2': '0.756', 'weapon4': '1.230', 'weapon3': '1.532', 'DAMAGECOUNT': '2.256', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:16:54,669][2409407] DAMAGECOUNT value on done: 8344.0
[2023-02-25 13:16:54,670][2409407] Sum rewards: 5.065, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.710', 'AMMO5': '0.030', 'AMMO2': '0.042', 'weapon7': '0.082', 'AMMO3': '0.146', 'weapon5': '0.148', 'AMMO4': '0.212', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.400', 'WEAPON5': '0.600', 'weapon2': '0.630', 'HITCOUNT': '0.850', 'weapon4': '0.970', 'WEAPON3': '1.000', 'weapon3': '1.652', 'DAMAGECOUNT': '3.273', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:16:54,704][2409100] DAMAGECOUNT value on done: 6939.0
[2023-02-25 13:16:54,708][2409100] Sum rewards: 14.915, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.540', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon7': '0.050', 'weapon5': '0.064', 'AMMO3': '0.087', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.141', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'ARMOR': '0.460', 'WEAPON3': '0.500', 'weapon4': '0.660', 'HITCOUNT': '0.980', 'weapon2': '1.032', 'weapon3': '1.498', 'DAMAGECOUNT': '4.089', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:16:54,724][2409355] DAMAGECOUNT value on done: 5852.0
[2023-02-25 13:16:54,724][2409355] Sum rewards: 3.761, reward structure: {'DEATHCOUNT': '-0.750', 'HEALTH': '-0.206', 'AMMO2': '0.005', 'AMMO3': '0.024', 'AMMO4': '0.025', 'HITCOUNT': '0.040', 'weapon7': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'DAMAGECOUNT': '0.135', 'WEAPON4': '0.200', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.200', 'weapon3': '0.512', 'weapon4': '0.854', 'ARMOR': '0.997', 'FRAGCOUNT': '1.000'}
[2023-02-25 13:16:54,846][2409548] DAMAGECOUNT value on done: 8157.0
[2023-02-25 13:16:54,846][2409548] Sum rewards: 15.346, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.492', 'AMMO2': '0.017', 'AMMO5': '0.020', 'weapon7': '0.036', 'weapon5': '0.062', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'weapon4': '0.106', 'AMMO3': '0.107', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.800', 'ARMOR': '1.254', 'weapon3': '1.530', 'weapon2': '1.916', 'DAMAGECOUNT': '3.006', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:16:55,311][2409866] DAMAGECOUNT value on done: 8009.0
[2023-02-25 13:16:55,315][2409866] Sum rewards: 2.852, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.996', 'AMMO2': '0.012', 'AMMO5': '0.012', 'AMMO4': '0.060', 'weapon7': '0.084', 'AMMO3': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.166', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'weapon4': '0.492', 'WEAPON3': '0.650', 'HITCOUNT': '0.690', 'weapon3': '1.288', 'weapon2': '1.510', 'FRAGCOUNT': '2.500', 'DAMAGECOUNT': '2.634'}
[2023-02-25 13:16:55,325][2409101] DAMAGECOUNT value on done: 6549.0
[2023-02-25 13:16:55,329][2409101] Sum rewards: 9.721, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'weapon5': '0.112', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'HEALTH': '0.194', 'weapon4': '0.194', 'WEAPON3': '0.450', 'ARMOR': '0.457', 'HITCOUNT': '0.920', 'weapon3': '1.050', 'weapon2': '1.652', 'DAMAGECOUNT': '2.934', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:16:55,698][2409389] DAMAGECOUNT value on done: 6567.0
[2023-02-25 13:16:55,701][2409389] Sum rewards: 14.936, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.820', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon5': '0.260', 'weapon4': '0.270', 'WEAPON5': '0.350', 'ARMOR': '0.456', 'WEAPON3': '0.550', 'HITCOUNT': '1.160', 'weapon2': '1.398', 'weapon3': '1.630', 'DAMAGECOUNT': '3.720', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:16:55,863][2409074] Updated weights for policy 0, policy_version 21461 (0.0012)
[2023-02-25 13:16:56,075][2409373] DAMAGECOUNT value on done: 6864.0
[2023-02-25 13:16:56,076][2409373] Sum rewards: 7.975, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.172', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.005', 'AMMO3': '0.030', 'weapon7': '0.084', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.282', 'HITCOUNT': '0.320', 'ARMOR': '0.400', 'weapon3': '0.654', 'weapon2': '0.710', 'weapon4': '1.084', 'DAMAGECOUNT': '1.932', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:16:56,248][2409102] DAMAGECOUNT value on done: 6153.0
[2023-02-25 13:16:56,251][2409102] Sum rewards: 7.598, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.031', 'AMMO2': '0.002', 'AMMO4': '0.012', 'AMMO5': '0.022', 'WEAPON1': '0.040', 'AMMO3': '0.102', 'weapon5': '0.254', 'WEAPON5': '0.450', 'HITCOUNT': '0.630', 'WEAPON3': '0.700', 'ARMOR': '1.240', 'weapon2': '1.564', 'weapon3': '1.890', 'DAMAGECOUNT': '2.472', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:16:56,409][2409596] DAMAGECOUNT value on done: 7048.0
[2023-02-25 13:16:56,410][2409596] Sum rewards: 12.208, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.480', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO3': '0.085', 'weapon5': '0.246', 'WEAPON5': '0.400', 'ARMOR': '0.444', 'WEAPON3': '0.550', 'HITCOUNT': '0.750', 'weapon2': '1.340', 'weapon3': '1.346', 'DAMAGECOUNT': '3.006', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:16:56,544][2409104] DAMAGECOUNT value on done: 6952.0
[2023-02-25 13:16:56,547][2409104] Sum rewards: 11.066, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.030', 'AMMO5': '0.015', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.077', 'AMMO3': '0.092', 'weapon7': '0.096', 'weapon5': '0.182', 'WEAPON4': '0.200', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'weapon4': '0.338', 'WEAPON5': '0.400', 'ARMOR': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '0.660', 'weapon2': '1.432', 'weapon3': '1.668', 'DAMAGECOUNT': '2.850', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:16:56,697][2409405] DAMAGECOUNT value on done: 5668.0
[2023-02-25 13:16:56,698][2409405] Sum rewards: 10.076, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.685', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO3': '0.080', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'weapon5': '0.270', 'weapon4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '0.780', 'weapon2': '1.266', 'weapon3': '1.820', 'DAMAGECOUNT': '3.057', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:16:56,714][2409597] DAMAGECOUNT value on done: 5988.0
[2023-02-25 13:16:56,715][2409597] Sum rewards: 10.988, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.368', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.043', 'AMMO3': '0.066', 'weapon7': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.110', 'WEAPON4': '0.200', 'AMMO4': '0.213', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'ARMOR': '0.453', 'weapon2': '0.570', 'HITCOUNT': '0.610', 'weapon3': '0.868', 'weapon4': '1.174', 'DAMAGECOUNT': '2.457', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:16:57,059][2409103] DAMAGECOUNT value on done: 7485.0
[2023-02-25 13:16:57,062][2409103] Sum rewards: 10.379, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.546', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO3': '0.050', 'weapon7': '0.068', 'AMMO4': '0.089', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'ARMOR': '0.454', 'HITCOUNT': '0.510', 'weapon2': '0.724', 'weapon3': '1.262', 'weapon4': '1.374', 'DAMAGECOUNT': '2.448', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:16:57,117][2409549] DAMAGECOUNT value on done: 8262.0
[2023-02-25 13:16:57,118][2409549] Sum rewards: 15.400, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.304', 'AMMO2': '0.017', 'AMMO5': '0.017', 'AMMO4': '0.083', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'weapon5': '0.252', 'weapon4': '0.260', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'ARMOR': '0.844', 'HITCOUNT': '0.890', 'weapon3': '1.372', 'weapon2': '1.688', 'DAMAGECOUNT': '4.644', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:16:57,186][2408954] Fps is (10 sec: 24166.7, 60 sec: 24234.8, 300 sec: 25034.2). Total num frames: 87937024. Throughput: 0: 6068.3. Samples: 21985452. Policy #0 lag: (min: 0.0, avg: 10.8, max: 24.0)
[2023-02-25 13:16:57,186][2408954] Avg episode reward: [(0, '10.430')]
[2023-02-25 13:16:57,423][2409485] DAMAGECOUNT value on done: 7264.0
[2023-02-25 13:16:57,424][2409485] Sum rewards: 10.795, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.990', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.015', 'AMMO4': '0.055', 'weapon7': '0.056', 'AMMO3': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.200', 'weapon5': '0.244', 'WEAPON5': '0.300', 'ARMOR': '0.480', 'weapon2': '0.538', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'weapon4': '1.326', 'weapon3': '1.594', 'DAMAGECOUNT': '3.099', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:16:57,429][2409074] Updated weights for policy 0, policy_version 21471 (0.0013)
[2023-02-25 13:16:57,538][2409077] DAMAGECOUNT value on done: 6785.0
[2023-02-25 13:16:57,538][2409077] Sum rewards: 5.588, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.018', 'AMMO5': '0.012', 'ARMOR': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.060', 'weapon5': '0.138', 'AMMO4': '0.142', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.370', 'WEAPON3': '0.400', 'weapon2': '0.750', 'weapon4': '0.806', 'weapon3': '1.406', 'DAMAGECOUNT': '1.422', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:16:57,560][2409406] DAMAGECOUNT value on done: 7420.0
[2023-02-25 13:16:57,561][2409406] Sum rewards: 12.423, reward structure: {'DEATHCOUNT': '-8.250', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.043', 'AMMO3': '0.068', 'weapon7': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HEALTH': '0.152', 'weapon5': '0.188', 'WEAPON7': '0.200', 'AMMO4': '0.216', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'ARMOR': '0.453', 'weapon4': '0.488', 'HITCOUNT': '0.740', 'weapon2': '0.818', 'weapon3': '1.272', 'DAMAGECOUNT': '3.618', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:16:58,285][2409565] DAMAGECOUNT value on done: 6296.0
[2023-02-25 13:16:58,286][2409565] Sum rewards: 16.758, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.465', 'AMMO5': '0.017', 'AMMO2': '0.020', 'weapon7': '0.024', 'WEAPON1': '0.030', 'weapon4': '0.058', 'AMMO3': '0.070', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'weapon5': '0.184', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON5': '0.500', 'WEAPON3': '0.500', 'ARMOR': '0.884', 'HITCOUNT': '0.970', 'weapon2': '1.588', 'weapon3': '1.676', 'DAMAGECOUNT': '4.050', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:16:58,645][2409105] DAMAGECOUNT value on done: 7466.0
[2023-02-25 13:16:58,649][2409105] Sum rewards: 8.527, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.605', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon5': '0.038', 'AMMO3': '0.076', 'AMMO4': '0.131', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.490', 'AMMO6': '0.500', 'WEAPON7': '0.500', 'AMMO7': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.700', 'ARMOR': '0.907', 'weapon3': '1.470', 'weapon2': '1.508', 'DAMAGECOUNT': '2.274', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:16:58,685][2409355] DAMAGECOUNT value on done: 8062.0
[2023-02-25 13:16:58,686][2409355] Sum rewards: 7.246, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.370', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.080', 'AMMO3': '0.098', 'weapon5': '0.166', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.572', 'WEAPON3': '0.650', 'HITCOUNT': '0.680', 'ARMOR': '0.852', 'weapon2': '1.140', 'weapon3': '1.636', 'DAMAGECOUNT': '3.213', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:16:58,827][2409100] DAMAGECOUNT value on done: 6332.0
[2023-02-25 13:16:58,828][2409100] Sum rewards: 12.411, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.155', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.022', 'weapon7': '0.054', 'AMMO4': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.106', 'WEAPON4': '0.150', 'weapon5': '0.290', 'ARMOR': '0.400', 'weapon4': '0.424', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'HITCOUNT': '0.810', 'weapon2': '1.224', 'weapon3': '1.470', 'DAMAGECOUNT': '3.288', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:16:58,827][2409407] DAMAGECOUNT value on done: 8647.0
[2023-02-25 13:16:58,831][2409407] Sum rewards: 13.707, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.232', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.024', 'AMMO5': '0.028', 'weapon7': '0.048', 'AMMO3': '0.103', 'weapon5': '0.166', 'WEAPON4': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON5': '0.650', 'WEAPON3': '0.700', 'weapon4': '0.764', 'ARMOR': '0.856', 'HITCOUNT': '0.920', 'weapon2': '1.184', 'weapon3': '1.254', 'DAMAGECOUNT': '5.127', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:16:59,000][2409548] DAMAGECOUNT value on done: 6307.0
[2023-02-25 13:16:59,005][2409548] Sum rewards: 12.103, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.961', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO3': '0.102', 'WEAPON4': '0.150', 'weapon5': '0.318', 'weapon4': '0.320', 'ARMOR': '0.465', 'WEAPON5': '0.600', 'HITCOUNT': '0.630', 'WEAPON3': '0.750', 'weapon2': '1.354', 'weapon3': '1.474', 'DAMAGECOUNT': '2.874', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:16:59,181][2409101] DAMAGECOUNT value on done: 7942.0
[2023-02-25 13:16:59,182][2409101] Sum rewards: 5.811, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.211', 'AMMO5': '0.012', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO3': '0.070', 'AMMO4': '0.072', 'weapon4': '0.126', 'WEAPON4': '0.200', 'weapon5': '0.208', 'WEAPON5': '0.400', 'ARMOR': '0.452', 'HITCOUNT': '0.510', 'WEAPON3': '0.550', 'weapon3': '1.640', 'weapon2': '1.642', 'DAMAGECOUNT': '3.105', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:16:59,237][2409074] Updated weights for policy 0, policy_version 21481 (0.0014)
[2023-02-25 13:16:59,430][2409866] DAMAGECOUNT value on done: 7814.0
[2023-02-25 13:16:59,433][2409866] Sum rewards: 12.078, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.810', 'WEAPON1': '0.010', 'AMMO5': '0.025', 'AMMO2': '0.037', 'AMMO3': '0.126', 'WEAPON4': '0.150', 'weapon5': '0.176', 'AMMO4': '0.184', 'weapon4': '0.296', 'WEAPON5': '0.600', 'WEAPON3': '0.850', 'HITCOUNT': '1.060', 'weapon2': '1.148', 'weapon3': '2.036', 'DAMAGECOUNT': '4.440', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:16:59,593][2409389] DAMAGECOUNT value on done: 5558.0
[2023-02-25 13:16:59,596][2409389] Sum rewards: 7.701, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.361', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.020', 'AMMO3': '0.044', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'weapon7': '0.182', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON3': '0.250', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.430', 'weapon2': '0.708', 'weapon3': '0.736', 'weapon4': '1.600', 'DAMAGECOUNT': '1.743', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:16:59,795][2409102] DAMAGECOUNT value on done: 7320.0
[2023-02-25 13:16:59,798][2409102] Sum rewards: 14.276, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.004', 'AMMO5': '0.017', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'weapon7': '0.078', 'AMMO3': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.140', 'WEAPON7': '0.200', 'weapon4': '0.230', 'HEALTH': '0.264', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'HITCOUNT': '0.850', 'weapon2': '1.224', 'ARMOR': '1.309', 'weapon3': '1.784', 'DAMAGECOUNT': '3.249', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:16:59,865][2409373] DAMAGECOUNT value on done: 6348.0
[2023-02-25 13:16:59,866][2409373] Sum rewards: 16.930, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.570', 'AMMO2': '0.011', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'AMMO4': '0.052', 'weapon7': '0.134', 'WEAPON4': '0.150', 'weapon5': '0.216', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'WEAPON5': '0.400', 'HITCOUNT': '0.680', 'weapon4': '0.794', 'weapon3': '0.998', 'weapon2': '1.232', 'DAMAGECOUNT': '3.168', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:17:00,636][2409074] Updated weights for policy 0, policy_version 21491 (0.0012)
[2023-02-25 13:17:00,830][2409549] DAMAGECOUNT value on done: 7391.0
[2023-02-25 13:17:00,830][2409549] Sum rewards: 8.988, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.002', 'AMMO2': '0.007', 'AMMO4': '0.035', 'AMMO5': '0.037', 'AMMO3': '0.166', 'weapon5': '0.182', 'WEAPON4': '0.300', 'weapon4': '0.514', 'WEAPON5': '0.750', 'weapon2': '1.000', 'HITCOUNT': '1.080', 'WEAPON3': '1.100', 'ARMOR': '1.355', 'weapon3': '2.014', 'DAMAGECOUNT': '4.449', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:17:00,890][2409405] DAMAGECOUNT value on done: 6213.0
[2023-02-25 13:17:00,905][2409103] DAMAGECOUNT value on done: 6005.0
[2023-02-25 13:17:00,907][2409405] Sum rewards: 13.922, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.976', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.089', 'AMMO4': '0.123', 'weapon5': '0.136', 'WEAPON4': '0.200', 'weapon4': '0.320', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.850', 'weapon2': '1.076', 'weapon3': '1.786', 'DAMAGECOUNT': '3.408', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:17:00,907][2409103] Sum rewards: 9.658, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO3': '0.052', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'weapon5': '0.196', 'HEALTH': '0.235', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'weapon4': '0.474', 'HITCOUNT': '0.560', 'ARMOR': '0.886', 'weapon3': '1.164', 'weapon2': '1.360', 'DAMAGECOUNT': '1.605', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:17:01,067][2409597] DAMAGECOUNT value on done: 7828.0
[2023-02-25 13:17:01,069][2409597] Sum rewards: 10.418, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.556', 'AMMO2': '0.011', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.054', 'weapon7': '0.066', 'AMMO3': '0.106', 'WEAPON4': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon5': '0.176', 'WEAPON7': '0.200', 'weapon4': '0.238', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'HITCOUNT': '0.880', 'weapon2': '1.510', 'weapon3': '1.660', 'DAMAGECOUNT': '3.063', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:01,091][2409596] DAMAGECOUNT value on done: 7480.0
[2023-02-25 13:17:01,094][2409596] Sum rewards: 12.933, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.900', 'AMMO2': '0.019', 'AMMO5': '0.020', 'AMMO4': '0.092', 'weapon5': '0.116', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.276', 'weapon2': '0.358', 'WEAPON5': '0.450', 'ARMOR': '0.453', 'WEAPON3': '0.650', 'HITCOUNT': '0.880', 'weapon3': '1.882', 'DAMAGECOUNT': '3.867', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:17:01,226][2409104] DAMAGECOUNT value on done: 6160.0
[2023-02-25 13:17:01,226][2409104] Sum rewards: 6.402, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.347', 'AMMO5': '0.015', 'AMMO2': '0.018', 'weapon7': '0.048', 'AMMO3': '0.076', 'AMMO4': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.388', 'ARMOR': '0.400', 'HITCOUNT': '0.460', 'WEAPON3': '0.550', 'weapon2': '1.560', 'weapon3': '1.596', 'DAMAGECOUNT': '2.304', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:17:01,282][2409485] DAMAGECOUNT value on done: 5933.0
[2023-02-25 13:17:01,785][2409077] DAMAGECOUNT value on done: 5815.0
[2023-02-25 13:17:01,786][2409077] Sum rewards: 14.734, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.134', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.021', 'AMMO3': '0.072', 'weapon7': '0.080', 'weapon5': '0.188', 'WEAPON4': '0.200', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'weapon4': '0.348', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.750', 'weapon3': '1.244', 'ARMOR': '1.303', 'weapon2': '1.902', 'DAMAGECOUNT': '3.981', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:17:01,799][2409406] DAMAGECOUNT value on done: 6647.0
[2023-02-25 13:17:01,802][2409406] Sum rewards: 12.247, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.309', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO3': '0.069', 'AMMO4': '0.073', 'weapon5': '0.172', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.600', 'weapon3': '1.282', 'DAMAGECOUNT': '2.349', 'weapon2': '2.384', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:17:02,186][2408954] Fps is (10 sec: 22937.7, 60 sec: 24098.2, 300 sec: 24923.2). Total num frames: 88051712. Throughput: 0: 6062.7. Samples: 22021404. Policy #0 lag: (min: 0.0, avg: 12.8, max: 25.0)
[2023-02-25 13:17:02,187][2408954] Avg episode reward: [(0, '10.203')]
[2023-02-25 13:17:02,256][2409565] DAMAGECOUNT value on done: 7664.0
[2023-02-25 13:17:02,259][2409565] Sum rewards: 16.384, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.262', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.015', 'AMMO4': '0.055', 'weapon7': '0.098', 'AMMO3': '0.112', 'WEAPON4': '0.150', 'weapon5': '0.188', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.256', 'WEAPON7': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '0.790', 'ARMOR': '0.954', 'weapon2': '1.482', 'weapon3': '1.598', 'DAMAGECOUNT': '4.536', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:17:02,535][2409355] DAMAGECOUNT value on done: 5914.0
[2023-02-25 13:17:02,536][2409355] Sum rewards: 10.514, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.799', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO5': '0.025', 'AMMO4': '0.093', 'AMMO3': '0.116', 'WEAPON4': '0.200', 'weapon5': '0.286', 'weapon4': '0.366', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'HITCOUNT': '0.970', 'ARMOR': '1.390', 'weapon2': '1.404', 'weapon3': '1.496', 'DAMAGECOUNT': '3.438', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:02,538][2409105] DAMAGECOUNT value on done: 5469.0
[2023-02-25 13:17:02,539][2409105] Sum rewards: 8.343, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.685', 'AMMO2': '0.020', 'AMMO5': '0.025', 'AMMO3': '0.062', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'weapon5': '0.194', 'WEAPON5': '0.450', 'WEAPON3': '0.450', 'weapon4': '0.494', 'HITCOUNT': '0.550', 'ARMOR': '1.252', 'weapon3': '1.486', 'weapon2': '1.630', 'DAMAGECOUNT': '2.916', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:17:02,712][2409074] Updated weights for policy 0, policy_version 21501 (0.0012)
[2023-02-25 13:17:02,932][2409033] Signal inference workers to stop experience collection... (2600 times)
[2023-02-25 13:17:02,938][2409033] Signal inference workers to resume experience collection... (2600 times)
[2023-02-25 13:17:02,970][2409074] InferenceWorker_p0-w0: stopping experience collection (2600 times)
[2023-02-25 13:17:02,972][2409074] InferenceWorker_p0-w0: resuming experience collection (2600 times)
[2023-02-25 13:17:03,021][2409101] DAMAGECOUNT value on done: 8118.0
[2023-02-25 13:17:03,024][2409101] Sum rewards: 18.159, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.154', 'AMMO2': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.052', 'AMMO3': '0.104', 'weapon5': '0.258', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.710', 'ARMOR': '1.251', 'weapon2': '1.310', 'weapon3': '1.760', 'DAMAGECOUNT': '4.890', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:17:03,101][2409100] DAMAGECOUNT value on done: 6657.0
[2023-02-25 13:17:03,102][2409100] Sum rewards: 17.511, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.186', 'AMMO2': '0.013', 'AMMO5': '0.022', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.109', 'weapon5': '0.202', 'weapon4': '0.220', 'ARMOR': '0.461', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'weapon2': '0.980', 'HITCOUNT': '1.160', 'weapon3': '2.086', 'DAMAGECOUNT': '4.626', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:17:03,159][2409866] DAMAGECOUNT value on done: 6315.0
[2023-02-25 13:17:03,159][2409866] Sum rewards: 5.316, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.562', 'AMMO2': '0.021', 'AMMO5': '0.022', 'weapon5': '0.054', 'weapon7': '0.060', 'AMMO3': '0.096', 'AMMO4': '0.104', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON4': '0.300', 'HITCOUNT': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'weapon4': '0.922', 'weapon3': '1.080', 'weapon2': '1.494', 'DAMAGECOUNT': '1.725', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:17:03,193][2409407] DAMAGECOUNT value on done: 6914.0
[2023-02-25 13:17:03,195][2409407] Sum rewards: 8.960, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.104', 'AMMO2': '0.007', 'AMMO5': '0.022', 'AMMO4': '0.033', 'AMMO3': '0.071', 'weapon5': '0.260', 'WEAPON3': '0.450', 'WEAPON5': '0.450', 'HITCOUNT': '0.710', 'ARMOR': '1.293', 'weapon2': '1.366', 'weapon3': '1.786', 'DAMAGECOUNT': '3.366', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:17:03,346][2409548] DAMAGECOUNT value on done: 7096.0
[2023-02-25 13:17:03,347][2409548] Sum rewards: 12.640, reward structure: {'DEATHCOUNT': '-6.750', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.028', 'weapon5': '0.060', 'weapon7': '0.068', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HEALTH': '0.236', 'WEAPON5': '0.450', 'weapon4': '0.474', 'weapon2': '0.612', 'WEAPON3': '0.650', 'HITCOUNT': '0.830', 'weapon3': '1.934', 'DAMAGECOUNT': '3.180', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:17:03,480][2409389] DAMAGECOUNT value on done: 7560.0
[2023-02-25 13:17:03,484][2409389] Sum rewards: 15.883, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.757', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'AMMO3': '0.088', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'weapon5': '0.326', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'weapon2': '0.650', 'weapon4': '0.868', 'ARMOR': '0.948', 'HITCOUNT': '1.220', 'weapon3': '1.594', 'DAMAGECOUNT': '4.608', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:17:03,721][2409373] DAMAGECOUNT value on done: 7949.0
[2023-02-25 13:17:03,725][2409373] Sum rewards: 7.839, reward structure: {'DEATHCOUNT': '-3.750', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.016', 'weapon5': '0.064', 'AMMO3': '0.078', 'AMMO4': '0.078', 'weapon7': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'HEALTH': '0.170', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.434', 'HITCOUNT': '0.470', 'weapon2': '0.554', 'weapon3': '1.030', 'DAMAGECOUNT': '2.484', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:17:04,132][2409102] DAMAGECOUNT value on done: 6494.0
[2023-02-25 13:17:04,134][2409102] Sum rewards: 12.766, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.268', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.079', 'weapon5': '0.368', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.700', 'weapon3': '1.530', 'weapon2': '1.800', 'DAMAGECOUNT': '3.075', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:17:04,173][2409105] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:17:04,271][2409074] Updated weights for policy 0, policy_version 21511 (0.0013)
[2023-02-25 13:17:04,655][2409103] DAMAGECOUNT value on done: 6007.0
[2023-02-25 13:17:04,658][2409103] Sum rewards: 7.916, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.735', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.025', 'AMMO3': '0.084', 'weapon5': '0.090', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.534', 'WEAPON3': '0.700', 'weapon2': '0.838', 'HITCOUNT': '0.840', 'ARMOR': '0.842', 'weapon3': '1.534', 'DAMAGECOUNT': '3.246', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:17:04,687][2409549] DAMAGECOUNT value on done: 8469.0
[2023-02-25 13:17:04,688][2409549] Sum rewards: 6.243, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.260', 'AMMO5': '0.015', 'AMMO2': '0.020', 'weapon5': '0.044', 'AMMO3': '0.077', 'AMMO4': '0.097', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.350', 'ARMOR': '0.495', 'WEAPON3': '0.600', 'HITCOUNT': '0.810', 'weapon2': '1.520', 'weapon3': '1.552', 'DAMAGECOUNT': '2.673', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:17:05,110][2409485] DAMAGECOUNT value on done: 6432.0
[2023-02-25 13:17:05,113][2409485] Sum rewards: 5.733, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.013', 'AMMO5': '0.015', 'weapon5': '0.036', 'AMMO4': '0.067', 'AMMO3': '0.085', 'weapon7': '0.094', 'WEAPON4': '0.100', 'HEALTH': '0.148', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.410', 'WEAPON3': '0.550', 'ARMOR': '0.800', 'weapon2': '0.804', 'weapon4': '0.958', 'weapon3': '1.348', 'DAMAGECOUNT': '2.205', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:17:05,289][2409405] DAMAGECOUNT value on done: 6554.0
[2023-02-25 13:17:05,289][2409405] Sum rewards: 8.260, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.648', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.059', 'weapon7': '0.062', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.194', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.450', 'weapon4': '0.894', 'weapon3': '1.048', 'weapon2': '1.252', 'DAMAGECOUNT': '2.040', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:17:05,326][2409597] DAMAGECOUNT value on done: 4950.0
[2023-02-25 13:17:05,326][2409597] Sum rewards: 9.886, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.060', 'AMMO5': '0.022', 'AMMO2': '0.026', 'WEAPON1': '0.060', 'AMMO3': '0.083', 'AMMO4': '0.130', 'weapon7': '0.140', 'weapon5': '0.170', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '0.720', 'weapon4': '0.806', 'weapon2': '1.018', 'weapon3': '1.598', 'DAMAGECOUNT': '2.892', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:05,453][2409596] DAMAGECOUNT value on done: 6015.0
[2023-02-25 13:17:05,454][2409596] Sum rewards: 14.284, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.682', 'AMMO2': '0.009', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'AMMO3': '0.083', 'weapon5': '0.164', 'weapon7': '0.178', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'WEAPON7': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.814', 'HITCOUNT': '0.840', 'weapon2': '1.158', 'weapon3': '1.256', 'DAMAGECOUNT': '3.555', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:17:05,643][2409104] DAMAGECOUNT value on done: 7919.0
[2023-02-25 13:17:05,645][2409104] Sum rewards: 6.451, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.116', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO5': '0.024', 'WEAPON4': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.146', 'weapon5': '0.214', 'weapon4': '0.218', 'WEAPON5': '0.550', 'HITCOUNT': '0.650', 'ARMOR': '0.856', 'WEAPON3': '0.900', 'weapon2': '1.316', 'weapon3': '1.854', 'DAMAGECOUNT': '2.445', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:17:05,832][2409406] DAMAGECOUNT value on done: 6195.0
[2023-02-25 13:17:05,833][2409406] Sum rewards: 2.145, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.684', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'AMMO5': '0.012', 'AMMO3': '0.077', 'weapon7': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.166', 'WEAPON7': '0.200', 'HITCOUNT': '0.240', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.095', 'weapon3': '1.344', 'weapon2': '1.722', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:17:05,835][2409077] DAMAGECOUNT value on done: 6487.0
[2023-02-25 13:17:05,837][2409077] Sum rewards: 3.774, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.320', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'AMMO3': '0.084', 'weapon5': '0.122', 'WEAPON4': '0.150', 'AMMO4': '0.152', 'weapon4': '0.240', 'WEAPON5': '0.300', 'HITCOUNT': '0.440', 'WEAPON3': '0.550', 'weapon2': '1.530', 'weapon3': '1.762', 'DAMAGECOUNT': '1.950', 'FRAGCOUNT': '3.500'}
[2023-02-25 13:17:06,195][2409565] DAMAGECOUNT value on done: 7068.0
[2023-02-25 13:17:06,196][2409565] Sum rewards: 6.368, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.910', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.063', 'weapon7': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.140', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'HITCOUNT': '0.470', 'ARMOR': '0.480', 'weapon2': '0.896', 'weapon3': '0.908', 'weapon4': '0.956', 'DAMAGECOUNT': '2.286', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:17:06,241][2409097] DAMAGECOUNT value on done: 8001.0
[2023-02-25 13:17:06,244][2409097] Sum rewards: 18.899, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.490', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.010', 'AMMO3': '0.079', 'WEAPON4': '0.200', 'weapon5': '0.292', 'WEAPON5': '0.350', 'weapon4': '0.512', 'WEAPON3': '0.600', 'ARMOR': '0.906', 'HITCOUNT': '1.080', 'weapon2': '1.444', 'weapon3': '1.486', 'DAMAGECOUNT': '4.677', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:17:06,262][2409355] DAMAGECOUNT value on done: 6445.0
[2023-02-25 13:17:06,265][2409355] Sum rewards: 10.869, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.059', 'AMMO5': '0.003', 'AMMO2': '0.017', 'AMMO3': '0.030', 'weapon5': '0.050', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon7': '0.164', 'WEAPON3': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'weapon4': '0.444', 'HITCOUNT': '0.680', 'weapon3': '0.714', 'weapon2': '2.160', 'DAMAGECOUNT': '2.841', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:17:06,307][2409074] Updated weights for policy 0, policy_version 21521 (0.0012)
[2023-02-25 13:17:06,828][2409866] DAMAGECOUNT value on done: 7188.0
[2023-02-25 13:17:06,830][2409866] Sum rewards: 11.884, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.227', 'AMMO2': '0.016', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'weapon7': '0.052', 'AMMO3': '0.060', 'AMMO4': '0.079', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.190', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'WEAPON5': '0.500', 'HITCOUNT': '0.550', 'weapon2': '0.564', 'ARMOR': '0.883', 'weapon4': '0.978', 'weapon3': '1.188', 'DAMAGECOUNT': '3.021', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:17:06,936][2409407] DAMAGECOUNT value on done: 8871.0
[2023-02-25 13:17:06,937][2409407] Sum rewards: 13.936, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.183', 'AMMO5': '0.020', 'AMMO2': '0.027', 'weapon7': '0.070', 'AMMO3': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.132', 'WEAPON7': '0.200', 'weapon5': '0.246', 'WEAPON4': '0.350', 'ARMOR': '0.455', 'WEAPON5': '0.500', 'weapon2': '0.708', 'WEAPON3': '0.750', 'weapon4': '0.754', 'HITCOUNT': '1.130', 'weapon3': '1.826', 'DAMAGECOUNT': '4.854', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:17:07,036][2409105] DAMAGECOUNT value on done: 8290.0
[2023-02-25 13:17:07,037][2409105] Sum rewards: 16.549, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.633', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.029', 'AMMO3': '0.040', 'weapon7': '0.052', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.282', 'WEAPON3': '0.300', 'HITCOUNT': '0.590', 'weapon3': '0.740', 'weapon4': '0.916', 'weapon2': '1.196', 'ARMOR': '1.273', 'DAMAGECOUNT': '2.958', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:17:07,053][2409389] DAMAGECOUNT value on done: 7563.0
[2023-02-25 13:17:07,057][2409389] Sum rewards: 2.772, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.220', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon5': '0.052', 'AMMO3': '0.059', 'weapon7': '0.064', 'AMMO4': '0.077', 'weapon2': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.310', 'WEAPON3': '0.350', 'weapon3': '0.554', 'weapon4': '0.666', 'DAMAGECOUNT': '1.317', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:17:07,071][2409101] DAMAGECOUNT value on done: 6976.0
[2023-02-25 13:17:07,072][2409101] Sum rewards: 16.486, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.145', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO3': '0.060', 'weapon5': '0.062', 'weapon7': '0.066', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'weapon4': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'ARMOR': '0.455', 'HITCOUNT': '0.920', 'weapon3': '1.480', 'weapon2': '1.790', 'DAMAGECOUNT': '3.891', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:17:07,186][2408954] Fps is (10 sec: 23756.9, 60 sec: 24303.0, 300 sec: 24895.3). Total num frames: 88174592. Throughput: 0: 6043.5. Samples: 22039380. Policy #0 lag: (min: 0.0, avg: 12.8, max: 25.0)
[2023-02-25 13:17:07,186][2408954] Avg episode reward: [(0, '10.254')]
[2023-02-25 13:17:07,237][2409100] DAMAGECOUNT value on done: 5979.0
[2023-02-25 13:17:07,238][2409100] Sum rewards: 3.282, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.394', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO5': '0.022', 'AMMO4': '0.076', 'AMMO3': '0.124', 'weapon7': '0.132', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.266', 'WEAPON4': '0.300', 'HITCOUNT': '0.380', 'WEAPON5': '0.600', 'weapon4': '0.716', 'WEAPON3': '0.800', 'weapon2': '1.088', 'weapon3': '1.344', 'ARMOR': '1.794', 'DAMAGECOUNT': '1.908', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:17:07,511][2409074] Updated weights for policy 0, policy_version 21531 (0.0012)
[2023-02-25 13:17:07,512][2409373] DAMAGECOUNT value on done: 6641.0
[2023-02-25 13:17:07,513][2409373] Sum rewards: 0.410, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.672', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.070', 'weapon5': '0.208', 'WEAPON5': '0.400', 'HITCOUNT': '0.450', 'ARMOR': '0.455', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.344', 'weapon2': '1.388', 'weapon3': '1.728'}
[2023-02-25 13:17:07,618][2409548] DAMAGECOUNT value on done: 6785.0
[2023-02-25 13:17:07,619][2409548] Sum rewards: 11.619, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.290', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'AMMO5': '0.017', 'AMMO3': '0.052', 'WEAPON4': '0.100', 'weapon5': '0.116', 'weapon4': '0.252', 'WEAPON3': '0.350', 'WEAPON5': '0.400', 'HITCOUNT': '0.620', 'ARMOR': '1.047', 'weapon3': '1.058', 'weapon2': '1.442', 'DAMAGECOUNT': '2.955', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:07,769][2409102] DAMAGECOUNT value on done: 6557.0
[2023-02-25 13:17:07,772][2409102] Sum rewards: 5.178, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.580', 'AMMO2': '0.011', 'AMMO3': '0.020', 'weapon7': '0.052', 'AMMO4': '0.056', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.280', 'WEAPON4': '0.400', 'weapon3': '0.476', 'weapon2': '0.674', 'DAMAGECOUNT': '0.897', 'weapon4': '1.252', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:17:08,695][2409549] DAMAGECOUNT value on done: 7125.0
[2023-02-25 13:17:08,696][2409549] Sum rewards: 10.809, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.016', 'AMMO5': '0.017', 'ARMOR': '0.040', 'HEALTH': '0.064', 'AMMO3': '0.070', 'AMMO4': '0.080', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'weapon4': '0.568', 'HITCOUNT': '0.810', 'weapon2': '1.356', 'weapon3': '1.490', 'DAMAGECOUNT': '2.781', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:17:08,857][2409103] DAMAGECOUNT value on done: 5262.0
[2023-02-25 13:17:08,857][2409103] Sum rewards: 9.996, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.018', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon4': '0.046', 'AMMO3': '0.060', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'weapon5': '0.436', 'WEAPON3': '0.500', 'WEAPON5': '0.500', 'HITCOUNT': '0.720', 'ARMOR': '0.863', 'weapon3': '1.560', 'weapon2': '1.612', 'DAMAGECOUNT': '3.639', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:17:09,289][2409405] DAMAGECOUNT value on done: 7156.0
[2023-02-25 13:17:09,290][2409405] Sum rewards: 24.152, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.518', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.023', 'AMMO3': '0.075', 'AMMO4': '0.113', 'WEAPON4': '0.250', 'weapon5': '0.288', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon4': '0.550', 'HITCOUNT': '1.390', 'weapon2': '1.412', 'weapon3': '1.436', 'DAMAGECOUNT': '6.756', 'FRAGCOUNT': '17.000'}
[2023-02-25 13:17:09,291][2409485] DAMAGECOUNT value on done: 6820.0
[2023-02-25 13:17:09,293][2409485] Sum rewards: 8.391, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.825', 'AMMO2': '0.010', 'weapon4': '0.026', 'AMMO5': '0.037', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.123', 'weapon5': '0.412', 'HITCOUNT': '0.640', 'WEAPON5': '0.750', 'WEAPON3': '0.800', 'ARMOR': '0.899', 'weapon2': '1.300', 'weapon3': '1.968', 'DAMAGECOUNT': '3.153', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:09,502][2409597] DAMAGECOUNT value on done: 8290.0
[2023-02-25 13:17:09,503][2409597] Sum rewards: 23.620, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.048', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.049', 'AMMO3': '0.060', 'weapon7': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.340', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'ARMOR': '0.499', 'weapon4': '0.684', 'HITCOUNT': '0.870', 'weapon2': '1.220', 'weapon3': '1.338', 'DAMAGECOUNT': '5.670', 'FRAGCOUNT': '16.000'}
[2023-02-25 13:17:09,646][2409075] DAMAGECOUNT value on done: 6356.0
[2023-02-25 13:17:09,647][2409075] Sum rewards: 15.732, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.367', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.062', 'weapon7': '0.072', 'AMMO3': '0.087', 'AMMO4': '0.108', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.600', 'weapon4': '0.612', 'HITCOUNT': '0.820', 'ARMOR': '0.833', 'weapon2': '1.172', 'weapon3': '1.544', 'DAMAGECOUNT': '2.667', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:17:09,714][2409074] Updated weights for policy 0, policy_version 21541 (0.0015)
[2023-02-25 13:17:09,769][2409596] DAMAGECOUNT value on done: 7589.0
[2023-02-25 13:17:09,770][2409596] Sum rewards: 8.997, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.280', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.010', 'weapon5': '0.082', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'weapon7': '0.100', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'weapon4': '0.262', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.650', 'weapon3': '1.292', 'weapon2': '2.070', 'DAMAGECOUNT': '2.631', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:17:09,985][2409104] DAMAGECOUNT value on done: 7166.0
[2023-02-25 13:17:09,989][2409104] Sum rewards: 11.279, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.982', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO3': '0.059', 'AMMO4': '0.075', 'weapon7': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.214', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HITCOUNT': '0.340', 'WEAPON3': '0.350', 'weapon4': '0.454', 'weapon3': '0.488', 'ARMOR': '0.851', 'weapon2': '1.430', 'DAMAGECOUNT': '2.280', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:17:10,021][2409355] DAMAGECOUNT value on done: 7481.0
[2023-02-25 13:17:10,022][2409355] Sum rewards: 10.833, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.930', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'WEAPON1': '0.040', 'AMMO3': '0.053', 'weapon7': '0.082', 'WEAPON4': '0.100', 'weapon5': '0.140', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.422', 'WEAPON3': '0.500', 'HITCOUNT': '0.740', 'weapon2': '1.146', 'weapon3': '1.202', 'DAMAGECOUNT': '3.045', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:10,220][2409565] DAMAGECOUNT value on done: 7667.0
[2023-02-25 13:17:10,221][2409565] Sum rewards: 7.146, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.580', 'AMMO2': '0.009', 'AMMO5': '0.015', 'AMMO4': '0.046', 'weapon7': '0.052', 'AMMO3': '0.058', 'weapon5': '0.080', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'ARMOR': '0.400', 'HITCOUNT': '0.550', 'weapon4': '0.872', 'weapon3': '1.118', 'weapon2': '1.392', 'DAMAGECOUNT': '1.944', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:17:10,355][2409097] DAMAGECOUNT value on done: 6531.0
[2023-02-25 13:17:10,356][2409097] Sum rewards: 8.764, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.326', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon7': '0.086', 'AMMO3': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'weapon5': '0.152', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.390', 'weapon4': '0.526', 'WEAPON3': '0.700', 'weapon2': '1.246', 'weapon3': '1.348', 'ARMOR': '1.715', 'DAMAGECOUNT': '2.511', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:17:10,516][2409078] DAMAGECOUNT value on done: 6463.0
[2023-02-25 13:17:10,518][2409078] Sum rewards: 12.482, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.097', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO3': '0.040', 'weapon7': '0.054', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.158', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.520', 'weapon4': '0.664', 'ARMOR': '0.851', 'weapon3': '0.966', 'weapon2': '1.570', 'DAMAGECOUNT': '2.475', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:10,578][2409866] DAMAGECOUNT value on done: 4864.0
[2023-02-25 13:17:10,579][2409866] Sum rewards: 10.987, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.316', 'AMMO5': '0.005', 'AMMO2': '0.027', 'AMMO3': '0.042', 'weapon7': '0.064', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.134', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'weapon4': '0.428', 'HITCOUNT': '0.580', 'ARMOR': '0.855', 'weapon3': '0.934', 'weapon2': '1.584', 'DAMAGECOUNT': '2.262', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:17:10,746][2409097] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)]
[2023-02-25 13:17:10,822][2409101] DAMAGECOUNT value on done: 7024.0
[2023-02-25 13:17:10,823][2409101] Sum rewards: 12.931, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.202', 'AMMO2': '0.017', 'AMMO5': '0.032', 'WEAPON1': '0.040', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon5': '0.166', 'WEAPON5': '0.650', 'WEAPON3': '0.700', 'HITCOUNT': '0.760', 'ARMOR': '0.942', 'weapon2': '1.428', 'weapon3': '2.080', 'DAMAGECOUNT': '3.531', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:17:11,031][2409407] DAMAGECOUNT value on done: 8324.0
[2023-02-25 13:17:11,032][2409407] Sum rewards: 12.692, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.588', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.024', 'AMMO3': '0.051', 'weapon5': '0.054', 'WEAPON4': '0.100', 'weapon7': '0.140', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.228', 'WEAPON3': '0.400', 'HITCOUNT': '0.640', 'weapon3': '0.710', 'ARMOR': '0.800', 'weapon2': '1.900', 'DAMAGECOUNT': '3.171', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:11,036][2409105] DAMAGECOUNT value on done: 6307.0
[2023-02-25 13:17:11,037][2409105] Sum rewards: 9.515, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.910', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'AMMO3': '0.020', 'weapon7': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'weapon3': '0.544', 'HITCOUNT': '0.580', 'weapon2': '0.970', 'weapon4': '1.352', 'DAMAGECOUNT': '2.031', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:17:11,194][2409406] DAMAGECOUNT value on done: 7148.0
[2023-02-25 13:17:11,197][2409406] Sum rewards: 15.853, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.085', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.302', 'WEAPON3': '0.500', 'HITCOUNT': '0.910', 'weapon3': '1.238', 'weapon2': '1.518', 'DAMAGECOUNT': '3.717', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:17:11,205][2409077] DAMAGECOUNT value on done: 5502.0
[2023-02-25 13:17:11,206][2409077] Sum rewards: 12.987, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.970', 'AMMO5': '0.018', 'AMMO2': '0.024', 'weapon5': '0.054', 'AMMO4': '0.117', 'AMMO3': '0.126', 'WEAPON4': '0.150', 'weapon4': '0.346', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'ARMOR': '0.946', 'HITCOUNT': '1.030', 'weapon2': '1.124', 'weapon3': '1.752', 'DAMAGECOUNT': '3.870', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:17:11,223][2409389] DAMAGECOUNT value on done: 5532.0
[2023-02-25 13:17:11,224][2409389] Sum rewards: 7.312, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'HEALTH': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.030', 'WEAPON4': '0.100', 'AMMO4': '0.131', 'weapon5': '0.156', 'weapon7': '0.160', 'WEAPON3': '0.200', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.400', 'weapon4': '0.422', 'weapon3': '0.856', 'weapon2': '1.812', 'DAMAGECOUNT': '2.139', 'FRAGCOUNT': '2.500'}
[2023-02-25 13:17:11,287][2409074] Updated weights for policy 0, policy_version 21551 (0.0012)
[2023-02-25 13:17:11,342][2409080] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:17:11,770][2409373] DAMAGECOUNT value on done: 7359.0
[2023-02-25 13:17:11,770][2409373] Sum rewards: 11.711, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon7': '0.056', 'AMMO3': '0.086', 'HEALTH': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.129', 'weapon5': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.544', 'WEAPON3': '0.550', 'weapon2': '0.780', 'HITCOUNT': '0.820', 'weapon3': '1.830', 'DAMAGECOUNT': '3.432', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:17:12,009][2409469] DAMAGECOUNT value on done: 7164.0
[2023-02-25 13:17:12,014][2409469] Sum rewards: 12.847, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.562', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'weapon7': '0.050', 'AMMO2': '0.052', 'AMMO3': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.190', 'WEAPON7': '0.200', 'AMMO4': '0.262', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '0.600', 'HITCOUNT': '0.770', 'weapon2': '0.862', 'weapon4': '1.166', 'weapon3': '1.302', 'DAMAGECOUNT': '3.816', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:17:12,034][2409102] DAMAGECOUNT value on done: 7573.0
[2023-02-25 13:17:12,034][2409102] Sum rewards: 7.180, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.174', 'AMMO5': '0.017', 'AMMO2': '0.021', 'AMMO3': '0.072', 'AMMO4': '0.106', 'weapon5': '0.116', 'weapon7': '0.206', 'WEAPON4': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.440', 'WEAPON3': '0.500', 'weapon3': '0.832', 'ARMOR': '0.875', 'weapon2': '1.104', 'weapon4': '1.476', 'DAMAGECOUNT': '2.598', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:17:12,186][2408954] Fps is (10 sec: 24575.9, 60 sec: 24303.0, 300 sec: 24950.9). Total num frames: 88297472. Throughput: 0: 6004.6. Samples: 22075032. Policy #0 lag: (min: 1.0, avg: 12.2, max: 23.0)
[2023-02-25 13:17:12,186][2408954] Avg episode reward: [(0, '10.620')]
[2023-02-25 13:17:12,512][2409103] DAMAGECOUNT value on done: 5898.0
[2023-02-25 13:17:12,515][2409103] Sum rewards: 13.081, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.655', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO3': '0.040', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'weapon7': '0.104', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.300', 'WEAPON7': '0.400', 'weapon4': '0.766', 'weapon3': '0.814', 'HITCOUNT': '1.010', 'weapon2': '1.070', 'DAMAGECOUNT': '4.194', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:12,578][2409549] DAMAGECOUNT value on done: 7814.0
[2023-02-25 13:17:12,582][2409549] Sum rewards: 10.637, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.841', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.024', 'AMMO3': '0.068', 'WEAPON4': '0.150', 'weapon4': '0.192', 'WEAPON5': '0.200', 'weapon5': '0.236', 'WEAPON3': '0.450', 'HITCOUNT': '0.740', 'ARMOR': '0.930', 'weapon3': '1.198', 'weapon2': '2.132', 'DAMAGECOUNT': '3.381', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:17:12,811][2409074] Updated weights for policy 0, policy_version 21561 (0.0012)
[2023-02-25 13:17:12,844][2409100] DAMAGECOUNT value on done: 6374.0
[2023-02-25 13:17:12,845][2409100] Sum rewards: 7.560, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.352', 'AMMO5': '0.018', 'AMMO2': '0.038', 'weapon7': '0.066', 'weapon5': '0.068', 'AMMO3': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.340', 'WEAPON3': '0.550', 'HITCOUNT': '0.840', 'ARMOR': '0.855', 'weapon3': '1.500', 'weapon2': '1.758', 'DAMAGECOUNT': '3.057', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:17:12,944][2409485] DAMAGECOUNT value on done: 6998.0
[2023-02-25 13:17:12,947][2409485] Sum rewards: 13.393, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.126', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.040', 'WEAPON5': '0.050', 'weapon7': '0.076', 'WEAPON4': '0.100', 'weapon5': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'weapon4': '0.360', 'ARMOR': '0.400', 'HITCOUNT': '0.620', 'weapon3': '0.998', 'weapon2': '1.158', 'DAMAGECOUNT': '3.087', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:13,112][2409597] DAMAGECOUNT value on done: 6701.0
[2023-02-25 13:17:13,113][2409597] Sum rewards: 6.315, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.017', 'AMMO5': '0.003', 'weapon5': '0.026', 'AMMO3': '0.030', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'AMMO4': '0.154', 'weapon7': '0.156', 'WEAPON3': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HITCOUNT': '0.340', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon3': '0.576', 'weapon2': '0.816', 'DAMAGECOUNT': '1.383', 'weapon4': '1.578', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:17:13,301][2409548] DAMAGECOUNT value on done: 6688.0
[2023-02-25 13:17:13,302][2409548] Sum rewards: 13.154, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.081', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.040', 'AMMO3': '0.093', 'AMMO4': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.282', 'weapon4': '0.296', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.800', 'weapon2': '1.154', 'weapon3': '1.804', 'DAMAGECOUNT': '3.828', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:17:13,409][2409405] DAMAGECOUNT value on done: 6725.0
[2023-02-25 13:17:13,409][2409405] Sum rewards: 8.621, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.203', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO5': '0.015', 'AMMO4': '0.070', 'AMMO3': '0.073', 'weapon5': '0.170', 'weapon7': '0.190', 'AMMO6': '0.280', 'AMMO7': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'HITCOUNT': '0.420', 'weapon2': '0.494', 'WEAPON3': '0.500', 'weapon4': '0.810', 'ARMOR': '0.918', 'weapon3': '1.332', 'DAMAGECOUNT': '2.448', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:17:13,472][2409075] DAMAGECOUNT value on done: 7519.0
[2023-02-25 13:17:13,473][2409075] Sum rewards: 13.366, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.590', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.019', 'AMMO3': '0.042', 'weapon7': '0.072', 'weapon5': '0.130', 'WEAPON4': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.770', 'ARMOR': '0.903', 'weapon3': '1.034', 'weapon2': '1.046', 'weapon4': '1.082', 'DAMAGECOUNT': '4.062', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:17:13,476][2409596] DAMAGECOUNT value on done: 6680.0
[2023-02-25 13:17:13,479][2409596] Sum rewards: 13.246, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.839', 'AMMO2': '0.004', 'AMMO5': '0.017', 'AMMO4': '0.019', 'AMMO3': '0.078', 'weapon5': '0.172', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '0.860', 'weapon2': '1.454', 'weapon3': '1.522', 'DAMAGECOUNT': '3.408', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:17:13,759][2409104] DAMAGECOUNT value on done: 6378.0
[2023-02-25 13:17:13,762][2409104] Sum rewards: 12.543, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.219', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.013', 'AMMO3': '0.048', 'weapon5': '0.136', 'weapon7': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.350', 'WEAPON7': '0.400', 'ARMOR': '0.463', 'HITCOUNT': '0.750', 'weapon3': '0.764', 'weapon2': '0.884', 'weapon4': '1.048', 'DAMAGECOUNT': '3.624', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:13,953][2409355] DAMAGECOUNT value on done: 7041.0
[2023-02-25 13:17:13,957][2409355] Sum rewards: 9.273, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.868', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO4': '0.023', 'AMMO3': '0.159', 'weapon5': '0.236', 'WEAPON5': '0.600', 'HITCOUNT': '0.980', 'WEAPON3': '1.100', 'weapon2': '1.300', 'weapon3': '2.084', 'DAMAGECOUNT': '3.612', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:17:14,180][2409565] DAMAGECOUNT value on done: 7120.0
[2023-02-25 13:17:14,181][2409565] Sum rewards: 7.592, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.430', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon7': '0.070', 'AMMO3': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.186', 'WEAPON7': '0.200', 'weapon4': '0.298', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.800', 'weapon2': '1.062', 'ARMOR': '1.390', 'weapon3': '1.682', 'DAMAGECOUNT': '2.811', 'FRAGCOUNT': '6.500'}
[2023-02-25 13:17:14,405][2409097] DAMAGECOUNT value on done: 7372.0
[2023-02-25 13:17:14,411][2409097] Sum rewards: 13.456, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.852', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'ARMOR': '0.004', 'AMMO5': '0.015', 'WEAPON4': '0.050', 'weapon7': '0.054', 'AMMO3': '0.072', 'weapon5': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.400', 'weapon4': '0.598', 'WEAPON3': '0.600', 'HITCOUNT': '0.900', 'weapon2': '1.136', 'weapon3': '1.712', 'DAMAGECOUNT': '2.886', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:17:14,486][2409078] DAMAGECOUNT value on done: 6590.0
[2023-02-25 13:17:14,490][2409078] Sum rewards: 20.049, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.497', 'AMMO5': '0.019', 'AMMO2': '0.036', 'weapon5': '0.038', 'weapon7': '0.076', 'AMMO3': '0.085', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.181', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.574', 'WEAPON3': '0.600', 'weapon2': '0.806', 'HITCOUNT': '1.200', 'weapon3': '1.372', 'DAMAGECOUNT': '4.968', 'FRAGCOUNT': '17.000'}
[2023-02-25 13:17:14,526][2409074] Updated weights for policy 0, policy_version 21571 (0.0012)
[2023-02-25 13:17:14,527][2409866] DAMAGECOUNT value on done: 6841.0
[2023-02-25 13:17:14,531][2409866] Sum rewards: 6.350, reward structure: {'DEATHCOUNT': '-8.250', 'WEAPON1': '0.010', 'AMMO5': '0.024', 'AMMO2': '0.030', 'AMMO3': '0.104', 'AMMO4': '0.147', 'weapon5': '0.176', 'WEAPON4': '0.200', 'HEALTH': '0.337', 'weapon4': '0.342', 'ARMOR': '0.453', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '0.740', 'weapon2': '0.968', 'weapon3': '2.144', 'DAMAGECOUNT': '2.775', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:17:14,630][2409407] DAMAGECOUNT value on done: 10447.0
[2023-02-25 13:17:14,631][2409407] Sum rewards: 5.914, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.547', 'AMMO5': '0.022', 'AMMO2': '0.023', 'weapon7': '0.048', 'AMMO3': '0.103', 'weapon5': '0.110', 'AMMO4': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.436', 'WEAPON5': '0.550', 'HITCOUNT': '0.710', 'WEAPON3': '0.750', 'weapon4': '0.990', 'weapon2': '1.154', 'weapon3': '1.372', 'DAMAGECOUNT': '3.090', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:14,815][2409389] DAMAGECOUNT value on done: 6802.0
[2023-02-25 13:17:14,815][2409389] Sum rewards: 8.864, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.830', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'AMMO3': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.054', 'weapon7': '0.074', 'weapon5': '0.146', 'WEAPON5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.540', 'weapon3': '0.984', 'DAMAGECOUNT': '2.385', 'weapon2': '2.570', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:17:14,858][2409105] DAMAGECOUNT value on done: 6676.0
[2023-02-25 13:17:14,862][2409105] Sum rewards: 10.538, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO3': '0.060', 'AMMO4': '0.063', 'weapon7': '0.074', 'HEALTH': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.328', 'WEAPON3': '0.400', 'ARMOR': '0.400', 'HITCOUNT': '0.640', 'weapon2': '0.880', 'weapon3': '1.336', 'DAMAGECOUNT': '2.559', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:14,904][2409101] DAMAGECOUNT value on done: 5860.0
[2023-02-25 13:17:14,908][2409101] Sum rewards: 11.148, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.822', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO3': '0.080', 'weapon5': '0.096', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.416', 'WEAPON3': '0.600', 'HITCOUNT': '0.700', 'ARMOR': '0.856', 'weapon3': '1.454', 'weapon2': '1.874', 'DAMAGECOUNT': '2.862', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:17:15,283][2409405] Large shaping reward 3.642 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:17:15,753][2409102] DAMAGECOUNT value on done: 6790.0
[2023-02-25 13:17:15,754][2409102] Sum rewards: 7.762, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.564', 'AMMO5': '0.005', 'AMMO3': '0.030', 'AMMO2': '0.046', 'weapon5': '0.086', 'weapon7': '0.136', 'WEAPON5': '0.150', 'WEAPON3': '0.200', 'AMMO4': '0.230', 'AMMO6': '0.240', 'AMMO7': '0.240', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'WEAPON4': '0.500', 'HITCOUNT': '0.590', 'weapon3': '0.640', 'weapon2': '1.292', 'weapon4': '1.478', 'DAMAGECOUNT': '2.412', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:17:16,011][2409074] Updated weights for policy 0, policy_version 21581 (0.0013)
[2023-02-25 13:17:16,155][2409469] DAMAGECOUNT value on done: 6698.0
[2023-02-25 13:17:16,160][2409469] Sum rewards: 11.616, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.892', 'AMMO2': '0.011', 'AMMO5': '0.022', 'AMMO4': '0.053', 'AMMO3': '0.064', 'WEAPON4': '0.100', 'weapon7': '0.140', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.258', 'WEAPON7': '0.300', 'weapon5': '0.398', 'WEAPON3': '0.450', 'WEAPON5': '0.450', 'HITCOUNT': '0.650', 'ARMOR': '0.800', 'weapon3': '1.104', 'weapon2': '1.934', 'DAMAGECOUNT': '3.834', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:17:16,252][2409406] DAMAGECOUNT value on done: 7545.0
[2023-02-25 13:17:16,257][2409406] Sum rewards: 7.114, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.340', 'AMMO2': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.034', 'AMMO3': '0.056', 'weapon7': '0.064', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.258', 'WEAPON3': '0.300', 'HITCOUNT': '0.420', 'weapon4': '0.438', 'ARMOR': '0.451', 'weapon3': '0.864', 'weapon2': '1.048', 'DAMAGECOUNT': '1.704', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:17:16,277][2409077] DAMAGECOUNT value on done: 7279.0
[2023-02-25 13:17:16,278][2409077] Sum rewards: 14.728, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.164', 'AMMO2': '0.006', 'AMMO5': '0.027', 'AMMO4': '0.031', 'AMMO3': '0.066', 'weapon7': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.260', 'weapon4': '0.406', 'ARMOR': '0.447', 'WEAPON3': '0.550', 'WEAPON5': '0.600', 'HITCOUNT': '0.660', 'weapon2': '1.370', 'weapon3': '1.382', 'DAMAGECOUNT': '3.864', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:17:16,405][2409373] DAMAGECOUNT value on done: 7059.0
[2023-02-25 13:17:16,406][2409373] Sum rewards: 5.375, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.975', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.019', 'WEAPON1': '0.020', 'weapon7': '0.078', 'AMMO3': '0.085', 'weapon5': '0.092', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'weapon2': '0.806', 'weapon4': '1.216', 'weapon3': '1.228', 'DAMAGECOUNT': '1.725', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:17:16,419][2409549] DAMAGECOUNT value on done: 6085.0
[2023-02-25 13:17:16,420][2409549] Sum rewards: 6.116, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.672', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO5': '0.017', 'weapon5': '0.054', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'weapon4': '0.218', 'WEAPON5': '0.400', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.690', 'weapon2': '1.280', 'weapon3': '1.556', 'DAMAGECOUNT': '2.385', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:17:16,509][2409103] DAMAGECOUNT value on done: 8149.0
[2023-02-25 13:17:16,510][2409103] Sum rewards: 12.020, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.906', 'AMMO5': '0.028', 'AMMO2': '0.032', 'weapon7': '0.052', 'AMMO3': '0.085', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.159', 'WEAPON7': '0.200', 'weapon5': '0.226', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon4': '0.422', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.920', 'weapon2': '1.096', 'weapon3': '1.866', 'DAMAGECOUNT': '3.501', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:17:16,985][2409485] DAMAGECOUNT value on done: 6503.0
[2023-02-25 13:17:16,990][2409485] Sum rewards: 6.497, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.213', 'AMMO5': '0.013', 'AMMO2': '0.014', 'AMMO4': '0.069', 'AMMO3': '0.070', 'weapon7': '0.082', 'weapon5': '0.182', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.410', 'WEAPON3': '0.500', 'weapon4': '0.710', 'weapon2': '1.106', 'weapon3': '1.262', 'DAMAGECOUNT': '1.902', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:17:17,062][2409597] DAMAGECOUNT value on done: 6563.0
[2023-02-25 13:17:17,066][2409597] Sum rewards: 10.666, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.578', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon7': '0.066', 'AMMO3': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'weapon5': '0.176', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'HITCOUNT': '0.650', 'weapon2': '1.084', 'weapon4': '1.112', 'ARMOR': '1.287', 'weapon3': '1.384', 'DAMAGECOUNT': '2.559', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:17:17,186][2408954] Fps is (10 sec: 22937.6, 60 sec: 24029.9, 300 sec: 24853.7). Total num frames: 88403968. Throughput: 0: 6011.2. Samples: 22111224. Policy #0 lag: (min: 1.0, avg: 12.2, max: 23.0)
[2023-02-25 13:17:17,186][2408954] Avg episode reward: [(0, '10.635')]
[2023-02-25 13:17:17,243][2409405] DAMAGECOUNT value on done: 8686.0
[2023-02-25 13:17:17,247][2409405] Sum rewards: 19.560, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.312', 'AMMO2': '0.014', 'AMMO5': '0.016', 'AMMO3': '0.060', 'AMMO4': '0.070', 'weapon7': '0.148', 'weapon5': '0.186', 'WEAPON4': '0.250', 'weapon4': '0.292', 'WEAPON5': '0.300', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON3': '0.400', 'WEAPON7': '0.500', 'ARMOR': '0.850', 'HITCOUNT': '1.010', 'weapon3': '1.258', 'weapon2': '1.594', 'DAMAGECOUNT': '5.244', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:17:17,482][2409075] DAMAGECOUNT value on done: 8000.0
[2023-02-25 13:17:17,485][2409075] Sum rewards: 15.879, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.450', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.015', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'weapon4': '0.206', 'weapon5': '0.258', 'WEAPON5': '0.300', 'ARMOR': '0.458', 'WEAPON3': '0.800', 'weapon2': '0.952', 'HITCOUNT': '1.000', 'weapon3': '2.122', 'DAMAGECOUNT': '4.254', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:17:17,604][2409596] DAMAGECOUNT value on done: 6610.0
[2023-02-25 13:17:17,606][2409596] Sum rewards: 8.795, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.011', 'AMMO5': '0.028', 'AMMO2': '0.037', 'WEAPON1': '0.060', 'weapon7': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.118', 'weapon5': '0.124', 'AMMO4': '0.185', 'WEAPON4': '0.200', 'weapon4': '0.278', 'WEAPON5': '0.550', 'HITCOUNT': '0.810', 'ARMOR': '0.834', 'WEAPON3': '0.900', 'weapon2': '0.930', 'weapon3': '2.008', 'DAMAGECOUNT': '3.360', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:17:17,673][2409100] DAMAGECOUNT value on done: 7321.0
[2023-02-25 13:17:17,674][2409100] Sum rewards: 14.517, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.455', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.086', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'weapon7': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.140', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.446', 'weapon4': '0.468', 'WEAPON3': '0.550', 'HITCOUNT': '0.950', 'weapon2': '1.316', 'weapon3': '1.704', 'DAMAGECOUNT': '3.225', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:17:17,924][2409565] DAMAGECOUNT value on done: 7725.0
[2023-02-25 13:17:17,924][2409565] Sum rewards: 16.291, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.003', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon7': '0.070', 'AMMO3': '0.077', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.200', 'weapon4': '0.280', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.880', 'ARMOR': '0.901', 'weapon2': '1.540', 'weapon3': '1.620', 'DAMAGECOUNT': '4.341', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:17:17,973][2409104] DAMAGECOUNT value on done: 7064.0
[2023-02-25 13:17:17,976][2409104] Sum rewards: 8.137, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.033', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO3': '0.074', 'AMMO4': '0.104', 'weapon5': '0.138', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '0.500', 'weapon2': '0.654', 'HITCOUNT': '0.760', 'ARMOR': '0.800', 'weapon4': '1.024', 'weapon3': '1.332', 'DAMAGECOUNT': '2.400', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:17:18,122][2409548] DAMAGECOUNT value on done: 6821.0
[2023-02-25 13:17:18,125][2409548] Sum rewards: 12.182, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.966', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO5': '0.027', 'WEAPON4': '0.050', 'AMMO4': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.124', 'AMMO3': '0.131', 'weapon5': '0.296', 'weapon4': '0.466', 'WEAPON5': '0.500', 'HITCOUNT': '0.790', 'WEAPON3': '0.800', 'ARMOR': '0.849', 'weapon2': '1.034', 'weapon3': '1.652', 'DAMAGECOUNT': '3.534', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:17:18,127][2409074] Updated weights for policy 0, policy_version 21591 (0.0012)
[2023-02-25 13:17:18,256][2409355] DAMAGECOUNT value on done: 7134.0
[2023-02-25 13:17:18,256][2409355] Sum rewards: 12.583, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.207', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO3': '0.063', 'AMMO4': '0.065', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.100', 'weapon5': '0.212', 'WEAPON5': '0.250', 'HITCOUNT': '0.390', 'WEAPON3': '0.450', 'ARMOR': '0.451', 'weapon4': '0.836', 'weapon3': '0.986', 'weapon2': '1.558', 'DAMAGECOUNT': '2.805', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:18,273][2409407] DAMAGECOUNT value on done: 6133.0
[2023-02-25 13:17:18,274][2409407] Sum rewards: 16.473, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.070', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.069', 'weapon7': '0.070', 'AMMO4': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.184', 'WEAPON5': '0.250', 'ARMOR': '0.408', 'WEAPON3': '0.450', 'weapon4': '0.480', 'HITCOUNT': '0.910', 'weapon2': '0.920', 'weapon3': '1.310', 'DAMAGECOUNT': '3.699', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:17:18,349][2409078] DAMAGECOUNT value on done: 6574.0
[2023-02-25 13:17:18,350][2409078] Sum rewards: 4.649, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.330', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.036', 'weapon7': '0.066', 'AMMO3': '0.068', 'weapon5': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.177', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.410', 'weapon4': '1.088', 'DAMAGECOUNT': '1.170', 'weapon3': '1.192', 'weapon2': '1.212', 'ARMOR': '1.256', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:17:18,506][2409097] DAMAGECOUNT value on done: 7441.0
[2023-02-25 13:17:18,509][2409097] Sum rewards: 8.793, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.826', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.021', 'weapon4': '0.080', 'AMMO3': '0.095', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'weapon5': '0.338', 'ARMOR': '0.474', 'WEAPON5': '0.600', 'HITCOUNT': '0.710', 'WEAPON3': '0.750', 'weapon2': '0.922', 'weapon3': '2.186', 'DAMAGECOUNT': '4.158', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:17:18,531][2409101] DAMAGECOUNT value on done: 8164.0
[2023-02-25 13:17:18,532][2409101] Sum rewards: 17.533, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.036', 'AMMO5': '0.005', 'AMMO2': '0.027', 'AMMO3': '0.053', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'ARMOR': '0.800', 'HITCOUNT': '0.830', 'weapon4': '0.844', 'weapon2': '0.930', 'weapon3': '1.152', 'DAMAGECOUNT': '3.648', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:17:18,644][2409105] DAMAGECOUNT value on done: 7292.0
[2023-02-25 13:17:18,647][2409105] Sum rewards: 13.634, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.033', 'weapon7': '0.056', 'AMMO3': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.162', 'WEAPON4': '0.200', 'weapon5': '0.220', 'WEAPON3': '0.350', 'weapon4': '0.464', 'HEALTH': '0.474', 'HITCOUNT': '0.800', 'ARMOR': '0.972', 'weapon2': '1.300', 'weapon3': '1.322', 'DAMAGECOUNT': '2.799', 'FRAGCOUNT': '8.500'}
[2023-02-25 13:17:18,870][2409866] DAMAGECOUNT value on done: 7091.0
[2023-02-25 13:17:18,871][2409866] Sum rewards: 5.805, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.901', 'AMMO2': '0.009', 'AMMO5': '0.019', 'AMMO4': '0.045', 'weapon7': '0.050', 'weapon5': '0.082', 'AMMO3': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'HITCOUNT': '0.490', 'WEAPON3': '0.650', 'weapon2': '0.754', 'weapon3': '1.220', 'weapon4': '1.310', 'DAMAGECOUNT': '2.226', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:17:19,073][2409389] DAMAGECOUNT value on done: 7503.0
[2023-02-25 13:17:19,077][2409389] Sum rewards: 14.084, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.070', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO3': '0.046', 'weapon7': '0.056', 'AMMO4': '0.089', 'weapon5': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'weapon2': '0.412', 'HITCOUNT': '0.680', 'weapon3': '0.910', 'weapon4': '1.308', 'DAMAGECOUNT': '3.117', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:17:19,258][2409076] DAMAGECOUNT value on done: 7073.0
[2023-02-25 13:17:19,261][2409076] Sum rewards: 13.347, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.536', 'AMMO5': '0.009', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon7': '0.054', 'AMMO3': '0.060', 'AMMO4': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.130', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'HITCOUNT': '0.780', 'weapon2': '0.970', 'weapon3': '1.012', 'weapon4': '1.368', 'DAMAGECOUNT': '3.393', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:17:19,620][2409074] Updated weights for policy 0, policy_version 21601 (0.0012)
[2023-02-25 13:17:19,693][2409102] DAMAGECOUNT value on done: 6155.0
[2023-02-25 13:17:19,694][2409102] Sum rewards: 5.448, reward structure: {'HEALTH': '-0.170', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO3': '0.010', 'weapon7': '0.052', 'HITCOUNT': '0.060', 'WEAPON3': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon3': '0.270', 'DAMAGECOUNT': '0.399', 'ARMOR': '0.445', 'weapon2': '1.872', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:17:19,999][2409469] DAMAGECOUNT value on done: 6902.0
[2023-02-25 13:17:20,000][2409469] Sum rewards: 16.165, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.015', 'AMMO2': '0.020', 'HEALTH': '0.047', 'AMMO3': '0.077', 'weapon7': '0.084', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.296', 'WEAPON7': '0.300', 'weapon4': '0.346', 'WEAPON3': '0.400', 'HITCOUNT': '0.710', 'weapon3': '1.448', 'ARMOR': '1.630', 'weapon2': '1.630', 'DAMAGECOUNT': '4.074', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:17:20,098][2409549] DAMAGECOUNT value on done: 7103.0
[2023-02-25 13:17:20,101][2409549] Sum rewards: 20.087, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.690', 'AMMO2': '0.004', 'AMMO5': '0.020', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'AMMO3': '0.084', 'weapon4': '0.204', 'weapon5': '0.296', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '0.820', 'ARMOR': '0.896', 'weapon2': '1.408', 'weapon3': '1.638', 'DAMAGECOUNT': '4.536', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:17:20,110][2409373] DAMAGECOUNT value on done: 7516.0
[2023-02-25 13:17:20,114][2409373] Sum rewards: 14.357, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.898', 'AMMO5': '0.017', 'AMMO2': '0.028', 'AMMO3': '0.083', 'weapon7': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.139', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.350', 'ARMOR': '0.412', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon4': '0.722', 'HITCOUNT': '0.750', 'weapon2': '0.926', 'weapon3': '1.418', 'DAMAGECOUNT': '3.636', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:17:20,178][2409406] DAMAGECOUNT value on done: 6689.0
[2023-02-25 13:17:20,179][2409406] Sum rewards: 14.262, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.903', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'weapon7': '0.048', 'AMMO3': '0.057', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.129', 'weapon5': '0.140', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'ARMOR': '0.460', 'HITCOUNT': '0.480', 'weapon2': '0.818', 'weapon3': '0.954', 'weapon4': '1.614', 'DAMAGECOUNT': '3.471', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:17:20,198][2409077] DAMAGECOUNT value on done: 7470.0
[2023-02-25 13:17:20,199][2409077] Sum rewards: 21.493, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.118', 'AMMO2': '0.022', 'AMMO5': '0.030', 'AMMO3': '0.094', 'AMMO4': '0.107', 'weapon4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.500', 'WEAPON3': '0.500', 'weapon5': '0.650', 'HITCOUNT': '1.110', 'ARMOR': '1.256', 'weapon2': '1.356', 'weapon3': '1.572', 'DAMAGECOUNT': '6.654', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:17:20,609][2409103] DAMAGECOUNT value on done: 7658.0
[2023-02-25 13:17:20,612][2409103] Sum rewards: 9.959, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.997', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO5': '0.025', 'AMMO4': '0.050', 'weapon4': '0.058', 'AMMO3': '0.145', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.244', 'WEAPON5': '0.450', 'ARMOR': '0.455', 'WEAPON3': '0.900', 'HITCOUNT': '0.920', 'weapon2': '1.404', 'weapon3': '1.926', 'DAMAGECOUNT': '3.309', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:17:20,646][2409597] DAMAGECOUNT value on done: 7039.0
[2023-02-25 13:17:20,650][2409597] Sum rewards: 14.992, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.027', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'weapon5': '0.082', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'weapon7': '0.150', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.462', 'WEAPON3': '0.500', 'weapon4': '0.760', 'HITCOUNT': '0.920', 'weapon3': '1.242', 'weapon2': '1.382', 'DAMAGECOUNT': '3.840', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:17:20,777][2409405] DAMAGECOUNT value on done: 6234.0
[2023-02-25 13:17:20,781][2409405] Sum rewards: 9.177, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.418', 'AMMO2': '0.009', 'AMMO5': '0.012', 'AMMO4': '0.043', 'AMMO3': '0.084', 'weapon5': '0.084', 'weapon7': '0.106', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.600', 'WEAPON3': '0.650', 'weapon2': '1.004', 'weapon4': '1.102', 'weapon3': '1.424', 'DAMAGECOUNT': '2.937', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:21,187][2409485] DAMAGECOUNT value on done: 6851.0
[2023-02-25 13:17:21,191][2409485] Sum rewards: 5.492, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.175', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO3': '0.020', 'AMMO4': '0.024', 'weapon7': '0.048', 'weapon2': '0.064', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.340', 'weapon3': '0.462', 'weapon4': '0.550', 'DAMAGECOUNT': '1.659', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:17:21,258][2409074] Updated weights for policy 0, policy_version 21611 (0.0013)
[2023-02-25 13:17:21,642][2409075] DAMAGECOUNT value on done: 6189.0
[2023-02-25 13:17:21,646][2409075] Sum rewards: 8.912, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.623', 'AMMO2': '0.019', 'AMMO5': '0.020', 'weapon7': '0.076', 'AMMO4': '0.095', 'AMMO3': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.182', 'HITCOUNT': '0.310', 'weapon5': '0.310', 'WEAPON5': '0.500', 'WEAPON3': '0.500', 'weapon3': '0.752', 'ARMOR': '0.909', 'weapon2': '1.656', 'DAMAGECOUNT': '2.709', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:17:21,650][2409565] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:17:21,901][2409355] DAMAGECOUNT value on done: 7519.0
[2023-02-25 13:17:21,902][2409355] Sum rewards: 8.587, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.542', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.016', 'AMMO3': '0.084', 'weapon7': '0.108', 'WEAPON4': '0.150', 'weapon5': '0.176', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HITCOUNT': '0.420', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon3': '0.710', 'ARMOR': '0.879', 'weapon4': '1.274', 'weapon2': '1.352', 'DAMAGECOUNT': '3.510', 'FRAGCOUNT': '6.500'}
[2023-02-25 13:17:22,054][2409565] DAMAGECOUNT value on done: 7299.0
[2023-02-25 13:17:22,058][2409565] Sum rewards: 14.526, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.816', 'AMMO2': '0.012', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'weapon7': '0.050', 'AMMO4': '0.059', 'AMMO3': '0.065', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.152', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'HITCOUNT': '0.550', 'weapon4': '0.738', 'weapon2': '0.924', 'weapon3': '1.400', 'DAMAGECOUNT': '3.105', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:17:22,181][2409596] DAMAGECOUNT value on done: 5641.0
[2023-02-25 13:17:22,182][2409596] Sum rewards: 4.208, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.342', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'weapon7': '0.050', 'weapon5': '0.086', 'AMMO3': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.430', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'weapon2': '1.164', 'weapon3': '1.628', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:17:22,186][2408954] Fps is (10 sec: 22937.7, 60 sec: 23893.3, 300 sec: 24839.8). Total num frames: 88526848. Throughput: 0: 5991.5. Samples: 22128768. Policy #0 lag: (min: 1.0, avg: 12.2, max: 23.0)
[2023-02-25 13:17:22,186][2408954] Avg episode reward: [(0, '11.019')]
[2023-02-25 13:17:22,187][2409033] Saving new best policy, reward=11.019!
[2023-02-25 13:17:22,260][2409105] DAMAGECOUNT value on done: 7453.0
[2023-02-25 13:17:22,263][2409105] Sum rewards: 13.752, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.688', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO5': '0.022', 'AMMO3': '0.073', 'weapon7': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'weapon4': '0.356', 'weapon5': '0.360', 'WEAPON3': '0.400', 'WEAPON5': '0.450', 'HITCOUNT': '0.680', 'weapon3': '1.128', 'ARMOR': '1.652', 'weapon2': '1.764', 'DAMAGECOUNT': '4.119', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:17:22,326][2409097] DAMAGECOUNT value on done: 8175.0
[2023-02-25 13:17:22,332][2409097] Sum rewards: 13.513, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.710', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.030', 'weapon5': '0.064', 'weapon7': '0.068', 'AMMO3': '0.079', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.640', 'weapon2': '0.948', 'weapon4': '1.134', 'weapon3': '1.278', 'DAMAGECOUNT': '3.615', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:17:22,427][2409078] DAMAGECOUNT value on done: 7110.0
[2023-02-25 13:17:22,428][2409078] Sum rewards: 10.807, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.152', 'AMMO2': '0.008', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.040', 'weapon7': '0.064', 'weapon4': '0.082', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'weapon5': '0.128', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.810', 'ARMOR': '1.200', 'weapon2': '1.290', 'weapon3': '1.968', 'DAMAGECOUNT': '3.381', 'FRAGCOUNT': '6.500'}
[2023-02-25 13:17:22,490][2409104] DAMAGECOUNT value on done: 6433.0
[2023-02-25 13:17:22,493][2409104] Sum rewards: 11.483, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.430', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO5': '0.025', 'WEAPON4': '0.050', 'weapon5': '0.076', 'AMMO4': '0.077', 'AMMO3': '0.113', 'weapon4': '0.208', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'HITCOUNT': '0.980', 'weapon2': '1.522', 'weapon3': '1.686', 'DAMAGECOUNT': '3.351', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:17:22,513][2409075] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:17:22,514][2409100] DAMAGECOUNT value on done: 7065.0
[2023-02-25 13:17:22,517][2409100] Sum rewards: 16.694, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.025', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon5': '0.188', 'weapon4': '0.274', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '0.850', 'ARMOR': '1.300', 'weapon3': '1.334', 'weapon2': '1.862', 'DAMAGECOUNT': '3.483', 'FRAGCOUNT': '12.500'}
[2023-02-25 13:17:22,521][2409866] DAMAGECOUNT value on done: 8598.0
[2023-02-25 13:17:22,529][2409866] Sum rewards: 14.325, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.530', 'AMMO2': '0.007', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.035', 'weapon7': '0.054', 'AMMO3': '0.077', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.138', 'weapon5': '0.154', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.820', 'ARMOR': '1.299', 'weapon2': '1.668', 'weapon3': '1.698', 'DAMAGECOUNT': '4.614', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:17:22,648][2409407] DAMAGECOUNT value on done: 7819.0
[2023-02-25 13:17:22,649][2409407] Sum rewards: 4.402, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.313', 'AMMO2': '0.011', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.057', 'AMMO3': '0.110', 'weapon5': '0.116', 'WEAPON4': '0.250', 'weapon4': '0.322', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'HITCOUNT': '0.520', 'WEAPON3': '0.750', 'weapon2': '1.210', 'weapon3': '1.528', 'DAMAGECOUNT': '1.701', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:17:22,681][2409101] DAMAGECOUNT value on done: 6966.0
[2023-02-25 13:17:22,682][2409101] Sum rewards: 9.051, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO3': '0.050', 'weapon7': '0.062', 'AMMO4': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.352', 'HEALTH': '0.438', 'HITCOUNT': '0.460', 'weapon3': '1.138', 'weapon4': '1.658', 'DAMAGECOUNT': '2.226', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:17:22,968][2409389] DAMAGECOUNT value on done: 7543.0
[2023-02-25 13:17:22,974][2409389] Sum rewards: 18.187, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.420', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon7': '0.050', 'AMMO3': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'weapon5': '0.246', 'WEAPON5': '0.450', 'weapon4': '0.604', 'WEAPON3': '0.650', 'ARMOR': '0.902', 'weapon2': '0.988', 'HITCOUNT': '1.200', 'weapon3': '1.834', 'DAMAGECOUNT': '5.238', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:17:23,088][2409548] DAMAGECOUNT value on done: 7377.0
[2023-02-25 13:17:23,088][2409548] Sum rewards: 15.117, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.510', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.016', 'weapon7': '0.080', 'AMMO4': '0.080', 'AMMO3': '0.081', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.266', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon4': '0.874', 'weapon2': '0.996', 'HITCOUNT': '1.200', 'weapon3': '1.498', 'DAMAGECOUNT': '4.170', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:17:23,106][2409076] DAMAGECOUNT value on done: 7391.0
[2023-02-25 13:17:23,109][2409076] Sum rewards: 12.489, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.528', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'AMMO5': '0.029', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'weapon4': '0.208', 'weapon5': '0.258', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '0.740', 'ARMOR': '1.304', 'weapon3': '1.418', 'weapon2': '1.486', 'DAMAGECOUNT': '3.492', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:17:23,341][2409074] Updated weights for policy 0, policy_version 21621 (0.0013)
[2023-02-25 13:17:23,554][2409102] DAMAGECOUNT value on done: 6330.0
[2023-02-25 13:17:23,558][2409102] Sum rewards: 12.692, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.013', 'AMMO5': '0.017', 'weapon7': '0.048', 'AMMO3': '0.059', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HEALTH': '0.270', 'weapon5': '0.302', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.458', 'HITCOUNT': '0.490', 'weapon2': '0.882', 'weapon3': '0.902', 'ARMOR': '1.246', 'DAMAGECOUNT': '3.198', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:24,156][2409373] DAMAGECOUNT value on done: 7326.0
[2023-02-25 13:17:24,157][2409373] Sum rewards: 20.413, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.010', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.071', 'AMMO3': '0.081', 'HEALTH': '0.182', 'weapon5': '0.198', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'ARMOR': '0.845', 'HITCOUNT': '1.140', 'weapon2': '1.608', 'weapon3': '1.926', 'DAMAGECOUNT': '4.818', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:17:24,158][2409549] DAMAGECOUNT value on done: 7815.0
[2023-02-25 13:17:24,159][2409549] Sum rewards: 9.096, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.162', 'AMMO2': '0.009', 'AMMO5': '0.012', 'AMMO4': '0.044', 'weapon7': '0.084', 'weapon5': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.460', 'HITCOUNT': '0.610', 'WEAPON3': '0.750', 'ARMOR': '0.800', 'weapon3': '1.432', 'weapon2': '1.544', 'DAMAGECOUNT': '2.955', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:24,163][2409406] DAMAGECOUNT value on done: 6159.0
[2023-02-25 13:17:24,171][2409406] Sum rewards: 13.821, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.930', 'AMMO5': '0.010', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'weapon7': '0.054', 'AMMO3': '0.083', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'weapon5': '0.190', 'WEAPON5': '0.300', 'ARMOR': '0.453', 'WEAPON3': '0.600', 'HITCOUNT': '0.670', 'weapon4': '0.970', 'weapon2': '1.070', 'weapon3': '1.492', 'DAMAGECOUNT': '4.227', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:17:24,204][2409077] DAMAGECOUNT value on done: 6794.0
[2023-02-25 13:17:24,205][2409077] Sum rewards: 10.139, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.836', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.052', 'AMMO3': '0.060', 'weapon7': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'WEAPON7': '0.500', 'HITCOUNT': '0.620', 'weapon2': '0.692', 'weapon4': '0.958', 'weapon3': '1.226', 'DAMAGECOUNT': '2.919', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:24,328][2409469] DAMAGECOUNT value on done: 8013.0
[2023-02-25 13:17:24,328][2409469] Sum rewards: 8.886, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.310', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon4': '0.160', 'weapon5': '0.286', 'WEAPON3': '0.400', 'WEAPON5': '0.450', 'HITCOUNT': '0.480', 'ARMOR': '0.500', 'weapon3': '1.440', 'weapon2': '1.878', 'DAMAGECOUNT': '2.667', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:17:24,461][2409103] DAMAGECOUNT value on done: 8008.0
[2023-02-25 13:17:24,462][2409103] Sum rewards: 16.932, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.332', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO3': '0.050', 'AMMO4': '0.074', 'weapon5': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.288', 'WEAPON3': '0.400', 'ARMOR': '0.400', 'HITCOUNT': '1.020', 'weapon3': '1.226', 'weapon2': '1.730', 'DAMAGECOUNT': '4.086', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:17:24,716][2409074] Updated weights for policy 0, policy_version 21631 (0.0012)
[2023-02-25 13:17:24,898][2409405] DAMAGECOUNT value on done: 8177.0
[2023-02-25 13:17:24,901][2409405] Sum rewards: 11.728, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.458', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'weapon4': '0.054', 'AMMO4': '0.087', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'weapon5': '0.226', 'ARMOR': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '0.900', 'weapon2': '1.520', 'weapon3': '1.818', 'DAMAGECOUNT': '4.170', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:17:25,007][2409485] DAMAGECOUNT value on done: 7913.0
[2023-02-25 13:17:25,008][2409485] Sum rewards: 22.344, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.017', 'AMMO5': '0.017', 'WEAPON1': '0.050', 'weapon7': '0.060', 'AMMO3': '0.080', 'AMMO4': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'HEALTH': '0.175', 'weapon5': '0.324', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon2': '0.592', 'weapon4': '0.594', 'HITCOUNT': '1.070', 'weapon3': '1.882', 'DAMAGECOUNT': '5.796', 'FRAGCOUNT': '17.000'}
[2023-02-25 13:17:25,164][2409597] DAMAGECOUNT value on done: 8566.0
[2023-02-25 13:17:25,168][2409597] Sum rewards: 12.702, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.494', 'AMMO2': '0.014', 'AMMO5': '0.020', 'weapon7': '0.048', 'AMMO4': '0.068', 'AMMO3': '0.089', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.298', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'weapon4': '0.678', 'HITCOUNT': '0.880', 'weapon2': '0.972', 'weapon3': '1.514', 'DAMAGECOUNT': '3.975', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:17:25,694][2409075] DAMAGECOUNT value on done: 6714.0
[2023-02-25 13:17:25,695][2409075] Sum rewards: 5.769, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon7': '0.058', 'AMMO3': '0.067', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.114', 'AMMO4': '0.163', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'HEALTH': '0.396', 'ARMOR': '0.400', 'HITCOUNT': '0.440', 'weapon3': '0.980', 'weapon4': '1.150', 'weapon2': '1.278', 'DAMAGECOUNT': '1.833', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:17:25,955][2409355] DAMAGECOUNT value on done: 7416.0
[2023-02-25 13:17:25,956][2409355] Sum rewards: 12.283, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.179', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.028', 'AMMO3': '0.092', 'AMMO4': '0.140', 'weapon5': '0.186', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.552', 'HITCOUNT': '0.660', 'weapon2': '0.818', 'ARMOR': '1.383', 'weapon3': '2.020', 'DAMAGECOUNT': '3.141', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:17:26,072][2409078] DAMAGECOUNT value on done: 5987.0
[2023-02-25 13:17:26,073][2409078] Sum rewards: 2.708, reward structure: {'DEATHCOUNT': '-0.750', 'HEALTH': '-0.380', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'weapon2': '0.026', 'AMMO3': '0.027', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.140', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.252', 'weapon3': '0.308', 'HITCOUNT': '0.310', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.035'}
[2023-02-25 13:17:26,227][2409100] DAMAGECOUNT value on done: 7177.0
[2023-02-25 13:17:26,242][2409100] Sum rewards: 4.405, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.620', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'weapon5': '0.052', 'weapon7': '0.056', 'AMMO3': '0.069', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.450', 'weapon3': '0.704', 'weapon2': '0.816', 'ARMOR': '0.854', 'weapon4': '0.932', 'DAMAGECOUNT': '1.629', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:17:26,370][2409565] DAMAGECOUNT value on done: 6839.0
[2023-02-25 13:17:26,371][2409565] Sum rewards: 2.385, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.518', 'AMMO5': '0.005', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.082', 'AMMO4': '0.095', 'weapon5': '0.108', 'weapon7': '0.128', 'WEAPON5': '0.150', 'AMMO6': '0.320', 'AMMO7': '0.320', 'HITCOUNT': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'weapon4': '0.412', 'ARMOR': '0.500', 'weapon3': '1.256', 'weapon2': '1.498', 'DAMAGECOUNT': '1.500', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:17:26,430][2409097] DAMAGECOUNT value on done: 6283.0
[2023-02-25 13:17:26,433][2409097] Sum rewards: 7.238, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO3': '0.076', 'AMMO4': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.400', 'weapon4': '0.484', 'HEALTH': '0.576', 'weapon2': '0.618', 'ARMOR': '0.800', 'weapon3': '1.622', 'DAMAGECOUNT': '1.917', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:17:26,499][2409596] DAMAGECOUNT value on done: 6811.0
[2023-02-25 13:17:26,500][2409596] Sum rewards: 7.179, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.964', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.014', 'WEAPON1': '0.020', 'weapon7': '0.032', 'AMMO3': '0.064', 'weapon5': '0.128', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.580', 'weapon3': '1.474', 'weapon2': '1.492', 'DAMAGECOUNT': '2.706', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:17:26,605][2409548] DAMAGECOUNT value on done: 8225.0
[2023-02-25 13:17:26,609][2409548] Sum rewards: 8.819, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.460', 'AMMO2': '0.010', 'AMMO5': '0.014', 'AMMO4': '0.050', 'AMMO3': '0.097', 'weapon5': '0.190', 'WEAPON5': '0.350', 'HITCOUNT': '0.640', 'WEAPON3': '0.700', 'ARMOR': '0.923', 'weapon2': '1.504', 'weapon3': '1.606', 'DAMAGECOUNT': '2.445', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:17:26,617][2409101] DAMAGECOUNT value on done: 8232.0
[2023-02-25 13:17:26,622][2409101] Sum rewards: 14.367, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.460', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.007', 'AMMO3': '0.067', 'weapon7': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.174', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.447', 'WEAPON3': '0.500', 'HITCOUNT': '0.800', 'weapon3': '1.112', 'weapon2': '1.606', 'DAMAGECOUNT': '4.176', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:17:26,665][2409866] DAMAGECOUNT value on done: 7188.0
[2023-02-25 13:17:26,668][2409866] Sum rewards: 11.305, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.113', 'AMMO5': '0.026', 'AMMO2': '0.028', 'weapon7': '0.050', 'weapon4': '0.076', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'AMMO4': '0.138', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'weapon5': '0.418', 'WEAPON3': '0.500', 'WEAPON5': '0.500', 'HITCOUNT': '0.650', 'weapon2': '1.290', 'weapon3': '1.718', 'ARMOR': '1.744', 'DAMAGECOUNT': '3.198', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:17:26,794][2409104] DAMAGECOUNT value on done: 6364.0
[2023-02-25 13:17:26,794][2409104] Sum rewards: 13.242, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.218', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.042', 'AMMO3': '0.068', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.108', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.440', 'WEAPON3': '0.450', 'HITCOUNT': '0.810', 'ARMOR': '0.853', 'weapon3': '1.350', 'weapon2': '1.640', 'DAMAGECOUNT': '2.712', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:26,909][2409105] DAMAGECOUNT value on done: 7196.0
[2023-02-25 13:17:26,913][2409105] Sum rewards: 12.265, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.490', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO5': '0.025', 'AMMO4': '0.082', 'AMMO3': '0.174', 'weapon5': '0.280', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'HITCOUNT': '1.090', 'weapon2': '1.108', 'weapon3': '2.184', 'DAMAGECOUNT': '4.836', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:17:26,997][2409407] DAMAGECOUNT value on done: 6897.0
[2023-02-25 13:17:26,998][2409407] Sum rewards: 13.065, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.098', 'AMMO2': '0.010', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.050', 'weapon4': '0.072', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.136', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.730', 'ARMOR': '0.853', 'weapon2': '1.330', 'weapon3': '1.908', 'DAMAGECOUNT': '2.904', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:17:27,107][2409074] Updated weights for policy 0, policy_version 21641 (0.0012)
[2023-02-25 13:17:27,186][2408954] Fps is (10 sec: 23756.7, 60 sec: 23893.4, 300 sec: 24812.0). Total num frames: 88641536. Throughput: 0: 5989.3. Samples: 22164432. Policy #0 lag: (min: 0.0, avg: 11.3, max: 26.0)
[2023-02-25 13:17:27,186][2408954] Avg episode reward: [(0, '11.406')]
[2023-02-25 13:17:27,191][2409033] Saving new best policy, reward=11.406!
[2023-02-25 13:17:27,769][2409102] DAMAGECOUNT value on done: 6127.0
[2023-02-25 13:17:27,773][2409102] Sum rewards: 2.739, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.860', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO4': '0.034', 'weapon7': '0.070', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'weapon4': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.192', 'WEAPON7': '0.200', 'HITCOUNT': '0.340', 'WEAPON3': '0.450', 'WEAPON5': '0.500', 'weapon3': '0.800', 'ARMOR': '0.834', 'weapon2': '1.694', 'DAMAGECOUNT': '1.896', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:17:27,852][2409076] DAMAGECOUNT value on done: 6648.0
[2023-02-25 13:17:27,855][2409076] Sum rewards: 7.097, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.725', 'AMMO2': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.050', 'AMMO3': '0.096', 'HITCOUNT': '0.340', 'weapon5': '0.370', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'ARMOR': '0.849', 'weapon3': '1.620', 'weapon2': '1.714', 'DAMAGECOUNT': '1.758', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:17:27,869][2409389] DAMAGECOUNT value on done: 7774.0
[2023-02-25 13:17:27,872][2409389] Sum rewards: 12.263, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.920', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon7': '0.066', 'AMMO3': '0.070', 'AMMO4': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.170', 'weapon4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.710', 'weapon2': '1.516', 'weapon3': '1.554', 'DAMAGECOUNT': '3.405', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:17:28,018][2409074] Updated weights for policy 0, policy_version 21651 (0.0013)
[2023-02-25 13:17:28,254][2409549] DAMAGECOUNT value on done: 6191.0
[2023-02-25 13:17:28,257][2409549] Sum rewards: 9.217, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO3': '0.030', 'AMMO4': '0.075', 'weapon7': '0.076', 'HEALTH': '0.097', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.214', 'WEAPON4': '0.250', 'HITCOUNT': '0.610', 'weapon2': '0.636', 'weapon3': '0.748', 'weapon4': '1.324', 'DAMAGECOUNT': '2.544', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:17:28,263][2409469] DAMAGECOUNT value on done: 8026.0
[2023-02-25 13:17:28,264][2409469] Sum rewards: 11.990, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.917', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.015', 'AMMO3': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.216', 'weapon5': '0.288', 'WEAPON5': '0.350', 'ARMOR': '0.440', 'WEAPON3': '0.450', 'HITCOUNT': '0.580', 'weapon2': '0.996', 'weapon3': '1.256', 'DAMAGECOUNT': '3.204', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:28,274][2409103] DAMAGECOUNT value on done: 7304.0
[2023-02-25 13:17:28,275][2409103] Sum rewards: 10.675, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.915', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'weapon4': '0.032', 'AMMO5': '0.032', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'weapon5': '0.282', 'ARMOR': '0.456', 'HITCOUNT': '0.810', 'WEAPON5': '0.850', 'WEAPON3': '0.850', 'weapon2': '1.506', 'weapon3': '1.764', 'DAMAGECOUNT': '3.708', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:28,442][2409406] DAMAGECOUNT value on done: 6650.0
[2023-02-25 13:17:28,446][2409406] Sum rewards: 8.851, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.583', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.075', 'AMMO4': '0.094', 'weapon5': '0.224', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.512', 'HITCOUNT': '0.820', 'weapon3': '1.184', 'weapon2': '1.346', 'DAMAGECOUNT': '3.630', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:17:28,454][2409077] DAMAGECOUNT value on done: 6190.0
[2023-02-25 13:17:28,455][2409077] Sum rewards: 5.685, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.200', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.012', 'weapon7': '0.054', 'AMMO3': '0.089', 'weapon5': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.560', 'WEAPON3': '0.600', 'ARMOR': '0.840', 'weapon3': '1.014', 'weapon2': '1.054', 'DAMAGECOUNT': '1.836', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:17:28,798][2409405] DAMAGECOUNT value on done: 6748.0
[2023-02-25 13:17:28,799][2409405] Sum rewards: 8.726, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.352', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'weapon7': '0.140', 'weapon5': '0.164', 'AMMO4': '0.188', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'HITCOUNT': '0.540', 'weapon4': '0.556', 'weapon3': '1.032', 'weapon2': '1.402', 'DAMAGECOUNT': '2.430', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:17:28,809][2409485] DAMAGECOUNT value on done: 5416.0
[2023-02-25 13:17:28,810][2409485] Sum rewards: 6.787, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.735', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO3': '0.046', 'AMMO4': '0.075', 'weapon7': '0.112', 'weapon5': '0.132', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.410', 'weapon2': '0.828', 'weapon3': '0.912', 'weapon4': '1.428', 'DAMAGECOUNT': '2.013', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:17:28,826][2409373] DAMAGECOUNT value on done: 6721.0
[2023-02-25 13:17:28,829][2409373] Sum rewards: 2.429, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.368', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.069', 'weapon5': '0.076', 'AMMO4': '0.077', 'weapon7': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.455', 'WEAPON3': '0.500', 'HITCOUNT': '0.520', 'weapon4': '0.900', 'weapon2': '1.002', 'weapon3': '1.076', 'DAMAGECOUNT': '1.803', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:17:29,569][2409597] DAMAGECOUNT value on done: 7871.0
[2023-02-25 13:17:29,573][2409597] Sum rewards: 2.749, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.870', 'AMMO4': '-0.056', 'AMMO2': '-0.011', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'weapon7': '0.052', 'weapon5': '0.054', 'AMMO3': '0.063', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.400', 'ARMOR': '0.460', 'WEAPON3': '0.500', 'weapon4': '0.568', 'weapon3': '0.888', 'weapon2': '1.122', 'DAMAGECOUNT': '1.416', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:17:29,887][2409074] Updated weights for policy 0, policy_version 21661 (0.0012)
[2023-02-25 13:17:30,190][2409355] DAMAGECOUNT value on done: 6574.0
[2023-02-25 13:17:30,194][2409355] Sum rewards: 5.772, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.425', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.011', 'AMMO3': '0.045', 'weapon5': '0.062', 'WEAPON4': '0.200', 'weapon7': '0.204', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'AMMO6': '0.360', 'AMMO7': '0.360', 'HITCOUNT': '0.400', 'WEAPON7': '0.600', 'weapon3': '0.610', 'weapon2': '0.686', 'ARMOR': '0.850', 'weapon4': '1.072', 'DAMAGECOUNT': '1.662', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:17:30,204][2409078] DAMAGECOUNT value on done: 7645.0
[2023-02-25 13:17:30,207][2409078] Sum rewards: 16.596, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.742', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.023', 'weapon7': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.116', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'ARMOR': '0.900', 'HITCOUNT': '0.920', 'weapon2': '0.934', 'weapon4': '0.948', 'weapon3': '1.560', 'DAMAGECOUNT': '4.326', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:17:30,361][2409565] DAMAGECOUNT value on done: 5929.0
[2023-02-25 13:17:30,364][2409565] Sum rewards: 9.062, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.560', 'AMMO2': '0.006', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'weapon4': '0.220', 'weapon5': '0.306', 'ARMOR': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '0.800', 'weapon2': '1.486', 'weapon3': '1.542', 'DAMAGECOUNT': '2.616', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:17:30,367][2409596] DAMAGECOUNT value on done: 5960.0
[2023-02-25 13:17:30,370][2409596] Sum rewards: 7.957, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.003', 'AMMO2': '0.015', 'AMMO3': '0.030', 'weapon5': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.073', 'HEALTH': '0.085', 'WEAPON5': '0.100', 'weapon7': '0.120', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.250', 'WEAPON7': '0.300', 'HITCOUNT': '0.540', 'weapon4': '0.650', 'weapon3': '0.712', 'weapon2': '1.314', 'DAMAGECOUNT': '2.229', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:17:30,438][2409101] DAMAGECOUNT value on done: 8524.0
[2023-02-25 13:17:30,442][2409097] DAMAGECOUNT value on done: 7393.0
[2023-02-25 13:17:30,441][2409101] Sum rewards: 15.720, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.054', 'AMMO5': '0.023', 'WEAPON1': '0.030', 'AMMO2': '0.041', 'AMMO3': '0.087', 'weapon4': '0.162', 'AMMO4': '0.204', 'weapon5': '0.306', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'ARMOR': '0.850', 'HITCOUNT': '1.010', 'weapon2': '1.484', 'weapon3': '1.626', 'DAMAGECOUNT': '4.551', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:17:30,442][2409097] Sum rewards: 13.516, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.074', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon7': '0.058', 'AMMO3': '0.079', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.152', 'AMMO4': '0.204', 'WEAPON4': '0.350', 'WEAPON3': '0.500', 'HITCOUNT': '0.670', 'weapon4': '0.792', 'ARMOR': '0.816', 'weapon2': '1.264', 'weapon3': '1.346', 'DAMAGECOUNT': '3.606', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:17:30,461][2409548] DAMAGECOUNT value on done: 8213.0
[2023-02-25 13:17:30,463][2409548] Sum rewards: 12.955, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.425', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.006', 'WEAPON1': '0.020', 'weapon7': '0.054', 'AMMO3': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.124', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.392', 'ARMOR': '0.453', 'WEAPON3': '0.550', 'HITCOUNT': '0.900', 'weapon2': '1.132', 'weapon3': '1.268', 'DAMAGECOUNT': '3.024', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:17:30,641][2409486] DAMAGECOUNT value on done: 5054.0
[2023-02-25 13:17:30,641][2409486] Sum rewards: 6.503, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.743', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon7': '0.048', 'AMMO3': '0.055', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.127', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.450', 'HITCOUNT': '0.530', 'ARMOR': '0.852', 'weapon4': '1.010', 'weapon2': '1.038', 'weapon3': '1.168', 'DAMAGECOUNT': '1.902', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:17:30,682][2409104] DAMAGECOUNT value on done: 5738.0
[2023-02-25 13:17:30,684][2409104] Sum rewards: 0.564, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.114', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO3': '0.043', 'weapon5': '0.064', 'WEAPON4': '0.100', 'HITCOUNT': '0.160', 'weapon7': '0.162', 'WEAPON5': '0.200', 'WEAPON3': '0.300', 'AMMO6': '0.360', 'AMMO7': '0.360', 'DAMAGECOUNT': '0.375', 'weapon4': '0.382', 'WEAPON7': '0.600', 'weapon3': '0.660', 'FRAGCOUNT': '1.000', 'ARMOR': '1.288', 'weapon2': '1.614'}
[2023-02-25 13:17:30,774][2409866] DAMAGECOUNT value on done: 6904.0
[2023-02-25 13:17:30,777][2409866] Sum rewards: 11.567, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.614', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO3': '0.088', 'AMMO4': '0.144', 'weapon5': '0.200', 'weapon7': '0.290', 'WEAPON5': '0.300', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON4': '0.350', 'WEAPON7': '0.500', 'WEAPON3': '0.550', 'weapon4': '0.692', 'HITCOUNT': '0.740', 'ARMOR': '0.900', 'weapon2': '1.156', 'weapon3': '1.202', 'DAMAGECOUNT': '3.600', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:17:30,890][2409075] DAMAGECOUNT value on done: 8079.0
[2023-02-25 13:17:30,891][2409075] Sum rewards: 16.150, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.660', 'AMMO2': '0.004', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.020', 'WEAPON4': '0.050', 'weapon7': '0.054', 'AMMO3': '0.057', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.250', 'weapon5': '0.260', 'ARMOR': '0.445', 'WEAPON3': '0.450', 'HITCOUNT': '0.730', 'weapon4': '1.034', 'weapon3': '1.082', 'weapon2': '1.124', 'DAMAGECOUNT': '4.668', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:17:30,913][2409096] DAMAGECOUNT value on done: 7999.0
[2023-02-25 13:17:30,913][2409096] Sum rewards: 8.331, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.700', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.061', 'weapon5': '0.076', 'weapon7': '0.106', 'AMMO4': '0.128', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'ARMOR': '0.452', 'HITCOUNT': '0.590', 'weapon2': '0.996', 'weapon4': '1.200', 'weapon3': '1.248', 'DAMAGECOUNT': '2.883', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:17:31,083][2409407] DAMAGECOUNT value on done: 7164.0
[2023-02-25 13:17:31,086][2409407] Sum rewards: 20.660, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.132', 'WEAPON5': '0.250', 'weapon5': '0.252', 'HEALTH': '0.396', 'ARMOR': '0.400', 'weapon4': '0.420', 'WEAPON3': '0.450', 'HITCOUNT': '1.110', 'weapon2': '1.298', 'weapon3': '1.500', 'DAMAGECOUNT': '4.470', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:17:31,604][2409076] DAMAGECOUNT value on done: 6845.0
[2023-02-25 13:17:31,605][2409076] Sum rewards: 7.884, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.726', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO5': '0.032', 'weapon7': '0.066', 'AMMO4': '0.077', 'AMMO3': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.128', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.382', 'HITCOUNT': '0.530', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'ARMOR': '0.857', 'weapon2': '1.350', 'weapon3': '1.576', 'DAMAGECOUNT': '2.391', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:17:31,694][2409074] Updated weights for policy 0, policy_version 21671 (0.0013)
[2023-02-25 13:17:31,748][2409079] DAMAGECOUNT value on done: 6624.0
[2023-02-25 13:17:31,751][2409079] Sum rewards: 12.892, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.321', 'AMMO2': '0.016', 'AMMO5': '0.022', 'weapon7': '0.048', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.078', 'AMMO4': '0.079', 'AMMO3': '0.081', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.350', 'weapon4': '0.506', 'WEAPON3': '0.550', 'ARMOR': '0.835', 'HITCOUNT': '0.850', 'weapon3': '1.548', 'weapon2': '1.582', 'DAMAGECOUNT': '3.267', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:17:31,775][2409105] DAMAGECOUNT value on done: 8019.0
[2023-02-25 13:17:31,779][2409105] Sum rewards: 12.798, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.915', 'AMMO2': '0.005', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.023', 'AMMO3': '0.056', 'weapon7': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.166', 'WEAPON5': '0.300', 'ARMOR': '0.432', 'WEAPON3': '0.500', 'HITCOUNT': '0.650', 'weapon4': '0.692', 'weapon3': '1.092', 'weapon2': '1.338', 'DAMAGECOUNT': '3.393', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:17:32,033][2409102] DAMAGECOUNT value on done: 6928.0
[2023-02-25 13:17:32,033][2409102] Sum rewards: 7.085, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.887', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO5': '0.033', 'AMMO3': '0.104', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.306', 'weapon5': '0.376', 'ARMOR': '0.489', 'WEAPON5': '0.750', 'WEAPON3': '0.750', 'HITCOUNT': '0.880', 'weapon2': '1.156', 'weapon3': '1.764', 'DAMAGECOUNT': '3.537', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:17:32,186][2408954] Fps is (10 sec: 25395.1, 60 sec: 24234.8, 300 sec: 24853.7). Total num frames: 88780800. Throughput: 0: 5989.9. Samples: 22200600. Policy #0 lag: (min: 0.0, avg: 11.3, max: 26.0)
[2023-02-25 13:17:32,186][2408954] Avg episode reward: [(0, '11.013')]
[2023-02-25 13:17:32,471][2409406] DAMAGECOUNT value on done: 5778.0
[2023-02-25 13:17:32,474][2409406] Sum rewards: 14.245, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.200', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'weapon4': '0.020', 'AMMO5': '0.023', 'AMMO4': '0.055', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'weapon5': '0.280', 'ARMOR': '0.449', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.820', 'weapon2': '1.336', 'weapon3': '2.012', 'DAMAGECOUNT': '4.146', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:17:32,476][2409077] DAMAGECOUNT value on done: 7087.0
[2023-02-25 13:17:32,480][2409077] Sum rewards: 11.080, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.060', 'AMMO5': '0.028', 'AMMO2': '0.036', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.158', 'AMMO4': '0.181', 'weapon5': '0.274', 'weapon4': '0.398', 'WEAPON5': '0.600', 'HITCOUNT': '0.850', 'weapon2': '0.874', 'WEAPON3': '0.950', 'ARMOR': '1.705', 'weapon3': '1.778', 'DAMAGECOUNT': '3.918', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:17:32,615][2409485] DAMAGECOUNT value on done: 7857.0
[2023-02-25 13:17:32,619][2409485] Sum rewards: 12.848, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.628', 'AMMO2': '0.012', 'AMMO5': '0.025', 'weapon4': '0.054', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'weapon5': '0.260', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.770', 'ARMOR': '0.845', 'weapon2': '1.228', 'weapon3': '2.294', 'DAMAGECOUNT': '3.468', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:17:32,649][2409373] DAMAGECOUNT value on done: 7405.0
[2023-02-25 13:17:32,655][2409373] Sum rewards: 12.938, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.596', 'AMMO5': '0.026', 'AMMO2': '0.037', 'AMMO3': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.156', 'AMMO4': '0.184', 'weapon4': '0.232', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'HITCOUNT': '0.940', 'weapon3': '1.580', 'weapon2': '1.644', 'DAMAGECOUNT': '3.585', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:17:32,839][2409469] DAMAGECOUNT value on done: 6655.0
[2023-02-25 13:17:32,843][2409469] Sum rewards: 10.533, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.392', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.016', 'weapon7': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.109', 'weapon5': '0.162', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'HITCOUNT': '0.820', 'ARMOR': '0.900', 'weapon2': '1.346', 'weapon3': '2.108', 'DAMAGECOUNT': '2.787', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:32,922][2409405] DAMAGECOUNT value on done: 6775.0
[2023-02-25 13:17:32,923][2409405] Sum rewards: 10.464, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.000', 'AMMO5': '0.022', 'AMMO2': '0.036', 'AMMO3': '0.064', 'weapon5': '0.134', 'AMMO4': '0.178', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.642', 'HITCOUNT': '0.770', 'ARMOR': '0.908', 'weapon2': '1.260', 'weapon3': '1.498', 'DAMAGECOUNT': '2.802', 'FRAGCOUNT': '9.500'}
[2023-02-25 13:17:33,060][2409389] DAMAGECOUNT value on done: 7468.0
[2023-02-25 13:17:33,060][2409389] Sum rewards: 9.930, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO3': '0.062', 'weapon5': '0.104', 'weapon7': '0.126', 'AMMO4': '0.135', 'HEALTH': '0.154', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'ARMOR': '0.499', 'weapon2': '0.730', 'HITCOUNT': '0.810', 'weapon3': '0.946', 'weapon4': '1.188', 'DAMAGECOUNT': '2.799', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:17:33,186][2409548] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:17:33,615][2409074] Updated weights for policy 0, policy_version 21681 (0.0012)
[2023-02-25 13:17:34,046][2409597] DAMAGECOUNT value on done: 5802.0
[2023-02-25 13:17:34,049][2409597] Sum rewards: 10.395, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.916', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'weapon7': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.110', 'AMMO3': '0.134', 'WEAPON5': '0.250', 'WEAPON3': '0.800', 'HITCOUNT': '0.870', 'weapon2': '1.466', 'weapon3': '2.040', 'DAMAGECOUNT': '2.985', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:17:34,121][2409078] DAMAGECOUNT value on done: 8174.0
[2023-02-25 13:17:34,122][2409078] Sum rewards: 19.064, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.406', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO3': '0.071', 'AMMO4': '0.109', 'weapon5': '0.112', 'WEAPON4': '0.150', 'weapon7': '0.174', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'weapon4': '0.732', 'weapon2': '0.946', 'HITCOUNT': '1.120', 'weapon3': '1.760', 'DAMAGECOUNT': '5.472', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:17:34,172][2409596] DAMAGECOUNT value on done: 8402.0
[2023-02-25 13:17:34,173][2409596] Sum rewards: 14.325, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.356', 'AMMO5': '0.014', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon7': '0.054', 'AMMO4': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.102', 'weapon5': '0.188', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.636', 'WEAPON3': '0.650', 'weapon2': '0.724', 'HITCOUNT': '0.800', 'weapon3': '1.640', 'DAMAGECOUNT': '4.893', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:17:34,268][2409355] DAMAGECOUNT value on done: 6127.0
[2023-02-25 13:17:34,269][2409355] Sum rewards: 12.500, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.730', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO3': '0.070', 'weapon7': '0.106', 'AMMO4': '0.117', 'weapon5': '0.166', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '0.500', 'HITCOUNT': '0.670', 'weapon4': '0.700', 'ARMOR': '0.841', 'weapon2': '1.076', 'weapon3': '1.138', 'DAMAGECOUNT': '3.984', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:17:34,395][2409101] DAMAGECOUNT value on done: 8142.0
[2023-02-25 13:17:34,399][2409101] Sum rewards: 7.887, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.320', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'AMMO3': '0.102', 'weapon5': '0.136', 'AMMO4': '0.187', 'weapon4': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.700', 'HITCOUNT': '0.900', 'weapon2': '1.166', 'weapon3': '1.686', 'DAMAGECOUNT': '3.516', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:17:34,499][2409104] DAMAGECOUNT value on done: 7256.0
[2023-02-25 13:17:34,500][2409104] Sum rewards: 5.896, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.874', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'AMMO2': '0.026', 'AMMO3': '0.081', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'weapon5': '0.260', 'ARMOR': '0.476', 'WEAPON3': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.696', 'HITCOUNT': '0.710', 'weapon2': '1.046', 'weapon3': '1.402', 'DAMAGECOUNT': '2.598', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:17:34,650][2409548] DAMAGECOUNT value on done: 6688.0
[2023-02-25 13:17:34,650][2409548] Sum rewards: 5.649, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.439', 'weapon5': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.022', 'AMMO3': '0.099', 'AMMO4': '0.107', 'weapon7': '0.118', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON7': '0.400', 'WEAPON3': '0.600', 'weapon2': '0.618', 'HITCOUNT': '0.730', 'weapon3': '0.992', 'weapon4': '1.050', 'DAMAGECOUNT': '2.847', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:17:34,675][2409565] DAMAGECOUNT value on done: 6901.0
[2023-02-25 13:17:34,675][2409565] Sum rewards: 10.085, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.847', 'AMMO5': '0.020', 'AMMO2': '0.031', 'weapon5': '0.082', 'AMMO3': '0.086', 'AMMO4': '0.153', 'weapon7': '0.184', 'AMMO6': '0.360', 'AMMO7': '0.360', 'ARMOR': '0.400', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON7': '0.600', 'WEAPON3': '0.650', 'weapon2': '0.726', 'HITCOUNT': '0.830', 'weapon4': '1.074', 'weapon3': '1.558', 'DAMAGECOUNT': '3.168', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:17:34,720][2409407] DAMAGECOUNT value on done: 6602.0
[2023-02-25 13:17:34,720][2409407] Sum rewards: 4.252, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'weapon7': '0.020', 'AMMO2': '0.038', 'AMMO3': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.191', 'WEAPON5': '0.200', 'weapon5': '0.210', 'WEAPON3': '0.250', 'HEALTH': '0.270', 'WEAPON4': '0.300', 'weapon4': '0.568', 'HITCOUNT': '0.610', 'weapon3': '1.126', 'weapon2': '1.180', 'DAMAGECOUNT': '1.929', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:17:34,772][2409486] DAMAGECOUNT value on done: 7469.0
[2023-02-25 13:17:34,775][2409486] Sum rewards: 9.826, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.440', 'AMMO5': '0.013', 'AMMO2': '0.019', 'weapon5': '0.024', 'AMMO3': '0.075', 'AMMO4': '0.096', 'weapon7': '0.152', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'ARMOR': '0.436', 'HITCOUNT': '0.460', 'WEAPON3': '0.550', 'weapon2': '0.654', 'weapon4': '1.058', 'weapon3': '1.462', 'DAMAGECOUNT': '2.427', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:17:34,795][2409866] DAMAGECOUNT value on done: 7714.0
[2023-02-25 13:17:34,798][2409866] Sum rewards: 22.018, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.648', 'AMMO2': '0.009', 'AMMO5': '0.010', 'weapon7': '0.038', 'AMMO4': '0.046', 'AMMO3': '0.050', 'weapon5': '0.126', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'weapon4': '0.400', 'ARMOR': '0.874', 'HITCOUNT': '1.140', 'weapon3': '1.224', 'weapon2': '1.430', 'DAMAGECOUNT': '4.698', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:17:35,121][2409097] DAMAGECOUNT value on done: 6922.0
[2023-02-25 13:17:35,124][2409097] Sum rewards: 9.497, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.578', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.094', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.362', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.550', 'weapon2': '0.942', 'weapon3': '1.834', 'DAMAGECOUNT': '2.763', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:17:35,328][2409096] DAMAGECOUNT value on done: 6907.0
[2023-02-25 13:17:35,329][2409096] Sum rewards: 17.399, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.641', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.010', 'AMMO3': '0.063', 'WEAPON5': '0.100', 'weapon5': '0.104', 'WEAPON4': '0.250', 'WEAPON3': '0.500', 'weapon4': '0.838', 'weapon2': '0.866', 'HITCOUNT': '1.050', 'ARMOR': '1.297', 'weapon3': '1.392', 'DAMAGECOUNT': '4.062', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:17:35,382][2409074] Updated weights for policy 0, policy_version 21691 (0.0012)
[2023-02-25 13:17:35,645][2409079] DAMAGECOUNT value on done: 6296.0
[2023-02-25 13:17:35,648][2409079] Sum rewards: 6.497, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.718', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'AMMO3': '0.040', 'weapon4': '0.040', 'AMMO4': '0.103', 'weapon5': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'ARMOR': '0.455', 'HITCOUNT': '0.490', 'weapon3': '1.020', 'DAMAGECOUNT': '1.878', 'weapon2': '2.150', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:17:35,801][2409105] DAMAGECOUNT value on done: 7529.0
[2023-02-25 13:17:35,802][2409105] Sum rewards: 9.820, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.045', 'AMMO2': '0.009', 'AMMO5': '0.013', 'WEAPON1': '0.040', 'AMMO4': '0.042', 'AMMO3': '0.060', 'weapon7': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.290', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon2': '0.698', 'weapon4': '0.724', 'HITCOUNT': '0.810', 'weapon3': '1.544', 'DAMAGECOUNT': '3.150', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:17:35,981][2409076] DAMAGECOUNT value on done: 7772.0
[2023-02-25 13:17:35,983][2409076] Sum rewards: 13.434, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.672', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon5': '0.098', 'AMMO4': '0.110', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.296', 'WEAPON3': '0.650', 'ARMOR': '0.900', 'weapon2': '1.138', 'HITCOUNT': '1.160', 'weapon3': '1.550', 'DAMAGECOUNT': '4.221', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:17:36,282][2409485] DAMAGECOUNT value on done: 6068.0
[2023-02-25 13:17:36,289][2409485] Sum rewards: 5.171, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.630', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'AMMO3': '0.054', 'AMMO4': '0.118', 'weapon5': '0.126', 'weapon7': '0.132', 'HITCOUNT': '0.160', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'weapon2': '0.320', 'WEAPON3': '0.350', 'weapon3': '0.696', 'DAMAGECOUNT': '1.053', 'weapon4': '2.258', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:17:36,343][2409102] DAMAGECOUNT value on done: 6492.0
[2023-02-25 13:17:36,353][2409102] Sum rewards: 5.726, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.400', 'AMMO2': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.030', 'AMMO3': '0.061', 'weapon7': '0.072', 'WEAPON4': '0.100', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.420', 'WEAPON3': '0.450', 'weapon4': '1.014', 'weapon3': '1.030', 'weapon2': '1.568', 'DAMAGECOUNT': '1.986', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:17:36,504][2409075] DAMAGECOUNT value on done: 6964.0
[2023-02-25 13:17:36,505][2409075] Sum rewards: 8.638, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.232', 'AMMO5': '0.013', 'AMMO2': '0.033', 'WEAPON1': '0.040', 'AMMO3': '0.080', 'weapon5': '0.162', 'AMMO4': '0.163', 'weapon7': '0.186', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'weapon4': '0.348', 'WEAPON5': '0.400', 'HITCOUNT': '0.620', 'WEAPON3': '0.650', 'ARMOR': '0.918', 'weapon2': '1.036', 'weapon3': '1.736', 'DAMAGECOUNT': '3.945', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:17:36,512][2409405] DAMAGECOUNT value on done: 5936.0
[2023-02-25 13:17:36,513][2409405] Sum rewards: 8.792, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.287', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon7': '0.068', 'weapon5': '0.078', 'AMMO3': '0.100', 'AMMO4': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'ARMOR': '0.448', 'HITCOUNT': '0.480', 'WEAPON3': '0.600', 'weapon3': '0.744', 'weapon4': '1.208', 'weapon2': '1.498', 'DAMAGECOUNT': '2.361', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:36,602][2409077] DAMAGECOUNT value on done: 8472.0
[2023-02-25 13:17:36,605][2409077] Sum rewards: 18.371, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.529', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO5': '0.020', 'AMMO3': '0.080', 'weapon5': '0.212', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.760', 'weapon2': '0.852', 'weapon3': '1.898', 'DAMAGECOUNT': '4.308', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:17:36,618][2409406] DAMAGECOUNT value on done: 5160.0
[2023-02-25 13:17:36,623][2409406] Sum rewards: 7.471, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.728', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.005', 'AMMO3': '0.030', 'weapon7': '0.050', 'weapon5': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.300', 'HITCOUNT': '0.360', 'ARMOR': '0.400', 'weapon3': '0.740', 'weapon2': '0.898', 'weapon4': '1.612', 'DAMAGECOUNT': '1.653', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:17:36,746][2409373] DAMAGECOUNT value on done: 7320.0
[2023-02-25 13:17:36,749][2409373] Sum rewards: 7.575, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.480', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO2': '0.035', 'AMMO3': '0.088', 'weapon7': '0.150', 'AMMO4': '0.175', 'weapon5': '0.178', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.440', 'weapon4': '0.582', 'WEAPON3': '0.600', 'ARMOR': '0.904', 'weapon2': '1.028', 'weapon3': '1.696', 'DAMAGECOUNT': '2.034', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:17:36,953][2409074] Updated weights for policy 0, policy_version 21701 (0.0013)
[2023-02-25 13:17:37,186][2408954] Fps is (10 sec: 24985.7, 60 sec: 24029.9, 300 sec: 24812.0). Total num frames: 88891392. Throughput: 0: 5974.1. Samples: 22218120. Policy #0 lag: (min: 0.0, avg: 11.3, max: 26.0)
[2023-02-25 13:17:37,186][2408954] Avg episode reward: [(0, '10.570')]
[2023-02-25 13:17:37,253][2409469] DAMAGECOUNT value on done: 8515.0
[2023-02-25 13:17:37,254][2409469] Sum rewards: 12.216, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.350', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO3': '0.040', 'weapon5': '0.098', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'WEAPON3': '0.250', 'weapon7': '0.264', 'AMMO6': '0.420', 'AMMO7': '0.420', 'ARMOR': '0.484', 'WEAPON7': '0.500', 'weapon4': '0.786', 'HITCOUNT': '0.830', 'weapon3': '0.912', 'weapon2': '1.336', 'DAMAGECOUNT': '2.946', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:37,850][2409078] DAMAGECOUNT value on done: 8043.0
[2023-02-25 13:17:37,853][2409078] Sum rewards: 16.961, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.244', 'AMMO5': '0.015', 'AMMO2': '0.021', 'weapon7': '0.024', 'AMMO3': '0.095', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.278', 'WEAPON5': '0.300', 'weapon4': '0.482', 'WEAPON3': '0.550', 'HITCOUNT': '0.800', 'weapon2': '1.170', 'ARMOR': '1.252', 'weapon3': '1.648', 'DAMAGECOUNT': '4.464', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:17:37,950][2409389] DAMAGECOUNT value on done: 6886.0
[2023-02-25 13:17:37,955][2409389] Sum rewards: 5.483, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.090', 'AMMO2': '0.009', 'weapon4': '0.010', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO4': '0.045', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'weapon5': '0.378', 'WEAPON5': '0.500', 'HITCOUNT': '0.610', 'WEAPON3': '0.650', 'ARMOR': '0.869', 'weapon3': '1.336', 'DAMAGECOUNT': '1.941', 'weapon2': '1.992', 'FRAGCOUNT': '6.500'}
[2023-02-25 13:17:37,992][2409597] DAMAGECOUNT value on done: 8088.0
[2023-02-25 13:17:37,993][2409597] Sum rewards: 21.378, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.822', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO3': '0.075', 'weapon5': '0.130', 'weapon4': '0.136', 'AMMO4': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '1.240', 'weapon2': '1.462', 'weapon3': '1.602', 'DAMAGECOUNT': '5.202', 'FRAGCOUNT': '16.000'}
[2023-02-25 13:17:38,046][2409355] DAMAGECOUNT value on done: 7806.0
[2023-02-25 13:17:38,047][2409355] Sum rewards: 2.379, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.818', 'AMMO2': '0.004', 'AMMO4': '0.021', 'AMMO5': '0.026', 'AMMO3': '0.070', 'WEAPON4': '0.150', 'weapon5': '0.324', 'weapon4': '0.330', 'WEAPON3': '0.550', 'HITCOUNT': '0.580', 'WEAPON5': '0.600', 'ARMOR': '0.900', 'weapon2': '1.356', 'weapon3': '1.596', 'DAMAGECOUNT': '2.439', 'FRAGCOUNT': '3.500'}
[2023-02-25 13:17:38,075][2409101] DAMAGECOUNT value on done: 6659.0
[2023-02-25 13:17:38,076][2409101] Sum rewards: 6.774, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.204', 'AMMO5': '0.014', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.080', 'AMMO3': '0.100', 'weapon5': '0.154', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'weapon4': '0.644', 'HITCOUNT': '0.760', 'ARMOR': '1.003', 'weapon2': '1.092', 'weapon3': '1.480', 'DAMAGECOUNT': '2.514', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:17:38,507][2409486] DAMAGECOUNT value on done: 6586.0
[2023-02-25 13:17:38,510][2409486] Sum rewards: 9.920, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.146', 'AMMO2': '0.006', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.029', 'AMMO3': '0.104', 'weapon5': '0.226', 'WEAPON5': '0.350', 'HITCOUNT': '0.730', 'WEAPON3': '0.750', 'weapon2': '0.830', 'ARMOR': '0.895', 'weapon3': '1.800', 'DAMAGECOUNT': '3.309', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:38,563][2409866] DAMAGECOUNT value on done: 6748.0
[2023-02-25 13:17:38,564][2409866] Sum rewards: 5.297, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.320', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO5': '0.028', 'AMMO4': '0.096', 'AMMO3': '0.116', 'weapon5': '0.188', 'HITCOUNT': '0.570', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'weapon2': '1.280', 'weapon3': '2.040', 'DAMAGECOUNT': '2.370', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:17:38,654][2409548] DAMAGECOUNT value on done: 7907.0
[2023-02-25 13:17:38,657][2409548] Sum rewards: 18.363, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.426', 'AMMO5': '0.016', 'AMMO2': '0.026', 'AMMO3': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.110', 'AMMO4': '0.129', 'weapon5': '0.210', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.546', 'WEAPON3': '0.650', 'weapon2': '1.034', 'HITCOUNT': '1.150', 'weapon3': '1.456', 'DAMAGECOUNT': '5.424', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:17:38,760][2409097] DAMAGECOUNT value on done: 7804.0
[2023-02-25 13:17:38,764][2409097] Sum rewards: 10.987, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.058', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.012', 'WEAPON1': '0.050', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.102', 'weapon4': '0.108', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '1.020', 'weapon3': '1.540', 'weapon2': '1.784', 'DAMAGECOUNT': '3.354', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:17:38,860][2409075] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:17:38,882][2409565] DAMAGECOUNT value on done: 8249.0
[2023-02-25 13:17:38,883][2409565] Sum rewards: 10.670, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.798', 'AMMO2': '0.028', 'AMMO5': '0.028', 'WEAPON1': '0.050', 'AMMO3': '0.116', 'AMMO4': '0.140', 'weapon4': '0.200', 'weapon5': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.700', 'WEAPON3': '0.750', 'weapon2': '0.972', 'HITCOUNT': '0.980', 'weapon3': '2.036', 'DAMAGECOUNT': '4.314', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:38,997][2409074] Updated weights for policy 0, policy_version 21711 (0.0012)
[2023-02-25 13:17:39,114][2409596] DAMAGECOUNT value on done: 6975.0
[2023-02-25 13:17:39,115][2409596] Sum rewards: 7.215, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.151', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.062', 'AMMO3': '0.081', 'weapon4': '0.096', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON3': '0.600', 'HITCOUNT': '0.670', 'ARMOR': '1.321', 'weapon3': '1.418', 'weapon2': '1.780', 'DAMAGECOUNT': '2.295', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:17:39,120][2409096] DAMAGECOUNT value on done: 6054.0
[2023-02-25 13:17:39,122][2409096] Sum rewards: 11.284, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.060', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO3': '0.062', 'WEAPON4': '0.100', 'weapon4': '0.186', 'weapon5': '0.316', 'WEAPON5': '0.350', 'ARMOR': '0.455', 'WEAPON3': '0.500', 'HITCOUNT': '0.670', 'weapon3': '1.492', 'weapon2': '1.504', 'DAMAGECOUNT': '3.189', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:39,356][2409407] DAMAGECOUNT value on done: 8317.0
[2023-02-25 13:17:39,359][2409407] Sum rewards: 20.069, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.558', 'AMMO5': '0.019', 'weapon7': '0.022', 'WEAPON1': '0.030', 'AMMO2': '0.041', 'AMMO3': '0.107', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.203', 'weapon5': '0.276', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.466', 'weapon2': '0.608', 'WEAPON3': '0.650', 'HITCOUNT': '1.180', 'weapon3': '1.776', 'DAMAGECOUNT': '5.649', 'FRAGCOUNT': '17.000'}
[2023-02-25 13:17:39,481][2409104] DAMAGECOUNT value on done: 7877.0
[2023-02-25 13:17:39,484][2409104] Sum rewards: 13.401, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.084', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'weapon5': '0.062', 'AMMO3': '0.063', 'weapon7': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.200', 'ARMOR': '0.446', 'WEAPON3': '0.450', 'HITCOUNT': '0.790', 'weapon2': '1.030', 'weapon4': '1.120', 'weapon3': '1.120', 'DAMAGECOUNT': '3.219', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:17:39,674][2409076] DAMAGECOUNT value on done: 6968.0
[2023-02-25 13:17:39,678][2409076] Sum rewards: 14.056, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.450', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.064', 'weapon4': '0.172', 'weapon5': '0.306', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.690', 'weapon3': '1.374', 'weapon2': '1.756', 'DAMAGECOUNT': '4.026', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:17:39,816][2409105] DAMAGECOUNT value on done: 7081.0
[2023-02-25 13:17:39,820][2409105] Sum rewards: 10.632, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.828', 'AMMO5': '0.015', 'AMMO2': '0.027', 'weapon7': '0.064', 'AMMO3': '0.107', 'AMMO4': '0.135', 'weapon5': '0.184', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.620', 'WEAPON3': '0.750', 'ARMOR': '0.851', 'weapon4': '1.022', 'weapon2': '1.108', 'weapon3': '1.312', 'DAMAGECOUNT': '3.015', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:17:40,287][2409079] DAMAGECOUNT value on done: 5733.0
[2023-02-25 13:17:40,288][2409102] DAMAGECOUNT value on done: 6633.0
[2023-02-25 13:17:40,291][2409102] Sum rewards: 7.945, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.581', 'AMMO5': '0.019', 'AMMO2': '0.029', 'AMMO3': '0.060', 'AMMO4': '0.143', 'weapon4': '0.154', 'weapon5': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.700', 'ARMOR': '1.221', 'weapon3': '1.304', 'weapon2': '1.808', 'DAMAGECOUNT': '2.856', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:40,299][2409485] DAMAGECOUNT value on done: 6676.0
[2023-02-25 13:17:40,300][2409485] Sum rewards: 14.123, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.017', 'AMMO2': '0.032', 'weapon7': '0.054', 'AMMO3': '0.076', 'AMMO4': '0.159', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'weapon5': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'HEALTH': '0.433', 'WEAPON3': '0.450', 'weapon4': '0.622', 'HITCOUNT': '0.760', 'ARMOR': '0.854', 'weapon2': '1.260', 'weapon3': '1.512', 'DAMAGECOUNT': '3.159', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:17:40,331][2409405] DAMAGECOUNT value on done: 6694.0
[2023-02-25 13:17:40,333][2409405] Sum rewards: 17.276, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.016', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.054', 'AMMO3': '0.070', 'AMMO4': '0.078', 'HEALTH': '0.156', 'weapon5': '0.300', 'WEAPON3': '0.450', 'WEAPON5': '0.500', 'HITCOUNT': '0.740', 'ARMOR': '0.855', 'weapon3': '1.444', 'weapon2': '1.892', 'DAMAGECOUNT': '4.632', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:17:40,429][2409373] DAMAGECOUNT value on done: 8802.0
[2023-02-25 13:17:40,432][2409373] Sum rewards: 15.142, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.017', 'AMMO2': '0.030', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'weapon5': '0.214', 'weapon4': '0.234', 'HEALTH': '0.390', 'WEAPON3': '0.450', 'HITCOUNT': '0.960', 'weapon2': '1.430', 'weapon3': '1.506', 'DAMAGECOUNT': '3.633', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:17:40,561][2409077] DAMAGECOUNT value on done: 7904.0
[2023-02-25 13:17:40,568][2409077] Sum rewards: 11.245, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.083', 'AMMO2': '0.012', 'AMMO5': '0.012', 'weapon7': '0.052', 'AMMO4': '0.058', 'AMMO3': '0.061', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.180', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'HITCOUNT': '0.580', 'weapon4': '0.594', 'ARMOR': '0.756', 'weapon3': '1.108', 'weapon2': '1.336', 'DAMAGECOUNT': '3.039', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:17:40,594][2409406] DAMAGECOUNT value on done: 7197.0
[2023-02-25 13:17:40,597][2409406] Sum rewards: 10.365, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.020', 'AMMO5': '0.020', 'AMMO2': '0.031', 'AMMO3': '0.067', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.150', 'AMMO4': '0.153', 'weapon2': '0.156', 'WEAPON3': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.532', 'HITCOUNT': '0.590', 'weapon3': '1.270', 'DAMAGECOUNT': '2.547', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:40,638][2409074] Updated weights for policy 0, policy_version 21721 (0.0012)
[2023-02-25 13:17:40,883][2409075] DAMAGECOUNT value on done: 6192.0
[2023-02-25 13:17:40,887][2409075] Sum rewards: 11.224, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.872', 'AMMO5': '0.009', 'AMMO2': '0.024', 'AMMO3': '0.040', 'AMMO4': '0.120', 'weapon5': '0.170', 'weapon7': '0.236', 'WEAPON5': '0.300', 'WEAPON3': '0.300', 'weapon2': '0.324', 'HITCOUNT': '0.340', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON4': '0.400', 'WEAPON7': '0.500', 'weapon3': '0.830', 'ARMOR': '0.852', 'weapon4': '1.752', 'DAMAGECOUNT': '2.718', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:17:41,005][2409469] DAMAGECOUNT value on done: 8442.0
[2023-02-25 13:17:41,009][2409469] Sum rewards: 9.268, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.204', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO3': '0.060', 'AMMO4': '0.131', 'weapon4': '0.134', 'weapon5': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '0.870', 'weapon3': '1.418', 'weapon2': '1.820', 'DAMAGECOUNT': '3.654', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:17:41,653][2409074] Updated weights for policy 0, policy_version 21731 (0.0014)
[2023-02-25 13:17:41,920][2409078] DAMAGECOUNT value on done: 7370.0
[2023-02-25 13:17:41,922][2409078] Sum rewards: 5.467, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.498', 'AMMO5': '0.018', 'AMMO2': '0.048', 'weapon7': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.110', 'weapon5': '0.232', 'AMMO4': '0.241', 'WEAPON5': '0.400', 'HITCOUNT': '0.400', 'weapon2': '0.474', 'WEAPON4': '0.500', 'WEAPON3': '0.700', 'ARMOR': '0.860', 'weapon4': '1.080', 'weapon3': '1.652', 'DAMAGECOUNT': '2.373', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:41,998][2409101] DAMAGECOUNT value on done: 8009.0
[2023-02-25 13:17:41,999][2409101] Sum rewards: 10.096, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.430', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO3': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.110', 'weapon5': '0.116', 'WEAPON5': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.570', 'weapon2': '0.734', 'weapon3': '0.788', 'weapon4': '1.540', 'DAMAGECOUNT': '2.625', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:17:42,109][2409389] DAMAGECOUNT value on done: 7286.0
[2023-02-25 13:17:42,126][2409389] Sum rewards: 9.430, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.008', 'AMMO5': '0.023', 'AMMO2': '0.041', 'AMMO3': '0.081', 'weapon7': '0.146', 'AMMO4': '0.206', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.288', 'WEAPON7': '0.300', 'WEAPON4': '0.450', 'ARMOR': '0.460', 'WEAPON5': '0.600', 'WEAPON3': '0.600', 'HITCOUNT': '0.700', 'weapon4': '0.772', 'weapon2': '1.180', 'weapon3': '1.274', 'DAMAGECOUNT': '4.626', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:17:42,154][2409597] DAMAGECOUNT value on done: 7051.0
[2023-02-25 13:17:42,158][2409597] Sum rewards: 15.334, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.113', 'AMMO2': '0.017', 'AMMO5': '0.022', 'weapon7': '0.050', 'AMMO3': '0.084', 'AMMO4': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.192', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon4': '0.560', 'HITCOUNT': '0.780', 'weapon2': '1.022', 'weapon3': '1.654', 'DAMAGECOUNT': '3.630', 'FRAGCOUNT': '11.500'}
[2023-02-25 13:17:42,186][2408954] Fps is (10 sec: 23756.3, 60 sec: 24029.8, 300 sec: 24839.8). Total num frames: 89018368. Throughput: 0: 5973.0. Samples: 22254240. Policy #0 lag: (min: 0.0, avg: 15.5, max: 26.0)
[2023-02-25 13:17:42,186][2408954] Avg episode reward: [(0, '10.251')]
[2023-02-25 13:17:42,334][2409486] DAMAGECOUNT value on done: 6122.0
[2023-02-25 13:17:42,337][2409486] Sum rewards: 16.873, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.078', 'weapon4': '0.162', 'weapon5': '0.192', 'WEAPON5': '0.200', 'WEAPON3': '0.350', 'ARMOR': '0.800', 'HEALTH': '0.880', 'HITCOUNT': '1.000', 'weapon3': '1.396', 'weapon2': '1.416', 'DAMAGECOUNT': '4.011', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:17:42,422][2409355] DAMAGECOUNT value on done: 7035.0
[2023-02-25 13:17:42,425][2409355] Sum rewards: 14.591, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.068', 'AMMO5': '0.018', 'AMMO2': '0.037', 'weapon7': '0.050', 'AMMO3': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.185', 'weapon5': '0.188', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.690', 'weapon4': '0.772', 'weapon2': '0.858', 'ARMOR': '1.303', 'weapon3': '1.418', 'DAMAGECOUNT': '3.219', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:17:42,565][2409097] DAMAGECOUNT value on done: 7842.0
[2023-02-25 13:17:42,568][2409097] Sum rewards: 8.695, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.389', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'AMMO5': '0.037', 'weapon7': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.117', 'weapon5': '0.138', 'AMMO4': '0.169', 'WEAPON4': '0.250', 'weapon4': '0.496', 'WEAPON5': '0.700', 'weapon2': '0.788', 'WEAPON3': '0.800', 'HITCOUNT': '0.850', 'ARMOR': '0.855', 'weapon3': '2.094', 'DAMAGECOUNT': '2.850', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:17:42,766][2409565] DAMAGECOUNT value on done: 6878.0
[2023-02-25 13:17:42,767][2409565] Sum rewards: 9.143, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.580', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.013', 'WEAPON1': '0.020', 'weapon7': '0.062', 'AMMO3': '0.063', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.126', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'weapon4': '0.556', 'HITCOUNT': '0.720', 'weapon2': '0.740', 'weapon3': '1.416', 'DAMAGECOUNT': '2.904', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:17:42,909][2409548] DAMAGECOUNT value on done: 6477.0
[2023-02-25 13:17:42,910][2409548] Sum rewards: 15.122, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.860', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon7': '0.060', 'AMMO3': '0.101', 'weapon5': '0.140', 'AMMO4': '0.146', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.270', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'ARMOR': '0.836', 'HITCOUNT': '0.960', 'weapon2': '1.152', 'weapon3': '1.780', 'DAMAGECOUNT': '4.263', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:17:43,131][2409866] DAMAGECOUNT value on done: 6795.0
[2023-02-25 13:17:43,132][2409866] Sum rewards: 8.813, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.272', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon7': '0.052', 'weapon5': '0.090', 'AMMO3': '0.094', 'AMMO4': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'weapon4': '0.838', 'HITCOUNT': '0.840', 'weapon2': '1.234', 'weapon3': '1.448', 'DAMAGECOUNT': '2.784', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:17:43,221][2409096] DAMAGECOUNT value on done: 5612.0
[2023-02-25 13:17:43,222][2409096] Sum rewards: 15.968, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.549', 'AMMO2': '0.004', 'AMMO5': '0.013', 'AMMO4': '0.018', 'weapon5': '0.060', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'weapon4': '0.146', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'HITCOUNT': '0.930', 'weapon3': '1.408', 'weapon2': '1.698', 'DAMAGECOUNT': '3.759', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:17:43,276][2409407] DAMAGECOUNT value on done: 7876.0
[2023-02-25 13:17:43,279][2409407] Sum rewards: 22.908, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.780', 'AMMO5': '0.022', 'AMMO2': '0.028', 'AMMO3': '0.075', 'AMMO4': '0.138', 'weapon5': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.548', 'WEAPON3': '0.600', 'weapon2': '0.674', 'ARMOR': '0.902', 'HITCOUNT': '1.520', 'weapon3': '1.744', 'DAMAGECOUNT': '6.084', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:17:43,794][2409596] DAMAGECOUNT value on done: 6646.0
[2023-02-25 13:17:43,797][2409596] Sum rewards: 14.651, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.603', 'AMMO5': '0.013', 'AMMO2': '0.020', 'AMMO3': '0.030', 'weapon7': '0.052', 'AMMO4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'WEAPON4': '0.300', 'weapon5': '0.366', 'ARMOR': '0.400', 'HITCOUNT': '0.670', 'weapon3': '0.706', 'weapon2': '0.850', 'weapon4': '1.354', 'DAMAGECOUNT': '3.252', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:17:43,926][2409074] Updated weights for policy 0, policy_version 21741 (0.0012)
[2023-02-25 13:17:44,024][2409079] DAMAGECOUNT value on done: 6254.0
[2023-02-25 13:17:44,027][2409079] Sum rewards: 8.484, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.605', 'weapon7': '0.006', 'AMMO5': '0.021', 'AMMO2': '0.021', 'AMMO4': '0.107', 'AMMO3': '0.111', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.238', 'WEAPON4': '0.250', 'weapon4': '0.328', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'HITCOUNT': '0.880', 'weapon2': '1.268', 'weapon3': '1.812', 'DAMAGECOUNT': '2.997', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:17:44,094][2409105] DAMAGECOUNT value on done: 6787.0
[2023-02-25 13:17:44,094][2409105] Sum rewards: 9.730, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.600', 'AMMO2': '0.014', 'AMMO5': '0.033', 'AMMO4': '0.068', 'AMMO3': '0.097', 'weapon5': '0.130', 'weapon7': '0.146', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.250', 'WEAPON7': '0.400', 'WEAPON5': '0.600', 'HITCOUNT': '0.610', 'weapon2': '0.654', 'WEAPON3': '0.700', 'weapon4': '1.140', 'weapon3': '1.652', 'DAMAGECOUNT': '2.856', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:17:44,095][2409104] DAMAGECOUNT value on done: 6409.0
[2023-02-25 13:17:44,096][2409104] Sum rewards: 4.032, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.420', 'AMMO5': '0.017', 'AMMO2': '0.024', 'AMMO3': '0.088', 'AMMO4': '0.117', 'weapon5': '0.184', 'WEAPON4': '0.200', 'HITCOUNT': '0.330', 'WEAPON5': '0.350', 'weapon4': '0.396', 'WEAPON3': '0.550', 'weapon3': '1.154', 'ARMOR': '1.228', 'weapon2': '1.394', 'DAMAGECOUNT': '1.419', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:17:44,242][2409102] DAMAGECOUNT value on done: 7029.0
[2023-02-25 13:17:44,245][2409102] Sum rewards: 18.287, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.785', 'AMMO2': '0.014', 'AMMO5': '0.030', 'AMMO4': '0.070', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'weapon5': '0.270', 'weapon4': '0.376', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'ARMOR': '0.947', 'HITCOUNT': '1.050', 'weapon2': '1.230', 'weapon3': '1.762', 'DAMAGECOUNT': '4.530', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:17:44,331][2409485] DAMAGECOUNT value on done: 6523.0
[2023-02-25 13:17:44,334][2409485] Sum rewards: 14.022, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.114', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO5': '0.015', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'weapon5': '0.272', 'weapon4': '0.274', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'HITCOUNT': '0.820', 'weapon2': '1.260', 'weapon3': '1.774', 'DAMAGECOUNT': '3.591', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:17:44,477][2409077] DAMAGECOUNT value on done: 6692.0
[2023-02-25 13:17:44,478][2409077] Sum rewards: 19.984, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.022', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon7': '0.054', 'AMMO3': '0.089', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.146', 'AMMO4': '0.191', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.900', 'ARMOR': '1.246', 'weapon2': '1.296', 'weapon3': '1.460', 'DAMAGECOUNT': '4.128', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:17:44,486][2409406] DAMAGECOUNT value on done: 6651.0
[2023-02-25 13:17:44,488][2409406] Sum rewards: 10.350, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.628', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'AMMO5': '0.027', 'weapon7': '0.060', 'weapon4': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.116', 'AMMO3': '0.119', 'AMMO4': '0.129', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'ARMOR': '0.800', 'HITCOUNT': '0.970', 'weapon2': '1.550', 'weapon3': '1.898', 'DAMAGECOUNT': '4.233', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:17:44,643][2409405] DAMAGECOUNT value on done: 8628.0
[2023-02-25 13:17:44,646][2409405] Sum rewards: 13.604, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.894', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO3': '0.040', 'ARMOR': '0.040', 'weapon7': '0.052', 'AMMO4': '0.091', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon5': '0.176', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'WEAPON4': '0.400', 'HITCOUNT': '0.640', 'weapon4': '0.710', 'weapon3': '0.840', 'weapon2': '1.052', 'DAMAGECOUNT': '4.041', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:17:44,693][2409076] DAMAGECOUNT value on done: 7526.0
[2023-02-25 13:17:44,697][2409076] Sum rewards: 11.463, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.017', 'AMMO2': '0.023', 'AMMO3': '0.081', 'AMMO4': '0.114', 'weapon4': '0.140', 'WEAPON4': '0.150', 'weapon5': '0.244', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.680', 'HEALTH': '0.744', 'ARMOR': '0.800', 'weapon2': '1.140', 'weapon3': '1.448', 'DAMAGECOUNT': '3.081', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:44,743][2409075] DAMAGECOUNT value on done: 6247.0
[2023-02-25 13:17:44,744][2409075] Sum rewards: 10.066, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.094', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO3': '0.040', 'AMMO4': '0.049', 'weapon7': '0.080', 'weapon5': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'HITCOUNT': '0.580', 'weapon4': '0.790', 'weapon3': '0.970', 'ARMOR': '0.992', 'weapon2': '1.572', 'DAMAGECOUNT': '2.142', 'FRAGCOUNT': '6.500'}
[2023-02-25 13:17:44,772][2409548] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:17:45,359][2409074] Updated weights for policy 0, policy_version 21751 (0.0012)
[2023-02-25 13:17:45,557][2409373] DAMAGECOUNT value on done: 8410.0
[2023-02-25 13:17:45,558][2409373] Sum rewards: 14.990, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.142', 'AMMO5': '0.017', 'AMMO2': '0.029', 'AMMO4': '0.145', 'AMMO3': '0.158', 'weapon5': '0.268', 'WEAPON4': '0.300', 'weapon4': '0.336', 'WEAPON5': '0.400', 'ARMOR': '0.800', 'WEAPON3': '0.850', 'weapon2': '0.888', 'HITCOUNT': '1.080', 'weapon3': '2.100', 'DAMAGECOUNT': '5.010', 'FRAGCOUNT': '12.500'}
[2023-02-25 13:17:45,744][2409469] DAMAGECOUNT value on done: 9646.0
[2023-02-25 13:17:45,749][2409469] Sum rewards: 6.739, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.200', 'AMMO5': '0.026', 'weapon7': '0.028', 'WEAPON1': '0.030', 'AMMO2': '0.039', 'AMMO3': '0.098', 'AMMO4': '0.196', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.256', 'WEAPON4': '0.400', 'weapon4': '0.418', 'HITCOUNT': '0.670', 'WEAPON3': '0.700', 'WEAPON5': '0.700', 'ARMOR': '0.841', 'weapon2': '0.892', 'weapon3': '1.436', 'DAMAGECOUNT': '2.859', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:17:45,999][2409078] DAMAGECOUNT value on done: 6869.0
[2023-02-25 13:17:46,000][2409078] Sum rewards: 12.435, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.920', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.018', 'AMMO3': '0.080', 'AMMO4': '0.085', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon7': '0.258', 'AMMO6': '0.440', 'AMMO7': '0.440', 'WEAPON3': '0.500', 'WEAPON7': '0.600', 'weapon2': '0.676', 'HITCOUNT': '0.680', 'weapon3': '0.716', 'weapon4': '1.272', 'ARMOR': '1.324', 'DAMAGECOUNT': '3.891', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:46,081][2409389] DAMAGECOUNT value on done: 8797.0
[2023-02-25 13:17:46,082][2409389] Sum rewards: 13.446, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.370', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO5': '0.032', 'AMMO4': '0.085', 'AMMO3': '0.159', 'weapon5': '0.194', 'weapon4': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.600', 'weapon2': '0.624', 'WEAPON3': '1.050', 'HITCOUNT': '1.110', 'ARMOR': '1.369', 'weapon3': '2.222', 'DAMAGECOUNT': '4.248', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:17:46,177][2409597] DAMAGECOUNT value on done: 6023.0
[2023-02-25 13:17:46,178][2409597] Sum rewards: 9.739, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.450', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.021', 'AMMO4': '0.059', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'weapon5': '0.190', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'ARMOR': '0.898', 'HITCOUNT': '1.020', 'weapon2': '1.606', 'weapon3': '1.808', 'DAMAGECOUNT': '4.290', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:46,188][2409486] DAMAGECOUNT value on done: 6287.0
[2023-02-25 13:17:46,191][2409486] Sum rewards: 11.379, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.360', 'AMMO2': '0.010', 'AMMO5': '0.025', 'AMMO4': '0.050', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon5': '0.258', 'WEAPON5': '0.350', 'HITCOUNT': '0.630', 'WEAPON3': '0.650', 'ARMOR': '0.955', 'weapon2': '1.292', 'weapon3': '2.054', 'DAMAGECOUNT': '3.417', 'FRAGCOUNT': '8.500'}
[2023-02-25 13:17:46,392][2409355] DAMAGECOUNT value on done: 7986.0
[2023-02-25 13:17:46,395][2409355] Sum rewards: 9.508, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.382', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.109', 'weapon5': '0.134', 'weapon4': '0.242', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.860', 'weapon2': '1.466', 'weapon3': '1.582', 'DAMAGECOUNT': '3.069', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:17:46,730][2409866] Large shaping reward 2.551 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.519, 173.0), ('weapon7', 0.002)]
[2023-02-25 13:17:46,805][2409097] DAMAGECOUNT value on done: 6343.0
[2023-02-25 13:17:46,806][2409097] Sum rewards: 7.252, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.544', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.029', 'AMMO5': '0.032', 'WEAPON4': '0.100', 'weapon7': '0.108', 'weapon4': '0.122', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO3': '0.179', 'WEAPON7': '0.200', 'weapon5': '0.288', 'ARMOR': '0.447', 'WEAPON5': '0.800', 'HITCOUNT': '0.840', 'WEAPON3': '1.150', 'weapon2': '1.218', 'weapon3': '1.850', 'DAMAGECOUNT': '3.336', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:17:46,819][2409866] DAMAGECOUNT value on done: 7807.0
[2023-02-25 13:17:46,820][2409866] Sum rewards: 11.725, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.875', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.025', 'weapon7': '0.056', 'AMMO3': '0.061', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.126', 'weapon5': '0.182', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'ARMOR': '0.458', 'HITCOUNT': '0.520', 'weapon4': '0.536', 'weapon3': '1.032', 'weapon2': '1.344', 'DAMAGECOUNT': '2.991', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:17:47,050][2409565] DAMAGECOUNT value on done: 8491.0
[2023-02-25 13:17:47,054][2409565] Sum rewards: 10.779, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.676', 'AMMO5': '0.032', 'AMMO2': '0.073', 'weapon7': '0.106', 'AMMO3': '0.119', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.304', 'AMMO4': '0.366', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'HITCOUNT': '0.670', 'WEAPON3': '0.700', 'weapon2': '0.728', 'ARMOR': '0.800', 'weapon3': '1.202', 'weapon4': '1.260', 'DAMAGECOUNT': '4.095', 'FRAGCOUNT': '10.500'}
[2023-02-25 13:17:47,186][2408954] Fps is (10 sec: 23756.6, 60 sec: 23893.4, 300 sec: 24784.3). Total num frames: 89128960. Throughput: 0: 5965.9. Samples: 22289868. Policy #0 lag: (min: 0.0, avg: 15.5, max: 26.0)
[2023-02-25 13:17:47,187][2408954] Avg episode reward: [(0, '11.345')]
[2023-02-25 13:17:47,301][2409074] Updated weights for policy 0, policy_version 21761 (0.0013)
[2023-02-25 13:17:47,361][2409407] DAMAGECOUNT value on done: 7470.0
[2023-02-25 13:17:47,363][2409407] Sum rewards: 14.257, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO3': '0.056', 'AMMO4': '0.063', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.148', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'HEALTH': '0.218', 'weapon4': '0.226', 'WEAPON3': '0.300', 'ARMOR': '0.520', 'HITCOUNT': '0.640', 'weapon3': '1.182', 'weapon2': '1.694', 'DAMAGECOUNT': '3.249', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:17:47,552][2409548] DAMAGECOUNT value on done: 8285.0
[2023-02-25 13:17:47,555][2409548] Sum rewards: 5.428, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.838', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.012', 'weapon7': '0.032', 'AMMO3': '0.087', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.170', 'WEAPON5': '0.350', 'HITCOUNT': '0.510', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'weapon3': '1.646', 'weapon2': '1.748', 'DAMAGECOUNT': '1.968', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:17:47,673][2409596] DAMAGECOUNT value on done: 7196.0
[2023-02-25 13:17:47,674][2409596] Sum rewards: 9.534, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.660', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO5': '0.030', 'weapon4': '0.040', 'AMMO4': '0.090', 'AMMO3': '0.096', 'WEAPON4': '0.200', 'weapon5': '0.344', 'HITCOUNT': '0.560', 'WEAPON3': '0.650', 'WEAPON5': '0.700', 'ARMOR': '0.897', 'weapon3': '1.498', 'weapon2': '1.606', 'DAMAGECOUNT': '3.444', 'FRAGCOUNT': '8.500'}
[2023-02-25 13:17:47,804][2409096] DAMAGECOUNT value on done: 7261.0
[2023-02-25 13:17:47,807][2409096] Sum rewards: 16.168, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.120', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO3': '0.055', 'weapon5': '0.236', 'WEAPON5': '0.400', 'ARMOR': '0.451', 'WEAPON3': '0.500', 'HITCOUNT': '0.810', 'weapon3': '1.154', 'weapon2': '1.898', 'DAMAGECOUNT': '3.777', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:17:47,891][2409105] DAMAGECOUNT value on done: 8496.0
[2023-02-25 13:17:47,892][2409105] Sum rewards: 8.662, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.315', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.036', 'AMMO3': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon7': '0.124', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.246', 'WEAPON3': '0.350', 'WEAPON7': '0.400', 'HITCOUNT': '0.490', 'weapon3': '0.988', 'ARMOR': '1.256', 'weapon2': '2.246', 'DAMAGECOUNT': '2.340', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:17:47,995][2409104] DAMAGECOUNT value on done: 6274.0
[2023-02-25 13:17:47,996][2409104] Sum rewards: 12.172, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.129', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.089', 'AMMO4': '0.117', 'WEAPON4': '0.200', 'weapon4': '0.282', 'weapon5': '0.294', 'WEAPON5': '0.450', 'HITCOUNT': '0.640', 'WEAPON3': '0.650', 'ARMOR': '0.873', 'weapon2': '1.358', 'weapon3': '1.464', 'DAMAGECOUNT': '3.573', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:17:48,305][2409485] DAMAGECOUNT value on done: 6920.0
[2023-02-25 13:17:48,306][2409485] Sum rewards: 8.345, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.009', 'AMMO5': '0.013', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.055', 'weapon5': '0.058', 'AMMO4': '0.077', 'weapon7': '0.090', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON3': '0.350', 'WEAPON7': '0.400', 'HITCOUNT': '0.450', 'weapon3': '0.890', 'weapon2': '1.134', 'weapon4': '1.364', 'DAMAGECOUNT': '1.848', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:17:48,422][2409079] DAMAGECOUNT value on done: 6092.0
[2023-02-25 13:17:48,422][2409079] Sum rewards: 15.330, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.088', 'AMMO5': '0.017', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'weapon4': '0.084', 'AMMO4': '0.101', 'weapon5': '0.396', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '0.650', 'weapon2': '1.196', 'ARMOR': '1.240', 'weapon3': '1.902', 'DAMAGECOUNT': '2.931', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:17:48,491][2409405] DAMAGECOUNT value on done: 7599.0
[2023-02-25 13:17:48,494][2409405] Sum rewards: 18.592, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.557', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.034', 'weapon4': '0.042', 'AMMO3': '0.074', 'WEAPON4': '0.100', 'weapon5': '0.214', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '1.170', 'weapon3': '1.604', 'weapon2': '1.672', 'ARMOR': '1.695', 'DAMAGECOUNT': '4.677', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:17:48,819][2409406] DAMAGECOUNT value on done: 6655.0
[2023-02-25 13:17:48,820][2409406] Sum rewards: 7.312, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.314', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO4': '0.017', 'AMMO3': '0.080', 'weapon5': '0.150', 'WEAPON5': '0.400', 'ARMOR': '0.453', 'WEAPON3': '0.650', 'HITCOUNT': '0.800', 'weapon2': '1.664', 'weapon3': '1.952', 'DAMAGECOUNT': '3.180', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:17:48,821][2409077] DAMAGECOUNT value on done: 8977.0
[2023-02-25 13:17:48,824][2409077] Sum rewards: 14.273, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.700', 'AMMO5': '0.022', 'AMMO2': '0.041', 'weapon4': '0.100', 'AMMO3': '0.102', 'WEAPON4': '0.150', 'AMMO4': '0.207', 'weapon5': '0.220', 'ARMOR': '0.400', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'HITCOUNT': '1.120', 'weapon2': '1.414', 'weapon3': '1.776', 'DAMAGECOUNT': '4.869', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:17:49,018][2409074] Updated weights for policy 0, policy_version 21771 (0.0012)
[2023-02-25 13:17:49,073][2409076] DAMAGECOUNT value on done: 7525.0
[2023-02-25 13:17:49,074][2409076] Sum rewards: 17.100, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.017', 'AMMO2': '0.025', 'weapon7': '0.052', 'HEALTH': '0.058', 'AMMO3': '0.077', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.272', 'WEAPON5': '0.300', 'weapon5': '0.304', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.640', 'weapon2': '1.386', 'weapon3': '1.640', 'DAMAGECOUNT': '3.762', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:17:49,213][2409075] DAMAGECOUNT value on done: 7109.0
[2023-02-25 13:17:49,214][2409075] Sum rewards: 11.984, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.123', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.010', 'weapon7': '0.070', 'AMMO3': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.196', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.471', 'WEAPON3': '0.550', 'HITCOUNT': '0.780', 'weapon3': '1.626', 'weapon2': '1.692', 'DAMAGECOUNT': '3.672', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:17:49,900][2409373] DAMAGECOUNT value on done: 6940.0
[2023-02-25 13:17:49,901][2409373] Sum rewards: 17.739, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.043', 'HEALTH': '0.045', 'AMMO3': '0.070', 'weapon7': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.152', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'ARMOR': '0.453', 'weapon4': '0.462', 'weapon2': '0.814', 'HITCOUNT': '0.980', 'weapon3': '1.814', 'DAMAGECOUNT': '3.795', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:17:49,938][2409469] DAMAGECOUNT value on done: 7885.0
[2023-02-25 13:17:49,941][2409469] Sum rewards: 5.117, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.310', 'weapon7': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'weapon5': '0.142', 'weapon4': '0.172', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.350', 'ARMOR': '0.451', 'HITCOUNT': '0.570', 'WEAPON3': '0.800', 'weapon2': '1.658', 'weapon3': '1.728', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:17:49,943][2409078] DAMAGECOUNT value on done: 7188.0
[2023-02-25 13:17:49,946][2409078] Sum rewards: 6.811, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.403', 'AMMO2': '0.009', 'AMMO5': '0.018', 'AMMO3': '0.040', 'AMMO4': '0.046', 'weapon7': '0.048', 'weapon5': '0.150', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.840', 'ARMOR': '0.852', 'weapon3': '0.958', 'weapon4': '1.028', 'weapon2': '1.462', 'DAMAGECOUNT': '3.072', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:17:49,951][2409597] DAMAGECOUNT value on done: 7595.0
[2023-02-25 13:17:49,953][2409597] Sum rewards: 15.687, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.623', 'AMMO2': '0.014', 'AMMO5': '0.015', 'AMMO4': '0.069', 'AMMO3': '0.070', 'weapon7': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.310', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.850', 'ARMOR': '0.858', 'weapon3': '0.894', 'weapon4': '1.042', 'weapon2': '1.148', 'DAMAGECOUNT': '4.308', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:17:49,966][2409355] DAMAGECOUNT value on done: 8167.0
[2023-02-25 13:17:49,966][2409355] Sum rewards: 18.517, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.078', 'AMMO4': '0.114', 'weapon7': '0.138', 'weapon5': '0.158', 'HEALTH': '0.170', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'weapon2': '0.626', 'weapon4': '0.884', 'HITCOUNT': '1.080', 'weapon3': '1.518', 'DAMAGECOUNT': '4.068', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:17:50,031][2409486] DAMAGECOUNT value on done: 6616.0
[2023-02-25 13:17:50,032][2409486] Sum rewards: 15.164, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.954', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.083', 'weapon7': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.204', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.610', 'weapon2': '0.730', 'ARMOR': '0.949', 'weapon4': '1.012', 'weapon3': '1.466', 'DAMAGECOUNT': '3.897', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:17:50,377][2409866] DAMAGECOUNT value on done: 8013.0
[2023-02-25 13:17:50,378][2409866] Sum rewards: 4.130, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.901', 'AMMO2': '0.003', 'AMMO5': '0.011', 'AMMO4': '0.016', 'AMMO3': '0.031', 'weapon5': '0.048', 'weapon7': '0.086', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.250', 'weapon4': '0.254', 'HITCOUNT': '0.400', 'weapon3': '0.538', 'ARMOR': '0.891', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.425', 'weapon2': '2.288'}
[2023-02-25 13:17:50,805][2409389] DAMAGECOUNT value on done: 6027.0
[2023-02-25 13:17:50,809][2409389] Sum rewards: 7.067, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.116', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.015', 'weapon5': '0.042', 'weapon7': '0.074', 'AMMO3': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.457', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'weapon4': '0.694', 'weapon3': '1.220', 'weapon2': '1.248', 'DAMAGECOUNT': '2.505', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:17:50,916][2409074] Updated weights for policy 0, policy_version 21781 (0.0013)
[2023-02-25 13:17:51,558][2409548] DAMAGECOUNT value on done: 6999.0
[2023-02-25 13:17:51,560][2409548] Sum rewards: 7.709, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.482', 'AMMO5': '0.015', 'AMMO2': '0.019', 'AMMO3': '0.058', 'AMMO4': '0.097', 'weapon7': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.206', 'WEAPON5': '0.350', 'weapon4': '0.368', 'WEAPON3': '0.400', 'HITCOUNT': '0.400', 'ARMOR': '1.024', 'weapon3': '1.208', 'weapon2': '1.654', 'DAMAGECOUNT': '2.442', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:17:51,585][2409097] DAMAGECOUNT value on done: 6862.0
[2023-02-25 13:17:51,586][2409097] Sum rewards: 12.636, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.800', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.015', 'weapon5': '0.060', 'AMMO3': '0.063', 'WEAPON4': '0.100', 'weapon7': '0.118', 'WEAPON5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.490', 'weapon3': '0.720', 'weapon4': '0.814', 'ARMOR': '0.882', 'weapon2': '1.812', 'DAMAGECOUNT': '2.763', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:51,609][2409596] DAMAGECOUNT value on done: 5810.0
[2023-02-25 13:17:51,612][2409596] Sum rewards: 11.481, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.015', 'ARMOR': '0.016', 'AMMO2': '0.021', 'weapon5': '0.084', 'AMMO4': '0.102', 'weapon7': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.144', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.372', 'HEALTH': '0.456', 'weapon2': '0.710', 'WEAPON3': '0.800', 'HITCOUNT': '1.000', 'weapon3': '2.208', 'DAMAGECOUNT': '3.759', 'FRAGCOUNT': '10.500'}
[2023-02-25 13:17:51,728][2409407] DAMAGECOUNT value on done: 6322.0
[2023-02-25 13:17:51,732][2409407] Sum rewards: 12.557, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.604', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO3': '0.068', 'AMMO4': '0.133', 'weapon7': '0.160', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'weapon5': '0.288', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.696', 'HITCOUNT': '0.770', 'weapon3': '1.230', 'weapon2': '1.382', 'DAMAGECOUNT': '3.255', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:17:51,913][2409104] DAMAGECOUNT value on done: 7069.0
[2023-02-25 13:17:51,916][2409104] Sum rewards: 12.504, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.577', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.020', 'AMMO3': '0.092', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'weapon7': '0.108', 'weapon5': '0.172', 'weapon4': '0.188', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.790', 'ARMOR': '1.316', 'weapon2': '1.574', 'weapon3': '1.700', 'DAMAGECOUNT': '2.706', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:17:51,959][2409096] DAMAGECOUNT value on done: 6998.0
[2023-02-25 13:17:51,960][2409096] Sum rewards: 13.599, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.242', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon5': '0.058', 'weapon7': '0.062', 'AMMO4': '0.081', 'AMMO3': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.450', 'weapon4': '0.490', 'WEAPON3': '0.700', 'weapon2': '0.798', 'HITCOUNT': '1.150', 'weapon3': '1.698', 'DAMAGECOUNT': '3.933', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:17:51,975][2409105] DAMAGECOUNT value on done: 7132.0
[2023-02-25 13:17:51,976][2409105] Sum rewards: 8.601, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.598', 'AMMO2': '0.012', 'AMMO5': '0.020', 'AMMO4': '0.058', 'weapon7': '0.068', 'weapon5': '0.076', 'AMMO3': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'ARMOR': '0.476', 'weapon4': '0.544', 'HITCOUNT': '0.700', 'WEAPON3': '0.750', 'weapon2': '1.002', 'weapon3': '2.016', 'DAMAGECOUNT': '2.625', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:52,066][2409565] DAMAGECOUNT value on done: 8284.0
[2023-02-25 13:17:52,067][2409565] Sum rewards: 8.015, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.221', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'AMMO3': '0.093', 'weapon5': '0.154', 'ARMOR': '0.452', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'HITCOUNT': '0.770', 'weapon2': '1.474', 'weapon3': '2.146', 'DAMAGECOUNT': '2.580', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:17:52,186][2408954] Fps is (10 sec: 22938.1, 60 sec: 23756.8, 300 sec: 24742.6). Total num frames: 89247744. Throughput: 0: 5958.9. Samples: 22307532. Policy #0 lag: (min: 0.0, avg: 15.5, max: 26.0)
[2023-02-25 13:17:52,186][2408954] Avg episode reward: [(0, '11.469')]
[2023-02-25 13:17:52,187][2409033] Saving new best policy, reward=11.469!
[2023-02-25 13:17:52,234][2409405] DAMAGECOUNT value on done: 9139.0
[2023-02-25 13:17:52,237][2409405] Sum rewards: 23.665, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.170', 'AMMO2': '0.009', 'AMMO5': '0.015', 'AMMO4': '0.046', 'AMMO3': '0.070', 'WEAPON4': '0.200', 'weapon4': '0.260', 'weapon5': '0.266', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'ARMOR': '0.853', 'weapon2': '1.174', 'HITCOUNT': '1.270', 'weapon3': '1.490', 'DAMAGECOUNT': '5.382', 'FRAGCOUNT': '18.000'}
[2023-02-25 13:17:52,396][2409485] DAMAGECOUNT value on done: 9264.0
[2023-02-25 13:17:52,397][2409485] Sum rewards: 8.138, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.169', 'AMMO2': '0.009', 'AMMO5': '0.019', 'AMMO4': '0.046', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.116', 'AMMO3': '0.133', 'weapon4': '0.214', 'WEAPON5': '0.350', 'HITCOUNT': '0.820', 'WEAPON3': '0.850', 'ARMOR': '0.854', 'weapon2': '0.986', 'weapon3': '1.830', 'DAMAGECOUNT': '3.420', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:17:52,547][2409079] DAMAGECOUNT value on done: 6845.0
[2023-02-25 13:17:52,550][2409079] Sum rewards: 6.436, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.904', 'AMMO2': '0.013', 'AMMO5': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.068', 'weapon5': '0.124', 'weapon4': '0.284', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'HITCOUNT': '0.660', 'weapon2': '1.090', 'weapon3': '1.388', 'DAMAGECOUNT': '2.478', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:17:52,674][2409074] Updated weights for policy 0, policy_version 21791 (0.0014)
[2023-02-25 13:17:52,928][2409406] DAMAGECOUNT value on done: 8387.0
[2023-02-25 13:17:52,928][2409406] Sum rewards: 13.876, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.382', 'AMMO5': '0.018', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'weapon7': '0.052', 'AMMO3': '0.084', 'AMMO4': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.332', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon4': '0.576', 'HITCOUNT': '0.910', 'ARMOR': '1.270', 'weapon3': '1.322', 'weapon2': '1.356', 'DAMAGECOUNT': '4.260', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:17:52,938][2409077] DAMAGECOUNT value on done: 8403.0
[2023-02-25 13:17:52,939][2409077] Sum rewards: 12.589, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.907', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.015', 'AMMO4': '0.061', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'weapon5': '0.186', 'weapon4': '0.216', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.890', 'weapon2': '1.492', 'weapon3': '1.514', 'DAMAGECOUNT': '3.606', 'FRAGCOUNT': '9.500'}
[2023-02-25 13:17:53,019][2409076] DAMAGECOUNT value on done: 7818.0
[2023-02-25 13:17:53,022][2409076] Sum rewards: 12.848, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.678', 'AMMO2': '0.005', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.024', 'AMMO3': '0.075', 'weapon4': '0.084', 'WEAPON4': '0.100', 'weapon5': '0.280', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.820', 'weapon2': '1.496', 'weapon3': '1.646', 'DAMAGECOUNT': '3.408', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:17:53,412][2409468] Large shaping reward 2.550 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.534, 178.0), ('HEALTH', -0.006, -2.0), ('weapon5', 0.002)]
[2023-02-25 13:17:53,532][2409075] DAMAGECOUNT value on done: 6462.0
[2023-02-25 13:17:53,533][2409075] Sum rewards: 5.126, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon7': '0.048', 'AMMO3': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.114', 'WEAPON4': '0.150', 'AMMO4': '0.189', 'weapon5': '0.216', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'HITCOUNT': '0.710', 'HEALTH': '1.050', 'weapon3': '1.494', 'ARMOR': '1.604', 'weapon2': '1.762', 'DAMAGECOUNT': '2.709', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:17:53,576][2409078] DAMAGECOUNT value on done: 6486.0
[2023-02-25 13:17:53,577][2409078] Sum rewards: 6.436, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.014', 'AMMO5': '0.015', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.072', 'AMMO3': '0.084', 'AMMO4': '0.097', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '0.600', 'weapon4': '0.628', 'HITCOUNT': '0.760', 'ARMOR': '0.858', 'weapon2': '1.266', 'weapon3': '1.270', 'DAMAGECOUNT': '2.811', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:17:53,687][2409373] DAMAGECOUNT value on done: 6299.0
[2023-02-25 13:17:53,688][2409373] Sum rewards: 12.027, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.432', 'AMMO2': '0.007', 'AMMO5': '0.012', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'weapon5': '0.182', 'weapon4': '0.210', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'ARMOR': '0.912', 'HITCOUNT': '0.930', 'weapon3': '1.444', 'weapon2': '1.708', 'DAMAGECOUNT': '3.639', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:17:53,789][2409469] DAMAGECOUNT value on done: 7264.0
[2023-02-25 13:17:53,793][2409469] Sum rewards: 9.117, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.738', 'AMMO2': '0.012', 'AMMO5': '0.020', 'weapon5': '0.052', 'AMMO4': '0.062', 'AMMO3': '0.110', 'weapon7': '0.146', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.400', 'HITCOUNT': '0.750', 'WEAPON3': '0.800', 'ARMOR': '0.932', 'weapon4': '0.962', 'weapon2': '1.096', 'weapon3': '1.528', 'DAMAGECOUNT': '2.595', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:53,938][2409486] DAMAGECOUNT value on done: 7061.0
[2023-02-25 13:17:53,942][2409486] Sum rewards: 6.844, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.510', 'AMMO2': '0.008', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'weapon7': '0.024', 'AMMO4': '0.041', 'AMMO3': '0.064', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.242', 'weapon5': '0.392', 'WEAPON5': '0.450', 'HITCOUNT': '0.470', 'ARMOR': '0.500', 'WEAPON3': '0.550', 'weapon2': '1.296', 'weapon3': '1.456', 'DAMAGECOUNT': '2.274', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:17:53,986][2409355] DAMAGECOUNT value on done: 7897.0
[2023-02-25 13:17:53,987][2409355] Sum rewards: 17.056, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.066', 'AMMO4': '0.087', 'WEAPON5': '0.200', 'weapon4': '0.236', 'weapon5': '0.244', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HEALTH': '0.532', 'HITCOUNT': '0.770', 'weapon2': '1.110', 'weapon3': '1.180', 'DAMAGECOUNT': '3.234', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:17:54,081][2409074] Updated weights for policy 0, policy_version 21801 (0.0013)
[2023-02-25 13:17:54,346][2409597] DAMAGECOUNT value on done: 7385.0
[2023-02-25 13:17:54,349][2409597] Sum rewards: 10.029, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.082', 'AMMO5': '0.003', 'AMMO2': '0.017', 'AMMO3': '0.042', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'weapon7': '0.218', 'WEAPON3': '0.300', 'AMMO6': '0.380', 'AMMO7': '0.380', 'ARMOR': '0.499', 'WEAPON7': '0.500', 'HITCOUNT': '0.550', 'weapon4': '0.926', 'weapon3': '1.028', 'weapon2': '1.352', 'DAMAGECOUNT': '2.328', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:17:54,429][2409866] DAMAGECOUNT value on done: 7674.0
[2023-02-25 13:17:54,432][2409866] Sum rewards: 11.854, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.376', 'AMMO5': '0.025', 'AMMO2': '0.031', 'AMMO3': '0.092', 'weapon7': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.154', 'WEAPON7': '0.200', 'weapon5': '0.222', 'WEAPON4': '0.350', 'WEAPON5': '0.550', 'weapon4': '0.590', 'WEAPON3': '0.600', 'HITCOUNT': '0.700', 'ARMOR': '0.861', 'weapon3': '1.196', 'weapon2': '1.364', 'DAMAGECOUNT': '3.213', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:17:54,863][2409389] DAMAGECOUNT value on done: 7280.0
[2023-02-25 13:17:54,875][2409389] Sum rewards: 18.952, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.366', 'weapon7': '0.002', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.037', 'AMMO3': '0.088', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.183', 'weapon5': '0.282', 'weapon4': '0.318', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'ARMOR': '0.804', 'HITCOUNT': '1.220', 'weapon2': '1.362', 'weapon3': '1.722', 'DAMAGECOUNT': '4.818', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:17:55,251][2409548] DAMAGECOUNT value on done: 6269.0
[2023-02-25 13:17:55,255][2409548] Sum rewards: 6.566, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.488', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.051', 'AMMO3': '0.065', 'weapon7': '0.128', 'weapon5': '0.134', 'WEAPON5': '0.250', 'AMMO4': '0.255', 'AMMO6': '0.340', 'AMMO7': '0.340', 'ARMOR': '0.400', 'WEAPON7': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '0.550', 'HITCOUNT': '0.640', 'weapon4': '0.810', 'weapon2': '1.208', 'weapon3': '1.260', 'DAMAGECOUNT': '3.045', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:17:55,259][2409100] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:17:55,270][2409407] DAMAGECOUNT value on done: 5736.0
[2023-02-25 13:17:55,271][2409407] Sum rewards: 11.252, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.766', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO3': '0.060', 'AMMO4': '0.061', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.214', 'WEAPON3': '0.500', 'HITCOUNT': '0.650', 'ARMOR': '1.232', 'weapon3': '1.490', 'weapon2': '1.710', 'DAMAGECOUNT': '2.865', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:55,629][2409565] DAMAGECOUNT value on done: 6553.0
[2023-02-25 13:17:55,634][2409565] Sum rewards: 9.345, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.582', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO3': '0.050', 'weapon7': '0.064', 'AMMO4': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.102', 'weapon5': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'ARMOR': '0.458', 'HITCOUNT': '0.660', 'weapon3': '1.146', 'weapon2': '2.340', 'DAMAGECOUNT': '2.712', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:17:55,678][2409074] Updated weights for policy 0, policy_version 21811 (0.0014)
[2023-02-25 13:17:55,765][2409104] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:17:55,823][2409405] DAMAGECOUNT value on done: 6336.0
[2023-02-25 13:17:55,824][2409405] Sum rewards: 7.179, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.848', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO5': '0.010', 'AMMO3': '0.058', 'weapon5': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.158', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.420', 'WEAPON3': '0.450', 'ARMOR': '0.495', 'weapon3': '1.348', 'weapon2': '1.384', 'DAMAGECOUNT': '1.965', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:17:56,029][2409596] DAMAGECOUNT value on done: 6977.0
[2023-02-25 13:17:56,029][2409596] Sum rewards: 8.099, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.192', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'weapon5': '0.112', 'weapon4': '0.134', 'WEAPON5': '0.200', 'HITCOUNT': '0.580', 'WEAPON3': '0.750', 'weapon2': '1.626', 'weapon3': '1.722', 'ARMOR': '1.757', 'DAMAGECOUNT': '2.637', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:17:56,040][2409097] DAMAGECOUNT value on done: 6714.0
[2023-02-25 13:17:56,041][2409097] Sum rewards: 10.610, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.750', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.102', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.226', 'WEAPON4': '0.250', 'weapon4': '0.342', 'WEAPON5': '0.350', 'HITCOUNT': '0.620', 'WEAPON3': '0.650', 'weapon2': '1.228', 'ARMOR': '1.348', 'weapon3': '1.416', 'DAMAGECOUNT': '3.624', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:56,077][2409096] DAMAGECOUNT value on done: 7481.0
[2023-02-25 13:17:56,080][2409096] Sum rewards: 8.315, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.190', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.038', 'AMMO3': '0.060', 'weapon7': '0.166', 'weapon5': '0.176', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'HITCOUNT': '0.320', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'weapon3': '0.854', 'weapon2': '1.088', 'weapon4': '1.452', 'DAMAGECOUNT': '1.953', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:17:56,111][2409079] DAMAGECOUNT value on done: 7288.0
[2023-02-25 13:17:56,114][2409079] Sum rewards: 10.381, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.484', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'AMMO3': '0.107', 'weapon4': '0.124', 'WEAPON5': '0.200', 'weapon5': '0.220', 'ARMOR': '0.457', 'WEAPON3': '0.650', 'HITCOUNT': '0.830', 'weapon2': '1.286', 'weapon3': '1.550', 'DAMAGECOUNT': '3.588', 'FRAGCOUNT': '8.500'}
[2023-02-25 13:17:56,344][2409104] DAMAGECOUNT value on done: 8001.0
[2023-02-25 13:17:56,348][2409104] Sum rewards: 17.949, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.728', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.017', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'weapon5': '0.202', 'weapon4': '0.216', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'HITCOUNT': '1.170', 'weapon2': '1.232', 'weapon3': '2.014', 'DAMAGECOUNT': '5.778', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:17:56,722][2409105] DAMAGECOUNT value on done: 8017.0
[2023-02-25 13:17:56,726][2409105] Sum rewards: 12.500, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.240', 'weapon7': '0.002', 'AMMO5': '0.017', 'AMMO2': '0.021', 'AMMO3': '0.102', 'AMMO4': '0.107', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.290', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'ARMOR': '0.452', 'WEAPON3': '0.650', 'weapon4': '0.774', 'weapon2': '1.008', 'HITCOUNT': '1.010', 'weapon3': '1.296', 'DAMAGECOUNT': '3.810', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:17:56,950][2409076] DAMAGECOUNT value on done: 7127.0
[2023-02-25 13:17:56,953][2409076] Sum rewards: 1.705, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.320', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.022', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'weapon5': '0.248', 'weapon4': '0.266', 'WEAPON5': '0.400', 'HITCOUNT': '0.610', 'WEAPON3': '0.700', 'weapon2': '1.160', 'ARMOR': '1.402', 'weapon3': '1.932', 'DAMAGECOUNT': '2.094', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:17:57,155][2409078] DAMAGECOUNT value on done: 6947.0
[2023-02-25 13:17:57,159][2409078] Sum rewards: 9.486, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.630', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon5': '0.048', 'weapon7': '0.078', 'AMMO3': '0.091', 'AMMO4': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.448', 'WEAPON3': '0.550', 'HITCOUNT': '0.560', 'weapon2': '0.726', 'weapon4': '0.948', 'weapon3': '1.040', 'DAMAGECOUNT': '2.181', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:17:57,186][2408954] Fps is (10 sec: 23756.9, 60 sec: 23825.1, 300 sec: 24756.5). Total num frames: 89366528. Throughput: 0: 5982.4. Samples: 22344240. Policy #0 lag: (min: 0.0, avg: 10.2, max: 25.0)
[2023-02-25 13:17:57,186][2408954] Avg episode reward: [(0, '11.484')]
[2023-02-25 13:17:57,190][2409033] Saving new best policy, reward=11.484!
[2023-02-25 13:17:57,387][2409406] DAMAGECOUNT value on done: 5551.0
[2023-02-25 13:17:57,388][2409406] Sum rewards: 12.230, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.774', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO5': '0.031', 'AMMO3': '0.063', 'AMMO4': '0.111', 'weapon7': '0.136', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.350', 'weapon5': '0.420', 'WEAPON3': '0.500', 'WEAPON5': '0.600', 'HITCOUNT': '0.640', 'weapon4': '0.786', 'weapon3': '1.150', 'weapon2': '1.240', 'ARMOR': '1.303', 'DAMAGECOUNT': '2.781', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:17:57,399][2409077] DAMAGECOUNT value on done: 7335.0
[2023-02-25 13:17:57,400][2409077] Sum rewards: 8.320, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.044', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO3': '0.088', 'AMMO4': '0.166', 'weapon5': '0.166', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.388', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.700', 'weapon2': '1.364', 'weapon3': '1.840', 'DAMAGECOUNT': '2.646', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:17:57,473][2409074] Updated weights for policy 0, policy_version 21821 (0.0013)
[2023-02-25 13:17:57,621][2409373] DAMAGECOUNT value on done: 8367.0
[2023-02-25 13:17:57,622][2409373] Sum rewards: 10.783, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.446', 'AMMO5': '0.014', 'AMMO2': '0.026', 'AMMO3': '0.060', 'weapon5': '0.120', 'weapon7': '0.126', 'AMMO4': '0.130', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.704', 'HITCOUNT': '0.830', 'weapon2': '1.156', 'weapon3': '1.402', 'DAMAGECOUNT': '3.570', 'FRAGCOUNT': '8.500'}
[2023-02-25 13:17:57,662][2409075] DAMAGECOUNT value on done: 7346.0
[2023-02-25 13:17:57,663][2409075] Sum rewards: 2.476, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.870', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO3': '0.070', 'weapon7': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.168', 'AMMO4': '0.172', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'WEAPON4': '0.500', 'HITCOUNT': '0.570', 'weapon4': '0.740', 'weapon3': '1.150', 'ARMOR': '1.245', 'weapon2': '1.372', 'DAMAGECOUNT': '1.848', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:17:58,216][2409469] DAMAGECOUNT value on done: 5783.0
[2023-02-25 13:17:58,216][2409469] Sum rewards: 14.724, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.421', 'AMMO2': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.020', 'AMMO3': '0.050', 'weapon7': '0.090', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'HITCOUNT': '0.640', 'ARMOR': '0.906', 'weapon2': '0.934', 'weapon4': '1.044', 'weapon3': '1.246', 'DAMAGECOUNT': '2.385', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:17:58,370][2409355] DAMAGECOUNT value on done: 7616.0
[2023-02-25 13:17:58,371][2409355] Sum rewards: 10.941, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.290', 'AMMO2': '0.012', 'AMMO5': '0.015', 'AMMO4': '0.059', 'AMMO3': '0.073', 'weapon7': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'weapon2': '0.572', 'HITCOUNT': '0.660', 'weapon3': '1.148', 'weapon4': '1.284', 'DAMAGECOUNT': '3.120', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:58,868][2409486] DAMAGECOUNT value on done: 7518.0
[2023-02-25 13:17:58,869][2409486] Sum rewards: 9.224, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.097', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'weapon5': '0.044', 'weapon7': '0.056', 'AMMO3': '0.063', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'HITCOUNT': '0.650', 'weapon3': '0.792', 'weapon2': '1.014', 'weapon4': '1.166', 'ARMOR': '1.313', 'DAMAGECOUNT': '2.430', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:17:58,944][2409389] DAMAGECOUNT value on done: 7498.0
[2023-02-25 13:17:58,947][2409389] Sum rewards: 10.781, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.675', 'AMMO2': '0.026', 'AMMO5': '0.027', 'AMMO3': '0.102', 'AMMO4': '0.127', 'weapon5': '0.244', 'weapon4': '0.286', 'WEAPON4': '0.300', 'ARMOR': '0.461', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'HITCOUNT': '0.790', 'weapon2': '1.110', 'weapon3': '1.836', 'DAMAGECOUNT': '2.946', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:17:59,121][2409866] DAMAGECOUNT value on done: 7211.0
[2023-02-25 13:17:59,124][2409866] Sum rewards: 8.759, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.524', 'AMMO2': '0.011', 'AMMO5': '0.017', 'AMMO3': '0.053', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'weapon4': '0.220', 'weapon5': '0.296', 'WEAPON3': '0.400', 'WEAPON5': '0.450', 'HITCOUNT': '0.630', 'ARMOR': '0.868', 'weapon3': '1.104', 'weapon2': '1.346', 'DAMAGECOUNT': '2.232', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:17:59,144][2409074] Updated weights for policy 0, policy_version 21831 (0.0012)
[2023-02-25 13:17:59,206][2409548] DAMAGECOUNT value on done: 5975.0
[2023-02-25 13:17:59,207][2409548] Sum rewards: 11.698, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.896', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO3': '0.061', 'weapon5': '0.064', 'AMMO4': '0.084', 'WEAPON5': '0.150', 'weapon7': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'WEAPON7': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.530', 'weapon4': '0.572', 'weapon3': '0.942', 'weapon2': '1.492', 'DAMAGECOUNT': '2.445', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:17:59,235][2409407] DAMAGECOUNT value on done: 7724.0
[2023-02-25 13:17:59,235][2409407] Sum rewards: 9.322, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.807', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO3': '0.074', 'weapon7': '0.096', 'weapon5': '0.102', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.510', 'ARMOR': '0.800', 'weapon2': '0.820', 'weapon3': '0.870', 'weapon4': '1.384', 'DAMAGECOUNT': '2.352', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:17:59,281][2409565] DAMAGECOUNT value on done: 9291.0
[2023-02-25 13:17:59,284][2409565] Sum rewards: 15.363, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.348', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO3': '0.070', 'weapon5': '0.244', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.990', 'weapon3': '1.694', 'weapon2': '1.798', 'DAMAGECOUNT': '4.125', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:17:59,329][2409597] DAMAGECOUNT value on done: 6648.0
[2023-02-25 13:17:59,330][2409597] Sum rewards: 9.662, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.526', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO3': '0.050', 'weapon5': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.128', 'AMMO4': '0.147', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'HITCOUNT': '0.800', 'weapon3': '1.030', 'weapon2': '1.074', 'weapon4': '1.126', 'DAMAGECOUNT': '3.006', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:17:59,920][2409405] DAMAGECOUNT value on done: 8509.0
[2023-02-25 13:17:59,921][2409405] Sum rewards: 15.735, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.290', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.007', 'WEAPON1': '0.040', 'weapon5': '0.052', 'AMMO3': '0.056', 'weapon7': '0.074', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.477', 'WEAPON3': '0.500', 'weapon2': '0.880', 'weapon4': '0.912', 'HITCOUNT': '0.930', 'weapon3': '1.084', 'DAMAGECOUNT': '3.801', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:18:00,158][2409079] DAMAGECOUNT value on done: 7295.0
[2023-02-25 13:18:00,162][2409079] Sum rewards: 6.268, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.722', 'AMMO2': '0.024', 'AMMO5': '0.029', 'weapon4': '0.046', 'AMMO3': '0.102', 'AMMO4': '0.118', 'WEAPON4': '0.200', 'weapon5': '0.306', 'WEAPON5': '0.700', 'HITCOUNT': '0.720', 'WEAPON3': '0.750', 'ARMOR': '0.951', 'weapon2': '1.572', 'weapon3': '1.724', 'DAMAGECOUNT': '3.498', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:18:00,229][2409097] DAMAGECOUNT value on done: 7114.0
[2023-02-25 13:18:00,230][2409097] Sum rewards: 20.676, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.118', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO3': '0.050', 'weapon5': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.100', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'weapon4': '0.608', 'HITCOUNT': '1.080', 'weapon3': '1.178', 'weapon2': '1.350', 'DAMAGECOUNT': '3.846', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:18:00,345][2409096] DAMAGECOUNT value on done: 8436.0
[2023-02-25 13:18:00,345][2409096] Sum rewards: 13.298, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.333', 'AMMO2': '0.006', 'AMMO5': '0.022', 'AMMO4': '0.028', 'WEAPON1': '0.030', 'weapon7': '0.038', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.128', 'WEAPON7': '0.200', 'weapon4': '0.210', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'weapon2': '0.878', 'HITCOUNT': '0.910', 'weapon3': '1.800', 'DAMAGECOUNT': '4.053', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:18:00,624][2409099] DAMAGECOUNT value on done: 6753.0
[2023-02-25 13:18:00,625][2409099] Sum rewards: 8.226, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.156', 'AMMO5': '0.007', 'AMMO2': '0.034', 'AMMO3': '0.040', 'weapon5': '0.046', 'weapon7': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.300', 'weapon2': '0.480', 'weapon4': '0.548', 'HITCOUNT': '0.650', 'weapon3': '0.860', 'DAMAGECOUNT': '2.454', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:18:00,629][2409596] DAMAGECOUNT value on done: 6909.0
[2023-02-25 13:18:00,630][2409596] Sum rewards: 10.826, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.458', 'weapon7': '0.006', 'AMMO2': '0.009', 'AMMO5': '0.017', 'AMMO4': '0.047', 'AMMO3': '0.102', 'WEAPON4': '0.150', 'weapon5': '0.176', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.258', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.700', 'weapon2': '0.722', 'weapon3': '1.490', 'DAMAGECOUNT': '3.606', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:18:00,989][2409074] Updated weights for policy 0, policy_version 21841 (0.0012)
[2023-02-25 13:18:01,023][2409406] DAMAGECOUNT value on done: 7161.0
[2023-02-25 13:18:01,025][2409077] DAMAGECOUNT value on done: 7482.0
[2023-02-25 13:18:01,026][2409406] Sum rewards: 9.801, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.220', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.029', 'weapon7': '0.048', 'AMMO3': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.142', 'WEAPON4': '0.200', 'weapon5': '0.216', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.624', 'HITCOUNT': '0.660', 'weapon2': '1.090', 'weapon3': '1.394', 'DAMAGECOUNT': '3.498', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:18:01,027][2409077] Sum rewards: 12.053, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.580', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'weapon4': '0.062', 'AMMO3': '0.074', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'weapon5': '0.242', 'ARMOR': '0.448', 'WEAPON3': '0.500', 'WEAPON5': '0.550', 'HITCOUNT': '0.730', 'weapon2': '1.568', 'weapon3': '1.578', 'DAMAGECOUNT': '3.324', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:18:01,147][2409076] DAMAGECOUNT value on done: 7951.0
[2023-02-25 13:18:01,148][2409076] Sum rewards: 8.794, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.462', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon4': '0.044', 'AMMO3': '0.050', 'weapon7': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.119', 'weapon5': '0.202', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '0.500', 'weapon3': '1.194', 'ARMOR': '1.682', 'weapon2': '2.064', 'DAMAGECOUNT': '3.132', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:18:01,157][2409105] DAMAGECOUNT value on done: 6428.0
[2023-02-25 13:18:01,157][2409105] Sum rewards: 10.636, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.851', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.033', 'AMMO4': '0.057', 'weapon5': '0.126', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'weapon4': '0.260', 'WEAPON5': '0.500', 'HITCOUNT': '0.830', 'WEAPON3': '0.850', 'ARMOR': '1.437', 'weapon3': '1.582', 'weapon2': '1.688', 'DAMAGECOUNT': '3.270', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:18:01,284][2409033] Signal inference workers to stop experience collection... (2650 times)
[2023-02-25 13:18:01,291][2409033] Signal inference workers to resume experience collection... (2650 times)
[2023-02-25 13:18:01,329][2409074] InferenceWorker_p0-w0: stopping experience collection (2650 times)
[2023-02-25 13:18:01,331][2409074] InferenceWorker_p0-w0: resuming experience collection (2650 times)
[2023-02-25 13:18:01,333][2409078] DAMAGECOUNT value on done: 7408.0
[2023-02-25 13:18:01,334][2409078] Sum rewards: 15.877, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.320', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.017', 'weapon5': '0.054', 'AMMO3': '0.062', 'weapon7': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO6': '0.400', 'AMMO7': '0.400', 'ARMOR': '0.455', 'WEAPON3': '0.500', 'WEAPON7': '0.600', 'HITCOUNT': '0.930', 'weapon3': '0.934', 'weapon4': '0.988', 'weapon2': '1.304', 'DAMAGECOUNT': '4.749', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:18:01,361][2409104] DAMAGECOUNT value on done: 7667.0
[2023-02-25 13:18:01,364][2409104] Sum rewards: 14.446, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.218', 'AMMO4': '-0.054', 'AMMO2': '-0.011', 'AMMO5': '0.022', 'WEAPON4': '0.050', 'weapon7': '0.052', 'AMMO3': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.130', 'weapon4': '0.158', 'WEAPON7': '0.200', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'ARMOR': '0.915', 'HITCOUNT': '0.970', 'weapon3': '1.396', 'weapon2': '1.492', 'DAMAGECOUNT': '4.797', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:18:01,627][2409075] DAMAGECOUNT value on done: 6884.0
[2023-02-25 13:18:01,632][2409075] Sum rewards: 10.054, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.364', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'AMMO3': '0.050', 'WEAPON4': '0.100', 'weapon5': '0.102', 'WEAPON5': '0.150', 'weapon4': '0.214', 'WEAPON3': '0.350', 'ARMOR': '0.451', 'HITCOUNT': '0.640', 'weapon3': '1.238', 'weapon2': '1.638', 'DAMAGECOUNT': '2.931', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:18:01,662][2409866] Large shaping reward 2.596 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5640000000000001, 188.0), ('weapon7', 0.002)]
[2023-02-25 13:18:01,869][2409373] DAMAGECOUNT value on done: 8592.0
[2023-02-25 13:18:01,873][2409373] Sum rewards: 13.989, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.880', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO3': '0.051', 'weapon5': '0.056', 'AMMO4': '0.057', 'weapon7': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.236', 'WEAPON3': '0.400', 'ARMOR': '0.448', 'HITCOUNT': '0.830', 'weapon3': '1.168', 'weapon2': '2.108', 'DAMAGECOUNT': '3.180', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:18:02,004][2409469] DAMAGECOUNT value on done: 6931.0
[2023-02-25 13:18:02,005][2409469] Sum rewards: 13.096, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.418', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO3': '0.069', 'AMMO4': '0.148', 'weapon5': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.424', 'WEAPON3': '0.450', 'HITCOUNT': '0.530', 'weapon3': '1.096', 'ARMOR': '1.368', 'weapon2': '1.820', 'DAMAGECOUNT': '3.291', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:18:02,187][2408954] Fps is (10 sec: 24164.5, 60 sec: 23961.3, 300 sec: 24728.7). Total num frames: 89489408. Throughput: 0: 5975.9. Samples: 22380144. Policy #0 lag: (min: 0.0, avg: 10.2, max: 25.0)
[2023-02-25 13:18:02,187][2408954] Avg episode reward: [(0, '11.304')]
[2023-02-25 13:18:02,503][2409074] Updated weights for policy 0, policy_version 21851 (0.0013)
[2023-02-25 13:18:02,752][2409389] DAMAGECOUNT value on done: 6302.0
[2023-02-25 13:18:02,775][2409389] Sum rewards: 13.593, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.070', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO3': '0.042', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'weapon7': '0.110', 'weapon5': '0.222', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'weapon4': '0.298', 'WEAPON3': '0.350', 'WEAPON7': '0.400', 'ARMOR': '0.426', 'HITCOUNT': '0.460', 'weapon3': '0.942', 'weapon2': '2.222', 'DAMAGECOUNT': '3.024', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:18:02,824][2409548] DAMAGECOUNT value on done: 5677.0
[2023-02-25 13:18:02,825][2409548] Sum rewards: 9.615, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.910', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon5': '0.064', 'AMMO4': '0.074', 'AMMO3': '0.100', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.456', 'WEAPON3': '0.700', 'HITCOUNT': '0.820', 'ARMOR': '0.886', 'weapon2': '1.080', 'weapon3': '1.880', 'DAMAGECOUNT': '2.940', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:18:02,901][2409486] DAMAGECOUNT value on done: 6783.0
[2023-02-25 13:18:02,911][2409486] Sum rewards: 9.810, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.267', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.040', 'AMMO4': '0.066', 'AMMO3': '0.087', 'weapon5': '0.128', 'weapon7': '0.160', 'WEAPON4': '0.250', 'AMMO6': '0.260', 'AMMO7': '0.260', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.650', 'weapon4': '0.650', 'HITCOUNT': '0.820', 'weapon2': '1.224', 'weapon3': '1.274', 'DAMAGECOUNT': '2.835', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:18:03,020][2409565] DAMAGECOUNT value on done: 8797.0
[2023-02-25 13:18:03,021][2409565] Sum rewards: 8.549, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.499', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.034', 'weapon7': '0.052', 'AMMO3': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.216', 'WEAPON3': '0.450', 'HITCOUNT': '0.600', 'ARMOR': '0.800', 'weapon3': '0.934', 'weapon2': '2.554', 'DAMAGECOUNT': '3.183', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:18:03,043][2409597] DAMAGECOUNT value on done: 8627.0
[2023-02-25 13:18:03,046][2409407] DAMAGECOUNT value on done: 7119.0
[2023-02-25 13:18:03,046][2409597] Sum rewards: 12.596, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.768', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO2': '0.022', 'AMMO4': '0.110', 'AMMO3': '0.118', 'weapon5': '0.158', 'weapon4': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '1.130', 'weapon2': '1.314', 'weapon3': '2.040', 'DAMAGECOUNT': '4.224', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:18:03,049][2409407] Sum rewards: 9.215, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.070', 'weapon7': '0.012', 'AMMO5': '0.022', 'AMMO2': '0.030', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.125', 'AMMO4': '0.152', 'weapon5': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.550', 'weapon4': '0.612', 'HITCOUNT': '0.790', 'weapon2': '0.802', 'WEAPON3': '0.850', 'weapon3': '1.766', 'DAMAGECOUNT': '3.732', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:18:03,115][2409355] DAMAGECOUNT value on done: 7118.0
[2023-02-25 13:18:03,115][2409355] Sum rewards: 10.877, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.100', 'AMMO2': '0.003', 'AMMO4': '0.012', 'AMMO5': '0.019', 'AMMO3': '0.092', 'WEAPON4': '0.150', 'weapon5': '0.162', 'weapon4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'ARMOR': '0.854', 'HITCOUNT': '0.980', 'weapon2': '1.266', 'weapon3': '1.630', 'DAMAGECOUNT': '3.609', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:18:03,668][2409405] DAMAGECOUNT value on done: 7655.0
[2023-02-25 13:18:03,671][2409405] Sum rewards: 11.666, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.125', 'AMMO2': '0.005', 'weapon7': '0.010', 'AMMO4': '0.026', 'AMMO5': '0.027', 'WEAPON4': '0.050', 'weapon4': '0.074', 'weapon5': '0.090', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.101', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'HITCOUNT': '0.920', 'weapon2': '1.722', 'weapon3': '1.728', 'DAMAGECOUNT': '3.987', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:18:03,819][2409866] DAMAGECOUNT value on done: 9016.0
[2023-02-25 13:18:03,822][2409866] Sum rewards: 17.794, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.701', 'AMMO5': '0.016', 'AMMO2': '0.024', 'AMMO3': '0.053', 'weapon7': '0.076', 'AMMO4': '0.119', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.268', 'WEAPON7': '0.300', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'ARMOR': '0.453', 'HITCOUNT': '0.640', 'weapon3': '1.152', 'weapon4': '1.326', 'DAMAGECOUNT': '4.740', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:18:03,995][2409096] DAMAGECOUNT value on done: 6807.0
[2023-02-25 13:18:03,996][2409096] Sum rewards: 10.134, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.252', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon7': '0.052', 'AMMO3': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.128', 'weapon2': '0.164', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.500', 'HITCOUNT': '0.900', 'weapon3': '1.114', 'weapon4': '2.100', 'DAMAGECOUNT': '3.387', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:18:04,083][2409079] DAMAGECOUNT value on done: 7216.0
[2023-02-25 13:18:04,083][2409079] Sum rewards: 3.326, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.839', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'ARMOR': '0.043', 'AMMO3': '0.047', 'weapon7': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.111', 'weapon5': '0.126', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.340', 'WEAPON3': '0.350', 'weapon3': '0.946', 'weapon4': '1.150', 'DAMAGECOUNT': '1.224', 'weapon2': '1.368', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:18:04,261][2409097] DAMAGECOUNT value on done: 6627.0
[2023-02-25 13:18:04,262][2409097] Sum rewards: 10.478, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.015', 'ARMOR': '0.004', 'AMMO2': '0.019', 'AMMO5': '0.020', 'AMMO3': '0.071', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'weapon7': '0.128', 'weapon5': '0.146', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.450', 'WEAPON3': '0.450', 'weapon2': '0.478', 'HITCOUNT': '0.570', 'weapon4': '0.676', 'weapon3': '0.958', 'DAMAGECOUNT': '3.228', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:18:04,307][2409074] Updated weights for policy 0, policy_version 21861 (0.0013)
[2023-02-25 13:18:04,801][2409105] DAMAGECOUNT value on done: 8554.0
[2023-02-25 13:18:04,804][2409105] Sum rewards: 8.158, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.934', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO2': '0.021', 'AMMO3': '0.075', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.454', 'ARMOR': '0.498', 'WEAPON3': '0.600', 'weapon2': '0.874', 'HITCOUNT': '0.930', 'weapon3': '1.620', 'DAMAGECOUNT': '3.042', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:18:05,031][2409099] DAMAGECOUNT value on done: 6238.0
[2023-02-25 13:18:05,031][2409099] Sum rewards: 14.591, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.839', 'AMMO2': '0.008', 'AMMO5': '0.017', 'AMMO4': '0.040', 'weapon7': '0.054', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'weapon5': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.500', 'weapon4': '0.500', 'HITCOUNT': '0.650', 'ARMOR': '0.906', 'weapon3': '1.272', 'weapon2': '1.552', 'DAMAGECOUNT': '2.487', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:18:05,064][2409078] DAMAGECOUNT value on done: 6525.0
[2023-02-25 13:18:05,067][2409078] Sum rewards: 8.398, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.905', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'AMMO4': '0.054', 'weapon5': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.300', 'weapon4': '0.332', 'ARMOR': '0.460', 'HITCOUNT': '0.730', 'weapon3': '0.992', 'weapon2': '2.174', 'DAMAGECOUNT': '3.255', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:18:05,184][2409596] DAMAGECOUNT value on done: 6660.0
[2023-02-25 13:18:05,184][2409596] Sum rewards: 11.114, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.845', 'AMMO4': '-0.067', 'AMMO2': '-0.013', 'AMMO5': '0.005', 'AMMO3': '0.043', 'weapon7': '0.068', 'weapon5': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'ARMOR': '0.441', 'HITCOUNT': '0.540', 'weapon3': '0.928', 'weapon2': '1.324', 'DAMAGECOUNT': '1.812', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:18:05,479][2409077] DAMAGECOUNT value on done: 6635.0
[2023-02-25 13:18:05,480][2409077] Sum rewards: 3.168, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.458', 'AMMO2': '0.005', 'AMMO5': '0.017', 'AMMO4': '0.023', 'weapon7': '0.078', 'AMMO3': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.404', 'weapon2': '0.452', 'HITCOUNT': '0.460', 'weapon5': '0.466', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.470', 'weapon3': '1.822', 'FRAGCOUNT': '3.500'}
[2023-02-25 13:18:05,487][2409406] DAMAGECOUNT value on done: 7583.0
[2023-02-25 13:18:05,488][2409406] Sum rewards: 8.560, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.212', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.012', 'AMMO3': '0.060', 'weapon7': '0.064', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.232', 'WEAPON5': '0.250', 'HITCOUNT': '0.410', 'WEAPON3': '0.450', 'ARMOR': '0.850', 'weapon3': '0.984', 'weapon2': '1.060', 'weapon4': '1.438', 'DAMAGECOUNT': '2.193', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:18:05,522][2409104] DAMAGECOUNT value on done: 7909.0
[2023-02-25 13:18:05,524][2409104] Sum rewards: 16.050, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO3': '0.060', 'AMMO4': '0.075', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.232', 'HEALTH': '0.246', 'weapon4': '0.266', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.930', 'weapon2': '1.350', 'weapon3': '1.480', 'DAMAGECOUNT': '4.785', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:18:05,669][2409076] DAMAGECOUNT value on done: 7787.0
[2023-02-25 13:18:05,670][2409076] Sum rewards: 22.948, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.545', 'AMMO2': '0.007', 'AMMO5': '0.017', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'weapon7': '0.086', 'AMMO3': '0.087', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.236', 'weapon5': '0.284', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'HITCOUNT': '1.110', 'weapon2': '1.130', 'ARMOR': '1.702', 'weapon3': '1.846', 'DAMAGECOUNT': '5.265', 'FRAGCOUNT': '17.000'}
[2023-02-25 13:18:05,697][2409075] DAMAGECOUNT value on done: 6936.0
[2023-02-25 13:18:05,699][2409075] Sum rewards: 8.086, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.484', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon5': '0.046', 'AMMO3': '0.048', 'AMMO4': '0.081', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon7': '0.230', 'WEAPON3': '0.250', 'HITCOUNT': '0.320', 'weapon3': '0.364', 'AMMO6': '0.540', 'AMMO7': '0.540', 'WEAPON7': '0.700', 'weapon4': '1.426', 'weapon2': '1.798', 'DAMAGECOUNT': '1.800', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:18:05,933][2409469] DAMAGECOUNT value on done: 8444.0
[2023-02-25 13:18:05,933][2409469] Sum rewards: 10.348, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon7': '0.050', 'AMMO3': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.141', 'WEAPON4': '0.150', 'HEALTH': '0.194', 'weapon5': '0.378', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'HITCOUNT': '0.530', 'weapon4': '0.532', 'weapon3': '1.226', 'weapon2': '1.458', 'DAMAGECOUNT': '3.783', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:18:06,108][2409074] Updated weights for policy 0, policy_version 21871 (0.0012)
[2023-02-25 13:18:06,323][2409373] DAMAGECOUNT value on done: 8668.0
[2023-02-25 13:18:06,324][2409373] Sum rewards: 8.185, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.298', 'AMMO2': '0.006', 'AMMO5': '0.016', 'AMMO4': '0.030', 'weapon7': '0.086', 'AMMO3': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.452', 'ARMOR': '0.494', 'HITCOUNT': '0.580', 'WEAPON3': '0.650', 'weapon3': '1.370', 'weapon2': '1.478', 'DAMAGECOUNT': '2.676', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:18:06,920][2409389] DAMAGECOUNT value on done: 6405.0
[2023-02-25 13:18:06,924][2409389] Sum rewards: 7.043, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.049', 'AMMO3': '0.050', 'HEALTH': '0.202', 'WEAPON3': '0.350', 'HITCOUNT': '0.570', 'ARMOR': '0.850', 'weapon3': '1.302', 'weapon2': '1.738', 'DAMAGECOUNT': '1.902', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:18:06,985][2409486] DAMAGECOUNT value on done: 6780.0
[2023-02-25 13:18:06,986][2409486] Sum rewards: 3.202, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.481', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'AMMO3': '0.030', 'WEAPON1': '0.030', 'weapon5': '0.128', 'WEAPON5': '0.150', 'WEAPON3': '0.300', 'HITCOUNT': '0.350', 'weapon3': '0.702', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.275', 'weapon2': '1.998'}
[2023-02-25 13:18:07,060][2409565] DAMAGECOUNT value on done: 8233.0
[2023-02-25 13:18:07,061][2409565] Sum rewards: 10.899, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.512', 'AMMO2': '0.009', 'AMMO5': '0.015', 'AMMO4': '0.043', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'weapon4': '0.340', 'weapon5': '0.348', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'HITCOUNT': '0.680', 'weapon2': '1.166', 'ARMOR': '1.349', 'weapon3': '1.508', 'DAMAGECOUNT': '3.021', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:18:07,173][2409407] DAMAGECOUNT value on done: 6707.0
[2023-02-25 13:18:07,176][2409407] Sum rewards: 13.571, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.850', 'AMMO2': '0.013', 'AMMO5': '0.016', 'AMMO3': '0.054', 'AMMO4': '0.066', 'weapon5': '0.072', 'weapon7': '0.116', 'WEAPON4': '0.200', 'AMMO6': '0.280', 'AMMO7': '0.280', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'weapon4': '0.604', 'HITCOUNT': '0.800', 'weapon3': '0.974', 'weapon2': '1.288', 'ARMOR': '1.390', 'DAMAGECOUNT': '3.417', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:18:07,186][2408954] Fps is (10 sec: 24985.3, 60 sec: 24029.8, 300 sec: 24742.6). Total num frames: 89616384. Throughput: 0: 5994.4. Samples: 22398516. Policy #0 lag: (min: 0.0, avg: 10.2, max: 25.0)
[2023-02-25 13:18:07,186][2408954] Avg episode reward: [(0, '10.955')]
[2023-02-25 13:18:07,325][2409405] DAMAGECOUNT value on done: 5108.0
[2023-02-25 13:18:07,326][2409405] Sum rewards: 5.465, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.783', 'AMMO2': '0.007', 'AMMO5': '0.015', 'AMMO4': '0.035', 'weapon7': '0.048', 'weapon5': '0.064', 'AMMO3': '0.070', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.560', 'weapon2': '0.928', 'weapon4': '0.982', 'weapon3': '1.162', 'DAMAGECOUNT': '1.986', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:18:07,334][2409355] DAMAGECOUNT value on done: 5613.0
[2023-02-25 13:18:07,339][2409355] Sum rewards: 13.252, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.291', 'AMMO4': '-0.013', 'AMMO2': '-0.002', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO3': '0.068', 'WEAPON4': '0.150', 'weapon5': '0.184', 'weapon4': '0.384', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.800', 'weapon3': '1.300', 'weapon2': '1.422', 'ARMOR': '1.444', 'DAMAGECOUNT': '3.081', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:18:07,731][2409866] DAMAGECOUNT value on done: 8943.0
[2023-02-25 13:18:07,732][2409866] Sum rewards: 17.666, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.454', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO4': '0.097', 'AMMO3': '0.100', 'WEAPON4': '0.200', 'weapon5': '0.272', 'weapon4': '0.338', 'WEAPON5': '0.550', 'weapon2': '0.564', 'WEAPON3': '0.750', 'HITCOUNT': '1.020', 'ARMOR': '1.407', 'weapon3': '2.382', 'DAMAGECOUNT': '5.127', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:18:07,749][2409097] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:18:07,830][2409074] Updated weights for policy 0, policy_version 21881 (0.0012)
[2023-02-25 13:18:08,056][2409097] DAMAGECOUNT value on done: 8362.0
[2023-02-25 13:18:08,058][2409097] Sum rewards: 19.645, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.834', 'AMMO5': '0.012', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.096', 'weapon4': '0.136', 'weapon5': '0.358', 'WEAPON5': '0.400', 'ARMOR': '0.453', 'WEAPON3': '0.550', 'HITCOUNT': '1.070', 'weapon2': '1.600', 'weapon3': '1.638', 'DAMAGECOUNT': '5.784', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:18:08,165][2409079] DAMAGECOUNT value on done: 7269.0
[2023-02-25 13:18:08,169][2409079] Sum rewards: 8.122, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.327', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.031', 'AMMO3': '0.050', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.168', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'weapon4': '0.474', 'HITCOUNT': '0.500', 'ARMOR': '0.951', 'weapon3': '1.188', 'weapon2': '1.228', 'DAMAGECOUNT': '2.190', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:18:08,920][2409078] DAMAGECOUNT value on done: 8620.0
[2023-02-25 13:18:08,923][2409078] Sum rewards: 16.493, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.294', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO3': '0.040', 'AMMO4': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.106', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'weapon4': '0.612', 'weapon2': '0.764', 'HITCOUNT': '0.820', 'weapon3': '0.956', 'DAMAGECOUNT': '3.957', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:18:08,964][2409074] Updated weights for policy 0, policy_version 21891 (0.0012)
[2023-02-25 13:18:09,043][2409099] DAMAGECOUNT value on done: 8063.0
[2023-02-25 13:18:09,044][2409099] Sum rewards: 11.511, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.140', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO5': '0.015', 'weapon7': '0.080', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.272', 'weapon4': '0.314', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '0.890', 'weapon2': '1.410', 'weapon3': '1.596', 'DAMAGECOUNT': '3.381', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:18:09,237][2409096] DAMAGECOUNT value on done: 7284.0
[2023-02-25 13:18:09,240][2409096] Sum rewards: 10.855, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.855', 'AMMO2': '0.010', 'AMMO5': '0.026', 'AMMO4': '0.049', 'AMMO3': '0.084', 'WEAPON4': '0.200', 'weapon5': '0.394', 'ARMOR': '0.457', 'WEAPON5': '0.500', 'weapon4': '0.516', 'WEAPON3': '0.650', 'weapon2': '0.834', 'HITCOUNT': '0.860', 'weapon3': '1.614', 'DAMAGECOUNT': '3.765', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:18:09,321][2409077] DAMAGECOUNT value on done: 8455.0
[2023-02-25 13:18:09,322][2409077] Sum rewards: 15.276, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.753', 'AMMO2': '0.010', 'AMMO5': '0.020', 'weapon4': '0.026', 'AMMO4': '0.052', 'AMMO3': '0.071', 'WEAPON4': '0.100', 'weapon5': '0.388', 'WEAPON3': '0.550', 'WEAPON5': '0.550', 'ARMOR': '0.819', 'HITCOUNT': '0.820', 'weapon2': '1.514', 'weapon3': '1.570', 'DAMAGECOUNT': '3.789', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:18:09,339][2409406] DAMAGECOUNT value on done: 6544.0
[2023-02-25 13:18:09,340][2409406] Sum rewards: 8.492, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.316', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon7': '0.068', 'AMMO3': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.227', 'weapon5': '0.262', 'WEAPON4': '0.300', 'weapon4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '0.810', 'ARMOR': '0.900', 'weapon2': '1.116', 'weapon3': '1.556', 'DAMAGECOUNT': '3.699', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:18:09,407][2409075] DAMAGECOUNT value on done: 7669.0
[2023-02-25 13:18:09,411][2409075] Sum rewards: 8.767, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'AMMO4': '0.144', 'WEAPON3': '0.350', 'HEALTH': '0.620', 'HITCOUNT': '0.680', 'weapon4': '0.688', 'ARMOR': '0.800', 'weapon2': '0.838', 'weapon3': '1.376', 'DAMAGECOUNT': '2.709', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:18:09,536][2409105] DAMAGECOUNT value on done: 7695.0
[2023-02-25 13:18:09,536][2409105] Sum rewards: 14.466, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.036', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.043', 'weapon5': '0.070', 'AMMO3': '0.092', 'weapon7': '0.118', 'AMMO4': '0.217', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'WEAPON3': '0.550', 'weapon2': '0.932', 'HITCOUNT': '1.040', 'weapon4': '1.086', 'weapon3': '1.538', 'DAMAGECOUNT': '4.947', 'FRAGCOUNT': '11.500'}
[2023-02-25 13:18:09,734][2409596] DAMAGECOUNT value on done: 8645.0
[2023-02-25 13:18:09,738][2409596] Sum rewards: 15.608, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.120', 'AMMO5': '0.022', 'AMMO2': '0.025', 'AMMO3': '0.088', 'AMMO4': '0.124', 'weapon7': '0.156', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.250', 'weapon5': '0.348', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon4': '0.560', 'HITCOUNT': '0.820', 'weapon2': '0.846', 'weapon3': '1.368', 'DAMAGECOUNT': '4.641', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:18:09,911][2409076] DAMAGECOUNT value on done: 5717.0
[2023-02-25 13:18:09,912][2409076] Sum rewards: 10.819, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.652', 'AMMO2': '0.012', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'AMMO4': '0.061', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'weapon4': '0.220', 'weapon5': '0.248', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '0.920', 'ARMOR': '1.200', 'weapon2': '1.338', 'weapon3': '1.636', 'DAMAGECOUNT': '3.939', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:18:10,069][2409104] DAMAGECOUNT value on done: 9683.0
[2023-02-25 13:18:10,072][2409104] Sum rewards: 13.778, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.040', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO5': '0.021', 'weapon7': '0.048', 'AMMO3': '0.053', 'AMMO4': '0.102', 'weapon5': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.742', 'HITCOUNT': '0.880', 'weapon3': '1.204', 'weapon2': '1.344', 'DAMAGECOUNT': '3.387', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:18:10,473][2409373] DAMAGECOUNT value on done: 6836.0
[2023-02-25 13:18:10,474][2409373] Sum rewards: 18.409, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.479', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'weapon4': '0.614', 'ARMOR': '0.890', 'HITCOUNT': '1.130', 'weapon3': '1.234', 'weapon2': '1.484', 'DAMAGECOUNT': '4.875', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:18:10,807][2409389] DAMAGECOUNT value on done: 8366.0
[2023-02-25 13:18:10,809][2409074] Updated weights for policy 0, policy_version 21901 (0.0012)
[2023-02-25 13:18:10,808][2409389] Sum rewards: 20.837, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.403', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.032', 'AMMO3': '0.040', 'weapon5': '0.080', 'weapon7': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'weapon2': '0.716', 'HITCOUNT': '0.970', 'weapon3': '0.974', 'weapon4': '1.644', 'DAMAGECOUNT': '5.085', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:18:10,841][2409407] DAMAGECOUNT value on done: 6835.0
[2023-02-25 13:18:10,843][2409407] Sum rewards: 10.770, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.093', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon7': '0.050', 'weapon5': '0.056', 'AMMO3': '0.064', 'AMMO4': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.400', 'HITCOUNT': '0.620', 'weapon3': '0.676', 'ARMOR': '0.863', 'weapon4': '0.912', 'weapon2': '1.094', 'DAMAGECOUNT': '2.154', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:18:10,906][2409355] DAMAGECOUNT value on done: 7915.0
[2023-02-25 13:18:10,911][2409355] Sum rewards: 9.021, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.015', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'HEALTH': '0.030', 'WEAPON4': '0.050', 'weapon7': '0.072', 'AMMO4': '0.077', 'AMMO3': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.112', 'weapon5': '0.204', 'WEAPON5': '0.350', 'HITCOUNT': '0.470', 'WEAPON3': '0.500', 'weapon2': '1.408', 'weapon3': '1.584', 'DAMAGECOUNT': '2.235', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:18:10,971][2409486] DAMAGECOUNT value on done: 8178.0
[2023-02-25 13:18:10,972][2409486] Sum rewards: 13.351, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.038', 'AMMO2': '0.010', 'AMMO5': '0.020', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'weapon5': '0.082', 'weapon4': '0.082', 'AMMO3': '0.111', 'weapon7': '0.140', 'AMMO6': '0.260', 'AMMO7': '0.260', 'WEAPON7': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '0.780', 'ARMOR': '0.887', 'weapon2': '1.280', 'weapon3': '2.026', 'DAMAGECOUNT': '4.152', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:18:10,983][2409469] DAMAGECOUNT value on done: 7230.0
[2023-02-25 13:18:10,987][2409469] Sum rewards: 9.902, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.102', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'AMMO5': '0.032', 'weapon7': '0.050', 'AMMO3': '0.085', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.121', 'weapon5': '0.132', 'WEAPON3': '0.500', 'WEAPON5': '0.550', 'HITCOUNT': '0.670', 'weapon4': '0.850', 'ARMOR': '0.899', 'weapon2': '1.120', 'weapon3': '1.282', 'DAMAGECOUNT': '2.529', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:18:11,299][2409866] DAMAGECOUNT value on done: 8159.0
[2023-02-25 13:18:11,299][2409866] Sum rewards: 11.048, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.350', 'AMMO2': '0.011', 'AMMO5': '0.014', 'weapon7': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.230', 'weapon4': '0.394', 'WEAPON5': '0.400', 'HITCOUNT': '0.590', 'WEAPON3': '0.700', 'weapon2': '0.864', 'weapon3': '1.460', 'DAMAGECOUNT': '3.078', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:18:11,406][2409547] DAMAGECOUNT value on done: 6578.0
[2023-02-25 13:18:11,409][2409547] Sum rewards: 22.977, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.206', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon7': '0.060', 'AMMO3': '0.083', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.114', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'weapon4': '0.630', 'HITCOUNT': '1.170', 'weapon2': '1.192', 'ARMOR': '1.260', 'weapon3': '1.684', 'DAMAGECOUNT': '4.515', 'FRAGCOUNT': '17.000'}
[2023-02-25 13:18:11,753][2409405] DAMAGECOUNT value on done: 7879.0
[2023-02-25 13:18:11,754][2409405] Sum rewards: 23.247, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.064', 'AMMO5': '0.015', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.078', 'weapon7': '0.088', 'AMMO3': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.214', 'weapon4': '0.360', 'WEAPON5': '0.400', 'ARMOR': '0.460', 'weapon2': '0.568', 'WEAPON3': '0.650', 'HITCOUNT': '1.390', 'weapon3': '2.146', 'DAMAGECOUNT': '6.222', 'FRAGCOUNT': '16.000'}
[2023-02-25 13:18:12,021][2409097] DAMAGECOUNT value on done: 6790.0
[2023-02-25 13:18:12,022][2409097] Sum rewards: 8.549, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.242', 'AMMO2': '0.019', 'weapon4': '0.026', 'AMMO5': '0.029', 'AMMO4': '0.095', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'weapon5': '0.438', 'HITCOUNT': '0.720', 'WEAPON5': '0.750', 'ARMOR': '0.879', 'WEAPON3': '0.900', 'weapon2': '1.042', 'weapon3': '2.070', 'DAMAGECOUNT': '3.042', 'FRAGCOUNT': '8.500'}
[2023-02-25 13:18:12,061][2409079] DAMAGECOUNT value on done: 7406.0
[2023-02-25 13:18:12,062][2409079] Sum rewards: 11.926, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.416', 'AMMO2': '0.009', 'AMMO5': '0.020', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'weapon7': '0.070', 'AMMO3': '0.145', 'weapon4': '0.218', 'weapon5': '0.220', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.640', 'WEAPON3': '0.850', 'ARMOR': '1.298', 'weapon3': '1.458', 'weapon2': '1.550', 'DAMAGECOUNT': '3.327', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:18:12,186][2408954] Fps is (10 sec: 24987.5, 60 sec: 24029.9, 300 sec: 24701.0). Total num frames: 89739264. Throughput: 0: 6009.3. Samples: 22434852. Policy #0 lag: (min: 0.0, avg: 11.6, max: 24.0)
[2023-02-25 13:18:12,186][2408954] Avg episode reward: [(0, '11.496')]
[2023-02-25 13:18:12,187][2409033] Saving new best policy, reward=11.496!
[2023-02-25 13:18:12,437][2409074] Updated weights for policy 0, policy_version 21911 (0.0012)
[2023-02-25 13:18:13,096][2409096] DAMAGECOUNT value on done: 6882.0
[2023-02-25 13:18:13,097][2409096] Sum rewards: 9.585, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.428', 'AMMO2': '0.026', 'AMMO5': '0.027', 'AMMO3': '0.085', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'weapon5': '0.220', 'weapon4': '0.498', 'WEAPON5': '0.600', 'WEAPON3': '0.600', 'HITCOUNT': '0.810', 'ARMOR': '0.890', 'weapon2': '1.242', 'weapon3': '1.552', 'DAMAGECOUNT': '2.931', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:18:13,250][2409099] DAMAGECOUNT value on done: 6301.0
[2023-02-25 13:18:13,253][2409099] Sum rewards: 4.772, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.465', 'AMMO5': '0.005', 'AMMO3': '0.020', 'AMMO2': '0.024', 'weapon7': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'HITCOUNT': '0.190', 'weapon5': '0.194', 'WEAPON3': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.362', 'weapon3': '0.534', 'DAMAGECOUNT': '1.050', 'weapon4': '1.076', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:18:13,323][2409077] DAMAGECOUNT value on done: 7726.0
[2023-02-25 13:18:13,328][2409406] DAMAGECOUNT value on done: 6016.0
[2023-02-25 13:18:13,326][2409077] Sum rewards: 16.586, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.490', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.015', 'weapon7': '0.052', 'AMMO4': '0.053', 'AMMO3': '0.055', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.208', 'weapon4': '0.380', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'ARMOR': '0.452', 'HITCOUNT': '0.570', 'weapon3': '1.106', 'weapon2': '1.656', 'DAMAGECOUNT': '3.918', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:18:13,329][2409406] Sum rewards: 11.741, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.532', 'AMMO2': '0.018', 'AMMO5': '0.020', 'AMMO3': '0.080', 'AMMO4': '0.092', 'WEAPON4': '0.200', 'weapon5': '0.252', 'WEAPON5': '0.400', 'ARMOR': '0.471', 'WEAPON3': '0.550', 'weapon4': '0.600', 'HITCOUNT': '0.750', 'weapon2': '1.122', 'weapon3': '1.578', 'DAMAGECOUNT': '2.640', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:18:13,331][2409078] DAMAGECOUNT value on done: 6673.0
[2023-02-25 13:18:13,335][2409078] Sum rewards: 9.793, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.004', 'AMMO4': '0.022', 'AMMO3': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon7': '0.140', 'HEALTH': '0.150', 'weapon4': '0.234', 'WEAPON3': '0.250', 'HITCOUNT': '0.460', 'weapon2': '1.322', 'DAMAGECOUNT': '1.749', 'weapon3': '2.002', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:18:13,674][2409105] DAMAGECOUNT value on done: 7049.0
[2023-02-25 13:18:13,677][2409105] Sum rewards: 10.107, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.240', 'AMMO2': '0.013', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.052', 'AMMO4': '0.064', 'weapon7': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.108', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.590', 'weapon4': '0.676', 'weapon3': '1.216', 'weapon2': '1.726', 'DAMAGECOUNT': '2.481', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:18:13,910][2409075] DAMAGECOUNT value on done: 7619.0
[2023-02-25 13:18:13,913][2409075] Sum rewards: 14.962, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.111', 'AMMO5': '0.012', 'AMMO2': '0.031', 'WEAPON4': '0.050', 'AMMO3': '0.087', 'weapon5': '0.104', 'AMMO4': '0.153', 'weapon4': '0.180', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'ARMOR': '0.800', 'HITCOUNT': '0.920', 'weapon2': '1.452', 'weapon3': '1.744', 'DAMAGECOUNT': '3.990', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:18:14,118][2409076] DAMAGECOUNT value on done: 6949.0
[2023-02-25 13:18:14,121][2409076] Sum rewards: 7.111, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.448', 'AMMO5': '0.020', 'AMMO2': '0.024', 'weapon7': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.114', 'AMMO4': '0.118', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.400', 'weapon4': '0.436', 'HITCOUNT': '0.580', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'weapon3': '1.486', 'weapon2': '1.602', 'DAMAGECOUNT': '2.613', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:18:14,142][2409596] DAMAGECOUNT value on done: 7098.0
[2023-02-25 13:18:14,146][2409596] Sum rewards: 10.861, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.366', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO5': '0.034', 'WEAPON4': '0.050', 'AMMO4': '0.092', 'AMMO3': '0.143', 'weapon5': '0.162', 'weapon4': '0.188', 'ARMOR': '0.451', 'WEAPON5': '0.700', 'WEAPON3': '0.950', 'weapon2': '0.976', 'HITCOUNT': '0.980', 'weapon3': '2.202', 'DAMAGECOUNT': '3.510', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:18:14,447][2409355] DAMAGECOUNT value on done: 8167.0
[2023-02-25 13:18:14,452][2409355] Sum rewards: 11.164, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.881', 'AMMO2': '0.015', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO3': '0.064', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.188', 'WEAPON7': '0.200', 'weapon4': '0.258', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.690', 'weapon2': '1.324', 'weapon3': '1.516', 'DAMAGECOUNT': '3.231', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:18:14,628][2409104] DAMAGECOUNT value on done: 7488.0
[2023-02-25 13:18:14,629][2409104] Sum rewards: 7.713, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.994', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO5': '0.026', 'weapon7': '0.074', 'AMMO4': '0.085', 'AMMO3': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.154', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.232', 'WEAPON5': '0.500', 'HITCOUNT': '0.520', 'WEAPON3': '0.600', 'ARMOR': '1.264', 'weapon2': '1.366', 'weapon3': '1.382', 'DAMAGECOUNT': '2.226', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:18:14,749][2409074] Updated weights for policy 0, policy_version 21921 (0.0012)
[2023-02-25 13:18:14,828][2409469] DAMAGECOUNT value on done: 8968.0
[2023-02-25 13:18:14,829][2409469] Sum rewards: 13.044, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.826', 'weapon7': '0.002', 'AMMO2': '0.019', 'AMMO5': '0.025', 'WEAPON1': '0.040', 'AMMO4': '0.093', 'weapon4': '0.122', 'AMMO3': '0.135', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.228', 'WEAPON5': '0.600', 'ARMOR': '0.858', 'WEAPON3': '0.900', 'HITCOUNT': '0.980', 'weapon2': '1.308', 'weapon3': '1.972', 'DAMAGECOUNT': '4.788', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:18:14,831][2409866] DAMAGECOUNT value on done: 7425.0
[2023-02-25 13:18:14,835][2409866] Sum rewards: 13.441, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.040', 'AMMO2': '0.007', 'AMMO5': '0.021', 'AMMO4': '0.037', 'AMMO3': '0.052', 'weapon7': '0.052', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.162', 'WEAPON7': '0.200', 'WEAPON3': '0.450', 'WEAPON5': '0.500', 'HITCOUNT': '0.790', 'weapon2': '0.790', 'weapon3': '1.200', 'DAMAGECOUNT': '2.949', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:18:14,881][2409373] DAMAGECOUNT value on done: 6797.0
[2023-02-25 13:18:14,884][2409373] Sum rewards: 14.451, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.642', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.010', 'AMMO3': '0.057', 'weapon7': '0.070', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.368', 'weapon4': '0.396', 'WEAPON3': '0.400', 'HITCOUNT': '0.750', 'ARMOR': '0.896', 'weapon3': '1.032', 'weapon2': '1.600', 'DAMAGECOUNT': '4.464', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:18:14,884][2409407] DAMAGECOUNT value on done: 7466.0
[2023-02-25 13:18:14,888][2409407] Sum rewards: 14.287, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.425', 'AMMO5': '0.020', 'AMMO2': '0.036', 'AMMO3': '0.073', 'weapon5': '0.126', 'AMMO4': '0.178', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.330', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.980', 'weapon3': '1.414', 'weapon2': '1.556', 'DAMAGECOUNT': '3.999', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:18:15,100][2409389] DAMAGECOUNT value on done: 6967.0
[2023-02-25 13:18:15,100][2409389] Sum rewards: 14.448, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.542', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.015', 'AMMO3': '0.096', 'weapon5': '0.262', 'WEAPON5': '0.400', 'HITCOUNT': '0.530', 'WEAPON3': '0.650', 'weapon2': '1.488', 'weapon3': '1.948', 'DAMAGECOUNT': '3.621', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:18:15,135][2409486] DAMAGECOUNT value on done: 7631.0
[2023-02-25 13:18:15,136][2409486] Sum rewards: 12.043, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.013', 'AMMO5': '0.019', 'weapon7': '0.052', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.222', 'HEALTH': '0.344', 'WEAPON5': '0.400', 'WEAPON3': '0.400', 'weapon4': '0.472', 'HITCOUNT': '0.530', 'weapon2': '1.372', 'weapon3': '1.536', 'ARMOR': '1.667', 'DAMAGECOUNT': '3.393', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:18:15,381][2409405] DAMAGECOUNT value on done: 8242.0
[2023-02-25 13:18:15,382][2409405] Sum rewards: 10.221, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.550', 'AMMO2': '0.006', 'weapon4': '0.016', 'WEAPON1': '0.020', 'AMMO5': '0.028', 'AMMO4': '0.031', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon5': '0.322', 'WEAPON5': '0.650', 'WEAPON3': '0.750', 'HITCOUNT': '0.900', 'weapon2': '1.162', 'weapon3': '1.318', 'ARMOR': '1.401', 'DAMAGECOUNT': '3.960', 'FRAGCOUNT': '9.500'}
[2023-02-25 13:18:15,423][2409468] Large shaping reward 2.652 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:18:15,617][2409547] DAMAGECOUNT value on done: 7554.0
[2023-02-25 13:18:15,621][2409547] Sum rewards: 11.986, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.504', 'AMMO2': '0.007', 'weapon5': '0.018', 'AMMO5': '0.020', 'AMMO4': '0.036', 'weapon7': '0.048', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.268', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.730', 'ARMOR': '0.913', 'weapon2': '1.286', 'weapon3': '1.802', 'DAMAGECOUNT': '2.535', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:18:16,052][2409079] DAMAGECOUNT value on done: 8764.0
[2023-02-25 13:18:16,053][2409079] Sum rewards: 21.010, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.020', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO5': '0.020', 'AMMO3': '0.062', 'AMMO4': '0.067', 'weapon7': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon5': '0.302', 'weapon4': '0.432', 'ARMOR': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.450', 'HITCOUNT': '0.840', 'weapon2': '1.020', 'weapon3': '1.470', 'DAMAGECOUNT': '5.862', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:18:16,149][2409074] Updated weights for policy 0, policy_version 21931 (0.0013)
[2023-02-25 13:18:16,181][2409097] DAMAGECOUNT value on done: 6504.0
[2023-02-25 13:18:16,185][2409097] Sum rewards: 9.450, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.246', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.070', 'weapon5': '0.140', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.610', 'weapon3': '1.682', 'weapon2': '1.934', 'DAMAGECOUNT': '2.163', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:18:16,862][2409078] DAMAGECOUNT value on done: 8527.0
[2023-02-25 13:18:16,863][2409078] Sum rewards: 19.504, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.761', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO3': '0.069', 'AMMO4': '0.138', 'weapon5': '0.152', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon4': '0.416', 'WEAPON3': '0.500', 'HITCOUNT': '1.130', 'weapon3': '1.216', 'weapon2': '1.280', 'DAMAGECOUNT': '4.728', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:18:17,060][2409099] DAMAGECOUNT value on done: 5276.0
[2023-02-25 13:18:17,061][2409099] Sum rewards: 5.423, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.015', 'weapon7': '0.058', 'AMMO3': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.168', 'HEALTH': '0.186', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.420', 'WEAPON3': '0.450', 'HITCOUNT': '0.490', 'weapon4': '0.800', 'weapon2': '0.950', 'weapon3': '1.534', 'DAMAGECOUNT': '2.220', 'FRAGCOUNT': '2.500'}
[2023-02-25 13:18:17,186][2408954] Fps is (10 sec: 24166.4, 60 sec: 24234.6, 300 sec: 24701.0). Total num frames: 89858048. Throughput: 0: 5998.4. Samples: 22470528. Policy #0 lag: (min: 0.0, avg: 11.6, max: 24.0)
[2023-02-25 13:18:17,186][2408954] Avg episode reward: [(0, '11.902')]
[2023-02-25 13:18:17,191][2409033] Saving /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000021938_89858048.pth...
[2023-02-25 13:18:17,293][2409033] Removing /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000020497_83955712.pth
[2023-02-25 13:18:17,303][2409033] Saving new best policy, reward=11.902!
[2023-02-25 13:18:17,414][2409096] DAMAGECOUNT value on done: 6931.0
[2023-02-25 13:18:17,417][2409096] Sum rewards: 7.246, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.011', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'weapon7': '0.052', 'AMMO4': '0.056', 'AMMO3': '0.075', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.114', 'HEALTH': '0.276', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.660', 'weapon2': '0.828', 'weapon4': '0.926', 'weapon3': '1.498', 'DAMAGECOUNT': '2.400', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:18:17,697][2409077] DAMAGECOUNT value on done: 8316.0
[2023-02-25 13:18:17,700][2409077] Sum rewards: 19.205, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.012', 'weapon7': '0.026', 'AMMO2': '0.035', 'AMMO3': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'HEALTH': '0.152', 'AMMO4': '0.177', 'WEAPON4': '0.200', 'weapon5': '0.216', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'weapon4': '0.374', 'ARMOR': '0.420', 'HITCOUNT': '0.960', 'weapon3': '1.188', 'weapon2': '1.354', 'DAMAGECOUNT': '4.440', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:18:17,717][2409406] DAMAGECOUNT value on done: 7165.0
[2023-02-25 13:18:17,718][2409406] Sum rewards: 9.949, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.798', 'WEAPON1': '0.020', 'AMMO5': '0.028', 'AMMO2': '0.028', 'AMMO4': '0.139', 'AMMO3': '0.156', 'weapon5': '0.212', 'weapon4': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'HITCOUNT': '0.860', 'WEAPON3': '0.900', 'weapon2': '0.970', 'ARMOR': '1.248', 'weapon3': '2.096', 'DAMAGECOUNT': '3.666', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:18:17,930][2409074] Updated weights for policy 0, policy_version 21941 (0.0012)
[2023-02-25 13:18:18,012][2409075] DAMAGECOUNT value on done: 6905.0
[2023-02-25 13:18:18,013][2409075] Sum rewards: 10.603, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.581', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.056', 'weapon7': '0.082', 'weapon5': '0.124', 'AMMO3': '0.130', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.270', 'AMMO4': '0.282', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'ARMOR': '0.467', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'HITCOUNT': '1.020', 'weapon3': '1.576', 'weapon2': '1.622', 'DAMAGECOUNT': '3.432', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:18:18,083][2409355] DAMAGECOUNT value on done: 6809.0
[2023-02-25 13:18:18,086][2409355] Sum rewards: 15.589, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.180', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon7': '0.062', 'AMMO3': '0.069', 'weapon5': '0.114', 'AMMO4': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.500', 'WEAPON3': '0.500', 'HITCOUNT': '0.840', 'weapon2': '0.990', 'weapon4': '1.054', 'weapon3': '1.090', 'DAMAGECOUNT': '3.816', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:18:18,259][2409596] DAMAGECOUNT value on done: 7964.0
[2023-02-25 13:18:18,262][2409596] Sum rewards: 15.255, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.424', 'AMMO5': '0.018', 'AMMO2': '0.035', 'AMMO3': '0.070', 'weapon7': '0.140', 'AMMO4': '0.177', 'weapon5': '0.190', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'ARMOR': '0.453', 'weapon4': '0.584', 'HITCOUNT': '1.080', 'weapon2': '1.224', 'weapon3': '1.600', 'DAMAGECOUNT': '5.607', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:18:18,330][2409105] DAMAGECOUNT value on done: 8896.0
[2023-02-25 13:18:18,330][2409105] Sum rewards: 22.367, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.880', 'AMMO5': '0.017', 'AMMO2': '0.022', 'AMMO3': '0.100', 'AMMO4': '0.110', 'WEAPON4': '0.350', 'weapon5': '0.352', 'WEAPON5': '0.400', 'weapon4': '0.424', 'WEAPON3': '0.650', 'ARMOR': '0.849', 'HITCOUNT': '1.080', 'weapon3': '1.394', 'weapon2': '1.426', 'DAMAGECOUNT': '6.072', 'FRAGCOUNT': '16.000'}
[2023-02-25 13:18:18,409][2409076] DAMAGECOUNT value on done: 6172.0
[2023-02-25 13:18:18,414][2409076] Sum rewards: 3.796, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.690', 'AMMO5': '0.012', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'weapon5': '0.064', 'AMMO3': '0.085', 'AMMO4': '0.108', 'weapon4': '0.214', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.430', 'WEAPON3': '0.550', 'weapon3': '1.060', 'weapon2': '1.094', 'DAMAGECOUNT': '1.347', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:18:18,465][2409104] Large shaping reward 2.641 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO2', -0.0001, -1.0), ('AMMO4', -0.0005, -1.0), ('weapon2', 0.002)]
[2023-02-25 13:18:18,510][2409866] DAMAGECOUNT value on done: 8325.0
[2023-02-25 13:18:18,511][2409866] Sum rewards: 11.744, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.128', 'AMMO5': '0.013', 'AMMO2': '0.014', 'weapon4': '0.016', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.052', 'AMMO4': '0.067', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.226', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.760', 'weapon3': '1.276', 'weapon2': '1.926', 'DAMAGECOUNT': '3.081', 'FRAGCOUNT': '6.500'}
[2023-02-25 13:18:18,574][2409468] Large shaping reward 2.580 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.558, 186.0), ('weapon5', 0.002)]
[2023-02-25 13:18:18,604][2409104] DAMAGECOUNT value on done: 8418.0
[2023-02-25 13:18:18,605][2409104] Sum rewards: 14.955, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.766', 'AMMO5': '0.015', 'AMMO2': '0.019', 'weapon7': '0.074', 'AMMO3': '0.090', 'AMMO4': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'weapon4': '0.534', 'WEAPON3': '0.550', 'HITCOUNT': '1.050', 'ARMOR': '1.256', 'weapon3': '1.260', 'weapon2': '1.828', 'DAMAGECOUNT': '3.810', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:18:18,684][2409407] DAMAGECOUNT value on done: 6720.0
[2023-02-25 13:18:18,689][2409407] Sum rewards: 9.551, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.488', 'AMMO5': '0.018', 'AMMO2': '0.020', 'AMMO3': '0.044', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'weapon5': '0.232', 'WEAPON3': '0.250', 'WEAPON5': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'weapon7': '0.338', 'HITCOUNT': '0.350', 'weapon3': '0.390', 'WEAPON7': '0.400', 'ARMOR': '1.302', 'weapon2': '1.348', 'weapon4': '1.378', 'DAMAGECOUNT': '2.481', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:18:18,863][2409373] DAMAGECOUNT value on done: 5894.0
[2023-02-25 13:18:18,864][2409373] Sum rewards: 5.958, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.080', 'AMMO2': '0.004', 'AMMO5': '0.013', 'weapon4': '0.020', 'AMMO4': '0.020', 'AMMO3': '0.046', 'weapon7': '0.070', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.164', 'WEAPON7': '0.200', 'HITCOUNT': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'ARMOR': '0.431', 'weapon2': '0.510', 'weapon3': '0.814', 'DAMAGECOUNT': '1.455', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:18:19,032][2409405] DAMAGECOUNT value on done: 7736.0
[2023-02-25 13:18:19,033][2409389] DAMAGECOUNT value on done: 8162.0
[2023-02-25 13:18:19,034][2409389] Sum rewards: 10.315, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.578', 'AMMO5': '0.015', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.058', 'weapon7': '0.078', 'AMMO4': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.222', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '0.450', 'HITCOUNT': '0.560', 'weapon3': '0.790', 'weapon4': '0.866', 'weapon2': '1.248', 'ARMOR': '1.250', 'DAMAGECOUNT': '2.874', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:18:19,034][2409405] Sum rewards: 9.256, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.675', 'AMMO5': '0.013', 'AMMO2': '0.022', 'AMMO3': '0.067', 'AMMO4': '0.110', 'weapon5': '0.208', 'weapon7': '0.270', 'AMMO6': '0.440', 'AMMO7': '0.440', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'WEAPON7': '0.600', 'weapon2': '0.632', 'HITCOUNT': '0.680', 'weapon4': '0.722', 'weapon3': '1.100', 'DAMAGECOUNT': '2.976', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:18:19,081][2409486] DAMAGECOUNT value on done: 7830.0
[2023-02-25 13:18:19,084][2409486] Sum rewards: 7.767, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.798', 'AMMO5': '0.030', 'AMMO2': '0.033', 'weapon5': '0.066', 'weapon7': '0.096', 'AMMO3': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.163', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon4': '0.530', 'WEAPON5': '0.600', 'HITCOUNT': '0.820', 'WEAPON3': '0.850', 'weapon2': '0.904', 'weapon3': '1.620', 'DAMAGECOUNT': '4.143', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:18:19,393][2409469] DAMAGECOUNT value on done: 7653.0
[2023-02-25 13:18:19,394][2409469] Sum rewards: 19.412, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.625', 'AMMO5': '0.022', 'AMMO2': '0.029', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.124', 'AMMO4': '0.145', 'weapon5': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'weapon2': '0.608', 'weapon4': '0.736', 'WEAPON3': '0.850', 'HITCOUNT': '0.940', 'weapon3': '1.766', 'DAMAGECOUNT': '6.054', 'FRAGCOUNT': '16.000'}
[2023-02-25 13:18:19,580][2409074] Updated weights for policy 0, policy_version 21951 (0.0015)
[2023-02-25 13:18:19,874][2409547] DAMAGECOUNT value on done: 5896.0
[2023-02-25 13:18:19,875][2409547] Sum rewards: 8.503, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.900', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.005', 'AMMO3': '0.030', 'WEAPON5': '0.100', 'weapon7': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.300', 'WEAPON3': '0.300', 'ARMOR': '0.453', 'weapon3': '0.808', 'weapon2': '0.978', 'weapon4': '1.352', 'DAMAGECOUNT': '1.437', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:18:19,935][2409079] DAMAGECOUNT value on done: 7111.0
[2023-02-25 13:18:19,936][2409079] Sum rewards: 8.629, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.943', 'AMMO2': '0.021', 'AMMO5': '0.038', 'AMMO3': '0.098', 'AMMO4': '0.103', 'weapon7': '0.154', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'weapon5': '0.340', 'HITCOUNT': '0.460', 'WEAPON3': '0.600', 'weapon2': '0.602', 'weapon4': '0.798', 'WEAPON5': '0.800', 'ARMOR': '1.254', 'weapon3': '1.276', 'DAMAGECOUNT': '3.288', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:18:20,343][2409097] DAMAGECOUNT value on done: 5961.0
[2023-02-25 13:18:20,347][2409097] Sum rewards: 9.496, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.234', 'AMMO5': '0.005', 'AMMO2': '0.029', 'AMMO3': '0.040', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'WEAPON3': '0.200', 'weapon7': '0.226', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON4': '0.350', 'WEAPON7': '0.500', 'HITCOUNT': '0.510', 'weapon2': '0.858', 'weapon3': '0.878', 'weapon4': '1.576', 'DAMAGECOUNT': '2.070', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:18:20,847][2409074] Updated weights for policy 0, policy_version 21961 (0.0012)
[2023-02-25 13:18:21,218][2409099] DAMAGECOUNT value on done: 8185.0
[2023-02-25 13:18:21,221][2409099] Sum rewards: 6.232, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.350', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO3': '0.097', 'weapon5': '0.102', 'weapon7': '0.110', 'AMMO4': '0.112', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'HITCOUNT': '0.610', 'WEAPON3': '0.650', 'weapon4': '0.856', 'weapon3': '1.184', 'weapon2': '1.304', 'DAMAGECOUNT': '2.835', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:18:21,370][2409096] DAMAGECOUNT value on done: 7778.0
[2023-02-25 13:18:21,372][2409096] Sum rewards: 5.420, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.272', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'weapon7': '0.058', 'weapon5': '0.068', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.310', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'weapon2': '1.168', 'weapon4': '1.202', 'weapon3': '1.248', 'DAMAGECOUNT': '1.746', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:18:21,532][2409469] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:18:21,760][2409075] DAMAGECOUNT value on done: 8190.0
[2023-02-25 13:18:21,763][2409075] Sum rewards: 17.806, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.218', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO3': '0.050', 'AMMO4': '0.083', 'weapon7': '0.108', 'weapon5': '0.202', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'HITCOUNT': '0.690', 'weapon4': '0.798', 'weapon3': '1.174', 'weapon2': '1.268', 'DAMAGECOUNT': '4.044', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:18:21,949][2409078] DAMAGECOUNT value on done: 7047.0
[2023-02-25 13:18:21,949][2409078] Sum rewards: 14.117, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.575', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO3': '0.073', 'AMMO4': '0.080', 'weapon4': '0.158', 'WEAPON4': '0.200', 'weapon5': '0.210', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'HITCOUNT': '1.030', 'weapon3': '1.526', 'weapon2': '1.880', 'DAMAGECOUNT': '3.906', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:18:22,025][2409077] DAMAGECOUNT value on done: 8333.0
[2023-02-25 13:18:22,027][2409077] Sum rewards: 9.463, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.086', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'AMMO4': '0.052', 'weapon7': '0.112', 'weapon4': '0.170', 'weapon5': '0.172', 'WEAPON4': '0.200', 'AMMO6': '0.280', 'AMMO7': '0.280', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.740', 'weapon3': '1.300', 'weapon2': '1.504', 'DAMAGECOUNT': '3.138', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:18:22,096][2409406] DAMAGECOUNT value on done: 7115.0
[2023-02-25 13:18:22,106][2409406] Sum rewards: 8.572, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.829', 'AMMO2': '0.002', 'AMMO4': '0.012', 'AMMO5': '0.017', 'WEAPON4': '0.050', 'weapon5': '0.066', 'AMMO3': '0.087', 'weapon7': '0.178', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.500', 'weapon4': '0.504', 'WEAPON3': '0.600', 'weapon2': '1.072', 'weapon3': '1.606', 'ARMOR': '1.725', 'DAMAGECOUNT': '1.941', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:18:22,167][2409355] DAMAGECOUNT value on done: 8129.0
[2023-02-25 13:18:22,168][2409355] Sum rewards: 9.636, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.710', 'AMMO2': '0.022', 'AMMO5': '0.025', 'weapon7': '0.088', 'AMMO4': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.132', 'AMMO3': '0.134', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.316', 'ARMOR': '0.470', 'WEAPON5': '0.600', 'weapon2': '0.908', 'WEAPON3': '0.950', 'HITCOUNT': '1.030', 'weapon3': '1.882', 'DAMAGECOUNT': '3.687', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:18:22,186][2408954] Fps is (10 sec: 22527.1, 60 sec: 23961.4, 300 sec: 24659.3). Total num frames: 89964544. Throughput: 0: 6019.4. Samples: 22488996. Policy #0 lag: (min: 0.0, avg: 11.6, max: 24.0)
[2023-02-25 13:18:22,186][2408954] Avg episode reward: [(0, '11.786')]
[2023-02-25 13:18:22,230][2409596] DAMAGECOUNT value on done: 7283.0
[2023-02-25 13:18:22,231][2409596] Sum rewards: 6.004, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.486', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO4': '0.068', 'weapon7': '0.086', 'AMMO3': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.168', 'WEAPON4': '0.200', 'weapon4': '0.284', 'HITCOUNT': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'ARMOR': '0.906', 'weapon2': '1.164', 'weapon3': '1.498', 'DAMAGECOUNT': '2.160', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:18:22,593][2409104] DAMAGECOUNT value on done: 6910.0
[2023-02-25 13:18:22,597][2409104] Sum rewards: 11.982, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.150', 'AMMO5': '0.007', 'AMMO2': '0.033', 'AMMO3': '0.084', 'weapon5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.136', 'AMMO4': '0.164', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '0.760', 'ARMOR': '0.853', 'weapon4': '0.982', 'weapon2': '1.070', 'weapon3': '1.216', 'DAMAGECOUNT': '3.336', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:18:22,626][2409407] DAMAGECOUNT value on done: 5952.0
[2023-02-25 13:18:22,629][2409407] Sum rewards: 10.703, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.048', 'AMMO2': '0.024', 'AMMO5': '0.045', 'weapon7': '0.102', 'AMMO3': '0.109', 'AMMO4': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.264', 'WEAPON4': '0.350', 'ARMOR': '0.455', 'weapon2': '0.456', 'HITCOUNT': '0.650', 'WEAPON3': '0.750', 'WEAPON5': '0.850', 'weapon4': '1.236', 'weapon3': '1.542', 'DAMAGECOUNT': '3.360', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:18:22,790][2409076] DAMAGECOUNT value on done: 6700.0
[2023-02-25 13:18:22,791][2409076] Sum rewards: 7.192, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.940', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.041', 'weapon7': '0.048', 'AMMO3': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.162', 'WEAPON7': '0.200', 'AMMO4': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.382', 'ARMOR': '0.492', 'HITCOUNT': '0.670', 'WEAPON3': '0.700', 'weapon2': '1.290', 'weapon3': '1.684', 'DAMAGECOUNT': '2.835', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:18:22,820][2409389] DAMAGECOUNT value on done: 7102.0
[2023-02-25 13:18:22,823][2409389] Sum rewards: 10.898, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.495', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO3': '0.048', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'weapon7': '0.110', 'WEAPON4': '0.200', 'WEAPON3': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'ARMOR': '0.451', 'HITCOUNT': '0.530', 'weapon4': '0.542', 'weapon3': '0.654', 'weapon2': '1.296', 'DAMAGECOUNT': '2.442', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:18:23,078][2409469] DAMAGECOUNT value on done: 7269.0
[2023-02-25 13:18:23,080][2409469] Sum rewards: 4.334, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.765', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'AMMO3': '0.036', 'weapon7': '0.048', 'weapon5': '0.060', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'weapon2': '0.308', 'ARMOR': '0.445', 'weapon3': '0.640', 'DAMAGECOUNT': '0.690', 'weapon4': '1.018', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:18:23,296][2409373] DAMAGECOUNT value on done: 7732.0
[2023-02-25 13:18:23,299][2409373] Sum rewards: 7.410, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.840', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO3': '0.020', 'weapon5': '0.056', 'AMMO4': '0.089', 'weapon7': '0.136', 'WEAPON3': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.232', 'WEAPON4': '0.350', 'AMMO6': '0.380', 'AMMO7': '0.380', 'HITCOUNT': '0.480', 'WEAPON7': '0.500', 'weapon3': '0.502', 'weapon4': '0.530', 'DAMAGECOUNT': '2.670', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:18:23,365][2409074] Updated weights for policy 0, policy_version 21971 (0.0012)
[2023-02-25 13:18:23,364][2409486] DAMAGECOUNT value on done: 7659.0
[2023-02-25 13:18:23,369][2409486] Sum rewards: 11.565, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.324', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO3': '0.040', 'weapon7': '0.088', 'AMMO4': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.300', 'HITCOUNT': '0.480', 'ARMOR': '0.855', 'weapon3': '0.970', 'weapon4': '1.198', 'weapon2': '1.306', 'DAMAGECOUNT': '2.814', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:18:23,882][2409079] DAMAGECOUNT value on done: 7121.0
[2023-02-25 13:18:23,884][2409079] Sum rewards: 8.472, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.569', 'AMMO5': '0.015', 'AMMO2': '0.017', 'weapon7': '0.048', 'AMMO4': '0.083', 'AMMO3': '0.089', 'weapon5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon4': '0.520', 'WEAPON3': '0.650', 'HITCOUNT': '0.900', 'weapon2': '1.168', 'weapon3': '1.770', 'DAMAGECOUNT': '3.741', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:18:23,895][2409547] DAMAGECOUNT value on done: 7813.0
[2023-02-25 13:18:23,899][2409547] Sum rewards: 9.289, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.040', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.122', 'weapon5': '0.124', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'weapon4': '0.366', 'HEALTH': '0.451', 'HITCOUNT': '0.460', 'ARMOR': '0.496', 'weapon3': '1.450', 'weapon2': '1.546', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:18:24,280][2409097] DAMAGECOUNT value on done: 8398.0
[2023-02-25 13:18:24,280][2409097] Sum rewards: 16.602, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.200', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.101', 'AMMO4': '0.127', 'WEAPON4': '0.250', 'weapon5': '0.342', 'WEAPON5': '0.400', 'ARMOR': '0.482', 'WEAPON3': '0.600', 'weapon4': '0.646', 'weapon2': '0.892', 'HITCOUNT': '1.120', 'weapon3': '1.796', 'DAMAGECOUNT': '4.986', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:18:24,417][2409074] Updated weights for policy 0, policy_version 21981 (0.0012)
[2023-02-25 13:18:25,367][2409099] DAMAGECOUNT value on done: 7744.0
[2023-02-25 13:18:25,372][2409099] Sum rewards: 14.932, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.265', 'AMMO2': '0.013', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO3': '0.054', 'AMMO4': '0.066', 'weapon7': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.202', 'WEAPON3': '0.350', 'HITCOUNT': '0.740', 'weapon4': '0.814', 'weapon3': '1.132', 'weapon2': '1.240', 'DAMAGECOUNT': '4.437', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:18:25,446][2409096] DAMAGECOUNT value on done: 6166.0
[2023-02-25 13:18:25,449][2409096] Sum rewards: 4.815, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.234', 'AMMO2': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.021', 'AMMO3': '0.056', 'weapon5': '0.134', 'weapon7': '0.172', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'HITCOUNT': '0.370', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'weapon3': '0.564', 'ARMOR': '0.855', 'weapon4': '1.212', 'weapon2': '1.350', 'DAMAGECOUNT': '2.253', 'FRAGCOUNT': '2.500'}
[2023-02-25 13:18:25,538][2409075] DAMAGECOUNT value on done: 6760.0
[2023-02-25 13:18:25,541][2409075] Sum rewards: 10.518, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.680', 'AMMO2': '0.010', 'AMMO5': '0.022', 'AMMO3': '0.049', 'AMMO4': '0.050', 'weapon5': '0.150', 'weapon7': '0.216', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'AMMO6': '0.360', 'AMMO7': '0.360', 'WEAPON3': '0.400', 'ARMOR': '0.458', 'HITCOUNT': '0.470', 'weapon2': '0.528', 'WEAPON7': '0.600', 'weapon3': '1.076', 'weapon4': '1.698', 'DAMAGECOUNT': '3.300', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:18:26,085][2409078] DAMAGECOUNT value on done: 6685.0
[2023-02-25 13:18:26,087][2409078] Sum rewards: 14.465, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.500', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.019', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'weapon5': '0.236', 'WEAPON5': '0.450', 'weapon4': '0.482', 'WEAPON3': '0.800', 'ARMOR': '0.852', 'weapon2': '1.122', 'HITCOUNT': '1.160', 'weapon3': '1.938', 'DAMAGECOUNT': '4.389', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:18:26,177][2409077] DAMAGECOUNT value on done: 6815.0
[2023-02-25 13:18:26,180][2409077] Sum rewards: 13.217, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.060', 'AMMO4': '0.060', 'WEAPON5': '0.100', 'weapon5': '0.126', 'HEALTH': '0.138', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.900', 'weapon3': '1.492', 'weapon2': '1.856', 'DAMAGECOUNT': '3.195', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:18:26,356][2409406] DAMAGECOUNT value on done: 7355.0
[2023-02-25 13:18:26,357][2409406] Sum rewards: 6.844, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.622', 'AMMO2': '0.016', 'AMMO5': '0.025', 'AMMO4': '0.081', 'AMMO3': '0.137', 'weapon5': '0.236', 'WEAPON4': '0.300', 'weapon4': '0.352', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'HITCOUNT': '0.910', 'ARMOR': '0.952', 'weapon2': '1.220', 'weapon3': '1.828', 'DAMAGECOUNT': '3.459', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:18:26,477][2409104] DAMAGECOUNT value on done: 8352.0
[2023-02-25 13:18:26,478][2409104] Sum rewards: 9.791, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.266', 'AMMO2': '0.011', 'AMMO5': '0.025', 'AMMO4': '0.057', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'weapon5': '0.188', 'weapon4': '0.200', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.710', 'ARMOR': '0.856', 'weapon2': '1.530', 'weapon3': '1.688', 'DAMAGECOUNT': '2.655', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:18:26,602][2409074] Updated weights for policy 0, policy_version 21991 (0.0012)
[2023-02-25 13:18:26,610][2409389] DAMAGECOUNT value on done: 6263.0
[2023-02-25 13:18:26,611][2409389] Sum rewards: 12.540, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.388', 'AMMO5': '0.015', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'AMMO4': '0.100', 'weapon4': '0.114', 'weapon5': '0.162', 'WEAPON5': '0.400', 'ARMOR': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '0.790', 'weapon2': '1.560', 'weapon3': '1.736', 'DAMAGECOUNT': '3.654', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:18:27,005][2409469] DAMAGECOUNT value on done: 7899.0
[2023-02-25 13:18:27,008][2409469] Sum rewards: 25.272, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.060', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.025', 'weapon7': '0.048', 'AMMO3': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.126', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.485', 'WEAPON3': '0.500', 'weapon4': '0.948', 'weapon2': '1.082', 'weapon3': '1.288', 'HITCOUNT': '1.330', 'DAMAGECOUNT': '5.826', 'FRAGCOUNT': '19.000'}
[2023-02-25 13:18:27,120][2409486] DAMAGECOUNT value on done: 7158.0
[2023-02-25 13:18:27,121][2409486] Sum rewards: 11.871, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'AMMO3': '0.042', 'WEAPON4': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.110', 'weapon7': '0.130', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'weapon4': '0.194', 'HEALTH': '0.272', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.470', 'weapon3': '0.842', 'weapon2': '1.992', 'DAMAGECOUNT': '3.168', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:18:27,186][2408954] Fps is (10 sec: 22937.5, 60 sec: 24098.1, 300 sec: 24631.5). Total num frames: 90087424. Throughput: 0: 6013.6. Samples: 22524852. Policy #0 lag: (min: 0.0, avg: 11.6, max: 28.0)
[2023-02-25 13:18:27,187][2408954] Avg episode reward: [(0, '11.782')]
[2023-02-25 13:18:27,196][2409076] DAMAGECOUNT value on done: 8659.0
[2023-02-25 13:18:27,197][2409076] Sum rewards: 15.175, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.770', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.088', 'weapon5': '0.238', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'HITCOUNT': '0.820', 'ARMOR': '1.259', 'weapon2': '1.654', 'weapon3': '1.804', 'DAMAGECOUNT': '4.047', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:18:27,597][2409373] DAMAGECOUNT value on done: 6944.0
[2023-02-25 13:18:27,598][2409373] Sum rewards: 12.366, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'HEALTH': '0.012', 'AMMO2': '0.020', 'AMMO3': '0.067', 'AMMO4': '0.102', 'weapon7': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'weapon2': '0.502', 'weapon4': '0.704', 'HITCOUNT': '0.760', 'ARMOR': '0.928', 'weapon3': '1.258', 'DAMAGECOUNT': '3.003', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:18:27,699][2409079] DAMAGECOUNT value on done: 8176.0
[2023-02-25 13:18:27,700][2409079] Sum rewards: 13.585, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.286', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.017', 'AMMO3': '0.074', 'weapon7': '0.078', 'WEAPON4': '0.100', 'weapon5': '0.122', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.750', 'weapon4': '1.026', 'weapon2': '1.142', 'weapon3': '1.282', 'DAMAGECOUNT': '3.822', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:18:27,909][2409074] Updated weights for policy 0, policy_version 22001 (0.0012)
[2023-02-25 13:18:27,967][2409547] DAMAGECOUNT value on done: 8167.0
[2023-02-25 13:18:27,970][2409547] Sum rewards: 8.590, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.444', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.062', 'weapon7': '0.078', 'AMMO4': '0.183', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON4': '0.350', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.598', 'HITCOUNT': '0.760', 'ARMOR': '0.949', 'weapon3': '1.346', 'weapon2': '1.756', 'DAMAGECOUNT': '2.808', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:18:28,385][2409097] DAMAGECOUNT value on done: 7003.0
[2023-02-25 13:18:28,386][2409097] Sum rewards: 5.227, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.828', 'AMMO2': '0.010', 'AMMO5': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'weapon4': '0.068', 'AMMO3': '0.140', 'weapon5': '0.254', 'WEAPON5': '0.400', 'HITCOUNT': '0.630', 'ARMOR': '0.800', 'WEAPON3': '0.850', 'weapon3': '1.514', 'weapon2': '1.834', 'DAMAGECOUNT': '2.433', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:18:29,281][2409074] Updated weights for policy 0, policy_version 22011 (0.0013)
[2023-02-25 13:18:29,338][2409075] DAMAGECOUNT value on done: 7477.0
[2023-02-25 13:18:29,343][2409075] Sum rewards: 12.629, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.592', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon7': '0.050', 'AMMO3': '0.056', 'weapon5': '0.096', 'AMMO4': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.850', 'weapon4': '0.866', 'weapon3': '1.102', 'weapon2': '1.542', 'DAMAGECOUNT': '3.357', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:18:29,348][2409096] DAMAGECOUNT value on done: 6762.0
[2023-02-25 13:18:29,349][2409096] Sum rewards: 14.352, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.154', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon7': '0.050', 'AMMO3': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.135', 'weapon5': '0.168', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.650', 'HITCOUNT': '0.720', 'weapon4': '0.802', 'ARMOR': '0.857', 'weapon2': '1.098', 'weapon3': '1.462', 'DAMAGECOUNT': '4.068', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:18:29,579][2409099] DAMAGECOUNT value on done: 9276.0
[2023-02-25 13:18:29,587][2409099] Sum rewards: 10.810, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.490', 'AMMO5': '0.024', 'AMMO2': '0.030', 'AMMO3': '0.092', 'weapon7': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.148', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.202', 'weapon4': '0.362', 'ARMOR': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'weapon2': '0.680', 'HITCOUNT': '0.770', 'weapon3': '1.546', 'DAMAGECOUNT': '3.189', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:18:29,768][2409078] DAMAGECOUNT value on done: 7748.0
[2023-02-25 13:18:29,771][2409078] Sum rewards: 15.794, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.680', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.034', 'AMMO3': '0.106', 'WEAPON4': '0.200', 'weapon5': '0.250', 'weapon4': '0.252', 'ARMOR': '0.456', 'WEAPON5': '0.750', 'WEAPON3': '0.850', 'weapon2': '1.078', 'HITCOUNT': '1.190', 'weapon3': '1.910', 'DAMAGECOUNT': '4.893', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:18:30,433][2409389] DAMAGECOUNT value on done: 7316.0
[2023-02-25 13:18:30,436][2409389] Sum rewards: 14.920, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.570', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon5': '0.014', 'AMMO3': '0.073', 'weapon7': '0.146', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.850', 'ARMOR': '0.856', 'weapon3': '1.490', 'weapon2': '1.678', 'DAMAGECOUNT': '3.033', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:18:30,503][2409104] DAMAGECOUNT value on done: 6413.0
[2023-02-25 13:18:30,504][2409104] Sum rewards: 18.189, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.045', 'weapon5': '0.074', 'AMMO3': '0.081', 'weapon7': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HEALTH': '0.231', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'HITCOUNT': '0.780', 'ARMOR': '1.295', 'weapon2': '1.624', 'weapon3': '1.670', 'DAMAGECOUNT': '3.309', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:18:30,875][2409469] DAMAGECOUNT value on done: 6878.0
[2023-02-25 13:18:30,878][2409469] Sum rewards: 15.926, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.958', 'AMMO5': '0.020', 'AMMO2': '0.040', 'weapon7': '0.074', 'AMMO3': '0.098', 'AMMO4': '0.199', 'weapon5': '0.248', 'WEAPON5': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'ARMOR': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '0.650', 'weapon2': '0.840', 'weapon4': '0.928', 'HITCOUNT': '1.020', 'weapon3': '1.360', 'DAMAGECOUNT': '5.067', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:18:31,384][2409076] DAMAGECOUNT value on done: 6920.0
[2023-02-25 13:18:31,385][2409076] Sum rewards: 9.032, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.232', 'AMMO5': '0.020', 'AMMO2': '0.041', 'weapon7': '0.068', 'AMMO3': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.196', 'AMMO4': '0.204', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '0.680', 'weapon4': '0.782', 'weapon2': '1.144', 'weapon3': '1.522', 'DAMAGECOUNT': '2.919', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:18:31,430][2409074] Updated weights for policy 0, policy_version 22021 (0.0013)
[2023-02-25 13:18:31,663][2409079] DAMAGECOUNT value on done: 7588.0
[2023-02-25 13:18:31,666][2409079] Sum rewards: 7.292, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.928', 'AMMO2': '0.019', 'AMMO5': '0.027', 'WEAPON1': '0.030', 'weapon7': '0.092', 'AMMO4': '0.095', 'AMMO3': '0.095', 'weapon5': '0.216', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'HITCOUNT': '0.690', 'weapon4': '0.700', 'weapon3': '1.214', 'weapon2': '1.268', 'DAMAGECOUNT': '3.024', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:18:31,782][2409373] DAMAGECOUNT value on done: 6815.0
[2023-02-25 13:18:31,783][2409373] Sum rewards: 9.156, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.090', 'AMMO5': '0.029', 'AMMO2': '0.031', 'WEAPON1': '0.040', 'weapon4': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'AMMO4': '0.153', 'weapon5': '0.220', 'ARMOR': '0.400', 'WEAPON5': '0.600', 'HITCOUNT': '0.620', 'WEAPON3': '0.700', 'weapon2': '1.478', 'weapon3': '1.640', 'DAMAGECOUNT': '2.817', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:18:31,879][2409486] DAMAGECOUNT value on done: 8886.0
[2023-02-25 13:18:31,880][2409486] Sum rewards: 18.100, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.424', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.035', 'AMMO4': '0.035', 'AMMO3': '0.120', 'weapon4': '0.190', 'WEAPON4': '0.200', 'weapon5': '0.240', 'weapon2': '0.774', 'WEAPON5': '0.800', 'WEAPON3': '0.950', 'HITCOUNT': '1.110', 'weapon3': '2.154', 'DAMAGECOUNT': '5.898', 'FRAGCOUNT': '17.000'}
[2023-02-25 13:18:32,186][2408954] Fps is (10 sec: 24986.5, 60 sec: 23893.3, 300 sec: 24603.8). Total num frames: 90214400. Throughput: 0: 6021.9. Samples: 22560852. Policy #0 lag: (min: 0.0, avg: 11.6, max: 28.0)
[2023-02-25 13:18:32,187][2408954] Avg episode reward: [(0, '11.946')]
[2023-02-25 13:18:32,188][2409033] Saving new best policy, reward=11.946!
[2023-02-25 13:18:32,382][2409547] DAMAGECOUNT value on done: 6525.0
[2023-02-25 13:18:32,385][2409547] Sum rewards: 9.081, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.774', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'AMMO5': '0.020', 'weapon5': '0.064', 'weapon7': '0.092', 'AMMO3': '0.097', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.450', 'HITCOUNT': '0.660', 'WEAPON3': '0.700', 'ARMOR': '0.909', 'weapon2': '1.688', 'weapon3': '1.776', 'DAMAGECOUNT': '2.505', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:18:32,683][2409097] DAMAGECOUNT value on done: 7589.0
[2023-02-25 13:18:32,689][2409097] Sum rewards: 13.546, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.485', 'AMMO2': '0.020', 'weapon7': '0.026', 'AMMO5': '0.026', 'AMMO3': '0.071', 'AMMO4': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.300', 'weapon4': '0.432', 'weapon5': '0.458', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'weapon2': '0.718', 'WEAPON5': '0.750', 'weapon3': '1.848', 'DAMAGECOUNT': '4.011', 'FRAGCOUNT': '11.500'}
[2023-02-25 13:18:33,001][2409074] Updated weights for policy 0, policy_version 22031 (0.0012)
[2023-02-25 13:18:33,123][2409096] DAMAGECOUNT value on done: 6237.0
[2023-02-25 13:18:33,127][2409096] Sum rewards: 12.986, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.332', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO3': '0.050', 'weapon7': '0.050', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.166', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.350', 'ARMOR': '0.433', 'HITCOUNT': '0.720', 'weapon2': '1.084', 'weapon3': '1.088', 'weapon4': '1.218', 'DAMAGECOUNT': '3.147', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:18:33,354][2409075] DAMAGECOUNT value on done: 9513.0
[2023-02-25 13:18:33,355][2409075] Sum rewards: 19.074, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.948', 'AMMO5': '0.009', 'AMMO2': '0.053', 'AMMO3': '0.055', 'weapon5': '0.136', 'weapon7': '0.184', 'WEAPON5': '0.250', 'AMMO4': '0.266', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'WEAPON4': '0.400', 'HITCOUNT': '0.870', 'weapon4': '0.954', 'weapon3': '0.990', 'weapon2': '1.128', 'DAMAGECOUNT': '4.686', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:18:33,960][2409078] DAMAGECOUNT value on done: 7278.0
[2023-02-25 13:18:33,961][2409078] Sum rewards: 7.454, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.508', 'AMMO2': '0.008', 'AMMO5': '0.013', 'weapon4': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.038', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.218', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.700', 'weapon3': '1.396', 'weapon2': '1.770', 'DAMAGECOUNT': '2.622', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:18:34,168][2409099] DAMAGECOUNT value on done: 6072.0
[2023-02-25 13:18:34,169][2409099] Sum rewards: 5.273, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.394', 'AMMO2': '0.013', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'weapon7': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.148', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.450', 'ARMOR': '0.456', 'HITCOUNT': '0.710', 'weapon4': '0.728', 'WEAPON3': '0.850', 'weapon2': '0.886', 'weapon3': '1.398', 'DAMAGECOUNT': '2.613', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:18:34,327][2409104] DAMAGECOUNT value on done: 6033.0
[2023-02-25 13:18:34,328][2409104] Sum rewards: 6.562, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.940', 'AMMO2': '0.017', 'AMMO5': '0.019', 'WEAPON1': '0.030', 'AMMO4': '0.083', 'AMMO3': '0.101', 'WEAPON4': '0.300', 'weapon5': '0.344', 'weapon4': '0.386', 'WEAPON5': '0.550', 'HITCOUNT': '0.590', 'WEAPON3': '0.700', 'weapon2': '0.962', 'weapon3': '1.434', 'DAMAGECOUNT': '2.736', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:18:34,777][2409469] DAMAGECOUNT value on done: 8313.0
[2023-02-25 13:18:34,782][2409469] Sum rewards: 12.226, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.071', 'HEALTH': '0.079', 'weapon7': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.124', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.202', 'WEAPON3': '0.450', 'ARMOR': '0.477', 'HITCOUNT': '0.790', 'weapon3': '1.536', 'weapon2': '1.830', 'DAMAGECOUNT': '3.300', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:18:35,000][2409074] Updated weights for policy 0, policy_version 22041 (0.0012)
[2023-02-25 13:18:35,390][2409079] DAMAGECOUNT value on done: 6759.0
[2023-02-25 13:18:35,391][2409079] Sum rewards: 13.292, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.030', 'AMMO2': '0.006', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.031', 'AMMO3': '0.060', 'WEAPON4': '0.150', 'weapon5': '0.236', 'weapon4': '0.398', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.890', 'weapon3': '1.398', 'weapon2': '1.518', 'DAMAGECOUNT': '3.552', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:18:35,673][2409076] DAMAGECOUNT value on done: 7771.0
[2023-02-25 13:18:35,674][2409076] Sum rewards: 6.461, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.635', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO4': '0.112', 'AMMO3': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.196', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.306', 'WEAPON5': '0.350', 'weapon2': '0.618', 'HITCOUNT': '0.760', 'WEAPON3': '0.800', 'ARMOR': '0.800', 'weapon4': '0.814', 'weapon3': '1.634', 'DAMAGECOUNT': '3.138', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:18:35,834][2409486] DAMAGECOUNT value on done: 7968.0
[2023-02-25 13:18:35,838][2409486] Sum rewards: 14.547, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.395', 'AMMO2': '0.008', 'AMMO5': '0.008', 'weapon7': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.041', 'weapon4': '0.072', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.212', 'WEAPON5': '0.250', 'WEAPON3': '0.650', 'ARMOR': '0.907', 'HITCOUNT': '0.960', 'weapon2': '1.122', 'weapon3': '1.684', 'DAMAGECOUNT': '4.203', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:18:36,509][2409074] Updated weights for policy 0, policy_version 22051 (0.0012)
[2023-02-25 13:18:36,999][2409547] DAMAGECOUNT value on done: 8153.0
[2023-02-25 13:18:37,002][2409547] Sum rewards: 7.427, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.665', 'AMMO2': '0.020', 'AMMO5': '0.021', 'AMMO4': '0.098', 'AMMO3': '0.112', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.244', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'weapon4': '0.648', 'weapon2': '0.670', 'HITCOUNT': '0.710', 'WEAPON3': '0.900', 'weapon3': '1.728', 'DAMAGECOUNT': '2.991', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:18:37,090][2409096] DAMAGECOUNT value on done: 9125.0
[2023-02-25 13:18:37,091][2409096] Sum rewards: 15.004, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.118', 'AMMO5': '0.016', 'AMMO2': '0.018', 'AMMO3': '0.064', 'AMMO4': '0.090', 'weapon5': '0.158', 'weapon7': '0.166', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'WEAPON7': '0.500', 'HITCOUNT': '0.710', 'weapon4': '1.006', 'weapon3': '1.152', 'weapon2': '1.206', 'DAMAGECOUNT': '4.155', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:18:37,186][2408954] Fps is (10 sec: 25395.6, 60 sec: 24166.4, 300 sec: 24659.3). Total num frames: 90341376. Throughput: 0: 6039.7. Samples: 22579320. Policy #0 lag: (min: 0.0, avg: 11.6, max: 28.0)
[2023-02-25 13:18:37,186][2408954] Avg episode reward: [(0, '11.493')]
[2023-02-25 13:18:37,342][2409097] DAMAGECOUNT value on done: 7731.0
[2023-02-25 13:18:37,343][2409097] Sum rewards: 10.730, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.480', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.025', 'AMMO4': '0.060', 'AMMO3': '0.077', 'weapon7': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.200', 'weapon5': '0.232', 'WEAPON5': '0.450', 'ARMOR': '0.500', 'weapon4': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.700', 'weapon2': '0.934', 'weapon3': '1.680', 'DAMAGECOUNT': '2.895', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:18:37,837][2409099] DAMAGECOUNT value on done: 7166.0
[2023-02-25 13:18:37,838][2409099] Sum rewards: 9.877, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.764', 'AMMO5': '0.015', 'AMMO2': '0.018', 'AMMO3': '0.048', 'AMMO4': '0.089', 'weapon5': '0.112', 'weapon7': '0.190', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'AMMO6': '0.440', 'AMMO7': '0.440', 'ARMOR': '0.490', 'WEAPON7': '0.600', 'HITCOUNT': '0.610', 'weapon2': '0.650', 'weapon3': '0.806', 'weapon4': '1.844', 'DAMAGECOUNT': '2.589', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:18:38,041][2409075] DAMAGECOUNT value on done: 7633.0
[2023-02-25 13:18:38,044][2409075] Sum rewards: 10.895, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.638', 'AMMO2': '0.019', 'AMMO5': '0.027', 'AMMO4': '0.095', 'AMMO3': '0.109', 'weapon4': '0.196', 'WEAPON4': '0.200', 'weapon5': '0.376', 'WEAPON5': '0.650', 'WEAPON3': '0.650', 'HITCOUNT': '0.830', 'weapon3': '1.260', 'ARMOR': '1.459', 'weapon2': '1.698', 'DAMAGECOUNT': '3.213', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:18:38,620][2409074] Updated weights for policy 0, policy_version 22061 (0.0013)
[2023-02-25 13:18:38,658][2409469] DAMAGECOUNT value on done: 7496.0
[2023-02-25 13:18:38,662][2409469] Sum rewards: 10.407, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.828', 'AMMO2': '0.008', 'AMMO5': '0.020', 'AMMO4': '0.041', 'AMMO3': '0.095', 'WEAPON4': '0.150', 'weapon5': '0.262', 'WEAPON5': '0.450', 'weapon4': '0.454', 'WEAPON3': '0.650', 'HITCOUNT': '0.840', 'weapon2': '1.018', 'weapon3': '1.874', 'ARMOR': '2.132', 'DAMAGECOUNT': '3.240', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:18:38,770][2409078] DAMAGECOUNT value on done: 8750.0
[2023-02-25 13:18:38,773][2409078] Sum rewards: 21.120, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.450', 'WEAPON1': '0.010', 'AMMO5': '0.030', 'AMMO2': '0.040', 'weapon7': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.134', 'WEAPON7': '0.200', 'AMMO4': '0.201', 'weapon5': '0.216', 'WEAPON4': '0.350', 'weapon2': '0.574', 'weapon4': '0.582', 'WEAPON5': '0.650', 'WEAPON3': '0.800', 'HITCOUNT': '1.220', 'weapon3': '2.030', 'DAMAGECOUNT': '6.222', 'FRAGCOUNT': '18.000'}
[2023-02-25 13:18:39,505][2409076] DAMAGECOUNT value on done: 7760.0
[2023-02-25 13:18:39,506][2409076] Sum rewards: 8.783, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.777', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO3': '0.050', 'AMMO4': '0.055', 'weapon5': '0.096', 'WEAPON5': '0.200', 'WEAPON3': '0.450', 'ARMOR': '0.476', 'HITCOUNT': '0.550', 'weapon3': '1.218', 'DAMAGECOUNT': '2.067', 'weapon2': '2.382', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:18:39,539][2409486] DAMAGECOUNT value on done: 7822.0
[2023-02-25 13:18:39,540][2409486] Sum rewards: 14.667, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.126', 'AMMO5': '0.012', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'AMMO4': '0.068', 'AMMO3': '0.076', 'weapon7': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.266', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon4': '0.666', 'HITCOUNT': '0.750', 'weapon2': '1.028', 'weapon3': '1.524', 'DAMAGECOUNT': '4.917', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:18:39,901][2409079] DAMAGECOUNT value on done: 9223.0
[2023-02-25 13:18:39,902][2409079] Sum rewards: 17.386, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.794', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO3': '0.050', 'weapon7': '0.068', 'AMMO4': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'weapon2': '0.914', 'weapon4': '0.958', 'HITCOUNT': '0.960', 'weapon3': '1.254', 'DAMAGECOUNT': '4.731', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:18:39,962][2409074] Updated weights for policy 0, policy_version 22071 (0.0013)
[2023-02-25 13:18:40,373][2409102] Large shaping reward 2.641 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO2', -0.0001, -1.0), ('AMMO4', -0.0005, -1.0), ('weapon4', 0.002)]
[2023-02-25 13:18:41,173][2409096] DAMAGECOUNT value on done: 6679.0
[2023-02-25 13:18:41,174][2409096] Sum rewards: 7.146, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.975', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.010', 'AMMO3': '0.066', 'weapon7': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.560', 'weapon3': '0.834', 'ARMOR': '0.907', 'weapon2': '1.034', 'weapon4': '1.384', 'DAMAGECOUNT': '1.983', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:18:41,345][2409547] DAMAGECOUNT value on done: 7224.0
[2023-02-25 13:18:41,346][2409547] Sum rewards: 10.137, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.206', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO3': '0.058', 'weapon7': '0.076', 'AMMO4': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.214', 'WEAPON5': '0.300', 'HITCOUNT': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'weapon4': '0.832', 'weapon2': '1.114', 'weapon3': '1.170', 'DAMAGECOUNT': '2.613', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:18:41,499][2409097] DAMAGECOUNT value on done: 6925.0
[2023-02-25 13:18:41,503][2409097] Sum rewards: 10.995, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.118', 'AMMO5': '0.024', 'AMMO2': '0.026', 'WEAPON1': '0.040', 'AMMO3': '0.078', 'weapon5': '0.088', 'AMMO4': '0.129', 'WEAPON4': '0.250', 'weapon4': '0.296', 'WEAPON3': '0.550', 'WEAPON5': '0.550', 'HITCOUNT': '0.900', 'weapon2': '1.550', 'weapon3': '1.556', 'DAMAGECOUNT': '3.075', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:18:41,571][2409074] Updated weights for policy 0, policy_version 22081 (0.0012)
[2023-02-25 13:18:42,040][2409099] DAMAGECOUNT value on done: 7995.0
[2023-02-25 13:18:42,044][2409099] Sum rewards: 12.067, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.154', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO5': '0.018', 'weapon7': '0.054', 'AMMO4': '0.062', 'AMMO3': '0.064', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.210', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '0.460', 'weapon3': '0.716', 'ARMOR': '0.910', 'weapon2': '0.964', 'weapon4': '1.372', 'DAMAGECOUNT': '3.327', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:18:42,050][2409075] DAMAGECOUNT value on done: 7590.0
[2023-02-25 13:18:42,053][2409075] Sum rewards: 15.407, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.057', 'AMMO2': '0.007', 'AMMO5': '0.015', 'AMMO4': '0.034', 'AMMO3': '0.088', 'weapon5': '0.102', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'ARMOR': '0.885', 'HITCOUNT': '1.180', 'weapon3': '1.770', 'weapon2': '1.838', 'DAMAGECOUNT': '4.545', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:18:42,186][2408954] Fps is (10 sec: 23756.8, 60 sec: 23893.4, 300 sec: 24576.0). Total num frames: 90451968. Throughput: 0: 6020.0. Samples: 22615140. Policy #0 lag: (min: 0.0, avg: 14.8, max: 29.0)
[2023-02-25 13:18:42,186][2408954] Avg episode reward: [(0, '11.695')]
[2023-02-25 13:18:42,519][2409078] DAMAGECOUNT value on done: 7184.0
[2023-02-25 13:18:42,539][2409078] Sum rewards: 8.068, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.576', 'AMMO5': '0.003', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.039', 'weapon5': '0.060', 'AMMO3': '0.074', 'WEAPON5': '0.100', 'weapon7': '0.174', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'weapon4': '0.720', 'HITCOUNT': '0.740', 'weapon2': '0.816', 'weapon3': '0.966', 'DAMAGECOUNT': '2.985', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:18:42,674][2409469] DAMAGECOUNT value on done: 7029.0
[2023-02-25 13:18:42,675][2409469] Sum rewards: 16.590, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.338', 'AMMO5': '0.025', 'AMMO2': '0.032', 'AMMO3': '0.113', 'AMMO4': '0.161', 'weapon5': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.500', 'weapon4': '0.522', 'WEAPON3': '0.700', 'ARMOR': '0.849', 'weapon2': '0.976', 'HITCOUNT': '1.310', 'weapon3': '1.520', 'DAMAGECOUNT': '5.046', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:18:43,182][2409074] Updated weights for policy 0, policy_version 22091 (0.0012)
[2023-02-25 13:18:43,698][2409486] DAMAGECOUNT value on done: 6190.0
[2023-02-25 13:18:43,699][2409486] Sum rewards: 15.065, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.010', 'weapon4': '0.020', 'AMMO2': '0.020', 'AMMO3': '0.052', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'weapon5': '0.182', 'HEALTH': '0.286', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.790', 'weapon3': '1.346', 'weapon2': '1.780', 'DAMAGECOUNT': '3.972', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:18:43,758][2409079] DAMAGECOUNT value on done: 7695.0
[2023-02-25 13:18:43,759][2409079] Sum rewards: 3.357, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.688', 'AMMO5': '0.018', 'AMMO2': '0.026', 'weapon5': '0.062', 'AMMO3': '0.091', 'AMMO4': '0.129', 'weapon7': '0.142', 'WEAPON5': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON4': '0.400', 'HITCOUNT': '0.420', 'ARMOR': '0.495', 'WEAPON3': '0.550', 'weapon2': '0.718', 'weapon3': '1.012', 'weapon4': '1.492', 'DAMAGECOUNT': '1.650', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:18:44,125][2409076] DAMAGECOUNT value on done: 7031.0
[2023-02-25 13:18:44,126][2409076] Sum rewards: 11.624, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.684', 'AMMO2': '0.011', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.052', 'AMMO3': '0.060', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'weapon5': '0.450', 'WEAPON3': '0.500', 'HITCOUNT': '0.560', 'weapon2': '1.380', 'weapon3': '1.498', 'DAMAGECOUNT': '2.709', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:18:44,830][2409074] Updated weights for policy 0, policy_version 22101 (0.0013)
[2023-02-25 13:18:44,840][2409096] DAMAGECOUNT value on done: 7179.0
[2023-02-25 13:18:44,843][2409096] Sum rewards: 14.725, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.268', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon7': '0.046', 'AMMO3': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.154', 'WEAPON7': '0.200', 'weapon5': '0.206', 'WEAPON4': '0.250', 'WEAPON3': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.720', 'weapon4': '0.948', 'weapon2': '1.000', 'weapon3': '1.292', 'DAMAGECOUNT': '3.345', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:18:45,938][2409547] DAMAGECOUNT value on done: 6559.0
[2023-02-25 13:18:45,942][2409547] Sum rewards: 13.248, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.356', 'AMMO2': '0.006', 'AMMO5': '0.017', 'AMMO4': '0.030', 'weapon7': '0.068', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.154', 'weapon5': '0.196', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.443', 'WEAPON3': '0.450', 'HITCOUNT': '0.530', 'weapon3': '1.144', 'weapon2': '1.646', 'DAMAGECOUNT': '2.556', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:18:46,233][2409075] DAMAGECOUNT value on done: 6705.0
[2023-02-25 13:18:46,233][2409075] Sum rewards: 10.202, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.032', 'AMMO2': '0.020', 'AMMO5': '0.021', 'weapon7': '0.058', 'AMMO3': '0.099', 'AMMO4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.156', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.448', 'WEAPON5': '0.500', 'HITCOUNT': '0.570', 'WEAPON3': '0.650', 'weapon2': '0.706', 'weapon4': '1.152', 'weapon3': '1.482', 'DAMAGECOUNT': '2.631', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:18:46,393][2409469] DAMAGECOUNT value on done: 7207.0
[2023-02-25 13:18:46,394][2409469] Sum rewards: 12.548, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.598', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.049', 'AMMO3': '0.060', 'WEAPON4': '0.200', 'weapon5': '0.266', 'weapon4': '0.318', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'HITCOUNT': '0.760', 'ARMOR': '0.800', 'weapon2': '1.464', 'weapon3': '1.510', 'DAMAGECOUNT': '4.131', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:18:46,580][2409099] DAMAGECOUNT value on done: 6826.0
[2023-02-25 13:18:46,583][2409099] Sum rewards: 3.012, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.346', 'AMMO2': '0.017', 'AMMO5': '0.017', 'weapon7': '0.064', 'AMMO4': '0.087', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.450', 'HITCOUNT': '0.570', 'WEAPON3': '0.700', 'weapon4': '0.734', 'weapon2': '0.868', 'DAMAGECOUNT': '1.725', 'weapon3': '1.754', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:18:46,932][2409074] Updated weights for policy 0, policy_version 22111 (0.0012)
[2023-02-25 13:18:47,186][2408954] Fps is (10 sec: 23347.2, 60 sec: 24098.2, 300 sec: 24576.0). Total num frames: 90574848. Throughput: 0: 6031.8. Samples: 22651572. Policy #0 lag: (min: 0.0, avg: 14.8, max: 29.0)
[2023-02-25 13:18:47,186][2408954] Avg episode reward: [(0, '11.371')]
[2023-02-25 13:18:47,680][2409079] DAMAGECOUNT value on done: 9266.0
[2023-02-25 13:18:47,681][2409079] Sum rewards: 12.808, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.395', 'AMMO2': '0.014', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.048', 'weapon7': '0.066', 'AMMO4': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.250', 'weapon5': '0.326', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'WEAPON5': '0.550', 'HITCOUNT': '0.780', 'weapon3': '0.798', 'weapon4': '0.898', 'weapon2': '1.492', 'DAMAGECOUNT': '4.023', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:18:48,131][2409486] DAMAGECOUNT value on done: 8063.0
[2023-02-25 13:18:48,132][2409486] Sum rewards: 13.576, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.342', 'AMMO5': '0.003', 'AMMO2': '0.026', 'AMMO3': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'weapon7': '0.132', 'WEAPON3': '0.200', 'weapon5': '0.208', 'AMMO6': '0.280', 'AMMO7': '0.280', 'weapon2': '0.282', 'WEAPON4': '0.400', 'WEAPON7': '0.400', 'weapon3': '0.722', 'HITCOUNT': '0.960', 'weapon4': '2.104', 'DAMAGECOUNT': '3.663', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:18:48,201][2409076] DAMAGECOUNT value on done: 7543.0
[2023-02-25 13:18:48,205][2409076] Sum rewards: 17.650, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.242', 'AMMO5': '0.017', 'AMMO2': '0.018', 'AMMO3': '0.064', 'AMMO4': '0.091', 'weapon7': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.334', 'weapon4': '0.336', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'ARMOR': '0.819', 'HITCOUNT': '0.870', 'weapon3': '1.390', 'weapon2': '1.498', 'DAMAGECOUNT': '4.860', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:18:48,239][2409074] Updated weights for policy 0, policy_version 22121 (0.0012)
[2023-02-25 13:18:48,609][2409096] DAMAGECOUNT value on done: 6604.0
[2023-02-25 13:18:48,611][2409096] Sum rewards: 9.699, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.870', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO3': '0.053', 'AMMO4': '0.077', 'weapon7': '0.078', 'weapon5': '0.114', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'AMMO6': '0.360', 'AMMO7': '0.360', 'WEAPON7': '0.400', 'WEAPON3': '0.400', 'ARMOR': '0.446', 'weapon4': '0.494', 'HITCOUNT': '0.760', 'weapon3': '1.202', 'weapon2': '1.258', 'DAMAGECOUNT': '2.541', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:18:49,365][2409104] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:18:49,732][2409074] Updated weights for policy 0, policy_version 22131 (0.0012)
[2023-02-25 13:18:50,524][2409099] DAMAGECOUNT value on done: 6922.0
[2023-02-25 13:18:50,525][2409099] Sum rewards: 10.593, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.154', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.034', 'weapon7': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon5': '0.168', 'WEAPON7': '0.200', 'weapon4': '0.304', 'WEAPON3': '0.550', 'HITCOUNT': '0.710', 'weapon2': '1.504', 'weapon3': '1.532', 'DAMAGECOUNT': '4.077', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:18:50,662][2409547] DAMAGECOUNT value on done: 7171.0
[2023-02-25 13:18:50,666][2409547] Sum rewards: 14.831, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.216', 'AMMO5': '0.010', 'AMMO2': '0.047', 'AMMO3': '0.085', 'weapon5': '0.140', 'AMMO4': '0.233', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.622', 'HITCOUNT': '0.850', 'weapon3': '1.088', 'weapon2': '1.520', 'DAMAGECOUNT': '4.002', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:18:51,844][2409074] Updated weights for policy 0, policy_version 22141 (0.0012)
[2023-02-25 13:18:51,845][2409079] DAMAGECOUNT value on done: 6939.0
[2023-02-25 13:18:51,850][2409079] Sum rewards: 10.731, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.750', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'weapon7': '0.078', 'weapon5': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.460', 'weapon3': '0.498', 'weapon2': '0.600', 'weapon4': '1.650', 'DAMAGECOUNT': '2.490', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:18:52,186][2408954] Fps is (10 sec: 25395.2, 60 sec: 24302.9, 300 sec: 24617.7). Total num frames: 90705920. Throughput: 0: 6029.6. Samples: 22669848. Policy #0 lag: (min: 0.0, avg: 14.8, max: 29.0)
[2023-02-25 13:18:52,186][2408954] Avg episode reward: [(0, '11.437')]
[2023-02-25 13:18:52,306][2409076] DAMAGECOUNT value on done: 6626.0
[2023-02-25 13:18:52,307][2409076] Sum rewards: 16.316, reward structure: {'DEATHCOUNT': '-5.250', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'weapon7': '0.046', 'AMMO3': '0.060', 'AMMO4': '0.083', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.242', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'weapon4': '0.376', 'HITCOUNT': '0.690', 'HEALTH': '0.738', 'weapon3': '1.300', 'weapon2': '1.670', 'DAMAGECOUNT': '3.270', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:18:52,370][2409486] DAMAGECOUNT value on done: 6000.0
[2023-02-25 13:18:52,371][2409486] Sum rewards: 9.588, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.846', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.031', 'AMMO3': '0.067', 'weapon7': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.202', 'WEAPON4': '0.250', 'WEAPON3': '0.500', 'ARMOR': '0.533', 'HITCOUNT': '0.580', 'weapon2': '0.778', 'weapon3': '0.916', 'weapon4': '1.146', 'DAMAGECOUNT': '2.250', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:18:52,666][2409096] DAMAGECOUNT value on done: 6807.0
[2023-02-25 13:18:52,667][2409096] Sum rewards: 7.628, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.950', 'AMMO5': '0.022', 'AMMO2': '0.024', 'AMMO3': '0.093', 'AMMO4': '0.117', 'weapon5': '0.210', 'weapon7': '0.276', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON4': '0.350', 'WEAPON7': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.500', 'HITCOUNT': '0.670', 'weapon2': '0.748', 'weapon3': '0.926', 'ARMOR': '1.300', 'weapon4': '1.310', 'DAMAGECOUNT': '3.351', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:18:53,401][2409074] Updated weights for policy 0, policy_version 22151 (0.0014)
[2023-02-25 13:18:54,620][2409099] DAMAGECOUNT value on done: 6434.0
[2023-02-25 13:18:54,816][2409547] DAMAGECOUNT value on done: 8295.0
[2023-02-25 13:18:54,819][2409547] Sum rewards: 7.285, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.295', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO3': '0.050', 'weapon5': '0.068', 'weapon7': '0.098', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'weapon4': '0.762', 'HITCOUNT': '0.890', 'weapon3': '1.114', 'weapon2': '1.156', 'DAMAGECOUNT': '3.033', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:18:55,285][2409074] Updated weights for policy 0, policy_version 22161 (0.0013)
[2023-02-25 13:18:55,734][2409079] DAMAGECOUNT value on done: 8337.0
[2023-02-25 13:18:55,734][2409079] Sum rewards: -0.569, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.347', 'weapon7': '0.008', 'AMMO2': '0.012', 'AMMO5': '0.037', 'AMMO4': '0.060', 'weapon5': '0.112', 'weapon4': '0.118', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.750', 'WEAPON5': '0.800', 'ARMOR': '0.848', 'weapon2': '0.930', 'WEAPON3': '1.250', 'weapon3': '2.462', 'DAMAGECOUNT': '2.646', 'FRAGCOUNT': '3.500'}
[2023-02-25 13:18:56,109][2409486] DAMAGECOUNT value on done: 7207.0
[2023-02-25 13:18:56,109][2409486] Sum rewards: 12.007, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.020', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.020', 'AMMO3': '0.074', 'weapon5': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.570', 'WEAPON3': '0.600', 'weapon4': '0.604', 'ARMOR': '0.933', 'HITCOUNT': '0.950', 'weapon3': '1.620', 'DAMAGECOUNT': '3.513', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:18:56,456][2409076] DAMAGECOUNT value on done: 6787.0
[2023-02-25 13:18:56,459][2409076] Sum rewards: 12.338, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.362', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO3': '0.093', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.112', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.446', 'WEAPON3': '0.600', 'HITCOUNT': '0.720', 'ARMOR': '1.006', 'weapon2': '1.462', 'weapon3': '1.612', 'DAMAGECOUNT': '2.691', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:18:56,839][2409074] Updated weights for policy 0, policy_version 22171 (0.0012)
[2023-02-25 13:18:56,934][2409096] DAMAGECOUNT value on done: 6244.0
[2023-02-25 13:18:56,937][2409096] Sum rewards: 8.080, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.376', 'AMMO2': '0.010', 'AMMO5': '0.014', 'AMMO4': '0.051', 'AMMO3': '0.072', 'WEAPON4': '0.150', 'weapon5': '0.204', 'weapon4': '0.294', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.730', 'ARMOR': '0.800', 'weapon3': '1.042', 'weapon2': '1.658', 'DAMAGECOUNT': '2.880', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:18:57,186][2408954] Fps is (10 sec: 24576.0, 60 sec: 24234.7, 300 sec: 24562.1). Total num frames: 90820608. Throughput: 0: 6024.8. Samples: 22705968. Policy #0 lag: (min: 0.0, avg: 12.5, max: 23.0)
[2023-02-25 13:18:57,186][2408954] Avg episode reward: [(0, '11.233')]
[2023-02-25 13:18:58,252][2409099] DAMAGECOUNT value on done: 6986.0
[2023-02-25 13:18:58,254][2409099] Sum rewards: 5.871, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.132', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO3': '0.033', 'AMMO2': '0.035', 'weapon5': '0.062', 'weapon7': '0.078', 'WEAPON5': '0.150', 'AMMO4': '0.173', 'WEAPON3': '0.200', 'WEAPON4': '0.250', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.340', 'ARMOR': '0.400', 'weapon3': '0.520', 'weapon2': '1.220', 'DAMAGECOUNT': '1.410', 'weapon4': '1.714', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:18:58,762][2409074] Updated weights for policy 0, policy_version 22181 (0.0012)
[2023-02-25 13:18:58,823][2409547] DAMAGECOUNT value on done: 6106.0
[2023-02-25 13:18:58,823][2409547] Sum rewards: 13.122, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO2': '0.002', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.010', 'AMMO3': '0.040', 'HEALTH': '0.044', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.164', 'WEAPON3': '0.300', 'HITCOUNT': '0.400', 'ARMOR': '0.487', 'weapon2': '0.844', 'weapon3': '0.968', 'DAMAGECOUNT': '2.577', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:18:59,955][2409074] Updated weights for policy 0, policy_version 22191 (0.0012)
[2023-02-25 13:19:00,184][2409486] DAMAGECOUNT value on done: 7726.0
[2023-02-25 13:19:00,185][2409486] Sum rewards: 9.992, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.484', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.054', 'AMMO3': '0.090', 'AMMO4': '0.090', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.920', 'weapon2': '1.184', 'ARMOR': '1.200', 'weapon3': '1.554', 'DAMAGECOUNT': '3.360', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:19:00,197][2409079] DAMAGECOUNT value on done: 7149.0
[2023-02-25 13:19:00,211][2409079] Sum rewards: 6.330, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.438', 'AMMO5': '0.003', 'AMMO2': '0.018', 'AMMO3': '0.043', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.087', 'HITCOUNT': '0.240', 'weapon7': '0.248', 'WEAPON3': '0.250', 'WEAPON4': '0.300', 'AMMO6': '0.360', 'AMMO7': '0.360', 'ARMOR': '0.400', 'WEAPON7': '0.600', 'weapon3': '0.692', 'weapon2': '0.764', 'DAMAGECOUNT': '1.281', 'weapon4': '1.758', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:19:01,088][2409096] DAMAGECOUNT value on done: 6930.0
[2023-02-25 13:19:01,091][2409096] Sum rewards: 8.422, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.075', 'AMMO2': '0.003', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.017', 'weapon7': '0.088', 'AMMO3': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.126', 'WEAPON5': '0.250', 'ARMOR': '0.455', 'WEAPON3': '0.600', 'HITCOUNT': '0.660', 'weapon3': '1.200', 'weapon2': '1.602', 'DAMAGECOUNT': '2.583', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:19:01,680][2409074] Updated weights for policy 0, policy_version 22201 (0.0012)
[2023-02-25 13:19:02,186][2408954] Fps is (10 sec: 23756.7, 60 sec: 24234.9, 300 sec: 24589.9). Total num frames: 90943488. Throughput: 0: 6049.1. Samples: 22742736. Policy #0 lag: (min: 0.0, avg: 12.5, max: 23.0)
[2023-02-25 13:19:02,187][2408954] Avg episode reward: [(0, '11.148')]
[2023-02-25 13:19:02,552][2409099] DAMAGECOUNT value on done: 6823.0
[2023-02-25 13:19:02,552][2409099] Sum rewards: 6.688, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.078', 'AMMO2': '0.006', 'AMMO5': '0.014', 'AMMO4': '0.031', 'weapon7': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.109', 'weapon5': '0.126', 'weapon4': '0.258', 'WEAPON5': '0.300', 'HITCOUNT': '0.690', 'WEAPON3': '0.750', 'weapon2': '1.006', 'ARMOR': '1.309', 'weapon3': '1.902', 'DAMAGECOUNT': '2.802', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:19:02,598][2409547] DAMAGECOUNT value on done: 7288.0
[2023-02-25 13:19:02,599][2409547] Sum rewards: 7.600, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.982', 'AMMO2': '0.018', 'AMMO5': '0.024', 'AMMO4': '0.091', 'AMMO3': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.162', 'weapon5': '0.230', 'WEAPON4': '0.250', 'weapon4': '0.268', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.800', 'ARMOR': '0.853', 'weapon2': '1.446', 'weapon3': '1.566', 'DAMAGECOUNT': '3.381', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:19:02,716][2409080] DAMAGECOUNT value on done: 9028.0
[2023-02-25 13:19:02,722][2409080] Sum rewards: 14.532, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.514', 'AMMO2': '0.012', 'AMMO5': '0.012', 'weapon7': '0.048', 'AMMO4': '0.060', 'AMMO3': '0.078', 'weapon5': '0.100', 'weapon4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'ARMOR': '0.838', 'HITCOUNT': '0.840', 'weapon3': '1.076', 'weapon2': '1.766', 'DAMAGECOUNT': '4.626', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:19:03,638][2409074] Updated weights for policy 0, policy_version 22211 (0.0012)
[2023-02-25 13:19:04,003][2409486] DAMAGECOUNT value on done: 8411.0
[2023-02-25 13:19:04,007][2409486] Sum rewards: 10.955, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.586', 'weapon4': '0.012', 'AMMO2': '0.015', 'AMMO5': '0.028', 'AMMO4': '0.075', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'weapon5': '0.300', 'WEAPON5': '0.500', 'WEAPON3': '0.500', 'HITCOUNT': '0.580', 'ARMOR': '0.937', 'weapon2': '1.458', 'weapon3': '1.670', 'DAMAGECOUNT': '4.290', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:19:04,693][2409096] DAMAGECOUNT value on done: 7419.0
[2023-02-25 13:19:04,695][2409096] Sum rewards: 11.033, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.160', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO3': '0.098', 'AMMO4': '0.099', 'weapon5': '0.128', 'weapon4': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.700', 'ARMOR': '0.889', 'HITCOUNT': '1.080', 'weapon2': '1.172', 'weapon3': '1.970', 'DAMAGECOUNT': '3.690', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:19:04,750][2409079] DAMAGECOUNT value on done: 6261.0
[2023-02-25 13:19:04,751][2409079] Sum rewards: 13.671, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.341', 'AMMO5': '0.020', 'AMMO2': '0.020', 'WEAPON1': '0.070', 'AMMO4': '0.102', 'AMMO3': '0.132', 'weapon5': '0.186', 'WEAPON4': '0.200', 'weapon4': '0.208', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'HITCOUNT': '0.900', 'ARMOR': '0.915', 'weapon2': '1.212', 'weapon3': '1.998', 'DAMAGECOUNT': '3.999', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:19:05,232][2409074] Updated weights for policy 0, policy_version 22221 (0.0012)
[2023-02-25 13:19:06,375][2409099] DAMAGECOUNT value on done: 7569.0
[2023-02-25 13:19:06,377][2409099] Sum rewards: 19.121, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.610', 'AMMO2': '0.008', 'AMMO5': '0.019', 'AMMO4': '0.039', 'AMMO3': '0.075', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.320', 'weapon4': '0.490', 'WEAPON3': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.632', 'HITCOUNT': '1.090', 'weapon3': '1.644', 'DAMAGECOUNT': '5.364', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:19:06,446][2409547] DAMAGECOUNT value on done: 6615.0
[2023-02-25 13:19:06,450][2409547] Sum rewards: 7.028, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.668', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.023', 'weapon5': '0.030', 'AMMO4': '0.054', 'AMMO3': '0.088', 'weapon7': '0.190', 'WEAPON4': '0.250', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON5': '0.350', 'WEAPON7': '0.500', 'HITCOUNT': '0.540', 'WEAPON3': '0.600', 'weapon2': '0.846', 'ARMOR': '0.908', 'weapon3': '1.260', 'weapon4': '1.262', 'DAMAGECOUNT': '2.595', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:19:07,099][2409074] Updated weights for policy 0, policy_version 22231 (0.0016)
[2023-02-25 13:19:07,186][2408954] Fps is (10 sec: 23756.8, 60 sec: 24029.9, 300 sec: 24492.7). Total num frames: 91058176. Throughput: 0: 6031.5. Samples: 22760412. Policy #0 lag: (min: 0.0, avg: 12.5, max: 23.0)
[2023-02-25 13:19:07,186][2408954] Avg episode reward: [(0, '11.224')]
[2023-02-25 13:19:07,286][2409080] DAMAGECOUNT value on done: 6375.0
[2023-02-25 13:19:07,287][2409080] Sum rewards: 13.661, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.072', 'AMMO2': '0.010', 'AMMO5': '0.022', 'AMMO4': '0.052', 'AMMO3': '0.086', 'weapon7': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.660', 'weapon2': '1.058', 'weapon4': '1.070', 'weapon3': '1.170', 'DAMAGECOUNT': '3.768', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:19:08,336][2409074] Updated weights for policy 0, policy_version 22241 (0.0012)
[2023-02-25 13:19:10,491][2409074] Updated weights for policy 0, policy_version 22251 (0.0012)
[2023-02-25 13:19:10,512][2409547] DAMAGECOUNT value on done: 6944.0
[2023-02-25 13:19:10,516][2409547] Sum rewards: 13.270, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.456', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO3': '0.053', 'weapon7': '0.060', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.174', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.300', 'weapon4': '0.586', 'HITCOUNT': '0.670', 'ARMOR': '0.855', 'weapon3': '1.242', 'weapon2': '1.664', 'DAMAGECOUNT': '3.663', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:19:10,550][2409099] DAMAGECOUNT value on done: 7225.0
[2023-02-25 13:19:10,551][2409099] Sum rewards: 5.438, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.865', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.012', 'weapon4': '0.024', 'WEAPON4': '0.050', 'AMMO3': '0.056', 'weapon5': '0.198', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '0.430', 'weapon3': '1.102', 'weapon2': '1.782', 'DAMAGECOUNT': '2.397', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:19:11,299][2409080] DAMAGECOUNT value on done: 7236.0
[2023-02-25 13:19:11,300][2409080] Sum rewards: 11.992, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.250', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO5': '0.028', 'AMMO4': '0.105', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'weapon5': '0.204', 'weapon4': '0.450', 'ARMOR': '0.453', 'weapon2': '0.470', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'HITCOUNT': '1.030', 'weapon3': '1.916', 'DAMAGECOUNT': '3.423', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:19:11,967][2409074] Updated weights for policy 0, policy_version 22261 (0.0012)
[2023-02-25 13:19:12,186][2408954] Fps is (10 sec: 24166.3, 60 sec: 24098.1, 300 sec: 24506.6). Total num frames: 91185152. Throughput: 0: 6052.0. Samples: 22797192. Policy #0 lag: (min: 1.0, avg: 13.3, max: 28.0)
[2023-02-25 13:19:12,187][2408954] Avg episode reward: [(0, '11.336')]
[2023-02-25 13:19:13,805][2409074] Updated weights for policy 0, policy_version 22271 (0.0012)
[2023-02-25 13:19:14,269][2409099] DAMAGECOUNT value on done: 7773.0
[2023-02-25 13:19:14,271][2409099] Sum rewards: 11.790, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.938', 'AMMO2': '0.014', 'AMMO5': '0.019', 'AMMO4': '0.067', 'AMMO3': '0.070', 'WEAPON4': '0.200', 'weapon5': '0.286', 'weapon4': '0.298', 'ARMOR': '0.432', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '0.730', 'weapon2': '1.312', 'weapon3': '1.794', 'DAMAGECOUNT': '3.456', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:19:14,454][2409547] DAMAGECOUNT value on done: 7987.0
[2023-02-25 13:19:14,455][2409547] Sum rewards: 14.916, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.380', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO5': '0.032', 'AMMO4': '0.097', 'AMMO3': '0.117', 'WEAPON4': '0.150', 'weapon4': '0.214', 'weapon5': '0.384', 'WEAPON5': '0.700', 'WEAPON3': '0.900', 'HITCOUNT': '0.970', 'weapon2': '1.050', 'ARMOR': '1.252', 'weapon3': '1.990', 'DAMAGECOUNT': '4.650', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:19:15,378][2409074] Updated weights for policy 0, policy_version 22281 (0.0012)
[2023-02-25 13:19:15,388][2409080] DAMAGECOUNT value on done: 5914.0
[2023-02-25 13:19:15,389][2409080] Sum rewards: 12.956, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.740', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'weapon7': '0.052', 'AMMO3': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.100', 'weapon5': '0.228', 'WEAPON5': '0.450', 'ARMOR': '0.452', 'WEAPON3': '0.500', 'weapon4': '0.548', 'HITCOUNT': '0.750', 'weapon2': '1.306', 'weapon3': '1.614', 'DAMAGECOUNT': '4.209', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:19:16,608][2409074] Updated weights for policy 0, policy_version 22291 (0.0012)
[2023-02-25 13:19:17,186][2408954] Fps is (10 sec: 25395.2, 60 sec: 24234.7, 300 sec: 24520.5). Total num frames: 91312128. Throughput: 0: 6071.2. Samples: 22834056. Policy #0 lag: (min: 1.0, avg: 13.3, max: 28.0)
[2023-02-25 13:19:17,186][2408954] Avg episode reward: [(0, '11.459')]
[2023-02-25 13:19:18,544][2409547] DAMAGECOUNT value on done: 9144.0
[2023-02-25 13:19:18,545][2409547] Sum rewards: 13.005, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.315', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.068', 'AMMO3': '0.085', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'weapon7': '0.158', 'WEAPON4': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'weapon2': '0.452', 'ARMOR': '0.454', 'WEAPON3': '0.600', 'HITCOUNT': '0.820', 'weapon3': '1.372', 'weapon4': '1.662', 'DAMAGECOUNT': '4.527', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:19:18,663][2409099] DAMAGECOUNT value on done: 8396.0
[2023-02-25 13:19:18,666][2409099] Sum rewards: 12.570, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.103', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.030', 'AMMO3': '0.106', 'AMMO4': '0.148', 'weapon5': '0.326', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.654', 'WEAPON3': '0.700', 'weapon4': '0.724', 'HITCOUNT': '1.110', 'weapon3': '1.692', 'DAMAGECOUNT': '4.455', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:19:18,835][2409074] Updated weights for policy 0, policy_version 22301 (0.0012)
[2023-02-25 13:19:19,737][2409080] DAMAGECOUNT value on done: 7038.0
[2023-02-25 13:19:19,738][2409080] Sum rewards: 9.092, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.630', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO3': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.350', 'weapon4': '0.496', 'ARMOR': '0.500', 'HITCOUNT': '0.640', 'WEAPON3': '0.650', 'weapon3': '1.228', 'weapon2': '1.848', 'DAMAGECOUNT': '3.267', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:19:20,482][2409074] Updated weights for policy 0, policy_version 22311 (0.0012)
[2023-02-25 13:19:22,186][2408954] Fps is (10 sec: 23757.2, 60 sec: 24303.1, 300 sec: 24478.8). Total num frames: 91422720. Throughput: 0: 6058.1. Samples: 22851936. Policy #0 lag: (min: 1.0, avg: 13.3, max: 28.0)
[2023-02-25 13:19:22,186][2408954] Avg episode reward: [(0, '11.397')]
[2023-02-25 13:19:22,275][2409074] Updated weights for policy 0, policy_version 22321 (0.0012)
[2023-02-25 13:19:22,919][2409547] DAMAGECOUNT value on done: 7054.0
[2023-02-25 13:19:22,921][2409547] Sum rewards: 7.790, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.165', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.090', 'AMMO4': '0.105', 'weapon7': '0.132', 'weapon5': '0.198', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.340', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'weapon2': '0.744', 'weapon3': '0.828', 'ARMOR': '0.910', 'DAMAGECOUNT': '1.782', 'weapon4': '1.828', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:19:23,229][2409468] DAMAGECOUNT value on done: 7889.0
[2023-02-25 13:19:23,233][2409468] Sum rewards: 15.504, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.692', 'AMMO5': '0.022', 'AMMO2': '0.025', 'AMMO3': '0.080', 'AMMO4': '0.125', 'WEAPON4': '0.200', 'weapon4': '0.202', 'weapon5': '0.256', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'WEAPON5': '0.500', 'HITCOUNT': '0.660', 'weapon3': '1.414', 'weapon2': '1.486', 'DAMAGECOUNT': '4.125', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:19:23,479][2409099] DAMAGECOUNT value on done: 7136.0
[2023-02-25 13:19:23,484][2409099] Sum rewards: 13.158, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.904', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.117', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'weapon5': '0.290', 'weapon4': '0.384', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.712', 'WEAPON3': '0.800', 'HITCOUNT': '1.090', 'weapon3': '2.124', 'DAMAGECOUNT': '4.512', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:19:23,503][2409080] DAMAGECOUNT value on done: 8133.0
[2023-02-25 13:19:23,506][2409080] Sum rewards: 14.138, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.950', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon7': '0.060', 'AMMO3': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.131', 'weapon5': '0.168', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.538', 'WEAPON3': '0.550', 'HITCOUNT': '0.970', 'weapon4': '1.196', 'weapon3': '1.354', 'DAMAGECOUNT': '3.213', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:19:23,649][2409074] Updated weights for policy 0, policy_version 22331 (0.0013)
[2023-02-25 13:19:25,505][2409033] Signal inference workers to stop experience collection... (2700 times)
[2023-02-25 13:19:25,522][2409033] Signal inference workers to resume experience collection... (2700 times)
[2023-02-25 13:19:25,539][2409074] InferenceWorker_p0-w0: stopping experience collection (2700 times)
[2023-02-25 13:19:25,556][2409074] InferenceWorker_p0-w0: resuming experience collection (2700 times)
[2023-02-25 13:19:25,571][2409074] Updated weights for policy 0, policy_version 22341 (0.0013)
[2023-02-25 13:19:26,890][2409547] DAMAGECOUNT value on done: 6398.0
[2023-02-25 13:19:26,891][2409547] Sum rewards: 12.246, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.252', 'AMMO2': '0.011', 'AMMO5': '0.017', 'AMMO4': '0.054', 'AMMO3': '0.080', 'weapon7': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.156', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'weapon5': '0.234', 'WEAPON5': '0.350', 'ARMOR': '0.449', 'WEAPON3': '0.550', 'HITCOUNT': '0.750', 'weapon3': '1.260', 'weapon2': '1.758', 'DAMAGECOUNT': '3.030', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:19:26,962][2409074] Updated weights for policy 0, policy_version 22351 (0.0012)
[2023-02-25 13:19:27,186][2408954] Fps is (10 sec: 24166.1, 60 sec: 24439.5, 300 sec: 24451.0). Total num frames: 91553792. Throughput: 0: 6082.4. Samples: 22888848. Policy #0 lag: (min: 0.0, avg: 13.5, max: 27.0)
[2023-02-25 13:19:27,186][2408954] Avg episode reward: [(0, '11.527')]
[2023-02-25 13:19:27,351][2409099] DAMAGECOUNT value on done: 7748.0
[2023-02-25 13:19:27,352][2409099] Sum rewards: 17.544, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.683', 'AMMO5': '0.017', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.085', 'AMMO4': '0.093', 'weapon7': '0.122', 'WEAPON4': '0.300', 'weapon5': '0.318', 'WEAPON5': '0.400', 'AMMO6': '0.400', 'WEAPON7': '0.400', 'AMMO7': '0.400', 'weapon4': '0.634', 'WEAPON3': '0.650', 'weapon2': '0.920', 'HITCOUNT': '0.940', 'weapon3': '1.416', 'DAMAGECOUNT': '4.593', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:19:27,468][2409468] DAMAGECOUNT value on done: 6381.0
[2023-02-25 13:19:27,468][2409468] Sum rewards: 11.210, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon7': '0.048', 'AMMO3': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.162', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.288', 'HEALTH': '0.407', 'WEAPON3': '0.450', 'HITCOUNT': '0.680', 'ARMOR': '0.800', 'weapon3': '1.208', 'weapon2': '1.246', 'DAMAGECOUNT': '3.054', 'FRAGCOUNT': '8.500'}
[2023-02-25 13:19:27,822][2409080] DAMAGECOUNT value on done: 6741.0
[2023-02-25 13:19:27,827][2409080] Sum rewards: 17.356, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.752', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'AMMO5': '0.029', 'weapon7': '0.054', 'AMMO3': '0.101', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.248', 'ARMOR': '0.400', 'weapon4': '0.434', 'weapon2': '0.604', 'WEAPON5': '0.650', 'WEAPON3': '0.700', 'HITCOUNT': '1.230', 'weapon3': '2.092', 'DAMAGECOUNT': '4.152', 'FRAGCOUNT': '12.500'}
[2023-02-25 13:19:28,948][2409074] Updated weights for policy 0, policy_version 22361 (0.0012)
[2023-02-25 13:19:30,413][2409074] Updated weights for policy 0, policy_version 22371 (0.0013)
[2023-02-25 13:19:30,746][2409547] DAMAGECOUNT value on done: 7797.0
[2023-02-25 13:19:30,748][2409547] Sum rewards: 2.901, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.160', 'AMMO2': '0.029', 'AMMO5': '0.035', 'AMMO3': '0.098', 'AMMO4': '0.143', 'weapon5': '0.180', 'weapon4': '0.398', 'WEAPON4': '0.400', 'HITCOUNT': '0.580', 'WEAPON5': '0.600', 'WEAPON3': '0.650', 'ARMOR': '0.915', 'weapon2': '1.448', 'weapon3': '1.674', 'DAMAGECOUNT': '2.661', 'FRAGCOUNT': '3.500'}
[2023-02-25 13:19:31,039][2409099] DAMAGECOUNT value on done: 7013.0
[2023-02-25 13:19:31,040][2409099] Sum rewards: 10.529, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.276', 'WEAPON1': '0.020', 'AMMO5': '0.026', 'AMMO2': '0.031', 'weapon7': '0.060', 'AMMO3': '0.077', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.148', 'AMMO4': '0.152', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon4': '0.788', 'HITCOUNT': '0.860', 'weapon2': '1.000', 'ARMOR': '1.300', 'weapon3': '1.594', 'DAMAGECOUNT': '3.159', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:19:32,061][2409103] Large shaping reward 3.652 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:19:32,151][2409074] Updated weights for policy 0, policy_version 22381 (0.0014)
[2023-02-25 13:19:32,186][2408954] Fps is (10 sec: 24985.6, 60 sec: 24302.9, 300 sec: 24478.8). Total num frames: 91672576. Throughput: 0: 6078.4. Samples: 22925100. Policy #0 lag: (min: 0.0, avg: 13.5, max: 27.0)
[2023-02-25 13:19:32,186][2408954] Avg episode reward: [(0, '11.376')]
[2023-02-25 13:19:32,453][2409468] DAMAGECOUNT value on done: 7944.0
[2023-02-25 13:19:32,454][2409468] Sum rewards: 12.703, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO3': '0.060', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.106', 'weapon4': '0.114', 'WEAPON4': '0.150', 'weapon5': '0.198', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'HEALTH': '0.458', 'ARMOR': '0.800', 'HITCOUNT': '0.870', 'weapon2': '1.450', 'weapon3': '1.542', 'DAMAGECOUNT': '3.459', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:19:32,745][2409080] DAMAGECOUNT value on done: 7630.0
[2023-02-25 13:19:32,749][2409080] Sum rewards: 11.334, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.756', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO5': '0.015', 'AMMO3': '0.105', 'weapon5': '0.246', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '0.810', 'ARMOR': '0.853', 'weapon3': '1.408', 'weapon2': '1.992', 'DAMAGECOUNT': '3.288', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:19:34,174][2409074] Updated weights for policy 0, policy_version 22391 (0.0012)
[2023-02-25 13:19:34,856][2409486] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:19:35,005][2409103] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.588, 196.0), ('weapon7', 0.002)]
[2023-02-25 13:19:35,085][2409099] DAMAGECOUNT value on done: 8535.0
[2023-02-25 13:19:35,087][2409099] Sum rewards: 8.451, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.490', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.096', 'weapon5': '0.102', 'AMMO4': '0.102', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon4': '0.470', 'WEAPON3': '0.650', 'HITCOUNT': '0.900', 'weapon2': '0.976', 'weapon3': '1.912', 'DAMAGECOUNT': '2.922', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:19:35,215][2409074] Updated weights for policy 0, policy_version 22401 (0.0015)
[2023-02-25 13:19:35,235][2409547] DAMAGECOUNT value on done: 6544.0
[2023-02-25 13:19:35,239][2409547] Sum rewards: 13.245, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.668', 'AMMO2': '0.009', 'weapon7': '0.014', 'AMMO5': '0.017', 'AMMO4': '0.043', 'weapon5': '0.064', 'AMMO3': '0.078', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.470', 'WEAPON3': '0.550', 'weapon4': '0.702', 'ARMOR': '0.878', 'HITCOUNT': '0.930', 'weapon3': '1.534', 'DAMAGECOUNT': '3.624', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:19:36,420][2409468] DAMAGECOUNT value on done: 6027.0
[2023-02-25 13:19:36,421][2409468] Sum rewards: 11.013, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.812', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon7': '0.052', 'AMMO3': '0.067', 'AMMO4': '0.081', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.246', 'WEAPON4': '0.250', 'WEAPON3': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.610', 'weapon4': '0.808', 'weapon3': '0.852', 'weapon2': '1.586', 'DAMAGECOUNT': '3.006', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:19:36,694][2409080] DAMAGECOUNT value on done: 6576.0
[2023-02-25 13:19:36,698][2409080] Sum rewards: 8.729, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.588', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.033', 'AMMO3': '0.050', 'weapon5': '0.064', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon7': '0.172', 'AMMO6': '0.380', 'AMMO7': '0.380', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'WEAPON7': '0.500', 'HITCOUNT': '0.510', 'weapon3': '0.930', 'weapon2': '1.088', 'weapon4': '1.224', 'DAMAGECOUNT': '2.424', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:19:37,186][2408954] Fps is (10 sec: 23757.1, 60 sec: 24166.4, 300 sec: 24409.4). Total num frames: 91791360. Throughput: 0: 6073.6. Samples: 22943160. Policy #0 lag: (min: 0.0, avg: 13.5, max: 27.0)
[2023-02-25 13:19:37,187][2408954] Avg episode reward: [(0, '11.363')]
[2023-02-25 13:19:37,305][2409074] Updated weights for policy 0, policy_version 22411 (0.0013)
[2023-02-25 13:19:38,880][2409074] Updated weights for policy 0, policy_version 22421 (0.0013)
[2023-02-25 13:19:39,209][2409547] DAMAGECOUNT value on done: 8784.0
[2023-02-25 13:19:39,212][2409547] Sum rewards: 14.689, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.422', 'AMMO2': '0.019', 'AMMO5': '0.025', 'weapon7': '0.092', 'AMMO4': '0.092', 'AMMO3': '0.111', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon4': '0.490', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'HITCOUNT': '0.940', 'weapon2': '1.216', 'weapon3': '1.470', 'DAMAGECOUNT': '4.602', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:19:40,579][2409468] DAMAGECOUNT value on done: 8982.0
[2023-02-25 13:19:40,583][2409468] Sum rewards: 11.709, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.110', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.038', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'weapon5': '0.246', 'weapon4': '0.346', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.680', 'weapon3': '1.288', 'ARMOR': '1.354', 'weapon2': '1.764', 'DAMAGECOUNT': '3.498', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:19:40,602][2409074] Updated weights for policy 0, policy_version 22431 (0.0013)
[2023-02-25 13:19:40,900][2409080] DAMAGECOUNT value on done: 8161.0
[2023-02-25 13:19:40,904][2409080] Sum rewards: 9.871, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.898', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.028', 'AMMO5': '0.031', 'weapon4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'weapon5': '0.350', 'WEAPON5': '0.550', 'HITCOUNT': '0.640', 'WEAPON3': '0.700', 'ARMOR': '0.855', 'weapon2': '1.066', 'weapon3': '1.662', 'DAMAGECOUNT': '3.570', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:19:41,419][2409406] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)]
[2023-02-25 13:19:42,186][2408954] Fps is (10 sec: 23347.0, 60 sec: 24234.6, 300 sec: 24367.7). Total num frames: 91906048. Throughput: 0: 6080.5. Samples: 22979592. Policy #0 lag: (min: 0.0, avg: 13.5, max: 27.0)
[2023-02-25 13:19:42,186][2408954] Avg episode reward: [(0, '11.310')]
[2023-02-25 13:19:42,400][2409074] Updated weights for policy 0, policy_version 22441 (0.0012)
[2023-02-25 13:19:43,385][2409547] DAMAGECOUNT value on done: 6156.0
[2023-02-25 13:19:43,387][2409547] Sum rewards: 7.819, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.320', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon7': '0.054', 'AMMO3': '0.076', 'AMMO4': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.114', 'WEAPON5': '0.200', 'WEAPON3': '0.450', 'HITCOUNT': '0.510', 'weapon3': '0.908', 'weapon4': '0.998', 'ARMOR': '1.297', 'weapon2': '1.668', 'DAMAGECOUNT': '2.358', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:19:44,117][2409074] Updated weights for policy 0, policy_version 22451 (0.0012)
[2023-02-25 13:19:45,512][2409074] Updated weights for policy 0, policy_version 22461 (0.0012)
[2023-02-25 13:19:46,789][2409468] DAMAGECOUNT value on done: 5871.0
[2023-02-25 13:19:46,790][2409468] Sum rewards: 11.263, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.148', 'AMMO5': '0.015', 'AMMO2': '0.017', 'AMMO3': '0.053', 'weapon7': '0.058', 'AMMO4': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.244', 'WEAPON5': '0.350', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.460', 'weapon4': '0.562', 'weapon2': '0.762', 'weapon3': '1.172', 'DAMAGECOUNT': '2.481', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:19:46,970][2409080] DAMAGECOUNT value on done: 8097.0
[2023-02-25 13:19:46,971][2409080] Sum rewards: 11.914, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.027', 'AMMO2': '0.038', 'AMMO3': '0.086', 'HEALTH': '0.168', 'AMMO4': '0.190', 'weapon5': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.404', 'WEAPON3': '0.450', 'HITCOUNT': '0.690', 'weapon3': '1.118', 'ARMOR': '1.650', 'weapon2': '1.788', 'DAMAGECOUNT': '3.216', 'FRAGCOUNT': '9.500'}
[2023-02-25 13:19:47,186][2408954] Fps is (10 sec: 23756.8, 60 sec: 24234.7, 300 sec: 24395.5). Total num frames: 92028928. Throughput: 0: 6068.3. Samples: 23015808. Policy #0 lag: (min: 0.0, avg: 12.4, max: 27.0)
[2023-02-25 13:19:47,186][2408954] Avg episode reward: [(0, '11.189')]
[2023-02-25 13:19:47,305][2409547] DAMAGECOUNT value on done: 7500.0
[2023-02-25 13:19:47,306][2409547] Sum rewards: 15.063, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.218', 'AMMO2': '0.002', 'AMMO4': '0.010', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'WEAPON4': '0.050', 'weapon7': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.103', 'weapon4': '0.128', 'weapon5': '0.310', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'ARMOR': '0.885', 'HITCOUNT': '1.060', 'weapon3': '1.476', 'weapon2': '1.754', 'DAMAGECOUNT': '5.037', 'FRAGCOUNT': '13.500'}
[2023-02-25 13:19:47,789][2409074] Updated weights for policy 0, policy_version 22471 (0.0012)
[2023-02-25 13:19:48,843][2409074] Updated weights for policy 0, policy_version 22481 (0.0013)
[2023-02-25 13:19:50,973][2409074] Updated weights for policy 0, policy_version 22491 (0.0012)
[2023-02-25 13:19:51,209][2409468] DAMAGECOUNT value on done: 7784.0
[2023-02-25 13:19:51,210][2409468] Sum rewards: 7.510, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.059', 'AMMO4': '0.079', 'weapon7': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.158', 'WEAPON5': '0.250', 'HITCOUNT': '0.270', 'WEAPON3': '0.350', 'HEALTH': '0.364', 'weapon2': '0.402', 'ARMOR': '0.800', 'weapon3': '0.884', 'weapon4': '0.960', 'DAMAGECOUNT': '2.406', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:19:51,364][2409080] DAMAGECOUNT value on done: 6966.0
[2023-02-25 13:19:51,370][2409080] Sum rewards: 7.038, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.682', 'AMMO2': '0.018', 'AMMO5': '0.018', 'AMMO3': '0.082', 'AMMO4': '0.092', 'weapon7': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.200', 'weapon5': '0.230', 'WEAPON5': '0.400', 'weapon4': '0.446', 'WEAPON3': '0.500', 'HITCOUNT': '0.600', 'weapon3': '1.270', 'ARMOR': '1.286', 'weapon2': '1.614', 'DAMAGECOUNT': '2.319', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:19:52,186][2408954] Fps is (10 sec: 23756.8, 60 sec: 23961.6, 300 sec: 24312.2). Total num frames: 92143616. Throughput: 0: 6081.1. Samples: 23034060. Policy #0 lag: (min: 0.0, avg: 12.4, max: 27.0)
[2023-02-25 13:19:52,187][2408954] Avg episode reward: [(0, '11.140')]
[2023-02-25 13:19:52,415][2409074] Updated weights for policy 0, policy_version 22501 (0.0012)
[2023-02-25 13:19:54,167][2409074] Updated weights for policy 0, policy_version 22511 (0.0012)
[2023-02-25 13:19:55,090][2409468] DAMAGECOUNT value on done: 9650.0
[2023-02-25 13:19:55,094][2409468] Sum rewards: 11.368, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.810', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO3': '0.106', 'weapon7': '0.126', 'AMMO4': '0.149', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON7': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.830', 'weapon4': '0.832', 'weapon2': '1.116', 'weapon3': '1.382', 'DAMAGECOUNT': '3.312', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:19:55,232][2409080] DAMAGECOUNT value on done: 6008.0
[2023-02-25 13:19:55,237][2409080] Sum rewards: 8.876, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.675', 'AMMO4': '-0.065', 'AMMO2': '-0.013', 'AMMO5': '0.005', 'AMMO3': '0.030', 'weapon7': '0.054', 'WEAPON3': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon3': '0.230', 'HITCOUNT': '0.320', 'DAMAGECOUNT': '1.500', 'weapon2': '2.450', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:19:55,920][2409074] Updated weights for policy 0, policy_version 22521 (0.0013)
[2023-02-25 13:19:57,092][2409074] Updated weights for policy 0, policy_version 22531 (0.0012)
[2023-02-25 13:19:57,186][2408954] Fps is (10 sec: 25804.7, 60 sec: 24439.4, 300 sec: 24381.6). Total num frames: 92286976. Throughput: 0: 6077.3. Samples: 23070672. Policy #0 lag: (min: 0.0, avg: 12.4, max: 27.0)
[2023-02-25 13:19:57,186][2408954] Avg episode reward: [(0, '11.116')]
[2023-02-25 13:19:59,338][2409468] DAMAGECOUNT value on done: 8816.0
[2023-02-25 13:19:59,339][2409468] Sum rewards: 15.259, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.369', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO3': '0.116', 'weapon5': '0.158', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'HITCOUNT': '1.040', 'ARMOR': '1.311', 'weapon2': '1.382', 'weapon3': '1.984', 'DAMAGECOUNT': '4.197', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:19:59,522][2409080] DAMAGECOUNT value on done: 7915.0
[2023-02-25 13:19:59,526][2409080] Sum rewards: 10.466, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.855', 'AMMO2': '0.008', 'AMMO5': '0.014', 'AMMO4': '0.038', 'AMMO3': '0.050', 'weapon7': '0.070', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'weapon4': '0.482', 'HITCOUNT': '0.670', 'weapon2': '0.820', 'weapon3': '1.282', 'DAMAGECOUNT': '2.937', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:19:59,551][2409074] Updated weights for policy 0, policy_version 22541 (0.0012)
[2023-02-25 13:20:00,678][2409074] Updated weights for policy 0, policy_version 22551 (0.0012)
[2023-02-25 13:20:02,186][2408954] Fps is (10 sec: 25395.1, 60 sec: 24234.7, 300 sec: 24326.1). Total num frames: 92397568. Throughput: 0: 6056.0. Samples: 23106576. Policy #0 lag: (min: 0.0, avg: 14.5, max: 26.0)
[2023-02-25 13:20:02,186][2408954] Avg episode reward: [(0, '11.052')]
[2023-02-25 13:20:02,972][2409074] Updated weights for policy 0, policy_version 22561 (0.0013)
[2023-02-25 13:20:03,490][2409468] DAMAGECOUNT value on done: 7098.0
[2023-02-25 13:20:03,496][2409468] Sum rewards: 10.311, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.510', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO3': '0.070', 'weapon7': '0.072', 'AMMO4': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.450', 'ARMOR': '0.500', 'HITCOUNT': '0.780', 'weapon4': '0.970', 'weapon2': '1.050', 'weapon3': '1.256', 'DAMAGECOUNT': '3.045', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:20:03,589][2409080] DAMAGECOUNT value on done: 8284.0
[2023-02-25 13:20:03,593][2409080] Sum rewards: 25.562, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.296', 'AMMO2': '0.019', 'AMMO5': '0.022', 'weapon7': '0.030', 'AMMO3': '0.088', 'AMMO4': '0.094', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon5': '0.190', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.302', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'weapon2': '1.416', 'HITCOUNT': '1.420', 'weapon3': '1.784', 'DAMAGECOUNT': '6.222', 'FRAGCOUNT': '20.000'}
[2023-02-25 13:20:04,155][2409074] Updated weights for policy 0, policy_version 22571 (0.0013)
[2023-02-25 13:20:05,515][2409074] Updated weights for policy 0, policy_version 22581 (0.0013)
[2023-02-25 13:20:06,389][2409105] Large shaping reward 2.614 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.582, 194.0), ('weapon7', 0.002)]
[2023-02-25 13:20:07,186][2408954] Fps is (10 sec: 22118.4, 60 sec: 24166.4, 300 sec: 24298.3). Total num frames: 92508160. Throughput: 0: 6066.1. Samples: 23124912. Policy #0 lag: (min: 0.0, avg: 14.5, max: 26.0)
[2023-02-25 13:20:07,186][2408954] Avg episode reward: [(0, '11.284')]
[2023-02-25 13:20:07,517][2409468] DAMAGECOUNT value on done: 7012.0
[2023-02-25 13:20:07,518][2409468] Sum rewards: 6.925, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.532', 'AMMO2': '0.018', 'AMMO5': '0.027', 'AMMO4': '0.090', 'AMMO3': '0.172', 'weapon5': '0.184', 'WEAPON4': '0.250', 'weapon4': '0.284', 'WEAPON5': '0.650', 'HITCOUNT': '0.830', 'ARMOR': '0.901', 'weapon2': '1.058', 'WEAPON3': '1.200', 'weapon3': '2.164', 'DAMAGECOUNT': '3.129', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:20:07,596][2409080] DAMAGECOUNT value on done: 6768.0
[2023-02-25 13:20:07,599][2409080] Sum rewards: 5.588, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.030', 'AMMO3': '0.050', 'weapon7': '0.052', 'weapon5': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'WEAPON3': '0.250', 'HITCOUNT': '0.450', 'HEALTH': '0.766', 'weapon3': '1.010', 'weapon2': '1.400', 'DAMAGECOUNT': '2.109', 'FRAGCOUNT': '2.500'}
[2023-02-25 13:20:07,885][2409074] Updated weights for policy 0, policy_version 22591 (0.0012)
[2023-02-25 13:20:09,139][2409074] Updated weights for policy 0, policy_version 22601 (0.0013)
[2023-02-25 13:20:11,230][2409074] Updated weights for policy 0, policy_version 22611 (0.0012)
[2023-02-25 13:20:11,429][2409468] DAMAGECOUNT value on done: 6943.0
[2023-02-25 13:20:11,432][2409468] Sum rewards: 14.281, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.064', 'AMMO2': '0.013', 'AMMO5': '0.017', 'AMMO4': '0.064', 'weapon5': '0.092', 'AMMO3': '0.102', 'WEAPON4': '0.200', 'weapon4': '0.370', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '1.040', 'weapon2': '1.176', 'weapon3': '1.596', 'DAMAGECOUNT': '3.924', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:20:11,484][2409080] DAMAGECOUNT value on done: 7197.0
[2023-02-25 13:20:11,486][2409080] Sum rewards: 14.454, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.282', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.021', 'weapon7': '0.072', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.230', 'weapon4': '0.306', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.890', 'weapon2': '1.358', 'weapon3': '1.442', 'DAMAGECOUNT': '4.350', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:20:12,186][2408954] Fps is (10 sec: 24166.1, 60 sec: 24234.6, 300 sec: 24270.5). Total num frames: 92639232. Throughput: 0: 6056.8. Samples: 23161404. Policy #0 lag: (min: 0.0, avg: 14.5, max: 26.0)
[2023-02-25 13:20:12,186][2408954] Avg episode reward: [(0, '11.311')]
[2023-02-25 13:20:12,532][2409074] Updated weights for policy 0, policy_version 22621 (0.0012)
[2023-02-25 13:20:12,733][2409549] DAMAGECOUNT value on done: 7559.0
[2023-02-25 13:20:12,737][2409549] Sum rewards: 7.474, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.408', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO3': '0.080', 'AMMO4': '0.089', 'weapon4': '0.100', 'weapon5': '0.146', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON3': '0.500', 'HITCOUNT': '0.790', 'ARMOR': '0.856', 'weapon2': '1.326', 'weapon3': '1.838', 'DAMAGECOUNT': '2.577', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:20:14,644][2409074] Updated weights for policy 0, policy_version 22631 (0.0012)
[2023-02-25 13:20:15,314][2409468] DAMAGECOUNT value on done: 9824.0
[2023-02-25 13:20:15,318][2409468] Sum rewards: 14.661, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.134', 'AMMO5': '0.009', 'AMMO2': '0.026', 'AMMO3': '0.079', 'AMMO4': '0.131', 'weapon5': '0.164', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'WEAPON4': '0.550', 'weapon4': '0.828', 'ARMOR': '0.911', 'weapon2': '1.122', 'HITCOUNT': '1.160', 'weapon3': '1.450', 'DAMAGECOUNT': '4.314', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:20:15,355][2409080] DAMAGECOUNT value on done: 7914.0
[2023-02-25 13:20:15,356][2409080] Sum rewards: 10.735, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.030', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'AMMO3': '0.087', 'weapon5': '0.104', 'AMMO4': '0.108', 'weapon7': '0.178', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON7': '0.400', 'weapon4': '0.446', 'ARMOR': '0.449', 'WEAPON3': '0.650', 'weapon2': '0.974', 'HITCOUNT': '1.060', 'weapon3': '1.676', 'DAMAGECOUNT': '3.762', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:20:16,324][2409074] Updated weights for policy 0, policy_version 22641 (0.0013)
[2023-02-25 13:20:16,765][2409080] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)]
[2023-02-25 13:20:17,006][2409549] DAMAGECOUNT value on done: 9190.0
[2023-02-25 13:20:17,011][2409549] Sum rewards: 12.975, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.681', 'AMMO2': '0.012', 'AMMO5': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.099', 'weapon4': '0.210', 'weapon5': '0.220', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'ARMOR': '0.848', 'HITCOUNT': '1.040', 'weapon2': '1.246', 'weapon3': '1.500', 'DAMAGECOUNT': '3.456', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:20:17,173][2409100] DAMAGECOUNT value on done: 7659.0
[2023-02-25 13:20:17,174][2409100] Sum rewards: 11.944, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.270', 'AMMO2': '0.007', 'AMMO5': '0.025', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'weapon7': '0.068', 'weapon4': '0.094', 'AMMO3': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.384', 'WEAPON5': '0.450', 'HITCOUNT': '0.460', 'WEAPON3': '0.650', 'ARMOR': '0.905', 'weapon3': '1.238', 'weapon2': '1.890', 'DAMAGECOUNT': '3.153', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:20:17,186][2408954] Fps is (10 sec: 25395.2, 60 sec: 24166.4, 300 sec: 24256.7). Total num frames: 92762112. Throughput: 0: 6054.9. Samples: 23197572. Policy #0 lag: (min: 0.0, avg: 13.8, max: 26.0)
[2023-02-25 13:20:17,187][2408954] Avg episode reward: [(0, '11.292')]
[2023-02-25 13:20:17,192][2409033] Saving /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000022647_92762112.pth...
[2023-02-25 13:20:17,293][2409033] Removing /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000021231_86962176.pth
[2023-02-25 13:20:18,075][2409074] Updated weights for policy 0, policy_version 22651 (0.0012)
[2023-02-25 13:20:19,236][2409468] DAMAGECOUNT value on done: 6708.0
[2023-02-25 13:20:19,236][2409468] Sum rewards: 13.709, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.018', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'AMMO3': '0.050', 'weapon5': '0.052', 'WEAPON5': '0.150', 'weapon7': '0.154', 'AMMO4': '0.171', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'HITCOUNT': '0.730', 'ARMOR': '0.820', 'weapon2': '1.176', 'weapon3': '1.180', 'weapon4': '1.186', 'DAMAGECOUNT': '2.799', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:20:19,258][2409080] DAMAGECOUNT value on done: 8433.0
[2023-02-25 13:20:19,259][2409080] Sum rewards: 17.712, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.363', 'AMMO4': '-0.062', 'AMMO2': '-0.012', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO3': '0.080', 'weapon5': '0.172', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'ARMOR': '0.898', 'HITCOUNT': '1.070', 'weapon2': '1.494', 'weapon3': '1.672', 'DAMAGECOUNT': '3.978', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:20:19,816][2409074] Updated weights for policy 0, policy_version 22661 (0.0012)
[2023-02-25 13:20:20,830][2409074] Updated weights for policy 0, policy_version 22671 (0.0013)
[2023-02-25 13:20:21,487][2409549] DAMAGECOUNT value on done: 7206.0
[2023-02-25 13:20:21,491][2409549] Sum rewards: 6.612, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.430', 'AMMO5': '0.010', 'AMMO3': '0.013', 'AMMO2': '0.023', 'weapon5': '0.026', 'WEAPON3': '0.100', 'AMMO4': '0.114', 'weapon7': '0.118', 'weapon3': '0.184', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HITCOUNT': '0.300', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'weapon2': '0.402', 'DAMAGECOUNT': '1.839', 'weapon4': '2.424', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:20:21,532][2409100] DAMAGECOUNT value on done: 8091.0
[2023-02-25 13:20:21,535][2409100] Sum rewards: 15.563, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.210', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO3': '0.040', 'AMMO4': '0.044', 'weapon7': '0.058', 'weapon5': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.250', 'WEAPON3': '0.300', 'weapon3': '0.990', 'HITCOUNT': '1.140', 'weapon2': '1.214', 'DAMAGECOUNT': '4.617', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:20:22,116][2409103] DAMAGECOUNT value on done: 6703.0
[2023-02-25 13:20:22,117][2409103] Sum rewards: 9.305, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.559', 'AMMO2': '0.007', 'AMMO5': '0.015', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'AMMO3': '0.056', 'weapon7': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.174', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'HITCOUNT': '0.440', 'weapon4': '0.736', 'ARMOR': '0.872', 'weapon2': '1.034', 'weapon3': '1.186', 'DAMAGECOUNT': '2.979', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:20:22,186][2408954] Fps is (10 sec: 24576.4, 60 sec: 24371.2, 300 sec: 24284.4). Total num frames: 92884992. Throughput: 0: 6062.4. Samples: 23215968. Policy #0 lag: (min: 0.0, avg: 13.8, max: 26.0)
[2023-02-25 13:20:22,187][2408954] Avg episode reward: [(0, '11.283')]
[2023-02-25 13:20:22,714][2409074] Updated weights for policy 0, policy_version 22681 (0.0012)
[2023-02-25 13:20:23,215][2409468] DAMAGECOUNT value on done: 6506.0
[2023-02-25 13:20:23,217][2409468] Sum rewards: 15.573, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.995', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.025', 'weapon7': '0.080', 'AMMO3': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.126', 'WEAPON7': '0.200', 'weapon5': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon4': '0.582', 'WEAPON3': '0.800', 'ARMOR': '0.855', 'weapon2': '1.016', 'HITCOUNT': '1.210', 'weapon3': '1.572', 'DAMAGECOUNT': '4.239', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:20:23,225][2409080] DAMAGECOUNT value on done: 7696.0
[2023-02-25 13:20:23,226][2409080] Sum rewards: 16.329, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.146', 'AMMO2': '0.013', 'AMMO5': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.100', 'weapon5': '0.110', 'weapon4': '0.156', 'WEAPON5': '0.350', 'ARMOR': '0.430', 'WEAPON3': '0.650', 'HITCOUNT': '1.170', 'weapon2': '1.302', 'weapon3': '1.960', 'DAMAGECOUNT': '4.107', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:20:24,466][2409074] Updated weights for policy 0, policy_version 22691 (0.0012)
[2023-02-25 13:20:25,305][2409100] DAMAGECOUNT value on done: 7294.0
[2023-02-25 13:20:25,308][2409100] Sum rewards: 15.312, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.200', 'AMMO5': '0.012', 'AMMO2': '0.023', 'WEAPON4': '0.050', 'AMMO3': '0.064', 'AMMO4': '0.116', 'weapon7': '0.122', 'weapon4': '0.258', 'AMMO6': '0.260', 'AMMO7': '0.260', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'weapon5': '0.420', 'WEAPON3': '0.450', 'weapon2': '0.716', 'HITCOUNT': '0.720', 'weapon3': '1.576', 'DAMAGECOUNT': '3.615', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:20:25,780][2409549] DAMAGECOUNT value on done: 8644.0
[2023-02-25 13:20:25,781][2409549] Sum rewards: 7.247, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.818', 'AMMO2': '0.001', 'AMMO4': '0.006', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.214', 'WEAPON5': '0.350', 'HITCOUNT': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon3': '0.786', 'weapon2': '1.178', 'weapon4': '1.392', 'DAMAGECOUNT': '2.682', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:20:26,277][2409103] DAMAGECOUNT value on done: 9697.0
[2023-02-25 13:20:26,278][2409103] Sum rewards: 11.570, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.047', 'AMMO5': '0.011', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.060', 'weapon7': '0.066', 'AMMO4': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'ARMOR': '0.467', 'weapon2': '0.692', 'HITCOUNT': '0.880', 'weapon4': '1.266', 'weapon3': '1.406', 'DAMAGECOUNT': '3.291', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:20:26,445][2409074] Updated weights for policy 0, policy_version 22701 (0.0012)
[2023-02-25 13:20:26,919][2409469] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:20:27,186][2408954] Fps is (10 sec: 23756.9, 60 sec: 24098.2, 300 sec: 24242.8). Total num frames: 92999680. Throughput: 0: 6057.3. Samples: 23252172. Policy #0 lag: (min: 0.0, avg: 13.8, max: 26.0)
[2023-02-25 13:20:27,186][2408954] Avg episode reward: [(0, '11.333')]
[2023-02-25 13:20:27,220][2409468] DAMAGECOUNT value on done: 8505.0
[2023-02-25 13:20:27,223][2409468] Sum rewards: 14.879, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.854', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.018', 'AMMO3': '0.093', 'WEAPON4': '0.200', 'weapon4': '0.296', 'weapon5': '0.338', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'weapon2': '0.780', 'ARMOR': '0.851', 'HITCOUNT': '0.890', 'weapon3': '2.002', 'DAMAGECOUNT': '3.834', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:20:27,224][2409080] DAMAGECOUNT value on done: 7010.0
[2023-02-25 13:20:27,226][2409080] Sum rewards: 6.031, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.981', 'WEAPON1': '0.010', 'AMMO5': '0.032', 'AMMO2': '0.033', 'AMMO3': '0.112', 'weapon7': '0.128', 'AMMO4': '0.165', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.228', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'HITCOUNT': '0.540', 'weapon4': '0.660', 'WEAPON3': '0.700', 'ARMOR': '0.891', 'weapon2': '1.190', 'weapon3': '1.362', 'DAMAGECOUNT': '3.120', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:20:28,207][2409074] Updated weights for policy 0, policy_version 22711 (0.0012)
[2023-02-25 13:20:28,490][2409080] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)]
[2023-02-25 13:20:29,075][2409100] DAMAGECOUNT value on done: 8293.0
[2023-02-25 13:20:29,079][2409100] Sum rewards: 14.527, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.918', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.083', 'AMMO3': '0.088', 'WEAPON4': '0.150', 'weapon5': '0.234', 'weapon4': '0.282', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'HITCOUNT': '1.100', 'weapon2': '1.252', 'weapon3': '1.796', 'DAMAGECOUNT': '4.431', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:20:29,321][2409074] Updated weights for policy 0, policy_version 22721 (0.0013)
[2023-02-25 13:20:29,335][2409101] DAMAGECOUNT value on done: 7224.0
[2023-02-25 13:20:29,336][2409101] Sum rewards: 18.634, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.740', 'AMMO5': '0.022', 'AMMO2': '0.026', 'weapon5': '0.048', 'AMMO3': '0.118', 'AMMO4': '0.127', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'HITCOUNT': '1.220', 'weapon2': '1.454', 'weapon3': '2.120', 'DAMAGECOUNT': '4.539', 'FRAGCOUNT': '17.000'}
[2023-02-25 13:20:30,092][2409549] DAMAGECOUNT value on done: 9314.0
[2023-02-25 13:20:30,096][2409549] Sum rewards: 14.510, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.444', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.014', 'weapon5': '0.046', 'AMMO3': '0.097', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.144', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'HITCOUNT': '0.820', 'ARMOR': '0.829', 'weapon2': '1.344', 'weapon3': '1.466', 'DAMAGECOUNT': '3.039', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:20:30,626][2409103] DAMAGECOUNT value on done: 6306.0
[2023-02-25 13:20:30,627][2409103] Sum rewards: 7.750, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.434', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO5': '0.017', 'AMMO4': '0.078', 'AMMO3': '0.087', 'weapon7': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.218', 'WEAPON5': '0.400', 'HITCOUNT': '0.530', 'WEAPON3': '0.650', 'weapon4': '0.772', 'weapon2': '0.900', 'weapon3': '1.640', 'DAMAGECOUNT': '2.127', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:20:31,454][2409074] Updated weights for policy 0, policy_version 22731 (0.0012)
[2023-02-25 13:20:31,627][2409080] DAMAGECOUNT value on done: 7219.0
[2023-02-25 13:20:31,628][2409080] Sum rewards: 8.652, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.371', 'AMMO5': '0.015', 'AMMO2': '0.016', 'AMMO3': '0.061', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'weapon5': '0.158', 'WEAPON5': '0.300', 'weapon4': '0.322', 'ARMOR': '0.449', 'WEAPON3': '0.450', 'HITCOUNT': '0.750', 'weapon2': '1.100', 'weapon3': '1.444', 'DAMAGECOUNT': '2.280', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:20:31,647][2409468] DAMAGECOUNT value on done: 8402.0
[2023-02-25 13:20:31,649][2409468] Sum rewards: 20.150, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.278', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO3': '0.058', 'AMMO4': '0.067', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.160', 'WEAPON7': '0.200', 'weapon7': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'weapon2': '0.530', 'HITCOUNT': '0.930', 'weapon4': '1.032', 'weapon3': '1.064', 'DAMAGECOUNT': '4.341', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:20:32,186][2408954] Fps is (10 sec: 23756.9, 60 sec: 24166.4, 300 sec: 24173.3). Total num frames: 93122560. Throughput: 0: 6061.6. Samples: 23288580. Policy #0 lag: (min: 0.0, avg: 11.2, max: 24.0)
[2023-02-25 13:20:32,186][2408954] Avg episode reward: [(0, '11.437')]
[2023-02-25 13:20:32,487][2409102] DAMAGECOUNT value on done: 9089.0
[2023-02-25 13:20:32,487][2409102] Sum rewards: 14.479, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.515', 'AMMO2': '0.005', 'AMMO5': '0.015', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.118', 'weapon4': '0.126', 'weapon5': '0.210', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'ARMOR': '0.857', 'HITCOUNT': '1.110', 'weapon2': '1.424', 'weapon3': '1.892', 'DAMAGECOUNT': '4.560', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:20:32,894][2409074] Updated weights for policy 0, policy_version 22741 (0.0012)
[2023-02-25 13:20:32,899][2409100] DAMAGECOUNT value on done: 8031.0
[2023-02-25 13:20:32,900][2409100] Sum rewards: 9.515, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.608', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO5': '0.015', 'AMMO4': '0.068', 'weapon4': '0.078', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'weapon5': '0.164', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'HITCOUNT': '0.700', 'ARMOR': '1.285', 'weapon3': '1.402', 'weapon2': '2.152', 'DAMAGECOUNT': '2.730', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:20:33,283][2409101] DAMAGECOUNT value on done: 9410.0
[2023-02-25 13:20:33,287][2409101] Sum rewards: 14.726, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.027', 'AMMO2': '0.012', 'AMMO5': '0.027', 'AMMO4': '0.058', 'AMMO3': '0.119', 'WEAPON4': '0.150', 'weapon4': '0.182', 'ARMOR': '0.400', 'weapon5': '0.442', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'HITCOUNT': '0.870', 'weapon2': '0.994', 'weapon3': '1.994', 'DAMAGECOUNT': '4.605', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:20:34,153][2409549] DAMAGECOUNT value on done: 9249.0
[2023-02-25 13:20:34,154][2409549] Sum rewards: 6.590, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.758', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.023', 'AMMO5': '0.033', 'WEAPON4': '0.050', 'weapon4': '0.108', 'weapon5': '0.120', 'AMMO3': '0.145', 'ARMOR': '0.445', 'WEAPON5': '0.750', 'HITCOUNT': '0.870', 'WEAPON3': '0.900', 'weapon2': '1.242', 'weapon3': '2.262', 'DAMAGECOUNT': '3.126', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:20:34,214][2409103] DAMAGECOUNT value on done: 7194.0
[2023-02-25 13:20:34,215][2409103] Sum rewards: 9.195, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.936', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.012', 'AMMO3': '0.070', 'weapon7': '0.084', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.134', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.432', 'WEAPON3': '0.500', 'HITCOUNT': '0.710', 'weapon4': '0.756', 'weapon2': '1.112', 'weapon3': '1.348', 'DAMAGECOUNT': '2.670', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:20:34,886][2409074] Updated weights for policy 0, policy_version 22751 (0.0013)
[2023-02-25 13:20:35,976][2409080] DAMAGECOUNT value on done: 8996.0
[2023-02-25 13:20:35,978][2409080] Sum rewards: 17.137, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.202', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.107', 'AMMO4': '0.132', 'weapon4': '0.196', 'weapon5': '0.268', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '1.120', 'weapon2': '1.244', 'ARMOR': '1.409', 'weapon3': '1.954', 'DAMAGECOUNT': '4.800', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:20:36,005][2409468] DAMAGECOUNT value on done: 7577.0
[2023-02-25 13:20:36,007][2409468] Sum rewards: 8.335, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.655', 'AMMO2': '0.015', 'AMMO5': '0.022', 'weapon5': '0.070', 'AMMO4': '0.074', 'AMMO3': '0.139', 'WEAPON4': '0.150', 'weapon4': '0.446', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'ARMOR': '0.873', 'HITCOUNT': '0.950', 'weapon2': '0.990', 'weapon3': '1.502', 'DAMAGECOUNT': '3.159', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:20:36,516][2409074] Updated weights for policy 0, policy_version 22761 (0.0012)
[2023-02-25 13:20:36,539][2409100] DAMAGECOUNT value on done: 6920.0
[2023-02-25 13:20:36,543][2409100] Sum rewards: 11.830, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.304', 'AMMO2': '0.013', 'AMMO5': '0.015', 'AMMO3': '0.040', 'AMMO4': '0.065', 'weapon4': '0.072', 'WEAPON4': '0.100', 'weapon5': '0.114', 'WEAPON5': '0.200', 'WEAPON3': '0.300', 'HITCOUNT': '0.580', 'ARMOR': '0.851', 'weapon3': '0.930', 'weapon2': '2.368', 'DAMAGECOUNT': '2.736', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:20:36,670][2409102] DAMAGECOUNT value on done: 7950.0
[2023-02-25 13:20:36,671][2409102] Sum rewards: 8.623, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.956', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO5': '0.017', 'AMMO3': '0.070', 'weapon4': '0.182', 'WEAPON4': '0.200', 'weapon5': '0.268', 'WEAPON3': '0.450', 'WEAPON5': '0.450', 'ARMOR': '0.456', 'HITCOUNT': '0.940', 'weapon2': '1.472', 'weapon3': '1.610', 'DAMAGECOUNT': '3.444', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:20:36,794][2409096] Large shaping reward 2.584 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.552, 184.0), ('weapon5', 0.002)]
[2023-02-25 13:20:37,044][2409101] DAMAGECOUNT value on done: 9019.0
[2023-02-25 13:20:37,045][2409101] Sum rewards: 9.293, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.775', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.024', 'AMMO3': '0.107', 'weapon5': '0.116', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.254', 'WEAPON3': '0.750', 'HITCOUNT': '0.880', 'ARMOR': '1.302', 'weapon3': '1.564', 'weapon2': '1.674', 'DAMAGECOUNT': '3.384', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:20:37,186][2408954] Fps is (10 sec: 24166.4, 60 sec: 24166.4, 300 sec: 24187.2). Total num frames: 93241344. Throughput: 0: 6056.5. Samples: 23306604. Policy #0 lag: (min: 0.0, avg: 11.2, max: 24.0)
[2023-02-25 13:20:37,186][2408954] Avg episode reward: [(0, '11.377')]
[2023-02-25 13:20:37,312][2409033] Signal inference workers to stop experience collection... (2750 times)
[2023-02-25 13:20:37,324][2409033] Signal inference workers to resume experience collection... (2750 times)
[2023-02-25 13:20:37,338][2409074] InferenceWorker_p0-w0: stopping experience collection (2750 times)
[2023-02-25 13:20:37,351][2409074] InferenceWorker_p0-w0: resuming experience collection (2750 times)
[2023-02-25 13:20:37,911][2409549] DAMAGECOUNT value on done: 8677.0
[2023-02-25 13:20:37,922][2409549] Sum rewards: 10.099, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.048', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO3': '0.086', 'AMMO4': '0.145', 'weapon5': '0.160', 'weapon4': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.900', 'ARMOR': '1.242', 'weapon3': '1.584', 'weapon2': '1.596', 'DAMAGECOUNT': '3.867', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:20:38,186][2409103] DAMAGECOUNT value on done: 6839.0
[2023-02-25 13:20:38,187][2409103] Sum rewards: 6.538, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO3': '0.044', 'AMMO4': '0.053', 'HEALTH': '0.054', 'weapon7': '0.108', 'weapon5': '0.110', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.410', 'ARMOR': '0.536', 'weapon3': '0.690', 'weapon4': '0.810', 'DAMAGECOUNT': '1.770', 'weapon2': '2.092', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:20:38,285][2409074] Updated weights for policy 0, policy_version 22771 (0.0012)
[2023-02-25 13:20:39,800][2409074] Updated weights for policy 0, policy_version 22781 (0.0012)
[2023-02-25 13:20:40,183][2409080] DAMAGECOUNT value on done: 6455.0
[2023-02-25 13:20:40,186][2409080] Sum rewards: 8.158, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.940', 'AMMO2': '0.012', 'AMMO5': '0.020', 'AMMO4': '0.060', 'weapon5': '0.106', 'AMMO3': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.450', 'weapon4': '0.534', 'weapon2': '0.732', 'WEAPON3': '0.750', 'HITCOUNT': '1.010', 'weapon3': '1.782', 'DAMAGECOUNT': '3.078', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:20:40,239][2409468] DAMAGECOUNT value on done: 8573.0
[2023-02-25 13:20:40,240][2409468] Sum rewards: 24.117, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.666', 'AMMO5': '0.014', 'AMMO2': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'weapon5': '0.128', 'weapon4': '0.130', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'weapon2': '1.388', 'HITCOUNT': '1.420', 'weapon3': '1.982', 'DAMAGECOUNT': '5.541', 'FRAGCOUNT': '18.000'}
[2023-02-25 13:20:40,264][2409102] DAMAGECOUNT value on done: 9181.0
[2023-02-25 13:20:40,265][2409102] Sum rewards: 12.956, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.982', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'weapon7': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.101', 'weapon5': '0.318', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.770', 'ARMOR': '0.849', 'weapon3': '1.018', 'weapon2': '1.046', 'weapon4': '1.182', 'DAMAGECOUNT': '3.627', 'FRAGCOUNT': '9.500'}
[2023-02-25 13:20:40,797][2409100] DAMAGECOUNT value on done: 8014.0
[2023-02-25 13:20:40,798][2409100] Sum rewards: 10.547, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.115', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'weapon7': '0.048', 'AMMO3': '0.073', 'AMMO4': '0.083', 'weapon5': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon2': '0.512', 'HITCOUNT': '0.760', 'weapon4': '1.212', 'weapon3': '1.464', 'DAMAGECOUNT': '3.054', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:20:41,101][2409101] DAMAGECOUNT value on done: 7434.0
[2023-02-25 13:20:41,102][2409101] Sum rewards: 7.899, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.587', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.041', 'weapon7': '0.056', 'AMMO3': '0.065', 'weapon5': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO6': '0.260', 'AMMO7': '0.260', 'weapon4': '0.296', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.480', 'weapon3': '1.082', 'weapon2': '1.512', 'ARMOR': '1.833', 'DAMAGECOUNT': '2.079', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:20:41,727][2409074] Updated weights for policy 0, policy_version 22791 (0.0013)
[2023-02-25 13:20:41,750][2409549] DAMAGECOUNT value on done: 7636.0
[2023-02-25 13:20:41,753][2409549] Sum rewards: 12.714, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.487', 'AMMO5': '0.014', 'AMMO2': '0.031', 'AMMO3': '0.060', 'WEAPON1': '0.060', 'weapon7': '0.086', 'weapon5': '0.130', 'AMMO4': '0.156', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'weapon4': '0.614', 'HITCOUNT': '0.890', 'weapon3': '1.004', 'weapon2': '1.436', 'DAMAGECOUNT': '3.579', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:20:42,045][2409103] DAMAGECOUNT value on done: 7661.0
[2023-02-25 13:20:42,046][2409103] Sum rewards: 18.142, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.100', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon5': '0.050', 'AMMO3': '0.060', 'weapon7': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'WEAPON3': '0.450', 'weapon4': '0.516', 'HITCOUNT': '1.020', 'weapon2': '1.076', 'weapon3': '1.438', 'DAMAGECOUNT': '3.651', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:20:42,186][2408954] Fps is (10 sec: 24166.4, 60 sec: 24303.0, 300 sec: 24201.1). Total num frames: 93364224. Throughput: 0: 6040.8. Samples: 23342508. Policy #0 lag: (min: 0.0, avg: 11.2, max: 24.0)
[2023-02-25 13:20:42,186][2408954] Avg episode reward: [(0, '11.736')]
[2023-02-25 13:20:43,262][2409074] Updated weights for policy 0, policy_version 22801 (0.0012)
[2023-02-25 13:20:44,565][2409102] DAMAGECOUNT value on done: 8245.0
[2023-02-25 13:20:44,570][2409102] Sum rewards: 4.980, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.586', 'AMMO5': '0.014', 'AMMO2': '0.024', 'AMMO3': '0.045', 'weapon5': '0.070', 'weapon7': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.120', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'HITCOUNT': '0.360', 'weapon2': '0.556', 'weapon3': '0.656', 'ARMOR': '0.800', 'weapon4': '1.274', 'DAMAGECOUNT': '1.815', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:20:44,633][2409468] DAMAGECOUNT value on done: 7718.0
[2023-02-25 13:20:44,634][2409468] Sum rewards: 20.017, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.011', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.020', 'weapon4': '0.022', 'WEAPON4': '0.050', 'AMMO3': '0.073', 'weapon5': '0.174', 'WEAPON5': '0.400', 'ARMOR': '0.452', 'WEAPON3': '0.550', 'HITCOUNT': '1.120', 'weapon2': '1.504', 'weapon3': '1.524', 'DAMAGECOUNT': '5.397', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:20:44,770][2409100] DAMAGECOUNT value on done: 7952.0
[2023-02-25 13:20:44,771][2409100] Sum rewards: 14.058, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.112', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.056', 'weapon7': '0.060', 'AMMO3': '0.069', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'ARMOR': '0.411', 'WEAPON3': '0.550', 'HITCOUNT': '0.920', 'weapon3': '1.230', 'weapon2': '1.962', 'DAMAGECOUNT': '2.979', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:20:44,995][2409074] Updated weights for policy 0, policy_version 22811 (0.0013)
[2023-02-25 13:20:45,147][2409101] DAMAGECOUNT value on done: 9272.0
[2023-02-25 13:20:45,147][2409101] Sum rewards: 22.797, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.961', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO3': '0.078', 'weapon4': '0.086', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'weapon5': '0.324', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '1.340', 'weapon2': '1.394', 'weapon3': '1.504', 'DAMAGECOUNT': '5.520', 'FRAGCOUNT': '17.000'}
[2023-02-25 13:20:45,761][2409549] DAMAGECOUNT value on done: 7151.0
[2023-02-25 13:20:45,761][2409549] Sum rewards: 13.909, reward structure: {'DEATHCOUNT': '-0.750', 'HEALTH': '-0.221', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'AMMO3': '0.020', 'WEAPON4': '0.100', 'weapon5': '0.100', 'weapon7': '0.164', 'WEAPON5': '0.200', 'WEAPON3': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.376', 'WEAPON7': '0.400', 'HITCOUNT': '0.450', 'weapon2': '0.462', 'weapon3': '0.464', 'ARMOR': '0.925', 'DAMAGECOUNT': '2.565', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:20:45,966][2409103] DAMAGECOUNT value on done: 7618.0
[2023-02-25 13:20:45,968][2409103] Sum rewards: 13.859, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.013', 'AMMO5': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.081', 'weapon5': '0.116', 'weapon4': '0.140', 'HEALTH': '0.209', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.930', 'weapon2': '1.208', 'weapon3': '1.882', 'DAMAGECOUNT': '3.900', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:20:46,520][2409074] Updated weights for policy 0, policy_version 22821 (0.0012)
[2023-02-25 13:20:47,186][2408954] Fps is (10 sec: 24576.1, 60 sec: 24302.9, 300 sec: 24159.5). Total num frames: 93487104. Throughput: 0: 6053.9. Samples: 23379000. Policy #0 lag: (min: 0.0, avg: 14.7, max: 27.0)
[2023-02-25 13:20:47,186][2408954] Avg episode reward: [(0, '12.128')]
[2023-02-25 13:20:47,193][2409033] Saving new best policy, reward=12.128!
[2023-02-25 13:20:47,475][2409485] DAMAGECOUNT value on done: 7696.0
[2023-02-25 13:20:47,478][2409485] Sum rewards: 5.496, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.618', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'AMMO5': '0.029', 'weapon4': '0.030', 'AMMO3': '0.123', 'AMMO4': '0.136', 'WEAPON4': '0.200', 'weapon5': '0.274', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'HITCOUNT': '0.840', 'ARMOR': '0.857', 'weapon2': '1.068', 'weapon3': '2.176', 'DAMAGECOUNT': '3.294', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:20:48,405][2409074] Updated weights for policy 0, policy_version 22831 (0.0012)
[2023-02-25 13:20:48,659][2409100] DAMAGECOUNT value on done: 9197.0
[2023-02-25 13:20:48,662][2409100] Sum rewards: 18.441, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.412', 'AMMO5': '0.022', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'AMMO3': '0.098', 'AMMO4': '0.122', 'WEAPON4': '0.200', 'weapon5': '0.324', 'weapon4': '0.380', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'ARMOR': '0.804', 'weapon2': '0.836', 'HITCOUNT': '1.120', 'weapon3': '1.890', 'DAMAGECOUNT': '4.701', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:20:48,786][2409468] DAMAGECOUNT value on done: 7724.0
[2023-02-25 13:20:48,786][2409468] Sum rewards: 8.817, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.184', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'weapon7': '0.060', 'AMMO4': '0.061', 'AMMO3': '0.075', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.110', 'WEAPON5': '0.200', 'WEAPON3': '0.400', 'HITCOUNT': '0.440', 'weapon4': '0.836', 'ARMOR': '0.871', 'weapon3': '0.916', 'weapon2': '1.442', 'DAMAGECOUNT': '2.457', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:20:48,926][2409101] DAMAGECOUNT value on done: 8761.0
[2023-02-25 13:20:48,927][2409101] Sum rewards: 14.972, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.854', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon7': '0.050', 'AMMO3': '0.085', 'AMMO4': '0.111', 'weapon5': '0.134', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.418', 'WEAPON3': '0.600', 'ARMOR': '0.896', 'HITCOUNT': '1.130', 'weapon3': '1.476', 'weapon2': '1.560', 'DAMAGECOUNT': '4.071', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:20:48,951][2409102] DAMAGECOUNT value on done: 8317.0
[2023-02-25 13:20:48,954][2409102] Sum rewards: 9.739, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.566', 'weapon5': '0.008', 'AMMO2': '0.013', 'AMMO5': '0.015', 'AMMO4': '0.064', 'weapon7': '0.090', 'AMMO3': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'weapon4': '0.782', 'weapon2': '0.794', 'HITCOUNT': '0.840', 'ARMOR': '0.898', 'weapon3': '1.436', 'DAMAGECOUNT': '3.516', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:20:49,536][2409549] DAMAGECOUNT value on done: 8381.0
[2023-02-25 13:20:49,539][2409549] Sum rewards: 17.223, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.249', 'AMMO2': '0.015', 'AMMO5': '0.028', 'WEAPON1': '0.030', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'weapon4': '0.120', 'AMMO3': '0.126', 'weapon5': '0.258', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'ARMOR': '0.800', 'weapon2': '0.848', 'HITCOUNT': '1.120', 'weapon3': '2.304', 'DAMAGECOUNT': '5.001', 'FRAGCOUNT': '13.500'}
[2023-02-25 13:20:49,877][2409103] DAMAGECOUNT value on done: 8450.0
[2023-02-25 13:20:49,879][2409103] Sum rewards: 14.147, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.466', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.012', 'AMMO4': '0.062', 'weapon7': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'weapon5': '0.170', 'WEAPON5': '0.200', 'weapon4': '0.272', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.750', 'HITCOUNT': '0.910', 'weapon2': '1.270', 'ARMOR': '1.310', 'weapon3': '1.536', 'DAMAGECOUNT': '4.140', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:20:50,227][2409074] Updated weights for policy 0, policy_version 22841 (0.0013)
[2023-02-25 13:20:51,444][2409485] DAMAGECOUNT value on done: 9604.0
[2023-02-25 13:20:51,449][2409485] Sum rewards: 14.560, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.453', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.046', 'AMMO3': '0.070', 'WEAPON4': '0.150', 'weapon5': '0.184', 'WEAPON5': '0.250', 'weapon4': '0.490', 'ARMOR': '0.491', 'WEAPON3': '0.500', 'HITCOUNT': '0.910', 'weapon2': '1.288', 'weapon3': '1.556', 'DAMAGECOUNT': '4.308', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:20:51,601][2409074] Updated weights for policy 0, policy_version 22851 (0.0013)
[2023-02-25 13:20:52,186][2408954] Fps is (10 sec: 24166.3, 60 sec: 24371.2, 300 sec: 24145.6). Total num frames: 93605888. Throughput: 0: 6043.2. Samples: 23396856. Policy #0 lag: (min: 0.0, avg: 14.7, max: 27.0)
[2023-02-25 13:20:52,186][2408954] Avg episode reward: [(0, '12.186')]
[2023-02-25 13:20:52,187][2409033] Saving new best policy, reward=12.186!
[2023-02-25 13:20:52,615][2409101] DAMAGECOUNT value on done: 7155.0
[2023-02-25 13:20:52,619][2409101] Sum rewards: 8.322, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.017', 'AMMO2': '0.019', 'HEALTH': '0.076', 'AMMO3': '0.077', 'AMMO4': '0.092', 'weapon7': '0.170', 'weapon5': '0.198', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.448', 'WEAPON3': '0.450', 'HITCOUNT': '0.810', 'weapon2': '1.012', 'weapon3': '1.366', 'DAMAGECOUNT': '3.186', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:20:52,756][2409468] DAMAGECOUNT value on done: 7283.0
[2023-02-25 13:20:52,759][2409468] Sum rewards: 14.172, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.105', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO3': '0.030', 'AMMO4': '0.050', 'weapon5': '0.064', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.200', 'weapon7': '0.232', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON7': '0.500', 'HITCOUNT': '0.600', 'weapon2': '0.670', 'weapon3': '0.756', 'weapon4': '1.260', 'DAMAGECOUNT': '3.222', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:20:52,772][2409100] DAMAGECOUNT value on done: 8156.0
[2023-02-25 13:20:52,776][2409100] Sum rewards: 20.498, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.795', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.087', 'weapon4': '0.196', 'WEAPON5': '0.200', 'weapon5': '0.248', 'ARMOR': '0.453', 'WEAPON3': '0.600', 'HITCOUNT': '1.100', 'weapon2': '1.322', 'weapon3': '1.838', 'DAMAGECOUNT': '5.100', 'FRAGCOUNT': '16.000'}
[2023-02-25 13:20:52,961][2409102] DAMAGECOUNT value on done: 8220.0
[2023-02-25 13:20:52,964][2409102] Sum rewards: 20.534, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.129', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.071', 'weapon5': '0.138', 'WEAPON5': '0.200', 'WEAPON3': '0.600', 'ARMOR': '0.880', 'HITCOUNT': '1.120', 'weapon3': '1.650', 'weapon2': '1.790', 'DAMAGECOUNT': '4.740', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:20:53,229][2409549] DAMAGECOUNT value on done: 6714.0
[2023-02-25 13:20:53,232][2409549] Sum rewards: 8.065, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.950', 'AMMO2': '0.003', 'AMMO4': '0.017', 'AMMO5': '0.017', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.182', 'weapon5': '0.276', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.580', 'ARMOR': '0.900', 'weapon3': '1.318', 'weapon2': '1.696', 'DAMAGECOUNT': '2.325', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:20:53,713][2409074] Updated weights for policy 0, policy_version 22861 (0.0012)
[2023-02-25 13:20:54,150][2409103] DAMAGECOUNT value on done: 8397.0
[2023-02-25 13:20:54,151][2409103] Sum rewards: 9.230, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.310', 'AMMO5': '0.015', 'AMMO2': '0.022', 'weapon7': '0.054', 'AMMO4': '0.109', 'AMMO3': '0.113', 'weapon5': '0.148', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.492', 'WEAPON3': '0.750', 'weapon2': '0.838', 'ARMOR': '0.913', 'HITCOUNT': '1.110', 'weapon3': '1.866', 'DAMAGECOUNT': '3.840', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:20:55,060][2409074] Updated weights for policy 0, policy_version 22871 (0.0012)
[2023-02-25 13:20:55,134][2409548] DAMAGECOUNT value on done: 7836.0
[2023-02-25 13:20:55,137][2409548] Sum rewards: 9.695, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.428', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.039', 'weapon7': '0.048', 'AMMO3': '0.059', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.262', 'WEAPON5': '0.300', 'ARMOR': '0.443', 'WEAPON3': '0.450', 'HITCOUNT': '0.500', 'weapon4': '0.576', 'weapon3': '0.944', 'weapon2': '0.960', 'DAMAGECOUNT': '2.619', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:20:55,802][2409485] DAMAGECOUNT value on done: 6356.0
[2023-02-25 13:20:55,804][2409485] Sum rewards: 11.474, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.054', 'AMMO5': '0.022', 'AMMO2': '0.030', 'weapon7': '0.058', 'AMMO3': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.148', 'weapon5': '0.180', 'WEAPON7': '0.200', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon2': '0.634', 'WEAPON3': '0.650', 'HITCOUNT': '0.780', 'weapon4': '0.892', 'ARMOR': '0.905', 'weapon3': '1.662', 'DAMAGECOUNT': '3.870', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:20:56,498][2409100] DAMAGECOUNT value on done: 7802.0
[2023-02-25 13:20:56,502][2409100] Sum rewards: 13.954, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.480', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'weapon4': '0.070', 'AMMO3': '0.095', 'weapon5': '0.218', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'HITCOUNT': '0.900', 'weapon2': '1.202', 'weapon3': '2.122', 'DAMAGECOUNT': '4.233', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:20:56,574][2409101] DAMAGECOUNT value on done: 6634.0
[2023-02-25 13:20:56,577][2409101] Sum rewards: 17.386, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.124', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.021', 'weapon7': '0.076', 'AMMO3': '0.085', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.350', 'weapon5': '0.356', 'WEAPON3': '0.500', 'weapon4': '0.602', 'HITCOUNT': '0.900', 'weapon2': '1.042', 'weapon3': '1.470', 'DAMAGECOUNT': '4.530', 'FRAGCOUNT': '11.500'}
[2023-02-25 13:20:56,767][2409102] DAMAGECOUNT value on done: 8769.0
[2023-02-25 13:20:56,768][2409102] Sum rewards: 9.944, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.340', 'AMMO2': '0.018', 'AMMO5': '0.028', 'weapon7': '0.050', 'AMMO4': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.127', 'weapon5': '0.160', 'WEAPON4': '0.350', 'weapon4': '0.470', 'WEAPON5': '0.550', 'ARMOR': '0.889', 'WEAPON3': '0.950', 'HITCOUNT': '0.970', 'weapon2': '1.108', 'weapon3': '1.874', 'DAMAGECOUNT': '3.849', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:20:56,815][2409565] DAMAGECOUNT value on done: 8595.0
[2023-02-25 13:20:56,819][2409565] Sum rewards: 11.256, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.727', 'AMMO5': '0.017', 'AMMO2': '0.023', 'AMMO3': '0.101', 'AMMO4': '0.114', 'weapon5': '0.124', 'weapon7': '0.124', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.880', 'weapon2': '0.898', 'weapon4': '1.028', 'weapon3': '1.300', 'DAMAGECOUNT': '3.534', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:20:56,930][2409074] Updated weights for policy 0, policy_version 22881 (0.0013)
[2023-02-25 13:20:56,933][2409468] DAMAGECOUNT value on done: 7282.0
[2023-02-25 13:20:56,935][2409468] Sum rewards: 12.662, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.182', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'weapon4': '0.024', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon5': '0.252', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '0.840', 'ARMOR': '1.287', 'weapon3': '1.518', 'weapon2': '1.646', 'DAMAGECOUNT': '3.858', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:20:57,162][2409549] DAMAGECOUNT value on done: 6640.0
[2023-02-25 13:20:57,165][2409549] Sum rewards: 6.104, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.660', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'AMMO3': '0.030', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.138', 'weapon5': '0.214', 'WEAPON4': '0.250', 'WEAPON3': '0.300', 'WEAPON5': '0.400', 'HITCOUNT': '0.430', 'weapon4': '0.516', 'weapon3': '0.820', 'DAMAGECOUNT': '1.392', 'weapon2': '1.866', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:20:57,186][2408954] Fps is (10 sec: 23756.7, 60 sec: 23961.6, 300 sec: 24131.7). Total num frames: 93724672. Throughput: 0: 6039.5. Samples: 23433180. Policy #0 lag: (min: 0.0, avg: 14.7, max: 27.0)
[2023-02-25 13:20:57,186][2408954] Avg episode reward: [(0, '12.302')]
[2023-02-25 13:20:57,192][2409033] Saving new best policy, reward=12.302!
[2023-02-25 13:20:57,595][2409597] DAMAGECOUNT value on done: 7855.0
[2023-02-25 13:20:57,596][2409597] Sum rewards: 9.265, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.743', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.070', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'weapon4': '0.118', 'weapon7': '0.144', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'HITCOUNT': '0.720', 'ARMOR': '0.800', 'weapon3': '1.344', 'weapon2': '2.130', 'DAMAGECOUNT': '2.826', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:20:58,447][2409074] Updated weights for policy 0, policy_version 22891 (0.0013)
[2023-02-25 13:20:58,467][2409103] DAMAGECOUNT value on done: 7091.0
[2023-02-25 13:20:58,468][2409103] Sum rewards: 9.910, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.616', 'AMMO5': '0.028', 'AMMO2': '0.041', 'AMMO3': '0.055', 'weapon5': '0.142', 'weapon4': '0.154', 'AMMO4': '0.207', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'WEAPON5': '0.450', 'HITCOUNT': '0.640', 'weapon3': '1.222', 'ARMOR': '1.239', 'weapon2': '1.830', 'DAMAGECOUNT': '3.117', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:20:59,046][2409548] DAMAGECOUNT value on done: 7252.0
[2023-02-25 13:20:59,050][2409548] Sum rewards: 13.149, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.411', 'AMMO2': '0.007', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'AMMO3': '0.097', 'weapon5': '0.232', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'weapon4': '0.460', 'WEAPON3': '0.650', 'HITCOUNT': '0.910', 'weapon2': '1.102', 'weapon3': '1.758', 'DAMAGECOUNT': '4.272', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:20:59,951][2409485] DAMAGECOUNT value on done: 8417.0
[2023-02-25 13:20:59,953][2409485] Sum rewards: 8.345, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.941', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO3': '0.064', 'weapon5': '0.118', 'weapon7': '0.126', 'AMMO4': '0.131', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'ARMOR': '0.453', 'WEAPON3': '0.500', 'HITCOUNT': '0.660', 'weapon2': '0.738', 'weapon4': '1.042', 'weapon3': '1.374', 'DAMAGECOUNT': '2.856', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:21:00,143][2409074] Updated weights for policy 0, policy_version 22901 (0.0012)
[2023-02-25 13:21:00,360][2409102] DAMAGECOUNT value on done: 7553.0
[2023-02-25 13:21:00,361][2409102] Sum rewards: 9.212, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.290', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.052', 'AMMO3': '0.077', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon7': '0.286', 'AMMO6': '0.340', 'AMMO7': '0.340', 'ARMOR': '0.453', 'WEAPON7': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.590', 'weapon3': '0.830', 'weapon2': '1.064', 'weapon4': '1.252', 'DAMAGECOUNT': '2.706', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:21:00,407][2409100] DAMAGECOUNT value on done: 8137.0
[2023-02-25 13:21:00,417][2409100] Sum rewards: 9.372, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.027', 'AMMO2': '0.005', 'AMMO5': '0.015', 'ARMOR': '0.020', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'AMMO3': '0.097', 'weapon5': '0.112', 'weapon4': '0.162', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.550', 'weapon3': '1.570', 'weapon2': '1.978', 'DAMAGECOUNT': '2.163', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:21:00,451][2409565] DAMAGECOUNT value on done: 7859.0
[2023-02-25 13:21:00,454][2409565] Sum rewards: 10.518, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.637', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.055', 'AMMO3': '0.060', 'weapon7': '0.066', 'WEAPON4': '0.100', 'weapon5': '0.146', 'weapon4': '0.196', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.660', 'ARMOR': '0.882', 'weapon3': '1.398', 'weapon2': '1.804', 'DAMAGECOUNT': '2.619', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:21:00,888][2409101] DAMAGECOUNT value on done: 6325.0
[2023-02-25 13:21:00,889][2409101] Sum rewards: 6.740, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.635', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.043', 'AMMO3': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.224', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.456', 'HITCOUNT': '0.550', 'weapon4': '0.594', 'weapon2': '1.012', 'weapon3': '1.338', 'DAMAGECOUNT': '2.025', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:21:01,099][2409468] DAMAGECOUNT value on done: 7865.0
[2023-02-25 13:21:01,101][2409468] Sum rewards: 13.457, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.126', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO3': '0.105', 'AMMO4': '0.135', 'weapon5': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.512', 'WEAPON3': '0.750', 'ARMOR': '0.851', 'weapon2': '0.918', 'HITCOUNT': '1.030', 'weapon3': '1.918', 'DAMAGECOUNT': '3.774', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:21:01,415][2409549] DAMAGECOUNT value on done: 8974.0
[2023-02-25 13:21:01,416][2409549] Sum rewards: 10.772, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.025', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.028', 'AMMO3': '0.062', 'WEAPON4': '0.100', 'weapon7': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.142', 'weapon4': '0.162', 'weapon5': '0.188', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.650', 'weapon2': '1.070', 'weapon3': '1.656', 'DAMAGECOUNT': '3.057', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:21:02,008][2409074] Updated weights for policy 0, policy_version 22911 (0.0012)
[2023-02-25 13:21:02,186][2408954] Fps is (10 sec: 24166.4, 60 sec: 24166.4, 300 sec: 24173.4). Total num frames: 93847552. Throughput: 0: 6038.4. Samples: 23469300. Policy #0 lag: (min: 1.0, avg: 11.9, max: 23.0)
[2023-02-25 13:21:02,186][2408954] Avg episode reward: [(0, '12.085')]
[2023-02-25 13:21:02,437][2409597] DAMAGECOUNT value on done: 9957.0
[2023-02-25 13:21:02,438][2409597] Sum rewards: 15.735, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.138', 'AMMO2': '0.021', 'AMMO5': '0.022', 'AMMO3': '0.054', 'AMMO4': '0.103', 'WEAPON4': '0.250', 'weapon5': '0.378', 'WEAPON3': '0.400', 'weapon4': '0.438', 'WEAPON5': '0.450', 'HITCOUNT': '0.690', 'weapon3': '1.140', 'weapon2': '1.338', 'ARMOR': '2.151', 'DAMAGECOUNT': '4.437', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:21:02,886][2409103] DAMAGECOUNT value on done: 7557.0
[2023-02-25 13:21:02,887][2409103] Sum rewards: 12.498, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.100', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO3': '0.081', 'AMMO4': '0.151', 'weapon7': '0.206', 'weapon5': '0.224', 'WEAPON4': '0.350', 'AMMO6': '0.360', 'AMMO7': '0.360', 'WEAPON5': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.600', 'weapon4': '0.712', 'HITCOUNT': '0.770', 'weapon2': '1.032', 'weapon3': '1.490', 'DAMAGECOUNT': '3.906', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:21:03,295][2409548] DAMAGECOUNT value on done: 8323.0
[2023-02-25 13:21:03,296][2409548] Sum rewards: 5.946, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.244', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.020', 'weapon4': '0.060', 'AMMO3': '0.091', 'WEAPON4': '0.150', 'weapon5': '0.170', 'HITCOUNT': '0.540', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'weapon3': '1.388', 'weapon2': '1.698', 'DAMAGECOUNT': '1.830', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:21:03,674][2409074] Updated weights for policy 0, policy_version 22921 (0.0012)
[2023-02-25 13:21:03,919][2409102] DAMAGECOUNT value on done: 8449.0
[2023-02-25 13:21:03,922][2409102] Sum rewards: 6.867, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.075', 'AMMO5': '0.004', 'AMMO2': '0.008', 'AMMO3': '0.025', 'AMMO4': '0.041', 'weapon5': '0.046', 'WEAPON5': '0.100', 'HITCOUNT': '0.120', 'weapon7': '0.142', 'WEAPON4': '0.150', 'WEAPON3': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon2': '0.244', 'WEAPON7': '0.300', 'weapon3': '0.362', 'DAMAGECOUNT': '1.056', 'weapon4': '2.204', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:21:04,043][2409565] DAMAGECOUNT value on done: 7993.0
[2023-02-25 13:21:04,044][2409565] Sum rewards: 8.794, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.798', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.003', 'weapon5': '0.048', 'weapon7': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON3': '0.500', 'HITCOUNT': '0.700', 'weapon4': '0.850', 'weapon3': '1.036', 'weapon2': '1.724', 'DAMAGECOUNT': '2.712', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:21:04,676][2409100] DAMAGECOUNT value on done: 7641.0
[2023-02-25 13:21:04,677][2409100] Sum rewards: 7.242, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.490', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.034', 'AMMO3': '0.093', 'AMMO4': '0.168', 'weapon4': '0.210', 'weapon5': '0.342', 'WEAPON4': '0.350', 'WEAPON5': '0.600', 'HITCOUNT': '0.610', 'WEAPON3': '0.650', 'weapon2': '1.146', 'weapon3': '1.756', 'DAMAGECOUNT': '2.481', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:21:04,885][2409485] DAMAGECOUNT value on done: 8720.0
[2023-02-25 13:21:04,886][2409485] Sum rewards: 12.455, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.017', 'AMMO5': '0.017', 'AMMO3': '0.060', 'HEALTH': '0.078', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'weapon5': '0.266', 'weapon4': '0.318', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'HITCOUNT': '0.810', 'ARMOR': '0.841', 'weapon2': '1.190', 'weapon3': '1.476', 'DAMAGECOUNT': '2.895', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:21:04,987][2409101] DAMAGECOUNT value on done: 10225.0
[2023-02-25 13:21:04,988][2409101] Sum rewards: 10.739, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.105', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.007', 'AMMO3': '0.030', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.152', 'weapon7': '0.168', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.250', 'WEAPON7': '0.400', 'weapon4': '0.466', 'HITCOUNT': '0.570', 'weapon2': '0.644', 'weapon3': '0.730', 'DAMAGECOUNT': '2.217', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:21:05,498][2409549] DAMAGECOUNT value on done: 9179.0
[2023-02-25 13:21:05,502][2409549] Sum rewards: 6.744, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.356', 'AMMO5': '0.003', 'AMMO3': '0.020', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.102', 'WEAPON3': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'weapon3': '0.544', 'weapon2': '0.622', 'ARMOR': '0.957', 'DAMAGECOUNT': '1.119', 'weapon4': '1.704', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:21:05,546][2409074] Updated weights for policy 0, policy_version 22931 (0.0012)
[2023-02-25 13:21:06,044][2409597] DAMAGECOUNT value on done: 6686.0
[2023-02-25 13:21:06,044][2409597] Sum rewards: 9.550, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.562', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.019', 'weapon5': '0.058', 'AMMO3': '0.078', 'AMMO4': '0.097', 'weapon7': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.580', 'weapon4': '0.642', 'weapon2': '1.318', 'weapon3': '1.436', 'DAMAGECOUNT': '2.211', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:21:07,028][2409548] DAMAGECOUNT value on done: 7963.0
[2023-02-25 13:21:07,032][2409548] Sum rewards: 22.080, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.014', 'AMMO2': '0.024', 'AMMO3': '0.081', 'AMMO4': '0.118', 'weapon7': '0.150', 'weapon5': '0.156', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HEALTH': '0.344', 'weapon4': '0.344', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'ARMOR': '0.800', 'HITCOUNT': '0.890', 'weapon3': '1.404', 'weapon2': '1.490', 'DAMAGECOUNT': '5.565', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:21:07,106][2409549] Large shaping reward 2.640 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200)]
[2023-02-25 13:21:07,155][2409103] DAMAGECOUNT value on done: 8601.0
[2023-02-25 13:21:07,186][2408954] Fps is (10 sec: 23756.9, 60 sec: 24234.7, 300 sec: 24145.6). Total num frames: 93962240. Throughput: 0: 6020.0. Samples: 23486868. Policy #0 lag: (min: 1.0, avg: 11.9, max: 23.0)
[2023-02-25 13:21:07,186][2408954] Avg episode reward: [(0, '12.102')]
[2023-02-25 13:21:07,188][2409103] Sum rewards: 13.049, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.060', 'AMMO4': '0.096', 'HEALTH': '0.120', 'WEAPON4': '0.150', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'weapon4': '0.530', 'HITCOUNT': '0.830', 'weapon2': '1.014', 'weapon3': '1.246', 'DAMAGECOUNT': '3.327', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:21:07,219][2409074] Updated weights for policy 0, policy_version 22941 (0.0012)
[2023-02-25 13:21:07,591][2409102] DAMAGECOUNT value on done: 8666.0
[2023-02-25 13:21:07,592][2409102] Sum rewards: 6.048, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.848', 'AMMO5': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.075', 'weapon5': '0.086', 'AMMO4': '0.128', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'HITCOUNT': '0.500', 'weapon4': '0.510', 'WEAPON3': '0.550', 'weapon2': '0.890', 'ARMOR': '0.940', 'weapon3': '1.524', 'DAMAGECOUNT': '1.947', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:21:07,742][2409565] DAMAGECOUNT value on done: 8914.0
[2023-02-25 13:21:07,743][2409565] Sum rewards: 18.901, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.032', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO5': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.095', 'weapon4': '0.236', 'weapon5': '0.238', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'ARMOR': '0.950', 'HITCOUNT': '1.060', 'weapon2': '1.092', 'weapon3': '1.932', 'DAMAGECOUNT': '4.923', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:21:07,907][2409406] Large shaping reward 2.593 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.561, 187.0), ('weapon5', 0.002)]
[2023-02-25 13:21:08,236][2409100] DAMAGECOUNT value on done: 8856.0
[2023-02-25 13:21:08,237][2409100] Sum rewards: 10.266, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.485', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO5': '0.033', 'weapon5': '0.054', 'weapon7': '0.058', 'AMMO4': '0.077', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'ARMOR': '0.454', 'WEAPON5': '0.550', 'weapon4': '0.710', 'HITCOUNT': '0.730', 'weapon2': '0.746', 'WEAPON3': '0.800', 'weapon3': '1.674', 'DAMAGECOUNT': '3.024', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:21:08,700][2409101] DAMAGECOUNT value on done: 7828.0
[2023-02-25 13:21:08,703][2409101] Sum rewards: 11.530, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.981', 'AMMO2': '0.016', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'weapon5': '0.066', 'AMMO4': '0.080', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.102', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.460', 'weapon4': '0.550', 'WEAPON3': '0.700', 'weapon2': '0.908', 'HITCOUNT': '0.990', 'weapon3': '1.648', 'DAMAGECOUNT': '3.741', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:21:08,715][2409074] Updated weights for policy 0, policy_version 22951 (0.0012)
[2023-02-25 13:21:08,919][2409485] DAMAGECOUNT value on done: 9060.0
[2023-02-25 13:21:08,928][2409485] Sum rewards: 9.321, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.459', 'AMMO2': '0.017', 'AMMO5': '0.025', 'weapon4': '0.034', 'AMMO3': '0.082', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'weapon5': '0.308', 'WEAPON5': '0.450', 'HITCOUNT': '0.470', 'ARMOR': '0.485', 'WEAPON3': '0.500', 'weapon2': '1.276', 'weapon3': '1.828', 'DAMAGECOUNT': '2.868', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:21:09,179][2409549] DAMAGECOUNT value on done: 8977.0
[2023-02-25 13:21:09,180][2409549] Sum rewards: 11.631, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.305', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'AMMO3': '0.050', 'weapon5': '0.176', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'HITCOUNT': '0.710', 'weapon3': '1.228', 'weapon2': '1.678', 'DAMAGECOUNT': '2.601', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:21:10,264][2409074] Updated weights for policy 0, policy_version 22961 (0.0014)
[2023-02-25 13:21:10,658][2409548] DAMAGECOUNT value on done: 9289.0
[2023-02-25 13:21:10,659][2409548] Sum rewards: 14.495, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.330', 'AMMO5': '0.016', 'AMMO2': '0.019', 'weapon4': '0.036', 'AMMO3': '0.070', 'AMMO4': '0.094', 'WEAPON4': '0.250', 'weapon5': '0.258', 'ARMOR': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '1.040', 'weapon3': '1.460', 'weapon2': '1.714', 'DAMAGECOUNT': '4.818', 'FRAGCOUNT': '10.500'}
[2023-02-25 13:21:11,083][2409597] DAMAGECOUNT value on done: 8664.0
[2023-02-25 13:21:11,084][2409597] Sum rewards: 12.857, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.752', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO5': '0.015', 'weapon7': '0.058', 'WEAPON4': '0.100', 'weapon5': '0.100', 'AMMO3': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.268', 'WEAPON5': '0.400', 'ARMOR': '0.448', 'WEAPON3': '0.850', 'HITCOUNT': '1.110', 'weapon2': '1.410', 'weapon3': '1.804', 'DAMAGECOUNT': '4.794', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:21:11,134][2409103] DAMAGECOUNT value on done: 8840.0
[2023-02-25 13:21:11,137][2409103] Sum rewards: 17.831, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.814', 'AMMO5': '0.019', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'weapon7': '0.084', 'AMMO4': '0.099', 'AMMO3': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.218', 'ARMOR': '0.400', 'weapon4': '0.466', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'weapon2': '0.700', 'HITCOUNT': '1.150', 'weapon3': '1.900', 'DAMAGECOUNT': '4.608', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:21:11,188][2409549] Large shaping reward 3.642 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:21:11,193][2409102] DAMAGECOUNT value on done: 8951.0
[2023-02-25 13:21:11,194][2409102] Sum rewards: 14.046, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.886', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.012', 'weapon7': '0.014', 'AMMO3': '0.060', 'weapon5': '0.108', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.308', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.780', 'weapon3': '1.504', 'weapon2': '1.542', 'DAMAGECOUNT': '3.069', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:21:11,476][2409866] DAMAGECOUNT value on done: 6357.0
[2023-02-25 13:21:11,480][2409866] Sum rewards: 11.033, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.151', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'WEAPON4': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.083', 'weapon4': '0.090', 'weapon5': '0.168', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.730', 'ARMOR': '0.853', 'weapon2': '1.242', 'weapon3': '1.578', 'DAMAGECOUNT': '3.507', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:21:11,487][2409565] DAMAGECOUNT value on done: 9831.0
[2023-02-25 13:21:11,490][2409565] Sum rewards: 19.030, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.359', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.005', 'WEAPON5': '0.050', 'AMMO3': '0.051', 'weapon5': '0.092', 'weapon7': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'ARMOR': '0.457', 'HITCOUNT': '1.150', 'weapon3': '1.348', 'weapon2': '1.532', 'DAMAGECOUNT': '4.770', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:21:11,715][2409074] Updated weights for policy 0, policy_version 22971 (0.0013)
[2023-02-25 13:21:11,857][2409100] DAMAGECOUNT value on done: 8117.0
[2023-02-25 13:21:11,859][2409100] Sum rewards: 19.664, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.025', 'AMMO5': '0.020', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'weapon7': '0.048', 'weapon5': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.128', 'AMMO3': '0.129', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.560', 'weapon4': '0.620', 'WEAPON3': '0.850', 'HITCOUNT': '1.280', 'weapon3': '2.166', 'DAMAGECOUNT': '5.160', 'FRAGCOUNT': '16.000'}
[2023-02-25 13:21:12,186][2408954] Fps is (10 sec: 24575.4, 60 sec: 24234.7, 300 sec: 24173.3). Total num frames: 94093312. Throughput: 0: 6040.2. Samples: 23523984. Policy #0 lag: (min: 1.0, avg: 11.9, max: 23.0)
[2023-02-25 13:21:12,187][2408954] Avg episode reward: [(0, '12.304')]
[2023-02-25 13:21:12,187][2409033] Saving new best policy, reward=12.304!
[2023-02-25 13:21:12,686][2409407] DAMAGECOUNT value on done: 8433.0
[2023-02-25 13:21:12,686][2409407] Sum rewards: 16.647, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.778', 'AMMO2': '0.005', 'AMMO5': '0.014', 'AMMO4': '0.026', 'weapon7': '0.070', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.202', 'WEAPON3': '0.600', 'ARMOR': '0.850', 'HITCOUNT': '1.240', 'weapon2': '1.334', 'weapon3': '1.506', 'DAMAGECOUNT': '3.864', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:21:12,693][2409485] DAMAGECOUNT value on done: 7148.0
[2023-02-25 13:21:12,696][2409485] Sum rewards: 13.224, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.664', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon5': '0.166', 'weapon4': '0.202', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'ARMOR': '0.856', 'HITCOUNT': '0.870', 'weapon2': '1.560', 'weapon3': '1.696', 'DAMAGECOUNT': '3.678', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:21:12,818][2409101] DAMAGECOUNT value on done: 7807.0
[2023-02-25 13:21:12,822][2409101] Sum rewards: 12.186, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.700', 'AMMO5': '0.005', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.025', 'AMMO3': '0.069', 'WEAPON4': '0.100', 'weapon5': '0.136', 'WEAPON5': '0.150', 'weapon4': '0.296', 'WEAPON3': '0.500', 'HITCOUNT': '1.010', 'weapon3': '1.272', 'weapon2': '1.784', 'DAMAGECOUNT': '3.774', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:21:13,307][2409549] DAMAGECOUNT value on done: 9301.0
[2023-02-25 13:21:13,310][2409549] Sum rewards: 13.496, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.396', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.019', 'AMMO3': '0.040', 'WEAPON4': '0.100', 'weapon7': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.182', 'weapon4': '0.186', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'ARMOR': '0.462', 'HITCOUNT': '0.930', 'weapon3': '0.960', 'weapon2': '1.928', 'DAMAGECOUNT': '3.117', 'FRAGCOUNT': '8.500'}
[2023-02-25 13:21:13,672][2409596] DAMAGECOUNT value on done: 9577.0
[2023-02-25 13:21:13,673][2409596] Sum rewards: 17.233, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.596', 'AMMO2': '0.006', 'AMMO4': '0.027', 'AMMO5': '0.029', 'WEAPON4': '0.050', 'AMMO3': '0.100', 'weapon5': '0.216', 'weapon4': '0.264', 'WEAPON5': '0.650', 'WEAPON3': '0.750', 'weapon2': '0.832', 'HITCOUNT': '1.160', 'ARMOR': '1.309', 'weapon3': '2.076', 'DAMAGECOUNT': '4.110', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:21:13,820][2409105] DAMAGECOUNT value on done: 7325.0
[2023-02-25 13:21:13,823][2409105] Sum rewards: 13.674, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.392', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO5': '0.029', 'AMMO3': '0.083', 'AMMO4': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon7': '0.110', 'weapon5': '0.270', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'WEAPON5': '0.550', 'HITCOUNT': '0.670', 'weapon4': '0.748', 'weapon2': '0.756', 'weapon3': '1.460', 'DAMAGECOUNT': '2.967', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:21:13,908][2409074] Updated weights for policy 0, policy_version 22981 (0.0012)
[2023-02-25 13:21:14,320][2409565] Large shaping reward 2.640 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200)]
[2023-02-25 13:21:14,438][2409548] DAMAGECOUNT value on done: 8876.0
[2023-02-25 13:21:14,439][2409548] Sum rewards: 19.440, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.561', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'AMMO4': '0.053', 'weapon7': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.178', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.900', 'weapon4': '0.984', 'weapon3': '1.170', 'weapon2': '1.344', 'DAMAGECOUNT': '4.431', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:21:14,510][2409405] DAMAGECOUNT value on done: 8790.0
[2023-02-25 13:21:14,511][2409405] Sum rewards: 12.137, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.270', 'AMMO5': '0.016', 'AMMO2': '0.026', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'AMMO4': '0.131', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.244', 'weapon5': '0.296', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'ARMOR': '0.900', 'HITCOUNT': '0.920', 'weapon2': '1.472', 'weapon3': '1.548', 'DAMAGECOUNT': '3.483', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:21:14,738][2409597] DAMAGECOUNT value on done: 8913.0
[2023-02-25 13:21:14,739][2409597] Sum rewards: 9.251, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.530', 'AMMO5': '0.015', 'AMMO2': '0.030', 'ARMOR': '0.032', 'AMMO3': '0.096', 'AMMO4': '0.151', 'weapon5': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'weapon4': '0.658', 'HITCOUNT': '0.730', 'weapon2': '0.846', 'weapon3': '1.738', 'DAMAGECOUNT': '2.547', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:21:14,749][2409103] DAMAGECOUNT value on done: 7701.0
[2023-02-25 13:21:14,752][2409103] Sum rewards: 18.210, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.960', 'AMMO2': '0.019', 'AMMO5': '0.025', 'WEAPON1': '0.030', 'weapon7': '0.076', 'AMMO4': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.132', 'weapon5': '0.190', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.484', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'weapon2': '1.000', 'HITCOUNT': '1.300', 'weapon3': '1.772', 'DAMAGECOUNT': '5.355', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:21:15,105][2409074] Updated weights for policy 0, policy_version 22991 (0.0012)
[2023-02-25 13:21:15,288][2409102] DAMAGECOUNT value on done: 7341.0
[2023-02-25 13:21:15,289][2409102] Sum rewards: 7.201, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.095', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO4': '0.116', 'AMMO3': '0.119', 'weapon7': '0.134', 'weapon5': '0.142', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '0.750', 'ARMOR': '0.920', 'HITCOUNT': '0.920', 'weapon2': '0.940', 'weapon4': '1.060', 'weapon3': '1.330', 'DAMAGECOUNT': '3.564', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:21:15,353][2409355] DAMAGECOUNT value on done: 7753.0
[2023-02-25 13:21:15,354][2409355] Sum rewards: 11.218, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.255', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.005', 'AMMO3': '0.040', 'weapon5': '0.074', 'weapon7': '0.102', 'WEAPON5': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'WEAPON7': '0.400', 'HITCOUNT': '0.760', 'weapon2': '0.912', 'weapon3': '0.986', 'weapon4': '1.276', 'DAMAGECOUNT': '2.886', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:21:15,463][2409866] DAMAGECOUNT value on done: 8934.0
[2023-02-25 13:21:15,464][2409866] Sum rewards: 15.339, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.445', 'AMMO2': '0.015', 'AMMO5': '0.019', 'AMMO3': '0.062', 'AMMO4': '0.076', 'weapon5': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.370', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.662', 'HITCOUNT': '1.020', 'weapon3': '1.430', 'DAMAGECOUNT': '4.251', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:21:15,505][2409547] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)]
[2023-02-25 13:21:15,525][2409565] DAMAGECOUNT value on done: 9444.0
[2023-02-25 13:21:15,526][2409565] Sum rewards: 13.007, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO3': '0.043', 'WEAPON4': '0.050', 'AMMO4': '0.097', 'weapon5': '0.114', 'HEALTH': '0.174', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon7': '0.274', 'WEAPON3': '0.300', 'HITCOUNT': '0.530', 'weapon4': '0.560', 'ARMOR': '0.800', 'weapon3': '0.896', 'weapon2': '1.812', 'DAMAGECOUNT': '2.718', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:21:16,337][2409100] DAMAGECOUNT value on done: 9096.0
[2023-02-25 13:21:16,340][2409100] Sum rewards: 23.146, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.374', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'AMMO4': '0.089', 'AMMO3': '0.119', 'WEAPON4': '0.250', 'weapon5': '0.344', 'weapon4': '0.468', 'WEAPON5': '0.600', 'weapon2': '0.688', 'WEAPON3': '0.850', 'ARMOR': '0.896', 'HITCOUNT': '1.210', 'weapon3': '1.964', 'DAMAGECOUNT': '5.730', 'FRAGCOUNT': '18.000'}
[2023-02-25 13:21:16,364][2409485] DAMAGECOUNT value on done: 8804.0
[2023-02-25 13:21:16,365][2409485] Sum rewards: 19.880, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.183', 'AMMO2': '0.004', 'AMMO5': '0.017', 'AMMO4': '0.020', 'AMMO3': '0.075', 'weapon5': '0.194', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'ARMOR': '0.800', 'HITCOUNT': '0.860', 'weapon3': '1.590', 'weapon2': '1.916', 'DAMAGECOUNT': '4.686', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:21:16,732][2409407] DAMAGECOUNT value on done: 9502.0
[2023-02-25 13:21:16,733][2409407] Sum rewards: 8.630, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.224', 'AMMO2': '0.009', 'AMMO5': '0.032', 'AMMO4': '0.042', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon5': '0.176', 'weapon4': '0.376', 'ARMOR': '0.458', 'WEAPON5': '0.650', 'HITCOUNT': '0.780', 'weapon2': '0.806', 'WEAPON3': '0.850', 'weapon3': '1.994', 'DAMAGECOUNT': '3.474', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:21:16,783][2409101] DAMAGECOUNT value on done: 9162.0
[2023-02-25 13:21:16,786][2409101] Sum rewards: 13.640, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.040', 'AMMO4': '-0.066', 'AMMO2': '-0.013', 'AMMO5': '0.010', 'AMMO3': '0.091', 'weapon5': '0.156', 'WEAPON5': '0.300', 'ARMOR': '0.438', 'WEAPON3': '0.600', 'HITCOUNT': '0.790', 'weapon2': '1.606', 'weapon3': '1.608', 'DAMAGECOUNT': '3.660', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:21:17,109][2409074] Updated weights for policy 0, policy_version 23001 (0.0012)
[2023-02-25 13:21:17,186][2408954] Fps is (10 sec: 25395.1, 60 sec: 24234.7, 300 sec: 24145.6). Total num frames: 94216192. Throughput: 0: 6058.1. Samples: 23561196. Policy #0 lag: (min: 0.0, avg: 13.1, max: 24.0)
[2023-02-25 13:21:17,186][2408954] Avg episode reward: [(0, '12.539')]
[2023-02-25 13:21:17,191][2409033] Saving new best policy, reward=12.539!
[2023-02-25 13:21:17,220][2409549] DAMAGECOUNT value on done: 8718.0
[2023-02-25 13:21:17,221][2409549] Sum rewards: 12.006, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.101', 'AMMO2': '0.003', 'AMMO5': '0.014', 'AMMO4': '0.016', 'AMMO3': '0.061', 'weapon5': '0.158', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.851', 'HITCOUNT': '0.880', 'weapon3': '1.466', 'weapon2': '1.856', 'DAMAGECOUNT': '3.801', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:21:17,492][2409596] DAMAGECOUNT value on done: 7203.0
[2023-02-25 13:21:17,493][2409596] Sum rewards: 11.631, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO3': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'HEALTH': '0.080', 'weapon5': '0.172', 'WEAPON5': '0.200', 'WEAPON3': '0.250', 'weapon4': '0.252', 'HITCOUNT': '0.650', 'weapon3': '0.992', 'weapon2': '1.370', 'DAMAGECOUNT': '2.727', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:21:17,613][2409105] DAMAGECOUNT value on done: 9246.0
[2023-02-25 13:21:17,623][2409105] Sum rewards: 20.498, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.620', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.037', 'weapon7': '0.046', 'AMMO3': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.168', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'ARMOR': '0.500', 'weapon4': '0.854', 'weapon2': '0.898', 'HITCOUNT': '0.950', 'weapon3': '1.234', 'DAMAGECOUNT': '5.175', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:21:18,319][2409103] DAMAGECOUNT value on done: 8104.0
[2023-02-25 13:21:18,320][2409103] Sum rewards: 17.529, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.556', 'AMMO2': '0.016', 'AMMO5': '0.017', 'AMMO4': '0.081', 'AMMO3': '0.090', 'weapon5': '0.094', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.254', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'ARMOR': '0.815', 'HITCOUNT': '0.910', 'weapon2': '1.322', 'weapon3': '1.708', 'DAMAGECOUNT': '3.927', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:21:18,462][2409074] Updated weights for policy 0, policy_version 23011 (0.0012)
[2023-02-25 13:21:18,463][2409405] DAMAGECOUNT value on done: 6835.0
[2023-02-25 13:21:18,464][2409405] Sum rewards: 13.441, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.596', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.037', 'weapon7': '0.050', 'AMMO4': '0.053', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.120', 'WEAPON4': '0.200', 'weapon5': '0.226', 'weapon4': '0.432', 'WEAPON5': '0.750', 'ARMOR': '0.845', 'WEAPON3': '0.850', 'weapon2': '0.926', 'HITCOUNT': '1.240', 'weapon3': '1.834', 'DAMAGECOUNT': '4.653', 'FRAGCOUNT': '11.500'}
[2023-02-25 13:21:18,890][2409597] DAMAGECOUNT value on done: 9194.0
[2023-02-25 13:21:18,895][2409597] Sum rewards: 17.385, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.011', 'AMMO5': '0.015', 'weapon7': '0.048', 'AMMO4': '0.053', 'AMMO3': '0.083', 'HEALTH': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.300', 'weapon5': '0.338', 'weapon4': '0.374', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.800', 'weapon2': '1.208', 'weapon3': '1.704', 'DAMAGECOUNT': '4.305', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:21:18,963][2409102] DAMAGECOUNT value on done: 8605.0
[2023-02-25 13:21:18,966][2409102] Sum rewards: 10.449, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.610', 'AMMO2': '0.021', 'AMMO5': '0.023', 'AMMO3': '0.089', 'AMMO4': '0.103', 'weapon4': '0.144', 'WEAPON4': '0.250', 'weapon5': '0.260', 'ARMOR': '0.420', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'HITCOUNT': '0.860', 'weapon2': '1.316', 'weapon3': '1.818', 'DAMAGECOUNT': '3.855', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:21:19,245][2409565] DAMAGECOUNT value on done: 7231.0
[2023-02-25 13:21:19,248][2409565] Sum rewards: 13.334, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.143', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.040', 'AMMO3': '0.050', 'WEAPON4': '0.200', 'weapon5': '0.338', 'WEAPON3': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.456', 'HITCOUNT': '0.510', 'ARMOR': '0.938', 'weapon3': '1.304', 'weapon2': '1.462', 'DAMAGECOUNT': '2.805', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:21:19,746][2409548] DAMAGECOUNT value on done: 8679.0
[2023-02-25 13:21:19,749][2409548] Sum rewards: 12.493, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.104', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.010', 'weapon7': '0.050', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.160', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'ARMOR': '0.451', 'WEAPON3': '0.550', 'HITCOUNT': '0.740', 'weapon4': '0.872', 'weapon3': '1.262', 'weapon2': '1.394', 'DAMAGECOUNT': '2.901', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:21:19,924][2409389] DAMAGECOUNT value on done: 7681.0
[2023-02-25 13:21:19,928][2409355] DAMAGECOUNT value on done: 6866.0
[2023-02-25 13:21:19,926][2409389] Sum rewards: 7.877, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.436', 'AMMO5': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.114', 'AMMO4': '0.146', 'weapon5': '0.174', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon4': '0.820', 'HITCOUNT': '0.840', 'weapon2': '1.272', 'weapon3': '1.326', 'DAMAGECOUNT': '3.342', 'FRAGCOUNT': '6.500'}
[2023-02-25 13:21:19,929][2409355] Sum rewards: 13.048, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.050', 'AMMO2': '0.016', 'AMMO5': '0.027', 'AMMO3': '0.077', 'AMMO4': '0.081', 'weapon7': '0.124', 'WEAPON4': '0.150', 'weapon4': '0.204', 'weapon5': '0.236', 'AMMO6': '0.400', 'WEAPON7': '0.400', 'AMMO7': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.710', 'weapon3': '1.248', 'ARMOR': '1.254', 'weapon2': '1.628', 'DAMAGECOUNT': '3.042', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:21:19,971][2409485] DAMAGECOUNT value on done: 7924.0
[2023-02-25 13:21:19,972][2409485] Sum rewards: 10.925, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.530', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.019', 'weapon7': '0.068', 'AMMO3': '0.071', 'WEAPON4': '0.150', 'weapon5': '0.278', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.540', 'weapon4': '0.626', 'weapon2': '0.774', 'ARMOR': '1.304', 'weapon3': '1.378', 'DAMAGECOUNT': '2.628', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:21:20,043][2409866] DAMAGECOUNT value on done: 9392.0
[2023-02-25 13:21:20,043][2409866] Sum rewards: 17.245, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.715', 'weapon7': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO3': '0.072', 'AMMO4': '0.091', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.465', 'WEAPON3': '0.550', 'weapon4': '0.578', 'weapon2': '0.806', 'HITCOUNT': '0.940', 'weapon3': '1.590', 'DAMAGECOUNT': '4.149', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:21:20,136][2409074] Updated weights for policy 0, policy_version 23021 (0.0012)
[2023-02-25 13:21:20,745][2409096] Large shaping reward 2.566 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.534, 178.0), ('weapon7', 0.002)]
[2023-02-25 13:21:20,746][2409407] DAMAGECOUNT value on done: 10301.0
[2023-02-25 13:21:20,749][2409407] Sum rewards: 18.687, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.020', 'AMMO2': '0.042', 'AMMO3': '0.092', 'weapon7': '0.140', 'weapon5': '0.158', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'AMMO4': '0.211', 'weapon4': '0.302', 'HEALTH': '0.372', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'weapon2': '0.926', 'HITCOUNT': '0.930', 'weapon3': '1.582', 'DAMAGECOUNT': '4.962', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:21:20,804][2409077] DAMAGECOUNT value on done: 9749.0
[2023-02-25 13:21:20,805][2409077] Sum rewards: 13.818, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.104', 'HEALTH': '0.252', 'WEAPON3': '0.350', 'ARMOR': '0.800', 'HITCOUNT': '0.830', 'weapon3': '1.158', 'weapon2': '1.886', 'DAMAGECOUNT': '3.276', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:21:20,833][2409101] DAMAGECOUNT value on done: 9601.0
[2023-02-25 13:21:20,834][2409101] Sum rewards: 15.026, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.450', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO5': '0.032', 'AMMO4': '0.092', 'AMMO3': '0.097', 'weapon5': '0.238', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon2': '0.468', 'WEAPON5': '0.600', 'weapon4': '0.614', 'WEAPON3': '0.750', 'HITCOUNT': '1.210', 'weapon3': '1.986', 'DAMAGECOUNT': '4.449', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:21:20,939][2409100] DAMAGECOUNT value on done: 8108.0
[2023-02-25 13:21:20,959][2409100] Sum rewards: 10.770, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.002', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon7': '0.048', 'AMMO4': '0.049', 'AMMO3': '0.069', 'WEAPON5': '0.100', 'weapon5': '0.140', 'WEAPON4': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.404', 'WEAPON3': '0.500', 'HITCOUNT': '0.670', 'ARMOR': '0.831', 'weapon3': '1.256', 'weapon2': '1.510', 'DAMAGECOUNT': '3.507', 'FRAGCOUNT': '6.500'}
[2023-02-25 13:21:21,230][2409406] DAMAGECOUNT value on done: 7052.0
[2023-02-25 13:21:21,231][2409406] Sum rewards: 10.229, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO5': '0.005', 'AMMO2': '0.015', 'HEALTH': '0.040', 'AMMO3': '0.043', 'weapon7': '0.060', 'AMMO4': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.112', 'WEAPON5': '0.150', 'WEAPON3': '0.300', 'HITCOUNT': '0.420', 'ARMOR': '0.725', 'weapon3': '0.986', 'weapon2': '1.284', 'DAMAGECOUNT': '1.965', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:21:21,277][2409549] DAMAGECOUNT value on done: 9134.0
[2023-02-25 13:21:21,278][2409549] Sum rewards: 6.947, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.849', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.016', 'AMMO3': '0.056', 'weapon7': '0.082', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.136', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.386', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.620', 'weapon3': '1.078', 'weapon2': '1.428', 'DAMAGECOUNT': '1.995', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:21:21,440][2409596] DAMAGECOUNT value on done: 7172.0
[2023-02-25 13:21:21,443][2409596] Sum rewards: 10.150, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.694', 'AMMO2': '0.018', 'AMMO5': '0.025', 'AMMO4': '0.091', 'AMMO3': '0.138', 'weapon5': '0.156', 'WEAPON4': '0.300', 'ARMOR': '0.462', 'weapon4': '0.482', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'HITCOUNT': '1.030', 'weapon2': '1.214', 'weapon3': '1.520', 'DAMAGECOUNT': '3.558', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:21:21,681][2409105] DAMAGECOUNT value on done: 9102.0
[2023-02-25 13:21:21,682][2409105] Sum rewards: 17.970, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.017', 'AMMO5': '0.020', 'AMMO3': '0.078', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'HEALTH': '0.210', 'weapon4': '0.234', 'weapon5': '0.250', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.920', 'weapon2': '1.408', 'weapon3': '1.430', 'ARMOR': '1.704', 'DAMAGECOUNT': '3.867', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:21:21,940][2409103] DAMAGECOUNT value on done: 9167.0
[2023-02-25 13:21:21,944][2409103] Sum rewards: 11.594, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.230', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon7': '0.052', 'AMMO3': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.143', 'WEAPON4': '0.150', 'weapon4': '0.190', 'WEAPON7': '0.200', 'weapon5': '0.254', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.760', 'weapon2': '1.396', 'weapon3': '1.716', 'DAMAGECOUNT': '3.546', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:21:22,033][2409074] Updated weights for policy 0, policy_version 23031 (0.0012)
[2023-02-25 13:21:22,186][2408954] Fps is (10 sec: 24575.8, 60 sec: 24234.6, 300 sec: 24173.3). Total num frames: 94339072. Throughput: 0: 6073.6. Samples: 23579916. Policy #0 lag: (min: 0.0, avg: 13.1, max: 24.0)
[2023-02-25 13:21:22,187][2408954] Avg episode reward: [(0, '12.870')]
[2023-02-25 13:21:22,188][2409033] Saving new best policy, reward=12.870!
[2023-02-25 13:21:22,351][2409405] DAMAGECOUNT value on done: 7031.0
[2023-02-25 13:21:22,352][2409405] Sum rewards: 8.082, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.062', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.067', 'AMMO3': '0.097', 'weapon5': '0.126', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.350', 'ARMOR': '0.449', 'WEAPON3': '0.650', 'HITCOUNT': '0.990', 'weapon2': '1.286', 'weapon3': '1.614', 'DAMAGECOUNT': '4.089', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:21:22,565][2409597] DAMAGECOUNT value on done: 9136.0
[2023-02-25 13:21:22,566][2409597] Sum rewards: 10.151, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.766', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'weapon5': '0.216', 'weapon4': '0.222', 'ARMOR': '0.472', 'WEAPON5': '0.500', 'HITCOUNT': '0.750', 'weapon2': '0.804', 'WEAPON3': '0.900', 'weapon3': '1.900', 'DAMAGECOUNT': '3.630', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:21:22,687][2409102] DAMAGECOUNT value on done: 7663.0
[2023-02-25 13:21:22,687][2409102] Sum rewards: 11.371, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.756', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO5': '0.022', 'AMMO3': '0.081', 'weapon5': '0.102', 'weapon7': '0.128', 'WEAPON4': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.476', 'WEAPON3': '0.600', 'weapon2': '0.664', 'HITCOUNT': '0.900', 'ARMOR': '1.296', 'weapon3': '1.602', 'DAMAGECOUNT': '3.507', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:21:22,970][2409565] DAMAGECOUNT value on done: 8840.0
[2023-02-25 13:21:22,973][2409565] Sum rewards: 16.888, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.498', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO3': '0.045', 'AMMO4': '0.046', 'weapon7': '0.122', 'WEAPON4': '0.200', 'weapon5': '0.222', 'AMMO6': '0.280', 'AMMO7': '0.280', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'WEAPON7': '0.400', 'HITCOUNT': '0.750', 'ARMOR': '0.895', 'weapon3': '0.916', 'weapon4': '1.044', 'weapon2': '1.238', 'DAMAGECOUNT': '3.528', 'FRAGCOUNT': '10.500'}
[2023-02-25 13:21:23,595][2409355] DAMAGECOUNT value on done: 9013.0
[2023-02-25 13:21:23,599][2409355] Sum rewards: 8.048, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.004', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.091', 'weapon5': '0.338', 'ARMOR': '0.436', 'WEAPON5': '0.500', 'HITCOUNT': '0.590', 'WEAPON3': '0.700', 'weapon2': '1.216', 'weapon3': '1.584', 'DAMAGECOUNT': '2.853', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:21:23,601][2409074] Updated weights for policy 0, policy_version 23041 (0.0012)
[2023-02-25 13:21:23,633][2409485] DAMAGECOUNT value on done: 8139.0
[2023-02-25 13:21:23,638][2409485] Sum rewards: 7.355, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.988', 'AMMO2': '0.017', 'AMMO5': '0.028', 'weapon7': '0.048', 'AMMO4': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.129', 'weapon5': '0.186', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.550', 'WEAPON5': '0.600', 'weapon2': '0.730', 'WEAPON3': '0.750', 'weapon4': '1.078', 'ARMOR': '1.410', 'weapon3': '1.620', 'DAMAGECOUNT': '2.625', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:21:23,696][2409389] DAMAGECOUNT value on done: 6460.0
[2023-02-25 13:21:23,702][2409866] DAMAGECOUNT value on done: 8307.0
[2023-02-25 13:21:23,702][2409389] Sum rewards: 7.569, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.638', 'AMMO2': '0.011', 'AMMO5': '0.012', 'weapon5': '0.022', 'AMMO4': '0.054', 'AMMO3': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.104', 'weapon7': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'HITCOUNT': '0.540', 'WEAPON3': '0.550', 'ARMOR': '0.851', 'weapon3': '1.510', 'weapon2': '1.936', 'DAMAGECOUNT': '2.706', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:21:23,703][2409866] Sum rewards: 5.463, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.230', 'AMMO5': '0.015', 'weapon5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'weapon7': '0.048', 'AMMO3': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.147', 'WEAPON4': '0.250', 'weapon2': '0.276', 'WEAPON5': '0.300', 'HITCOUNT': '0.300', 'WEAPON3': '0.500', 'weapon3': '0.812', 'DAMAGECOUNT': '1.479', 'weapon4': '1.630', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:21:23,849][2409548] DAMAGECOUNT value on done: 9444.0
[2023-02-25 13:21:23,850][2409548] Sum rewards: 12.629, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.650', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO3': '0.040', 'AMMO4': '0.049', 'weapon7': '0.106', 'weapon5': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.300', 'WEAPON7': '0.300', 'ARMOR': '0.462', 'HITCOUNT': '0.580', 'weapon4': '0.762', 'weapon3': '0.800', 'weapon2': '0.888', 'DAMAGECOUNT': '3.861', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:21:24,429][2409101] DAMAGECOUNT value on done: 7706.0
[2023-02-25 13:21:24,431][2409101] Sum rewards: 10.209, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.262', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'AMMO5': '0.007', 'weapon7': '0.048', 'AMMO3': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.124', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.450', 'ARMOR': '0.489', 'HITCOUNT': '0.670', 'weapon4': '1.014', 'weapon2': '1.180', 'weapon3': '1.208', 'DAMAGECOUNT': '2.190', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:21:24,466][2409407] DAMAGECOUNT value on done: 7955.0
[2023-02-25 13:21:24,469][2409407] Sum rewards: 14.819, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.380', 'AMMO2': '0.021', 'AMMO3': '0.070', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'WEAPON3': '0.450', 'weapon4': '0.738', 'HITCOUNT': '0.930', 'ARMOR': '0.932', 'weapon3': '1.160', 'weapon2': '1.394', 'DAMAGECOUNT': '3.123', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:21:24,857][2409549] DAMAGECOUNT value on done: 8577.0
[2023-02-25 13:21:24,858][2409549] Sum rewards: 16.713, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.320', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'weapon5': '0.056', 'weapon7': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.104', 'WEAPON4': '0.150', 'weapon4': '0.308', 'WEAPON3': '0.650', 'HITCOUNT': '1.110', 'ARMOR': '1.240', 'weapon3': '1.458', 'weapon2': '1.772', 'DAMAGECOUNT': '4.188', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:21:24,996][2409100] DAMAGECOUNT value on done: 7933.0
[2023-02-25 13:21:25,000][2409100] Sum rewards: 20.270, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.855', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.023', 'AMMO3': '0.077', 'weapon7': '0.136', 'WEAPON4': '0.200', 'weapon4': '0.292', 'weapon5': '0.296', 'WEAPON5': '0.400', 'ARMOR': '0.450', 'AMMO6': '0.460', 'AMMO7': '0.460', 'WEAPON7': '0.500', 'WEAPON3': '0.550', 'weapon2': '0.902', 'HITCOUNT': '0.980', 'weapon3': '1.568', 'DAMAGECOUNT': '4.803', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:21:25,162][2409077] DAMAGECOUNT value on done: 7399.0
[2023-02-25 13:21:25,163][2409077] Sum rewards: 10.277, reward structure: {'DEATHCOUNT': '-4.500', 'weapon7': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.071', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'HEALTH': '0.230', 'weapon5': '0.246', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.740', 'weapon2': '1.634', 'weapon3': '1.694', 'DAMAGECOUNT': '3.000', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:21:25,253][2409074] Updated weights for policy 0, policy_version 23051 (0.0012)
[2023-02-25 13:21:25,374][2409105] DAMAGECOUNT value on done: 7547.0
[2023-02-25 13:21:25,375][2409105] Sum rewards: 12.036, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.655', 'AMMO2': '0.007', 'AMMO5': '0.017', 'AMMO4': '0.034', 'AMMO3': '0.040', 'weapon7': '0.072', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'HITCOUNT': '0.840', 'ARMOR': '0.930', 'weapon4': '0.940', 'weapon3': '0.984', 'weapon2': '1.320', 'DAMAGECOUNT': '3.705', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:21:25,543][2409406] DAMAGECOUNT value on done: 9357.0
[2023-02-25 13:21:25,544][2409406] Sum rewards: 21.780, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.001', 'AMMO2': '0.004', 'AMMO5': '0.017', 'AMMO4': '0.020', 'weapon7': '0.072', 'AMMO3': '0.073', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon5': '0.384', 'WEAPON3': '0.550', 'weapon2': '0.642', 'weapon4': '0.902', 'ARMOR': '0.906', 'HITCOUNT': '1.150', 'weapon3': '1.450', 'DAMAGECOUNT': '4.770', 'FRAGCOUNT': '16.000'}
[2023-02-25 13:21:25,587][2409103] DAMAGECOUNT value on done: 7415.0
[2023-02-25 13:21:25,588][2409103] Sum rewards: 17.076, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.020', 'weapon7': '0.022', 'AMMO2': '0.043', 'weapon5': '0.086', 'AMMO3': '0.096', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon4': '0.714', 'weapon2': '0.800', 'HEALTH': '0.866', 'HITCOUNT': '1.240', 'weapon3': '1.742', 'DAMAGECOUNT': '4.230', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:21:25,603][2409373] DAMAGECOUNT value on done: 8109.0
[2023-02-25 13:21:25,604][2409373] Sum rewards: 13.959, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.465', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon5': '0.064', 'AMMO3': '0.087', 'AMMO4': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.354', 'WEAPON3': '0.550', 'weapon2': '0.758', 'HITCOUNT': '1.030', 'ARMOR': '1.271', 'weapon3': '1.478', 'DAMAGECOUNT': '3.735', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:21:25,701][2409596] DAMAGECOUNT value on done: 8097.0
[2023-02-25 13:21:25,702][2409596] Sum rewards: 11.574, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.744', 'AMMO2': '0.011', 'AMMO5': '0.017', 'weapon7': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.122', 'weapon5': '0.166', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.780', 'ARMOR': '1.238', 'weapon3': '1.550', 'weapon2': '1.712', 'DAMAGECOUNT': '3.147', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:21:26,215][2409405] DAMAGECOUNT value on done: 7382.0
[2023-02-25 13:21:26,218][2409405] Sum rewards: 11.970, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.465', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.017', 'AMMO3': '0.068', 'WEAPON4': '0.200', 'weapon5': '0.314', 'WEAPON5': '0.400', 'weapon4': '0.458', 'WEAPON3': '0.550', 'ARMOR': '0.909', 'HITCOUNT': '0.940', 'weapon2': '1.060', 'weapon3': '1.264', 'DAMAGECOUNT': '3.507', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:21:26,291][2409102] DAMAGECOUNT value on done: 7487.0
[2023-02-25 13:21:26,295][2409102] Sum rewards: 11.830, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.962', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO5': '0.010', 'AMMO3': '0.058', 'WEAPON4': '0.100', 'weapon5': '0.116', 'WEAPON5': '0.300', 'weapon4': '0.324', 'WEAPON3': '0.450', 'HITCOUNT': '0.720', 'ARMOR': '0.955', 'weapon3': '1.148', 'weapon2': '1.364', 'DAMAGECOUNT': '2.790', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:21:26,444][2409597] DAMAGECOUNT value on done: 7053.0
[2023-02-25 13:21:26,445][2409597] Sum rewards: 9.835, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.556', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.025', 'AMMO3': '0.091', 'weapon5': '0.130', 'ARMOR': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'HITCOUNT': '0.780', 'weapon2': '1.220', 'weapon3': '2.206', 'DAMAGECOUNT': '3.075', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:21:26,627][2409565] DAMAGECOUNT value on done: 7743.0
[2023-02-25 13:21:26,630][2409565] Sum rewards: 6.168, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO3': '0.089', 'weapon5': '0.130', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'HEALTH': '0.224', 'WEAPON5': '0.250', 'weapon4': '0.364', 'ARMOR': '0.416', 'WEAPON3': '0.500', 'HITCOUNT': '0.590', 'weapon3': '1.532', 'weapon2': '1.636', 'DAMAGECOUNT': '2.025', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:21:26,805][2409074] Updated weights for policy 0, policy_version 23061 (0.0012)
[2023-02-25 13:21:26,877][2409104] DAMAGECOUNT value on done: 9520.0
[2023-02-25 13:21:26,878][2409104] Sum rewards: 14.599, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.826', 'AMMO2': '0.018', 'AMMO5': '0.027', 'weapon7': '0.048', 'AMMO4': '0.087', 'AMMO3': '0.142', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon5': '0.346', 'weapon4': '0.448', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'weapon2': '1.076', 'HITCOUNT': '1.160', 'ARMOR': '1.200', 'weapon3': '1.648', 'DAMAGECOUNT': '6.204', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:21:27,186][2408954] Fps is (10 sec: 24985.7, 60 sec: 24439.5, 300 sec: 24201.1). Total num frames: 94466048. Throughput: 0: 6104.5. Samples: 23617212. Policy #0 lag: (min: 0.0, avg: 13.1, max: 24.0)
[2023-02-25 13:21:27,187][2408954] Avg episode reward: [(0, '12.565')]
[2023-02-25 13:21:27,242][2409485] DAMAGECOUNT value on done: 7195.0
[2023-02-25 13:21:27,245][2409485] Sum rewards: 11.859, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.670', 'AMMO5': '0.020', 'AMMO2': '0.040', 'AMMO3': '0.096', 'weapon7': '0.146', 'AMMO4': '0.198', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.232', 'WEAPON7': '0.300', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.730', 'ARMOR': '0.800', 'weapon4': '0.968', 'weapon3': '1.030', 'weapon2': '1.042', 'DAMAGECOUNT': '3.786', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:21:27,644][2409548] DAMAGECOUNT value on done: 7093.0
[2023-02-25 13:21:27,659][2409548] Sum rewards: 11.435, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.213', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.017', 'weapon7': '0.074', 'AMMO3': '0.093', 'weapon5': '0.094', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'ARMOR': '0.486', 'WEAPON3': '0.700', 'weapon4': '0.758', 'HITCOUNT': '0.770', 'weapon2': '1.056', 'weapon3': '1.588', 'DAMAGECOUNT': '2.358', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:21:27,835][2409389] DAMAGECOUNT value on done: 8970.0
[2023-02-25 13:21:27,838][2409389] Sum rewards: 13.952, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.586', 'AMMO2': '0.007', 'AMMO5': '0.022', 'AMMO4': '0.032', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'weapon5': '0.192', 'weapon4': '0.224', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'ARMOR': '0.852', 'HITCOUNT': '1.030', 'weapon2': '1.170', 'weapon3': '1.590', 'DAMAGECOUNT': '4.230', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:21:27,926][2409355] DAMAGECOUNT value on done: 6973.0
[2023-02-25 13:21:27,929][2409355] Sum rewards: 12.829, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.054', 'weapon5': '0.058', 'weapon7': '0.082', 'AMMO4': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'WEAPON3': '0.300', 'HITCOUNT': '0.670', 'HEALTH': '0.775', 'weapon3': '1.092', 'weapon4': '1.244', 'weapon2': '1.248', 'DAMAGECOUNT': '3.177', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:21:28,018][2409866] DAMAGECOUNT value on done: 7493.0
[2023-02-25 13:21:28,019][2409866] Sum rewards: 16.448, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.327', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO5': '0.025', 'AMMO4': '0.086', 'AMMO3': '0.103', 'WEAPON4': '0.150', 'weapon4': '0.182', 'weapon5': '0.286', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'weapon2': '0.712', 'ARMOR': '0.853', 'HITCOUNT': '1.000', 'weapon3': '2.216', 'DAMAGECOUNT': '3.534', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:21:28,055][2409407] DAMAGECOUNT value on done: 9646.0
[2023-02-25 13:21:28,055][2409407] Sum rewards: 10.624, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.824', 'AMMO2': '0.001', 'AMMO4': '0.003', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO3': '0.066', 'WEAPON4': '0.100', 'weapon5': '0.132', 'weapon4': '0.306', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.740', 'ARMOR': '1.262', 'weapon3': '1.348', 'weapon2': '1.472', 'DAMAGECOUNT': '2.325', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:21:28,647][2409074] Updated weights for policy 0, policy_version 23071 (0.0012)
[2023-02-25 13:21:28,671][2409100] DAMAGECOUNT value on done: 7267.0
[2023-02-25 13:21:28,675][2409100] Sum rewards: 6.845, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.778', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO3': '0.042', 'AMMO4': '0.043', 'weapon5': '0.092', 'weapon7': '0.146', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.580', 'weapon3': '0.802', 'weapon4': '1.194', 'weapon2': '1.290', 'DAMAGECOUNT': '1.830', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:21:28,951][2409101] DAMAGECOUNT value on done: 8494.0
[2023-02-25 13:21:28,951][2409101] Sum rewards: 13.079, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.869', 'AMMO5': '0.016', 'AMMO2': '0.018', 'AMMO3': '0.060', 'AMMO4': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.150', 'weapon5': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'weapon2': '0.774', 'HITCOUNT': '0.790', 'weapon4': '0.974', 'weapon3': '1.246', 'ARMOR': '1.734', 'DAMAGECOUNT': '4.410', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:21:29,186][2409103] DAMAGECOUNT value on done: 7271.0
[2023-02-25 13:21:29,190][2409103] Sum rewards: 15.238, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.422', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.122', 'weapon5': '0.174', 'WEAPON3': '0.550', 'HITCOUNT': '0.810', 'ARMOR': '1.298', 'weapon2': '1.418', 'weapon3': '1.656', 'DAMAGECOUNT': '3.792', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:21:29,265][2409105] DAMAGECOUNT value on done: 8551.0
[2023-02-25 13:21:29,268][2409105] Sum rewards: 6.954, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.543', 'AMMO5': '0.015', 'AMMO2': '0.018', 'weapon4': '0.028', 'AMMO3': '0.040', 'weapon7': '0.078', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.258', 'ARMOR': '0.456', 'HITCOUNT': '0.570', 'weapon3': '0.996', 'weapon2': '2.004', 'DAMAGECOUNT': '3.255', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:21:29,346][2409549] DAMAGECOUNT value on done: 9604.0
[2023-02-25 13:21:29,347][2409549] Sum rewards: 19.483, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.998', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO5': '0.019', 'weapon7': '0.050', 'AMMO3': '0.080', 'AMMO4': '0.090', 'weapon5': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon2': '0.628', 'ARMOR': '0.949', 'weapon4': '1.252', 'HITCOUNT': '1.300', 'weapon3': '1.566', 'DAMAGECOUNT': '5.370', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:21:29,396][2409373] DAMAGECOUNT value on done: 7344.0
[2023-02-25 13:21:29,399][2409373] Sum rewards: 7.015, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.343', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.015', 'AMMO5': '0.022', 'AMMO3': '0.087', 'weapon5': '0.260', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.790', 'weapon2': '1.612', 'weapon3': '1.670', 'DAMAGECOUNT': '2.988', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:21:29,427][2409077] DAMAGECOUNT value on done: 7874.0
[2023-02-25 13:21:29,427][2409077] Sum rewards: 10.458, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.940', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.025', 'weapon5': '0.106', 'AMMO3': '0.112', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'HITCOUNT': '0.960', 'ARMOR': '1.372', 'weapon2': '1.442', 'weapon3': '2.106', 'DAMAGECOUNT': '3.267', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:21:29,697][2409406] DAMAGECOUNT value on done: 8330.0
[2023-02-25 13:21:29,700][2409406] Sum rewards: 9.568, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.015', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO3': '0.059', 'AMMO4': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.168', 'HEALTH': '0.194', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.680', 'weapon2': '1.046', 'weapon3': '1.064', 'weapon4': '1.074', 'DAMAGECOUNT': '2.730', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:21:29,977][2409102] DAMAGECOUNT value on done: 8212.0
[2023-02-25 13:21:29,979][2409102] Sum rewards: 9.390, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.206', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.014', 'AMMO3': '0.030', 'WEAPON5': '0.100', 'weapon5': '0.104', 'WEAPON4': '0.150', 'weapon7': '0.164', 'WEAPON3': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'HITCOUNT': '0.380', 'WEAPON7': '0.400', 'weapon3': '0.508', 'ARMOR': '0.800', 'weapon2': '1.048', 'weapon4': '1.540', 'DAMAGECOUNT': '1.917', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:21:30,206][2409597] DAMAGECOUNT value on done: 8983.0
[2023-02-25 13:21:30,210][2409597] Sum rewards: 15.773, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO3': '0.040', 'weapon5': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'weapon7': '0.154', 'WEAPON3': '0.250', 'weapon4': '0.436', 'HEALTH': '0.475', 'HITCOUNT': '0.770', 'weapon2': '0.774', 'weapon3': '0.934', 'DAMAGECOUNT': '3.465', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:21:30,211][2409074] Updated weights for policy 0, policy_version 23081 (0.0012)
[2023-02-25 13:21:30,234][2409596] DAMAGECOUNT value on done: 8545.0
[2023-02-25 13:21:30,235][2409596] Sum rewards: 11.771, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.270', 'AMMO2': '0.012', 'AMMO5': '0.013', 'weapon7': '0.048', 'weapon5': '0.058', 'AMMO4': '0.059', 'AMMO3': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'ARMOR': '0.489', 'WEAPON3': '0.500', 'HITCOUNT': '0.700', 'weapon2': '1.058', 'weapon3': '1.068', 'weapon4': '1.072', 'DAMAGECOUNT': '3.195', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:21:30,293][2409405] DAMAGECOUNT value on done: 7554.0
[2023-02-25 13:21:30,296][2409405] Sum rewards: 9.479, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.689', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon7': '0.048', 'AMMO3': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.172', 'AMMO4': '0.173', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'weapon4': '0.712', 'HITCOUNT': '0.730', 'ARMOR': '0.800', 'weapon2': '1.202', 'weapon3': '1.638', 'DAMAGECOUNT': '3.000', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:21:30,310][2409565] DAMAGECOUNT value on done: 9268.0
[2023-02-25 13:21:30,311][2409565] Sum rewards: 16.082, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.258', 'AMMO2': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.047', 'AMMO3': '0.084', 'weapon7': '0.084', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.276', 'weapon4': '0.358', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'ARMOR': '0.922', 'weapon2': '1.108', 'HITCOUNT': '1.140', 'weapon3': '1.650', 'DAMAGECOUNT': '4.803', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:21:31,111][2409485] DAMAGECOUNT value on done: 7445.0
[2023-02-25 13:21:31,118][2409485] Sum rewards: 6.333, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.773', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'AMMO3': '0.087', 'weapon4': '0.172', 'weapon5': '0.198', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.750', 'weapon2': '1.316', 'weapon3': '1.658', 'DAMAGECOUNT': '3.039', 'FRAGCOUNT': '4.500'}
[2023-02-25 13:21:31,286][2409104] DAMAGECOUNT value on done: 7139.0
[2023-02-25 13:21:31,289][2409104] Sum rewards: 11.689, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO2': '0.013', 'AMMO3': '0.020', 'AMMO4': '0.065', 'HEALTH': '0.105', 'WEAPON4': '0.150', 'WEAPON3': '0.150', 'AMMO6': '0.320', 'AMMO7': '0.320', 'weapon7': '0.326', 'WEAPON7': '0.400', 'weapon3': '0.474', 'HITCOUNT': '0.590', 'weapon2': '0.832', 'weapon4': '1.252', 'DAMAGECOUNT': '2.922', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:21:31,422][2409548] DAMAGECOUNT value on done: 7810.0
[2023-02-25 13:21:31,423][2409548] Sum rewards: 11.008, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.656', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO3': '0.060', 'weapon5': '0.064', 'AMMO4': '0.100', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'ARMOR': '0.515', 'HITCOUNT': '0.660', 'weapon2': '0.806', 'weapon4': '0.970', 'weapon3': '1.414', 'DAMAGECOUNT': '2.142', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:21:31,687][2409097] DAMAGECOUNT value on done: 10059.0
[2023-02-25 13:21:31,688][2409097] Sum rewards: 19.946, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.522', 'AMMO5': '0.023', 'AMMO2': '0.031', 'AMMO3': '0.064', 'weapon7': '0.118', 'AMMO4': '0.157', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.214', 'weapon4': '0.368', 'WEAPON3': '0.450', 'WEAPON5': '0.450', 'HITCOUNT': '1.040', 'ARMOR': '1.229', 'weapon3': '1.250', 'weapon2': '1.850', 'DAMAGECOUNT': '6.174', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:21:31,829][2409074] Updated weights for policy 0, policy_version 23091 (0.0012)
[2023-02-25 13:21:31,839][2409389] DAMAGECOUNT value on done: 8821.0
[2023-02-25 13:21:31,844][2409389] Sum rewards: 8.522, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.744', 'AMMO5': '0.015', 'AMMO2': '0.047', 'AMMO3': '0.056', 'weapon7': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.200', 'AMMO4': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.518', 'HITCOUNT': '0.590', 'weapon3': '1.064', 'weapon2': '1.796', 'DAMAGECOUNT': '3.774', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:21:31,943][2409355] DAMAGECOUNT value on done: 6924.0
[2023-02-25 13:21:31,944][2409355] Sum rewards: 6.728, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.590', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO3': '0.063', 'weapon5': '0.070', 'AMMO4': '0.071', 'WEAPON4': '0.150', 'weapon7': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.300', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.310', 'weapon2': '0.872', 'weapon3': '0.878', 'DAMAGECOUNT': '1.437', 'weapon4': '1.700', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:21:32,038][2409866] DAMAGECOUNT value on done: 8533.0
[2023-02-25 13:21:32,041][2409866] Sum rewards: 12.329, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.482', 'AMMO2': '0.011', 'AMMO5': '0.019', 'weapon7': '0.026', 'AMMO4': '0.055', 'AMMO3': '0.059', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.140', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'weapon4': '0.468', 'ARMOR': '0.495', 'HITCOUNT': '0.820', 'weapon3': '1.058', 'weapon2': '1.474', 'DAMAGECOUNT': '4.035', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:21:32,186][2408954] Fps is (10 sec: 24986.3, 60 sec: 24439.5, 300 sec: 24201.1). Total num frames: 94588928. Throughput: 0: 6116.8. Samples: 23654256. Policy #0 lag: (min: 0.0, avg: 13.9, max: 29.0)
[2023-02-25 13:21:32,186][2408954] Avg episode reward: [(0, '12.876')]
[2023-02-25 13:21:32,213][2409033] Saving new best policy, reward=12.876!
[2023-02-25 13:21:32,407][2409100] DAMAGECOUNT value on done: 6723.0
[2023-02-25 13:21:32,410][2409100] Sum rewards: 5.827, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.188', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO3': '0.040', 'weapon7': '0.066', 'AMMO4': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.300', 'WEAPON3': '0.300', 'weapon5': '0.308', 'ARMOR': '0.400', 'weapon4': '0.530', 'HITCOUNT': '0.670', 'weapon3': '0.994', 'weapon2': '1.418', 'DAMAGECOUNT': '2.232', 'FRAGCOUNT': '3.500'}
[2023-02-25 13:21:32,533][2409101] DAMAGECOUNT value on done: 7300.0
[2023-02-25 13:21:32,534][2409101] Sum rewards: 13.852, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.546', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'AMMO3': '0.085', 'weapon7': '0.126', 'AMMO4': '0.135', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon5': '0.312', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'weapon4': '0.754', 'HITCOUNT': '0.840', 'weapon2': '1.178', 'weapon3': '1.262', 'ARMOR': '1.381', 'DAMAGECOUNT': '4.320', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:21:32,736][2409407] DAMAGECOUNT value on done: 10015.0
[2023-02-25 13:21:32,741][2409407] Sum rewards: 18.333, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.684', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.070', 'weapon5': '0.080', 'weapon7': '0.148', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'WEAPON7': '0.400', 'ARMOR': '0.460', 'WEAPON3': '0.550', 'HITCOUNT': '1.070', 'weapon2': '1.220', 'weapon3': '1.714', 'DAMAGECOUNT': '5.073', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:21:32,897][2409549] DAMAGECOUNT value on done: 7232.0
[2023-02-25 13:21:32,900][2409549] Sum rewards: 15.242, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.520', 'AMMO4': '-0.079', 'AMMO2': '-0.016', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.066', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'weapon4': '0.216', 'WEAPON5': '0.300', 'ARMOR': '0.455', 'WEAPON3': '0.650', 'HITCOUNT': '0.980', 'weapon2': '1.328', 'weapon3': '1.448', 'DAMAGECOUNT': '3.441', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:21:33,122][2409373] DAMAGECOUNT value on done: 9886.0
[2023-02-25 13:21:33,123][2409103] DAMAGECOUNT value on done: 6336.0
[2023-02-25 13:21:33,124][2409373] Sum rewards: 23.380, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.770', 'AMMO2': '0.004', 'AMMO5': '0.012', 'AMMO4': '0.018', 'weapon7': '0.054', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.168', 'WEAPON7': '0.200', 'weapon5': '0.206', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '1.290', 'weapon3': '1.304', 'weapon2': '1.424', 'DAMAGECOUNT': '5.811', 'FRAGCOUNT': '17.000'}
[2023-02-25 13:21:33,124][2409103] Sum rewards: 13.249, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.492', 'AMMO2': '0.006', 'AMMO5': '0.013', 'AMMO4': '0.027', 'AMMO3': '0.059', 'weapon7': '0.060', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.126', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'ARMOR': '0.453', 'HITCOUNT': '0.870', 'weapon4': '0.944', 'weapon3': '0.968', 'weapon2': '1.352', 'DAMAGECOUNT': '3.222', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:21:33,353][2409077] DAMAGECOUNT value on done: 6760.0
[2023-02-25 13:21:33,354][2409077] Sum rewards: 15.277, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.130', 'AMMO2': '0.005', 'AMMO5': '0.015', 'AMMO4': '0.025', 'AMMO3': '0.040', 'WEAPON4': '0.050', 'weapon5': '0.068', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon7': '0.278', 'WEAPON3': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.420', 'ARMOR': '0.487', 'weapon4': '0.580', 'weapon3': '1.020', 'weapon2': '1.344', 'DAMAGECOUNT': '2.835', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:21:33,496][2409074] Updated weights for policy 0, policy_version 23101 (0.0012)
[2023-02-25 13:21:33,694][2409406] DAMAGECOUNT value on done: 8820.0
[2023-02-25 13:21:33,695][2409406] Sum rewards: 22.339, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.473', 'WEAPON1': '0.010', 'AMMO5': '0.023', 'AMMO2': '0.038', 'weapon7': '0.072', 'AMMO3': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.162', 'AMMO4': '0.188', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon5': '0.430', 'WEAPON3': '0.500', 'WEAPON5': '0.550', 'ARMOR': '0.852', 'weapon2': '1.248', 'HITCOUNT': '1.250', 'weapon3': '1.654', 'DAMAGECOUNT': '6.519', 'FRAGCOUNT': '17.000'}
[2023-02-25 13:21:33,730][2409102] DAMAGECOUNT value on done: 7957.0
[2023-02-25 13:21:33,734][2409102] Sum rewards: 6.938, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.959', 'AMMO5': '0.024', 'AMMO2': '0.028', 'weapon7': '0.082', 'AMMO3': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.138', 'weapon5': '0.148', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.434', 'ARMOR': '0.455', 'weapon2': '0.476', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'HITCOUNT': '0.930', 'weapon3': '1.436', 'DAMAGECOUNT': '3.501', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:21:33,912][2409405] DAMAGECOUNT value on done: 8192.0
[2023-02-25 13:21:33,915][2409405] Sum rewards: 12.873, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.762', 'AMMO2': '0.007', 'AMMO5': '0.014', 'AMMO4': '0.036', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.089', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.162', 'weapon4': '0.296', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.890', 'weapon3': '1.550', 'weapon2': '1.684', 'DAMAGECOUNT': '3.108', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:21:33,962][2409105] DAMAGECOUNT value on done: 6304.0
[2023-02-25 13:21:33,965][2409105] Sum rewards: 11.156, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.460', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'weapon7': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.236', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'ARMOR': '0.500', 'HITCOUNT': '0.620', 'weapon2': '0.964', 'weapon3': '1.270', 'DAMAGECOUNT': '2.505', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:21:33,974][2409596] DAMAGECOUNT value on done: 6726.0
[2023-02-25 13:21:33,975][2409596] Sum rewards: 10.840, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.684', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'weapon7': '0.050', 'AMMO3': '0.077', 'AMMO4': '0.093', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.222', 'WEAPON4': '0.250', 'WEAPON3': '0.500', 'weapon4': '0.504', 'WEAPON5': '0.550', 'HITCOUNT': '0.660', 'ARMOR': '0.882', 'weapon2': '1.348', 'weapon3': '1.504', 'DAMAGECOUNT': '2.133', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:21:34,098][2409565] DAMAGECOUNT value on done: 7712.0
[2023-02-25 13:21:34,099][2409565] Sum rewards: 5.127, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.009', 'AMMO2': '0.010', 'weapon4': '0.016', 'AMMO3': '0.030', 'HEALTH': '0.032', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.062', 'weapon7': '0.124', 'WEAPON3': '0.200', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HITCOUNT': '0.390', 'ARMOR': '0.478', 'weapon3': '0.574', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.776', 'weapon2': '3.136'}
[2023-02-25 13:21:34,880][2409485] DAMAGECOUNT value on done: 8278.0
[2023-02-25 13:21:34,885][2409485] Sum rewards: 13.697, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.320', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'AMMO5': '0.040', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.154', 'weapon5': '0.194', 'weapon4': '0.226', 'weapon2': '0.808', 'WEAPON5': '0.850', 'ARMOR': '0.851', 'WEAPON3': '1.000', 'HITCOUNT': '1.030', 'weapon3': '2.232', 'DAMAGECOUNT': '4.374', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:21:34,957][2409597] DAMAGECOUNT value on done: 6923.0
[2023-02-25 13:21:34,958][2409597] Sum rewards: 18.072, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.908', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.021', 'weapon7': '0.076', 'AMMO3': '0.084', 'AMMO4': '0.105', 'weapon5': '0.248', 'WEAPON4': '0.250', 'AMMO6': '0.260', 'AMMO7': '0.260', 'WEAPON7': '0.300', 'WEAPON5': '0.450', 'ARMOR': '0.452', 'WEAPON3': '0.500', 'weapon4': '0.832', 'HITCOUNT': '1.100', 'weapon2': '1.196', 'weapon3': '1.398', 'DAMAGECOUNT': '5.919', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:21:35,055][2409104] DAMAGECOUNT value on done: 9070.0
[2023-02-25 13:21:35,059][2409104] Sum rewards: 8.400, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.566', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.071', 'weapon7': '0.128', 'weapon5': '0.138', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.300', 'WEAPON7': '0.400', 'HITCOUNT': '0.420', 'WEAPON3': '0.550', 'weapon4': '1.086', 'weapon3': '1.134', 'weapon2': '1.212', 'ARMOR': '1.252', 'DAMAGECOUNT': '2.553', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:21:35,181][2409548] DAMAGECOUNT value on done: 7868.0
[2023-02-25 13:21:35,182][2409548] Sum rewards: 12.130, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.050', 'weapon7': '0.054', 'AMMO3': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HEALTH': '0.226', 'weapon5': '0.292', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'HITCOUNT': '0.720', 'weapon3': '1.184', 'weapon2': '2.024', 'DAMAGECOUNT': '3.249', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:21:35,286][2409074] Updated weights for policy 0, policy_version 23111 (0.0012)
[2023-02-25 13:21:35,404][2409097] DAMAGECOUNT value on done: 8058.0
[2023-02-25 13:21:35,404][2409097] Sum rewards: 18.795, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.219', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon4': '0.074', 'weapon5': '0.076', 'AMMO3': '0.090', 'AMMO4': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.116', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'HITCOUNT': '1.170', 'weapon2': '1.428', 'weapon3': '1.850', 'DAMAGECOUNT': '4.581', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:21:35,508][2409075] DAMAGECOUNT value on done: 7214.0
[2023-02-25 13:21:35,512][2409075] Sum rewards: 7.680, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.260', 'AMMO5': '0.020', 'AMMO2': '0.028', 'AMMO3': '0.047', 'weapon5': '0.074', 'weapon7': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.139', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'WEAPON3': '0.350', 'WEAPON5': '0.400', 'ARMOR': '0.442', 'HITCOUNT': '0.630', 'weapon2': '0.760', 'weapon3': '0.840', 'weapon4': '1.760', 'DAMAGECOUNT': '2.574', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:21:36,126][2409100] DAMAGECOUNT value on done: 7763.0
[2023-02-25 13:21:36,127][2409389] DAMAGECOUNT value on done: 6566.0
[2023-02-25 13:21:36,127][2409100] Sum rewards: 8.398, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.724', 'AMMO5': '0.012', 'AMMO2': '0.019', 'WEAPON1': '0.050', 'weapon5': '0.072', 'AMMO4': '0.096', 'AMMO3': '0.099', 'weapon7': '0.142', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.326', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.700', 'weapon3': '1.414', 'weapon2': '1.744', 'DAMAGECOUNT': '3.297', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:21:36,130][2409389] Sum rewards: 8.707, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.325', 'AMMO5': '0.020', 'AMMO2': '0.021', 'weapon5': '0.096', 'weapon7': '0.102', 'AMMO3': '0.106', 'AMMO4': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.296', 'WEAPON5': '0.400', 'weapon2': '0.686', 'WEAPON3': '0.700', 'HITCOUNT': '0.770', 'weapon3': '1.236', 'DAMAGECOUNT': '3.102', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:21:36,134][2409101] DAMAGECOUNT value on done: 9449.0
[2023-02-25 13:21:36,135][2409101] Sum rewards: 12.098, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.015', 'AMMO5': '0.015', 'AMMO2': '0.020', 'AMMO3': '0.080', 'weapon7': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.274', 'weapon5': '0.304', 'WEAPON5': '0.400', 'ARMOR': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '0.860', 'weapon2': '1.074', 'weapon3': '1.848', 'DAMAGECOUNT': '3.855', 'FRAGCOUNT': '9.500'}
[2023-02-25 13:21:36,239][2409355] DAMAGECOUNT value on done: 8093.0
[2023-02-25 13:21:36,243][2409355] Sum rewards: 9.346, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO3': '0.052', 'AMMO4': '0.080', 'HEALTH': '0.086', 'WEAPON4': '0.100', 'weapon7': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.146', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.252', 'WEAPON3': '0.350', 'HITCOUNT': '0.520', 'ARMOR': '0.846', 'weapon3': '0.974', 'weapon2': '1.834', 'DAMAGECOUNT': '1.836', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:21:36,315][2409866] DAMAGECOUNT value on done: 6041.0
[2023-02-25 13:21:36,316][2409866] Sum rewards: 14.860, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.997', 'AMMO2': '0.002', 'AMMO4': '0.012', 'AMMO5': '0.017', 'weapon4': '0.040', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'weapon5': '0.386', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.690', 'ARMOR': '1.345', 'weapon3': '1.472', 'weapon2': '1.482', 'DAMAGECOUNT': '3.531', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:21:36,485][2409549] DAMAGECOUNT value on done: 8168.0
[2023-02-25 13:21:36,486][2409549] Sum rewards: 11.784, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.276', 'AMMO5': '0.017', 'AMMO2': '0.029', 'weapon7': '0.048', 'AMMO3': '0.079', 'weapon5': '0.084', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.830', 'weapon4': '0.892', 'weapon2': '1.068', 'weapon3': '1.524', 'DAMAGECOUNT': '3.195', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:21:36,574][2409074] Updated weights for policy 0, policy_version 23121 (0.0012)
[2023-02-25 13:21:36,683][2409407] DAMAGECOUNT value on done: 12369.0
[2023-02-25 13:21:36,684][2409407] Sum rewards: 11.648, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.220', 'AMMO2': '0.004', 'AMMO5': '0.012', 'AMMO4': '0.017', 'weapon7': '0.054', 'AMMO3': '0.093', 'weapon5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.466', 'weapon2': '0.488', 'weapon4': '0.634', 'WEAPON3': '0.650', 'HITCOUNT': '0.980', 'weapon3': '1.514', 'DAMAGECOUNT': '3.966', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:21:36,730][2409078] DAMAGECOUNT value on done: 7492.0
[2023-02-25 13:21:36,733][2409078] Sum rewards: 16.417, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.331', 'AMMO2': '0.003', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO4': '0.013', 'AMMO3': '0.050', 'weapon7': '0.052', 'weapon5': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.308', 'WEAPON3': '0.400', 'HITCOUNT': '0.900', 'weapon2': '0.942', 'weapon3': '1.096', 'DAMAGECOUNT': '3.087', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:21:37,046][2409103] DAMAGECOUNT value on done: 7372.0
[2023-02-25 13:21:37,050][2409103] Sum rewards: 15.903, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'weapon7': '0.054', 'AMMO3': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.112', 'AMMO4': '0.168', 'WEAPON5': '0.250', 'HEALTH': '0.296', 'WEAPON4': '0.300', 'ARMOR': '0.436', 'WEAPON3': '0.450', 'weapon2': '0.558', 'HITCOUNT': '0.810', 'weapon3': '1.110', 'weapon4': '1.170', 'DAMAGECOUNT': '4.005', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:21:37,146][2409373] DAMAGECOUNT value on done: 8195.0
[2023-02-25 13:21:37,150][2409373] Sum rewards: 16.526, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.916', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.012', 'weapon7': '0.048', 'AMMO4': '0.061', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.220', 'WEAPON5': '0.300', 'weapon4': '0.410', 'WEAPON3': '0.500', 'ARMOR': '0.903', 'HITCOUNT': '1.080', 'weapon3': '1.440', 'weapon2': '1.668', 'DAMAGECOUNT': '4.662', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:21:37,186][2408954] Fps is (10 sec: 24166.0, 60 sec: 24439.4, 300 sec: 24173.3). Total num frames: 94707712. Throughput: 0: 6129.6. Samples: 23672688. Policy #0 lag: (min: 0.0, avg: 13.9, max: 29.0)
[2023-02-25 13:21:37,186][2408954] Avg episode reward: [(0, '12.509')]
[2023-02-25 13:21:37,558][2409077] DAMAGECOUNT value on done: 7860.0
[2023-02-25 13:21:37,561][2409077] Sum rewards: 10.670, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.604', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.017', 'weapon4': '0.046', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.180', 'ARMOR': '0.446', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '0.860', 'weapon2': '1.202', 'weapon3': '1.520', 'DAMAGECOUNT': '4.119', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:21:37,590][2409405] DAMAGECOUNT value on done: 7968.0
[2023-02-25 13:21:37,591][2409405] Sum rewards: 13.959, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.602', 'AMMO2': '0.016', 'AMMO5': '0.019', 'AMMO3': '0.050', 'AMMO4': '0.080', 'weapon7': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.450', 'HITCOUNT': '0.730', 'ARMOR': '0.800', 'weapon2': '1.252', 'weapon3': '1.278', 'DAMAGECOUNT': '3.729', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:21:37,814][2409105] DAMAGECOUNT value on done: 9230.0
[2023-02-25 13:21:37,829][2409105] Sum rewards: 11.870, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.855', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.017', 'WEAPON4': '0.050', 'weapon4': '0.086', 'AMMO3': '0.089', 'weapon5': '0.244', 'ARMOR': '0.435', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.780', 'weapon2': '1.526', 'weapon3': '1.834', 'DAMAGECOUNT': '2.820', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:21:37,852][2409405] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:21:37,862][2409406] DAMAGECOUNT value on done: 7216.0
[2023-02-25 13:21:37,866][2409406] Sum rewards: 9.735, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.244', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO5': '0.015', 'weapon4': '0.024', 'AMMO4': '0.067', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'AMMO6': '0.153', 'AMMO7': '0.153', 'WEAPON6': '0.200', 'weapon6': '0.236', 'weapon5': '0.250', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.650', 'weapon3': '1.466', 'weapon2': '1.586', 'DAMAGECOUNT': '3.063', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:21:37,882][2409596] DAMAGECOUNT value on done: 7954.0
[2023-02-25 13:21:37,883][2409596] Sum rewards: 4.163, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.380', 'weapon4': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO3': '0.053', 'weapon7': '0.078', 'WEAPON4': '0.100', 'weapon5': '0.102', 'AMMO4': '0.107', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HITCOUNT': '0.250', 'WEAPON3': '0.300', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.095', 'weapon3': '1.644', 'weapon2': '1.726'}
[2023-02-25 13:21:37,963][2409102] DAMAGECOUNT value on done: 7077.0
[2023-02-25 13:21:37,964][2409102] Sum rewards: 8.903, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.230', 'weapon5': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.019', 'AMMO3': '0.069', 'AMMO4': '0.096', 'weapon7': '0.104', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'ARMOR': '0.454', 'HITCOUNT': '0.550', 'weapon3': '1.088', 'weapon2': '1.216', 'DAMAGECOUNT': '2.766', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:21:38,335][2409565] DAMAGECOUNT value on done: 8945.0
[2023-02-25 13:21:38,338][2409565] Sum rewards: 11.571, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.920', 'AMMO2': '0.012', 'AMMO5': '0.012', 'weapon4': '0.024', 'weapon7': '0.058', 'AMMO4': '0.058', 'AMMO3': '0.065', 'weapon5': '0.084', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.444', 'WEAPON3': '0.500', 'HITCOUNT': '0.790', 'weapon3': '1.216', 'weapon2': '1.728', 'DAMAGECOUNT': '3.660', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:21:38,519][2409074] Updated weights for policy 0, policy_version 23131 (0.0012)
[2023-02-25 13:21:38,671][2409597] DAMAGECOUNT value on done: 9636.0
[2023-02-25 13:21:38,672][2409597] Sum rewards: 18.574, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.111', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.007', 'AMMO3': '0.040', 'weapon5': '0.208', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'ARMOR': '0.497', 'HITCOUNT': '0.910', 'weapon3': '0.994', 'weapon2': '1.684', 'DAMAGECOUNT': '4.038', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:21:38,972][2409104] DAMAGECOUNT value on done: 7665.0
[2023-02-25 13:21:38,973][2409104] Sum rewards: 5.577, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.014', 'AMMO5': '0.015', 'AMMO3': '0.050', 'weapon7': '0.066', 'AMMO4': '0.070', 'weapon5': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'HEALTH': '0.376', 'HITCOUNT': '0.380', 'ARMOR': '0.400', 'weapon2': '0.798', 'weapon3': '1.062', 'DAMAGECOUNT': '1.497', 'weapon4': '1.578', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:21:39,114][2409548] DAMAGECOUNT value on done: 8421.0
[2023-02-25 13:21:39,118][2409548] Sum rewards: 15.967, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.020', 'AMMO2': '0.007', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon7': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.132', 'WEAPON5': '0.200', 'weapon4': '0.220', 'WEAPON3': '0.400', 'ARMOR': '0.450', 'HITCOUNT': '0.850', 'weapon3': '1.452', 'weapon2': '1.530', 'DAMAGECOUNT': '5.199', 'FRAGCOUNT': '9.500'}
[2023-02-25 13:21:39,226][2409485] DAMAGECOUNT value on done: 7867.0
[2023-02-25 13:21:39,236][2409485] Sum rewards: 7.996, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.389', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.032', 'weapon4': '0.042', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'weapon5': '0.102', 'WEAPON5': '0.550', 'HITCOUNT': '0.720', 'WEAPON3': '0.750', 'ARMOR': '1.301', 'weapon2': '1.538', 'weapon3': '1.794', 'DAMAGECOUNT': '2.607', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:21:39,310][2409469] DAMAGECOUNT value on done: 8257.0
[2023-02-25 13:21:39,313][2409469] Sum rewards: 12.042, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.170', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.031', 'AMMO3': '0.116', 'AMMO4': '0.154', 'WEAPON4': '0.250', 'weapon4': '0.310', 'weapon5': '0.342', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.450', 'WEAPON3': '0.700', 'weapon2': '0.740', 'weapon3': '1.760', 'DAMAGECOUNT': '3.279', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:21:39,359][2409097] DAMAGECOUNT value on done: 8176.0
[2023-02-25 13:21:39,361][2409097] Sum rewards: 7.989, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.787', 'AMMO5': '0.007', 'AMMO2': '0.035', 'AMMO3': '0.040', 'weapon5': '0.068', 'weapon7': '0.114', 'WEAPON5': '0.150', 'AMMO4': '0.174', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.250', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'WEAPON4': '0.450', 'HITCOUNT': '0.550', 'weapon3': '0.810', 'weapon2': '0.954', 'weapon4': '1.872', 'DAMAGECOUNT': '2.412', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:21:39,433][2409407] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)]
[2023-02-25 13:21:39,504][2409075] DAMAGECOUNT value on done: 8573.0
[2023-02-25 13:21:39,505][2409075] Sum rewards: 11.762, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.195', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO3': '0.020', 'AMMO4': '0.052', 'weapon5': '0.148', 'weapon7': '0.148', 'WEAPON3': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon3': '0.428', 'weapon2': '0.446', 'ARMOR': '0.454', 'HITCOUNT': '0.520', 'weapon4': '1.572', 'DAMAGECOUNT': '3.162', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:21:39,684][2409101] DAMAGECOUNT value on done: 8011.0
[2023-02-25 13:21:39,687][2409101] Sum rewards: 8.790, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.971', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'AMMO3': '0.050', 'weapon7': '0.052', 'WEAPON4': '0.100', 'weapon4': '0.204', 'weapon5': '0.226', 'WEAPON5': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.790', 'weapon3': '1.242', 'weapon2': '1.332', 'DAMAGECOUNT': '3.135', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:21:39,867][2409389] DAMAGECOUNT value on done: 7421.0
[2023-02-25 13:21:39,868][2409389] Sum rewards: 9.045, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.730', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.013', 'weapon5': '0.056', 'weapon7': '0.058', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.250', 'WEAPON3': '0.500', 'HITCOUNT': '0.570', 'ARMOR': '0.951', 'weapon3': '1.098', 'weapon2': '1.346', 'DAMAGECOUNT': '1.857', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:21:39,906][2409355] DAMAGECOUNT value on done: 8170.0
[2023-02-25 13:21:39,907][2409355] Sum rewards: 9.309, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.792', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'AMMO3': '0.110', 'weapon5': '0.174', 'WEAPON5': '0.450', 'ARMOR': '0.846', 'WEAPON3': '0.850', 'HITCOUNT': '0.920', 'weapon2': '1.592', 'weapon3': '1.738', 'DAMAGECOUNT': '3.387', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:21:39,993][2409866] DAMAGECOUNT value on done: 8742.0
[2023-02-25 13:21:39,994][2409866] Sum rewards: 16.690, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.468', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.023', 'AMMO4': '0.057', 'weapon7': '0.060', 'AMMO3': '0.071', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.266', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.457', 'WEAPON3': '0.600', 'WEAPON5': '0.600', 'weapon4': '0.642', 'weapon2': '0.798', 'HITCOUNT': '0.860', 'weapon3': '1.660', 'DAMAGECOUNT': '5.703', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:21:40,011][2409100] DAMAGECOUNT value on done: 8593.0
[2023-02-25 13:21:40,012][2409100] Sum rewards: 17.123, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.485', 'AMMO2': '0.002', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.010', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.244', 'weapon4': '0.320', 'WEAPON3': '0.400', 'HITCOUNT': '0.770', 'ARMOR': '1.307', 'weapon2': '1.398', 'weapon3': '1.496', 'DAMAGECOUNT': '3.816', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:21:40,035][2409549] DAMAGECOUNT value on done: 9785.0
[2023-02-25 13:21:40,036][2409549] Sum rewards: 20.037, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.206', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'AMMO5': '0.022', 'AMMO4': '0.106', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'weapon5': '0.216', 'weapon4': '0.358', 'ARMOR': '0.449', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'HITCOUNT': '1.210', 'weapon2': '1.442', 'weapon3': '1.716', 'DAMAGECOUNT': '5.910', 'FRAGCOUNT': '17.000'}
[2023-02-25 13:21:40,165][2409074] Updated weights for policy 0, policy_version 23141 (0.0012)
[2023-02-25 13:21:40,524][2409078] DAMAGECOUNT value on done: 7280.0
[2023-02-25 13:21:40,527][2409078] Sum rewards: 7.707, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.086', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO3': '0.030', 'AMMO4': '0.101', 'weapon5': '0.114', 'weapon7': '0.126', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.250', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.490', 'weapon3': '0.858', 'weapon2': '0.902', 'weapon4': '1.684', 'DAMAGECOUNT': '2.070', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:21:40,687][2409407] DAMAGECOUNT value on done: 7783.0
[2023-02-25 13:21:40,687][2409407] Sum rewards: 17.244, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.225', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.010', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'weapon4': '0.142', 'weapon5': '0.258', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'ARMOR': '0.911', 'HITCOUNT': '1.270', 'weapon2': '1.468', 'weapon3': '1.576', 'DAMAGECOUNT': '4.485', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:21:41,143][2409373] DAMAGECOUNT value on done: 8172.0
[2023-02-25 13:21:41,146][2409373] Sum rewards: 7.190, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.875', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.032', 'AMMO3': '0.057', 'weapon7': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon5': '0.190', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'weapon2': '0.516', 'HITCOUNT': '0.620', 'weapon3': '1.042', 'weapon4': '1.546', 'DAMAGECOUNT': '2.439', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:21:41,406][2409405] DAMAGECOUNT value on done: 10353.0
[2023-02-25 13:21:41,409][2409405] Sum rewards: 12.449, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.120', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.014', 'weapon7': '0.048', 'AMMO3': '0.067', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.234', 'WEAPON4': '0.250', 'weapon4': '0.330', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.890', 'weapon3': '1.438', 'weapon2': '1.650', 'DAMAGECOUNT': '4.848', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:21:41,487][2409103] DAMAGECOUNT value on done: 9183.0
[2023-02-25 13:21:41,488][2409103] Sum rewards: 8.489, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.168', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'weapon4': '0.224', 'weapon5': '0.280', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '0.770', 'ARMOR': '0.892', 'weapon2': '1.140', 'weapon3': '1.494', 'DAMAGECOUNT': '3.102', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:21:41,662][2409077] DAMAGECOUNT value on done: 6803.0
[2023-02-25 13:21:41,664][2409077] Sum rewards: 11.195, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.694', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'WEAPON4': '0.050', 'weapon7': '0.050', 'weapon4': '0.054', 'AMMO4': '0.061', 'AMMO3': '0.062', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.290', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.740', 'weapon2': '1.444', 'weapon3': '1.542', 'DAMAGECOUNT': '3.900', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:21:41,748][2409596] DAMAGECOUNT value on done: 7646.0
[2023-02-25 13:21:41,751][2409074] Updated weights for policy 0, policy_version 23151 (0.0012)
[2023-02-25 13:21:41,752][2409596] Sum rewards: 7.397, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.312', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.007', 'WEAPON4': '0.050', 'weapon7': '0.068', 'AMMO3': '0.075', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.154', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'HITCOUNT': '0.500', 'weapon4': '0.660', 'weapon3': '0.788', 'ARMOR': '1.315', 'weapon2': '1.892', 'DAMAGECOUNT': '2.898', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:21:41,864][2409105] DAMAGECOUNT value on done: 7191.0
[2023-02-25 13:21:41,867][2409105] Sum rewards: 9.782, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.224', 'AMMO2': '0.021', 'AMMO5': '0.025', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.105', 'weapon5': '0.226', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '0.720', 'weapon2': '1.552', 'weapon3': '1.732', 'DAMAGECOUNT': '2.652', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:21:41,928][2409102] DAMAGECOUNT value on done: 7651.0
[2023-02-25 13:21:41,929][2409102] Sum rewards: 14.668, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.220', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO3': '0.065', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.116', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.316', 'ARMOR': '0.448', 'WEAPON3': '0.450', 'HITCOUNT': '0.980', 'weapon3': '1.348', 'weapon2': '1.542', 'DAMAGECOUNT': '3.963', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:21:41,941][2409406] DAMAGECOUNT value on done: 7975.0
[2023-02-25 13:21:41,942][2409406] Sum rewards: 7.894, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.128', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.042', 'AMMO3': '0.062', 'weapon7': '0.088', 'weapon5': '0.162', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'HITCOUNT': '0.450', 'ARMOR': '0.854', 'weapon3': '0.920', 'weapon4': '0.938', 'weapon2': '1.418', 'DAMAGECOUNT': '2.481', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:21:42,186][2408954] Fps is (10 sec: 24985.7, 60 sec: 24576.0, 300 sec: 24215.0). Total num frames: 94838784. Throughput: 0: 6150.4. Samples: 23709948. Policy #0 lag: (min: 0.0, avg: 13.9, max: 29.0)
[2023-02-25 13:21:42,186][2408954] Avg episode reward: [(0, '12.226')]
[2023-02-25 13:21:42,340][2409565] DAMAGECOUNT value on done: 8942.0
[2023-02-25 13:21:42,340][2409565] Sum rewards: 16.807, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.300', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.087', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.300', 'weapon4': '0.558', 'WEAPON3': '0.650', 'weapon2': '0.892', 'HITCOUNT': '1.590', 'weapon3': '1.716', 'DAMAGECOUNT': '4.929', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:21:42,877][2409104] DAMAGECOUNT value on done: 7489.0
[2023-02-25 13:21:42,892][2409104] Sum rewards: 13.615, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.494', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO3': '0.050', 'weapon5': '0.064', 'AMMO4': '0.066', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon7': '0.240', 'WEAPON7': '0.300', 'weapon4': '0.312', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.770', 'weapon3': '1.336', 'weapon2': '1.524', 'DAMAGECOUNT': '3.333', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:21:42,912][2409548] DAMAGECOUNT value on done: 8321.0
[2023-02-25 13:21:42,913][2409548] Sum rewards: 16.667, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.461', 'AMMO4': '-0.062', 'AMMO2': '-0.012', 'AMMO5': '0.015', 'weapon4': '0.018', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.068', 'WEAPON5': '0.200', 'weapon5': '0.220', 'WEAPON3': '0.600', 'ARMOR': '0.883', 'HITCOUNT': '1.060', 'weapon3': '1.304', 'weapon2': '1.764', 'DAMAGECOUNT': '4.500', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:21:43,096][2409597] DAMAGECOUNT value on done: 7668.0
[2023-02-25 13:21:43,107][2409597] Sum rewards: 9.919, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.236', 'AMMO2': '0.004', 'AMMO4': '0.017', 'AMMO5': '0.017', 'weapon4': '0.018', 'WEAPON4': '0.050', 'AMMO3': '0.067', 'weapon5': '0.430', 'WEAPON3': '0.450', 'WEAPON5': '0.450', 'HITCOUNT': '0.610', 'ARMOR': '1.276', 'weapon3': '1.392', 'weapon2': '1.472', 'DAMAGECOUNT': '2.901', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:21:43,116][2409469] DAMAGECOUNT value on done: 8083.0
[2023-02-25 13:21:43,117][2409469] Sum rewards: 18.291, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.012', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.025', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.224', 'weapon5': '0.490', 'WEAPON3': '0.550', 'WEAPON5': '0.600', 'HITCOUNT': '0.720', 'weapon2': '1.010', 'ARMOR': '1.364', 'weapon3': '1.660', 'DAMAGECOUNT': '4.155', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:21:43,119][2409075] DAMAGECOUNT value on done: 8560.0
[2023-02-25 13:21:43,120][2409075] Sum rewards: 2.764, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.324', 'AMMO2': '0.011', 'AMMO5': '0.017', 'AMMO4': '0.054', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'weapon4': '0.122', 'weapon5': '0.140', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'HITCOUNT': '0.530', 'ARMOR': '0.887', 'weapon2': '1.104', 'weapon3': '1.274', 'DAMAGECOUNT': '1.680', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:21:43,219][2409074] Updated weights for policy 0, policy_version 23161 (0.0013)
[2023-02-25 13:21:43,399][2409485] DAMAGECOUNT value on done: 8108.0
[2023-02-25 13:21:43,403][2409485] Sum rewards: 22.732, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.016', 'AMMO3': '0.060', 'weapon5': '0.240', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'HEALTH': '0.498', 'ARMOR': '0.849', 'HITCOUNT': '0.900', 'weapon3': '1.468', 'weapon2': '1.670', 'DAMAGECOUNT': '4.815', 'FRAGCOUNT': '16.000'}
[2023-02-25 13:21:43,404][2409101] DAMAGECOUNT value on done: 9557.0
[2023-02-25 13:21:43,407][2409101] Sum rewards: 18.308, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.015', 'AMMO5': '0.020', 'AMMO3': '0.069', 'AMMO4': '0.073', 'WEAPON5': '0.300', 'weapon5': '0.338', 'WEAPON3': '0.350', 'HEALTH': '0.764', 'HITCOUNT': '0.770', 'ARMOR': '0.800', 'weapon2': '1.284', 'weapon3': '1.300', 'DAMAGECOUNT': '3.975', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:21:43,451][2409389] DAMAGECOUNT value on done: 8457.0
[2023-02-25 13:21:43,452][2409389] Sum rewards: 9.789, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.205', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.022', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'weapon5': '0.162', 'weapon4': '0.220', 'WEAPON5': '0.400', 'ARMOR': '0.444', 'WEAPON3': '0.600', 'HITCOUNT': '0.670', 'weapon2': '1.012', 'weapon3': '1.674', 'DAMAGECOUNT': '2.862', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:21:43,532][2409355] DAMAGECOUNT value on done: 7894.0
[2023-02-25 13:21:43,536][2409355] Sum rewards: 7.245, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.761', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.024', 'AMMO3': '0.068', 'weapon7': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.122', 'weapon5': '0.170', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'weapon4': '0.486', 'HITCOUNT': '0.760', 'ARMOR': '0.855', 'weapon3': '1.286', 'weapon2': '1.468', 'DAMAGECOUNT': '2.280', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:21:43,632][2409866] DAMAGECOUNT value on done: 7912.0
[2023-02-25 13:21:43,633][2409866] Sum rewards: 12.738, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.250', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.031', 'AMMO3': '0.037', 'WEAPON5': '0.050', 'weapon7': '0.068', 'WEAPON4': '0.100', 'weapon5': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'HITCOUNT': '0.460', 'weapon3': '0.556', 'weapon2': '0.774', 'weapon4': '1.294', 'DAMAGECOUNT': '2.463', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:21:43,748][2409549] DAMAGECOUNT value on done: 8057.0
[2023-02-25 13:21:43,749][2409549] Sum rewards: 21.006, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.282', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon7': '0.066', 'AMMO4': '0.077', 'AMMO3': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.208', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.451', 'weapon4': '0.560', 'weapon2': '1.256', 'HITCOUNT': '1.280', 'weapon3': '1.336', 'DAMAGECOUNT': '5.598', 'FRAGCOUNT': '16.000'}
[2023-02-25 13:21:43,751][2409100] DAMAGECOUNT value on done: 8405.0
[2023-02-25 13:21:43,752][2409100] Sum rewards: 15.942, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.168', 'AMMO2': '0.006', 'AMMO5': '0.016', 'AMMO4': '0.030', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'weapon5': '0.244', 'weapon4': '0.252', 'WEAPON5': '0.450', 'ARMOR': '0.451', 'WEAPON3': '0.600', 'HITCOUNT': '0.950', 'weapon2': '1.518', 'weapon3': '1.646', 'DAMAGECOUNT': '4.020', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:21:44,138][2409097] DAMAGECOUNT value on done: 8573.0
[2023-02-25 13:21:44,141][2409097] Sum rewards: 8.936, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.687', 'AMMO2': '0.028', 'AMMO5': '0.034', 'WEAPON1': '0.040', 'AMMO3': '0.088', 'AMMO4': '0.137', 'weapon7': '0.168', 'WEAPON4': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'weapon5': '0.346', 'WEAPON7': '0.400', 'weapon4': '0.412', 'HITCOUNT': '0.420', 'WEAPON3': '0.600', 'ARMOR': '0.800', 'WEAPON5': '0.850', 'weapon3': '1.088', 'weapon2': '1.626', 'DAMAGECOUNT': '3.396', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:21:44,318][2409407] DAMAGECOUNT value on done: 9442.0
[2023-02-25 13:21:44,322][2409407] Sum rewards: 13.219, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.935', 'AMMO5': '0.017', 'AMMO2': '0.034', 'weapon7': '0.110', 'AMMO3': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.154', 'AMMO4': '0.171', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.464', 'WEAPON3': '0.700', 'HITCOUNT': '1.000', 'weapon2': '1.120', 'weapon3': '1.510', 'DAMAGECOUNT': '4.869', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:21:44,434][2409078] DAMAGECOUNT value on done: 8331.0
[2023-02-25 13:21:44,435][2409078] Sum rewards: 18.596, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.011', 'AMMO5': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'weapon4': '0.064', 'AMMO3': '0.095', 'weapon5': '0.310', 'HEALTH': '0.342', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'ARMOR': '0.800', 'HITCOUNT': '1.060', 'weapon3': '1.606', 'weapon2': '1.664', 'DAMAGECOUNT': '5.271', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:21:44,993][2409373] DAMAGECOUNT value on done: 8895.0
[2023-02-25 13:21:44,995][2409373] Sum rewards: 19.687, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.505', 'AMMO2': '0.011', 'AMMO5': '0.017', 'AMMO4': '0.053', 'AMMO3': '0.112', 'weapon5': '0.192', 'WEAPON4': '0.250', 'weapon4': '0.408', 'WEAPON5': '0.450', 'weapon2': '0.598', 'WEAPON3': '0.850', 'HITCOUNT': '1.350', 'weapon3': '2.142', 'DAMAGECOUNT': '5.508', 'FRAGCOUNT': '16.000'}
[2023-02-25 13:21:45,266][2409405] DAMAGECOUNT value on done: 6849.0
[2023-02-25 13:21:45,269][2409405] Sum rewards: 7.253, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.830', 'AMMO5': '0.019', 'AMMO2': '0.021', 'AMMO3': '0.057', 'weapon7': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.103', 'weapon5': '0.230', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'HITCOUNT': '0.530', 'WEAPON5': '0.550', 'weapon4': '0.920', 'weapon2': '1.108', 'weapon3': '1.134', 'DAMAGECOUNT': '1.845', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:21:45,379][2409074] Updated weights for policy 0, policy_version 23171 (0.0012)
[2023-02-25 13:21:45,678][2409077] DAMAGECOUNT value on done: 8838.0
[2023-02-25 13:21:45,678][2409077] Sum rewards: 19.227, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.094', 'AMMO5': '0.017', 'AMMO2': '0.036', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.181', 'weapon5': '0.230', 'weapon4': '0.314', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'HITCOUNT': '1.200', 'weapon2': '1.222', 'weapon3': '1.834', 'DAMAGECOUNT': '4.677', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:21:45,790][2409103] DAMAGECOUNT value on done: 8672.0
[2023-02-25 13:21:45,792][2409103] Sum rewards: 11.408, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.452', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO3': '0.087', 'weapon5': '0.206', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.870', 'weapon2': '1.690', 'weapon3': '1.822', 'DAMAGECOUNT': '3.042', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:21:45,909][2409596] DAMAGECOUNT value on done: 7686.0
[2023-02-25 13:21:45,910][2409596] Sum rewards: 10.841, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.133', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'AMMO3': '0.105', 'weapon5': '0.146', 'WEAPON4': '0.150', 'AMMO4': '0.178', 'weapon4': '0.236', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '0.820', 'weapon3': '1.412', 'weapon2': '1.428', 'DAMAGECOUNT': '3.228', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:21:45,986][2409105] DAMAGECOUNT value on done: 7553.0
[2023-02-25 13:21:45,989][2409406] DAMAGECOUNT value on done: 8465.0
[2023-02-25 13:21:45,989][2409105] Sum rewards: 11.202, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.130', 'AMMO5': '0.003', 'AMMO2': '0.012', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'weapon7': '0.060', 'AMMO4': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON3': '0.350', 'weapon3': '0.708', 'HITCOUNT': '0.770', 'weapon2': '0.918', 'weapon4': '1.266', 'DAMAGECOUNT': '2.631', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:21:45,994][2409406] Sum rewards: 7.991, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.982', 'AMMO2': '0.004', 'WEAPON1': '0.020', 'AMMO4': '0.021', 'weapon5': '0.024', 'AMMO5': '0.025', 'weapon7': '0.088', 'AMMO3': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon2': '0.496', 'WEAPON5': '0.500', 'HITCOUNT': '0.510', 'WEAPON3': '0.600', 'weapon3': '1.032', 'DAMAGECOUNT': '2.760', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:21:46,081][2409102] DAMAGECOUNT value on done: 7438.0
[2023-02-25 13:21:46,084][2409102] Sum rewards: 7.526, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.327', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.012', 'weapon7': '0.052', 'AMMO3': '0.058', 'weapon5': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.180', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'weapon3': '0.634', 'ARMOR': '0.895', 'weapon2': '1.430', 'DAMAGECOUNT': '2.133', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:21:46,480][2409074] Updated weights for policy 0, policy_version 23181 (0.0013)
[2023-02-25 13:21:46,620][2409565] DAMAGECOUNT value on done: 8837.0
[2023-02-25 13:21:46,621][2409565] Sum rewards: 23.335, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.370', 'AMMO5': '0.020', 'AMMO2': '0.027', 'AMMO3': '0.063', 'AMMO4': '0.133', 'WEAPON4': '0.150', 'weapon5': '0.190', 'weapon4': '0.260', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'weapon2': '1.230', 'HITCOUNT': '1.370', 'weapon3': '1.518', 'DAMAGECOUNT': '5.994', 'FRAGCOUNT': '16.000'}
[2023-02-25 13:21:46,713][2409469] DAMAGECOUNT value on done: 8240.0
[2023-02-25 13:21:46,714][2409469] Sum rewards: 14.605, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.200', 'AMMO2': '0.006', 'AMMO5': '0.022', 'AMMO4': '0.028', 'AMMO3': '0.085', 'WEAPON4': '0.150', 'weapon5': '0.176', 'weapon4': '0.296', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '0.710', 'ARMOR': '1.308', 'weapon3': '1.322', 'weapon2': '2.038', 'DAMAGECOUNT': '4.014', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:21:46,820][2409597] DAMAGECOUNT value on done: 7779.0
[2023-02-25 13:21:46,821][2409597] Sum rewards: 10.759, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.184', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'AMMO5': '0.012', 'WEAPON4': '0.050', 'weapon4': '0.058', 'AMMO3': '0.070', 'weapon5': '0.328', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.760', 'ARMOR': '1.301', 'weapon3': '1.588', 'weapon2': '1.728', 'DAMAGECOUNT': '3.648', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:21:46,864][2409548] DAMAGECOUNT value on done: 8706.0
[2023-02-25 13:21:46,865][2409548] Sum rewards: 13.090, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.655', 'AMMO2': '0.008', 'AMMO5': '0.032', 'AMMO4': '0.042', 'AMMO3': '0.142', 'weapon5': '0.278', 'WEAPON5': '0.600', 'HITCOUNT': '0.770', 'WEAPON3': '0.800', 'ARMOR': '0.851', 'weapon2': '1.182', 'weapon3': '2.052', 'DAMAGECOUNT': '3.987', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:21:47,039][2409104] DAMAGECOUNT value on done: 8677.0
[2023-02-25 13:21:47,043][2409104] Sum rewards: 17.863, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.246', 'AMMO2': '0.011', 'AMMO5': '0.022', 'AMMO4': '0.053', 'weapon4': '0.066', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.330', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '1.140', 'weapon2': '1.188', 'weapon3': '2.020', 'DAMAGECOUNT': '4.839', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:21:47,054][2409075] DAMAGECOUNT value on done: 6541.0
[2023-02-25 13:21:47,055][2409075] Sum rewards: 4.449, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.360', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO3': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'weapon5': '0.062', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.200', 'WEAPON3': '0.300', 'HITCOUNT': '0.300', 'ARMOR': '0.448', 'weapon3': '0.804', 'DAMAGECOUNT': '1.056', 'weapon4': '1.362', 'weapon2': '1.490', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:21:47,186][2408954] Fps is (10 sec: 25395.0, 60 sec: 24575.9, 300 sec: 24201.1). Total num frames: 94961664. Throughput: 0: 6168.8. Samples: 23746896. Policy #0 lag: (min: 1.0, avg: 11.2, max: 27.0)
[2023-02-25 13:21:47,187][2408954] Avg episode reward: [(0, '12.501')]
[2023-02-25 13:21:47,361][2409101] DAMAGECOUNT value on done: 9447.0
[2023-02-25 13:21:47,364][2409101] Sum rewards: 11.353, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.585', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO3': '0.060', 'weapon7': '0.088', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'weapon5': '0.154', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.590', 'weapon2': '0.592', 'weapon4': '0.826', 'weapon3': '0.996', 'DAMAGECOUNT': '2.769', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:21:47,372][2409389] DAMAGECOUNT value on done: 8785.0
[2023-02-25 13:21:47,376][2409389] Sum rewards: 11.585, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.290', 'AMMO4': '-0.059', 'AMMO2': '-0.012', 'AMMO5': '0.017', 'AMMO3': '0.072', 'weapon5': '0.320', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '0.650', 'weapon3': '1.500', 'weapon2': '1.710', 'DAMAGECOUNT': '3.726', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:21:47,460][2409355] DAMAGECOUNT value on done: 9346.0
[2023-02-25 13:21:47,464][2409355] Sum rewards: 16.923, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.792', 'AMMO2': '0.004', 'AMMO5': '0.017', 'AMMO4': '0.018', 'AMMO3': '0.093', 'weapon5': '0.264', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '1.040', 'weapon3': '1.414', 'weapon2': '1.934', 'DAMAGECOUNT': '5.481', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:21:47,567][2409866] DAMAGECOUNT value on done: 10021.0
[2023-02-25 13:21:47,569][2409866] Sum rewards: 12.975, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.122', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO5': '0.028', 'weapon4': '0.064', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'weapon5': '0.180', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'ARMOR': '0.849', 'HITCOUNT': '1.030', 'weapon2': '1.290', 'weapon3': '1.974', 'DAMAGECOUNT': '4.269', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:21:47,640][2409100] DAMAGECOUNT value on done: 8004.0
[2023-02-25 13:21:47,644][2409100] Sum rewards: 8.774, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.120', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'AMMO3': '0.076', 'weapon4': '0.120', 'weapon5': '0.218', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'HITCOUNT': '0.730', 'ARMOR': '0.800', 'weapon2': '1.552', 'weapon3': '1.572', 'DAMAGECOUNT': '2.481', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:21:47,912][2409485] DAMAGECOUNT value on done: 8155.0
[2023-02-25 13:21:47,927][2409485] Sum rewards: 10.213, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.130', 'AMMO2': '0.015', 'weapon4': '0.026', 'AMMO5': '0.032', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.073', 'AMMO3': '0.117', 'weapon5': '0.296', 'ARMOR': '0.400', 'WEAPON5': '0.750', 'HITCOUNT': '0.750', 'WEAPON3': '0.850', 'weapon2': '1.350', 'weapon3': '1.932', 'DAMAGECOUNT': '3.912', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:21:47,962][2409097] DAMAGECOUNT value on done: 8710.0
[2023-02-25 13:21:47,965][2409097] Sum rewards: 5.232, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.097', 'AMMO2': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.049', 'weapon7': '0.050', 'AMMO3': '0.079', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.450', 'WEAPON3': '0.550', 'weapon4': '0.760', 'ARMOR': '0.859', 'weapon3': '1.366', 'weapon2': '1.534', 'DAMAGECOUNT': '1.605', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:21:48,359][2409078] DAMAGECOUNT value on done: 8321.0
[2023-02-25 13:21:48,364][2409078] Sum rewards: 13.213, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.858', 'weapon7': '0.012', 'AMMO2': '0.014', 'AMMO5': '0.015', 'weapon4': '0.044', 'AMMO4': '0.071', 'AMMO3': '0.099', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'ARMOR': '0.856', 'HITCOUNT': '0.970', 'weapon2': '1.604', 'weapon3': '1.742', 'DAMAGECOUNT': '3.633', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:21:48,510][2409074] Updated weights for policy 0, policy_version 23191 (0.0012)
[2023-02-25 13:21:48,619][2409407] DAMAGECOUNT value on done: 8273.0
[2023-02-25 13:21:48,622][2409407] Sum rewards: 15.542, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.286', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.020', 'WEAPON1': '0.040', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'weapon4': '0.190', 'weapon5': '0.292', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.780', 'ARMOR': '0.879', 'weapon3': '1.320', 'weapon2': '1.596', 'DAMAGECOUNT': '4.128', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:21:49,119][2409405] DAMAGECOUNT value on done: 9649.0
[2023-02-25 13:21:49,122][2409405] Sum rewards: 20.413, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.402', 'AMMO2': '0.013', 'AMMO5': '0.015', 'AMMO3': '0.060', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'weapon7': '0.118', 'weapon5': '0.144', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.432', 'WEAPON3': '0.450', 'HITCOUNT': '0.820', 'ARMOR': '0.910', 'weapon2': '1.278', 'weapon3': '1.352', 'DAMAGECOUNT': '4.416', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:21:49,203][2409373] DAMAGECOUNT value on done: 8742.0
[2023-02-25 13:21:49,203][2409373] Sum rewards: 12.834, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.148', 'AMMO2': '0.018', 'AMMO5': '0.030', 'AMMO4': '0.088', 'AMMO3': '0.110', 'weapon5': '0.194', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '0.860', 'ARMOR': '1.300', 'weapon2': '1.406', 'weapon3': '1.848', 'DAMAGECOUNT': '3.678', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:21:49,485][2409077] DAMAGECOUNT value on done: 9062.0
[2023-02-25 13:21:49,487][2409077] Sum rewards: 13.228, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.171', 'AMMO2': '0.017', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'weapon7': '0.058', 'AMMO3': '0.077', 'AMMO4': '0.083', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.242', 'WEAPON4': '0.300', 'weapon4': '0.418', 'ARMOR': '0.446', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '0.820', 'weapon2': '0.952', 'weapon3': '1.532', 'DAMAGECOUNT': '4.776', 'FRAGCOUNT': '11.500'}
[2023-02-25 13:21:49,738][2409596] DAMAGECOUNT value on done: 6978.0
[2023-02-25 13:21:49,742][2409596] Sum rewards: 11.966, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.240', 'AMMO2': '0.007', 'AMMO5': '0.012', 'AMMO4': '0.033', 'WEAPON1': '0.040', 'weapon5': '0.064', 'AMMO3': '0.081', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon7': '0.264', 'AMMO6': '0.340', 'AMMO7': '0.340', 'ARMOR': '0.452', 'WEAPON7': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.690', 'weapon2': '0.868', 'weapon3': '1.200', 'weapon4': '1.254', 'DAMAGECOUNT': '4.011', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:21:49,762][2409406] DAMAGECOUNT value on done: 8357.0
[2023-02-25 13:21:49,763][2409406] Sum rewards: 15.896, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.879', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO5': '0.026', 'AMMO4': '0.068', 'AMMO3': '0.089', 'weapon4': '0.160', 'WEAPON4': '0.200', 'weapon5': '0.240', 'WEAPON5': '0.450', 'ARMOR': '0.468', 'WEAPON3': '0.700', 'HITCOUNT': '1.010', 'weapon2': '1.222', 'weapon3': '1.700', 'DAMAGECOUNT': '4.917', 'FRAGCOUNT': '12.500'}
[2023-02-25 13:21:49,837][2409103] DAMAGECOUNT value on done: 9048.0
[2023-02-25 13:21:49,838][2409103] Sum rewards: 13.032, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.340', 'AMMO5': '0.018', 'AMMO2': '0.025', 'AMMO3': '0.066', 'weapon7': '0.068', 'weapon5': '0.092', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO6': '0.400', 'WEAPON7': '0.400', 'AMMO7': '0.400', 'WEAPON3': '0.450', 'ARMOR': '0.451', 'HITCOUNT': '0.820', 'weapon4': '0.916', 'weapon3': '1.222', 'weapon2': '1.348', 'DAMAGECOUNT': '3.120', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:21:49,959][2409074] Updated weights for policy 0, policy_version 23201 (0.0013)
[2023-02-25 13:21:50,123][2409076] DAMAGECOUNT value on done: 7917.0
[2023-02-25 13:21:50,123][2409076] Sum rewards: 13.687, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.525', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'AMMO4': '0.025', 'weapon4': '0.058', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.226', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.620', 'ARMOR': '1.276', 'weapon3': '1.326', 'weapon2': '2.090', 'DAMAGECOUNT': '2.532', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:21:50,405][2409548] DAMAGECOUNT value on done: 9960.0
[2023-02-25 13:21:50,408][2409548] Sum rewards: 15.463, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.238', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO4': '0.097', 'AMMO3': '0.129', 'WEAPON4': '0.150', 'weapon5': '0.192', 'weapon4': '0.298', 'ARMOR': '0.457', 'WEAPON5': '0.600', 'WEAPON3': '0.900', 'weapon2': '0.902', 'HITCOUNT': '1.110', 'weapon3': '1.846', 'DAMAGECOUNT': '5.205', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:21:50,444][2409102] DAMAGECOUNT value on done: 8124.0
[2023-02-25 13:21:50,445][2409102] Sum rewards: 12.755, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.142', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO2': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.111', 'weapon5': '0.128', 'AMMO4': '0.148', 'weapon4': '0.284', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.700', 'weapon2': '1.234', 'weapon3': '1.984', 'DAMAGECOUNT': '3.588', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:21:50,525][2409105] DAMAGECOUNT value on done: 8783.0
[2023-02-25 13:21:50,535][2409105] Sum rewards: 15.295, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.017', 'AMMO2': '0.027', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'AMMO4': '0.135', 'weapon5': '0.262', 'WEAPON5': '0.300', 'weapon4': '0.364', 'WEAPON3': '0.500', 'HEALTH': '0.594', 'ARMOR': '0.800', 'weapon2': '1.050', 'HITCOUNT': '1.080', 'weapon3': '1.496', 'DAMAGECOUNT': '4.473', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:21:50,689][2409469] DAMAGECOUNT value on done: 9301.0
[2023-02-25 13:21:50,690][2409469] Sum rewards: 10.448, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.930', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.039', 'AMMO4': '0.046', 'AMMO3': '0.096', 'weapon4': '0.098', 'WEAPON4': '0.100', 'weapon5': '0.198', 'WEAPON5': '0.600', 'WEAPON3': '0.650', 'HITCOUNT': '0.720', 'ARMOR': '1.337', 'weapon2': '1.674', 'weapon3': '1.686', 'DAMAGECOUNT': '3.864', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:21:50,882][2409104] DAMAGECOUNT value on done: 7443.0
[2023-02-25 13:21:50,885][2409104] Sum rewards: 12.286, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.341', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO5': '0.012', 'AMMO3': '0.070', 'weapon5': '0.312', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'HITCOUNT': '0.740', 'weapon2': '1.428', 'weapon3': '1.718', 'DAMAGECOUNT': '3.030', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:21:50,979][2409075] DAMAGECOUNT value on done: 7944.0
[2023-02-25 13:21:50,982][2409075] Sum rewards: 12.188, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.348', 'AMMO5': '0.015', 'AMMO2': '0.019', 'weapon5': '0.064', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'WEAPON5': '0.250', 'weapon4': '0.266', 'WEAPON3': '0.750', 'ARMOR': '0.800', 'HITCOUNT': '0.970', 'weapon2': '1.016', 'weapon3': '1.880', 'DAMAGECOUNT': '3.690', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:21:50,995][2409565] DAMAGECOUNT value on done: 7448.0
[2023-02-25 13:21:51,004][2409565] Sum rewards: 15.432, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.604', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon7': '0.052', 'AMMO3': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.100', 'weapon5': '0.158', 'WEAPON4': '0.200', 'weapon4': '0.264', 'WEAPON5': '0.300', 'ARMOR': '0.424', 'WEAPON3': '0.600', 'HITCOUNT': '0.930', 'weapon2': '1.200', 'weapon3': '1.726', 'DAMAGECOUNT': '4.407', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:21:51,051][2409101] DAMAGECOUNT value on done: 9422.0
[2023-02-25 13:21:51,051][2409101] Sum rewards: 10.431, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.452', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO5': '0.017', 'AMMO3': '0.107', 'weapon5': '0.166', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'HITCOUNT': '0.790', 'ARMOR': '0.856', 'weapon3': '1.584', 'weapon2': '1.706', 'DAMAGECOUNT': '3.840', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:21:51,314][2409389] DAMAGECOUNT value on done: 8752.0
[2023-02-25 13:21:51,316][2409389] Sum rewards: 8.644, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.134', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO3': '0.087', 'AMMO4': '0.153', 'weapon5': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon4': '0.534', 'HITCOUNT': '0.540', 'WEAPON3': '0.550', 'weapon2': '0.806', 'weapon3': '1.676', 'DAMAGECOUNT': '2.934', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:21:51,371][2409597] DAMAGECOUNT value on done: 8836.0
[2023-02-25 13:21:51,372][2409597] Sum rewards: 12.833, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'weapon7': '0.062', 'AMMO3': '0.063', 'AMMO4': '0.064', 'HEALTH': '0.096', 'WEAPON4': '0.100', 'weapon5': '0.102', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.690', 'weapon3': '1.002', 'weapon2': '1.246', 'weapon4': '1.294', 'DAMAGECOUNT': '3.591', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:21:51,610][2409097] DAMAGECOUNT value on done: 7709.0
[2023-02-25 13:21:51,615][2409097] Sum rewards: 18.883, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.635', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.014', 'weapon4': '0.024', 'WEAPON4': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.078', 'WEAPON5': '0.300', 'weapon5': '0.322', 'ARMOR': '0.470', 'WEAPON3': '0.500', 'HITCOUNT': '1.020', 'weapon3': '1.334', 'weapon2': '1.538', 'DAMAGECOUNT': '4.278', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:21:51,649][2409074] Updated weights for policy 0, policy_version 23211 (0.0012)
[2023-02-25 13:21:51,804][2409485] DAMAGECOUNT value on done: 9481.0
[2023-02-25 13:21:51,805][2409485] Sum rewards: 9.877, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.774', 'AMMO5': '0.023', 'AMMO2': '0.037', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.125', 'AMMO4': '0.186', 'WEAPON7': '0.200', 'weapon5': '0.210', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'weapon4': '0.650', 'WEAPON3': '0.850', 'weapon2': '0.870', 'ARMOR': '0.911', 'HITCOUNT': '0.940', 'weapon3': '1.764', 'DAMAGECOUNT': '4.704', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:21:51,904][2409355] DAMAGECOUNT value on done: 8373.0
[2023-02-25 13:21:51,905][2409355] Sum rewards: 13.091, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.013', 'AMMO5': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.065', 'weapon4': '0.096', 'AMMO3': '0.111', 'weapon5': '0.126', 'WEAPON5': '0.300', 'HEALTH': '0.580', 'WEAPON3': '0.650', 'HITCOUNT': '0.810', 'ARMOR': '1.488', 'weapon2': '1.506', 'weapon3': '1.910', 'DAMAGECOUNT': '2.871', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:21:52,015][2409078] DAMAGECOUNT value on done: 7485.0
[2023-02-25 13:21:52,015][2409078] Sum rewards: 12.200, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.712', 'WEAPON1': '0.010', 'AMMO5': '0.031', 'AMMO2': '0.033', 'AMMO3': '0.120', 'AMMO4': '0.166', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.300', 'weapon2': '0.494', 'WEAPON4': '0.550', 'WEAPON5': '0.800', 'WEAPON3': '0.800', 'ARMOR': '0.895', 'weapon4': '0.912', 'HITCOUNT': '0.920', 'weapon3': '1.786', 'DAMAGECOUNT': '4.494', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:21:52,016][2409866] DAMAGECOUNT value on done: 8737.0
[2023-02-25 13:21:52,018][2409866] Sum rewards: 7.908, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.676', 'AMMO5': '0.020', 'AMMO2': '0.033', 'weapon7': '0.134', 'AMMO3': '0.138', 'weapon5': '0.154', 'AMMO4': '0.165', 'weapon4': '0.286', 'WEAPON4': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'WEAPON5': '0.450', 'HITCOUNT': '0.840', 'WEAPON3': '0.850', 'weapon2': '0.996', 'weapon3': '1.992', 'DAMAGECOUNT': '4.536', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:21:52,152][2409407] DAMAGECOUNT value on done: 8628.0
[2023-02-25 13:21:52,156][2409407] Sum rewards: 15.175, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.836', 'AMMO5': '0.017', 'AMMO2': '0.026', 'AMMO3': '0.078', 'weapon5': '0.086', 'AMMO4': '0.132', 'weapon7': '0.152', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'weapon4': '0.762', 'ARMOR': '0.853', 'HITCOUNT': '1.040', 'weapon2': '1.124', 'weapon3': '1.398', 'DAMAGECOUNT': '4.392', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:21:52,186][2408954] Fps is (10 sec: 23756.2, 60 sec: 24507.6, 300 sec: 24201.1). Total num frames: 95076352. Throughput: 0: 6196.0. Samples: 23765688. Policy #0 lag: (min: 1.0, avg: 11.2, max: 27.0)
[2023-02-25 13:21:52,186][2408954] Avg episode reward: [(0, '12.498')]
[2023-02-25 13:21:52,726][2409405] DAMAGECOUNT value on done: 8564.0
[2023-02-25 13:21:52,729][2409405] Sum rewards: 18.841, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.688', 'AMMO2': '0.011', 'AMMO5': '0.019', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.055', 'weapon7': '0.072', 'AMMO3': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.370', 'weapon4': '0.442', 'ARMOR': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '1.040', 'weapon2': '1.088', 'weapon3': '1.558', 'DAMAGECOUNT': '5.448', 'FRAGCOUNT': '12.500'}
[2023-02-25 13:21:53,176][2409373] DAMAGECOUNT value on done: 8428.0
[2023-02-25 13:21:53,179][2409373] Sum rewards: 9.246, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.246', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'weapon7': '0.060', 'weapon4': '0.082', 'AMMO3': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.140', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'HITCOUNT': '0.940', 'weapon2': '1.080', 'weapon3': '1.834', 'DAMAGECOUNT': '3.306', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:21:53,425][2409077] DAMAGECOUNT value on done: 8017.0
[2023-02-25 13:21:53,426][2409077] Sum rewards: 12.134, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.716', 'AMMO2': '0.007', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'AMMO3': '0.115', 'weapon4': '0.238', 'weapon5': '0.280', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'HITCOUNT': '1.010', 'weapon2': '1.136', 'weapon3': '1.772', 'DAMAGECOUNT': '3.669', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:21:53,510][2409406] Large shaping reward 2.615 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.585, 195.0)]
[2023-02-25 13:21:53,582][2409074] Updated weights for policy 0, policy_version 23221 (0.0012)
[2023-02-25 13:21:53,670][2409103] DAMAGECOUNT value on done: 8742.0
[2023-02-25 13:21:53,672][2409103] Sum rewards: 18.089, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.027', 'AMMO2': '0.028', 'AMMO4': '0.138', 'AMMO3': '0.139', 'WEAPON4': '0.150', 'weapon4': '0.280', 'weapon5': '0.286', 'HEALTH': '0.445', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'weapon2': '0.784', 'HITCOUNT': '0.850', 'ARMOR': '1.352', 'weapon3': '2.096', 'DAMAGECOUNT': '4.314', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:21:53,720][2409406] DAMAGECOUNT value on done: 7611.0
[2023-02-25 13:21:53,723][2409406] Sum rewards: 15.182, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.050', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.020', 'weapon7': '0.048', 'AMMO3': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'weapon4': '0.578', 'HITCOUNT': '1.030', 'weapon3': '1.172', 'weapon2': '1.282', 'DAMAGECOUNT': '4.356', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:21:54,025][2409596] DAMAGECOUNT value on done: 8008.0
[2023-02-25 13:21:54,026][2409596] Sum rewards: 15.873, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.064', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO3': '0.073', 'weapon7': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon5': '0.234', 'WEAPON3': '0.450', 'weapon4': '0.678', 'HITCOUNT': '0.740', 'ARMOR': '0.800', 'weapon3': '1.148', 'weapon2': '1.350', 'DAMAGECOUNT': '3.591', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:21:54,095][2409548] DAMAGECOUNT value on done: 9684.0
[2023-02-25 13:21:54,098][2409548] Sum rewards: 19.496, reward structure: {'DEATHCOUNT': '-5.250', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO5': '0.014', 'AMMO4': '0.063', 'AMMO3': '0.081', 'weapon5': '0.242', 'WEAPON5': '0.250', 'HEALTH': '0.362', 'WEAPON3': '0.450', 'HITCOUNT': '0.780', 'ARMOR': '0.851', 'weapon3': '1.370', 'weapon2': '1.846', 'DAMAGECOUNT': '4.413', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:21:54,255][2409076] DAMAGECOUNT value on done: 8830.0
[2023-02-25 13:21:54,256][2409076] Sum rewards: 13.864, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.323', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.015', 'AMMO3': '0.060', 'weapon7': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.206', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.451', 'HITCOUNT': '0.820', 'weapon3': '1.318', 'weapon2': '2.234', 'DAMAGECOUNT': '4.317', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:21:54,410][2409102] DAMAGECOUNT value on done: 9120.0
[2023-02-25 13:21:54,411][2409102] Sum rewards: 25.518, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.762', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'AMMO5': '0.025', 'weapon7': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.109', 'weapon5': '0.136', 'WEAPON4': '0.150', 'weapon4': '0.418', 'ARMOR': '0.455', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'weapon2': '1.000', 'HITCOUNT': '1.480', 'weapon3': '1.914', 'DAMAGECOUNT': '6.972', 'FRAGCOUNT': '20.000'}
[2023-02-25 13:21:54,528][2409105] DAMAGECOUNT value on done: 8440.0
[2023-02-25 13:21:54,529][2409105] Sum rewards: 9.308, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.885', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'AMMO5': '0.017', 'weapon7': '0.068', 'AMMO3': '0.071', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.294', 'WEAPON5': '0.400', 'HITCOUNT': '0.520', 'WEAPON3': '0.600', 'ARMOR': '1.360', 'weapon3': '1.586', 'weapon2': '1.678', 'DAMAGECOUNT': '2.961', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:21:54,641][2409101] DAMAGECOUNT value on done: 7653.0
[2023-02-25 13:21:54,643][2409101] Sum rewards: 13.276, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.460', 'AMMO2': '0.016', 'AMMO5': '0.022', 'weapon7': '0.070', 'AMMO4': '0.080', 'AMMO3': '0.080', 'WEAPON4': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon5': '0.178', 'WEAPON7': '0.200', 'weapon4': '0.302', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.880', 'ARMOR': '0.899', 'weapon2': '1.144', 'weapon3': '1.462', 'DAMAGECOUNT': '2.982', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:21:54,667][2409074] Updated weights for policy 0, policy_version 23231 (0.0014)
[2023-02-25 13:21:54,923][2409565] DAMAGECOUNT value on done: 7598.0
[2023-02-25 13:21:54,926][2409565] Sum rewards: 9.552, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.559', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO3': '0.060', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'weapon5': '0.120', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.558', 'HITCOUNT': '0.580', 'ARMOR': '0.800', 'weapon3': '0.974', 'weapon2': '1.258', 'DAMAGECOUNT': '2.091', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:21:55,057][2409075] DAMAGECOUNT value on done: 9145.0
[2023-02-25 13:21:55,060][2409075] Sum rewards: 8.813, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.878', 'AMMO2': '0.011', 'AMMO5': '0.012', 'AMMO4': '0.054', 'AMMO3': '0.070', 'weapon7': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'HITCOUNT': '0.440', 'weapon4': '0.440', 'ARMOR': '0.447', 'WEAPON3': '0.600', 'weapon2': '1.008', 'weapon3': '1.248', 'DAMAGECOUNT': '3.198', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:21:55,133][2409104] DAMAGECOUNT value on done: 7537.0
[2023-02-25 13:21:55,134][2409104] Sum rewards: 13.692, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.552', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO5': '0.012', 'WEAPON4': '0.100', 'weapon4': '0.112', 'AMMO3': '0.115', 'weapon5': '0.148', 'WEAPON5': '0.350', 'HITCOUNT': '0.650', 'WEAPON3': '0.750', 'ARMOR': '1.295', 'weapon3': '1.694', 'weapon2': '1.790', 'DAMAGECOUNT': '3.519', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:21:55,296][2409486] DAMAGECOUNT value on done: 6248.0
[2023-02-25 13:21:55,297][2409486] Sum rewards: 14.165, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.612', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'weapon7': '0.016', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO3': '0.071', 'WEAPON4': '0.200', 'weapon5': '0.346', 'AMMO6': '0.400', 'WEAPON7': '0.400', 'AMMO7': '0.400', 'ARMOR': '0.435', 'WEAPON5': '0.450', 'weapon4': '0.556', 'WEAPON3': '0.600', 'HITCOUNT': '0.790', 'weapon2': '0.866', 'weapon3': '1.638', 'DAMAGECOUNT': '3.582', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:21:55,303][2409469] DAMAGECOUNT value on done: 9148.0
[2023-02-25 13:21:55,304][2409469] Sum rewards: 11.603, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.072', 'AMMO5': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.056', 'weapon5': '0.082', 'AMMO4': '0.102', 'weapon7': '0.226', 'WEAPON4': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.570', 'ARMOR': '0.859', 'weapon2': '1.106', 'weapon3': '1.122', 'weapon4': '1.128', 'DAMAGECOUNT': '2.793', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:21:55,358][2409389] DAMAGECOUNT value on done: 8423.0
[2023-02-25 13:21:55,358][2409389] Sum rewards: 8.295, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.260', 'AMMO2': '0.013', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'AMMO4': '0.066', 'AMMO3': '0.091', 'WEAPON4': '0.150', 'weapon4': '0.176', 'weapon5': '0.270', 'ARMOR': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '0.680', 'weapon3': '1.326', 'weapon2': '1.458', 'DAMAGECOUNT': '2.865', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:21:55,641][2409485] DAMAGECOUNT value on done: 7564.0
[2023-02-25 13:21:55,645][2409485] Sum rewards: 22.293, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.766', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.027', 'AMMO3': '0.124', 'AMMO4': '0.134', 'weapon4': '0.268', 'WEAPON4': '0.300', 'weapon5': '0.346', 'WEAPON5': '0.450', 'ARMOR': '0.451', 'WEAPON3': '0.800', 'weapon2': '0.950', 'HITCOUNT': '1.410', 'weapon3': '1.828', 'DAMAGECOUNT': '6.444', 'FRAGCOUNT': '17.000'}
[2023-02-25 13:21:55,647][2409097] DAMAGECOUNT value on done: 8693.0
[2023-02-25 13:21:55,647][2409078] DAMAGECOUNT value on done: 9211.0
[2023-02-25 13:21:55,648][2409078] Sum rewards: 11.087, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.058', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'AMMO5': '0.025', 'AMMO3': '0.113', 'AMMO4': '0.123', 'weapon5': '0.178', 'weapon4': '0.358', 'WEAPON4': '0.400', 'ARMOR': '0.447', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'HITCOUNT': '1.300', 'weapon2': '1.358', 'weapon3': '1.710', 'DAMAGECOUNT': '4.698', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:21:55,650][2409097] Sum rewards: 11.875, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.430', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.036', 'weapon7': '0.064', 'AMMO3': '0.099', 'WEAPON4': '0.150', 'weapon5': '0.170', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.422', 'WEAPON3': '0.650', 'HITCOUNT': '0.730', 'ARMOR': '0.908', 'weapon3': '1.446', 'weapon2': '1.606', 'DAMAGECOUNT': '3.900', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:21:55,805][2409597] DAMAGECOUNT value on done: 10070.0
[2023-02-25 13:21:55,805][2409355] DAMAGECOUNT value on done: 7551.0
[2023-02-25 13:21:55,806][2409597] Sum rewards: 13.333, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.730', 'AMMO5': '0.020', 'AMMO2': '0.029', 'weapon7': '0.048', 'AMMO3': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.124', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.582', 'WEAPON3': '0.650', 'HITCOUNT': '1.230', 'weapon2': '1.372', 'ARMOR': '1.399', 'weapon3': '1.556', 'DAMAGECOUNT': '4.512', 'FRAGCOUNT': '10.500'}
[2023-02-25 13:21:55,806][2409355] Sum rewards: 12.193, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'AMMO2': '0.034', 'AMMO3': '0.045', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO4': '0.170', 'HEALTH': '0.170', 'WEAPON4': '0.250', 'WEAPON3': '0.250', 'weapon2': '0.518', 'HITCOUNT': '0.720', 'weapon3': '0.806', 'weapon4': '1.492', 'DAMAGECOUNT': '2.931', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:21:55,941][2409866] DAMAGECOUNT value on done: 7786.0
[2023-02-25 13:21:55,943][2409866] Sum rewards: 9.666, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.060', 'HEALTH': '0.073', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'weapon5': '0.424', 'ARMOR': '0.452', 'HITCOUNT': '0.690', 'weapon3': '1.334', 'weapon2': '1.468', 'DAMAGECOUNT': '2.646', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:21:56,182][2409407] DAMAGECOUNT value on done: 7647.0
[2023-02-25 13:21:56,186][2409407] Sum rewards: 2.323, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.260', 'WEAPON1': '0.020', 'AMMO5': '0.034', 'AMMO2': '0.054', 'weapon7': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.180', 'AMMO3': '0.197', 'WEAPON7': '0.200', 'AMMO4': '0.271', 'ARMOR': '0.413', 'WEAPON4': '0.450', 'weapon4': '0.478', 'weapon2': '0.716', 'HITCOUNT': '0.750', 'WEAPON5': '0.800', 'WEAPON3': '1.250', 'weapon3': '2.070', 'DAMAGECOUNT': '3.135', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:21:56,259][2409079] DAMAGECOUNT value on done: 7749.0
[2023-02-25 13:21:56,261][2409079] Sum rewards: 6.528, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.760', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.036', 'AMMO3': '0.156', 'weapon4': '0.164', 'AMMO4': '0.178', 'weapon5': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'HITCOUNT': '0.940', 'WEAPON3': '1.000', 'weapon2': '1.074', 'weapon3': '2.098', 'DAMAGECOUNT': '3.375', 'FRAGCOUNT': '9.500'}
[2023-02-25 13:21:56,381][2409405] DAMAGECOUNT value on done: 7921.0
[2023-02-25 13:21:56,384][2409405] Sum rewards: 14.168, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.006', 'AMMO5': '0.022', 'AMMO4': '0.029', 'AMMO3': '0.071', 'HEALTH': '0.145', 'weapon5': '0.380', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.800', 'weapon3': '1.498', 'ARMOR': '1.600', 'weapon2': '1.828', 'DAMAGECOUNT': '3.438', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:21:56,542][2409373] Large shaping reward 2.560 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.54, 180.0)]
[2023-02-25 13:21:56,838][2409074] Updated weights for policy 0, policy_version 23241 (0.0012)
[2023-02-25 13:21:57,051][2409373] DAMAGECOUNT value on done: 7546.0
[2023-02-25 13:21:57,053][2409373] Sum rewards: 10.561, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.452', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO3': '0.041', 'weapon7': '0.054', 'AMMO4': '0.066', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'HITCOUNT': '0.600', 'weapon3': '0.996', 'weapon4': '1.234', 'weapon2': '1.252', 'DAMAGECOUNT': '2.475', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:21:57,186][2408954] Fps is (10 sec: 24166.6, 60 sec: 24644.2, 300 sec: 24242.8). Total num frames: 95203328. Throughput: 0: 6195.5. Samples: 23802780. Policy #0 lag: (min: 1.0, avg: 11.2, max: 27.0)
[2023-02-25 13:21:57,187][2408954] Avg episode reward: [(0, '12.906')]
[2023-02-25 13:21:57,192][2409033] Saving new best policy, reward=12.906!
[2023-02-25 13:21:57,330][2409077] DAMAGECOUNT value on done: 7391.0
[2023-02-25 13:21:57,331][2409077] Sum rewards: 11.709, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.935', 'AMMO2': '0.024', 'AMMO5': '0.030', 'weapon7': '0.054', 'AMMO3': '0.100', 'AMMO4': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.218', 'WEAPON4': '0.350', 'weapon4': '0.386', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'HITCOUNT': '0.890', 'weapon2': '1.204', 'ARMOR': '1.329', 'weapon3': '1.798', 'DAMAGECOUNT': '3.603', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:21:57,607][2409406] DAMAGECOUNT value on done: 7971.0
[2023-02-25 13:21:57,608][2409406] Sum rewards: 13.631, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.796', 'AMMO2': '0.013', 'AMMO5': '0.019', 'weapon7': '0.054', 'AMMO4': '0.065', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'weapon5': '0.148', 'weapon4': '0.322', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'HITCOUNT': '1.090', 'weapon2': '1.218', 'weapon3': '1.918', 'DAMAGECOUNT': '3.963', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:21:57,824][2409596] DAMAGECOUNT value on done: 7273.0
[2023-02-25 13:21:57,828][2409596] Sum rewards: 17.999, reward structure: {'DEATHCOUNT': '-4.500', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.036', 'AMMO3': '0.079', 'AMMO4': '0.182', 'WEAPON4': '0.250', 'weapon4': '0.276', 'WEAPON5': '0.300', 'weapon5': '0.312', 'WEAPON3': '0.450', 'HEALTH': '0.493', 'ARMOR': '0.940', 'HITCOUNT': '0.990', 'weapon2': '1.054', 'weapon3': '1.670', 'DAMAGECOUNT': '3.939', 'FRAGCOUNT': '11.500'}
[2023-02-25 13:21:57,887][2409076] DAMAGECOUNT value on done: 7760.0
[2023-02-25 13:21:57,888][2409076] Sum rewards: 15.853, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.815', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.010', 'AMMO3': '0.080', 'weapon5': '0.192', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.890', 'weapon3': '1.570', 'weapon2': '1.920', 'DAMAGECOUNT': '3.336', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:21:57,913][2409565] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:21:58,121][2409074] Updated weights for policy 0, policy_version 23251 (0.0012)
[2023-02-25 13:21:58,177][2409101] DAMAGECOUNT value on done: 9197.0
[2023-02-25 13:21:58,192][2409101] Sum rewards: 11.450, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'AMMO2': '0.039', 'weapon7': '0.086', 'AMMO3': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HEALTH': '0.152', 'weapon5': '0.176', 'AMMO4': '0.196', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon4': '0.550', 'HITCOUNT': '0.660', 'weapon2': '0.934', 'weapon3': '1.562', 'DAMAGECOUNT': '3.564', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:21:58,284][2409079] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)]
[2023-02-25 13:21:58,295][2409548] DAMAGECOUNT value on done: 7112.0
[2023-02-25 13:21:58,299][2409548] Sum rewards: 4.684, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.920', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'weapon5': '0.322', 'HITCOUNT': '0.390', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'weapon3': '1.082', 'DAMAGECOUNT': '1.272', 'weapon2': '1.910', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:21:58,384][2409096] DAMAGECOUNT value on done: 8950.0
[2023-02-25 13:21:58,385][2409096] Sum rewards: 2.255, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.065', 'AMMO5': '0.025', 'weapon4': '0.036', 'AMMO2': '0.039', 'WEAPON4': '0.100', 'AMMO3': '0.152', 'AMMO4': '0.196', 'weapon5': '0.216', 'WEAPON5': '0.500', 'HITCOUNT': '0.620', 'WEAPON3': '0.850', 'ARMOR': '1.352', 'weapon3': '1.534', 'weapon2': '1.846', 'DAMAGECOUNT': '2.853', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:21:58,530][2409102] DAMAGECOUNT value on done: 8070.0
[2023-02-25 13:21:58,533][2409102] Sum rewards: 14.980, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.741', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO3': '0.076', 'weapon4': '0.084', 'WEAPON4': '0.100', 'AMMO4': '0.111', 'weapon5': '0.202', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'ARMOR': '0.800', 'HITCOUNT': '0.940', 'weapon2': '1.512', 'weapon3': '1.730', 'DAMAGECOUNT': '4.311', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:21:58,954][2409104] DAMAGECOUNT value on done: 6573.0
[2023-02-25 13:21:58,957][2409104] Sum rewards: 10.339, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.016', 'AMMO2': '0.013', 'AMMO5': '0.022', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.065', 'weapon7': '0.144', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.262', 'weapon5': '0.288', 'WEAPON3': '0.350', 'HITCOUNT': '0.440', 'WEAPON5': '0.450', 'weapon3': '0.736', 'ARMOR': '1.336', 'weapon2': '2.294', 'DAMAGECOUNT': '2.505', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:21:59,123][2409075] DAMAGECOUNT value on done: 8038.0
[2023-02-25 13:21:59,124][2409075] Sum rewards: 6.380, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.866', 'AMMO2': '0.006', 'AMMO5': '0.027', 'AMMO4': '0.030', 'AMMO3': '0.121', 'weapon5': '0.172', 'WEAPON4': '0.200', 'weapon4': '0.226', 'WEAPON5': '0.600', 'WEAPON3': '0.850', 'ARMOR': '0.900', 'HITCOUNT': '0.930', 'weapon2': '1.462', 'weapon3': '1.750', 'DAMAGECOUNT': '3.222', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:21:59,227][2409565] DAMAGECOUNT value on done: 9901.0
[2023-02-25 13:21:59,228][2409565] Sum rewards: 19.788, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.212', 'AMMO2': '0.016', 'AMMO5': '0.020', 'AMMO4': '0.078', 'AMMO3': '0.088', 'WEAPON4': '0.200', 'weapon5': '0.354', 'weapon4': '0.370', 'WEAPON5': '0.650', 'WEAPON3': '0.700', 'weapon2': '0.868', 'HITCOUNT': '1.160', 'weapon3': '1.790', 'DAMAGECOUNT': '4.956', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:21:59,272][2409485] DAMAGECOUNT value on done: 9156.0
[2023-02-25 13:21:59,273][2409485] Sum rewards: 20.814, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.150', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'AMMO3': '0.107', 'weapon5': '0.108', 'WEAPON5': '0.150', 'weapon4': '0.240', 'WEAPON3': '0.600', 'HITCOUNT': '1.110', 'weapon3': '1.246', 'ARMOR': '1.300', 'weapon2': '1.370', 'DAMAGECOUNT': '3.897', 'FRAGCOUNT': '17.000'}
[2023-02-25 13:21:59,290][2409469] DAMAGECOUNT value on done: 7625.0
[2023-02-25 13:21:59,291][2409469] Sum rewards: 12.553, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.426', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.018', 'weapon5': '0.062', 'AMMO3': '0.070', 'weapon7': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.404', 'WEAPON3': '0.500', 'HITCOUNT': '0.840', 'weapon2': '1.074', 'weapon3': '1.510', 'DAMAGECOUNT': '2.910', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:21:59,348][2409389] DAMAGECOUNT value on done: 8515.0
[2023-02-25 13:21:59,352][2409389] Sum rewards: 13.160, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.502', 'AMMO2': '0.013', 'AMMO5': '0.017', 'weapon4': '0.056', 'AMMO4': '0.064', 'AMMO3': '0.070', 'weapon7': '0.070', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.190', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.770', 'weapon3': '1.438', 'weapon2': '1.646', 'DAMAGECOUNT': '4.287', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:21:59,381][2409486] DAMAGECOUNT value on done: 8578.0
[2023-02-25 13:21:59,382][2409486] Sum rewards: 8.572, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.974', 'AMMO2': '0.009', 'AMMO5': '0.024', 'AMMO4': '0.045', 'AMMO3': '0.097', 'WEAPON4': '0.150', 'weapon4': '0.204', 'weapon5': '0.240', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'ARMOR': '0.876', 'HITCOUNT': '1.000', 'weapon2': '1.280', 'weapon3': '1.744', 'DAMAGECOUNT': '3.327', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:21:59,631][2409078] DAMAGECOUNT value on done: 10193.0
[2023-02-25 13:21:59,632][2409078] Sum rewards: 19.988, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.024', 'AMMO5': '0.030', 'weapon4': '0.042', 'AMMO3': '0.112', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'weapon5': '0.308', 'HEALTH': '0.584', 'WEAPON5': '0.600', 'WEAPON3': '0.600', 'ARMOR': '0.800', 'HITCOUNT': '0.850', 'weapon2': '1.336', 'weapon3': '1.874', 'DAMAGECOUNT': '6.057', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:21:59,678][2409355] DAMAGECOUNT value on done: 7524.0
[2023-02-25 13:21:59,680][2409355] Sum rewards: 18.646, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.544', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO5': '0.028', 'WEAPON4': '0.050', 'weapon4': '0.070', 'AMMO3': '0.097', 'weapon5': '0.104', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'HITCOUNT': '0.920', 'weapon2': '1.348', 'ARMOR': '1.430', 'weapon3': '1.752', 'DAMAGECOUNT': '4.191', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:21:59,713][2409105] DAMAGECOUNT value on done: 9353.0
[2023-02-25 13:21:59,714][2409105] Sum rewards: 18.954, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.676', 'AMMO5': '0.022', 'AMMO2': '0.031', 'weapon5': '0.074', 'AMMO3': '0.113', 'weapon7': '0.152', 'AMMO4': '0.153', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon2': '0.244', 'WEAPON5': '0.400', 'WEAPON7': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'weapon4': '0.826', 'ARMOR': '0.856', 'HITCOUNT': '1.010', 'weapon3': '1.698', 'DAMAGECOUNT': '4.671', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:21:59,768][2409866] DAMAGECOUNT value on done: 9132.0
[2023-02-25 13:21:59,769][2409866] Sum rewards: 13.880, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.593', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO3': '0.078', 'weapon5': '0.104', 'weapon7': '0.120', 'AMMO4': '0.139', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.600', 'weapon2': '0.850', 'HITCOUNT': '1.000', 'weapon4': '1.168', 'weapon3': '1.430', 'DAMAGECOUNT': '4.254', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:21:59,788][2409097] DAMAGECOUNT value on done: 8464.0
[2023-02-25 13:21:59,790][2409097] Sum rewards: 14.723, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.760', 'WEAPON1': '0.030', 'AMMO5': '0.032', 'AMMO2': '0.039', 'AMMO3': '0.077', 'weapon5': '0.184', 'AMMO4': '0.197', 'weapon4': '0.318', 'WEAPON4': '0.350', 'WEAPON3': '0.500', 'WEAPON5': '0.550', 'ARMOR': '0.852', 'HITCOUNT': '0.880', 'weapon2': '1.188', 'weapon3': '1.410', 'DAMAGECOUNT': '4.626', 'FRAGCOUNT': '12.500'}
[2023-02-25 13:21:59,918][2409074] Updated weights for policy 0, policy_version 23261 (0.0012)
[2023-02-25 13:22:00,093][2409407] DAMAGECOUNT value on done: 10114.0
[2023-02-25 13:22:00,099][2409407] Sum rewards: 16.905, reward structure: {'DEATHCOUNT': '-7.500', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO5': '0.020', 'weapon7': '0.058', 'AMMO4': '0.075', 'AMMO3': '0.085', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HEALTH': '0.165', 'WEAPON4': '0.250', 'weapon5': '0.258', 'WEAPON5': '0.450', 'weapon4': '0.528', 'WEAPON3': '0.550', 'ARMOR': '0.943', 'HITCOUNT': '1.030', 'weapon2': '1.038', 'weapon3': '1.738', 'DAMAGECOUNT': '5.391', 'FRAGCOUNT': '11.500'}
[2023-02-25 13:22:00,207][2409079] DAMAGECOUNT value on done: 7543.0
[2023-02-25 13:22:00,208][2409079] Sum rewards: 15.937, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.845', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.050', 'AMMO4': '0.115', 'weapon5': '0.220', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'ARMOR': '0.540', 'weapon4': '0.634', 'weapon2': '0.878', 'HITCOUNT': '1.010', 'weapon3': '1.238', 'DAMAGECOUNT': '3.741', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:22:00,294][2409405] DAMAGECOUNT value on done: 7398.0
[2023-02-25 13:22:00,297][2409405] Sum rewards: 17.182, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.017', 'AMMO5': '0.020', 'AMMO3': '0.070', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'weapon5': '0.292', 'weapon4': '0.330', 'HEALTH': '0.390', 'WEAPON5': '0.450', 'WEAPON3': '0.450', 'HITCOUNT': '0.930', 'weapon2': '1.280', 'weapon3': '1.634', 'DAMAGECOUNT': '4.386', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:22:00,588][2409597] DAMAGECOUNT value on done: 9292.0
[2023-02-25 13:22:00,589][2409597] Sum rewards: 12.926, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.010', 'AMMO2': '0.004', 'AMMO4': '0.018', 'AMMO5': '0.025', 'AMMO3': '0.111', 'WEAPON4': '0.150', 'weapon5': '0.326', 'weapon4': '0.344', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'weapon2': '0.864', 'HITCOUNT': '0.910', 'ARMOR': '1.297', 'weapon3': '1.774', 'DAMAGECOUNT': '4.263', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:22:01,041][2409373] DAMAGECOUNT value on done: 8399.0
[2023-02-25 13:22:01,042][2409373] Sum rewards: 9.636, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.029', 'AMMO4': '-0.055', 'AMMO2': '-0.011', 'weapon4': '0.006', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.067', 'weapon5': '0.076', 'weapon7': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.680', 'weapon3': '1.284', 'weapon2': '1.368', 'DAMAGECOUNT': '2.982', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:22:01,235][2409077] DAMAGECOUNT value on done: 8018.0
[2023-02-25 13:22:01,236][2409077] Sum rewards: 10.348, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.074', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon5': '0.060', 'weapon7': '0.074', 'AMMO3': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.451', 'weapon2': '0.628', 'WEAPON3': '0.650', 'HITCOUNT': '0.780', 'weapon4': '1.012', 'weapon3': '1.712', 'DAMAGECOUNT': '2.793', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:22:01,473][2409406] DAMAGECOUNT value on done: 7182.0
[2023-02-25 13:22:01,474][2409406] Sum rewards: 17.296, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.567', 'AMMO5': '0.025', 'AMMO2': '0.034', 'WEAPON4': '0.050', 'AMMO3': '0.097', 'AMMO4': '0.170', 'weapon4': '0.174', 'weapon5': '0.220', 'ARMOR': '0.446', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '0.840', 'weapon2': '1.326', 'weapon3': '1.868', 'DAMAGECOUNT': '4.212', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:22:01,567][2409596] DAMAGECOUNT value on done: 8680.0
[2023-02-25 13:22:01,568][2409596] Sum rewards: 5.621, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.305', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO3': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'weapon7': '0.076', 'weapon5': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'ARMOR': '0.496', 'weapon3': '0.668', 'weapon2': '0.808', 'DAMAGECOUNT': '0.834', 'weapon4': '0.950', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:22:01,782][2409074] Updated weights for policy 0, policy_version 23271 (0.0012)
[2023-02-25 13:22:01,861][2409548] DAMAGECOUNT value on done: 9101.0
[2023-02-25 13:22:01,865][2409548] Sum rewards: 15.687, reward structure: {'DEATHCOUNT': '-5.250', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO3': '0.080', 'AMMO4': '0.103', 'WEAPON5': '0.250', 'weapon5': '0.250', 'HEALTH': '0.362', 'WEAPON3': '0.400', 'ARMOR': '0.800', 'HITCOUNT': '0.860', 'weapon3': '1.382', 'weapon2': '1.824', 'DAMAGECOUNT': '3.582', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:22:02,106][2409076] DAMAGECOUNT value on done: 8376.0
[2023-02-25 13:22:02,107][2409076] Sum rewards: 14.970, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.326', 'AMMO2': '0.014', 'AMMO5': '0.026', 'AMMO4': '0.067', 'AMMO3': '0.130', 'weapon4': '0.138', 'weapon5': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'ARMOR': '0.800', 'WEAPON3': '0.900', 'HITCOUNT': '1.350', 'weapon2': '1.404', 'weapon3': '1.972', 'DAMAGECOUNT': '4.593', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:22:02,186][2408954] Fps is (10 sec: 25395.7, 60 sec: 24712.5, 300 sec: 24256.6). Total num frames: 95330304. Throughput: 0: 6197.6. Samples: 23840088. Policy #0 lag: (min: 0.0, avg: 10.8, max: 27.0)
[2023-02-25 13:22:02,187][2408954] Avg episode reward: [(0, '13.007')]
[2023-02-25 13:22:02,191][2409033] Saving new best policy, reward=13.007!
[2023-02-25 13:22:02,403][2409096] DAMAGECOUNT value on done: 8928.0
[2023-02-25 13:22:02,404][2409096] Sum rewards: 21.456, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.146', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.027', 'WEAPON1': '0.030', 'weapon7': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.111', 'WEAPON5': '0.550', 'weapon5': '0.618', 'WEAPON3': '0.750', 'HITCOUNT': '1.020', 'weapon2': '1.238', 'ARMOR': '1.350', 'weapon3': '1.752', 'DAMAGECOUNT': '5.508', 'FRAGCOUNT': '16.000'}
[2023-02-25 13:22:02,418][2409102] DAMAGECOUNT value on done: 7866.0
[2023-02-25 13:22:02,418][2409102] Sum rewards: 11.309, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.640', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO3': '0.049', 'AMMO4': '0.110', 'weapon7': '0.158', 'weapon5': '0.168', 'WEAPON5': '0.300', 'WEAPON3': '0.300', 'WEAPON4': '0.400', 'AMMO6': '0.440', 'AMMO7': '0.440', 'HITCOUNT': '0.540', 'WEAPON7': '0.600', 'ARMOR': '0.800', 'weapon3': '0.808', 'weapon2': '1.138', 'weapon4': '1.402', 'DAMAGECOUNT': '2.511', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:22:02,940][2409104] DAMAGECOUNT value on done: 8402.0
[2023-02-25 13:22:02,941][2409104] Sum rewards: 12.909, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.730', 'AMMO4': '-0.033', 'AMMO2': '-0.006', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'weapon7': '0.064', 'AMMO3': '0.069', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.226', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.880', 'weapon3': '1.202', 'weapon2': '1.664', 'DAMAGECOUNT': '3.438', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:22:02,947][2409565] DAMAGECOUNT value on done: 8108.0
[2023-02-25 13:22:02,948][2409565] Sum rewards: 11.397, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.772', 'AMMO2': '0.012', 'AMMO5': '0.020', 'AMMO4': '0.059', 'AMMO3': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.234', 'weapon4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'weapon2': '0.826', 'HITCOUNT': '0.990', 'ARMOR': '1.300', 'weapon3': '1.688', 'DAMAGECOUNT': '3.690', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:22:02,962][2409485] DAMAGECOUNT value on done: 7740.0
[2023-02-25 13:22:02,963][2409485] Sum rewards: 16.421, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.603', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO4': '0.051', 'AMMO3': '0.079', 'WEAPON4': '0.150', 'weapon5': '0.252', 'ARMOR': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '0.550', 'weapon4': '0.652', 'weapon2': '0.668', 'HITCOUNT': '1.170', 'weapon3': '1.430', 'DAMAGECOUNT': '5.016', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:22:03,062][2409074] Updated weights for policy 0, policy_version 23281 (0.0013)
[2023-02-25 13:22:03,160][2409469] DAMAGECOUNT value on done: 9754.0
[2023-02-25 13:22:03,160][2409469] Sum rewards: 15.810, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.607', 'AMMO2': '0.005', 'AMMO5': '0.010', 'weapon7': '0.022', 'AMMO4': '0.026', 'AMMO3': '0.095', 'weapon4': '0.098', 'WEAPON4': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon5': '0.162', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.449', 'WEAPON3': '0.650', 'HITCOUNT': '0.870', 'weapon2': '1.226', 'weapon3': '1.916', 'DAMAGECOUNT': '3.717', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:22:03,340][2409075] DAMAGECOUNT value on done: 8021.0
[2023-02-25 13:22:03,341][2409075] Sum rewards: 13.622, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.362', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO4': '0.044', 'weapon5': '0.054', 'AMMO3': '0.085', 'weapon7': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.850', 'weapon3': '1.418', 'weapon2': '1.712', 'DAMAGECOUNT': '3.987', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:22:03,345][2409355] DAMAGECOUNT value on done: 8529.0
[2023-02-25 13:22:03,346][2409355] Sum rewards: 6.060, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.230', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'weapon7': '0.050', 'AMMO3': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.550', 'HITCOUNT': '0.560', 'ARMOR': '0.925', 'weapon2': '0.928', 'weapon3': '0.976', 'weapon4': '1.448', 'DAMAGECOUNT': '2.169', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:22:03,443][2409866] DAMAGECOUNT value on done: 7834.0
[2023-02-25 13:22:03,446][2409866] Sum rewards: 10.920, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.306', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.040', 'AMMO3': '0.070', 'weapon5': '0.154', 'weapon7': '0.196', 'AMMO4': '0.198', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON4': '0.350', 'WEAPON7': '0.400', 'ARMOR': '0.433', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'HITCOUNT': '0.660', 'weapon2': '0.942', 'weapon3': '1.104', 'weapon4': '1.294', 'DAMAGECOUNT': '3.258', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:22:03,552][2409389] DAMAGECOUNT value on done: 8993.0
[2023-02-25 13:22:03,553][2409389] Sum rewards: 18.221, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.538', 'AMMO2': '0.006', 'AMMO5': '0.015', 'weapon7': '0.018', 'AMMO4': '0.029', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.216', 'weapon5': '0.238', 'WEAPON5': '0.400', 'ARMOR': '0.436', 'WEAPON3': '0.550', 'HITCOUNT': '1.050', 'weapon2': '1.188', 'weapon3': '1.536', 'DAMAGECOUNT': '5.121', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:22:03,615][2409105] DAMAGECOUNT value on done: 9588.0
[2023-02-25 13:22:03,617][2409105] Sum rewards: 19.895, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.093', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.072', 'weapon7': '0.080', 'AMMO3': '0.081', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'WEAPON3': '0.500', 'weapon4': '0.632', 'weapon2': '1.036', 'weapon3': '1.248', 'HITCOUNT': '1.250', 'DAMAGECOUNT': '4.707', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:22:03,629][2409078] DAMAGECOUNT value on done: 9314.0
[2023-02-25 13:22:03,630][2409078] Sum rewards: 5.012, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.098', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO5': '0.027', 'weapon7': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.129', 'AMMO4': '0.130', 'weapon5': '0.196', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.440', 'WEAPON5': '0.550', 'HITCOUNT': '0.750', 'WEAPON3': '0.800', 'ARMOR': '0.856', 'weapon2': '0.918', 'weapon3': '1.808', 'DAMAGECOUNT': '3.813', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:22:03,784][2409486] DAMAGECOUNT value on done: 8111.0
[2023-02-25 13:22:03,786][2409486] Sum rewards: 13.353, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.566', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'AMMO5': '0.024', 'AMMO3': '0.078', 'AMMO4': '0.102', 'WEAPON4': '0.350', 'weapon5': '0.366', 'weapon4': '0.390', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'weapon2': '0.812', 'HITCOUNT': '0.910', 'ARMOR': '1.316', 'weapon3': '1.556', 'DAMAGECOUNT': '4.575', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:22:04,083][2409407] DAMAGECOUNT value on done: 9418.0
[2023-02-25 13:22:04,084][2409407] Sum rewards: 16.819, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.992', 'AMMO5': '0.013', 'AMMO2': '0.027', 'AMMO3': '0.080', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'weapon4': '0.218', 'weapon5': '0.260', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '1.010', 'weapon2': '1.164', 'weapon3': '1.726', 'DAMAGECOUNT': '4.626', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:22:04,202][2409079] DAMAGECOUNT value on done: 6785.0
[2023-02-25 13:22:04,205][2409079] Sum rewards: 11.910, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.351', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.061', 'weapon5': '0.130', 'WEAPON5': '0.150', 'weapon4': '0.232', 'WEAPON3': '0.350', 'ARMOR': '0.482', 'HITCOUNT': '0.810', 'weapon2': '1.242', 'weapon3': '1.260', 'DAMAGECOUNT': '3.156', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:22:04,238][2409097] DAMAGECOUNT value on done: 9404.0
[2023-02-25 13:22:04,239][2409097] Sum rewards: 18.800, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.016', 'AMMO5': '0.017', 'WEAPON4': '0.050', 'weapon4': '0.058', 'AMMO3': '0.063', 'weapon7': '0.070', 'AMMO4': '0.081', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.282', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'HEALTH': '0.422', 'HITCOUNT': '0.710', 'ARMOR': '0.928', 'weapon3': '1.464', 'weapon2': '1.588', 'DAMAGECOUNT': '4.500', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:22:04,420][2409405] DAMAGECOUNT value on done: 7609.0
[2023-02-25 13:22:04,422][2409405] Sum rewards: 11.902, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.336', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO5': '0.020', 'AMMO4': '0.073', 'AMMO3': '0.111', 'weapon5': '0.130', 'WEAPON5': '0.400', 'HITCOUNT': '0.660', 'WEAPON3': '0.700', 'weapon2': '1.488', 'weapon3': '1.636', 'DAMAGECOUNT': '2.745', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:22:04,424][2409597] DAMAGECOUNT value on done: 7756.0
[2023-02-25 13:22:04,426][2409597] Sum rewards: 20.415, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.095', 'AMMO2': '0.018', 'AMMO5': '0.022', 'AMMO3': '0.081', 'AMMO4': '0.092', 'WEAPON4': '0.300', 'weapon4': '0.392', 'WEAPON5': '0.450', 'weapon5': '0.458', 'WEAPON3': '0.550', 'weapon2': '0.834', 'HITCOUNT': '0.970', 'weapon3': '1.480', 'DAMAGECOUNT': '5.862', 'FRAGCOUNT': '16.000'}
[2023-02-25 13:22:04,879][2409074] Updated weights for policy 0, policy_version 23291 (0.0012)
[2023-02-25 13:22:04,912][2409373] DAMAGECOUNT value on done: 8058.0
[2023-02-25 13:22:04,915][2409373] Sum rewards: 9.912, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.730', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO3': '0.030', 'weapon7': '0.056', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.300', 'ARMOR': '0.450', 'weapon3': '0.746', 'weapon2': '0.862', 'weapon4': '1.060', 'DAMAGECOUNT': '2.214', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:22:05,067][2409077] DAMAGECOUNT value on done: 9539.0
[2023-02-25 13:22:05,068][2409077] Sum rewards: 4.083, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.310', 'AMMO2': '0.012', 'AMMO5': '0.017', 'AMMO4': '0.061', 'weapon7': '0.072', 'weapon5': '0.090', 'AMMO3': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '0.700', 'weapon4': '0.748', 'weapon2': '0.842', 'HITCOUNT': '0.870', 'ARMOR': '1.311', 'weapon3': '1.582', 'DAMAGECOUNT': '3.201', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:22:05,299][2409406] DAMAGECOUNT value on done: 6736.0
[2023-02-25 13:22:05,300][2409406] Sum rewards: 17.285, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.335', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO3': '0.080', 'AMMO4': '0.083', 'weapon5': '0.194', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '0.600', 'weapon4': '0.604', 'ARMOR': '0.858', 'weapon2': '1.092', 'HITCOUNT': '1.170', 'weapon3': '1.472', 'DAMAGECOUNT': '4.728', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:22:05,652][2409548] DAMAGECOUNT value on done: 8055.0
[2023-02-25 13:22:05,650][2409596] DAMAGECOUNT value on done: 8617.0
[2023-02-25 13:22:05,654][2409548] Sum rewards: 14.813, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.100', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO3': '0.067', 'AMMO4': '0.169', 'weapon5': '0.308', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.608', 'ARMOR': '0.912', 'HITCOUNT': '1.130', 'weapon2': '1.178', 'weapon3': '1.308', 'DAMAGECOUNT': '4.734', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:22:05,654][2409596] Sum rewards: 14.849, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.047', 'AMMO2': '0.014', 'AMMO5': '0.027', 'AMMO4': '0.070', 'AMMO3': '0.078', 'weapon5': '0.184', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'weapon4': '0.496', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'HITCOUNT': '0.940', 'weapon2': '0.942', 'weapon3': '1.718', 'DAMAGECOUNT': '4.926', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:22:05,755][2409076] DAMAGECOUNT value on done: 8971.0
[2023-02-25 13:22:05,758][2409076] Sum rewards: 9.343, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.958', 'AMMO5': '0.028', 'AMMO2': '0.039', 'AMMO3': '0.073', 'weapon5': '0.158', 'AMMO4': '0.194', 'weapon2': '0.240', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'ARMOR': '0.456', 'WEAPON3': '0.550', 'weapon4': '1.020', 'HITCOUNT': '1.140', 'weapon3': '1.706', 'DAMAGECOUNT': '3.597', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:22:06,386][2409096] DAMAGECOUNT value on done: 7123.0
[2023-02-25 13:22:06,387][2409096] Sum rewards: 11.604, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.182', 'AMMO2': '0.020', 'AMMO5': '0.021', 'AMMO3': '0.096', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.192', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon7': '0.240', 'ARMOR': '0.460', 'WEAPON5': '0.500', 'weapon2': '0.570', 'WEAPON3': '0.600', 'HITCOUNT': '0.690', 'weapon4': '0.764', 'weapon3': '1.326', 'DAMAGECOUNT': '3.207', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:22:06,414][2409074] Updated weights for policy 0, policy_version 23301 (0.0012)
[2023-02-25 13:22:06,774][2409104] DAMAGECOUNT value on done: 9076.0
[2023-02-25 13:22:06,774][2409104] Sum rewards: 15.551, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'AMMO2': '0.029', 'AMMO3': '0.071', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.100', 'weapon5': '0.130', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.228', 'HEALTH': '0.298', 'WEAPON3': '0.400', 'weapon2': '0.622', 'HITCOUNT': '0.890', 'weapon3': '1.184', 'DAMAGECOUNT': '3.597', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:22:06,775][2409485] DAMAGECOUNT value on done: 7833.0
[2023-02-25 13:22:06,780][2409485] Sum rewards: 12.226, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.102', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO2': '0.029', 'AMMO3': '0.062', 'AMMO4': '0.143', 'WEAPON4': '0.200', 'weapon4': '0.208', 'weapon5': '0.254', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.700', 'weapon2': '1.154', 'weapon3': '1.366', 'DAMAGECOUNT': '3.471', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:22:06,783][2409565] DAMAGECOUNT value on done: 10260.0
[2023-02-25 13:22:06,784][2409565] Sum rewards: 18.246, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.343', 'AMMO2': '0.002', 'AMMO4': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO3': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.142', 'WEAPON4': '0.150', 'weapon5': '0.264', 'weapon4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.840', 'weapon3': '1.456', 'weapon2': '1.512', 'ARMOR': '1.798', 'DAMAGECOUNT': '5.079', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:22:06,969][2409355] DAMAGECOUNT value on done: 8168.0
[2023-02-25 13:22:06,973][2409355] Sum rewards: 16.303, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.204', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.010', 'weapon7': '0.058', 'AMMO3': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.204', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'ARMOR': '0.448', 'weapon2': '0.740', 'HITCOUNT': '0.980', 'weapon3': '1.294', 'DAMAGECOUNT': '3.399', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:22:07,083][2409866] DAMAGECOUNT value on done: 8236.0
[2023-02-25 13:22:07,087][2409866] Sum rewards: 18.407, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.202', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO4': '0.037', 'AMMO3': '0.077', 'WEAPON4': '0.250', 'weapon5': '0.290', 'weapon4': '0.368', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon2': '0.776', 'ARMOR': '0.892', 'HITCOUNT': '0.970', 'weapon3': '1.726', 'DAMAGECOUNT': '4.323', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:22:07,111][2409469] DAMAGECOUNT value on done: 9205.0
[2023-02-25 13:22:07,112][2409469] Sum rewards: 9.740, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.252', 'AMMO5': '0.005', 'AMMO2': '0.024', 'AMMO3': '0.030', 'weapon5': '0.100', 'AMMO4': '0.118', 'weapon7': '0.132', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.250', 'WEAPON4': '0.400', 'WEAPON7': '0.400', 'HITCOUNT': '0.490', 'weapon3': '0.704', 'weapon4': '1.326', 'ARMOR': '1.345', 'weapon2': '1.460', 'DAMAGECOUNT': '2.028', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:22:07,162][2409075] DAMAGECOUNT value on done: 7609.0
[2023-02-25 13:22:07,163][2409075] Sum rewards: 15.242, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.253', 'AMMO5': '0.017', 'AMMO2': '0.028', 'AMMO3': '0.094', 'AMMO4': '0.140', 'WEAPON4': '0.250', 'weapon5': '0.290', 'WEAPON5': '0.450', 'ARMOR': '0.464', 'weapon4': '0.504', 'WEAPON3': '0.650', 'HITCOUNT': '0.930', 'weapon2': '1.056', 'weapon3': '1.536', 'DAMAGECOUNT': '4.086', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:22:07,186][2408954] Fps is (10 sec: 25395.6, 60 sec: 24917.3, 300 sec: 24270.5). Total num frames: 95457280. Throughput: 0: 6193.4. Samples: 23858616. Policy #0 lag: (min: 0.0, avg: 10.8, max: 27.0)
[2023-02-25 13:22:07,186][2408954] Avg episode reward: [(0, '13.354')]
[2023-02-25 13:22:07,202][2409033] Saving new best policy, reward=13.354!
[2023-02-25 13:22:07,458][2409389] DAMAGECOUNT value on done: 9820.0
[2023-02-25 13:22:07,464][2409389] Sum rewards: 10.129, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.518', 'AMMO2': '0.005', 'AMMO4': '0.022', 'AMMO5': '0.027', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.103', 'WEAPON4': '0.150', 'weapon5': '0.200', 'ARMOR': '0.452', 'WEAPON5': '0.650', 'weapon4': '0.650', 'WEAPON3': '0.750', 'HITCOUNT': '0.760', 'weapon2': '1.006', 'weapon3': '1.454', 'DAMAGECOUNT': '3.069', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:22:07,668][2409105] DAMAGECOUNT value on done: 8227.0
[2023-02-25 13:22:07,669][2409105] Sum rewards: 7.476, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO5': '0.003', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO4': '0.018', 'weapon5': '0.020', 'AMMO3': '0.030', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'HEALTH': '0.100', 'weapon4': '0.162', 'weapon7': '0.170', 'WEAPON3': '0.200', 'AMMO6': '0.280', 'AMMO7': '0.280', 'WEAPON7': '0.400', 'HITCOUNT': '0.410', 'weapon3': '0.678', 'weapon2': '0.802', 'DAMAGECOUNT': '2.010', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:22:07,719][2409407] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)]
[2023-02-25 13:22:07,775][2409078] DAMAGECOUNT value on done: 8584.0
[2023-02-25 13:22:07,779][2409078] Sum rewards: 11.921, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.055', 'AMMO2': '0.013', 'AMMO5': '0.025', 'weapon7': '0.060', 'AMMO4': '0.066', 'AMMO3': '0.070', 'WEAPON4': '0.150', 'weapon5': '0.178', 'weapon4': '0.282', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'HITCOUNT': '0.740', 'ARMOR': '0.852', 'weapon3': '1.142', 'weapon2': '1.906', 'DAMAGECOUNT': '3.642', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:22:07,843][2409407] DAMAGECOUNT value on done: 8325.0
[2023-02-25 13:22:07,846][2409407] Sum rewards: 7.421, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.030', 'AMMO3': '0.050', 'HEALTH': '0.067', 'weapon5': '0.170', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'HITCOUNT': '0.720', 'ARMOR': '0.800', 'weapon3': '0.980', 'weapon2': '1.970', 'DAMAGECOUNT': '2.565', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:22:07,990][2409486] DAMAGECOUNT value on done: 6915.0
[2023-02-25 13:22:07,994][2409486] Sum rewards: 8.863, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.587', 'AMMO5': '0.017', 'AMMO2': '0.022', 'weapon5': '0.044', 'AMMO3': '0.076', 'AMMO4': '0.109', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon7': '0.204', 'WEAPON5': '0.250', 'weapon4': '0.474', 'WEAPON3': '0.500', 'HITCOUNT': '0.680', 'ARMOR': '1.281', 'weapon2': '1.350', 'weapon3': '1.564', 'DAMAGECOUNT': '2.379', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:22:08,009][2409079] DAMAGECOUNT value on done: 7260.0
[2023-02-25 13:22:08,012][2409079] Sum rewards: 12.191, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.480', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO3': '0.050', 'AMMO4': '0.079', 'weapon7': '0.128', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon5': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'WEAPON7': '0.400', 'weapon2': '0.576', 'HITCOUNT': '0.690', 'weapon3': '1.074', 'weapon4': '1.404', 'DAMAGECOUNT': '3.018', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:22:08,023][2409097] DAMAGECOUNT value on done: 8724.0
[2023-02-25 13:22:08,026][2409097] Sum rewards: 11.837, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.094', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon7': '0.054', 'AMMO3': '0.067', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.176', 'WEAPON4': '0.200', 'weapon5': '0.216', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.560', 'weapon2': '0.584', 'weapon3': '1.342', 'weapon4': '1.478', 'DAMAGECOUNT': '2.556', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:22:08,357][2409597] DAMAGECOUNT value on done: 9345.0
[2023-02-25 13:22:08,360][2409597] Sum rewards: 14.643, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.168', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.035', 'AMMO3': '0.050', 'weapon7': '0.060', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.268', 'weapon4': '0.310', 'WEAPON3': '0.400', 'HITCOUNT': '0.870', 'weapon2': '1.106', 'weapon3': '1.226', 'DAMAGECOUNT': '3.771', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:22:08,396][2409405] DAMAGECOUNT value on done: 9019.0
[2023-02-25 13:22:08,400][2409405] Sum rewards: 6.128, reward structure: {'HEALTH': '-0.033', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'AMMO3': '0.010', 'weapon7': '0.064', 'weapon5': '0.068', 'WEAPON5': '0.100', 'WEAPON3': '0.100', 'HITCOUNT': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon3': '0.242', 'weapon2': '0.430', 'ARMOR': '0.451', 'DAMAGECOUNT': '1.173', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:22:08,528][2409074] Updated weights for policy 0, policy_version 23311 (0.0012)
[2023-02-25 13:22:08,701][2409033] Signal inference workers to stop experience collection... (2800 times)
[2023-02-25 13:22:08,706][2409033] Signal inference workers to resume experience collection... (2800 times)
[2023-02-25 13:22:08,728][2409074] InferenceWorker_p0-w0: stopping experience collection (2800 times)
[2023-02-25 13:22:08,729][2409074] InferenceWorker_p0-w0: resuming experience collection (2800 times)
[2023-02-25 13:22:08,797][2409077] DAMAGECOUNT value on done: 9439.0
[2023-02-25 13:22:08,798][2409077] Sum rewards: 17.612, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.861', 'AMMO5': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.095', 'AMMO4': '0.115', 'weapon5': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.452', 'weapon4': '0.554', 'WEAPON3': '0.600', 'weapon2': '1.090', 'HITCOUNT': '1.190', 'weapon3': '1.602', 'DAMAGECOUNT': '4.605', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:22:09,028][2409373] DAMAGECOUNT value on done: 9401.0
[2023-02-25 13:22:09,032][2409373] Sum rewards: 7.247, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.142', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO3': '0.030', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.120', 'AMMO4': '0.141', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'weapon7': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.372', 'HITCOUNT': '0.420', 'weapon3': '0.844', 'weapon2': '0.964', 'DAMAGECOUNT': '1.797', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:22:09,049][2409406] DAMAGECOUNT value on done: 8273.0
[2023-02-25 13:22:09,049][2409406] Sum rewards: 11.948, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.009', 'weapon7': '0.012', 'AMMO5': '0.015', 'HEALTH': '0.028', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'weapon4': '0.070', 'AMMO3': '0.080', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.500', 'ARMOR': '0.856', 'HITCOUNT': '0.870', 'weapon3': '1.290', 'weapon2': '1.496', 'DAMAGECOUNT': '3.228', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:22:09,537][2409596] DAMAGECOUNT value on done: 7348.0
[2023-02-25 13:22:09,540][2409596] Sum rewards: 5.523, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.688', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.084', 'weapon7': '0.152', 'AMMO4': '0.167', 'weapon5': '0.174', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.470', 'WEAPON3': '0.550', 'weapon3': '0.980', 'weapon4': '1.020', 'weapon2': '1.354', 'DAMAGECOUNT': '2.106', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:22:09,862][2409548] DAMAGECOUNT value on done: 9322.0
[2023-02-25 13:22:09,865][2409548] Sum rewards: 11.410, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.078', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.015', 'weapon5': '0.122', 'AMMO3': '0.123', 'WEAPON5': '0.350', 'ARMOR': '0.464', 'WEAPON3': '0.750', 'HITCOUNT': '0.970', 'weapon2': '1.594', 'weapon3': '2.026', 'DAMAGECOUNT': '3.111', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:22:09,883][2409074] Updated weights for policy 0, policy_version 23321 (0.0012)
[2023-02-25 13:22:09,885][2409076] DAMAGECOUNT value on done: 8203.0
[2023-02-25 13:22:09,889][2409076] Sum rewards: 9.052, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.376', 'AMMO2': '0.015', 'AMMO5': '0.017', 'weapon7': '0.026', 'AMMO4': '0.074', 'AMMO3': '0.115', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon5': '0.268', 'WEAPON4': '0.350', 'weapon4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'HITCOUNT': '1.140', 'weapon2': '1.296', 'ARMOR': '1.363', 'weapon3': '1.638', 'DAMAGECOUNT': '3.705', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:22:10,121][2409100] Large shaping reward 2.603 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5730000000000001, 191.0)]
[2023-02-25 13:22:10,240][2409096] DAMAGECOUNT value on done: 6903.0
[2023-02-25 13:22:10,241][2409096] Sum rewards: 12.795, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.766', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO5': '0.015', 'AMMO3': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.200', 'weapon5': '0.264', 'WEAPON3': '0.400', 'HITCOUNT': '0.830', 'ARMOR': '0.882', 'weapon3': '1.132', 'weapon2': '1.406', 'DAMAGECOUNT': '3.873', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:22:10,692][2409104] DAMAGECOUNT value on done: 7794.0
[2023-02-25 13:22:10,693][2409104] Sum rewards: 13.600, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.020', 'AMMO2': '0.035', 'WEAPON1': '0.040', 'weapon4': '0.042', 'AMMO3': '0.097', 'WEAPON4': '0.150', 'AMMO4': '0.173', 'weapon5': '0.254', 'WEAPON5': '0.450', 'HEALTH': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.890', 'weapon2': '1.210', 'weapon3': '1.784', 'DAMAGECOUNT': '4.155', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:22:10,719][2409565] DAMAGECOUNT value on done: 9607.0
[2023-02-25 13:22:10,720][2409565] Sum rewards: 16.326, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.812', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'AMMO5': '0.020', 'AMMO3': '0.088', 'weapon5': '0.334', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'ARMOR': '0.851', 'HITCOUNT': '0.880', 'weapon2': '1.392', 'weapon3': '1.656', 'DAMAGECOUNT': '3.969', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:22:10,890][2409355] DAMAGECOUNT value on done: 9659.0
[2023-02-25 13:22:10,892][2409355] Sum rewards: 11.242, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.625', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.015', 'WEAPON4': '0.050', 'weapon7': '0.068', 'weapon5': '0.070', 'AMMO3': '0.073', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.130', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.620', 'weapon2': '1.126', 'weapon3': '1.222', 'DAMAGECOUNT': '3.519', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:22:11,016][2409485] DAMAGECOUNT value on done: 6974.0
[2023-02-25 13:22:11,017][2409485] Sum rewards: 8.686, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.007', 'AMMO3': '0.040', 'weapon5': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.102', 'HEALTH': '0.104', 'WEAPON5': '0.150', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.400', 'weapon3': '0.988', 'DAMAGECOUNT': '1.353', 'weapon2': '1.716', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:22:11,026][2409866] DAMAGECOUNT value on done: 9085.0
[2023-02-25 13:22:11,027][2409866] Sum rewards: 19.551, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.967', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.080', 'weapon5': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.168', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.451', 'weapon4': '0.468', 'WEAPON3': '0.600', 'HITCOUNT': '1.000', 'weapon2': '1.268', 'weapon3': '1.490', 'DAMAGECOUNT': '3.834', 'FRAGCOUNT': '17.000'}
[2023-02-25 13:22:11,200][2409075] DAMAGECOUNT value on done: 8224.0
[2023-02-25 13:22:11,203][2409075] Sum rewards: 8.120, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.182', 'AMMO2': '0.010', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.049', 'AMMO3': '0.077', 'weapon5': '0.170', 'WEAPON4': '0.350', 'weapon4': '0.356', 'ARMOR': '0.452', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '0.870', 'weapon3': '1.358', 'weapon2': '1.578', 'DAMAGECOUNT': '3.345', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:22:11,244][2409074] Updated weights for policy 0, policy_version 23331 (0.0012)
[2023-02-25 13:22:11,390][2409469] DAMAGECOUNT value on done: 10616.0
[2023-02-25 13:22:11,396][2409389] DAMAGECOUNT value on done: 6780.0
[2023-02-25 13:22:11,400][2409389] Sum rewards: 7.043, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.865', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.021', 'AMMO3': '0.050', 'weapon7': '0.054', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.190', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'ARMOR': '0.455', 'weapon4': '0.688', 'HITCOUNT': '0.700', 'weapon3': '1.188', 'weapon2': '1.448', 'DAMAGECOUNT': '2.259', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:22:11,400][2409469] Sum rewards: 14.405, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.610', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO3': '0.058', 'weapon7': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.760', 'weapon3': '1.066', 'weapon2': '1.836', 'DAMAGECOUNT': '2.910', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:22:11,431][2409105] DAMAGECOUNT value on done: 7731.0
[2023-02-25 13:22:11,432][2409105] Sum rewards: 3.490, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.931', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.032', 'ARMOR': '0.032', 'AMMO3': '0.057', 'weapon5': '0.088', 'AMMO4': '0.159', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'weapon4': '0.382', 'HITCOUNT': '0.520', 'weapon3': '1.092', 'weapon2': '1.486', 'DAMAGECOUNT': '1.950', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:22:11,541][2409078] DAMAGECOUNT value on done: 8243.0
[2023-02-25 13:22:11,542][2409078] Sum rewards: 16.470, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.164', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO3': '0.093', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.158', 'AMMO4': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.542', 'WEAPON3': '0.550', 'ARMOR': '0.800', 'weapon4': '1.064', 'HITCOUNT': '1.090', 'weapon3': '1.138', 'DAMAGECOUNT': '4.122', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:22:11,630][2409407] DAMAGECOUNT value on done: 7646.0
[2023-02-25 13:22:11,633][2409407] Sum rewards: 9.895, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.566', 'AMMO2': '0.009', 'AMMO5': '0.017', 'AMMO4': '0.045', 'weapon7': '0.062', 'AMMO3': '0.081', 'weapon5': '0.146', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.318', 'WEAPON5': '0.450', 'ARMOR': '0.454', 'WEAPON3': '0.600', 'HITCOUNT': '1.140', 'weapon2': '1.150', 'weapon3': '1.246', 'DAMAGECOUNT': '3.972', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:22:11,825][2409079] DAMAGECOUNT value on done: 7158.0
[2023-02-25 13:22:11,826][2409079] Sum rewards: 11.817, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.150', 'AMMO2': '0.004', 'WEAPON1': '0.020', 'AMMO4': '0.022', 'AMMO5': '0.022', 'AMMO3': '0.072', 'WEAPON4': '0.150', 'weapon5': '0.234', 'WEAPON5': '0.400', 'weapon4': '0.432', 'WEAPON3': '0.600', 'HITCOUNT': '0.690', 'ARMOR': '0.897', 'weapon2': '0.954', 'weapon3': '1.772', 'DAMAGECOUNT': '3.198', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:22:12,123][2409597] DAMAGECOUNT value on done: 8155.0
[2023-02-25 13:22:12,127][2409597] Sum rewards: 10.399, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.280', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO5': '0.022', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'weapon4': '0.208', 'weapon5': '0.380', 'WEAPON3': '0.550', 'HITCOUNT': '0.610', 'WEAPON5': '0.650', 'weapon3': '0.956', 'ARMOR': '1.356', 'weapon2': '2.236', 'DAMAGECOUNT': '3.312', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:22:12,139][2409405] DAMAGECOUNT value on done: 8818.0
[2023-02-25 13:22:12,140][2409405] Sum rewards: 13.585, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.807', 'WEAPON1': '0.010', 'AMMO5': '0.023', 'AMMO2': '0.031', 'weapon5': '0.044', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.114', 'AMMO4': '0.152', 'WEAPON4': '0.250', 'weapon4': '0.300', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'HITCOUNT': '0.960', 'weapon3': '1.352', 'weapon2': '2.066', 'DAMAGECOUNT': '3.537', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:22:12,144][2409097] DAMAGECOUNT value on done: 7786.0
[2023-02-25 13:22:12,145][2409097] Sum rewards: 11.092, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.103', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'AMMO5': '0.028', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon4': '0.116', 'AMMO4': '0.121', 'AMMO3': '0.137', 'weapon5': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.650', 'WEAPON3': '0.900', 'ARMOR': '0.976', 'HITCOUNT': '1.000', 'weapon2': '1.436', 'weapon3': '1.550', 'DAMAGECOUNT': '4.329', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:22:12,146][2409486] DAMAGECOUNT value on done: 7415.0
[2023-02-25 13:22:12,147][2409486] Sum rewards: 12.602, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.838', 'AMMO2': '0.008', 'AMMO5': '0.008', 'AMMO4': '0.037', 'AMMO3': '0.070', 'weapon7': '0.094', 'weapon5': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.450', 'HITCOUNT': '0.630', 'weapon2': '0.930', 'ARMOR': '0.968', 'weapon4': '1.022', 'weapon3': '1.188', 'DAMAGECOUNT': '3.384', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:22:12,188][2408954] Fps is (10 sec: 24571.1, 60 sec: 24711.8, 300 sec: 24312.0). Total num frames: 95576064. Throughput: 0: 6197.9. Samples: 23896128. Policy #0 lag: (min: 0.0, avg: 10.8, max: 27.0)
[2023-02-25 13:22:12,188][2408954] Avg episode reward: [(0, '12.629')]
[2023-02-25 13:22:12,422][2409077] DAMAGECOUNT value on done: 7787.0
[2023-02-25 13:22:12,427][2409077] Sum rewards: 8.403, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.710', 'AMMO2': '0.028', 'AMMO5': '0.038', 'AMMO3': '0.102', 'AMMO4': '0.141', 'weapon5': '0.274', 'WEAPON3': '0.700', 'HITCOUNT': '0.740', 'WEAPON5': '0.750', 'ARMOR': '0.854', 'weapon2': '1.346', 'weapon3': '1.854', 'DAMAGECOUNT': '3.285', 'FRAGCOUNT': '6.500'}
[2023-02-25 13:22:12,670][2409406] DAMAGECOUNT value on done: 8057.0
[2023-02-25 13:22:12,671][2409406] Sum rewards: 10.604, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.768', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'WEAPON1': '0.020', 'AMMO5': '0.028', 'AMMO3': '0.118', 'weapon5': '0.188', 'ARMOR': '0.400', 'WEAPON5': '0.650', 'WEAPON3': '0.800', 'HITCOUNT': '1.050', 'weapon2': '1.508', 'weapon3': '1.906', 'DAMAGECOUNT': '4.218', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:22:13,093][2409373] DAMAGECOUNT value on done: 9798.0
[2023-02-25 13:22:13,095][2409373] Sum rewards: 13.774, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.881', 'AMMO2': '0.015', 'AMMO5': '0.020', 'weapon7': '0.054', 'AMMO4': '0.077', 'AMMO3': '0.083', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.200', 'weapon5': '0.278', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.820', 'weapon2': '1.282', 'ARMOR': '1.310', 'weapon3': '1.552', 'DAMAGECOUNT': '4.164', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:22:13,145][2409074] Updated weights for policy 0, policy_version 23341 (0.0012)
[2023-02-25 13:22:13,347][2409596] DAMAGECOUNT value on done: 8784.0
[2023-02-25 13:22:13,348][2409596] Sum rewards: 20.529, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.300', 'AMMO2': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.032', 'weapon7': '0.064', 'AMMO3': '0.079', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.200', 'weapon5': '0.290', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'weapon4': '0.730', 'weapon2': '0.870', 'HITCOUNT': '1.120', 'weapon3': '1.594', 'DAMAGECOUNT': '4.764', 'FRAGCOUNT': '16.000'}
[2023-02-25 13:22:14,057][2409076] DAMAGECOUNT value on done: 9088.0
[2023-02-25 13:22:14,058][2409076] Sum rewards: 16.206, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'AMMO4': '0.113', 'weapon5': '0.138', 'HEALTH': '0.276', 'weapon4': '0.298', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.455', 'HITCOUNT': '1.160', 'weapon3': '1.180', 'weapon2': '2.192', 'DAMAGECOUNT': '4.686', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:22:14,127][2409548] DAMAGECOUNT value on done: 8929.0
[2023-02-25 13:22:14,130][2409548] Sum rewards: 16.412, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.060', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.014', 'WEAPON1': '0.030', 'AMMO3': '0.090', 'WEAPON4': '0.300', 'weapon5': '0.328', 'WEAPON5': '0.450', 'weapon4': '0.584', 'weapon2': '0.706', 'WEAPON3': '0.750', 'ARMOR': '0.888', 'HITCOUNT': '1.010', 'weapon3': '1.774', 'DAMAGECOUNT': '5.790', 'FRAGCOUNT': '12.500'}
[2023-02-25 13:22:14,327][2409565] DAMAGECOUNT value on done: 7518.0
[2023-02-25 13:22:14,328][2409565] Sum rewards: 10.295, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.682', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.060', 'AMMO3': '0.070', 'WEAPON4': '0.150', 'weapon5': '0.152', 'WEAPON5': '0.250', 'weapon4': '0.262', 'WEAPON3': '0.500', 'ARMOR': '0.740', 'HITCOUNT': '0.830', 'weapon2': '1.314', 'weapon3': '1.464', 'DAMAGECOUNT': '2.895', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:22:14,399][2409104] DAMAGECOUNT value on done: 7175.0
[2023-02-25 13:22:14,403][2409104] Sum rewards: 10.919, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.648', 'AMMO5': '0.007', 'AMMO3': '0.030', 'AMMO2': '0.032', 'weapon7': '0.134', 'AMMO4': '0.160', 'weapon5': '0.194', 'WEAPON3': '0.200', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.590', 'weapon3': '0.734', 'weapon2': '1.042', 'weapon4': '1.550', 'DAMAGECOUNT': '2.703', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:22:14,480][2409355] DAMAGECOUNT value on done: 9213.0
[2023-02-25 13:22:14,481][2409355] Sum rewards: 12.696, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.522', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.030', 'AMMO3': '0.045', 'weapon5': '0.054', 'WEAPON5': '0.100', 'weapon7': '0.196', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'ARMOR': '0.454', 'HITCOUNT': '0.680', 'weapon3': '0.918', 'weapon2': '0.940', 'weapon4': '1.624', 'DAMAGECOUNT': '3.138', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:22:14,520][2409096] DAMAGECOUNT value on done: 8901.0
[2023-02-25 13:22:14,522][2409096] Sum rewards: 21.416, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.763', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO3': '0.099', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.126', 'weapon5': '0.138', 'AMMO4': '0.187', 'WEAPON7': '0.200', 'weapon2': '0.344', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.572', 'WEAPON3': '0.700', 'HITCOUNT': '1.140', 'weapon3': '2.010', 'DAMAGECOUNT': '4.920', 'FRAGCOUNT': '19.000'}
[2023-02-25 13:22:14,617][2409866] DAMAGECOUNT value on done: 9075.0
[2023-02-25 13:22:14,620][2409866] Sum rewards: 5.925, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.288', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon7': '0.042', 'AMMO3': '0.089', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.164', 'weapon5': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.416', 'WEAPON3': '0.450', 'ARMOR': '0.906', 'HITCOUNT': '0.940', 'weapon2': '1.190', 'weapon3': '1.450', 'DAMAGECOUNT': '3.186', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:22:14,756][2409074] Updated weights for policy 0, policy_version 23351 (0.0013)
[2023-02-25 13:22:15,021][2409468] Large shaping reward 2.640 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200)]
[2023-02-25 13:22:15,130][2409485] DAMAGECOUNT value on done: 8155.0
[2023-02-25 13:22:15,130][2409485] Sum rewards: 17.413, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.116', 'AMMO5': '0.012', 'weapon7': '0.022', 'AMMO2': '0.031', 'AMMO3': '0.073', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon5': '0.324', 'ARMOR': '0.451', 'WEAPON3': '0.500', 'weapon4': '0.516', 'HITCOUNT': '0.810', 'weapon2': '0.822', 'weapon3': '1.558', 'DAMAGECOUNT': '3.705', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:22:15,254][2409105] DAMAGECOUNT value on done: 7473.0
[2023-02-25 13:22:15,257][2409105] Sum rewards: 6.813, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.490', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.015', 'weapon4': '0.016', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon5': '0.280', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'ARMOR': '0.449', 'HITCOUNT': '0.560', 'weapon3': '1.224', 'weapon2': '2.036', 'DAMAGECOUNT': '2.058', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:22:15,321][2409075] DAMAGECOUNT value on done: 8297.0
[2023-02-25 13:22:15,324][2409075] Sum rewards: 20.329, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.019', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.058', 'AMMO4': '0.097', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.108', 'HEALTH': '0.180', 'weapon5': '0.218', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'HITCOUNT': '1.000', 'weapon2': '1.434', 'weapon3': '1.960', 'DAMAGECOUNT': '5.505', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:22:15,346][2409407] DAMAGECOUNT value on done: 6956.0
[2023-02-25 13:22:15,348][2409407] Sum rewards: 19.372, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.384', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.010', 'weapon5': '0.010', 'weapon7': '0.080', 'AMMO3': '0.083', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.280', 'WEAPON3': '0.650', 'HITCOUNT': '0.990', 'weapon2': '1.148', 'weapon3': '1.270', 'ARMOR': '1.320', 'DAMAGECOUNT': '3.660', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:22:15,371][2409469] DAMAGECOUNT value on done: 8893.0
[2023-02-25 13:22:15,374][2409469] Sum rewards: 9.839, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.090', 'AMMO2': '0.009', 'AMMO5': '0.023', 'AMMO4': '0.045', 'weapon7': '0.058', 'AMMO3': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.110', 'WEAPON4': '0.200', 'weapon4': '0.318', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.760', 'ARMOR': '1.274', 'weapon3': '1.418', 'weapon2': '1.744', 'DAMAGECOUNT': '3.024', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:22:15,502][2409389] DAMAGECOUNT value on done: 8008.0
[2023-02-25 13:22:15,505][2409389] Sum rewards: 4.148, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.170', 'AMMO5': '0.020', 'AMMO2': '0.028', 'weapon7': '0.066', 'AMMO3': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.128', 'AMMO4': '0.140', 'weapon5': '0.196', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'weapon2': '1.310', 'weapon3': '1.844', 'DAMAGECOUNT': '2.184', 'FRAGCOUNT': '3.500'}
[2023-02-25 13:22:15,691][2409078] DAMAGECOUNT value on done: 7925.0
[2023-02-25 13:22:15,692][2409078] Sum rewards: 8.785, reward structure: {'DEATHCOUNT': '-6.750', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.023', 'weapon4': '0.094', 'AMMO4': '0.115', 'AMMO3': '0.117', 'WEAPON4': '0.150', 'WEAPON5': '0.350', 'weapon5': '0.466', 'HITCOUNT': '0.530', 'HEALTH': '0.538', 'ARMOR': '0.572', 'WEAPON3': '0.600', 'weapon2': '1.122', 'weapon3': '1.616', 'DAMAGECOUNT': '2.211', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:22:15,723][2409079] DAMAGECOUNT value on done: 7627.0
[2023-02-25 13:22:15,732][2409079] Sum rewards: 11.072, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.003', 'AMMO2': '0.014', 'AMMO3': '0.030', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.071', 'weapon7': '0.088', 'weapon5': '0.130', 'WEAPON3': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HEALTH': '0.368', 'ARMOR': '0.400', 'HITCOUNT': '0.440', 'weapon4': '0.748', 'weapon3': '0.754', 'weapon2': '1.640', 'DAMAGECOUNT': '2.346', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:22:16,047][2409597] DAMAGECOUNT value on done: 7720.0
[2023-02-25 13:22:16,048][2409597] Sum rewards: 18.475, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.003', 'AMMO5': '0.023', 'AMMO2': '0.026', 'AMMO3': '0.116', 'AMMO4': '0.130', 'weapon4': '0.220', 'WEAPON4': '0.300', 'weapon5': '0.370', 'ARMOR': '0.436', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'HITCOUNT': '1.050', 'weapon2': '1.366', 'weapon3': '1.700', 'DAMAGECOUNT': '5.091', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:22:16,137][2409486] DAMAGECOUNT value on done: 7865.0
[2023-02-25 13:22:16,137][2409486] Sum rewards: 15.307, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.062', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO3': '0.053', 'AMMO4': '0.149', 'weapon5': '0.192', 'weapon7': '0.192', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.300', 'AMMO6': '0.520', 'AMMO7': '0.520', 'HITCOUNT': '0.540', 'WEAPON7': '0.600', 'weapon3': '0.682', 'ARMOR': '1.293', 'weapon4': '1.334', 'weapon2': '1.356', 'DAMAGECOUNT': '3.543', 'FRAGCOUNT': '9.500'}
[2023-02-25 13:22:16,200][2409074] Updated weights for policy 0, policy_version 23361 (0.0012)
[2023-02-25 13:22:16,350][2409405] DAMAGECOUNT value on done: 10819.0
[2023-02-25 13:22:16,352][2409405] Sum rewards: 15.612, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.160', 'AMMO2': '0.016', 'AMMO5': '0.022', 'AMMO4': '0.082', 'AMMO3': '0.133', 'WEAPON4': '0.250', 'weapon5': '0.346', 'weapon4': '0.384', 'WEAPON5': '0.600', 'WEAPON3': '0.850', 'weapon2': '0.970', 'HITCOUNT': '1.150', 'weapon3': '1.678', 'DAMAGECOUNT': '5.040', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:22:16,359][2409077] DAMAGECOUNT value on done: 9353.0
[2023-02-25 13:22:16,360][2409077] Sum rewards: 1.931, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.420', 'AMMO2': '0.013', 'AMMO5': '0.017', 'AMMO3': '0.058', 'AMMO4': '0.065', 'weapon7': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.190', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'HITCOUNT': '0.410', 'FRAGCOUNT': '0.500', 'weapon3': '1.008', 'weapon4': '1.098', 'DAMAGECOUNT': '1.128', 'weapon2': '1.166'}
[2023-02-25 13:22:16,600][2409406] DAMAGECOUNT value on done: 7969.0
[2023-02-25 13:22:16,602][2409406] Sum rewards: 15.922, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.644', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO5': '0.027', 'AMMO4': '0.051', 'AMMO3': '0.083', 'weapon5': '0.198', 'ARMOR': '0.486', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.970', 'weapon2': '1.434', 'weapon3': '1.544', 'DAMAGECOUNT': '3.942', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:22:16,728][2409097] DAMAGECOUNT value on done: 8018.0
[2023-02-25 13:22:16,732][2409097] Sum rewards: 15.374, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.350', 'AMMO2': '0.009', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'AMMO3': '0.072', 'WEAPON5': '0.300', 'weapon5': '0.304', 'weapon4': '0.318', 'WEAPON3': '0.450', 'HITCOUNT': '0.830', 'ARMOR': '1.283', 'weapon3': '1.332', 'weapon2': '1.714', 'DAMAGECOUNT': '3.468', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:22:16,898][2409373] DAMAGECOUNT value on done: 7840.0
[2023-02-25 13:22:16,899][2409373] Sum rewards: 8.613, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.401', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon7': '0.048', 'AMMO3': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.124', 'AMMO4': '0.132', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.670', 'weapon2': '1.120', 'weapon4': '1.150', 'weapon3': '1.202', 'DAMAGECOUNT': '2.700', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:22:17,000][2409596] DAMAGECOUNT value on done: 6792.0
[2023-02-25 13:22:17,003][2409596] Sum rewards: 10.383, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.200', 'AMMO5': '0.011', 'AMMO2': '0.014', 'AMMO3': '0.058', 'AMMO4': '0.070', 'weapon5': '0.088', 'weapon7': '0.124', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.450', 'weapon2': '0.580', 'HITCOUNT': '0.590', 'ARMOR': '0.856', 'weapon3': '1.046', 'weapon4': '1.160', 'DAMAGECOUNT': '2.946', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:22:17,073][2409547] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:22:17,186][2408954] Fps is (10 sec: 24575.4, 60 sec: 24780.7, 300 sec: 24326.1). Total num frames: 95703040. Throughput: 0: 6203.2. Samples: 23933400. Policy #0 lag: (min: 0.0, avg: 11.5, max: 27.0)
[2023-02-25 13:22:17,186][2408954] Avg episode reward: [(0, '12.645')]
[2023-02-25 13:22:17,206][2409033] Saving /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000023366_95707136.pth...
[2023-02-25 13:22:17,309][2409033] Removing /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000021938_89858048.pth
[2023-02-25 13:22:17,939][2409076] DAMAGECOUNT value on done: 8772.0
[2023-02-25 13:22:17,942][2409076] Sum rewards: 14.330, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.642', 'AMMO5': '0.015', 'AMMO2': '0.022', 'ARMOR': '0.032', 'weapon7': '0.058', 'AMMO3': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'weapon5': '0.192', 'WEAPON5': '0.400', 'weapon4': '0.406', 'WEAPON3': '0.650', 'HITCOUNT': '0.780', 'weapon2': '1.352', 'weapon3': '1.678', 'DAMAGECOUNT': '3.741', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:22:18,026][2409074] Updated weights for policy 0, policy_version 23371 (0.0012)
[2023-02-25 13:22:18,058][2409104] DAMAGECOUNT value on done: 8919.0
[2023-02-25 13:22:18,061][2409104] Sum rewards: 16.903, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.289', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'AMMO5': '0.025', 'AMMO3': '0.111', 'weapon5': '0.298', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'HITCOUNT': '1.190', 'weapon2': '1.428', 'weapon3': '1.742', 'DAMAGECOUNT': '5.550', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:22:18,104][2409355] DAMAGECOUNT value on done: 9903.0
[2023-02-25 13:22:18,104][2409355] Sum rewards: 17.400, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.748', 'AMMO2': '0.018', 'AMMO5': '0.029', 'AMMO3': '0.079', 'AMMO4': '0.091', 'weapon5': '0.282', 'ARMOR': '0.440', 'WEAPON4': '0.450', 'WEAPON3': '0.550', 'WEAPON5': '0.600', 'weapon2': '0.638', 'weapon4': '0.730', 'HITCOUNT': '0.900', 'weapon3': '1.322', 'DAMAGECOUNT': '6.018', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:22:18,118][2409548] DAMAGECOUNT value on done: 7856.0
[2023-02-25 13:22:18,119][2409548] Sum rewards: 17.820, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.605', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO5': '0.028', 'AMMO3': '0.083', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'weapon4': '0.212', 'weapon5': '0.352', 'ARMOR': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'weapon2': '1.008', 'HITCOUNT': '1.010', 'weapon3': '1.936', 'DAMAGECOUNT': '4.761', 'FRAGCOUNT': '12.500'}
[2023-02-25 13:22:18,232][2409866] DAMAGECOUNT value on done: 8465.0
[2023-02-25 13:22:18,236][2409866] Sum rewards: 7.820, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.202', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO3': '0.030', 'weapon7': '0.066', 'weapon5': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.123', 'WEAPON4': '0.250', 'WEAPON3': '0.300', 'WEAPON5': '0.300', 'HITCOUNT': '0.420', 'weapon2': '0.618', 'weapon3': '0.778', 'weapon4': '1.092', 'DAMAGECOUNT': '2.373', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:22:18,471][2409565] DAMAGECOUNT value on done: 10734.0
[2023-02-25 13:22:18,475][2409565] Sum rewards: 19.320, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.800', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.007', 'AMMO3': '0.070', 'weapon7': '0.082', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.156', 'WEAPON7': '0.200', 'weapon4': '0.218', 'WEAPON5': '0.250', 'ARMOR': '0.457', 'WEAPON3': '0.500', 'HITCOUNT': '0.770', 'weapon3': '1.238', 'weapon2': '1.476', 'DAMAGECOUNT': '4.143', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:22:18,666][2409096] DAMAGECOUNT value on done: 8308.0
[2023-02-25 13:22:18,670][2409096] Sum rewards: 15.283, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.981', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.012', 'AMMO3': '0.050', 'weapon5': '0.060', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon7': '0.176', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.240', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'ARMOR': '0.462', 'HITCOUNT': '0.740', 'weapon2': '1.426', 'weapon3': '1.432', 'DAMAGECOUNT': '3.930', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:22:19,110][2409485] DAMAGECOUNT value on done: 10583.0
[2023-02-25 13:22:19,111][2409485] Sum rewards: 13.736, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.490', 'AMMO5': '0.016', 'AMMO2': '0.040', 'AMMO3': '0.050', 'weapon7': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.254', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'weapon4': '0.576', 'WEAPON4': '0.650', 'HITCOUNT': '0.760', 'weapon3': '1.216', 'ARMOR': '1.351', 'weapon2': '1.406', 'DAMAGECOUNT': '3.957', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:22:19,173][2409075] DAMAGECOUNT value on done: 8206.0
[2023-02-25 13:22:19,174][2409075] Sum rewards: 10.011, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.946', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'AMMO3': '0.068', 'weapon4': '0.096', 'WEAPON4': '0.100', 'weapon5': '0.116', 'weapon7': '0.122', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'WEAPON7': '0.400', 'HITCOUNT': '0.530', 'WEAPON3': '0.550', 'ARMOR': '0.855', 'weapon3': '1.290', 'weapon2': '1.768', 'DAMAGECOUNT': '2.580', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:22:19,250][2409105] DAMAGECOUNT value on done: 10965.0
[2023-02-25 13:22:19,253][2409105] Sum rewards: 18.457, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.342', 'AMMO2': '0.004', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.021', 'weapon7': '0.050', 'AMMO3': '0.089', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.200', 'weapon5': '0.218', 'WEAPON5': '0.350', 'weapon4': '0.356', 'WEAPON3': '0.600', 'ARMOR': '0.856', 'HITCOUNT': '1.050', 'weapon2': '1.314', 'weapon3': '1.448', 'DAMAGECOUNT': '5.907', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:22:19,337][2409407] DAMAGECOUNT value on done: 8969.0
[2023-02-25 13:22:19,340][2409407] Sum rewards: 6.039, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.570', 'AMMO2': '0.011', 'weapon4': '0.016', 'AMMO5': '0.017', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'weapon5': '0.212', 'WEAPON5': '0.450', 'ARMOR': '0.454', 'WEAPON3': '0.800', 'HITCOUNT': '0.850', 'weapon2': '1.486', 'weapon3': '1.834', 'DAMAGECOUNT': '3.705', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:22:19,351][2409469] DAMAGECOUNT value on done: 7834.0
[2023-02-25 13:22:19,355][2409469] Sum rewards: 5.081, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.165', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.022', 'weapon5': '0.064', 'AMMO3': '0.067', 'weapon7': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'WEAPON3': '0.450', 'HITCOUNT': '0.520', 'ARMOR': '0.849', 'weapon3': '1.184', 'weapon2': '1.322', 'DAMAGECOUNT': '1.710', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:22:19,403][2409389] DAMAGECOUNT value on done: 8437.0
[2023-02-25 13:22:19,406][2409389] Sum rewards: 10.449, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.067', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon7': '0.068', 'AMMO4': '0.068', 'AMMO3': '0.076', 'weapon5': '0.076', 'weapon4': '0.096', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.439', 'WEAPON3': '0.500', 'weapon2': '0.614', 'HITCOUNT': '0.720', 'weapon3': '0.978', 'DAMAGECOUNT': '2.817', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:22:19,529][2409074] Updated weights for policy 0, policy_version 23381 (0.0012)
[2023-02-25 13:22:19,612][2409079] DAMAGECOUNT value on done: 8085.0
[2023-02-25 13:22:19,615][2409079] Sum rewards: 6.317, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.070', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO3': '0.089', 'AMMO4': '0.140', 'weapon5': '0.148', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.362', 'WEAPON3': '0.450', 'HITCOUNT': '0.600', 'weapon3': '1.104', 'weapon2': '1.564', 'DAMAGECOUNT': '2.391', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:22:20,038][2409597] DAMAGECOUNT value on done: 8746.0
[2023-02-25 13:22:20,041][2409597] Sum rewards: 6.354, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.030', 'AMMO5': '0.003', 'AMMO2': '0.019', 'AMMO3': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.093', 'weapon7': '0.158', 'WEAPON3': '0.200', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'HITCOUNT': '0.650', 'weapon3': '0.838', 'weapon4': '1.042', 'weapon2': '1.094', 'DAMAGECOUNT': '2.553', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:22:20,093][2409078] DAMAGECOUNT value on done: 9346.0
[2023-02-25 13:22:20,096][2409078] Sum rewards: 26.799, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.210', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO5': '0.022', 'AMMO4': '0.051', 'weapon7': '0.052', 'AMMO3': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.394', 'weapon4': '0.446', 'WEAPON5': '0.500', 'ARMOR': '0.500', 'WEAPON3': '0.600', 'weapon2': '1.170', 'HITCOUNT': '1.280', 'weapon3': '1.478', 'DAMAGECOUNT': '6.999', 'FRAGCOUNT': '19.000'}
[2023-02-25 13:22:20,378][2409077] DAMAGECOUNT value on done: 9571.0
[2023-02-25 13:22:20,382][2409077] Sum rewards: 11.338, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.890', 'AMMO2': '0.011', 'AMMO5': '0.021', 'AMMO4': '0.054', 'AMMO3': '0.087', 'WEAPON4': '0.200', 'weapon4': '0.224', 'weapon5': '0.318', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'ARMOR': '0.855', 'HITCOUNT': '0.880', 'weapon2': '1.238', 'weapon3': '1.736', 'DAMAGECOUNT': '3.504', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:22:20,435][2409486] DAMAGECOUNT value on done: 8290.0
[2023-02-25 13:22:20,439][2409486] Sum rewards: 15.450, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.142', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO5': '0.015', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon4': '0.110', 'weapon5': '0.208', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'ARMOR': '0.889', 'HITCOUNT': '0.910', 'weapon3': '1.648', 'weapon2': '1.664', 'DAMAGECOUNT': '3.687', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:22:20,584][2409097] DAMAGECOUNT value on done: 7659.0
[2023-02-25 13:22:20,588][2409097] Sum rewards: 12.134, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.259', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.022', 'AMMO3': '0.137', 'weapon5': '0.156', 'WEAPON5': '0.400', 'HITCOUNT': '0.710', 'WEAPON3': '0.850', 'ARMOR': '1.311', 'weapon2': '1.666', 'weapon3': '1.810', 'DAMAGECOUNT': '2.835', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:22:20,609][2409406] DAMAGECOUNT value on done: 9933.0
[2023-02-25 13:22:20,610][2409406] Sum rewards: 18.191, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.322', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.096', 'weapon7': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.294', 'WEAPON3': '0.650', 'ARMOR': '0.871', 'HITCOUNT': '1.230', 'weapon2': '1.340', 'weapon3': '1.690', 'DAMAGECOUNT': '4.638', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:22:20,772][2409596] DAMAGECOUNT value on done: 8182.0
[2023-02-25 13:22:20,772][2409405] DAMAGECOUNT value on done: 7393.0
[2023-02-25 13:22:20,776][2409405] Sum rewards: 10.100, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.708', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.015', 'AMMO3': '0.050', 'WEAPON3': '0.350', 'weapon5': '0.350', 'WEAPON5': '0.400', 'HITCOUNT': '0.640', 'ARMOR': '0.914', 'weapon3': '1.110', 'weapon2': '2.098', 'DAMAGECOUNT': '3.171', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:22:20,775][2409596] Sum rewards: 13.703, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.227', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon7': '0.066', 'AMMO3': '0.075', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.133', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.250', 'WEAPON3': '0.350', 'ARMOR': '0.408', 'HITCOUNT': '0.720', 'weapon2': '0.820', 'weapon4': '0.856', 'weapon3': '1.010', 'DAMAGECOUNT': '3.615', 'FRAGCOUNT': '8.500'}
[2023-02-25 13:22:21,057][2409373] DAMAGECOUNT value on done: 7522.0
[2023-02-25 13:22:21,057][2409373] Sum rewards: 14.291, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.766', 'AMMO2': '0.002', 'AMMO4': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'weapon5': '0.158', 'weapon4': '0.246', 'ARMOR': '0.453', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '1.100', 'weapon2': '1.172', 'weapon3': '1.880', 'DAMAGECOUNT': '3.669', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:22:21,315][2409074] Updated weights for policy 0, policy_version 23391 (0.0012)
[2023-02-25 13:22:21,686][2409355] DAMAGECOUNT value on done: 8863.0
[2023-02-25 13:22:21,687][2409355] Sum rewards: 14.710, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.930', 'AMMO5': '0.015', 'AMMO2': '0.031', 'ARMOR': '0.032', 'AMMO3': '0.078', 'weapon7': '0.108', 'AMMO4': '0.156', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon5': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.458', 'WEAPON3': '0.600', 'HITCOUNT': '0.740', 'weapon2': '1.062', 'weapon3': '1.516', 'DAMAGECOUNT': '3.741', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:22:21,807][2409866] DAMAGECOUNT value on done: 8744.0
[2023-02-25 13:22:21,809][2409866] Sum rewards: 21.419, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.154', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'weapon7': '0.086', 'AMMO3': '0.088', 'weapon4': '0.096', 'AMMO4': '0.111', 'weapon5': '0.114', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.350', 'ARMOR': '0.452', 'WEAPON3': '0.650', 'HITCOUNT': '1.110', 'weapon2': '1.292', 'weapon3': '1.928', 'DAMAGECOUNT': '4.599', 'FRAGCOUNT': '17.000'}
[2023-02-25 13:22:22,033][2409076] DAMAGECOUNT value on done: 9449.0
[2023-02-25 13:22:22,036][2409076] Sum rewards: 13.862, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.975', 'AMMO2': '0.000', 'AMMO4': '0.002', 'WEAPON1': '0.020', 'AMMO5': '0.028', 'weapon5': '0.108', 'AMMO3': '0.113', 'WEAPON4': '0.200', 'weapon4': '0.364', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'ARMOR': '0.907', 'HITCOUNT': '1.160', 'weapon2': '1.324', 'weapon3': '1.718', 'DAMAGECOUNT': '4.893', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:22:22,111][2409548] DAMAGECOUNT value on done: 7537.0
[2023-02-25 13:22:22,111][2409548] Sum rewards: 11.858, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO3': '0.040', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.117', 'weapon4': '0.132', 'WEAPON4': '0.150', 'weapon5': '0.190', 'WEAPON5': '0.200', 'HEALTH': '0.241', 'WEAPON3': '0.250', 'HITCOUNT': '0.550', 'ARMOR': '0.800', 'weapon3': '0.894', 'weapon2': '1.476', 'DAMAGECOUNT': '3.186', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:22:22,126][2409565] DAMAGECOUNT value on done: 10304.0
[2023-02-25 13:22:22,127][2409565] Sum rewards: 16.577, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.730', 'AMMO2': '0.037', 'AMMO5': '0.040', 'weapon7': '0.052', 'AMMO3': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.185', 'weapon5': '0.190', 'WEAPON4': '0.300', 'weapon2': '0.436', 'ARMOR': '0.454', 'WEAPON3': '0.750', 'WEAPON5': '0.850', 'HITCOUNT': '1.080', 'weapon4': '1.108', 'weapon3': '1.658', 'DAMAGECOUNT': '4.521', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:22:22,186][2408954] Fps is (10 sec: 24990.7, 60 sec: 24780.9, 300 sec: 24353.8). Total num frames: 95825920. Throughput: 0: 6204.8. Samples: 23951904. Policy #0 lag: (min: 0.0, avg: 11.5, max: 27.0)
[2023-02-25 13:22:22,186][2408954] Avg episode reward: [(0, '12.664')]
[2023-02-25 13:22:22,333][2409104] DAMAGECOUNT value on done: 9161.0
[2023-02-25 13:22:22,334][2409104] Sum rewards: 13.560, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.744', 'AMMO2': '0.015', 'AMMO5': '0.017', 'AMMO4': '0.073', 'weapon7': '0.078', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.278', 'weapon4': '0.352', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.750', 'ARMOR': '0.861', 'weapon2': '1.258', 'weapon3': '1.664', 'DAMAGECOUNT': '3.480', 'FRAGCOUNT': '10.500'}
[2023-02-25 13:22:22,733][2409096] DAMAGECOUNT value on done: 9022.0
[2023-02-25 13:22:22,733][2409096] Sum rewards: 12.485, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.353', 'AMMO5': '0.005', 'AMMO2': '0.031', 'AMMO3': '0.060', 'weapon7': '0.090', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.500', 'weapon4': '0.544', 'HITCOUNT': '0.620', 'weapon2': '1.448', 'weapon3': '1.450', 'DAMAGECOUNT': '3.423', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:22:22,933][2409407] DAMAGECOUNT value on done: 8424.0
[2023-02-25 13:22:22,935][2409407] Sum rewards: 15.321, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.017', 'AMMO2': '0.024', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon5': '0.110', 'AMMO4': '0.120', 'WEAPON5': '0.350', 'weapon4': '0.386', 'HEALTH': '0.513', 'WEAPON3': '0.550', 'weapon2': '0.692', 'ARMOR': '0.896', 'HITCOUNT': '1.080', 'weapon3': '1.464', 'DAMAGECOUNT': '3.915', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:22:22,962][2409074] Updated weights for policy 0, policy_version 23401 (0.0013)
[2023-02-25 13:22:23,242][2409079] DAMAGECOUNT value on done: 9070.0
[2023-02-25 13:22:23,245][2409079] Sum rewards: 21.189, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.254', 'AMMO2': '0.003', 'AMMO5': '0.016', 'AMMO4': '0.017', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.052', 'weapon4': '0.218', 'weapon5': '0.332', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '0.780', 'weapon3': '1.302', 'weapon2': '1.316', 'DAMAGECOUNT': '5.325', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:22:23,474][2409105] DAMAGECOUNT value on done: 8141.0
[2023-02-25 13:22:23,475][2409105] Sum rewards: 9.619, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.401', 'AMMO2': '0.002', 'AMMO4': '0.007', 'AMMO5': '0.011', 'AMMO3': '0.069', 'weapon7': '0.148', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.232', 'weapon4': '0.232', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.610', 'weapon3': '1.226', 'weapon2': '1.266', 'DAMAGECOUNT': '3.027', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:22:23,518][2409469] DAMAGECOUNT value on done: 7288.0
[2023-02-25 13:22:23,521][2409469] Sum rewards: 8.179, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.487', 'AMMO2': '0.006', 'weapon4': '0.022', 'AMMO4': '0.029', 'AMMO5': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.110', 'weapon5': '0.296', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'ARMOR': '0.852', 'HITCOUNT': '1.070', 'weapon2': '1.608', 'weapon3': '1.728', 'DAMAGECOUNT': '4.515', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:22:23,688][2409075] DAMAGECOUNT value on done: 8378.0
[2023-02-25 13:22:23,689][2409075] Sum rewards: 10.513, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.142', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO5': '0.032', 'AMMO4': '0.055', 'weapon5': '0.160', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'weapon4': '0.258', 'WEAPON5': '0.650', 'ARMOR': '0.800', 'WEAPON3': '1.050', 'weapon2': '1.140', 'HITCOUNT': '1.180', 'weapon3': '1.890', 'DAMAGECOUNT': '4.482', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:22:23,812][2409389] DAMAGECOUNT value on done: 8347.0
[2023-02-25 13:22:23,815][2409373] Large shaping reward 2.563 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.531, 177.0), ('weapon7', 0.002)]
[2023-02-25 13:22:23,816][2409389] Sum rewards: 14.766, reward structure: {'DEATHCOUNT': '-6.750', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.034', 'weapon5': '0.068', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'weapon7': '0.158', 'AMMO4': '0.172', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.410', 'HEALTH': '0.494', 'WEAPON3': '0.550', 'weapon2': '0.706', 'HITCOUNT': '1.050', 'weapon3': '1.908', 'DAMAGECOUNT': '4.335', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:22:24,002][2409078] DAMAGECOUNT value on done: 8627.0
[2023-02-25 13:22:24,003][2409078] Sum rewards: 21.247, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.600', 'AMMO4': '-0.056', 'AMMO2': '-0.011', 'AMMO5': '0.010', 'AMMO3': '0.070', 'weapon5': '0.158', 'WEAPON5': '0.250', 'ARMOR': '0.452', 'WEAPON3': '0.550', 'HITCOUNT': '1.160', 'weapon3': '1.694', 'weapon2': '1.780', 'DAMAGECOUNT': '5.040', 'FRAGCOUNT': '16.000'}
[2023-02-25 13:22:24,024][2409486] DAMAGECOUNT value on done: 8685.0
[2023-02-25 13:22:24,027][2409486] Sum rewards: 15.112, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.690', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'AMMO5': '0.028', 'AMMO4': '0.100', 'AMMO3': '0.115', 'weapon5': '0.186', 'WEAPON4': '0.250', 'weapon4': '0.402', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'HITCOUNT': '0.790', 'weapon2': '0.864', 'weapon3': '1.686', 'DAMAGECOUNT': '3.501', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:22:24,054][2409077] DAMAGECOUNT value on done: 8407.0
[2023-02-25 13:22:24,057][2409077] Sum rewards: 6.994, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.578', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.024', 'AMMO3': '0.087', 'AMMO4': '0.118', 'weapon7': '0.176', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.272', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.600', 'ARMOR': '0.888', 'weapon4': '0.912', 'weapon3': '1.100', 'weapon2': '1.252', 'DAMAGECOUNT': '3.216', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:22:24,254][2409597] DAMAGECOUNT value on done: 8912.0
[2023-02-25 13:22:24,257][2409597] Sum rewards: 14.063, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.343', 'AMMO2': '0.030', 'AMMO5': '0.033', 'weapon7': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.111', 'AMMO4': '0.148', 'weapon5': '0.278', 'WEAPON4': '0.350', 'ARMOR': '0.453', 'weapon2': '0.516', 'WEAPON5': '0.650', 'WEAPON3': '0.750', 'HITCOUNT': '0.880', 'weapon4': '1.188', 'weapon3': '1.310', 'DAMAGECOUNT': '4.581', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:22:24,266][2409406] DAMAGECOUNT value on done: 6521.0
[2023-02-25 13:22:24,269][2409406] Sum rewards: 9.461, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.148', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO3': '0.102', 'WEAPON4': '0.200', 'weapon5': '0.204', 'weapon4': '0.440', 'WEAPON5': '0.600', 'HITCOUNT': '0.730', 'WEAPON3': '0.750', 'weapon2': '0.774', 'weapon3': '1.870', 'DAMAGECOUNT': '2.910', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:22:24,540][2409074] Updated weights for policy 0, policy_version 23411 (0.0013)
[2023-02-25 13:22:24,573][2409405] DAMAGECOUNT value on done: 9272.0
[2023-02-25 13:22:24,576][2409405] Sum rewards: 7.325, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.948', 'AMMO2': '0.007', 'AMMO5': '0.019', 'AMMO4': '0.034', 'weapon4': '0.044', 'AMMO3': '0.071', 'WEAPON4': '0.100', 'weapon7': '0.106', 'weapon5': '0.254', 'AMMO6': '0.280', 'AMMO7': '0.280', 'WEAPON5': '0.400', 'WEAPON7': '0.400', 'HITCOUNT': '0.490', 'WEAPON3': '0.500', 'ARMOR': '0.855', 'weapon3': '1.272', 'weapon2': '1.372', 'DAMAGECOUNT': '2.289', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:22:24,992][2409373] DAMAGECOUNT value on done: 9723.0
[2023-02-25 13:22:24,993][2409373] Sum rewards: 16.373, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.220', 'AMMO2': '0.009', 'AMMO5': '0.022', 'AMMO4': '0.045', 'weapon7': '0.062', 'AMMO3': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.638', 'WEAPON3': '0.750', 'weapon4': '0.874', 'ARMOR': '0.895', 'HITCOUNT': '1.090', 'weapon3': '1.792', 'DAMAGECOUNT': '4.068', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:22:25,019][2409469] Large shaping reward 3.652 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:22:25,054][2409596] DAMAGECOUNT value on done: 8206.0
[2023-02-25 13:22:25,057][2409596] Sum rewards: 16.313, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.014', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.061', 'AMMO4': '0.068', 'weapon7': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.252', 'weapon4': '0.288', 'WEAPON5': '0.350', 'HEALTH': '0.364', 'WEAPON3': '0.400', 'HITCOUNT': '0.740', 'weapon2': '1.202', 'weapon3': '1.624', 'DAMAGECOUNT': '3.891', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:22:25,099][2409097] DAMAGECOUNT value on done: 7956.0
[2023-02-25 13:22:25,100][2409097] Sum rewards: 11.489, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.068', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.012', 'AMMO3': '0.057', 'weapon7': '0.072', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.122', 'weapon4': '0.138', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.680', 'ARMOR': '0.854', 'weapon3': '1.034', 'weapon2': '1.546', 'DAMAGECOUNT': '2.526', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:22:25,471][2409355] DAMAGECOUNT value on done: 8483.0
[2023-02-25 13:22:25,474][2409355] Sum rewards: 17.892, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.036', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'AMMO5': '0.010', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'weapon4': '0.220', 'weapon5': '0.264', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'ARMOR': '0.932', 'HITCOUNT': '1.030', 'weapon2': '1.384', 'weapon3': '1.416', 'DAMAGECOUNT': '4.095', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:22:25,577][2409866] DAMAGECOUNT value on done: 10705.0
[2023-02-25 13:22:25,580][2409866] Sum rewards: 18.420, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.802', 'AMMO2': '0.022', 'AMMO5': '0.026', 'weapon4': '0.040', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'AMMO4': '0.111', 'weapon5': '0.282', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'ARMOR': '0.900', 'HITCOUNT': '0.900', 'weapon2': '1.536', 'weapon3': '1.744', 'DAMAGECOUNT': '5.067', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:22:25,748][2409548] DAMAGECOUNT value on done: 7150.0
[2023-02-25 13:22:25,749][2409548] Sum rewards: 17.712, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.276', 'AMMO2': '0.004', 'AMMO5': '0.012', 'AMMO4': '0.018', 'AMMO3': '0.098', 'weapon5': '0.110', 'weapon7': '0.152', 'WEAPON5': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.900', 'weapon3': '1.522', 'weapon2': '1.762', 'DAMAGECOUNT': '4.419', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:22:25,779][2409565] DAMAGECOUNT value on done: 9894.0
[2023-02-25 13:22:25,780][2409565] Sum rewards: 15.855, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.379', 'AMMO2': '0.014', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'AMMO4': '0.068', 'AMMO3': '0.091', 'weapon7': '0.096', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.206', 'weapon4': '0.362', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '0.760', 'weapon2': '1.202', 'weapon3': '1.702', 'DAMAGECOUNT': '4.983', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:22:25,975][2409076] DAMAGECOUNT value on done: 8193.0
[2023-02-25 13:22:25,976][2409076] Sum rewards: 8.708, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.133', 'AMMO2': '0.008', 'AMMO5': '0.022', 'AMMO4': '0.041', 'AMMO3': '0.069', 'weapon5': '0.128', 'weapon7': '0.174', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'WEAPON7': '0.400', 'WEAPON5': '0.450', 'ARMOR': '0.456', 'WEAPON3': '0.550', 'weapon4': '0.688', 'HITCOUNT': '0.810', 'weapon2': '1.024', 'weapon3': '1.042', 'DAMAGECOUNT': '3.198', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:22:26,148][2409104] DAMAGECOUNT value on done: 8448.0
[2023-02-25 13:22:26,152][2409104] Sum rewards: 8.604, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.742', 'AMMO5': '0.009', 'AMMO2': '0.011', 'weapon5': '0.030', 'AMMO4': '0.055', 'AMMO3': '0.081', 'weapon7': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.288', 'WEAPON4': '0.300', 'ARMOR': '0.497', 'WEAPON3': '0.600', 'HITCOUNT': '0.690', 'weapon3': '1.006', 'weapon2': '1.204', 'DAMAGECOUNT': '2.343', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:22:26,409][2409074] Updated weights for policy 0, policy_version 23421 (0.0012)
[2023-02-25 13:22:27,089][2409096] DAMAGECOUNT value on done: 9334.0
[2023-02-25 13:22:27,090][2409096] Sum rewards: 9.142, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.020', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'AMMO3': '0.082', 'HEALTH': '0.116', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'weapon4': '0.254', 'weapon5': '0.286', 'HITCOUNT': '0.440', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon2': '1.140', 'ARMOR': '1.204', 'weapon3': '1.378', 'DAMAGECOUNT': '2.694', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:22:27,186][2408954] Fps is (10 sec: 24985.5, 60 sec: 24780.7, 300 sec: 24312.2). Total num frames: 95952896. Throughput: 0: 6211.4. Samples: 23989464. Policy #0 lag: (min: 0.0, avg: 11.5, max: 27.0)
[2023-02-25 13:22:27,187][2408954] Avg episode reward: [(0, '12.870')]
[2023-02-25 13:22:27,256][2409407] DAMAGECOUNT value on done: 8167.0
[2023-02-25 13:22:27,259][2409407] Sum rewards: 9.901, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.692', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'WEAPON4': '0.150', 'weapon4': '0.414', 'ARMOR': '0.432', 'WEAPON3': '0.800', 'weapon2': '1.104', 'HITCOUNT': '1.150', 'weapon3': '1.862', 'DAMAGECOUNT': '4.380', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:22:27,262][2409075] DAMAGECOUNT value on done: 8256.0
[2023-02-25 13:22:27,265][2409075] Sum rewards: 14.521, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.659', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'weapon7': '0.052', 'AMMO3': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.236', 'weapon4': '0.280', 'WEAPON5': '0.400', 'ARMOR': '0.462', 'WEAPON3': '0.700', 'HITCOUNT': '1.060', 'weapon2': '1.270', 'weapon3': '1.704', 'DAMAGECOUNT': '3.960', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:22:27,358][2409389] DAMAGECOUNT value on done: 7609.0
[2023-02-25 13:22:27,359][2409389] Sum rewards: 13.839, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.645', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO3': '0.105', 'weapon5': '0.162', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'HITCOUNT': '1.040', 'weapon2': '1.392', 'weapon3': '1.898', 'DAMAGECOUNT': '3.612', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:22:27,529][2409105] DAMAGECOUNT value on done: 8552.0
[2023-02-25 13:22:27,530][2409105] Sum rewards: 7.327, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO3': '0.020', 'weapon7': '0.058', 'AMMO4': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.172', 'HEALTH': '0.241', 'HITCOUNT': '0.390', 'ARMOR': '0.400', 'weapon3': '0.492', 'weapon2': '0.580', 'DAMAGECOUNT': '1.605', 'weapon4': '1.794', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:22:27,573][2409078] DAMAGECOUNT value on done: 8028.0
[2023-02-25 13:22:27,577][2409078] Sum rewards: 2.201, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.484', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.033', 'AMMO3': '0.088', 'weapon7': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.167', 'weapon5': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'HITCOUNT': '0.570', 'WEAPON3': '0.600', 'weapon4': '0.802', 'ARMOR': '0.804', 'weapon2': '1.050', 'weapon3': '1.194', 'DAMAGECOUNT': '1.860', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:22:27,686][2409074] Updated weights for policy 0, policy_version 23431 (0.0012)
[2023-02-25 13:22:27,761][2409469] DAMAGECOUNT value on done: 8731.0
[2023-02-25 13:22:27,762][2409469] Sum rewards: 20.436, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.040', 'AMMO2': '0.015', 'AMMO5': '0.017', 'weapon7': '0.058', 'AMMO4': '0.073', 'AMMO3': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.182', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.324', 'WEAPON5': '0.350', 'ARMOR': '0.448', 'WEAPON3': '0.750', 'weapon2': '1.302', 'HITCOUNT': '1.440', 'weapon3': '1.616', 'DAMAGECOUNT': '5.400', 'FRAGCOUNT': '15.500'}
[2023-02-25 13:22:27,818][2409079] DAMAGECOUNT value on done: 7737.0
[2023-02-25 13:22:27,819][2409079] Sum rewards: 7.751, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.044', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO3': '0.030', 'weapon5': '0.052', 'AMMO4': '0.053', 'weapon7': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'WEAPON3': '0.250', 'HITCOUNT': '0.350', 'weapon4': '0.556', 'weapon2': '0.678', 'weapon3': '0.836', 'ARMOR': '0.938', 'DAMAGECOUNT': '1.563', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:22:27,881][2409077] DAMAGECOUNT value on done: 8415.0
[2023-02-25 13:22:27,884][2409077] Sum rewards: 8.383, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'AMMO3': '0.077', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'HEALTH': '0.157', 'weapon5': '0.210', 'WEAPON5': '0.250', 'weapon4': '0.286', 'WEAPON3': '0.500', 'HITCOUNT': '0.660', 'weapon2': '0.972', 'weapon3': '1.672', 'DAMAGECOUNT': '2.799', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:22:27,959][2409099] DAMAGECOUNT value on done: 8445.0
[2023-02-25 13:22:27,962][2409099] Sum rewards: 16.697, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.950', 'AMMO5': '0.015', 'ARMOR': '0.020', 'AMMO2': '0.035', 'AMMO3': '0.082', 'AMMO4': '0.174', 'weapon5': '0.176', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.572', 'WEAPON3': '0.600', 'weapon2': '0.712', 'HITCOUNT': '1.140', 'weapon3': '1.422', 'DAMAGECOUNT': '5.049', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:22:27,969][2409486] DAMAGECOUNT value on done: 7961.0
[2023-02-25 13:22:27,970][2409486] Sum rewards: 9.852, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.240', 'AMMO2': '0.007', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.033', 'weapon7': '0.058', 'AMMO3': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.188', 'WEAPON5': '0.450', 'ARMOR': '0.500', 'WEAPON3': '0.500', 'weapon4': '0.732', 'HITCOUNT': '0.850', 'weapon2': '1.132', 'weapon3': '1.456', 'DAMAGECOUNT': '3.432', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:22:28,098][2409406] DAMAGECOUNT value on done: 8461.0
[2023-02-25 13:22:28,101][2409406] Sum rewards: 14.596, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.863', 'AMMO2': '0.019', 'AMMO5': '0.019', 'WEAPON4': '0.050', 'AMMO3': '0.079', 'AMMO4': '0.095', 'weapon5': '0.122', 'weapon4': '0.214', 'WEAPON5': '0.450', 'ARMOR': '0.496', 'WEAPON3': '0.500', 'HITCOUNT': '0.970', 'weapon2': '0.980', 'weapon3': '1.064', 'DAMAGECOUNT': '3.900', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:22:28,208][2409405] DAMAGECOUNT value on done: 8905.0
[2023-02-25 13:22:28,209][2409405] Sum rewards: 10.099, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.468', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.012', 'weapon7': '0.052', 'weapon5': '0.100', 'AMMO3': '0.118', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon4': '0.162', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'HITCOUNT': '0.820', 'WEAPON3': '0.850', 'ARMOR': '0.905', 'weapon3': '1.472', 'weapon2': '1.766', 'DAMAGECOUNT': '3.750', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:22:28,338][2409597] DAMAGECOUNT value on done: 8555.0
[2023-02-25 13:22:28,340][2409597] Sum rewards: 19.909, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.440', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO4': '0.018', 'AMMO5': '0.019', 'AMMO3': '0.104', 'weapon5': '0.266', 'WEAPON5': '0.400', 'ARMOR': '0.451', 'WEAPON3': '0.700', 'HITCOUNT': '1.310', 'weapon2': '1.330', 'weapon3': '2.016', 'DAMAGECOUNT': '5.721', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:22:28,720][2409097] DAMAGECOUNT value on done: 7489.0
[2023-02-25 13:22:28,721][2409097] Sum rewards: 7.758, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.104', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.018', 'AMMO3': '0.080', 'AMMO4': '0.091', 'weapon7': '0.092', 'weapon5': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.324', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.720', 'weapon2': '0.998', 'weapon3': '1.758', 'DAMAGECOUNT': '2.586', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:22:28,960][2409373] DAMAGECOUNT value on done: 9683.0
[2023-02-25 13:22:28,960][2409373] Sum rewards: 11.704, reward structure: {'DEATHCOUNT': '-6.750', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO5': '0.020', 'AMMO4': '0.078', 'AMMO3': '0.085', 'weapon5': '0.344', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.610', 'HEALTH': '0.636', 'ARMOR': '1.200', 'weapon3': '1.584', 'weapon2': '1.748', 'DAMAGECOUNT': '3.273', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:22:29,099][2409596] DAMAGECOUNT value on done: 7588.0
[2023-02-25 13:22:29,102][2409596] Sum rewards: 14.320, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.736', 'AMMO2': '0.004', 'AMMO5': '0.014', 'AMMO4': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.073', 'weapon7': '0.142', 'weapon5': '0.164', 'AMMO6': '0.260', 'AMMO7': '0.260', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.570', 'ARMOR': '1.385', 'weapon3': '1.442', 'weapon2': '1.568', 'DAMAGECOUNT': '2.784', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:22:29,393][2409355] DAMAGECOUNT value on done: 6601.0
[2023-02-25 13:22:29,394][2409355] Sum rewards: 13.252, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.009', 'AMMO5': '0.015', 'HEALTH': '0.022', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon5': '0.304', 'WEAPON5': '0.400', 'weapon4': '0.408', 'WEAPON3': '0.450', 'HITCOUNT': '0.760', 'ARMOR': '0.978', 'weapon2': '1.378', 'weapon3': '1.410', 'DAMAGECOUNT': '2.964', 'FRAGCOUNT': '8.500'}
[2023-02-25 13:22:29,487][2409866] DAMAGECOUNT value on done: 10407.0
[2023-02-25 13:22:29,491][2409866] Sum rewards: 14.412, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.744', 'AMMO5': '0.030', 'AMMO2': '0.039', 'AMMO3': '0.148', 'AMMO4': '0.196', 'weapon4': '0.246', 'WEAPON4': '0.300', 'weapon5': '0.412', 'WEAPON5': '0.650', 'ARMOR': '0.800', 'HITCOUNT': '0.890', 'WEAPON3': '0.900', 'weapon2': '1.146', 'weapon3': '1.756', 'DAMAGECOUNT': '4.392', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:22:30,028][2409076] DAMAGECOUNT value on done: 8494.0
[2023-02-25 13:22:30,031][2409076] Sum rewards: 7.454, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.930', 'AMMO2': '0.010', 'AMMO5': '0.014', 'AMMO4': '0.049', 'AMMO3': '0.066', 'weapon7': '0.074', 'WEAPON4': '0.100', 'weapon5': '0.134', 'AMMO6': '0.320', 'AMMO7': '0.320', 'HITCOUNT': '0.330', 'WEAPON5': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.882', 'weapon3': '0.890', 'weapon2': '1.066', 'DAMAGECOUNT': '1.629', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:22:30,165][2409074] Updated weights for policy 0, policy_version 23441 (0.0012)
[2023-02-25 13:22:30,186][2409104] DAMAGECOUNT value on done: 9330.0
[2023-02-25 13:22:30,188][2409104] Sum rewards: 12.644, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.441', 'AMMO5': '0.020', 'AMMO2': '0.021', 'weapon7': '0.076', 'AMMO4': '0.104', 'AMMO3': '0.119', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.318', 'weapon4': '0.438', 'ARMOR': '0.464', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '0.880', 'weapon2': '1.272', 'weapon3': '1.560', 'DAMAGECOUNT': '4.263', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:22:30,920][2409074] Updated weights for policy 0, policy_version 23451 (0.0015)
[2023-02-25 13:22:31,300][2409075] DAMAGECOUNT value on done: 9393.0
[2023-02-25 13:22:31,300][2409075] Sum rewards: 14.787, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.095', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.017', 'AMMO3': '0.081', 'weapon7': '0.184', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon5': '0.286', 'WEAPON5': '0.300', 'WEAPON7': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.670', 'weapon2': '1.290', 'ARMOR': '1.298', 'weapon3': '1.406', 'DAMAGECOUNT': '5.172', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:22:31,376][2409389] DAMAGECOUNT value on done: 9913.0
[2023-02-25 13:22:31,380][2409389] Sum rewards: 18.263, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.424', 'AMMO2': '0.013', 'weapon4': '0.014', 'WEAPON1': '0.020', 'AMMO5': '0.030', 'AMMO4': '0.066', 'AMMO3': '0.073', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.122', 'weapon5': '0.350', 'WEAPON3': '0.500', 'WEAPON5': '0.500', 'HITCOUNT': '0.850', 'weapon2': '1.236', 'ARMOR': '1.246', 'weapon3': '1.876', 'DAMAGECOUNT': '4.641', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:22:31,451][2409407] DAMAGECOUNT value on done: 7957.0
[2023-02-25 13:22:31,454][2409407] Sum rewards: 10.385, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.641', 'AMMO5': '0.017', 'AMMO2': '0.022', 'weapon7': '0.048', 'AMMO3': '0.062', 'AMMO4': '0.110', 'weapon5': '0.208', 'WEAPON4': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.436', 'WEAPON3': '0.450', 'HITCOUNT': '0.770', 'ARMOR': '1.308', 'weapon2': '1.414', 'weapon3': '1.624', 'DAMAGECOUNT': '3.366', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:22:31,497][2409077] DAMAGECOUNT value on done: 8120.0
[2023-02-25 13:22:31,497][2409077] Sum rewards: 11.827, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.120', 'AMMO2': '0.024', 'AMMO5': '0.026', 'WEAPON1': '0.040', 'AMMO3': '0.097', 'AMMO4': '0.122', 'weapon5': '0.196', 'WEAPON4': '0.250', 'weapon4': '0.396', 'WEAPON5': '0.600', 'weapon2': '0.684', 'WEAPON3': '0.700', 'HITCOUNT': '1.100', 'weapon3': '2.006', 'DAMAGECOUNT': '4.455', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:22:31,529][2409078] DAMAGECOUNT value on done: 7921.0
[2023-02-25 13:22:31,532][2409078] Sum rewards: 18.764, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.812', 'AMMO2': '0.018', 'AMMO5': '0.018', 'AMMO4': '0.092', 'weapon7': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.103', 'weapon5': '0.156', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.800', 'ARMOR': '1.254', 'weapon3': '1.516', 'weapon2': '1.984', 'DAMAGECOUNT': '4.188', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:22:31,577][2409096] DAMAGECOUNT value on done: 7926.0
[2023-02-25 13:22:31,577][2409096] Sum rewards: 13.105, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.892', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon7': '0.048', 'AMMO3': '0.061', 'weapon5': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.170', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.680', 'weapon4': '0.872', 'weapon2': '0.940', 'weapon3': '0.994', 'DAMAGECOUNT': '3.357', 'FRAGCOUNT': '9.500'}
[2023-02-25 13:22:31,718][2409406] DAMAGECOUNT value on done: 8847.0
[2023-02-25 13:22:31,719][2409406] Sum rewards: 10.642, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.014', 'AMMO2': '0.010', 'AMMO5': '0.027', 'WEAPON1': '0.030', 'AMMO4': '0.050', 'AMMO3': '0.102', 'weapon7': '0.112', 'weapon5': '0.190', 'WEAPON4': '0.250', 'AMMO6': '0.380', 'AMMO7': '0.380', 'WEAPON7': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'weapon2': '0.726', 'HITCOUNT': '0.740', 'weapon4': '0.784', 'ARMOR': '1.390', 'weapon3': '1.642', 'DAMAGECOUNT': '3.792', 'FRAGCOUNT': '8.500'}
[2023-02-25 13:22:31,837][2409079] DAMAGECOUNT value on done: 8012.0
[2023-02-25 13:22:31,841][2409079] Sum rewards: 8.264, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.770', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO3': '0.070', 'weapon7': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.160', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.590', 'weapon2': '1.294', 'weapon3': '1.682', 'DAMAGECOUNT': '2.229', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:22:31,917][2409105] DAMAGECOUNT value on done: 7779.0
[2023-02-25 13:22:31,917][2409105] Sum rewards: 10.746, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.509', 'AMMO2': '0.010', 'AMMO5': '0.022', 'AMMO4': '0.050', 'AMMO3': '0.088', 'weapon4': '0.142', 'WEAPON4': '0.150', 'weapon5': '0.346', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.820', 'ARMOR': '0.851', 'weapon2': '1.296', 'weapon3': '1.844', 'DAMAGECOUNT': '4.035', 'FRAGCOUNT': '6.500'}
[2023-02-25 13:22:32,046][2409486] DAMAGECOUNT value on done: 7886.0
[2023-02-25 13:22:32,050][2409486] Sum rewards: 12.789, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.081', 'AMMO2': '0.011', 'AMMO5': '0.022', 'AMMO4': '0.056', 'weapon7': '0.078', 'weapon4': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.125', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.266', 'WEAPON5': '0.550', 'HITCOUNT': '0.890', 'WEAPON3': '0.900', 'weapon2': '1.180', 'ARMOR': '1.297', 'weapon3': '1.932', 'DAMAGECOUNT': '3.318', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:22:32,098][2409099] DAMAGECOUNT value on done: 7576.0
[2023-02-25 13:22:32,101][2409099] Sum rewards: 14.436, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.859', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO3': '0.138', 'AMMO4': '0.145', 'weapon5': '0.194', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.680', 'ARMOR': '0.828', 'WEAPON3': '0.850', 'HITCOUNT': '1.080', 'weapon2': '1.140', 'weapon3': '1.532', 'DAMAGECOUNT': '4.014', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:22:32,162][2409405] DAMAGECOUNT value on done: 6245.0
[2023-02-25 13:22:32,163][2409405] Sum rewards: 13.620, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.260', 'AMMO2': '0.004', 'AMMO5': '0.008', 'AMMO4': '0.021', 'AMMO3': '0.079', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.254', 'weapon4': '0.258', 'WEAPON3': '0.550', 'HITCOUNT': '0.840', 'weapon3': '0.996', 'weapon2': '1.758', 'DAMAGECOUNT': '3.411', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:22:32,186][2408954] Fps is (10 sec: 26623.9, 60 sec: 25053.9, 300 sec: 24409.4). Total num frames: 96092160. Throughput: 0: 6222.4. Samples: 24026904. Policy #0 lag: (min: 0.0, avg: 11.5, max: 27.0)
[2023-02-25 13:22:32,186][2408954] Avg episode reward: [(0, '12.925')]
[2023-02-25 13:22:32,194][2409469] DAMAGECOUNT value on done: 9931.0
[2023-02-25 13:22:32,195][2409469] Sum rewards: 20.127, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.557', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.014', 'weapon4': '0.038', 'AMMO3': '0.063', 'weapon7': '0.090', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.326', 'ARMOR': '0.458', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.850', 'weapon2': '1.332', 'weapon3': '1.524', 'DAMAGECOUNT': '4.110', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:22:32,519][2409597] DAMAGECOUNT value on done: 10085.0
[2023-02-25 13:22:32,520][2409597] Sum rewards: 14.665, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.361', 'AMMO2': '0.009', 'AMMO5': '0.014', 'AMMO4': '0.047', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'weapon5': '0.188', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'ARMOR': '0.914', 'HITCOUNT': '1.150', 'weapon3': '1.684', 'weapon2': '1.736', 'DAMAGECOUNT': '4.374', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:22:32,722][2409074] Updated weights for policy 0, policy_version 23461 (0.0012)
[2023-02-25 13:22:32,806][2409097] DAMAGECOUNT value on done: 9794.0
[2023-02-25 13:22:32,807][2409097] Sum rewards: 9.195, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.988', 'AMMO2': '0.026', 'AMMO5': '0.031', 'AMMO3': '0.110', 'AMMO4': '0.127', 'weapon4': '0.294', 'WEAPON4': '0.300', 'weapon5': '0.338', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'WEAPON5': '0.700', 'HITCOUNT': '0.910', 'weapon2': '0.976', 'weapon3': '1.974', 'DAMAGECOUNT': '4.296', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:22:32,954][2409596] DAMAGECOUNT value on done: 9790.0
[2023-02-25 13:22:32,956][2409596] Sum rewards: 12.540, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.826', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO5': '0.025', 'AMMO4': '0.089', 'AMMO3': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.104', 'WEAPON4': '0.150', 'weapon5': '0.176', 'weapon4': '0.464', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'HITCOUNT': '0.810', 'ARMOR': '0.852', 'weapon2': '0.884', 'weapon3': '1.804', 'DAMAGECOUNT': '3.435', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:22:33,214][2409373] DAMAGECOUNT value on done: 10240.0
[2023-02-25 13:22:33,215][2409373] Sum rewards: 19.959, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.011', 'weapon7': '0.016', 'AMMO5': '0.018', 'AMMO4': '0.056', 'AMMO3': '0.073', 'HEALTH': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.268', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '1.160', 'weapon2': '1.338', 'weapon3': '1.652', 'DAMAGECOUNT': '4.716', 'FRAGCOUNT': '13.500'}
[2023-02-25 13:22:33,334][2409355] DAMAGECOUNT value on done: 9603.0
[2023-02-25 13:22:33,337][2409355] Sum rewards: 19.252, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.832', 'AMMO2': '0.011', 'AMMO5': '0.020', 'AMMO4': '0.056', 'AMMO3': '0.132', 'weapon4': '0.178', 'WEAPON4': '0.200', 'weapon5': '0.244', 'WEAPON5': '0.450', 'WEAPON3': '0.900', 'HITCOUNT': '1.010', 'weapon3': '1.660', 'weapon2': '1.700', 'ARMOR': '1.708', 'DAMAGECOUNT': '5.064', 'FRAGCOUNT': '16.000'}
[2023-02-25 13:22:33,421][2409866] DAMAGECOUNT value on done: 9229.0
[2023-02-25 13:22:33,421][2409866] Sum rewards: 12.124, reward structure: {'DEATHCOUNT': '-3.750', 'weapon7': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.022', 'AMMO3': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.108', 'HEALTH': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.350', 'WEAPON3': '0.350', 'weapon5': '0.356', 'weapon4': '0.442', 'weapon2': '0.572', 'HITCOUNT': '0.680', 'ARMOR': '0.850', 'weapon3': '1.262', 'DAMAGECOUNT': '3.210', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:22:34,015][2409104] DAMAGECOUNT value on done: 11064.0
[2023-02-25 13:22:34,016][2409104] Sum rewards: 14.783, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.809', 'AMMO2': '0.015', 'AMMO5': '0.020', 'ARMOR': '0.028', 'AMMO3': '0.067', 'weapon7': '0.072', 'AMMO4': '0.073', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.180', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'HITCOUNT': '0.810', 'weapon4': '0.890', 'weapon2': '1.012', 'weapon3': '1.142', 'DAMAGECOUNT': '4.143', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:22:34,517][2409076] DAMAGECOUNT value on done: 8891.0
[2023-02-25 13:22:34,521][2409076] Sum rewards: 14.918, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon7': '0.058', 'AMMO3': '0.060', 'HEALTH': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.125', 'weapon5': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.284', 'WEAPON3': '0.400', 'ARMOR': '0.455', 'HITCOUNT': '0.870', 'weapon3': '1.274', 'weapon2': '1.608', 'DAMAGECOUNT': '3.312', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:22:34,527][2409074] Updated weights for policy 0, policy_version 23471 (0.0012)
[2023-02-25 13:22:35,202][2409075] DAMAGECOUNT value on done: 8545.0
[2023-02-25 13:22:35,206][2409075] Sum rewards: 16.051, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO3': '0.040', 'AMMO4': '0.109', 'weapon5': '0.118', 'weapon7': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.500', 'HEALTH': '0.575', 'weapon3': '0.806', 'weapon2': '0.820', 'weapon4': '1.686', 'DAMAGECOUNT': '2.778', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:22:35,220][2409077] DAMAGECOUNT value on done: 9029.0
[2023-02-25 13:22:35,223][2409077] Sum rewards: 7.107, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.578', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO3': '0.059', 'weapon7': '0.100', 'AMMO4': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.172', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '0.510', 'weapon2': '0.804', 'weapon3': '0.908', 'weapon4': '1.586', 'DAMAGECOUNT': '1.722', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:22:35,264][2409389] DAMAGECOUNT value on done: 7869.0
[2023-02-25 13:22:35,268][2409389] Sum rewards: 12.230, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.469', 'AMMO2': '0.012', 'AMMO5': '0.031', 'weapon4': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.081', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon7': '0.196', 'WEAPON7': '0.200', 'weapon5': '0.316', 'HITCOUNT': '0.580', 'WEAPON3': '0.600', 'WEAPON5': '0.600', 'weapon2': '1.122', 'weapon3': '1.710', 'ARMOR': '1.794', 'DAMAGECOUNT': '2.706', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:22:35,372][2409096] DAMAGECOUNT value on done: 8769.0
[2023-02-25 13:22:35,373][2409096] Sum rewards: 15.682, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.465', 'AMMO5': '0.012', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.079', 'weapon5': '0.082', 'weapon4': '0.232', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'HITCOUNT': '0.920', 'weapon2': '1.396', 'weapon3': '1.528', 'DAMAGECOUNT': '4.455', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:22:35,428][2409406] DAMAGECOUNT value on done: 7532.0
[2023-02-25 13:22:35,432][2409406] Sum rewards: 7.534, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.540', 'AMMO2': '0.013', 'AMMO5': '0.027', 'WEAPON1': '0.040', 'AMMO4': '0.062', 'AMMO3': '0.093', 'weapon5': '0.176', 'weapon4': '0.186', 'WEAPON4': '0.300', 'ARMOR': '0.451', 'WEAPON5': '0.600', 'HITCOUNT': '0.740', 'WEAPON3': '0.750', 'weapon2': '1.354', 'weapon3': '1.818', 'DAMAGECOUNT': '2.964', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:22:35,523][2409105] DAMAGECOUNT value on done: 10026.0
[2023-02-25 13:22:35,526][2409105] Sum rewards: 14.085, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.984', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'weapon7': '0.054', 'AMMO3': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.152', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.990', 'weapon3': '1.538', 'weapon2': '1.604', 'DAMAGECOUNT': '4.221', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:22:35,533][2409078] DAMAGECOUNT value on done: 9587.0
[2023-02-25 13:22:35,536][2409078] Sum rewards: 9.948, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.467', 'AMMO5': '0.015', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'AMMO3': '0.076', 'AMMO4': '0.077', 'weapon4': '0.222', 'weapon5': '0.272', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.620', 'weapon3': '1.046', 'weapon2': '1.420', 'DAMAGECOUNT': '2.901', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:22:35,652][2409074] Updated weights for policy 0, policy_version 23481 (0.0012)
[2023-02-25 13:22:35,715][2409407] DAMAGECOUNT value on done: 8255.0
[2023-02-25 13:22:35,715][2409407] Sum rewards: 8.471, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.440', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon4': '0.060', 'weapon5': '0.068', 'AMMO3': '0.075', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'weapon7': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.452', 'WEAPON3': '0.500', 'HITCOUNT': '0.540', 'weapon3': '0.924', 'weapon2': '1.260', 'DAMAGECOUNT': '2.346', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:22:35,943][2409486] DAMAGECOUNT value on done: 8690.0
[2023-02-25 13:22:35,945][2409486] Sum rewards: 3.432, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.602', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO3': '0.068', 'AMMO4': '0.081', 'weapon5': '0.106', 'weapon7': '0.132', 'WEAPON4': '0.150', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.590', 'weapon3': '0.812', 'weapon2': '0.858', 'weapon4': '1.272', 'DAMAGECOUNT': '1.536', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:22:35,972][2409469] DAMAGECOUNT value on done: 8417.0
[2023-02-25 13:22:35,973][2409469] Sum rewards: 9.108, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.535', 'AMMO5': '0.027', 'WEAPON1': '0.030', 'AMMO2': '0.033', 'WEAPON4': '0.050', 'AMMO3': '0.126', 'weapon4': '0.156', 'AMMO4': '0.164', 'weapon5': '0.294', 'ARMOR': '0.505', 'WEAPON5': '0.550', 'HITCOUNT': '0.760', 'WEAPON3': '0.800', 'weapon2': '1.056', 'weapon3': '2.030', 'DAMAGECOUNT': '3.561', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:22:36,022][2409099] DAMAGECOUNT value on done: 9650.0
[2023-02-25 13:22:36,027][2409099] Sum rewards: 15.504, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.977', 'AMMO4': '-0.081', 'AMMO2': '-0.016', 'AMMO5': '0.007', 'AMMO3': '0.065', 'weapon5': '0.120', 'WEAPON5': '0.250', 'ARMOR': '0.485', 'WEAPON3': '0.500', 'HITCOUNT': '1.010', 'weapon3': '1.308', 'weapon2': '1.572', 'DAMAGECOUNT': '4.761', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:22:36,079][2409405] DAMAGECOUNT value on done: 8986.0
[2023-02-25 13:22:36,080][2409405] Sum rewards: 10.018, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.185', 'AMMO2': '0.007', 'AMMO5': '0.012', 'AMMO4': '0.033', 'AMMO3': '0.051', 'weapon5': '0.070', 'weapon7': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.491', 'HITCOUNT': '0.590', 'weapon2': '0.612', 'weapon3': '1.264', 'weapon4': '1.342', 'DAMAGECOUNT': '3.021', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:22:36,135][2409102] Large shaping reward 2.617 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.585, 195.0), ('weapon7', 0.002)]
[2023-02-25 13:22:36,153][2409079] DAMAGECOUNT value on done: 8595.0
[2023-02-25 13:22:36,156][2409079] Sum rewards: 13.832, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.531', 'AMMO2': '0.021', 'AMMO5': '0.022', 'weapon7': '0.062', 'AMMO3': '0.088', 'AMMO4': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.170', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.450', 'weapon4': '0.462', 'WEAPON3': '0.550', 'HITCOUNT': '0.800', 'ARMOR': '0.856', 'weapon2': '1.012', 'weapon3': '1.306', 'DAMAGECOUNT': '3.567', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:22:36,454][2409097] DAMAGECOUNT value on done: 9070.0
[2023-02-25 13:22:36,455][2409097] Sum rewards: 26.028, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.488', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.086', 'weapon5': '0.168', 'weapon4': '0.230', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'weapon2': '1.046', 'HITCOUNT': '1.400', 'weapon3': '1.838', 'DAMAGECOUNT': '6.840', 'FRAGCOUNT': '19.000'}
[2023-02-25 13:22:36,776][2409596] DAMAGECOUNT value on done: 8315.0
[2023-02-25 13:22:36,777][2409596] Sum rewards: 14.869, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.840', 'AMMO2': '0.011', 'AMMO5': '0.012', 'AMMO4': '0.054', 'AMMO3': '0.069', 'weapon7': '0.136', 'WEAPON4': '0.150', 'weapon5': '0.200', 'weapon4': '0.212', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.740', 'ARMOR': '0.861', 'weapon3': '1.228', 'weapon2': '2.054', 'DAMAGECOUNT': '3.651', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:22:37,023][2409355] DAMAGECOUNT value on done: 9249.0
[2023-02-25 13:22:37,027][2409355] Sum rewards: 13.245, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.282', 'AMMO2': '0.012', 'AMMO5': '0.025', 'weapon7': '0.048', 'AMMO4': '0.060', 'AMMO3': '0.087', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.154', 'weapon5': '0.162', 'WEAPON7': '0.200', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'HITCOUNT': '0.720', 'weapon3': '1.226', 'ARMOR': '1.657', 'weapon2': '1.840', 'DAMAGECOUNT': '3.246', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:22:37,095][2409866] DAMAGECOUNT value on done: 8278.0
[2023-02-25 13:22:37,096][2409866] Sum rewards: 10.316, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.498', 'AMMO2': '0.012', 'AMMO5': '0.017', 'AMMO4': '0.059', 'AMMO3': '0.067', 'weapon5': '0.242', 'WEAPON5': '0.500', 'WEAPON3': '0.500', 'HITCOUNT': '0.690', 'ARMOR': '1.200', 'weapon3': '1.290', 'weapon2': '2.178', 'DAMAGECOUNT': '2.559', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:22:37,186][2408954] Fps is (10 sec: 24576.7, 60 sec: 24849.1, 300 sec: 24340.0). Total num frames: 96198656. Throughput: 0: 6231.5. Samples: 24046104. Policy #0 lag: (min: 0.0, avg: 15.7, max: 25.0)
[2023-02-25 13:22:37,187][2408954] Avg episode reward: [(0, '12.947')]
[2023-02-25 13:22:37,386][2409373] DAMAGECOUNT value on done: 8169.0
[2023-02-25 13:22:37,387][2409373] Sum rewards: 12.995, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.009', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.084', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.103', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.368', 'WEAPON3': '0.500', 'HITCOUNT': '1.030', 'weapon2': '1.270', 'weapon3': '1.376', 'DAMAGECOUNT': '3.999', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:22:37,798][2409104] DAMAGECOUNT value on done: 9141.0
[2023-02-25 13:22:37,798][2409104] Sum rewards: 14.845, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.969', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO3': '0.045', 'AMMO4': '0.134', 'weapon5': '0.136', 'weapon7': '0.212', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.250', 'WEAPON3': '0.300', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'weapon4': '0.432', 'ARMOR': '0.456', 'HITCOUNT': '0.710', 'weapon3': '1.010', 'weapon2': '1.460', 'DAMAGECOUNT': '4.647', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:22:38,013][2409074] Updated weights for policy 0, policy_version 23491 (0.0012)
[2023-02-25 13:22:38,421][2409076] DAMAGECOUNT value on done: 7201.0
[2023-02-25 13:22:38,423][2409076] Sum rewards: 9.365, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.483', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.081', 'weapon7': '0.116', 'WEAPON4': '0.150', 'weapon5': '0.198', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.320', 'WEAPON5': '0.400', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'ARMOR': '0.913', 'weapon3': '0.992', 'weapon2': '1.812', 'DAMAGECOUNT': '3.252', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:22:38,931][2409075] DAMAGECOUNT value on done: 8549.0
[2023-02-25 13:22:38,932][2409075] Sum rewards: 13.223, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.478', 'AMMO5': '0.017', 'AMMO2': '0.024', 'AMMO3': '0.076', 'AMMO4': '0.118', 'weapon5': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'ARMOR': '0.500', 'weapon4': '0.704', 'weapon2': '0.726', 'HITCOUNT': '0.970', 'weapon3': '1.398', 'DAMAGECOUNT': '4.932', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:22:38,956][2409074] Updated weights for policy 0, policy_version 23501 (0.0012)
[2023-02-25 13:22:38,968][2409389] DAMAGECOUNT value on done: 8886.0
[2023-02-25 13:22:38,969][2409389] Sum rewards: 7.367, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO3': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.063', 'WEAPON5': '0.100', 'weapon7': '0.196', 'WEAPON3': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.278', 'HITCOUNT': '0.280', 'ARMOR': '0.400', 'weapon3': '0.476', 'HEALTH': '0.694', 'weapon2': '0.710', 'weapon4': '1.088', 'DAMAGECOUNT': '2.172', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:22:38,974][2409077] DAMAGECOUNT value on done: 9279.0
[2023-02-25 13:22:38,977][2409077] Sum rewards: 17.586, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.433', 'AMMO2': '0.004', 'WEAPON1': '0.020', 'AMMO4': '0.022', 'AMMO5': '0.037', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'weapon4': '0.110', 'weapon5': '0.282', 'ARMOR': '0.400', 'WEAPON5': '0.700', 'WEAPON3': '0.750', 'HITCOUNT': '1.100', 'weapon2': '1.156', 'weapon3': '2.080', 'DAMAGECOUNT': '4.659', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:22:39,032][2409096] DAMAGECOUNT value on done: 7907.0
[2023-02-25 13:22:39,033][2409096] Sum rewards: 12.267, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.780', 'AMMO2': '0.008', 'AMMO5': '0.016', 'AMMO4': '0.040', 'AMMO3': '0.121', 'WEAPON4': '0.200', 'weapon5': '0.262', 'WEAPON5': '0.300', 'weapon4': '0.306', 'WEAPON3': '0.650', 'HITCOUNT': '0.850', 'weapon2': '1.196', 'ARMOR': '1.340', 'weapon3': '1.432', 'DAMAGECOUNT': '3.075', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:22:39,187][2409406] DAMAGECOUNT value on done: 7121.0
[2023-02-25 13:22:39,189][2409406] Sum rewards: 12.485, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.029', 'AMMO5': '0.017', 'AMMO2': '0.028', 'AMMO3': '0.063', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'weapon5': '0.220', 'weapon4': '0.306', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'ARMOR': '0.800', 'HITCOUNT': '1.000', 'weapon2': '1.330', 'weapon3': '1.392', 'DAMAGECOUNT': '3.315', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:22:39,237][2409105] DAMAGECOUNT value on done: 8873.0
[2023-02-25 13:22:39,240][2409105] Sum rewards: 10.390, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.018', 'AMMO2': '0.021', 'AMMO4': '0.103', 'HEALTH': '0.106', 'AMMO3': '0.110', 'weapon4': '0.126', 'WEAPON4': '0.150', 'weapon5': '0.162', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.960', 'ARMOR': '1.200', 'weapon2': '1.342', 'weapon3': '2.058', 'DAMAGECOUNT': '3.534', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:22:39,376][2409078] DAMAGECOUNT value on done: 7427.0
[2023-02-25 13:22:39,379][2409078] Sum rewards: 9.179, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.010', 'HEALTH': '0.015', 'AMMO2': '0.021', 'AMMO3': '0.040', 'weapon7': '0.080', 'AMMO4': '0.106', 'WEAPON5': '0.200', 'weapon5': '0.234', 'WEAPON4': '0.250', 'WEAPON3': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'weapon4': '0.406', 'HITCOUNT': '0.610', 'ARMOR': '0.886', 'weapon3': '0.992', 'weapon2': '1.226', 'DAMAGECOUNT': '2.262', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:22:39,403][2409407] DAMAGECOUNT value on done: 7995.0
[2023-02-25 13:22:39,406][2409407] Sum rewards: 10.008, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.782', 'AMMO5': '0.022', 'AMMO2': '0.023', 'AMMO3': '0.107', 'AMMO4': '0.113', 'weapon4': '0.290', 'WEAPON4': '0.300', 'weapon5': '0.304', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '0.830', 'ARMOR': '0.856', 'weapon2': '1.394', 'weapon3': '1.526', 'DAMAGECOUNT': '3.825', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:22:39,621][2409565] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:22:39,651][2409469] DAMAGECOUNT value on done: 10217.0
[2023-02-25 13:22:39,652][2409469] Sum rewards: 11.215, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.772', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO5': '0.013', 'weapon5': '0.060', 'weapon4': '0.082', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.890', 'weapon2': '1.552', 'weapon3': '1.896', 'DAMAGECOUNT': '3.747', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:22:39,859][2409547] DAMAGECOUNT value on done: 7411.0
[2023-02-25 13:22:39,860][2409547] Sum rewards: 9.528, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.250', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.044', 'AMMO3': '0.046', 'weapon7': '0.172', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'weapon5': '0.220', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'ARMOR': '0.444', 'HITCOUNT': '0.690', 'weapon2': '0.738', 'weapon3': '0.902', 'weapon4': '1.042', 'DAMAGECOUNT': '2.499', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:22:39,879][2409079] DAMAGECOUNT value on done: 10054.0
[2023-02-25 13:22:39,882][2409079] Sum rewards: 18.048, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.400', 'AMMO5': '0.020', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.115', 'weapon5': '0.290', 'weapon4': '0.352', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '0.920', 'weapon3': '1.294', 'ARMOR': '1.297', 'weapon2': '1.666', 'DAMAGECOUNT': '3.870', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:22:39,905][2409405] DAMAGECOUNT value on done: 10535.0
[2023-02-25 13:22:39,906][2409405] Sum rewards: 20.971, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.587', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'AMMO4': '0.110', 'weapon7': '0.124', 'weapon5': '0.146', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'ARMOR': '0.489', 'WEAPON3': '0.500', 'weapon4': '0.810', 'weapon2': '0.974', 'HITCOUNT': '1.060', 'weapon3': '1.508', 'DAMAGECOUNT': '5.079', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:22:40,060][2409486] DAMAGECOUNT value on done: 8706.0
[2023-02-25 13:22:40,063][2409486] Sum rewards: 15.669, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.420', 'AMMO2': '0.009', 'AMMO5': '0.014', 'AMMO4': '0.043', 'AMMO3': '0.094', 'weapon5': '0.182', 'WEAPON4': '0.200', 'weapon4': '0.290', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'ARMOR': '0.854', 'HITCOUNT': '0.910', 'weapon2': '1.380', 'weapon3': '1.888', 'DAMAGECOUNT': '3.225', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:22:40,175][2409099] DAMAGECOUNT value on done: 8198.0
[2023-02-25 13:22:40,178][2409099] Sum rewards: 17.738, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.950', 'AMMO5': '0.025', 'AMMO2': '0.027', 'AMMO4': '0.132', 'AMMO3': '0.151', 'weapon5': '0.272', 'WEAPON4': '0.350', 'weapon4': '0.356', 'WEAPON5': '0.550', 'weapon2': '0.964', 'WEAPON3': '1.000', 'HITCOUNT': '1.100', 'ARMOR': '1.250', 'weapon3': '2.070', 'DAMAGECOUNT': '5.691', 'FRAGCOUNT': '17.000'}
[2023-02-25 13:22:40,183][2409097] DAMAGECOUNT value on done: 7800.0
[2023-02-25 13:22:40,184][2409097] Sum rewards: 15.574, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.770', 'AMMO2': '0.012', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.062', 'AMMO3': '0.076', 'weapon7': '0.110', 'weapon5': '0.192', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'ARMOR': '0.800', 'HITCOUNT': '0.840', 'weapon2': '0.920', 'weapon4': '0.952', 'weapon3': '1.478', 'DAMAGECOUNT': '3.873', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:22:40,399][2409596] DAMAGECOUNT value on done: 8951.0
[2023-02-25 13:22:40,400][2409596] Sum rewards: 7.331, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.398', 'AMMO5': '0.012', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO3': '0.094', 'AMMO4': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.142', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.460', 'WEAPON3': '0.650', 'HITCOUNT': '0.720', 'weapon3': '1.466', 'weapon2': '1.700', 'DAMAGECOUNT': '2.961', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:22:40,974][2409355] DAMAGECOUNT value on done: 8700.0
[2023-02-25 13:22:40,975][2409355] Sum rewards: 18.362, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.395', 'AMMO2': '0.015', 'AMMO5': '0.021', 'AMMO4': '0.076', 'AMMO3': '0.086', 'weapon5': '0.270', 'weapon4': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'weapon2': '0.792', 'HITCOUNT': '1.400', 'weapon3': '1.834', 'DAMAGECOUNT': '5.673', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:22:41,062][2409866] DAMAGECOUNT value on done: 9547.0
[2023-02-25 13:22:41,065][2409866] Sum rewards: 12.212, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.180', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO2': '0.024', 'weapon7': '0.080', 'AMMO3': '0.119', 'AMMO4': '0.122', 'WEAPON4': '0.250', 'AMMO6': '0.260', 'AMMO7': '0.260', 'weapon5': '0.268', 'WEAPON7': '0.300', 'WEAPON5': '0.550', 'weapon4': '0.688', 'weapon2': '0.712', 'HITCOUNT': '0.720', 'WEAPON3': '0.750', 'weapon3': '1.832', 'DAMAGECOUNT': '3.666', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:22:41,358][2409373] DAMAGECOUNT value on done: 7144.0
[2023-02-25 13:22:41,359][2409373] Sum rewards: 3.354, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.375', 'AMMO2': '0.008', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.037', 'AMMO3': '0.070', 'weapon5': '0.138', 'weapon7': '0.146', 'WEAPON4': '0.200', 'AMMO6': '0.320', 'AMMO7': '0.320', 'HITCOUNT': '0.380', 'WEAPON7': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.530', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.041', 'weapon3': '1.244', 'weapon4': '1.410', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:22:41,383][2409565] Large shaping reward 2.641 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO2', -0.0001, -1.0), ('AMMO4', -0.0005, -1.0), ('weapon2', 0.002)]
[2023-02-25 13:22:41,436][2409074] Updated weights for policy 0, policy_version 23511 (0.0013)
[2023-02-25 13:22:41,523][2409104] DAMAGECOUNT value on done: 10238.0
[2023-02-25 13:22:41,524][2409104] Sum rewards: 23.381, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.656', 'AMMO2': '0.014', 'AMMO5': '0.020', 'AMMO4': '0.067', 'AMMO3': '0.095', 'weapon5': '0.140', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.714', 'WEAPON3': '0.750', 'weapon4': '0.752', 'ARMOR': '0.853', 'HITCOUNT': '1.260', 'weapon3': '1.762', 'DAMAGECOUNT': '5.460', 'FRAGCOUNT': '20.000'}
[2023-02-25 13:22:42,186][2408954] Fps is (10 sec: 23347.3, 60 sec: 24780.8, 300 sec: 24395.5). Total num frames: 96325632. Throughput: 0: 6245.9. Samples: 24083844. Policy #0 lag: (min: 0.0, avg: 15.7, max: 25.0)
[2023-02-25 13:22:42,186][2408954] Avg episode reward: [(0, '12.910')]
[2023-02-25 13:22:42,422][2409074] Updated weights for policy 0, policy_version 23521 (0.0013)
[2023-02-25 13:22:42,707][2409076] DAMAGECOUNT value on done: 8390.0
[2023-02-25 13:22:42,711][2409076] Sum rewards: 13.360, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.420', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO5': '0.032', 'AMMO4': '0.062', 'weapon7': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.110', 'weapon5': '0.410', 'WEAPON3': '0.700', 'WEAPON5': '0.750', 'ARMOR': '0.889', 'HITCOUNT': '0.970', 'weapon2': '1.306', 'weapon3': '1.812', 'DAMAGECOUNT': '4.323', 'FRAGCOUNT': '10.500'}
[2023-02-25 13:22:42,778][2409077] DAMAGECOUNT value on done: 9776.0
[2023-02-25 13:22:42,779][2409077] Sum rewards: 12.542, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.100', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'AMMO3': '0.126', 'weapon4': '0.160', 'AMMO4': '0.170', 'weapon5': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.850', 'HITCOUNT': '1.060', 'ARMOR': '1.238', 'weapon2': '1.254', 'weapon3': '1.912', 'DAMAGECOUNT': '4.380', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:22:42,787][2409075] DAMAGECOUNT value on done: 9500.0
[2023-02-25 13:22:42,787][2409075] Sum rewards: 12.400, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.565', 'AMMO5': '0.014', 'AMMO2': '0.017', 'AMMO4': '0.085', 'AMMO3': '0.107', 'weapon4': '0.214', 'weapon5': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.451', 'WEAPON3': '0.700', 'HITCOUNT': '0.760', 'weapon2': '1.304', 'weapon3': '1.312', 'DAMAGECOUNT': '3.930', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:22:42,807][2409389] DAMAGECOUNT value on done: 8465.0
[2023-02-25 13:22:42,808][2409389] Sum rewards: 14.409, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.808', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'weapon7': '0.064', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.222', 'weapon5': '0.230', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'weapon2': '0.798', 'HITCOUNT': '0.840', 'weapon3': '1.182', 'DAMAGECOUNT': '4.089', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:22:42,812][2409096] DAMAGECOUNT value on done: 8984.0
[2023-02-25 13:22:42,827][2409096] Sum rewards: 24.670, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon7': '0.066', 'AMMO3': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.169', 'HEALTH': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'weapon5': '0.448', 'weapon4': '0.474', 'weapon2': '0.726', 'HITCOUNT': '1.230', 'weapon3': '1.672', 'DAMAGECOUNT': '6.159', 'FRAGCOUNT': '19.000'}
[2023-02-25 13:22:42,983][2409406] DAMAGECOUNT value on done: 8227.0
[2023-02-25 13:22:42,986][2409406] Sum rewards: 8.446, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.648', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO3': '0.081', 'weapon4': '0.118', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'weapon5': '0.278', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '0.680', 'weapon2': '1.248', 'weapon3': '1.888', 'DAMAGECOUNT': '3.186', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:22:43,016][2409407] DAMAGECOUNT value on done: 7391.0
[2023-02-25 13:22:43,018][2409407] Sum rewards: 15.629, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO3': '0.060', 'AMMO4': '0.173', 'HEALTH': '0.192', 'WEAPON4': '0.200', 'weapon5': '0.252', 'weapon2': '0.284', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'weapon4': '0.802', 'HITCOUNT': '1.180', 'weapon3': '1.468', 'DAMAGECOUNT': '4.317', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:22:43,085][2409105] DAMAGECOUNT value on done: 7715.0
[2023-02-25 13:22:43,085][2409105] Sum rewards: 6.560, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.294', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO5': '0.016', 'AMMO4': '0.068', 'AMMO3': '0.074', 'weapon7': '0.142', 'weapon5': '0.146', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon2': '0.528', 'HITCOUNT': '0.530', 'weapon3': '1.116', 'weapon4': '1.272', 'DAMAGECOUNT': '1.998', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:22:43,406][2409469] DAMAGECOUNT value on done: 8261.0
[2023-02-25 13:22:43,406][2409469] Sum rewards: 8.666, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.570', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO5': '0.010', 'AMMO3': '0.050', 'weapon7': '0.066', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.124', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.324', 'WEAPON3': '0.350', 'ARMOR': '0.463', 'HITCOUNT': '0.510', 'weapon3': '0.770', 'weapon2': '0.938', 'DAMAGECOUNT': '1.824', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:22:43,553][2409078] DAMAGECOUNT value on done: 10364.0
[2023-02-25 13:22:43,554][2409078] Sum rewards: 22.239, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.686', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon7': '0.048', 'AMMO3': '0.077', 'AMMO4': '0.097', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.692', 'HITCOUNT': '1.020', 'weapon3': '1.328', 'weapon2': '1.600', 'DAMAGECOUNT': '5.181', 'FRAGCOUNT': '17.000'}
[2023-02-25 13:22:43,668][2409547] DAMAGECOUNT value on done: 8976.0
[2023-02-25 13:22:43,669][2409547] Sum rewards: 12.400, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.929', 'AMMO2': '0.012', 'AMMO5': '0.016', 'AMMO4': '0.058', 'weapon4': '0.098', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'weapon5': '0.150', 'WEAPON5': '0.400', 'ARMOR': '0.459', 'WEAPON3': '0.800', 'HITCOUNT': '1.000', 'weapon2': '1.326', 'weapon3': '2.120', 'DAMAGECOUNT': '3.867', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:22:43,863][2409486] DAMAGECOUNT value on done: 8660.0
[2023-02-25 13:22:43,863][2409486] Sum rewards: 12.457, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.314', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.042', 'weapon7': '0.066', 'weapon5': '0.068', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.590', 'weapon3': '0.912', 'weapon4': '0.918', 'weapon2': '1.758', 'DAMAGECOUNT': '2.490', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:22:43,878][2409079] DAMAGECOUNT value on done: 8249.0
[2023-02-25 13:22:43,878][2409079] Sum rewards: 13.624, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.785', 'AMMO2': '0.005', 'AMMO4': '0.024', 'AMMO5': '0.028', 'weapon4': '0.050', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.326', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.860', 'ARMOR': '1.200', 'weapon2': '1.492', 'weapon3': '1.864', 'DAMAGECOUNT': '3.414', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:22:43,887][2409097] DAMAGECOUNT value on done: 8040.0
[2023-02-25 13:22:43,890][2409097] Sum rewards: 24.702, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.810', 'AMMO2': '0.017', 'AMMO5': '0.019', 'AMMO3': '0.070', 'AMMO4': '0.084', 'weapon5': '0.264', 'WEAPON4': '0.300', 'weapon4': '0.336', 'WEAPON5': '0.450', 'ARMOR': '0.451', 'WEAPON3': '0.600', 'HITCOUNT': '1.130', 'weapon2': '1.360', 'weapon3': '1.694', 'DAMAGECOUNT': '6.237', 'FRAGCOUNT': '17.000'}
[2023-02-25 13:22:43,993][2409099] DAMAGECOUNT value on done: 6283.0
[2023-02-25 13:22:43,995][2409099] Sum rewards: 8.003, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.290', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO4': '0.032', 'AMMO3': '0.060', 'weapon5': '0.138', 'WEAPON5': '0.200', 'WEAPON3': '0.450', 'HITCOUNT': '0.660', 'weapon2': '1.126', 'weapon3': '1.312', 'DAMAGECOUNT': '3.021', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:22:44,031][2409074] Updated weights for policy 0, policy_version 23531 (0.0012)
[2023-02-25 13:22:44,118][2409405] DAMAGECOUNT value on done: 9007.0
[2023-02-25 13:22:44,121][2409405] Sum rewards: 8.793, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.324', 'AMMO5': '0.030', 'AMMO2': '0.034', 'weapon7': '0.090', 'AMMO3': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.164', 'AMMO4': '0.171', 'weapon4': '0.378', 'WEAPON4': '0.450', 'ARMOR': '0.450', 'WEAPON5': '0.650', 'WEAPON3': '0.700', 'HITCOUNT': '0.900', 'weapon2': '1.170', 'weapon3': '1.724', 'DAMAGECOUNT': '3.813', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:22:44,262][2409596] DAMAGECOUNT value on done: 8815.0
[2023-02-25 13:22:44,263][2409596] Sum rewards: 16.962, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.537', 'AMMO2': '0.005', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.022', 'weapon5': '0.044', 'AMMO3': '0.077', 'weapon7': '0.182', 'weapon2': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'AMMO6': '0.420', 'AMMO7': '0.420', 'WEAPON7': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '1.020', 'weapon3': '1.152', 'weapon4': '1.708', 'DAMAGECOUNT': '4.596', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:22:44,606][2409355] DAMAGECOUNT value on done: 9862.0
[2023-02-25 13:22:44,606][2409355] Sum rewards: 17.616, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.233', 'AMMO4': '-0.023', 'AMMO2': '-0.004', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'weapon7': '0.046', 'AMMO3': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.162', 'WEAPON7': '0.200', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'ARMOR': '0.845', 'HITCOUNT': '1.230', 'weapon2': '1.630', 'weapon3': '1.940', 'DAMAGECOUNT': '5.199', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:22:45,320][2409104] DAMAGECOUNT value on done: 7918.0
[2023-02-25 13:22:45,321][2409104] Sum rewards: 8.172, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.794', 'AMMO2': '0.008', 'AMMO5': '0.017', 'AMMO4': '0.040', 'weapon7': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.111', 'weapon5': '0.132', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'HITCOUNT': '0.740', 'ARMOR': '0.800', 'weapon2': '1.330', 'weapon3': '1.844', 'DAMAGECOUNT': '3.024', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:22:45,494][2409468] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:22:45,748][2409373] DAMAGECOUNT value on done: 7074.0
[2023-02-25 13:22:45,749][2409373] Sum rewards: 10.092, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.769', 'AMMO2': '0.022', 'AMMO5': '0.022', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.112', 'WEAPON4': '0.150', 'weapon5': '0.192', 'weapon4': '0.340', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'HITCOUNT': '0.830', 'ARMOR': '0.847', 'weapon2': '1.122', 'weapon3': '1.874', 'DAMAGECOUNT': '3.540', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:22:46,057][2409074] Updated weights for policy 0, policy_version 23541 (0.0012)
[2023-02-25 13:22:46,144][2409596] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:22:46,649][2409077] DAMAGECOUNT value on done: 10120.0
[2023-02-25 13:22:46,655][2409077] Sum rewards: 10.024, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.655', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.054', 'AMMO3': '0.124', 'AMMO4': '0.270', 'weapon5': '0.330', 'WEAPON5': '0.400', 'weapon4': '0.414', 'WEAPON4': '0.600', 'WEAPON3': '0.700', 'weapon2': '0.884', 'HITCOUNT': '1.150', 'weapon3': '1.862', 'DAMAGECOUNT': '5.361', 'FRAGCOUNT': '10.500'}
[2023-02-25 13:22:46,690][2409096] DAMAGECOUNT value on done: 8787.0
[2023-02-25 13:22:46,691][2409096] Sum rewards: 11.549, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.485', 'AMMO2': '0.014', 'AMMO5': '0.025', 'weapon4': '0.038', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.069', 'weapon5': '0.202', 'ARMOR': '0.449', 'WEAPON3': '0.450', 'WEAPON5': '0.500', 'HITCOUNT': '0.650', 'weapon2': '1.126', 'weapon3': '1.584', 'DAMAGECOUNT': '3.027', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:22:46,846][2409074] Updated weights for policy 0, policy_version 23551 (0.0012)
[2023-02-25 13:22:46,882][2409406] DAMAGECOUNT value on done: 8566.0
[2023-02-25 13:22:46,885][2409406] Sum rewards: 9.879, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.830', 'AMMO5': '0.003', 'AMMO2': '0.014', 'AMMO3': '0.030', 'weapon7': '0.064', 'weapon5': '0.066', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.250', 'HITCOUNT': '0.450', 'weapon3': '0.652', 'weapon2': '1.158', 'weapon4': '1.612', 'DAMAGECOUNT': '2.553', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:22:47,115][2409076] DAMAGECOUNT value on done: 7643.0
[2023-02-25 13:22:47,116][2409076] Sum rewards: 16.683, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.015', 'AMMO2': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.096', 'weapon5': '0.110', 'AMMO4': '0.161', 'weapon4': '0.228', 'HEALTH': '0.298', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.930', 'weapon3': '1.542', 'weapon2': '1.558', 'DAMAGECOUNT': '4.413', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:22:47,176][2409389] DAMAGECOUNT value on done: 7300.0
[2023-02-25 13:22:47,179][2409389] Sum rewards: 10.937, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.125', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.019', 'AMMO3': '0.072', 'weapon5': '0.110', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.274', 'ARMOR': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '0.750', 'weapon2': '1.376', 'weapon3': '1.538', 'DAMAGECOUNT': '3.111', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:22:47,186][2408954] Fps is (10 sec: 27443.3, 60 sec: 25190.5, 300 sec: 24492.7). Total num frames: 96473088. Throughput: 0: 6250.4. Samples: 24121356. Policy #0 lag: (min: 0.0, avg: 15.7, max: 25.0)
[2023-02-25 13:22:47,186][2408954] Avg episode reward: [(0, '13.149')]
[2023-02-25 13:22:47,193][2409075] DAMAGECOUNT value on done: 8131.0
[2023-02-25 13:22:47,194][2409075] Sum rewards: 16.590, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.106', 'AMMO5': '0.010', 'weapon5': '0.018', 'AMMO2': '0.028', 'weapon7': '0.046', 'AMMO3': '0.073', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.142', 'WEAPON5': '0.200', 'WEAPON3': '0.500', 'weapon2': '0.908', 'HITCOUNT': '1.040', 'weapon4': '1.222', 'weapon3': '1.496', 'DAMAGECOUNT': '4.113', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:22:47,255][2409469] DAMAGECOUNT value on done: 8133.0
[2023-02-25 13:22:47,256][2409469] Sum rewards: 8.091, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.620', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.010', 'AMMO3': '0.067', 'weapon7': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.144', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.342', 'WEAPON3': '0.500', 'HITCOUNT': '0.730', 'weapon2': '0.982', 'weapon3': '1.136', 'DAMAGECOUNT': '2.592', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:22:47,345][2409078] DAMAGECOUNT value on done: 8511.0
[2023-02-25 13:22:47,353][2409078] Sum rewards: 14.148, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.460', 'AMMO2': '0.008', 'AMMO5': '0.027', 'AMMO4': '0.039', 'AMMO3': '0.124', 'ARMOR': '0.400', 'weapon5': '0.430', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'HITCOUNT': '0.900', 'weapon2': '1.016', 'weapon3': '2.122', 'DAMAGECOUNT': '4.392', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:22:47,544][2409105] DAMAGECOUNT value on done: 11098.0
[2023-02-25 13:22:47,545][2409105] Sum rewards: 27.925, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.457', 'AMMO4': '-0.008', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'AMMO3': '0.060', 'weapon7': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.272', 'WEAPON5': '0.350', 'ARMOR': '0.459', 'weapon4': '0.488', 'WEAPON3': '0.550', 'HITCOUNT': '1.350', 'weapon2': '1.362', 'weapon3': '1.456', 'DAMAGECOUNT': '6.606', 'FRAGCOUNT': '21.000'}
[2023-02-25 13:22:47,605][2409486] DAMAGECOUNT value on done: 9192.0
[2023-02-25 13:22:47,615][2409486] Sum rewards: 14.366, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.469', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO5': '0.030', 'AMMO4': '0.086', 'AMMO3': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.192', 'weapon5': '0.362', 'WEAPON3': '0.600', 'WEAPON5': '0.650', 'HITCOUNT': '0.830', 'ARMOR': '0.895', 'weapon3': '1.492', 'weapon2': '1.562', 'DAMAGECOUNT': '4.599', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:22:47,829][2409079] DAMAGECOUNT value on done: 8085.0
[2023-02-25 13:22:47,830][2409079] Sum rewards: 8.041, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.494', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.044', 'AMMO3': '0.065', 'weapon7': '0.084', 'weapon5': '0.146', 'WEAPON4': '0.150', 'weapon4': '0.238', 'WEAPON5': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.730', 'weapon2': '1.154', 'weapon3': '1.176', 'DAMAGECOUNT': '2.892', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:22:47,859][2409547] DAMAGECOUNT value on done: 7323.0
[2023-02-25 13:22:47,859][2409547] Sum rewards: 16.150, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.912', 'AMMO2': '0.015', 'weapon4': '0.016', 'AMMO5': '0.029', 'weapon7': '0.060', 'AMMO4': '0.073', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.108', 'weapon5': '0.318', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'ARMOR': '0.800', 'HITCOUNT': '0.840', 'weapon2': '1.018', 'weapon3': '1.934', 'DAMAGECOUNT': '4.101', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:22:47,872][2409099] DAMAGECOUNT value on done: 9150.0
[2023-02-25 13:22:47,873][2409099] Sum rewards: 9.427, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.342', 'weapon7': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.033', 'AMMO3': '0.085', 'AMMO4': '0.167', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.348', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.414', 'WEAPON3': '0.550', 'HITCOUNT': '0.840', 'ARMOR': '0.847', 'weapon3': '1.422', 'weapon2': '1.540', 'DAMAGECOUNT': '2.895', 'FRAGCOUNT': '8.500'}
[2023-02-25 13:22:47,971][2409097] DAMAGECOUNT value on done: 9698.0
[2023-02-25 13:22:47,971][2409097] Sum rewards: 9.855, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon5': '0.044', 'AMMO3': '0.060', 'AMMO4': '0.129', 'weapon7': '0.152', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HEALTH': '0.298', 'WEAPON3': '0.350', 'HITCOUNT': '0.530', 'weapon4': '0.736', 'weapon3': '0.772', 'ARMOR': '0.800', 'weapon2': '1.022', 'DAMAGECOUNT': '3.174', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:22:47,971][2409468] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:22:49,124][2409104] DAMAGECOUNT value on done: 9475.0
[2023-02-25 13:22:49,125][2409104] Sum rewards: 12.341, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.481', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.019', 'WEAPON1': '0.040', 'weapon7': '0.064', 'AMMO3': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.222', 'weapon4': '0.246', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '0.810', 'weapon2': '0.878', 'ARMOR': '0.946', 'weapon3': '1.466', 'DAMAGECOUNT': '3.369', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:22:49,730][2409074] Updated weights for policy 0, policy_version 23561 (0.0013)
[2023-02-25 13:22:50,004][2409373] DAMAGECOUNT value on done: 9670.0
[2023-02-25 13:22:50,007][2409373] Sum rewards: 17.352, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.197', 'AMMO2': '0.030', 'AMMO5': '0.032', 'AMMO3': '0.124', 'AMMO4': '0.149', 'weapon5': '0.330', 'weapon4': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.750', 'WEAPON3': '0.800', 'ARMOR': '0.852', 'HITCOUNT': '1.030', 'weapon2': '1.090', 'weapon3': '1.864', 'DAMAGECOUNT': '5.814', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:22:50,371][2409077] DAMAGECOUNT value on done: 7889.0
[2023-02-25 13:22:50,373][2409077] Sum rewards: 13.847, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.870', 'AMMO2': '0.021', 'AMMO5': '0.022', 'weapon7': '0.070', 'AMMO4': '0.103', 'AMMO3': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.142', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'weapon2': '0.670', 'WEAPON3': '0.750', 'HITCOUNT': '0.860', 'weapon4': '1.038', 'weapon3': '1.318', 'DAMAGECOUNT': '3.222', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:22:50,412][2409074] Updated weights for policy 0, policy_version 23571 (0.0013)
[2023-02-25 13:22:50,616][2409406] DAMAGECOUNT value on done: 8748.0
[2023-02-25 13:22:50,620][2409406] Sum rewards: 14.004, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.022', 'AMMO2': '0.030', 'weapon7': '0.052', 'AMMO3': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.151', 'weapon5': '0.270', 'weapon2': '0.314', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'HEALTH': '0.422', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon4': '0.898', 'HITCOUNT': '1.140', 'weapon3': '1.884', 'DAMAGECOUNT': '4.179', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:22:50,672][2409096] DAMAGECOUNT value on done: 7397.0
[2023-02-25 13:22:50,674][2409096] Sum rewards: 14.850, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.924', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.025', 'WEAPON4': '0.050', 'AMMO3': '0.103', 'weapon4': '0.116', 'weapon5': '0.266', 'ARMOR': '0.494', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'HITCOUNT': '0.780', 'weapon2': '1.330', 'weapon3': '1.746', 'DAMAGECOUNT': '3.693', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:22:51,005][2409078] DAMAGECOUNT value on done: 7955.0
[2023-02-25 13:22:51,006][2409078] Sum rewards: 18.497, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.910', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.051', 'weapon5': '0.062', 'weapon7': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'ARMOR': '0.455', 'HITCOUNT': '1.010', 'weapon3': '1.210', 'weapon2': '1.222', 'weapon4': '1.228', 'DAMAGECOUNT': '3.810', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:22:51,182][2409076] DAMAGECOUNT value on done: 7689.0
[2023-02-25 13:22:51,185][2409076] Sum rewards: 9.820, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.752', 'AMMO2': '0.004', 'AMMO5': '0.013', 'AMMO4': '0.019', 'weapon5': '0.052', 'weapon7': '0.054', 'AMMO3': '0.071', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.456', 'WEAPON3': '0.550', 'HITCOUNT': '0.700', 'weapon2': '0.936', 'weapon3': '1.098', 'weapon4': '1.362', 'DAMAGECOUNT': '2.967', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:22:51,203][2409469] DAMAGECOUNT value on done: 9748.0
[2023-02-25 13:22:51,204][2409469] Sum rewards: 18.236, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.165', 'AMMO2': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.051', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'weapon4': '0.130', 'weapon5': '0.172', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '1.330', 'weapon3': '1.512', 'weapon2': '1.790', 'DAMAGECOUNT': '5.511', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:22:51,385][2409389] DAMAGECOUNT value on done: 9174.0
[2023-02-25 13:22:51,385][2409389] Sum rewards: 17.543, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.187', 'AMMO5': '0.013', 'AMMO2': '0.017', 'weapon4': '0.052', 'weapon5': '0.062', 'AMMO4': '0.083', 'AMMO3': '0.106', 'weapon7': '0.158', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'ARMOR': '0.913', 'HITCOUNT': '1.130', 'weapon3': '1.420', 'weapon2': '1.762', 'DAMAGECOUNT': '5.574', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:22:51,394][2409075] DAMAGECOUNT value on done: 8443.0
[2023-02-25 13:22:51,395][2409075] Sum rewards: 9.271, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.420', 'AMMO2': '0.022', 'AMMO5': '0.027', 'AMMO3': '0.065', 'AMMO4': '0.109', 'weapon4': '0.252', 'weapon5': '0.304', 'WEAPON4': '0.350', 'WEAPON3': '0.500', 'HITCOUNT': '0.580', 'WEAPON5': '0.600', 'weapon2': '1.280', 'weapon3': '1.454', 'DAMAGECOUNT': '2.898', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:22:51,599][2409486] DAMAGECOUNT value on done: 8205.0
[2023-02-25 13:22:51,602][2409486] Sum rewards: 6.602, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.016', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO4': '0.045', 'weapon7': '0.054', 'AMMO3': '0.070', 'weapon5': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.290', 'WEAPON3': '0.500', 'ARMOR': '0.848', 'HITCOUNT': '0.930', 'weapon2': '1.542', 'weapon3': '1.742', 'DAMAGECOUNT': '3.141', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:22:51,703][2409079] DAMAGECOUNT value on done: 9332.0
[2023-02-25 13:22:51,707][2409079] Sum rewards: 10.874, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.390', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'weapon4': '0.082', 'weapon5': '0.206', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.810', 'ARMOR': '1.252', 'weapon3': '1.552', 'weapon2': '1.932', 'DAMAGECOUNT': '3.468', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:22:51,779][2409547] DAMAGECOUNT value on done: 8793.0
[2023-02-25 13:22:51,782][2409547] Sum rewards: 10.972, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.638', 'AMMO2': '0.011', 'AMMO5': '0.012', 'AMMO4': '0.054', 'AMMO3': '0.086', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'ARMOR': '0.450', 'WEAPON3': '0.600', 'weapon4': '0.616', 'HITCOUNT': '0.840', 'weapon2': '1.196', 'weapon3': '1.522', 'DAMAGECOUNT': '2.940', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:22:51,827][2409099] DAMAGECOUNT value on done: 9381.0
[2023-02-25 13:22:51,829][2409099] Sum rewards: 15.764, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.110', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'weapon7': '0.076', 'AMMO3': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.145', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.288', 'WEAPON5': '0.450', 'ARMOR': '0.453', 'WEAPON3': '0.500', 'weapon4': '0.594', 'HITCOUNT': '0.830', 'weapon2': '1.070', 'weapon3': '1.458', 'DAMAGECOUNT': '4.911', 'FRAGCOUNT': '12.500'}
[2023-02-25 13:22:51,860][2409097] DAMAGECOUNT value on done: 8138.0
[2023-02-25 13:22:51,864][2409097] Sum rewards: 12.246, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.964', 'AMMO5': '0.015', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO3': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'weapon5': '0.394', 'WEAPON5': '0.500', 'weapon4': '0.650', 'weapon2': '0.700', 'HITCOUNT': '0.730', 'WEAPON3': '0.750', 'ARMOR': '0.850', 'weapon3': '1.700', 'DAMAGECOUNT': '3.405', 'FRAGCOUNT': '10.500'}
[2023-02-25 13:22:52,186][2408954] Fps is (10 sec: 25395.1, 60 sec: 25054.0, 300 sec: 24451.0). Total num frames: 96579584. Throughput: 0: 6257.1. Samples: 24140184. Policy #0 lag: (min: 0.0, avg: 12.7, max: 26.0)
[2023-02-25 13:22:52,187][2408954] Avg episode reward: [(0, '13.338')]
[2023-02-25 13:22:52,378][2409074] Updated weights for policy 0, policy_version 23581 (0.0012)
[2023-02-25 13:22:53,290][2409104] DAMAGECOUNT value on done: 7631.0
[2023-02-25 13:22:53,293][2409104] Sum rewards: 13.972, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.579', 'AMMO2': '0.001', 'AMMO4': '0.005', 'weapon4': '0.012', 'WEAPON1': '0.020', 'AMMO5': '0.026', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'weapon5': '0.382', 'ARMOR': '0.466', 'WEAPON5': '0.650', 'WEAPON3': '0.700', 'HITCOUNT': '0.850', 'weapon2': '1.308', 'weapon3': '1.532', 'DAMAGECOUNT': '3.654', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:22:53,679][2409373] DAMAGECOUNT value on done: 8558.0
[2023-02-25 13:22:53,683][2409373] Sum rewards: 15.170, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.139', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon7': '0.052', 'weapon5': '0.066', 'AMMO3': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.193', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '0.650', 'weapon4': '0.970', 'HITCOUNT': '1.050', 'weapon2': '1.062', 'weapon3': '1.586', 'DAMAGECOUNT': '4.842', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:22:54,041][2409074] Updated weights for policy 0, policy_version 23591 (0.0013)
[2023-02-25 13:22:54,590][2409096] DAMAGECOUNT value on done: 8233.0
[2023-02-25 13:22:54,593][2409096] Sum rewards: 13.483, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.946', 'AMMO2': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.051', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.109', 'weapon5': '0.256', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'HITCOUNT': '0.890', 'weapon2': '1.310', 'weapon3': '2.098', 'DAMAGECOUNT': '4.413', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:22:54,799][2409078] DAMAGECOUNT value on done: 9133.0
[2023-02-25 13:22:54,802][2409078] Sum rewards: 14.083, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon7': '0.060', 'AMMO3': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.114', 'AMMO4': '0.155', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HEALTH': '0.326', 'weapon4': '0.332', 'WEAPON3': '0.550', 'ARMOR': '0.895', 'HITCOUNT': '0.970', 'weapon2': '1.476', 'weapon3': '1.570', 'DAMAGECOUNT': '4.155', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:22:55,031][2409075] DAMAGECOUNT value on done: 10708.0
[2023-02-25 13:22:55,034][2409075] Sum rewards: 12.648, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.504', 'AMMO2': '0.011', 'AMMO5': '0.012', 'AMMO4': '0.054', 'weapon4': '0.056', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'weapon5': '0.222', 'WEAPON5': '0.350', 'ARMOR': '0.441', 'WEAPON3': '0.650', 'HITCOUNT': '0.790', 'weapon3': '1.360', 'weapon2': '1.684', 'DAMAGECOUNT': '3.585', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:22:55,142][2409074] Updated weights for policy 0, policy_version 23601 (0.0012)
[2023-02-25 13:22:55,283][2409076] DAMAGECOUNT value on done: 9424.0
[2023-02-25 13:22:55,283][2409076] Sum rewards: 6.647, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.719', 'AMMO2': '0.005', 'AMMO5': '0.025', 'AMMO4': '0.027', 'AMMO3': '0.091', 'weapon5': '0.372', 'HITCOUNT': '0.560', 'WEAPON3': '0.600', 'WEAPON5': '0.600', 'weapon2': '1.260', 'weapon3': '1.572', 'ARMOR': '1.709', 'DAMAGECOUNT': '2.295', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:22:55,305][2409469] DAMAGECOUNT value on done: 8836.0
[2023-02-25 13:22:55,306][2409469] Sum rewards: 16.998, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.658', 'AMMO2': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.048', 'AMMO3': '0.063', 'weapon7': '0.106', 'weapon5': '0.208', 'WEAPON4': '0.300', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'WEAPON7': '0.500', 'weapon2': '0.546', 'HITCOUNT': '0.750', 'weapon4': '1.168', 'weapon3': '1.236', 'DAMAGECOUNT': '4.074', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:22:55,427][2409866] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:22:55,481][2409079] DAMAGECOUNT value on done: 9397.0
[2023-02-25 13:22:55,482][2409079] Sum rewards: 17.344, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.648', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.061', 'weapon4': '0.110', 'AMMO3': '0.136', 'weapon5': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.855', 'WEAPON3': '0.900', 'weapon2': '1.196', 'HITCOUNT': '1.290', 'weapon3': '2.130', 'DAMAGECOUNT': '5.427', 'FRAGCOUNT': '16.000'}
[2023-02-25 13:22:55,773][2409547] DAMAGECOUNT value on done: 9696.0
[2023-02-25 13:22:55,774][2409547] Sum rewards: 14.627, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.370', 'AMMO5': '0.022', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon4': '0.124', 'AMMO3': '0.132', 'WEAPON4': '0.250', 'weapon5': '0.348', 'WEAPON5': '0.500', 'HITCOUNT': '0.830', 'WEAPON3': '0.850', 'weapon2': '0.926', 'ARMOR': '1.344', 'weapon3': '2.192', 'DAMAGECOUNT': '4.587', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:22:55,775][2409097] DAMAGECOUNT value on done: 8205.0
[2023-02-25 13:22:55,777][2409097] Sum rewards: 5.039, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.603', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon7': '0.072', 'AMMO4': '0.076', 'AMMO3': '0.093', 'weapon5': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.248', 'WEAPON5': '0.250', 'HITCOUNT': '0.490', 'WEAPON3': '0.550', 'ARMOR': '0.897', 'weapon3': '1.310', 'weapon2': '1.806', 'DAMAGECOUNT': '1.848', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:22:55,862][2409486] DAMAGECOUNT value on done: 9962.0
[2023-02-25 13:22:55,863][2409486] Sum rewards: 14.083, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.592', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.046', 'weapon5': '0.082', 'weapon7': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.106', 'AMMO4': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon2': '0.616', 'WEAPON3': '0.650', 'HITCOUNT': '0.760', 'weapon3': '1.224', 'weapon4': '1.310', 'DAMAGECOUNT': '3.228', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:22:56,173][2409099] DAMAGECOUNT value on done: 10090.0
[2023-02-25 13:22:56,177][2409099] Sum rewards: 7.645, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.198', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO3': '0.064', 'weapon7': '0.072', 'weapon5': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.516', 'WEAPON3': '0.550', 'HITCOUNT': '0.680', 'weapon4': '0.720', 'weapon2': '0.956', 'weapon3': '1.402', 'DAMAGECOUNT': '2.442', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:22:57,031][2409104] DAMAGECOUNT value on done: 7434.0
[2023-02-25 13:22:57,032][2409104] Sum rewards: 16.750, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.270', 'AMMO5': '0.017', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'AMMO3': '0.094', 'AMMO4': '0.106', 'weapon4': '0.156', 'weapon5': '0.158', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.930', 'weapon2': '1.402', 'weapon3': '1.482', 'DAMAGECOUNT': '4.203', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:22:57,186][2408954] Fps is (10 sec: 21708.7, 60 sec: 24780.9, 300 sec: 24409.4). Total num frames: 96690176. Throughput: 0: 6247.2. Samples: 24177240. Policy #0 lag: (min: 0.0, avg: 12.7, max: 26.0)
[2023-02-25 13:22:57,186][2408954] Avg episode reward: [(0, '13.135')]
[2023-02-25 13:22:57,600][2409074] Updated weights for policy 0, policy_version 23611 (0.0012)
[2023-02-25 13:22:57,951][2409373] DAMAGECOUNT value on done: 8003.0
[2023-02-25 13:22:57,952][2409373] Sum rewards: 17.572, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.135', 'AMMO2': '0.004', 'AMMO5': '0.014', 'AMMO4': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'weapon7': '0.052', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.210', 'weapon5': '0.298', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.800', 'weapon2': '0.964', 'weapon3': '1.374', 'DAMAGECOUNT': '3.564', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:22:58,724][2409074] Updated weights for policy 0, policy_version 23621 (0.0012)
[2023-02-25 13:22:58,798][2409096] DAMAGECOUNT value on done: 8080.0
[2023-02-25 13:22:58,798][2409096] Sum rewards: 15.771, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.171', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.021', 'AMMO3': '0.061', 'weapon7': '0.072', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.374', 'weapon4': '0.386', 'WEAPON3': '0.450', 'WEAPON5': '0.450', 'ARMOR': '0.456', 'HITCOUNT': '1.050', 'weapon2': '1.254', 'weapon3': '1.550', 'DAMAGECOUNT': '5.529', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:22:59,006][2409075] DAMAGECOUNT value on done: 8913.0
[2023-02-25 13:22:59,007][2409075] Sum rewards: 10.285, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.612', 'AMMO2': '0.008', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.042', 'weapon7': '0.100', 'AMMO3': '0.106', 'weapon5': '0.200', 'WEAPON4': '0.250', 'AMMO6': '0.280', 'AMMO7': '0.280', 'WEAPON5': '0.400', 'WEAPON7': '0.400', 'weapon4': '0.662', 'weapon2': '0.714', 'WEAPON3': '0.800', 'HITCOUNT': '0.840', 'ARMOR': '0.857', 'weapon3': '1.874', 'DAMAGECOUNT': '3.546', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:22:59,224][2409079] DAMAGECOUNT value on done: 7498.0
[2023-02-25 13:22:59,225][2409079] Sum rewards: 6.651, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'weapon5': '0.180', 'weapon4': '0.260', 'HEALTH': '0.391', 'WEAPON5': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.690', 'ARMOR': '0.812', 'weapon2': '1.046', 'weapon3': '1.428', 'DAMAGECOUNT': '2.217', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:22:59,278][2409078] DAMAGECOUNT value on done: 8714.0
[2023-02-25 13:22:59,279][2409078] Sum rewards: 14.586, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.634', 'AMMO2': '0.022', 'AMMO5': '0.031', 'weapon4': '0.090', 'AMMO3': '0.096', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'weapon5': '0.314', 'WEAPON5': '0.700', 'HITCOUNT': '0.720', 'WEAPON3': '0.750', 'ARMOR': '1.013', 'weapon2': '1.366', 'weapon3': '1.552', 'DAMAGECOUNT': '4.308', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:22:59,307][2409469] DAMAGECOUNT value on done: 9974.0
[2023-02-25 13:22:59,310][2409469] Sum rewards: 14.179, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.109', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO5': '0.027', 'weapon7': '0.108', 'AMMO4': '0.127', 'AMMO3': '0.171', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon5': '0.316', 'WEAPON4': '0.350', 'weapon4': '0.498', 'WEAPON5': '0.650', 'HITCOUNT': '1.030', 'WEAPON3': '1.050', 'weapon2': '1.236', 'ARMOR': '1.294', 'weapon3': '1.412', 'DAMAGECOUNT': '4.983', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:22:59,416][2409076] DAMAGECOUNT value on done: 7910.0
[2023-02-25 13:22:59,418][2409076] Sum rewards: 9.636, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.511', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.044', 'AMMO3': '0.050', 'weapon5': '0.054', 'weapon7': '0.110', 'WEAPON5': '0.200', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.400', 'WEAPON4': '0.450', 'ARMOR': '0.462', 'HITCOUNT': '0.690', 'weapon2': '0.934', 'weapon3': '0.978', 'weapon4': '1.246', 'DAMAGECOUNT': '2.970', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:22:59,556][2409097] DAMAGECOUNT value on done: 8816.0
[2023-02-25 13:22:59,560][2409097] Sum rewards: 12.993, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.387', 'AMMO2': '0.007', 'AMMO5': '0.022', 'AMMO4': '0.033', 'weapon7': '0.070', 'AMMO3': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.248', 'WEAPON4': '0.250', 'weapon4': '0.464', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'ARMOR': '0.834', 'HITCOUNT': '0.850', 'weapon2': '0.872', 'weapon3': '1.434', 'DAMAGECOUNT': '3.255', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:22:59,602][2409547] DAMAGECOUNT value on done: 7638.0
[2023-02-25 13:22:59,606][2409547] Sum rewards: 12.507, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO3': '0.060', 'AMMO4': '0.068', 'weapon7': '0.146', 'WEAPON4': '0.150', 'weapon5': '0.160', 'HEALTH': '0.172', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'HITCOUNT': '0.610', 'weapon4': '0.960', 'weapon3': '0.974', 'weapon2': '1.514', 'DAMAGECOUNT': '3.339', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:23:00,361][2409486] DAMAGECOUNT value on done: 9449.0
[2023-02-25 13:23:00,362][2409486] Sum rewards: 16.758, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.204', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO5': '0.043', 'weapon7': '0.060', 'AMMO4': '0.067', 'AMMO3': '0.109', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.262', 'weapon4': '0.498', 'WEAPON5': '0.750', 'WEAPON3': '0.750', 'weapon2': '0.836', 'ARMOR': '0.904', 'HITCOUNT': '1.060', 'weapon3': '1.816', 'DAMAGECOUNT': '4.443', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:23:00,596][2409099] DAMAGECOUNT value on done: 7266.0
[2023-02-25 13:23:00,599][2409099] Sum rewards: 9.498, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.330', 'WEAPON1': '0.010', 'AMMO5': '0.021', 'AMMO2': '0.038', 'weapon7': '0.072', 'AMMO3': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.189', 'WEAPON7': '0.200', 'weapon5': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.400', 'WEAPON3': '0.550', 'ARMOR': '0.800', 'HITCOUNT': '0.800', 'weapon2': '1.230', 'weapon3': '1.490', 'DAMAGECOUNT': '3.582', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:23:00,767][2409548] Large shaping reward 2.575 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.543, 181.0), ('weapon7', 0.002)]
[2023-02-25 13:23:00,985][2409074] Updated weights for policy 0, policy_version 23631 (0.0012)
[2023-02-25 13:23:02,142][2409074] Updated weights for policy 0, policy_version 23641 (0.0012)
[2023-02-25 13:23:02,186][2408954] Fps is (10 sec: 25395.1, 60 sec: 25053.9, 300 sec: 24464.9). Total num frames: 96833536. Throughput: 0: 6252.8. Samples: 24214776. Policy #0 lag: (min: 0.0, avg: 12.7, max: 26.0)
[2023-02-25 13:23:02,186][2408954] Avg episode reward: [(0, '13.341')]
[2023-02-25 13:23:03,044][2409078] DAMAGECOUNT value on done: 9215.0
[2023-02-25 13:23:03,047][2409078] Sum rewards: 5.018, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.592', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO5': '0.003', 'AMMO3': '0.040', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon7': '0.128', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.380', 'ARMOR': '0.400', 'weapon3': '0.932', 'DAMAGECOUNT': '1.395', 'FRAGCOUNT': '2.000', 'weapon2': '2.192'}
[2023-02-25 13:23:03,255][2409075] DAMAGECOUNT value on done: 8780.0
[2023-02-25 13:23:03,260][2409075] Sum rewards: 9.436, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.258', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.182', 'weapon4': '0.228', 'WEAPON5': '0.250', 'WEAPON3': '0.750', 'ARMOR': '0.846', 'HITCOUNT': '0.910', 'weapon2': '1.608', 'weapon3': '1.650', 'DAMAGECOUNT': '3.570', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:23:03,393][2409097] DAMAGECOUNT value on done: 8113.0
[2023-02-25 13:23:03,394][2409097] Sum rewards: 17.906, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.305', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.037', 'AMMO3': '0.050', 'weapon5': '0.102', 'weapon7': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'weapon4': '0.322', 'weapon2': '0.832', 'HITCOUNT': '0.980', 'weapon3': '1.120', 'DAMAGECOUNT': '3.564', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:23:03,400][2409076] DAMAGECOUNT value on done: 9204.0
[2023-02-25 13:23:03,403][2409076] Sum rewards: 13.263, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.554', 'AMMO2': '0.004', 'AMMO5': '0.020', 'AMMO4': '0.022', 'weapon7': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.268', 'weapon4': '0.288', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.850', 'weapon2': '1.072', 'ARMOR': '1.251', 'weapon3': '1.856', 'DAMAGECOUNT': '3.879', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:23:03,427][2409079] DAMAGECOUNT value on done: 11024.0
[2023-02-25 13:23:03,430][2409079] Sum rewards: 19.587, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.543', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.018', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.230', 'weapon4': '0.352', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'ARMOR': '0.885', 'HITCOUNT': '1.190', 'weapon2': '1.248', 'weapon3': '1.866', 'DAMAGECOUNT': '5.403', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:23:03,452][2409096] DAMAGECOUNT value on done: 11221.0
[2023-02-25 13:23:03,453][2409096] Sum rewards: 24.654, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.392', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO3': '0.073', 'weapon5': '0.244', 'WEAPON5': '0.250', 'ARMOR': '0.444', 'WEAPON3': '0.550', 'HITCOUNT': '1.470', 'weapon3': '1.586', 'weapon2': '1.634', 'DAMAGECOUNT': '6.288', 'FRAGCOUNT': '17.000'}
[2023-02-25 13:23:03,473][2409547] DAMAGECOUNT value on done: 9034.0
[2023-02-25 13:23:03,474][2409547] Sum rewards: 12.424, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.908', 'AMMO5': '0.017', 'AMMO2': '0.022', 'weapon7': '0.062', 'AMMO3': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.110', 'WEAPON4': '0.200', 'weapon5': '0.244', 'WEAPON5': '0.450', 'HITCOUNT': '0.530', 'weapon4': '0.620', 'WEAPON3': '0.650', 'weapon2': '1.160', 'ARMOR': '1.373', 'weapon3': '1.608', 'DAMAGECOUNT': '2.643', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:23:03,807][2409074] Updated weights for policy 0, policy_version 23651 (0.0012)
[2023-02-25 13:23:03,930][2409469] DAMAGECOUNT value on done: 8767.0
[2023-02-25 13:23:03,934][2409469] Sum rewards: 11.576, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.990', 'AMMO2': '0.012', 'AMMO5': '0.032', 'AMMO4': '0.057', 'AMMO3': '0.062', 'weapon5': '0.232', 'WEAPON4': '0.350', 'WEAPON3': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.628', 'HITCOUNT': '0.840', 'ARMOR': '0.988', 'weapon2': '1.144', 'weapon3': '1.528', 'DAMAGECOUNT': '3.693', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:23:04,072][2409486] DAMAGECOUNT value on done: 8684.0
[2023-02-25 13:23:04,073][2409486] Sum rewards: 10.440, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.502', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO5': '0.023', 'weapon7': '0.048', 'AMMO3': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.113', 'weapon4': '0.210', 'WEAPON4': '0.250', 'weapon5': '0.298', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'HITCOUNT': '0.540', 'weapon3': '1.062', 'ARMOR': '1.249', 'weapon2': '1.970', 'DAMAGECOUNT': '2.586', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:23:04,352][2409099] DAMAGECOUNT value on done: 8844.0
[2023-02-25 13:23:04,353][2409099] Sum rewards: 12.285, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.090', 'WEAPON1': '0.010', 'AMMO5': '0.024', 'AMMO2': '0.038', 'weapon5': '0.114', 'AMMO3': '0.125', 'weapon7': '0.152', 'AMMO4': '0.191', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'weapon2': '0.760', 'HITCOUNT': '0.880', 'ARMOR': '0.946', 'weapon4': '1.078', 'weapon3': '1.622', 'DAMAGECOUNT': '5.034', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:23:04,902][2409468] Large shaping reward 2.505 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.483, 161.0), ('weapon7', 0.002)]
[2023-02-25 13:23:05,835][2409074] Updated weights for policy 0, policy_version 23661 (0.0013)
[2023-02-25 13:23:06,385][2409033] Signal inference workers to stop experience collection... (2850 times)
[2023-02-25 13:23:06,404][2409033] Signal inference workers to resume experience collection... (2850 times)
[2023-02-25 13:23:06,407][2409074] InferenceWorker_p0-w0: stopping experience collection (2850 times)
[2023-02-25 13:23:06,431][2409074] InferenceWorker_p0-w0: resuming experience collection (2850 times)
[2023-02-25 13:23:06,456][2409074] Updated weights for policy 0, policy_version 23671 (0.0013)
[2023-02-25 13:23:06,969][2409078] DAMAGECOUNT value on done: 8840.0
[2023-02-25 13:23:06,970][2409078] Sum rewards: 19.472, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.244', 'AMMO2': '0.007', 'AMMO5': '0.025', 'WEAPON1': '0.030', 'AMMO4': '0.033', 'AMMO3': '0.141', 'weapon5': '0.194', 'ARMOR': '0.460', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'weapon2': '0.908', 'HITCOUNT': '1.320', 'weapon3': '2.480', 'DAMAGECOUNT': '4.968', 'FRAGCOUNT': '16.000'}
[2023-02-25 13:23:07,118][2409096] DAMAGECOUNT value on done: 8285.0
[2023-02-25 13:23:07,119][2409096] Sum rewards: 17.259, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.434', 'AMMO2': '0.010', 'AMMO5': '0.026', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'AMMO3': '0.148', 'weapon4': '0.150', 'weapon5': '0.254', 'ARMOR': '0.438', 'WEAPON5': '0.550', 'weapon2': '0.606', 'WEAPON3': '0.900', 'HITCOUNT': '1.120', 'weapon3': '2.522', 'DAMAGECOUNT': '4.818', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:23:07,186][2408954] Fps is (10 sec: 27852.5, 60 sec: 25190.3, 300 sec: 24506.6). Total num frames: 96968704. Throughput: 0: 6265.8. Samples: 24233868. Policy #0 lag: (min: 0.0, avg: 9.8, max: 25.0)
[2023-02-25 13:23:07,186][2408954] Avg episode reward: [(0, '13.428')]
[2023-02-25 13:23:07,191][2409033] Saving new best policy, reward=13.428!
[2023-02-25 13:23:07,435][2409079] DAMAGECOUNT value on done: 9405.0
[2023-02-25 13:23:07,437][2409079] Sum rewards: 17.891, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.802', 'AMMO2': '0.013', 'AMMO5': '0.032', 'AMMO4': '0.063', 'weapon7': '0.090', 'AMMO3': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.378', 'weapon2': '0.568', 'WEAPON5': '0.650', 'WEAPON3': '0.700', 'HITCOUNT': '0.710', 'ARMOR': '0.800', 'weapon4': '1.162', 'weapon3': '1.338', 'DAMAGECOUNT': '5.130', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:23:07,465][2409547] DAMAGECOUNT value on done: 8293.0
[2023-02-25 13:23:07,468][2409547] Sum rewards: 13.863, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.166', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO3': '0.060', 'weapon7': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'weapon4': '0.154', 'weapon5': '0.248', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.630', 'weapon2': '1.204', 'weapon3': '1.226', 'DAMAGECOUNT': '3.192', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:23:07,526][2409076] DAMAGECOUNT value on done: 9301.0
[2023-02-25 13:23:07,527][2409076] Sum rewards: 11.783, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.180', 'AMMO2': '0.032', 'AMMO5': '0.032', 'weapon7': '0.080', 'AMMO3': '0.087', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.140', 'AMMO4': '0.159', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'WEAPON5': '0.650', 'HITCOUNT': '0.700', 'weapon4': '0.802', 'weapon2': '1.186', 'weapon3': '1.352', 'DAMAGECOUNT': '3.153', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:23:07,542][2409075] DAMAGECOUNT value on done: 7978.0
[2023-02-25 13:23:07,545][2409075] Sum rewards: 12.453, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.054', 'weapon7': '0.078', 'AMMO3': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.140', 'AMMO4': '0.149', 'HEALTH': '0.156', 'WEAPON3': '0.550', 'HITCOUNT': '0.860', 'weapon3': '1.260', 'ARMOR': '1.300', 'weapon2': '2.212', 'DAMAGECOUNT': '3.819', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:23:07,576][2409469] DAMAGECOUNT value on done: 8121.0
[2023-02-25 13:23:07,579][2409469] Sum rewards: 6.299, reward structure: {'DEATHCOUNT': '-9.000', 'weapon7': '0.004', 'HEALTH': '0.014', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.107', 'AMMO4': '0.160', 'weapon5': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'weapon4': '0.448', 'WEAPON3': '0.700', 'HITCOUNT': '0.740', 'ARMOR': '0.800', 'weapon2': '1.054', 'weapon3': '1.840', 'DAMAGECOUNT': '3.276', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:23:07,801][2409486] DAMAGECOUNT value on done: 8183.0
[2023-02-25 13:23:07,802][2409486] Sum rewards: 20.600, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.277', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon7': '0.056', 'AMMO3': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.165', 'weapon5': '0.176', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.400', 'WEAPON3': '0.600', 'weapon2': '0.968', 'HITCOUNT': '1.310', 'weapon3': '2.036', 'DAMAGECOUNT': '5.979', 'FRAGCOUNT': '17.000'}
[2023-02-25 13:23:08,102][2409099] DAMAGECOUNT value on done: 8894.0
[2023-02-25 13:23:08,103][2409099] Sum rewards: 11.344, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.430', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'AMMO3': '0.050', 'weapon7': '0.052', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.138', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'weapon4': '0.482', 'HITCOUNT': '0.630', 'weapon3': '0.756', 'ARMOR': '0.862', 'weapon2': '1.328', 'DAMAGECOUNT': '2.697', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:23:08,605][2409101] Large shaping reward 3.642 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:23:09,001][2409074] Updated weights for policy 0, policy_version 23681 (0.0012)
[2023-02-25 13:23:10,220][2409074] Updated weights for policy 0, policy_version 23691 (0.0012)
[2023-02-25 13:23:11,405][2409096] DAMAGECOUNT value on done: 7981.0
[2023-02-25 13:23:11,409][2409096] Sum rewards: 8.340, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.264', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO3': '0.030', 'AMMO4': '0.054', 'weapon5': '0.136', 'WEAPON4': '0.150', 'weapon7': '0.186', 'WEAPON3': '0.200', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HITCOUNT': '0.290', 'WEAPON7': '0.300', 'weapon3': '0.752', 'weapon2': '1.098', 'weapon4': '1.502', 'DAMAGECOUNT': '1.986', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:23:11,501][2409486] DAMAGECOUNT value on done: 8727.0
[2023-02-25 13:23:11,505][2409486] Sum rewards: 9.939, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO3': '0.030', 'weapon7': '0.062', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'weapon5': '0.110', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON3': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HEALTH': '0.352', 'HITCOUNT': '0.380', 'weapon2': '0.386', 'ARMOR': '0.400', 'weapon3': '0.772', 'weapon4': '1.278', 'DAMAGECOUNT': '1.950', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:23:11,718][2409079] DAMAGECOUNT value on done: 10394.0
[2023-02-25 13:23:11,722][2409079] Sum rewards: 12.022, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.487', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'AMMO3': '0.072', 'AMMO4': '0.138', 'weapon5': '0.142', 'WEAPON4': '0.150', 'weapon7': '0.158', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.272', 'WEAPON7': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '0.890', 'ARMOR': '1.255', 'weapon2': '1.276', 'weapon3': '1.714', 'DAMAGECOUNT': '3.384', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:23:11,759][2409076] DAMAGECOUNT value on done: 8539.0
[2023-02-25 13:23:11,763][2409076] Sum rewards: 18.954, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.884', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.009', 'AMMO3': '0.040', 'WEAPON5': '0.150', 'weapon5': '0.158', 'WEAPON4': '0.200', 'weapon7': '0.294', 'WEAPON3': '0.350', 'AMMO6': '0.360', 'AMMO7': '0.360', 'WEAPON7': '0.600', 'weapon4': '0.790', 'ARMOR': '0.835', 'HITCOUNT': '0.850', 'weapon3': '0.984', 'weapon2': '1.082', 'DAMAGECOUNT': '4.524', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:23:11,824][2409099] DAMAGECOUNT value on done: 8150.0
[2023-02-25 13:23:11,827][2409099] Sum rewards: 12.693, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.360', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.089', 'AMMO4': '0.102', 'weapon5': '0.108', 'weapon7': '0.236', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'WEAPON7': '0.500', 'WEAPON3': '0.600', 'weapon4': '0.666', 'HITCOUNT': '0.940', 'weapon2': '1.170', 'weapon3': '1.284', 'DAMAGECOUNT': '3.972', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:23:11,834][2409469] DAMAGECOUNT value on done: 8817.0
[2023-02-25 13:23:11,835][2409469] Sum rewards: 13.408, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.896', 'AMMO5': '0.009', 'AMMO2': '0.014', 'weapon7': '0.062', 'AMMO4': '0.067', 'AMMO3': '0.085', 'weapon5': '0.126', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.920', 'weapon2': '0.998', 'weapon4': '1.102', 'weapon3': '1.400', 'DAMAGECOUNT': '4.530', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:23:11,927][2409547] DAMAGECOUNT value on done: 7737.0
[2023-02-25 13:23:11,929][2409547] Sum rewards: 13.037, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.994', 'AMMO5': '0.021', 'AMMO2': '0.031', 'weapon7': '0.082', 'AMMO3': '0.084', 'AMMO4': '0.154', 'weapon5': '0.258', 'AMMO6': '0.260', 'AMMO7': '0.260', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '0.660', 'weapon4': '0.760', 'ARMOR': '0.892', 'weapon2': '1.256', 'weapon3': '1.328', 'DAMAGECOUNT': '3.534', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:23:12,186][2408954] Fps is (10 sec: 24166.6, 60 sec: 24986.5, 300 sec: 24464.9). Total num frames: 97075200. Throughput: 0: 6258.4. Samples: 24271092. Policy #0 lag: (min: 0.0, avg: 9.8, max: 25.0)
[2023-02-25 13:23:12,186][2408954] Avg episode reward: [(0, '13.459')]
[2023-02-25 13:23:12,187][2409033] Saving new best policy, reward=13.459!
[2023-02-25 13:23:12,330][2409074] Updated weights for policy 0, policy_version 23701 (0.0012)
[2023-02-25 13:23:13,726][2409074] Updated weights for policy 0, policy_version 23711 (0.0013)
[2023-02-25 13:23:14,864][2409074] Updated weights for policy 0, policy_version 23721 (0.0013)
[2023-02-25 13:23:15,145][2409486] DAMAGECOUNT value on done: 7023.0
[2023-02-25 13:23:15,146][2409486] Sum rewards: 10.973, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.647', 'AMMO5': '0.027', 'AMMO2': '0.049', 'weapon7': '0.062', 'AMMO3': '0.120', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon5': '0.196', 'WEAPON7': '0.200', 'AMMO4': '0.247', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'weapon4': '0.692', 'HITCOUNT': '0.870', 'weapon2': '1.088', 'weapon3': '1.588', 'ARMOR': '1.692', 'DAMAGECOUNT': '3.069', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:23:15,501][2409099] DAMAGECOUNT value on done: 8083.0
[2023-02-25 13:23:15,504][2409099] Sum rewards: 11.438, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.982', 'AMMO5': '0.012', 'AMMO2': '0.018', 'weapon7': '0.068', 'AMMO4': '0.089', 'AMMO3': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.252', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.960', 'weapon2': '0.968', 'weapon3': '1.346', 'DAMAGECOUNT': '3.483', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:23:15,705][2409096] DAMAGECOUNT value on done: 7734.0
[2023-02-25 13:23:15,706][2409096] Sum rewards: 13.206, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.017', 'AMMO2': '0.022', 'AMMO3': '0.060', 'weapon7': '0.068', 'AMMO4': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HEALTH': '0.134', 'weapon5': '0.194', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'ARMOR': '0.808', 'HITCOUNT': '0.830', 'weapon2': '0.842', 'weapon4': '0.880', 'weapon3': '1.560', 'DAMAGECOUNT': '3.390', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:23:15,807][2409079] DAMAGECOUNT value on done: 8168.0
[2023-02-25 13:23:15,806][2409547] DAMAGECOUNT value on done: 7955.0
[2023-02-25 13:23:15,809][2409079] Sum rewards: 12.758, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.420', 'AMMO5': '0.015', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO4': '0.076', 'AMMO3': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.286', 'WEAPON5': '0.450', 'ARMOR': '0.454', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'weapon4': '0.736', 'weapon2': '0.878', 'weapon3': '1.558', 'DAMAGECOUNT': '3.687', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:23:15,809][2409547] Sum rewards: 9.197, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.889', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'AMMO3': '0.040', 'weapon5': '0.052', 'weapon7': '0.058', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.228', 'WEAPON3': '0.350', 'ARMOR': '0.463', 'HITCOUNT': '0.490', 'weapon3': '1.012', 'DAMAGECOUNT': '2.352', 'weapon2': '2.358', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:23:16,124][2409076] DAMAGECOUNT value on done: 8569.0
[2023-02-25 13:23:16,125][2409076] Sum rewards: 11.603, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.041', 'weapon7': '0.048', 'AMMO3': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.218', 'HEALTH': '0.298', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.920', 'weapon3': '1.258', 'weapon2': '1.494', 'DAMAGECOUNT': '3.078', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:23:17,186][2408954] Fps is (10 sec: 22937.5, 60 sec: 24917.4, 300 sec: 24520.5). Total num frames: 97198080. Throughput: 0: 6272.2. Samples: 24309156. Policy #0 lag: (min: 0.0, avg: 9.8, max: 25.0)
[2023-02-25 13:23:17,186][2408954] Avg episode reward: [(0, '13.143')]
[2023-02-25 13:23:17,281][2409074] Updated weights for policy 0, policy_version 23731 (0.0012)
[2023-02-25 13:23:18,163][2409074] Updated weights for policy 0, policy_version 23741 (0.0013)
[2023-02-25 13:23:19,209][2409486] DAMAGECOUNT value on done: 8860.0
[2023-02-25 13:23:19,210][2409486] Sum rewards: 14.934, reward structure: {'DEATHCOUNT': '-9.750', 'weapon4': '0.008', 'AMMO2': '0.011', 'AMMO5': '0.027', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'HEALTH': '0.118', 'AMMO3': '0.142', 'weapon5': '0.286', 'ARMOR': '0.400', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'HITCOUNT': '0.930', 'weapon2': '1.158', 'weapon3': '2.142', 'DAMAGECOUNT': '4.959', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:23:19,657][2409547] DAMAGECOUNT value on done: 10147.0
[2023-02-25 13:23:19,658][2409547] Sum rewards: 15.536, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.182', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon7': '0.054', 'AMMO3': '0.084', 'weapon5': '0.178', 'AMMO4': '0.184', 'WEAPON5': '0.200', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.496', 'WEAPON3': '0.550', 'HITCOUNT': '0.580', 'ARMOR': '0.855', 'weapon2': '1.110', 'weapon3': '1.226', 'DAMAGECOUNT': '4.656', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:23:19,703][2409079] DAMAGECOUNT value on done: 9298.0
[2023-02-25 13:23:19,703][2409099] DAMAGECOUNT value on done: 6842.0
[2023-02-25 13:23:19,704][2409079] Sum rewards: 8.022, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.092', 'AMMO5': '0.010', 'AMMO2': '0.010', 'AMMO3': '0.040', 'AMMO4': '0.051', 'weapon7': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon5': '0.160', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'WEAPON4': '0.350', 'HITCOUNT': '0.800', 'weapon4': '0.844', 'ARMOR': '0.866', 'weapon3': '1.028', 'weapon2': '1.364', 'DAMAGECOUNT': '2.883', 'FRAGCOUNT': '6.500'}
[2023-02-25 13:23:19,704][2409099] Sum rewards: 0.976, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.840', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon7': '0.076', 'AMMO3': '0.079', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.420', 'WEAPON3': '0.500', 'FRAGCOUNT': '0.500', 'weapon3': '0.978', 'weapon2': '1.060', 'weapon4': '1.106', 'DAMAGECOUNT': '1.224'}
[2023-02-25 13:23:19,766][2409076] DAMAGECOUNT value on done: 7779.0
[2023-02-25 13:23:19,766][2409076] Sum rewards: 16.329, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.875', 'AMMO5': '0.021', 'AMMO2': '0.036', 'weapon7': '0.062', 'AMMO3': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.178', 'WEAPON7': '0.200', 'weapon5': '0.280', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.450', 'WEAPON4': '0.500', 'HITCOUNT': '0.780', 'weapon3': '1.010', 'weapon4': '1.118', 'weapon2': '1.200', 'DAMAGECOUNT': '3.459', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:23:20,082][2409096] DAMAGECOUNT value on done: 8611.0
[2023-02-25 13:23:20,085][2409096] Sum rewards: 20.412, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.740', 'AMMO2': '0.014', 'AMMO5': '0.024', 'AMMO4': '0.070', 'AMMO3': '0.115', 'weapon5': '0.188', 'weapon4': '0.358', 'WEAPON4': '0.400', 'WEAPON5': '0.600', 'ARMOR': '0.894', 'WEAPON3': '0.900', 'weapon2': '1.064', 'HITCOUNT': '1.250', 'weapon3': '1.612', 'DAMAGECOUNT': '5.412', 'FRAGCOUNT': '17.000'}
[2023-02-25 13:23:20,605][2409074] Updated weights for policy 0, policy_version 23751 (0.0012)
[2023-02-25 13:23:21,509][2409074] Updated weights for policy 0, policy_version 23761 (0.0012)
[2023-02-25 13:23:22,186][2408954] Fps is (10 sec: 26623.9, 60 sec: 25258.7, 300 sec: 24589.9). Total num frames: 97341440. Throughput: 0: 6259.5. Samples: 24327780. Policy #0 lag: (min: 0.0, avg: 10.6, max: 25.0)
[2023-02-25 13:23:22,186][2408954] Avg episode reward: [(0, '13.166')]
[2023-02-25 13:23:23,256][2409074] Updated weights for policy 0, policy_version 23771 (0.0013)
[2023-02-25 13:23:23,381][2409079] DAMAGECOUNT value on done: 8681.0
[2023-02-25 13:23:23,384][2409079] Sum rewards: 12.437, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.283', 'AMMO2': '0.004', 'AMMO4': '0.018', 'WEAPON1': '0.020', 'AMMO5': '0.031', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.144', 'weapon5': '0.434', 'WEAPON5': '0.700', 'HITCOUNT': '0.780', 'WEAPON3': '0.900', 'weapon3': '1.304', 'ARMOR': '1.352', 'weapon2': '1.818', 'DAMAGECOUNT': '4.545', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:23:23,416][2409547] DAMAGECOUNT value on done: 7184.0
[2023-02-25 13:23:23,419][2409547] Sum rewards: 10.530, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.450', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'weapon7': '0.002', 'AMMO5': '0.007', 'AMMO3': '0.051', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.206', 'WEAPON3': '0.400', 'HITCOUNT': '0.730', 'ARMOR': '0.856', 'weapon3': '1.284', 'weapon2': '1.586', 'DAMAGECOUNT': '3.234', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:23:23,658][2409486] DAMAGECOUNT value on done: 8361.0
[2023-02-25 13:23:23,662][2409486] Sum rewards: 8.423, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.062', 'AMMO2': '0.002', 'AMMO4': '0.012', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'weapon5': '0.066', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'weapon4': '0.444', 'HITCOUNT': '0.450', 'WEAPON3': '0.550', 'weapon2': '0.896', 'weapon3': '1.776', 'DAMAGECOUNT': '1.905', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:23:23,872][2409076] DAMAGECOUNT value on done: 8345.0
[2023-02-25 13:23:23,876][2409076] Sum rewards: 16.451, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.570', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.031', 'AMMO3': '0.040', 'weapon5': '0.100', 'weapon7': '0.170', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.370', 'ARMOR': '0.445', 'weapon3': '1.116', 'weapon2': '2.194', 'DAMAGECOUNT': '3.504', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:23:24,029][2409099] DAMAGECOUNT value on done: 7635.0
[2023-02-25 13:23:24,030][2409099] Sum rewards: 6.530, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.305', 'AMMO2': '0.014', 'AMMO5': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.058', 'AMMO4': '0.072', 'weapon7': '0.134', 'weapon5': '0.196', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.390', 'WEAPON3': '0.400', 'weapon4': '0.468', 'weapon3': '1.056', 'weapon2': '1.440', 'DAMAGECOUNT': '1.947', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:23:24,163][2409096] DAMAGECOUNT value on done: 7577.0
[2023-02-25 13:23:24,164][2409096] Sum rewards: 13.435, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.172', 'AMMO5': '0.022', 'AMMO2': '0.024', 'weapon7': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.105', 'weapon4': '0.120', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.236', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.790', 'ARMOR': '0.894', 'weapon2': '1.406', 'weapon3': '1.770', 'DAMAGECOUNT': '3.999', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:23:25,098][2409074] Updated weights for policy 0, policy_version 23781 (0.0012)
[2023-02-25 13:23:26,584][2409074] Updated weights for policy 0, policy_version 23791 (0.0012)
[2023-02-25 13:23:27,186][2408954] Fps is (10 sec: 26214.7, 60 sec: 25122.2, 300 sec: 24562.1). Total num frames: 97460224. Throughput: 0: 6260.8. Samples: 24365580. Policy #0 lag: (min: 0.0, avg: 10.6, max: 25.0)
[2023-02-25 13:23:27,186][2408954] Avg episode reward: [(0, '12.998')]
[2023-02-25 13:23:27,313][2409547] DAMAGECOUNT value on done: 8747.0
[2023-02-25 13:23:27,314][2409547] Sum rewards: 10.120, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.168', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO4': '0.027', 'weapon5': '0.074', 'AMMO3': '0.140', 'WEAPON4': '0.200', 'weapon4': '0.368', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.950', 'weapon2': '1.082', 'HITCOUNT': '1.180', 'weapon3': '2.054', 'DAMAGECOUNT': '4.377', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:23:27,528][2409079] DAMAGECOUNT value on done: 7690.0
[2023-02-25 13:23:27,531][2409079] Sum rewards: 12.559, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.216', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'AMMO3': '0.092', 'weapon7': '0.152', 'AMMO4': '0.163', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon5': '0.288', 'weapon4': '0.378', 'WEAPON3': '0.550', 'ARMOR': '0.834', 'HITCOUNT': '0.970', 'weapon2': '1.042', 'weapon3': '1.352', 'DAMAGECOUNT': '4.287', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:23:27,871][2409486] DAMAGECOUNT value on done: 9282.0
[2023-02-25 13:23:27,872][2409486] Sum rewards: 8.211, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.564', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO3': '0.060', 'AMMO4': '0.065', 'weapon7': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.182', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.470', 'HITCOUNT': '0.570', 'weapon3': '0.792', 'weapon2': '0.794', 'DAMAGECOUNT': '2.613', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:23:28,295][2409099] DAMAGECOUNT value on done: 8291.0
[2023-02-25 13:23:28,296][2409099] Sum rewards: 16.749, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.510', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.007', 'AMMO3': '0.060', 'weapon7': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.218', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'weapon4': '0.678', 'HITCOUNT': '1.200', 'weapon2': '1.220', 'weapon3': '1.494', 'DAMAGECOUNT': '4.404', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:23:28,572][2409096] DAMAGECOUNT value on done: 8156.0
[2023-02-25 13:23:28,575][2409096] Sum rewards: 11.080, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.086', 'AMMO2': '0.013', 'weapon4': '0.016', 'AMMO5': '0.018', 'WEAPON1': '0.030', 'AMMO4': '0.062', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'weapon5': '0.282', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'HITCOUNT': '0.590', 'weapon3': '1.392', 'weapon2': '1.560', 'DAMAGECOUNT': '3.678', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:23:28,782][2409074] Updated weights for policy 0, policy_version 23801 (0.0012)
[2023-02-25 13:23:29,763][2409074] Updated weights for policy 0, policy_version 23811 (0.0012)
[2023-02-25 13:23:31,034][2409547] DAMAGECOUNT value on done: 8263.0
[2023-02-25 13:23:31,037][2409547] Sum rewards: 19.684, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.782', 'AMMO5': '0.016', 'AMMO2': '0.032', 'AMMO3': '0.088', 'AMMO4': '0.160', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon7': '0.242', 'weapon5': '0.312', 'WEAPON4': '0.350', 'WEAPON7': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon4': '0.528', 'weapon2': '1.074', 'HITCOUNT': '1.130', 'weapon3': '1.260', 'DAMAGECOUNT': '4.944', 'FRAGCOUNT': '14.500'}
[2023-02-25 13:23:31,979][2409099] DAMAGECOUNT value on done: 9053.0
[2023-02-25 13:23:31,980][2409099] Sum rewards: 17.070, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.263', 'AMMO2': '0.012', 'AMMO5': '0.025', 'weapon7': '0.048', 'AMMO3': '0.060', 'AMMO4': '0.061', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.152', 'WEAPON5': '0.400', 'weapon4': '0.422', 'WEAPON3': '0.450', 'ARMOR': '1.075', 'weapon2': '1.252', 'HITCOUNT': '1.260', 'weapon3': '1.464', 'DAMAGECOUNT': '4.452', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:23:32,048][2409074] Updated weights for policy 0, policy_version 23821 (0.0012)
[2023-02-25 13:23:32,186][2408954] Fps is (10 sec: 22937.4, 60 sec: 24644.2, 300 sec: 24506.6). Total num frames: 97570816. Throughput: 0: 6271.2. Samples: 24403560. Policy #0 lag: (min: 0.0, avg: 10.6, max: 25.0)
[2023-02-25 13:23:32,187][2408954] Avg episode reward: [(0, '13.113')]
[2023-02-25 13:23:32,384][2409096] DAMAGECOUNT value on done: 8442.0
[2023-02-25 13:23:32,385][2409096] Sum rewards: 11.880, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.104', 'AMMO5': '0.021', 'AMMO2': '0.036', 'weapon4': '0.036', 'AMMO3': '0.092', 'AMMO4': '0.179', 'WEAPON4': '0.200', 'weapon5': '0.350', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '0.660', 'ARMOR': '1.255', 'weapon2': '1.398', 'weapon3': '1.488', 'DAMAGECOUNT': '3.069', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:23:33,120][2409074] Updated weights for policy 0, policy_version 23831 (0.0012)
[2023-02-25 13:23:33,478][2409407] Large shaping reward 2.536 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.504, 168.0), ('weapon7', 0.002)]
[2023-02-25 13:23:33,833][2409080] DAMAGECOUNT value on done: 10431.0
[2023-02-25 13:23:33,834][2409080] Sum rewards: 16.920, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.948', 'AMMO2': '0.007', 'AMMO5': '0.020', 'AMMO4': '0.036', 'AMMO3': '0.091', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.122', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.282', 'WEAPON5': '0.450', 'ARMOR': '0.455', 'weapon4': '0.550', 'WEAPON3': '0.600', 'HITCOUNT': '0.840', 'weapon2': '0.874', 'weapon3': '1.492', 'DAMAGECOUNT': '4.209', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:23:34,750][2409074] Updated weights for policy 0, policy_version 23841 (0.0014)
[2023-02-25 13:23:34,892][2409547] DAMAGECOUNT value on done: 7305.0
[2023-02-25 13:23:34,893][2409547] Sum rewards: 4.722, reward structure: {'DEATHCOUNT': '-0.750', 'HEALTH': '-0.360', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'AMMO3': '0.010', 'weapon7': '0.048', 'WEAPON3': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.160', 'WEAPON7': '0.200', 'weapon3': '0.258', 'weapon4': '0.720', 'weapon2': '0.740', 'DAMAGECOUNT': '1.080', 'FRAGCOUNT': '2.000'}
[2023-02-25 13:23:35,697][2409099] DAMAGECOUNT value on done: 8647.0
[2023-02-25 13:23:35,700][2409099] Sum rewards: 15.547, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.653', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.023', 'weapon7': '0.064', 'AMMO3': '0.080', 'AMMO4': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.940', 'weapon2': '0.952', 'weapon4': '1.060', 'ARMOR': '1.200', 'weapon3': '1.366', 'DAMAGECOUNT': '4.266', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:23:36,530][2409074] Updated weights for policy 0, policy_version 23851 (0.0014)
[2023-02-25 13:23:37,186][2408954] Fps is (10 sec: 24985.6, 60 sec: 25190.4, 300 sec: 24603.8). Total num frames: 97710080. Throughput: 0: 6261.1. Samples: 24421932. Policy #0 lag: (min: 3.0, avg: 11.1, max: 25.0)
[2023-02-25 13:23:37,186][2408954] Avg episode reward: [(0, '13.106')]
[2023-02-25 13:23:37,778][2409074] Updated weights for policy 0, policy_version 23861 (0.0012)
[2023-02-25 13:23:38,026][2409080] DAMAGECOUNT value on done: 8020.0
[2023-02-25 13:23:38,030][2409080] Sum rewards: 13.115, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.285', 'AMMO5': '0.023', 'AMMO2': '0.026', 'AMMO3': '0.110', 'AMMO4': '0.131', 'WEAPON4': '0.200', 'weapon5': '0.318', 'weapon4': '0.440', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon2': '0.902', 'HITCOUNT': '1.120', 'weapon3': '1.894', 'DAMAGECOUNT': '4.935', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:23:38,775][2409547] DAMAGECOUNT value on done: 9184.0
[2023-02-25 13:23:38,779][2409547] Sum rewards: 14.676, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.130', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.038', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'weapon5': '0.134', 'WEAPON4': '0.150', 'weapon4': '0.466', 'WEAPON3': '0.650', 'HITCOUNT': '0.880', 'ARMOR': '0.904', 'weapon2': '1.256', 'weapon3': '1.520', 'DAMAGECOUNT': '3.591', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:23:39,536][2409099] DAMAGECOUNT value on done: 9390.0
[2023-02-25 13:23:39,537][2409099] Sum rewards: 14.027, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.576', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO5': '0.016', 'WEAPON4': '0.050', 'weapon4': '0.064', 'AMMO4': '0.064', 'AMMO3': '0.090', 'weapon5': '0.298', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.820', 'weapon2': '1.172', 'weapon3': '2.104', 'DAMAGECOUNT': '4.851', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:23:40,029][2409074] Updated weights for policy 0, policy_version 23871 (0.0012)
[2023-02-25 13:23:40,705][2409596] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:23:41,243][2409074] Updated weights for policy 0, policy_version 23881 (0.0013)
[2023-02-25 13:23:41,329][2409075] Large shaping reward 3.246 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.195, 65.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)]
[2023-02-25 13:23:42,174][2409080] DAMAGECOUNT value on done: 8499.0
[2023-02-25 13:23:42,175][2409080] Sum rewards: 13.212, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.688', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.069', 'AMMO3': '0.080', 'WEAPON4': '0.150', 'weapon7': '0.178', 'WEAPON5': '0.250', 'AMMO6': '0.280', 'AMMO7': '0.280', 'weapon5': '0.290', 'WEAPON3': '0.350', 'WEAPON7': '0.400', 'weapon4': '0.438', 'ARMOR': '0.456', 'HITCOUNT': '0.710', 'weapon3': '1.044', 'weapon2': '1.360', 'DAMAGECOUNT': '3.789', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:23:42,186][2408954] Fps is (10 sec: 27444.0, 60 sec: 25327.0, 300 sec: 24645.4). Total num frames: 97845248. Throughput: 0: 6286.4. Samples: 24460128. Policy #0 lag: (min: 3.0, avg: 11.1, max: 25.0)
[2023-02-25 13:23:42,186][2408954] Avg episode reward: [(0, '13.021')]
[2023-02-25 13:23:42,688][2409547] DAMAGECOUNT value on done: 10568.0
[2023-02-25 13:23:42,689][2409547] Sum rewards: 15.664, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.275', 'AMMO2': '0.016', 'AMMO5': '0.020', 'AMMO3': '0.050', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'weapon5': '0.310', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.564', 'HITCOUNT': '0.770', 'ARMOR': '0.828', 'weapon2': '0.900', 'weapon3': '1.082', 'DAMAGECOUNT': '4.272', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:23:42,958][2409074] Updated weights for policy 0, policy_version 23891 (0.0012)
[2023-02-25 13:23:43,550][2409099] DAMAGECOUNT value on done: 9526.0
[2023-02-25 13:23:43,553][2409099] Sum rewards: 16.301, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.020', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO3': '0.060', 'weapon7': '0.086', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.450', 'ARMOR': '0.459', 'weapon4': '0.682', 'HITCOUNT': '0.860', 'weapon3': '1.162', 'weapon2': '1.480', 'DAMAGECOUNT': '3.390', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:23:44,388][2409074] Updated weights for policy 0, policy_version 23901 (0.0012)
[2023-02-25 13:23:45,987][2409074] Updated weights for policy 0, policy_version 23911 (0.0012)
[2023-02-25 13:23:46,526][2409080] DAMAGECOUNT value on done: 6884.0
[2023-02-25 13:23:46,530][2409080] Sum rewards: 13.600, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.015', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'AMMO3': '0.068', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.111', 'weapon5': '0.196', 'weapon4': '0.224', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'HEALTH': '0.676', 'HITCOUNT': '0.750', 'ARMOR': '0.800', 'weapon2': '1.288', 'weapon3': '1.340', 'DAMAGECOUNT': '2.910', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:23:46,622][2409547] DAMAGECOUNT value on done: 8696.0
[2023-02-25 13:23:46,627][2409547] Sum rewards: 19.986, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.750', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.012', 'WEAPON4': '0.050', 'weapon7': '0.072', 'AMMO3': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.180', 'weapon4': '0.226', 'WEAPON5': '0.350', 'ARMOR': '0.449', 'WEAPON3': '0.750', 'weapon2': '1.034', 'HITCOUNT': '1.070', 'weapon3': '1.482', 'DAMAGECOUNT': '4.926', 'FRAGCOUNT': '16.000'}
[2023-02-25 13:23:46,711][2409075] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:23:47,186][2408954] Fps is (10 sec: 24985.7, 60 sec: 24780.8, 300 sec: 24589.9). Total num frames: 97959936. Throughput: 0: 6285.3. Samples: 24497616. Policy #0 lag: (min: 3.0, avg: 11.1, max: 25.0)
[2023-02-25 13:23:47,186][2408954] Avg episode reward: [(0, '13.157')]
[2023-02-25 13:23:47,609][2409099] DAMAGECOUNT value on done: 8195.0
[2023-02-25 13:23:47,613][2409099] Sum rewards: 11.992, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.647', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO4': '0.031', 'AMMO3': '0.079', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon7': '0.100', 'weapon5': '0.220', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon4': '0.554', 'HITCOUNT': '0.650', 'ARMOR': '0.942', 'weapon3': '1.224', 'weapon2': '1.462', 'DAMAGECOUNT': '3.177', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:23:47,924][2409074] Updated weights for policy 0, policy_version 23921 (0.0012)
[2023-02-25 13:23:49,185][2409405] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:23:49,483][2409074] Updated weights for policy 0, policy_version 23931 (0.0012)
[2023-02-25 13:23:49,733][2409033] Signal inference workers to stop experience collection... (2900 times)
[2023-02-25 13:23:49,743][2409033] Signal inference workers to resume experience collection... (2900 times)
[2023-02-25 13:23:49,778][2409074] InferenceWorker_p0-w0: stopping experience collection (2900 times)
[2023-02-25 13:23:49,778][2409074] InferenceWorker_p0-w0: resuming experience collection (2900 times)
[2023-02-25 13:23:50,329][2409080] DAMAGECOUNT value on done: 8466.0
[2023-02-25 13:23:50,333][2409080] Sum rewards: 18.614, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.111', 'AMMO2': '0.011', 'AMMO5': '0.015', 'weapon7': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.071', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'weapon5': '0.328', 'WEAPON3': '0.500', 'weapon2': '0.772', 'weapon4': '0.838', 'ARMOR': '0.869', 'HITCOUNT': '1.000', 'weapon3': '1.492', 'DAMAGECOUNT': '4.227', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:23:50,719][2409547] DAMAGECOUNT value on done: 7655.0
[2023-02-25 13:23:50,722][2409547] Sum rewards: 13.800, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.606', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon7': '0.084', 'AMMO3': '0.103', 'AMMO4': '0.121', 'weapon5': '0.126', 'WEAPON4': '0.150', 'weapon4': '0.208', 'WEAPON5': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.890', 'weapon3': '1.296', 'ARMOR': '1.402', 'weapon2': '1.826', 'DAMAGECOUNT': '3.771', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:23:51,465][2409074] Updated weights for policy 0, policy_version 23941 (0.0016)
[2023-02-25 13:23:51,604][2409099] DAMAGECOUNT value on done: 8519.0
[2023-02-25 13:23:51,605][2409099] Sum rewards: 7.134, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.317', 'AMMO2': '0.012', 'AMMO5': '0.022', 'AMMO4': '0.060', 'weapon5': '0.066', 'weapon4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'WEAPON5': '0.450', 'HITCOUNT': '0.580', 'WEAPON3': '0.750', 'ARMOR': '1.377', 'weapon3': '1.616', 'weapon2': '1.916', 'DAMAGECOUNT': '2.313', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:23:52,186][2408954] Fps is (10 sec: 24166.1, 60 sec: 25122.2, 300 sec: 24631.5). Total num frames: 98086912. Throughput: 0: 6285.4. Samples: 24516708. Policy #0 lag: (min: 3.0, avg: 11.1, max: 25.0)
[2023-02-25 13:23:52,187][2408954] Avg episode reward: [(0, '13.061')]
[2023-02-25 13:23:52,843][2409074] Updated weights for policy 0, policy_version 23951 (0.0012)
[2023-02-25 13:23:53,885][2409074] Updated weights for policy 0, policy_version 23961 (0.0013)
[2023-02-25 13:23:54,364][2409080] DAMAGECOUNT value on done: 9353.0
[2023-02-25 13:23:54,367][2409080] Sum rewards: 8.441, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.304', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.029', 'AMMO4': '0.040', 'weapon7': '0.054', 'AMMO3': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.202', 'WEAPON4': '0.300', 'ARMOR': '0.455', 'weapon4': '0.580', 'WEAPON5': '0.700', 'weapon2': '0.770', 'WEAPON3': '0.800', 'HITCOUNT': '0.810', 'weapon3': '1.776', 'DAMAGECOUNT': '3.660', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:23:54,507][2409547] DAMAGECOUNT value on done: 9392.0
[2023-02-25 13:23:54,510][2409547] Sum rewards: 18.406, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.960', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'weapon7': '0.090', 'AMMO3': '0.096', 'AMMO4': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.236', 'WEAPON4': '0.300', 'weapon4': '0.360', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '1.030', 'weapon2': '1.048', 'weapon3': '1.592', 'DAMAGECOUNT': '4.785', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:23:55,199][2409468] DAMAGECOUNT value on done: 9408.0
[2023-02-25 13:23:55,200][2409468] Sum rewards: 20.913, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.034', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO3': '0.087', 'weapon5': '0.106', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon7': '0.194', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.548', 'ARMOR': '0.900', 'weapon2': '0.982', 'HITCOUNT': '1.200', 'weapon3': '1.390', 'DAMAGECOUNT': '4.557', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:23:55,360][2409099] DAMAGECOUNT value on done: 9191.0
[2023-02-25 13:23:55,362][2409099] Sum rewards: 22.257, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.410', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'AMMO5': '0.029', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.131', 'weapon5': '0.340', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'HITCOUNT': '1.260', 'ARMOR': '1.299', 'weapon2': '1.462', 'weapon3': '1.536', 'DAMAGECOUNT': '6.534', 'FRAGCOUNT': '16.000'}
[2023-02-25 13:23:56,038][2409074] Updated weights for policy 0, policy_version 23971 (0.0012)
[2023-02-25 13:23:56,493][2409485] Large shaping reward 2.598 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.579, 193.0), ('HEALTH', -0.012, -4.0), ('ARMOR', -0.001, -1.0), ('weapon7', 0.002)]
[2023-02-25 13:23:57,186][2408954] Fps is (10 sec: 24985.6, 60 sec: 25326.9, 300 sec: 24631.5). Total num frames: 98209792. Throughput: 0: 6288.3. Samples: 24554064. Policy #0 lag: (min: 0.0, avg: 13.5, max: 24.0)
[2023-02-25 13:23:57,186][2408954] Avg episode reward: [(0, '13.212')]
[2023-02-25 13:23:57,526][2409074] Updated weights for policy 0, policy_version 23981 (0.0012)
[2023-02-25 13:23:58,444][2409080] DAMAGECOUNT value on done: 8412.0
[2023-02-25 13:23:58,445][2409080] Sum rewards: 20.595, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.296', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.015', 'AMMO5': '0.020', 'weapon5': '0.046', 'WEAPON4': '0.050', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.106', 'WEAPON5': '0.300', 'weapon4': '0.520', 'WEAPON3': '0.800', 'HITCOUNT': '1.270', 'weapon2': '1.274', 'weapon3': '1.862', 'DAMAGECOUNT': '5.013', 'FRAGCOUNT': '17.000'}
[2023-02-25 13:23:58,629][2409547] DAMAGECOUNT value on done: 7758.0
[2023-02-25 13:23:58,630][2409547] Sum rewards: 11.669, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.218', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.014', 'AMMO3': '0.092', 'weapon5': '0.144', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.950', 'weapon2': '1.254', 'weapon3': '2.126', 'DAMAGECOUNT': '3.642', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:23:59,185][2409099] DAMAGECOUNT value on done: 9709.0
[2023-02-25 13:23:59,186][2409099] Sum rewards: 7.156, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.546', 'AMMO2': '0.008', 'AMMO5': '0.017', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.052', 'weapon7': '0.052', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.124', 'WEAPON7': '0.200', 'weapon5': '0.212', 'WEAPON5': '0.400', 'HITCOUNT': '0.640', 'WEAPON3': '0.750', 'weapon2': '1.358', 'weapon3': '1.536', 'DAMAGECOUNT': '3.522', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:23:59,386][2409468] DAMAGECOUNT value on done: 7355.0
[2023-02-25 13:23:59,387][2409468] Sum rewards: 10.890, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.090', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.063', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon7': '0.228', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'weapon2': '0.650', 'weapon4': '0.790', 'HITCOUNT': '0.850', 'weapon3': '0.970', 'DAMAGECOUNT': '2.922', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:23:59,483][2409074] Updated weights for policy 0, policy_version 23991 (0.0012)
[2023-02-25 13:24:01,236][2409074] Updated weights for policy 0, policy_version 24001 (0.0012)
[2023-02-25 13:24:01,562][2409079] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:24:02,186][2408954] Fps is (10 sec: 24574.6, 60 sec: 24985.4, 300 sec: 24659.3). Total num frames: 98332672. Throughput: 0: 6266.3. Samples: 24591144. Policy #0 lag: (min: 0.0, avg: 13.5, max: 24.0)
[2023-02-25 13:24:02,187][2408954] Avg episode reward: [(0, '13.273')]
[2023-02-25 13:24:02,478][2409547] DAMAGECOUNT value on done: 9946.0
[2023-02-25 13:24:02,479][2409547] Sum rewards: 13.492, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.330', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO3': '0.048', 'weapon5': '0.064', 'AMMO4': '0.076', 'weapon7': '0.116', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.440', 'weapon2': '0.536', 'weapon3': '0.544', 'weapon4': '1.630', 'DAMAGECOUNT': '3.255', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:24:02,801][2409074] Updated weights for policy 0, policy_version 24011 (0.0012)
[2023-02-25 13:24:02,809][2409080] DAMAGECOUNT value on done: 9530.0
[2023-02-25 13:24:02,810][2409080] Sum rewards: 20.314, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.696', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'AMMO3': '0.080', 'weapon7': '0.082', 'AMMO4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.246', 'weapon4': '0.332', 'WEAPON5': '0.350', 'ARMOR': '0.432', 'WEAPON3': '0.550', 'weapon2': '0.946', 'HITCOUNT': '0.960', 'weapon3': '1.582', 'DAMAGECOUNT': '5.652', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:24:03,631][2409468] DAMAGECOUNT value on done: 8962.0
[2023-02-25 13:24:03,633][2409468] Sum rewards: 11.756, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.684', 'AMMO2': '0.016', 'AMMO5': '0.017', 'AMMO3': '0.067', 'weapon7': '0.076', 'AMMO4': '0.079', 'weapon5': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'weapon4': '0.438', 'WEAPON3': '0.500', 'HITCOUNT': '0.700', 'weapon3': '1.018', 'weapon2': '1.630', 'DAMAGECOUNT': '3.054', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:24:03,847][2409074] Updated weights for policy 0, policy_version 24021 (0.0012)
[2023-02-25 13:24:06,058][2409074] Updated weights for policy 0, policy_version 24031 (0.0012)
[2023-02-25 13:24:06,537][2409547] DAMAGECOUNT value on done: 7350.0
[2023-02-25 13:24:06,541][2409547] Sum rewards: 8.236, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.928', 'WEAPON1': '0.010', 'weapon7': '0.010', 'AMMO2': '0.037', 'AMMO5': '0.037', 'AMMO3': '0.097', 'AMMO4': '0.186', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.338', 'WEAPON4': '0.500', 'WEAPON3': '0.650', 'WEAPON5': '0.650', 'weapon4': '0.750', 'HITCOUNT': '0.810', 'weapon2': '0.888', 'ARMOR': '1.200', 'weapon3': '1.568', 'DAMAGECOUNT': '3.582', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:24:06,766][2409080] DAMAGECOUNT value on done: 7961.0
[2023-02-25 13:24:06,771][2409080] Sum rewards: 15.171, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.289', 'AMMO5': '0.026', 'AMMO2': '0.032', 'AMMO3': '0.086', 'weapon7': '0.132', 'AMMO4': '0.162', 'weapon5': '0.210', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.402', 'WEAPON7': '0.500', 'WEAPON3': '0.500', 'HITCOUNT': '0.580', 'weapon2': '1.044', 'ARMOR': '1.200', 'weapon3': '1.250', 'DAMAGECOUNT': '4.155', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:24:06,951][2409104] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:24:07,160][2409596] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:24:07,186][2408954] Fps is (10 sec: 25395.2, 60 sec: 24917.4, 300 sec: 24673.2). Total num frames: 98463744. Throughput: 0: 6268.0. Samples: 24609840. Policy #0 lag: (min: 0.0, avg: 13.5, max: 24.0)
[2023-02-25 13:24:07,186][2408954] Avg episode reward: [(0, '13.273')]
[2023-02-25 13:24:07,438][2409074] Updated weights for policy 0, policy_version 24041 (0.0013)
[2023-02-25 13:24:07,595][2409468] DAMAGECOUNT value on done: 7641.0
[2023-02-25 13:24:07,597][2409468] Sum rewards: 9.442, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.830', 'AMMO5': '0.032', 'AMMO2': '0.040', 'weapon7': '0.080', 'AMMO3': '0.126', 'weapon5': '0.172', 'AMMO4': '0.201', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.572', 'WEAPON5': '0.700', 'weapon4': '0.834', 'WEAPON3': '0.900', 'HITCOUNT': '1.040', 'weapon3': '1.852', 'DAMAGECOUNT': '4.533', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:24:08,513][2409373] Large shaping reward 3.651 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO2', -0.0001, -1.0), ('AMMO4', -0.0005, -1.0), ('weapon4', 0.002)]
[2023-02-25 13:24:09,266][2409074] Updated weights for policy 0, policy_version 24051 (0.0012)
[2023-02-25 13:24:09,674][2409565] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:24:10,507][2409547] DAMAGECOUNT value on done: 8320.0
[2023-02-25 13:24:10,508][2409547] Sum rewards: 9.722, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.014', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon7': '0.008', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'AMMO3': '0.089', 'weapon4': '0.096', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.118', 'WEAPON5': '0.150', 'WEAPON3': '0.500', 'HITCOUNT': '0.600', 'ARMOR': '1.330', 'weapon3': '1.442', 'weapon2': '2.050', 'DAMAGECOUNT': '2.460', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:24:10,641][2409080] DAMAGECOUNT value on done: 9459.0
[2023-02-25 13:24:10,643][2409080] Sum rewards: 11.887, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.844', 'weapon7': '0.008', 'AMMO5': '0.024', 'AMMO2': '0.038', 'AMMO3': '0.074', 'weapon4': '0.180', 'AMMO4': '0.189', 'WEAPON4': '0.200', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'weapon5': '0.364', 'WEAPON5': '0.550', 'WEAPON3': '0.550', 'ARMOR': '0.800', 'HITCOUNT': '0.800', 'weapon2': '1.402', 'weapon3': '1.660', 'DAMAGECOUNT': '3.492', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:24:10,806][2409074] Updated weights for policy 0, policy_version 24061 (0.0012)
[2023-02-25 13:24:11,454][2409597] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon2', 0.002)]
[2023-02-25 13:24:11,552][2409468] DAMAGECOUNT value on done: 10971.0
[2023-02-25 13:24:11,555][2409468] Sum rewards: 16.632, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.017', 'AMMO5': '0.012', 'AMMO2': '0.017', 'weapon7': '0.068', 'AMMO4': '0.083', 'AMMO3': '0.091', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.172', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.438', 'ARMOR': '0.448', 'WEAPON3': '0.600', 'weapon2': '0.766', 'HITCOUNT': '0.820', 'weapon3': '1.976', 'DAMAGECOUNT': '4.167', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:24:12,186][2408954] Fps is (10 sec: 25806.1, 60 sec: 25258.7, 300 sec: 24673.2). Total num frames: 98590720. Throughput: 0: 6267.2. Samples: 24647604. Policy #0 lag: (min: 0.0, avg: 12.4, max: 25.0)
[2023-02-25 13:24:12,186][2408954] Avg episode reward: [(0, '13.214')]
[2023-02-25 13:24:12,427][2409074] Updated weights for policy 0, policy_version 24071 (0.0012)
[2023-02-25 13:24:14,169][2409074] Updated weights for policy 0, policy_version 24081 (0.0012)
[2023-02-25 13:24:15,239][2409080] DAMAGECOUNT value on done: 9679.0
[2023-02-25 13:24:15,240][2409080] Sum rewards: 15.573, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.322', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'WEAPON5': '0.200', 'weapon4': '0.726', 'weapon2': '0.752', 'ARMOR': '0.914', 'WEAPON3': '0.950', 'HITCOUNT': '1.070', 'weapon3': '1.718', 'DAMAGECOUNT': '4.746', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:24:15,334][2409074] Updated weights for policy 0, policy_version 24091 (0.0012)
[2023-02-25 13:24:15,361][2409104] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 13:24:16,344][2409468] DAMAGECOUNT value on done: 6692.0
[2023-02-25 13:24:16,346][2409468] Sum rewards: 10.460, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.114', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO3': '0.077', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'weapon5': '0.246', 'WEAPON5': '0.400', 'weapon4': '0.568', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'ARMOR': '0.855', 'weapon2': '1.234', 'weapon3': '1.636', 'DAMAGECOUNT': '2.463', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:24:17,186][2408954] Fps is (10 sec: 24985.5, 60 sec: 25258.7, 300 sec: 24714.8). Total num frames: 98713600. Throughput: 0: 6257.1. Samples: 24685128. Policy #0 lag: (min: 0.0, avg: 12.4, max: 25.0)
[2023-02-25 13:24:17,186][2408954] Avg episode reward: [(0, '13.277')]
[2023-02-25 13:24:17,191][2409033] Saving /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000024100_98713600.pth...
[2023-02-25 13:24:17,287][2409033] Removing /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000022647_92762112.pth
[2023-02-25 13:24:17,451][2409074] Updated weights for policy 0, policy_version 24101 (0.0013)
[2023-02-25 13:24:18,820][2409074] Updated weights for policy 0, policy_version 24111 (0.0015)
[2023-02-25 13:24:19,353][2409080] DAMAGECOUNT value on done: 8366.0
[2023-02-25 13:24:19,354][2409080] Sum rewards: 15.062, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.612', 'AMMO2': '0.014', 'AMMO5': '0.022', 'AMMO3': '0.040', 'AMMO4': '0.067', 'weapon5': '0.136', 'weapon7': '0.176', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.710', 'weapon3': '0.918', 'ARMOR': '0.955', 'HITCOUNT': '1.060', 'weapon4': '1.136', 'DAMAGECOUNT': '4.200', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:24:20,350][2409468] DAMAGECOUNT value on done: 8828.0
[2023-02-25 13:24:20,351][2409468] Sum rewards: 10.328, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.190', 'AMMO2': '0.007', 'AMMO5': '0.017', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'weapon7': '0.062', 'AMMO3': '0.075', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.236', 'weapon4': '0.274', 'WEAPON5': '0.450', 'ARMOR': '0.452', 'WEAPON3': '0.500', 'HITCOUNT': '0.740', 'weapon2': '1.372', 'weapon3': '1.564', 'DAMAGECOUNT': '3.132', 'FRAGCOUNT': '6.500'}
[2023-02-25 13:24:20,821][2409074] Updated weights for policy 0, policy_version 24121 (0.0012)
[2023-02-25 13:24:21,413][2409549] Large shaping reward 2.592 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5760000000000001, 192.0), ('HEALTH', -0.015, -5.0), ('AMMO2', -0.0001, -1.0), ('AMMO4', -0.0005, -1.0), ('weapon4', 0.002)]
[2023-02-25 13:24:22,186][2408954] Fps is (10 sec: 24166.3, 60 sec: 24849.0, 300 sec: 24673.2). Total num frames: 98832384. Throughput: 0: 6266.4. Samples: 24703920. Policy #0 lag: (min: 0.0, avg: 12.4, max: 25.0)
[2023-02-25 13:24:22,186][2408954] Avg episode reward: [(0, '13.314')]
[2023-02-25 13:24:22,362][2409074] Updated weights for policy 0, policy_version 24131 (0.0013)
[2023-02-25 13:24:22,464][2409076] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO2', -0.0001, -1.0), ('AMMO4', -0.0005, -1.0), ('weapon4', 0.002)]
[2023-02-25 13:24:23,633][2409074] Updated weights for policy 0, policy_version 24141 (0.0012)
[2023-02-25 13:24:23,690][2409080] DAMAGECOUNT value on done: 7321.0
[2023-02-25 13:24:23,693][2409080] Sum rewards: 13.116, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.474', 'AMMO5': '0.019', 'weapon7': '0.024', 'AMMO2': '0.035', 'AMMO3': '0.086', 'weapon5': '0.118', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO4': '0.175', 'WEAPON7': '0.200', 'weapon4': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'ARMOR': '0.909', 'HITCOUNT': '1.160', 'weapon2': '1.238', 'weapon3': '1.736', 'DAMAGECOUNT': '3.939', 'FRAGCOUNT': '10.500'}
[2023-02-25 13:24:23,952][2409549] DAMAGECOUNT value on done: 8639.0
[2023-02-25 13:24:23,953][2409549] Sum rewards: 10.535, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'weapon4': '0.032', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'weapon5': '0.386', 'WEAPON5': '0.400', 'HEALTH': '0.444', 'ARMOR': '0.500', 'WEAPON3': '0.500', 'HITCOUNT': '0.780', 'weapon2': '1.428', 'weapon3': '1.624', 'DAMAGECOUNT': '3.240', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:24:24,489][2409547] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)]
[2023-02-25 13:24:24,647][2409468] DAMAGECOUNT value on done: 11056.0
[2023-02-25 13:24:24,649][2409468] Sum rewards: 16.747, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.054', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.027', 'WEAPON4': '0.050', 'weapon7': '0.074', 'AMMO3': '0.077', 'weapon4': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.362', 'WEAPON5': '0.600', 'WEAPON3': '0.600', 'HITCOUNT': '0.710', 'ARMOR': '1.256', 'weapon3': '1.412', 'weapon2': '1.746', 'DAMAGECOUNT': '4.005', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:24:25,704][2409097] Large shaping reward 2.584 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.552, 184.0), ('weapon7', 0.002)]
[2023-02-25 13:24:25,804][2409074] Updated weights for policy 0, policy_version 24151 (0.0012)
[2023-02-25 13:24:27,066][2409074] Updated weights for policy 0, policy_version 24161 (0.0013)
[2023-02-25 13:24:27,186][2408954] Fps is (10 sec: 25395.3, 60 sec: 25122.1, 300 sec: 24728.7). Total num frames: 98967552. Throughput: 0: 6250.6. Samples: 24741408. Policy #0 lag: (min: 0.0, avg: 11.5, max: 25.0)
[2023-02-25 13:24:27,186][2408954] Avg episode reward: [(0, '13.217')]
[2023-02-25 13:24:27,702][2409080] DAMAGECOUNT value on done: 9118.0
[2023-02-25 13:24:27,705][2409080] Sum rewards: 14.656, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.729', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.027', 'weapon4': '0.058', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.300', 'weapon5': '0.322', 'WEAPON3': '0.500', 'HITCOUNT': '0.910', 'weapon3': '1.552', 'weapon2': '1.682', 'DAMAGECOUNT': '3.609', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:24:27,881][2409549] DAMAGECOUNT value on done: 10591.0
[2023-02-25 13:24:27,882][2409549] Sum rewards: 13.151, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.130', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.010', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'weapon5': '0.172', 'weapon4': '0.232', 'WEAPON5': '0.350', 'WEAPON3': '0.900', 'HITCOUNT': '1.060', 'ARMOR': '1.374', 'weapon2': '1.540', 'weapon3': '1.672', 'DAMAGECOUNT': '4.203', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:24:28,689][2409468] DAMAGECOUNT value on done: 9860.0
[2023-02-25 13:24:28,690][2409468] Sum rewards: 7.902, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.047', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO3': '0.113', 'weapon5': '0.274', 'ARMOR': '0.447', 'WEAPON5': '0.450', 'HITCOUNT': '0.700', 'WEAPON3': '0.750', 'weapon3': '1.448', 'weapon2': '1.658', 'DAMAGECOUNT': '3.132', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:24:28,891][2409074] Updated weights for policy 0, policy_version 24171 (0.0012)
[2023-02-25 13:24:29,897][2409100] DAMAGECOUNT value on done: 9305.0
[2023-02-25 13:24:29,898][2409100] Sum rewards: 12.746, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.294', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.066', 'weapon5': '0.154', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'ARMOR': '0.452', 'HITCOUNT': '1.000', 'weapon3': '1.272', 'weapon2': '1.430', 'DAMAGECOUNT': '4.938', 'FRAGCOUNT': '7.500'}
[2023-02-25 13:24:30,296][2409074] Updated weights for policy 0, policy_version 24181 (0.0012)
[2023-02-25 13:24:30,468][2409096] Large shaping reward 2.575 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.543, 181.0), ('weapon7', 0.002)]
[2023-02-25 13:24:30,946][2409565] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0)]
[2023-02-25 13:24:30,997][2409077] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)]
[2023-02-25 13:24:31,616][2409549] DAMAGECOUNT value on done: 9249.0
[2023-02-25 13:24:31,620][2409549] Sum rewards: 24.407, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.329', 'AMMO5': '0.012', 'AMMO2': '0.050', 'AMMO3': '0.068', 'weapon7': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.152', 'WEAPON7': '0.200', 'AMMO4': '0.252', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.802', 'weapon3': '1.160', 'weapon4': '1.184', 'HITCOUNT': '1.200', 'DAMAGECOUNT': '5.643', 'FRAGCOUNT': '19.000'}
[2023-02-25 13:24:31,858][2409074] Updated weights for policy 0, policy_version 24191 (0.0012)
[2023-02-25 13:24:32,005][2409080] DAMAGECOUNT value on done: 9919.0
[2023-02-25 13:24:32,008][2409080] Sum rewards: 18.068, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.715', 'AMMO5': '0.012', 'AMMO2': '0.017', 'weapon7': '0.054', 'AMMO3': '0.061', 'weapon5': '0.072', 'AMMO4': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon2': '0.622', 'weapon4': '1.192', 'HITCOUNT': '1.210', 'weapon3': '1.458', 'DAMAGECOUNT': '4.860', 'FRAGCOUNT': '12.500'}
[2023-02-25 13:24:32,186][2408954] Fps is (10 sec: 25804.9, 60 sec: 25327.0, 300 sec: 24742.6). Total num frames: 99090432. Throughput: 0: 6256.8. Samples: 24779172. Policy #0 lag: (min: 0.0, avg: 11.5, max: 25.0)
[2023-02-25 13:24:32,186][2408954] Avg episode reward: [(0, '13.443')]
[2023-02-25 13:24:32,248][2409389] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:24:33,090][2409468] DAMAGECOUNT value on done: 7739.0
[2023-02-25 13:24:33,091][2409468] Sum rewards: 7.678, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.620', 'AMMO5': '0.005', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.035', 'AMMO3': '0.038', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.104', 'weapon7': '0.174', 'WEAPON5': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.420', 'weapon3': '0.548', 'ARMOR': '0.849', 'weapon2': '1.424', 'DAMAGECOUNT': '1.923', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:24:33,610][2409100] DAMAGECOUNT value on done: 8966.0
[2023-02-25 13:24:33,613][2409100] Sum rewards: 10.258, reward structure: {'DEATHCOUNT': '-4.500', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO3': '0.078', 'AMMO4': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon7': '0.156', 'weapon5': '0.170', 'WEAPON5': '0.250', 'HEALTH': '0.252', 'weapon4': '0.374', 'WEAPON3': '0.450', 'weapon2': '0.790', 'HITCOUNT': '0.800', 'weapon3': '1.276', 'DAMAGECOUNT': '2.625', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:24:33,699][2409074] Updated weights for policy 0, policy_version 24201 (0.0012)
[2023-02-25 13:24:34,865][2409355] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:24:35,322][2409074] Updated weights for policy 0, policy_version 24211 (0.0013)
[2023-02-25 13:24:35,463][2409549] DAMAGECOUNT value on done: 11322.0
[2023-02-25 13:24:35,464][2409549] Sum rewards: 15.396, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.815', 'WEAPON1': '0.020', 'AMMO5': '0.027', 'AMMO2': '0.044', 'AMMO3': '0.074', 'weapon7': '0.120', 'AMMO4': '0.218', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.254', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'weapon2': '0.742', 'ARMOR': '0.800', 'weapon4': '0.914', 'HITCOUNT': '1.060', 'weapon3': '1.564', 'DAMAGECOUNT': '6.234', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:24:35,697][2409102] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200.0), ('weapon7', 0.002)]
[2023-02-25 13:24:36,021][2409080] DAMAGECOUNT value on done: 8436.0
[2023-02-25 13:24:36,025][2409080] Sum rewards: 15.864, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.795', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.031', 'AMMO4': '0.053', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'weapon4': '0.204', 'weapon5': '0.238', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'ARMOR': '0.861', 'HITCOUNT': '1.070', 'weapon2': '1.180', 'weapon3': '1.848', 'DAMAGECOUNT': '5.004', 'FRAGCOUNT': '11.500'}
[2023-02-25 13:24:36,403][2409548] Large shaping reward 2.640 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200)]
[2023-02-25 13:24:37,065][2409468] DAMAGECOUNT value on done: 8101.0
[2023-02-25 13:24:37,066][2409468] Sum rewards: 13.662, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.130', 'AMMO2': '0.009', 'AMMO5': '0.012', 'weapon4': '0.022', 'AMMO4': '0.043', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'weapon7': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.236', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.770', 'ARMOR': '0.918', 'weapon2': '0.950', 'weapon3': '1.732', 'DAMAGECOUNT': '3.267', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:24:37,186][2408954] Fps is (10 sec: 23347.1, 60 sec: 24849.1, 300 sec: 24728.7). Total num frames: 99201024. Throughput: 0: 6243.2. Samples: 24797652. Policy #0 lag: (min: 0.0, avg: 11.5, max: 25.0)
[2023-02-25 13:24:37,187][2408954] Avg episode reward: [(0, '13.539')]
[2023-02-25 13:24:37,192][2409033] Saving new best policy, reward=13.539!
[2023-02-25 13:24:37,366][2409100] DAMAGECOUNT value on done: 8143.0
[2023-02-25 13:24:37,367][2409100] Sum rewards: 10.873, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO3': '0.040', 'AMMO4': '0.065', 'HEALTH': '0.070', 'weapon5': '0.114', 'weapon7': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.250', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.650', 'weapon3': '0.960', 'weapon2': '0.964', 'weapon4': '1.622', 'DAMAGECOUNT': '2.547', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:24:37,458][2409074] Updated weights for policy 0, policy_version 24221 (0.0012)
[2023-02-25 13:24:38,599][2409074] Updated weights for policy 0, policy_version 24231 (0.0012)
[2023-02-25 13:24:39,134][2409077] Large shaping reward 2.623 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.591, 197.0), ('weapon7', 0.002)]
[2023-02-25 13:24:39,286][2409549] DAMAGECOUNT value on done: 10391.0
[2023-02-25 13:24:39,287][2409549] Sum rewards: 9.450, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.855', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.029', 'AMMO3': '0.068', 'weapon7': '0.144', 'AMMO4': '0.147', 'weapon5': '0.188', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '0.570', 'weapon4': '0.584', 'weapon3': '0.752', 'weapon2': '0.776', 'ARMOR': '1.306', 'DAMAGECOUNT': '3.231', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:24:39,393][2409355] Large shaping reward 2.587 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.045, -15.0), ('weapon7', 0.002)]
[2023-02-25 13:24:39,973][2409074] Updated weights for policy 0, policy_version 24241 (0.0013)
[2023-02-25 13:24:40,004][2409080] DAMAGECOUNT value on done: 8423.0
[2023-02-25 13:24:40,007][2409080] Sum rewards: 8.965, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.704', 'AMMO2': '0.012', 'AMMO5': '0.012', 'weapon7': '0.052', 'AMMO4': '0.060', 'AMMO3': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.166', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.378', 'WEAPON3': '0.550', 'HITCOUNT': '0.740', 'ARMOR': '0.954', 'weapon2': '1.466', 'weapon3': '1.668', 'DAMAGECOUNT': '3.378', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:24:40,147][2409101] DAMAGECOUNT value on done: 8484.0
[2023-02-25 13:24:40,148][2409101] Sum rewards: 14.672, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.321', 'AMMO5': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.082', 'AMMO4': '0.085', 'weapon5': '0.088', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.302', 'WEAPON3': '0.600', 'ARMOR': '0.844', 'HITCOUNT': '1.050', 'weapon3': '1.308', 'weapon2': '1.604', 'DAMAGECOUNT': '3.780', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:24:40,381][2409104] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO2', -0.0001, -1.0), ('AMMO4', -0.0005, -1.0), ('weapon4', 0.002)]
[2023-02-25 13:24:41,264][2409468] DAMAGECOUNT value on done: 7400.0
[2023-02-25 13:24:41,266][2409468] Sum rewards: 6.135, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.387', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO3': '0.030', 'weapon7': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.300', 'weapon3': '0.768', 'weapon4': '1.108', 'weapon2': '1.156', 'DAMAGECOUNT': '1.371', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:24:41,409][2409100] DAMAGECOUNT value on done: 10349.0
[2023-02-25 13:24:41,413][2409100] Sum rewards: 20.814, reward structure: {'DEATHCOUNT': '-4.500', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.015', 'HEALTH': '0.025', 'AMMO3': '0.060', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'weapon5': '0.282', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'weapon4': '0.406', 'HITCOUNT': '0.980', 'weapon2': '1.028', 'weapon3': '1.426', 'DAMAGECOUNT': '6.159', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:24:42,056][2409074] Updated weights for policy 0, policy_version 24251 (0.0013)
[2023-02-25 13:24:42,186][2408954] Fps is (10 sec: 24576.2, 60 sec: 24849.0, 300 sec: 24770.4). Total num frames: 99336192. Throughput: 0: 6250.4. Samples: 24835332. Policy #0 lag: (min: 0.0, avg: 9.0, max: 24.0)
[2023-02-25 13:24:42,186][2408954] Avg episode reward: [(0, '13.254')]
[2023-02-25 13:24:42,942][2409103] DAMAGECOUNT value on done: 7584.0
[2023-02-25 13:24:42,945][2409103] Sum rewards: 10.603, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.210', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon7': '0.050', 'AMMO3': '0.056', 'weapon5': '0.090', 'AMMO4': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.700', 'weapon3': '0.972', 'weapon4': '1.038', 'weapon2': '1.160', 'DAMAGECOUNT': '2.643', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:24:43,126][2409549] DAMAGECOUNT value on done: 10769.0
[2023-02-25 13:24:43,127][2409549] Sum rewards: 12.906, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.575', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.066', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.113', 'WEAPON5': '0.150', 'AMMO4': '0.180', 'WEAPON4': '0.450', 'weapon4': '0.748', 'WEAPON3': '0.750', 'ARMOR': '0.852', 'weapon2': '1.128', 'HITCOUNT': '1.160', 'weapon3': '1.730', 'DAMAGECOUNT': '4.560', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:24:43,257][2409102] DAMAGECOUNT value on done: 11100.0
[2023-02-25 13:24:43,258][2409102] Sum rewards: 15.001, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.082', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'AMMO3': '0.076', 'weapon7': '0.110', 'weapon5': '0.138', 'AMMO4': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO6': '0.280', 'AMMO7': '0.280', 'weapon4': '0.292', 'WEAPON7': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.970', 'weapon3': '1.072', 'weapon2': '1.934', 'DAMAGECOUNT': '4.233', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:24:43,359][2409074] Updated weights for policy 0, policy_version 24261 (0.0012)
[2023-02-25 13:24:43,784][2409597] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:24:44,217][2409101] DAMAGECOUNT value on done: 10608.0
[2023-02-25 13:24:44,218][2409101] Sum rewards: 10.790, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.161', 'AMMO5': '0.020', 'AMMO2': '0.035', 'AMMO3': '0.086', 'weapon7': '0.086', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.100', 'weapon4': '0.126', 'WEAPON4': '0.150', 'AMMO4': '0.174', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'HITCOUNT': '0.890', 'weapon2': '1.396', 'weapon3': '1.894', 'DAMAGECOUNT': '3.594', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:24:44,428][2409080] DAMAGECOUNT value on done: 8527.0
[2023-02-25 13:24:44,432][2409080] Sum rewards: 9.751, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.232', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO3': '0.050', 'AMMO4': '0.051', 'weapon7': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.490', 'weapon3': '0.958', 'weapon4': '1.176', 'ARMOR': '1.247', 'weapon2': '1.474', 'DAMAGECOUNT': '1.839', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:24:44,997][2409100] DAMAGECOUNT value on done: 9494.0
[2023-02-25 13:24:45,000][2409100] Sum rewards: 18.567, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.002', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.044', 'AMMO3': '0.070', 'WEAPON5': '0.250', 'weapon5': '0.274', 'WEAPON3': '0.450', 'ARMOR': '0.524', 'HITCOUNT': '0.870', 'weapon3': '1.246', 'weapon2': '2.170', 'DAMAGECOUNT': '4.389', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:24:45,435][2409468] DAMAGECOUNT value on done: 10956.0
[2023-02-25 13:24:45,438][2409468] Sum rewards: 9.392, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.456', 'AMMO2': '0.011', 'AMMO5': '0.011', 'AMMO4': '0.053', 'weapon7': '0.054', 'AMMO3': '0.087', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.128', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'HITCOUNT': '0.520', 'WEAPON3': '0.600', 'weapon2': '0.830', 'weapon4': '1.158', 'ARMOR': '1.307', 'weapon3': '1.402', 'DAMAGECOUNT': '3.396', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:24:45,558][2409074] Updated weights for policy 0, policy_version 24271 (0.0012)
[2023-02-25 13:24:46,023][2409033] Signal inference workers to stop experience collection... (2950 times)
[2023-02-25 13:24:46,028][2409074] InferenceWorker_p0-w0: stopping experience collection (2950 times)
[2023-02-25 13:24:46,033][2409033] Signal inference workers to resume experience collection... (2950 times)
[2023-02-25 13:24:46,049][2409074] InferenceWorker_p0-w0: resuming experience collection (2950 times)
[2023-02-25 13:24:46,602][2409103] DAMAGECOUNT value on done: 11147.0
[2023-02-25 13:24:46,603][2409103] Sum rewards: 17.601, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.871', 'AMMO4': '-0.054', 'AMMO2': '-0.011', 'AMMO5': '0.007', 'AMMO3': '0.040', 'weapon7': '0.070', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.208', 'WEAPON3': '0.400', 'weapon2': '0.874', 'weapon3': '0.934', 'ARMOR': '0.953', 'HITCOUNT': '1.060', 'DAMAGECOUNT': '4.350', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:24:46,606][2409074] Updated weights for policy 0, policy_version 24281 (0.0012)
[2023-02-25 13:24:46,950][2409102] DAMAGECOUNT value on done: 9110.0
[2023-02-25 13:24:46,952][2409102] Sum rewards: 11.358, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.169', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.176', 'weapon4': '0.258', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.890', 'weapon3': '1.334', 'weapon2': '1.408', 'DAMAGECOUNT': '3.480', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:24:47,186][2408954] Fps is (10 sec: 26624.2, 60 sec: 25122.1, 300 sec: 24825.9). Total num frames: 99467264. Throughput: 0: 6252.3. Samples: 24872496. Policy #0 lag: (min: 0.0, avg: 9.0, max: 24.0)
[2023-02-25 13:24:47,187][2408954] Avg episode reward: [(0, '13.197')]
[2023-02-25 13:24:47,284][2409549] DAMAGECOUNT value on done: 9517.0
[2023-02-25 13:24:47,288][2409549] Sum rewards: 11.434, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.217', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO3': '0.052', 'weapon7': '0.070', 'AMMO4': '0.085', 'weapon5': '0.092', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.640', 'weapon2': '0.646', 'weapon3': '0.928', 'weapon4': '1.052', 'DAMAGECOUNT': '2.520', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:24:48,154][2409101] DAMAGECOUNT value on done: 10441.0
[2023-02-25 13:24:48,155][2409101] Sum rewards: 17.456, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.507', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'AMMO3': '0.066', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.112', 'weapon5': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'ARMOR': '0.456', 'weapon4': '0.662', 'weapon2': '0.952', 'HITCOUNT': '1.020', 'weapon3': '1.390', 'DAMAGECOUNT': '4.266', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:24:48,260][2409080] DAMAGECOUNT value on done: 9780.0
[2023-02-25 13:24:48,263][2409080] Sum rewards: 17.561, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.620', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.030', 'weapon7': '0.070', 'AMMO3': '0.077', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.142', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'weapon4': '0.502', 'HITCOUNT': '0.980', 'weapon3': '1.352', 'weapon2': '1.430', 'DAMAGECOUNT': '4.041', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:24:48,575][2409074] Updated weights for policy 0, policy_version 24291 (0.0012)
[2023-02-25 13:24:48,627][2409100] DAMAGECOUNT value on done: 8434.0
[2023-02-25 13:24:48,628][2409100] Sum rewards: 14.716, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.203', 'AMMO2': '0.006', 'AMMO5': '0.024', 'AMMO4': '0.030', 'AMMO3': '0.134', 'weapon5': '0.200', 'ARMOR': '0.400', 'WEAPON5': '0.650', 'WEAPON3': '0.850', 'HITCOUNT': '1.330', 'weapon2': '1.488', 'weapon3': '1.764', 'DAMAGECOUNT': '4.542', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:24:49,284][2409468] DAMAGECOUNT value on done: 8970.0
[2023-02-25 13:24:49,287][2409468] Sum rewards: 12.543, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.540', 'AMMO2': '0.016', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.078', 'AMMO3': '0.094', 'weapon5': '0.172', 'weapon7': '0.182', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'ARMOR': '0.450', 'weapon4': '0.456', 'WEAPON3': '0.700', 'weapon2': '0.954', 'HITCOUNT': '1.040', 'weapon3': '1.628', 'DAMAGECOUNT': '4.986', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:24:50,248][2409074] Updated weights for policy 0, policy_version 24301 (0.0013)
[2023-02-25 13:24:50,522][2409103] DAMAGECOUNT value on done: 7776.0
[2023-02-25 13:24:50,523][2409103] Sum rewards: 19.821, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.334', 'AMMO5': '0.015', 'AMMO2': '0.018', 'AMMO4': '0.092', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.128', 'weapon4': '0.282', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '1.260', 'weapon2': '1.300', 'weapon3': '1.850', 'DAMAGECOUNT': '4.410', 'FRAGCOUNT': '16.000'}
[2023-02-25 13:24:50,882][2409407] Large shaping reward 2.652 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5.0), ('DAMAGECOUNT', 0.6, 200), ('weapon2', 0.002)]
[2023-02-25 13:24:51,006][2409549] DAMAGECOUNT value on done: 8285.0
[2023-02-25 13:24:51,010][2409549] Sum rewards: 7.018, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.027', 'AMMO3': '0.059', 'weapon5': '0.068', 'HEALTH': '0.078', 'weapon7': '0.092', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'ARMOR': '0.450', 'HITCOUNT': '0.450', 'weapon2': '1.038', 'weapon3': '1.104', 'weapon4': '1.154', 'DAMAGECOUNT': '1.947', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:24:51,377][2409102] DAMAGECOUNT value on done: 10442.0
[2023-02-25 13:24:51,380][2409102] Sum rewards: 7.663, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.513', 'AMMO2': '0.004', 'AMMO5': '0.017', 'AMMO4': '0.022', 'AMMO3': '0.054', 'weapon5': '0.208', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.820', 'ARMOR': '0.835', 'weapon3': '1.072', 'weapon2': '2.400', 'FRAGCOUNT': '3.500', 'DAMAGECOUNT': '3.693'}
[2023-02-25 13:24:51,799][2409074] Updated weights for policy 0, policy_version 24311 (0.0013)
[2023-02-25 13:24:51,923][2409101] DAMAGECOUNT value on done: 9011.0
[2023-02-25 13:24:51,928][2409101] Sum rewards: 17.200, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.004', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.015', 'weapon7': '0.056', 'AMMO4': '0.060', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.154', 'WEAPON7': '0.200', 'weapon5': '0.214', 'WEAPON5': '0.400', 'ARMOR': '0.457', 'WEAPON3': '0.600', 'HITCOUNT': '0.990', 'weapon2': '1.404', 'weapon3': '1.656', 'DAMAGECOUNT': '4.551', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:24:52,186][2408954] Fps is (10 sec: 24985.4, 60 sec: 24985.6, 300 sec: 24742.6). Total num frames: 99586048. Throughput: 0: 6253.3. Samples: 24891240. Policy #0 lag: (min: 0.0, avg: 9.0, max: 24.0)
[2023-02-25 13:24:52,187][2408954] Avg episode reward: [(0, '13.247')]
[2023-02-25 13:24:52,195][2409080] DAMAGECOUNT value on done: 9734.0
[2023-02-25 13:24:52,196][2409080] Sum rewards: 24.710, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.230', 'AMMO2': '0.008', 'AMMO5': '0.026', 'AMMO4': '0.040', 'AMMO3': '0.097', 'weapon5': '0.148', 'WEAPON4': '0.200', 'weapon4': '0.388', 'ARMOR': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'weapon2': '1.010', 'HITCOUNT': '1.530', 'weapon3': '2.028', 'DAMAGECOUNT': '6.114', 'FRAGCOUNT': '21.000'}
[2023-02-25 13:24:52,311][2409100] DAMAGECOUNT value on done: 9772.0
[2023-02-25 13:24:52,314][2409100] Sum rewards: 14.078, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.964', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO4': '0.117', 'AMMO3': '0.140', 'weapon5': '0.140', 'WEAPON4': '0.200', 'weapon4': '0.306', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'weapon2': '1.220', 'HITCOUNT': '1.350', 'weapon3': '1.846', 'DAMAGECOUNT': '5.274', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:24:53,555][2409074] Updated weights for policy 0, policy_version 24321 (0.0012)
[2023-02-25 13:24:53,763][2409468] DAMAGECOUNT value on done: 7822.0
[2023-02-25 13:24:53,765][2409468] Sum rewards: 15.911, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.420', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.089', 'weapon4': '0.104', 'weapon5': '0.318', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.790', 'ARMOR': '1.059', 'weapon2': '1.268', 'weapon3': '1.622', 'DAMAGECOUNT': '3.948', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:24:54,343][2409103] DAMAGECOUNT value on done: 8620.0
[2023-02-25 13:24:54,347][2409103] Sum rewards: 14.183, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.021', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO5': '0.028', 'AMMO4': '0.055', 'AMMO3': '0.106', 'weapon7': '0.150', 'weapon5': '0.236', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'WEAPON7': '0.400', 'ARMOR': '0.445', 'weapon4': '0.502', 'WEAPON5': '0.650', 'HITCOUNT': '0.790', 'weapon2': '0.796', 'WEAPON3': '0.800', 'weapon3': '1.906', 'DAMAGECOUNT': '4.278', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:24:54,670][2409549] DAMAGECOUNT value on done: 8633.0
[2023-02-25 13:24:54,673][2409549] Sum rewards: 10.837, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.794', 'AMMO2': '0.017', 'AMMO5': '0.033', 'weapon4': '0.050', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon5': '0.238', 'WEAPON5': '0.700', 'ARMOR': '0.906', 'HITCOUNT': '1.090', 'WEAPON3': '1.150', 'weapon2': '1.204', 'weapon3': '2.138', 'DAMAGECOUNT': '4.446', 'FRAGCOUNT': '11.500'}
[2023-02-25 13:24:54,983][2409074] Updated weights for policy 0, policy_version 24331 (0.0012)
[2023-02-25 13:24:55,005][2409102] DAMAGECOUNT value on done: 9515.0
[2023-02-25 13:24:55,008][2409102] Sum rewards: 9.291, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.858', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO5': '0.029', 'weapon4': '0.058', 'AMMO3': '0.089', 'AMMO4': '0.112', 'WEAPON4': '0.200', 'weapon5': '0.556', 'WEAPON3': '0.600', 'WEAPON5': '0.600', 'HITCOUNT': '0.700', 'weapon2': '1.102', 'ARMOR': '1.305', 'weapon3': '1.640', 'DAMAGECOUNT': '3.615', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:24:55,605][2409101] DAMAGECOUNT value on done: 10541.0
[2023-02-25 13:24:55,607][2409101] Sum rewards: 11.912, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.468', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO5': '0.025', 'AMMO4': '0.062', 'AMMO3': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.102', 'weapon5': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'ARMOR': '0.456', 'weapon2': '0.478', 'WEAPON3': '0.650', 'weapon4': '0.666', 'HITCOUNT': '0.950', 'weapon3': '1.614', 'DAMAGECOUNT': '3.807', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:24:56,364][2409100] DAMAGECOUNT value on done: 9693.0
[2023-02-25 13:24:56,365][2409100] Sum rewards: 18.902, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.192', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon4': '0.032', 'WEAPON4': '0.050', 'weapon7': '0.052', 'AMMO4': '0.074', 'AMMO3': '0.075', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.128', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.830', 'weapon3': '1.516', 'weapon2': '1.836', 'DAMAGECOUNT': '5.223', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:24:56,577][2409080] DAMAGECOUNT value on done: 8787.0
[2023-02-25 13:24:56,582][2409080] Sum rewards: 19.172, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.355', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.022', 'AMMO3': '0.085', 'weapon5': '0.244', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '1.190', 'ARMOR': '1.332', 'weapon3': '1.684', 'weapon2': '1.708', 'DAMAGECOUNT': '5.331', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:24:56,660][2409074] Updated weights for policy 0, policy_version 24341 (0.0012)
[2023-02-25 13:24:57,186][2408954] Fps is (10 sec: 24166.4, 60 sec: 24985.6, 300 sec: 24784.3). Total num frames: 99708928. Throughput: 0: 6258.4. Samples: 24929232. Policy #0 lag: (min: 0.0, avg: 9.0, max: 24.0)
[2023-02-25 13:24:57,186][2408954] Avg episode reward: [(0, '13.631')]
[2023-02-25 13:24:57,191][2409033] Saving new best policy, reward=13.631!
[2023-02-25 13:24:57,627][2409468] DAMAGECOUNT value on done: 10104.0
[2023-02-25 13:24:57,630][2409468] Sum rewards: 15.977, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.020', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.022', 'WEAPON1': '0.040', 'weapon7': '0.060', 'AMMO3': '0.086', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.222', 'WEAPON5': '0.300', 'ARMOR': '0.447', 'WEAPON3': '0.600', 'HITCOUNT': '1.140', 'weapon2': '1.446', 'weapon3': '1.688', 'DAMAGECOUNT': '4.797', 'FRAGCOUNT': '11.500'}
[2023-02-25 13:24:58,117][2409074] Updated weights for policy 0, policy_version 24351 (0.0014)
[2023-02-25 13:24:58,218][2409103] DAMAGECOUNT value on done: 7940.0
[2023-02-25 13:24:58,219][2409103] Sum rewards: 8.535, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.354', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon7': '0.064', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.130', 'WEAPON7': '0.200', 'weapon5': '0.218', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.680', 'ARMOR': '0.887', 'weapon2': '1.292', 'weapon3': '1.714', 'DAMAGECOUNT': '3.303', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:24:58,606][2409549] DAMAGECOUNT value on done: 9060.0
[2023-02-25 13:24:58,607][2409549] Sum rewards: 6.134, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.897', 'AMMO4': '-0.064', 'AMMO2': '-0.013', 'AMMO5': '0.003', 'AMMO3': '0.049', 'weapon5': '0.076', 'weapon7': '0.098', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'ARMOR': '0.479', 'HITCOUNT': '0.580', 'weapon3': '0.814', 'weapon2': '1.282', 'DAMAGECOUNT': '2.037', 'FRAGCOUNT': '3.000'}
[2023-02-25 13:24:58,717][2409102] DAMAGECOUNT value on done: 9934.0
[2023-02-25 13:24:58,717][2409102] Sum rewards: 15.435, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.803', 'AMMO5': '0.005', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.037', 'AMMO3': '0.050', 'weapon5': '0.120', 'weapon7': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'HITCOUNT': '0.710', 'weapon4': '0.918', 'weapon2': '1.224', 'weapon3': '1.286', 'DAMAGECOUNT': '4.251', 'FRAGCOUNT': '10.000'}
[2023-02-25 13:24:59,550][2409101] DAMAGECOUNT value on done: 10578.0
[2023-02-25 13:24:59,554][2409101] Sum rewards: 20.823, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.688', 'weapon7': '0.004', 'AMMO2': '0.020', 'AMMO5': '0.024', 'AMMO4': '0.098', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.104', 'WEAPON4': '0.200', 'weapon2': '0.222', 'weapon5': '0.232', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'weapon4': '0.746', 'ARMOR': '0.846', 'HITCOUNT': '1.390', 'weapon3': '1.674', 'DAMAGECOUNT': '5.451', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:24:59,837][2409074] Updated weights for policy 0, policy_version 24361 (0.0012)
[2023-02-25 13:25:00,543][2409080] DAMAGECOUNT value on done: 8158.0
[2023-02-25 13:25:00,546][2409080] Sum rewards: 6.585, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.898', 'AMMO2': '0.002', 'AMMO5': '0.009', 'AMMO4': '0.010', 'WEAPON4': '0.050', 'AMMO3': '0.076', 'weapon5': '0.196', 'WEAPON5': '0.250', 'weapon4': '0.298', 'WEAPON3': '0.550', 'HITCOUNT': '0.600', 'ARMOR': '0.917', 'weapon2': '1.272', 'weapon3': '1.686', 'DAMAGECOUNT': '2.817', 'FRAGCOUNT': '4.000'}
[2023-02-25 13:25:00,625][2409100] DAMAGECOUNT value on done: 10625.0
[2023-02-25 13:25:00,629][2409100] Sum rewards: 17.767, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.536', 'AMMO2': '0.008', 'AMMO5': '0.014', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'AMMO3': '0.071', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.176', 'weapon4': '0.272', 'WEAPON5': '0.300', 'weapon5': '0.384', 'WEAPON3': '0.500', 'HITCOUNT': '0.940', 'weapon3': '1.230', 'ARMOR': '1.304', 'weapon2': '1.430', 'DAMAGECOUNT': '4.284', 'FRAGCOUNT': '11.500'}
[2023-02-25 13:25:01,489][2409485] Large shaping reward 3.642 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)]
[2023-02-25 13:25:01,658][2409074] Updated weights for policy 0, policy_version 24371 (0.0012)
[2023-02-25 13:25:01,721][2409468] DAMAGECOUNT value on done: 9727.0
[2023-02-25 13:25:01,722][2409468] Sum rewards: 8.610, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.690', 'AMMO2': '0.009', 'AMMO5': '0.019', 'AMMO4': '0.047', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'weapon7': '0.112', 'weapon5': '0.180', 'weapon4': '0.244', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON5': '0.350', 'WEAPON7': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.660', 'weapon2': '0.784', 'weapon3': '1.680', 'DAMAGECOUNT': '3.741', 'FRAGCOUNT': '5.500'}
[2023-02-25 13:25:02,186][2408954] Fps is (10 sec: 25395.2, 60 sec: 25122.3, 300 sec: 24853.7). Total num frames: 99840000. Throughput: 0: 6261.9. Samples: 24966912. Policy #0 lag: (min: 0.0, avg: 11.2, max: 25.0)
[2023-02-25 13:25:02,186][2408954] Avg episode reward: [(0, '13.638')]
[2023-02-25 13:25:02,188][2409033] Saving new best policy, reward=13.638!
[2023-02-25 13:25:02,318][2409549] DAMAGECOUNT value on done: 8151.0
[2023-02-25 13:25:02,319][2409549] Sum rewards: 14.851, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.490', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon7': '0.032', 'AMMO3': '0.093', 'AMMO4': '0.114', 'weapon5': '0.134', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon4': '0.598', 'weapon2': '0.680', 'WEAPON3': '0.700', 'HITCOUNT': '1.170', 'weapon3': '1.676', 'DAMAGECOUNT': '4.311', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:25:02,375][2409102] DAMAGECOUNT value on done: 10559.0
[2023-02-25 13:25:02,376][2409102] Sum rewards: 25.851, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.935', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'weapon7': '0.064', 'AMMO4': '0.085', 'AMMO3': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.312', 'weapon4': '0.410', 'WEAPON5': '0.600', 'WEAPON3': '0.650', 'weapon2': '0.862', 'ARMOR': '0.918', 'HITCOUNT': '1.200', 'weapon3': '1.780', 'DAMAGECOUNT': '6.417', 'FRAGCOUNT': '18.000'}
[2023-02-25 13:25:02,402][2409103] DAMAGECOUNT value on done: 8983.0
[2023-02-25 13:25:02,406][2409103] Sum rewards: 9.927, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.088', 'AMMO2': '0.009', 'AMMO5': '0.016', 'WEAPON1': '0.030', 'AMMO4': '0.043', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'weapon4': '0.142', 'weapon5': '0.260', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.790', 'weapon2': '1.266', 'weapon3': '1.944', 'DAMAGECOUNT': '3.966', 'FRAGCOUNT': '8.000'}
[2023-02-25 13:25:03,254][2409074] Updated weights for policy 0, policy_version 24381 (0.0013)
[2023-02-25 13:25:03,289][2409101] DAMAGECOUNT value on done: 8040.0
[2023-02-25 13:25:03,290][2409101] Sum rewards: 11.510, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.420', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.007', 'weapon5': '0.048', 'AMMO3': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon7': '0.222', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.730', 'weapon4': '0.766', 'weapon2': '0.950', 'weapon3': '1.112', 'DAMAGECOUNT': '2.655', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:25:04,319][2409549] Large shaping reward 2.650 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5.0), ('DAMAGECOUNT', 0.6, 200)]
[2023-02-25 13:25:04,636][2409100] DAMAGECOUNT value on done: 10544.0
[2023-02-25 13:25:04,638][2409100] Sum rewards: 21.552, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.082', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO3': '0.050', 'AMMO4': '0.126', 'weapon7': '0.212', 'weapon5': '0.226', 'WEAPON4': '0.250', 'WEAPON3': '0.300', 'weapon4': '0.334', 'WEAPON5': '0.350', 'AMMO6': '0.360', 'AMMO7': '0.360', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'HITCOUNT': '0.930', 'weapon3': '1.308', 'weapon2': '1.574', 'DAMAGECOUNT': '5.664', 'FRAGCOUNT': '14.000'}
[2023-02-25 13:25:04,807][2409080] DAMAGECOUNT value on done: 9932.0
[2023-02-25 13:25:04,810][2409080] Sum rewards: 11.130, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.868', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO3': '0.068', 'weapon7': '0.072', 'weapon4': '0.096', 'AMMO4': '0.105', 'weapon5': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.830', 'ARMOR': '0.848', 'weapon2': '1.298', 'weapon3': '1.330', 'DAMAGECOUNT': '2.808', 'FRAGCOUNT': '7.000'}
[2023-02-25 13:25:05,079][2409074] Updated weights for policy 0, policy_version 24391 (0.0012)
[2023-02-25 13:25:05,940][2409468] DAMAGECOUNT value on done: 8149.0
[2023-02-25 13:25:05,943][2409468] Sum rewards: 7.092, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.072', 'AMMO2': '0.012', 'AMMO5': '0.012', 'AMMO4': '0.057', 'AMMO3': '0.084', 'weapon5': '0.090', 'weapon7': '0.126', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HITCOUNT': '0.300', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.500', 'ARMOR': '0.800', 'weapon3': '1.040', 'weapon4': '1.048', 'weapon2': '1.188', 'DAMAGECOUNT': '1.716', 'FRAGCOUNT': '5.000'}
[2023-02-25 13:25:05,957][2409549] DAMAGECOUNT value on done: 7509.0
[2023-02-25 13:25:05,960][2409549] Sum rewards: 9.468, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.746', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO3': '0.066', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'weapon7': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.260', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'weapon4': '0.708', 'HITCOUNT': '0.770', 'ARMOR': '0.886', 'weapon2': '1.146', 'weapon3': '1.514', 'DAMAGECOUNT': '2.607', 'FRAGCOUNT': '6.000'}
[2023-02-25 13:25:05,995][2409102] DAMAGECOUNT value on done: 10209.0
[2023-02-25 13:25:06,000][2409102] Sum rewards: 19.864, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.016', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon7': '0.050', 'AMMO3': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.216', 'AMMO4': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.444', 'ARMOR': '0.455', 'WEAPON3': '0.500', 'HITCOUNT': '0.900', 'weapon2': '1.014', 'weapon3': '1.666', 'DAMAGECOUNT': '4.320', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:25:06,165][2409103] DAMAGECOUNT value on done: 9637.0
[2023-02-25 13:25:06,166][2409103] Sum rewards: 22.011, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.012', 'HEALTH': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.059', 'AMMO3': '0.074', 'weapon7': '0.134', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.500', 'weapon4': '0.636', 'HITCOUNT': '1.160', 'weapon3': '1.310', 'weapon2': '1.594', 'ARMOR': '1.712', 'DAMAGECOUNT': '6.048', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:25:06,281][2409074] Updated weights for policy 0, policy_version 24401 (0.0012)
[2023-02-25 13:25:06,702][2409373] Large shaping reward 3.640 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200)]
[2023-02-25 13:25:07,186][2408954] Fps is (10 sec: 24985.6, 60 sec: 24917.3, 300 sec: 24812.1). Total num frames: 99958784. Throughput: 0: 6260.0. Samples: 24985620. Policy #0 lag: (min: 0.0, avg: 11.2, max: 25.0)
[2023-02-25 13:25:07,186][2408954] Avg episode reward: [(0, '13.794')]
[2023-02-25 13:25:07,214][2409101] DAMAGECOUNT value on done: 7956.0
[2023-02-25 13:25:07,216][2409033] Saving new best policy, reward=13.794!
[2023-02-25 13:25:07,217][2409101] Sum rewards: 15.220, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.025', 'AMMO2': '0.004', 'AMMO4': '0.018', 'AMMO5': '0.019', 'WEAPON4': '0.050', 'AMMO3': '0.067', 'weapon4': '0.218', 'weapon5': '0.252', 'WEAPON3': '0.500', 'WEAPON5': '0.500', 'ARMOR': '0.903', 'HITCOUNT': '0.990', 'weapon3': '1.276', 'weapon2': '1.732', 'DAMAGECOUNT': '3.966', 'FRAGCOUNT': '11.000'}
[2023-02-25 13:25:07,810][2409565] DAMAGECOUNT value on done: 9775.0
[2023-02-25 13:25:07,813][2409565] Sum rewards: 14.293, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.018', 'AMMO2': '0.033', 'AMMO3': '0.080', 'WEAPON4': '0.150', 'AMMO4': '0.163', 'weapon5': '0.362', 'HEALTH': '0.392', 'weapon4': '0.438', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'weapon2': '0.884', 'HITCOUNT': '1.000', 'ARMOR': '1.299', 'weapon3': '1.884', 'DAMAGECOUNT': '3.540', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:25:08,002][2409074] Updated weights for policy 0, policy_version 24411 (0.0012)
[2023-02-25 13:25:08,833][2409100] DAMAGECOUNT value on done: 9686.0
[2023-02-25 13:25:08,854][2409100] Sum rewards: 14.772, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.150', 'AMMO2': '0.007', 'weapon4': '0.018', 'WEAPON1': '0.020', 'AMMO5': '0.027', 'AMMO4': '0.035', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'weapon5': '0.176', 'WEAPON5': '0.700', 'WEAPON3': '0.900', 'HITCOUNT': '1.190', 'weapon2': '1.280', 'weapon3': '1.950', 'DAMAGECOUNT': '5.649', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:25:08,891][2409080] DAMAGECOUNT value on done: 8805.0
[2023-02-25 13:25:08,893][2409080] Sum rewards: 21.972, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.235', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon7': '0.052', 'AMMO3': '0.062', 'weapon5': '0.078', 'AMMO4': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'ARMOR': '0.461', 'HITCOUNT': '0.900', 'weapon2': '0.902', 'weapon4': '1.142', 'weapon3': '1.286', 'DAMAGECOUNT': '4.635', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:25:08,995][2409485] DAMAGECOUNT value on done: 8666.0
[2023-02-25 13:25:08,996][2409485] Sum rewards: 9.249, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.606', 'AMMO5': '0.024', 'AMMO2': '0.033', 'weapon7': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.136', 'AMMO4': '0.164', 'WEAPON4': '0.300', 'weapon5': '0.310', 'weapon4': '0.440', 'WEAPON5': '0.550', 'HITCOUNT': '0.580', 'ARMOR': '0.844', 'WEAPON3': '0.900', 'weapon2': '1.040', 'weapon3': '1.480', 'DAMAGECOUNT': '2.910', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:25:09,078][2408954] Component Batcher_0 stopped!
[2023-02-25 13:25:09,078][2409033] Stopping Batcher_0...
[2023-02-25 13:25:09,079][2409033] Loop batcher_evt_loop terminating...
[2023-02-25 13:25:09,079][2409033] Saving /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000024416_100007936.pth...
[2023-02-25 13:25:09,092][2409097] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)]
[2023-02-25 13:25:09,128][2409074] Weights refcount: 2 0
[2023-02-25 13:25:09,129][2409074] Stopping InferenceWorker_p0-w0...
[2023-02-25 13:25:09,130][2408954] Component InferenceWorker_p0-w0 stopped!
[2023-02-25 13:25:09,131][2409074] Loop inference_proc0-0_evt_loop terminating...
[2023-02-25 13:25:09,178][2409033] Removing /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000023366_95707136.pth
[2023-02-25 13:25:09,185][2409033] Saving new best policy, reward=13.928!
[2023-02-25 13:25:09,283][2409078] Stopping RolloutWorker_w2...
[2023-02-25 13:25:09,284][2408954] Component RolloutWorker_w2 stopped!
[2023-02-25 13:25:09,285][2409078] Loop rollout_proc2_evt_loop terminating...
[2023-02-25 13:25:09,288][2409866] Stopping RolloutWorker_w31...
[2023-02-25 13:25:09,289][2409866] Loop rollout_proc31_evt_loop terminating...
[2023-02-25 13:25:09,289][2409389] Stopping RolloutWorker_w17...
[2023-02-25 13:25:09,289][2409389] Loop rollout_proc17_evt_loop terminating...
[2023-02-25 13:25:09,291][2408954] Component RolloutWorker_w31 stopped!
[2023-02-25 13:25:09,291][2408954] Component RolloutWorker_w17 stopped!
[2023-02-25 13:25:09,294][2409033] Saving /home/sebas/research/hugging-face-course/vizdoom/train_dir/default_experiment/checkpoint_p0/checkpoint_000024416_100007936.pth...
[2023-02-25 13:25:09,296][2409596] Stopping RolloutWorker_w29...
[2023-02-25 13:25:09,296][2409102] Stopping RolloutWorker_w12...
[2023-02-25 13:25:09,296][2409596] Loop rollout_proc29_evt_loop terminating...
[2023-02-25 13:25:09,296][2409102] Loop rollout_proc12_evt_loop terminating...
[2023-02-25 13:25:09,297][2408954] Component RolloutWorker_w29 stopped!
[2023-02-25 13:25:09,297][2409097] Stopping RolloutWorker_w9...
[2023-02-25 13:25:09,297][2408954] Component RolloutWorker_w12 stopped!
[2023-02-25 13:25:09,297][2409097] Loop rollout_proc9_evt_loop terminating...
[2023-02-25 13:25:09,298][2408954] Component RolloutWorker_w9 stopped!
[2023-02-25 13:25:09,300][2409079] Stopping RolloutWorker_w4...
[2023-02-25 13:25:09,301][2409079] Loop rollout_proc4_evt_loop terminating...
[2023-02-25 13:25:09,301][2409104] Stopping RolloutWorker_w13...
[2023-02-25 13:25:09,302][2409104] Loop rollout_proc13_evt_loop terminating...
[2023-02-25 13:25:09,301][2408954] Component RolloutWorker_w4 stopped!
[2023-02-25 13:25:09,302][2409549] Stopping RolloutWorker_w26...
[2023-02-25 13:25:09,303][2409549] Loop rollout_proc26_evt_loop terminating...
[2023-02-25 13:25:09,303][2409547] Stopping RolloutWorker_w25...
[2023-02-25 13:25:09,303][2408954] Component RolloutWorker_w13 stopped!
[2023-02-25 13:25:09,303][2409547] Loop rollout_proc25_evt_loop terminating...
[2023-02-25 13:25:09,303][2408954] Component RolloutWorker_w26 stopped!
[2023-02-25 13:25:09,304][2408954] Component RolloutWorker_w25 stopped!
[2023-02-25 13:25:09,306][2409103] Stopping RolloutWorker_w8...
[2023-02-25 13:25:09,307][2409075] Stopping RolloutWorker_w1...
[2023-02-25 13:25:09,307][2408954] Component RolloutWorker_w8 stopped!
[2023-02-25 13:25:09,307][2409103] Loop rollout_proc8_evt_loop terminating...
[2023-02-25 13:25:09,307][2409075] Loop rollout_proc1_evt_loop terminating...
[2023-02-25 13:25:09,307][2408954] Component RolloutWorker_w1 stopped!
[2023-02-25 13:25:09,307][2409355] Stopping RolloutWorker_w15...
[2023-02-25 13:25:09,308][2409355] Loop rollout_proc15_evt_loop terminating...
[2023-02-25 13:25:09,308][2408954] Component RolloutWorker_w15 stopped!
[2023-02-25 13:25:09,312][2409565] Stopping RolloutWorker_w28...
[2023-02-25 13:25:09,312][2408954] Component RolloutWorker_w28 stopped!
[2023-02-25 13:25:09,313][2409565] Loop rollout_proc28_evt_loop terminating...
[2023-02-25 13:25:09,314][2409101] Stopping RolloutWorker_w10...
[2023-02-25 13:25:09,314][2408954] Component RolloutWorker_w10 stopped!
[2023-02-25 13:25:09,314][2409099] Stopping RolloutWorker_w7...
[2023-02-25 13:25:09,314][2408954] Component RolloutWorker_w7 stopped!
[2023-02-25 13:25:09,314][2409099] Loop rollout_proc7_evt_loop terminating...
[2023-02-25 13:25:09,315][2409101] Loop rollout_proc10_evt_loop terminating...
[2023-02-25 13:25:09,318][2409405] Stopping RolloutWorker_w18...
[2023-02-25 13:25:09,319][2408954] Component RolloutWorker_w18 stopped!
[2023-02-25 13:25:09,319][2409405] Loop rollout_proc18_evt_loop terminating...
[2023-02-25 13:25:09,322][2409407] Stopping RolloutWorker_w20...
[2023-02-25 13:25:09,322][2409485] Stopping RolloutWorker_w24...
[2023-02-25 13:25:09,322][2408954] Component RolloutWorker_w20 stopped!
[2023-02-25 13:25:09,323][2409485] Loop rollout_proc24_evt_loop terminating...
[2023-02-25 13:25:09,323][2408954] Component RolloutWorker_w24 stopped!
[2023-02-25 13:25:09,323][2409407] Loop rollout_proc20_evt_loop terminating...
[2023-02-25 13:25:09,326][2409486] Stopping RolloutWorker_w23...
[2023-02-25 13:25:09,326][2408954] Component RolloutWorker_w23 stopped!
[2023-02-25 13:25:09,327][2409486] Loop rollout_proc23_evt_loop terminating...
[2023-02-25 13:25:09,347][2409080] Stopping RolloutWorker_w5...
[2023-02-25 13:25:09,347][2408954] Component RolloutWorker_w5 stopped!
[2023-02-25 13:25:09,347][2409080] Loop rollout_proc5_evt_loop terminating...
[2023-02-25 13:25:09,359][2409468] Stopping RolloutWorker_w21...
[2023-02-25 13:25:09,359][2408954] Component RolloutWorker_w21 stopped!
[2023-02-25 13:25:09,359][2409468] Loop rollout_proc21_evt_loop terminating...
[2023-02-25 13:25:09,367][2409373] Stopping RolloutWorker_w16...
[2023-02-25 13:25:09,367][2408954] Component RolloutWorker_w16 stopped!
[2023-02-25 13:25:09,368][2409373] Loop rollout_proc16_evt_loop terminating...
[2023-02-25 13:25:09,384][2409406] Stopping RolloutWorker_w19...
[2023-02-25 13:25:09,384][2408954] Component RolloutWorker_w19 stopped!
[2023-02-25 13:25:09,385][2409406] Loop rollout_proc19_evt_loop terminating...
[2023-02-25 13:25:09,391][2408954] Component RolloutWorker_w3 stopped!
[2023-02-25 13:25:09,391][2409077] Stopping RolloutWorker_w3...
[2023-02-25 13:25:09,392][2409077] Loop rollout_proc3_evt_loop terminating...
[2023-02-25 13:25:09,394][2408954] Component RolloutWorker_w0 stopped!
[2023-02-25 13:25:09,394][2409076] Stopping RolloutWorker_w0...
[2023-02-25 13:25:09,395][2409076] Loop rollout_proc0_evt_loop terminating...
[2023-02-25 13:25:09,404][2408954] Component RolloutWorker_w14 stopped!
[2023-02-25 13:25:09,404][2409105] Stopping RolloutWorker_w14...
[2023-02-25 13:25:09,405][2409105] Loop rollout_proc14_evt_loop terminating...
[2023-02-25 13:25:09,422][2409597] Stopping RolloutWorker_w30...
[2023-02-25 13:25:09,422][2408954] Component RolloutWorker_w30 stopped!
[2023-02-25 13:25:09,422][2409597] Loop rollout_proc30_evt_loop terminating...
[2023-02-25 13:25:09,456][2409033] Stopping LearnerWorker_p0...
[2023-02-25 13:25:09,456][2408954] Component LearnerWorker_p0 stopped!
[2023-02-25 13:25:09,456][2409033] Loop learner_proc0_evt_loop terminating...
[2023-02-25 13:25:09,525][2409548] Stopping RolloutWorker_w27...
[2023-02-25 13:25:09,526][2408954] Component RolloutWorker_w27 stopped!
[2023-02-25 13:25:09,526][2409548] Loop rollout_proc27_evt_loop terminating...
[2023-02-25 13:25:09,539][2408954] Component RolloutWorker_w11 stopped!
[2023-02-25 13:25:09,539][2409100] Stopping RolloutWorker_w11...
[2023-02-25 13:25:09,540][2409100] Loop rollout_proc11_evt_loop terminating...
[2023-02-25 13:25:09,695][2408954] Component RolloutWorker_w6 stopped!
[2023-02-25 13:25:09,695][2409096] Stopping RolloutWorker_w6...
[2023-02-25 13:25:09,696][2409096] Loop rollout_proc6_evt_loop terminating...
[2023-02-25 13:25:09,755][2408954] Component RolloutWorker_w22 stopped!
[2023-02-25 13:25:09,756][2408954] Waiting for process learner_proc0 to stop...
[2023-02-25 13:25:09,755][2409469] Stopping RolloutWorker_w22...
[2023-02-25 13:25:09,757][2409469] Loop rollout_proc22_evt_loop terminating...
[2023-02-25 13:25:11,012][2408954] Waiting for process inference_proc0-0 to join...
[2023-02-25 13:25:11,012][2408954] Waiting for process rollout_proc0 to join...
[2023-02-25 13:25:11,013][2408954] Waiting for process rollout_proc1 to join...
[2023-02-25 13:25:11,013][2408954] Waiting for process rollout_proc2 to join...
[2023-02-25 13:25:11,013][2408954] Waiting for process rollout_proc3 to join...
[2023-02-25 13:25:11,097][2408954] Waiting for process rollout_proc4 to join...
[2023-02-25 13:25:11,098][2408954] Waiting for process rollout_proc5 to join...
[2023-02-25 13:25:11,098][2408954] Waiting for process rollout_proc6 to join...
[2023-02-25 13:25:11,181][2408954] Waiting for process rollout_proc7 to join...
[2023-02-25 13:25:11,181][2408954] Waiting for process rollout_proc8 to join...
[2023-02-25 13:25:11,182][2408954] Waiting for process rollout_proc9 to join...
[2023-02-25 13:25:11,182][2408954] Waiting for process rollout_proc10 to join...
[2023-02-25 13:25:11,182][2408954] Waiting for process rollout_proc11 to join...
[2023-02-25 13:25:11,182][2408954] Waiting for process rollout_proc12 to join...
[2023-02-25 13:25:11,182][2408954] Waiting for process rollout_proc13 to join...
[2023-02-25 13:25:11,183][2408954] Waiting for process rollout_proc14 to join...
[2023-02-25 13:25:11,183][2408954] Waiting for process rollout_proc15 to join...
[2023-02-25 13:25:11,183][2408954] Waiting for process rollout_proc16 to join...
[2023-02-25 13:25:11,183][2408954] Waiting for process rollout_proc17 to join...
[2023-02-25 13:25:11,183][2408954] Waiting for process rollout_proc18 to join...
[2023-02-25 13:25:11,183][2408954] Waiting for process rollout_proc19 to join...
[2023-02-25 13:25:11,184][2408954] Waiting for process rollout_proc20 to join...
[2023-02-25 13:25:11,184][2408954] Waiting for process rollout_proc21 to join...
[2023-02-25 13:25:11,184][2408954] Waiting for process rollout_proc22 to join...
[2023-02-25 13:25:11,184][2408954] Waiting for process rollout_proc23 to join...
[2023-02-25 13:25:11,184][2408954] Waiting for process rollout_proc24 to join...
[2023-02-25 13:25:11,185][2408954] Waiting for process rollout_proc25 to join...
[2023-02-25 13:25:11,185][2408954] Waiting for process rollout_proc26 to join...
[2023-02-25 13:25:11,185][2408954] Waiting for process rollout_proc27 to join...
[2023-02-25 13:25:11,185][2408954] Waiting for process rollout_proc28 to join...
[2023-02-25 13:25:11,185][2408954] Waiting for process rollout_proc29 to join...
[2023-02-25 13:25:11,185][2408954] Waiting for process rollout_proc30 to join...
[2023-02-25 13:25:11,186][2408954] Waiting for process rollout_proc31 to join...
[2023-02-25 13:25:11,186][2408954] Batcher 0 profile tree view:
batching: 497.5253, releasing_batches: 8.4162
[2023-02-25 13:25:11,186][2408954] InferenceWorker_p0-w0 profile tree view:
wait_policy: 0.0025
  wait_policy_total: 2403.2129
update_model: 45.0170
  weight_update: 0.0012
one_step: 0.0064
  handle_policy_step: 1470.8096
    deserialize: 222.5112, stack: 8.8120, obs_to_device_normalize: 511.3429, forward: 447.5288, send_messages: 60.7587
    prepare_outputs: 175.9737
      to_cpu: 81.5942
[2023-02-25 13:25:11,186][2408954] Learner 0 profile tree view:
misc: 0.1020, prepare_batch: 177.1861
train: 641.1576
  epoch_init: 0.1520, minibatch_init: 0.1475, losses_postprocess: 6.6601, kl_divergence: 26.8023, after_optimizer: 68.6295
  calculate_losses: 264.1850
    losses_init: 0.0734, forward_head: 22.1123, bptt_initial: 92.9154, tail: 39.6988, advantages_returns: 4.7631, losses: 64.7610
    bptt: 34.4026
      bptt_forward_core: 33.0090
  update: 260.2037
    clip: 32.6253
[2023-02-25 13:25:11,186][2408954] RolloutWorker_w0 profile tree view:
wait_for_trajectories: 0.8357, enqueue_policy_requests: 62.1907, env_step: 3676.2636, overhead: 98.9969, complete_rollouts: 4.5943
save_policy_outputs: 48.8725
  split_output_tensors: 22.1230
[2023-02-25 13:25:11,187][2408954] RolloutWorker_w31 profile tree view:
wait_for_trajectories: 0.6644, enqueue_policy_requests: 60.8506, env_step: 3680.9570, overhead: 96.1682, complete_rollouts: 5.1203
save_policy_outputs: 47.7324
  split_output_tensors: 21.8927
[2023-02-25 13:25:11,187][2408954] Loop Runner_EvtLoop terminating...
[2023-02-25 13:25:11,187][2408954] Runner profile tree view:
main_loop: 4011.9160
[2023-02-25 13:25:11,187][2408954] Collected {0: 100007936}, FPS: 24927.7
[2023-02-25 13:25:11,192][2408954] Loading existing experiment configuration from train_dir/default_experiment/config.json
[2023-02-25 13:25:11,193][2408954] Overriding arg 'train_dir' with value 'train_dir' passed from command line
[2023-02-25 13:25:11,193][2408954] Adding new argument 'no_render'=True that is not in the saved config file!
[2023-02-25 13:25:11,193][2408954] Adding new argument 'save_video'=True that is not in the saved config file!
[2023-02-25 13:25:11,193][2408954] Adding new argument 'video_frames'=1000000000.0 that is not in the saved config file!
[2023-02-25 13:25:11,193][2408954] Adding new argument 'video_name'=None that is not in the saved config file!
[2023-02-25 13:25:11,193][2408954] Adding new argument 'max_num_frames'=1000000000.0 that is not in the saved config file!
[2023-02-25 13:25:11,193][2408954] Adding new argument 'max_num_episodes'=10 that is not in the saved config file!
[2023-02-25 13:25:11,193][2408954] Adding new argument 'push_to_hub'=True that is not in the saved config file!
[2023-02-25 13:25:11,194][2408954] Adding new argument 'hf_repository'='eldraco/rl_course_vizdoom_health_gathering_supreme' that is not in the saved config file!
[2023-02-25 13:25:11,194][2408954] Adding new argument 'policy_index'=0 that is not in the saved config file!
[2023-02-25 13:25:11,194][2408954] Adding new argument 'eval_deterministic'=False that is not in the saved config file!
[2023-02-25 13:25:11,194][2408954] Adding new argument 'train_script'=None that is not in the saved config file!
[2023-02-25 13:25:11,194][2408954] Adding new argument 'enjoy_script'=None that is not in the saved config file!
[2023-02-25 13:25:11,194][2408954] Using frameskip 1 and render_action_repeat=4 for evaluation
[2023-02-25 13:25:11,200][2408954] Doom resolution: 160x120, resize resolution: (128, 72)
[2023-02-25 13:25:11,201][2408954] Port 40300 is available
[2023-02-25 13:25:11,201][2408954] Using port 40300
[2023-02-25 13:25:11,201][2408954] RunningMeanStd input shape: (23,)
[2023-02-25 13:25:11,202][2408954] RunningMeanStd input shape: (3, 72, 128)
[2023-02-25 13:25:11,202][2408954] RunningMeanStd input shape: (1,)
[2023-02-25 13:25:11,209][2408954] ConvEncoder: input_channels=3
[2023-02-25 13:25:11,320][2408954] Conv encoder output size: 512
[2023-02-25 13:25:11,320][2408954] Policy head output size: 512
[2023-02-25 13:25:12,699][2408954] Loading state from checkpoint train_dir/default_experiment/checkpoint_p0/checkpoint_000024416_100007936.pth...
[2023-02-25 13:25:12,717][2408954] Using port 40300 on host...
[2023-02-25 13:25:12,945][2408954] Initialized w:0 v:0 player:0
[2023-02-25 13:25:13,445][2408954] Num frames 100...
[2023-02-25 13:25:13,537][2408954] Num frames 200...
[2023-02-25 13:25:13,635][2408954] Num frames 300...
[2023-02-25 13:25:13,736][2408954] Num frames 400...
[2023-02-25 13:25:13,838][2408954] Num frames 500...
[2023-02-25 13:25:13,936][2408954] Num frames 600...
[2023-02-25 13:25:14,037][2408954] Num frames 700...
[2023-02-25 13:25:14,139][2408954] Num frames 800...
[2023-02-25 13:25:14,240][2408954] Num frames 900...
[2023-02-25 13:25:14,340][2408954] Num frames 1000...
[2023-02-25 13:25:14,440][2408954] Num frames 1100...
[2023-02-25 13:25:14,541][2408954] Num frames 1200...
[2023-02-25 13:25:14,641][2408954] Num frames 1300...
[2023-02-25 13:25:14,741][2408954] Num frames 1400...
[2023-02-25 13:25:14,840][2408954] Num frames 1500...
[2023-02-25 13:25:14,941][2408954] Num frames 1600...
[2023-02-25 13:25:15,041][2408954] Num frames 1700...
[2023-02-25 13:25:15,140][2408954] Num frames 1800...
[2023-02-25 13:25:15,248][2408954] Num frames 1900...
[2023-02-25 13:25:15,354][2408954] Num frames 2000...
[2023-02-25 13:25:15,455][2408954] Num frames 2100...
[2023-02-25 13:25:15,551][2408954] Num frames 2200...
[2023-02-25 13:25:15,645][2408954] Num frames 2300...
[2023-02-25 13:25:15,742][2408954] Num frames 2400...
[2023-02-25 13:25:15,843][2408954] Num frames 2500...
[2023-02-25 13:25:15,942][2408954] Num frames 2600...
[2023-02-25 13:25:16,046][2408954] Num frames 2700...
[2023-02-25 13:25:16,154][2408954] Num frames 2800...
[2023-02-25 13:25:16,258][2408954] Num frames 2900...
[2023-02-25 13:25:16,356][2408954] Num frames 3000...
[2023-02-25 13:25:16,453][2408954] Num frames 3100...
[2023-02-25 13:25:16,560][2408954] Num frames 3200...
[2023-02-25 13:25:16,663][2408954] Num frames 3300...
[2023-02-25 13:25:16,762][2408954] Num frames 3400...
[2023-02-25 13:25:16,863][2408954] Num frames 3500...
[2023-02-25 13:25:16,970][2408954] Num frames 3600...
[2023-02-25 13:25:17,071][2408954] Num frames 3700...
[2023-02-25 13:25:17,169][2408954] Num frames 3800...
[2023-02-25 13:25:17,267][2408954] Num frames 3900...
[2023-02-25 13:25:17,374][2408954] Num frames 4000...
[2023-02-25 13:25:17,476][2408954] Num frames 4100...
[2023-02-25 13:25:17,572][2408954] Num frames 4200...
[2023-02-25 13:25:17,671][2408954] Num frames 4300...
[2023-02-25 13:25:17,775][2408954] Num frames 4400...
[2023-02-25 13:25:17,876][2408954] Num frames 4500...
[2023-02-25 13:25:17,976][2408954] Num frames 4600...
[2023-02-25 13:25:18,077][2408954] Num frames 4700...
[2023-02-25 13:25:18,176][2408954] Num frames 4800...
[2023-02-25 13:25:18,279][2408954] Num frames 4900...
[2023-02-25 13:25:18,381][2408954] Num frames 5000...
[2023-02-25 13:25:18,480][2408954] Num frames 5100...
[2023-02-25 13:25:18,581][2408954] Num frames 5200...
[2023-02-25 13:25:18,685][2408954] Num frames 5300...
[2023-02-25 13:25:18,784][2408954] Num frames 5400...
[2023-02-25 13:25:18,885][2408954] Num frames 5500...
[2023-02-25 13:25:18,987][2408954] Num frames 5600...
[2023-02-25 13:25:19,089][2408954] Num frames 5700...
[2023-02-25 13:25:19,194][2408954] Num frames 5800...
[2023-02-25 13:25:19,295][2408954] Num frames 5900...
[2023-02-25 13:25:19,396][2408954] Num frames 6000...
[2023-02-25 13:25:19,495][2408954] Num frames 6100...
[2023-02-25 13:25:19,595][2408954] Num frames 6200...
[2023-02-25 13:25:19,696][2408954] Num frames 6300...
[2023-02-25 13:25:19,820][2408954] Num frames 6400...
[2023-02-25 13:25:19,921][2408954] Num frames 6500...
[2023-02-25 13:25:20,020][2408954] Num frames 6600...
[2023-02-25 13:25:20,124][2408954] Num frames 6700...
[2023-02-25 13:25:20,225][2408954] Num frames 6800...
[2023-02-25 13:25:20,328][2408954] Num frames 6900...
[2023-02-25 13:25:20,426][2408954] Num frames 7000...
[2023-02-25 13:25:20,525][2408954] Num frames 7100...
[2023-02-25 13:25:20,623][2408954] Num frames 7200...
[2023-02-25 13:25:20,723][2408954] Num frames 7300...
[2023-02-25 13:25:20,821][2408954] Num frames 7400...
[2023-02-25 13:25:20,917][2408954] Num frames 7500...
[2023-02-25 13:25:21,014][2408954] Num frames 7600...
[2023-02-25 13:25:21,119][2408954] Num frames 7700...
[2023-02-25 13:25:21,240][2408954] Num frames 7800...
[2023-02-25 13:25:21,345][2408954] Num frames 7900...
[2023-02-25 13:25:21,444][2408954] Num frames 8000...
[2023-02-25 13:25:21,541][2408954] Num frames 8100...
[2023-02-25 13:25:21,636][2408954] Num frames 8200...
[2023-02-25 13:25:21,735][2408954] Num frames 8300...
[2023-02-25 13:25:21,831][2408954] DAMAGECOUNT value on done: 2050.0
[2023-02-25 13:25:21,831][2408954] Sum rewards: 26.607, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-3.498', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO5': '0.025', 'WEAPON4': '0.100', 'AMMO3': '0.152', 'weapon4': '0.218', 'WEAPON5': '0.500', 'weapon5': '0.638', 'WEAPON3': '1.100', 'ARMOR': '1.345', 'HITCOUNT': '1.360', 'DAMAGECOUNT': '6.150', 'weapon2': '6.950', 'weapon3': '7.050', 'FRAGCOUNT': '13.500'}
[2023-02-25 13:25:21,887][2408954] Avg episode rewards: #0: 26.609, true rewards: #0: 14.000
[2023-02-25 13:25:21,887][2408954] Avg episode reward: 26.609, avg true_objective: 14.000
[2023-02-25 13:25:21,891][2408954] Num frames 8400...
[2023-02-25 13:25:22,037][2408954] Num frames 8500...
[2023-02-25 13:25:22,137][2408954] Num frames 8600...
[2023-02-25 13:25:22,235][2408954] Num frames 8700...
[2023-02-25 13:25:22,333][2408954] Num frames 8800...
[2023-02-25 13:25:22,433][2408954] Num frames 8900...
[2023-02-25 13:25:22,535][2408954] Num frames 9000...
[2023-02-25 13:25:22,639][2408954] Num frames 9100...
[2023-02-25 13:25:22,738][2408954] Num frames 9200...
[2023-02-25 13:25:22,836][2408954] Num frames 9300...
[2023-02-25 13:25:22,935][2408954] Num frames 9400...
[2023-02-25 13:25:23,035][2408954] Num frames 9500...
[2023-02-25 13:25:23,135][2408954] Num frames 9600...
[2023-02-25 13:25:23,234][2408954] Num frames 9700...
[2023-02-25 13:25:23,331][2408954] Num frames 9800...
[2023-02-25 13:25:23,433][2408954] Num frames 9900...
[2023-02-25 13:25:23,536][2408954] Num frames 10000...
[2023-02-25 13:25:23,636][2408954] Num frames 10100...
[2023-02-25 13:25:23,738][2408954] Num frames 10200...
[2023-02-25 13:25:23,838][2408954] Num frames 10300...
[2023-02-25 13:25:23,942][2408954] Num frames 10400...
[2023-02-25 13:25:24,047][2408954] Num frames 10500...
[2023-02-25 13:25:24,148][2408954] Num frames 10600...
[2023-02-25 13:25:24,246][2408954] Num frames 10700...
[2023-02-25 13:25:24,347][2408954] Num frames 10800...
[2023-02-25 13:25:24,457][2408954] Num frames 10900...
[2023-02-25 13:25:24,556][2408954] Num frames 11000...
[2023-02-25 13:25:24,657][2408954] Num frames 11100...
[2023-02-25 13:25:24,760][2408954] Num frames 11200...
[2023-02-25 13:25:24,860][2408954] Num frames 11300...
[2023-02-25 13:25:24,963][2408954] Num frames 11400...
[2023-02-25 13:25:25,060][2408954] Num frames 11500...
[2023-02-25 13:25:25,165][2408954] Num frames 11600...
[2023-02-25 13:25:25,269][2408954] Num frames 11700...
[2023-02-25 13:25:25,373][2408954] Num frames 11800...
[2023-02-25 13:25:25,480][2408954] Num frames 11900...
[2023-02-25 13:25:25,584][2408954] Num frames 12000...
[2023-02-25 13:25:25,685][2408954] Num frames 12100...
[2023-02-25 13:25:25,789][2408954] Num frames 12200...
[2023-02-25 13:25:25,891][2408954] Num frames 12300...
[2023-02-25 13:25:25,991][2408954] Num frames 12400...
[2023-02-25 13:25:26,095][2408954] Num frames 12500...
[2023-02-25 13:25:26,197][2408954] Num frames 12600...
[2023-02-25 13:25:26,297][2408954] Num frames 12700...
[2023-02-25 13:25:26,398][2408954] Num frames 12800...
[2023-02-25 13:25:26,495][2408954] Num frames 12900...
[2023-02-25 13:25:26,594][2408954] Num frames 13000...
[2023-02-25 13:25:26,700][2408954] Num frames 13100...
[2023-02-25 13:25:26,802][2408954] Num frames 13200...
[2023-02-25 13:25:26,905][2408954] Num frames 13300...
[2023-02-25 13:25:27,001][2408954] Num frames 13400...
[2023-02-25 13:25:27,101][2408954] Num frames 13500...
[2023-02-25 13:25:27,205][2408954] Num frames 13600...
[2023-02-25 13:25:27,304][2408954] Num frames 13700...
[2023-02-25 13:25:27,400][2408954] Num frames 13800...
[2023-02-25 13:25:27,496][2408954] Num frames 13900...
[2023-02-25 13:25:27,601][2408954] Num frames 14000...
[2023-02-25 13:25:27,708][2408954] Num frames 14100...
[2023-02-25 13:25:27,810][2408954] Num frames 14200...
[2023-02-25 13:25:27,911][2408954] Num frames 14300...
[2023-02-25 13:25:28,016][2408954] Num frames 14400...
[2023-02-25 13:25:28,123][2408954] Num frames 14500...
[2023-02-25 13:25:28,228][2408954] Num frames 14600...
[2023-02-25 13:25:28,348][2408954] Num frames 14700...
[2023-02-25 13:25:28,454][2408954] Num frames 14800...
[2023-02-25 13:25:28,562][2408954] Num frames 14900...
[2023-02-25 13:25:28,663][2408954] Num frames 15000...
[2023-02-25 13:25:28,765][2408954] Num frames 15100...
[2023-02-25 13:25:28,865][2408954] Num frames 15200...
[2023-02-25 13:25:28,963][2408954] Num frames 15300...
[2023-02-25 13:25:29,061][2408954] Num frames 15400...
[2023-02-25 13:25:29,166][2408954] Num frames 15500...
[2023-02-25 13:25:29,272][2408954] Num frames 15600...
[2023-02-25 13:25:29,372][2408954] Num frames 15700...
[2023-02-25 13:25:29,471][2408954] Num frames 15800...
[2023-02-25 13:25:29,570][2408954] Num frames 15900...
[2023-02-25 13:25:29,672][2408954] Num frames 16000...
[2023-02-25 13:25:29,777][2408954] Num frames 16100...
[2023-02-25 13:25:29,882][2408954] Num frames 16200...
[2023-02-25 13:25:29,986][2408954] Num frames 16300...
[2023-02-25 13:25:30,089][2408954] Num frames 16400...
[2023-02-25 13:25:30,189][2408954] Num frames 16500...
[2023-02-25 13:25:30,289][2408954] Num frames 16600...
[2023-02-25 13:25:30,387][2408954] Num frames 16700...
[2023-02-25 13:25:30,483][2408954] DAMAGECOUNT value on done: 3342.0
[2023-02-25 13:25:30,484][2408954] Sum rewards: 24.157, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.515', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.028', 'AMMO3': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon7': '0.392', 'WEAPON3': '0.500', 'weapon5': '0.690', 'HITCOUNT': '1.050', 'weapon4': '2.618', 'DAMAGECOUNT': '3.876', 'weapon2': '4.034', 'weapon3': '6.118', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:25:30,540][2408954] Avg episode rewards: #0: 25.383, true rewards: #0: 11.500
[2023-02-25 13:25:30,541][2408954] Avg episode reward: 25.383, avg true_objective: 11.500
[2023-02-25 13:25:30,550][2408954] Num frames 16800...
[2023-02-25 13:25:30,653][2408954] Num frames 16900...
[2023-02-25 13:25:30,751][2408954] Num frames 17000...
[2023-02-25 13:25:30,851][2408954] Num frames 17100...
[2023-02-25 13:25:30,957][2408954] Num frames 17200...
[2023-02-25 13:25:31,063][2408954] Num frames 17300...
[2023-02-25 13:25:31,165][2408954] Num frames 17400...
[2023-02-25 13:25:31,267][2408954] Num frames 17500...
[2023-02-25 13:25:31,370][2408954] Num frames 17600...
[2023-02-25 13:25:31,470][2408954] Num frames 17700...
[2023-02-25 13:25:31,569][2408954] Num frames 17800...
[2023-02-25 13:25:31,674][2408954] Num frames 17900...
[2023-02-25 13:25:31,777][2408954] Num frames 18000...
[2023-02-25 13:25:31,877][2408954] Num frames 18100...
[2023-02-25 13:25:31,977][2408954] Num frames 18200...
[2023-02-25 13:25:32,077][2408954] Num frames 18300...
[2023-02-25 13:25:32,179][2408954] Num frames 18400...
[2023-02-25 13:25:32,279][2408954] Num frames 18500...
[2023-02-25 13:25:32,382][2408954] Num frames 18600...
[2023-02-25 13:25:32,482][2408954] Num frames 18700...
[2023-02-25 13:25:32,584][2408954] Num frames 18800...
[2023-02-25 13:25:32,683][2408954] Num frames 18900...
[2023-02-25 13:25:32,782][2408954] Num frames 19000...
[2023-02-25 13:25:32,888][2408954] Num frames 19100...
[2023-02-25 13:25:32,994][2408954] Num frames 19200...
[2023-02-25 13:25:33,097][2408954] Num frames 19300...
[2023-02-25 13:25:33,198][2408954] Num frames 19400...
[2023-02-25 13:25:33,308][2408954] Num frames 19500...
[2023-02-25 13:25:33,409][2408954] Num frames 19600...
[2023-02-25 13:25:33,509][2408954] Num frames 19700...
[2023-02-25 13:25:33,626][2408954] Num frames 19800...
[2023-02-25 13:25:33,732][2408954] Num frames 19900...
[2023-02-25 13:25:33,833][2408954] Num frames 20000...
[2023-02-25 13:25:33,945][2408954] Num frames 20100...
[2023-02-25 13:25:34,049][2408954] Num frames 20200...
[2023-02-25 13:25:34,152][2408954] Num frames 20300...
[2023-02-25 13:25:34,262][2408954] Num frames 20400...
[2023-02-25 13:25:34,367][2408954] Num frames 20500...
[2023-02-25 13:25:34,472][2408954] Num frames 20600...
[2023-02-25 13:25:34,575][2408954] Num frames 20700...
[2023-02-25 13:25:34,674][2408954] Num frames 20800...
[2023-02-25 13:25:34,785][2408954] Num frames 20900...
[2023-02-25 13:25:34,888][2408954] Num frames 21000...
[2023-02-25 13:25:34,988][2408954] Num frames 21100...
[2023-02-25 13:25:35,092][2408954] Num frames 21200...
[2023-02-25 13:25:35,193][2408954] Num frames 21300...
[2023-02-25 13:25:35,300][2408954] Num frames 21400...
[2023-02-25 13:25:35,411][2408954] Num frames 21500...
[2023-02-25 13:25:35,535][2408954] Num frames 21600...
[2023-02-25 13:25:35,638][2408954] Num frames 21700...
[2023-02-25 13:25:35,736][2408954] Num frames 21800...
[2023-02-25 13:25:35,830][2408954] Num frames 21900...
[2023-02-25 13:25:35,933][2408954] Num frames 22000...
[2023-02-25 13:25:36,033][2408954] Num frames 22100...
[2023-02-25 13:25:36,127][2408954] Num frames 22200...
[2023-02-25 13:25:36,233][2408954] Num frames 22300...
[2023-02-25 13:25:36,334][2408954] Num frames 22400...
[2023-02-25 13:25:36,433][2408954] Num frames 22500...
[2023-02-25 13:25:36,534][2408954] Num frames 22600...
[2023-02-25 13:25:36,637][2408954] Num frames 22700...
[2023-02-25 13:25:36,737][2408954] Num frames 22800...
[2023-02-25 13:25:36,839][2408954] Num frames 22900...
[2023-02-25 13:25:36,943][2408954] Num frames 23000...
[2023-02-25 13:25:37,041][2408954] Num frames 23100...
[2023-02-25 13:25:37,142][2408954] Num frames 23200...
[2023-02-25 13:25:37,243][2408954] Num frames 23300...
[2023-02-25 13:25:37,343][2408954] Num frames 23400...
[2023-02-25 13:25:37,444][2408954] Num frames 23500...
[2023-02-25 13:25:37,548][2408954] Num frames 23600...
[2023-02-25 13:25:37,650][2408954] Num frames 23700...
[2023-02-25 13:25:37,751][2408954] Num frames 23800...
[2023-02-25 13:25:37,851][2408954] Num frames 23900...
[2023-02-25 13:25:37,951][2408954] Num frames 24000...
[2023-02-25 13:25:38,048][2408954] Num frames 24100...
[2023-02-25 13:25:38,140][2408954] Num frames 24200...
[2023-02-25 13:25:38,238][2408954] Num frames 24300...
[2023-02-25 13:25:38,340][2408954] Num frames 24400...
[2023-02-25 13:25:38,442][2408954] Num frames 24500...
[2023-02-25 13:25:38,543][2408954] Num frames 24600...
[2023-02-25 13:25:38,644][2408954] Num frames 24700...
[2023-02-25 13:25:38,751][2408954] Num frames 24800...
[2023-02-25 13:25:38,851][2408954] Num frames 24900...
[2023-02-25 13:25:38,954][2408954] Num frames 25000...
[2023-02-25 13:25:39,066][2408954] Num frames 25100...
[2023-02-25 13:25:39,168][2408954] DAMAGECOUNT value on done: 4268.0
[2023-02-25 13:25:39,168][2408954] Sum rewards: 23.739, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.620', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.010', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon7': '0.470', 'HITCOUNT': '0.590', 'weapon5': '0.722', 'WEAPON3': '0.800', 'ARMOR': '0.901', 'DAMAGECOUNT': '2.778', 'weapon2': '6.150', 'weapon3': '6.682', 'FRAGCOUNT': '13.000'}
[2023-02-25 13:25:39,225][2408954] Avg episode rewards: #0: 24.836, true rewards: #0: 12.000
[2023-02-25 13:25:39,226][2408954] Avg episode reward: 24.836, avg true_objective: 12.000
[2023-02-25 13:25:39,248][2408954] Num frames 25200...
[2023-02-25 13:25:39,417][2408954] Num frames 25300...
[2023-02-25 13:25:39,519][2408954] Num frames 25400...
[2023-02-25 13:25:39,625][2408954] Num frames 25500...
[2023-02-25 13:25:39,728][2408954] Num frames 25600...
[2023-02-25 13:25:39,833][2408954] Num frames 25700...
[2023-02-25 13:25:39,934][2408954] Num frames 25800...
[2023-02-25 13:25:40,037][2408954] Num frames 25900...
[2023-02-25 13:25:40,141][2408954] Num frames 26000...
[2023-02-25 13:25:40,242][2408954] Num frames 26100...
[2023-02-25 13:25:40,344][2408954] Num frames 26200...
[2023-02-25 13:25:40,450][2408954] Num frames 26300...
[2023-02-25 13:25:40,554][2408954] Num frames 26400...
[2023-02-25 13:25:40,657][2408954] Num frames 26500...
[2023-02-25 13:25:40,757][2408954] Num frames 26600...
[2023-02-25 13:25:40,859][2408954] Num frames 26700...
[2023-02-25 13:25:40,962][2408954] Num frames 26800...
[2023-02-25 13:25:41,062][2408954] Num frames 26900...
[2023-02-25 13:25:41,159][2408954] Num frames 27000...
[2023-02-25 13:25:41,259][2408954] Num frames 27100...
[2023-02-25 13:25:41,359][2408954] Num frames 27200...
[2023-02-25 13:25:41,460][2408954] Num frames 27300...
[2023-02-25 13:25:41,561][2408954] Num frames 27400...
[2023-02-25 13:25:41,660][2408954] Num frames 27500...
[2023-02-25 13:25:41,761][2408954] Num frames 27600...
[2023-02-25 13:25:41,871][2408954] Num frames 27700...
[2023-02-25 13:25:41,977][2408954] Num frames 27800...
[2023-02-25 13:25:42,086][2408954] Num frames 27900...
[2023-02-25 13:25:42,192][2408954] Num frames 28000...
[2023-02-25 13:25:42,296][2408954] Num frames 28100...
[2023-02-25 13:25:42,403][2408954] Num frames 28200...
[2023-02-25 13:25:42,507][2408954] Num frames 28300...
[2023-02-25 13:25:42,628][2408954] Num frames 28400...
[2023-02-25 13:25:42,733][2408954] Num frames 28500...
[2023-02-25 13:25:42,835][2408954] Num frames 28600...
[2023-02-25 13:25:42,942][2408954] Num frames 28700...
[2023-02-25 13:25:43,046][2408954] Num frames 28800...
[2023-02-25 13:25:43,152][2408954] Num frames 28900...
[2023-02-25 13:25:43,261][2408954] Num frames 29000...
[2023-02-25 13:25:43,363][2408954] Num frames 29100...
[2023-02-25 13:25:43,465][2408954] Num frames 29200...
[2023-02-25 13:25:43,568][2408954] Num frames 29300...
[2023-02-25 13:25:43,673][2408954] Num frames 29400...
[2023-02-25 13:25:43,786][2408954] Num frames 29500...
[2023-02-25 13:25:43,889][2408954] Num frames 29600...
[2023-02-25 13:25:43,992][2408954] Num frames 29700...
[2023-02-25 13:25:44,105][2408954] Num frames 29800...
[2023-02-25 13:25:44,210][2408954] Num frames 29900...
[2023-02-25 13:25:44,322][2408954] Num frames 30000...
[2023-02-25 13:25:44,422][2408954] Num frames 30100...
[2023-02-25 13:25:44,522][2408954] Num frames 30200...
[2023-02-25 13:25:44,623][2408954] Num frames 30300...
[2023-02-25 13:25:44,726][2408954] Num frames 30400...
[2023-02-25 13:25:44,834][2408954] Num frames 30500...
[2023-02-25 13:25:44,937][2408954] Num frames 30600...
[2023-02-25 13:25:45,038][2408954] Num frames 30700...
[2023-02-25 13:25:45,141][2408954] Num frames 30800...
[2023-02-25 13:25:45,242][2408954] Num frames 30900...
[2023-02-25 13:25:45,343][2408954] Num frames 31000...
[2023-02-25 13:25:45,442][2408954] Num frames 31100...
[2023-02-25 13:25:45,536][2408954] Num frames 31200...
[2023-02-25 13:25:45,632][2408954] Num frames 31300...
[2023-02-25 13:25:45,730][2408954] Num frames 31400...
[2023-02-25 13:25:45,834][2408954] Num frames 31500...
[2023-02-25 13:25:45,939][2408954] Num frames 31600...
[2023-02-25 13:25:46,039][2408954] Num frames 31700...
[2023-02-25 13:25:46,139][2408954] Num frames 31800...
[2023-02-25 13:25:46,238][2408954] Num frames 31900...
[2023-02-25 13:25:46,339][2408954] Num frames 32000...
[2023-02-25 13:25:46,441][2408954] Num frames 32100...
[2023-02-25 13:25:46,542][2408954] Num frames 32200...
[2023-02-25 13:25:46,638][2408954] Num frames 32300...
[2023-02-25 13:25:46,735][2408954] Num frames 32400...
[2023-02-25 13:25:46,834][2408954] Num frames 32500...
[2023-02-25 13:25:46,941][2408954] Num frames 32600...
[2023-02-25 13:25:47,043][2408954] Num frames 32700...
[2023-02-25 13:25:47,141][2408954] Num frames 32800...
[2023-02-25 13:25:47,243][2408954] Num frames 32900...
[2023-02-25 13:25:47,341][2408954] Num frames 33000...
[2023-02-25 13:25:47,439][2408954] Num frames 33100...
[2023-02-25 13:25:47,541][2408954] Num frames 33200...
[2023-02-25 13:25:47,641][2408954] Num frames 33300...
[2023-02-25 13:25:47,743][2408954] Num frames 33400...
[2023-02-25 13:25:47,844][2408954] Num frames 33500...
[2023-02-25 13:25:47,943][2408954] DAMAGECOUNT value on done: 5540.0
[2023-02-25 13:25:47,943][2408954] Sum rewards: 19.240, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.920', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'weapon7': '0.020', 'AMMO5': '0.024', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.400', 'weapon5': '0.644', 'WEAPON3': '0.900', 'ARMOR': '0.902', 'HITCOUNT': '0.910', 'weapon4': '1.672', 'DAMAGECOUNT': '3.816', 'weapon2': '5.422', 'FRAGCOUNT': '7.000', 'weapon3': '7.202'}
[2023-02-25 13:25:47,999][2408954] Avg episode rewards: #0: 23.437, true rewards: #0: 10.750
[2023-02-25 13:25:47,999][2408954] Avg episode reward: 23.437, avg true_objective: 10.750
[2023-02-25 13:25:48,006][2408954] Num frames 33600...
[2023-02-25 13:25:48,110][2408954] Num frames 33700...
[2023-02-25 13:25:48,209][2408954] Num frames 33800...
[2023-02-25 13:25:48,307][2408954] Num frames 33900...
[2023-02-25 13:25:48,409][2408954] Num frames 34000...
[2023-02-25 13:25:48,514][2408954] Num frames 34100...
[2023-02-25 13:25:48,613][2408954] Num frames 34200...
[2023-02-25 13:25:48,710][2408954] Num frames 34300...
[2023-02-25 13:25:48,811][2408954] Num frames 34400...
[2023-02-25 13:25:48,910][2408954] Num frames 34500...
[2023-02-25 13:25:49,009][2408954] Num frames 34600...
[2023-02-25 13:25:49,114][2408954] Num frames 34700...
[2023-02-25 13:25:49,219][2408954] Num frames 34800...
[2023-02-25 13:25:49,322][2408954] Num frames 34900...
[2023-02-25 13:25:49,425][2408954] Num frames 35000...
[2023-02-25 13:25:49,535][2408954] Num frames 35100...
[2023-02-25 13:25:49,638][2408954] Num frames 35200...
[2023-02-25 13:25:49,765][2408954] Num frames 35300...
[2023-02-25 13:25:49,870][2408954] Num frames 35400...
[2023-02-25 13:25:49,973][2408954] Num frames 35500...
[2023-02-25 13:25:50,079][2408954] Num frames 35600...
[2023-02-25 13:25:50,183][2408954] Num frames 35700...
[2023-02-25 13:25:50,284][2408954] Num frames 35800...
[2023-02-25 13:25:50,386][2408954] Num frames 35900...
[2023-02-25 13:25:50,484][2408954] Num frames 36000...
[2023-02-25 13:25:50,588][2408954] Num frames 36100...
[2023-02-25 13:25:50,690][2408954] Num frames 36200...
[2023-02-25 13:25:50,792][2408954] Num frames 36300...
[2023-02-25 13:25:50,897][2408954] Num frames 36400...
[2023-02-25 13:25:50,999][2408954] Num frames 36500...
[2023-02-25 13:25:51,099][2408954] Num frames 36600...
[2023-02-25 13:25:51,204][2408954] Num frames 36700...
[2023-02-25 13:25:51,307][2408954] Num frames 36800...
[2023-02-25 13:25:51,414][2408954] Num frames 36900...
[2023-02-25 13:25:51,520][2408954] Num frames 37000...
[2023-02-25 13:25:51,619][2408954] Num frames 37100...
[2023-02-25 13:25:51,726][2408954] Num frames 37200...
[2023-02-25 13:25:51,829][2408954] Num frames 37300...
[2023-02-25 13:25:51,931][2408954] Num frames 37400...
[2023-02-25 13:25:52,035][2408954] Num frames 37500...
[2023-02-25 13:25:52,136][2408954] Num frames 37600...
[2023-02-25 13:25:52,237][2408954] Num frames 37700...
[2023-02-25 13:25:52,342][2408954] Num frames 37800...
[2023-02-25 13:25:52,444][2408954] Num frames 37900...
[2023-02-25 13:25:52,545][2408954] Num frames 38000...
[2023-02-25 13:25:52,643][2408954] Num frames 38100...
[2023-02-25 13:25:52,742][2408954] Num frames 38200...
[2023-02-25 13:25:52,842][2408954] Num frames 38300...
[2023-02-25 13:25:52,940][2408954] Num frames 38400...
[2023-02-25 13:25:53,038][2408954] Num frames 38500...
[2023-02-25 13:25:53,139][2408954] Num frames 38600...
[2023-02-25 13:25:53,242][2408954] Num frames 38700...
[2023-02-25 13:25:53,352][2408954] Num frames 38800...
[2023-02-25 13:25:53,455][2408954] Num frames 38900...
[2023-02-25 13:25:53,559][2408954] Num frames 39000...
[2023-02-25 13:25:53,657][2408954] Num frames 39100...
[2023-02-25 13:25:53,760][2408954] Num frames 39200...
[2023-02-25 13:25:53,864][2408954] Num frames 39300...
[2023-02-25 13:25:53,966][2408954] Num frames 39400...
[2023-02-25 13:25:54,064][2408954] Num frames 39500...
[2023-02-25 13:25:54,168][2408954] Num frames 39600...
[2023-02-25 13:25:54,268][2408954] Num frames 39700...
[2023-02-25 13:25:54,368][2408954] Num frames 39800...
[2023-02-25 13:25:54,470][2408954] Num frames 39900...
[2023-02-25 13:25:54,571][2408954] Num frames 40000...
[2023-02-25 13:25:54,673][2408954] Num frames 40100...
[2023-02-25 13:25:54,773][2408954] Num frames 40200...
[2023-02-25 13:25:54,877][2408954] Num frames 40300...
[2023-02-25 13:25:54,979][2408954] Num frames 40400...
[2023-02-25 13:25:55,080][2408954] Num frames 40500...
[2023-02-25 13:25:55,184][2408954] Num frames 40600...
[2023-02-25 13:25:55,284][2408954] Num frames 40700...
[2023-02-25 13:25:55,380][2408954] Num frames 40800...
[2023-02-25 13:25:55,479][2408954] Num frames 40900...
[2023-02-25 13:25:55,578][2408954] Num frames 41000...
[2023-02-25 13:25:55,683][2408954] Num frames 41100...
[2023-02-25 13:25:55,787][2408954] Num frames 41200...
[2023-02-25 13:25:55,888][2408954] Num frames 41300...
[2023-02-25 13:25:55,989][2408954] Num frames 41400...
[2023-02-25 13:25:56,095][2408954] Num frames 41500...
[2023-02-25 13:25:56,198][2408954] Num frames 41600...
[2023-02-25 13:25:56,300][2408954] Num frames 41700...
[2023-02-25 13:25:56,407][2408954] Num frames 41800...
[2023-02-25 13:25:56,511][2408954] Num frames 41900...
[2023-02-25 13:25:56,608][2408954] DAMAGECOUNT value on done: 7198.0
[2023-02-25 13:25:56,608][2408954] Sum rewards: 25.996, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.770', 'AMMO2': '0.019', 'AMMO5': '0.022', 'AMMO4': '0.096', 'AMMO3': '0.165', 'WEAPON4': '0.300', 'WEAPON5': '0.500', 'weapon5': '0.950', 'WEAPON3': '1.200', 'HITCOUNT': '1.250', 'ARMOR': '1.387', 'weapon4': '1.634', 'weapon2': '4.148', 'DAMAGECOUNT': '4.974', 'weapon3': '7.870', 'FRAGCOUNT': '15.000'}
[2023-02-25 13:25:56,665][2408954] Avg episode rewards: #0: 23.949, true rewards: #0: 11.600
[2023-02-25 13:25:56,665][2408954] Avg episode reward: 23.949, avg true_objective: 11.600
[2023-02-25 13:25:56,676][2408954] Num frames 42000...
[2023-02-25 13:25:56,793][2408954] Num frames 42100...
[2023-02-25 13:25:56,912][2408954] Num frames 42200...
[2023-02-25 13:25:57,018][2408954] Num frames 42300...
[2023-02-25 13:25:57,121][2408954] Num frames 42400...
[2023-02-25 13:25:57,222][2408954] Num frames 42500...
[2023-02-25 13:25:57,323][2408954] Num frames 42600...
[2023-02-25 13:25:57,430][2408954] Num frames 42700...
[2023-02-25 13:25:57,532][2408954] Num frames 42800...
[2023-02-25 13:25:57,632][2408954] Num frames 42900...
[2023-02-25 13:25:57,737][2408954] Num frames 43000...
[2023-02-25 13:25:57,836][2408954] Num frames 43100...
[2023-02-25 13:25:57,939][2408954] Num frames 43200...
[2023-02-25 13:25:58,043][2408954] Num frames 43300...
[2023-02-25 13:25:58,142][2408954] Num frames 43400...
[2023-02-25 13:25:58,240][2408954] Num frames 43500...
[2023-02-25 13:25:58,339][2408954] Num frames 43600...
[2023-02-25 13:25:58,437][2408954] Num frames 43700...
[2023-02-25 13:25:58,538][2408954] Num frames 43800...
[2023-02-25 13:25:58,635][2408954] Num frames 43900...
[2023-02-25 13:25:58,738][2408954] Num frames 44000...
[2023-02-25 13:25:58,838][2408954] Num frames 44100...
[2023-02-25 13:25:58,936][2408954] Num frames 44200...
[2023-02-25 13:25:59,038][2408954] Num frames 44300...
[2023-02-25 13:25:59,141][2408954] Num frames 44400...
[2023-02-25 13:25:59,242][2408954] Num frames 44500...
[2023-02-25 13:25:59,344][2408954] Num frames 44600...
[2023-02-25 13:25:59,438][2408954] Num frames 44700...
[2023-02-25 13:25:59,538][2408954] Num frames 44800...
[2023-02-25 13:25:59,640][2408954] Num frames 44900...
[2023-02-25 13:25:59,744][2408954] Num frames 45000...
[2023-02-25 13:25:59,848][2408954] Num frames 45100...
[2023-02-25 13:25:59,949][2408954] Num frames 45200...
[2023-02-25 13:26:00,051][2408954] Num frames 45300...
[2023-02-25 13:26:00,149][2408954] Num frames 45400...
[2023-02-25 13:26:00,247][2408954] Num frames 45500...
[2023-02-25 13:26:00,346][2408954] Num frames 45600...
[2023-02-25 13:26:00,447][2408954] Num frames 45700...
[2023-02-25 13:26:00,546][2408954] Num frames 45800...
[2023-02-25 13:26:00,648][2408954] Num frames 45900...
[2023-02-25 13:26:00,745][2408954] Num frames 46000...
[2023-02-25 13:26:00,840][2408954] Num frames 46100...
[2023-02-25 13:26:00,940][2408954] Num frames 46200...
[2023-02-25 13:26:01,041][2408954] Num frames 46300...
[2023-02-25 13:26:01,142][2408954] Num frames 46400...
[2023-02-25 13:26:01,242][2408954] Num frames 46500...
[2023-02-25 13:26:01,342][2408954] Num frames 46600...
[2023-02-25 13:26:01,448][2408954] Num frames 46700...
[2023-02-25 13:26:01,561][2408954] Num frames 46800...
[2023-02-25 13:26:01,662][2408954] Num frames 46900...
[2023-02-25 13:26:01,762][2408954] Num frames 47000...
[2023-02-25 13:26:01,861][2408954] Num frames 47100...
[2023-02-25 13:26:01,979][2408954] Num frames 47200...
[2023-02-25 13:26:02,081][2408954] Num frames 47300...
[2023-02-25 13:26:02,180][2408954] Num frames 47400...
[2023-02-25 13:26:02,281][2408954] Num frames 47500...
[2023-02-25 13:26:02,389][2408954] Num frames 47600...
[2023-02-25 13:26:02,498][2408954] Num frames 47700...
[2023-02-25 13:26:02,598][2408954] Num frames 47800...
[2023-02-25 13:26:02,700][2408954] Num frames 47900...
[2023-02-25 13:26:02,806][2408954] Num frames 48000...
[2023-02-25 13:26:02,909][2408954] Num frames 48100...
[2023-02-25 13:26:03,012][2408954] Num frames 48200...
[2023-02-25 13:26:03,116][2408954] Num frames 48300...
[2023-02-25 13:26:03,221][2408954] Num frames 48400...
[2023-02-25 13:26:03,322][2408954] Num frames 48500...
[2023-02-25 13:26:03,427][2408954] Num frames 48600...
[2023-02-25 13:26:03,528][2408954] Num frames 48700...
[2023-02-25 13:26:03,629][2408954] Num frames 48800...
[2023-02-25 13:26:03,738][2408954] Num frames 48900...
[2023-02-25 13:26:03,844][2408954] Num frames 49000...
[2023-02-25 13:26:03,947][2408954] Num frames 49100...
[2023-02-25 13:26:04,062][2408954] Num frames 49200...
[2023-02-25 13:26:04,166][2408954] Num frames 49300...
[2023-02-25 13:26:04,268][2408954] Num frames 49400...
[2023-02-25 13:26:04,370][2408954] Num frames 49500...
[2023-02-25 13:26:04,470][2408954] Num frames 49600...
[2023-02-25 13:26:04,576][2408954] Num frames 49700...
[2023-02-25 13:26:04,681][2408954] Num frames 49800...
[2023-02-25 13:26:04,784][2408954] Num frames 49900...
[2023-02-25 13:26:04,888][2408954] Num frames 50000...
[2023-02-25 13:26:04,993][2408954] Num frames 50100...
[2023-02-25 13:26:05,095][2408954] Num frames 50200...
[2023-02-25 13:26:05,205][2408954] Num frames 50300...
[2023-02-25 13:26:05,304][2408954] DAMAGECOUNT value on done: 8055.0
[2023-02-25 13:26:05,304][2408954] Sum rewards: 15.122, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.660', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.006', 'WEAPON1': '0.020', 'WEAPON4': '0.100', 'AMMO3': '0.141', 'WEAPON5': '0.200', 'weapon4': '0.276', 'ARMOR': '0.461', 'weapon5': '0.538', 'HITCOUNT': '0.850', 'WEAPON3': '0.900', 'DAMAGECOUNT': '2.571', 'FRAGCOUNT': '5.000', 'weapon2': '6.562', 'weapon3': '6.900'}
[2023-02-25 13:26:05,360][2408954] Avg episode rewards: #0: 22.478, true rewards: #0: 10.500
[2023-02-25 13:26:05,360][2408954] Avg episode reward: 22.478, avg true_objective: 10.500
[2023-02-25 13:26:05,374][2408954] Num frames 50400...
[2023-02-25 13:26:05,481][2408954] Num frames 50500...
[2023-02-25 13:26:05,583][2408954] Num frames 50600...
[2023-02-25 13:26:05,690][2408954] Num frames 50700...
[2023-02-25 13:26:05,795][2408954] Num frames 50800...
[2023-02-25 13:26:05,902][2408954] Num frames 50900...
[2023-02-25 13:26:06,008][2408954] Num frames 51000...
[2023-02-25 13:26:06,108][2408954] Num frames 51100...
[2023-02-25 13:26:06,217][2408954] Num frames 51200...
[2023-02-25 13:26:06,319][2408954] Num frames 51300...
[2023-02-25 13:26:06,419][2408954] Num frames 51400...
[2023-02-25 13:26:06,523][2408954] Num frames 51500...
[2023-02-25 13:26:06,626][2408954] Num frames 51600...
[2023-02-25 13:26:06,734][2408954] Num frames 51700...
[2023-02-25 13:26:06,840][2408954] Num frames 51800...
[2023-02-25 13:26:06,944][2408954] Num frames 51900...
[2023-02-25 13:26:07,053][2408954] Num frames 52000...
[2023-02-25 13:26:07,161][2408954] Num frames 52100...
[2023-02-25 13:26:07,263][2408954] Num frames 52200...
[2023-02-25 13:26:07,375][2408954] Num frames 52300...
[2023-02-25 13:26:07,482][2408954] Num frames 52400...
[2023-02-25 13:26:07,584][2408954] Num frames 52500...
[2023-02-25 13:26:07,691][2408954] Num frames 52600...
[2023-02-25 13:26:07,798][2408954] Num frames 52700...
[2023-02-25 13:26:07,899][2408954] Num frames 52800...
[2023-02-25 13:26:08,008][2408954] Num frames 52900...
[2023-02-25 13:26:08,112][2408954] Num frames 53000...
[2023-02-25 13:26:08,212][2408954] Num frames 53100...
[2023-02-25 13:26:08,316][2408954] Num frames 53200...
[2023-02-25 13:26:08,421][2408954] Num frames 53300...
[2023-02-25 13:26:08,518][2408954] Num frames 53400...
[2023-02-25 13:26:08,616][2408954] Num frames 53500...
[2023-02-25 13:26:08,716][2408954] Num frames 53600...
[2023-02-25 13:26:08,819][2408954] Num frames 53700...
[2023-02-25 13:26:08,924][2408954] Num frames 53800...
[2023-02-25 13:26:09,024][2408954] Num frames 53900...
[2023-02-25 13:26:09,125][2408954] Num frames 54000...
[2023-02-25 13:26:09,227][2408954] Num frames 54100...
[2023-02-25 13:26:09,328][2408954] Num frames 54200...
[2023-02-25 13:26:09,429][2408954] Num frames 54300...
[2023-02-25 13:26:09,527][2408954] Num frames 54400...
[2023-02-25 13:26:09,641][2408954] Num frames 54500...
[2023-02-25 13:26:09,742][2408954] Num frames 54600...
[2023-02-25 13:26:09,838][2408954] Num frames 54700...
[2023-02-25 13:26:09,940][2408954] Num frames 54800...
[2023-02-25 13:26:10,041][2408954] Num frames 54900...
[2023-02-25 13:26:10,141][2408954] Num frames 55000...
[2023-02-25 13:26:10,242][2408954] Num frames 55100...
[2023-02-25 13:26:10,343][2408954] Num frames 55200...
[2023-02-25 13:26:10,447][2408954] Num frames 55300...
[2023-02-25 13:26:10,551][2408954] Num frames 55400...
[2023-02-25 13:26:10,652][2408954] Num frames 55500...
[2023-02-25 13:26:10,763][2408954] Num frames 55600...
[2023-02-25 13:26:10,860][2408954] Num frames 55700...
[2023-02-25 13:26:10,958][2408954] Num frames 55800...
[2023-02-25 13:26:11,063][2408954] Num frames 55900...
[2023-02-25 13:26:11,182][2408954] Num frames 56000...
[2023-02-25 13:26:11,282][2408954] Num frames 56100...
[2023-02-25 13:26:11,385][2408954] Num frames 56200...
[2023-02-25 13:26:11,489][2408954] Num frames 56300...
[2023-02-25 13:26:11,595][2408954] Num frames 56400...
[2023-02-25 13:26:11,697][2408954] Num frames 56500...
[2023-02-25 13:26:11,801][2408954] Num frames 56600...
[2023-02-25 13:26:11,908][2408954] Num frames 56700...
[2023-02-25 13:26:12,011][2408954] Num frames 56800...
[2023-02-25 13:26:12,112][2408954] Num frames 56900...
[2023-02-25 13:26:12,218][2408954] Num frames 57000...
[2023-02-25 13:26:12,326][2408954] Num frames 57100...
[2023-02-25 13:26:12,425][2408954] Num frames 57200...
[2023-02-25 13:26:12,523][2408954] Num frames 57300...
[2023-02-25 13:26:12,628][2408954] Num frames 57400...
[2023-02-25 13:26:12,724][2408954] Num frames 57500...
[2023-02-25 13:26:12,824][2408954] Num frames 57600...
[2023-02-25 13:26:12,924][2408954] Num frames 57700...
[2023-02-25 13:26:13,025][2408954] Num frames 57800...
[2023-02-25 13:26:13,125][2408954] Num frames 57900...
[2023-02-25 13:26:13,234][2408954] Num frames 58000...
[2023-02-25 13:26:13,338][2408954] Num frames 58100...
[2023-02-25 13:26:13,439][2408954] Num frames 58200...
[2023-02-25 13:26:13,545][2408954] Num frames 58300...
[2023-02-25 13:26:13,647][2408954] Num frames 58400...
[2023-02-25 13:26:13,743][2408954] Num frames 58500...
[2023-02-25 13:26:13,855][2408954] Num frames 58600...
[2023-02-25 13:26:13,960][2408954] Num frames 58700...
[2023-02-25 13:26:14,054][2408954] DAMAGECOUNT value on done: 9377.0
[2023-02-25 13:26:14,054][2408954] Sum rewards: 27.005, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.363', 'AMMO2': '0.004', 'AMMO5': '0.016', 'AMMO4': '0.021', 'AMMO3': '0.100', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON7': '0.400', 'weapon5': '0.430', 'weapon7': '0.614', 'WEAPON3': '0.700', 'ARMOR': '0.958', 'HITCOUNT': '1.070', 'weapon2': '3.584', 'DAMAGECOUNT': '3.966', 'weapon3': '4.354', 'weapon4': '6.070', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:26:14,111][2408954] Avg episode rewards: #0: 23.125, true rewards: #0: 10.714
[2023-02-25 13:26:14,112][2408954] Avg episode reward: 23.125, avg true_objective: 10.714
[2023-02-25 13:26:14,121][2408954] Num frames 58800...
[2023-02-25 13:26:14,223][2408954] Num frames 58900...
[2023-02-25 13:26:14,324][2408954] Num frames 59000...
[2023-02-25 13:26:14,431][2408954] Num frames 59100...
[2023-02-25 13:26:14,531][2408954] Num frames 59200...
[2023-02-25 13:26:14,638][2408954] Num frames 59300...
[2023-02-25 13:26:14,744][2408954] Num frames 59400...
[2023-02-25 13:26:14,850][2408954] Num frames 59500...
[2023-02-25 13:26:14,946][2408954] Num frames 59600...
[2023-02-25 13:26:15,047][2408954] Num frames 59700...
[2023-02-25 13:26:15,152][2408954] Num frames 59800...
[2023-02-25 13:26:15,257][2408954] Num frames 59900...
[2023-02-25 13:26:15,355][2408954] Num frames 60000...
[2023-02-25 13:26:15,455][2408954] Num frames 60100...
[2023-02-25 13:26:15,555][2408954] Num frames 60200...
[2023-02-25 13:26:15,654][2408954] Num frames 60300...
[2023-02-25 13:26:15,756][2408954] Num frames 60400...
[2023-02-25 13:26:15,858][2408954] Num frames 60500...
[2023-02-25 13:26:15,962][2408954] Num frames 60600...
[2023-02-25 13:26:16,065][2408954] Num frames 60700...
[2023-02-25 13:26:16,166][2408954] Num frames 60800...
[2023-02-25 13:26:16,268][2408954] Num frames 60900...
[2023-02-25 13:26:16,372][2408954] Num frames 61000...
[2023-02-25 13:26:16,470][2408954] Num frames 61100...
[2023-02-25 13:26:16,569][2408954] Num frames 61200...
[2023-02-25 13:26:16,668][2408954] Num frames 61300...
[2023-02-25 13:26:16,766][2408954] Num frames 61400...
[2023-02-25 13:26:16,865][2408954] Num frames 61500...
[2023-02-25 13:26:16,973][2408954] Num frames 61600...
[2023-02-25 13:26:17,078][2408954] Num frames 61700...
[2023-02-25 13:26:17,177][2408954] Num frames 61800...
[2023-02-25 13:26:17,273][2408954] Num frames 61900...
[2023-02-25 13:26:17,372][2408954] Num frames 62000...
[2023-02-25 13:26:17,472][2408954] Num frames 62100...
[2023-02-25 13:26:17,574][2408954] Num frames 62200...
[2023-02-25 13:26:17,674][2408954] Num frames 62300...
[2023-02-25 13:26:17,774][2408954] Num frames 62400...
[2023-02-25 13:26:17,875][2408954] Num frames 62500...
[2023-02-25 13:26:17,971][2408954] Num frames 62600...
[2023-02-25 13:26:18,065][2408954] Num frames 62700...
[2023-02-25 13:26:18,172][2408954] Num frames 62800...
[2023-02-25 13:26:18,295][2408954] Num frames 62900...
[2023-02-25 13:26:18,399][2408954] Num frames 63000...
[2023-02-25 13:26:18,498][2408954] Num frames 63100...
[2023-02-25 13:26:18,598][2408954] Num frames 63200...
[2023-02-25 13:26:18,697][2408954] Num frames 63300...
[2023-02-25 13:26:18,801][2408954] Num frames 63400...
[2023-02-25 13:26:18,905][2408954] Num frames 63500...
[2023-02-25 13:26:19,003][2408954] Num frames 63600...
[2023-02-25 13:26:19,102][2408954] Num frames 63700...
[2023-02-25 13:26:19,201][2408954] Num frames 63800...
[2023-02-25 13:26:19,294][2408954] Num frames 63900...
[2023-02-25 13:26:19,407][2408954] Num frames 64000...
[2023-02-25 13:26:19,509][2408954] Num frames 64100...
[2023-02-25 13:26:19,605][2408954] Num frames 64200...
[2023-02-25 13:26:19,701][2408954] Num frames 64300...
[2023-02-25 13:26:19,810][2408954] Num frames 64400...
[2023-02-25 13:26:19,916][2408954] Num frames 64500...
[2023-02-25 13:26:20,017][2408954] Num frames 64600...
[2023-02-25 13:26:20,119][2408954] Num frames 64700...
[2023-02-25 13:26:20,234][2408954] Num frames 64800...
[2023-02-25 13:26:20,334][2408954] Num frames 64900...
[2023-02-25 13:26:20,433][2408954] Num frames 65000...
[2023-02-25 13:26:20,538][2408954] Num frames 65100...
[2023-02-25 13:26:20,644][2408954] Num frames 65200...
[2023-02-25 13:26:20,743][2408954] Num frames 65300...
[2023-02-25 13:26:20,846][2408954] Num frames 65400...
[2023-02-25 13:26:20,955][2408954] Num frames 65500...
[2023-02-25 13:26:21,053][2408954] Num frames 65600...
[2023-02-25 13:26:21,152][2408954] Num frames 65700...
[2023-02-25 13:26:21,261][2408954] Num frames 65800...
[2023-02-25 13:26:21,361][2408954] Num frames 65900...
[2023-02-25 13:26:21,461][2408954] Num frames 66000...
[2023-02-25 13:26:21,568][2408954] Num frames 66100...
[2023-02-25 13:26:21,671][2408954] Num frames 66200...
[2023-02-25 13:26:21,774][2408954] Num frames 66300...
[2023-02-25 13:26:21,876][2408954] Num frames 66400...
[2023-02-25 13:26:21,978][2408954] Num frames 66500...
[2023-02-25 13:26:22,088][2408954] Num frames 66600...
[2023-02-25 13:26:22,192][2408954] Num frames 66700...
[2023-02-25 13:26:22,294][2408954] Num frames 66800...
[2023-02-25 13:26:22,400][2408954] Num frames 66900...
[2023-02-25 13:26:22,499][2408954] Num frames 67000...
[2023-02-25 13:26:22,604][2408954] Num frames 67100...
[2023-02-25 13:26:22,696][2408954] DAMAGECOUNT value on done: 10384.0
[2023-02-25 13:26:22,696][2408954] Sum rewards: 22.141, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.615', 'AMMO5': '0.024', 'AMMO2': '0.025', 'AMMO3': '0.093', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.125', 'WEAPON7': '0.200', 'weapon7': '0.266', 'WEAPON4': '0.400', 'ARMOR': '0.458', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'HITCOUNT': '0.700', 'weapon5': '0.978', 'DAMAGECOUNT': '3.021', 'weapon4': '4.524', 'weapon2': '4.628', 'weapon3': '5.524', 'FRAGCOUNT': '9.000'}
[2023-02-25 13:26:22,752][2408954] Avg episode rewards: #0: 23.002, true rewards: #0: 10.500
[2023-02-25 13:26:22,752][2408954] Avg episode reward: 23.002, avg true_objective: 10.500
[2023-02-25 13:26:22,774][2408954] Num frames 67200...
[2023-02-25 13:26:22,923][2408954] Num frames 67300...
[2023-02-25 13:26:23,023][2408954] Num frames 67400...
[2023-02-25 13:26:23,134][2408954] Num frames 67500...
[2023-02-25 13:26:23,234][2408954] Num frames 67600...
[2023-02-25 13:26:23,339][2408954] Num frames 67700...
[2023-02-25 13:26:23,445][2408954] Num frames 67800...
[2023-02-25 13:26:23,544][2408954] Num frames 67900...
[2023-02-25 13:26:23,643][2408954] Num frames 68000...
[2023-02-25 13:26:23,751][2408954] Num frames 68100...
[2023-02-25 13:26:23,854][2408954] Num frames 68200...
[2023-02-25 13:26:23,956][2408954] Num frames 68300...
[2023-02-25 13:26:24,062][2408954] Num frames 68400...
[2023-02-25 13:26:24,164][2408954] Num frames 68500...
[2023-02-25 13:26:24,270][2408954] Num frames 68600...
[2023-02-25 13:26:24,376][2408954] Num frames 68700...
[2023-02-25 13:26:24,479][2408954] Num frames 68800...
[2023-02-25 13:26:24,579][2408954] Num frames 68900...
[2023-02-25 13:26:24,681][2408954] Num frames 69000...
[2023-02-25 13:26:24,784][2408954] Num frames 69100...
[2023-02-25 13:26:24,886][2408954] Num frames 69200...
[2023-02-25 13:26:24,990][2408954] Num frames 69300...
[2023-02-25 13:26:25,090][2408954] Num frames 69400...
[2023-02-25 13:26:25,187][2408954] Num frames 69500...
[2023-02-25 13:26:25,283][2408954] Num frames 69600...
[2023-02-25 13:26:25,389][2408954] Num frames 69700...
[2023-02-25 13:26:25,492][2408954] Num frames 69800...
[2023-02-25 13:26:25,594][2408954] Num frames 69900...
[2023-02-25 13:26:25,692][2408954] Num frames 70000...
[2023-02-25 13:26:25,793][2408954] Num frames 70100...
[2023-02-25 13:26:25,895][2408954] Num frames 70200...
[2023-02-25 13:26:25,996][2408954] Num frames 70300...
[2023-02-25 13:26:26,096][2408954] Num frames 70400...
[2023-02-25 13:26:26,200][2408954] Num frames 70500...
[2023-02-25 13:26:26,299][2408954] Num frames 70600...
[2023-02-25 13:26:26,405][2408954] Num frames 70700...
[2023-02-25 13:26:26,515][2408954] Num frames 70800...
[2023-02-25 13:26:26,614][2408954] Num frames 70900...
[2023-02-25 13:26:26,716][2408954] Num frames 71000...
[2023-02-25 13:26:26,820][2408954] Num frames 71100...
[2023-02-25 13:26:26,919][2408954] Num frames 71200...
[2023-02-25 13:26:27,017][2408954] Num frames 71300...
[2023-02-25 13:26:27,113][2408954] Num frames 71400...
[2023-02-25 13:26:27,209][2408954] Num frames 71500...
[2023-02-25 13:26:27,308][2408954] Num frames 71600...
[2023-02-25 13:26:27,409][2408954] Num frames 71700...
[2023-02-25 13:26:27,515][2408954] Num frames 71800...
[2023-02-25 13:26:27,622][2408954] Num frames 71900...
[2023-02-25 13:26:27,725][2408954] Num frames 72000...
[2023-02-25 13:26:27,825][2408954] Num frames 72100...
[2023-02-25 13:26:27,933][2408954] Num frames 72200...
[2023-02-25 13:26:28,041][2408954] Num frames 72300...
[2023-02-25 13:26:28,141][2408954] Num frames 72400...
[2023-02-25 13:26:28,241][2408954] Num frames 72500...
[2023-02-25 13:26:28,349][2408954] Num frames 72600...
[2023-02-25 13:26:28,452][2408954] Num frames 72700...
[2023-02-25 13:26:28,550][2408954] Num frames 72800...
[2023-02-25 13:26:28,655][2408954] Num frames 72900...
[2023-02-25 13:26:28,757][2408954] Num frames 73000...
[2023-02-25 13:26:28,859][2408954] Num frames 73100...
[2023-02-25 13:26:28,966][2408954] Num frames 73200...
[2023-02-25 13:26:29,069][2408954] Num frames 73300...
[2023-02-25 13:26:29,170][2408954] Num frames 73400...
[2023-02-25 13:26:29,272][2408954] Num frames 73500...
[2023-02-25 13:26:29,377][2408954] Num frames 73600...
[2023-02-25 13:26:29,479][2408954] Num frames 73700...
[2023-02-25 13:26:29,587][2408954] Num frames 73800...
[2023-02-25 13:26:29,690][2408954] Num frames 73900...
[2023-02-25 13:26:29,791][2408954] Num frames 74000...
[2023-02-25 13:26:29,893][2408954] Num frames 74100...
[2023-02-25 13:26:29,996][2408954] Num frames 74200...
[2023-02-25 13:26:30,096][2408954] Num frames 74300...
[2023-02-25 13:26:30,207][2408954] Num frames 74400...
[2023-02-25 13:26:30,309][2408954] Num frames 74500...
[2023-02-25 13:26:30,411][2408954] Num frames 74600...
[2023-02-25 13:26:30,513][2408954] Num frames 74700...
[2023-02-25 13:26:30,612][2408954] Num frames 74800...
[2023-02-25 13:26:30,718][2408954] Num frames 74900...
[2023-02-25 13:26:30,819][2408954] Num frames 75000...
[2023-02-25 13:26:30,920][2408954] Num frames 75100...
[2023-02-25 13:26:31,031][2408954] Num frames 75200...
[2023-02-25 13:26:31,135][2408954] Num frames 75300...
[2023-02-25 13:26:31,241][2408954] Num frames 75400...
[2023-02-25 13:26:31,344][2408954] Num frames 75500...
[2023-02-25 13:26:31,434][2408954] DAMAGECOUNT value on done: 11829.0
[2023-02-25 13:26:31,434][2408954] Sum rewards: 26.674, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.942', 'AMMO5': '0.017', 'AMMO2': '0.026', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.130', 'AMMO3': '0.131', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon7': '0.316', 'WEAPON5': '0.400', 'weapon5': '0.468', 'WEAPON3': '1.000', 'HITCOUNT': '1.100', 'ARMOR': '1.403', 'weapon4': '3.672', 'weapon2': '4.090', 'DAMAGECOUNT': '4.335', 'weapon3': '7.288', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:26:31,491][2408954] Avg episode rewards: #0: 23.410, true rewards: #0: 10.667
[2023-02-25 13:26:31,491][2408954] Avg episode reward: 23.410, avg true_objective: 10.667
[2023-02-25 13:26:31,509][2408954] Num frames 75600...
[2023-02-25 13:26:31,619][2408954] Num frames 75700...
[2023-02-25 13:26:31,724][2408954] Num frames 75800...
[2023-02-25 13:26:31,828][2408954] Num frames 75900...
[2023-02-25 13:26:31,936][2408954] Num frames 76000...
[2023-02-25 13:26:32,041][2408954] Num frames 76100...
[2023-02-25 13:26:32,146][2408954] Num frames 76200...
[2023-02-25 13:26:32,251][2408954] Num frames 76300...
[2023-02-25 13:26:32,354][2408954] Num frames 76400...
[2023-02-25 13:26:32,464][2408954] Num frames 76500...
[2023-02-25 13:26:32,572][2408954] Num frames 76600...
[2023-02-25 13:26:32,673][2408954] Num frames 76700...
[2023-02-25 13:26:32,773][2408954] Num frames 76800...
[2023-02-25 13:26:32,878][2408954] Num frames 76900...
[2023-02-25 13:26:32,907][2408954] Large shaping reward 3.642 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon4', 0.002)]
[2023-02-25 13:26:32,981][2408954] Num frames 77000...
[2023-02-25 13:26:33,085][2408954] Num frames 77100...
[2023-02-25 13:26:33,185][2408954] Num frames 77200...
[2023-02-25 13:26:33,284][2408954] Num frames 77300...
[2023-02-25 13:26:33,382][2408954] Num frames 77400...
[2023-02-25 13:26:33,481][2408954] Num frames 77500...
[2023-02-25 13:26:33,580][2408954] Num frames 77600...
[2023-02-25 13:26:33,678][2408954] Num frames 77700...
[2023-02-25 13:26:33,779][2408954] Num frames 77800...
[2023-02-25 13:26:33,878][2408954] Num frames 77900...
[2023-02-25 13:26:33,975][2408954] Num frames 78000...
[2023-02-25 13:26:34,078][2408954] Num frames 78100...
[2023-02-25 13:26:34,186][2408954] Num frames 78200...
[2023-02-25 13:26:34,286][2408954] Num frames 78300...
[2023-02-25 13:26:34,386][2408954] Num frames 78400...
[2023-02-25 13:26:34,486][2408954] Num frames 78500...
[2023-02-25 13:26:34,584][2408954] Num frames 78600...
[2023-02-25 13:26:34,685][2408954] Num frames 78700...
[2023-02-25 13:26:34,783][2408954] Num frames 78800...
[2023-02-25 13:26:34,889][2408954] Num frames 78900...
[2023-02-25 13:26:34,999][2408954] Num frames 79000...
[2023-02-25 13:26:35,101][2408954] Num frames 79100...
[2023-02-25 13:26:35,197][2408954] Num frames 79200...
[2023-02-25 13:26:35,296][2408954] Num frames 79300...
[2023-02-25 13:26:35,402][2408954] Num frames 79400...
[2023-02-25 13:26:35,504][2408954] Num frames 79500...
[2023-02-25 13:26:35,602][2408954] Num frames 79600...
[2023-02-25 13:26:35,701][2408954] Num frames 79700...
[2023-02-25 13:26:35,803][2408954] Num frames 79800...
[2023-02-25 13:26:35,906][2408954] Num frames 79900...
[2023-02-25 13:26:36,007][2408954] Num frames 80000...
[2023-02-25 13:26:36,107][2408954] Num frames 80100...
[2023-02-25 13:26:36,214][2408954] Num frames 80200...
[2023-02-25 13:26:36,317][2408954] Num frames 80300...
[2023-02-25 13:26:36,418][2408954] Num frames 80400...
[2023-02-25 13:26:36,525][2408954] Num frames 80500...
[2023-02-25 13:26:36,629][2408954] Num frames 80600...
[2023-02-25 13:26:36,732][2408954] Num frames 80700...
[2023-02-25 13:26:36,841][2408954] Num frames 80800...
[2023-02-25 13:26:36,945][2408954] Num frames 80900...
[2023-02-25 13:26:37,049][2408954] Num frames 81000...
[2023-02-25 13:26:37,155][2408954] Num frames 81100...
[2023-02-25 13:26:37,258][2408954] Num frames 81200...
[2023-02-25 13:26:37,356][2408954] Num frames 81300...
[2023-02-25 13:26:37,457][2408954] Num frames 81400...
[2023-02-25 13:26:37,560][2408954] Num frames 81500...
[2023-02-25 13:26:37,663][2408954] Num frames 81600...
[2023-02-25 13:26:37,769][2408954] Num frames 81700...
[2023-02-25 13:26:37,874][2408954] Num frames 81800...
[2023-02-25 13:26:37,977][2408954] Num frames 81900...
[2023-02-25 13:26:38,081][2408954] Num frames 82000...
[2023-02-25 13:26:38,186][2408954] Num frames 82100...
[2023-02-25 13:26:38,288][2408954] Num frames 82200...
[2023-02-25 13:26:38,392][2408954] Num frames 82300...
[2023-02-25 13:26:38,496][2408954] Num frames 82400...
[2023-02-25 13:26:38,605][2408954] Num frames 82500...
[2023-02-25 13:26:38,706][2408954] Num frames 82600...
[2023-02-25 13:26:38,808][2408954] Num frames 82700...
[2023-02-25 13:26:38,909][2408954] Num frames 82800...
[2023-02-25 13:26:39,005][2408954] Num frames 82900...
[2023-02-25 13:26:39,105][2408954] Num frames 83000...
[2023-02-25 13:26:39,203][2408954] Num frames 83100...
[2023-02-25 13:26:39,297][2408954] Num frames 83200...
[2023-02-25 13:26:39,400][2408954] Num frames 83300...
[2023-02-25 13:26:39,503][2408954] Num frames 83400...
[2023-02-25 13:26:39,609][2408954] Num frames 83500...
[2023-02-25 13:26:39,718][2408954] Num frames 83600...
[2023-02-25 13:26:39,824][2408954] Num frames 83700...
[2023-02-25 13:26:39,927][2408954] Num frames 83800...
[2023-02-25 13:26:40,035][2408954] Num frames 83900...
[2023-02-25 13:26:40,130][2408954] DAMAGECOUNT value on done: 13343.0
[2023-02-25 13:26:40,130][2408954] Sum rewards: 26.685, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.972', 'AMMO5': '0.017', 'AMMO2': '0.024', 'AMMO3': '0.089', 'AMMO4': '0.119', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '0.700', 'HITCOUNT': '0.770', 'weapon7': '0.776', 'weapon5': '1.248', 'ARMOR': '1.370', 'weapon4': '4.080', 'DAMAGECOUNT': '4.281', 'weapon2': '4.502', 'weapon3': '5.400', 'FRAGCOUNT': '12.000'}
[2023-02-25 13:26:40,187][2408954] Avg episode rewards: #0: 23.738, true rewards: #0: 10.800
[2023-02-25 13:26:40,187][2408954] Avg episode reward: 23.738, avg true_objective: 10.800
[2023-02-25 13:28:10,525][2408954] Replay video saved to train_dir/default_experiment/replay.mp4!