[2024-08-05 09:39:28,566][00034] Saving configuration to /kaggle/working/train_dir/default_experiment/config.json... [2024-08-05 09:39:28,569][00034] Rollout worker 0 uses device cpu [2024-08-05 09:39:28,569][00034] Rollout worker 1 uses device cpu [2024-08-05 09:39:28,571][00034] Rollout worker 2 uses device cpu [2024-08-05 09:39:28,572][00034] Rollout worker 3 uses device cpu [2024-08-05 09:39:28,573][00034] Rollout worker 4 uses device cpu [2024-08-05 09:39:28,574][00034] Rollout worker 5 uses device cpu [2024-08-05 09:39:28,575][00034] Rollout worker 6 uses device cpu [2024-08-05 09:39:28,576][00034] Rollout worker 7 uses device cpu [2024-08-05 09:39:28,577][00034] Rollout worker 8 uses device cpu [2024-08-05 09:39:28,578][00034] Rollout worker 9 uses device cpu [2024-08-05 09:39:28,579][00034] Rollout worker 10 uses device cpu [2024-08-05 09:39:28,580][00034] Rollout worker 11 uses device cpu [2024-08-05 09:39:28,581][00034] Rollout worker 12 uses device cpu [2024-08-05 09:39:28,582][00034] Rollout worker 13 uses device cpu [2024-08-05 09:39:28,583][00034] Rollout worker 14 uses device cpu [2024-08-05 09:39:28,584][00034] Rollout worker 15 uses device cpu [2024-08-05 09:39:29,106][00034] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2024-08-05 09:39:29,107][00034] InferenceWorker_p0-w0: min num requests: 5 [2024-08-05 09:39:29,178][00034] Starting all processes... [2024-08-05 09:39:29,180][00034] Starting process learner_proc0 [2024-08-05 09:39:29,288][00034] Starting all processes... [2024-08-05 09:39:29,298][00034] Starting process inference_proc0-0 [2024-08-05 09:39:29,298][00034] Starting process rollout_proc0 [2024-08-05 09:39:29,299][00034] Starting process rollout_proc1 [2024-08-05 09:39:29,299][00034] Starting process rollout_proc2 [2024-08-05 09:39:29,299][00034] Starting process rollout_proc3 [2024-08-05 09:39:29,299][00034] Starting process rollout_proc4 [2024-08-05 09:39:29,299][00034] Starting process rollout_proc5 [2024-08-05 09:39:29,299][00034] Starting process rollout_proc6 [2024-08-05 09:39:29,301][00034] Starting process rollout_proc7 [2024-08-05 09:39:29,302][00034] Starting process rollout_proc8 [2024-08-05 09:39:29,302][00034] Starting process rollout_proc9 [2024-08-05 09:39:29,304][00034] Starting process rollout_proc10 [2024-08-05 09:39:29,305][00034] Starting process rollout_proc11 [2024-08-05 09:39:29,306][00034] Starting process rollout_proc12 [2024-08-05 09:39:29,306][00034] Starting process rollout_proc13 [2024-08-05 09:39:29,306][00034] Starting process rollout_proc14 [2024-08-05 09:39:29,729][00034] Starting process rollout_proc15 [2024-08-05 09:39:45,017][00162] Worker 6 uses CPU cores [2] [2024-08-05 09:39:45,046][00136] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2024-08-05 09:39:45,047][00136] Set environment var CUDA_VISIBLE_DEVICES to '0' (GPU indices [0]) for learning process 0 [2024-08-05 09:39:45,081][00170] Worker 14 uses CPU cores [2] [2024-08-05 09:39:45,095][00156] Worker 0 uses CPU cores [0] [2024-08-05 09:39:45,109][00136] Num visible devices: 1 [2024-08-05 09:39:45,156][00136] Setting fixed seed 0 [2024-08-05 09:39:45,159][00136] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2024-08-05 09:39:45,160][00136] Initializing actor-critic model on device cuda:0 [2024-08-05 09:39:45,160][00136] RunningMeanStd input shape: (23,) [2024-08-05 09:39:45,163][00136] RunningMeanStd input shape: (3, 72, 128) [2024-08-05 09:39:45,164][00136] RunningMeanStd input shape: (1,) [2024-08-05 09:39:45,236][00136] ConvEncoder: input_channels=3 [2024-08-05 09:39:45,591][00159] Worker 2 uses CPU cores [2] [2024-08-05 09:39:45,606][00157] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2024-08-05 09:39:45,610][00157] Set environment var CUDA_VISIBLE_DEVICES to '0' (GPU indices [0]) for inference process 0 [2024-08-05 09:39:45,707][00157] Num visible devices: 1 [2024-08-05 09:39:45,920][00163] Worker 5 uses CPU cores [1] [2024-08-05 09:39:45,973][00158] Worker 1 uses CPU cores [1] [2024-08-05 09:39:46,001][00136] Conv encoder output size: 512 [2024-08-05 09:39:46,003][00136] Policy head output size: 640 [2024-08-05 09:39:46,027][00166] Worker 8 uses CPU cores [0] [2024-08-05 09:39:46,027][00164] Worker 7 uses CPU cores [3] [2024-08-05 09:39:46,047][00167] Worker 12 uses CPU cores [0] [2024-08-05 09:39:46,056][00169] Worker 10 uses CPU cores [2] [2024-08-05 09:39:46,084][00161] Worker 4 uses CPU cores [0] [2024-08-05 09:39:46,096][00168] Worker 11 uses CPU cores [3] [2024-08-05 09:39:46,112][00171] Worker 13 uses CPU cores [1] [2024-08-05 09:39:46,115][00165] Worker 9 uses CPU cores [1] [2024-08-05 09:39:46,146][00172] Worker 15 uses CPU cores [3] [2024-08-05 09:39:46,159][00136] Created Actor Critic model with architecture: [2024-08-05 09:39:46,159][00136] ActorCriticSharedWeights( (obs_normalizer): ObservationNormalizer( (running_mean_std): RunningMeanStdDictInPlace( (running_mean_std): ModuleDict( (measurements): RunningMeanStdInPlace() (obs): RunningMeanStdInPlace() ) ) ) (returns_normalizer): RecursiveScriptModule(original_name=RunningMeanStdInPlace) (encoder): VizdoomEncoder( (basic_encoder): ConvEncoder( (enc): RecursiveScriptModule( original_name=ConvEncoderImpl (conv_head): RecursiveScriptModule( original_name=Sequential (0): RecursiveScriptModule(original_name=Conv2d) (1): RecursiveScriptModule(original_name=ReLU) (2): RecursiveScriptModule(original_name=Conv2d) (3): RecursiveScriptModule(original_name=ReLU) (4): RecursiveScriptModule(original_name=Conv2d) (5): RecursiveScriptModule(original_name=ReLU) ) (mlp_layers): RecursiveScriptModule( original_name=Sequential (0): RecursiveScriptModule(original_name=Linear) (1): RecursiveScriptModule(original_name=ReLU) ) ) ) (measurements_head): Sequential( (0): Linear(in_features=23, out_features=128, bias=True) (1): ReLU() (2): Linear(in_features=128, out_features=128, bias=True) (3): ReLU() ) ) (core): ModelCoreRNN( (core): LSTM(640, 512) ) (decoder): MlpDecoder( (mlp): Identity() ) (critic_linear): Linear(in_features=512, out_features=1, bias=True) (action_parameterization): ActionParameterizationDefault( (distribution_linear): Linear(in_features=512, out_features=39, bias=True) ) ) [2024-08-05 09:39:46,167][00160] Worker 3 uses CPU cores [3] [2024-08-05 09:39:46,417][00136] Using optimizer [2024-08-05 09:39:47,516][00136] No checkpoints found [2024-08-05 09:39:47,517][00136] Did not load from checkpoint, starting from scratch! [2024-08-05 09:39:47,517][00136] Initialized policy 0 weights for model version 0 [2024-08-05 09:39:47,519][00136] LearnerWorker_p0 finished initialization! [2024-08-05 09:39:47,521][00136] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2024-08-05 09:39:47,609][00157] RunningMeanStd input shape: (23,) [2024-08-05 09:39:47,609][00157] RunningMeanStd input shape: (3, 72, 128) [2024-08-05 09:39:47,610][00157] RunningMeanStd input shape: (1,) [2024-08-05 09:39:47,627][00157] ConvEncoder: input_channels=3 [2024-08-05 09:39:47,750][00157] Conv encoder output size: 512 [2024-08-05 09:39:47,751][00157] Policy head output size: 640 [2024-08-05 09:39:47,824][00034] Inference worker 0-0 is ready! [2024-08-05 09:39:47,825][00034] All inference workers are ready! Signal rollout workers to start! [2024-08-05 09:39:48,040][00166] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 09:39:48,044][00163] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 09:39:48,038][00156] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 09:39:48,042][00167] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 09:39:48,048][00161] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 09:39:48,051][00165] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 09:39:48,051][00171] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 09:39:48,052][00172] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 09:39:48,051][00170] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 09:39:48,047][00162] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 09:39:48,055][00160] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 09:39:48,047][00158] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 09:39:48,050][00168] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 09:39:48,054][00166] Port 41100 is available [2024-08-05 09:39:48,056][00166] Using port 41100 [2024-08-05 09:39:48,053][00169] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 09:39:48,057][00159] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 09:39:48,057][00164] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 09:39:48,050][00163] Port 40800 is available [2024-08-05 09:39:48,060][00163] Using port 40800 [2024-08-05 09:39:48,058][00156] Port 40300 is available [2024-08-05 09:39:48,059][00167] Port 41500 is available [2024-08-05 09:39:48,061][00167] Using port 41500 [2024-08-05 09:39:48,062][00161] Port 40700 is available [2024-08-05 09:39:48,060][00156] Using port 40300 [2024-08-05 09:39:48,056][00171] Port 41600 is available [2024-08-05 09:39:48,060][00165] Port 41200 is available [2024-08-05 09:39:48,063][00171] Using port 41600 [2024-08-05 09:39:48,063][00165] Using port 41200 [2024-08-05 09:39:48,064][00158] Port 40400 is available [2024-08-05 09:39:48,062][00172] Port 41800 is available [2024-08-05 09:39:48,066][00158] Using port 40400 [2024-08-05 09:39:48,067][00161] Using port 40700 [2024-08-05 09:39:48,069][00168] Port 41400 is available [2024-08-05 09:39:48,069][00172] Using port 41800 [2024-08-05 09:39:48,069][00168] Using port 41400 [2024-08-05 09:39:48,068][00170] Port 41700 is available [2024-08-05 09:39:48,069][00162] Port 40900 is available [2024-08-05 09:39:48,071][00160] Port 40600 is available [2024-08-05 09:39:48,073][00164] Port 41000 is available [2024-08-05 09:39:48,071][00170] Using port 41700 [2024-08-05 09:39:48,072][00162] Using port 40900 [2024-08-05 09:39:48,074][00160] Using port 40600 [2024-08-05 09:39:48,073][00164] Using port 41000 [2024-08-05 09:39:48,073][00169] Port 41300 is available [2024-08-05 09:39:48,077][00169] Using port 41300 [2024-08-05 09:39:48,078][00159] Port 40500 is available [2024-08-05 09:39:48,081][00159] Using port 40500 [2024-08-05 09:39:48,253][00166] Port 41101 is available [2024-08-05 09:39:48,256][00171] Port 41601 is available [2024-08-05 09:39:48,251][00163] Port 40801 is available [2024-08-05 09:39:48,257][00163] Using port 40801 [2024-08-05 09:39:48,257][00166] Using port 41101 [2024-08-05 09:39:48,256][00158] Port 40401 is available [2024-08-05 09:39:48,257][00171] Using port 41601 [2024-08-05 09:39:48,261][00158] Using port 40401 [2024-08-05 09:39:48,262][00161] Port 40701 is available [2024-08-05 09:39:48,264][00167] Port 41501 is available [2024-08-05 09:39:48,255][00165] Port 41201 is available [2024-08-05 09:39:48,266][00167] Using port 41501 [2024-08-05 09:39:48,264][00165] Using port 41201 [2024-08-05 09:39:48,265][00156] Port 40301 is available [2024-08-05 09:39:48,266][00161] Using port 40701 [2024-08-05 09:39:48,267][00156] Using port 40301 [2024-08-05 09:39:48,270][00172] Port 41801 is available [2024-08-05 09:39:48,271][00172] Using port 41801 [2024-08-05 09:39:48,269][00164] Port 41001 is available [2024-08-05 09:39:48,278][00164] Using port 41001 [2024-08-05 09:39:48,277][00168] Port 41401 is available [2024-08-05 09:39:48,281][00168] Using port 41401 [2024-08-05 09:39:48,276][00162] Port 40901 is available [2024-08-05 09:39:48,273][00160] Port 40601 is available [2024-08-05 09:39:48,284][00162] Using port 40901 [2024-08-05 09:39:48,284][00160] Using port 40601 [2024-08-05 09:39:48,294][00169] Port 41301 is available [2024-08-05 09:39:48,295][00169] Using port 41301 [2024-08-05 09:39:48,293][00170] Port 41701 is available [2024-08-05 09:39:48,298][00170] Using port 41701 [2024-08-05 09:39:48,291][00159] Port 40501 is available [2024-08-05 09:39:48,305][00159] Using port 40501 [2024-08-05 09:39:48,355][00034] Fps is (10 sec: nan, 60 sec: nan, 300 sec: nan). Total num frames: 0. Throughput: 0: nan. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 09:39:48,447][00166] Port 41102 is available [2024-08-05 09:39:48,453][00163] Port 40802 is available [2024-08-05 09:39:48,454][00166] Using port 41102 [2024-08-05 09:39:48,454][00163] Using port 40802 [2024-08-05 09:39:48,453][00161] Port 40702 is available [2024-08-05 09:39:48,454][00158] Port 40402 is available [2024-08-05 09:39:48,458][00161] Using port 40702 [2024-08-05 09:39:48,447][00171] Port 41602 is available [2024-08-05 09:39:48,459][00158] Using port 40402 [2024-08-05 09:39:48,459][00171] Using port 41602 [2024-08-05 09:39:48,459][00165] Port 41202 is available [2024-08-05 09:39:48,464][00165] Using port 41202 [2024-08-05 09:39:48,464][00167] Port 41502 is available [2024-08-05 09:39:48,465][00167] Using port 41502 [2024-08-05 09:39:48,464][00156] Port 40302 is available [2024-08-05 09:39:48,468][00156] Using port 40302 [2024-08-05 09:39:48,463][00172] Port 41802 is available [2024-08-05 09:39:48,471][00172] Using port 41802 [2024-08-05 09:39:48,470][00168] Port 41402 is available [2024-08-05 09:39:48,481][00168] Using port 41402 [2024-08-05 09:39:48,473][00164] Port 41002 is available [2024-08-05 09:39:48,484][00164] Using port 41002 [2024-08-05 09:39:48,477][00160] Port 40602 is available [2024-08-05 09:39:48,487][00160] Using port 40602 [2024-08-05 09:39:48,493][00169] Port 41302 is available [2024-08-05 09:39:48,502][00169] Using port 41302 [2024-08-05 09:39:48,501][00170] Port 41702 is available [2024-08-05 09:39:48,498][00162] Port 40902 is available [2024-08-05 09:39:48,507][00170] Using port 41702 [2024-08-05 09:39:48,508][00162] Using port 40902 [2024-08-05 09:39:48,510][00159] Port 40502 is available [2024-08-05 09:39:48,515][00159] Using port 40502 [2024-08-05 09:39:48,652][00166] Port 41103 is available [2024-08-05 09:39:48,654][00161] Port 40703 is available [2024-08-05 09:39:48,653][00166] Using port 41103 [2024-08-05 09:39:48,653][00163] Port 40803 is available [2024-08-05 09:39:48,655][00163] Using port 40803 [2024-08-05 09:39:48,657][00161] Using port 40703 [2024-08-05 09:39:48,656][00158] Port 40403 is available [2024-08-05 09:39:48,658][00171] Port 41603 is available [2024-08-05 09:39:48,658][00158] Using port 40403 [2024-08-05 09:39:48,659][00167] Port 41503 is available [2024-08-05 09:39:48,658][00171] Using port 41603 [2024-08-05 09:39:48,665][00167] Using port 41503 [2024-08-05 09:39:48,665][00156] Port 40303 is available [2024-08-05 09:39:48,667][00156] Using port 40303 [2024-08-05 09:39:48,666][00165] Port 41203 is available [2024-08-05 09:39:48,670][00165] Using port 41203 [2024-08-05 09:39:48,679][00172] Port 41803 is available [2024-08-05 09:39:48,672][00168] Port 41403 is available [2024-08-05 09:39:48,681][00172] Using port 41803 [2024-08-05 09:39:48,680][00168] Using port 41403 [2024-08-05 09:39:48,684][00164] Port 41003 is available [2024-08-05 09:39:48,687][00164] Using port 41003 [2024-08-05 09:39:48,689][00160] Port 40603 is available [2024-08-05 09:39:48,697][00160] Using port 40603 [2024-08-05 09:39:48,710][00169] Port 41303 is available [2024-08-05 09:39:48,714][00169] Using port 41303 [2024-08-05 09:39:48,722][00162] Port 40903 is available [2024-08-05 09:39:48,724][00162] Using port 40903 [2024-08-05 09:39:48,720][00159] Port 40503 is available [2024-08-05 09:39:48,729][00159] Using port 40503 [2024-08-05 09:39:48,724][00170] Port 41703 is available [2024-08-05 09:39:48,734][00170] Using port 41703 [2024-08-05 09:39:48,858][00171] Port 41604 is available [2024-08-05 09:39:48,850][00166] Port 41104 is available [2024-08-05 09:39:48,860][00161] Port 40704 is available [2024-08-05 09:39:48,859][00166] Using port 41104 [2024-08-05 09:39:48,859][00171] Using port 41604 [2024-08-05 09:39:48,865][00167] Port 41504 is available [2024-08-05 09:39:48,863][00163] Port 40804 is available [2024-08-05 09:39:48,866][00161] Using port 40704 [2024-08-05 09:39:48,866][00163] Using port 40804 [2024-08-05 09:39:48,866][00158] Port 40404 is available [2024-08-05 09:39:48,869][00167] Using port 41504 [2024-08-05 09:39:48,869][00158] Using port 40404 [2024-08-05 09:39:48,876][00165] Port 41204 is available [2024-08-05 09:39:48,877][00165] Using port 41204 [2024-08-05 09:39:48,874][00156] Port 40304 is available [2024-08-05 09:39:48,880][00156] Using port 40304 [2024-08-05 09:39:48,872][00168] Port 41404 is available [2024-08-05 09:39:48,883][00168] Using port 41404 [2024-08-05 09:39:48,880][00172] Port 41804 is available [2024-08-05 09:39:48,889][00172] Using port 41804 [2024-08-05 09:39:48,905][00164] Port 41004 is available [2024-08-05 09:39:48,909][00164] Using port 41004 [2024-08-05 09:39:48,903][00160] Port 40604 is available [2024-08-05 09:39:48,916][00160] Using port 40604 [2024-08-05 09:39:48,926][00169] Port 41304 is available [2024-08-05 09:39:48,929][00169] Using port 41304 [2024-08-05 09:39:48,941][00162] Port 40904 is available [2024-08-05 09:39:48,942][00162] Using port 40904 [2024-08-05 09:39:48,938][00170] Port 41704 is available [2024-08-05 09:39:48,947][00170] Using port 41704 [2024-08-05 09:39:48,941][00159] Port 40504 is available [2024-08-05 09:39:48,949][00159] Using port 40504 [2024-08-05 09:39:49,069][00163] Port 40805 is available [2024-08-05 09:39:49,068][00158] Port 40405 is available [2024-08-05 09:39:49,069][00163] Using port 40805 [2024-08-05 09:39:49,070][00158] Using port 40405 [2024-08-05 09:39:49,070][00166] Port 41105 is available [2024-08-05 09:39:49,073][00171] Port 41605 is available [2024-08-05 09:39:49,075][00171] Using port 41605 [2024-08-05 09:39:49,074][00166] Using port 41105 [2024-08-05 09:39:49,079][00165] Port 41205 is available [2024-08-05 09:39:49,082][00165] Using port 41205 [2024-08-05 09:39:49,077][00167] Port 41505 is available [2024-08-05 09:39:49,087][00167] Using port 41505 [2024-08-05 09:39:49,082][00156] Port 40305 is available [2024-08-05 09:39:49,090][00156] Using port 40305 [2024-08-05 09:39:49,084][00161] Port 40705 is available [2024-08-05 09:39:49,091][00161] Using port 40705 [2024-08-05 09:39:49,096][00034] Heartbeat connected on Batcher_0 [2024-08-05 09:39:49,090][00168] Port 41405 is available [2024-08-05 09:39:49,100][00034] Heartbeat connected on LearnerWorker_p0 [2024-08-05 09:39:49,099][00168] Using port 41405 [2024-08-05 09:39:49,109][00172] Port 41805 is available [2024-08-05 09:39:49,113][00172] Using port 41805 [2024-08-05 09:39:49,122][00164] Port 41005 is available [2024-08-05 09:39:49,129][00164] Using port 41005 [2024-08-05 09:39:49,128][00160] Port 40605 is available [2024-08-05 09:39:49,132][00160] Using port 40605 [2024-08-05 09:39:49,154][00034] Heartbeat connected on InferenceWorker_p0-w0 [2024-08-05 09:39:49,151][00169] Port 41305 is available [2024-08-05 09:39:49,157][00169] Using port 41305 [2024-08-05 09:39:49,152][00170] Port 41705 is available [2024-08-05 09:39:49,159][00170] Using port 41705 [2024-08-05 09:39:49,157][00162] Port 40905 is available [2024-08-05 09:39:49,167][00162] Using port 40905 [2024-08-05 09:39:49,170][00159] Port 40505 is available [2024-08-05 09:39:49,174][00159] Using port 40505 [2024-08-05 09:39:49,272][00163] Port 40806 is available [2024-08-05 09:39:49,276][00163] Using port 40806 [2024-08-05 09:39:49,268][00158] Port 40406 is available [2024-08-05 09:39:49,278][00158] Using port 40406 [2024-08-05 09:39:49,276][00165] Port 41206 is available [2024-08-05 09:39:49,282][00165] Using port 41206 [2024-08-05 09:39:49,289][00171] Port 41606 is available [2024-08-05 09:39:49,290][00171] Using port 41606 [2024-08-05 09:39:49,293][00166] Port 41106 is available [2024-08-05 09:39:49,293][00166] Using port 41106 [2024-08-05 09:39:49,296][00167] Port 41506 is available [2024-08-05 09:39:49,292][00156] Port 40306 is available [2024-08-05 09:39:49,298][00167] Using port 41506 [2024-08-05 09:39:49,298][00156] Using port 40306 [2024-08-05 09:39:49,297][00168] Port 41406 is available [2024-08-05 09:39:49,302][00168] Using port 41406 [2024-08-05 09:39:49,298][00161] Port 40706 is available [2024-08-05 09:39:49,307][00161] Using port 40706 [2024-08-05 09:39:49,309][00172] Port 41806 is available [2024-08-05 09:39:49,319][00172] Using port 41806 [2024-08-05 09:39:49,327][00160] Port 40606 is available [2024-08-05 09:39:49,335][00160] Using port 40606 [2024-08-05 09:39:49,331][00164] Port 41006 is available [2024-08-05 09:39:49,339][00164] Using port 41006 [2024-08-05 09:39:49,356][00170] Port 41706 is available [2024-08-05 09:39:49,368][00170] Using port 41706 [2024-08-05 09:39:49,365][00162] Port 40906 is available [2024-08-05 09:39:49,371][00169] Port 41306 is available [2024-08-05 09:39:49,372][00162] Using port 40906 [2024-08-05 09:39:49,373][00169] Using port 41306 [2024-08-05 09:39:49,391][00159] Port 40506 is available [2024-08-05 09:39:49,392][00159] Using port 40506 [2024-08-05 09:39:49,459][00163] Port 40807 is available [2024-08-05 09:39:49,466][00163] Using port 40807 [2024-08-05 09:39:49,463][00165] Port 41207 is available [2024-08-05 09:39:49,471][00163] Using port 40800 on host... [2024-08-05 09:39:49,474][00165] Using port 41207 [2024-08-05 09:39:49,473][00158] Port 40407 is available [2024-08-05 09:39:49,481][00158] Using port 40407 [2024-08-05 09:39:49,484][00165] Using port 41200 on host... [2024-08-05 09:39:49,483][00158] Using port 40400 on host... [2024-08-05 09:39:49,487][00171] Port 41607 is available [2024-08-05 09:39:49,491][00171] Using port 41607 [2024-08-05 09:39:49,498][00166] Port 41107 is available [2024-08-05 09:39:49,496][00161] Port 40707 is available [2024-08-05 09:39:49,500][00166] Using port 41107 [2024-08-05 09:39:49,500][00161] Using port 40707 [2024-08-05 09:39:49,494][00171] Using port 41600 on host... [2024-08-05 09:39:49,499][00168] Port 41407 is available [2024-08-05 09:39:49,505][00168] Using port 41407 [2024-08-05 09:39:49,509][00167] Port 41507 is available [2024-08-05 09:39:49,509][00167] Using port 41507 [2024-08-05 09:39:49,502][00166] Using port 41100 on host... [2024-08-05 09:39:49,513][00161] Using port 40700 on host... [2024-08-05 09:39:49,514][00167] Using port 41500 on host... [2024-08-05 09:39:49,509][00156] Port 40307 is available [2024-08-05 09:39:49,515][00156] Using port 40307 [2024-08-05 09:39:49,510][00168] Using port 41400 on host... [2024-08-05 09:39:49,517][00156] Using port 40300 on host... [2024-08-05 09:39:49,512][00172] Port 41807 is available [2024-08-05 09:39:49,518][00172] Using port 41807 [2024-08-05 09:39:49,528][00172] Using port 41800 on host... [2024-08-05 09:39:49,526][00160] Port 40607 is available [2024-08-05 09:39:49,534][00160] Using port 40607 [2024-08-05 09:39:49,540][00164] Port 41007 is available [2024-08-05 09:39:49,539][00160] Using port 40600 on host... [2024-08-05 09:39:49,543][00164] Using port 41007 [2024-08-05 09:39:49,546][00164] Using port 41000 on host... [2024-08-05 09:39:49,583][00170] Port 41707 is available [2024-08-05 09:39:49,585][00170] Using port 41707 [2024-08-05 09:39:49,588][00162] Port 40907 is available [2024-08-05 09:39:49,592][00162] Using port 40907 [2024-08-05 09:39:49,588][00170] Using port 41700 on host... [2024-08-05 09:39:49,598][00162] Using port 40900 on host... [2024-08-05 09:39:49,601][00169] Port 41307 is available [2024-08-05 09:39:49,604][00169] Using port 41307 [2024-08-05 09:39:49,606][00169] Using port 41300 on host... [2024-08-05 09:39:49,613][00159] Port 40507 is available [2024-08-05 09:39:49,616][00159] Using port 40507 [2024-08-05 09:39:49,619][00159] Using port 40500 on host... [2024-08-05 09:39:51,570][00167] Initialized w:12 v:0 player:0 [2024-08-05 09:39:51,572][00171] Initialized w:13 v:0 player:0 [2024-08-05 09:39:51,572][00164] Initialized w:7 v:0 player:0 [2024-08-05 09:39:51,573][00161] Initialized w:4 v:0 player:0 [2024-08-05 09:39:51,575][00166] Initialized w:8 v:0 player:0 [2024-08-05 09:39:51,576][00163] Initialized w:5 v:0 player:0 [2024-08-05 09:39:51,574][00172] Initialized w:15 v:0 player:0 [2024-08-05 09:39:51,574][00165] Initialized w:9 v:0 player:0 [2024-08-05 09:39:51,579][00156] Initialized w:0 v:0 player:0 [2024-08-05 09:39:51,579][00158] Initialized w:1 v:0 player:0 [2024-08-05 09:39:51,579][00160] Initialized w:3 v:0 player:0 [2024-08-05 09:39:51,580][00168] Initialized w:11 v:0 player:0 [2024-08-05 09:39:51,587][00163] Decorrelating experience for 0 frames... [2024-08-05 09:39:51,588][00171] Decorrelating experience for 0 frames... [2024-08-05 09:39:51,588][00167] Decorrelating experience for 0 frames... [2024-08-05 09:39:51,590][00168] Decorrelating experience for 0 frames... [2024-08-05 09:39:51,589][00166] Decorrelating experience for 0 frames... [2024-08-05 09:39:51,589][00161] Decorrelating experience for 0 frames... [2024-08-05 09:39:51,588][00164] Decorrelating experience for 0 frames... [2024-08-05 09:39:51,589][00172] Decorrelating experience for 0 frames... [2024-08-05 09:39:51,590][00160] Decorrelating experience for 0 frames... [2024-08-05 09:39:51,589][00165] Decorrelating experience for 0 frames... [2024-08-05 09:39:51,587][00156] Decorrelating experience for 0 frames... [2024-08-05 09:39:51,589][00158] Decorrelating experience for 0 frames... [2024-08-05 09:39:51,595][00160] Using port 40601 on host... [2024-08-05 09:39:51,593][00167] Using port 41501 on host... [2024-08-05 09:39:51,593][00171] Using port 41601 on host... [2024-08-05 09:39:51,595][00166] Using port 41101 on host... [2024-08-05 09:39:51,593][00161] Using port 40701 on host... [2024-08-05 09:39:51,595][00163] Using port 40801 on host... [2024-08-05 09:39:51,596][00165] Using port 41201 on host... [2024-08-05 09:39:51,595][00156] Using port 40301 on host... [2024-08-05 09:39:51,595][00158] Using port 40401 on host... [2024-08-05 09:39:51,596][00164] Using port 41001 on host... [2024-08-05 09:39:51,593][00172] Using port 41801 on host... [2024-08-05 09:39:51,597][00168] Using port 41401 on host... [2024-08-05 09:39:51,650][00162] Initialized w:6 v:0 player:0 [2024-08-05 09:39:51,652][00170] Initialized w:14 v:0 player:0 [2024-08-05 09:39:51,657][00170] Decorrelating experience for 0 frames... [2024-08-05 09:39:51,654][00162] Decorrelating experience for 0 frames... [2024-08-05 09:39:51,659][00170] Using port 41701 on host... [2024-08-05 09:39:51,660][00162] Using port 40901 on host... [2024-08-05 09:39:51,678][00169] Initialized w:10 v:0 player:0 [2024-08-05 09:39:51,680][00169] Decorrelating experience for 0 frames... [2024-08-05 09:39:51,686][00169] Using port 41301 on host... [2024-08-05 09:39:51,700][00159] Initialized w:2 v:0 player:0 [2024-08-05 09:39:51,702][00159] Decorrelating experience for 0 frames... [2024-08-05 09:39:51,709][00159] Using port 40501 on host... [2024-08-05 09:39:53,355][00034] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 09:39:53,619][00166] Initialized w:8 v:1 player:0 [2024-08-05 09:39:53,620][00158] Initialized w:1 v:1 player:0 [2024-08-05 09:39:53,622][00156] Initialized w:0 v:1 player:0 [2024-08-05 09:39:53,625][00165] Initialized w:9 v:1 player:0 [2024-08-05 09:39:53,625][00161] Initialized w:4 v:1 player:0 [2024-08-05 09:39:53,628][00167] Initialized w:12 v:1 player:0 [2024-08-05 09:39:53,629][00158] Decorrelating experience for 32 frames... [2024-08-05 09:39:53,630][00166] Decorrelating experience for 32 frames... [2024-08-05 09:39:53,624][00156] Decorrelating experience for 32 frames... [2024-08-05 09:39:53,630][00165] Decorrelating experience for 32 frames... [2024-08-05 09:39:53,631][00161] Decorrelating experience for 32 frames... [2024-08-05 09:39:53,639][00163] Initialized w:5 v:1 player:0 [2024-08-05 09:39:53,632][00167] Decorrelating experience for 32 frames... [2024-08-05 09:39:53,645][00163] Decorrelating experience for 32 frames... [2024-08-05 09:39:53,654][00171] Initialized w:13 v:1 player:0 [2024-08-05 09:39:53,656][00171] Decorrelating experience for 32 frames... [2024-08-05 09:39:53,662][00170] Initialized w:14 v:1 player:0 [2024-08-05 09:39:53,669][00170] Decorrelating experience for 32 frames... [2024-08-05 09:39:53,678][00172] Initialized w:15 v:1 player:0 [2024-08-05 09:39:53,681][00172] Decorrelating experience for 32 frames... [2024-08-05 09:39:53,685][00162] Initialized w:6 v:1 player:0 [2024-08-05 09:39:53,687][00162] Decorrelating experience for 32 frames... [2024-08-05 09:39:53,691][00168] Initialized w:11 v:1 player:0 [2024-08-05 09:39:53,694][00160] Initialized w:3 v:1 player:0 [2024-08-05 09:39:53,696][00160] Decorrelating experience for 32 frames... [2024-08-05 09:39:53,698][00168] Decorrelating experience for 32 frames... [2024-08-05 09:39:53,698][00169] Initialized w:10 v:1 player:0 [2024-08-05 09:39:53,701][00169] Decorrelating experience for 32 frames... [2024-08-05 09:39:53,714][00164] Initialized w:7 v:1 player:0 [2024-08-05 09:39:53,716][00164] Decorrelating experience for 32 frames... [2024-08-05 09:39:53,816][00159] Initialized w:2 v:1 player:0 [2024-08-05 09:39:53,818][00159] Decorrelating experience for 32 frames... [2024-08-05 09:39:53,948][00161] Using port 40702 on host... [2024-08-05 09:39:53,961][00166] Using port 41102 on host... [2024-08-05 09:39:53,963][00165] Using port 41202 on host... [2024-08-05 09:39:53,965][00158] Using port 40402 on host... [2024-08-05 09:39:53,965][00156] Using port 40302 on host... [2024-08-05 09:39:53,975][00163] Using port 40802 on host... [2024-08-05 09:39:53,974][00167] Using port 41502 on host... [2024-08-05 09:39:53,991][00171] Using port 41602 on host... [2024-08-05 09:39:54,002][00170] Using port 41702 on host... [2024-08-05 09:39:54,019][00162] Using port 40902 on host... [2024-08-05 09:39:54,026][00169] Using port 41302 on host... [2024-08-05 09:39:54,030][00172] Using port 41802 on host... [2024-08-05 09:39:54,037][00168] Using port 41402 on host... [2024-08-05 09:39:54,046][00160] Using port 40602 on host... [2024-08-05 09:39:54,075][00164] Using port 41002 on host... [2024-08-05 09:39:54,125][00159] Using port 40502 on host... [2024-08-05 09:39:56,049][00156] Initialized w:0 v:2 player:0 [2024-08-05 09:39:56,053][00156] Decorrelating experience for 64 frames... [2024-08-05 09:39:56,069][00161] Initialized w:4 v:2 player:0 [2024-08-05 09:39:56,074][00166] Initialized w:8 v:2 player:0 [2024-08-05 09:39:56,071][00161] Decorrelating experience for 64 frames... [2024-08-05 09:39:56,086][00166] Decorrelating experience for 64 frames... [2024-08-05 09:39:56,122][00167] Initialized w:12 v:2 player:0 [2024-08-05 09:39:56,124][00167] Decorrelating experience for 64 frames... [2024-08-05 09:39:56,154][00162] Initialized w:6 v:2 player:0 [2024-08-05 09:39:56,160][00170] Initialized w:14 v:2 player:0 [2024-08-05 09:39:56,161][00162] Decorrelating experience for 64 frames... [2024-08-05 09:39:56,167][00170] Decorrelating experience for 64 frames... [2024-08-05 09:39:56,169][00163] Initialized w:5 v:2 player:0 [2024-08-05 09:39:56,172][00158] Initialized w:1 v:2 player:0 [2024-08-05 09:39:56,171][00163] Decorrelating experience for 64 frames... [2024-08-05 09:39:56,176][00158] Decorrelating experience for 64 frames... [2024-08-05 09:39:56,183][00172] Initialized w:15 v:2 player:0 [2024-08-05 09:39:56,187][00165] Initialized w:9 v:2 player:0 [2024-08-05 09:39:56,190][00160] Initialized w:3 v:2 player:0 [2024-08-05 09:39:56,186][00172] Decorrelating experience for 64 frames... [2024-08-05 09:39:56,190][00171] Initialized w:13 v:2 player:0 [2024-08-05 09:39:56,189][00165] Decorrelating experience for 64 frames... [2024-08-05 09:39:56,193][00171] Decorrelating experience for 64 frames... [2024-08-05 09:39:56,198][00168] Initialized w:11 v:2 player:0 [2024-08-05 09:39:56,199][00160] Decorrelating experience for 64 frames... [2024-08-05 09:39:56,205][00168] Decorrelating experience for 64 frames... [2024-08-05 09:39:56,209][00169] Initialized w:10 v:2 player:0 [2024-08-05 09:39:56,211][00169] Decorrelating experience for 64 frames... [2024-08-05 09:39:56,214][00164] Initialized w:7 v:2 player:0 [2024-08-05 09:39:56,216][00164] Decorrelating experience for 64 frames... [2024-08-05 09:39:56,272][00159] Initialized w:2 v:2 player:0 [2024-08-05 09:39:56,279][00159] Decorrelating experience for 64 frames... [2024-08-05 09:39:56,738][00156] Using port 40303 on host... [2024-08-05 09:39:56,741][00166] Using port 41103 on host... [2024-08-05 09:39:56,772][00161] Using port 40703 on host... [2024-08-05 09:39:56,844][00167] Using port 41503 on host... [2024-08-05 09:39:56,876][00158] Using port 40403 on host... [2024-08-05 09:39:56,884][00172] Using port 41803 on host... [2024-08-05 09:39:56,891][00165] Using port 41203 on host... [2024-08-05 09:39:56,895][00168] Using port 41403 on host... [2024-08-05 09:39:56,899][00162] Using port 40903 on host... [2024-08-05 09:39:56,901][00171] Using port 41603 on host... [2024-08-05 09:39:56,905][00163] Using port 40803 on host... [2024-08-05 09:39:56,951][00170] Using port 41703 on host... [2024-08-05 09:39:56,958][00164] Using port 41003 on host... [2024-08-05 09:39:56,969][00169] Using port 41303 on host... [2024-08-05 09:39:56,981][00159] Using port 40503 on host... [2024-08-05 09:39:56,979][00160] Using port 40603 on host... [2024-08-05 09:39:58,356][00034] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 09:39:58,982][00156] Initialized w:0 v:3 player:0 [2024-08-05 09:39:58,987][00156] Decorrelating experience for 96 frames... [2024-08-05 09:39:58,994][00166] Initialized w:8 v:3 player:0 [2024-08-05 09:39:58,996][00166] Decorrelating experience for 96 frames... [2024-08-05 09:39:59,064][00161] Initialized w:4 v:3 player:0 [2024-08-05 09:39:59,066][00161] Decorrelating experience for 96 frames... [2024-08-05 09:39:59,070][00171] Initialized w:13 v:3 player:0 [2024-08-05 09:39:59,074][00158] Initialized w:1 v:3 player:0 [2024-08-05 09:39:59,079][00165] Initialized w:9 v:3 player:0 [2024-08-05 09:39:59,075][00171] Decorrelating experience for 96 frames... [2024-08-05 09:39:59,085][00163] Initialized w:5 v:3 player:0 [2024-08-05 09:39:59,077][00158] Decorrelating experience for 96 frames... [2024-08-05 09:39:59,088][00165] Decorrelating experience for 96 frames... [2024-08-05 09:39:59,087][00163] Decorrelating experience for 96 frames... [2024-08-05 09:39:59,152][00172] Initialized w:15 v:3 player:0 [2024-08-05 09:39:59,153][00162] Initialized w:6 v:3 player:0 [2024-08-05 09:39:59,154][00172] Decorrelating experience for 96 frames... [2024-08-05 09:39:59,155][00162] Decorrelating experience for 96 frames... [2024-08-05 09:39:59,176][00168] Initialized w:11 v:3 player:0 [2024-08-05 09:39:59,182][00168] Decorrelating experience for 96 frames... [2024-08-05 09:39:59,184][00167] Initialized w:12 v:3 player:0 [2024-08-05 09:39:59,200][00167] Decorrelating experience for 96 frames... [2024-08-05 09:39:59,216][00164] Initialized w:7 v:3 player:0 [2024-08-05 09:39:59,218][00164] Decorrelating experience for 96 frames... [2024-08-05 09:39:59,242][00160] Initialized w:3 v:3 player:0 [2024-08-05 09:39:59,249][00170] Initialized w:14 v:3 player:0 [2024-08-05 09:39:59,250][00160] Decorrelating experience for 96 frames... [2024-08-05 09:39:59,257][00169] Initialized w:10 v:3 player:0 [2024-08-05 09:39:59,251][00170] Decorrelating experience for 96 frames... [2024-08-05 09:39:59,259][00169] Decorrelating experience for 96 frames... [2024-08-05 09:39:59,275][00159] Initialized w:2 v:3 player:0 [2024-08-05 09:39:59,277][00159] Decorrelating experience for 96 frames... [2024-08-05 09:40:00,016][00156] Using port 40304 on host... [2024-08-05 09:40:00,026][00166] Using port 41104 on host... [2024-08-05 09:40:00,077][00161] Using port 40704 on host... [2024-08-05 09:40:00,136][00163] Using port 40804 on host... [2024-08-05 09:40:00,147][00165] Using port 41204 on host... [2024-08-05 09:40:00,150][00172] Using port 41804 on host... [2024-08-05 09:40:00,156][00171] Using port 41604 on host... [2024-08-05 09:40:00,174][00168] Using port 41404 on host... [2024-08-05 09:40:00,194][00167] Using port 41504 on host... [2024-08-05 09:40:00,237][00158] Using port 40404 on host... [2024-08-05 09:40:00,248][00164] Using port 41004 on host... [2024-08-05 09:40:00,269][00162] Using port 40904 on host... [2024-08-05 09:40:00,277][00160] Using port 40604 on host... [2024-08-05 09:40:00,332][00169] Using port 41304 on host... [2024-08-05 09:40:00,340][00170] Using port 41704 on host... [2024-08-05 09:40:00,352][00159] Using port 40504 on host... [2024-08-05 09:40:02,280][00156] Initialized w:0 v:4 player:0 [2024-08-05 09:40:02,282][00156] Decorrelating experience for 128 frames... [2024-08-05 09:40:02,317][00166] Initialized w:8 v:4 player:0 [2024-08-05 09:40:02,319][00166] Decorrelating experience for 128 frames... [2024-08-05 09:40:02,390][00161] Initialized w:4 v:4 player:0 [2024-08-05 09:40:02,392][00161] Decorrelating experience for 128 frames... [2024-08-05 09:40:02,423][00168] Initialized w:11 v:4 player:0 [2024-08-05 09:40:02,429][00165] Initialized w:9 v:4 player:0 [2024-08-05 09:40:02,428][00168] Decorrelating experience for 128 frames... [2024-08-05 09:40:02,428][00171] Initialized w:13 v:4 player:0 [2024-08-05 09:40:02,432][00171] Decorrelating experience for 128 frames... [2024-08-05 09:40:02,438][00165] Decorrelating experience for 128 frames... [2024-08-05 09:40:02,441][00163] Initialized w:5 v:4 player:0 [2024-08-05 09:40:02,443][00163] Decorrelating experience for 128 frames... [2024-08-05 09:40:02,468][00172] Initialized w:15 v:4 player:0 [2024-08-05 09:40:02,474][00172] Decorrelating experience for 128 frames... [2024-08-05 09:40:02,488][00164] Initialized w:7 v:4 player:0 [2024-08-05 09:40:02,493][00164] Decorrelating experience for 128 frames... [2024-08-05 09:40:02,528][00160] Initialized w:3 v:4 player:0 [2024-08-05 09:40:02,530][00160] Decorrelating experience for 128 frames... [2024-08-05 09:40:02,555][00169] Initialized w:10 v:4 player:0 [2024-08-05 09:40:02,554][00162] Initialized w:6 v:4 player:0 [2024-08-05 09:40:02,556][00167] Initialized w:12 v:4 player:0 [2024-08-05 09:40:02,562][00169] Decorrelating experience for 128 frames... [2024-08-05 09:40:02,558][00162] Decorrelating experience for 128 frames... [2024-08-05 09:40:02,564][00167] Decorrelating experience for 128 frames... [2024-08-05 09:40:02,577][00170] Initialized w:14 v:4 player:0 [2024-08-05 09:40:02,582][00159] Initialized w:2 v:4 player:0 [2024-08-05 09:40:02,579][00170] Decorrelating experience for 128 frames... [2024-08-05 09:40:02,584][00159] Decorrelating experience for 128 frames... [2024-08-05 09:40:02,604][00158] Initialized w:1 v:4 player:0 [2024-08-05 09:40:02,606][00158] Decorrelating experience for 128 frames... [2024-08-05 09:40:03,355][00034] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 09:40:03,651][00156] Using port 40305 on host... [2024-08-05 09:40:03,707][00166] Using port 41105 on host... [2024-08-05 09:40:03,791][00163] Using port 40805 on host... [2024-08-05 09:40:03,821][00171] Using port 41605 on host... [2024-08-05 09:40:03,835][00164] Using port 41005 on host... [2024-08-05 09:40:03,851][00161] Using port 40705 on host... [2024-08-05 09:40:03,856][00172] Using port 41805 on host... [2024-08-05 09:40:03,880][00168] Using port 41405 on host... [2024-08-05 09:40:03,917][00162] Using port 40905 on host... [2024-08-05 09:40:03,921][00165] Using port 41205 on host... [2024-08-05 09:40:03,955][00160] Using port 40605 on host... [2024-08-05 09:40:03,971][00158] Using port 40405 on host... [2024-08-05 09:40:03,980][00167] Using port 41505 on host... [2024-08-05 09:40:03,991][00169] Using port 41305 on host... [2024-08-05 09:40:04,010][00159] Using port 40505 on host... [2024-08-05 09:40:04,020][00170] Using port 41705 on host... [2024-08-05 09:40:06,075][00156] Initialized w:0 v:5 player:0 [2024-08-05 09:40:06,077][00156] Decorrelating experience for 160 frames... [2024-08-05 09:40:06,085][00164] Initialized w:7 v:5 player:0 [2024-08-05 09:40:06,092][00172] Initialized w:15 v:5 player:0 [2024-08-05 09:40:06,094][00163] Initialized w:5 v:5 player:0 [2024-08-05 09:40:06,091][00164] Decorrelating experience for 160 frames... [2024-08-05 09:40:06,099][00163] Decorrelating experience for 160 frames... [2024-08-05 09:40:06,103][00168] Initialized w:11 v:5 player:0 [2024-08-05 09:40:06,094][00172] Decorrelating experience for 160 frames... [2024-08-05 09:40:06,108][00168] Decorrelating experience for 160 frames... [2024-08-05 09:40:06,125][00166] Initialized w:8 v:5 player:0 [2024-08-05 09:40:06,129][00171] Initialized w:13 v:5 player:0 [2024-08-05 09:40:06,129][00162] Initialized w:6 v:5 player:0 [2024-08-05 09:40:06,131][00162] Decorrelating experience for 160 frames... [2024-08-05 09:40:06,131][00171] Decorrelating experience for 160 frames... [2024-08-05 09:40:06,132][00166] Decorrelating experience for 160 frames... [2024-08-05 09:40:06,206][00165] Initialized w:9 v:5 player:0 [2024-08-05 09:40:06,208][00165] Decorrelating experience for 160 frames... [2024-08-05 09:40:06,224][00169] Initialized w:10 v:5 player:0 [2024-08-05 09:40:06,233][00169] Decorrelating experience for 160 frames... [2024-08-05 09:40:06,240][00160] Initialized w:3 v:5 player:0 [2024-08-05 09:40:06,242][00159] Initialized w:2 v:5 player:0 [2024-08-05 09:40:06,242][00160] Decorrelating experience for 160 frames... [2024-08-05 09:40:06,245][00159] Decorrelating experience for 160 frames... [2024-08-05 09:40:06,254][00158] Initialized w:1 v:5 player:0 [2024-08-05 09:40:06,256][00158] Decorrelating experience for 160 frames... [2024-08-05 09:40:06,266][00161] Initialized w:4 v:5 player:0 [2024-08-05 09:40:06,268][00161] Decorrelating experience for 160 frames... [2024-08-05 09:40:06,293][00170] Initialized w:14 v:5 player:0 [2024-08-05 09:40:06,300][00170] Decorrelating experience for 160 frames... [2024-08-05 09:40:06,463][00167] Initialized w:12 v:5 player:0 [2024-08-05 09:40:06,466][00167] Decorrelating experience for 160 frames... [2024-08-05 09:40:07,796][00164] Using port 41006 on host... [2024-08-05 09:40:07,801][00163] Using port 40806 on host... [2024-08-05 09:40:07,819][00162] Using port 40906 on host... [2024-08-05 09:40:07,824][00171] Using port 41606 on host... [2024-08-05 09:40:07,832][00166] Using port 41106 on host... [2024-08-05 09:40:07,845][00172] Using port 41806 on host... [2024-08-05 09:40:07,879][00156] Using port 40306 on host... [2024-08-05 09:40:07,882][00168] Using port 41406 on host... [2024-08-05 09:40:07,943][00165] Using port 41206 on host... [2024-08-05 09:40:07,948][00160] Using port 40606 on host... [2024-08-05 09:40:07,987][00158] Using port 40406 on host... [2024-08-05 09:40:07,986][00169] Using port 41306 on host... [2024-08-05 09:40:07,993][00161] Using port 40706 on host... [2024-08-05 09:40:08,012][00159] Using port 40506 on host... [2024-08-05 09:40:08,040][00170] Using port 41706 on host... [2024-08-05 09:40:08,158][00167] Using port 41506 on host... [2024-08-05 09:40:08,355][00034] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 09:40:10,115][00164] Initialized w:7 v:6 player:0 [2024-08-05 09:40:10,121][00164] Decorrelating experience for 192 frames... [2024-08-05 09:40:10,133][00172] Initialized w:15 v:6 player:0 [2024-08-05 09:40:10,135][00172] Decorrelating experience for 192 frames... [2024-08-05 09:40:10,156][00163] Initialized w:5 v:6 player:0 [2024-08-05 09:40:10,158][00163] Decorrelating experience for 192 frames... [2024-08-05 09:40:10,185][00168] Initialized w:11 v:6 player:0 [2024-08-05 09:40:10,187][00168] Decorrelating experience for 192 frames... [2024-08-05 09:40:10,193][00171] Initialized w:13 v:6 player:0 [2024-08-05 09:40:10,201][00171] Decorrelating experience for 192 frames... [2024-08-05 09:40:10,269][00166] Initialized w:8 v:6 player:0 [2024-08-05 09:40:10,271][00166] Decorrelating experience for 192 frames... [2024-08-05 09:40:10,306][00165] Initialized w:9 v:6 player:0 [2024-08-05 09:40:10,308][00162] Initialized w:6 v:6 player:0 [2024-08-05 09:40:10,310][00162] Decorrelating experience for 192 frames... [2024-08-05 09:40:10,312][00165] Decorrelating experience for 192 frames... [2024-08-05 09:40:10,348][00158] Initialized w:1 v:6 player:0 [2024-08-05 09:40:10,354][00160] Initialized w:3 v:6 player:0 [2024-08-05 09:40:10,360][00160] Decorrelating experience for 192 frames... [2024-08-05 09:40:10,364][00156] Initialized w:0 v:6 player:0 [2024-08-05 09:40:10,372][00156] Decorrelating experience for 192 frames... [2024-08-05 09:40:10,361][00158] Decorrelating experience for 192 frames... [2024-08-05 09:40:10,406][00161] Initialized w:4 v:6 player:0 [2024-08-05 09:40:10,408][00161] Decorrelating experience for 192 frames... [2024-08-05 09:40:10,461][00159] Initialized w:2 v:6 player:0 [2024-08-05 09:40:10,463][00159] Decorrelating experience for 192 frames... [2024-08-05 09:40:10,481][00169] Initialized w:10 v:6 player:0 [2024-08-05 09:40:10,483][00169] Decorrelating experience for 192 frames... [2024-08-05 09:40:10,527][00170] Initialized w:14 v:6 player:0 [2024-08-05 09:40:10,529][00170] Decorrelating experience for 192 frames... [2024-08-05 09:40:10,746][00167] Initialized w:12 v:6 player:0 [2024-08-05 09:40:10,748][00167] Decorrelating experience for 192 frames... [2024-08-05 09:40:12,439][00162] Using port 40907 on host... [2024-08-05 09:40:12,467][00166] Using port 41107 on host... [2024-08-05 09:40:12,568][00161] Using port 40707 on host... [2024-08-05 09:40:12,629][00156] Using port 40307 on host... [2024-08-05 09:40:12,674][00172] Using port 41807 on host... [2024-08-05 09:40:12,704][00170] Using port 41707 on host... [2024-08-05 09:40:12,731][00164] Using port 41007 on host... [2024-08-05 09:40:12,741][00159] Using port 40507 on host... [2024-08-05 09:40:12,760][00160] Using port 40607 on host... [2024-08-05 09:40:12,793][00168] Using port 41407 on host... [2024-08-05 09:40:12,818][00169] Using port 41307 on host... [2024-08-05 09:40:12,831][00167] Using port 41507 on host... [2024-08-05 09:40:12,951][00163] Using port 40807 on host... [2024-08-05 09:40:12,992][00171] Using port 41607 on host... [2024-08-05 09:40:13,120][00165] Using port 41207 on host... [2024-08-05 09:40:13,131][00158] Using port 40407 on host... [2024-08-05 09:40:13,355][00034] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 09:40:14,693][00162] Initialized w:6 v:7 player:0 [2024-08-05 09:40:14,701][00162] Decorrelating experience for 224 frames... [2024-08-05 09:40:14,752][00166] Initialized w:8 v:7 player:0 [2024-08-05 09:40:14,754][00166] Decorrelating experience for 224 frames... [2024-08-05 09:40:14,808][00172] Initialized w:15 v:7 player:0 [2024-08-05 09:40:14,810][00172] Decorrelating experience for 224 frames... [2024-08-05 09:40:14,851][00161] Initialized w:4 v:7 player:0 [2024-08-05 09:40:14,852][00161] Decorrelating experience for 224 frames... [2024-08-05 09:40:14,861][00170] Initialized w:14 v:7 player:0 [2024-08-05 09:40:14,863][00170] Decorrelating experience for 224 frames... [2024-08-05 09:40:14,863][00160] Initialized w:3 v:7 player:0 [2024-08-05 09:40:14,865][00160] Decorrelating experience for 224 frames... [2024-08-05 09:40:14,888][00164] Initialized w:7 v:7 player:0 [2024-08-05 09:40:14,891][00164] Decorrelating experience for 224 frames... [2024-08-05 09:40:14,911][00159] Initialized w:2 v:7 player:0 [2024-08-05 09:40:14,914][00168] Initialized w:11 v:7 player:0 [2024-08-05 09:40:14,915][00159] Decorrelating experience for 224 frames... [2024-08-05 09:40:14,922][00168] Decorrelating experience for 224 frames... [2024-08-05 09:40:14,983][00169] Initialized w:10 v:7 player:0 [2024-08-05 09:40:14,989][00169] Decorrelating experience for 224 frames... [2024-08-05 09:40:15,003][00156] Initialized w:0 v:7 player:0 [2024-08-05 09:40:15,005][00156] Decorrelating experience for 224 frames... [2024-08-05 09:40:15,068][00163] Initialized w:5 v:7 player:0 [2024-08-05 09:40:15,070][00163] Decorrelating experience for 224 frames... [2024-08-05 09:40:15,099][00171] Initialized w:13 v:7 player:0 [2024-08-05 09:40:15,101][00171] Decorrelating experience for 224 frames... [2024-08-05 09:40:15,131][00167] Initialized w:12 v:7 player:0 [2024-08-05 09:40:15,136][00167] Decorrelating experience for 224 frames... [2024-08-05 09:40:15,244][00165] Initialized w:9 v:7 player:0 [2024-08-05 09:40:15,246][00165] Decorrelating experience for 224 frames... [2024-08-05 09:40:15,267][00158] Initialized w:1 v:7 player:0 [2024-08-05 09:40:15,269][00158] Decorrelating experience for 224 frames... [2024-08-05 09:40:17,026][00166] Port 41108 is available [2024-08-05 09:40:17,030][00166] Using port 41108 [2024-08-05 09:40:17,041][00162] Port 40908 is available [2024-08-05 09:40:17,046][00162] Using port 40908 [2024-08-05 09:40:17,091][00172] Port 41808 is available [2024-08-05 09:40:17,098][00172] Using port 41808 [2024-08-05 09:40:17,148][00164] Port 41008 is available [2024-08-05 09:40:17,152][00164] Using port 41008 [2024-08-05 09:40:17,193][00170] Port 41708 is available [2024-08-05 09:40:17,193][00170] Using port 41708 [2024-08-05 09:40:17,207][00161] Port 40708 is available [2024-08-05 09:40:17,212][00161] Using port 40708 [2024-08-05 09:40:17,216][00162] Port 40909 is available [2024-08-05 09:40:17,219][00160] Port 40608 is available [2024-08-05 09:40:17,225][00162] Using port 40909 [2024-08-05 09:40:17,219][00166] Port 41109 is available [2024-08-05 09:40:17,225][00160] Using port 40608 [2024-08-05 09:40:17,226][00166] Using port 41109 [2024-08-05 09:40:17,242][00172] Port 41809 is available [2024-08-05 09:40:17,250][00172] Using port 41809 [2024-08-05 09:40:17,244][00168] Port 41408 is available [2024-08-05 09:40:17,253][00168] Using port 41408 [2024-08-05 09:40:17,269][00163] Port 40808 is available [2024-08-05 09:40:17,280][00163] Using port 40808 [2024-08-05 09:40:17,279][00169] Port 41308 is available [2024-08-05 09:40:17,286][00169] Using port 41308 [2024-08-05 09:40:17,310][00159] Port 40508 is available [2024-08-05 09:40:17,312][00164] Port 41009 is available [2024-08-05 09:40:17,317][00159] Using port 40508 [2024-08-05 09:40:17,318][00164] Using port 41009 [2024-08-05 09:40:17,367][00170] Port 41709 is available [2024-08-05 09:40:17,367][00167] Port 41508 is available [2024-08-05 09:40:17,372][00167] Using port 41508 [2024-08-05 09:40:17,369][00170] Using port 41709 [2024-08-05 09:40:17,368][00161] Port 40709 is available [2024-08-05 09:40:17,376][00161] Using port 40709 [2024-08-05 09:40:17,383][00160] Port 40609 is available [2024-08-05 09:40:17,384][00160] Using port 40609 [2024-08-05 09:40:17,386][00166] Port 41110 is available [2024-08-05 09:40:17,392][00162] Port 40910 is available [2024-08-05 09:40:17,392][00166] Using port 41110 [2024-08-05 09:40:17,392][00162] Using port 40910 [2024-08-05 09:40:17,397][00172] Port 41810 is available [2024-08-05 09:40:17,407][00172] Using port 41810 [2024-08-05 09:40:17,414][00168] Port 41409 is available [2024-08-05 09:40:17,415][00168] Using port 41409 [2024-08-05 09:40:17,438][00169] Port 41309 is available [2024-08-05 09:40:17,449][00169] Using port 41309 [2024-08-05 09:40:17,450][00163] Port 40809 is available [2024-08-05 09:40:17,451][00163] Using port 40809 [2024-08-05 09:40:17,452][00156] Port 40308 is available [2024-08-05 09:40:17,464][00156] Using port 40308 [2024-08-05 09:40:17,464][00165] Port 41208 is available [2024-08-05 09:40:17,471][00165] Using port 41208 [2024-08-05 09:40:17,471][00164] Port 41010 is available [2024-08-05 09:40:17,474][00164] Using port 41010 [2024-08-05 09:40:17,467][00171] Port 41608 is available [2024-08-05 09:40:17,478][00171] Using port 41608 [2024-08-05 09:40:17,481][00159] Port 40509 is available [2024-08-05 09:40:17,481][00159] Using port 40509 [2024-08-05 09:40:17,522][00167] Port 41509 is available [2024-08-05 09:40:17,526][00167] Using port 41509 [2024-08-05 09:40:17,532][00161] Port 40710 is available [2024-08-05 09:40:17,532][00161] Using port 40710 [2024-08-05 09:40:17,537][00170] Port 41710 is available [2024-08-05 09:40:17,538][00170] Using port 41710 [2024-08-05 09:40:17,538][00160] Port 40610 is available [2024-08-05 09:40:17,543][00166] Port 41111 is available [2024-08-05 09:40:17,543][00166] Using port 41111 [2024-08-05 09:40:17,543][00160] Using port 40610 [2024-08-05 09:40:17,554][00162] Port 40911 is available [2024-08-05 09:40:17,558][00162] Using port 40911 [2024-08-05 09:40:17,561][00168] Port 41410 is available [2024-08-05 09:40:17,569][00168] Using port 41410 [2024-08-05 09:40:17,568][00172] Port 41811 is available [2024-08-05 09:40:17,574][00172] Using port 41811 [2024-08-05 09:40:17,573][00158] Port 40408 is available [2024-08-05 09:40:17,580][00158] Using port 40408 [2024-08-05 09:40:17,600][00163] Port 40810 is available [2024-08-05 09:40:17,606][00169] Port 41310 is available [2024-08-05 09:40:17,609][00169] Using port 41310 [2024-08-05 09:40:17,609][00163] Using port 40810 [2024-08-05 09:40:17,603][00156] Port 40309 is available [2024-08-05 09:40:17,616][00156] Using port 40309 [2024-08-05 09:40:17,618][00165] Port 41209 is available [2024-08-05 09:40:17,625][00165] Using port 41209 [2024-08-05 09:40:17,625][00171] Port 41609 is available [2024-08-05 09:40:17,631][00171] Using port 41609 [2024-08-05 09:40:17,631][00164] Port 41011 is available [2024-08-05 09:40:17,632][00164] Using port 41011 [2024-08-05 09:40:17,644][00159] Port 40510 is available [2024-08-05 09:40:17,644][00159] Using port 40510 [2024-08-05 09:40:17,680][00167] Port 41510 is available [2024-08-05 09:40:17,681][00161] Port 40711 is available [2024-08-05 09:40:17,684][00167] Using port 41510 [2024-08-05 09:40:17,684][00161] Using port 40711 [2024-08-05 09:40:17,699][00160] Port 40611 is available [2024-08-05 09:40:17,703][00160] Using port 40611 [2024-08-05 09:40:17,707][00166] Port 41112 is available [2024-08-05 09:40:17,717][00166] Using port 41112 [2024-08-05 09:40:17,708][00170] Port 41711 is available [2024-08-05 09:40:17,720][00170] Using port 41711 [2024-08-05 09:40:17,725][00162] Port 40912 is available [2024-08-05 09:40:17,728][00162] Using port 40912 [2024-08-05 09:40:17,733][00168] Port 41411 is available [2024-08-05 09:40:17,733][00168] Using port 41411 [2024-08-05 09:40:17,741][00172] Port 41812 is available [2024-08-05 09:40:17,744][00172] Using port 41812 [2024-08-05 09:40:17,747][00158] Port 40409 is available [2024-08-05 09:40:17,753][00158] Using port 40409 [2024-08-05 09:40:17,769][00163] Port 40811 is available [2024-08-05 09:40:17,774][00163] Using port 40811 [2024-08-05 09:40:17,771][00156] Port 40310 is available [2024-08-05 09:40:17,779][00156] Using port 40310 [2024-08-05 09:40:17,772][00169] Port 41311 is available [2024-08-05 09:40:17,780][00169] Using port 41311 [2024-08-05 09:40:17,788][00165] Port 41210 is available [2024-08-05 09:40:17,791][00165] Using port 41210 [2024-08-05 09:40:17,797][00171] Port 41610 is available [2024-08-05 09:40:17,797][00171] Using port 41610 [2024-08-05 09:40:17,800][00164] Port 41012 is available [2024-08-05 09:40:17,806][00164] Using port 41012 [2024-08-05 09:40:17,803][00159] Port 40511 is available [2024-08-05 09:40:17,814][00159] Using port 40511 [2024-08-05 09:40:17,831][00161] Port 40712 is available [2024-08-05 09:40:17,834][00167] Port 41511 is available [2024-08-05 09:40:17,841][00161] Using port 40712 [2024-08-05 09:40:17,842][00167] Using port 41511 [2024-08-05 09:40:17,857][00160] Port 40612 is available [2024-08-05 09:40:17,865][00160] Using port 40612 [2024-08-05 09:40:17,875][00166] Port 41113 is available [2024-08-05 09:40:17,876][00166] Using port 41113 [2024-08-05 09:40:17,871][00170] Port 41712 is available [2024-08-05 09:40:17,885][00170] Using port 41712 [2024-08-05 09:40:17,892][00168] Port 41412 is available [2024-08-05 09:40:17,895][00168] Using port 41412 [2024-08-05 09:40:17,892][00162] Port 40913 is available [2024-08-05 09:40:17,898][00162] Using port 40913 [2024-08-05 09:40:17,895][00172] Port 41813 is available [2024-08-05 09:40:17,907][00172] Using port 41813 [2024-08-05 09:40:17,912][00158] Port 40410 is available [2024-08-05 09:40:17,918][00158] Using port 40410 [2024-08-05 09:40:17,925][00163] Port 40812 is available [2024-08-05 09:40:17,928][00163] Using port 40812 [2024-08-05 09:40:17,937][00156] Port 40311 is available [2024-08-05 09:40:17,937][00156] Using port 40311 [2024-08-05 09:40:17,935][00169] Port 41312 is available [2024-08-05 09:40:17,943][00165] Port 41211 is available [2024-08-05 09:40:17,943][00169] Using port 41312 [2024-08-05 09:40:17,944][00165] Using port 41211 [2024-08-05 09:40:17,948][00171] Port 41611 is available [2024-08-05 09:40:17,951][00171] Using port 41611 [2024-08-05 09:40:17,954][00164] Port 41013 is available [2024-08-05 09:40:17,963][00164] Using port 41013 [2024-08-05 09:40:17,971][00159] Port 40512 is available [2024-08-05 09:40:17,975][00159] Using port 40512 [2024-08-05 09:40:17,990][00167] Port 41512 is available [2024-08-05 09:40:17,992][00167] Using port 41512 [2024-08-05 09:40:17,993][00161] Port 40713 is available [2024-08-05 09:40:18,001][00161] Using port 40713 [2024-08-05 09:40:18,013][00160] Port 40613 is available [2024-08-05 09:40:18,021][00160] Using port 40613 [2024-08-05 09:40:18,018][00166] Port 41114 is available [2024-08-05 09:40:18,024][00166] Using port 41114 [2024-08-05 09:40:18,041][00170] Port 41713 is available [2024-08-05 09:40:18,045][00170] Using port 41713 [2024-08-05 09:40:18,055][00168] Port 41413 is available [2024-08-05 09:40:18,057][00168] Using port 41413 [2024-08-05 09:40:18,066][00172] Port 41814 is available [2024-08-05 09:40:18,063][00162] Port 40914 is available [2024-08-05 09:40:18,068][00162] Using port 40914 [2024-08-05 09:40:18,067][00172] Using port 41814 [2024-08-05 09:40:18,077][00158] Port 40411 is available [2024-08-05 09:40:18,084][00158] Using port 40411 [2024-08-05 09:40:18,090][00163] Port 40813 is available [2024-08-05 09:40:18,091][00163] Using port 40813 [2024-08-05 09:40:18,086][00156] Port 40312 is available [2024-08-05 09:40:18,091][00156] Using port 40312 [2024-08-05 09:40:18,101][00165] Port 41212 is available [2024-08-05 09:40:18,105][00165] Using port 41212 [2024-08-05 09:40:18,108][00169] Port 41313 is available [2024-08-05 09:40:18,110][00169] Using port 41313 [2024-08-05 09:40:18,104][00171] Port 41612 is available [2024-08-05 09:40:18,113][00171] Using port 41612 [2024-08-05 09:40:18,123][00164] Port 41014 is available [2024-08-05 09:40:18,126][00164] Using port 41014 [2024-08-05 09:40:18,142][00159] Port 40513 is available [2024-08-05 09:40:18,146][00159] Using port 40513 [2024-08-05 09:40:18,144][00167] Port 41513 is available [2024-08-05 09:40:18,150][00167] Using port 41513 [2024-08-05 09:40:18,149][00161] Port 40714 is available [2024-08-05 09:40:18,160][00161] Using port 40714 [2024-08-05 09:40:18,171][00166] Port 41115 is available [2024-08-05 09:40:18,178][00166] Using port 41115 [2024-08-05 09:40:18,184][00166] Using port 41108 on host... [2024-08-05 09:40:18,187][00160] Port 40614 is available [2024-08-05 09:40:18,190][00160] Using port 40614 [2024-08-05 09:40:18,202][00170] Port 41714 is available [2024-08-05 09:40:18,210][00170] Using port 41714 [2024-08-05 09:40:18,216][00168] Port 41414 is available [2024-08-05 09:40:18,221][00168] Using port 41414 [2024-08-05 09:40:18,217][00172] Port 41815 is available [2024-08-05 09:40:18,224][00172] Using port 41815 [2024-08-05 09:40:18,226][00162] Port 40915 is available [2024-08-05 09:40:18,234][00162] Using port 40915 [2024-08-05 09:40:18,237][00172] Using port 41808 on host... [2024-08-05 09:40:18,241][00162] Using port 40908 on host... [2024-08-05 09:40:18,236][00158] Port 40412 is available [2024-08-05 09:40:18,242][00158] Using port 40412 [2024-08-05 09:40:18,245][00156] Port 40313 is available [2024-08-05 09:40:18,245][00156] Using port 40313 [2024-08-05 09:40:18,247][00163] Port 40814 is available [2024-08-05 09:40:18,252][00163] Using port 40814 [2024-08-05 09:40:18,260][00165] Port 41213 is available [2024-08-05 09:40:18,261][00165] Using port 41213 [2024-08-05 09:40:18,264][00171] Port 41613 is available [2024-08-05 09:40:18,268][00171] Using port 41613 [2024-08-05 09:40:18,274][00169] Port 41314 is available [2024-08-05 09:40:18,274][00169] Using port 41314 [2024-08-05 09:40:18,283][00164] Port 41015 is available [2024-08-05 09:40:18,286][00164] Using port 41015 [2024-08-05 09:40:18,291][00164] Using port 41008 on host... [2024-08-05 09:40:18,309][00159] Port 40514 is available [2024-08-05 09:40:18,309][00159] Using port 40514 [2024-08-05 09:40:18,307][00167] Port 41514 is available [2024-08-05 09:40:18,311][00167] Using port 41514 [2024-08-05 09:40:18,310][00161] Port 40715 is available [2024-08-05 09:40:18,317][00161] Using port 40715 [2024-08-05 09:40:18,322][00161] Using port 40708 on host... [2024-08-05 09:40:18,339][00160] Port 40615 is available [2024-08-05 09:40:18,346][00160] Using port 40615 [2024-08-05 09:40:18,348][00160] Using port 40608 on host... [2024-08-05 09:40:18,355][00034] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 09:40:18,360][00168] Port 41415 is available [2024-08-05 09:40:18,363][00168] Using port 41415 [2024-08-05 09:40:18,365][00168] Using port 41408 on host... [2024-08-05 09:40:18,383][00170] Port 41715 is available [2024-08-05 09:40:18,386][00170] Using port 41715 [2024-08-05 09:40:18,395][00170] Using port 41708 on host... [2024-08-05 09:40:18,392][00156] Port 40314 is available [2024-08-05 09:40:18,397][00156] Using port 40314 [2024-08-05 09:40:18,401][00158] Port 40413 is available [2024-08-05 09:40:18,412][00158] Using port 40413 [2024-08-05 09:40:18,422][00165] Port 41214 is available [2024-08-05 09:40:18,429][00165] Using port 41214 [2024-08-05 09:40:18,429][00171] Port 41614 is available [2024-08-05 09:40:18,436][00171] Using port 41614 [2024-08-05 09:40:18,433][00163] Port 40815 is available [2024-08-05 09:40:18,437][00163] Using port 40815 [2024-08-05 09:40:18,432][00169] Port 41315 is available [2024-08-05 09:40:18,441][00169] Using port 41315 [2024-08-05 09:40:18,445][00169] Using port 41308 on host... [2024-08-05 09:40:18,441][00163] Using port 40808 on host... [2024-08-05 09:40:18,454][00167] Port 41515 is available [2024-08-05 09:40:18,462][00167] Using port 41515 [2024-08-05 09:40:18,467][00159] Port 40515 is available [2024-08-05 09:40:18,469][00159] Using port 40515 [2024-08-05 09:40:18,469][00167] Using port 41508 on host... [2024-08-05 09:40:18,475][00159] Using port 40508 on host... [2024-08-05 09:40:18,548][00156] Port 40315 is available [2024-08-05 09:40:18,552][00156] Using port 40315 [2024-08-05 09:40:18,555][00158] Port 40414 is available [2024-08-05 09:40:18,556][00158] Using port 40414 [2024-08-05 09:40:18,554][00156] Using port 40308 on host... [2024-08-05 09:40:18,571][00165] Port 41215 is available [2024-08-05 09:40:18,572][00165] Using port 41215 [2024-08-05 09:40:18,574][00165] Using port 41208 on host... [2024-08-05 09:40:18,580][00171] Port 41615 is available [2024-08-05 09:40:18,584][00171] Using port 41615 [2024-08-05 09:40:18,587][00171] Using port 41608 on host... [2024-08-05 09:40:18,685][00158] Port 40415 is available [2024-08-05 09:40:18,694][00158] Using port 40415 [2024-08-05 09:40:18,696][00158] Using port 40408 on host... [2024-08-05 09:40:20,196][00166] Initialized w:8 v:8 player:0 [2024-08-05 09:40:20,198][00166] Decorrelating experience for 256 frames... [2024-08-05 09:40:20,280][00172] Initialized w:15 v:8 player:0 [2024-08-05 09:40:20,282][00172] Decorrelating experience for 256 frames... [2024-08-05 09:40:20,352][00162] Initialized w:6 v:8 player:0 [2024-08-05 09:40:20,354][00162] Decorrelating experience for 256 frames... [2024-08-05 09:40:20,354][00164] Initialized w:7 v:8 player:0 [2024-08-05 09:40:20,357][00164] Decorrelating experience for 256 frames... [2024-08-05 09:40:20,393][00161] Initialized w:4 v:8 player:0 [2024-08-05 09:40:20,394][00161] Decorrelating experience for 256 frames... [2024-08-05 09:40:20,453][00160] Initialized w:3 v:8 player:0 [2024-08-05 09:40:20,455][00160] Decorrelating experience for 256 frames... [2024-08-05 09:40:20,472][00168] Initialized w:11 v:8 player:0 [2024-08-05 09:40:20,474][00168] Decorrelating experience for 256 frames... [2024-08-05 09:40:20,491][00163] Initialized w:5 v:8 player:0 [2024-08-05 09:40:20,497][00163] Decorrelating experience for 256 frames... [2024-08-05 09:40:20,503][00170] Initialized w:14 v:8 player:0 [2024-08-05 09:40:20,504][00170] Decorrelating experience for 256 frames... [2024-08-05 09:40:20,549][00167] Initialized w:12 v:8 player:0 [2024-08-05 09:40:20,550][00169] Initialized w:10 v:8 player:0 [2024-08-05 09:40:20,553][00169] Decorrelating experience for 256 frames... [2024-08-05 09:40:20,551][00167] Decorrelating experience for 256 frames... [2024-08-05 09:40:20,634][00171] Initialized w:13 v:8 player:0 [2024-08-05 09:40:20,636][00171] Decorrelating experience for 256 frames... [2024-08-05 09:40:20,643][00165] Initialized w:9 v:8 player:0 [2024-08-05 09:40:20,645][00165] Decorrelating experience for 256 frames... [2024-08-05 09:40:20,693][00159] Initialized w:2 v:8 player:0 [2024-08-05 09:40:20,695][00159] Decorrelating experience for 256 frames... [2024-08-05 09:40:20,732][00156] Initialized w:0 v:8 player:0 [2024-08-05 09:40:20,733][00156] Decorrelating experience for 256 frames... [2024-08-05 09:40:20,806][00158] Initialized w:1 v:8 player:0 [2024-08-05 09:40:20,811][00158] Decorrelating experience for 256 frames... [2024-08-05 09:40:22,584][00166] Using port 41109 on host... [2024-08-05 09:40:22,680][00172] Using port 41809 on host... [2024-08-05 09:40:22,727][00161] Using port 40709 on host... [2024-08-05 09:40:22,758][00162] Using port 40909 on host... [2024-08-05 09:40:22,808][00164] Using port 41009 on host... [2024-08-05 09:40:22,844][00167] Using port 41509 on host... [2024-08-05 09:40:22,866][00163] Using port 40809 on host... [2024-08-05 09:40:22,877][00160] Using port 40609 on host... [2024-08-05 09:40:22,895][00168] Using port 41409 on host... [2024-08-05 09:40:22,938][00169] Using port 41309 on host... [2024-08-05 09:40:23,024][00165] Using port 41209 on host... [2024-08-05 09:40:23,086][00156] Using port 40309 on host... [2024-08-05 09:40:23,090][00171] Using port 41609 on host... [2024-08-05 09:40:23,095][00170] Using port 41709 on host... [2024-08-05 09:40:23,181][00159] Using port 40509 on host... [2024-08-05 09:40:23,181][00158] Using port 40409 on host... [2024-08-05 09:40:23,355][00034] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 09:40:24,734][00166] Initialized w:8 v:9 player:0 [2024-08-05 09:40:24,737][00166] Decorrelating experience for 288 frames... [2024-08-05 09:40:24,797][00172] Initialized w:15 v:9 player:0 [2024-08-05 09:40:24,802][00172] Decorrelating experience for 288 frames... [2024-08-05 09:40:24,892][00161] Initialized w:4 v:9 player:0 [2024-08-05 09:40:24,891][00164] Initialized w:7 v:9 player:0 [2024-08-05 09:40:24,894][00161] Decorrelating experience for 288 frames... [2024-08-05 09:40:24,897][00164] Decorrelating experience for 288 frames... [2024-08-05 09:40:24,991][00163] Initialized w:5 v:9 player:0 [2024-08-05 09:40:24,993][00163] Decorrelating experience for 288 frames... [2024-08-05 09:40:25,010][00168] Initialized w:11 v:9 player:0 [2024-08-05 09:40:25,012][00168] Decorrelating experience for 288 frames... [2024-08-05 09:40:25,024][00160] Initialized w:3 v:9 player:0 [2024-08-05 09:40:25,026][00160] Decorrelating experience for 288 frames... [2024-08-05 09:40:25,036][00162] Initialized w:6 v:9 player:0 [2024-08-05 09:40:25,037][00167] Initialized w:12 v:9 player:0 [2024-08-05 09:40:25,038][00162] Decorrelating experience for 288 frames... [2024-08-05 09:40:25,040][00167] Decorrelating experience for 288 frames... [2024-08-05 09:40:25,113][00169] Initialized w:10 v:9 player:0 [2024-08-05 09:40:25,126][00169] Decorrelating experience for 288 frames... [2024-08-05 09:40:25,144][00165] Initialized w:9 v:9 player:0 [2024-08-05 09:40:25,146][00165] Decorrelating experience for 288 frames... [2024-08-05 09:40:25,234][00171] Initialized w:13 v:9 player:0 [2024-08-05 09:40:25,236][00171] Decorrelating experience for 288 frames... [2024-08-05 09:40:25,283][00170] Initialized w:14 v:9 player:0 [2024-08-05 09:40:25,285][00170] Decorrelating experience for 288 frames... [2024-08-05 09:40:25,293][00156] Initialized w:0 v:9 player:0 [2024-08-05 09:40:25,298][00156] Decorrelating experience for 288 frames... [2024-08-05 09:40:25,338][00158] Initialized w:1 v:9 player:0 [2024-08-05 09:40:25,346][00159] Initialized w:2 v:9 player:0 [2024-08-05 09:40:25,340][00158] Decorrelating experience for 288 frames... [2024-08-05 09:40:25,348][00159] Decorrelating experience for 288 frames... [2024-08-05 09:40:26,945][00166] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 09:40:27,425][00172] Using port 41810 on host... [2024-08-05 09:40:27,503][00166] Using port 41110 on host... [2024-08-05 09:40:27,514][00161] Using port 40710 on host... [2024-08-05 09:40:27,539][00164] Using port 41010 on host... [2024-08-05 09:40:27,619][00168] Using port 41410 on host... [2024-08-05 09:40:27,656][00163] Using port 40810 on host... [2024-08-05 09:40:27,674][00160] Using port 40610 on host... [2024-08-05 09:40:27,706][00162] Using port 40910 on host... [2024-08-05 09:40:27,717][00167] Using port 41510 on host... [2024-08-05 09:40:27,792][00165] Using port 41210 on host... [2024-08-05 09:40:27,804][00169] Using port 41310 on host... [2024-08-05 09:40:27,886][00156] Using port 40310 on host... [2024-08-05 09:40:27,918][00171] Using port 41610 on host... [2024-08-05 09:40:27,935][00158] Using port 40410 on host... [2024-08-05 09:40:28,010][00170] Using port 41710 on host... [2024-08-05 09:40:28,050][00159] Using port 40510 on host... [2024-08-05 09:40:28,355][00034] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 09:40:29,484][00172] Initialized w:15 v:10 player:0 [2024-08-05 09:40:29,486][00172] Decorrelating experience for 320 frames... [2024-08-05 09:40:29,612][00166] Initialized w:8 v:10 player:0 [2024-08-05 09:40:29,614][00166] Decorrelating experience for 320 frames... [2024-08-05 09:40:29,635][00161] Initialized w:4 v:10 player:0 [2024-08-05 09:40:29,637][00161] Decorrelating experience for 320 frames... [2024-08-05 09:40:29,642][00164] Initialized w:7 v:10 player:0 [2024-08-05 09:40:29,645][00168] Initialized w:11 v:10 player:0 [2024-08-05 09:40:29,644][00164] Decorrelating experience for 320 frames... [2024-08-05 09:40:29,649][00168] Decorrelating experience for 320 frames... [2024-08-05 09:40:29,750][00163] Initialized w:5 v:10 player:0 [2024-08-05 09:40:29,752][00163] Decorrelating experience for 320 frames... [2024-08-05 09:40:29,762][00160] Initialized w:3 v:10 player:0 [2024-08-05 09:40:29,764][00160] Decorrelating experience for 320 frames... [2024-08-05 09:40:29,811][00167] Initialized w:12 v:10 player:0 [2024-08-05 09:40:29,812][00167] Decorrelating experience for 320 frames... [2024-08-05 09:40:29,834][00165] Initialized w:9 v:10 player:0 [2024-08-05 09:40:29,836][00165] Decorrelating experience for 320 frames... [2024-08-05 09:40:29,846][00162] Initialized w:6 v:10 player:0 [2024-08-05 09:40:29,848][00162] Decorrelating experience for 320 frames... [2024-08-05 09:40:29,938][00169] Initialized w:10 v:10 player:0 [2024-08-05 09:40:29,943][00169] Decorrelating experience for 320 frames... [2024-08-05 09:40:29,992][00171] Initialized w:13 v:10 player:0 [2024-08-05 09:40:29,995][00171] Decorrelating experience for 320 frames... [2024-08-05 09:40:30,016][00156] Initialized w:0 v:10 player:0 [2024-08-05 09:40:30,019][00156] Decorrelating experience for 320 frames... [2024-08-05 09:40:30,048][00158] Initialized w:1 v:10 player:0 [2024-08-05 09:40:30,051][00158] Decorrelating experience for 320 frames... [2024-08-05 09:40:30,123][00170] Initialized w:14 v:10 player:0 [2024-08-05 09:40:30,125][00170] Decorrelating experience for 320 frames... [2024-08-05 09:40:30,181][00159] Initialized w:2 v:10 player:0 [2024-08-05 09:40:30,187][00159] Decorrelating experience for 320 frames... [2024-08-05 09:40:32,403][00172] Using port 41811 on host... [2024-08-05 09:40:32,439][00161] Using port 40711 on host... [2024-08-05 09:40:32,447][00166] Using port 41111 on host... [2024-08-05 09:40:32,555][00164] Using port 41011 on host... [2024-08-05 09:40:32,618][00168] Using port 41411 on host... [2024-08-05 09:40:32,645][00163] Using port 40811 on host... [2024-08-05 09:40:32,659][00160] Using port 40611 on host... [2024-08-05 09:40:32,710][00165] Using port 41211 on host... [2024-08-05 09:40:32,755][00167] Using port 41511 on host... [2024-08-05 09:40:32,858][00162] Using port 40911 on host... [2024-08-05 09:40:32,894][00171] Using port 41611 on host... [2024-08-05 09:40:32,930][00156] Using port 40311 on host... [2024-08-05 09:40:32,957][00158] Using port 40411 on host... [2024-08-05 09:40:33,054][00169] Using port 41311 on host... [2024-08-05 09:40:33,085][00170] Using port 41711 on host... [2024-08-05 09:40:33,200][00159] Using port 40511 on host... [2024-08-05 09:40:33,355][00034] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 09:40:34,534][00161] Initialized w:4 v:11 player:0 [2024-08-05 09:40:34,542][00161] Decorrelating experience for 352 frames... [2024-08-05 09:40:34,554][00166] Initialized w:8 v:11 player:0 [2024-08-05 09:40:34,556][00166] Decorrelating experience for 352 frames... [2024-08-05 09:40:34,580][00172] Initialized w:15 v:11 player:0 [2024-08-05 09:40:34,591][00172] Decorrelating experience for 352 frames... [2024-08-05 09:40:34,674][00164] Initialized w:7 v:11 player:0 [2024-08-05 09:40:34,685][00164] Decorrelating experience for 352 frames... [2024-08-05 09:40:34,808][00168] Initialized w:11 v:11 player:0 [2024-08-05 09:40:34,811][00168] Decorrelating experience for 352 frames... [2024-08-05 09:40:34,862][00163] Initialized w:5 v:11 player:0 [2024-08-05 09:40:34,864][00163] Decorrelating experience for 352 frames... [2024-08-05 09:40:34,869][00160] Initialized w:3 v:11 player:0 [2024-08-05 09:40:34,871][00160] Decorrelating experience for 352 frames... [2024-08-05 09:40:34,912][00165] Initialized w:9 v:11 player:0 [2024-08-05 09:40:34,914][00165] Decorrelating experience for 352 frames... [2024-08-05 09:40:34,937][00167] Initialized w:12 v:11 player:0 [2024-08-05 09:40:34,939][00167] Decorrelating experience for 352 frames... [2024-08-05 09:40:35,023][00162] Initialized w:6 v:11 player:0 [2024-08-05 09:40:35,025][00162] Decorrelating experience for 352 frames... [2024-08-05 09:40:35,094][00171] Initialized w:13 v:11 player:0 [2024-08-05 09:40:35,096][00171] Decorrelating experience for 352 frames... [2024-08-05 09:40:35,131][00156] Initialized w:0 v:11 player:0 [2024-08-05 09:40:35,133][00156] Decorrelating experience for 352 frames... [2024-08-05 09:40:35,194][00169] Initialized w:10 v:11 player:0 [2024-08-05 09:40:35,195][00169] Decorrelating experience for 352 frames... [2024-08-05 09:40:35,208][00158] Initialized w:1 v:11 player:0 [2024-08-05 09:40:35,214][00170] Initialized w:14 v:11 player:0 [2024-08-05 09:40:35,215][00170] Decorrelating experience for 352 frames... [2024-08-05 09:40:35,210][00158] Decorrelating experience for 352 frames... [2024-08-05 09:40:35,371][00159] Initialized w:2 v:11 player:0 [2024-08-05 09:40:35,374][00159] Decorrelating experience for 352 frames... [2024-08-05 09:40:37,837][00166] Using port 41112 on host... [2024-08-05 09:40:37,864][00161] Using port 40712 on host... [2024-08-05 09:40:37,901][00172] Using port 41812 on host... [2024-08-05 09:40:38,008][00163] Using port 40812 on host... [2024-08-05 09:40:38,074][00168] Using port 41412 on host... [2024-08-05 09:40:38,091][00165] Using port 41212 on host... [2024-08-05 09:40:38,133][00160] Using port 40612 on host... [2024-08-05 09:40:38,138][00162] Using port 40912 on host... [2024-08-05 09:40:38,142][00167] Using port 41512 on host... [2024-08-05 09:40:38,168][00164] Using port 41012 on host... [2024-08-05 09:40:38,279][00171] Using port 41612 on host... [2024-08-05 09:40:38,294][00156] Using port 40312 on host... [2024-08-05 09:40:38,356][00034] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 09:40:38,384][00158] Using port 40412 on host... [2024-08-05 09:40:38,408][00170] Using port 41712 on host... [2024-08-05 09:40:38,441][00169] Using port 41312 on host... [2024-08-05 09:40:38,450][00159] Using port 40512 on host... [2024-08-05 09:40:40,003][00166] Initialized w:8 v:12 player:0 [2024-08-05 09:40:40,014][00161] Initialized w:4 v:12 player:0 [2024-08-05 09:40:40,005][00166] Decorrelating experience for 384 frames... [2024-08-05 09:40:40,016][00161] Decorrelating experience for 384 frames... [2024-08-05 09:40:40,025][00172] Initialized w:15 v:12 player:0 [2024-08-05 09:40:40,027][00172] Decorrelating experience for 384 frames... [2024-08-05 09:40:40,133][00163] Initialized w:5 v:12 player:0 [2024-08-05 09:40:40,135][00163] Decorrelating experience for 384 frames... [2024-08-05 09:40:40,167][00168] Initialized w:11 v:12 player:0 [2024-08-05 09:40:40,174][00168] Decorrelating experience for 384 frames... [2024-08-05 09:40:40,211][00160] Initialized w:3 v:12 player:0 [2024-08-05 09:40:40,213][00160] Decorrelating experience for 384 frames... [2024-08-05 09:40:40,222][00165] Initialized w:9 v:12 player:0 [2024-08-05 09:40:40,230][00165] Decorrelating experience for 384 frames... [2024-08-05 09:40:40,253][00162] Initialized w:6 v:12 player:0 [2024-08-05 09:40:40,255][00162] Decorrelating experience for 384 frames... [2024-08-05 09:40:40,292][00164] Initialized w:7 v:12 player:0 [2024-08-05 09:40:40,295][00164] Decorrelating experience for 384 frames... [2024-08-05 09:40:40,314][00167] Initialized w:12 v:12 player:0 [2024-08-05 09:40:40,316][00167] Decorrelating experience for 384 frames... [2024-08-05 09:40:40,374][00171] Initialized w:13 v:12 player:0 [2024-08-05 09:40:40,377][00171] Decorrelating experience for 384 frames... [2024-08-05 09:40:40,470][00169] Initialized w:10 v:12 player:0 [2024-08-05 09:40:40,473][00169] Decorrelating experience for 384 frames... [2024-08-05 09:40:40,482][00158] Initialized w:1 v:12 player:0 [2024-08-05 09:40:40,484][00158] Decorrelating experience for 384 frames... [2024-08-05 09:40:40,492][00170] Initialized w:14 v:12 player:0 [2024-08-05 09:40:40,494][00170] Decorrelating experience for 384 frames... [2024-08-05 09:40:40,499][00156] Initialized w:0 v:12 player:0 [2024-08-05 09:40:40,508][00159] Initialized w:2 v:12 player:0 [2024-08-05 09:40:40,502][00156] Decorrelating experience for 384 frames... [2024-08-05 09:40:40,510][00159] Decorrelating experience for 384 frames... [2024-08-05 09:40:43,355][00034] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 09:40:43,474][00161] Using port 40713 on host... [2024-08-05 09:40:43,527][00172] Using port 41813 on host... [2024-08-05 09:40:43,586][00166] Using port 41113 on host... [2024-08-05 09:40:43,882][00168] Using port 41413 on host... [2024-08-05 09:40:43,946][00167] Using port 41513 on host... [2024-08-05 09:40:44,059][00164] Using port 41013 on host... [2024-08-05 09:40:44,143][00160] Using port 40613 on host... [2024-08-05 09:40:44,251][00163] Using port 40813 on host... [2024-08-05 09:40:44,283][00165] Using port 41213 on host... [2024-08-05 09:40:44,314][00156] Using port 40313 on host... [2024-08-05 09:40:44,386][00171] Using port 41613 on host... [2024-08-05 09:40:44,439][00158] Using port 40413 on host... [2024-08-05 09:40:44,583][00162] Using port 40913 on host... [2024-08-05 09:40:44,656][00169] Using port 41313 on host... [2024-08-05 09:40:44,883][00170] Using port 41713 on host... [2024-08-05 09:40:44,908][00159] Using port 40513 on host... [2024-08-05 09:40:45,719][00172] Initialized w:15 v:13 player:0 [2024-08-05 09:40:45,721][00172] Decorrelating experience for 416 frames... [2024-08-05 09:40:45,997][00161] Initialized w:4 v:13 player:0 [2024-08-05 09:40:45,999][00161] Decorrelating experience for 416 frames... [2024-08-05 09:40:46,064][00166] Initialized w:8 v:13 player:0 [2024-08-05 09:40:46,066][00166] Decorrelating experience for 416 frames... [2024-08-05 09:40:46,099][00168] Initialized w:11 v:13 player:0 [2024-08-05 09:40:46,103][00168] Decorrelating experience for 416 frames... [2024-08-05 09:40:46,311][00164] Initialized w:7 v:13 player:0 [2024-08-05 09:40:46,313][00164] Decorrelating experience for 416 frames... [2024-08-05 09:40:46,397][00160] Initialized w:3 v:13 player:0 [2024-08-05 09:40:46,401][00160] Decorrelating experience for 416 frames... [2024-08-05 09:40:46,454][00163] Initialized w:5 v:13 player:0 [2024-08-05 09:40:46,457][00163] Decorrelating experience for 416 frames... [2024-08-05 09:40:46,471][00167] Initialized w:12 v:13 player:0 [2024-08-05 09:40:46,473][00167] Decorrelating experience for 416 frames... [2024-08-05 09:40:46,482][00165] Initialized w:9 v:13 player:0 [2024-08-05 09:40:46,485][00165] Decorrelating experience for 416 frames... [2024-08-05 09:40:46,569][00171] Initialized w:13 v:13 player:0 [2024-08-05 09:40:46,572][00171] Decorrelating experience for 416 frames... [2024-08-05 09:40:46,666][00158] Initialized w:1 v:13 player:0 [2024-08-05 09:40:46,668][00158] Decorrelating experience for 416 frames... [2024-08-05 09:40:46,774][00162] Initialized w:6 v:13 player:0 [2024-08-05 09:40:46,776][00162] Decorrelating experience for 416 frames... [2024-08-05 09:40:46,790][00156] Initialized w:0 v:13 player:0 [2024-08-05 09:40:46,792][00156] Decorrelating experience for 416 frames... [2024-08-05 09:40:46,830][00169] Initialized w:10 v:13 player:0 [2024-08-05 09:40:46,832][00169] Decorrelating experience for 416 frames... [2024-08-05 09:40:46,949][00170] Initialized w:14 v:13 player:0 [2024-08-05 09:40:46,951][00170] Decorrelating experience for 416 frames... [2024-08-05 09:40:46,972][00159] Initialized w:2 v:13 player:0 [2024-08-05 09:40:46,974][00159] Decorrelating experience for 416 frames... [2024-08-05 09:40:48,355][00034] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 09:40:49,701][00172] Using port 41814 on host... [2024-08-05 09:40:49,912][00168] Using port 41414 on host... [2024-08-05 09:40:49,925][00161] Using port 40714 on host... [2024-08-05 09:40:49,995][00166] Using port 41114 on host... [2024-08-05 09:40:50,171][00160] Using port 40614 on host... [2024-08-05 09:40:50,210][00164] Using port 41014 on host... [2024-08-05 09:40:50,276][00167] Using port 41514 on host... [2024-08-05 09:40:50,366][00163] Using port 40814 on host... [2024-08-05 09:40:50,476][00171] Using port 41614 on host... [2024-08-05 09:40:50,510][00169] Using port 41314 on host... [2024-08-05 09:40:50,542][00162] Using port 40914 on host... [2024-08-05 09:40:50,558][00165] Using port 41214 on host... [2024-08-05 09:40:50,580][00156] Using port 40314 on host... [2024-08-05 09:40:50,613][00158] Using port 40414 on host... [2024-08-05 09:40:50,734][00159] Using port 40514 on host... [2024-08-05 09:40:50,819][00170] Using port 41714 on host... [2024-08-05 09:40:51,861][00172] Initialized w:15 v:14 player:0 [2024-08-05 09:40:51,864][00172] Decorrelating experience for 448 frames... [2024-08-05 09:40:52,023][00168] Initialized w:11 v:14 player:0 [2024-08-05 09:40:52,025][00168] Decorrelating experience for 448 frames... [2024-08-05 09:40:52,037][00161] Initialized w:4 v:14 player:0 [2024-08-05 09:40:52,040][00161] Decorrelating experience for 448 frames... [2024-08-05 09:40:52,133][00166] Initialized w:8 v:14 player:0 [2024-08-05 09:40:52,135][00166] Decorrelating experience for 448 frames... [2024-08-05 09:40:52,291][00160] Initialized w:3 v:14 player:0 [2024-08-05 09:40:52,299][00160] Decorrelating experience for 448 frames... [2024-08-05 09:40:52,359][00164] Initialized w:7 v:14 player:0 [2024-08-05 09:40:52,361][00164] Decorrelating experience for 448 frames... [2024-08-05 09:40:52,408][00167] Initialized w:12 v:14 player:0 [2024-08-05 09:40:52,415][00167] Decorrelating experience for 448 frames... [2024-08-05 09:40:52,524][00163] Initialized w:5 v:14 player:0 [2024-08-05 09:40:52,526][00163] Decorrelating experience for 448 frames... [2024-08-05 09:40:52,618][00169] Initialized w:10 v:14 player:0 [2024-08-05 09:40:52,620][00169] Decorrelating experience for 448 frames... [2024-08-05 09:40:52,622][00162] Initialized w:6 v:14 player:0 [2024-08-05 09:40:52,624][00162] Decorrelating experience for 448 frames... [2024-08-05 09:40:52,641][00171] Initialized w:13 v:14 player:0 [2024-08-05 09:40:52,644][00171] Decorrelating experience for 448 frames... [2024-08-05 09:40:52,682][00165] Initialized w:9 v:14 player:0 [2024-08-05 09:40:52,686][00165] Decorrelating experience for 448 frames... [2024-08-05 09:40:52,759][00158] Initialized w:1 v:14 player:0 [2024-08-05 09:40:52,761][00158] Decorrelating experience for 448 frames... [2024-08-05 09:40:52,795][00156] Initialized w:0 v:14 player:0 [2024-08-05 09:40:52,797][00156] Decorrelating experience for 448 frames... [2024-08-05 09:40:52,814][00159] Initialized w:2 v:14 player:0 [2024-08-05 09:40:52,816][00159] Decorrelating experience for 448 frames... [2024-08-05 09:40:52,902][00170] Initialized w:14 v:14 player:0 [2024-08-05 09:40:52,905][00170] Decorrelating experience for 448 frames... [2024-08-05 09:40:53,356][00034] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 09:40:56,054][00161] Using port 40715 on host... [2024-08-05 09:40:56,090][00172] Using port 41815 on host... [2024-08-05 09:40:56,195][00168] Using port 41415 on host... [2024-08-05 09:40:56,312][00166] Using port 41115 on host... [2024-08-05 09:40:56,380][00160] Using port 40615 on host... [2024-08-05 09:40:56,423][00167] Using port 41515 on host... [2024-08-05 09:40:56,502][00164] Using port 41015 on host... [2024-08-05 09:40:56,548][00169] Using port 41315 on host... [2024-08-05 09:40:56,716][00156] Using port 40315 on host... [2024-08-05 09:40:56,719][00163] Using port 40815 on host... [2024-08-05 09:40:56,772][00159] Using port 40515 on host... [2024-08-05 09:40:56,810][00162] Using port 40915 on host... [2024-08-05 09:40:56,862][00158] Using port 40415 on host... [2024-08-05 09:40:56,879][00170] Using port 41715 on host... [2024-08-05 09:40:56,970][00171] Using port 41615 on host... [2024-08-05 09:40:56,986][00165] Using port 41215 on host... [2024-08-05 09:40:58,160][00172] Initialized w:15 v:15 player:0 [2024-08-05 09:40:58,162][00172] Decorrelating experience for 480 frames... [2024-08-05 09:40:58,204][00161] Initialized w:4 v:15 player:0 [2024-08-05 09:40:58,206][00161] Decorrelating experience for 480 frames... [2024-08-05 09:40:58,248][00168] Initialized w:11 v:15 player:0 [2024-08-05 09:40:58,250][00168] Decorrelating experience for 480 frames... [2024-08-05 09:40:58,355][00034] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 09:40:58,386][00166] Initialized w:8 v:15 player:0 [2024-08-05 09:40:58,388][00166] Decorrelating experience for 480 frames... [2024-08-05 09:40:58,460][00160] Initialized w:3 v:15 player:0 [2024-08-05 09:40:58,467][00160] Decorrelating experience for 480 frames... [2024-08-05 09:40:58,522][00167] Initialized w:12 v:15 player:0 [2024-08-05 09:40:58,525][00167] Decorrelating experience for 480 frames... [2024-08-05 09:40:58,625][00169] Initialized w:10 v:15 player:0 [2024-08-05 09:40:58,628][00169] Decorrelating experience for 480 frames... [2024-08-05 09:40:58,664][00164] Initialized w:7 v:15 player:0 [2024-08-05 09:40:58,666][00164] Decorrelating experience for 480 frames... [2024-08-05 09:40:58,819][00163] Initialized w:5 v:15 player:0 [2024-08-05 09:40:58,821][00163] Decorrelating experience for 480 frames... [2024-08-05 09:40:58,854][00159] Initialized w:2 v:15 player:0 [2024-08-05 09:40:58,856][00159] Decorrelating experience for 480 frames... [2024-08-05 09:40:58,886][00156] Initialized w:0 v:15 player:0 [2024-08-05 09:40:58,889][00156] Decorrelating experience for 480 frames... [2024-08-05 09:40:58,916][00162] Initialized w:6 v:15 player:0 [2024-08-05 09:40:58,920][00162] Decorrelating experience for 480 frames... [2024-08-05 09:40:58,962][00158] Initialized w:1 v:15 player:0 [2024-08-05 09:40:58,964][00158] Decorrelating experience for 480 frames... [2024-08-05 09:40:58,986][00170] Initialized w:14 v:15 player:0 [2024-08-05 09:40:58,989][00170] Decorrelating experience for 480 frames... [2024-08-05 09:40:59,079][00165] Initialized w:9 v:15 player:0 [2024-08-05 09:40:59,083][00171] Initialized w:13 v:15 player:0 [2024-08-05 09:40:59,082][00165] Decorrelating experience for 480 frames... [2024-08-05 09:40:59,089][00171] Decorrelating experience for 480 frames... [2024-08-05 09:41:02,523][00034] Heartbeat connected on RolloutWorker_w4 [2024-08-05 09:41:02,697][00034] Heartbeat connected on RolloutWorker_w11 [2024-08-05 09:41:02,702][00034] Heartbeat connected on RolloutWorker_w8 [2024-08-05 09:41:02,753][00034] Heartbeat connected on RolloutWorker_w15 [2024-08-05 09:41:02,905][00034] Heartbeat connected on RolloutWorker_w3 [2024-08-05 09:41:02,933][00034] Heartbeat connected on RolloutWorker_w10 [2024-08-05 09:41:02,949][00034] Heartbeat connected on RolloutWorker_w12 [2024-08-05 09:41:02,995][00034] Heartbeat connected on RolloutWorker_w7 [2024-08-05 09:41:03,103][00034] Heartbeat connected on RolloutWorker_w5 [2024-08-05 09:41:03,138][00034] Heartbeat connected on RolloutWorker_w0 [2024-08-05 09:41:03,231][00034] Heartbeat connected on RolloutWorker_w2 [2024-08-05 09:41:03,251][00034] Heartbeat connected on RolloutWorker_w6 [2024-08-05 09:41:03,299][00034] Heartbeat connected on RolloutWorker_w14 [2024-08-05 09:41:03,345][00034] Heartbeat connected on RolloutWorker_w1 [2024-08-05 09:41:03,355][00034] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 09:41:03,402][00034] Heartbeat connected on RolloutWorker_w13 [2024-08-05 09:41:03,418][00034] Heartbeat connected on RolloutWorker_w9 [2024-08-05 09:41:08,355][00034] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 66.0. Samples: 2968. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 09:41:09,793][00136] Signal inference workers to stop experience collection... [2024-08-05 09:41:09,819][00157] InferenceWorker_p0-w0: stopping experience collection [2024-08-05 09:41:13,355][00034] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 180.8. Samples: 8136. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 09:41:14,632][00136] Signal inference workers to resume experience collection... [2024-08-05 09:41:14,633][00157] InferenceWorker_p0-w0: resuming experience collection [2024-08-05 09:41:18,355][00034] Fps is (10 sec: 3276.8, 60 sec: 546.1, 300 sec: 364.1). Total num frames: 32768. Throughput: 0: 245.3. Samples: 11040. Policy #0 lag: (min: 0.0, avg: 2.7, max: 3.0) [2024-08-05 09:41:23,356][00034] Fps is (10 sec: 5734.3, 60 sec: 955.7, 300 sec: 603.6). Total num frames: 57344. Throughput: 0: 332.6. Samples: 14968. Policy #0 lag: (min: 0.0, avg: 0.6, max: 4.0) [2024-08-05 09:41:23,374][00136] Saving /kaggle/working/train_dir/default_experiment/checkpoint_p0/checkpoint_000000008_65536.pth... [2024-08-05 09:41:28,355][00034] Fps is (10 sec: 4096.0, 60 sec: 1228.8, 300 sec: 737.3). Total num frames: 73728. Throughput: 0: 502.2. Samples: 22600. Policy #0 lag: (min: 0.0, avg: 0.8, max: 4.0) [2024-08-05 09:41:28,728][00157] Updated weights for policy 0, policy_version 10 (0.0235) [2024-08-05 09:41:33,355][00034] Fps is (10 sec: 4096.0, 60 sec: 1638.4, 300 sec: 936.2). Total num frames: 98304. Throughput: 0: 676.4. Samples: 30440. Policy #0 lag: (min: 0.0, avg: 0.8, max: 4.0) [2024-08-05 09:41:38,355][00034] Fps is (10 sec: 5734.4, 60 sec: 2184.5, 300 sec: 1191.6). Total num frames: 131072. Throughput: 0: 757.5. Samples: 34088. Policy #0 lag: (min: 1.0, avg: 2.8, max: 6.0) [2024-08-05 09:41:41,785][00157] Updated weights for policy 0, policy_version 20 (0.0020) [2024-08-05 09:41:43,355][00034] Fps is (10 sec: 6553.6, 60 sec: 2730.7, 300 sec: 1424.7). Total num frames: 163840. Throughput: 0: 931.9. Samples: 41936. Policy #0 lag: (min: 0.0, avg: 1.1, max: 4.0) [2024-08-05 09:41:48,355][00034] Fps is (10 sec: 4915.2, 60 sec: 3003.7, 300 sec: 1501.9). Total num frames: 180224. Throughput: 0: 1094.8. Samples: 49264. Policy #0 lag: (min: 0.0, avg: 0.7, max: 4.0) [2024-08-05 09:41:53,356][00034] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 1572.9). Total num frames: 196608. Throughput: 0: 1106.7. Samples: 52768. Policy #0 lag: (min: 0.0, avg: 0.7, max: 4.0) [2024-08-05 09:41:58,355][00034] Fps is (10 sec: 4915.2, 60 sec: 3822.9, 300 sec: 1764.4). Total num frames: 229376. Throughput: 0: 1161.4. Samples: 60400. Policy #0 lag: (min: 0.0, avg: 0.5, max: 4.0) [2024-08-05 09:42:00,919][00157] Updated weights for policy 0, policy_version 30 (0.0022) [2024-08-05 09:42:03,355][00034] Fps is (10 sec: 6553.7, 60 sec: 4369.1, 300 sec: 1941.8). Total num frames: 262144. Throughput: 0: 1269.5. Samples: 68168. Policy #0 lag: (min: 0.0, avg: 0.4, max: 4.0) [2024-08-05 09:42:08,355][00034] Fps is (10 sec: 6553.6, 60 sec: 4915.2, 300 sec: 2106.5). Total num frames: 294912. Throughput: 0: 1267.6. Samples: 72008. Policy #0 lag: (min: 0.0, avg: 0.6, max: 4.0) [2024-08-05 09:42:13,356][00034] Fps is (10 sec: 4096.0, 60 sec: 5051.7, 300 sec: 2090.4). Total num frames: 303104. Throughput: 0: 1270.9. Samples: 79792. Policy #0 lag: (min: 0.0, avg: 0.6, max: 4.0) [2024-08-05 09:42:15,327][00157] Updated weights for policy 0, policy_version 40 (0.0026) [2024-08-05 09:42:18,356][00034] Fps is (10 sec: 3276.8, 60 sec: 4915.2, 300 sec: 2184.5). Total num frames: 327680. Throughput: 0: 1266.0. Samples: 87408. Policy #0 lag: (min: 0.0, avg: 2.5, max: 5.0) [2024-08-05 09:42:23,356][00034] Fps is (10 sec: 5734.4, 60 sec: 5051.7, 300 sec: 2325.5). Total num frames: 360448. Throughput: 0: 1258.5. Samples: 90720. Policy #0 lag: (min: 0.0, avg: 2.6, max: 4.0) [2024-08-05 09:42:28,356][00034] Fps is (10 sec: 5734.2, 60 sec: 5188.2, 300 sec: 2406.4). Total num frames: 385024. Throughput: 0: 1254.4. Samples: 98384. Policy #0 lag: (min: 0.0, avg: 0.7, max: 4.0) [2024-08-05 09:42:33,192][00157] Updated weights for policy 0, policy_version 50 (0.0026) [2024-08-05 09:42:33,355][00034] Fps is (10 sec: 4915.2, 60 sec: 5188.3, 300 sec: 2482.4). Total num frames: 409600. Throughput: 0: 1264.5. Samples: 106168. Policy #0 lag: (min: 0.0, avg: 1.0, max: 4.0) [2024-08-05 09:42:38,355][00034] Fps is (10 sec: 4096.1, 60 sec: 4915.2, 300 sec: 2505.8). Total num frames: 425984. Throughput: 0: 1270.9. Samples: 109960. Policy #0 lag: (min: 0.0, avg: 2.3, max: 4.0) [2024-08-05 09:42:43,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 2621.4). Total num frames: 458752. Throughput: 0: 1274.8. Samples: 117768. Policy #0 lag: (min: 0.0, avg: 1.8, max: 4.0) [2024-08-05 09:42:48,355][00034] Fps is (10 sec: 5734.4, 60 sec: 5051.7, 300 sec: 2685.2). Total num frames: 483328. Throughput: 0: 1272.5. Samples: 125432. Policy #0 lag: (min: 0.0, avg: 1.3, max: 4.0) [2024-08-05 09:42:48,762][00157] Updated weights for policy 0, policy_version 60 (0.0019) [2024-08-05 09:42:53,355][00034] Fps is (10 sec: 5734.4, 60 sec: 5324.8, 300 sec: 2789.7). Total num frames: 516096. Throughput: 0: 1272.7. Samples: 129280. Policy #0 lag: (min: 0.0, avg: 0.9, max: 4.0) [2024-08-05 09:42:58,355][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 2802.5). Total num frames: 532480. Throughput: 0: 1254.8. Samples: 136256. Policy #0 lag: (min: 0.0, avg: 1.1, max: 4.0) [2024-08-05 09:43:03,355][00034] Fps is (10 sec: 4096.0, 60 sec: 4915.2, 300 sec: 2856.7). Total num frames: 557056. Throughput: 0: 1258.5. Samples: 144040. Policy #0 lag: (min: 0.0, avg: 1.8, max: 4.0) [2024-08-05 09:43:04,798][00157] Updated weights for policy 0, policy_version 70 (0.0021) [2024-08-05 09:43:08,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 2908.2). Total num frames: 581632. Throughput: 0: 1267.7. Samples: 147768. Policy #0 lag: (min: 0.0, avg: 2.6, max: 4.0) [2024-08-05 09:43:13,356][00034] Fps is (10 sec: 5734.3, 60 sec: 5188.2, 300 sec: 2997.1). Total num frames: 614400. Throughput: 0: 1272.5. Samples: 155648. Policy #0 lag: (min: 0.0, avg: 2.6, max: 6.0) [2024-08-05 09:43:18,356][00034] Fps is (10 sec: 5734.3, 60 sec: 5188.3, 300 sec: 3042.7). Total num frames: 638976. Throughput: 0: 1269.3. Samples: 163288. Policy #0 lag: (min: 0.0, avg: 1.3, max: 4.0) [2024-08-05 09:43:22,372][00157] Updated weights for policy 0, policy_version 80 (0.0020) [2024-08-05 09:43:23,356][00034] Fps is (10 sec: 4915.3, 60 sec: 5051.7, 300 sec: 3086.3). Total num frames: 663552. Throughput: 0: 1270.2. Samples: 167120. Policy #0 lag: (min: 0.0, avg: 1.2, max: 4.0) [2024-08-05 09:43:23,361][00136] Saving /kaggle/working/train_dir/default_experiment/checkpoint_p0/checkpoint_000000081_663552.pth... [2024-08-05 09:43:28,355][00034] Fps is (10 sec: 4096.0, 60 sec: 4915.2, 300 sec: 3090.6). Total num frames: 679936. Throughput: 0: 1251.4. Samples: 174080. Policy #0 lag: (min: 0.0, avg: 2.1, max: 4.0) [2024-08-05 09:43:33,356][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 3167.6). Total num frames: 712704. Throughput: 0: 1254.0. Samples: 181864. Policy #0 lag: (min: 0.0, avg: 2.0, max: 4.0) [2024-08-05 09:43:37,075][00157] Updated weights for policy 0, policy_version 90 (0.0019) [2024-08-05 09:43:38,355][00034] Fps is (10 sec: 5734.4, 60 sec: 5188.3, 300 sec: 3205.6). Total num frames: 737280. Throughput: 0: 1251.4. Samples: 185592. Policy #0 lag: (min: 0.0, avg: 1.2, max: 4.0) [2024-08-05 09:43:43,355][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 3241.9). Total num frames: 761856. Throughput: 0: 1269.2. Samples: 193368. Policy #0 lag: (min: 0.0, avg: 1.2, max: 4.0) [2024-08-05 09:43:48,355][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 3276.8). Total num frames: 786432. Throughput: 0: 1264.2. Samples: 200928. Policy #0 lag: (min: 0.0, avg: 1.2, max: 4.0) [2024-08-05 09:43:53,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 3310.2). Total num frames: 811008. Throughput: 0: 1265.1. Samples: 204696. Policy #0 lag: (min: 0.0, avg: 2.3, max: 5.0) [2024-08-05 09:43:55,106][00157] Updated weights for policy 0, policy_version 100 (0.0019) [2024-08-05 09:43:58,356][00034] Fps is (10 sec: 4915.0, 60 sec: 5051.7, 300 sec: 3342.3). Total num frames: 835584. Throughput: 0: 1251.2. Samples: 211952. Policy #0 lag: (min: 0.0, avg: 2.3, max: 5.0) [2024-08-05 09:44:03,356][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 3373.2). Total num frames: 860160. Throughput: 0: 1247.5. Samples: 219424. Policy #0 lag: (min: 0.0, avg: 1.5, max: 4.0) [2024-08-05 09:44:08,356][00034] Fps is (10 sec: 4915.3, 60 sec: 5051.7, 300 sec: 3402.8). Total num frames: 884736. Throughput: 0: 1246.2. Samples: 223200. Policy #0 lag: (min: 0.0, avg: 1.8, max: 4.0) [2024-08-05 09:44:10,763][00157] Updated weights for policy 0, policy_version 110 (0.0021) [2024-08-05 09:44:13,356][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 3431.4). Total num frames: 909312. Throughput: 0: 1261.2. Samples: 230832. Policy #0 lag: (min: 0.0, avg: 1.6, max: 4.0) [2024-08-05 09:44:18,356][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 3458.8). Total num frames: 933888. Throughput: 0: 1256.0. Samples: 238384. Policy #0 lag: (min: 0.0, avg: 2.1, max: 5.0) [2024-08-05 09:44:23,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 3485.3). Total num frames: 958464. Throughput: 0: 1258.8. Samples: 242240. Policy #0 lag: (min: 0.0, avg: 2.0, max: 4.0) [2024-08-05 09:44:26,730][00157] Updated weights for policy 0, policy_version 120 (0.0028) [2024-08-05 09:44:28,364][00034] Fps is (10 sec: 5729.4, 60 sec: 5187.5, 300 sec: 3540.0). Total num frames: 991232. Throughput: 0: 1255.8. Samples: 249888. Policy #0 lag: (min: 0.0, avg: 2.0, max: 4.0) [2024-08-05 09:44:33,355][00034] Fps is (10 sec: 5734.4, 60 sec: 5051.7, 300 sec: 3564.2). Total num frames: 1015808. Throughput: 0: 1247.3. Samples: 257056. Policy #0 lag: (min: 0.0, avg: 1.6, max: 4.0) [2024-08-05 09:44:38,356][00034] Fps is (10 sec: 4099.6, 60 sec: 4915.2, 300 sec: 3559.3). Total num frames: 1032192. Throughput: 0: 1246.8. Samples: 260800. Policy #0 lag: (min: 0.0, avg: 1.4, max: 4.0) [2024-08-05 09:44:43,355][00034] Fps is (10 sec: 4096.0, 60 sec: 4915.2, 300 sec: 3582.3). Total num frames: 1056768. Throughput: 0: 1256.4. Samples: 268488. Policy #0 lag: (min: 0.0, avg: 2.5, max: 5.0) [2024-08-05 09:44:44,510][00157] Updated weights for policy 0, policy_version 130 (0.0021) [2024-08-05 09:44:48,356][00034] Fps is (10 sec: 5734.4, 60 sec: 5051.7, 300 sec: 3693.3). Total num frames: 1089536. Throughput: 0: 1258.0. Samples: 276032. Policy #0 lag: (min: 0.0, avg: 2.4, max: 4.0) [2024-08-05 09:44:53,356][00034] Fps is (10 sec: 5734.4, 60 sec: 5051.7, 300 sec: 3776.7). Total num frames: 1114112. Throughput: 0: 1259.9. Samples: 279896. Policy #0 lag: (min: 0.0, avg: 2.0, max: 6.0) [2024-08-05 09:44:58,355][00034] Fps is (10 sec: 4915.3, 60 sec: 5051.8, 300 sec: 3860.0). Total num frames: 1138688. Throughput: 0: 1259.9. Samples: 287528. Policy #0 lag: (min: 0.0, avg: 1.7, max: 4.0) [2024-08-05 09:44:59,149][00157] Updated weights for policy 0, policy_version 140 (0.0030) [2024-08-05 09:45:03,355][00034] Fps is (10 sec: 4096.0, 60 sec: 4915.2, 300 sec: 3915.5). Total num frames: 1155072. Throughput: 0: 1250.0. Samples: 294632. Policy #0 lag: (min: 0.0, avg: 2.2, max: 4.0) [2024-08-05 09:45:08,355][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4026.6). Total num frames: 1187840. Throughput: 0: 1245.5. Samples: 298288. Policy #0 lag: (min: 0.0, avg: 2.5, max: 5.0) [2024-08-05 09:45:12,753][00166] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 09:45:13,355][00034] Fps is (10 sec: 5734.4, 60 sec: 5051.7, 300 sec: 4109.9). Total num frames: 1212416. Throughput: 0: 1247.7. Samples: 306024. Policy #0 lag: (min: 0.0, avg: 1.4, max: 4.0) [2024-08-05 09:45:16,883][00157] Updated weights for policy 0, policy_version 150 (0.0020) [2024-08-05 09:45:18,355][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4193.2). Total num frames: 1236992. Throughput: 0: 1258.8. Samples: 313704. Policy #0 lag: (min: 0.0, avg: 1.4, max: 4.0) [2024-08-05 09:45:23,356][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4276.5). Total num frames: 1261568. Throughput: 0: 1259.0. Samples: 317456. Policy #0 lag: (min: 0.0, avg: 1.3, max: 4.0) [2024-08-05 09:45:23,362][00136] Saving /kaggle/working/train_dir/default_experiment/checkpoint_p0/checkpoint_000000154_1261568.pth... [2024-08-05 09:45:23,563][00136] Removing /kaggle/working/train_dir/default_experiment/checkpoint_p0/checkpoint_000000008_65536.pth [2024-08-05 09:45:28,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.9, 300 sec: 4359.8). Total num frames: 1286144. Throughput: 0: 1256.0. Samples: 325008. Policy #0 lag: (min: 0.0, avg: 2.0, max: 5.0) [2024-08-05 09:45:32,344][00157] Updated weights for policy 0, policy_version 160 (0.0020) [2024-08-05 09:45:33,355][00034] Fps is (10 sec: 5734.4, 60 sec: 5051.7, 300 sec: 4470.9). Total num frames: 1318912. Throughput: 0: 1257.8. Samples: 332632. Policy #0 lag: (min: 0.0, avg: 2.1, max: 5.0) [2024-08-05 09:45:38,356][00034] Fps is (10 sec: 4915.0, 60 sec: 5051.7, 300 sec: 4526.4). Total num frames: 1335296. Throughput: 0: 1245.5. Samples: 335944. Policy #0 lag: (min: 0.0, avg: 1.7, max: 4.0) [2024-08-05 09:45:43,355][00034] Fps is (10 sec: 4096.0, 60 sec: 5051.7, 300 sec: 4609.7). Total num frames: 1359872. Throughput: 0: 1247.3. Samples: 343656. Policy #0 lag: (min: 0.0, avg: 1.6, max: 4.0) [2024-08-05 09:45:48,356][00034] Fps is (10 sec: 4915.4, 60 sec: 4915.2, 300 sec: 4693.0). Total num frames: 1384448. Throughput: 0: 1259.9. Samples: 351328. Policy #0 lag: (min: 0.0, avg: 2.1, max: 5.0) [2024-08-05 09:45:49,116][00157] Updated weights for policy 0, policy_version 170 (0.0020) [2024-08-05 09:45:53,355][00034] Fps is (10 sec: 5734.4, 60 sec: 5051.7, 300 sec: 4804.1). Total num frames: 1417216. Throughput: 0: 1261.5. Samples: 355056. Policy #0 lag: (min: 0.0, avg: 2.1, max: 5.0) [2024-08-05 09:45:58,355][00034] Fps is (10 sec: 5734.5, 60 sec: 5051.7, 300 sec: 4887.4). Total num frames: 1441792. Throughput: 0: 1259.7. Samples: 362712. Policy #0 lag: (min: 0.0, avg: 2.1, max: 5.0) [2024-08-05 09:46:03,356][00034] Fps is (10 sec: 4915.2, 60 sec: 5188.3, 300 sec: 4970.7). Total num frames: 1466368. Throughput: 0: 1260.6. Samples: 370432. Policy #0 lag: (min: 0.0, avg: 1.3, max: 4.0) [2024-08-05 09:46:04,281][00157] Updated weights for policy 0, policy_version 180 (0.0021) [2024-08-05 09:46:08,355][00034] Fps is (10 sec: 4096.0, 60 sec: 4915.2, 300 sec: 5026.3). Total num frames: 1482752. Throughput: 0: 1254.8. Samples: 373920. Policy #0 lag: (min: 0.0, avg: 1.8, max: 4.0) [2024-08-05 09:46:13,356][00034] Fps is (10 sec: 4915.1, 60 sec: 5051.7, 300 sec: 5026.3). Total num frames: 1515520. Throughput: 0: 1252.1. Samples: 381352. Policy #0 lag: (min: 0.0, avg: 1.9, max: 4.0) [2024-08-05 09:46:18,356][00034] Fps is (10 sec: 5734.3, 60 sec: 5051.7, 300 sec: 5026.3). Total num frames: 1540096. Throughput: 0: 1252.6. Samples: 389000. Policy #0 lag: (min: 0.0, avg: 2.0, max: 4.0) [2024-08-05 09:46:21,540][00157] Updated weights for policy 0, policy_version 190 (0.0035) [2024-08-05 09:46:23,356][00034] Fps is (10 sec: 4915.3, 60 sec: 5051.7, 300 sec: 5054.0). Total num frames: 1564672. Throughput: 0: 1263.8. Samples: 392816. Policy #0 lag: (min: 0.0, avg: 1.4, max: 4.0) [2024-08-05 09:46:28,355][00034] Fps is (10 sec: 4915.3, 60 sec: 5051.7, 300 sec: 5054.0). Total num frames: 1589248. Throughput: 0: 1262.2. Samples: 400456. Policy #0 lag: (min: 0.0, avg: 1.7, max: 4.0) [2024-08-05 09:46:32,344][00169] DAMAGECOUNT value on done: 110.0 [2024-08-05 09:46:32,346][00169] Sum rewards: -6.528, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.670', 'AMMO2': '0.031', 'HITCOUNT': '0.060', 'ARMOR': '0.092', 'weapon4': '0.132', 'AMMO3': '0.135', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.330', 'weapon3': '0.598', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.208'} [2024-08-05 09:46:32,351][00170] DAMAGECOUNT value on done: 15.0 [2024-08-05 09:46:33,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 5026.3). Total num frames: 1613824. Throughput: 0: 1263.5. Samples: 408184. Policy #0 lag: (min: 0.0, avg: 2.1, max: 4.0) [2024-08-05 09:46:33,358][00034] Avg episode reward: [(0, '-5.065')] [2024-08-05 09:46:33,365][00136] Saving new best policy, reward=-5.065! [2024-08-05 09:46:34,105][00159] DAMAGECOUNT value on done: 139.0 [2024-08-05 09:46:34,113][00159] Sum rewards: -3.738, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.459', 'ARMOR': '0.004', 'AMMO5': '0.004', 'AMMO2': '0.012', 'HITCOUNT': '0.020', 'weapon4': '0.028', 'WEAPON4': '0.050', 'weapon5': '0.056', 'AMMO4': '0.060', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.417', 'WEAPON3': '0.550', 'weapon3': '0.888', 'weapon2': '0.932'} [2024-08-05 09:46:34,139][00162] DAMAGECOUNT value on done: 10.0 [2024-08-05 09:46:36,883][00157] Updated weights for policy 0, policy_version 200 (0.0019) [2024-08-05 09:46:37,896][00166] DAMAGECOUNT value on done: 65.0 [2024-08-05 09:46:37,909][00166] Sum rewards: -1.390, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.565', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.017', 'weapon5': '0.028', 'HITCOUNT': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'ARMOR': '0.064', 'AMMO3': '0.087', 'DAMAGECOUNT': '0.195', 'weapon4': '0.202', 'weapon3': '0.324', 'WEAPON3': '0.400', 'FRAGCOUNT': '1.000', 'weapon2': '1.202'} [2024-08-05 09:46:38,355][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.8, 300 sec: 4998.5). Total num frames: 1638400. Throughput: 0: 1262.9. Samples: 411888. Policy #0 lag: (min: 0.0, avg: 1.3, max: 4.0) [2024-08-05 09:46:38,357][00034] Avg episode reward: [(0, '-4.216')] [2024-08-05 09:46:38,359][00136] Saving new best policy, reward=-4.216! [2024-08-05 09:46:38,750][00168] DAMAGECOUNT value on done: 40.0 [2024-08-05 09:46:38,899][00172] DAMAGECOUNT value on done: 127.0 [2024-08-05 09:46:38,901][00172] Sum rewards: -6.399, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.306', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'HITCOUNT': '0.070', 'AMMO3': '0.129', 'DAMAGECOUNT': '0.381', 'ARMOR': '0.515', 'WEAPON3': '0.700', 'weapon3': '0.786', 'FRAGCOUNT': '1.000', 'weapon2': '1.366'} [2024-08-05 09:46:39,007][00169] DAMAGECOUNT value on done: 75.0 [2024-08-05 09:46:39,013][00169] Sum rewards: -10.854, reward structure: {'DEATHCOUNT': '-12.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.910', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'ARMOR': '0.030', 'weapon5': '0.034', 'HITCOUNT': '0.050', 'weapon4': '0.058', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.165', 'DAMAGECOUNT': '0.225', 'weapon3': '0.726', 'WEAPON3': '0.800', 'weapon2': '1.170'} [2024-08-05 09:46:39,051][00170] DAMAGECOUNT value on done: 223.0 [2024-08-05 09:46:39,051][00170] Sum rewards: -6.237, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.371', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.030', 'weapon4': '0.082', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'HITCOUNT': '0.160', 'ARMOR': '0.404', 'DAMAGECOUNT': '0.669', 'WEAPON3': '0.800', 'weapon3': '0.802', 'FRAGCOUNT': '1.000', 'weapon2': '1.084'} [2024-08-05 09:46:39,069][00165] DAMAGECOUNT value on done: 135.0 [2024-08-05 09:46:39,077][00165] Sum rewards: -7.061, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.992', 'AMMO2': '0.017', 'ARMOR': '0.032', 'HITCOUNT': '0.070', 'AMMO4': '0.086', 'weapon4': '0.138', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon3': '0.328', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.286'} [2024-08-05 09:46:39,909][00167] DAMAGECOUNT value on done: 0.0 [2024-08-05 09:46:39,946][00161] DAMAGECOUNT value on done: 110.0 [2024-08-05 09:46:39,953][00161] Sum rewards: -8.117, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.280', 'AMMO2': '0.030', 'weapon4': '0.036', 'ARMOR': '0.048', 'HITCOUNT': '0.110', 'AMMO4': '0.149', 'AMMO3': '0.150', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.330', 'weapon3': '0.612', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.148'} [2024-08-05 09:46:40,504][00164] DAMAGECOUNT value on done: 5.0 [2024-08-05 09:46:40,854][00160] DAMAGECOUNT value on done: 120.0 [2024-08-05 09:46:40,862][00160] Sum rewards: -9.545, reward structure: {'DEATHCOUNT': '-10.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.192', 'AMMO2': '0.012', 'AMMO5': '0.017', 'ARMOR': '0.024', 'weapon5': '0.046', 'AMMO4': '0.061', 'HITCOUNT': '0.090', 'weapon4': '0.128', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.360', 'weapon3': '0.620', 'WEAPON3': '0.650', 'weapon2': '1.094'} [2024-08-05 09:46:41,322][00156] DAMAGECOUNT value on done: 125.0 [2024-08-05 09:46:41,325][00156] Sum rewards: -7.655, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.112', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'ARMOR': '0.040', 'HITCOUNT': '0.080', 'AMMO4': '0.085', 'weapon4': '0.116', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.650', 'weapon3': '0.720', 'FRAGCOUNT': '1.000', 'weapon2': '1.246'} [2024-08-05 09:46:41,437][00163] DAMAGECOUNT value on done: 100.0 [2024-08-05 09:46:41,445][00163] Sum rewards: -6.242, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'ARMOR': '0.064', 'HITCOUNT': '0.070', 'AMMO3': '0.113', 'HEALTH': '0.154', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.600', 'weapon3': '0.674', 'FRAGCOUNT': '1.000', 'weapon2': '1.128'} [2024-08-05 09:46:41,564][00159] DAMAGECOUNT value on done: 23.0 [2024-08-05 09:46:41,692][00162] DAMAGECOUNT value on done: 15.0 [2024-08-05 09:46:41,933][00158] DAMAGECOUNT value on done: 60.0 [2024-08-05 09:46:42,465][00171] DAMAGECOUNT value on done: 70.0 [2024-08-05 09:46:43,355][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5026.3). Total num frames: 1662976. Throughput: 0: 1246.4. Samples: 418800. Policy #0 lag: (min: 0.0, avg: 1.2, max: 4.0) [2024-08-05 09:46:43,358][00034] Avg episode reward: [(0, '-5.682')] [2024-08-05 09:46:44,506][00166] DAMAGECOUNT value on done: 60.0 [2024-08-05 09:46:44,515][00166] Sum rewards: -6.688, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.264', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.008', 'weapon4': '0.040', 'HITCOUNT': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.125', 'DAMAGECOUNT': '0.180', 'ARMOR': '0.476', 'WEAPON3': '0.550', 'weapon3': '0.594', 'FRAGCOUNT': '1.000', 'weapon2': '1.246'} [2024-08-05 09:46:44,847][00168] DAMAGECOUNT value on done: 95.0 [2024-08-05 09:46:44,911][00172] DAMAGECOUNT value on done: 55.0 [2024-08-05 09:46:46,032][00167] DAMAGECOUNT value on done: 15.0 [2024-08-05 09:46:46,038][00167] Sum rewards: -7.357, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.400', 'AMMO5': '0.012', 'AMMO2': '0.018', 'HITCOUNT': '0.020', 'DAMAGECOUNT': '0.045', 'weapon5': '0.048', 'ARMOR': '0.050', 'AMMO4': '0.088', 'AMMO3': '0.113', 'weapon4': '0.140', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon3': '0.596', 'WEAPON3': '0.600', 'weapon2': '0.962'} [2024-08-05 09:46:46,145][00161] DAMAGECOUNT value on done: 90.0 [2024-08-05 09:46:46,220][00165] DAMAGECOUNT value on done: 155.0 [2024-08-05 09:46:46,229][00165] Sum rewards: -7.164, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.388', 'AMMO2': '0.022', 'ARMOR': '0.032', 'weapon4': '0.060', 'AMMO4': '0.111', 'HITCOUNT': '0.120', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.465', 'WEAPON3': '0.750', 'weapon3': '0.888', 'weapon2': '0.994', 'FRAGCOUNT': '1.000'} [2024-08-05 09:46:46,290][00169] DAMAGECOUNT value on done: 195.0 [2024-08-05 09:46:46,291][00169] Sum rewards: -2.996, reward structure: {'DEATHCOUNT': '-7.500', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'ARMOR': '0.044', 'AMMO4': '0.082', 'AMMO3': '0.083', 'weapon4': '0.114', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'HEALTH': '0.166', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.585', 'weapon3': '0.760', 'weapon2': '0.914', 'FRAGCOUNT': '1.000'} [2024-08-05 09:46:46,378][00170] DAMAGECOUNT value on done: 50.0 [2024-08-05 09:46:46,378][00170] Sum rewards: -6.248, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.055', 'AMMO2': '0.004', 'ARMOR': '0.008', 'AMMO4': '0.021', 'HITCOUNT': '0.040', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'DAMAGECOUNT': '0.150', 'WEAPON3': '0.650', 'weapon3': '0.796', 'FRAGCOUNT': '1.000', 'weapon2': '1.074'} [2024-08-05 09:46:46,731][00164] DAMAGECOUNT value on done: 72.0 [2024-08-05 09:46:46,737][00164] Sum rewards: -4.139, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.066', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.030', 'HITCOUNT': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.096', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.216', 'weapon4': '0.274', 'weapon3': '0.292', 'ARMOR': '0.497', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon2': '1.090'} [2024-08-05 09:46:47,082][00160] DAMAGECOUNT value on done: 45.0 [2024-08-05 09:46:47,637][00156] DAMAGECOUNT value on done: 45.0 [2024-08-05 09:46:47,638][00156] Sum rewards: -7.704, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.078', 'weapon5': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'HITCOUNT': '0.040', 'weapon4': '0.054', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.135', 'WEAPON4': '0.150', 'AMMO3': '0.158', 'ARMOR': '0.496', 'weapon3': '0.568', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.216'} [2024-08-05 09:46:48,355][00034] Fps is (10 sec: 4096.0, 60 sec: 4915.2, 300 sec: 5026.3). Total num frames: 1679360. Throughput: 0: 1237.9. Samples: 426136. Policy #0 lag: (min: 0.0, avg: 1.8, max: 4.0) [2024-08-05 09:46:48,357][00034] Avg episode reward: [(0, '-5.551')] [2024-08-05 09:46:48,645][00163] DAMAGECOUNT value on done: 50.0 [2024-08-05 09:46:48,845][00159] DAMAGECOUNT value on done: 45.0 [2024-08-05 09:46:48,966][00162] DAMAGECOUNT value on done: 175.0 [2024-08-05 09:46:48,975][00162] Sum rewards: -8.699, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.010', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.024', 'ARMOR': '0.036', 'AMMO2': '0.037', 'HITCOUNT': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.110', 'AMMO3': '0.152', 'AMMO4': '0.188', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.525', 'weapon3': '0.628', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.148'} [2024-08-05 09:46:49,105][00158] DAMAGECOUNT value on done: 165.0 [2024-08-05 09:46:49,106][00158] Sum rewards: -4.353, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.706', 'AMMO2': '0.011', 'weapon4': '0.032', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.118', 'HITCOUNT': '0.130', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.650', 'weapon2': '0.832', 'FRAGCOUNT': '1.000', 'weapon3': '1.194'} [2024-08-05 09:46:49,536][00171] DAMAGECOUNT value on done: 0.0 [2024-08-05 09:46:50,807][00166] DAMAGECOUNT value on done: 80.0 [2024-08-05 09:46:50,811][00166] Sum rewards: -8.365, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.226', 'AMMO5': '0.003', 'AMMO2': '0.010', 'ARMOR': '0.040', 'AMMO4': '0.049', 'HITCOUNT': '0.070', 'AMMO3': '0.134', 'WEAPON4': '0.150', 'weapon4': '0.184', 'DAMAGECOUNT': '0.240', 'weapon3': '0.512', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.270'} [2024-08-05 09:46:50,983][00168] DAMAGECOUNT value on done: 15.0 [2024-08-05 09:46:51,101][00172] DAMAGECOUNT value on done: 30.0 [2024-08-05 09:46:52,240][00167] DAMAGECOUNT value on done: 0.0 [2024-08-05 09:46:52,372][00161] DAMAGECOUNT value on done: 5.0 [2024-08-05 09:46:52,891][00164] DAMAGECOUNT value on done: 70.0 [2024-08-05 09:46:53,153][00169] DAMAGECOUNT value on done: 55.0 [2024-08-05 09:46:53,196][00170] DAMAGECOUNT value on done: 15.0 [2024-08-05 09:46:53,298][00160] DAMAGECOUNT value on done: 35.0 [2024-08-05 09:46:53,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 5026.3). Total num frames: 1712128. Throughput: 0: 1242.5. Samples: 429832. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 09:46:53,357][00034] Avg episode reward: [(0, '-5.458')] [2024-08-05 09:46:53,701][00165] DAMAGECOUNT value on done: 140.0 [2024-08-05 09:46:53,702][00165] Sum rewards: -5.819, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.020', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.036', 'HITCOUNT': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.135', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.700', 'weapon3': '0.880', 'FRAGCOUNT': '1.000', 'weapon2': '1.092'} [2024-08-05 09:46:53,868][00156] DAMAGECOUNT value on done: 55.0 [2024-08-05 09:46:53,872][00156] Sum rewards: -2.955, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.016', 'HITCOUNT': '0.050', 'HEALTH': '0.054', 'ARMOR': '0.068', 'AMMO4': '0.079', 'AMMO3': '0.089', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.165', 'weapon4': '0.206', 'WEAPON3': '0.400', 'weapon3': '0.456', 'FRAGCOUNT': '1.000', 'weapon2': '1.062'} [2024-08-05 09:46:54,779][00157] Updated weights for policy 0, policy_version 210 (0.0020) [2024-08-05 09:46:55,401][00159] DAMAGECOUNT value on done: 42.0 [2024-08-05 09:46:55,402][00159] Sum rewards: -9.899, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.300', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.004', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon5': '0.028', 'HITCOUNT': '0.040', 'weapon4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'ARMOR': '0.108', 'DAMAGECOUNT': '0.126', 'AMMO3': '0.170', 'WEAPON3': '0.900', 'weapon3': '0.962', 'weapon2': '1.034'} [2024-08-05 09:46:55,566][00162] DAMAGECOUNT value on done: 15.0 [2024-08-05 09:46:56,402][00163] DAMAGECOUNT value on done: 155.0 [2024-08-05 09:46:56,404][00163] Sum rewards: -8.167, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.410', 'AMMO2': '0.018', 'AMMO4': '0.090', 'HITCOUNT': '0.100', 'AMMO3': '0.157', 'weapon4': '0.174', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.465', 'ARMOR': '0.536', 'weapon3': '0.730', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.222'} [2024-08-05 09:46:56,663][00158] DAMAGECOUNT value on done: 20.0 [2024-08-05 09:46:56,988][00171] DAMAGECOUNT value on done: 70.0 [2024-08-05 09:46:57,018][00168] DAMAGECOUNT value on done: 65.0 [2024-08-05 09:46:57,024][00168] Sum rewards: -3.507, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.854', 'AMMO5': '0.003', 'ARMOR': '0.028', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'HITCOUNT': '0.060', 'AMMO3': '0.084', 'AMMO4': '0.166', 'DAMAGECOUNT': '0.195', 'weapon4': '0.270', 'WEAPON3': '0.350', 'WEAPON4': '0.350', 'weapon3': '0.456', 'FRAGCOUNT': '1.000', 'weapon2': '1.052'} [2024-08-05 09:46:57,167][00166] DAMAGECOUNT value on done: 90.0 [2024-08-05 09:46:57,168][00166] Sum rewards: -6.887, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.530', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.019', 'ARMOR': '0.040', 'HITCOUNT': '0.080', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'weapon4': '0.104', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.270', 'WEAPON3': '0.550', 'weapon3': '0.594', 'FRAGCOUNT': '1.000', 'weapon2': '1.230'} [2024-08-05 09:46:57,227][00172] DAMAGECOUNT value on done: 59.0 [2024-08-05 09:46:57,233][00172] Sum rewards: -5.062, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.470', 'AMMO2': '0.006', 'weapon5': '0.006', 'AMMO5': '0.010', 'weapon4': '0.026', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'weapon7': '0.060', 'HITCOUNT': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.132', 'AMMO6': '0.160', 'AMMO7': '0.160', 'DAMAGECOUNT': '0.177', 'WEAPON7': '0.200', 'WEAPON3': '0.700', 'weapon3': '0.758', 'FRAGCOUNT': '1.000', 'weapon2': '1.014'} [2024-08-05 09:46:58,355][00034] Fps is (10 sec: 5734.4, 60 sec: 4915.2, 300 sec: 4998.5). Total num frames: 1736704. Throughput: 0: 1243.6. Samples: 437312. Policy #0 lag: (min: 0.0, avg: 2.4, max: 6.0) [2024-08-05 09:46:58,358][00034] Avg episode reward: [(0, '-5.467')] [2024-08-05 09:46:58,883][00167] DAMAGECOUNT value on done: 172.0 [2024-08-05 09:46:58,884][00167] Sum rewards: -4.428, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.510', 'AMMO5': '0.010', 'AMMO2': '0.011', 'weapon5': '0.032', 'ARMOR': '0.040', 'AMMO4': '0.053', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'HITCOUNT': '0.140', 'WEAPON5': '0.150', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.516', 'WEAPON3': '0.650', 'weapon3': '0.838', 'weapon2': '1.078'} [2024-08-05 09:46:58,974][00164] DAMAGECOUNT value on done: 25.0 [2024-08-05 09:46:59,132][00161] DAMAGECOUNT value on done: 75.0 [2024-08-05 09:46:59,518][00160] DAMAGECOUNT value on done: 220.0 [2024-08-05 09:46:59,526][00160] Sum rewards: -2.132, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.083', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'ARMOR': '0.036', 'weapon4': '0.070', 'AMMO3': '0.074', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'WEAPON3': '0.400', 'weapon3': '0.642', 'DAMAGECOUNT': '0.660', 'weapon2': '1.246', 'FRAGCOUNT': '2.000'} [2024-08-05 09:46:59,896][00169] DAMAGECOUNT value on done: 160.0 [2024-08-05 09:46:59,902][00169] Sum rewards: -9.017, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.256', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'weapon4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'HITCOUNT': '0.160', 'DAMAGECOUNT': '0.480', 'weapon3': '0.554', 'WEAPON3': '0.650', 'weapon2': '1.176'} [2024-08-05 09:46:59,979][00170] DAMAGECOUNT value on done: 19.0 [2024-08-05 09:47:00,000][00165] DAMAGECOUNT value on done: 15.0 [2024-08-05 09:47:01,114][00156] DAMAGECOUNT value on done: 75.0 [2024-08-05 09:47:01,117][00156] Sum rewards: -5.639, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.838', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.018', 'weapon4': '0.024', 'HITCOUNT': '0.050', 'AMMO4': '0.081', 'ARMOR': '0.086', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.225', 'WEAPON3': '0.550', 'weapon3': '0.594', 'FRAGCOUNT': '1.000', 'weapon2': '1.454'} [2024-08-05 09:47:02,113][00159] DAMAGECOUNT value on done: 70.0 [2024-08-05 09:47:02,114][00159] Sum rewards: -4.133, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.010', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.032', 'HITCOUNT': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.100', 'AMMO3': '0.125', 'DAMAGECOUNT': '0.210', 'WEAPON3': '0.650', 'weapon2': '0.898', 'FRAGCOUNT': '1.000', 'weapon3': '1.028'} [2024-08-05 09:47:02,273][00162] DAMAGECOUNT value on done: 15.0 [2024-08-05 09:47:02,463][00163] DAMAGECOUNT value on done: 10.0 [2024-08-05 09:47:02,835][00158] DAMAGECOUNT value on done: 214.0 [2024-08-05 09:47:02,836][00158] Sum rewards: -9.364, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.243', 'AMMO2': '0.019', 'ARMOR': '0.036', 'weapon4': '0.036', 'AMMO4': '0.093', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.642', 'weapon3': '0.688', 'FRAGCOUNT': '1.000', 'weapon2': '1.332'} [2024-08-05 09:47:02,965][00168] DAMAGECOUNT value on done: 130.0 [2024-08-05 09:47:02,969][00168] Sum rewards: -2.509, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.804', 'ARMOR': '0.016', 'AMMO2': '0.017', 'HITCOUNT': '0.080', 'AMMO4': '0.084', 'AMMO3': '0.088', 'weapon4': '0.132', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.500', 'weapon3': '0.740', 'FRAGCOUNT': '1.000', 'weapon2': '1.098'} [2024-08-05 09:47:03,142][00171] DAMAGECOUNT value on done: 120.0 [2024-08-05 09:47:03,144][00171] Sum rewards: -4.095, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.861', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.006', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.159', 'DAMAGECOUNT': '0.360', 'ARMOR': '0.560', 'WEAPON3': '0.900', 'weapon3': '0.988', 'FRAGCOUNT': '1.000', 'weapon2': '1.110'} [2024-08-05 09:47:03,217][00172] DAMAGECOUNT value on done: 10.0 [2024-08-05 09:47:03,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 1761280. Throughput: 0: 1241.4. Samples: 444864. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 09:47:03,357][00034] Avg episode reward: [(0, '-5.406')] [2024-08-05 09:47:03,995][00166] DAMAGECOUNT value on done: 60.0 [2024-08-05 09:47:05,153][00164] DAMAGECOUNT value on done: 75.0 [2024-08-05 09:47:05,154][00164] Sum rewards: -5.436, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.590', 'AMMO5': '0.005', 'AMMO2': '0.013', 'HITCOUNT': '0.050', 'weapon5': '0.054', 'AMMO4': '0.065', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'weapon4': '0.112', 'DAMAGECOUNT': '0.225', 'WEAPON3': '0.600', 'weapon3': '0.694', 'FRAGCOUNT': '1.000', 'weapon2': '1.274'} [2024-08-05 09:47:05,446][00167] DAMAGECOUNT value on done: 10.0 [2024-08-05 09:47:05,701][00161] DAMAGECOUNT value on done: 0.0 [2024-08-05 09:47:06,101][00160] DAMAGECOUNT value on done: 40.0 [2024-08-05 09:47:06,311][00165] DAMAGECOUNT value on done: 25.0 [2024-08-05 09:47:06,965][00169] DAMAGECOUNT value on done: 110.0 [2024-08-05 09:47:07,075][00170] DAMAGECOUNT value on done: 95.0 [2024-08-05 09:47:07,383][00156] DAMAGECOUNT value on done: 5.0 [2024-08-05 09:47:08,356][00034] Fps is (10 sec: 4915.1, 60 sec: 5051.7, 300 sec: 5026.3). Total num frames: 1785856. Throughput: 0: 1236.1. Samples: 448440. Policy #0 lag: (min: 0.0, avg: 2.3, max: 5.0) [2024-08-05 09:47:08,357][00034] Avg episode reward: [(0, '-5.453')] [2024-08-05 09:47:08,856][00159] DAMAGECOUNT value on done: 10.0 [2024-08-05 09:47:08,977][00162] DAMAGECOUNT value on done: 10.0 [2024-08-05 09:47:09,102][00163] DAMAGECOUNT value on done: 85.0 [2024-08-05 09:47:09,765][00158] DAMAGECOUNT value on done: 178.0 [2024-08-05 09:47:09,766][00158] Sum rewards: -3.845, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.550', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.136', 'HITCOUNT': '0.140', 'weapon4': '0.182', 'WEAPON4': '0.200', 'weapon3': '0.432', 'ARMOR': '0.532', 'DAMAGECOUNT': '0.534', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.272'} [2024-08-05 09:47:10,033][00168] DAMAGECOUNT value on done: 96.0 [2024-08-05 09:47:10,264][00171] DAMAGECOUNT value on done: 25.0 [2024-08-05 09:47:10,484][00172] DAMAGECOUNT value on done: 203.0 [2024-08-05 09:47:10,492][00172] Sum rewards: -8.474, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.026', 'AMMO5': '0.004', 'AMMO2': '0.005', 'AMMO4': '0.023', 'WEAPON1': '0.040', 'ARMOR': '0.048', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'HITCOUNT': '0.160', 'weapon3': '0.410', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.609', 'FRAGCOUNT': '1.000', 'weapon2': '1.678'} [2024-08-05 09:47:11,177][00166] DAMAGECOUNT value on done: 50.0 [2024-08-05 09:47:11,803][00157] Updated weights for policy 0, policy_version 220 (0.0019) [2024-08-05 09:47:12,509][00164] DAMAGECOUNT value on done: 70.0 [2024-08-05 09:47:12,515][00164] Sum rewards: -2.679, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.979', 'AMMO2': '0.002', 'AMMO4': '0.008', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'HITCOUNT': '0.060', 'ARMOR': '0.064', 'AMMO3': '0.092', 'weapon4': '0.122', 'DAMAGECOUNT': '0.210', 'WEAPON3': '0.500', 'weapon3': '0.536', 'weapon2': '1.386', 'FRAGCOUNT': '2.000'} [2024-08-05 09:47:12,772][00167] DAMAGECOUNT value on done: 105.0 [2024-08-05 09:47:13,106][00161] DAMAGECOUNT value on done: 30.0 [2024-08-05 09:47:13,162][00160] DAMAGECOUNT value on done: 30.0 [2024-08-05 09:47:13,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 5026.3). Total num frames: 1810432. Throughput: 0: 1219.2. Samples: 455320. Policy #0 lag: (min: 0.0, avg: 2.1, max: 4.0) [2024-08-05 09:47:13,357][00034] Avg episode reward: [(0, '-5.478')] [2024-08-05 09:47:13,466][00165] DAMAGECOUNT value on done: 0.0 [2024-08-05 09:47:13,487][00169] DAMAGECOUNT value on done: 5.0 [2024-08-05 09:47:13,550][00170] DAMAGECOUNT value on done: 115.0 [2024-08-05 09:47:13,560][00170] Sum rewards: -5.713, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.160', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.004', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.034', 'HITCOUNT': '0.060', 'weapon4': '0.068', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.600', 'weapon3': '0.816', 'weapon2': '1.102'} [2024-08-05 09:47:15,206][00156] DAMAGECOUNT value on done: 115.0 [2024-08-05 09:47:15,208][00156] Sum rewards: -4.173, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.032', 'AMMO3': '0.056', 'HITCOUNT': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.159', 'weapon4': '0.166', 'WEAPON4': '0.200', 'WEAPON3': '0.200', 'weapon3': '0.240', 'HEALTH': '0.332', 'DAMAGECOUNT': '0.345', 'ARMOR': '0.456', 'FRAGCOUNT': '1.000', 'weapon2': '1.450'} [2024-08-05 09:47:15,902][00159] DAMAGECOUNT value on done: 325.0 [2024-08-05 09:47:15,903][00159] Sum rewards: -4.094, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.440', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'ARMOR': '0.056', 'weapon4': '0.104', 'AMMO4': '0.108', 'HITCOUNT': '0.170', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'weapon3': '0.790', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.975', 'weapon2': '1.128', 'FRAGCOUNT': '3.000'} [2024-08-05 09:47:15,942][00163] DAMAGECOUNT value on done: 38.0 [2024-08-05 09:47:16,133][00162] DAMAGECOUNT value on done: 15.0 [2024-08-05 09:47:16,504][00158] DAMAGECOUNT value on done: 10.0 [2024-08-05 09:47:16,505][00158] Sum rewards: -8.849, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.038', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.014', 'HITCOUNT': '0.020', 'DAMAGECOUNT': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'ARMOR': '0.069', 'WEAPON4': '0.100', 'weapon4': '0.108', 'AMMO3': '0.114', 'weapon3': '0.400', 'WEAPON3': '0.500', 'weapon2': '1.218'} [2024-08-05 09:47:16,614][00168] DAMAGECOUNT value on done: 25.0 [2024-08-05 09:47:16,841][00172] DAMAGECOUNT value on done: 85.0 [2024-08-05 09:47:16,974][00171] DAMAGECOUNT value on done: 5.0 [2024-08-05 09:47:18,355][00034] Fps is (10 sec: 4096.1, 60 sec: 4778.7, 300 sec: 4970.7). Total num frames: 1826816. Throughput: 0: 1212.4. Samples: 462744. Policy #0 lag: (min: 0.0, avg: 2.2, max: 4.0) [2024-08-05 09:47:18,360][00166] DAMAGECOUNT value on done: 79.0 [2024-08-05 09:47:18,361][00034] Avg episode reward: [(0, '-5.551')] [2024-08-05 09:47:18,367][00166] Sum rewards: -9.181, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.594', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.009', 'ARMOR': '0.016', 'AMMO2': '0.018', 'weapon5': '0.024', 'AMMO4': '0.089', 'HITCOUNT': '0.100', 'weapon4': '0.110', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.237', 'weapon3': '0.422', 'WEAPON3': '0.550', 'weapon2': '1.364'} [2024-08-05 09:47:18,739][00164] DAMAGECOUNT value on done: 35.0 [2024-08-05 09:47:19,332][00160] DAMAGECOUNT value on done: 40.0 [2024-08-05 09:47:19,564][00167] DAMAGECOUNT value on done: 55.0 [2024-08-05 09:47:19,568][00167] Sum rewards: -6.379, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'ARMOR': '0.052', 'HITCOUNT': '0.060', 'AMMO4': '0.066', 'HEALTH': '0.066', 'weapon4': '0.070', 'AMMO3': '0.106', 'DAMAGECOUNT': '0.165', 'WEAPON3': '0.500', 'weapon3': '0.578', 'FRAGCOUNT': '1.000', 'weapon2': '1.342'} [2024-08-05 09:47:19,948][00161] DAMAGECOUNT value on done: 180.0 [2024-08-05 09:47:19,952][00161] Sum rewards: -3.301, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.728', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'ARMOR': '0.088', 'AMMO4': '0.102', 'AMMO3': '0.116', 'weapon4': '0.122', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.540', 'WEAPON3': '0.600', 'weapon3': '0.790', 'weapon2': '0.964', 'FRAGCOUNT': '2.000'} [2024-08-05 09:47:20,228][00169] DAMAGECOUNT value on done: 25.0 [2024-08-05 09:47:20,257][00170] DAMAGECOUNT value on done: 115.0 [2024-08-05 09:47:20,257][00170] Sum rewards: -2.697, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.042', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'HITCOUNT': '0.070', 'AMMO4': '0.079', 'AMMO3': '0.138', 'ARMOR': '0.139', 'WEAPON4': '0.200', 'weapon4': '0.210', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.650', 'weapon3': '0.658', 'weapon2': '0.778', 'FRAGCOUNT': '1.000'} [2024-08-05 09:47:20,335][00165] DAMAGECOUNT value on done: 180.0 [2024-08-05 09:47:21,598][00156] DAMAGECOUNT value on done: 30.0 [2024-08-05 09:47:21,599][00156] Sum rewards: -9.127, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.912', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.006', 'weapon5': '0.006', 'weapon4': '0.034', 'HITCOUNT': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'DAMAGECOUNT': '0.090', 'AMMO3': '0.123', 'WEAPON3': '0.550', 'weapon3': '0.794', 'weapon2': '1.288'} [2024-08-05 09:47:22,646][00159] DAMAGECOUNT value on done: 60.0 [2024-08-05 09:47:22,693][00163] DAMAGECOUNT value on done: 47.0 [2024-08-05 09:47:22,699][00163] Sum rewards: -8.731, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.610', 'AMMO2': '0.013', 'HITCOUNT': '0.040', 'AMMO4': '0.066', 'weapon4': '0.130', 'DAMAGECOUNT': '0.141', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'weapon3': '0.420', 'ARMOR': '0.421', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.584'} [2024-08-05 09:47:22,953][00162] DAMAGECOUNT value on done: 124.0 [2024-08-05 09:47:22,955][00162] Sum rewards: -3.116, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.254', 'AMMO2': '0.024', 'ARMOR': '0.036', 'HITCOUNT': '0.080', 'weapon4': '0.096', 'AMMO4': '0.119', 'AMMO3': '0.121', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.372', 'WEAPON3': '0.650', 'weapon3': '0.882', 'FRAGCOUNT': '1.000', 'weapon2': '1.108'} [2024-08-05 09:47:22,998][00168] DAMAGECOUNT value on done: 44.0 [2024-08-05 09:47:23,269][00172] DAMAGECOUNT value on done: 30.0 [2024-08-05 09:47:23,274][00172] Sum rewards: -6.391, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.182', 'AMMO5': '0.005', 'AMMO2': '0.021', 'ARMOR': '0.024', 'HITCOUNT': '0.040', 'DAMAGECOUNT': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.126', 'weapon4': '0.158', 'WEAPON4': '0.250', 'WEAPON3': '0.650', 'weapon3': '0.736', 'FRAGCOUNT': '1.000', 'weapon2': '1.234'} [2024-08-05 09:47:23,335][00158] DAMAGECOUNT value on done: 55.0 [2024-08-05 09:47:23,341][00158] Sum rewards: -4.268, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.370', 'AMMO2': '0.012', 'HITCOUNT': '0.040', 'AMMO4': '0.058', 'ARMOR': '0.076', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.165', 'weapon4': '0.180', 'weapon3': '0.408', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.112'} [2024-08-05 09:47:23,356][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4998.5). Total num frames: 1859584. Throughput: 0: 1212.4. Samples: 466448. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 09:47:23,357][00034] Avg episode reward: [(0, '-5.549')] [2024-08-05 09:47:23,365][00136] Saving /kaggle/working/train_dir/default_experiment/checkpoint_p0/checkpoint_000000227_1859584.pth... [2024-08-05 09:47:23,569][00136] Removing /kaggle/working/train_dir/default_experiment/checkpoint_p0/checkpoint_000000081_663552.pth [2024-08-05 09:47:23,913][00171] DAMAGECOUNT value on done: 125.0 [2024-08-05 09:47:23,919][00171] Sum rewards: -7.216, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.572', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.021', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'weapon4': '0.106', 'HITCOUNT': '0.120', 'AMMO3': '0.129', 'DAMAGECOUNT': '0.375', 'weapon3': '0.642', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.216'} [2024-08-05 09:47:24,799][00166] DAMAGECOUNT value on done: 32.0 [2024-08-05 09:47:25,388][00164] DAMAGECOUNT value on done: 104.0 [2024-08-05 09:47:25,961][00167] DAMAGECOUNT value on done: 0.0 [2024-08-05 09:47:26,074][00160] DAMAGECOUNT value on done: 60.0 [2024-08-05 09:47:26,361][00161] DAMAGECOUNT value on done: 85.0 [2024-08-05 09:47:26,483][00165] DAMAGECOUNT value on done: 80.0 [2024-08-05 09:47:27,567][00170] DAMAGECOUNT value on done: 60.0 [2024-08-05 09:47:27,568][00170] Sum rewards: -7.381, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.209', 'AMMO5': '0.003', 'AMMO2': '0.022', 'ARMOR': '0.048', 'HITCOUNT': '0.050', 'AMMO3': '0.094', 'AMMO4': '0.109', 'weapon4': '0.178', 'DAMAGECOUNT': '0.180', 'WEAPON4': '0.250', 'weapon3': '0.434', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon2': '1.460'} [2024-08-05 09:47:27,615][00169] DAMAGECOUNT value on done: 17.0 [2024-08-05 09:47:27,912][00157] Updated weights for policy 0, policy_version 230 (0.0020) [2024-08-05 09:47:28,196][00156] DAMAGECOUNT value on done: 45.0 [2024-08-05 09:47:28,203][00156] Sum rewards: -1.773, reward structure: {'DEATHCOUNT': '-3.750', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.365', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.022', 'ARMOR': '0.028', 'HITCOUNT': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.064', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.135', 'weapon4': '0.148', 'WEAPON3': '0.350', 'weapon3': '0.442', 'weapon2': '1.366'} [2024-08-05 09:47:28,356][00034] Fps is (10 sec: 5734.3, 60 sec: 4915.2, 300 sec: 4998.5). Total num frames: 1884160. Throughput: 0: 1224.0. Samples: 473880. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 09:47:28,357][00034] Avg episode reward: [(0, '-5.501')] [2024-08-05 09:47:28,850][00163] DAMAGECOUNT value on done: 5.0 [2024-08-05 09:47:29,318][00168] DAMAGECOUNT value on done: 24.0 [2024-08-05 09:47:29,579][00158] DAMAGECOUNT value on done: 55.0 [2024-08-05 09:47:29,615][00172] DAMAGECOUNT value on done: 21.0 [2024-08-05 09:47:29,620][00172] Sum rewards: -8.827, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.054', 'HITCOUNT': '0.030', 'AMMO2': '0.031', 'DAMAGECOUNT': '0.063', 'AMMO4': '0.153', 'weapon4': '0.168', 'AMMO3': '0.182', 'WEAPON4': '0.350', 'ARMOR': '0.410', 'weapon3': '0.550', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.390'} [2024-08-05 09:47:30,049][00159] DAMAGECOUNT value on done: 25.0 [2024-08-05 09:47:30,055][00159] Sum rewards: -11.597, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.332', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.007', 'AMMO2': '0.008', 'HITCOUNT': '0.030', 'weapon4': '0.030', 'AMMO4': '0.040', 'weapon5': '0.056', 'ARMOR': '0.064', 'DAMAGECOUNT': '0.075', 'WEAPON4': '0.100', 'AMMO3': '0.125', 'WEAPON5': '0.150', 'weapon3': '0.438', 'WEAPON3': '0.650', 'weapon2': '1.462'} [2024-08-05 09:47:30,131][00171] DAMAGECOUNT value on done: 125.0 [2024-08-05 09:47:30,135][00171] Sum rewards: -5.420, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.200', 'AMMO2': '0.006', 'AMMO5': '0.010', 'weapon5': '0.020', 'AMMO4': '0.027', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon4': '0.102', 'AMMO3': '0.106', 'HITCOUNT': '0.150', 'DAMAGECOUNT': '0.375', 'weapon3': '0.506', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.488'} [2024-08-05 09:47:30,391][00162] DAMAGECOUNT value on done: 15.0 [2024-08-05 09:47:30,392][00162] Sum rewards: -5.793, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.012', 'AMMO5': '0.005', 'weapon5': '0.008', 'HITCOUNT': '0.010', 'AMMO2': '0.029', 'ARMOR': '0.036', 'DAMAGECOUNT': '0.045', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'weapon4': '0.142', 'AMMO4': '0.143', 'WEAPON4': '0.250', 'weapon3': '0.268', 'WEAPON3': '0.400', 'weapon2': '1.446'} [2024-08-05 09:47:31,052][00166] DAMAGECOUNT value on done: 46.0 [2024-08-05 09:47:31,053][00166] Sum rewards: -0.569, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.026', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.054', 'HITCOUNT': '0.060', 'AMMO4': '0.085', 'DAMAGECOUNT': '0.138', 'HEALTH': '0.140', 'weapon4': '0.148', 'WEAPON4': '0.150', 'WEAPON3': '0.300', 'weapon3': '0.666', 'FRAGCOUNT': '1.000', 'weapon2': '1.052'} [2024-08-05 09:47:31,395][00164] DAMAGECOUNT value on done: 100.0 [2024-08-05 09:47:32,097][00160] DAMAGECOUNT value on done: 105.0 [2024-08-05 09:47:32,142][00167] DAMAGECOUNT value on done: 11.0 [2024-08-05 09:47:32,582][00161] DAMAGECOUNT value on done: 20.0 [2024-08-05 09:47:32,584][00161] Sum rewards: -10.784, reward structure: {'DEATHCOUNT': '-11.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.426', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.014', 'HITCOUNT': '0.020', 'WEAPON5': '0.050', 'DAMAGECOUNT': '0.060', 'weapon4': '0.064', 'AMMO4': '0.070', 'ARMOR': '0.080', 'WEAPON4': '0.150', 'AMMO3': '0.185', 'weapon3': '0.770', 'WEAPON3': '0.800', 'weapon2': '1.114'} [2024-08-05 09:47:32,712][00165] DAMAGECOUNT value on done: 90.0 [2024-08-05 09:47:32,723][00165] Sum rewards: -6.254, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.255', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.022', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.152', 'weapon4': '0.178', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.270', 'weapon3': '0.618', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.144'} [2024-08-05 09:47:33,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 5026.3). Total num frames: 1908736. Throughput: 0: 1229.0. Samples: 481440. Policy #0 lag: (min: 0.0, avg: 1.9, max: 4.0) [2024-08-05 09:47:33,364][00034] Avg episode reward: [(0, '-5.767')] [2024-08-05 09:47:34,505][00170] DAMAGECOUNT value on done: 110.0 [2024-08-05 09:47:34,515][00170] Sum rewards: -3.664, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.444', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.020', 'AMMO4': '0.058', 'HITCOUNT': '0.060', 'ARMOR': '0.079', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO3': '0.121', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.550', 'weapon3': '0.726', 'weapon2': '0.964', 'FRAGCOUNT': '1.000'} [2024-08-05 09:47:34,682][00169] DAMAGECOUNT value on done: 60.0 [2024-08-05 09:47:34,850][00156] DAMAGECOUNT value on done: 15.0 [2024-08-05 09:47:34,854][00156] Sum rewards: -3.405, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.003', 'HITCOUNT': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.036', 'DAMAGECOUNT': '0.045', 'WEAPON5': '0.050', 'ARMOR': '0.064', 'AMMO3': '0.098', 'AMMO4': '0.177', 'weapon4': '0.236', 'WEAPON4': '0.250', 'HEALTH': '0.468', 'WEAPON3': '0.500', 'weapon3': '0.632', 'FRAGCOUNT': '1.000', 'weapon2': '1.266'} [2024-08-05 09:47:35,335][00163] DAMAGECOUNT value on done: 45.0 [2024-08-05 09:47:35,683][00168] DAMAGECOUNT value on done: 7.0 [2024-08-05 09:47:36,077][00158] DAMAGECOUNT value on done: 155.0 [2024-08-05 09:47:36,086][00172] DAMAGECOUNT value on done: 155.0 [2024-08-05 09:47:36,088][00172] Sum rewards: -3.769, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.974', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.012', 'weapon5': '0.022', 'HITCOUNT': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'DAMAGECOUNT': '0.465', 'weapon3': '0.656', 'WEAPON3': '0.700', 'weapon2': '1.288', 'FRAGCOUNT': '2.000'} [2024-08-05 09:47:36,645][00171] DAMAGECOUNT value on done: 25.0 [2024-08-05 09:47:37,078][00159] DAMAGECOUNT value on done: 60.0 [2024-08-05 09:47:37,375][00162] DAMAGECOUNT value on done: 60.0 [2024-08-05 09:47:37,474][00166] DAMAGECOUNT value on done: 92.0 [2024-08-05 09:47:37,480][00166] Sum rewards: -4.941, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.034', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.022', 'ARMOR': '0.024', 'WEAPON5': '0.050', 'HITCOUNT': '0.100', 'AMMO4': '0.110', 'weapon4': '0.114', 'AMMO3': '0.116', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.276', 'WEAPON3': '0.450', 'weapon3': '0.738', 'FRAGCOUNT': '1.000', 'weapon2': '1.132'} [2024-08-05 09:47:37,623][00164] DAMAGECOUNT value on done: 59.0 [2024-08-05 09:47:38,356][00034] Fps is (10 sec: 4915.1, 60 sec: 4915.2, 300 sec: 4998.5). Total num frames: 1933312. Throughput: 0: 1227.7. Samples: 485080. Policy #0 lag: (min: 0.0, avg: 1.7, max: 4.0) [2024-08-05 09:47:38,358][00034] Avg episode reward: [(0, '-5.838')] [2024-08-05 09:47:38,627][00160] DAMAGECOUNT value on done: 91.0 [2024-08-05 09:47:38,631][00160] Sum rewards: -4.164, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.744', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'HITCOUNT': '0.070', 'AMMO3': '0.104', 'AMMO4': '0.117', 'weapon4': '0.180', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.273', 'ARMOR': '0.428', 'WEAPON3': '0.550', 'weapon3': '0.620', 'FRAGCOUNT': '1.000', 'weapon2': '1.194'} [2024-08-05 09:47:38,924][00165] DAMAGECOUNT value on done: 25.0 [2024-08-05 09:47:38,929][00165] Sum rewards: -3.503, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.694', 'AMMO2': '0.004', 'AMMO5': '0.005', 'HITCOUNT': '0.020', 'weapon4': '0.020', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'DAMAGECOUNT': '0.075', 'AMMO3': '0.076', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon2': '1.082', 'weapon3': '1.138'} [2024-08-05 09:47:38,938][00167] DAMAGECOUNT value on done: 25.0 [2024-08-05 09:47:39,650][00161] DAMAGECOUNT value on done: 138.0 [2024-08-05 09:47:39,655][00161] Sum rewards: -7.749, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-2.000', 'HEALTH': '-1.172', 'AMMO2': '0.006', 'AMMO5': '0.006', 'AMMO4': '0.028', 'weapon5': '0.030', 'ARMOR': '0.032', 'weapon4': '0.032', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'HITCOUNT': '0.130', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.414', 'WEAPON3': '0.550', 'weapon3': '0.784', 'weapon2': '1.298'} [2024-08-05 09:47:41,044][00170] DAMAGECOUNT value on done: 40.0 [2024-08-05 09:47:41,048][00170] Sum rewards: -8.304, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.128', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.018', 'HITCOUNT': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.090', 'AMMO3': '0.117', 'DAMAGECOUNT': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.272', 'WEAPON3': '0.500', 'weapon3': '0.714', 'weapon2': '0.990'} [2024-08-05 09:47:41,341][00163] DAMAGECOUNT value on done: 130.0 [2024-08-05 09:47:41,345][00163] Sum rewards: -5.461, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.330', 'AMMO2': '0.003', 'AMMO4': '0.015', 'ARMOR': '0.036', 'HITCOUNT': '0.070', 'AMMO3': '0.102', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.600', 'weapon3': '0.872', 'FRAGCOUNT': '1.000', 'weapon2': '1.280'} [2024-08-05 09:47:41,399][00169] DAMAGECOUNT value on done: 5.0 [2024-08-05 09:47:41,913][00168] DAMAGECOUNT value on done: 100.0 [2024-08-05 09:47:42,048][00156] DAMAGECOUNT value on done: 0.0 [2024-08-05 09:47:42,276][00158] DAMAGECOUNT value on done: 80.0 [2024-08-05 09:47:42,556][00172] DAMAGECOUNT value on done: 0.0 [2024-08-05 09:47:43,142][00171] DAMAGECOUNT value on done: 16.0 [2024-08-05 09:47:43,362][00034] Fps is (10 sec: 4912.2, 60 sec: 4914.7, 300 sec: 4998.4). Total num frames: 1957888. Throughput: 0: 1228.1. Samples: 492584. Policy #0 lag: (min: 0.0, avg: 2.1, max: 4.0) [2024-08-05 09:47:43,364][00034] Avg episode reward: [(0, '-5.983')] [2024-08-05 09:47:44,132][00164] DAMAGECOUNT value on done: 20.0 [2024-08-05 09:47:44,248][00159] DAMAGECOUNT value on done: 205.0 [2024-08-05 09:47:44,251][00159] Sum rewards: -5.283, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.964', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.036', 'weapon4': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'HITCOUNT': '0.130', 'WEAPON5': '0.150', 'ARMOR': '0.564', 'weapon3': '0.594', 'DAMAGECOUNT': '0.615', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.402'} [2024-08-05 09:47:44,433][00162] DAMAGECOUNT value on done: 31.0 [2024-08-05 09:47:45,029][00157] Updated weights for policy 0, policy_version 240 (0.0020) [2024-08-05 09:47:45,288][00160] DAMAGECOUNT value on done: 18.0 [2024-08-05 09:47:45,531][00166] DAMAGECOUNT value on done: 110.0 [2024-08-05 09:47:45,534][00166] Sum rewards: -2.353, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.544', 'ARMOR': '0.016', 'weapon4': '0.016', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'HITCOUNT': '0.060', 'AMMO3': '0.076', 'AMMO4': '0.124', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.400', 'weapon3': '0.796', 'FRAGCOUNT': '1.000', 'weapon2': '1.258'} [2024-08-05 09:47:45,540][00165] DAMAGECOUNT value on done: 67.0 [2024-08-05 09:47:45,546][00165] Sum rewards: -9.222, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.008', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'ARMOR': '0.040', 'HITCOUNT': '0.060', 'weapon4': '0.118', 'AMMO4': '0.130', 'AMMO3': '0.160', 'DAMAGECOUNT': '0.201', 'WEAPON4': '0.300', 'weapon3': '0.616', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.276'} [2024-08-05 09:47:46,740][00167] DAMAGECOUNT value on done: 19.0 [2024-08-05 09:47:47,109][00161] DAMAGECOUNT value on done: 50.0 [2024-08-05 09:47:48,090][00163] DAMAGECOUNT value on done: 125.0 [2024-08-05 09:47:48,092][00163] Sum rewards: -3.054, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.023', 'AMMO2': '0.003', 'AMMO5': '0.013', 'AMMO4': '0.015', 'weapon5': '0.042', 'HITCOUNT': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'WEAPON5': '0.250', 'weapon4': '0.256', 'DAMAGECOUNT': '0.375', 'weapon3': '0.418', 'WEAPON3': '0.450', 'ARMOR': '0.463', 'FRAGCOUNT': '1.000', 'weapon2': '1.150'} [2024-08-05 09:47:48,307][00168] DAMAGECOUNT value on done: 50.0 [2024-08-05 09:47:48,355][00034] Fps is (10 sec: 4915.4, 60 sec: 5051.7, 300 sec: 4970.7). Total num frames: 1982464. Throughput: 0: 1213.0. Samples: 499448. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 09:47:48,357][00034] Avg episode reward: [(0, '-5.891')] [2024-08-05 09:47:48,796][00170] DAMAGECOUNT value on done: 75.0 [2024-08-05 09:47:48,990][00172] DAMAGECOUNT value on done: 85.0 [2024-08-05 09:47:49,062][00156] DAMAGECOUNT value on done: 45.0 [2024-08-05 09:47:49,062][00156] Sum rewards: -5.047, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.310', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.030', 'HITCOUNT': '0.060', 'weapon4': '0.062', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.135', 'WEAPON4': '0.150', 'AMMO4': '0.150', 'WEAPON3': '0.550', 'weapon3': '0.894', 'FRAGCOUNT': '1.000', 'weapon2': '1.024'} [2024-08-05 09:47:49,209][00158] DAMAGECOUNT value on done: 45.0 [2024-08-05 09:47:49,210][00158] Sum rewards: -5.944, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.725', 'FRAGCOUNT': '-1.500', 'weapon4': '0.002', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.012', 'AMMO2': '0.016', 'HITCOUNT': '0.040', 'WEAPON5': '0.050', 'ARMOR': '0.052', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'DAMAGECOUNT': '0.135', 'WEAPON3': '0.600', 'weapon2': '1.012', 'weapon3': '1.056'} [2024-08-05 09:47:49,294][00169] DAMAGECOUNT value on done: 0.0 [2024-08-05 09:47:50,060][00171] DAMAGECOUNT value on done: 29.0 [2024-08-05 09:47:50,563][00164] DAMAGECOUNT value on done: 20.0 [2024-08-05 09:47:51,198][00159] DAMAGECOUNT value on done: 0.0 [2024-08-05 09:47:51,315][00162] DAMAGECOUNT value on done: 30.0 [2024-08-05 09:47:51,577][00160] DAMAGECOUNT value on done: 0.0 [2024-08-05 09:47:51,646][00166] DAMAGECOUNT value on done: 55.0 [2024-08-05 09:47:52,860][00167] DAMAGECOUNT value on done: 0.0 [2024-08-05 09:47:53,042][00165] DAMAGECOUNT value on done: 14.0 [2024-08-05 09:47:53,264][00161] DAMAGECOUNT value on done: 45.0 [2024-08-05 09:47:53,355][00034] Fps is (10 sec: 4918.3, 60 sec: 4915.2, 300 sec: 4998.5). Total num frames: 2007040. Throughput: 0: 1216.9. Samples: 503200. Policy #0 lag: (min: 0.0, avg: 2.0, max: 5.0) [2024-08-05 09:47:53,357][00034] Avg episode reward: [(0, '-5.957')] [2024-08-05 09:47:54,588][00168] DAMAGECOUNT value on done: 90.0 [2024-08-05 09:47:54,991][00170] DAMAGECOUNT value on done: 79.0 [2024-08-05 09:47:54,995][00170] Sum rewards: -10.913, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.820', 'AMMO2': '0.016', 'weapon4': '0.036', 'AMMO4': '0.079', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.147', 'DAMAGECOUNT': '0.237', 'weapon3': '0.440', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.412'} [2024-08-05 09:47:55,081][00156] DAMAGECOUNT value on done: 0.0 [2024-08-05 09:47:55,206][00172] DAMAGECOUNT value on done: 43.0 [2024-08-05 09:47:55,618][00169] DAMAGECOUNT value on done: 50.0 [2024-08-05 09:47:55,911][00163] DAMAGECOUNT value on done: 207.0 [2024-08-05 09:47:55,918][00163] Sum rewards: -5.066, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.501', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.027', 'HITCOUNT': '0.070', 'weapon5': '0.080', 'AMMO3': '0.082', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.621', 'weapon3': '0.770', 'FRAGCOUNT': '1.000', 'weapon2': '1.320'} [2024-08-05 09:47:56,806][00158] DAMAGECOUNT value on done: 0.0 [2024-08-05 09:47:56,987][00164] DAMAGECOUNT value on done: 10.0 [2024-08-05 09:47:57,505][00171] DAMAGECOUNT value on done: 30.0 [2024-08-05 09:47:57,683][00166] DAMAGECOUNT value on done: 85.0 [2024-08-05 09:47:57,842][00160] DAMAGECOUNT value on done: 65.0 [2024-08-05 09:47:58,347][00159] DAMAGECOUNT value on done: 265.0 [2024-08-05 09:47:58,356][00034] Fps is (10 sec: 4096.0, 60 sec: 4778.7, 300 sec: 4970.7). Total num frames: 2023424. Throughput: 0: 1228.6. Samples: 510608. Policy #0 lag: (min: 0.0, avg: 2.1, max: 5.0) [2024-08-05 09:47:58,357][00034] Avg episode reward: [(0, '-6.094')] [2024-08-05 09:47:58,353][00159] Sum rewards: -6.450, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.052', 'AMMO5': '0.003', 'weapon5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon4': '0.058', 'AMMO4': '0.101', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'HITCOUNT': '0.190', 'WEAPON3': '0.600', 'weapon3': '0.764', 'DAMAGECOUNT': '0.795', 'FRAGCOUNT': '1.000', 'weapon2': '1.220'} [2024-08-05 09:47:58,541][00162] DAMAGECOUNT value on done: 37.0 [2024-08-05 09:47:58,917][00167] DAMAGECOUNT value on done: 99.0 [2024-08-05 09:47:58,920][00167] Sum rewards: -8.331, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.122', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.011', 'ARMOR': '0.038', 'AMMO4': '0.056', 'HITCOUNT': '0.070', 'AMMO3': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.158', 'DAMAGECOUNT': '0.297', 'WEAPON3': '0.450', 'weapon3': '0.580', 'weapon2': '1.214'} [2024-08-05 09:47:59,327][00161] DAMAGECOUNT value on done: 0.0 [2024-08-05 09:47:59,575][00165] DAMAGECOUNT value on done: 98.0 [2024-08-05 09:47:59,577][00165] Sum rewards: -5.365, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.024', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'ARMOR': '0.040', 'HITCOUNT': '0.100', 'AMMO3': '0.179', 'DAMAGECOUNT': '0.294', 'weapon2': '0.834', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.312'} [2024-08-05 09:48:00,706][00168] DAMAGECOUNT value on done: 84.0 [2024-08-05 09:48:00,713][00168] Sum rewards: -3.908, reward structure: {'DEATHCOUNT': '-5.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.520', 'AMMO2': '0.009', 'AMMO5': '0.017', 'AMMO4': '0.044', 'weapon5': '0.050', 'ARMOR': '0.055', 'AMMO3': '0.067', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'weapon4': '0.158', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.252', 'WEAPON3': '0.350', 'weapon3': '0.688', 'weapon2': '1.212'} [2024-08-05 09:48:01,234][00156] DAMAGECOUNT value on done: 15.0 [2024-08-05 09:48:01,321][00172] DAMAGECOUNT value on done: 0.0 [2024-08-05 09:48:01,535][00157] Updated weights for policy 0, policy_version 250 (0.0020) [2024-08-05 09:48:01,916][00163] DAMAGECOUNT value on done: 55.0 [2024-08-05 09:48:01,923][00163] Sum rewards: -5.347, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.205', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'HITCOUNT': '0.050', 'AMMO3': '0.090', 'AMMO4': '0.092', 'DAMAGECOUNT': '0.165', 'weapon4': '0.186', 'WEAPON4': '0.200', 'WEAPON3': '0.500', 'weapon3': '0.576', 'FRAGCOUNT': '1.000', 'weapon2': '1.200'} [2024-08-05 09:48:02,573][00170] DAMAGECOUNT value on done: 120.0 [2024-08-05 09:48:02,967][00158] DAMAGECOUNT value on done: 64.0 [2024-08-05 09:48:03,054][00169] DAMAGECOUNT value on done: 130.0 [2024-08-05 09:48:03,197][00164] DAMAGECOUNT value on done: 10.0 [2024-08-05 09:48:03,356][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4998.5). Total num frames: 2056192. Throughput: 0: 1231.6. Samples: 518168. Policy #0 lag: (min: 0.0, avg: 2.0, max: 4.0) [2024-08-05 09:48:03,357][00034] Avg episode reward: [(0, '-6.179')] [2024-08-05 09:48:03,837][00171] DAMAGECOUNT value on done: 197.0 [2024-08-05 09:48:03,838][00171] Sum rewards: -3.054, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.525', 'weapon4': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.020', 'HITCOUNT': '0.040', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.101', 'weapon5': '0.104', 'AMMO3': '0.110', 'WEAPON5': '0.250', 'weapon3': '0.356', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.591', 'weapon2': '1.580', 'FRAGCOUNT': '2.000'} [2024-08-05 09:48:04,005][00160] DAMAGECOUNT value on done: 35.0 [2024-08-05 09:48:04,013][00160] Sum rewards: -3.195, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.304', 'AMMO5': '0.005', 'weapon5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'HITCOUNT': '0.030', 'AMMO3': '0.039', 'ARMOR': '0.076', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.105', 'AMMO4': '0.108', 'WEAPON3': '0.250', 'weapon4': '0.272', 'WEAPON4': '0.300', 'weapon3': '0.626', 'FRAGCOUNT': '1.000', 'weapon2': '1.140'} [2024-08-05 09:48:04,118][00166] DAMAGECOUNT value on done: 10.0 [2024-08-05 09:48:04,121][00166] Sum rewards: -7.269, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.640', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.007', 'HITCOUNT': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'DAMAGECOUNT': '0.030', 'weapon5': '0.030', 'weapon4': '0.046', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'WEAPON5': '0.150', 'WEAPON3': '0.600', 'weapon3': '0.792', 'weapon2': '1.134'} [2024-08-05 09:48:05,152][00159] DAMAGECOUNT value on done: 140.0 [2024-08-05 09:48:05,161][00159] Sum rewards: -6.772, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.119', 'AMMO2': '0.019', 'HITCOUNT': '0.080', 'weapon4': '0.082', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.160', 'DAMAGECOUNT': '0.420', 'ARMOR': '0.432', 'weapon3': '0.562', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.246'} [2024-08-05 09:48:05,215][00162] DAMAGECOUNT value on done: 0.0 [2024-08-05 09:48:05,468][00167] DAMAGECOUNT value on done: 70.0 [2024-08-05 09:48:05,473][00167] Sum rewards: -4.191, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.702', 'ARMOR': '0.024', 'AMMO2': '0.028', 'HITCOUNT': '0.070', 'AMMO3': '0.115', 'AMMO4': '0.138', 'weapon4': '0.200', 'DAMAGECOUNT': '0.210', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'weapon3': '0.588', 'weapon2': '1.288', 'FRAGCOUNT': '2.000'} [2024-08-05 09:48:05,875][00161] DAMAGECOUNT value on done: 35.0 [2024-08-05 09:48:06,223][00165] DAMAGECOUNT value on done: 160.0 [2024-08-05 09:48:06,225][00165] Sum rewards: -4.788, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.825', 'AMMO2': '0.010', 'weapon4': '0.022', 'AMMO4': '0.051', 'ARMOR': '0.080', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.125', 'DAMAGECOUNT': '0.480', 'weapon3': '0.564', 'WEAPON3': '0.650', 'weapon2': '1.584', 'FRAGCOUNT': '2.000'} [2024-08-05 09:48:07,392][00168] DAMAGECOUNT value on done: 0.0 [2024-08-05 09:48:07,798][00156] DAMAGECOUNT value on done: 20.0 [2024-08-05 09:48:08,234][00172] DAMAGECOUNT value on done: 30.0 [2024-08-05 09:48:08,356][00034] Fps is (10 sec: 5734.4, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 2080768. Throughput: 0: 1231.8. Samples: 521880. Policy #0 lag: (min: 0.0, avg: 2.1, max: 4.0) [2024-08-05 09:48:08,357][00034] Avg episode reward: [(0, '-6.131')] [2024-08-05 09:48:08,606][00170] DAMAGECOUNT value on done: 27.0 [2024-08-05 09:48:08,638][00163] DAMAGECOUNT value on done: 20.0 [2024-08-05 09:48:09,053][00169] DAMAGECOUNT value on done: 50.0 [2024-08-05 09:48:09,650][00158] DAMAGECOUNT value on done: 90.0 [2024-08-05 09:48:10,290][00166] DAMAGECOUNT value on done: 45.0 [2024-08-05 09:48:10,440][00171] DAMAGECOUNT value on done: 25.0 [2024-08-05 09:48:10,757][00164] DAMAGECOUNT value on done: 30.0 [2024-08-05 09:48:10,758][00164] Sum rewards: -5.940, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-3.000', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'HITCOUNT': '0.030', 'HEALTH': '0.034', 'AMMO3': '0.064', 'weapon5': '0.066', 'DAMAGECOUNT': '0.090', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'ARMOR': '0.132', 'WEAPON4': '0.200', 'weapon4': '0.280', 'WEAPON3': '0.350', 'weapon3': '0.660', 'weapon2': '0.926'} [2024-08-05 09:48:11,124][00159] DAMAGECOUNT value on done: 25.0 [2024-08-05 09:48:11,219][00162] DAMAGECOUNT value on done: 10.0 [2024-08-05 09:48:11,688][00167] DAMAGECOUNT value on done: 60.0 [2024-08-05 09:48:11,900][00160] DAMAGECOUNT value on done: 36.0 [2024-08-05 09:48:12,120][00161] DAMAGECOUNT value on done: 20.0 [2024-08-05 09:48:12,366][00165] DAMAGECOUNT value on done: 195.0 [2024-08-05 09:48:12,367][00165] Sum rewards: -3.876, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.340', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'ARMOR': '0.065', 'weapon4': '0.088', 'AMMO3': '0.113', 'HITCOUNT': '0.160', 'DAMAGECOUNT': '0.585', 'WEAPON3': '0.650', 'weapon3': '0.754', 'weapon2': '1.218', 'FRAGCOUNT': '2.000'} [2024-08-05 09:48:13,356][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 2105344. Throughput: 0: 1233.8. Samples: 529400. Policy #0 lag: (min: 0.0, avg: 1.7, max: 4.0) [2024-08-05 09:48:13,358][00034] Avg episode reward: [(0, '-6.216')] [2024-08-05 09:48:14,464][00156] DAMAGECOUNT value on done: 15.0 [2024-08-05 09:48:15,031][00163] DAMAGECOUNT value on done: 102.0 [2024-08-05 09:48:15,040][00163] Sum rewards: -8.436, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.452', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.029', 'ARMOR': '0.063', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.128', 'AMMO4': '0.144', 'AMMO3': '0.157', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.306', 'weapon3': '0.394', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.578'} [2024-08-05 09:48:15,123][00168] DAMAGECOUNT value on done: 130.0 [2024-08-05 09:48:15,128][00168] Sum rewards: -5.002, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.067', 'AMMO2': '0.021', 'AMMO4': '0.106', 'HITCOUNT': '0.110', 'AMMO3': '0.140', 'weapon4': '0.202', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.390', 'ARMOR': '0.448', 'WEAPON3': '0.550', 'weapon3': '0.732', 'FRAGCOUNT': '1.000', 'weapon2': '1.116'} [2024-08-05 09:48:15,161][00170] DAMAGECOUNT value on done: 107.0 [2024-08-05 09:48:15,806][00172] DAMAGECOUNT value on done: 75.0 [2024-08-05 09:48:15,812][00172] Sum rewards: -8.258, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.902', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON5': '0.050', 'HITCOUNT': '0.070', 'AMMO3': '0.164', 'DAMAGECOUNT': '0.225', 'WEAPON3': '0.750', 'weapon3': '0.916', 'weapon2': '1.182', 'FRAGCOUNT': '2.000'} [2024-08-05 09:48:15,941][00169] DAMAGECOUNT value on done: 0.0 [2024-08-05 09:48:16,255][00158] DAMAGECOUNT value on done: 25.0 [2024-08-05 09:48:16,263][00158] Sum rewards: -8.894, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.060', 'AMMO5': '0.006', 'weapon4': '0.008', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'HITCOUNT': '0.030', 'AMMO4': '0.070', 'DAMAGECOUNT': '0.075', 'ARMOR': '0.076', 'weapon5': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'WEAPON5': '0.150', 'weapon3': '0.586', 'WEAPON3': '0.600', 'weapon2': '1.476'} [2024-08-05 09:48:17,260][00171] DAMAGECOUNT value on done: 135.0 [2024-08-05 09:48:17,268][00171] Sum rewards: -3.172, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.524', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.023', 'ARMOR': '0.040', 'AMMO3': '0.099', 'HITCOUNT': '0.110', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'weapon4': '0.150', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.550', 'weapon3': '0.910', 'FRAGCOUNT': '1.000', 'weapon2': '1.034'} [2024-08-05 09:48:17,674][00166] DAMAGECOUNT value on done: 95.0 [2024-08-05 09:48:17,680][00166] Sum rewards: -7.055, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.610', 'AMMO2': '0.011', 'ARMOR': '0.040', 'HITCOUNT': '0.050', 'AMMO4': '0.054', 'weapon4': '0.108', 'AMMO3': '0.117', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.285', 'WEAPON3': '0.500', 'weapon3': '0.542', 'FRAGCOUNT': '1.000', 'weapon2': '1.448'} [2024-08-05 09:48:17,708][00164] DAMAGECOUNT value on done: 30.0 [2024-08-05 09:48:18,054][00159] DAMAGECOUNT value on done: 30.0 [2024-08-05 09:48:18,056][00159] Sum rewards: -5.675, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.354', 'AMMO5': '0.007', 'ARMOR': '0.024', 'AMMO2': '0.024', 'HITCOUNT': '0.030', 'AMMO3': '0.062', 'DAMAGECOUNT': '0.090', 'AMMO4': '0.121', 'weapon4': '0.198', 'WEAPON3': '0.250', 'WEAPON4': '0.300', 'weapon3': '0.548', 'FRAGCOUNT': '1.000', 'weapon2': '1.274'} [2024-08-05 09:48:18,194][00162] DAMAGECOUNT value on done: 53.0 [2024-08-05 09:48:18,282][00157] Updated weights for policy 0, policy_version 260 (0.0021) [2024-08-05 09:48:18,355][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4970.7). Total num frames: 2129920. Throughput: 0: 1218.3. Samples: 536264. Policy #0 lag: (min: 0.0, avg: 1.7, max: 4.0) [2024-08-05 09:48:18,357][00034] Avg episode reward: [(0, '-6.321')] [2024-08-05 09:48:18,690][00160] DAMAGECOUNT value on done: 65.0 [2024-08-05 09:48:19,181][00167] DAMAGECOUNT value on done: 70.0 [2024-08-05 09:48:19,429][00165] DAMAGECOUNT value on done: 76.0 [2024-08-05 09:48:19,772][00161] DAMAGECOUNT value on done: 65.0 [2024-08-05 09:48:19,774][00161] Sum rewards: -3.684, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.974', 'AMMO5': '0.014', 'AMMO2': '0.019', 'weapon5': '0.030', 'HITCOUNT': '0.070', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'weapon4': '0.120', 'AMMO3': '0.135', 'DAMAGECOUNT': '0.195', 'WEAPON4': '0.250', 'ARMOR': '0.436', 'WEAPON3': '0.550', 'weapon3': '0.714', 'FRAGCOUNT': '1.000', 'weapon2': '1.060'} [2024-08-05 09:48:21,820][00163] DAMAGECOUNT value on done: 55.0 [2024-08-05 09:48:21,845][00156] DAMAGECOUNT value on done: 17.0 [2024-08-05 09:48:21,850][00156] Sum rewards: -6.588, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.472', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.007', 'weapon5': '0.018', 'HITCOUNT': '0.030', 'WEAPON5': '0.050', 'DAMAGECOUNT': '0.051', 'AMMO3': '0.143', 'WEAPON3': '0.700', 'weapon3': '0.974', 'weapon2': '1.186'} [2024-08-05 09:48:23,026][00158] DAMAGECOUNT value on done: 35.0 [2024-08-05 09:48:23,031][00158] Sum rewards: -6.409, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.638', 'AMMO5': '0.015', 'AMMO2': '0.019', 'HITCOUNT': '0.050', 'weapon4': '0.058', 'weapon5': '0.064', 'ARMOR': '0.072', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'DAMAGECOUNT': '0.105', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'weapon3': '0.638', 'weapon2': '1.108'} [2024-08-05 09:48:23,356][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4998.5). Total num frames: 2154496. Throughput: 0: 1220.8. Samples: 540016. Policy #0 lag: (min: 0.0, avg: 1.9, max: 5.0) [2024-08-05 09:48:23,357][00034] Avg episode reward: [(0, '-6.305')] [2024-08-05 09:48:23,742][00171] DAMAGECOUNT value on done: 125.0 [2024-08-05 09:48:23,743][00171] Sum rewards: -1.147, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.676', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.028', 'AMMO3': '0.068', 'HITCOUNT': '0.100', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.154', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.400', 'weapon3': '0.952', 'weapon2': '0.998', 'FRAGCOUNT': '2.000'} [2024-08-05 09:48:28,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 2179072. Throughput: 0: 1222.9. Samples: 547608. Policy #0 lag: (min: 0.0, avg: 2.0, max: 5.0) [2024-08-05 09:48:28,357][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:48:33,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 2203648. Throughput: 0: 1243.4. Samples: 555400. Policy #0 lag: (min: 0.0, avg: 1.9, max: 4.0) [2024-08-05 09:48:33,357][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:48:34,540][00157] Updated weights for policy 0, policy_version 270 (0.0035) [2024-08-05 09:48:38,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 2228224. Throughput: 0: 1244.3. Samples: 559192. Policy #0 lag: (min: 0.0, avg: 2.0, max: 5.0) [2024-08-05 09:48:38,357][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:48:43,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.7, 300 sec: 4970.7). Total num frames: 2252800. Throughput: 0: 1252.6. Samples: 566976. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 09:48:43,357][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:48:48,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 2277376. Throughput: 0: 1242.0. Samples: 574056. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 09:48:48,357][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:48:51,255][00157] Updated weights for policy 0, policy_version 280 (0.0020) [2024-08-05 09:48:53,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 2301952. Throughput: 0: 1242.1. Samples: 577776. Policy #0 lag: (min: 0.0, avg: 2.0, max: 5.0) [2024-08-05 09:48:53,357][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:48:58,355][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4970.7). Total num frames: 2326528. Throughput: 0: 1244.1. Samples: 585384. Policy #0 lag: (min: 0.0, avg: 1.8, max: 5.0) [2024-08-05 09:48:58,357][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:49:03,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 2351104. Throughput: 0: 1263.6. Samples: 593128. Policy #0 lag: (min: 0.0, avg: 2.0, max: 5.0) [2024-08-05 09:49:03,357][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:49:06,691][00157] Updated weights for policy 0, policy_version 290 (0.0023) [2024-08-05 09:49:08,356][00034] Fps is (10 sec: 4915.1, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 2375680. Throughput: 0: 1264.2. Samples: 596904. Policy #0 lag: (min: 0.0, avg: 1.8, max: 4.0) [2024-08-05 09:49:08,360][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:49:13,355][00034] Fps is (10 sec: 5734.4, 60 sec: 5051.7, 300 sec: 4998.5). Total num frames: 2408448. Throughput: 0: 1265.1. Samples: 604536. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 09:49:13,357][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:49:16,368][00163] Large shaping reward -2.534 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 09:49:18,356][00034] Fps is (10 sec: 4915.3, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 2424832. Throughput: 0: 1260.3. Samples: 612112. Policy #0 lag: (min: 0.0, avg: 2.2, max: 4.0) [2024-08-05 09:49:18,360][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:49:23,356][00034] Fps is (10 sec: 4095.9, 60 sec: 4915.2, 300 sec: 4943.1). Total num frames: 2449408. Throughput: 0: 1247.3. Samples: 615320. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 09:49:23,358][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:49:23,369][00136] Saving /kaggle/working/train_dir/default_experiment/checkpoint_p0/checkpoint_000000299_2449408.pth... [2024-08-05 09:49:23,555][00136] Removing /kaggle/working/train_dir/default_experiment/checkpoint_p0/checkpoint_000000154_1261568.pth [2024-08-05 09:49:24,057][00157] Updated weights for policy 0, policy_version 300 (0.0030) [2024-08-05 09:49:28,356][00034] Fps is (10 sec: 4915.1, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 2473984. Throughput: 0: 1242.3. Samples: 622880. Policy #0 lag: (min: 0.0, avg: 2.1, max: 5.0) [2024-08-05 09:49:28,360][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:49:33,355][00034] Fps is (10 sec: 5734.5, 60 sec: 5051.7, 300 sec: 4998.5). Total num frames: 2506752. Throughput: 0: 1257.4. Samples: 630640. Policy #0 lag: (min: 0.0, avg: 2.1, max: 5.0) [2024-08-05 09:49:33,358][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:49:38,355][00034] Fps is (10 sec: 4915.3, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 2523136. Throughput: 0: 1259.6. Samples: 634456. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 09:49:38,357][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:49:38,924][00157] Updated weights for policy 0, policy_version 310 (0.0020) [2024-08-05 09:49:43,355][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4970.7). Total num frames: 2555904. Throughput: 0: 1262.8. Samples: 642208. Policy #0 lag: (min: 0.0, avg: 2.2, max: 4.0) [2024-08-05 09:49:43,358][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:49:48,355][00034] Fps is (10 sec: 5734.4, 60 sec: 5051.7, 300 sec: 4970.7). Total num frames: 2580480. Throughput: 0: 1258.1. Samples: 649744. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 09:49:48,359][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:49:53,356][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4970.7). Total num frames: 2605056. Throughput: 0: 1256.0. Samples: 653424. Policy #0 lag: (min: 0.0, avg: 2.1, max: 5.0) [2024-08-05 09:49:53,357][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:49:56,514][00157] Updated weights for policy 0, policy_version 320 (0.0026) [2024-08-05 09:49:58,356][00034] Fps is (10 sec: 4915.1, 60 sec: 5051.7, 300 sec: 4998.5). Total num frames: 2629632. Throughput: 0: 1244.1. Samples: 660520. Policy #0 lag: (min: 0.0, avg: 2.0, max: 5.0) [2024-08-05 09:49:58,357][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:50:03,356][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4970.7). Total num frames: 2654208. Throughput: 0: 1246.0. Samples: 668184. Policy #0 lag: (min: 0.0, avg: 1.9, max: 5.0) [2024-08-05 09:50:03,358][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:50:08,355][00034] Fps is (10 sec: 4915.3, 60 sec: 5051.8, 300 sec: 4970.7). Total num frames: 2678784. Throughput: 0: 1257.2. Samples: 671896. Policy #0 lag: (min: 0.0, avg: 2.0, max: 5.0) [2024-08-05 09:50:08,357][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:50:12,076][00157] Updated weights for policy 0, policy_version 330 (0.0032) [2024-08-05 09:50:13,356][00034] Fps is (10 sec: 4915.0, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 2703360. Throughput: 0: 1261.1. Samples: 679632. Policy #0 lag: (min: 0.0, avg: 2.0, max: 5.0) [2024-08-05 09:50:13,358][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:50:18,355][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4970.7). Total num frames: 2727936. Throughput: 0: 1255.6. Samples: 687144. Policy #0 lag: (min: 0.0, avg: 1.7, max: 5.0) [2024-08-05 09:50:18,358][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:50:23,356][00034] Fps is (10 sec: 4915.4, 60 sec: 5051.7, 300 sec: 4970.7). Total num frames: 2752512. Throughput: 0: 1255.3. Samples: 690944. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 09:50:23,364][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:50:28,355][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.8, 300 sec: 4943.0). Total num frames: 2777088. Throughput: 0: 1238.2. Samples: 697928. Policy #0 lag: (min: 0.0, avg: 2.1, max: 4.0) [2024-08-05 09:50:28,357][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:50:28,579][00157] Updated weights for policy 0, policy_version 340 (0.0020) [2024-08-05 09:50:33,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 2801664. Throughput: 0: 1242.1. Samples: 705640. Policy #0 lag: (min: 0.0, avg: 1.7, max: 4.0) [2024-08-05 09:50:33,357][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:50:38,355][00034] Fps is (10 sec: 5734.4, 60 sec: 5188.3, 300 sec: 4998.5). Total num frames: 2834432. Throughput: 0: 1244.1. Samples: 709408. Policy #0 lag: (min: 0.0, avg: 1.6, max: 4.0) [2024-08-05 09:50:38,357][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:50:43,356][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 2850816. Throughput: 0: 1256.2. Samples: 717048. Policy #0 lag: (min: 0.0, avg: 2.3, max: 5.0) [2024-08-05 09:50:43,357][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:50:44,541][00157] Updated weights for policy 0, policy_version 350 (0.0020) [2024-08-05 09:50:48,356][00034] Fps is (10 sec: 4915.1, 60 sec: 5051.7, 300 sec: 4970.7). Total num frames: 2883584. Throughput: 0: 1252.4. Samples: 724544. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 09:50:48,360][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:50:53,355][00034] Fps is (10 sec: 5734.4, 60 sec: 5051.7, 300 sec: 4970.7). Total num frames: 2908160. Throughput: 0: 1254.2. Samples: 728336. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 09:50:53,357][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:50:58,355][00034] Fps is (10 sec: 4915.3, 60 sec: 5051.7, 300 sec: 4970.7). Total num frames: 2932736. Throughput: 0: 1240.4. Samples: 735448. Policy #0 lag: (min: 0.0, avg: 1.6, max: 4.0) [2024-08-05 09:50:58,358][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:51:01,259][00157] Updated weights for policy 0, policy_version 360 (0.0024) [2024-08-05 09:51:03,355][00034] Fps is (10 sec: 4096.0, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 2949120. Throughput: 0: 1240.9. Samples: 742984. Policy #0 lag: (min: 0.0, avg: 2.3, max: 5.0) [2024-08-05 09:51:03,360][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:51:08,355][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4970.7). Total num frames: 2981888. Throughput: 0: 1239.8. Samples: 746736. Policy #0 lag: (min: 0.0, avg: 2.1, max: 5.0) [2024-08-05 09:51:08,360][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:51:13,355][00034] Fps is (10 sec: 5734.4, 60 sec: 5051.8, 300 sec: 4970.7). Total num frames: 3006464. Throughput: 0: 1254.8. Samples: 754392. Policy #0 lag: (min: 0.0, avg: 2.0, max: 5.0) [2024-08-05 09:51:13,360][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:51:17,512][00157] Updated weights for policy 0, policy_version 370 (0.0027) [2024-08-05 09:51:18,356][00034] Fps is (10 sec: 4915.0, 60 sec: 5051.7, 300 sec: 4970.7). Total num frames: 3031040. Throughput: 0: 1249.6. Samples: 761872. Policy #0 lag: (min: 0.0, avg: 1.8, max: 5.0) [2024-08-05 09:51:18,360][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:51:23,356][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4970.7). Total num frames: 3055616. Throughput: 0: 1248.9. Samples: 765608. Policy #0 lag: (min: 0.0, avg: 1.6, max: 4.0) [2024-08-05 09:51:23,357][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:51:23,367][00136] Saving /kaggle/working/train_dir/default_experiment/checkpoint_p0/checkpoint_000000373_3055616.pth... [2024-08-05 09:51:23,561][00136] Removing /kaggle/working/train_dir/default_experiment/checkpoint_p0/checkpoint_000000227_1859584.pth [2024-08-05 09:51:28,357][00034] Fps is (10 sec: 4914.5, 60 sec: 5051.6, 300 sec: 4970.7). Total num frames: 3080192. Throughput: 0: 1247.6. Samples: 773192. Policy #0 lag: (min: 0.0, avg: 2.3, max: 5.0) [2024-08-05 09:51:28,359][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:51:33,356][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4970.7). Total num frames: 3104768. Throughput: 0: 1236.8. Samples: 780200. Policy #0 lag: (min: 0.0, avg: 2.2, max: 4.0) [2024-08-05 09:51:33,357][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:51:34,863][00157] Updated weights for policy 0, policy_version 380 (0.0020) [2024-08-05 09:51:38,355][00034] Fps is (10 sec: 4916.2, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 3129344. Throughput: 0: 1236.6. Samples: 783984. Policy #0 lag: (min: 0.0, avg: 2.0, max: 4.0) [2024-08-05 09:51:38,357][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:51:43,355][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4998.5). Total num frames: 3153920. Throughput: 0: 1247.8. Samples: 791600. Policy #0 lag: (min: 0.0, avg: 1.9, max: 4.0) [2024-08-05 09:51:43,357][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:51:48,356][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 3178496. Throughput: 0: 1246.0. Samples: 799056. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 09:51:48,357][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:51:51,614][00157] Updated weights for policy 0, policy_version 390 (0.0020) [2024-08-05 09:51:53,356][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 3203072. Throughput: 0: 1247.6. Samples: 802880. Policy #0 lag: (min: 0.0, avg: 1.8, max: 4.0) [2024-08-05 09:51:53,357][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:51:58,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 3227648. Throughput: 0: 1244.6. Samples: 810400. Policy #0 lag: (min: 0.0, avg: 1.7, max: 4.0) [2024-08-05 09:51:58,357][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:52:03,356][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4970.7). Total num frames: 3252224. Throughput: 0: 1235.2. Samples: 817456. Policy #0 lag: (min: 0.0, avg: 2.1, max: 5.0) [2024-08-05 09:52:03,360][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:52:06,950][00157] Updated weights for policy 0, policy_version 400 (0.0022) [2024-08-05 09:52:08,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 3276800. Throughput: 0: 1235.4. Samples: 821200. Policy #0 lag: (min: 0.0, avg: 1.8, max: 4.0) [2024-08-05 09:52:08,360][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:52:13,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4998.5). Total num frames: 3301376. Throughput: 0: 1237.6. Samples: 828880. Policy #0 lag: (min: 0.0, avg: 1.7, max: 4.0) [2024-08-05 09:52:13,357][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:52:18,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 3325952. Throughput: 0: 1247.5. Samples: 836336. Policy #0 lag: (min: 0.0, avg: 1.7, max: 4.0) [2024-08-05 09:52:18,358][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:52:23,357][00034] Fps is (10 sec: 4914.2, 60 sec: 4915.0, 300 sec: 4970.7). Total num frames: 3350528. Throughput: 0: 1247.6. Samples: 840128. Policy #0 lag: (min: 0.0, avg: 2.0, max: 5.0) [2024-08-05 09:52:23,359][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:52:24,589][00157] Updated weights for policy 0, policy_version 410 (0.0020) [2024-08-05 09:52:28,355][00034] Fps is (10 sec: 5734.4, 60 sec: 5051.9, 300 sec: 4998.5). Total num frames: 3383296. Throughput: 0: 1245.2. Samples: 847632. Policy #0 lag: (min: 0.0, avg: 2.3, max: 4.0) [2024-08-05 09:52:28,360][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:52:33,355][00034] Fps is (10 sec: 4916.2, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 3399680. Throughput: 0: 1245.0. Samples: 855080. Policy #0 lag: (min: 0.0, avg: 1.7, max: 5.0) [2024-08-05 09:52:33,357][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:52:38,355][00034] Fps is (10 sec: 4096.0, 60 sec: 4915.2, 300 sec: 4970.8). Total num frames: 3424256. Throughput: 0: 1235.2. Samples: 858464. Policy #0 lag: (min: 0.0, avg: 2.0, max: 4.0) [2024-08-05 09:52:38,357][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:52:40,243][00157] Updated weights for policy 0, policy_version 420 (0.0020) [2024-08-05 09:52:43,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 3448832. Throughput: 0: 1237.5. Samples: 866088. Policy #0 lag: (min: 0.0, avg: 2.1, max: 4.0) [2024-08-05 09:52:43,357][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:52:44,678][00170] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 09:52:48,355][00034] Fps is (10 sec: 5734.4, 60 sec: 5051.7, 300 sec: 4998.5). Total num frames: 3481600. Throughput: 0: 1247.1. Samples: 873576. Policy #0 lag: (min: 0.0, avg: 2.0, max: 4.0) [2024-08-05 09:52:48,360][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:52:53,355][00034] Fps is (10 sec: 5734.4, 60 sec: 5051.7, 300 sec: 5026.3). Total num frames: 3506176. Throughput: 0: 1247.5. Samples: 877336. Policy #0 lag: (min: 0.0, avg: 2.0, max: 4.0) [2024-08-05 09:52:53,357][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:52:57,310][00157] Updated weights for policy 0, policy_version 430 (0.0020) [2024-08-05 09:52:58,355][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4998.5). Total num frames: 3530752. Throughput: 0: 1245.9. Samples: 884944. Policy #0 lag: (min: 0.0, avg: 1.9, max: 4.0) [2024-08-05 09:52:58,358][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:53:03,355][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4998.5). Total num frames: 3555328. Throughput: 0: 1249.4. Samples: 892560. Policy #0 lag: (min: 0.0, avg: 1.9, max: 4.0) [2024-08-05 09:53:03,357][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:53:06,884][00162] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 09:53:08,355][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4998.5). Total num frames: 3579904. Throughput: 0: 1239.9. Samples: 895920. Policy #0 lag: (min: 0.0, avg: 1.9, max: 5.0) [2024-08-05 09:53:08,357][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:53:13,340][00157] Updated weights for policy 0, policy_version 440 (0.0020) [2024-08-05 09:53:13,355][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4998.5). Total num frames: 3604480. Throughput: 0: 1239.5. Samples: 903408. Policy #0 lag: (min: 0.0, avg: 1.8, max: 5.0) [2024-08-05 09:53:13,357][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:53:18,356][00034] Fps is (10 sec: 4915.1, 60 sec: 5051.7, 300 sec: 4998.5). Total num frames: 3629056. Throughput: 0: 1242.3. Samples: 910984. Policy #0 lag: (min: 0.0, avg: 1.9, max: 4.0) [2024-08-05 09:53:18,358][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:53:23,356][00034] Fps is (10 sec: 4915.1, 60 sec: 5051.9, 300 sec: 4998.5). Total num frames: 3653632. Throughput: 0: 1251.6. Samples: 914784. Policy #0 lag: (min: 0.0, avg: 2.0, max: 4.0) [2024-08-05 09:53:23,358][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:53:23,365][00136] Saving /kaggle/working/train_dir/default_experiment/checkpoint_p0/checkpoint_000000446_3653632.pth... [2024-08-05 09:53:23,558][00136] Removing /kaggle/working/train_dir/default_experiment/checkpoint_p0/checkpoint_000000299_2449408.pth [2024-08-05 09:53:28,356][00034] Fps is (10 sec: 4915.3, 60 sec: 4915.2, 300 sec: 4998.5). Total num frames: 3678208. Throughput: 0: 1250.1. Samples: 922344. Policy #0 lag: (min: 0.0, avg: 2.1, max: 5.0) [2024-08-05 09:53:28,357][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:53:29,000][00157] Updated weights for policy 0, policy_version 450 (0.0030) [2024-08-05 09:53:33,355][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4998.5). Total num frames: 3702784. Throughput: 0: 1253.3. Samples: 929976. Policy #0 lag: (min: 0.0, avg: 2.0, max: 4.0) [2024-08-05 09:53:33,357][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:53:38,355][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4998.5). Total num frames: 3727360. Throughput: 0: 1251.6. Samples: 933656. Policy #0 lag: (min: 0.0, avg: 2.2, max: 6.0) [2024-08-05 09:53:38,357][00034] Avg episode reward: [(0, '-6.239')] [2024-08-05 09:53:39,383][00169] DAMAGECOUNT value on done: 230.0 [2024-08-05 09:53:39,389][00169] Sum rewards: -4.643, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.190', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'weapon5': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.139', 'WEAPON5': '0.150', 'weapon4': '0.154', 'DAMAGECOUNT': '0.360', 'ARMOR': '0.484', 'WEAPON3': '0.650', 'weapon3': '0.728', 'FRAGCOUNT': '1.000', 'weapon2': '1.912'} [2024-08-05 09:53:39,593][00170] DAMAGECOUNT value on done: 165.0 [2024-08-05 09:53:42,219][00159] DAMAGECOUNT value on done: 299.0 [2024-08-05 09:53:42,228][00159] Sum rewards: -1.048, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.721', 'weapon5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO5': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.068', 'AMMO4': '0.092', 'AMMO3': '0.097', 'HITCOUNT': '0.110', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.550', 'weapon3': '1.284', 'weapon2': '1.384', 'FRAGCOUNT': '2.000'} [2024-08-05 09:53:43,356][00034] Fps is (10 sec: 4915.1, 60 sec: 5051.7, 300 sec: 4998.5). Total num frames: 3751936. Throughput: 0: 1238.9. Samples: 940696. Policy #0 lag: (min: 0.0, avg: 2.0, max: 4.0) [2024-08-05 09:53:43,357][00034] Avg episode reward: [(0, '-6.121')] [2024-08-05 09:53:44,392][00168] DAMAGECOUNT value on done: 244.0 [2024-08-05 09:53:44,405][00168] Sum rewards: -2.285, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.970', 'AMMO4': '-0.043', 'AMMO2': '-0.008', 'AMMO5': '0.004', 'WEAPON1': '0.020', 'ARMOR': '0.036', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.612', 'WEAPON3': '0.800', 'weapon3': '0.916', 'weapon2': '1.854', 'FRAGCOUNT': '3.000'} [2024-08-05 09:53:44,513][00162] DAMAGECOUNT value on done: 44.0 [2024-08-05 09:53:45,871][00169] DAMAGECOUNT value on done: 284.0 [2024-08-05 09:53:45,874][00169] Sum rewards: -4.262, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.980', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'weapon5': '0.028', 'weapon4': '0.032', 'HITCOUNT': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.151', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.627', 'WEAPON3': '0.650', 'weapon3': '1.248', 'weapon2': '1.656'} [2024-08-05 09:53:46,161][00170] DAMAGECOUNT value on done: 331.0 [2024-08-05 09:53:46,162][00170] Sum rewards: -5.336, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.310', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.008', 'weapon5': '0.014', 'ARMOR': '0.044', 'AMMO2': '0.047', 'HITCOUNT': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.162', 'AMMO4': '0.233', 'weapon4': '0.308', 'DAMAGECOUNT': '0.324', 'WEAPON4': '0.400', 'WEAPON3': '0.800', 'weapon3': '0.974', 'weapon2': '1.250'} [2024-08-05 09:53:46,236][00172] DAMAGECOUNT value on done: 270.0 [2024-08-05 09:53:46,239][00172] Sum rewards: -6.179, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.420', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.016', 'ARMOR': '0.032', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'DAMAGECOUNT': '0.429', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.360', 'weapon3': '1.378'} [2024-08-05 09:53:46,669][00157] Updated weights for policy 0, policy_version 460 (0.0030) [2024-08-05 09:53:48,356][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4998.5). Total num frames: 3776512. Throughput: 0: 1235.4. Samples: 948152. Policy #0 lag: (min: 0.0, avg: 2.1, max: 5.0) [2024-08-05 09:53:48,360][00034] Avg episode reward: [(0, '-5.991')] [2024-08-05 09:53:49,810][00159] DAMAGECOUNT value on done: 72.0 [2024-08-05 09:53:50,667][00160] DAMAGECOUNT value on done: 313.0 [2024-08-05 09:53:50,691][00168] DAMAGECOUNT value on done: 155.0 [2024-08-05 09:53:50,694][00168] Sum rewards: -4.201, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.080', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'weapon5': '0.032', 'HITCOUNT': '0.050', 'ARMOR': '0.056', 'AMMO4': '0.067', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.180', 'weapon4': '0.220', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.218', 'weapon3': '1.296'} [2024-08-05 09:53:51,517][00164] DAMAGECOUNT value on done: 20.0 [2024-08-05 09:53:51,555][00166] DAMAGECOUNT value on done: 210.0 [2024-08-05 09:53:51,556][00166] Sum rewards: -6.427, reward structure: {'DEATHCOUNT': '-10.500', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.125', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.021', 'weapon5': '0.026', 'weapon4': '0.102', 'AMMO4': '0.103', 'HITCOUNT': '0.110', 'AMMO3': '0.137', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.600', 'weapon3': '1.076', 'weapon2': '1.558'} [2024-08-05 09:53:52,129][00162] DAMAGECOUNT value on done: 185.0 [2024-08-05 09:53:52,136][00162] Sum rewards: -3.659, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.895', 'AMMO5': '0.012', 'AMMO2': '0.028', 'ARMOR': '0.040', 'WEAPON1': '0.080', 'AMMO3': '0.096', 'HITCOUNT': '0.140', 'AMMO4': '0.142', 'WEAPON5': '0.200', 'weapon4': '0.210', 'WEAPON4': '0.350', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.550', 'weapon3': '1.022', 'weapon2': '1.604', 'FRAGCOUNT': '3.000'} [2024-08-05 09:53:52,450][00172] DAMAGECOUNT value on done: 60.0 [2024-08-05 09:53:53,143][00169] DAMAGECOUNT value on done: 369.0 [2024-08-05 09:53:53,148][00169] Sum rewards: -2.460, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.498', 'AMMO5': '0.005', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'HITCOUNT': '0.190', 'WEAPON4': '0.250', 'weapon4': '0.430', 'DAMAGECOUNT': '0.522', 'WEAPON3': '0.550', 'weapon3': '1.076', 'weapon2': '1.180', 'FRAGCOUNT': '2.000'} [2024-08-05 09:53:53,356][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4998.5). Total num frames: 3801088. Throughput: 0: 1244.4. Samples: 951920. Policy #0 lag: (min: 0.0, avg: 2.0, max: 5.0) [2024-08-05 09:53:53,355][00170] DAMAGECOUNT value on done: 155.0 [2024-08-05 09:53:53,357][00034] Avg episode reward: [(0, '-5.960')] [2024-08-05 09:53:53,357][00170] Sum rewards: -4.747, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.870', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.013', 'HITCOUNT': '0.060', 'weapon5': '0.108', 'AMMO3': '0.128', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.315', 'WEAPON3': '0.450', 'weapon2': '1.328', 'weapon3': '1.426'} [2024-08-05 09:53:55,467][00165] DAMAGECOUNT value on done: 388.0 [2024-08-05 09:53:55,469][00165] Sum rewards: -3.978, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.790', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.015', 'AMMO4': '0.053', 'AMMO3': '0.124', 'weapon5': '0.170', 'HITCOUNT': '0.180', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.759', 'FRAGCOUNT': '1.000', 'weapon3': '1.128', 'weapon2': '1.512'} [2024-08-05 09:53:55,778][00167] DAMAGECOUNT value on done: 30.0 [2024-08-05 09:53:56,108][00159] DAMAGECOUNT value on done: 117.0 [2024-08-05 09:53:56,112][00159] Sum rewards: -5.318, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.607', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.010', 'AMMO4': '0.038', 'HITCOUNT': '0.090', 'AMMO3': '0.096', 'ARMOR': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.186', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.216', 'WEAPON3': '0.550', 'weapon3': '0.742', 'FRAGCOUNT': '1.000', 'weapon2': '1.948'} [2024-08-05 09:53:56,369][00161] DAMAGECOUNT value on done: 202.0 [2024-08-05 09:53:56,407][00163] DAMAGECOUNT value on done: 202.0 [2024-08-05 09:53:56,411][00163] Sum rewards: -4.392, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.605', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.004', 'weapon4': '0.006', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.021', 'weapon7': '0.040', 'HITCOUNT': '0.050', 'weapon5': '0.062', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.306', 'WEAPON3': '0.550', 'weapon2': '1.056', 'weapon3': '1.378'} [2024-08-05 09:53:56,883][00168] DAMAGECOUNT value on done: 154.0 [2024-08-05 09:53:56,886][00168] Sum rewards: -6.611, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.662', 'AMMO5': '0.011', 'ARMOR': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'HITCOUNT': '0.070', 'AMMO3': '0.113', 'weapon5': '0.120', 'AMMO4': '0.158', 'weapon4': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.417', 'WEAPON3': '0.600', 'weapon3': '0.736', 'FRAGCOUNT': '1.000', 'weapon2': '1.548'} [2024-08-05 09:53:56,941][00160] DAMAGECOUNT value on done: 105.0 [2024-08-05 09:53:57,835][00164] DAMAGECOUNT value on done: 162.0 [2024-08-05 09:53:58,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4998.5). Total num frames: 3825664. Throughput: 0: 1244.4. Samples: 959408. Policy #0 lag: (min: 0.0, avg: 2.0, max: 4.0) [2024-08-05 09:53:58,357][00034] Avg episode reward: [(0, '-5.945')] [2024-08-05 09:53:58,616][00166] DAMAGECOUNT value on done: 488.0 [2024-08-05 09:53:58,627][00166] Sum rewards: -2.573, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.590', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO5': '0.026', 'ARMOR': '0.040', 'AMMO4': '0.055', 'weapon4': '0.088', 'AMMO3': '0.104', 'weapon5': '0.156', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon2': '1.180', 'weapon3': '1.192', 'DAMAGECOUNT': '1.284', 'FRAGCOUNT': '2.000'} [2024-08-05 09:53:58,666][00172] DAMAGECOUNT value on done: 251.0 [2024-08-05 09:53:58,670][00172] Sum rewards: -4.379, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.336', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.029', 'weapon5': '0.036', 'WEAPON1': '0.040', 'HITCOUNT': '0.070', 'AMMO3': '0.122', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'weapon4': '0.200', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.663', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.142', 'weapon2': '1.280'} [2024-08-05 09:53:59,011][00162] DAMAGECOUNT value on done: 400.0 [2024-08-05 09:53:59,011][00162] Sum rewards: -5.195, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.906', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.012', 'AMMO5': '0.014', 'weapon4': '0.022', 'WEAPON4': '0.050', 'AMMO4': '0.059', 'HITCOUNT': '0.070', 'weapon5': '0.096', 'AMMO3': '0.117', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.675', 'weapon3': '1.006', 'weapon2': '1.590'} [2024-08-05 09:53:59,992][00171] DAMAGECOUNT value on done: 289.0 [2024-08-05 09:53:59,997][00171] Sum rewards: -8.358, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.602', 'AMMO5': '0.012', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'weapon5': '0.020', 'AMMO4': '0.071', 'ARMOR': '0.100', 'weapon4': '0.102', 'AMMO3': '0.126', 'WEAPON5': '0.150', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'WEAPON3': '0.550', 'weapon3': '0.572', 'DAMAGECOUNT': '0.642', 'FRAGCOUNT': '1.000', 'weapon2': '2.224'} [2024-08-05 09:54:00,306][00169] DAMAGECOUNT value on done: 160.0 [2024-08-05 09:54:00,542][00170] DAMAGECOUNT value on done: 110.0 [2024-08-05 09:54:01,381][00156] DAMAGECOUNT value on done: 282.0 [2024-08-05 09:54:01,442][00165] DAMAGECOUNT value on done: 370.0 [2024-08-05 09:54:01,445][00165] Sum rewards: -2.515, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.726', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.084', 'AMMO3': '0.104', 'HITCOUNT': '0.110', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.645', 'weapon3': '1.124', 'weapon2': '1.344', 'FRAGCOUNT': '2.000'} [2024-08-05 09:54:01,473][00158] DAMAGECOUNT value on done: 109.0 [2024-08-05 09:54:02,124][00167] DAMAGECOUNT value on done: 170.0 [2024-08-05 09:54:02,126][00167] Sum rewards: -6.108, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.553', 'AMMO5': '0.013', 'AMMO2': '0.022', 'weapon5': '0.022', 'ARMOR': '0.060', 'weapon4': '0.106', 'AMMO4': '0.108', 'AMMO3': '0.119', 'HITCOUNT': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.465', 'WEAPON3': '0.700', 'weapon3': '0.910', 'FRAGCOUNT': '1.000', 'weapon2': '1.840'} [2024-08-05 09:54:02,260][00157] Updated weights for policy 0, policy_version 470 (0.0023) [2024-08-05 09:54:02,474][00163] DAMAGECOUNT value on done: 115.0 [2024-08-05 09:54:02,642][00161] DAMAGECOUNT value on done: 284.0 [2024-08-05 09:54:02,646][00161] Sum rewards: -2.674, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.074', 'AMMO5': '0.004', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon5': '0.058', 'ARMOR': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'AMMO4': '0.136', 'HITCOUNT': '0.140', 'WEAPON4': '0.250', 'weapon4': '0.276', 'DAMAGECOUNT': '0.582', 'WEAPON3': '0.650', 'weapon3': '0.816', 'weapon2': '1.408', 'FRAGCOUNT': '2.000'} [2024-08-05 09:54:02,994][00168] DAMAGECOUNT value on done: 364.0 [2024-08-05 09:54:02,998][00168] Sum rewards: -2.070, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.350', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'weapon4': '0.082', 'AMMO4': '0.108', 'weapon5': '0.108', 'HITCOUNT': '0.120', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'ARMOR': '0.445', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.897', 'FRAGCOUNT': '1.000', 'weapon3': '1.196', 'weapon2': '1.362'} [2024-08-05 09:54:03,164][00160] DAMAGECOUNT value on done: 110.0 [2024-08-05 09:54:03,168][00160] Sum rewards: -5.348, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.675', 'AMMO5': '0.005', 'weapon5': '0.010', 'weapon4': '0.016', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.111', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.225', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.204', 'weapon2': '1.718'} [2024-08-05 09:54:03,356][00034] Fps is (10 sec: 4915.1, 60 sec: 4915.2, 300 sec: 4998.5). Total num frames: 3850240. Throughput: 0: 1243.7. Samples: 966952. Policy #0 lag: (min: 0.0, avg: 2.1, max: 5.0) [2024-08-05 09:54:03,358][00034] Avg episode reward: [(0, '-5.754')] [2024-08-05 09:54:03,931][00164] DAMAGECOUNT value on done: 222.0 [2024-08-05 09:54:03,937][00164] Sum rewards: -10.737, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.160', 'FRAGCOUNT': '-1.000', 'AMMO5': '0.014', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'weapon5': '0.050', 'ARMOR': '0.056', 'AMMO4': '0.113', 'HITCOUNT': '0.140', 'weapon4': '0.140', 'AMMO3': '0.153', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.456', 'WEAPON3': '0.750', 'weapon3': '1.048', 'weapon2': '1.650'} [2024-08-05 09:54:04,060][00159] DAMAGECOUNT value on done: 147.0 [2024-08-05 09:54:04,073][00159] Sum rewards: -7.451, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.882', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.070', 'HITCOUNT': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.164', 'DAMAGECOUNT': '0.315', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.138', 'weapon2': '1.750'} [2024-08-05 09:54:04,955][00172] DAMAGECOUNT value on done: 148.0 [2024-08-05 09:54:04,956][00172] Sum rewards: -2.976, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.077', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.039', 'AMMO3': '0.090', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'ARMOR': '0.104', 'AMMO4': '0.194', 'weapon4': '0.206', 'DAMAGECOUNT': '0.267', 'WEAPON4': '0.400', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.078', 'weapon3': '1.446'} [2024-08-05 09:54:05,092][00166] DAMAGECOUNT value on done: 436.0 [2024-08-05 09:54:05,092][00166] Sum rewards: -4.043, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.790', 'AMMO5': '0.012', 'AMMO2': '0.027', 'WEAPON4': '0.100', 'weapon4': '0.100', 'weapon5': '0.102', 'AMMO3': '0.119', 'AMMO4': '0.135', 'HITCOUNT': '0.150', 'WEAPON5': '0.250', 'WEAPON3': '0.650', 'weapon3': '0.908', 'DAMAGECOUNT': '1.068', 'weapon2': '1.626', 'FRAGCOUNT': '2.000'} [2024-08-05 09:54:06,146][00171] DAMAGECOUNT value on done: 205.0 [2024-08-05 09:54:06,154][00171] Sum rewards: -5.983, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.660', 'AMMO2': '0.014', 'ARMOR': '0.048', 'AMMO4': '0.070', 'HITCOUNT': '0.150', 'AMMO3': '0.155', 'weapon4': '0.240', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.615', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.212', 'weapon3': '1.222'} [2024-08-05 09:54:06,628][00162] DAMAGECOUNT value on done: 205.0 [2024-08-05 09:54:06,642][00162] Sum rewards: -2.606, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.962', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO2': '0.024', 'weapon5': '0.074', 'AMMO3': '0.084', 'AMMO4': '0.121', 'weapon4': '0.134', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'WEAPON5': '0.250', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.570', 'weapon3': '1.142', 'weapon2': '1.306'} [2024-08-05 09:54:07,610][00165] DAMAGECOUNT value on done: 234.0 [2024-08-05 09:54:07,611][00158] DAMAGECOUNT value on done: 276.0 [2024-08-05 09:54:07,612][00165] Sum rewards: -6.928, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.980', 'AMMO5': '0.010', 'ARMOR': '0.036', 'AMMO2': '0.039', 'HITCOUNT': '0.050', 'weapon5': '0.070', 'AMMO3': '0.139', 'WEAPON5': '0.150', 'AMMO4': '0.194', 'weapon4': '0.248', 'DAMAGECOUNT': '0.282', 'WEAPON4': '0.400', 'WEAPON3': '0.700', 'weapon3': '0.854', 'weapon2': '1.630', 'FRAGCOUNT': '2.000'} [2024-08-05 09:54:07,612][00158] Sum rewards: -5.002, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.324', 'AMMO5': '0.003', 'weapon5': '0.012', 'HITCOUNT': '0.020', 'AMMO2': '0.042', 'WEAPON5': '0.050', 'ARMOR': '0.056', 'AMMO3': '0.084', 'weapon7': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.212', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.333', 'weapon4': '0.410', 'WEAPON3': '0.450', 'weapon3': '0.960', 'weapon2': '1.044'} [2024-08-05 09:54:07,880][00169] DAMAGECOUNT value on done: 170.0 [2024-08-05 09:54:07,943][00156] DAMAGECOUNT value on done: 55.0 [2024-08-05 09:54:08,069][00170] DAMAGECOUNT value on done: 264.0 [2024-08-05 09:54:08,070][00170] Sum rewards: -10.229, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.509', 'FRAGCOUNT': '-1.000', 'AMMO5': '0.011', 'AMMO2': '0.018', 'ARMOR': '0.024', 'WEAPON1': '0.040', 'weapon5': '0.072', 'AMMO4': '0.089', 'HITCOUNT': '0.150', 'AMMO3': '0.159', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.254', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.735', 'weapon3': '0.758', 'weapon2': '1.770'} [2024-08-05 09:54:08,356][00034] Fps is (10 sec: 4915.1, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 3874816. Throughput: 0: 1242.0. Samples: 970672. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 09:54:08,357][00034] Avg episode reward: [(0, '-5.677')] [2024-08-05 09:54:08,683][00167] DAMAGECOUNT value on done: 297.0 [2024-08-05 09:54:08,684][00167] Sum rewards: -5.455, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.000', 'HEALTH': '-0.310', 'weapon4': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'weapon5': '0.086', 'HITCOUNT': '0.140', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.891', 'weapon2': '1.204', 'weapon3': '1.346'} [2024-08-05 09:54:08,955][00163] DAMAGECOUNT value on done: 405.0 [2024-08-05 09:54:08,956][00163] Sum rewards: -5.521, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.000', 'ARMOR': '0.004', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'AMMO4': '0.069', 'weapon5': '0.070', 'AMMO3': '0.080', 'WEAPON4': '0.150', 'weapon4': '0.236', 'HITCOUNT': '0.240', 'HEALTH': '0.247', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.750', 'weapon3': '0.988', 'weapon2': '1.638'} [2024-08-05 09:54:09,363][00168] DAMAGECOUNT value on done: 217.0 [2024-08-05 09:54:09,364][00168] Sum rewards: -4.435, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.501', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'ARMOR': '0.068', 'AMMO3': '0.077', 'HITCOUNT': '0.090', 'AMMO4': '0.116', 'weapon4': '0.134', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.261', 'WEAPON3': '0.450', 'weapon3': '1.102', 'weapon2': '1.696'} [2024-08-05 09:54:09,542][00161] DAMAGECOUNT value on done: 5.0 [2024-08-05 09:54:09,604][00160] DAMAGECOUNT value on done: 325.0 [2024-08-05 09:54:10,704][00164] DAMAGECOUNT value on done: 255.0 [2024-08-05 09:54:10,710][00164] Sum rewards: -0.795, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.760', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.018', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'ARMOR': '0.064', 'AMMO3': '0.096', 'HITCOUNT': '0.120', 'AMMO4': '0.159', 'weapon4': '0.198', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.690', 'weapon3': '0.738', 'weapon2': '1.538', 'FRAGCOUNT': '3.000'} [2024-08-05 09:54:10,967][00159] DAMAGECOUNT value on done: 100.0 [2024-08-05 09:54:11,658][00172] DAMAGECOUNT value on done: 153.0 [2024-08-05 09:54:11,661][00172] Sum rewards: -6.089, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.590', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.015', 'weapon5': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'weapon4': '0.126', 'WEAPON3': '0.250', 'weapon3': '0.340', 'DAMAGECOUNT': '0.429', 'ARMOR': '0.485', 'FRAGCOUNT': '1.000', 'weapon2': '2.252'} [2024-08-05 09:54:12,526][00166] DAMAGECOUNT value on done: 415.0 [2024-08-05 09:54:12,527][00166] Sum rewards: -2.518, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.463', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'ARMOR': '0.076', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'weapon4': '0.196', 'HITCOUNT': '0.220', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.975', 'weapon3': '1.158', 'weapon2': '1.332', 'FRAGCOUNT': '2.000'} [2024-08-05 09:54:13,288][00171] DAMAGECOUNT value on done: 165.0 [2024-08-05 09:54:13,355][00034] Fps is (10 sec: 4915.4, 60 sec: 4915.2, 300 sec: 4998.5). Total num frames: 3899392. Throughput: 0: 1227.0. Samples: 977560. Policy #0 lag: (min: 0.0, avg: 2.0, max: 5.0) [2024-08-05 09:54:13,360][00034] Avg episode reward: [(0, '-5.586')] [2024-08-05 09:54:13,436][00162] DAMAGECOUNT value on done: 205.0 [2024-08-05 09:54:13,443][00162] Sum rewards: -2.915, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.007', 'weapon5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.117', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'HEALTH': '0.208', 'weapon4': '0.290', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.570', 'weapon3': '0.894', 'weapon2': '1.574', 'FRAGCOUNT': '2.000'} [2024-08-05 09:54:14,459][00165] DAMAGECOUNT value on done: 165.0 [2024-08-05 09:54:14,463][00165] Sum rewards: -4.313, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.281', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon5': '0.056', 'AMMO3': '0.085', 'ARMOR': '0.088', 'HITCOUNT': '0.110', 'AMMO4': '0.233', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon3': '0.400', 'weapon4': '0.416', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.450', 'FRAGCOUNT': '1.000', 'weapon2': '1.920'} [2024-08-05 09:54:14,532][00158] DAMAGECOUNT value on done: 300.0 [2024-08-05 09:54:14,538][00158] Sum rewards: -0.744, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.232', 'AMMO5': '0.010', 'weapon7': '0.014', 'AMMO2': '0.020', 'weapon5': '0.084', 'weapon4': '0.088', 'AMMO4': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.136', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.488', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.840', 'weapon3': '1.004', 'weapon2': '1.484', 'FRAGCOUNT': '2.000'} [2024-08-05 09:54:14,780][00169] DAMAGECOUNT value on done: 140.0 [2024-08-05 09:54:14,975][00170] DAMAGECOUNT value on done: 177.0 [2024-08-05 09:54:14,976][00170] Sum rewards: -8.639, reward structure: {'DEATHCOUNT': '-11.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.228', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.066', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'DAMAGECOUNT': '0.246', 'WEAPON3': '0.850', 'weapon2': '1.364', 'weapon3': '1.386'} [2024-08-05 09:54:15,374][00156] DAMAGECOUNT value on done: 212.0 [2024-08-05 09:54:15,809][00163] DAMAGECOUNT value on done: 85.0 [2024-08-05 09:54:16,037][00168] DAMAGECOUNT value on done: 228.0 [2024-08-05 09:54:16,041][00168] Sum rewards: 0.841, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.015', 'ARMOR': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.060', 'AMMO4': '0.072', 'HEALTH': '0.102', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.216', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.396', 'weapon3': '1.244', 'weapon2': '1.320', 'FRAGCOUNT': '2.000'} [2024-08-05 09:54:16,085][00167] DAMAGECOUNT value on done: 220.0 [2024-08-05 09:54:16,319][00160] DAMAGECOUNT value on done: 80.0 [2024-08-05 09:54:16,326][00160] Sum rewards: -2.537, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.550', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO4': '0.035', 'HITCOUNT': '0.040', 'weapon5': '0.062', 'weapon4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'DAMAGECOUNT': '0.120', 'WEAPON5': '0.150', 'WEAPON3': '0.700', 'weapon2': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.574'} [2024-08-05 09:54:16,572][00161] DAMAGECOUNT value on done: 125.0 [2024-08-05 09:54:16,573][00161] Sum rewards: -4.411, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.868', 'weapon4': '0.004', 'AMMO2': '0.007', 'weapon5': '0.012', 'AMMO5': '0.023', 'ARMOR': '0.028', 'AMMO4': '0.037', 'HITCOUNT': '0.040', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.150', 'DAMAGECOUNT': '0.150', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.376', 'weapon3': '1.430'} [2024-08-05 09:54:17,205][00164] DAMAGECOUNT value on done: 185.0 [2024-08-05 09:54:17,884][00172] DAMAGECOUNT value on done: 333.0 [2024-08-05 09:54:17,885][00172] Sum rewards: -9.547, reward structure: {'DEATHCOUNT': '-11.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.404', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'AMMO4': '0.080', 'weapon5': '0.096', 'HITCOUNT': '0.130', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.228', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.750', 'weapon3': '0.974', 'weapon2': '1.464'} [2024-08-05 09:54:18,360][00034] Fps is (10 sec: 4912.9, 60 sec: 4914.8, 300 sec: 4998.4). Total num frames: 3923968. Throughput: 0: 1221.7. Samples: 984960. Policy #0 lag: (min: 0.0, avg: 2.0, max: 4.0) [2024-08-05 09:54:18,365][00034] Avg episode reward: [(0, '-5.486')] [2024-08-05 09:54:18,498][00159] DAMAGECOUNT value on done: 45.0 [2024-08-05 09:54:18,878][00166] DAMAGECOUNT value on done: 200.0 [2024-08-05 09:54:18,882][00166] Sum rewards: -1.600, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.628', 'ARMOR': '0.004', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO3': '0.063', 'HITCOUNT': '0.100', 'weapon5': '0.104', 'AMMO4': '0.109', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'weapon4': '0.356', 'DAMAGECOUNT': '0.420', 'weapon3': '0.424', 'FRAGCOUNT': '1.000', 'weapon2': '1.644'} [2024-08-05 09:54:19,740][00171] DAMAGECOUNT value on done: 320.0 [2024-08-05 09:54:20,083][00157] Updated weights for policy 0, policy_version 480 (0.0020) [2024-08-05 09:54:20,878][00165] DAMAGECOUNT value on done: 25.0 [2024-08-05 09:54:21,064][00158] DAMAGECOUNT value on done: 629.0 [2024-08-05 09:54:21,071][00158] Sum rewards: -5.078, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.380', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.020', 'HITCOUNT': '0.130', 'AMMO3': '0.152', 'weapon5': '0.254', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'weapon3': '1.070', 'DAMAGECOUNT': '1.245', 'weapon2': '1.466', 'FRAGCOUNT': '3.000'} [2024-08-05 09:54:21,213][00162] DAMAGECOUNT value on done: 258.0 [2024-08-05 09:54:21,217][00162] Sum rewards: -10.031, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.049', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'AMMO4': '0.030', 'weapon4': '0.098', 'WEAPON5': '0.100', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'DAMAGECOUNT': '0.744', 'weapon3': '1.016', 'WEAPON3': '1.150', 'weapon2': '1.700', 'FRAGCOUNT': '2.000'} [2024-08-05 09:54:21,457][00156] DAMAGECOUNT value on done: 115.0 [2024-08-05 09:54:21,461][00156] Sum rewards: -6.111, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.782', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'HITCOUNT': '0.030', 'AMMO2': '0.031', 'weapon5': '0.036', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.120', 'AMMO3': '0.130', 'WEAPON4': '0.150', 'AMMO4': '0.153', 'weapon4': '0.176', 'WEAPON3': '0.650', 'weapon3': '0.950', 'weapon2': '1.630'} [2024-08-05 09:54:22,096][00163] DAMAGECOUNT value on done: 228.0 [2024-08-05 09:54:22,099][00163] Sum rewards: -2.814, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.106', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.072', 'HITCOUNT': '0.090', 'AMMO4': '0.142', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.429', 'weapon4': '0.472', 'weapon3': '0.766', 'FRAGCOUNT': '1.000', 'weapon2': '1.478'} [2024-08-05 09:54:22,302][00167] DAMAGECOUNT value on done: 165.0 [2024-08-05 09:54:22,303][00167] Sum rewards: -7.202, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.574', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.026', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'weapon4': '0.074', 'HITCOUNT': '0.120', 'AMMO4': '0.128', 'AMMO3': '0.164', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.465', 'WEAPON3': '0.800', 'weapon2': '1.302', 'weapon3': '1.450', 'FRAGCOUNT': '2.000'} [2024-08-05 09:54:22,309][00169] DAMAGECOUNT value on done: 140.0 [2024-08-05 09:54:22,315][00169] Sum rewards: -4.993, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.490', 'weapon4': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.008', 'ARMOR': '0.020', 'AMMO4': '0.041', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.141', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.396', 'weapon3': '1.458'} [2024-08-05 09:54:22,406][00168] DAMAGECOUNT value on done: 246.0 [2024-08-05 09:54:22,409][00168] Sum rewards: -3.347, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.910', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.019', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'ARMOR': '0.020', 'AMMO4': '0.092', 'AMMO3': '0.104', 'weapon4': '0.148', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.156', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.663', 'weapon2': '1.172', 'weapon3': '1.200'} [2024-08-05 09:54:22,519][00170] DAMAGECOUNT value on done: 169.0 [2024-08-05 09:54:22,682][00160] DAMAGECOUNT value on done: 320.0 [2024-08-05 09:54:22,686][00160] Sum rewards: -2.509, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.703', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.025', 'ARMOR': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.142', 'HITCOUNT': '0.210', 'weapon4': '0.344', 'WEAPON4': '0.350', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.870', 'weapon3': '0.976', 'weapon2': '1.336', 'FRAGCOUNT': '2.000'} [2024-08-05 09:54:22,870][00161] DAMAGECOUNT value on done: 105.0 [2024-08-05 09:54:23,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4998.5). Total num frames: 3948544. Throughput: 0: 1224.0. Samples: 988736. Policy #0 lag: (min: 0.0, avg: 1.9, max: 5.0) [2024-08-05 09:54:23,357][00034] Avg episode reward: [(0, '-5.052')] [2024-08-05 09:54:23,543][00164] DAMAGECOUNT value on done: 118.0 [2024-08-05 09:54:23,544][00164] Sum rewards: -8.362, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.330', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.017', 'AMMO2': '0.019', 'ARMOR': '0.028', 'WEAPON1': '0.030', 'weapon5': '0.058', 'HITCOUNT': '0.060', 'AMMO4': '0.092', 'DAMAGECOUNT': '0.144', 'AMMO3': '0.165', 'weapon4': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.700', 'weapon3': '0.894', 'weapon2': '1.556'} [2024-08-05 09:54:24,408][00172] DAMAGECOUNT value on done: 114.0 [2024-08-05 09:54:25,170][00166] DAMAGECOUNT value on done: 395.0 [2024-08-05 09:54:25,184][00166] Sum rewards: -2.985, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.017', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.118', 'AMMO3': '0.156', 'HITCOUNT': '0.260', 'HEALTH': '0.452', 'WEAPON3': '0.750', 'weapon2': '0.978', 'DAMAGECOUNT': '1.035', 'weapon3': '1.444', 'FRAGCOUNT': '2.000'} [2024-08-05 09:54:25,215][00159] DAMAGECOUNT value on done: 425.0 [2024-08-05 09:54:26,560][00171] DAMAGECOUNT value on done: 40.0 [2024-08-05 09:54:27,481][00162] DAMAGECOUNT value on done: 139.0 [2024-08-05 09:54:27,483][00162] Sum rewards: -4.141, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.548', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.029', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.122', 'AMMO4': '0.143', 'weapon4': '0.188', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.372', 'ARMOR': '0.408', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.252', 'weapon3': '1.432'} [2024-08-05 09:54:27,596][00165] DAMAGECOUNT value on done: 105.0 [2024-08-05 09:54:27,803][00158] DAMAGECOUNT value on done: 374.0 [2024-08-05 09:54:27,806][00158] Sum rewards: -3.795, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.956', 'AMMO5': '0.003', 'AMMO2': '0.006', 'ARMOR': '0.024', 'WEAPON1': '0.030', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.070', 'AMMO3': '0.133', 'HITCOUNT': '0.140', 'DAMAGECOUNT': '0.588', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.322', 'weapon3': '1.464'} [2024-08-05 09:54:28,152][00156] DAMAGECOUNT value on done: 129.0 [2024-08-05 09:54:28,157][00156] Sum rewards: -9.327, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.236', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.004', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon4': '0.030', 'ARMOR': '0.032', 'weapon5': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'HITCOUNT': '0.110', 'AMMO4': '0.131', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.372', 'WEAPON3': '0.650', 'weapon3': '0.904', 'weapon2': '1.938'} [2024-08-05 09:54:28,357][00034] Fps is (10 sec: 4917.1, 60 sec: 4915.1, 300 sec: 4970.7). Total num frames: 3973120. Throughput: 0: 1230.6. Samples: 996072. Policy #0 lag: (min: 0.0, avg: 1.9, max: 4.0) [2024-08-05 09:54:28,358][00034] Avg episode reward: [(0, '-4.984')] [2024-08-05 09:54:28,728][00163] DAMAGECOUNT value on done: 121.0 [2024-08-05 09:54:28,737][00163] Sum rewards: -5.554, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.129', 'AMMO5': '0.003', 'weapon4': '0.022', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'ARMOR': '0.056', 'HITCOUNT': '0.080', 'AMMO3': '0.114', 'AMMO4': '0.137', 'DAMAGECOUNT': '0.249', 'WEAPON4': '0.250', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.232', 'weapon2': '1.454'} [2024-08-05 09:54:28,895][00168] DAMAGECOUNT value on done: 106.0 [2024-08-05 09:54:28,975][00169] DAMAGECOUNT value on done: 90.0 [2024-08-05 09:54:29,029][00167] DAMAGECOUNT value on done: 310.0 [2024-08-05 09:54:29,144][00170] DAMAGECOUNT value on done: 130.0 [2024-08-05 09:54:29,207][00160] DAMAGECOUNT value on done: 115.0 [2024-08-05 09:54:29,209][00160] Sum rewards: -7.701, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.786', 'AMMO2': '0.029', 'ARMOR': '0.072', 'HITCOUNT': '0.080', 'AMMO3': '0.097', 'AMMO4': '0.144', 'DAMAGECOUNT': '0.225', 'weapon4': '0.368', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'weapon3': '0.762', 'FRAGCOUNT': '1.000', 'weapon2': '1.708'} [2024-08-05 09:54:29,479][00161] DAMAGECOUNT value on done: 77.0 [2024-08-05 09:54:30,050][00164] DAMAGECOUNT value on done: 150.0 [2024-08-05 09:54:30,054][00164] Sum rewards: -5.836, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.360', 'weapon5': '0.012', 'AMMO5': '0.018', 'AMMO2': '0.025', 'HITCOUNT': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.148', 'WEAPON4': '0.200', 'weapon4': '0.238', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.750', 'weapon3': '1.390', 'weapon2': '1.422', 'FRAGCOUNT': '2.000'} [2024-08-05 09:54:30,673][00172] DAMAGECOUNT value on done: 116.0 [2024-08-05 09:54:30,676][00172] Sum rewards: -5.973, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.898', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'weapon5': '0.040', 'ARMOR': '0.060', 'HITCOUNT': '0.070', 'AMMO4': '0.081', 'weapon4': '0.132', 'AMMO3': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.258', 'WEAPON3': '0.650', 'weapon2': '1.058', 'weapon3': '1.484'} [2024-08-05 09:54:31,704][00166] DAMAGECOUNT value on done: 259.0 [2024-08-05 09:54:31,783][00159] DAMAGECOUNT value on done: 80.0 [2024-08-05 09:54:31,789][00159] Sum rewards: -3.733, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.176', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.018', 'HITCOUNT': '0.020', 'weapon4': '0.020', 'ARMOR': '0.040', 'DAMAGECOUNT': '0.060', 'AMMO4': '0.090', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon3': '1.100', 'weapon2': '1.832'} [2024-08-05 09:54:33,355][00034] Fps is (10 sec: 4096.0, 60 sec: 4778.7, 300 sec: 4970.7). Total num frames: 3989504. Throughput: 0: 1233.4. Samples: 1003656. Policy #0 lag: (min: 0.0, avg: 2.0, max: 4.0) [2024-08-05 09:54:33,357][00034] Avg episode reward: [(0, '-5.182')] [2024-08-05 09:54:33,795][00162] DAMAGECOUNT value on done: 223.0 [2024-08-05 09:54:34,039][00171] DAMAGECOUNT value on done: 70.0 [2024-08-05 09:54:34,040][00171] Sum rewards: -1.759, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.136', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.014', 'AMMO2': '0.017', 'weapon7': '0.050', 'ARMOR': '0.080', 'HITCOUNT': '0.080', 'AMMO4': '0.084', 'AMMO3': '0.092', 'WEAPON5': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'DAMAGECOUNT': '0.195', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.266', 'WEAPON3': '0.500', 'weapon3': '0.926', 'FRAGCOUNT': '1.000', 'weapon2': '1.686'} [2024-08-05 09:54:34,370][00156] DAMAGECOUNT value on done: 185.0 [2024-08-05 09:54:34,966][00169] DAMAGECOUNT value on done: 82.0 [2024-08-05 09:54:34,967][00169] Sum rewards: -5.819, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.492', 'AMMO2': '0.010', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.028', 'ARMOR': '0.036', 'AMMO4': '0.049', 'HITCOUNT': '0.050', 'weapon4': '0.086', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.195', 'WEAPON5': '0.250', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.070', 'weapon3': '1.466'} [2024-08-05 09:54:35,148][00165] DAMAGECOUNT value on done: 335.0 [2024-08-05 09:54:35,161][00157] Updated weights for policy 0, policy_version 490 (0.0039) [2024-08-05 09:54:35,198][00170] DAMAGECOUNT value on done: 170.0 [2024-08-05 09:54:35,199][00170] Sum rewards: -8.058, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.900', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon5': '0.032', 'weapon4': '0.038', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.426', 'weapon3': '1.442'} [2024-08-05 09:54:35,253][00168] DAMAGECOUNT value on done: 228.0 [2024-08-05 09:54:35,259][00167] DAMAGECOUNT value on done: 333.0 [2024-08-05 09:54:35,256][00168] Sum rewards: -10.905, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.013', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.041', 'weapon5': '0.046', 'weapon4': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.180', 'AMMO3': '0.182', 'AMMO4': '0.207', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.612', 'WEAPON3': '0.750', 'weapon3': '0.796', 'weapon2': '1.964'} [2024-08-05 09:54:35,263][00167] Sum rewards: -3.824, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.992', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.008', 'weapon4': '0.012', 'ARMOR': '0.032', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.158', 'HITCOUNT': '0.240', 'DAMAGECOUNT': '0.834', 'WEAPON3': '0.900', 'weapon2': '1.342', 'weapon3': '1.446', 'FRAGCOUNT': '2.000'} [2024-08-05 09:54:35,501][00158] DAMAGECOUNT value on done: 40.0 [2024-08-05 09:54:35,610][00160] DAMAGECOUNT value on done: 345.0 [2024-08-05 09:54:35,611][00160] Sum rewards: -3.266, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.419', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'AMMO5': '0.024', 'AMMO4': '0.048', 'weapon5': '0.078', 'weapon4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.152', 'HITCOUNT': '0.220', 'WEAPON5': '0.400', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.855', 'weapon2': '0.872', 'weapon3': '1.500'} [2024-08-05 09:54:35,770][00161] DAMAGECOUNT value on done: 215.0 [2024-08-05 09:54:36,421][00164] DAMAGECOUNT value on done: 152.0 [2024-08-05 09:54:36,426][00164] Sum rewards: -5.335, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.149', 'AMMO5': '0.005', 'HITCOUNT': '0.020', 'AMMO2': '0.035', 'weapon5': '0.044', 'ARMOR': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.122', 'DAMAGECOUNT': '0.144', 'AMMO4': '0.175', 'WEAPON4': '0.350', 'weapon4': '0.456', 'WEAPON3': '0.600', 'weapon3': '0.794', 'FRAGCOUNT': '1.000', 'weapon2': '1.372'} [2024-08-05 09:54:36,633][00163] DAMAGECOUNT value on done: 88.0 [2024-08-05 09:54:37,041][00172] DAMAGECOUNT value on done: 79.0 [2024-08-05 09:54:37,847][00159] DAMAGECOUNT value on done: 135.0 [2024-08-05 09:54:37,855][00159] Sum rewards: -4.807, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.288', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.014', 'AMMO2': '0.033', 'ARMOR': '0.040', 'AMMO3': '0.075', 'HITCOUNT': '0.100', 'weapon5': '0.112', 'weapon4': '0.150', 'AMMO4': '0.166', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.450', 'weapon3': '1.186', 'weapon2': '1.224'} [2024-08-05 09:54:38,356][00034] Fps is (10 sec: 4096.4, 60 sec: 4778.7, 300 sec: 4943.0). Total num frames: 4014080. Throughput: 0: 1230.4. Samples: 1007288. Policy #0 lag: (min: 0.0, avg: 2.6, max: 5.0) [2024-08-05 09:54:38,357][00034] Avg episode reward: [(0, '-5.305')] [2024-08-05 09:54:38,640][00166] DAMAGECOUNT value on done: 212.0 [2024-08-05 09:54:39,908][00162] DAMAGECOUNT value on done: 61.0 [2024-08-05 09:54:40,544][00171] DAMAGECOUNT value on done: 220.0 [2024-08-05 09:54:40,547][00171] Sum rewards: -3.197, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.906', 'weapon7': '0.004', 'AMMO2': '0.030', 'HITCOUNT': '0.070', 'ARMOR': '0.085', 'AMMO3': '0.127', 'AMMO4': '0.148', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'DAMAGECOUNT': '0.285', 'weapon4': '0.334', 'WEAPON4': '0.400', 'WEAPON3': '0.700', 'weapon2': '0.998', 'FRAGCOUNT': '1.000', 'weapon3': '1.178'} [2024-08-05 09:54:41,168][00169] DAMAGECOUNT value on done: 150.0 [2024-08-05 09:54:41,173][00169] Sum rewards: -4.933, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.614', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.003', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO4': '0.014', 'WEAPON1': '0.020', 'weapon5': '0.036', 'AMMO3': '0.073', 'HITCOUNT': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.108', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'DAMAGECOUNT': '0.270', 'WEAPON3': '0.450', 'weapon3': '0.968', 'weapon2': '1.592'} [2024-08-05 09:54:41,430][00170] DAMAGECOUNT value on done: 314.0 [2024-08-05 09:54:41,435][00170] Sum rewards: -3.318, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.859', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'weapon4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.156', 'HITCOUNT': '0.170', 'DAMAGECOUNT': '0.612', 'WEAPON3': '0.800', 'weapon3': '1.102', 'weapon2': '1.588', 'FRAGCOUNT': '2.000'} [2024-08-05 09:54:41,483][00165] DAMAGECOUNT value on done: 374.0 [2024-08-05 09:54:41,491][00165] Sum rewards: -3.858, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.520', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon5': '0.026', 'WEAPON4': '0.050', 'AMMO4': '0.069', 'weapon4': '0.096', 'AMMO3': '0.145', 'HITCOUNT': '0.180', 'WEAPON5': '0.200', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.882', 'weapon2': '1.114', 'weapon3': '1.572', 'FRAGCOUNT': '2.000'} [2024-08-05 09:54:41,711][00156] DAMAGECOUNT value on done: 130.0 [2024-08-05 09:54:41,718][00156] Sum rewards: -5.966, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.510', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'weapon5': '0.042', 'HITCOUNT': '0.080', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'DAMAGECOUNT': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.322', 'ARMOR': '0.502', 'weapon3': '0.696', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.628'} [2024-08-05 09:54:41,787][00168] DAMAGECOUNT value on done: 243.0 [2024-08-05 09:54:41,794][00168] Sum rewards: -2.271, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.924', 'AMMO5': '0.003', 'AMMO2': '0.027', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'weapon5': '0.056', 'HITCOUNT': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'AMMO4': '0.135', 'weapon4': '0.298', 'WEAPON4': '0.300', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.708', 'weapon3': '0.802', 'weapon2': '1.552', 'FRAGCOUNT': '2.000'} [2024-08-05 09:54:41,995][00158] DAMAGECOUNT value on done: 225.0 [2024-08-05 09:54:41,996][00158] Sum rewards: -4.456, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.654', 'ARMOR': '0.004', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon5': '0.070', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'HITCOUNT': '0.130', 'AMMO3': '0.160', 'weapon4': '0.164', 'WEAPON5': '0.200', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.750', 'weapon2': '1.182', 'weapon3': '1.274'} [2024-08-05 09:54:42,407][00160] DAMAGECOUNT value on done: 265.0 [2024-08-05 09:54:42,413][00160] Sum rewards: -1.460, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.334', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'HITCOUNT': '0.030', 'ARMOR': '0.048', 'weapon5': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.124', 'AMMO4': '0.129', 'AMMO3': '0.137', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.750', 'weapon2': '0.994', 'weapon3': '1.482', 'FRAGCOUNT': '2.000'} [2024-08-05 09:54:42,588][00167] DAMAGECOUNT value on done: 96.0 [2024-08-05 09:54:42,588][00167] Sum rewards: -0.749, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.644', 'AMMO5': '0.007', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'weapon5': '0.046', 'AMMO3': '0.094', 'weapon4': '0.096', 'HITCOUNT': '0.110', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.288', 'ARMOR': '0.416', 'WEAPON3': '0.500', 'weapon2': '1.096', 'weapon3': '1.516', 'FRAGCOUNT': '2.000'} [2024-08-05 09:54:43,245][00161] DAMAGECOUNT value on done: 140.0 [2024-08-05 09:54:43,246][00161] Sum rewards: -11.683, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.030', 'FRAGCOUNT': '-1.500', 'AMMO2': '0.014', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'weapon5': '0.048', 'WEAPON4': '0.050', 'HITCOUNT': '0.060', 'AMMO4': '0.069', 'weapon4': '0.096', 'AMMO3': '0.158', 'DAMAGECOUNT': '0.165', 'WEAPON5': '0.300', 'WEAPON3': '0.950', 'weapon2': '1.288', 'weapon3': '1.352'} [2024-08-05 09:54:43,312][00164] DAMAGECOUNT value on done: 110.0 [2024-08-05 09:54:43,355][00034] Fps is (10 sec: 5734.4, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 4046848. Throughput: 0: 1226.7. Samples: 1014608. Policy #0 lag: (min: 0.0, avg: 2.5, max: 5.0) [2024-08-05 09:54:43,358][00034] Avg episode reward: [(0, '-5.220')] [2024-08-05 09:54:43,531][00163] DAMAGECOUNT value on done: 140.0 [2024-08-05 09:54:43,537][00163] Sum rewards: -7.389, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.222', 'weapon5': '0.008', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.035', 'HITCOUNT': '0.070', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'AMMO4': '0.173', 'weapon4': '0.186', 'WEAPON4': '0.350', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.020', 'weapon2': '1.654'} [2024-08-05 09:54:43,927][00172] DAMAGECOUNT value on done: 362.0 [2024-08-05 09:54:43,930][00172] Sum rewards: -3.092, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.314', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'HITCOUNT': '0.070', 'weapon5': '0.072', 'AMMO4': '0.082', 'AMMO3': '0.135', 'WEAPON5': '0.150', 'weapon4': '0.218', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.621', 'WEAPON3': '0.650', 'weapon3': '0.790', 'FRAGCOUNT': '1.000', 'weapon2': '1.626'} [2024-08-05 09:54:44,708][00159] DAMAGECOUNT value on done: 97.0 [2024-08-05 09:54:45,286][00166] DAMAGECOUNT value on done: 231.0 [2024-08-05 09:54:46,836][00162] DAMAGECOUNT value on done: 192.0 [2024-08-05 09:54:47,928][00169] DAMAGECOUNT value on done: 352.0 [2024-08-05 09:54:47,936][00169] Sum rewards: -1.821, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.820', 'AMMO2': '0.009', 'AMMO5': '0.010', 'ARMOR': '0.044', 'AMMO4': '0.047', 'AMMO3': '0.106', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.220', 'weapon4': '0.276', 'WEAPON3': '0.600', 'weapon3': '0.986', 'DAMAGECOUNT': '1.041', 'weapon2': '1.510', 'FRAGCOUNT': '3.000'} [2024-08-05 09:54:48,095][00170] DAMAGECOUNT value on done: 75.0 [2024-08-05 09:54:48,198][00171] DAMAGECOUNT value on done: 192.0 [2024-08-05 09:54:48,200][00171] Sum rewards: -10.398, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.510', 'AMMO5': '0.011', 'AMMO2': '0.034', 'HITCOUNT': '0.080', 'weapon4': '0.088', 'weapon5': '0.132', 'AMMO4': '0.169', 'AMMO3': '0.177', 'DAMAGECOUNT': '0.201', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.750', 'weapon3': '0.882', 'FRAGCOUNT': '1.000', 'weapon2': '1.588'} [2024-08-05 09:54:48,211][00156] DAMAGECOUNT value on done: 229.0 [2024-08-05 09:54:48,355][00034] Fps is (10 sec: 5734.4, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 4071424. Throughput: 0: 1216.2. Samples: 1021680. Policy #0 lag: (min: 0.0, avg: 1.9, max: 5.0) [2024-08-05 09:54:48,360][00034] Avg episode reward: [(0, '-5.259')] [2024-08-05 09:54:48,907][00165] DAMAGECOUNT value on done: 155.0 [2024-08-05 09:54:49,066][00168] DAMAGECOUNT value on done: 195.0 [2024-08-05 09:54:49,071][00168] Sum rewards: -9.788, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.636', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.050', 'AMMO4': '0.070', 'HITCOUNT': '0.110', 'ARMOR': '0.112', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.180', 'DAMAGECOUNT': '0.285', 'WEAPON3': '0.750', 'weapon2': '1.218', 'weapon3': '1.368'} [2024-08-05 09:54:49,103][00167] DAMAGECOUNT value on done: 26.0 [2024-08-05 09:54:49,314][00158] DAMAGECOUNT value on done: 329.0 [2024-08-05 09:54:49,320][00158] Sum rewards: -3.102, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.130', 'AMMO2': '0.000', 'AMMO4': '0.000', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'weapon5': '0.022', 'AMMO3': '0.116', 'HITCOUNT': '0.190', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.822', 'weapon2': '1.068', 'weapon3': '1.732', 'FRAGCOUNT': '2.000'} [2024-08-05 09:54:49,489][00160] DAMAGECOUNT value on done: 186.0 [2024-08-05 09:54:49,808][00161] DAMAGECOUNT value on done: 221.0 [2024-08-05 09:54:49,811][00161] Sum rewards: -4.614, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.836', 'AMMO5': '0.024', 'AMMO2': '0.043', 'weapon5': '0.054', 'ARMOR': '0.084', 'AMMO3': '0.088', 'HITCOUNT': '0.170', 'AMMO4': '0.215', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.410', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.603', 'weapon3': '0.856', 'FRAGCOUNT': '1.000', 'weapon2': '1.474'} [2024-08-05 09:54:50,163][00164] DAMAGECOUNT value on done: 99.0 [2024-08-05 09:54:50,332][00163] DAMAGECOUNT value on done: 262.0 [2024-08-05 09:54:50,338][00163] Sum rewards: -9.943, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.146', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'weapon5': '0.058', 'weapon4': '0.084', 'AMMO3': '0.110', 'AMMO4': '0.145', 'HITCOUNT': '0.150', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.431', 'WEAPON3': '0.500', 'weapon3': '0.650', 'DAMAGECOUNT': '0.651', 'weapon2': '1.864'} [2024-08-05 09:54:50,816][00172] DAMAGECOUNT value on done: 60.0 [2024-08-05 09:54:50,817][00172] Sum rewards: -3.472, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.170', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'HITCOUNT': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.092', 'weapon5': '0.104', 'weapon4': '0.128', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.180', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.447', 'WEAPON3': '0.450', 'weapon3': '0.894', 'FRAGCOUNT': '1.000', 'weapon2': '1.482'} [2024-08-05 09:54:51,443][00159] DAMAGECOUNT value on done: 245.0 [2024-08-05 09:54:51,449][00159] Sum rewards: -4.808, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.290', 'AMMO2': '0.024', 'HITCOUNT': '0.040', 'ARMOR': '0.044', 'AMMO4': '0.119', 'DAMAGECOUNT': '0.120', 'AMMO3': '0.121', 'weapon4': '0.244', 'WEAPON4': '0.250', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.182', 'weapon2': '1.588'} [2024-08-05 09:54:51,798][00166] DAMAGECOUNT value on done: 301.0 [2024-08-05 09:54:51,802][00166] Sum rewards: -6.145, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.904', 'weapon7': '0.002', 'AMMO5': '0.008', 'AMMO2': '0.019', 'HITCOUNT': '0.030', 'WEAPON1': '0.030', 'weapon4': '0.042', 'weapon5': '0.044', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.151', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'DAMAGECOUNT': '0.627', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.152', 'weapon3': '1.208'} [2024-08-05 09:54:53,355][00034] Fps is (10 sec: 4096.0, 60 sec: 4778.7, 300 sec: 4943.0). Total num frames: 4087808. Throughput: 0: 1214.4. Samples: 1025320. Policy #0 lag: (min: 0.0, avg: 2.3, max: 4.0) [2024-08-05 09:54:53,357][00034] Avg episode reward: [(0, '-5.306')] [2024-08-05 09:54:53,744][00157] Updated weights for policy 0, policy_version 500 (0.0020) [2024-08-05 09:54:53,740][00162] DAMAGECOUNT value on done: 111.0 [2024-08-05 09:54:54,387][00171] DAMAGECOUNT value on done: 105.0 [2024-08-05 09:54:54,763][00156] DAMAGECOUNT value on done: 122.0 [2024-08-05 09:54:54,902][00169] DAMAGECOUNT value on done: 110.0 [2024-08-05 09:54:55,054][00170] DAMAGECOUNT value on done: 245.0 [2024-08-05 09:54:55,057][00170] Sum rewards: -3.652, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.092', 'AMMO5': '0.010', 'weapon4': '0.018', 'WEAPON1': '0.020', 'ARMOR': '0.020', 'weapon5': '0.034', 'AMMO2': '0.038', 'weapon7': '0.050', 'HITCOUNT': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.142', 'AMMO4': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.750', 'weapon2': '1.214', 'weapon3': '1.396', 'FRAGCOUNT': '2.000'} [2024-08-05 09:54:55,223][00165] DAMAGECOUNT value on done: 339.0 [2024-08-05 09:54:55,229][00165] Sum rewards: -3.112, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.556', 'AMMO5': '0.010', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'ARMOR': '0.060', 'weapon5': '0.072', 'AMMO3': '0.122', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'HITCOUNT': '0.180', 'weapon4': '0.264', 'WEAPON4': '0.300', 'WEAPON3': '0.600', 'weapon3': '0.890', 'DAMAGECOUNT': '0.942', 'weapon2': '1.414', 'FRAGCOUNT': '2.000'} [2024-08-05 09:54:55,411][00167] DAMAGECOUNT value on done: 110.0 [2024-08-05 09:54:55,542][00158] DAMAGECOUNT value on done: 411.0 [2024-08-05 09:54:55,542][00158] Sum rewards: -3.051, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.016', 'weapon7': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon5': '0.076', 'ARMOR': '0.080', 'AMMO3': '0.095', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.101', 'HITCOUNT': '0.130', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.370', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.768', 'weapon3': '0.922', 'weapon2': '1.236', 'FRAGCOUNT': '2.000'} [2024-08-05 09:54:56,054][00161] DAMAGECOUNT value on done: 348.0 [2024-08-05 09:54:56,064][00161] Sum rewards: -6.338, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.024', 'weapon5': '0.002', 'ARMOR': '0.004', 'AMMO2': '0.012', 'AMMO5': '0.020', 'AMMO4': '0.058', 'AMMO3': '0.112', 'HITCOUNT': '0.140', 'weapon4': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.630', 'weapon3': '0.840', 'weapon2': '1.964', 'FRAGCOUNT': '2.000'} [2024-08-05 09:54:56,070][00168] DAMAGECOUNT value on done: 281.0 [2024-08-05 09:54:56,070][00168] Sum rewards: -0.712, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.998', 'weapon7': '0.004', 'AMMO5': '0.015', 'ARMOR': '0.028', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'weapon5': '0.046', 'weapon4': '0.086', 'AMMO3': '0.114', 'AMMO4': '0.140', 'HITCOUNT': '0.180', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.693', 'weapon2': '1.204', 'weapon3': '1.418'} [2024-08-05 09:54:56,633][00163] DAMAGECOUNT value on done: 185.0 [2024-08-05 09:54:56,636][00163] Sum rewards: -11.162, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.510', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'HITCOUNT': '0.050', 'AMMO4': '0.060', 'weapon7': '0.068', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.163', 'DAMAGECOUNT': '0.165', 'WEAPON4': '0.200', 'weapon4': '0.220', 'WEAPON3': '0.800', 'weapon3': '0.842', 'FRAGCOUNT': '1.000', 'weapon2': '1.698'} [2024-08-05 09:54:56,762][00160] DAMAGECOUNT value on done: 163.0 [2024-08-05 09:54:56,765][00160] Sum rewards: -3.296, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.376', 'AMMO5': '0.007', 'HITCOUNT': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'ARMOR': '0.052', 'weapon5': '0.092', 'AMMO3': '0.094', 'AMMO4': '0.110', 'weapon4': '0.126', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.450', 'weapon3': '0.898', 'FRAGCOUNT': '1.000', 'weapon2': '1.804'} [2024-08-05 09:54:57,586][00164] DAMAGECOUNT value on done: 65.0 [2024-08-05 09:54:57,841][00159] DAMAGECOUNT value on done: 398.0 [2024-08-05 09:54:57,847][00159] Sum rewards: -3.794, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.509', 'weapon5': '0.002', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.082', 'AMMO3': '0.119', 'weapon4': '0.160', 'WEAPON4': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.194', 'weapon2': '1.334', 'weapon3': '1.404', 'FRAGCOUNT': '2.000'} [2024-08-05 09:54:58,037][00166] DAMAGECOUNT value on done: 180.0 [2024-08-05 09:54:58,355][00034] Fps is (10 sec: 4096.0, 60 sec: 4778.7, 300 sec: 4943.0). Total num frames: 4112384. Throughput: 0: 1226.5. Samples: 1032752. Policy #0 lag: (min: 0.0, avg: 2.5, max: 5.0) [2024-08-05 09:54:58,357][00034] Avg episode reward: [(0, '-5.189')] [2024-08-05 09:54:58,470][00172] DAMAGECOUNT value on done: 215.0 [2024-08-05 09:54:59,941][00162] DAMAGECOUNT value on done: 69.0 [2024-08-05 09:55:00,954][00169] DAMAGECOUNT value on done: 80.0 [2024-08-05 09:55:01,005][00156] DAMAGECOUNT value on done: 0.0 [2024-08-05 09:55:01,009][00156] Sum rewards: -3.426, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO4': '0.089', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.122', 'weapon4': '0.248', 'WEAPON3': '0.500', 'HEALTH': '0.638', 'weapon3': '1.028', 'weapon2': '1.090'} [2024-08-05 09:55:01,129][00170] DAMAGECOUNT value on done: 104.0 [2024-08-05 09:55:01,130][00170] Sum rewards: -7.181, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.038', 'weapon4': '0.006', 'AMMO5': '0.017', 'HITCOUNT': '0.020', 'AMMO2': '0.048', 'WEAPON1': '0.060', 'DAMAGECOUNT': '0.075', 'weapon5': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'AMMO4': '0.240', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'weapon2': '1.072', 'weapon3': '1.538'} [2024-08-05 09:55:01,231][00171] DAMAGECOUNT value on done: 86.0 [2024-08-05 09:55:01,232][00171] Sum rewards: -4.123, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.026', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon5': '0.026', 'HITCOUNT': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'ARMOR': '0.081', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.210', 'weapon4': '0.250', 'WEAPON3': '0.400', 'weapon3': '0.964', 'FRAGCOUNT': '1.000', 'weapon2': '1.452'} [2024-08-05 09:55:01,564][00167] DAMAGECOUNT value on done: 97.0 [2024-08-05 09:55:02,135][00165] DAMAGECOUNT value on done: 212.0 [2024-08-05 09:55:02,138][00165] Sum rewards: -1.867, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.804', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.032', 'weapon5': '0.052', 'AMMO4': '0.103', 'AMMO3': '0.120', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.435', 'ARMOR': '0.454', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon2': '1.088', 'weapon3': '1.442'} [2024-08-05 09:55:02,221][00161] DAMAGECOUNT value on done: 140.0 [2024-08-05 09:55:02,223][00161] Sum rewards: -4.164, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.770', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'weapon5': '0.016', 'AMMO2': '0.030', 'ARMOR': '0.068', 'HITCOUNT': '0.110', 'AMMO3': '0.130', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.270', 'WEAPON4': '0.450', 'weapon4': '0.476', 'FRAGCOUNT': '0.500', 'weapon3': '0.508', 'WEAPON3': '0.600', 'weapon2': '1.628'} [2024-08-05 09:55:02,508][00158] DAMAGECOUNT value on done: 320.0 [2024-08-05 09:55:02,511][00158] Sum rewards: -6.331, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.242', 'AMMO5': '0.003', 'ARMOR': '0.024', 'weapon5': '0.024', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'AMMO3': '0.090', 'AMMO4': '0.145', 'HITCOUNT': '0.150', 'weapon4': '0.338', 'WEAPON4': '0.350', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.720', 'weapon3': '0.762', 'FRAGCOUNT': '1.000', 'weapon2': '1.976'} [2024-08-05 09:55:02,789][00168] DAMAGECOUNT value on done: 240.0 [2024-08-05 09:55:02,796][00168] Sum rewards: -2.382, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.569', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'weapon7': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.306', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.700', 'weapon3': '0.880', 'FRAGCOUNT': '1.000', 'weapon2': '1.376'} [2024-08-05 09:55:03,270][00160] DAMAGECOUNT value on done: 119.0 [2024-08-05 09:55:03,355][00034] Fps is (10 sec: 5734.4, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 4145152. Throughput: 0: 1229.6. Samples: 1040288. Policy #0 lag: (min: 0.0, avg: 2.0, max: 5.0) [2024-08-05 09:55:03,357][00034] Avg episode reward: [(0, '-5.169')] [2024-08-05 09:55:03,569][00163] DAMAGECOUNT value on done: 190.0 [2024-08-05 09:55:03,578][00163] Sum rewards: -5.691, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.662', 'AMMO5': '0.015', 'AMMO2': '0.027', 'weapon5': '0.028', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'HITCOUNT': '0.090', 'AMMO3': '0.124', 'AMMO4': '0.134', 'weapon4': '0.166', 'DAMAGECOUNT': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.148', 'weapon2': '1.422'} [2024-08-05 09:55:03,888][00164] DAMAGECOUNT value on done: 150.0 [2024-08-05 09:55:03,891][00164] Sum rewards: -4.974, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.676', 'AMMO5': '0.010', 'AMMO2': '0.044', 'ARMOR': '0.051', 'WEAPON5': '0.100', 'HITCOUNT': '0.130', 'AMMO3': '0.136', 'AMMO4': '0.220', 'weapon4': '0.266', 'DAMAGECOUNT': '0.390', 'WEAPON4': '0.450', 'WEAPON3': '0.650', 'weapon3': '1.024', 'weapon2': '1.480', 'FRAGCOUNT': '2.000'} [2024-08-05 09:55:04,019][00159] DAMAGECOUNT value on done: 465.0 [2024-08-05 09:55:04,028][00159] Sum rewards: -7.032, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.302', 'AMMO5': '0.007', 'AMMO2': '0.029', 'ARMOR': '0.036', 'weapon5': '0.040', 'WEAPON1': '0.050', 'HITCOUNT': '0.140', 'AMMO4': '0.144', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'weapon4': '0.206', 'WEAPON4': '0.350', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.700', 'weapon3': '1.268', 'weapon2': '1.406', 'FRAGCOUNT': '2.000'} [2024-08-05 09:55:04,426][00166] DAMAGECOUNT value on done: 255.0 [2024-08-05 09:55:04,430][00166] Sum rewards: -5.107, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.021', 'AMMO2': '0.011', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.030', 'AMMO4': '0.053', 'ARMOR': '0.064', 'AMMO3': '0.109', 'HITCOUNT': '0.150', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.288', 'weapon3': '1.372'} [2024-08-05 09:55:04,581][00172] DAMAGECOUNT value on done: 153.0 [2024-08-05 09:55:04,585][00172] Sum rewards: -5.291, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.184', 'ARMOR': '0.004', 'AMMO5': '0.012', 'weapon5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon4': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.113', 'AMMO4': '0.136', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.322', 'weapon3': '1.350'} [2024-08-05 09:55:06,065][00162] DAMAGECOUNT value on done: 137.0 [2024-08-05 09:55:06,067][00162] Sum rewards: -5.955, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.120', 'AMMO5': '0.003', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.062', 'weapon4': '0.078', 'HITCOUNT': '0.110', 'AMMO3': '0.197', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon3': '1.226', 'weapon2': '1.596'} [2024-08-05 09:55:07,104][00169] DAMAGECOUNT value on done: 190.0 [2024-08-05 09:55:07,317][00170] DAMAGECOUNT value on done: 174.0 [2024-08-05 09:55:07,515][00156] DAMAGECOUNT value on done: 186.0 [2024-08-05 09:55:07,521][00156] Sum rewards: -4.176, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.518', 'FRAGCOUNT': '-0.500', 'weapon4': '0.002', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.026', 'WEAPON1': '0.040', 'ARMOR': '0.054', 'weapon5': '0.054', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.144', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.423', 'WEAPON3': '0.750', 'weapon2': '0.902', 'weapon3': '1.710'} [2024-08-05 09:55:07,852][00171] DAMAGECOUNT value on done: 389.0 [2024-08-05 09:55:07,869][00171] Sum rewards: 2.287, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'AMMO2': '0.011', 'weapon5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.054', 'AMMO3': '0.094', 'WEAPON5': '0.200', 'HITCOUNT': '0.210', 'HEALTH': '0.272', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.080', 'weapon3': '1.316', 'weapon2': '1.508', 'FRAGCOUNT': '3.000'} [2024-08-05 09:55:08,095][00167] DAMAGECOUNT value on done: 120.0 [2024-08-05 09:55:08,098][00167] Sum rewards: -3.632, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.954', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.075', 'HITCOUNT': '0.120', 'weapon4': '0.140', 'AMMO3': '0.148', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.360', 'ARMOR': '0.468', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.054', 'weapon3': '1.568'} [2024-08-05 09:55:08,355][00034] Fps is (10 sec: 5734.4, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 4169728. Throughput: 0: 1228.6. Samples: 1044024. Policy #0 lag: (min: 0.0, avg: 1.9, max: 4.0) [2024-08-05 09:55:08,357][00034] Avg episode reward: [(0, '-5.160')] [2024-08-05 09:55:08,586][00165] DAMAGECOUNT value on done: 86.0 [2024-08-05 09:55:08,588][00165] Sum rewards: -5.509, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.093', 'AMMO5': '0.010', 'weapon5': '0.030', 'ARMOR': '0.032', 'AMMO2': '0.032', 'WEAPON1': '0.050', 'HITCOUNT': '0.070', 'AMMO3': '0.106', 'weapon4': '0.154', 'AMMO4': '0.162', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.216', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.226', 'weapon2': '1.446'} [2024-08-05 09:55:08,820][00161] DAMAGECOUNT value on done: 168.0 [2024-08-05 09:55:08,822][00161] Sum rewards: -7.526, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.378', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.011', 'ARMOR': '0.040', 'weapon5': '0.070', 'HITCOUNT': '0.120', 'AMMO3': '0.123', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.369', 'WEAPON3': '0.600', 'weapon2': '1.416', 'weapon3': '1.464'} [2024-08-05 09:55:09,007][00158] DAMAGECOUNT value on done: 125.0 [2024-08-05 09:55:09,011][00158] Sum rewards: -3.720, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.285', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'HITCOUNT': '0.080', 'AMMO4': '0.099', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'weapon4': '0.150', 'DAMAGECOUNT': '0.240', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.092', 'weapon2': '1.546'} [2024-08-05 09:55:09,070][00157] Updated weights for policy 0, policy_version 510 (0.0020) [2024-08-05 09:55:09,793][00168] DAMAGECOUNT value on done: 246.0 [2024-08-05 09:55:09,801][00168] Sum rewards: -5.063, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-3.110', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.018', 'weapon4': '0.066', 'weapon5': '0.084', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.486', 'WEAPON3': '1.050', 'weapon2': '1.102', 'weapon3': '1.632', 'FRAGCOUNT': '2.000'} [2024-08-05 09:55:10,152][00163] DAMAGECOUNT value on done: 222.0 [2024-08-05 09:55:10,161][00163] Sum rewards: -6.849, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.974', 'AMMO5': '0.003', 'HITCOUNT': '0.010', 'weapon5': '0.016', 'AMMO2': '0.016', 'DAMAGECOUNT': '0.045', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'AMMO4': '0.082', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'weapon4': '0.194', 'WEAPON3': '0.600', 'weapon3': '1.072', 'weapon2': '1.452'} [2024-08-05 09:55:10,336][00160] DAMAGECOUNT value on done: 265.0 [2024-08-05 09:55:10,337][00160] Sum rewards: -3.699, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.315', 'weapon5': '0.008', 'AMMO2': '0.010', 'AMMO5': '0.028', 'AMMO4': '0.049', 'weapon4': '0.098', 'WEAPON4': '0.100', 'HITCOUNT': '0.140', 'AMMO3': '0.160', 'WEAPON5': '0.450', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.750', 'weapon3': '1.126', 'weapon2': '1.598', 'FRAGCOUNT': '3.000'} [2024-08-05 09:55:10,416][00159] DAMAGECOUNT value on done: 200.0 [2024-08-05 09:55:10,419][00159] Sum rewards: -4.930, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'AMMO2': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.031', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'HITCOUNT': '0.060', 'weapon4': '0.060', 'weapon5': '0.060', 'DAMAGECOUNT': '0.180', 'WEAPON5': '0.200', 'HEALTH': '0.298', 'WEAPON3': '0.300', 'weapon3': '1.148', 'weapon2': '1.606'} [2024-08-05 09:55:10,648][00166] DAMAGECOUNT value on done: 210.0 [2024-08-05 09:55:10,657][00166] Sum rewards: -8.057, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.636', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.031', 'ARMOR': '0.060', 'AMMO3': '0.072', 'WEAPON5': '0.100', 'HITCOUNT': '0.120', 'AMMO4': '0.152', 'WEAPON4': '0.350', 'weapon4': '0.374', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.400', 'weapon3': '0.732', 'FRAGCOUNT': '1.000', 'weapon2': '1.802'} [2024-08-05 09:55:11,091][00164] DAMAGECOUNT value on done: 158.0 [2024-08-05 09:55:11,092][00164] Sum rewards: -7.613, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.210', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'weapon5': '0.032', 'weapon7': '0.054', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.113', 'HITCOUNT': '0.120', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.258', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.444', 'weapon3': '0.810', 'FRAGCOUNT': '1.000', 'weapon2': '1.508'} [2024-08-05 09:55:11,754][00172] DAMAGECOUNT value on done: 55.0 [2024-08-05 09:55:12,455][00162] DAMAGECOUNT value on done: 82.0 [2024-08-05 09:55:13,356][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 4194304. Throughput: 0: 1232.4. Samples: 1051528. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 09:55:13,358][00034] Avg episode reward: [(0, '-5.165')] [2024-08-05 09:55:13,734][00169] DAMAGECOUNT value on done: 270.0 [2024-08-05 09:55:13,738][00169] Sum rewards: -1.720, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.185', 'weapon5': '0.022', 'AMMO5': '0.023', 'WEAPON1': '0.030', 'AMMO2': '0.034', 'AMMO3': '0.094', 'HITCOUNT': '0.150', 'AMMO4': '0.168', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.442', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.660', 'FRAGCOUNT': '1.000', 'weapon2': '1.072', 'weapon3': '1.270'} [2024-08-05 09:55:13,906][00156] DAMAGECOUNT value on done: 64.0 [2024-08-05 09:55:13,911][00170] DAMAGECOUNT value on done: 36.0 [2024-08-05 09:55:14,474][00167] DAMAGECOUNT value on done: 299.0 [2024-08-05 09:55:14,478][00167] Sum rewards: -2.715, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.360', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.008', 'HITCOUNT': '0.020', 'WEAPON1': '0.040', 'weapon7': '0.060', 'AMMO3': '0.089', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon5': '0.180', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.600', 'weapon2': '1.044', 'weapon3': '1.202'} [2024-08-05 09:55:14,961][00171] DAMAGECOUNT value on done: 245.0 [2024-08-05 09:55:14,964][00171] Sum rewards: -0.680, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.830', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.015', 'weapon5': '0.110', 'AMMO3': '0.119', 'HITCOUNT': '0.170', 'weapon4': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.645', 'weapon3': '0.948', 'weapon2': '1.666', 'FRAGCOUNT': '3.000'} [2024-08-05 09:55:15,737][00161] DAMAGECOUNT value on done: 164.0 [2024-08-05 09:55:15,789][00165] DAMAGECOUNT value on done: 128.0 [2024-08-05 09:55:16,243][00158] DAMAGECOUNT value on done: 105.0 [2024-08-05 09:55:16,244][00158] Sum rewards: -7.352, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.960', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.018', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'HITCOUNT': '0.060', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'DAMAGECOUNT': '0.315', 'weapon2': '0.938', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon3': '1.904'} [2024-08-05 09:55:17,086][00168] DAMAGECOUNT value on done: 34.0 [2024-08-05 09:55:17,349][00163] DAMAGECOUNT value on done: 254.0 [2024-08-05 09:55:17,350][00163] Sum rewards: -3.255, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.364', 'AMMO5': '0.005', 'AMMO2': '0.021', 'HITCOUNT': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.096', 'weapon7': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.106', 'ARMOR': '0.108', 'WEAPON4': '0.300', 'weapon4': '0.526', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.597', 'weapon3': '0.900', 'weapon2': '0.922', 'FRAGCOUNT': '1.000'} [2024-08-05 09:55:17,628][00160] DAMAGECOUNT value on done: 290.0 [2024-08-05 09:55:17,631][00160] Sum rewards: -1.097, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.314', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon5': '0.022', 'WEAPON1': '0.030', 'AMMO3': '0.095', 'AMMO4': '0.105', 'HITCOUNT': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.250', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.765', 'weapon2': '1.098', 'weapon3': '1.238', 'FRAGCOUNT': '2.000'} [2024-08-05 09:55:17,633][00166] DAMAGECOUNT value on done: 102.0 [2024-08-05 09:55:17,640][00166] Sum rewards: -12.104, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.604', 'ARMOR': '0.004', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.046', 'AMMO4': '0.065', 'HITCOUNT': '0.080', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'DAMAGECOUNT': '0.276', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon3': '1.082', 'weapon2': '1.362'} [2024-08-05 09:55:17,694][00159] DAMAGECOUNT value on done: 157.0 [2024-08-05 09:55:17,695][00159] Sum rewards: -3.329, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.005', 'AMMO2': '0.027', 'ARMOR': '0.048', 'weapon5': '0.060', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.120', 'AMMO4': '0.136', 'WEAPON4': '0.200', 'weapon4': '0.286', 'DAMAGECOUNT': '0.396', 'WEAPON3': '0.650', 'HEALTH': '0.862', 'FRAGCOUNT': '1.000', 'weapon2': '1.060', 'weapon3': '1.360'} [2024-08-05 09:55:18,266][00164] DAMAGECOUNT value on done: 198.0 [2024-08-05 09:55:18,273][00164] Sum rewards: -3.759, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.226', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'AMMO2': '0.041', 'weapon5': '0.088', 'AMMO3': '0.090', 'HITCOUNT': '0.100', 'AMMO4': '0.205', 'weapon4': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.564', 'weapon3': '0.686', 'FRAGCOUNT': '1.000', 'weapon2': '1.552'} [2024-08-05 09:55:18,355][00034] Fps is (10 sec: 4096.0, 60 sec: 4779.1, 300 sec: 4943.0). Total num frames: 4210688. Throughput: 0: 1214.4. Samples: 1058304. Policy #0 lag: (min: 0.0, avg: 1.9, max: 5.0) [2024-08-05 09:55:18,357][00034] Avg episode reward: [(0, '-4.970')] [2024-08-05 09:55:18,937][00172] DAMAGECOUNT value on done: 200.0 [2024-08-05 09:55:18,940][00172] Sum rewards: -7.283, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.214', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon5': '0.028', 'ARMOR': '0.040', 'weapon4': '0.044', 'HITCOUNT': '0.110', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'DAMAGECOUNT': '0.510', 'WEAPON3': '1.000', 'weapon3': '1.268', 'weapon2': '1.310', 'FRAGCOUNT': '2.000'} [2024-08-05 09:55:20,436][00162] DAMAGECOUNT value on done: 153.0 [2024-08-05 09:55:20,440][00162] Sum rewards: -7.774, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.408', 'AMMO5': '0.005', 'weapon7': '0.006', 'AMMO2': '0.011', 'AMMO4': '0.053', 'ARMOR': '0.060', 'WEAPON5': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon4': '0.114', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.228', 'DAMAGECOUNT': '0.429', 'weapon2': '0.866', 'WEAPON3': '1.250', 'weapon3': '1.682', 'FRAGCOUNT': '2.000'} [2024-08-05 09:55:20,802][00156] DAMAGECOUNT value on done: 60.0 [2024-08-05 09:55:20,802][00156] Sum rewards: -3.327, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.512', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.032', 'HITCOUNT': '0.050', 'weapon5': '0.082', 'ARMOR': '0.088', 'AMMO3': '0.129', 'DAMAGECOUNT': '0.135', 'weapon4': '0.154', 'AMMO4': '0.162', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.100', 'weapon3': '1.174'} [2024-08-05 09:55:21,240][00171] DAMAGECOUNT value on done: 247.0 [2024-08-05 09:55:21,246][00171] Sum rewards: -6.049, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.080', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.021', 'ARMOR': '0.040', 'weapon5': '0.056', 'HITCOUNT': '0.060', 'weapon4': '0.102', 'AMMO4': '0.105', 'AMMO3': '0.124', 'DAMAGECOUNT': '0.150', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.550', 'weapon3': '1.142', 'weapon2': '1.558'} [2024-08-05 09:55:21,316][00169] DAMAGECOUNT value on done: 95.0 [2024-08-05 09:55:21,317][00169] Sum rewards: -2.225, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.914', 'AMMO5': '0.013', 'weapon5': '0.014', 'ARMOR': '0.032', 'AMMO2': '0.038', 'HITCOUNT': '0.090', 'AMMO3': '0.122', 'AMMO4': '0.187', 'weapon4': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.285', 'WEAPON3': '0.650', 'weapon2': '0.960', 'FRAGCOUNT': '1.000', 'weapon3': '1.300'} [2024-08-05 09:55:21,406][00167] DAMAGECOUNT value on done: 220.0 [2024-08-05 09:55:21,413][00167] Sum rewards: -1.599, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.700', 'AMMO2': '0.007', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO4': '0.032', 'ARMOR': '0.060', 'AMMO3': '0.112', 'HITCOUNT': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.264', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.550', 'weapon2': '1.310', 'weapon3': '1.310', 'FRAGCOUNT': '3.000'} [2024-08-05 09:55:21,515][00170] DAMAGECOUNT value on done: 237.0 [2024-08-05 09:55:21,516][00170] Sum rewards: -1.704, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.079', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon4': '0.098', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.390', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'weapon2': '0.986', 'FRAGCOUNT': '1.000', 'weapon3': '1.828'} [2024-08-05 09:55:22,015][00165] DAMAGECOUNT value on done: 250.0 [2024-08-05 09:55:22,016][00165] Sum rewards: -2.786, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.602', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon5': '0.028', 'ARMOR': '0.040', 'HITCOUNT': '0.050', 'AMMO3': '0.112', 'AMMO4': '0.126', 'DAMAGECOUNT': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.190', 'weapon3': '1.192'} [2024-08-05 09:55:22,182][00161] DAMAGECOUNT value on done: 97.0 [2024-08-05 09:55:22,710][00158] DAMAGECOUNT value on done: 124.0 [2024-08-05 09:55:23,344][00168] DAMAGECOUNT value on done: 180.0 [2024-08-05 09:55:23,349][00168] Sum rewards: -5.049, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.641', 'weapon5': '0.002', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.024', 'ARMOR': '0.036', 'HITCOUNT': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.066', 'AMMO4': '0.117', 'DAMAGECOUNT': '0.150', 'AMMO3': '0.153', 'WEAPON5': '0.250', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.204', 'weapon3': '1.560'} [2024-08-05 09:55:23,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 4243456. Throughput: 0: 1216.2. Samples: 1062016. Policy #0 lag: (min: 0.0, avg: 2.0, max: 4.0) [2024-08-05 09:55:23,357][00034] Avg episode reward: [(0, '-4.831')] [2024-08-05 09:55:23,369][00136] Saving /kaggle/working/train_dir/default_experiment/checkpoint_p0/checkpoint_000000518_4243456.pth... [2024-08-05 09:55:23,547][00136] Removing /kaggle/working/train_dir/default_experiment/checkpoint_p0/checkpoint_000000373_3055616.pth [2024-08-05 09:55:23,992][00160] DAMAGECOUNT value on done: 584.0 [2024-08-05 09:55:23,998][00160] Sum rewards: -0.040, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.270', 'AMMO2': '0.016', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'weapon5': '0.026', 'ARMOR': '0.040', 'AMMO4': '0.079', 'weapon4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.189', 'WEAPON5': '0.400', 'HITCOUNT': '0.420', 'WEAPON3': '1.050', 'weapon3': '1.316', 'weapon2': '1.576', 'DAMAGECOUNT': '1.644', 'FRAGCOUNT': '4.000'} [2024-08-05 09:55:24,065][00163] DAMAGECOUNT value on done: 135.0 [2024-08-05 09:55:24,069][00163] Sum rewards: -6.964, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.990', 'FRAGCOUNT': '-0.500', 'weapon5': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.018', 'HITCOUNT': '0.080', 'AMMO4': '0.091', 'AMMO3': '0.119', 'WEAPON4': '0.150', 'weapon4': '0.150', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.345', 'ARMOR': '0.436', 'WEAPON3': '0.650', 'weapon3': '1.302', 'weapon2': '1.402'} [2024-08-05 09:55:24,100][00166] DAMAGECOUNT value on done: 388.0 [2024-08-05 09:55:24,103][00166] Sum rewards: -4.379, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.090', 'AMMO5': '0.022', 'AMMO2': '0.025', 'ARMOR': '0.088', 'weapon5': '0.096', 'HITCOUNT': '0.120', 'AMMO4': '0.125', 'AMMO3': '0.143', 'weapon4': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.029', 'weapon3': '1.036', 'weapon2': '1.350'} [2024-08-05 09:55:24,590][00159] DAMAGECOUNT value on done: 170.0 [2024-08-05 09:55:24,590][00159] Sum rewards: -7.152, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.080', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.008', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.037', 'ARMOR': '0.040', 'weapon5': '0.078', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.133', 'weapon4': '0.160', 'WEAPON5': '0.400', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.750', 'weapon3': '1.160', 'weapon2': '1.512'} [2024-08-05 09:55:24,704][00164] DAMAGECOUNT value on done: 79.0 [2024-08-05 09:55:25,255][00172] DAMAGECOUNT value on done: 320.0 [2024-08-05 09:55:25,261][00172] Sum rewards: -7.869, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.770', 'AMMO5': '0.005', 'weapon5': '0.006', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'ARMOR': '0.040', 'weapon7': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.137', 'AMMO3': '0.141', 'HITCOUNT': '0.160', 'WEAPON4': '0.250', 'weapon4': '0.318', 'FRAGCOUNT': '0.500', 'weapon3': '0.734', 'DAMAGECOUNT': '0.735', 'WEAPON3': '0.750', 'weapon2': '1.598'} [2024-08-05 09:55:26,685][00162] DAMAGECOUNT value on done: 193.0 [2024-08-05 09:55:26,689][00162] Sum rewards: -4.122, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.201', 'AMMO5': '0.010', 'AMMO2': '0.011', 'ARMOR': '0.048', 'AMMO4': '0.057', 'AMMO3': '0.065', 'weapon7': '0.082', 'HITCOUNT': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.450', 'weapon3': '0.832', 'FRAGCOUNT': '1.000', 'weapon2': '1.966'} [2024-08-05 09:55:26,858][00157] Updated weights for policy 0, policy_version 520 (0.0025) [2024-08-05 09:55:28,091][00171] DAMAGECOUNT value on done: 130.0 [2024-08-05 09:55:28,092][00171] Sum rewards: -8.638, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.516', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.008', 'AMMO2': '0.009', 'WEAPON1': '0.040', 'AMMO4': '0.046', 'weapon5': '0.058', 'HITCOUNT': '0.090', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'weapon4': '0.180', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.315', 'ARMOR': '0.479', 'WEAPON3': '0.600', 'weapon3': '1.198', 'weapon2': '1.378'} [2024-08-05 09:55:28,186][00156] DAMAGECOUNT value on done: 70.0 [2024-08-05 09:55:28,187][00156] Sum rewards: -2.292, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.390', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon4': '0.026', 'ARMOR': '0.040', 'AMMO4': '0.045', 'HITCOUNT': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.102', 'weapon5': '0.142', 'DAMAGECOUNT': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.450', 'weapon3': '0.884', 'FRAGCOUNT': '1.000', 'weapon2': '1.680'} [2024-08-05 09:55:28,355][00034] Fps is (10 sec: 5734.4, 60 sec: 4915.3, 300 sec: 4970.7). Total num frames: 4268032. Throughput: 0: 1218.0. Samples: 1069416. Policy #0 lag: (min: 0.0, avg: 2.1, max: 5.0) [2024-08-05 09:55:28,357][00034] Avg episode reward: [(0, '-4.921')] [2024-08-05 09:55:28,642][00167] DAMAGECOUNT value on done: 229.0 [2024-08-05 09:55:28,642][00167] Sum rewards: -4.174, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.486', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.017', 'ARMOR': '0.048', 'weapon4': '0.060', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'HITCOUNT': '0.130', 'DAMAGECOUNT': '0.507', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.172', 'weapon2': '1.662'} [2024-08-05 09:55:28,676][00165] DAMAGECOUNT value on done: 380.0 [2024-08-05 09:55:28,680][00165] Sum rewards: -9.814, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.570', 'ARMOR': '0.008', 'AMMO2': '0.016', 'AMMO5': '0.025', 'weapon4': '0.044', 'weapon5': '0.064', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.162', 'HITCOUNT': '0.180', 'WEAPON5': '0.400', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.555', 'WEAPON3': '0.900', 'weapon3': '1.318', 'weapon2': '1.656'} [2024-08-05 09:55:29,439][00161] DAMAGECOUNT value on done: 252.0 [2024-08-05 09:55:29,440][00161] Sum rewards: -2.539, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.178', 'AMMO2': '0.011', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.053', 'AMMO3': '0.062', 'weapon7': '0.080', 'weapon5': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'weapon4': '0.184', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.696', 'weapon3': '0.922', 'weapon2': '1.560'} [2024-08-05 09:55:29,429][00158] DAMAGECOUNT value on done: 425.0 [2024-08-05 09:55:29,441][00158] Sum rewards: -6.156, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.420', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.029', 'WEAPON1': '0.040', 'weapon5': '0.126', 'AMMO4': '0.142', 'AMMO3': '0.169', 'HITCOUNT': '0.180', 'weapon4': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon3': '0.868', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.005', 'FRAGCOUNT': '1.500', 'weapon2': '1.702'} [2024-08-05 09:55:30,356][00160] DAMAGECOUNT value on done: 115.0 [2024-08-05 09:55:30,595][00163] DAMAGECOUNT value on done: 318.0 [2024-08-05 09:55:30,598][00163] Sum rewards: -2.684, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.106', 'AMMO2': '0.009', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.045', 'weapon4': '0.070', 'AMMO3': '0.108', 'weapon5': '0.136', 'WEAPON4': '0.150', 'HITCOUNT': '0.190', 'WEAPON5': '0.250', 'ARMOR': '0.455', 'DAMAGECOUNT': '0.648', 'WEAPON3': '0.650', 'weapon3': '1.042', 'weapon2': '1.632', 'FRAGCOUNT': '3.000'} [2024-08-05 09:55:31,238][00164] DAMAGECOUNT value on done: 155.0 [2024-08-05 09:55:31,239][00164] Sum rewards: -6.301, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.108', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'ARMOR': '0.048', 'AMMO3': '0.101', 'HITCOUNT': '0.110', 'AMMO4': '0.133', 'WEAPON5': '0.250', 'weapon4': '0.310', 'WEAPON4': '0.350', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.550', 'weapon3': '0.816', 'FRAGCOUNT': '1.000', 'weapon2': '1.454'} [2024-08-05 09:55:31,286][00166] DAMAGECOUNT value on done: 160.0 [2024-08-05 09:55:33,355][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4943.0). Total num frames: 4292608. Throughput: 0: 1230.0. Samples: 1077032. Policy #0 lag: (min: 0.0, avg: 2.3, max: 5.0) [2024-08-05 09:55:33,357][00034] Avg episode reward: [(0, '-4.814')] [2024-08-05 09:55:34,240][00156] DAMAGECOUNT value on done: 282.0 [2024-08-05 09:55:34,243][00156] Sum rewards: -2.130, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.880', 'AMMO2': '0.001', 'AMMO4': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'weapon5': '0.036', 'AMMO3': '0.142', 'HITCOUNT': '0.180', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.801', 'weapon2': '0.988', 'weapon3': '1.768', 'FRAGCOUNT': '2.000'} [2024-08-05 09:55:34,680][00171] DAMAGECOUNT value on done: 350.0 [2024-08-05 09:55:34,688][00171] Sum rewards: -2.009, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.791', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon5': '0.048', 'AMMO3': '0.086', 'AMMO4': '0.110', 'HITCOUNT': '0.140', 'weapon4': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.645', 'weapon3': '1.038', 'weapon2': '1.618', 'FRAGCOUNT': '2.000'} [2024-08-05 09:55:34,712][00167] DAMAGECOUNT value on done: 125.0 [2024-08-05 09:55:35,018][00165] DAMAGECOUNT value on done: 135.0 [2024-08-05 09:55:35,516][00161] DAMAGECOUNT value on done: 115.0 [2024-08-05 09:55:35,661][00158] DAMAGECOUNT value on done: 226.0 [2024-08-05 09:55:35,669][00158] Sum rewards: -2.750, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.270', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.029', 'ARMOR': '0.032', 'weapon5': '0.062', 'weapon7': '0.068', 'HITCOUNT': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.110', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'weapon4': '0.152', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.603', 'WEAPON3': '0.650', 'weapon3': '0.918', 'FRAGCOUNT': '1.000', 'weapon2': '1.502'} [2024-08-05 09:55:36,742][00163] DAMAGECOUNT value on done: 292.0 [2024-08-05 09:55:38,356][00034] Fps is (10 sec: 4915.1, 60 sec: 5051.7, 300 sec: 4970.7). Total num frames: 4317184. Throughput: 0: 1230.6. Samples: 1080696. Policy #0 lag: (min: 0.0, avg: 2.1, max: 5.0) [2024-08-05 09:55:38,357][00034] Avg episode reward: [(0, '-4.709')] [2024-08-05 09:55:40,440][00156] DAMAGECOUNT value on done: 212.0 [2024-08-05 09:55:42,176][00171] DAMAGECOUNT value on done: 175.0 [2024-08-05 09:55:42,909][00157] Updated weights for policy 0, policy_version 530 (0.0020) [2024-08-05 09:55:43,101][00158] DAMAGECOUNT value on done: 154.0 [2024-08-05 09:55:43,102][00158] Sum rewards: -6.585, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.890', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'weapon5': '0.044', 'WEAPON5': '0.100', 'HITCOUNT': '0.130', 'AMMO3': '0.131', 'AMMO4': '0.155', 'WEAPON4': '0.250', 'weapon4': '0.354', 'DAMAGECOUNT': '0.357', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.036', 'weapon2': '1.452'} [2024-08-05 09:55:43,356][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 4341760. Throughput: 0: 1234.7. Samples: 1088312. Policy #0 lag: (min: 0.0, avg: 1.9, max: 5.0) [2024-08-05 09:55:43,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:55:48,356][00034] Fps is (10 sec: 4095.9, 60 sec: 4778.6, 300 sec: 4915.2). Total num frames: 4358144. Throughput: 0: 1218.7. Samples: 1095128. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 09:55:48,358][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:55:53,356][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4943.0). Total num frames: 4390912. Throughput: 0: 1219.2. Samples: 1098888. Policy #0 lag: (min: 0.0, avg: 2.1, max: 5.0) [2024-08-05 09:55:53,360][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:55:58,355][00034] Fps is (10 sec: 5734.6, 60 sec: 5051.7, 300 sec: 4970.7). Total num frames: 4415488. Throughput: 0: 1220.3. Samples: 1106440. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 09:55:58,358][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:55:59,349][00157] Updated weights for policy 0, policy_version 540 (0.0021) [2024-08-05 09:56:03,355][00034] Fps is (10 sec: 4096.0, 60 sec: 4778.7, 300 sec: 4915.2). Total num frames: 4431872. Throughput: 0: 1239.8. Samples: 1114096. Policy #0 lag: (min: 0.0, avg: 1.8, max: 4.0) [2024-08-05 09:56:03,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:56:08,334][00168] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon4', 0.002)] [2024-08-05 09:56:08,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 4464640. Throughput: 0: 1239.3. Samples: 1117784. Policy #0 lag: (min: 0.0, avg: 1.9, max: 4.0) [2024-08-05 09:56:08,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:56:13,356][00034] Fps is (10 sec: 5734.3, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 4489216. Throughput: 0: 1246.2. Samples: 1125496. Policy #0 lag: (min: 0.0, avg: 1.8, max: 5.0) [2024-08-05 09:56:13,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:56:16,659][00157] Updated weights for policy 0, policy_version 550 (0.0020) [2024-08-05 09:56:18,355][00034] Fps is (10 sec: 5734.4, 60 sec: 5188.3, 300 sec: 4970.7). Total num frames: 4521984. Throughput: 0: 1245.2. Samples: 1133064. Policy #0 lag: (min: 0.0, avg: 1.9, max: 5.0) [2024-08-05 09:56:18,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:56:23,355][00034] Fps is (10 sec: 4096.1, 60 sec: 4778.7, 300 sec: 4915.2). Total num frames: 4530176. Throughput: 0: 1235.6. Samples: 1136296. Policy #0 lag: (min: 0.0, avg: 1.9, max: 4.0) [2024-08-05 09:56:23,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:56:28,356][00034] Fps is (10 sec: 4095.9, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 4562944. Throughput: 0: 1235.2. Samples: 1143896. Policy #0 lag: (min: 0.0, avg: 1.9, max: 4.0) [2024-08-05 09:56:28,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:56:29,855][00169] Large shaping reward -2.556 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('ARMOR', -0.007, -7.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 09:56:31,673][00157] Updated weights for policy 0, policy_version 560 (0.0019) [2024-08-05 09:56:33,356][00034] Fps is (10 sec: 5734.4, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 4587520. Throughput: 0: 1253.9. Samples: 1151552. Policy #0 lag: (min: 0.0, avg: 1.9, max: 5.0) [2024-08-05 09:56:33,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:56:38,355][00034] Fps is (10 sec: 4915.3, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 4612096. Throughput: 0: 1253.9. Samples: 1155312. Policy #0 lag: (min: 0.0, avg: 1.7, max: 4.0) [2024-08-05 09:56:38,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:56:43,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 4636672. Throughput: 0: 1256.0. Samples: 1162960. Policy #0 lag: (min: 0.0, avg: 2.0, max: 4.0) [2024-08-05 09:56:43,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:56:48,356][00034] Fps is (10 sec: 4915.1, 60 sec: 5051.7, 300 sec: 4943.0). Total num frames: 4661248. Throughput: 0: 1251.4. Samples: 1170408. Policy #0 lag: (min: 0.0, avg: 2.0, max: 5.0) [2024-08-05 09:56:48,358][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:56:48,698][00157] Updated weights for policy 0, policy_version 570 (0.0020) [2024-08-05 09:56:53,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 4685824. Throughput: 0: 1249.6. Samples: 1174016. Policy #0 lag: (min: 0.0, avg: 2.0, max: 5.0) [2024-08-05 09:56:53,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:56:58,355][00034] Fps is (10 sec: 4915.3, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 4710400. Throughput: 0: 1238.8. Samples: 1181240. Policy #0 lag: (min: 0.0, avg: 2.1, max: 5.0) [2024-08-05 09:56:58,360][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:57:03,356][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4943.0). Total num frames: 4734976. Throughput: 0: 1239.6. Samples: 1188848. Policy #0 lag: (min: 0.0, avg: 2.0, max: 4.0) [2024-08-05 09:57:03,360][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:57:05,215][00157] Updated weights for policy 0, policy_version 580 (0.0019) [2024-08-05 09:57:08,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 4759552. Throughput: 0: 1250.7. Samples: 1192576. Policy #0 lag: (min: 0.0, avg: 2.0, max: 5.0) [2024-08-05 09:57:08,358][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:57:13,356][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 4784128. Throughput: 0: 1252.4. Samples: 1200256. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 09:57:13,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:57:18,355][00034] Fps is (10 sec: 5734.4, 60 sec: 4915.2, 300 sec: 4970.8). Total num frames: 4816896. Throughput: 0: 1250.3. Samples: 1207816. Policy #0 lag: (min: 0.0, avg: 2.0, max: 5.0) [2024-08-05 09:57:18,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:57:21,180][00157] Updated weights for policy 0, policy_version 590 (0.0020) [2024-08-05 09:57:23,356][00034] Fps is (10 sec: 5734.4, 60 sec: 5188.3, 300 sec: 4943.0). Total num frames: 4841472. Throughput: 0: 1249.8. Samples: 1211552. Policy #0 lag: (min: 0.0, avg: 1.9, max: 4.0) [2024-08-05 09:57:23,360][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:57:23,372][00136] Saving /kaggle/working/train_dir/default_experiment/checkpoint_p0/checkpoint_000000591_4841472.pth... [2024-08-05 09:57:23,587][00136] Removing /kaggle/working/train_dir/default_experiment/checkpoint_p0/checkpoint_000000446_3653632.pth [2024-08-05 09:57:28,355][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4970.7). Total num frames: 4866048. Throughput: 0: 1231.8. Samples: 1218392. Policy #0 lag: (min: 0.0, avg: 1.9, max: 5.0) [2024-08-05 09:57:28,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:57:33,356][00034] Fps is (10 sec: 4096.0, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 4882432. Throughput: 0: 1235.6. Samples: 1226008. Policy #0 lag: (min: 0.0, avg: 2.0, max: 4.0) [2024-08-05 09:57:33,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:57:35,253][00158] Large shaping reward 2.605 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5730000000000001, 191.0), ('weapon7', 0.002)] [2024-08-05 09:57:38,355][00034] Fps is (10 sec: 4096.0, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 4907008. Throughput: 0: 1237.9. Samples: 1229720. Policy #0 lag: (min: 0.0, avg: 2.0, max: 5.0) [2024-08-05 09:57:38,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:57:38,697][00157] Updated weights for policy 0, policy_version 600 (0.0019) [2024-08-05 09:57:43,356][00034] Fps is (10 sec: 5734.4, 60 sec: 5051.7, 300 sec: 4943.0). Total num frames: 4939776. Throughput: 0: 1248.0. Samples: 1237400. Policy #0 lag: (min: 0.0, avg: 2.0, max: 5.0) [2024-08-05 09:57:43,358][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:57:47,931][00171] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 09:57:48,281][00171] Large shaping reward 2.640 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-05 09:57:48,356][00034] Fps is (10 sec: 5734.2, 60 sec: 5051.7, 300 sec: 4943.0). Total num frames: 4964352. Throughput: 0: 1247.1. Samples: 1244968. Policy #0 lag: (min: 0.0, avg: 1.9, max: 5.0) [2024-08-05 09:57:48,358][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:57:53,355][00034] Fps is (10 sec: 4915.3, 60 sec: 5051.7, 300 sec: 4943.0). Total num frames: 4988928. Throughput: 0: 1249.2. Samples: 1248792. Policy #0 lag: (min: 0.0, avg: 2.1, max: 5.0) [2024-08-05 09:57:53,360][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:57:55,123][00157] Updated weights for policy 0, policy_version 610 (0.0020) [2024-08-05 09:57:58,355][00034] Fps is (10 sec: 4915.4, 60 sec: 5051.7, 300 sec: 4943.0). Total num frames: 5013504. Throughput: 0: 1232.7. Samples: 1255728. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 09:57:58,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:58:03,356][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4943.0). Total num frames: 5038080. Throughput: 0: 1233.4. Samples: 1263320. Policy #0 lag: (min: 0.0, avg: 1.8, max: 4.0) [2024-08-05 09:58:03,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:58:08,357][00034] Fps is (10 sec: 4914.6, 60 sec: 5051.6, 300 sec: 4943.0). Total num frames: 5062656. Throughput: 0: 1235.0. Samples: 1267128. Policy #0 lag: (min: 0.0, avg: 1.8, max: 4.0) [2024-08-05 09:58:08,359][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:58:11,235][00157] Updated weights for policy 0, policy_version 620 (0.0019) [2024-08-05 09:58:13,356][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4943.0). Total num frames: 5087232. Throughput: 0: 1252.8. Samples: 1274768. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 09:58:13,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:58:18,060][00159] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 09:58:18,356][00034] Fps is (10 sec: 4915.6, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 5111808. Throughput: 0: 1252.1. Samples: 1282352. Policy #0 lag: (min: 0.0, avg: 2.1, max: 5.0) [2024-08-05 09:58:18,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:58:23,356][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 5136384. Throughput: 0: 1253.9. Samples: 1286144. Policy #0 lag: (min: 0.0, avg: 1.7, max: 5.0) [2024-08-05 09:58:23,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:58:28,101][00157] Updated weights for policy 0, policy_version 630 (0.0020) [2024-08-05 09:58:28,363][00034] Fps is (10 sec: 4911.8, 60 sec: 4914.6, 300 sec: 4942.8). Total num frames: 5160960. Throughput: 0: 1250.5. Samples: 1293680. Policy #0 lag: (min: 0.0, avg: 1.7, max: 5.0) [2024-08-05 09:58:28,365][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:58:33,355][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4943.0). Total num frames: 5185536. Throughput: 0: 1238.2. Samples: 1300688. Policy #0 lag: (min: 0.0, avg: 2.1, max: 4.0) [2024-08-05 09:58:33,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:58:38,355][00034] Fps is (10 sec: 4918.7, 60 sec: 5051.7, 300 sec: 4943.0). Total num frames: 5210112. Throughput: 0: 1235.2. Samples: 1304376. Policy #0 lag: (min: 0.0, avg: 2.1, max: 5.0) [2024-08-05 09:58:38,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:58:43,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 5234688. Throughput: 0: 1250.1. Samples: 1311984. Policy #0 lag: (min: 0.0, avg: 1.9, max: 4.0) [2024-08-05 09:58:43,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:58:44,872][00157] Updated weights for policy 0, policy_version 640 (0.0028) [2024-08-05 09:58:48,355][00034] Fps is (10 sec: 5734.5, 60 sec: 5051.8, 300 sec: 4970.7). Total num frames: 5267456. Throughput: 0: 1248.9. Samples: 1319520. Policy #0 lag: (min: 0.0, avg: 2.2, max: 4.0) [2024-08-05 09:58:48,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:58:53,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 5283840. Throughput: 0: 1248.9. Samples: 1323328. Policy #0 lag: (min: 0.0, avg: 1.9, max: 4.0) [2024-08-05 09:58:53,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:58:58,357][00034] Fps is (10 sec: 4095.5, 60 sec: 4915.1, 300 sec: 4943.0). Total num frames: 5308416. Throughput: 0: 1247.1. Samples: 1330888. Policy #0 lag: (min: 0.0, avg: 2.0, max: 4.0) [2024-08-05 09:58:58,359][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:59:01,104][00157] Updated weights for policy 0, policy_version 650 (0.0019) [2024-08-05 09:59:03,356][00034] Fps is (10 sec: 4915.1, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 5332992. Throughput: 0: 1235.6. Samples: 1337952. Policy #0 lag: (min: 0.0, avg: 2.4, max: 6.0) [2024-08-05 09:59:03,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:59:08,356][00034] Fps is (10 sec: 4915.7, 60 sec: 4915.3, 300 sec: 4943.0). Total num frames: 5357568. Throughput: 0: 1234.5. Samples: 1341696. Policy #0 lag: (min: 0.0, avg: 2.2, max: 4.0) [2024-08-05 09:59:08,358][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:59:13,356][00034] Fps is (10 sec: 4915.3, 60 sec: 4915.2, 300 sec: 4943.1). Total num frames: 5382144. Throughput: 0: 1235.9. Samples: 1349288. Policy #0 lag: (min: 0.0, avg: 2.3, max: 4.0) [2024-08-05 09:59:13,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:59:17,234][00157] Updated weights for policy 0, policy_version 660 (0.0019) [2024-08-05 09:59:18,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 5406720. Throughput: 0: 1247.3. Samples: 1356816. Policy #0 lag: (min: 0.0, avg: 2.4, max: 5.0) [2024-08-05 09:59:18,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:59:23,356][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 5431296. Throughput: 0: 1249.2. Samples: 1360592. Policy #0 lag: (min: 0.0, avg: 1.6, max: 4.0) [2024-08-05 09:59:23,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:59:23,366][00136] Saving /kaggle/working/train_dir/default_experiment/checkpoint_p0/checkpoint_000000663_5431296.pth... [2024-08-05 09:59:23,551][00136] Removing /kaggle/working/train_dir/default_experiment/checkpoint_p0/checkpoint_000000518_4243456.pth [2024-08-05 09:59:28,355][00034] Fps is (10 sec: 5734.4, 60 sec: 5052.3, 300 sec: 4998.5). Total num frames: 5464064. Throughput: 0: 1247.3. Samples: 1368112. Policy #0 lag: (min: 0.0, avg: 1.5, max: 4.0) [2024-08-05 09:59:28,358][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:59:33,356][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 5480448. Throughput: 0: 1240.9. Samples: 1375360. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 09:59:33,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:59:33,886][00157] Updated weights for policy 0, policy_version 670 (0.0020) [2024-08-05 09:59:38,356][00034] Fps is (10 sec: 4096.0, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 5505024. Throughput: 0: 1234.3. Samples: 1378872. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 09:59:38,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:59:43,356][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 5529600. Throughput: 0: 1234.3. Samples: 1386432. Policy #0 lag: (min: 0.0, avg: 1.8, max: 4.0) [2024-08-05 09:59:43,358][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:59:48,356][00034] Fps is (10 sec: 5734.2, 60 sec: 4915.2, 300 sec: 4998.5). Total num frames: 5562368. Throughput: 0: 1244.3. Samples: 1393944. Policy #0 lag: (min: 0.0, avg: 1.8, max: 5.0) [2024-08-05 09:59:48,358][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:59:50,237][00157] Updated weights for policy 0, policy_version 680 (0.0020) [2024-08-05 09:59:53,356][00034] Fps is (10 sec: 5734.4, 60 sec: 5051.7, 300 sec: 4998.5). Total num frames: 5586944. Throughput: 0: 1245.7. Samples: 1397752. Policy #0 lag: (min: 0.0, avg: 1.8, max: 5.0) [2024-08-05 09:59:53,358][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:59:58,355][00034] Fps is (10 sec: 4096.1, 60 sec: 4915.3, 300 sec: 4943.0). Total num frames: 5603328. Throughput: 0: 1245.3. Samples: 1405328. Policy #0 lag: (min: 0.0, avg: 2.1, max: 4.0) [2024-08-05 09:59:58,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 09:59:59,252][00166] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2024-08-05 10:00:03,355][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.8, 300 sec: 4970.7). Total num frames: 5636096. Throughput: 0: 1247.1. Samples: 1412936. Policy #0 lag: (min: 0.0, avg: 2.2, max: 4.0) [2024-08-05 10:00:03,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 10:00:06,727][00157] Updated weights for policy 0, policy_version 690 (0.0019) [2024-08-05 10:00:08,356][00034] Fps is (10 sec: 5734.4, 60 sec: 5051.7, 300 sec: 4970.7). Total num frames: 5660672. Throughput: 0: 1234.8. Samples: 1416160. Policy #0 lag: (min: 0.0, avg: 1.4, max: 4.0) [2024-08-05 10:00:08,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 10:00:12,961][00156] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2024-08-05 10:00:13,356][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4998.5). Total num frames: 5685248. Throughput: 0: 1235.9. Samples: 1423728. Policy #0 lag: (min: 0.0, avg: 1.7, max: 5.0) [2024-08-05 10:00:13,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 10:00:18,355][00034] Fps is (10 sec: 4096.0, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 5701632. Throughput: 0: 1240.9. Samples: 1431200. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 10:00:18,358][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 10:00:23,149][00157] Updated weights for policy 0, policy_version 700 (0.0020) [2024-08-05 10:00:23,355][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4970.7). Total num frames: 5734400. Throughput: 0: 1244.1. Samples: 1434856. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 10:00:23,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 10:00:28,355][00034] Fps is (10 sec: 5734.4, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 5758976. Throughput: 0: 1243.4. Samples: 1442384. Policy #0 lag: (min: 0.0, avg: 1.9, max: 5.0) [2024-08-05 10:00:28,360][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 10:00:33,355][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4970.7). Total num frames: 5783552. Throughput: 0: 1245.5. Samples: 1449992. Policy #0 lag: (min: 0.0, avg: 1.9, max: 5.0) [2024-08-05 10:00:33,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 10:00:38,355][00034] Fps is (10 sec: 4096.0, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 5799936. Throughput: 0: 1243.9. Samples: 1453728. Policy #0 lag: (min: 0.0, avg: 2.0, max: 4.0) [2024-08-05 10:00:38,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 10:00:39,685][00157] Updated weights for policy 0, policy_version 710 (0.0032) [2024-08-05 10:00:43,356][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4998.5). Total num frames: 5832704. Throughput: 0: 1231.6. Samples: 1460752. Policy #0 lag: (min: 0.0, avg: 2.0, max: 4.0) [2024-08-05 10:00:43,358][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 10:00:48,355][00034] Fps is (10 sec: 5734.4, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 5857280. Throughput: 0: 1228.6. Samples: 1468224. Policy #0 lag: (min: 0.0, avg: 1.6, max: 5.0) [2024-08-05 10:00:48,357][00034] Avg episode reward: [(0, '-4.760')] [2024-08-05 10:00:50,201][00169] DAMAGECOUNT value on done: 485.0 [2024-08-05 10:00:50,204][00169] Sum rewards: -4.384, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.020', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.024', 'weapon5': '0.048', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.134', 'WEAPON4': '0.250', 'weapon4': '0.296', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.765', 'weapon3': '1.270', 'weapon2': '1.458'} [2024-08-05 10:00:51,731][00170] DAMAGECOUNT value on done: 607.0 [2024-08-05 10:00:51,733][00170] Sum rewards: 2.609, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.132', 'AMMO2': '0.006', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'ARMOR': '0.038', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.108', 'weapon4': '0.204', 'WEAPON5': '0.250', 'HITCOUNT': '0.290', 'WEAPON3': '0.300', 'weapon3': '1.248', 'weapon2': '1.314', 'DAMAGECOUNT': '1.326', 'FRAGCOUNT': '2.000'} [2024-08-05 10:00:53,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 5881856. Throughput: 0: 1240.5. Samples: 1471984. Policy #0 lag: (min: 0.0, avg: 1.8, max: 4.0) [2024-08-05 10:00:53,357][00034] Avg episode reward: [(0, '-4.742')] [2024-08-05 10:00:55,220][00168] DAMAGECOUNT value on done: 263.0 [2024-08-05 10:00:55,221][00159] DAMAGECOUNT value on done: 576.0 [2024-08-05 10:00:55,226][00159] Sum rewards: -6.632, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.702', 'weapon7': '0.004', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'weapon5': '0.020', 'AMMO2': '0.022', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'weapon4': '0.186', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'ARMOR': '0.424', 'DAMAGECOUNT': '0.831', 'WEAPON3': '0.900', 'weapon2': '1.348', 'weapon3': '1.386', 'FRAGCOUNT': '2.000'} [2024-08-05 10:00:56,320][00157] Updated weights for policy 0, policy_version 720 (0.0019) [2024-08-05 10:00:57,079][00169] DAMAGECOUNT value on done: 403.0 [2024-08-05 10:00:57,081][00169] Sum rewards: -9.586, reward structure: {'DEATHCOUNT': '-12.000', 'FRAGCOUNT': '-2.000', 'HEALTH': '-0.674', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.025', 'HITCOUNT': '0.090', 'weapon5': '0.096', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.110', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'weapon4': '0.170', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.357', 'WEAPON3': '0.500', 'weapon3': '1.154', 'weapon2': '1.728'} [2024-08-05 10:00:57,635][00162] DAMAGECOUNT value on done: 210.0 [2024-08-05 10:00:57,639][00162] Sum rewards: -5.424, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.015', 'FRAGCOUNT': '-0.500', 'WEAPON1': '0.020', 'ARMOR': '0.020', 'AMMO2': '0.022', 'AMMO5': '0.023', 'HITCOUNT': '0.090', 'AMMO3': '0.091', 'AMMO4': '0.109', 'weapon5': '0.174', 'WEAPON5': '0.450', 'DAMAGECOUNT': '0.498', 'WEAPON3': '0.600', 'weapon2': '1.388', 'weapon3': '1.606'} [2024-08-05 10:00:58,251][00172] DAMAGECOUNT value on done: 844.0 [2024-08-05 10:00:58,253][00172] Sum rewards: 2.565, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.759', 'AMMO5': '0.007', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.074', 'AMMO3': '0.084', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.380', 'weapon4': '0.404', 'WEAPON3': '0.500', 'weapon2': '0.922', 'weapon3': '1.534', 'DAMAGECOUNT': '1.722', 'FRAGCOUNT': '4.000'} [2024-08-05 10:00:58,355][00034] Fps is (10 sec: 4096.0, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 5898240. Throughput: 0: 1239.6. Samples: 1479512. Policy #0 lag: (min: 0.0, avg: 2.0, max: 5.0) [2024-08-05 10:00:58,357][00034] Avg episode reward: [(0, '-4.821')] [2024-08-05 10:00:58,592][00170] DAMAGECOUNT value on done: 574.0 [2024-08-05 10:00:58,600][00170] Sum rewards: -5.344, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.480', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.036', 'weapon5': '0.038', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'HITCOUNT': '0.190', 'DAMAGECOUNT': '0.729', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.084', 'weapon3': '2.064'} [2024-08-05 10:01:01,365][00159] DAMAGECOUNT value on done: 227.0 [2024-08-05 10:01:01,461][00168] DAMAGECOUNT value on done: 320.0 [2024-08-05 10:01:01,463][00168] Sum rewards: -3.479, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.450', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.026', 'weapon5': '0.060', 'AMMO3': '0.142', 'HITCOUNT': '0.160', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.478', 'weapon3': '1.742'} [2024-08-05 10:01:03,056][00169] DAMAGECOUNT value on done: 439.0 [2024-08-05 10:01:03,356][00034] Fps is (10 sec: 4915.1, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 5931008. Throughput: 0: 1242.7. Samples: 1487120. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 10:01:03,357][00034] Avg episode reward: [(0, '-4.735')] [2024-08-05 10:01:03,520][00164] DAMAGECOUNT value on done: 224.0 [2024-08-05 10:01:03,521][00164] Sum rewards: -4.310, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.878', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.012', 'AMMO5': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.061', 'weapon4': '0.068', 'weapon5': '0.092', 'HITCOUNT': '0.100', 'AMMO3': '0.110', 'WEAPON5': '0.300', 'ARMOR': '0.440', 'DAMAGECOUNT': '0.612', 'WEAPON3': '0.650', 'weapon3': '1.210', 'weapon2': '1.598'} [2024-08-05 10:01:03,601][00160] DAMAGECOUNT value on done: 665.0 [2024-08-05 10:01:03,602][00160] Sum rewards: -2.571, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.140', 'AMMO5': '0.009', 'ARMOR': '0.020', 'AMMO2': '0.026', 'weapon5': '0.040', 'weapon7': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.125', 'weapon4': '0.126', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.210', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.056', 'weapon2': '1.120', 'weapon3': '1.766', 'FRAGCOUNT': '3.000'} [2024-08-05 10:01:03,709][00162] DAMAGECOUNT value on done: 337.0 [2024-08-05 10:01:04,306][00172] DAMAGECOUNT value on done: 210.0 [2024-08-05 10:01:04,850][00170] DAMAGECOUNT value on done: 309.0 [2024-08-05 10:01:04,851][00170] Sum rewards: -1.579, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.102', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO3': '0.087', 'weapon4': '0.088', 'weapon7': '0.088', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'weapon5': '0.106', 'HITCOUNT': '0.110', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.462', 'weapon3': '0.826', 'FRAGCOUNT': '1.000', 'weapon2': '1.638'} [2024-08-05 10:01:07,593][00168] DAMAGECOUNT value on done: 256.0 [2024-08-05 10:01:07,595][00168] Sum rewards: -6.165, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.502', 'AMMO5': '0.007', 'weapon4': '0.010', 'AMMO2': '0.023', 'ARMOR': '0.028', 'WEAPON1': '0.050', 'weapon5': '0.078', 'WEAPON4': '0.100', 'HITCOUNT': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.306', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.378', 'weapon2': '1.594'} [2024-08-05 10:01:07,610][00165] DAMAGECOUNT value on done: 512.0 [2024-08-05 10:01:07,613][00165] Sum rewards: -3.099, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.003', 'ARMOR': '0.032', 'AMMO2': '0.033', 'weapon7': '0.066', 'AMMO3': '0.080', 'HEALTH': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.140', 'AMMO4': '0.163', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.372', 'weapon4': '0.396', 'WEAPON3': '0.400', 'weapon3': '0.920', 'FRAGCOUNT': '1.000', 'weapon2': '1.648'} [2024-08-05 10:01:07,846][00166] DAMAGECOUNT value on done: 717.0 [2024-08-05 10:01:07,851][00166] Sum rewards: 0.843, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.673', 'AMMO2': '0.003', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO4': '0.016', 'WEAPON1': '0.020', 'weapon4': '0.052', 'weapon5': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.133', 'HITCOUNT': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'weapon2': '1.342', 'weapon3': '1.490', 'DAMAGECOUNT': '1.521', 'FRAGCOUNT': '3.000'} [2024-08-05 10:01:08,356][00034] Fps is (10 sec: 5734.4, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 5955584. Throughput: 0: 1244.4. Samples: 1490856. Policy #0 lag: (min: 0.0, avg: 2.0, max: 5.0) [2024-08-05 10:01:08,357][00034] Avg episode reward: [(0, '-4.615')] [2024-08-05 10:01:08,507][00159] DAMAGECOUNT value on done: 390.0 [2024-08-05 10:01:08,515][00159] Sum rewards: -5.653, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.578', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.005', 'AMMO5': '0.009', 'AMMO4': '0.023', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.100', 'weapon7': '0.112', 'AMMO3': '0.129', 'HITCOUNT': '0.180', 'WEAPON5': '0.200', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.819', 'weapon3': '1.108', 'weapon2': '1.790'} [2024-08-05 10:01:10,149][00164] DAMAGECOUNT value on done: 307.0 [2024-08-05 10:01:10,149][00164] Sum rewards: -8.279, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.880', 'FRAGCOUNT': '-0.500', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.018', 'ARMOR': '0.040', 'weapon5': '0.088', 'AMMO4': '0.090', 'weapon4': '0.156', 'HITCOUNT': '0.160', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.950', 'weapon2': '1.148', 'weapon3': '1.576'} [2024-08-05 10:01:10,319][00160] DAMAGECOUNT value on done: 349.0 [2024-08-05 10:01:10,319][00160] Sum rewards: -1.001, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.058', 'AMMO2': '0.005', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.025', 'AMMO3': '0.105', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'weapon5': '0.182', 'WEAPON5': '0.200', 'weapon4': '0.282', 'ARMOR': '0.452', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.732', 'FRAGCOUNT': '1.000', 'weapon3': '1.080', 'weapon2': '1.186'} [2024-08-05 10:01:10,489][00169] DAMAGECOUNT value on done: 177.0 [2024-08-05 10:01:11,035][00172] DAMAGECOUNT value on done: 521.0 [2024-08-05 10:01:11,039][00172] Sum rewards: -5.685, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.328', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.024', 'ARMOR': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.127', 'weapon4': '0.194', 'WEAPON4': '0.200', 'HITCOUNT': '0.220', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.810', 'weapon3': '1.504', 'weapon2': '1.546', 'FRAGCOUNT': '2.000'} [2024-08-05 10:01:11,204][00162] DAMAGECOUNT value on done: 495.0 [2024-08-05 10:01:12,189][00170] DAMAGECOUNT value on done: 355.0 [2024-08-05 10:01:12,191][00170] Sum rewards: 0.895, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.548', 'weapon5': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.082', 'AMMO4': '0.129', 'AMMO3': '0.131', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.220', 'ARMOR': '0.526', 'DAMAGECOUNT': '0.735', 'WEAPON3': '0.750', 'weapon3': '1.478', 'weapon2': '1.544', 'FRAGCOUNT': '3.000'} [2024-08-05 10:01:12,785][00163] DAMAGECOUNT value on done: 537.0 [2024-08-05 10:01:12,787][00163] Sum rewards: -2.462, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.334', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'weapon5': '0.068', 'AMMO4': '0.093', 'AMMO3': '0.110', 'WEAPON5': '0.200', 'HITCOUNT': '0.240', 'WEAPON4': '0.250', 'weapon4': '0.294', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.005', 'weapon2': '1.228', 'weapon3': '1.344', 'FRAGCOUNT': '3.000'} [2024-08-05 10:01:13,175][00157] Updated weights for policy 0, policy_version 730 (0.0028) [2024-08-05 10:01:13,356][00034] Fps is (10 sec: 4915.3, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 5980160. Throughput: 0: 1229.3. Samples: 1497704. Policy #0 lag: (min: 0.0, avg: 1.9, max: 4.0) [2024-08-05 10:01:13,357][00034] Avg episode reward: [(0, '-4.602')] [2024-08-05 10:01:13,692][00167] DAMAGECOUNT value on done: 311.0 [2024-08-05 10:01:13,694][00167] Sum rewards: -4.565, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.100', 'AMMO2': '0.005', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.024', 'HITCOUNT': '0.120', 'AMMO3': '0.155', 'weapon5': '0.164', 'WEAPON5': '0.200', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.843', 'weapon3': '1.272', 'weapon2': '1.620'} [2024-08-05 10:01:14,215][00161] DAMAGECOUNT value on done: 644.0 [2024-08-05 10:01:14,221][00161] Sum rewards: 5.399, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.131', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'AMMO3': '0.095', 'weapon5': '0.100', 'weapon4': '0.130', 'AMMO4': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.300', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.326', 'weapon2': '1.422', 'weapon3': '1.480', 'FRAGCOUNT': '7.000'} [2024-08-05 10:01:14,301][00168] DAMAGECOUNT value on done: 399.0 [2024-08-05 10:01:14,826][00165] DAMAGECOUNT value on done: 446.0 [2024-08-05 10:01:15,268][00159] DAMAGECOUNT value on done: 177.0 [2024-08-05 10:01:15,501][00166] DAMAGECOUNT value on done: 648.0 [2024-08-05 10:01:15,506][00166] Sum rewards: -0.710, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.572', 'AMMO2': '0.018', 'ARMOR': '0.072', 'AMMO4': '0.091', 'weapon7': '0.096', 'AMMO3': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.246', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.078', 'weapon2': '1.366'} [2024-08-05 10:01:16,507][00164] DAMAGECOUNT value on done: 437.0 [2024-08-05 10:01:16,511][00164] Sum rewards: -5.621, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.656', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.010', 'WEAPON1': '0.020', 'weapon5': '0.032', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.141', 'HITCOUNT': '0.170', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.800', 'weapon3': '1.394', 'weapon2': '1.722', 'FRAGCOUNT': '4.000'} [2024-08-05 10:01:16,663][00160] DAMAGECOUNT value on done: 169.0 [2024-08-05 10:01:17,056][00169] DAMAGECOUNT value on done: 418.0 [2024-08-05 10:01:17,061][00169] Sum rewards: -4.381, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.950', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.076', 'AMMO4': '0.125', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'weapon4': '0.186', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.744', 'WEAPON3': '0.850', 'weapon2': '1.448', 'weapon3': '1.448'} [2024-08-05 10:01:17,341][00172] DAMAGECOUNT value on done: 265.0 [2024-08-05 10:01:17,343][00172] Sum rewards: -10.469, reward structure: {'DEATHCOUNT': '-13.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.147', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.076', 'weapon5': '0.076', 'weapon4': '0.092', 'AMMO3': '0.108', 'HITCOUNT': '0.120', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.351', 'WEAPON3': '0.500', 'weapon3': '0.834', 'weapon2': '2.236'} [2024-08-05 10:01:17,763][00162] DAMAGECOUNT value on done: 323.0 [2024-08-05 10:01:17,764][00162] Sum rewards: -1.249, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.040', 'AMMO5': '0.008', 'AMMO2': '0.029', 'ARMOR': '0.040', 'weapon5': '0.044', 'AMMO3': '0.063', 'HITCOUNT': '0.100', 'AMMO4': '0.144', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.300', 'weapon4': '0.302', 'DAMAGECOUNT': '0.354', 'weapon3': '0.954', 'FRAGCOUNT': '1.000', 'weapon2': '1.752'} [2024-08-05 10:01:17,935][00158] DAMAGECOUNT value on done: 341.0 [2024-08-05 10:01:17,938][00158] Sum rewards: -1.971, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'weapon5': '0.068', 'AMMO4': '0.081', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'weapon4': '0.138', 'HITCOUNT': '0.170', 'WEAPON3': '0.450', 'HEALTH': '0.652', 'DAMAGECOUNT': '0.696', 'FRAGCOUNT': '1.000', 'weapon2': '1.172', 'weapon3': '1.568'} [2024-08-05 10:01:18,355][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4998.5). Total num frames: 6004736. Throughput: 0: 1224.5. Samples: 1505096. Policy #0 lag: (min: 0.0, avg: 2.1, max: 4.0) [2024-08-05 10:01:18,357][00034] Avg episode reward: [(0, '-4.434')] [2024-08-05 10:01:18,423][00171] DAMAGECOUNT value on done: 526.0 [2024-08-05 10:01:18,788][00170] DAMAGECOUNT value on done: 569.0 [2024-08-05 10:01:18,789][00170] Sum rewards: -8.157, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.260', 'FRAGCOUNT': '-1.000', 'weapon7': '0.002', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'ARMOR': '0.020', 'AMMO4': '0.059', 'weapon5': '0.064', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.181', 'weapon4': '0.188', 'HITCOUNT': '0.260', 'WEAPON5': '0.300', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.915', 'weapon2': '1.150', 'weapon3': '1.662'} [2024-08-05 10:01:19,076][00163] DAMAGECOUNT value on done: 265.0 [2024-08-05 10:01:19,078][00163] Sum rewards: -1.670, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.825', 'AMMO2': '0.004', 'weapon4': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.020', 'AMMO5': '0.023', 'WEAPON4': '0.050', 'weapon5': '0.060', 'AMMO3': '0.112', 'HITCOUNT': '0.130', 'WEAPON5': '0.400', 'DAMAGECOUNT': '0.450', 'ARMOR': '0.502', 'WEAPON3': '0.700', 'weapon3': '1.582', 'weapon2': '1.606', 'FRAGCOUNT': '2.000'} [2024-08-05 10:01:20,740][00168] DAMAGECOUNT value on done: 783.0 [2024-08-05 10:01:20,744][00168] Sum rewards: 3.416, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.762', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'weapon7': '0.050', 'AMMO3': '0.095', 'ARMOR': '0.101', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO4': '0.175', 'HITCOUNT': '0.190', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.498', 'WEAPON3': '0.550', 'weapon2': '1.130', 'weapon3': '1.262', 'DAMAGECOUNT': '1.410', 'FRAGCOUNT': '3.000'} [2024-08-05 10:01:21,037][00165] DAMAGECOUNT value on done: 469.0 [2024-08-05 10:01:21,041][00165] Sum rewards: -4.328, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.860', 'AMMO2': '0.010', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.048', 'weapon5': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'weapon4': '0.184', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.230', 'DAMAGECOUNT': '0.705', 'WEAPON3': '0.800', 'weapon2': '0.908', 'FRAGCOUNT': '1.000', 'weapon3': '1.892'} [2024-08-05 10:01:21,259][00156] DAMAGECOUNT value on done: 432.0 [2024-08-05 10:01:21,344][00167] DAMAGECOUNT value on done: 323.0 [2024-08-05 10:01:21,347][00167] Sum rewards: -3.637, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.998', 'AMMO2': '0.010', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.049', 'ARMOR': '0.096', 'AMMO3': '0.104', 'weapon5': '0.136', 'HITCOUNT': '0.140', 'WEAPON4': '0.200', 'weapon4': '0.206', 'WEAPON5': '0.400', 'DAMAGECOUNT': '0.459', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.206', 'weapon2': '1.670'} [2024-08-05 10:01:21,617][00159] DAMAGECOUNT value on done: 188.0 [2024-08-05 10:01:21,622][00159] Sum rewards: -7.040, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-3.000', 'HEALTH': '-0.300', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'ARMOR': '0.028', 'AMMO2': '0.042', 'AMMO3': '0.050', 'HITCOUNT': '0.070', 'weapon5': '0.152', 'weapon4': '0.166', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.210', 'WEAPON3': '0.250', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.264', 'WEAPON4': '0.350', 'weapon3': '1.278', 'weapon2': '1.528'} [2024-08-05 10:01:21,778][00161] DAMAGECOUNT value on done: 422.0 [2024-08-05 10:01:21,785][00161] Sum rewards: -0.116, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.088', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.025', 'weapon5': '0.034', 'AMMO4': '0.122', 'HITCOUNT': '0.130', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.372', 'DAMAGECOUNT': '0.414', 'WEAPON3': '0.800', 'weapon2': '1.214', 'weapon3': '1.594', 'FRAGCOUNT': '3.000'} [2024-08-05 10:01:22,837][00166] DAMAGECOUNT value on done: 496.0 [2024-08-05 10:01:22,839][00166] Sum rewards: -4.268, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.480', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.032', 'ARMOR': '0.040', 'HITCOUNT': '0.060', 'weapon7': '0.062', 'weapon5': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.124', 'AMMO4': '0.157', 'DAMAGECOUNT': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.428', 'WEAPON3': '0.700', 'weapon2': '0.984', 'FRAGCOUNT': '1.000', 'weapon3': '1.290'} [2024-08-05 10:01:23,299][00169] DAMAGECOUNT value on done: 458.0 [2024-08-05 10:01:23,302][00169] Sum rewards: -6.277, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-3.000', 'HEALTH': '-1.670', 'AMMO5': '0.010', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.069', 'weapon7': '0.094', 'AMMO3': '0.095', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.152', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.506', 'WEAPON3': '0.600', 'weapon3': '0.828', 'DAMAGECOUNT': '0.954', 'weapon2': '1.480'} [2024-08-05 10:01:23,356][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 6029312. Throughput: 0: 1223.1. Samples: 1508768. Policy #0 lag: (min: 0.0, avg: 1.8, max: 5.0) [2024-08-05 10:01:23,357][00034] Avg episode reward: [(0, '-4.265')] [2024-08-05 10:01:23,367][00136] Saving /kaggle/working/train_dir/default_experiment/checkpoint_p0/checkpoint_000000736_6029312.pth... [2024-08-05 10:01:23,451][00164] DAMAGECOUNT value on done: 379.0 [2024-08-05 10:01:23,460][00164] Sum rewards: -0.795, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.115', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.014', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'weapon5': '0.110', 'AMMO3': '0.111', 'weapon4': '0.258', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.372', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.128', 'weapon3': '1.424'} [2024-08-05 10:01:23,566][00136] Removing /kaggle/working/train_dir/default_experiment/checkpoint_p0/checkpoint_000000591_4841472.pth [2024-08-05 10:01:23,568][00160] DAMAGECOUNT value on done: 533.0 [2024-08-05 10:01:23,574][00160] Sum rewards: 0.374, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.898', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.015', 'ARMOR': '0.072', 'AMMO4': '0.072', 'AMMO3': '0.079', 'weapon7': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.134', 'weapon4': '0.140', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'WEAPON5': '0.200', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.624', 'weapon2': '0.708', 'FRAGCOUNT': '1.500', 'weapon3': '1.690'} [2024-08-05 10:01:24,051][00162] DAMAGECOUNT value on done: 254.0 [2024-08-05 10:01:24,059][00162] Sum rewards: -12.433, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.020', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.003', 'AMMO4': '0.012', 'ARMOR': '0.016', 'AMMO5': '0.021', 'HITCOUNT': '0.040', 'WEAPON1': '0.040', 'weapon4': '0.082', 'DAMAGECOUNT': '0.147', 'weapon5': '0.150', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'weapon3': '0.986', 'weapon2': '1.684'} [2024-08-05 10:01:24,394][00172] DAMAGECOUNT value on done: 385.0 [2024-08-05 10:01:24,398][00172] Sum rewards: -4.396, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.516', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.003', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.012', 'weapon5': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'HITCOUNT': '0.170', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.696', 'weapon2': '0.934', 'ARMOR': '0.955', 'weapon3': '1.470'} [2024-08-05 10:01:24,512][00158] DAMAGECOUNT value on done: 322.0 [2024-08-05 10:01:25,081][00170] DAMAGECOUNT value on done: 297.0 [2024-08-05 10:01:25,082][00170] Sum rewards: 0.121, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.648', 'AMMO5': '0.012', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'weapon4': '0.092', 'weapon5': '0.096', 'HITCOUNT': '0.110', 'AMMO3': '0.118', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.700', 'weapon2': '1.330', 'weapon3': '1.424', 'FRAGCOUNT': '2.000'} [2024-08-05 10:01:25,388][00171] DAMAGECOUNT value on done: 419.0 [2024-08-05 10:01:25,389][00171] Sum rewards: -7.010, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.780', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'weapon5': '0.052', 'HITCOUNT': '0.140', 'AMMO3': '0.234', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.642', 'weapon2': '0.978', 'WEAPON3': '1.150', 'weapon3': '1.976', 'FRAGCOUNT': '2.000'} [2024-08-05 10:01:26,190][00163] DAMAGECOUNT value on done: 600.0 [2024-08-05 10:01:26,986][00159] Large shaping reward 2.596 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5640000000000001, 188.0), ('weapon7', 0.002)] [2024-08-05 10:01:27,541][00168] DAMAGECOUNT value on done: 664.0 [2024-08-05 10:01:27,545][00168] Sum rewards: 0.059, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.207', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.017', 'weapon4': '0.078', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'HITCOUNT': '0.140', 'weapon7': '0.148', 'weapon5': '0.150', 'AMMO6': '0.260', 'AMMO7': '0.260', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'weapon2': '1.208', 'DAMAGECOUNT': '1.305', 'weapon3': '1.374', 'FRAGCOUNT': '1.500'} [2024-08-05 10:01:27,550][00156] DAMAGECOUNT value on done: 290.0 [2024-08-05 10:01:27,553][00156] Sum rewards: -0.581, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.080', 'weapon5': '0.006', 'AMMO5': '0.015', 'AMMO2': '0.021', 'ARMOR': '0.032', 'AMMO3': '0.095', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.230', 'weapon4': '0.248', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.705', 'weapon2': '1.090', 'weapon3': '1.652', 'FRAGCOUNT': '2.000'} [2024-08-05 10:01:27,606][00167] DAMAGECOUNT value on done: 700.0 [2024-08-05 10:01:27,611][00167] Sum rewards: -1.087, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.029', 'AMMO2': '0.006', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.031', 'weapon5': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.151', 'weapon4': '0.172', 'WEAPON5': '0.250', 'HITCOUNT': '0.320', 'ARMOR': '0.470', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.209', 'weapon3': '1.448', 'FRAGCOUNT': '1.500', 'weapon2': '1.562'} [2024-08-05 10:01:27,823][00159] DAMAGECOUNT value on done: 447.0 [2024-08-05 10:01:27,825][00159] Sum rewards: -3.426, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.404', 'AMMO2': '0.011', 'AMMO5': '0.032', 'ARMOR': '0.056', 'AMMO4': '0.057', 'weapon5': '0.074', 'HITCOUNT': '0.100', 'AMMO3': '0.123', 'weapon4': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.179', 'weapon3': '1.276', 'weapon2': '1.590'} [2024-08-05 10:01:28,041][00161] DAMAGECOUNT value on done: 602.0 [2024-08-05 10:01:28,042][00161] Sum rewards: -4.634, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.300', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.058', 'weapon5': '0.068', 'weapon4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'HITCOUNT': '0.340', 'WEAPON3': '1.200', 'weapon2': '1.486', 'weapon3': '1.588', 'DAMAGECOUNT': '1.791', 'FRAGCOUNT': '4.000'} [2024-08-05 10:01:28,356][00034] Fps is (10 sec: 4095.8, 60 sec: 4778.6, 300 sec: 4943.0). Total num frames: 6045696. Throughput: 0: 1228.8. Samples: 1516048. Policy #0 lag: (min: 0.0, avg: 2.0, max: 4.0) [2024-08-05 10:01:28,357][00034] Avg episode reward: [(0, '-4.128')] [2024-08-05 10:01:28,360][00136] Saving new best policy, reward=-4.128! [2024-08-05 10:01:28,527][00165] DAMAGECOUNT value on done: 398.0 [2024-08-05 10:01:28,527][00165] Sum rewards: -1.858, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.826', 'AMMO5': '0.020', 'AMMO2': '0.024', 'ARMOR': '0.028', 'weapon5': '0.084', 'AMMO3': '0.093', 'AMMO4': '0.120', 'HITCOUNT': '0.170', 'WEAPON4': '0.350', 'weapon4': '0.410', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.699', 'FRAGCOUNT': '1.000', 'weapon2': '1.098', 'weapon3': '1.322'} [2024-08-05 10:01:29,132][00166] DAMAGECOUNT value on done: 902.0 [2024-08-05 10:01:29,138][00166] Sum rewards: 2.041, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.236', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.029', 'WEAPON5': '0.050', 'weapon7': '0.074', 'weapon5': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.126', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'WEAPON7': '0.200', 'weapon4': '0.386', 'WEAPON3': '0.550', 'weapon2': '1.184', 'weapon3': '1.302', 'DAMAGECOUNT': '1.461', 'FRAGCOUNT': '3.000'} [2024-08-05 10:01:29,574][00169] DAMAGECOUNT value on done: 451.0 [2024-08-05 10:01:29,577][00169] Sum rewards: -3.801, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.929', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon4': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.141', 'AMMO3': '0.146', 'weapon5': '0.146', 'WEAPON4': '0.200', 'HITCOUNT': '0.230', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.933', 'weapon2': '1.140', 'weapon3': '1.596', 'FRAGCOUNT': '3.000'} [2024-08-05 10:01:29,658][00164] DAMAGECOUNT value on done: 315.0 [2024-08-05 10:01:29,661][00164] Sum rewards: -4.716, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.565', 'AMMO2': '0.005', 'AMMO5': '0.020', 'AMMO4': '0.023', 'weapon5': '0.090', 'AMMO3': '0.093', 'HITCOUNT': '0.110', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.390', 'ARMOR': '0.420', 'WEAPON3': '0.450', 'weapon2': '1.470', 'weapon3': '1.478'} [2024-08-05 10:01:29,804][00160] DAMAGECOUNT value on done: 260.0 [2024-08-05 10:01:29,810][00160] Sum rewards: -3.799, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.652', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.058', 'AMMO4': '0.071', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'ARMOR': '0.124', 'HITCOUNT': '0.140', 'WEAPON3': '0.350', 'weapon4': '0.466', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.540', 'weapon2': '1.176', 'weapon3': '1.376'} [2024-08-05 10:01:29,990][00157] Updated weights for policy 0, policy_version 740 (0.0020) [2024-08-05 10:01:30,414][00162] DAMAGECOUNT value on done: 378.0 [2024-08-05 10:01:30,418][00162] Sum rewards: 1.077, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.855', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.048', 'weapon5': '0.048', 'HITCOUNT': '0.090', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.308', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.500', 'ARMOR': '0.556', 'weapon2': '0.970', 'FRAGCOUNT': '1.000', 'weapon3': '1.438'} [2024-08-05 10:01:30,719][00172] DAMAGECOUNT value on done: 402.0 [2024-08-05 10:01:30,725][00172] Sum rewards: -6.116, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.407', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.026', 'ARMOR': '0.032', 'weapon5': '0.048', 'HITCOUNT': '0.070', 'weapon4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'DAMAGECOUNT': '0.207', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.426', 'weapon2': '1.564'} [2024-08-05 10:01:31,412][00170] DAMAGECOUNT value on done: 238.0 [2024-08-05 10:01:31,416][00170] Sum rewards: -6.954, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.300', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'weapon5': '0.038', 'HITCOUNT': '0.080', 'AMMO3': '0.111', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.207', 'WEAPON4': '0.350', 'weapon4': '0.378', 'WEAPON3': '0.500', 'weapon3': '0.958', 'weapon2': '1.606'} [2024-08-05 10:01:32,792][00158] DAMAGECOUNT value on done: 360.0 [2024-08-05 10:01:33,356][00034] Fps is (10 sec: 4096.0, 60 sec: 4778.7, 300 sec: 4943.0). Total num frames: 6070272. Throughput: 0: 1228.6. Samples: 1523512. Policy #0 lag: (min: 0.0, avg: 1.9, max: 5.0) [2024-08-05 10:01:33,358][00034] Avg episode reward: [(0, '-4.063')] [2024-08-05 10:01:33,365][00136] Saving new best policy, reward=-4.063! [2024-08-05 10:01:33,505][00171] DAMAGECOUNT value on done: 538.0 [2024-08-05 10:01:33,506][00171] Sum rewards: 1.028, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.734', 'AMMO5': '0.007', 'ARMOR': '0.028', 'AMMO2': '0.034', 'WEAPON1': '0.040', 'weapon7': '0.084', 'weapon5': '0.088', 'AMMO3': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.170', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.210', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.915', 'weapon2': '1.102', 'weapon3': '1.416', 'FRAGCOUNT': '2.000'} [2024-08-05 10:01:33,691][00168] DAMAGECOUNT value on done: 457.0 [2024-08-05 10:01:33,695][00168] Sum rewards: -5.725, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.490', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.072', 'ARMOR': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.146', 'weapon4': '0.156', 'HITCOUNT': '0.220', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.633', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.036', 'weapon3': '1.826'} [2024-08-05 10:01:33,821][00156] DAMAGECOUNT value on done: 362.0 [2024-08-05 10:01:34,021][00167] DAMAGECOUNT value on done: 445.0 [2024-08-05 10:01:34,024][00167] Sum rewards: -5.468, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.122', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.018', 'weapon5': '0.148', 'AMMO3': '0.171', 'HITCOUNT': '0.200', 'WEAPON5': '0.400', 'DAMAGECOUNT': '0.675', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon3': '1.264', 'weapon2': '1.618'} [2024-08-05 10:01:34,121][00159] DAMAGECOUNT value on done: 670.0 [2024-08-05 10:01:34,125][00159] Sum rewards: -5.062, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.076', 'AMMO2': '0.009', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.042', 'AMMO4': '0.045', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO3': '0.169', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.735', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.308', 'weapon3': '1.624'} [2024-08-05 10:01:34,163][00163] DAMAGECOUNT value on done: 527.0 [2024-08-05 10:01:34,165][00163] Sum rewards: -0.413, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.572', 'AMMO2': '0.009', 'AMMO5': '0.015', 'AMMO4': '0.042', 'ARMOR': '0.067', 'weapon5': '0.100', 'AMMO3': '0.139', 'weapon4': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.310', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.326', 'weapon2': '1.360', 'weapon3': '1.404', 'FRAGCOUNT': '4.000'} [2024-08-05 10:01:34,394][00161] DAMAGECOUNT value on done: 740.0 [2024-08-05 10:01:34,398][00161] Sum rewards: -1.548, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.578', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'AMMO5': '0.030', 'weapon4': '0.080', 'weapon5': '0.134', 'AMMO4': '0.134', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'HITCOUNT': '0.390', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'weapon2': '1.300', 'FRAGCOUNT': '1.500', 'weapon3': '1.676', 'DAMAGECOUNT': '1.845'} [2024-08-05 10:01:35,641][00166] DAMAGECOUNT value on done: 270.0 [2024-08-05 10:01:35,645][00166] Sum rewards: -3.753, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.672', 'AMMO5': '0.017', 'AMMO2': '0.024', 'weapon7': '0.026', 'ARMOR': '0.040', 'HITCOUNT': '0.090', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.112', 'AMMO4': '0.120', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'weapon4': '0.194', 'DAMAGECOUNT': '0.210', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.268', 'weapon3': '1.392'} [2024-08-05 10:01:35,794][00169] DAMAGECOUNT value on done: 285.0 [2024-08-05 10:01:35,794][00169] Sum rewards: -2.303, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.444', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'weapon5': '0.076', 'AMMO3': '0.079', 'HITCOUNT': '0.140', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.344', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.585', 'FRAGCOUNT': '1.000', 'weapon3': '1.156', 'weapon2': '1.350'} [2024-08-05 10:01:36,000][00165] DAMAGECOUNT value on done: 176.0 [2024-08-05 10:01:36,001][00165] Sum rewards: -5.275, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.080', 'AMMO2': '0.001', 'AMMO4': '0.006', 'weapon5': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.072', 'WEAPON5': '0.100', 'ARMOR': '0.112', 'AMMO3': '0.147', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.453', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.400', 'weapon3': '1.846'} [2024-08-05 10:01:36,380][00164] DAMAGECOUNT value on done: 396.0 [2024-08-05 10:01:36,381][00164] Sum rewards: -5.586, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.250', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'ARMOR': '0.044', 'AMMO3': '0.154', 'HITCOUNT': '0.170', 'WEAPON5': '0.200', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.834', 'weapon2': '1.246', 'weapon3': '1.752', 'FRAGCOUNT': '2.000'} [2024-08-05 10:01:36,553][00160] DAMAGECOUNT value on done: 689.0 [2024-08-05 10:01:36,554][00160] Sum rewards: -2.905, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.554', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.018', 'weapon7': '0.058', 'weapon4': '0.066', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.137', 'HITCOUNT': '0.190', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.800', 'weapon2': '0.922', 'DAMAGECOUNT': '1.107', 'weapon3': '1.884'} [2024-08-05 10:01:36,615][00162] DAMAGECOUNT value on done: 470.0 [2024-08-05 10:01:36,621][00162] Sum rewards: -1.534, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.786', 'AMMO5': '0.018', 'AMMO2': '0.024', 'AMMO3': '0.111', 'weapon5': '0.116', 'AMMO4': '0.117', 'weapon4': '0.132', 'HITCOUNT': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.993', 'weapon2': '1.140', 'FRAGCOUNT': '1.500', 'weapon3': '1.670'} [2024-08-05 10:01:37,599][00170] DAMAGECOUNT value on done: 329.0 [2024-08-05 10:01:37,602][00170] Sum rewards: -1.747, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.680', 'AMMO4': '-0.072', 'AMMO2': '-0.014', 'ARMOR': '0.012', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'weapon7': '0.054', 'weapon5': '0.058', 'AMMO3': '0.108', 'HITCOUNT': '0.120', 'WEAPON5': '0.250', 'AMMO6': '0.360', 'AMMO7': '0.360', 'WEAPON7': '0.400', 'DAMAGECOUNT': '0.597', 'WEAPON3': '0.650', 'weapon3': '1.062', 'weapon2': '1.700', 'FRAGCOUNT': '4.000'} [2024-08-05 10:01:37,950][00172] DAMAGECOUNT value on done: 205.0 [2024-08-05 10:01:37,950][00172] Sum rewards: -3.683, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.795', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'ARMOR': '0.028', 'AMMO2': '0.028', 'weapon5': '0.088', 'HITCOUNT': '0.100', 'weapon4': '0.136', 'AMMO4': '0.141', 'AMMO3': '0.145', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.273', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.356', 'weapon3': '1.542'} [2024-08-05 10:01:38,356][00034] Fps is (10 sec: 5734.5, 60 sec: 5051.7, 300 sec: 4970.7). Total num frames: 6103040. Throughput: 0: 1224.5. Samples: 1527088. Policy #0 lag: (min: 0.0, avg: 2.3, max: 5.0) [2024-08-05 10:01:38,360][00034] Avg episode reward: [(0, '-3.729')] [2024-08-05 10:01:38,362][00136] Saving new best policy, reward=-3.729! [2024-08-05 10:01:39,180][00158] DAMAGECOUNT value on done: 819.0 [2024-08-05 10:01:39,181][00158] Sum rewards: -5.110, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.865', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'ARMOR': '0.012', 'AMMO2': '0.030', 'weapon5': '0.048', 'AMMO4': '0.148', 'AMMO3': '0.169', 'HITCOUNT': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.412', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.650', 'weapon3': '0.894', 'FRAGCOUNT': '1.000', 'weapon2': '1.550'} [2024-08-05 10:01:39,907][00171] DAMAGECOUNT value on done: 375.0 [2024-08-05 10:01:39,913][00171] Sum rewards: -0.911, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.977', 'AMMO2': '0.009', 'AMMO5': '0.013', 'ARMOR': '0.020', 'AMMO4': '0.043', 'HITCOUNT': '0.050', 'weapon7': '0.050', 'AMMO3': '0.063', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.152', 'DAMAGECOUNT': '0.165', 'weapon5': '0.168', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '0.350', 'weapon3': '0.616', 'FRAGCOUNT': '1.000', 'weapon2': '1.576'} [2024-08-05 10:01:40,183][00156] DAMAGECOUNT value on done: 578.0 [2024-08-05 10:01:40,186][00156] Sum rewards: -5.042, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.038', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.010', 'ARMOR': '0.040', 'AMMO4': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'HITCOUNT': '0.310', 'WEAPON3': '1.050', 'weapon2': '1.132', 'DAMAGECOUNT': '1.389', 'weapon3': '2.168', 'FRAGCOUNT': '3.000'} [2024-08-05 10:01:40,293][00167] DAMAGECOUNT value on done: 449.0 [2024-08-05 10:01:40,302][00167] Sum rewards: 0.122, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.595', 'AMMO5': '0.004', 'AMMO2': '0.011', 'weapon5': '0.028', 'ARMOR': '0.040', 'AMMO4': '0.055', 'weapon7': '0.060', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'WEAPON3': '0.400', 'weapon4': '0.698', 'weapon3': '0.716', 'DAMAGECOUNT': '0.852', 'weapon2': '1.426', 'FRAGCOUNT': '3.000'} [2024-08-05 10:01:40,419][00159] DAMAGECOUNT value on done: 308.0 [2024-08-05 10:01:40,422][00159] Sum rewards: -9.215, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.854', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'ARMOR': '0.020', 'AMMO2': '0.025', 'weapon5': '0.094', 'AMMO4': '0.125', 'AMMO3': '0.169', 'weapon4': '0.218', 'HITCOUNT': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.684', 'WEAPON3': '0.750', 'weapon3': '0.810', 'FRAGCOUNT': '1.000', 'weapon2': '2.178'} [2024-08-05 10:01:40,642][00163] DAMAGECOUNT value on done: 378.0 [2024-08-05 10:01:40,648][00163] Sum rewards: -2.938, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.181', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'ARMOR': '0.060', 'AMMO3': '0.097', 'AMMO4': '0.108', 'weapon5': '0.144', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'WEAPON5': '0.250', 'weapon4': '0.262', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.550', 'weapon3': '1.188', 'weapon2': '1.282'} [2024-08-05 10:01:40,839][00161] DAMAGECOUNT value on done: 145.0 [2024-08-05 10:01:41,631][00168] DAMAGECOUNT value on done: 386.0 [2024-08-05 10:01:41,631][00168] Sum rewards: -4.386, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.294', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon5': '0.020', 'ARMOR': '0.060', 'AMMO4': '0.073', 'weapon4': '0.082', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'HITCOUNT': '0.200', 'WEAPON5': '0.200', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.840', 'weapon2': '1.268', 'weapon3': '1.648'} [2024-08-05 10:01:42,143][00166] DAMAGECOUNT value on done: 609.0 [2024-08-05 10:01:42,495][00169] DAMAGECOUNT value on done: 303.0 [2024-08-05 10:01:42,497][00169] Sum rewards: -5.728, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.590', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.029', 'weapon5': '0.032', 'ARMOR': '0.068', 'AMMO3': '0.102', 'weapon4': '0.104', 'AMMO4': '0.146', 'HITCOUNT': '0.180', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.663', 'weapon3': '1.364', 'weapon2': '1.746'} [2024-08-05 10:01:43,003][00165] DAMAGECOUNT value on done: 140.0 [2024-08-05 10:01:43,303][00162] DAMAGECOUNT value on done: 673.0 [2024-08-05 10:01:43,304][00162] Sum rewards: 0.469, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.003', 'weapon4': '0.002', 'AMMO5': '0.007', 'ARMOR': '0.024', 'AMMO2': '0.024', 'weapon5': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'HITCOUNT': '0.320', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.350', 'weapon2': '1.450', 'weapon3': '1.764', 'FRAGCOUNT': '2.000'} [2024-08-05 10:01:43,355][00034] Fps is (10 sec: 4915.3, 60 sec: 4778.7, 300 sec: 4943.0). Total num frames: 6119424. Throughput: 0: 1214.2. Samples: 1534152. Policy #0 lag: (min: 0.0, avg: 2.3, max: 5.0) [2024-08-05 10:01:43,357][00034] Avg episode reward: [(0, '-3.769')] [2024-08-05 10:01:44,443][00170] DAMAGECOUNT value on done: 220.0 [2024-08-05 10:01:44,444][00170] Sum rewards: -2.923, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.220', 'AMMO2': '0.004', 'weapon5': '0.016', 'AMMO5': '0.018', 'AMMO4': '0.019', 'WEAPON1': '0.040', 'weapon7': '0.052', 'HITCOUNT': '0.060', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.129', 'DAMAGECOUNT': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.368', 'WEAPON3': '0.700', 'weapon2': '0.874', 'FRAGCOUNT': '1.000', 'weapon3': '1.618'} [2024-08-05 10:01:44,621][00164] DAMAGECOUNT value on done: 345.0 [2024-08-05 10:01:44,625][00164] Sum rewards: -5.434, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.468', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO5': '0.037', 'WEAPON4': '0.050', 'HITCOUNT': '0.070', 'AMMO4': '0.073', 'AMMO3': '0.170', 'weapon5': '0.182', 'weapon4': '0.198', 'DAMAGECOUNT': '0.585', 'WEAPON5': '0.650', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.132', 'weapon2': '1.678'} [2024-08-05 10:01:44,782][00160] DAMAGECOUNT value on done: 255.0 [2024-08-05 10:01:44,786][00160] Sum rewards: -0.387, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'HEALTH': '0.055', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'weapon4': '0.100', 'AMMO4': '0.106', 'HITCOUNT': '0.140', 'weapon5': '0.142', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.450', 'ARMOR': '0.495', 'FRAGCOUNT': '1.000', 'weapon3': '1.042', 'weapon2': '1.890'} [2024-08-05 10:01:46,314][00158] DAMAGECOUNT value on done: 653.0 [2024-08-05 10:01:46,319][00158] Sum rewards: -4.098, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.860', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.014', 'AMMO5': '0.020', 'AMMO4': '0.071', 'weapon5': '0.098', 'AMMO3': '0.125', 'HITCOUNT': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.380', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.837', 'weapon2': '1.010', 'weapon3': '1.626'} [2024-08-05 10:01:46,348][00172] DAMAGECOUNT value on done: 392.0 [2024-08-05 10:01:46,349][00172] Sum rewards: -6.723, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.880', 'AMMO5': '0.009', 'AMMO2': '0.017', 'weapon4': '0.026', 'WEAPON1': '0.030', 'weapon5': '0.042', 'ARMOR': '0.044', 'WEAPON4': '0.050', 'AMMO4': '0.084', 'AMMO3': '0.160', 'HITCOUNT': '0.190', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.828', 'WEAPON3': '0.950', 'weapon2': '1.358', 'weapon3': '1.668', 'FRAGCOUNT': '2.000'} [2024-08-05 10:01:47,113][00159] DAMAGECOUNT value on done: 289.0 [2024-08-05 10:01:47,112][00171] DAMAGECOUNT value on done: 332.0 [2024-08-05 10:01:47,120][00171] Sum rewards: -0.889, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.880', 'AMMO5': '0.003', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.066', 'ARMOR': '0.070', 'weapon7': '0.080', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.123', 'AMMO4': '0.153', 'HITCOUNT': '0.210', 'WEAPON4': '0.400', 'weapon4': '0.544', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.876', 'weapon3': '0.964', 'FRAGCOUNT': '1.000', 'weapon2': '1.272'} [2024-08-05 10:01:47,169][00156] DAMAGECOUNT value on done: 344.0 [2024-08-05 10:01:47,212][00167] DAMAGECOUNT value on done: 360.0 [2024-08-05 10:01:47,737][00157] Updated weights for policy 0, policy_version 750 (0.0020) [2024-08-05 10:01:47,764][00161] DAMAGECOUNT value on done: 465.0 [2024-08-05 10:01:47,769][00161] Sum rewards: -2.849, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.384', 'AMMO5': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO4': '0.076', 'weapon5': '0.086', 'weapon4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.171', 'HITCOUNT': '0.220', 'WEAPON5': '0.250', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.164', 'weapon2': '1.372', 'weapon3': '1.506', 'FRAGCOUNT': '3.000'} [2024-08-05 10:01:47,836][00163] DAMAGECOUNT value on done: 336.0 [2024-08-05 10:01:47,839][00163] Sum rewards: 0.598, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.976', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.046', 'ARMOR': '0.048', 'WEAPON1': '0.050', 'weapon7': '0.062', 'weapon4': '0.074', 'AMMO4': '0.083', 'AMMO3': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.645', 'weapon3': '1.478', 'weapon2': '1.628', 'FRAGCOUNT': '2.000'} [2024-08-05 10:01:48,355][00034] Fps is (10 sec: 4096.1, 60 sec: 4778.7, 300 sec: 4943.0). Total num frames: 6144000. Throughput: 0: 1201.3. Samples: 1541176. Policy #0 lag: (min: 0.0, avg: 2.1, max: 5.0) [2024-08-05 10:01:48,357][00034] Avg episode reward: [(0, '-3.659')] [2024-08-05 10:01:48,360][00136] Saving new best policy, reward=-3.659! [2024-08-05 10:01:48,744][00166] DAMAGECOUNT value on done: 722.0 [2024-08-05 10:01:48,745][00166] Sum rewards: -1.584, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.052', 'AMMO5': '0.012', 'AMMO2': '0.027', 'ARMOR': '0.048', 'weapon5': '0.078', 'AMMO3': '0.124', 'AMMO4': '0.133', 'WEAPON5': '0.200', 'HITCOUNT': '0.280', 'WEAPON4': '0.350', 'WEAPON3': '0.600', 'weapon4': '0.642', 'weapon3': '0.988', 'DAMAGECOUNT': '1.389', 'weapon2': '1.596', 'FRAGCOUNT': '2.000'} [2024-08-05 10:01:48,864][00169] DAMAGECOUNT value on done: 267.0 [2024-08-05 10:01:49,490][00165] DAMAGECOUNT value on done: 445.0 [2024-08-05 10:01:49,496][00165] Sum rewards: -6.239, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.575', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO2': '0.033', 'HITCOUNT': '0.090', 'weapon5': '0.100', 'AMMO3': '0.141', 'AMMO4': '0.165', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.330', 'weapon4': '0.338', 'WEAPON4': '0.350', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.800', 'weapon2': '1.294', 'weapon3': '1.350'} [2024-08-05 10:01:49,526][00168] DAMAGECOUNT value on done: 378.0 [2024-08-05 10:01:49,539][00168] Sum rewards: -1.949, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.480', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.022', 'ARMOR': '0.040', 'weapon5': '0.044', 'AMMO3': '0.082', 'AMMO4': '0.112', 'HITCOUNT': '0.150', 'weapon4': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.500', 'FRAGCOUNT': '0.500', 'weapon2': '1.162', 'weapon3': '1.446'} [2024-08-05 10:01:49,664][00162] DAMAGECOUNT value on done: 210.0 [2024-08-05 10:01:49,668][00162] Sum rewards: -6.753, reward structure: {'DEATHCOUNT': '-11.250', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.130', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.023', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'AMMO4': '0.116', 'AMMO3': '0.122', 'weapon5': '0.148', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.447', 'WEAPON3': '0.600', 'weapon3': '1.026', 'weapon2': '2.150'} [2024-08-05 10:01:50,662][00170] DAMAGECOUNT value on done: 529.0 [2024-08-05 10:01:50,663][00170] Sum rewards: -1.978, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.684', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.009', 'weapon5': '0.028', 'ARMOR': '0.036', 'WEAPON4': '0.100', 'weapon4': '0.106', 'AMMO3': '0.124', 'WEAPON5': '0.200', 'HITCOUNT': '0.220', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.750', 'weapon3': '1.440', 'weapon2': '1.536', 'FRAGCOUNT': '2.000'} [2024-08-05 10:01:52,569][00164] DAMAGECOUNT value on done: 493.0 [2024-08-05 10:01:52,579][00164] Sum rewards: -0.572, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.786', 'AMMO5': '0.007', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'AMMO3': '0.077', 'ARMOR': '0.080', 'AMMO4': '0.099', 'weapon5': '0.124', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.234', 'HITCOUNT': '0.280', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.023', 'weapon3': '1.032', 'weapon2': '1.968', 'FRAGCOUNT': '2.000'} [2024-08-05 10:01:52,756][00160] DAMAGECOUNT value on done: 500.0 [2024-08-05 10:01:52,865][00158] DAMAGECOUNT value on done: 269.0 [2024-08-05 10:01:52,869][00158] Sum rewards: -3.643, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.670', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.143', 'HITCOUNT': '0.190', 'weapon4': '0.254', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.687', 'WEAPON3': '0.750', 'weapon2': '1.050', 'weapon3': '1.806', 'FRAGCOUNT': '2.000'} [2024-08-05 10:01:53,281][00159] DAMAGECOUNT value on done: 277.0 [2024-08-05 10:01:53,287][00159] Sum rewards: -2.158, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.758', 'AMMO5': '0.008', 'AMMO2': '0.010', 'weapon7': '0.040', 'AMMO4': '0.050', 'weapon5': '0.062', 'ARMOR': '0.064', 'AMMO3': '0.127', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO6': '0.160', 'AMMO7': '0.160', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.540', 'WEAPON3': '0.750', 'weapon2': '1.038', 'weapon3': '1.692', 'FRAGCOUNT': '2.000'} [2024-08-05 10:01:53,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4943.0). Total num frames: 6168576. Throughput: 0: 1200.4. Samples: 1544872. Policy #0 lag: (min: 0.0, avg: 2.4, max: 5.0) [2024-08-05 10:01:53,357][00034] Avg episode reward: [(0, '-3.760')] [2024-08-05 10:01:53,412][00156] DAMAGECOUNT value on done: 265.0 [2024-08-05 10:01:53,415][00156] Sum rewards: -5.981, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.784', 'AMMO5': '0.018', 'AMMO2': '0.018', 'ARMOR': '0.020', 'weapon5': '0.030', 'HITCOUNT': '0.080', 'AMMO3': '0.085', 'AMMO4': '0.092', 'weapon7': '0.132', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.240', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON5': '0.350', 'weapon4': '0.392', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'weapon3': '0.610', 'weapon2': '1.596'} [2024-08-05 10:01:53,417][00167] DAMAGECOUNT value on done: 704.0 [2024-08-05 10:01:53,421][00167] Sum rewards: -7.980, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.010', 'AMMO5': '0.015', 'AMMO2': '0.021', 'ARMOR': '0.040', 'WEAPON1': '0.040', 'AMMO4': '0.105', 'weapon5': '0.114', 'weapon4': '0.134', 'AMMO3': '0.141', 'WEAPON4': '0.200', 'HITCOUNT': '0.320', 'WEAPON5': '0.350', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.113', 'weapon3': '1.192', 'weapon2': '1.744'} [2024-08-05 10:01:53,680][00171] DAMAGECOUNT value on done: 366.0 [2024-08-05 10:01:53,684][00171] Sum rewards: -5.612, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.372', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.099', 'AMMO3': '0.103', 'weapon4': '0.106', 'WEAPON5': '0.150', 'weapon5': '0.156', 'WEAPON4': '0.200', 'HITCOUNT': '0.200', 'WEAPON3': '0.600', 'ARMOR': '0.884', 'DAMAGECOUNT': '0.888', 'weapon3': '1.160', 'weapon2': '1.426'} [2024-08-05 10:01:53,983][00161] DAMAGECOUNT value on done: 369.0 [2024-08-05 10:01:53,997][00161] Sum rewards: 0.065, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.621', 'AMMO2': '0.006', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.032', 'weapon4': '0.036', 'weapon5': '0.054', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'HITCOUNT': '0.150', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.462', 'weapon2': '1.298', 'weapon3': '1.634', 'FRAGCOUNT': '2.000'} [2024-08-05 10:01:54,090][00172] DAMAGECOUNT value on done: 525.0 [2024-08-05 10:01:54,091][00172] Sum rewards: -4.243, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.965', 'AMMO5': '0.029', 'WEAPON1': '0.040', 'AMMO2': '0.052', 'ARMOR': '0.056', 'WEAPON4': '0.100', 'weapon5': '0.106', 'AMMO3': '0.118', 'weapon4': '0.134', 'AMMO4': '0.259', 'HITCOUNT': '0.340', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'weapon2': '1.310', 'DAMAGECOUNT': '1.338', 'weapon3': '1.690', 'FRAGCOUNT': '2.000'} [2024-08-05 10:01:54,204][00163] DAMAGECOUNT value on done: 223.0 [2024-08-05 10:01:54,209][00163] Sum rewards: -4.841, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.294', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'ARMOR': '0.024', 'AMMO2': '0.026', 'weapon5': '0.076', 'AMMO3': '0.129', 'AMMO4': '0.130', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.170', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.600', 'weapon3': '0.848', 'weapon2': '1.924', 'FRAGCOUNT': '2.000'} [2024-08-05 10:01:55,078][00169] DAMAGECOUNT value on done: 537.0 [2024-08-05 10:01:55,082][00169] Sum rewards: -2.529, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.325', 'AMMO5': '0.007', 'AMMO2': '0.021', 'ARMOR': '0.028', 'weapon5': '0.062', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.110', 'HITCOUNT': '0.140', 'DAMAGECOUNT': '0.555', 'WEAPON3': '0.600', 'weapon3': '1.490', 'weapon2': '1.728', 'FRAGCOUNT': '2.000'} [2024-08-05 10:01:55,261][00166] DAMAGECOUNT value on done: 542.0 [2024-08-05 10:01:55,269][00166] Sum rewards: 0.653, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'ARMOR': '0.056', 'weapon5': '0.062', 'AMMO4': '0.074', 'weapon7': '0.074', 'AMMO3': '0.078', 'HITCOUNT': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HEALTH': '0.298', 'WEAPON3': '0.300', 'weapon4': '0.406', 'weapon3': '0.640', 'DAMAGECOUNT': '0.810', 'weapon2': '1.030', 'FRAGCOUNT': '2.000'} [2024-08-05 10:01:55,664][00165] DAMAGECOUNT value on done: 491.0 [2024-08-05 10:01:55,668][00165] Sum rewards: -5.447, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.574', 'AMMO5': '0.010', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.099', 'weapon5': '0.112', 'HITCOUNT': '0.130', 'AMMO3': '0.177', 'weapon4': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.351', 'ARMOR': '0.494', 'weapon2': '0.584', 'WEAPON3': '0.850', 'weapon3': '2.048'} [2024-08-05 10:01:55,909][00162] DAMAGECOUNT value on done: 385.0 [2024-08-05 10:01:55,915][00162] Sum rewards: -3.597, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.190', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'ARMOR': '0.088', 'weapon5': '0.100', 'AMMO3': '0.115', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'weapon4': '0.220', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.579', 'weapon3': '1.020', 'weapon2': '1.828'} [2024-08-05 10:01:56,952][00170] DAMAGECOUNT value on done: 190.0 [2024-08-05 10:01:56,953][00170] Sum rewards: -1.839, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.670', 'AMMO5': '0.008', 'ARMOR': '0.020', 'HITCOUNT': '0.020', 'AMMO2': '0.027', 'AMMO3': '0.078', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'weapon4': '0.298', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.146', 'weapon2': '1.520'} [2024-08-05 10:01:57,357][00168] DAMAGECOUNT value on done: 278.0 [2024-08-05 10:01:57,357][00168] Sum rewards: -6.632, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.468', 'AMMO5': '0.010', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'HITCOUNT': '0.030', 'weapon5': '0.040', 'ARMOR': '0.052', 'weapon4': '0.104', 'DAMAGECOUNT': '0.105', 'AMMO3': '0.109', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON3': '0.650', 'weapon2': '1.176', 'weapon3': '1.566'} [2024-08-05 10:01:58,356][00034] Fps is (10 sec: 4915.1, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 6193152. Throughput: 0: 1212.6. Samples: 1552272. Policy #0 lag: (min: 0.0, avg: 1.6, max: 4.0) [2024-08-05 10:01:58,357][00034] Avg episode reward: [(0, '-3.787')] [2024-08-05 10:01:59,470][00158] DAMAGECOUNT value on done: 435.0 [2024-08-05 10:01:59,563][00159] DAMAGECOUNT value on done: 600.0 [2024-08-05 10:01:59,563][00159] Sum rewards: 0.080, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.654', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'weapon5': '0.050', 'AMMO3': '0.099', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'WEAPON5': '0.200', 'weapon4': '0.204', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.065', 'weapon3': '1.102', 'weapon2': '1.158', 'FRAGCOUNT': '5.000'} [2024-08-05 10:01:59,649][00164] DAMAGECOUNT value on done: 435.0 [2024-08-05 10:01:59,658][00164] Sum rewards: -6.061, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.454', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.012', 'ARMOR': '0.040', 'weapon5': '0.064', 'weapon4': '0.084', 'AMMO3': '0.105', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.975', 'weapon3': '1.354', 'weapon2': '1.716'} [2024-08-05 10:01:59,727][00160] DAMAGECOUNT value on done: 635.0 [2024-08-05 10:01:59,730][00160] Sum rewards: -5.742, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.080', 'AMMO5': '0.005', 'weapon5': '0.022', 'AMMO2': '0.024', 'weapon4': '0.054', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.133', 'HITCOUNT': '0.180', 'ARMOR': '0.420', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.700', 'weapon3': '1.052', 'DAMAGECOUNT': '1.110', 'weapon2': '2.070'} [2024-08-05 10:02:00,277][00171] DAMAGECOUNT value on done: 365.0 [2024-08-05 10:02:00,299][00156] DAMAGECOUNT value on done: 576.0 [2024-08-05 10:02:00,301][00156] Sum rewards: -1.252, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.861', 'AMMO5': '0.014', 'AMMO2': '0.016', 'weapon5': '0.038', 'AMMO4': '0.077', 'weapon7': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.146', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.220', 'weapon4': '0.320', 'WEAPON3': '0.900', 'weapon2': '1.086', 'DAMAGECOUNT': '1.290', 'weapon3': '1.576', 'FRAGCOUNT': '3.000'} [2024-08-05 10:02:00,385][00167] DAMAGECOUNT value on done: 611.0 [2024-08-05 10:02:00,390][00167] Sum rewards: -4.552, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.278', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.026', 'ARMOR': '0.060', 'weapon4': '0.114', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'HITCOUNT': '0.330', 'WEAPON4': '0.350', 'WEAPON3': '1.000', 'weapon2': '1.220', 'DAMAGECOUNT': '1.545', 'weapon3': '1.856', 'FRAGCOUNT': '2.000'} [2024-08-05 10:02:00,873][00163] DAMAGECOUNT value on done: 416.0 [2024-08-05 10:02:00,877][00172] DAMAGECOUNT value on done: 703.0 [2024-08-05 10:02:00,878][00172] Sum rewards: -6.293, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.362', 'AMMO2': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.060', 'weapon4': '0.066', 'weapon5': '0.180', 'AMMO3': '0.208', 'HITCOUNT': '0.210', 'WEAPON5': '0.300', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.023', 'weapon3': '1.376', 'weapon2': '1.518'} [2024-08-05 10:02:00,874][00163] Sum rewards: -0.437, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.015', 'AMMO5': '0.011', 'AMMO2': '0.016', 'ARMOR': '0.024', 'WEAPON1': '0.030', 'AMMO4': '0.078', 'AMMO3': '0.096', 'weapon5': '0.104', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'WEAPON5': '0.250', 'weapon4': '0.390', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.828', 'FRAGCOUNT': '1.000', 'weapon2': '1.230', 'weapon3': '1.390'} [2024-08-05 10:02:00,967][00161] DAMAGECOUNT value on done: 465.0 [2024-08-05 10:02:00,970][00161] Sum rewards: -3.996, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.883', 'AMMO5': '0.015', 'ARMOR': '0.016', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'weapon4': '0.030', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'weapon5': '0.102', 'AMMO3': '0.103', 'HITCOUNT': '0.170', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.975', 'weapon3': '1.226', 'FRAGCOUNT': '1.500', 'weapon2': '1.620'} [2024-08-05 10:02:01,237][00169] DAMAGECOUNT value on done: 393.0 [2024-08-05 10:02:01,247][00169] Sum rewards: -5.128, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.312', 'AMMO2': '0.011', 'AMMO5': '0.014', 'ARMOR': '0.028', 'weapon5': '0.030', 'AMMO4': '0.053', 'WEAPON1': '0.060', 'weapon4': '0.060', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.849', 'weapon3': '1.512', 'weapon2': '1.562', 'FRAGCOUNT': '2.000'} [2024-08-05 10:02:01,915][00166] DAMAGECOUNT value on done: 535.0 [2024-08-05 10:02:01,922][00166] Sum rewards: -0.841, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.620', 'AMMO5': '0.008', 'weapon5': '0.016', 'AMMO2': '0.019', 'weapon4': '0.066', 'weapon7': '0.068', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.125', 'WEAPON7': '0.200', 'HITCOUNT': '0.240', 'ARMOR': '0.489', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.912', 'FRAGCOUNT': '1.000', 'weapon3': '1.302', 'weapon2': '1.698'} [2024-08-05 10:02:02,170][00165] DAMAGECOUNT value on done: 259.0 [2024-08-05 10:02:02,416][00162] DAMAGECOUNT value on done: 228.0 [2024-08-05 10:02:03,062][00157] Updated weights for policy 0, policy_version 760 (0.0025) [2024-08-05 10:02:03,355][00034] Fps is (10 sec: 5734.4, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 6225920. Throughput: 0: 1214.0. Samples: 1559728. Policy #0 lag: (min: 0.0, avg: 1.9, max: 4.0) [2024-08-05 10:02:03,360][00034] Avg episode reward: [(0, '-3.711')] [2024-08-05 10:02:03,585][00168] DAMAGECOUNT value on done: 288.0 [2024-08-05 10:02:03,592][00168] Sum rewards: -5.532, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.742', 'AMMO5': '0.016', 'AMMO2': '0.023', 'HITCOUNT': '0.080', 'AMMO4': '0.114', 'weapon4': '0.140', 'AMMO3': '0.143', 'weapon5': '0.218', 'DAMAGECOUNT': '0.279', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'ARMOR': '0.482', 'WEAPON3': '0.750', 'weapon2': '1.286', 'weapon3': '1.328', 'FRAGCOUNT': '2.000'} [2024-08-05 10:02:03,731][00170] DAMAGECOUNT value on done: 703.0 [2024-08-05 10:02:03,732][00170] Sum rewards: -3.935, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.374', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.027', 'weapon5': '0.062', 'ARMOR': '0.072', 'WEAPON4': '0.100', 'weapon4': '0.122', 'AMMO4': '0.133', 'AMMO3': '0.135', 'HITCOUNT': '0.230', 'WEAPON5': '0.350', 'WEAPON3': '0.850', 'weapon3': '1.360', 'DAMAGECOUNT': '1.374', 'FRAGCOUNT': '1.500', 'weapon2': '1.582'} [2024-08-05 10:02:05,760][00158] DAMAGECOUNT value on done: 344.0 [2024-08-05 10:02:05,867][00164] DAMAGECOUNT value on done: 129.0 [2024-08-05 10:02:05,926][00160] DAMAGECOUNT value on done: 386.0 [2024-08-05 10:02:05,931][00160] Sum rewards: -0.146, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.700', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'AMMO4': '0.045', 'WEAPON5': '0.050', 'AMMO3': '0.087', 'HITCOUNT': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.210', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.380', 'weapon3': '1.520'} [2024-08-05 10:02:06,600][00171] DAMAGECOUNT value on done: 267.0 [2024-08-05 10:02:06,604][00171] Sum rewards: -6.062, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.000', 'HEALTH': '-0.784', 'AMMO2': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.021', 'ARMOR': '0.028', 'WEAPON4': '0.050', 'weapon5': '0.074', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.146', 'AMMO3': '0.156', 'DAMAGECOUNT': '0.225', 'WEAPON3': '0.850', 'weapon2': '1.040', 'weapon3': '1.908'} [2024-08-05 10:02:06,901][00159] DAMAGECOUNT value on done: 574.0 [2024-08-05 10:02:06,906][00159] Sum rewards: -8.873, reward structure: {'DEATHCOUNT': '-12.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.942', 'AMMO5': '0.022', 'ARMOR': '0.024', 'AMMO2': '0.034', 'weapon5': '0.118', 'HITCOUNT': '0.140', 'AMMO3': '0.148', 'AMMO4': '0.169', 'weapon4': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.500', 'DAMAGECOUNT': '0.528', 'WEAPON3': '0.650', 'weapon3': '0.996', 'weapon2': '1.752'} [2024-08-05 10:02:06,933][00156] DAMAGECOUNT value on done: 324.0 [2024-08-05 10:02:06,945][00172] DAMAGECOUNT value on done: 277.0 [2024-08-05 10:02:06,949][00172] Sum rewards: 0.924, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.245', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon5': '0.030', 'ARMOR': '0.032', 'AMMO3': '0.072', 'AMMO4': '0.116', 'HITCOUNT': '0.170', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.308', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.651', 'weapon3': '1.258', 'weapon2': '1.296', 'FRAGCOUNT': '4.000'} [2024-08-05 10:02:06,977][00167] DAMAGECOUNT value on done: 141.0 [2024-08-05 10:02:06,979][00167] Sum rewards: 0.242, reward structure: {'DEATHCOUNT': '-4.500', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.005', 'AMMO2': '0.013', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.064', 'AMMO4': '0.067', 'weapon5': '0.074', 'weapon7': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.120', 'weapon4': '0.132', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.350', 'weapon2': '0.946', 'HEALTH': '1.008', 'weapon3': '1.538'} [2024-08-05 10:02:07,208][00163] DAMAGECOUNT value on done: 556.0 [2024-08-05 10:02:07,210][00163] Sum rewards: -3.980, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.972', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.015', 'AMMO2': '0.023', 'weapon5': '0.038', 'ARMOR': '0.052', 'AMMO4': '0.113', 'AMMO3': '0.131', 'weapon4': '0.172', 'HITCOUNT': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.882', 'weapon2': '1.232', 'weapon3': '1.534'} [2024-08-05 10:02:07,507][00161] DAMAGECOUNT value on done: 309.0 [2024-08-05 10:02:07,508][00161] Sum rewards: -7.291, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.130', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'ARMOR': '0.032', 'weapon5': '0.050', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.138', 'AMMO4': '0.156', 'DAMAGECOUNT': '0.264', 'WEAPON4': '0.300', 'weapon4': '0.426', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.194', 'weapon3': '1.320'} [2024-08-05 10:02:08,355][00034] Fps is (10 sec: 5734.5, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 6250496. Throughput: 0: 1214.0. Samples: 1563400. Policy #0 lag: (min: 0.0, avg: 1.4, max: 4.0) [2024-08-05 10:02:08,358][00034] Avg episode reward: [(0, '-3.742')] [2024-08-05 10:02:08,507][00169] DAMAGECOUNT value on done: 292.0 [2024-08-05 10:02:08,511][00169] Sum rewards: -3.357, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.544', 'AMMO5': '0.005', 'AMMO2': '0.022', 'ARMOR': '0.028', 'WEAPON1': '0.030', 'weapon5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.109', 'WEAPON5': '0.150', 'HITCOUNT': '0.180', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.636', 'weapon2': '1.372', 'weapon3': '1.646'} [2024-08-05 10:02:08,563][00165] DAMAGECOUNT value on done: 604.0 [2024-08-05 10:02:08,567][00165] Sum rewards: -4.779, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.747', 'ARMOR': '0.008', 'AMMO2': '0.009', 'AMMO5': '0.017', 'weapon5': '0.034', 'AMMO4': '0.045', 'AMMO3': '0.138', 'HITCOUNT': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.204', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.795', 'WEAPON3': '0.800', 'weapon2': '0.884', 'FRAGCOUNT': '1.000', 'weapon3': '1.884'} [2024-08-05 10:02:08,770][00166] DAMAGECOUNT value on done: 485.0 [2024-08-05 10:02:08,771][00166] Sum rewards: -5.930, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.730', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO5': '0.022', 'WEAPON4': '0.050', 'weapon5': '0.054', 'HITCOUNT': '0.070', 'weapon4': '0.160', 'AMMO3': '0.199', 'WEAPON5': '0.400', 'DAMAGECOUNT': '0.552', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.372', 'weapon2': '1.608'} [2024-08-05 10:02:09,481][00162] DAMAGECOUNT value on done: 268.0 [2024-08-05 10:02:09,483][00162] Sum rewards: -4.947, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.178', 'AMMO5': '0.012', 'weapon5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'ARMOR': '0.036', 'AMMO3': '0.108', 'AMMO4': '0.116', 'HITCOUNT': '0.210', 'weapon4': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.597', 'weapon3': '1.392', 'weapon2': '1.408'} [2024-08-05 10:02:09,591][00168] DAMAGECOUNT value on done: 589.0 [2024-08-05 10:02:09,597][00168] Sum rewards: -3.690, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.580', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'ARMOR': '0.056', 'weapon5': '0.056', 'AMMO4': '0.120', 'AMMO3': '0.138', 'weapon4': '0.154', 'HITCOUNT': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.924', 'weapon3': '1.386', 'weapon2': '1.570', 'FRAGCOUNT': '4.000'} [2024-08-05 10:02:10,573][00170] DAMAGECOUNT value on done: 264.0 [2024-08-05 10:02:10,577][00170] Sum rewards: -4.862, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.246', 'AMMO5': '0.012', 'AMMO2': '0.014', 'weapon5': '0.022', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.122', 'HITCOUNT': '0.150', 'AMMO3': '0.162', 'WEAPON5': '0.250', 'ARMOR': '0.460', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.462', 'weapon3': '1.630'} [2024-08-05 10:02:11,943][00164] DAMAGECOUNT value on done: 126.0 [2024-08-05 10:02:11,947][00164] Sum rewards: -8.248, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.900', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.070', 'HITCOUNT': '0.070', 'weapon4': '0.086', 'weapon5': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.175', 'DAMAGECOUNT': '0.183', 'WEAPON5': '0.200', 'WEAPON3': '0.900', 'weapon2': '1.462', 'weapon3': '1.526'} [2024-08-05 10:02:11,981][00160] DAMAGECOUNT value on done: 327.0 [2024-08-05 10:02:11,983][00160] Sum rewards: -3.011, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.870', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.017', 'ARMOR': '0.020', 'WEAPON1': '0.020', 'weapon5': '0.044', 'weapon4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'HITCOUNT': '0.160', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.492', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.650', 'weapon2': '1.184', 'weapon3': '1.626'} [2024-08-05 10:02:12,393][00158] DAMAGECOUNT value on done: 502.0 [2024-08-05 10:02:12,917][00172] DAMAGECOUNT value on done: 408.0 [2024-08-05 10:02:12,922][00172] Sum rewards: -2.882, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.824', 'AMMO5': '0.007', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'AMMO3': '0.073', 'weapon4': '0.108', 'AMMO4': '0.115', 'weapon5': '0.152', 'HITCOUNT': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'ARMOR': '0.428', 'DAMAGECOUNT': '0.579', 'weapon3': '1.036', 'FRAGCOUNT': '1.500', 'weapon2': '1.810'} [2024-08-05 10:02:13,275][00159] DAMAGECOUNT value on done: 555.0 [2024-08-05 10:02:13,276][00159] Sum rewards: -5.480, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.756', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'weapon5': '0.034', 'ARMOR': '0.040', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'HITCOUNT': '0.100', 'AMMO3': '0.127', 'WEAPON5': '0.150', 'weapon4': '0.246', 'DAMAGECOUNT': '0.270', 'WEAPON3': '0.500', 'weapon3': '1.314', 'weapon2': '1.370'} [2024-08-05 10:02:13,355][00034] Fps is (10 sec: 4096.0, 60 sec: 4778.7, 300 sec: 4915.2). Total num frames: 6266880. Throughput: 0: 1218.5. Samples: 1570880. Policy #0 lag: (min: 0.0, avg: 2.3, max: 5.0) [2024-08-05 10:02:13,357][00034] Avg episode reward: [(0, '-4.020')] [2024-08-05 10:02:14,002][00171] DAMAGECOUNT value on done: 325.0 [2024-08-05 10:02:14,005][00171] Sum rewards: -4.266, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.628', 'AMMO2': '0.011', 'AMMO5': '0.020', 'HITCOUNT': '0.020', 'ARMOR': '0.028', 'WEAPON1': '0.030', 'AMMO4': '0.052', 'weapon4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.143', 'weapon5': '0.166', 'WEAPON5': '0.400', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.660', 'WEAPON3': '0.700', 'weapon2': '1.066', 'weapon3': '1.640'} [2024-08-05 10:02:14,012][00156] DAMAGECOUNT value on done: 265.0 [2024-08-05 10:02:14,084][00167] DAMAGECOUNT value on done: 355.0 [2024-08-05 10:02:14,085][00167] Sum rewards: -6.048, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.370', 'FRAGCOUNT': '-0.500', 'weapon4': '0.008', 'AMMO2': '0.008', 'AMMO5': '0.018', 'AMMO4': '0.041', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'HITCOUNT': '0.110', 'AMMO3': '0.127', 'weapon5': '0.244', 'WEAPON5': '0.400', 'DAMAGECOUNT': '0.735', 'WEAPON3': '0.750', 'weapon2': '1.490', 'weapon3': '1.540'} [2024-08-05 10:02:14,701][00163] DAMAGECOUNT value on done: 666.0 [2024-08-05 10:02:14,703][00163] Sum rewards: -2.219, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.380', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.025', 'ARMOR': '0.040', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'AMMO4': '0.122', 'weapon5': '0.166', 'HITCOUNT': '0.210', 'WEAPON5': '0.400', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.750', 'weapon2': '1.210', 'DAMAGECOUNT': '1.443', 'weapon3': '1.452'} [2024-08-05 10:02:15,044][00161] DAMAGECOUNT value on done: 483.0 [2024-08-05 10:02:15,149][00169] DAMAGECOUNT value on done: 270.0 [2024-08-05 10:02:15,152][00169] Sum rewards: -6.587, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.494', 'weapon5': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.018', 'ARMOR': '0.064', 'HITCOUNT': '0.070', 'AMMO4': '0.089', 'AMMO3': '0.126', 'DAMAGECOUNT': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.432', 'WEAPON3': '0.500', 'weapon3': '0.964', 'weapon2': '1.632'} [2024-08-05 10:02:16,073][00165] DAMAGECOUNT value on done: 337.0 [2024-08-05 10:02:16,078][00165] Sum rewards: -6.504, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.732', 'AMMO5': '0.014', 'AMMO2': '0.026', 'WEAPON1': '0.050', 'weapon5': '0.074', 'WEAPON4': '0.100', 'AMMO4': '0.129', 'HITCOUNT': '0.130', 'weapon4': '0.132', 'AMMO3': '0.147', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.375', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.700', 'weapon2': '1.414', 'weapon3': '1.436'} [2024-08-05 10:02:16,234][00162] DAMAGECOUNT value on done: 252.0 [2024-08-05 10:02:16,238][00162] Sum rewards: -8.132, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-2.000', 'HEALTH': '-1.338', 'AMMO5': '0.013', 'AMMO2': '0.019', 'ARMOR': '0.030', 'WEAPON1': '0.050', 'AMMO4': '0.093', 'HITCOUNT': '0.110', 'AMMO3': '0.118', 'weapon5': '0.118', 'WEAPON4': '0.150', 'weapon4': '0.234', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.700', 'weapon2': '1.048', 'weapon3': '1.628'} [2024-08-05 10:02:16,279][00166] DAMAGECOUNT value on done: 420.0 [2024-08-05 10:02:16,285][00166] Sum rewards: -5.861, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.621', 'AMMO2': '0.018', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.088', 'AMMO4': '0.091', 'HITCOUNT': '0.190', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.414', 'DAMAGECOUNT': '0.720', 'WEAPON3': '0.950', 'weapon3': '1.240', 'weapon2': '1.268', 'FRAGCOUNT': '2.000'} [2024-08-05 10:02:16,458][00168] DAMAGECOUNT value on done: 561.0 [2024-08-05 10:02:16,463][00168] Sum rewards: -4.715, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.694', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'ARMOR': '0.044', 'AMMO2': '0.064', 'weapon5': '0.160', 'HITCOUNT': '0.170', 'AMMO3': '0.187', 'weapon4': '0.216', 'AMMO4': '0.322', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'DAMAGECOUNT': '0.963', 'WEAPON3': '1.100', 'weapon2': '1.132', 'weapon3': '1.530', 'FRAGCOUNT': '3.000'} [2024-08-05 10:02:17,227][00170] DAMAGECOUNT value on done: 254.0 [2024-08-05 10:02:18,356][00034] Fps is (10 sec: 4095.9, 60 sec: 4778.7, 300 sec: 4915.2). Total num frames: 6291456. Throughput: 0: 1202.3. Samples: 1577616. Policy #0 lag: (min: 0.0, avg: 2.3, max: 4.0) [2024-08-05 10:02:18,357][00034] Avg episode reward: [(0, '-4.263')] [2024-08-05 10:02:19,103][00164] DAMAGECOUNT value on done: 440.0 [2024-08-05 10:02:19,104][00164] Sum rewards: -8.006, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.780', 'AMMO5': '0.019', 'AMMO2': '0.028', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'weapon5': '0.092', 'AMMO4': '0.141', 'weapon4': '0.164', 'AMMO3': '0.206', 'HITCOUNT': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'DAMAGECOUNT': '0.870', 'weapon2': '0.896', 'WEAPON3': '1.200', 'FRAGCOUNT': '1.500', 'weapon3': '1.836'} [2024-08-05 10:02:19,193][00160] DAMAGECOUNT value on done: 322.0 [2024-08-05 10:02:19,200][00160] Sum rewards: -7.062, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.298', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon4': '0.034', 'ARMOR': '0.040', 'weapon5': '0.050', 'AMMO4': '0.098', 'HITCOUNT': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.609', 'WEAPON3': '0.800', 'weapon2': '1.490', 'weapon3': '1.700', 'FRAGCOUNT': '3.000'} [2024-08-05 10:02:19,559][00158] DAMAGECOUNT value on done: 766.0 [2024-08-05 10:02:19,563][00158] Sum rewards: -3.525, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO2': '0.031', 'AMMO3': '0.094', 'AMMO4': '0.156', 'weapon4': '0.162', 'weapon5': '0.184', 'WEAPON4': '0.200', 'HITCOUNT': '0.230', 'WEAPON5': '0.300', 'HEALTH': '0.426', 'WEAPON3': '0.450', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '1.338', 'weapon3': '1.364', 'weapon2': '1.492'} [2024-08-05 10:02:19,973][00159] DAMAGECOUNT value on done: 528.0 [2024-08-05 10:02:19,974][00159] Sum rewards: -0.612, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.268', 'FRAGCOUNT': '0.000', 'AMMO2': '0.006', 'AMMO5': '0.020', 'AMMO4': '0.029', 'WEAPON1': '0.040', 'weapon7': '0.052', 'weapon5': '0.082', 'AMMO3': '0.087', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.140', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon2': '0.854', 'DAMAGECOUNT': '0.984', 'weapon3': '1.972'} [2024-08-05 10:02:20,250][00172] DAMAGECOUNT value on done: 388.0 [2024-08-05 10:02:20,256][00172] Sum rewards: -0.629, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.377', 'AMMO5': '0.010', 'AMMO2': '0.029', 'ARMOR': '0.044', 'weapon7': '0.066', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'AMMO6': '0.160', 'AMMO7': '0.160', 'HITCOUNT': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.462', 'DAMAGECOUNT': '0.705', 'FRAGCOUNT': '1.000', 'weapon2': '1.052', 'weapon3': '1.476'} [2024-08-05 10:02:20,505][00171] DAMAGECOUNT value on done: 165.0 [2024-08-05 10:02:20,507][00171] Sum rewards: -0.770, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.746', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'HITCOUNT': '0.080', 'AMMO4': '0.092', 'AMMO3': '0.103', 'DAMAGECOUNT': '0.237', 'WEAPON4': '0.250', 'weapon4': '0.372', 'WEAPON3': '0.450', 'ARMOR': '0.514', 'FRAGCOUNT': '1.000', 'weapon2': '1.074', 'weapon3': '1.724'} [2024-08-05 10:02:20,974][00163] DAMAGECOUNT value on done: 285.0 [2024-08-05 10:02:20,975][00163] Sum rewards: -2.046, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.114', 'weapon4': '0.008', 'AMMO2': '0.013', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.116', 'HITCOUNT': '0.130', 'weapon5': '0.132', 'DAMAGECOUNT': '0.285', 'WEAPON5': '0.300', 'ARMOR': '0.436', 'WEAPON3': '0.550', 'weapon2': '0.914', 'weapon3': '1.534'} [2024-08-05 10:02:21,452][00157] Updated weights for policy 0, policy_version 770 (0.0023) [2024-08-05 10:02:21,583][00156] DAMAGECOUNT value on done: 105.0 [2024-08-05 10:02:21,584][00156] Sum rewards: -6.530, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.282', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.103', 'HITCOUNT': '0.110', 'AMMO3': '0.113', 'weapon4': '0.182', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.315', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'weapon3': '1.376', 'weapon2': '1.504'} [2024-08-05 10:02:21,620][00167] DAMAGECOUNT value on done: 398.0 [2024-08-05 10:02:21,621][00167] Sum rewards: -7.018, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.114', 'AMMO2': '0.013', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'weapon5': '0.042', 'AMMO4': '0.066', 'AMMO3': '0.106', 'HITCOUNT': '0.130', 'weapon7': '0.130', 'weapon4': '0.194', 'WEAPON4': '0.250', 'AMMO6': '0.280', 'AMMO7': '0.280', 'WEAPON7': '0.400', 'WEAPON5': '0.400', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.903', 'weapon3': '1.234', 'weapon2': '1.436'} [2024-08-05 10:02:21,896][00169] DAMAGECOUNT value on done: 515.0 [2024-08-05 10:02:21,904][00169] Sum rewards: -4.491, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.598', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'ARMOR': '0.032', 'weapon5': '0.044', 'weapon4': '0.094', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'HITCOUNT': '0.230', 'DAMAGECOUNT': '0.735', 'WEAPON3': '0.750', 'weapon2': '1.282', 'weapon3': '1.604', 'FRAGCOUNT': '3.000'} [2024-08-05 10:02:22,034][00161] DAMAGECOUNT value on done: 200.0 [2024-08-05 10:02:22,038][00161] Sum rewards: -7.435, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.028', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon5': '0.052', 'AMMO4': '0.058', 'HITCOUNT': '0.070', 'ARMOR': '0.090', 'AMMO3': '0.131', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.180', 'WEAPON4': '0.250', 'weapon4': '0.330', 'WEAPON3': '0.800', 'weapon3': '1.254', 'weapon2': '1.456'} [2024-08-05 10:02:22,249][00165] DAMAGECOUNT value on done: 241.0 [2024-08-05 10:02:22,253][00165] Sum rewards: -2.648, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.119', 'AMMO5': '0.015', 'weapon5': '0.036', 'AMMO2': '0.043', 'AMMO3': '0.135', 'HITCOUNT': '0.170', 'AMMO4': '0.213', 'weapon4': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'DAMAGECOUNT': '0.465', 'ARMOR': '0.506', 'WEAPON3': '0.750', 'weapon3': '1.306', 'weapon2': '1.486', 'FRAGCOUNT': '3.000'} [2024-08-05 10:02:22,979][00168] DAMAGECOUNT value on done: 472.0 [2024-08-05 10:02:23,020][00166] DAMAGECOUNT value on done: 475.0 [2024-08-05 10:02:23,024][00166] Sum rewards: -6.332, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.306', 'AMMO5': '0.014', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.066', 'AMMO4': '0.091', 'AMMO3': '0.168', 'HITCOUNT': '0.170', 'WEAPON5': '0.200', 'weapon4': '0.210', 'WEAPON4': '0.400', 'ARMOR': '0.540', 'DAMAGECOUNT': '0.660', 'WEAPON3': '0.850', 'weapon3': '0.868', 'weapon2': '1.948', 'FRAGCOUNT': '2.000'} [2024-08-05 10:02:23,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4915.2). Total num frames: 6316032. Throughput: 0: 1205.5. Samples: 1581336. Policy #0 lag: (min: 0.0, avg: 1.6, max: 4.0) [2024-08-05 10:02:23,357][00034] Avg episode reward: [(0, '-4.396')] [2024-08-05 10:02:23,426][00162] DAMAGECOUNT value on done: 265.0 [2024-08-05 10:02:24,678][00170] DAMAGECOUNT value on done: 368.0 [2024-08-05 10:02:24,687][00170] Sum rewards: -1.112, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.252', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'HITCOUNT': '0.100', 'AMMO3': '0.105', 'AMMO4': '0.107', 'weapon5': '0.238', 'WEAPON4': '0.250', 'weapon4': '0.320', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'ARMOR': '0.868', 'weapon3': '0.906', 'DAMAGECOUNT': '0.996', 'weapon2': '1.342', 'FRAGCOUNT': '2.000'} [2024-08-05 10:02:25,474][00164] DAMAGECOUNT value on done: 375.0 [2024-08-05 10:02:25,478][00164] Sum rewards: -2.351, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.095', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.006', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.030', 'AMMO3': '0.068', 'weapon4': '0.090', 'weapon5': '0.092', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.220', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.651', 'weapon3': '1.226', 'weapon2': '1.732'} [2024-08-05 10:02:25,563][00160] DAMAGECOUNT value on done: 637.0 [2024-08-05 10:02:25,564][00160] Sum rewards: -4.691, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.000', 'HEALTH': '-0.427', 'AMMO5': '0.012', 'AMMO2': '0.043', 'AMMO3': '0.084', 'weapon5': '0.142', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.214', 'AMMO4': '0.215', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'ARMOR': '0.880', 'weapon3': '0.938', 'DAMAGECOUNT': '1.116', 'weapon2': '1.662'} [2024-08-05 10:02:25,851][00158] DAMAGECOUNT value on done: 756.0 [2024-08-05 10:02:25,857][00158] Sum rewards: 1.525, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.710', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'weapon5': '0.038', 'AMMO4': '0.067', 'weapon7': '0.070', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO3': '0.165', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'HITCOUNT': '0.360', 'WEAPON4': '0.400', 'ARMOR': '0.485', 'weapon4': '0.510', 'WEAPON3': '0.900', 'weapon2': '1.046', 'weapon3': '1.376', 'DAMAGECOUNT': '1.893', 'FRAGCOUNT': '5.000'} [2024-08-05 10:02:26,505][00172] DAMAGECOUNT value on done: 311.0 [2024-08-05 10:02:26,511][00172] Sum rewards: -0.451, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.808', 'AMMO5': '0.009', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.057', 'weapon5': '0.060', 'AMMO3': '0.071', 'HITCOUNT': '0.120', 'weapon7': '0.166', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.250', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'ARMOR': '0.455', 'weapon4': '0.508', 'weapon3': '0.626', 'DAMAGECOUNT': '0.768', 'weapon2': '1.206', 'FRAGCOUNT': '3.000'} [2024-08-05 10:02:26,883][00171] DAMAGECOUNT value on done: 429.0 [2024-08-05 10:02:26,887][00171] Sum rewards: -8.247, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.536', 'weapon5': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'ARMOR': '0.028', 'AMMO2': '0.039', 'HITCOUNT': '0.060', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.120', 'AMMO3': '0.187', 'AMMO4': '0.193', 'weapon4': '0.444', 'WEAPON4': '0.450', 'weapon2': '0.918', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.100', 'weapon3': '1.622'} [2024-08-05 10:02:27,294][00163] DAMAGECOUNT value on done: 417.0 [2024-08-05 10:02:27,300][00163] Sum rewards: -4.613, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.061', 'weapon5': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.036', 'ARMOR': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'HITCOUNT': '0.150', 'AMMO4': '0.181', 'weapon4': '0.336', 'WEAPON4': '0.450', 'DAMAGECOUNT': '0.585', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.258', 'weapon2': '1.442'} [2024-08-05 10:02:27,954][00156] DAMAGECOUNT value on done: 461.0 [2024-08-05 10:02:27,963][00156] Sum rewards: -9.603, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.942', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'AMMO2': '0.040', 'weapon5': '0.068', 'AMMO4': '0.200', 'AMMO3': '0.213', 'HITCOUNT': '0.250', 'weapon4': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'ARMOR': '0.424', 'DAMAGECOUNT': '0.825', 'WEAPON3': '0.900', 'weapon3': '0.912', 'weapon2': '1.714', 'FRAGCOUNT': '3.000'} [2024-08-05 10:02:28,114][00167] DAMAGECOUNT value on done: 295.0 [2024-08-05 10:02:28,117][00167] Sum rewards: 0.116, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.826', 'AMMO5': '0.010', 'AMMO2': '0.021', 'ARMOR': '0.056', 'AMMO3': '0.078', 'weapon5': '0.104', 'AMMO4': '0.104', 'HITCOUNT': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.284', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.525', 'weapon3': '1.112', 'weapon2': '1.678', 'FRAGCOUNT': '2.000'} [2024-08-05 10:02:28,118][00159] DAMAGECOUNT value on done: 508.0 [2024-08-05 10:02:28,122][00159] Sum rewards: -1.121, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.964', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon4': '0.064', 'AMMO3': '0.091', 'AMMO4': '0.092', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon7': '0.158', 'HITCOUNT': '0.180', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.053', 'weapon3': '1.254', 'weapon2': '1.404', 'FRAGCOUNT': '3.000'} [2024-08-05 10:02:28,355][00034] Fps is (10 sec: 4915.3, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 6340608. Throughput: 0: 1211.4. Samples: 1588664. Policy #0 lag: (min: 0.0, avg: 2.3, max: 4.0) [2024-08-05 10:02:28,357][00034] Avg episode reward: [(0, '-4.283')] [2024-08-05 10:02:28,512][00165] DAMAGECOUNT value on done: 398.0 [2024-08-05 10:02:28,517][00165] Sum rewards: 0.565, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.508', 'AMMO5': '0.006', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.048', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'WEAPON5': '0.150', 'HITCOUNT': '0.200', 'weapon4': '0.218', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.810', 'weapon2': '1.054', 'weapon3': '1.856', 'FRAGCOUNT': '4.000'} [2024-08-05 10:02:28,567][00161] DAMAGECOUNT value on done: 287.0 [2024-08-05 10:02:28,568][00161] Sum rewards: -4.340, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.854', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.008', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.020', 'ARMOR': '0.052', 'AMMO4': '0.075', 'weapon7': '0.096', 'AMMO3': '0.119', 'HITCOUNT': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon4': '0.156', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.357', 'WEAPON3': '0.700', 'weapon3': '1.300', 'weapon2': '1.436'} [2024-08-05 10:02:29,159][00168] DAMAGECOUNT value on done: 606.0 [2024-08-05 10:02:29,164][00168] Sum rewards: -2.136, reward structure: {'DEATHCOUNT': '-11.250', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.102', 'AMMO3': '0.128', 'HEALTH': '0.145', 'AMMO4': '0.187', 'WEAPON4': '0.200', 'weapon4': '0.230', 'WEAPON5': '0.250', 'HITCOUNT': '0.320', 'WEAPON3': '0.700', 'weapon2': '0.978', 'weapon3': '1.598', 'DAMAGECOUNT': '1.716', 'FRAGCOUNT': '2.500'} [2024-08-05 10:02:29,610][00166] DAMAGECOUNT value on done: 536.0 [2024-08-05 10:02:29,614][00166] Sum rewards: -1.986, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.280', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'weapon4': '0.042', 'AMMO4': '0.062', 'ARMOR': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.136', 'HITCOUNT': '0.240', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.978', 'weapon2': '1.302', 'weapon3': '1.742', 'FRAGCOUNT': '2.000'} [2024-08-05 10:02:29,738][00169] DAMAGECOUNT value on done: 500.0 [2024-08-05 10:02:29,741][00169] Sum rewards: -0.944, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.304', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.012', 'AMMO3': '0.098', 'weapon5': '0.128', 'WEAPON5': '0.150', 'HITCOUNT': '0.230', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.215', 'weapon2': '1.242', 'weapon3': '1.874'} [2024-08-05 10:02:30,878][00162] DAMAGECOUNT value on done: 233.0 [2024-08-05 10:02:30,880][00162] Sum rewards: -3.421, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.017', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'HITCOUNT': '0.070', 'AMMO3': '0.071', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'weapon5': '0.200', 'HEALTH': '0.232', 'DAMAGECOUNT': '0.240', 'weapon4': '0.258', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'weapon3': '1.006', 'weapon2': '1.488'} [2024-08-05 10:02:31,894][00170] DAMAGECOUNT value on done: 491.0 [2024-08-05 10:02:31,898][00170] Sum rewards: -5.554, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.476', 'AMMO2': '0.006', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.030', 'ARMOR': '0.052', 'weapon5': '0.074', 'AMMO3': '0.116', 'weapon4': '0.160', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.762', 'FRAGCOUNT': '1.000', 'weapon3': '1.210', 'weapon2': '1.556'} [2024-08-05 10:02:31,956][00164] DAMAGECOUNT value on done: 388.0 [2024-08-05 10:02:31,959][00164] Sum rewards: -5.656, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.796', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'HITCOUNT': '0.130', 'AMMO4': '0.163', 'weapon4': '0.286', 'ARMOR': '0.488', 'WEAPON4': '0.500', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.302', 'weapon2': '1.342'} [2024-08-05 10:02:32,069][00158] DAMAGECOUNT value on done: 542.0 [2024-08-05 10:02:32,072][00158] Sum rewards: -5.822, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.630', 'ARMOR': '0.008', 'AMMO2': '0.014', 'AMMO5': '0.018', 'AMMO4': '0.070', 'HITCOUNT': '0.140', 'weapon5': '0.146', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon4': '0.274', 'WEAPON5': '0.350', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.950', 'weapon2': '1.234', 'DAMAGECOUNT': '1.311', 'weapon3': '1.394'} [2024-08-05 10:02:32,074][00160] DAMAGECOUNT value on done: 325.0 [2024-08-05 10:02:33,081][00172] DAMAGECOUNT value on done: 340.0 [2024-08-05 10:02:33,085][00172] Sum rewards: -1.511, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'weapon5': '0.066', 'AMMO3': '0.084', 'AMMO4': '0.093', 'HEALTH': '0.097', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.420', 'weapon4': '0.532', 'weapon3': '1.156', 'weapon2': '1.466', 'FRAGCOUNT': '2.000'} [2024-08-05 10:02:33,149][00171] DAMAGECOUNT value on done: 543.0 [2024-08-05 10:02:33,150][00171] Sum rewards: -8.962, reward structure: {'DEATHCOUNT': '-12.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.770', 'AMMO5': '0.019', 'AMMO2': '0.033', 'weapon5': '0.064', 'ARMOR': '0.124', 'HITCOUNT': '0.140', 'AMMO3': '0.141', 'AMMO4': '0.166', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.424', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.894', 'weapon2': '1.256', 'weapon3': '1.296'} [2024-08-05 10:02:33,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 6365184. Throughput: 0: 1220.4. Samples: 1596096. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 10:02:33,359][00034] Avg episode reward: [(0, '-4.326')] [2024-08-05 10:02:33,510][00163] DAMAGECOUNT value on done: 389.0 [2024-08-05 10:02:33,512][00163] Sum rewards: -6.569, reward structure: {'DEATHCOUNT': '-10.500', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.361', 'AMMO2': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'ARMOR': '0.036', 'weapon5': '0.058', 'AMMO4': '0.059', 'AMMO3': '0.107', 'HITCOUNT': '0.110', 'weapon4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.500', 'weapon3': '1.184', 'weapon2': '1.716'} [2024-08-05 10:02:34,520][00159] DAMAGECOUNT value on done: 371.0 [2024-08-05 10:02:34,523][00159] Sum rewards: -7.027, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.915', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.060', 'weapon7': '0.062', 'AMMO4': '0.075', 'HITCOUNT': '0.080', 'AMMO3': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.212', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.603', 'weapon3': '1.118', 'weapon2': '1.306'} [2024-08-05 10:02:34,988][00165] DAMAGECOUNT value on done: 525.0 [2024-08-05 10:02:34,992][00165] Sum rewards: -6.291, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.388', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.002', 'AMMO5': '0.008', 'AMMO4': '0.011', 'ARMOR': '0.028', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.054', 'weapon5': '0.066', 'WEAPON5': '0.150', 'HITCOUNT': '0.160', 'AMMO3': '0.175', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.825', 'weapon2': '1.516', 'weapon3': '1.522'} [2024-08-05 10:02:35,052][00156] DAMAGECOUNT value on done: 468.0 [2024-08-05 10:02:35,055][00156] Sum rewards: -4.875, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.672', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.042', 'weapon4': '0.116', 'AMMO3': '0.133', 'weapon5': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO4': '0.209', 'HITCOUNT': '0.290', 'ARMOR': '0.440', 'WEAPON3': '0.600', 'weapon3': '0.954', 'DAMAGECOUNT': '1.212', 'FRAGCOUNT': '1.500', 'weapon2': '1.918'} [2024-08-05 10:02:35,132][00167] DAMAGECOUNT value on done: 521.0 [2024-08-05 10:02:35,133][00167] Sum rewards: -4.270, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.167', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'AMMO4': '0.109', 'weapon4': '0.126', 'weapon5': '0.136', 'AMMO3': '0.176', 'HITCOUNT': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.666', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '1.066', 'weapon3': '1.786'} [2024-08-05 10:02:35,595][00161] DAMAGECOUNT value on done: 620.0 [2024-08-05 10:02:35,602][00161] Sum rewards: -0.319, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.915', 'AMMO5': '0.014', 'AMMO2': '0.031', 'WEAPON1': '0.050', 'HITCOUNT': '0.130', 'AMMO3': '0.138', 'weapon5': '0.146', 'AMMO4': '0.154', 'weapon4': '0.284', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.796', 'WEAPON3': '0.800', 'ARMOR': '0.963', 'DAMAGECOUNT': '1.368', 'weapon3': '1.772', 'FRAGCOUNT': '3.000'} [2024-08-05 10:02:35,918][00168] DAMAGECOUNT value on done: 185.0 [2024-08-05 10:02:35,922][00168] Sum rewards: -4.909, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.334', 'ARMOR': '0.008', 'AMMO5': '0.009', 'HITCOUNT': '0.010', 'AMMO2': '0.013', 'DAMAGECOUNT': '0.015', 'WEAPON1': '0.040', 'weapon5': '0.048', 'weapon7': '0.048', 'AMMO4': '0.064', 'weapon4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.600', 'weapon2': '1.192', 'weapon3': '1.638'} [2024-08-05 10:02:36,563][00166] DAMAGECOUNT value on done: 212.0 [2024-08-05 10:02:36,564][00166] Sum rewards: -2.575, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.303', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'ARMOR': '0.032', 'weapon4': '0.046', 'HITCOUNT': '0.050', 'WEAPON5': '0.050', 'weapon7': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.700', 'weapon2': '0.914', 'FRAGCOUNT': '1.000', 'weapon3': '2.068'} [2024-08-05 10:02:36,996][00157] Updated weights for policy 0, policy_version 780 (0.0021) [2024-08-05 10:02:37,096][00162] DAMAGECOUNT value on done: 300.0 [2024-08-05 10:02:37,097][00162] Sum rewards: -8.717, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.114', 'ARMOR': '0.008', 'AMMO2': '0.017', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'HITCOUNT': '0.080', 'AMMO4': '0.085', 'weapon5': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.154', 'weapon4': '0.206', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.321', 'WEAPON3': '0.800', 'weapon3': '0.934', 'FRAGCOUNT': '1.000', 'weapon2': '1.980'} [2024-08-05 10:02:38,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4915.2). Total num frames: 6389760. Throughput: 0: 1219.0. Samples: 1599728. Policy #0 lag: (min: 0.0, avg: 2.1, max: 5.0) [2024-08-05 10:02:38,357][00034] Avg episode reward: [(0, '-4.337')] [2024-08-05 10:02:38,409][00164] DAMAGECOUNT value on done: 209.0 [2024-08-05 10:02:38,563][00160] DAMAGECOUNT value on done: 674.0 [2024-08-05 10:02:38,567][00160] Sum rewards: -4.707, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.023', 'AMMO2': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.022', 'ARMOR': '0.024', 'WEAPON4': '0.050', 'weapon4': '0.058', 'AMMO3': '0.093', 'HITCOUNT': '0.110', 'weapon5': '0.178', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.270', 'WEAPON3': '0.500', 'weapon3': '1.272', 'weapon2': '1.454'} [2024-08-05 10:02:38,979][00158] DAMAGECOUNT value on done: 289.0 [2024-08-05 10:02:38,984][00158] Sum rewards: -4.560, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.136', 'AMMO2': '0.007', 'weapon5': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.034', 'WEAPON4': '0.100', 'weapon4': '0.126', 'HITCOUNT': '0.130', 'AMMO3': '0.148', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.180', 'weapon3': '1.758'} [2024-08-05 10:02:39,537][00172] DAMAGECOUNT value on done: 677.0 [2024-08-05 10:02:39,538][00172] Sum rewards: -0.348, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.559', 'AMMO5': '0.015', 'AMMO2': '0.039', 'ARMOR': '0.048', 'AMMO3': '0.089', 'weapon5': '0.108', 'weapon7': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.195', 'WEAPON7': '0.200', 'HITCOUNT': '0.220', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.446', 'WEAPON4': '0.500', 'weapon2': '0.916', 'DAMAGECOUNT': '1.071', 'weapon3': '1.312', 'FRAGCOUNT': '1.500'} [2024-08-05 10:02:40,109][00171] DAMAGECOUNT value on done: 387.0 [2024-08-05 10:02:40,115][00171] Sum rewards: -2.409, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.540', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon7': '0.082', 'AMMO3': '0.088', 'AMMO4': '0.099', 'HITCOUNT': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon3': '1.080', 'weapon2': '1.794'} [2024-08-05 10:02:40,374][00163] DAMAGECOUNT value on done: 284.0 [2024-08-05 10:02:41,597][00165] DAMAGECOUNT value on done: 540.0 [2024-08-05 10:02:41,601][00165] Sum rewards: -4.909, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO5': '0.020', 'ARMOR': '0.044', 'WEAPON4': '0.050', 'weapon4': '0.076', 'AMMO4': '0.096', 'AMMO3': '0.099', 'HITCOUNT': '0.130', 'weapon5': '0.134', 'WEAPON5': '0.400', 'DAMAGECOUNT': '0.480', 'HEALTH': '0.486', 'WEAPON3': '0.550', 'weapon3': '1.442', 'weapon2': '1.554'} [2024-08-05 10:02:42,597][00156] DAMAGECOUNT value on done: 470.0 [2024-08-05 10:02:42,601][00156] Sum rewards: -4.348, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.710', 'weapon5': '0.016', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'ARMOR': '0.032', 'weapon4': '0.082', 'AMMO4': '0.104', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'HITCOUNT': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.230', 'weapon2': '1.504', 'weapon3': '1.594', 'FRAGCOUNT': '3.000'} [2024-08-05 10:02:42,642][00167] DAMAGECOUNT value on done: 376.0 [2024-08-05 10:02:42,645][00167] Sum rewards: -5.512, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.360', 'FRAGCOUNT': '0.000', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.033', 'weapon5': '0.090', 'AMMO3': '0.142', 'WEAPON5': '0.150', 'weapon4': '0.156', 'HITCOUNT': '0.160', 'AMMO4': '0.165', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.468', 'WEAPON3': '0.650', 'weapon3': '1.378', 'weapon2': '1.672'} [2024-08-05 10:02:43,069][00161] DAMAGECOUNT value on done: 463.0 [2024-08-05 10:02:43,074][00161] Sum rewards: 0.280, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.086', 'AMMO2': '0.008', 'AMMO5': '0.017', 'ARMOR': '0.032', 'AMMO4': '0.039', 'weapon5': '0.118', 'AMMO3': '0.154', 'HITCOUNT': '0.240', 'WEAPON5': '0.250', 'WEAPON3': '0.700', 'weapon2': '1.050', 'DAMAGECOUNT': '1.098', 'FRAGCOUNT': '2.000', 'weapon3': '2.160'} [2024-08-05 10:02:43,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4915.2). Total num frames: 6414336. Throughput: 0: 1219.9. Samples: 1607168. Policy #0 lag: (min: 0.0, avg: 1.8, max: 5.0) [2024-08-05 10:02:43,357][00034] Avg episode reward: [(0, '-4.367')] [2024-08-05 10:02:43,917][00166] DAMAGECOUNT value on done: 618.0 [2024-08-05 10:02:43,924][00166] Sum rewards: -2.496, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.450', 'weapon7': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'ARMOR': '0.056', 'weapon5': '0.082', 'AMMO4': '0.094', 'AMMO3': '0.105', 'weapon4': '0.142', 'HITCOUNT': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'DAMAGECOUNT': '0.690', 'WEAPON3': '0.700', 'weapon3': '1.388', 'weapon2': '1.444', 'FRAGCOUNT': '2.000'} [2024-08-05 10:02:44,620][00164] DAMAGECOUNT value on done: 354.0 [2024-08-05 10:02:44,624][00164] Sum rewards: -1.024, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.760', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'weapon5': '0.014', 'AMMO3': '0.123', 'HITCOUNT': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.166', 'ARMOR': '0.530', 'DAMAGECOUNT': '0.597', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.226', 'weapon3': '1.706'} [2024-08-05 10:02:44,697][00160] DAMAGECOUNT value on done: 190.0 [2024-08-05 10:02:44,707][00160] Sum rewards: -4.382, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.680', 'FRAGCOUNT': '-0.500', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.039', 'AMMO3': '0.058', 'HITCOUNT': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.130', 'weapon7': '0.144', 'AMMO6': '0.220', 'AMMO7': '0.220', 'DAMAGECOUNT': '0.225', 'weapon4': '0.248', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'weapon3': '0.580', 'weapon2': '1.332'} [2024-08-05 10:02:46,026][00158] DAMAGECOUNT value on done: 630.0 [2024-08-05 10:02:46,030][00158] Sum rewards: -4.220, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.164', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'weapon5': '0.032', 'ARMOR': '0.044', 'AMMO4': '0.062', 'HITCOUNT': '0.070', 'weapon4': '0.086', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.615', 'WEAPON3': '0.750', 'weapon2': '0.910', 'FRAGCOUNT': '1.000', 'weapon3': '1.810'} [2024-08-05 10:02:47,371][00171] DAMAGECOUNT value on done: 367.0 [2024-08-05 10:02:47,387][00171] Sum rewards: 0.134, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.560', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'weapon5': '0.058', 'AMMO3': '0.093', 'HITCOUNT': '0.180', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.711', 'weapon2': '1.300', 'weapon3': '1.552', 'FRAGCOUNT': '2.000'} [2024-08-05 10:02:47,788][00163] DAMAGECOUNT value on done: 661.0 [2024-08-05 10:02:47,792][00163] Sum rewards: -0.771, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.710', 'AMMO2': '0.005', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.026', 'weapon5': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'weapon4': '0.244', 'WEAPON5': '0.250', 'HITCOUNT': '0.290', 'ARMOR': '0.530', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.029', 'weapon2': '1.352', 'weapon3': '1.474', 'FRAGCOUNT': '3.000'} [2024-08-05 10:02:48,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4915.2). Total num frames: 6438912. Throughput: 0: 1203.7. Samples: 1613896. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 10:02:48,357][00034] Avg episode reward: [(0, '-4.304')] [2024-08-05 10:02:48,862][00165] DAMAGECOUNT value on done: 546.0 [2024-08-05 10:02:48,863][00165] Sum rewards: -2.813, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.280', 'AMMO2': '0.009', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'AMMO4': '0.043', 'AMMO3': '0.110', 'HITCOUNT': '0.160', 'weapon5': '0.182', 'WEAPON4': '0.200', 'weapon4': '0.224', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon3': '1.168', 'DAMAGECOUNT': '1.233', 'weapon2': '1.502', 'FRAGCOUNT': '3.000'} [2024-08-05 10:02:49,852][00156] DAMAGECOUNT value on done: 304.0 [2024-08-05 10:02:49,855][00156] Sum rewards: -4.994, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.162', 'WEAPON1': '0.010', 'AMMO2': '0.036', 'HITCOUNT': '0.160', 'AMMO4': '0.178', 'AMMO3': '0.211', 'weapon4': '0.278', 'WEAPON4': '0.400', 'ARMOR': '0.525', 'DAMAGECOUNT': '0.702', 'WEAPON3': '1.050', 'weapon2': '1.332', 'weapon3': '1.536', 'FRAGCOUNT': '2.000'} [2024-08-05 10:02:49,874][00167] DAMAGECOUNT value on done: 525.0 [2024-08-05 10:02:49,882][00167] Sum rewards: -7.016, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.950', 'AMMO2': '0.019', 'AMMO5': '0.027', 'WEAPON1': '0.030', 'ARMOR': '0.044', 'weapon5': '0.076', 'AMMO4': '0.093', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'weapon4': '0.288', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.888', 'WEAPON3': '1.050', 'weapon2': '1.356', 'weapon3': '1.370', 'FRAGCOUNT': '1.500'} [2024-08-05 10:02:50,487][00161] DAMAGECOUNT value on done: 417.0 [2024-08-05 10:02:50,491][00161] Sum rewards: -6.714, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.200', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.006', 'weapon5': '0.028', 'WEAPON1': '0.030', 'ARMOR': '0.064', 'weapon4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'WEAPON5': '0.150', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.550', 'weapon3': '1.440', 'weapon2': '1.724'} [2024-08-05 10:02:51,558][00166] DAMAGECOUNT value on done: 315.0 [2024-08-05 10:02:52,692][00158] DAMAGECOUNT value on done: 256.0 [2024-08-05 10:02:53,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4915.2). Total num frames: 6463488. Throughput: 0: 1205.3. Samples: 1617640. Policy #0 lag: (min: 0.0, avg: 2.2, max: 4.0) [2024-08-05 10:02:53,357][00034] Avg episode reward: [(0, '-4.405')] [2024-08-05 10:02:53,822][00171] DAMAGECOUNT value on done: 521.0 [2024-08-05 10:02:53,830][00171] Sum rewards: -10.230, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.500', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.008', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.044', 'AMMO4': '0.062', 'weapon4': '0.064', 'WEAPON4': '0.100', 'HITCOUNT': '0.130', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.513', 'WEAPON3': '0.750', 'weapon3': '1.444', 'weapon2': '1.764'} [2024-08-05 10:02:53,975][00163] DAMAGECOUNT value on done: 727.0 [2024-08-05 10:02:53,976][00163] Sum rewards: 4.376, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.052', 'AMMO3': '0.060', 'AMMO4': '0.088', 'weapon4': '0.114', 'WEAPON3': '0.300', 'HITCOUNT': '0.360', 'weapon2': '1.236', 'DAMAGECOUNT': '1.305', 'HEALTH': '1.310', 'weapon3': '1.410', 'FRAGCOUNT': '4.000'} [2024-08-05 10:02:54,577][00157] Updated weights for policy 0, policy_version 790 (0.0027) [2024-08-05 10:02:56,468][00156] DAMAGECOUNT value on done: 372.0 [2024-08-05 10:02:56,469][00156] Sum rewards: 0.178, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.474', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.010', 'weapon5': '0.016', 'WEAPON4': '0.050', 'weapon4': '0.096', 'HITCOUNT': '0.100', 'ARMOR': '0.108', 'AMMO3': '0.114', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.270', 'WEAPON3': '0.550', 'weapon3': '1.456', 'weapon2': '1.472', 'FRAGCOUNT': '3.000'} [2024-08-05 10:02:56,496][00167] DAMAGECOUNT value on done: 260.0 [2024-08-05 10:02:56,499][00167] Sum rewards: -5.259, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.778', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'HITCOUNT': '0.140', 'AMMO4': '0.152', 'weapon4': '0.176', 'WEAPON4': '0.200', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.405', 'ARMOR': '0.519', 'FRAGCOUNT': '1.000', 'weapon3': '1.414', 'weapon2': '1.638'} [2024-08-05 10:02:56,915][00161] DAMAGECOUNT value on done: 531.0 [2024-08-05 10:02:56,921][00161] Sum rewards: -4.299, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.586', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.100', 'AMMO3': '0.177', 'HITCOUNT': '0.380', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'weapon2': '0.960', 'DAMAGECOUNT': '1.248', 'FRAGCOUNT': '2.000', 'weapon3': '2.090'} [2024-08-05 10:02:58,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4915.2). Total num frames: 6488064. Throughput: 0: 1207.3. Samples: 1625208. Policy #0 lag: (min: 0.0, avg: 2.1, max: 4.0) [2024-08-05 10:02:58,357][00034] Avg episode reward: [(0, '-4.300')] [2024-08-05 10:02:58,992][00158] DAMAGECOUNT value on done: 264.0 [2024-08-05 10:02:58,998][00158] Sum rewards: -3.874, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.468', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'ARMOR': '0.024', 'AMMO2': '0.032', 'weapon5': '0.042', 'AMMO3': '0.116', 'HITCOUNT': '0.140', 'AMMO4': '0.158', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.250', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.342', 'weapon2': '1.738'} [2024-08-05 10:03:00,157][00171] DAMAGECOUNT value on done: 394.0 [2024-08-05 10:03:00,160][00171] Sum rewards: -11.282, reward structure: {'DEATHCOUNT': '-12.000', 'FRAGCOUNT': '-3.500', 'HEALTH': '-1.032', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'weapon5': '0.060', 'AMMO4': '0.099', 'AMMO3': '0.123', 'weapon4': '0.148', 'HITCOUNT': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.657', 'weapon2': '1.402', 'weapon3': '1.522'} [2024-08-05 10:03:03,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4915.2). Total num frames: 6512640. Throughput: 0: 1227.0. Samples: 1632832. Policy #0 lag: (min: 0.0, avg: 2.0, max: 4.0) [2024-08-05 10:03:03,357][00034] Avg episode reward: [(0, '-4.463')] [2024-08-05 10:03:03,800][00156] DAMAGECOUNT value on done: 562.0 [2024-08-05 10:03:03,802][00156] Sum rewards: -3.133, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.370', 'weapon5': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'ARMOR': '0.076', 'weapon7': '0.078', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.154', 'WEAPON7': '0.200', 'HITCOUNT': '0.260', 'WEAPON4': '0.350', 'FRAGCOUNT': '0.500', 'weapon4': '0.504', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.050', 'weapon3': '1.336', 'weapon2': '1.444'} [2024-08-05 10:03:08,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4915.2). Total num frames: 6537216. Throughput: 0: 1227.2. Samples: 1636560. Policy #0 lag: (min: 0.0, avg: 1.8, max: 5.0) [2024-08-05 10:03:08,357][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:03:11,821][00157] Updated weights for policy 0, policy_version 800 (0.0020) [2024-08-05 10:03:13,355][00034] Fps is (10 sec: 5734.4, 60 sec: 5051.7, 300 sec: 4943.0). Total num frames: 6569984. Throughput: 0: 1234.7. Samples: 1644224. Policy #0 lag: (min: 0.0, avg: 1.8, max: 4.0) [2024-08-05 10:03:13,357][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:03:18,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4915.2). Total num frames: 6586368. Throughput: 0: 1234.8. Samples: 1651664. Policy #0 lag: (min: 0.0, avg: 1.9, max: 5.0) [2024-08-05 10:03:18,357][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:03:23,356][00034] Fps is (10 sec: 4095.8, 60 sec: 4915.2, 300 sec: 4915.3). Total num frames: 6610944. Throughput: 0: 1223.8. Samples: 1654800. Policy #0 lag: (min: 0.0, avg: 2.2, max: 4.0) [2024-08-05 10:03:23,357][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:03:23,366][00136] Saving /kaggle/working/train_dir/default_experiment/checkpoint_p0/checkpoint_000000807_6610944.pth... [2024-08-05 10:03:23,551][00136] Removing /kaggle/working/train_dir/default_experiment/checkpoint_p0/checkpoint_000000663_5431296.pth [2024-08-05 10:03:27,388][00157] Updated weights for policy 0, policy_version 810 (0.0021) [2024-08-05 10:03:28,356][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4915.2). Total num frames: 6635520. Throughput: 0: 1225.4. Samples: 1662312. Policy #0 lag: (min: 0.0, avg: 2.1, max: 4.0) [2024-08-05 10:03:28,357][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:03:33,356][00034] Fps is (10 sec: 4915.3, 60 sec: 4915.2, 300 sec: 4915.2). Total num frames: 6660096. Throughput: 0: 1245.9. Samples: 1669960. Policy #0 lag: (min: 0.0, avg: 2.0, max: 5.0) [2024-08-05 10:03:33,358][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:03:38,356][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4915.2). Total num frames: 6684672. Throughput: 0: 1245.5. Samples: 1673688. Policy #0 lag: (min: 0.0, avg: 2.0, max: 5.0) [2024-08-05 10:03:38,357][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:03:43,356][00034] Fps is (10 sec: 4915.3, 60 sec: 4915.2, 300 sec: 4887.4). Total num frames: 6709248. Throughput: 0: 1250.7. Samples: 1681488. Policy #0 lag: (min: 0.0, avg: 2.1, max: 6.0) [2024-08-05 10:03:43,358][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:03:43,597][00157] Updated weights for policy 0, policy_version 820 (0.0020) [2024-08-05 10:03:48,356][00034] Fps is (10 sec: 4915.1, 60 sec: 4915.2, 300 sec: 4915.2). Total num frames: 6733824. Throughput: 0: 1245.9. Samples: 1688896. Policy #0 lag: (min: 0.0, avg: 2.3, max: 5.0) [2024-08-05 10:03:48,358][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:03:53,356][00034] Fps is (10 sec: 4915.1, 60 sec: 4915.2, 300 sec: 4915.2). Total num frames: 6758400. Throughput: 0: 1243.0. Samples: 1692496. Policy #0 lag: (min: 0.0, avg: 1.8, max: 5.0) [2024-08-05 10:03:53,358][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:03:58,355][00034] Fps is (10 sec: 5734.6, 60 sec: 5051.7, 300 sec: 4943.0). Total num frames: 6791168. Throughput: 0: 1232.7. Samples: 1699696. Policy #0 lag: (min: 0.0, avg: 1.9, max: 4.0) [2024-08-05 10:03:58,359][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:04:00,483][00157] Updated weights for policy 0, policy_version 830 (0.0020) [2024-08-05 10:04:03,356][00034] Fps is (10 sec: 4915.3, 60 sec: 4915.2, 300 sec: 4915.2). Total num frames: 6807552. Throughput: 0: 1238.9. Samples: 1707416. Policy #0 lag: (min: 0.0, avg: 2.4, max: 4.0) [2024-08-05 10:04:03,357][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:04:08,355][00034] Fps is (10 sec: 4096.0, 60 sec: 4915.2, 300 sec: 4915.2). Total num frames: 6832128. Throughput: 0: 1252.5. Samples: 1711160. Policy #0 lag: (min: 0.0, avg: 2.4, max: 6.0) [2024-08-05 10:04:08,357][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:04:13,356][00034] Fps is (10 sec: 5734.3, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 6864896. Throughput: 0: 1255.5. Samples: 1718808. Policy #0 lag: (min: 0.0, avg: 1.9, max: 4.0) [2024-08-05 10:04:13,358][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:04:17,024][00157] Updated weights for policy 0, policy_version 840 (0.0023) [2024-08-05 10:04:18,356][00034] Fps is (10 sec: 5734.4, 60 sec: 5051.7, 300 sec: 4943.0). Total num frames: 6889472. Throughput: 0: 1251.2. Samples: 1726264. Policy #0 lag: (min: 0.0, avg: 1.9, max: 5.0) [2024-08-05 10:04:18,358][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:04:23,356][00034] Fps is (10 sec: 4096.1, 60 sec: 4915.2, 300 sec: 4887.4). Total num frames: 6905856. Throughput: 0: 1250.3. Samples: 1729952. Policy #0 lag: (min: 0.0, avg: 2.3, max: 5.0) [2024-08-05 10:04:23,357][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:04:28,356][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4943.0). Total num frames: 6938624. Throughput: 0: 1230.2. Samples: 1736848. Policy #0 lag: (min: 0.0, avg: 2.0, max: 4.0) [2024-08-05 10:04:28,358][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:04:33,214][00157] Updated weights for policy 0, policy_version 850 (0.0020) [2024-08-05 10:04:33,355][00034] Fps is (10 sec: 5734.5, 60 sec: 5051.8, 300 sec: 4943.0). Total num frames: 6963200. Throughput: 0: 1235.7. Samples: 1744504. Policy #0 lag: (min: 0.0, avg: 2.0, max: 4.0) [2024-08-05 10:04:33,358][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:04:38,356][00034] Fps is (10 sec: 4096.0, 60 sec: 4915.2, 300 sec: 4915.2). Total num frames: 6979584. Throughput: 0: 1237.2. Samples: 1748168. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 10:04:38,357][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:04:43,355][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4915.2). Total num frames: 7012352. Throughput: 0: 1248.2. Samples: 1755864. Policy #0 lag: (min: 0.0, avg: 2.3, max: 5.0) [2024-08-05 10:04:43,358][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:04:48,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4887.4). Total num frames: 7028736. Throughput: 0: 1241.2. Samples: 1763272. Policy #0 lag: (min: 0.0, avg: 2.4, max: 5.0) [2024-08-05 10:04:48,358][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:04:49,326][00157] Updated weights for policy 0, policy_version 860 (0.0027) [2024-08-05 10:04:53,355][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.8, 300 sec: 4943.0). Total num frames: 7061504. Throughput: 0: 1241.4. Samples: 1767024. Policy #0 lag: (min: 0.0, avg: 2.4, max: 5.0) [2024-08-05 10:04:53,357][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:04:58,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4887.4). Total num frames: 7077888. Throughput: 0: 1224.5. Samples: 1773912. Policy #0 lag: (min: 0.0, avg: 2.0, max: 5.0) [2024-08-05 10:04:58,357][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:05:03,356][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4915.2). Total num frames: 7110656. Throughput: 0: 1227.6. Samples: 1781504. Policy #0 lag: (min: 0.0, avg: 2.1, max: 5.0) [2024-08-05 10:05:03,357][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:05:06,245][00157] Updated weights for policy 0, policy_version 870 (0.0024) [2024-08-05 10:05:08,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4887.4). Total num frames: 7127040. Throughput: 0: 1227.7. Samples: 1785200. Policy #0 lag: (min: 0.0, avg: 2.3, max: 5.0) [2024-08-05 10:05:08,357][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:05:09,780][00167] Large shaping reward -2.534 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 10:05:13,356][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 7159808. Throughput: 0: 1243.2. Samples: 1792792. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 10:05:13,357][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:05:18,356][00034] Fps is (10 sec: 5734.4, 60 sec: 4915.2, 300 sec: 4915.2). Total num frames: 7184384. Throughput: 0: 1237.5. Samples: 1800192. Policy #0 lag: (min: 0.0, avg: 2.1, max: 5.0) [2024-08-05 10:05:18,357][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:05:22,764][00157] Updated weights for policy 0, policy_version 880 (0.0020) [2024-08-05 10:05:23,356][00034] Fps is (10 sec: 4915.1, 60 sec: 5051.7, 300 sec: 4915.2). Total num frames: 7208960. Throughput: 0: 1240.4. Samples: 1803984. Policy #0 lag: (min: 0.0, avg: 1.7, max: 4.0) [2024-08-05 10:05:23,358][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:05:23,367][00136] Saving /kaggle/working/train_dir/default_experiment/checkpoint_p0/checkpoint_000000880_7208960.pth... [2024-08-05 10:05:23,571][00136] Removing /kaggle/working/train_dir/default_experiment/checkpoint_p0/checkpoint_000000736_6029312.pth [2024-08-05 10:05:28,356][00034] Fps is (10 sec: 4096.0, 60 sec: 4778.7, 300 sec: 4887.4). Total num frames: 7225344. Throughput: 0: 1234.3. Samples: 1811408. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 10:05:28,360][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:05:33,355][00034] Fps is (10 sec: 4915.3, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 7258112. Throughput: 0: 1225.2. Samples: 1818408. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 10:05:33,360][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:05:38,355][00034] Fps is (10 sec: 4915.3, 60 sec: 4915.2, 300 sec: 4887.4). Total num frames: 7274496. Throughput: 0: 1225.2. Samples: 1822160. Policy #0 lag: (min: 0.0, avg: 2.0, max: 4.0) [2024-08-05 10:05:38,357][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:05:39,471][00157] Updated weights for policy 0, policy_version 890 (0.0020) [2024-08-05 10:05:43,356][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4915.2). Total num frames: 7307264. Throughput: 0: 1240.7. Samples: 1829744. Policy #0 lag: (min: 0.0, avg: 2.0, max: 4.0) [2024-08-05 10:05:43,357][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:05:48,355][00034] Fps is (10 sec: 5734.4, 60 sec: 5051.7, 300 sec: 4915.2). Total num frames: 7331840. Throughput: 0: 1235.9. Samples: 1837120. Policy #0 lag: (min: 0.0, avg: 2.0, max: 5.0) [2024-08-05 10:05:48,360][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:05:53,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 7356416. Throughput: 0: 1237.7. Samples: 1840896. Policy #0 lag: (min: 0.0, avg: 2.1, max: 5.0) [2024-08-05 10:05:53,357][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:05:55,989][00157] Updated weights for policy 0, policy_version 900 (0.0021) [2024-08-05 10:05:58,355][00034] Fps is (10 sec: 4096.0, 60 sec: 4915.2, 300 sec: 4887.4). Total num frames: 7372800. Throughput: 0: 1235.6. Samples: 1848392. Policy #0 lag: (min: 0.0, avg: 1.9, max: 4.0) [2024-08-05 10:05:58,357][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:06:03,356][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4915.2). Total num frames: 7405568. Throughput: 0: 1227.4. Samples: 1855424. Policy #0 lag: (min: 0.0, avg: 2.1, max: 4.0) [2024-08-05 10:06:03,357][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:06:06,059][00159] Large shaping reward 2.586 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5640000000000001, 188.0), ('weapon5', 0.002)] [2024-08-05 10:06:08,355][00034] Fps is (10 sec: 5734.4, 60 sec: 5051.7, 300 sec: 4915.2). Total num frames: 7430144. Throughput: 0: 1226.5. Samples: 1859176. Policy #0 lag: (min: 0.0, avg: 1.8, max: 4.0) [2024-08-05 10:06:08,357][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:06:12,312][00157] Updated weights for policy 0, policy_version 910 (0.0034) [2024-08-05 10:06:13,356][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4915.2). Total num frames: 7454720. Throughput: 0: 1230.0. Samples: 1866760. Policy #0 lag: (min: 0.0, avg: 1.9, max: 4.0) [2024-08-05 10:06:13,357][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:06:18,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4915.2). Total num frames: 7479296. Throughput: 0: 1239.5. Samples: 1874184. Policy #0 lag: (min: 0.0, avg: 2.2, max: 4.0) [2024-08-05 10:06:18,357][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:06:23,356][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 7503872. Throughput: 0: 1239.5. Samples: 1877936. Policy #0 lag: (min: 0.0, avg: 2.1, max: 5.0) [2024-08-05 10:06:23,358][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:06:24,516][00156] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 10:06:28,355][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4943.0). Total num frames: 7528448. Throughput: 0: 1237.5. Samples: 1885432. Policy #0 lag: (min: 0.0, avg: 1.6, max: 4.0) [2024-08-05 10:06:28,357][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:06:28,772][00157] Updated weights for policy 0, policy_version 920 (0.0020) [2024-08-05 10:06:33,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4915.2). Total num frames: 7553024. Throughput: 0: 1234.5. Samples: 1892672. Policy #0 lag: (min: 0.0, avg: 2.3, max: 5.0) [2024-08-05 10:06:33,357][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:06:38,355][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4943.0). Total num frames: 7577600. Throughput: 0: 1226.5. Samples: 1896088. Policy #0 lag: (min: 0.0, avg: 2.0, max: 5.0) [2024-08-05 10:06:38,359][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:06:43,356][00034] Fps is (10 sec: 4915.1, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 7602176. Throughput: 0: 1228.6. Samples: 1903680. Policy #0 lag: (min: 0.0, avg: 2.0, max: 5.0) [2024-08-05 10:06:43,360][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:06:45,949][00157] Updated weights for policy 0, policy_version 930 (0.0020) [2024-08-05 10:06:48,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 7626752. Throughput: 0: 1237.2. Samples: 1911096. Policy #0 lag: (min: 0.0, avg: 1.8, max: 4.0) [2024-08-05 10:06:48,360][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:06:53,355][00034] Fps is (10 sec: 4915.3, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 7651328. Throughput: 0: 1237.0. Samples: 1914840. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 10:06:53,360][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:06:58,355][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4915.2). Total num frames: 7675904. Throughput: 0: 1233.4. Samples: 1922264. Policy #0 lag: (min: 0.0, avg: 2.3, max: 5.0) [2024-08-05 10:06:58,357][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:07:02,856][00157] Updated weights for policy 0, policy_version 940 (0.0026) [2024-08-05 10:07:03,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4915.2). Total num frames: 7700480. Throughput: 0: 1238.0. Samples: 1929896. Policy #0 lag: (min: 0.0, avg: 2.3, max: 6.0) [2024-08-05 10:07:03,357][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:07:08,356][00034] Fps is (10 sec: 4915.0, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 7725056. Throughput: 0: 1225.1. Samples: 1933064. Policy #0 lag: (min: 0.0, avg: 2.3, max: 5.0) [2024-08-05 10:07:08,358][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:07:13,356][00034] Fps is (10 sec: 4915.0, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 7749632. Throughput: 0: 1227.7. Samples: 1940680. Policy #0 lag: (min: 0.0, avg: 1.8, max: 4.0) [2024-08-05 10:07:13,357][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:07:18,356][00034] Fps is (10 sec: 4915.3, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 7774208. Throughput: 0: 1230.8. Samples: 1948056. Policy #0 lag: (min: 0.0, avg: 1.7, max: 4.0) [2024-08-05 10:07:18,357][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:07:19,139][00157] Updated weights for policy 0, policy_version 950 (0.0020) [2024-08-05 10:07:23,356][00034] Fps is (10 sec: 4915.3, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 7798784. Throughput: 0: 1237.7. Samples: 1951784. Policy #0 lag: (min: 0.0, avg: 2.1, max: 4.0) [2024-08-05 10:07:23,357][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:07:23,365][00136] Saving /kaggle/working/train_dir/default_experiment/checkpoint_p0/checkpoint_000000952_7798784.pth... [2024-08-05 10:07:23,551][00136] Removing /kaggle/working/train_dir/default_experiment/checkpoint_p0/checkpoint_000000807_6610944.pth [2024-08-05 10:07:28,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 7823360. Throughput: 0: 1233.3. Samples: 1959176. Policy #0 lag: (min: 0.0, avg: 1.6, max: 4.0) [2024-08-05 10:07:28,357][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:07:33,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 7847936. Throughput: 0: 1237.5. Samples: 1966784. Policy #0 lag: (min: 0.0, avg: 1.7, max: 4.0) [2024-08-05 10:07:33,358][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:07:35,942][00157] Updated weights for policy 0, policy_version 960 (0.0022) [2024-08-05 10:07:38,357][00034] Fps is (10 sec: 4914.3, 60 sec: 4915.0, 300 sec: 4942.9). Total num frames: 7872512. Throughput: 0: 1236.9. Samples: 1970504. Policy #0 lag: (min: 0.0, avg: 2.2, max: 4.0) [2024-08-05 10:07:38,359][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:07:43,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 7897088. Throughput: 0: 1228.1. Samples: 1977528. Policy #0 lag: (min: 0.0, avg: 2.2, max: 4.0) [2024-08-05 10:07:43,358][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:07:48,355][00034] Fps is (10 sec: 4916.1, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 7921664. Throughput: 0: 1223.1. Samples: 1984936. Policy #0 lag: (min: 0.0, avg: 1.8, max: 4.0) [2024-08-05 10:07:48,358][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:07:52,915][00157] Updated weights for policy 0, policy_version 970 (0.0023) [2024-08-05 10:07:53,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 7946240. Throughput: 0: 1235.7. Samples: 1988672. Policy #0 lag: (min: 0.0, avg: 2.4, max: 5.0) [2024-08-05 10:07:53,357][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:07:58,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 7970816. Throughput: 0: 1230.6. Samples: 1996056. Policy #0 lag: (min: 0.0, avg: 2.3, max: 5.0) [2024-08-05 10:07:58,358][00034] Avg episode reward: [(0, '-4.420')] [2024-08-05 10:08:01,293][00169] DAMAGECOUNT value on done: 826.0 [2024-08-05 10:08:01,296][00169] Sum rewards: -3.956, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.859', 'ARMOR': '0.004', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO4': '0.021', 'AMMO5': '0.021', 'weapon7': '0.052', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.160', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.246', 'weapon4': '0.356', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.023', 'weapon3': '1.346', 'weapon2': '1.444', 'FRAGCOUNT': '2.000'} [2024-08-05 10:08:03,356][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 7995392. Throughput: 0: 1235.7. Samples: 2003664. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 10:08:03,357][00034] Avg episode reward: [(0, '-4.419')] [2024-08-05 10:08:04,971][00168] DAMAGECOUNT value on done: 596.0 [2024-08-05 10:08:04,972][00168] Sum rewards: -0.642, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.983', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.014', 'AMMO4': '0.049', 'weapon7': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.206', 'HITCOUNT': '0.220', 'WEAPON3': '0.950', 'DAMAGECOUNT': '0.999', 'weapon2': '1.160', 'weapon3': '1.990', 'FRAGCOUNT': '4.000'} [2024-08-05 10:08:05,309][00170] DAMAGECOUNT value on done: 797.0 [2024-08-05 10:08:07,630][00169] DAMAGECOUNT value on done: 678.0 [2024-08-05 10:08:07,631][00169] Sum rewards: -5.919, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.722', 'AMMO2': '0.021', 'AMMO5': '0.024', 'ARMOR': '0.024', 'WEAPON1': '0.040', 'AMMO4': '0.105', 'weapon4': '0.132', 'HITCOUNT': '0.150', 'AMMO3': '0.154', 'weapon5': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.550', 'DAMAGECOUNT': '0.825', 'WEAPON3': '0.850', 'weapon3': '1.240', 'weapon2': '1.642', 'FRAGCOUNT': '3.000'} [2024-08-05 10:08:07,726][00159] DAMAGECOUNT value on done: 693.0 [2024-08-05 10:08:08,362][00034] Fps is (10 sec: 4912.1, 60 sec: 4914.7, 300 sec: 4915.1). Total num frames: 8019968. Throughput: 0: 1236.6. Samples: 2007440. Policy #0 lag: (min: 0.0, avg: 1.8, max: 4.0) [2024-08-05 10:08:08,366][00034] Avg episode reward: [(0, '-4.300')] [2024-08-05 10:08:08,992][00157] Updated weights for policy 0, policy_version 980 (0.0045) [2024-08-05 10:08:09,859][00172] DAMAGECOUNT value on done: 1188.0 [2024-08-05 10:08:09,863][00172] Sum rewards: 0.594, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.370', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.011', 'AMMO3': '0.059', 'ARMOR': '0.072', 'weapon5': '0.080', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.300', 'weapon4': '0.344', 'WEAPON3': '0.400', 'DAMAGECOUNT': '1.032', 'weapon3': '1.124', 'weapon2': '1.860', 'FRAGCOUNT': '3.000'} [2024-08-05 10:08:11,555][00168] DAMAGECOUNT value on done: 535.0 [2024-08-05 10:08:11,562][00168] Sum rewards: -4.921, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-2.000', 'HEALTH': '-1.380', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'ARMOR': '0.036', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'weapon5': '0.126', 'AMMO4': '0.130', 'weapon4': '0.138', 'WEAPON5': '0.200', 'HITCOUNT': '0.220', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.645', 'weapon3': '1.454', 'weapon2': '1.478'} [2024-08-05 10:08:12,394][00162] DAMAGECOUNT value on done: 277.0 [2024-08-05 10:08:12,394][00162] Sum rewards: -6.759, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.715', 'FRAGCOUNT': '-1.500', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.039', 'HITCOUNT': '0.070', 'weapon5': '0.102', 'AMMO3': '0.142', 'AMMO4': '0.195', 'DAMAGECOUNT': '0.201', 'WEAPON4': '0.250', 'weapon4': '0.306', 'WEAPON5': '0.450', 'ARMOR': '0.488', 'WEAPON3': '0.850', 'weapon3': '1.262', 'weapon2': '1.808'} [2024-08-05 10:08:12,859][00170] DAMAGECOUNT value on done: 1005.0 [2024-08-05 10:08:12,860][00170] Sum rewards: -2.683, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.182', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'ARMOR': '0.016', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'weapon5': '0.154', 'HITCOUNT': '0.310', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'weapon3': '1.236', 'DAMAGECOUNT': '1.293', 'weapon2': '1.546', 'FRAGCOUNT': '3.000'} [2024-08-05 10:08:13,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 8044544. Throughput: 0: 1227.6. Samples: 2014416. Policy #0 lag: (min: 0.0, avg: 2.4, max: 5.0) [2024-08-05 10:08:13,360][00034] Avg episode reward: [(0, '-4.221')] [2024-08-05 10:08:14,779][00164] DAMAGECOUNT value on done: 494.0 [2024-08-05 10:08:14,781][00164] Sum rewards: -1.497, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.890', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.033', 'WEAPON5': '0.050', 'AMMO3': '0.078', 'weapon5': '0.090', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'HITCOUNT': '0.110', 'weapon4': '0.112', 'WEAPON4': '0.200', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.810', 'weapon2': '1.632', 'weapon3': '1.708', 'FRAGCOUNT': '3.000'} [2024-08-05 10:08:15,275][00169] DAMAGECOUNT value on done: 709.0 [2024-08-05 10:08:15,276][00169] Sum rewards: -1.413, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.015', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon5': '0.050', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.206', 'HITCOUNT': '0.250', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.810', 'FRAGCOUNT': '1.000', 'weapon2': '1.402', 'weapon3': '1.638'} [2024-08-05 10:08:15,427][00159] DAMAGECOUNT value on done: 345.0 [2024-08-05 10:08:15,431][00159] Sum rewards: -1.405, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.055', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'HITCOUNT': '0.140', 'weapon4': '0.212', 'DAMAGECOUNT': '0.354', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.156', 'weapon3': '1.798'} [2024-08-05 10:08:15,639][00160] DAMAGECOUNT value on done: 980.0 [2024-08-05 10:08:15,649][00160] Sum rewards: -3.477, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.264', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.026', 'ARMOR': '0.061', 'weapon5': '0.100', 'AMMO4': '0.130', 'AMMO3': '0.133', 'HITCOUNT': '0.180', 'WEAPON5': '0.200', 'weapon4': '0.384', 'WEAPON4': '0.400', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.945', 'weapon3': '1.388', 'weapon2': '1.616', 'FRAGCOUNT': '2.000'} [2024-08-05 10:08:16,147][00172] DAMAGECOUNT value on done: 535.0 [2024-08-05 10:08:16,149][00172] Sum rewards: -2.719, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.280', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.003', 'AMMO4': '0.012', 'AMMO5': '0.025', 'weapon5': '0.096', 'AMMO3': '0.106', 'HITCOUNT': '0.220', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.975', 'weapon3': '1.584', 'weapon2': '1.740'} [2024-08-05 10:08:17,741][00168] DAMAGECOUNT value on done: 566.0 [2024-08-05 10:08:17,743][00168] Sum rewards: -7.786, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.605', 'FRAGCOUNT': '-1.000', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'WEAPON1': '0.010', 'ARMOR': '0.020', 'AMMO5': '0.037', 'weapon5': '0.138', 'AMMO3': '0.168', 'HITCOUNT': '0.190', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'DAMAGECOUNT': '0.930', 'weapon3': '1.566', 'weapon2': '1.648'} [2024-08-05 10:08:18,356][00034] Fps is (10 sec: 4918.1, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 8069120. Throughput: 0: 1222.9. Samples: 2021816. Policy #0 lag: (min: 0.0, avg: 2.1, max: 4.0) [2024-08-05 10:08:18,360][00034] Avg episode reward: [(0, '-4.068')] [2024-08-05 10:08:19,607][00162] DAMAGECOUNT value on done: 620.0 [2024-08-05 10:08:19,611][00162] Sum rewards: -1.101, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.677', 'ARMOR': '0.008', 'AMMO2': '0.041', 'AMMO3': '0.150', 'AMMO4': '0.207', 'HITCOUNT': '0.280', 'WEAPON4': '0.450', 'weapon4': '0.514', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.849', 'weapon2': '1.082', 'weapon3': '1.694', 'FRAGCOUNT': '4.000'} [2024-08-05 10:08:19,921][00170] DAMAGECOUNT value on done: 670.0 [2024-08-05 10:08:19,926][00170] Sum rewards: -1.032, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.453', 'weapon7': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'ARMOR': '0.044', 'AMMO4': '0.070', 'AMMO3': '0.098', 'HITCOUNT': '0.130', 'weapon5': '0.154', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.412', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.083', 'weapon3': '1.270', 'weapon2': '1.352', 'FRAGCOUNT': '3.000'} [2024-08-05 10:08:21,285][00164] DAMAGECOUNT value on done: 417.0 [2024-08-05 10:08:21,286][00164] Sum rewards: -9.057, reward structure: {'DEATHCOUNT': '-11.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.488', 'AMMO5': '0.012', 'AMMO2': '0.014', 'ARMOR': '0.028', 'weapon5': '0.046', 'AMMO4': '0.068', 'HITCOUNT': '0.110', 'weapon4': '0.120', 'AMMO3': '0.143', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.750', 'weapon3': '1.204', 'weapon2': '2.006'} [2024-08-05 10:08:22,131][00169] DAMAGECOUNT value on done: 307.0 [2024-08-05 10:08:22,320][00159] DAMAGECOUNT value on done: 510.0 [2024-08-05 10:08:22,325][00159] Sum rewards: -5.773, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.236', 'AMMO2': '0.013', 'AMMO5': '0.014', 'ARMOR': '0.016', 'weapon5': '0.020', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.065', 'HITCOUNT': '0.110', 'AMMO3': '0.162', 'WEAPON5': '0.200', 'weapon4': '0.224', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.950', 'weapon2': '0.954', 'FRAGCOUNT': '1.000', 'weapon3': '1.794'} [2024-08-05 10:08:22,398][00160] DAMAGECOUNT value on done: 699.0 [2024-08-05 10:08:22,399][00160] Sum rewards: -3.150, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.996', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO5': '0.022', 'weapon5': '0.044', 'ARMOR': '0.071', 'AMMO4': '0.087', 'weapon4': '0.102', 'AMMO3': '0.142', 'HITCOUNT': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.050', 'weapon2': '1.260', 'weapon3': '1.910', 'FRAGCOUNT': '2.000'} [2024-08-05 10:08:23,042][00172] DAMAGECOUNT value on done: 944.0 [2024-08-05 10:08:23,046][00172] Sum rewards: -4.330, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.220', 'AMMO2': '0.009', 'weapon4': '0.018', 'AMMO5': '0.022', 'ARMOR': '0.028', 'WEAPON1': '0.040', 'weapon5': '0.040', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'AMMO3': '0.174', 'HITCOUNT': '0.330', 'WEAPON5': '0.450', 'weapon2': '0.806', 'WEAPON3': '1.050', 'DAMAGECOUNT': '1.269', 'FRAGCOUNT': '1.500', 'weapon3': '2.260'} [2024-08-05 10:08:23,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 8093696. Throughput: 0: 1222.1. Samples: 2025496. Policy #0 lag: (min: 0.0, avg: 2.2, max: 4.0) [2024-08-05 10:08:23,358][00034] Avg episode reward: [(0, '-3.958')] [2024-08-05 10:08:24,828][00168] DAMAGECOUNT value on done: 417.0 [2024-08-05 10:08:25,242][00165] DAMAGECOUNT value on done: 960.0 [2024-08-05 10:08:25,247][00165] Sum rewards: -4.064, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.080', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'weapon5': '0.084', 'AMMO4': '0.084', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.324', 'HITCOUNT': '0.360', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.344', 'weapon2': '1.446', 'weapon3': '1.472'} [2024-08-05 10:08:25,862][00162] DAMAGECOUNT value on done: 612.0 [2024-08-05 10:08:25,867][00162] Sum rewards: -3.653, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.154', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.032', 'ARMOR': '0.044', 'weapon5': '0.088', 'AMMO3': '0.102', 'HITCOUNT': '0.130', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'WEAPON4': '0.350', 'DAMAGECOUNT': '0.351', 'weapon4': '0.516', 'WEAPON3': '0.700', 'weapon2': '1.270', 'weapon3': '1.594'} [2024-08-05 10:08:26,164][00170] DAMAGECOUNT value on done: 625.0 [2024-08-05 10:08:26,168][00170] Sum rewards: 0.586, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.318', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'weapon5': '0.058', 'AMMO4': '0.061', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'HITCOUNT': '0.250', 'ARMOR': '0.456', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.810', 'FRAGCOUNT': '1.000', 'weapon2': '1.164', 'weapon3': '2.208'} [2024-08-05 10:08:26,393][00157] Updated weights for policy 0, policy_version 990 (0.0034) [2024-08-05 10:08:28,326][00169] DAMAGECOUNT value on done: 643.0 [2024-08-05 10:08:28,328][00169] Sum rewards: -4.249, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.558', 'AMMO2': '0.007', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.033', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'weapon7': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.380', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.675', 'FRAGCOUNT': '1.000', 'weapon3': '1.122', 'weapon2': '1.346'} [2024-08-05 10:08:28,355][00034] Fps is (10 sec: 4915.3, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 8118272. Throughput: 0: 1231.3. Samples: 2032936. Policy #0 lag: (min: 0.0, avg: 2.2, max: 4.0) [2024-08-05 10:08:28,357][00034] Avg episode reward: [(0, '-3.768')] [2024-08-05 10:08:28,554][00159] DAMAGECOUNT value on done: 282.0 [2024-08-05 10:08:28,558][00159] Sum rewards: 1.819, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.520', 'AMMO2': '0.005', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO4': '0.023', 'HITCOUNT': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'weapon4': '0.150', 'DAMAGECOUNT': '0.315', 'WEAPON3': '0.400', 'ARMOR': '0.495', 'weapon2': '0.548', 'weapon3': '1.756', 'FRAGCOUNT': '2.000'} [2024-08-05 10:08:28,793][00164] DAMAGECOUNT value on done: 712.0 [2024-08-05 10:08:29,613][00160] DAMAGECOUNT value on done: 428.0 [2024-08-05 10:08:29,617][00160] Sum rewards: -7.334, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-3.000', 'HEALTH': '-1.760', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO5': '0.029', 'ARMOR': '0.036', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'weapon5': '0.174', 'HITCOUNT': '0.210', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.777', 'weapon2': '1.176', 'weapon3': '1.918'} [2024-08-05 10:08:29,734][00166] DAMAGECOUNT value on done: 977.0 [2024-08-05 10:08:29,738][00166] Sum rewards: -3.593, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.007', 'weapon5': '0.020', 'AMMO2': '0.021', 'weapon4': '0.024', 'WEAPON1': '0.030', 'AMMO4': '0.103', 'ARMOR': '0.104', 'HEALTH': '0.127', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'HITCOUNT': '0.260', 'DAMAGECOUNT': '0.780', 'WEAPON3': '0.900', 'weapon2': '1.516', 'weapon3': '1.786', 'FRAGCOUNT': '3.000'} [2024-08-05 10:08:30,045][00172] DAMAGECOUNT value on done: 480.0 [2024-08-05 10:08:31,550][00168] DAMAGECOUNT value on done: 828.0 [2024-08-05 10:08:32,017][00162] DAMAGECOUNT value on done: 603.0 [2024-08-05 10:08:32,019][00162] Sum rewards: -1.237, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.960', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.048', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.100', 'AMMO3': '0.125', 'AMMO4': '0.242', 'HITCOUNT': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon4': '0.698', 'DAMAGECOUNT': '0.840', 'weapon3': '1.192', 'weapon2': '1.284', 'FRAGCOUNT': '3.000'} [2024-08-05 10:08:32,311][00170] DAMAGECOUNT value on done: 669.0 [2024-08-05 10:08:32,315][00170] Sum rewards: -4.958, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.365', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO3': '0.080', 'HITCOUNT': '0.100', 'AMMO4': '0.112', 'weapon5': '0.120', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.324', 'ARMOR': '0.400', 'weapon3': '1.144', 'weapon2': '1.772'} [2024-08-05 10:08:32,515][00165] DAMAGECOUNT value on done: 781.0 [2024-08-05 10:08:32,518][00165] Sum rewards: -3.246, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.615', 'weapon5': '0.004', 'AMMO2': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.020', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.155', 'HITCOUNT': '0.320', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.005', 'weapon2': '1.434', 'FRAGCOUNT': '2.000', 'weapon3': '2.010'} [2024-08-05 10:08:32,661][00163] DAMAGECOUNT value on done: 902.0 [2024-08-05 10:08:32,662][00163] Sum rewards: -4.228, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.900', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon4': '0.026', 'AMMO4': '0.034', 'WEAPON4': '0.100', 'weapon5': '0.128', 'AMMO3': '0.188', 'HITCOUNT': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.095', 'weapon3': '1.526', 'weapon2': '1.840', 'FRAGCOUNT': '2.000'} [2024-08-05 10:08:33,356][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 8142848. Throughput: 0: 1232.7. Samples: 2040408. Policy #0 lag: (min: 0.0, avg: 2.3, max: 4.0) [2024-08-05 10:08:33,362][00034] Avg episode reward: [(0, '-3.773')] [2024-08-05 10:08:34,397][00169] DAMAGECOUNT value on done: 1101.0 [2024-08-05 10:08:34,405][00169] Sum rewards: 3.184, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.114', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.024', 'ARMOR': '0.028', 'AMMO3': '0.099', 'AMMO4': '0.122', 'WEAPON4': '0.200', 'weapon4': '0.224', 'weapon5': '0.244', 'WEAPON5': '0.300', 'HITCOUNT': '0.430', 'WEAPON3': '0.550', 'weapon2': '1.280', 'weapon3': '1.590', 'DAMAGECOUNT': '1.929', 'FRAGCOUNT': '3.000'} [2024-08-05 10:08:34,705][00159] DAMAGECOUNT value on done: 593.0 [2024-08-05 10:08:34,708][00159] Sum rewards: 0.028, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.022', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon4': '0.016', 'AMMO2': '0.023', 'ARMOR': '0.032', 'WEAPON4': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.141', 'HITCOUNT': '0.180', 'weapon5': '0.186', 'WEAPON5': '0.200', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.215', 'weapon2': '1.414', 'weapon3': '1.460', 'FRAGCOUNT': '2.000'} [2024-08-05 10:08:35,040][00164] DAMAGECOUNT value on done: 494.0 [2024-08-05 10:08:35,041][00164] Sum rewards: -4.215, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.624', 'weapon5': '0.004', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'AMMO5': '0.030', 'ARMOR': '0.040', 'weapon7': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'HITCOUNT': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.122', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.345', 'WEAPON5': '0.500', 'weapon4': '0.574', 'WEAPON3': '0.600', 'weapon2': '1.250', 'weapon3': '1.284', 'FRAGCOUNT': '2.000'} [2024-08-05 10:08:35,951][00160] DAMAGECOUNT value on done: 698.0 [2024-08-05 10:08:35,953][00160] Sum rewards: -7.373, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.540', 'AMMO2': '0.009', 'AMMO5': '0.015', 'weapon5': '0.034', 'AMMO4': '0.044', 'ARMOR': '0.064', 'HITCOUNT': '0.110', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'weapon4': '0.250', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.495', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.050', 'weapon3': '1.608', 'weapon2': '1.764'} [2024-08-05 10:08:36,031][00161] DAMAGECOUNT value on done: 914.0 [2024-08-05 10:08:36,035][00161] Sum rewards: -9.763, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.586', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.012', 'AMMO5': '0.023', 'ARMOR': '0.024', 'AMMO4': '0.057', 'weapon4': '0.064', 'WEAPON4': '0.100', 'weapon5': '0.168', 'AMMO3': '0.190', 'HITCOUNT': '0.270', 'WEAPON5': '0.500', 'DAMAGECOUNT': '0.810', 'WEAPON3': '1.100', 'weapon3': '1.598', 'weapon2': '1.656'} [2024-08-05 10:08:36,240][00166] DAMAGECOUNT value on done: 938.0 [2024-08-05 10:08:36,249][00166] Sum rewards: -2.025, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.369', 'AMMO2': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.036', 'ARMOR': '0.044', 'AMMO3': '0.087', 'weapon5': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.230', 'weapon4': '0.326', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.870', 'weapon3': '1.258', 'weapon2': '1.624', 'FRAGCOUNT': '2.000'} [2024-08-05 10:08:36,366][00167] DAMAGECOUNT value on done: 519.0 [2024-08-05 10:08:36,373][00167] Sum rewards: -2.429, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.395', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'weapon5': '0.026', 'ARMOR': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'AMMO4': '0.118', 'HITCOUNT': '0.140', 'WEAPON4': '0.200', 'weapon4': '0.506', 'DAMAGECOUNT': '0.624', 'WEAPON3': '0.650', 'weapon2': '0.956', 'FRAGCOUNT': '1.000', 'weapon3': '1.712'} [2024-08-05 10:08:36,517][00172] DAMAGECOUNT value on done: 557.0 [2024-08-05 10:08:36,518][00172] Sum rewards: -6.186, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.030', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.040', 'AMMO4': '0.098', 'ARMOR': '0.140', 'WEAPON5': '0.150', 'HITCOUNT': '0.160', 'AMMO3': '0.168', 'WEAPON4': '0.350', 'weapon4': '0.404', 'DAMAGECOUNT': '0.516', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.278', 'weapon2': '1.860'} [2024-08-05 10:08:38,232][00162] DAMAGECOUNT value on done: 432.0 [2024-08-05 10:08:38,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.4, 300 sec: 4943.0). Total num frames: 8167424. Throughput: 0: 1230.6. Samples: 2044048. Policy #0 lag: (min: 0.0, avg: 2.1, max: 4.0) [2024-08-05 10:08:38,357][00034] Avg episode reward: [(0, '-3.780')] [2024-08-05 10:08:38,522][00170] DAMAGECOUNT value on done: 732.0 [2024-08-05 10:08:38,528][00170] Sum rewards: -2.545, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.310', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'weapon5': '0.050', 'ARMOR': '0.060', 'AMMO4': '0.103', 'weapon4': '0.104', 'AMMO3': '0.135', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'HITCOUNT': '0.330', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.305', 'weapon3': '1.466', 'weapon2': '1.696', 'FRAGCOUNT': '3.000'} [2024-08-05 10:08:38,598][00168] DAMAGECOUNT value on done: 1072.0 [2024-08-05 10:08:38,609][00168] Sum rewards: -4.619, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.032', 'AMMO2': '0.007', 'AMMO5': '0.028', 'AMMO4': '0.036', 'ARMOR': '0.068', 'weapon5': '0.102', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.224', 'WEAPON5': '0.350', 'HITCOUNT': '0.360', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.224', 'weapon2': '1.248', 'weapon3': '1.626', 'FRAGCOUNT': '2.000'} [2024-08-05 10:08:39,297][00158] DAMAGECOUNT value on done: 655.0 [2024-08-05 10:08:39,301][00158] Sum rewards: -5.524, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.646', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.012', 'weapon4': '0.016', 'WEAPON1': '0.020', 'ARMOR': '0.061', 'weapon5': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.204', 'HITCOUNT': '0.270', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.942', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.100', 'weapon2': '1.400', 'weapon3': '1.852'} [2024-08-05 10:08:39,377][00165] DAMAGECOUNT value on done: 804.0 [2024-08-05 10:08:39,380][00165] Sum rewards: -3.455, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.454', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.012', 'WEAPON1': '0.020', 'ARMOR': '0.068', 'weapon5': '0.116', 'AMMO3': '0.142', 'WEAPON5': '0.200', 'HITCOUNT': '0.220', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.005', 'weapon3': '1.204', 'FRAGCOUNT': '2.000', 'weapon2': '2.152'} [2024-08-05 10:08:39,544][00163] DAMAGECOUNT value on done: 542.0 [2024-08-05 10:08:39,546][00163] Sum rewards: -3.734, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.485', 'AMMO2': '0.006', 'AMMO5': '0.013', 'AMMO4': '0.031', 'weapon5': '0.072', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.222', 'HITCOUNT': '0.290', 'ARMOR': '0.488', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.831', 'weapon2': '1.232', 'weapon3': '1.950'} [2024-08-05 10:08:40,720][00169] DAMAGECOUNT value on done: 936.0 [2024-08-05 10:08:40,725][00169] Sum rewards: 1.655, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.682', 'AMMO2': '0.006', 'ARMOR': '0.012', 'AMMO5': '0.018', 'AMMO4': '0.031', 'WEAPON1': '0.040', 'AMMO3': '0.077', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.108', 'HITCOUNT': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'weapon2': '1.428', 'DAMAGECOUNT': '1.455', 'weapon3': '1.762', 'FRAGCOUNT': '3.500'} [2024-08-05 10:08:41,234][00159] DAMAGECOUNT value on done: 706.0 [2024-08-05 10:08:41,235][00159] Sum rewards: -1.611, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.147', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.018', 'weapon5': '0.054', 'AMMO4': '0.091', 'ARMOR': '0.096', 'AMMO3': '0.125', 'weapon4': '0.132', 'HITCOUNT': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.777', 'weapon2': '0.924', 'weapon3': '2.154'} [2024-08-05 10:08:42,712][00164] DAMAGECOUNT value on done: 520.0 [2024-08-05 10:08:42,725][00157] Updated weights for policy 0, policy_version 1000 (0.0022) [2024-08-05 10:08:42,723][00164] Sum rewards: -5.495, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.264', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO4': '0.035', 'AMMO3': '0.101', 'HITCOUNT': '0.140', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.615', 'FRAGCOUNT': '1.000', 'weapon3': '1.578', 'weapon2': '1.938'} [2024-08-05 10:08:43,053][00161] DAMAGECOUNT value on done: 612.0 [2024-08-05 10:08:43,055][00161] Sum rewards: -2.501, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.492', 'WEAPON1': '0.010', 'AMMO2': '0.037', 'AMMO3': '0.094', 'weapon4': '0.166', 'HITCOUNT': '0.180', 'AMMO4': '0.184', 'WEAPON4': '0.350', 'WEAPON3': '0.500', 'ARMOR': '0.536', 'DAMAGECOUNT': '0.570', 'weapon3': '1.256', 'weapon2': '1.858', 'FRAGCOUNT': '2.000'} [2024-08-05 10:08:43,162][00166] DAMAGECOUNT value on done: 965.0 [2024-08-05 10:08:43,164][00166] Sum rewards: -0.415, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.324', 'AMMO2': '0.009', 'weapon4': '0.012', 'AMMO5': '0.028', 'ARMOR': '0.036', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'weapon5': '0.088', 'AMMO3': '0.142', 'HITCOUNT': '0.390', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.407', 'weapon2': '1.484', 'weapon3': '1.818', 'FRAGCOUNT': '3.000'} [2024-08-05 10:08:43,184][00171] DAMAGECOUNT value on done: 901.0 [2024-08-05 10:08:43,186][00171] Sum rewards: -0.394, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.638', 'AMMO5': '0.015', 'AMMO2': '0.027', 'weapon5': '0.078', 'AMMO4': '0.135', 'AMMO3': '0.151', 'weapon4': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.320', 'ARMOR': '0.455', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.125', 'weapon3': '1.526', 'weapon2': '1.690', 'FRAGCOUNT': '3.000'} [2024-08-05 10:08:43,339][00167] DAMAGECOUNT value on done: 533.0 [2024-08-05 10:08:43,347][00167] Sum rewards: -2.146, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.008', 'weapon5': '0.012', 'AMMO2': '0.017', 'AMMO5': '0.018', 'AMMO4': '0.086', 'AMMO3': '0.121', 'HITCOUNT': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.312', 'ARMOR': '0.492', 'DAMAGECOUNT': '0.630', 'WEAPON3': '0.650', 'weapon2': '1.156', 'weapon3': '1.708', 'FRAGCOUNT': '2.000'} [2024-08-05 10:08:43,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 8192000. Throughput: 0: 1224.2. Samples: 2051144. Policy #0 lag: (min: 0.0, avg: 2.1, max: 5.0) [2024-08-05 10:08:43,357][00034] Avg episode reward: [(0, '-3.738')] [2024-08-05 10:08:43,476][00156] DAMAGECOUNT value on done: 764.0 [2024-08-05 10:08:43,477][00156] Sum rewards: 2.698, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.554', 'AMMO2': '0.018', 'AMMO3': '0.054', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'weapon7': '0.198', 'HITCOUNT': '0.210', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'weapon4': '0.466', 'weapon2': '0.676', 'DAMAGECOUNT': '0.996', 'weapon3': '1.406', 'FRAGCOUNT': '2.000'} [2024-08-05 10:08:43,571][00160] DAMAGECOUNT value on done: 475.0 [2024-08-05 10:08:43,573][00160] Sum rewards: -3.130, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.392', 'AMMO2': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon5': '0.012', 'AMMO4': '0.018', 'ARMOR': '0.024', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'weapon4': '0.230', 'DAMAGECOUNT': '0.645', 'weapon2': '0.792', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '2.052'} [2024-08-05 10:08:43,976][00172] DAMAGECOUNT value on done: 711.0 [2024-08-05 10:08:43,980][00172] Sum rewards: -3.345, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.782', 'AMMO2': '0.005', 'AMMO5': '0.005', 'ARMOR': '0.008', 'weapon7': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.022', 'weapon5': '0.076', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.112', 'AMMO3': '0.150', 'HITCOUNT': '0.240', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.927', 'weapon2': '1.528', 'weapon3': '1.682'} [2024-08-05 10:08:45,074][00162] DAMAGECOUNT value on done: 534.0 [2024-08-05 10:08:45,401][00170] DAMAGECOUNT value on done: 573.0 [2024-08-05 10:08:45,405][00170] Sum rewards: -0.648, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.453', 'AMMO5': '0.005', 'AMMO2': '0.010', 'ARMOR': '0.016', 'weapon5': '0.042', 'AMMO4': '0.047', 'weapon7': '0.050', 'AMMO3': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.128', 'WEAPON5': '0.150', 'HITCOUNT': '0.300', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.005', 'weapon2': '1.268', 'weapon3': '1.502'} [2024-08-05 10:08:45,619][00168] DAMAGECOUNT value on done: 722.0 [2024-08-05 10:08:45,620][00168] Sum rewards: -6.610, reward structure: {'DEATHCOUNT': '-10.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.290', 'weapon7': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.014', 'WEAPON1': '0.040', 'weapon5': '0.052', 'ARMOR': '0.064', 'AMMO4': '0.069', 'AMMO3': '0.146', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.252', 'HITCOUNT': '0.260', 'DAMAGECOUNT': '0.795', 'WEAPON3': '0.900', 'weapon2': '1.386', 'weapon3': '1.690'} [2024-08-05 10:08:46,544][00158] DAMAGECOUNT value on done: 575.0 [2024-08-05 10:08:46,548][00158] Sum rewards: -2.217, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.605', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.012', 'weapon5': '0.024', 'weapon4': '0.118', 'AMMO3': '0.121', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.250', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.759', 'ARMOR': '0.937', 'weapon3': '1.270', 'weapon2': '1.992', 'FRAGCOUNT': '2.500'} [2024-08-05 10:08:46,674][00165] DAMAGECOUNT value on done: 686.0 [2024-08-05 10:08:46,675][00165] Sum rewards: -3.451, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.134', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'AMMO4': '0.064', 'weapon7': '0.068', 'AMMO3': '0.087', 'weapon5': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'WEAPON7': '0.200', 'weapon4': '0.416', 'ARMOR': '0.436', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.864', 'FRAGCOUNT': '1.000', 'weapon3': '1.016', 'weapon2': '1.224'} [2024-08-05 10:08:46,839][00163] DAMAGECOUNT value on done: 1101.0 [2024-08-05 10:08:46,841][00163] Sum rewards: -1.875, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.211', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon4': '0.048', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'HITCOUNT': '0.420', 'WEAPON3': '0.750', 'weapon3': '1.480', 'DAMAGECOUNT': '1.503', 'weapon2': '1.946', 'FRAGCOUNT': '5.000'} [2024-08-05 10:08:47,823][00169] DAMAGECOUNT value on done: 598.0 [2024-08-05 10:08:47,828][00169] Sum rewards: -2.402, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.744', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.013', 'WEAPON1': '0.020', 'ARMOR': '0.072', 'WEAPON4': '0.100', 'weapon5': '0.124', 'weapon4': '0.146', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'HITCOUNT': '0.200', 'DAMAGECOUNT': '0.909', 'WEAPON3': '0.950', 'weapon3': '1.448', 'weapon2': '1.734', 'FRAGCOUNT': '2.000'} [2024-08-05 10:08:48,143][00159] DAMAGECOUNT value on done: 993.0 [2024-08-05 10:08:48,148][00159] Sum rewards: -1.219, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.198', 'AMMO4': '-0.054', 'AMMO2': '-0.011', 'weapon7': '0.002', 'AMMO5': '0.012', 'ARMOR': '0.028', 'weapon5': '0.072', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.136', 'HITCOUNT': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.969', 'weapon3': '1.592', 'weapon2': '1.632', 'FRAGCOUNT': '4.000'} [2024-08-05 10:08:48,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 8216576. Throughput: 0: 1213.7. Samples: 2058280. Policy #0 lag: (min: 0.0, avg: 1.6, max: 4.0) [2024-08-05 10:08:48,357][00034] Avg episode reward: [(0, '-3.434')] [2024-08-05 10:08:48,359][00136] Saving new best policy, reward=-3.434! [2024-08-05 10:08:49,013][00164] DAMAGECOUNT value on done: 712.0 [2024-08-05 10:08:49,020][00164] Sum rewards: -2.400, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.284', 'AMMO2': '0.013', 'AMMO5': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'weapon5': '0.080', 'AMMO3': '0.184', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.210', 'HITCOUNT': '0.230', 'WEAPON5': '0.300', 'WEAPON3': '0.900', 'DAMAGECOUNT': '0.948', 'weapon2': '0.964', 'FRAGCOUNT': '2.000', 'weapon3': '2.074'} [2024-08-05 10:08:49,910][00160] DAMAGECOUNT value on done: 1199.0 [2024-08-05 10:08:49,912][00160] Sum rewards: -3.585, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.328', 'AMMO2': '0.008', 'AMMO5': '0.019', 'ARMOR': '0.032', 'AMMO4': '0.039', 'WEAPON1': '0.040', 'weapon5': '0.076', 'AMMO3': '0.127', 'HITCOUNT': '0.260', 'WEAPON5': '0.300', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.750', 'weapon2': '1.416', 'DAMAGECOUNT': '1.530', 'weapon3': '1.646'} [2024-08-05 10:08:50,012][00161] DAMAGECOUNT value on done: 866.0 [2024-08-05 10:08:50,016][00161] Sum rewards: -7.255, reward structure: {'DEATHCOUNT': '-10.500', 'FRAGCOUNT': '-2.000', 'HEALTH': '-0.666', 'AMMO5': '0.010', 'AMMO2': '0.020', 'ARMOR': '0.040', 'weapon5': '0.070', 'AMMO4': '0.098', 'AMMO3': '0.123', 'WEAPON5': '0.150', 'weapon4': '0.190', 'WEAPON4': '0.200', 'HITCOUNT': '0.220', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.792', 'weapon3': '1.534', 'weapon2': '1.764'} [2024-08-05 10:08:50,036][00171] DAMAGECOUNT value on done: 612.0 [2024-08-05 10:08:50,048][00171] Sum rewards: -1.016, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.071', 'AMMO5': '0.006', 'AMMO2': '0.016', 'ARMOR': '0.044', 'WEAPON1': '0.060', 'AMMO4': '0.078', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'weapon5': '0.104', 'WEAPON5': '0.150', 'weapon4': '0.184', 'HITCOUNT': '0.190', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.579', 'FRAGCOUNT': '1.000', 'weapon3': '1.080', 'weapon2': '1.732'} [2024-08-05 10:08:50,060][00166] DAMAGECOUNT value on done: 1027.0 [2024-08-05 10:08:50,064][00166] Sum rewards: -7.936, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.007', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.042', 'ARMOR': '0.048', 'AMMO3': '0.146', 'HITCOUNT': '0.150', 'AMMO4': '0.157', 'WEAPON5': '0.200', 'weapon4': '0.246', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.378', 'weapon3': '1.638'} [2024-08-05 10:08:50,260][00172] DAMAGECOUNT value on done: 690.0 [2024-08-05 10:08:50,261][00172] Sum rewards: -9.428, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.030', 'AMMO2': '0.002', 'WEAPON1': '0.010', 'AMMO4': '0.010', 'AMMO5': '0.015', 'weapon5': '0.062', 'ARMOR': '0.070', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'HITCOUNT': '0.310', 'weapon2': '1.262', 'WEAPON3': '1.400', 'DAMAGECOUNT': '1.455', 'FRAGCOUNT': '2.000', 'weapon3': '2.002'} [2024-08-05 10:08:50,326][00167] DAMAGECOUNT value on done: 930.0 [2024-08-05 10:08:50,330][00167] Sum rewards: -8.602, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.990', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'ARMOR': '0.016', 'AMMO4': '0.035', 'weapon5': '0.070', 'weapon4': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.171', 'HITCOUNT': '0.190', 'WEAPON5': '0.250', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.690', 'WEAPON3': '0.950', 'weapon3': '1.354', 'weapon2': '1.876'} [2024-08-05 10:08:50,422][00156] DAMAGECOUNT value on done: 874.0 [2024-08-05 10:08:50,429][00156] Sum rewards: -4.131, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.546', 'AMMO2': '0.009', 'AMMO5': '0.022', 'ARMOR': '0.028', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'weapon4': '0.078', 'AMMO3': '0.132', 'weapon5': '0.146', 'HITCOUNT': '0.330', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'weapon2': '0.908', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.752', 'weapon3': '2.168'} [2024-08-05 10:08:51,901][00168] DAMAGECOUNT value on done: 838.0 [2024-08-05 10:08:51,904][00168] Sum rewards: 0.070, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.172', 'AMMO2': '0.002', 'AMMO5': '0.010', 'AMMO4': '0.011', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'weapon7': '0.066', 'AMMO3': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.330', 'WEAPON3': '0.500', 'weapon2': '1.106', 'DAMAGECOUNT': '1.275', 'weapon3': '1.376', 'FRAGCOUNT': '2.000'} [2024-08-05 10:08:51,921][00162] DAMAGECOUNT value on done: 695.0 [2024-08-05 10:08:51,922][00162] Sum rewards: 0.962, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.108', 'AMMO2': '0.002', 'AMMO5': '0.010', 'AMMO4': '0.012', 'WEAPON1': '0.030', 'AMMO3': '0.095', 'weapon5': '0.096', 'HITCOUNT': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.675', 'weapon2': '1.112', 'FRAGCOUNT': '2.000', 'weapon3': '2.088'} [2024-08-05 10:08:52,249][00170] DAMAGECOUNT value on done: 582.0 [2024-08-05 10:08:52,250][00170] Sum rewards: -2.613, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.514', 'AMMO5': '0.006', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'weapon5': '0.056', 'ARMOR': '0.064', 'AMMO4': '0.086', 'AMMO3': '0.110', 'WEAPON5': '0.150', 'HITCOUNT': '0.160', 'weapon4': '0.222', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.759', 'weapon3': '1.390', 'FRAGCOUNT': '1.500', 'weapon2': '1.730'} [2024-08-05 10:08:53,306][00158] DAMAGECOUNT value on done: 680.0 [2024-08-05 10:08:53,308][00158] Sum rewards: -4.417, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.693', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.012', 'ARMOR': '0.036', 'AMMO4': '0.061', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.220', 'weapon4': '0.264', 'weapon2': '0.934', 'DAMAGECOUNT': '0.960', 'WEAPON3': '1.050', 'weapon3': '1.862', 'FRAGCOUNT': '3.000'} [2024-08-05 10:08:53,334][00165] DAMAGECOUNT value on done: 247.0 [2024-08-05 10:08:53,356][00034] Fps is (10 sec: 4095.9, 60 sec: 4778.6, 300 sec: 4887.4). Total num frames: 8232960. Throughput: 0: 1210.5. Samples: 2061904. Policy #0 lag: (min: 0.0, avg: 2.0, max: 4.0) [2024-08-05 10:08:53,359][00034] Avg episode reward: [(0, '-3.430')] [2024-08-05 10:08:53,421][00136] Saving new best policy, reward=-3.430! [2024-08-05 10:08:53,579][00163] DAMAGECOUNT value on done: 957.0 [2024-08-05 10:08:53,589][00163] Sum rewards: -6.212, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.982', 'AMMO2': '0.016', 'AMMO5': '0.018', 'weapon5': '0.050', 'AMMO4': '0.079', 'weapon4': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.182', 'HITCOUNT': '0.240', 'WEAPON5': '0.300', 'ARMOR': '0.440', 'FRAGCOUNT': '0.500', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.290', 'weapon3': '1.612', 'weapon2': '1.756'} [2024-08-05 10:08:54,704][00169] DAMAGECOUNT value on done: 470.0 [2024-08-05 10:08:54,706][00169] Sum rewards: -2.535, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.598', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.036', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO4': '0.095', 'AMMO3': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.218', 'ARMOR': '0.450', 'DAMAGECOUNT': '0.501', 'WEAPON3': '0.650', 'weapon2': '1.178', 'weapon3': '1.480'} [2024-08-05 10:08:55,057][00159] DAMAGECOUNT value on done: 593.0 [2024-08-05 10:08:55,059][00159] Sum rewards: -3.076, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.895', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'ARMOR': '0.056', 'weapon5': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.178', 'WEAPON5': '0.250', 'HITCOUNT': '0.250', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.855', 'weapon2': '1.490', 'FRAGCOUNT': '1.500', 'weapon3': '1.502'} [2024-08-05 10:08:55,393][00164] DAMAGECOUNT value on done: 553.0 [2024-08-05 10:08:55,396][00164] Sum rewards: -4.300, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.204', 'AMMO5': '0.008', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'weapon5': '0.024', 'ARMOR': '0.064', 'AMMO4': '0.072', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'HITCOUNT': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.406', 'DAMAGECOUNT': '0.624', 'WEAPON3': '0.700', 'weapon3': '1.378', 'weapon2': '1.522', 'FRAGCOUNT': '2.000'} [2024-08-05 10:08:56,302][00160] DAMAGECOUNT value on done: 442.0 [2024-08-05 10:08:56,306][00160] Sum rewards: -0.051, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.450', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon5': '0.052', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'AMMO3': '0.133', 'HITCOUNT': '0.140', 'WEAPON5': '0.200', 'weapon4': '0.354', 'ARMOR': '0.428', 'DAMAGECOUNT': '0.561', 'WEAPON3': '0.600', 'weapon2': '1.132', 'weapon3': '1.628', 'FRAGCOUNT': '2.000'} [2024-08-05 10:08:56,695][00171] DAMAGECOUNT value on done: 833.0 [2024-08-05 10:08:56,696][00171] Sum rewards: -3.388, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.240', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'ARMOR': '0.052', 'weapon5': '0.086', 'AMMO4': '0.104', 'AMMO3': '0.104', 'HITCOUNT': '0.160', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.376', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.885', 'weapon2': '0.936', 'weapon3': '1.898'} [2024-08-05 10:08:56,739][00172] DAMAGECOUNT value on done: 667.0 [2024-08-05 10:08:56,746][00172] Sum rewards: -3.896, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.154', 'weapon5': '0.002', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO5': '0.023', 'ARMOR': '0.058', 'AMMO4': '0.071', 'weapon4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'HITCOUNT': '0.260', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.825', 'WEAPON3': '1.000', 'weapon2': '1.076', 'weapon3': '2.182', 'FRAGCOUNT': '3.000'} [2024-08-05 10:08:56,786][00161] DAMAGECOUNT value on done: 915.0 [2024-08-05 10:08:56,792][00161] Sum rewards: -5.253, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-3.500', 'weapon7': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'HITCOUNT': '0.060', 'ARMOR': '0.072', 'AMMO4': '0.085', 'AMMO3': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.242', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'HEALTH': '0.496', 'DAMAGECOUNT': '0.525', 'weapon3': '1.218', 'weapon2': '1.478'} [2024-08-05 10:08:56,894][00166] DAMAGECOUNT value on done: 684.0 [2024-08-05 10:08:56,895][00166] Sum rewards: -2.707, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.079', 'AMMO2': '0.008', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.041', 'weapon4': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'weapon5': '0.120', 'HITCOUNT': '0.190', 'WEAPON5': '0.250', 'ARMOR': '0.479', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.242', 'FRAGCOUNT': '1.500', 'weapon2': '1.622', 'weapon3': '1.718'} [2024-08-05 10:08:57,180][00167] DAMAGECOUNT value on done: 718.0 [2024-08-05 10:08:57,187][00167] Sum rewards: -2.862, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.670', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.015', 'ARMOR': '0.016', 'WEAPON1': '0.040', 'AMMO3': '0.136', 'weapon5': '0.152', 'HITCOUNT': '0.180', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.819', 'weapon3': '1.286', 'weapon2': '1.912', 'FRAGCOUNT': '2.000'} [2024-08-05 10:08:57,218][00156] DAMAGECOUNT value on done: 935.0 [2024-08-05 10:08:57,221][00156] Sum rewards: -2.222, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.332', 'WEAPON1': '0.010', 'AMMO5': '0.025', 'AMMO2': '0.026', 'weapon5': '0.110', 'AMMO4': '0.130', 'AMMO3': '0.168', 'weapon4': '0.190', 'WEAPON4': '0.250', 'HITCOUNT': '0.280', 'WEAPON5': '0.450', 'ARMOR': '0.454', 'WEAPON3': '1.000', 'weapon2': '1.280', 'DAMAGECOUNT': '1.719', 'weapon3': '2.018', 'FRAGCOUNT': '4.500'} [2024-08-05 10:08:58,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 8265728. Throughput: 0: 1219.4. Samples: 2069288. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 10:08:58,357][00034] Avg episode reward: [(0, '-3.290')] [2024-08-05 10:08:58,359][00136] Saving new best policy, reward=-3.290! [2024-08-05 10:08:58,442][00159] Large shaping reward -2.534 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 10:08:58,506][00168] DAMAGECOUNT value on done: 658.0 [2024-08-05 10:08:58,506][00168] Sum rewards: -3.333, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.044', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'AMMO5': '0.010', 'weapon5': '0.020', 'HITCOUNT': '0.180', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'ARMOR': '0.510', 'DAMAGECOUNT': '0.840', 'WEAPON3': '1.000', 'weapon2': '1.160', 'FRAGCOUNT': '2.000', 'weapon3': '2.402'} [2024-08-05 10:08:58,731][00162] DAMAGECOUNT value on done: 998.0 [2024-08-05 10:08:58,734][00162] Sum rewards: -1.526, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.290', 'weapon5': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'WEAPON4': '0.050', 'weapon7': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon4': '0.218', 'HITCOUNT': '0.280', 'WEAPON3': '0.950', 'DAMAGECOUNT': '0.975', 'weapon2': '1.058', 'weapon3': '1.876', 'FRAGCOUNT': '3.000'} [2024-08-05 10:08:58,950][00170] DAMAGECOUNT value on done: 490.0 [2024-08-05 10:08:58,951][00170] Sum rewards: -0.872, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.738', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.007', 'ARMOR': '0.077', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'weapon4': '0.242', 'HITCOUNT': '0.260', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.810', 'weapon2': '1.338', 'weapon3': '1.614', 'FRAGCOUNT': '3.000'} [2024-08-05 10:09:00,226][00157] Updated weights for policy 0, policy_version 1010 (0.0036) [2024-08-05 10:09:00,369][00158] DAMAGECOUNT value on done: 1293.0 [2024-08-05 10:09:00,373][00158] Sum rewards: -4.069, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-2.000', 'HEALTH': '-0.978', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'ARMOR': '0.052', 'AMMO4': '0.072', 'AMMO3': '0.121', 'weapon5': '0.136', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.254', 'HITCOUNT': '0.290', 'WEAPON3': '0.650', 'weapon3': '1.226', 'DAMAGECOUNT': '1.422', 'weapon2': '1.752'} [2024-08-05 10:09:00,444][00165] DAMAGECOUNT value on done: 654.0 [2024-08-05 10:09:00,447][00165] Sum rewards: 2.538, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.041', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO5': '0.010', 'ARMOR': '0.024', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.099', 'weapon5': '0.172', 'WEAPON5': '0.300', 'HITCOUNT': '0.320', 'WEAPON3': '0.450', 'weapon3': '1.388', 'DAMAGECOUNT': '1.542', 'weapon2': '1.742', 'FRAGCOUNT': '5.000'} [2024-08-05 10:09:00,476][00163] DAMAGECOUNT value on done: 623.0 [2024-08-05 10:09:00,479][00163] Sum rewards: 2.030, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.083', 'AMMO5': '0.014', 'AMMO2': '0.015', 'weapon5': '0.060', 'AMMO3': '0.072', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'HITCOUNT': '0.200', 'weapon4': '0.216', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.735', 'weapon2': '1.302', 'weapon3': '1.526', 'FRAGCOUNT': '2.000'} [2024-08-05 10:09:00,903][00169] DAMAGECOUNT value on done: 506.0 [2024-08-05 10:09:00,904][00169] Sum rewards: -3.484, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.425', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'AMMO2': '0.041', 'weapon5': '0.066', 'AMMO3': '0.106', 'WEAPON5': '0.150', 'HITCOUNT': '0.180', 'AMMO4': '0.205', 'WEAPON4': '0.500', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.717', 'weapon4': '0.818', 'weapon2': '0.966', 'weapon3': '1.334'} [2024-08-05 10:09:01,168][00159] DAMAGECOUNT value on done: 796.0 [2024-08-05 10:09:01,176][00159] Sum rewards: 2.413, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.038', 'AMMO2': '0.005', 'AMMO5': '0.015', 'AMMO4': '0.023', 'weapon5': '0.046', 'WEAPON4': '0.050', 'ARMOR': '0.072', 'weapon4': '0.096', 'AMMO3': '0.117', 'WEAPON5': '0.150', 'HITCOUNT': '0.370', 'WEAPON3': '0.550', 'weapon3': '1.418', 'DAMAGECOUNT': '1.521', 'weapon2': '2.018', 'FRAGCOUNT': '6.000'} [2024-08-05 10:09:02,576][00164] DAMAGECOUNT value on done: 712.0 [2024-08-05 10:09:02,584][00164] Sum rewards: -1.173, reward structure: {'DEATHCOUNT': '-7.500', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.014', 'ARMOR': '0.036', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'weapon5': '0.128', 'weapon4': '0.136', 'HITCOUNT': '0.190', 'HEALTH': '0.228', 'WEAPON5': '0.300', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.657', 'weapon2': '1.294', 'weapon3': '1.880'} [2024-08-05 10:09:03,179][00161] DAMAGECOUNT value on done: 370.0 [2024-08-05 10:09:03,182][00161] Sum rewards: -11.280, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.851', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.023', 'weapon5': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.150', 'HITCOUNT': '0.210', 'weapon4': '0.362', 'WEAPON4': '0.400', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.675', 'weapon3': '1.040', 'weapon2': '2.030'} [2024-08-05 10:09:03,328][00166] DAMAGECOUNT value on done: 753.0 [2024-08-05 10:09:03,329][00166] Sum rewards: -2.494, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.144', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.015', 'weapon5': '0.078', 'AMMO3': '0.085', 'weapon7': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.432', 'WEAPON3': '0.500', 'weapon2': '1.264', 'weapon3': '1.544'} [2024-08-05 10:09:03,356][00034] Fps is (10 sec: 5734.5, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 8290304. Throughput: 0: 1218.8. Samples: 2076664. Policy #0 lag: (min: 0.0, avg: 1.7, max: 4.0) [2024-08-05 10:09:03,357][00034] Avg episode reward: [(0, '-3.158')] [2024-08-05 10:09:03,368][00136] Saving new best policy, reward=-3.158! [2024-08-05 10:09:03,534][00171] DAMAGECOUNT value on done: 452.0 [2024-08-05 10:09:03,568][00167] DAMAGECOUNT value on done: 674.0 [2024-08-05 10:09:03,573][00167] Sum rewards: -5.856, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.360', 'WEAPON1': '0.010', 'ARMOR': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'HITCOUNT': '0.190', 'weapon4': '0.256', 'DAMAGECOUNT': '0.675', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.162', 'weapon2': '1.546'} [2024-08-05 10:09:03,614][00156] DAMAGECOUNT value on done: 926.0 [2024-08-05 10:09:03,620][00156] Sum rewards: -0.762, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.117', 'AMMO2': '0.008', 'AMMO5': '0.010', 'weapon5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.040', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'HITCOUNT': '0.220', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.044', 'weapon3': '1.532', 'weapon2': '1.940', 'FRAGCOUNT': '3.000'} [2024-08-05 10:09:03,710][00160] DAMAGECOUNT value on done: 1047.0 [2024-08-05 10:09:03,713][00160] Sum rewards: -1.873, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.314', 'AMMO2': '0.010', 'AMMO5': '0.017', 'ARMOR': '0.044', 'AMMO4': '0.048', 'WEAPON1': '0.050', 'AMMO3': '0.096', 'WEAPON4': '0.200', 'HITCOUNT': '0.240', 'weapon5': '0.312', 'weapon4': '0.356', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'weapon3': '0.788', 'DAMAGECOUNT': '1.641', 'weapon2': '1.738', 'FRAGCOUNT': '2.000'} [2024-08-05 10:09:04,011][00172] DAMAGECOUNT value on done: 1041.0 [2024-08-05 10:09:04,014][00172] Sum rewards: -2.006, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.394', 'AMMO5': '0.007', 'weapon4': '0.034', 'AMMO2': '0.037', 'weapon7': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.144', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'AMMO4': '0.184', 'HITCOUNT': '0.340', 'WEAPON4': '0.350', 'ARMOR': '0.534', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.548', 'weapon3': '1.586', 'weapon2': '1.764', 'FRAGCOUNT': '2.500'} [2024-08-05 10:09:05,134][00162] DAMAGECOUNT value on done: 405.0 [2024-08-05 10:09:05,137][00162] Sum rewards: -11.929, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.310', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon5': '0.018', 'AMMO4': '0.049', 'ARMOR': '0.072', 'WEAPON5': '0.100', 'weapon4': '0.120', 'HITCOUNT': '0.150', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.585', 'WEAPON3': '0.800', 'weapon3': '1.092', 'weapon2': '2.000'} [2024-08-05 10:09:05,365][00170] DAMAGECOUNT value on done: 953.0 [2024-08-05 10:09:05,369][00170] Sum rewards: -5.335, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.624', 'AMMO2': '0.013', 'weapon4': '0.016', 'AMMO5': '0.017', 'ARMOR': '0.024', 'AMMO4': '0.066', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon5': '0.232', 'HITCOUNT': '0.310', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.272', 'weapon3': '1.592', 'weapon2': '1.772', 'FRAGCOUNT': '3.000'} [2024-08-05 10:09:05,584][00168] DAMAGECOUNT value on done: 716.0 [2024-08-05 10:09:05,590][00168] Sum rewards: -9.715, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.784', 'AMMO2': '0.005', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.023', 'ARMOR': '0.040', 'weapon4': '0.092', 'WEAPON4': '0.100', 'weapon5': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'HITCOUNT': '0.230', 'FRAGCOUNT': '0.500', 'WEAPON3': '1.100', 'DAMAGECOUNT': '1.314', 'weapon2': '1.622', 'weapon3': '1.676'} [2024-08-05 10:09:06,613][00158] DAMAGECOUNT value on done: 868.0 [2024-08-05 10:09:06,618][00158] Sum rewards: -2.063, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.305', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.010', 'weapon5': '0.012', 'AMMO3': '0.107', 'WEAPON5': '0.200', 'HITCOUNT': '0.230', 'ARMOR': '0.474', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.750', 'weapon2': '1.582', 'weapon3': '2.002', 'FRAGCOUNT': '3.000'} [2024-08-05 10:09:06,706][00165] DAMAGECOUNT value on done: 622.0 [2024-08-05 10:09:06,710][00165] Sum rewards: -7.434, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.920', 'AMMO2': '0.021', 'AMMO5': '0.027', 'weapon5': '0.040', 'AMMO4': '0.104', 'HITCOUNT': '0.190', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon4': '0.318', 'WEAPON5': '0.450', 'DAMAGECOUNT': '0.531', 'FRAGCOUNT': '1.000', 'weapon2': '1.010', 'WEAPON3': '1.200', 'weapon3': '1.872'} [2024-08-05 10:09:06,803][00163] DAMAGECOUNT value on done: 711.0 [2024-08-05 10:09:06,808][00163] Sum rewards: 2.850, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.835', 'AMMO5': '0.010', 'weapon5': '0.014', 'weapon7': '0.022', 'AMMO2': '0.032', 'AMMO3': '0.119', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.400', 'WEAPON3': '0.700', 'weapon2': '1.048', 'DAMAGECOUNT': '1.125', 'weapon3': '1.856', 'FRAGCOUNT': '4.000'} [2024-08-05 10:09:07,297][00169] DAMAGECOUNT value on done: 767.0 [2024-08-05 10:09:07,301][00169] Sum rewards: -4.189, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.356', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.058', 'ARMOR': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'HITCOUNT': '0.200', 'weapon4': '0.228', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.690', 'WEAPON3': '0.750', 'weapon2': '1.500', 'weapon3': '1.744'} [2024-08-05 10:09:07,665][00159] DAMAGECOUNT value on done: 613.0 [2024-08-05 10:09:07,669][00159] Sum rewards: -5.184, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.818', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO4': '0.019', 'ARMOR': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'weapon4': '0.220', 'HITCOUNT': '0.250', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.008', 'weapon3': '1.360', 'weapon2': '1.946', 'FRAGCOUNT': '2.000'} [2024-08-05 10:09:08,356][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.7, 300 sec: 4915.2). Total num frames: 8314880. Throughput: 0: 1218.3. Samples: 2080320. Policy #0 lag: (min: 0.0, avg: 2.0, max: 5.0) [2024-08-05 10:09:08,357][00034] Avg episode reward: [(0, '-3.346')] [2024-08-05 10:09:09,238][00164] DAMAGECOUNT value on done: 557.0 [2024-08-05 10:09:09,950][00171] DAMAGECOUNT value on done: 464.0 [2024-08-05 10:09:09,952][00171] Sum rewards: -5.761, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-3.000', 'HEALTH': '-0.228', 'weapon4': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.096', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'weapon5': '0.180', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.396', 'WEAPON3': '0.700', 'weapon2': '0.944', 'weapon3': '1.970'} [2024-08-05 10:09:10,068][00160] DAMAGECOUNT value on done: 987.0 [2024-08-05 10:09:10,074][00160] Sum rewards: 0.819, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.303', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'AMMO3': '0.083', 'weapon4': '0.106', 'weapon5': '0.136', 'HITCOUNT': '0.150', 'WEAPON5': '0.250', 'ARMOR': '0.436', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.056', 'weapon3': '1.432', 'weapon2': '1.632', 'FRAGCOUNT': '2.000'} [2024-08-05 10:09:10,148][00161] DAMAGECOUNT value on done: 590.0 [2024-08-05 10:09:10,155][00161] Sum rewards: -7.944, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.100', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.018', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.088', 'HITCOUNT': '0.100', 'AMMO3': '0.144', 'weapon4': '0.252', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.750', 'weapon2': '1.350', 'weapon3': '1.680'} [2024-08-05 10:09:10,255][00166] DAMAGECOUNT value on done: 822.0 [2024-08-05 10:09:10,258][00166] Sum rewards: -8.272, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-3.000', 'HEALTH': '-1.932', 'AMMO2': '0.006', 'AMMO5': '0.018', 'AMMO4': '0.029', 'weapon5': '0.100', 'ARMOR': '0.108', 'HITCOUNT': '0.110', 'AMMO3': '0.125', 'WEAPON4': '0.200', 'weapon4': '0.236', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.650', 'weapon3': '1.204', 'weapon2': '1.524'} [2024-08-05 10:09:10,356][00172] DAMAGECOUNT value on done: 763.0 [2024-08-05 10:09:10,360][00172] Sum rewards: -0.323, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.668', 'AMMO2': '0.005', 'AMMO4': '0.022', 'HITCOUNT': '0.060', 'AMMO3': '0.093', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.180', 'weapon4': '0.232', 'WEAPON3': '0.550', 'ARMOR': '0.961', 'FRAGCOUNT': '1.000', 'weapon2': '1.056', 'weapon3': '1.286'} [2024-08-05 10:09:10,523][00167] DAMAGECOUNT value on done: 522.0 [2024-08-05 10:09:10,526][00167] Sum rewards: -1.798, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.512', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.024', 'WEAPON4': '0.050', 'weapon5': '0.064', 'weapon4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.122', 'HITCOUNT': '0.200', 'DAMAGECOUNT': '0.486', 'WEAPON3': '0.550', 'weapon3': '1.420', 'weapon2': '1.716', 'FRAGCOUNT': '2.000'} [2024-08-05 10:09:10,571][00156] DAMAGECOUNT value on done: 704.0 [2024-08-05 10:09:10,575][00156] Sum rewards: -4.813, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.770', 'AMMO5': '0.010', 'ARMOR': '0.012', 'weapon5': '0.016', 'AMMO2': '0.020', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'HITCOUNT': '0.280', 'weapon4': '0.370', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.080', 'weapon2': '1.128', 'weapon3': '1.834', 'FRAGCOUNT': '4.000'} [2024-08-05 10:09:11,818][00168] DAMAGECOUNT value on done: 465.0 [2024-08-05 10:09:11,821][00168] Sum rewards: -4.841, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.740', 'FRAGCOUNT': '-1.000', 'AMMO2': '0.012', 'AMMO5': '0.028', 'weapon7': '0.040', 'weapon5': '0.054', 'AMMO4': '0.059', 'AMMO3': '0.164', 'HITCOUNT': '0.190', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.214', 'WEAPON4': '0.300', 'ARMOR': '0.495', 'WEAPON5': '0.500', 'DAMAGECOUNT': '0.531', 'WEAPON3': '0.900', 'weapon2': '1.184', 'weapon3': '1.628'} [2024-08-05 10:09:12,575][00162] DAMAGECOUNT value on done: 619.0 [2024-08-05 10:09:12,575][00162] Sum rewards: -3.074, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.700', 'weapon5': '0.014', 'AMMO5': '0.023', 'AMMO2': '0.039', 'WEAPON1': '0.040', 'AMMO3': '0.175', 'AMMO4': '0.195', 'HITCOUNT': '0.200', 'weapon4': '0.368', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'ARMOR': '0.504', 'DAMAGECOUNT': '0.702', 'WEAPON3': '0.950', 'weapon2': '1.122', 'weapon3': '1.694', 'FRAGCOUNT': '3.000'} [2024-08-05 10:09:12,934][00158] DAMAGECOUNT value on done: 514.0 [2024-08-05 10:09:12,938][00158] Sum rewards: -3.454, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.076', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'weapon7': '0.016', 'WEAPON1': '0.040', 'ARMOR': '0.040', 'AMMO3': '0.117', 'weapon5': '0.158', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.258', 'DAMAGECOUNT': '0.735', 'WEAPON3': '0.800', 'weapon2': '1.474', 'weapon3': '1.488', 'FRAGCOUNT': '2.000'} [2024-08-05 10:09:12,956][00165] DAMAGECOUNT value on done: 818.0 [2024-08-05 10:09:12,958][00165] Sum rewards: -8.995, reward structure: {'DEATHCOUNT': '-12.000', 'FRAGCOUNT': '-2.000', 'HEALTH': '-1.664', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'AMMO5': '0.030', 'AMMO2': '0.033', 'weapon5': '0.096', 'AMMO3': '0.134', 'AMMO4': '0.167', 'WEAPON4': '0.200', 'HITCOUNT': '0.240', 'weapon4': '0.364', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.981', 'weapon2': '1.322', 'weapon3': '1.804'} [2024-08-05 10:09:13,057][00170] DAMAGECOUNT value on done: 429.0 [2024-08-05 10:09:13,058][00170] Sum rewards: -5.431, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.268', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.070', 'ARMOR': '0.128', 'WEAPON4': '0.150', 'weapon4': '0.182', 'AMMO3': '0.193', 'HITCOUNT': '0.250', 'DAMAGECOUNT': '0.717', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.564', 'weapon3': '1.806'} [2024-08-05 10:09:13,245][00163] DAMAGECOUNT value on done: 377.0 [2024-08-05 10:09:13,247][00163] Sum rewards: -3.483, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.516', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.064', 'AMMO3': '0.097', 'HITCOUNT': '0.120', 'weapon5': '0.230', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.462', 'WEAPON3': '0.650', 'weapon3': '1.246', 'weapon2': '1.846', 'FRAGCOUNT': '2.000'} [2024-08-05 10:09:13,356][00034] Fps is (10 sec: 4095.9, 60 sec: 4778.6, 300 sec: 4887.4). Total num frames: 8331264. Throughput: 0: 1216.9. Samples: 2087696. Policy #0 lag: (min: 0.0, avg: 2.1, max: 4.0) [2024-08-05 10:09:13,360][00034] Avg episode reward: [(0, '-3.425')] [2024-08-05 10:09:15,632][00169] DAMAGECOUNT value on done: 524.0 [2024-08-05 10:09:15,635][00169] Sum rewards: -8.466, reward structure: {'DEATHCOUNT': '-11.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.186', 'AMMO5': '0.007', 'weapon4': '0.024', 'AMMO2': '0.026', 'weapon5': '0.072', 'ARMOR': '0.088', 'WEAPON4': '0.100', 'AMMO4': '0.131', 'HITCOUNT': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'DAMAGECOUNT': '0.393', 'WEAPON3': '0.900', 'weapon3': '1.602', 'weapon2': '1.660'} [2024-08-05 10:09:15,967][00164] DAMAGECOUNT value on done: 389.0 [2024-08-05 10:09:15,969][00164] Sum rewards: -3.665, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.151', 'FRAGCOUNT': '-0.500', 'WEAPON1': '0.010', 'weapon5': '0.014', 'AMMO5': '0.018', 'AMMO2': '0.026', 'weapon7': '0.066', 'AMMO3': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.128', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.316', 'ARMOR': '0.480', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.780', 'weapon2': '1.400', 'weapon3': '1.524'} [2024-08-05 10:09:16,058][00159] DAMAGECOUNT value on done: 1033.0 [2024-08-05 10:09:16,059][00159] Sum rewards: -5.469, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.385', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO5': '0.028', 'AMMO4': '0.093', 'AMMO3': '0.151', 'weapon5': '0.214', 'WEAPON4': '0.250', 'weapon4': '0.282', 'HITCOUNT': '0.290', 'FRAGCOUNT': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'weapon2': '1.054', 'DAMAGECOUNT': '1.299', 'weapon3': '1.666'} [2024-08-05 10:09:16,700][00171] DAMAGECOUNT value on done: 725.0 [2024-08-05 10:09:16,701][00171] Sum rewards: 0.432, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.228', 'AMMO5': '0.019', 'AMMO2': '0.026', 'ARMOR': '0.076', 'AMMO3': '0.093', 'weapon5': '0.098', 'AMMO4': '0.130', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.286', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'weapon3': '0.966', 'DAMAGECOUNT': '1.077', 'weapon2': '1.718', 'FRAGCOUNT': '3.500'} [2024-08-05 10:09:16,785][00157] Updated weights for policy 0, policy_version 1020 (0.0020) [2024-08-05 10:09:16,837][00160] DAMAGECOUNT value on done: 636.0 [2024-08-05 10:09:16,841][00160] Sum rewards: -3.960, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.788', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'ARMOR': '0.028', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.175', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'weapon5': '0.212', 'weapon4': '0.248', 'WEAPON5': '0.450', 'DAMAGECOUNT': '0.750', 'WEAPON3': '0.950', 'weapon2': '1.192', 'weapon3': '1.742', 'FRAGCOUNT': '2.000'} [2024-08-05 10:09:17,158][00172] DAMAGECOUNT value on done: 493.0 [2024-08-05 10:09:17,164][00172] Sum rewards: -2.552, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.570', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon5': '0.016', 'AMMO5': '0.018', 'ARMOR': '0.040', 'AMMO4': '0.074', 'AMMO3': '0.204', 'HITCOUNT': '0.210', 'weapon4': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.648', 'weapon2': '0.722', 'WEAPON3': '0.950', 'FRAGCOUNT': '2.000', 'weapon3': '2.326'} [2024-08-05 10:09:17,471][00161] DAMAGECOUNT value on done: 768.0 [2024-08-05 10:09:17,478][00161] Sum rewards: -1.881, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.361', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon5': '0.024', 'WEAPON4': '0.050', 'ARMOR': '0.104', 'weapon4': '0.106', 'AMMO3': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.340', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.197', 'weapon2': '1.460', 'weapon3': '1.930', 'FRAGCOUNT': '3.000'} [2024-08-05 10:09:17,650][00166] DAMAGECOUNT value on done: 606.0 [2024-08-05 10:09:17,663][00166] Sum rewards: -3.681, reward structure: {'DEATHCOUNT': '-5.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.303', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon4': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.068', 'HITCOUNT': '0.070', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.192', 'WEAPON3': '0.450', 'ARMOR': '0.544', 'weapon3': '1.346', 'weapon2': '1.424'} [2024-08-05 10:09:18,062][00167] DAMAGECOUNT value on done: 764.0 [2024-08-05 10:09:18,066][00167] Sum rewards: -5.618, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.379', 'AMMO2': '0.011', 'ARMOR': '0.044', 'HITCOUNT': '0.050', 'AMMO4': '0.053', 'weapon7': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'DAMAGECOUNT': '0.180', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.402', 'weapon2': '0.984', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon3': '1.612'} [2024-08-05 10:09:18,131][00156] DAMAGECOUNT value on done: 437.0 [2024-08-05 10:09:18,133][00156] Sum rewards: -3.676, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.841', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon5': '0.090', 'AMMO3': '0.103', 'HITCOUNT': '0.110', 'ARMOR': '0.112', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'weapon4': '0.182', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.516', 'WEAPON3': '0.650', 'weapon3': '1.372', 'weapon2': '1.640'} [2024-08-05 10:09:18,356][00034] Fps is (10 sec: 4096.0, 60 sec: 4778.7, 300 sec: 4915.2). Total num frames: 8355840. Throughput: 0: 1200.5. Samples: 2094432. Policy #0 lag: (min: 0.0, avg: 2.1, max: 5.0) [2024-08-05 10:09:18,358][00034] Avg episode reward: [(0, '-3.514')] [2024-08-05 10:09:18,618][00168] DAMAGECOUNT value on done: 965.0 [2024-08-05 10:09:18,619][00168] Sum rewards: -2.958, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.858', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'AMMO2': '0.042', 'weapon5': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.155', 'weapon7': '0.158', 'HITCOUNT': '0.200', 'AMMO4': '0.210', 'weapon4': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.950', 'weapon2': '1.040', 'DAMAGECOUNT': '1.128', 'weapon3': '1.662', 'FRAGCOUNT': '4.000'} [2024-08-05 10:09:19,593][00165] DAMAGECOUNT value on done: 436.0 [2024-08-05 10:09:19,598][00158] DAMAGECOUNT value on done: 592.0 [2024-08-05 10:09:19,597][00165] Sum rewards: -2.862, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.324', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'weapon5': '0.112', 'AMMO3': '0.122', 'HITCOUNT': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.182', 'weapon4': '0.326', 'WEAPON4': '0.400', 'ARMOR': '0.515', 'DAMAGECOUNT': '0.531', 'WEAPON3': '0.700', 'weapon2': '1.424', 'weapon3': '1.536', 'FRAGCOUNT': '2.000'} [2024-08-05 10:09:19,599][00158] Sum rewards: -6.257, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.056', 'FRAGCOUNT': '-2.000', 'AMMO2': '0.009', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'AMMO4': '0.046', 'weapon7': '0.076', 'AMMO3': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.120', 'weapon5': '0.182', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.236', 'WEAPON5': '0.450', 'DAMAGECOUNT': '0.471', 'WEAPON3': '0.800', 'weapon2': '0.914', 'weapon3': '1.940'} [2024-08-05 10:09:19,677][00162] DAMAGECOUNT value on done: 643.0 [2024-08-05 10:09:19,682][00162] Sum rewards: -0.351, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.590', 'AMMO2': '0.011', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'weapon4': '0.052', 'AMMO4': '0.054', 'weapon5': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.204', 'HITCOUNT': '0.270', 'WEAPON5': '0.350', 'weapon2': '0.924', 'WEAPON3': '1.150', 'DAMAGECOUNT': '1.245', 'weapon3': '2.244', 'FRAGCOUNT': '5.000'} [2024-08-05 10:09:19,955][00170] DAMAGECOUNT value on done: 888.0 [2024-08-05 10:09:19,959][00170] Sum rewards: -3.090, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.826', 'AMMO2': '0.007', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.035', 'weapon5': '0.036', 'AMMO3': '0.140', 'HITCOUNT': '0.140', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.555', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.500', 'weapon2': '1.640', 'weapon3': '2.000'} [2024-08-05 10:09:19,976][00163] DAMAGECOUNT value on done: 795.0 [2024-08-05 10:09:19,983][00163] Sum rewards: -2.002, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.709', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'weapon5': '0.072', 'ARMOR': '0.076', 'AMMO4': '0.089', 'AMMO3': '0.112', 'WEAPON5': '0.150', 'HITCOUNT': '0.160', 'weapon4': '0.216', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.065', 'weapon3': '1.244', 'weapon2': '1.890', 'FRAGCOUNT': '2.000'} [2024-08-05 10:09:21,822][00169] DAMAGECOUNT value on done: 471.0 [2024-08-05 10:09:21,829][00169] Sum rewards: -3.654, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.838', 'AMMO5': '0.010', 'AMMO2': '0.019', 'ARMOR': '0.072', 'weapon7': '0.076', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.150', 'AMMO3': '0.156', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.352', 'DAMAGECOUNT': '0.537', 'WEAPON3': '0.750', 'weapon2': '0.956', 'FRAGCOUNT': '1.000', 'weapon3': '1.470'} [2024-08-05 10:09:22,242][00164] DAMAGECOUNT value on done: 375.0 [2024-08-05 10:09:22,248][00159] DAMAGECOUNT value on done: 751.0 [2024-08-05 10:09:22,249][00159] Sum rewards: -2.323, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.000', 'AMMO5': '0.012', 'weapon5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.169', 'HITCOUNT': '0.190', 'WEAPON5': '0.200', 'weapon4': '0.314', 'ARMOR': '0.444', 'DAMAGECOUNT': '0.531', 'WEAPON3': '0.850', 'weapon2': '1.258', 'weapon3': '1.880', 'FRAGCOUNT': '3.000'} [2024-08-05 10:09:22,247][00164] Sum rewards: -3.020, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.470', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'weapon4': '0.040', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.162', 'HITCOUNT': '0.240', 'DAMAGECOUNT': '0.747', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.376', 'weapon3': '1.778'} [2024-08-05 10:09:22,914][00171] DAMAGECOUNT value on done: 575.0 [2024-08-05 10:09:23,124][00160] DAMAGECOUNT value on done: 532.0 [2024-08-05 10:09:23,126][00160] Sum rewards: -3.346, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.328', 'AMMO2': '0.008', 'AMMO5': '0.012', 'weapon5': '0.024', 'WEAPON1': '0.030', 'AMMO4': '0.041', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'HITCOUNT': '0.160', 'weapon4': '0.266', 'ARMOR': '0.491', 'DAMAGECOUNT': '0.615', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.042', 'weapon3': '1.934'} [2024-08-05 10:09:23,356][00034] Fps is (10 sec: 5734.5, 60 sec: 4915.2, 300 sec: 4915.2). Total num frames: 8388608. Throughput: 0: 1201.4. Samples: 2098112. Policy #0 lag: (min: 0.0, avg: 2.0, max: 4.0) [2024-08-05 10:09:23,357][00034] Avg episode reward: [(0, '-3.421')] [2024-08-05 10:09:23,359][00172] DAMAGECOUNT value on done: 668.0 [2024-08-05 10:09:23,370][00136] Saving /kaggle/working/train_dir/default_experiment/checkpoint_p0/checkpoint_000001024_8388608.pth... [2024-08-05 10:09:23,366][00172] Sum rewards: 0.777, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.824', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.021', 'ARMOR': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.134', 'HITCOUNT': '0.190', 'WEAPON4': '0.400', 'weapon4': '0.466', 'DAMAGECOUNT': '0.780', 'WEAPON3': '0.850', 'weapon2': '1.076', 'weapon3': '1.892', 'FRAGCOUNT': '3.000'} [2024-08-05 10:09:23,570][00136] Removing /kaggle/working/train_dir/default_experiment/checkpoint_p0/checkpoint_000000880_7208960.pth [2024-08-05 10:09:24,846][00168] DAMAGECOUNT value on done: 641.0 [2024-08-05 10:09:25,259][00161] DAMAGECOUNT value on done: 692.0 [2024-08-05 10:09:25,261][00161] Sum rewards: -2.003, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.277', 'AMMO5': '0.003', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'weapon5': '0.024', 'AMMO4': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.094', 'HITCOUNT': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.164', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.268', 'WEAPON3': '0.500', 'ARMOR': '0.527', 'DAMAGECOUNT': '0.681', 'weapon3': '1.140', 'weapon2': '1.278'} [2024-08-05 10:09:25,330][00166] DAMAGECOUNT value on done: 978.0 [2024-08-05 10:09:25,331][00166] Sum rewards: -8.253, reward structure: {'DEATHCOUNT': '-11.250', 'FRAGCOUNT': '-2.000', 'HEALTH': '-1.500', 'AMMO2': '0.009', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.040', 'AMMO4': '0.047', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'weapon4': '0.324', 'HITCOUNT': '0.350', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.329', 'weapon2': '1.498', 'weapon3': '1.514'} [2024-08-05 10:09:25,734][00167] DAMAGECOUNT value on done: 828.0 [2024-08-05 10:09:25,737][00167] Sum rewards: -3.330, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.230', 'AMMO2': '0.000', 'AMMO4': '0.000', 'ARMOR': '0.048', 'weapon7': '0.074', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.150', 'AMMO3': '0.190', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.651', 'WEAPON3': '0.950', 'weapon3': '1.540', 'weapon2': '1.656', 'FRAGCOUNT': '2.000'} [2024-08-05 10:09:25,779][00156] DAMAGECOUNT value on done: 727.0 [2024-08-05 10:09:25,785][00156] Sum rewards: -5.774, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.093', 'AMMO2': '0.008', 'AMMO5': '0.019', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'weapon4': '0.078', 'AMMO3': '0.101', 'HITCOUNT': '0.110', 'weapon5': '0.134', 'WEAPON5': '0.300', 'ARMOR': '0.436', 'DAMAGECOUNT': '0.453', 'WEAPON3': '0.600', 'weapon2': '1.080', 'weapon3': '2.158'} [2024-08-05 10:09:26,223][00162] DAMAGECOUNT value on done: 746.0 [2024-08-05 10:09:26,227][00162] Sum rewards: -2.590, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.355', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO2': '0.029', 'weapon5': '0.050', 'AMMO3': '0.141', 'weapon4': '0.142', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'HITCOUNT': '0.250', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.434', 'weapon3': '1.538', 'weapon2': '1.694', 'FRAGCOUNT': '2.500'} [2024-08-05 10:09:26,240][00158] DAMAGECOUNT value on done: 429.0 [2024-08-05 10:09:26,241][00158] Sum rewards: -7.855, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.002', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.052', 'HITCOUNT': '0.090', 'ARMOR': '0.092', 'AMMO4': '0.094', 'AMMO3': '0.121', 'weapon4': '0.192', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.255', 'WEAPON4': '0.350', 'WEAPON3': '0.650', 'weapon2': '1.600', 'weapon3': '1.652'} [2024-08-05 10:09:26,325][00165] DAMAGECOUNT value on done: 774.0 [2024-08-05 10:09:26,325][00165] Sum rewards: -2.475, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.645', 'AMMO5': '0.004', 'AMMO2': '0.017', 'weapon5': '0.052', 'ARMOR': '0.072', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.113', 'HITCOUNT': '0.140', 'weapon4': '0.294', 'WEAPON4': '0.350', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.800', 'weapon2': '1.148', 'weapon3': '1.734', 'FRAGCOUNT': '2.000'} [2024-08-05 10:09:26,499][00170] DAMAGECOUNT value on done: 484.0 [2024-08-05 10:09:26,503][00170] Sum rewards: -3.990, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.365', 'AMMO2': '0.015', 'AMMO5': '0.017', 'ARMOR': '0.020', 'weapon5': '0.020', 'AMMO4': '0.077', 'weapon4': '0.098', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.210', 'DAMAGECOUNT': '0.660', 'WEAPON3': '0.750', 'weapon2': '1.434', 'weapon3': '1.840', 'FRAGCOUNT': '2.000'} [2024-08-05 10:09:26,922][00163] DAMAGECOUNT value on done: 1461.0 [2024-08-05 10:09:26,930][00163] Sum rewards: -2.083, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.352', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.032', 'AMMO4': '0.032', 'ARMOR': '0.073', 'HITCOUNT': '0.100', 'weapon7': '0.100', 'AMMO3': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.220', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.915', 'weapon3': '1.236', 'weapon2': '1.238'} [2024-08-05 10:09:28,325][00169] DAMAGECOUNT value on done: 679.0 [2024-08-05 10:09:28,326][00169] Sum rewards: 0.505, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.130', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.035', 'weapon7': '0.052', 'AMMO3': '0.092', 'weapon5': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.182', 'HITCOUNT': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.227', 'weapon3': '1.520', 'weapon2': '1.810', 'FRAGCOUNT': '2.500'} [2024-08-05 10:09:28,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4887.4). Total num frames: 8404992. Throughput: 0: 1206.4. Samples: 2105432. Policy #0 lag: (min: 0.0, avg: 2.4, max: 5.0) [2024-08-05 10:09:28,357][00034] Avg episode reward: [(0, '-3.673')] [2024-08-05 10:09:28,611][00164] DAMAGECOUNT value on done: 627.0 [2024-08-05 10:09:28,612][00164] Sum rewards: -3.486, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.370', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON1': '0.030', 'ARMOR': '0.044', 'weapon7': '0.050', 'AMMO4': '0.058', 'weapon4': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.208', 'HITCOUNT': '0.210', 'DAMAGECOUNT': '0.561', 'WEAPON3': '0.950', 'weapon2': '1.402', 'weapon3': '1.918', 'FRAGCOUNT': '3.000'} [2024-08-05 10:09:28,764][00159] DAMAGECOUNT value on done: 786.0 [2024-08-05 10:09:28,768][00159] Sum rewards: -5.598, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.254', 'AMMO5': '0.010', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'weapon5': '0.050', 'ARMOR': '0.064', 'AMMO3': '0.134', 'AMMO4': '0.165', 'WEAPON4': '0.200', 'HITCOUNT': '0.240', 'weapon4': '0.486', 'DAMAGECOUNT': '0.693', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.248', 'weapon3': '1.682'} [2024-08-05 10:09:29,380][00160] DAMAGECOUNT value on done: 626.0 [2024-08-05 10:09:29,387][00160] Sum rewards: -7.258, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.130', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.009', 'WEAPON1': '0.030', 'weapon5': '0.068', 'ARMOR': '0.072', 'weapon4': '0.082', 'WEAPON4': '0.100', 'HITCOUNT': '0.140', 'AMMO3': '0.141', 'WEAPON5': '0.200', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.912', 'weapon3': '1.416', 'weapon2': '1.940'} [2024-08-05 10:09:29,673][00172] DAMAGECOUNT value on done: 511.0 [2024-08-05 10:09:29,679][00172] Sum rewards: -6.952, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.468', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'weapon7': '0.012', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.034', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'HITCOUNT': '0.140', 'weapon4': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.369', 'WEAPON3': '0.750', 'weapon3': '1.588', 'weapon2': '1.618', 'FRAGCOUNT': '2.000'} [2024-08-05 10:09:30,635][00171] DAMAGECOUNT value on done: 429.0 [2024-08-05 10:09:30,636][00171] Sum rewards: -5.452, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.163', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'ARMOR': '0.040', 'weapon5': '0.052', 'AMMO4': '0.102', 'weapon7': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.136', 'weapon4': '0.142', 'HITCOUNT': '0.170', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'DAMAGECOUNT': '0.486', 'WEAPON3': '0.850', 'weapon2': '1.160', 'weapon3': '1.870'} [2024-08-05 10:09:31,091][00168] DAMAGECOUNT value on done: 546.0 [2024-08-05 10:09:31,093][00168] Sum rewards: -3.719, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.605', 'FRAGCOUNT': '-1.500', 'AMMO2': '0.004', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.020', 'weapon7': '0.066', 'HITCOUNT': '0.070', 'AMMO3': '0.093', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.102', 'WEAPON5': '0.200', 'weapon4': '0.202', 'DAMAGECOUNT': '0.222', 'ARMOR': '0.564', 'WEAPON3': '0.700', 'weapon2': '0.958', 'weapon3': '1.750'} [2024-08-05 10:09:31,279][00161] DAMAGECOUNT value on done: 496.0 [2024-08-05 10:09:31,288][00161] Sum rewards: -5.463, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.825', 'AMMO5': '0.007', 'weapon5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'AMMO4': '0.161', 'weapon4': '0.188', 'HITCOUNT': '0.190', 'WEAPON4': '0.350', 'DAMAGECOUNT': '0.561', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.428', 'weapon2': '1.808'} [2024-08-05 10:09:31,389][00166] DAMAGECOUNT value on done: 729.0 [2024-08-05 10:09:31,811][00156] DAMAGECOUNT value on done: 559.0 [2024-08-05 10:09:31,816][00156] Sum rewards: -2.593, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.361', 'AMMO2': '0.007', 'weapon5': '0.008', 'AMMO5': '0.018', 'WEAPON1': '0.030', 'AMMO4': '0.036', 'WEAPON4': '0.100', 'weapon4': '0.108', 'HITCOUNT': '0.200', 'AMMO3': '0.207', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.705', 'ARMOR': '0.911', 'WEAPON3': '1.100', 'weapon2': '1.266', 'weapon3': '1.722', 'FRAGCOUNT': '2.000'} [2024-08-05 10:09:31,824][00167] DAMAGECOUNT value on done: 713.0 [2024-08-05 10:09:31,825][00167] Sum rewards: 0.523, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.216', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.084', 'AMMO3': '0.122', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.246', 'HITCOUNT': '0.330', 'WEAPON3': '0.650', 'weapon2': '1.298', 'weapon3': '1.498', 'DAMAGECOUNT': '1.716', 'FRAGCOUNT': '5.000'} [2024-08-05 10:09:32,519][00162] DAMAGECOUNT value on done: 893.0 [2024-08-05 10:09:32,525][00162] Sum rewards: -0.723, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.018', 'AMMO2': '0.010', 'AMMO5': '0.015', 'weapon4': '0.016', 'WEAPON1': '0.030', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'weapon5': '0.078', 'AMMO3': '0.197', 'WEAPON5': '0.250', 'HITCOUNT': '0.450', 'weapon2': '1.028', 'WEAPON3': '1.150', 'DAMAGECOUNT': '1.923', 'weapon3': '2.300', 'FRAGCOUNT': '5.000'} [2024-08-05 10:09:32,856][00170] DAMAGECOUNT value on done: 565.0 [2024-08-05 10:09:32,857][00170] Sum rewards: 1.009, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'weapon5': '0.046', 'WEAPON4': '0.050', 'ARMOR': '0.064', 'weapon7': '0.064', 'WEAPON5': '0.100', 'HEALTH': '0.120', 'AMMO3': '0.123', 'AMMO4': '0.128', 'weapon4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.933', 'weapon2': '1.084', 'weapon3': '1.966', 'FRAGCOUNT': '3.000'} [2024-08-05 10:09:33,071][00157] Updated weights for policy 0, policy_version 1030 (0.0020) [2024-08-05 10:09:33,359][00034] Fps is (10 sec: 4913.3, 60 sec: 4914.9, 300 sec: 4942.9). Total num frames: 8437760. Throughput: 0: 1215.0. Samples: 2112960. Policy #0 lag: (min: 0.0, avg: 2.3, max: 5.0) [2024-08-05 10:09:33,361][00034] Avg episode reward: [(0, '-3.530')] [2024-08-05 10:09:33,728][00158] DAMAGECOUNT value on done: 702.0 [2024-08-05 10:09:33,786][00165] DAMAGECOUNT value on done: 642.0 [2024-08-05 10:09:33,791][00165] Sum rewards: 1.494, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.296', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'weapon7': '0.122', 'weapon4': '0.138', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'HITCOUNT': '0.220', 'WEAPON5': '0.250', 'weapon5': '0.258', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.915', 'weapon2': '1.138', 'weapon3': '1.624', 'FRAGCOUNT': '2.000'} [2024-08-05 10:09:34,328][00163] DAMAGECOUNT value on done: 841.0 [2024-08-05 10:09:34,333][00163] Sum rewards: -1.700, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.038', 'weapon4': '0.040', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.090', 'HITCOUNT': '0.180', 'WEAPON3': '0.250', 'HEALTH': '0.310', 'ARMOR': '0.500', 'DAMAGECOUNT': '0.525', 'weapon3': '1.092', 'weapon2': '1.604'} [2024-08-05 10:09:34,820][00164] DAMAGECOUNT value on done: 962.0 [2024-08-05 10:09:34,822][00164] Sum rewards: -1.571, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.190', 'AMMO2': '0.007', 'AMMO5': '0.025', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'weapon5': '0.074', 'AMMO3': '0.114', 'weapon4': '0.114', 'WEAPON5': '0.300', 'HITCOUNT': '0.390', 'WEAPON3': '0.600', 'weapon2': '1.360', 'weapon3': '1.538', 'DAMAGECOUNT': '1.761', 'FRAGCOUNT': '2.000'} [2024-08-05 10:09:35,175][00169] DAMAGECOUNT value on done: 806.0 [2024-08-05 10:09:35,176][00169] Sum rewards: -3.728, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.861', 'AMMO4': '-0.057', 'AMMO2': '-0.011', 'AMMO5': '0.017', 'weapon5': '0.110', 'AMMO3': '0.150', 'WEAPON5': '0.250', 'HITCOUNT': '0.260', 'DAMAGECOUNT': '0.873', 'WEAPON3': '1.000', 'weapon2': '1.400', 'weapon3': '1.890', 'FRAGCOUNT': '2.000'} [2024-08-05 10:09:35,628][00160] DAMAGECOUNT value on done: 759.0 [2024-08-05 10:09:35,640][00160] Sum rewards: -4.804, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.036', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO4': '0.035', 'ARMOR': '0.036', 'HITCOUNT': '0.070', 'weapon7': '0.088', 'weapon4': '0.090', 'AMMO3': '0.094', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.366', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.600', 'weapon3': '1.244', 'weapon2': '1.874'} [2024-08-05 10:09:35,720][00159] DAMAGECOUNT value on done: 782.0 [2024-08-05 10:09:35,721][00159] Sum rewards: -1.667, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.160', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.005', 'ARMOR': '0.036', 'WEAPON1': '0.040', 'weapon5': '0.062', 'AMMO3': '0.104', 'HITCOUNT': '0.130', 'weapon4': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.762', 'weapon2': '1.432', 'FRAGCOUNT': '1.500', 'weapon3': '1.724'} [2024-08-05 10:09:35,842][00172] DAMAGECOUNT value on done: 521.0 [2024-08-05 10:09:35,847][00172] Sum rewards: -5.100, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.928', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.044', 'weapon7': '0.110', 'AMMO4': '0.143', 'HITCOUNT': '0.150', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.360', 'ARMOR': '0.436', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.630', 'WEAPON3': '0.750', 'weapon3': '1.114', 'weapon2': '1.516'} [2024-08-05 10:09:37,271][00171] DAMAGECOUNT value on done: 505.0 [2024-08-05 10:09:37,275][00171] Sum rewards: -3.931, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.000', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'ARMOR': '0.029', 'AMMO4': '0.043', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.170', 'AMMO3': '0.173', 'weapon4': '0.186', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.540', 'WEAPON3': '0.900', 'weapon2': '1.034', 'FRAGCOUNT': '2.000', 'weapon3': '2.004'} [2024-08-05 10:09:37,385][00168] DAMAGECOUNT value on done: 741.0 [2024-08-05 10:09:37,705][00161] DAMAGECOUNT value on done: 705.0 [2024-08-05 10:09:37,707][00161] Sum rewards: -5.846, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.052', 'AMMO5': '0.020', 'AMMO2': '0.052', 'weapon5': '0.062', 'ARMOR': '0.068', 'AMMO3': '0.148', 'HITCOUNT': '0.180', 'WEAPON5': '0.250', 'AMMO4': '0.258', 'weapon4': '0.272', 'WEAPON4': '0.600', 'DAMAGECOUNT': '0.666', 'WEAPON3': '0.800', 'weapon3': '1.346', 'weapon2': '1.484', 'FRAGCOUNT': '2.000'} [2024-08-05 10:09:37,826][00166] DAMAGECOUNT value on done: 480.0 [2024-08-05 10:09:37,829][00166] Sum rewards: -2.763, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.962', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'ARMOR': '0.036', 'HITCOUNT': '0.070', 'AMMO4': '0.091', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'weapon7': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'DAMAGECOUNT': '0.180', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.338', 'WEAPON3': '0.600', 'weapon2': '0.954', 'FRAGCOUNT': '1.000', 'weapon3': '1.368'} [2024-08-05 10:09:38,253][00156] DAMAGECOUNT value on done: 569.0 [2024-08-05 10:09:38,254][00156] Sum rewards: -3.716, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.514', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.043', 'weapon5': '0.092', 'AMMO3': '0.126', 'WEAPON5': '0.150', 'AMMO4': '0.216', 'weapon4': '0.250', 'HITCOUNT': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.473', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.912', 'weapon2': '1.162', 'weapon3': '1.956', 'FRAGCOUNT': '2.000'} [2024-08-05 10:09:38,284][00167] DAMAGECOUNT value on done: 1186.0 [2024-08-05 10:09:38,287][00167] Sum rewards: 1.657, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.888', 'AMMO5': '0.008', 'AMMO2': '0.015', 'ARMOR': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.158', 'weapon4': '0.184', 'HITCOUNT': '0.420', 'WEAPON3': '0.850', 'weapon2': '1.166', 'weapon3': '2.026', 'DAMAGECOUNT': '2.493', 'FRAGCOUNT': '4.500'} [2024-08-05 10:09:38,356][00034] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4887.4). Total num frames: 8454144. Throughput: 0: 1215.6. Samples: 2116608. Policy #0 lag: (min: 0.0, avg: 1.8, max: 5.0) [2024-08-05 10:09:38,357][00034] Avg episode reward: [(0, '-3.524')] [2024-08-05 10:09:39,526][00162] DAMAGECOUNT value on done: 549.0 [2024-08-05 10:09:39,533][00162] Sum rewards: -3.164, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.943', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO5': '0.028', 'AMMO4': '0.045', 'AMMO3': '0.119', 'WEAPON4': '0.150', 'weapon4': '0.154', 'weapon5': '0.206', 'HITCOUNT': '0.230', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.852', 'weapon2': '1.448', 'FRAGCOUNT': '1.500', 'weapon3': '1.594'} [2024-08-05 10:09:39,850][00170] DAMAGECOUNT value on done: 418.0 [2024-08-05 10:09:39,851][00170] Sum rewards: -3.890, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.054', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'HITCOUNT': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'weapon7': '0.070', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.142', 'DAMAGECOUNT': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.204', 'ARMOR': '0.456', 'WEAPON3': '0.700', 'weapon2': '1.486', 'weapon3': '1.498'} [2024-08-05 10:09:40,280][00165] DAMAGECOUNT value on done: 420.0 [2024-08-05 10:09:40,285][00165] Sum rewards: -3.596, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.728', 'AMMO2': '0.004', 'AMMO5': '0.015', 'AMMO4': '0.019', 'weapon5': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.128', 'HITCOUNT': '0.170', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.537', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.454', 'weapon2': '1.880'} [2024-08-05 10:09:40,371][00158] DAMAGECOUNT value on done: 1048.0 [2024-08-05 10:09:40,372][00158] Sum rewards: -2.735, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.186', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON1': '0.030', 'AMMO4': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'weapon4': '0.132', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.846', 'weapon2': '1.406', 'weapon3': '1.976', 'FRAGCOUNT': '2.000'} [2024-08-05 10:09:41,232][00163] DAMAGECOUNT value on done: 574.0 [2024-08-05 10:09:41,246][00163] Sum rewards: -3.061, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.411', 'AMMO5': '0.009', 'AMMO2': '0.010', 'AMMO4': '0.051', 'ARMOR': '0.088', 'weapon5': '0.102', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'HITCOUNT': '0.220', 'weapon4': '0.222', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.867', 'WEAPON3': '0.950', 'weapon2': '0.954', 'FRAGCOUNT': '2.000', 'weapon3': '2.024'} [2024-08-05 10:09:41,511][00169] DAMAGECOUNT value on done: 727.0 [2024-08-05 10:09:41,515][00169] Sum rewards: -4.027, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.000', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'weapon5': '0.038', 'AMMO4': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon7': '0.104', 'AMMO3': '0.162', 'HITCOUNT': '0.170', 'weapon4': '0.242', 'ARMOR': '0.420', 'WEAPON5': '0.450', 'DAMAGECOUNT': '0.681', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.126', 'weapon3': '1.702'} [2024-08-05 10:09:41,583][00164] DAMAGECOUNT value on done: 553.0 [2024-08-05 10:09:41,584][00164] Sum rewards: -6.807, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.260', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO5': '0.019', 'WEAPON1': '0.030', 'weapon7': '0.080', 'weapon5': '0.086', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.191', 'weapon4': '0.194', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'ARMOR': '0.440', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.048', 'weapon2': '1.992'} [2024-08-05 10:09:42,002][00159] DAMAGECOUNT value on done: 663.0 [2024-08-05 10:09:42,010][00159] Sum rewards: -2.577, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.750', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'weapon5': '0.040', 'weapon4': '0.114', 'HITCOUNT': '0.150', 'AMMO3': '0.160', 'AMMO4': '0.179', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'DAMAGECOUNT': '0.465', 'WEAPON3': '1.050', 'weapon2': '1.432', 'weapon3': '1.866', 'FRAGCOUNT': '5.000'} [2024-08-05 10:09:42,332][00160] DAMAGECOUNT value on done: 390.0 [2024-08-05 10:09:42,334][00160] Sum rewards: -5.092, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.024', 'ARMOR': '0.024', 'weapon7': '0.066', 'HITCOUNT': '0.070', 'AMMO3': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.118', 'DAMAGECOUNT': '0.195', 'weapon5': '0.226', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'weapon4': '0.410', 'HEALTH': '0.648', 'weapon2': '0.824', 'weapon3': '1.530'} [2024-08-05 10:09:42,562][00172] DAMAGECOUNT value on done: 420.0 [2024-08-05 10:09:42,565][00172] Sum rewards: -9.155, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.547', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'ARMOR': '0.044', 'weapon4': '0.048', 'HITCOUNT': '0.050', 'AMMO4': '0.112', 'AMMO3': '0.195', 'DAMAGECOUNT': '0.240', 'WEAPON4': '0.250', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.200', 'weapon2': '1.372', 'weapon3': '2.098'} [2024-08-05 10:09:43,356][00034] Fps is (10 sec: 4917.1, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 8486912. Throughput: 0: 1218.3. Samples: 2124112. Policy #0 lag: (min: 0.0, avg: 2.1, max: 4.0) [2024-08-05 10:09:43,358][00034] Avg episode reward: [(0, '-3.729')] [2024-08-05 10:09:43,896][00161] DAMAGECOUNT value on done: 670.0 [2024-08-05 10:09:43,905][00161] Sum rewards: -3.848, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.206', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'weapon5': '0.160', 'AMMO3': '0.201', 'HITCOUNT': '0.280', 'WEAPON5': '0.300', 'WEAPON3': '0.950', 'weapon2': '1.304', 'DAMAGECOUNT': '1.410', 'weapon3': '1.976', 'FRAGCOUNT': '2.000'} [2024-08-05 10:09:43,962][00168] DAMAGECOUNT value on done: 382.0 [2024-08-05 10:09:43,967][00168] Sum rewards: -7.658, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.684', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.007', 'weapon5': '0.012', 'ARMOR': '0.036', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.076', 'AMMO3': '0.136', 'WEAPON5': '0.150', 'HITCOUNT': '0.220', 'DAMAGECOUNT': '0.591', 'WEAPON3': '0.800', 'weapon3': '1.752', 'weapon2': '1.902'} [2024-08-05 10:09:43,970][00166] DAMAGECOUNT value on done: 510.0 [2024-08-05 10:09:43,974][00166] Sum rewards: -4.262, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.182', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.035', 'HITCOUNT': '0.040', 'weapon5': '0.052', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.105', 'AMMO4': '0.176', 'WEAPON4': '0.300', 'weapon4': '0.420', 'WEAPON3': '0.500', 'weapon2': '0.782', 'weapon3': '1.550'} [2024-08-05 10:09:44,464][00167] DAMAGECOUNT value on done: 893.0 [2024-08-05 10:09:44,474][00167] Sum rewards: -6.010, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.699', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.036', 'weapon5': '0.060', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.296', 'HITCOUNT': '0.300', 'FRAGCOUNT': '0.500', 'ARMOR': '0.552', 'WEAPON3': '0.950', 'weapon2': '1.448', 'DAMAGECOUNT': '1.485', 'weapon3': '1.666'} [2024-08-05 10:09:44,536][00156] DAMAGECOUNT value on done: 153.0 [2024-08-05 10:09:44,544][00156] Sum rewards: -4.925, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.344', 'weapon5': '0.002', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'HITCOUNT': '0.050', 'ARMOR': '0.080', 'AMMO3': '0.135', 'AMMO4': '0.135', 'DAMAGECOUNT': '0.144', 'weapon4': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.394', 'weapon2': '1.702'} [2024-08-05 10:09:45,354][00171] DAMAGECOUNT value on done: 497.0 [2024-08-05 10:09:45,355][00171] Sum rewards: -5.059, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.080', 'AMMO5': '0.017', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'HITCOUNT': '0.140', 'AMMO3': '0.144', 'weapon4': '0.218', 'weapon5': '0.224', 'WEAPON5': '0.350', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.996', 'weapon3': '1.418', 'weapon2': '1.432'} [2024-08-05 10:09:45,883][00162] DAMAGECOUNT value on done: 815.0 [2024-08-05 10:09:45,889][00162] Sum rewards: -1.745, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.122', 'AMMO2': '0.004', 'weapon5': '0.014', 'AMMO4': '0.017', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.198', 'HITCOUNT': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon2': '1.568', 'DAMAGECOUNT': '1.581', 'weapon3': '1.830', 'FRAGCOUNT': '5.000'} [2024-08-05 10:09:46,288][00170] DAMAGECOUNT value on done: 634.0 [2024-08-05 10:09:46,293][00170] Sum rewards: -7.654, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.370', 'FRAGCOUNT': '-1.500', 'AMMO2': '0.001', 'ARMOR': '0.004', 'AMMO4': '0.004', 'AMMO5': '0.005', 'weapon5': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'HITCOUNT': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.182', 'DAMAGECOUNT': '0.429', 'WEAPON3': '0.750', 'weapon3': '1.468', 'weapon2': '1.784'} [2024-08-05 10:09:48,172][00165] DAMAGECOUNT value on done: 663.0 [2024-08-05 10:09:48,173][00165] Sum rewards: -0.734, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.569', 'FRAGCOUNT': '-0.500', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.021', 'ARMOR': '0.044', 'AMMO3': '0.085', 'AMMO4': '0.106', 'weapon5': '0.114', 'WEAPON4': '0.150', 'HITCOUNT': '0.190', 'weapon4': '0.214', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.795', 'weapon2': '1.266', 'weapon3': '1.828'} [2024-08-05 10:09:48,274][00158] DAMAGECOUNT value on done: 1092.0 [2024-08-05 10:09:48,278][00158] Sum rewards: 0.687, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.247', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'weapon5': '0.016', 'AMMO4': '0.054', 'ARMOR': '0.084', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.158', 'HITCOUNT': '0.290', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.008', 'weapon2': '1.264', 'weapon3': '1.888', 'FRAGCOUNT': '4.000'} [2024-08-05 10:09:48,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4887.4). Total num frames: 8503296. Throughput: 0: 1205.3. Samples: 2130904. Policy #0 lag: (min: 0.0, avg: 2.1, max: 5.0) [2024-08-05 10:09:48,358][00034] Avg episode reward: [(0, '-3.899')] [2024-08-05 10:09:48,851][00159] DAMAGECOUNT value on done: 730.0 [2024-08-05 10:09:48,857][00159] Sum rewards: 0.741, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.828', 'AMMO2': '0.006', 'AMMO4': '0.030', 'ARMOR': '0.044', 'weapon7': '0.082', 'AMMO3': '0.093', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.332', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.077', 'weapon3': '1.118', 'weapon2': '1.836'} [2024-08-05 10:09:49,008][00164] DAMAGECOUNT value on done: 356.0 [2024-08-05 10:09:49,028][00163] DAMAGECOUNT value on done: 731.0 [2024-08-05 10:09:49,031][00163] Sum rewards: -0.932, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.706', 'AMMO2': '0.012', 'AMMO5': '0.020', 'AMMO4': '0.062', 'weapon4': '0.074', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'weapon5': '0.166', 'HITCOUNT': '0.240', 'WEAPON5': '0.350', 'ARMOR': '0.404', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.942', 'weapon3': '1.478', 'weapon2': '1.762', 'FRAGCOUNT': '3.000'} [2024-08-05 10:09:49,973][00157] Updated weights for policy 0, policy_version 1040 (0.0019) [2024-08-05 10:09:50,067][00160] DAMAGECOUNT value on done: 1013.0 [2024-08-05 10:09:50,072][00160] Sum rewards: -2.459, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.979', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.025', 'WEAPON4': '0.050', 'weapon5': '0.058', 'AMMO3': '0.126', 'WEAPON5': '0.250', 'HITCOUNT': '0.290', 'ARMOR': '0.460', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.017', 'weapon2': '1.486', 'weapon3': '1.968'} [2024-08-05 10:09:50,264][00172] DAMAGECOUNT value on done: 917.0 [2024-08-05 10:09:50,268][00172] Sum rewards: -0.580, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.406', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO5': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'ARMOR': '0.084', 'weapon4': '0.088', 'AMMO3': '0.122', 'weapon5': '0.142', 'HITCOUNT': '0.180', 'WEAPON5': '0.200', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.720', 'FRAGCOUNT': '1.000', 'weapon2': '1.266', 'weapon3': '1.940'} [2024-08-05 10:09:50,597][00161] DAMAGECOUNT value on done: 522.0 [2024-08-05 10:09:50,601][00161] Sum rewards: -7.133, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.470', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.007', 'WEAPON1': '0.040', 'ARMOR': '0.044', 'weapon5': '0.048', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'weapon4': '0.234', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.705', 'weapon3': '1.476', 'weapon2': '1.706'} [2024-08-05 10:09:50,638][00166] DAMAGECOUNT value on done: 693.0 [2024-08-05 10:09:51,152][00167] DAMAGECOUNT value on done: 340.0 [2024-08-05 10:09:51,207][00156] DAMAGECOUNT value on done: 692.0 [2024-08-05 10:09:51,211][00156] Sum rewards: -3.798, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.086', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.042', 'AMMO3': '0.097', 'ARMOR': '0.132', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'HITCOUNT': '0.220', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'weapon4': '0.432', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.693', 'weapon3': '1.004', 'weapon2': '1.800'} [2024-08-05 10:09:52,167][00171] DAMAGECOUNT value on done: 550.0 [2024-08-05 10:09:52,335][00162] DAMAGECOUNT value on done: 765.0 [2024-08-05 10:09:52,342][00162] Sum rewards: -2.555, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.125', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.035', 'AMMO3': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.218', 'HITCOUNT': '0.220', 'weapon4': '0.292', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.395', 'weapon3': '1.412', 'FRAGCOUNT': '1.500', 'weapon2': '1.530'} [2024-08-05 10:09:53,355][00034] Fps is (10 sec: 4096.0, 60 sec: 4915.2, 300 sec: 4915.2). Total num frames: 8527872. Throughput: 0: 1207.3. Samples: 2134648. Policy #0 lag: (min: 0.0, avg: 2.1, max: 5.0) [2024-08-05 10:09:53,358][00034] Avg episode reward: [(0, '-3.651')] [2024-08-05 10:09:55,015][00165] DAMAGECOUNT value on done: 710.0 [2024-08-05 10:09:55,016][00165] Sum rewards: -4.229, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.338', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO5': '0.014', 'weapon5': '0.022', 'AMMO2': '0.036', 'AMMO3': '0.137', 'WEAPON5': '0.150', 'HITCOUNT': '0.160', 'AMMO4': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.304', 'DAMAGECOUNT': '0.555', 'WEAPON3': '0.700', 'weapon2': '0.890', 'FRAGCOUNT': '1.000', 'weapon3': '1.738'} [2024-08-05 10:09:55,150][00158] DAMAGECOUNT value on done: 1126.0 [2024-08-05 10:09:55,153][00158] Sum rewards: 1.575, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.713', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'weapon5': '0.188', 'weapon4': '0.276', 'WEAPON5': '0.350', 'HITCOUNT': '0.350', 'ARMOR': '0.475', 'WEAPON3': '0.550', 'weapon2': '1.106', 'weapon3': '1.562', 'DAMAGECOUNT': '1.752', 'FRAGCOUNT': '3.500'} [2024-08-05 10:09:55,791][00164] DAMAGECOUNT value on done: 533.0 [2024-08-05 10:09:55,796][00164] Sum rewards: -7.015, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.860', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.032', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'weapon4': '0.050', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'HITCOUNT': '0.130', 'AMMO3': '0.145', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.537', 'WEAPON3': '0.850', 'weapon3': '1.758', 'weapon2': '1.782'} [2024-08-05 10:09:55,997][00163] DAMAGECOUNT value on done: 655.0 [2024-08-05 10:09:56,002][00163] Sum rewards: 0.169, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.966', 'AMMO2': '0.008', 'AMMO4': '0.039', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.070', 'AMMO3': '0.132', 'HITCOUNT': '0.260', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.798', 'weapon2': '1.130', 'weapon3': '2.208', 'FRAGCOUNT': '4.000'} [2024-08-05 10:09:56,770][00160] DAMAGECOUNT value on done: 378.0 [2024-08-05 10:09:56,774][00160] Sum rewards: -6.575, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.870', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.007', 'ARMOR': '0.032', 'WEAPON5': '0.100', 'weapon5': '0.122', 'AMMO3': '0.152', 'HITCOUNT': '0.170', 'DAMAGECOUNT': '0.564', 'WEAPON3': '1.050', 'weapon2': '1.142', 'weapon3': '2.230'} [2024-08-05 10:09:57,303][00161] DAMAGECOUNT value on done: 934.0 [2024-08-05 10:09:57,425][00166] DAMAGECOUNT value on done: 461.0 [2024-08-05 10:09:57,425][00166] Sum rewards: -5.799, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.998', 'weapon4': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'AMMO3': '0.135', 'HITCOUNT': '0.190', 'weapon5': '0.190', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.747', 'WEAPON3': '0.800', 'weapon2': '1.280', 'FRAGCOUNT': '1.500', 'weapon3': '1.760'} [2024-08-05 10:09:58,170][00167] DAMAGECOUNT value on done: 836.0 [2024-08-05 10:09:58,171][00167] Sum rewards: -5.985, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.995', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.024', 'ARMOR': '0.072', 'weapon5': '0.078', 'AMMO4': '0.119', 'weapon4': '0.170', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'HITCOUNT': '0.270', 'WEAPON5': '0.400', 'DAMAGECOUNT': '0.945', 'WEAPON3': '0.950', 'weapon2': '1.424', 'weapon3': '1.642', 'FRAGCOUNT': '2.000'} [2024-08-05 10:09:58,207][00156] DAMAGECOUNT value on done: 741.0 [2024-08-05 10:09:58,208][00156] Sum rewards: 1.074, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.044', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'weapon4': '0.026', 'weapon7': '0.068', 'AMMO4': '0.097', 'HITCOUNT': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'weapon5': '0.138', 'WEAPON5': '0.200', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.819', 'weapon2': '1.298', 'weapon3': '1.328', 'FRAGCOUNT': '2.000'} [2024-08-05 10:09:58,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4887.4). Total num frames: 8552448. Throughput: 0: 1209.1. Samples: 2142104. Policy #0 lag: (min: 0.0, avg: 1.9, max: 5.0) [2024-08-05 10:09:58,357][00034] Avg episode reward: [(0, '-3.620')] [2024-08-05 10:09:58,896][00171] DAMAGECOUNT value on done: 793.0 [2024-08-05 10:09:58,898][00171] Sum rewards: 1.511, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.833', 'AMMO2': '0.002', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.012', 'WEAPON5': '0.050', 'AMMO3': '0.067', 'weapon7': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.230', 'weapon4': '0.388', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.750', 'weapon2': '0.856', 'weapon3': '1.092', 'FRAGCOUNT': '3.000'} [2024-08-05 10:10:01,066][00165] DAMAGECOUNT value on done: 947.0 [2024-08-05 10:10:01,067][00165] Sum rewards: -3.467, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.117', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon5': '0.072', 'weapon7': '0.122', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'weapon4': '0.242', 'HITCOUNT': '0.260', 'WEAPON5': '0.300', 'ARMOR': '0.482', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.221', 'weapon3': '1.384', 'weapon2': '1.454', 'FRAGCOUNT': '3.000'} [2024-08-05 10:10:01,243][00158] DAMAGECOUNT value on done: 510.0 [2024-08-05 10:10:01,244][00158] Sum rewards: -0.284, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.756', 'AMMO2': '0.012', 'AMMO5': '0.013', 'AMMO4': '0.060', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'weapon5': '0.212', 'WEAPON5': '0.250', 'weapon4': '0.278', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.663', 'ARMOR': '0.856', 'FRAGCOUNT': '1.000', 'weapon3': '1.314', 'weapon2': '1.500'} [2024-08-05 10:10:02,191][00163] DAMAGECOUNT value on done: 544.0 [2024-08-05 10:10:02,195][00163] Sum rewards: -4.125, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.752', 'AMMO2': '0.008', 'AMMO5': '0.011', 'ARMOR': '0.036', 'AMMO4': '0.039', 'WEAPON1': '0.040', 'weapon5': '0.150', 'HITCOUNT': '0.170', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.780', 'WEAPON3': '0.900', 'weapon3': '1.410', 'weapon2': '1.648', 'FRAGCOUNT': '3.000'} [2024-08-05 10:10:03,356][00034] Fps is (10 sec: 5734.4, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 8585216. Throughput: 0: 1227.2. Samples: 2149656. Policy #0 lag: (min: 0.0, avg: 1.7, max: 4.0) [2024-08-05 10:10:03,360][00034] Avg episode reward: [(0, '-3.377')] [2024-08-05 10:10:04,680][00161] DAMAGECOUNT value on done: 598.0 [2024-08-05 10:10:04,681][00161] Sum rewards: -5.547, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.092', 'AMMO5': '0.005', 'weapon7': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.033', 'weapon5': '0.050', 'weapon4': '0.078', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'AMMO4': '0.165', 'AMMO3': '0.185', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.350', 'DAMAGECOUNT': '0.405', 'WEAPON3': '1.050', 'weapon2': '1.290', 'weapon3': '1.854', 'FRAGCOUNT': '2.000'} [2024-08-05 10:10:04,808][00166] DAMAGECOUNT value on done: 1049.0 [2024-08-05 10:10:04,810][00166] Sum rewards: -4.932, reward structure: {'DEATHCOUNT': '-10.500', 'FRAGCOUNT': '-1.000', 'HEALTH': '-0.112', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO3': '0.112', 'weapon5': '0.124', 'WEAPON4': '0.150', 'AMMO4': '0.170', 'WEAPON5': '0.200', 'HITCOUNT': '0.340', 'weapon4': '0.398', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.293', 'weapon3': '1.396', 'weapon2': '1.500'} [2024-08-05 10:10:05,082][00171] DAMAGECOUNT value on done: 604.0 [2024-08-05 10:10:05,084][00171] Sum rewards: -5.394, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.336', 'weapon5': '0.002', 'AMMO2': '0.004', 'AMMO5': '0.013', 'AMMO4': '0.018', 'ARMOR': '0.078', 'AMMO3': '0.143', 'HITCOUNT': '0.180', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.252', 'DAMAGECOUNT': '0.651', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.264', 'weapon3': '1.688'} [2024-08-05 10:10:05,555][00167] DAMAGECOUNT value on done: 675.0 [2024-08-05 10:10:05,556][00167] Sum rewards: -3.953, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.620', 'AMMO2': '0.010', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.024', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'weapon4': '0.154', 'AMMO3': '0.157', 'HITCOUNT': '0.270', 'WEAPON5': '0.300', 'ARMOR': '0.515', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.897', 'FRAGCOUNT': '1.000', 'weapon2': '1.530', 'weapon3': '1.626'} [2024-08-05 10:10:05,615][00156] DAMAGECOUNT value on done: 679.0 [2024-08-05 10:10:05,615][00156] Sum rewards: -5.721, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.952', 'weapon5': '0.006', 'AMMO5': '0.018', 'AMMO2': '0.024', 'weapon7': '0.052', 'ARMOR': '0.072', 'AMMO4': '0.120', 'AMMO3': '0.150', 'HITCOUNT': '0.190', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.410', 'DAMAGECOUNT': '0.627', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.164', 'weapon3': '1.648'} [2024-08-05 10:10:06,407][00157] Updated weights for policy 0, policy_version 1050 (0.0019) [2024-08-05 10:10:07,213][00165] DAMAGECOUNT value on done: 1120.0 [2024-08-05 10:10:07,217][00165] Sum rewards: 1.007, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.242', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'ARMOR': '0.028', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'AMMO3': '0.076', 'weapon5': '0.114', 'weapon4': '0.128', 'WEAPON5': '0.150', 'HITCOUNT': '0.290', 'WEAPON3': '0.550', 'weapon3': '1.258', 'DAMAGECOUNT': '1.722', 'weapon2': '2.062', 'FRAGCOUNT': '3.000'} [2024-08-05 10:10:07,443][00158] DAMAGECOUNT value on done: 830.0 [2024-08-05 10:10:07,449][00158] Sum rewards: -1.290, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.378', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'HITCOUNT': '0.150', 'AMMO3': '0.172', 'weapon4': '0.212', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.950', 'weapon2': '1.396', 'weapon3': '1.792', 'FRAGCOUNT': '4.000'} [2024-08-05 10:10:08,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4887.4). Total num frames: 8601600. Throughput: 0: 1228.4. Samples: 2153392. Policy #0 lag: (min: 0.0, avg: 1.8, max: 4.0) [2024-08-05 10:10:08,360][00034] Avg episode reward: [(0, '-3.426')] [2024-08-05 10:10:08,475][00163] DAMAGECOUNT value on done: 841.0 [2024-08-05 10:10:08,483][00163] Sum rewards: -0.173, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.994', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.010', 'weapon5': '0.012', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'HITCOUNT': '0.170', 'ARMOR': '0.432', 'DAMAGECOUNT': '0.540', 'WEAPON3': '0.550', 'weapon3': '1.370', 'weapon2': '2.056', 'FRAGCOUNT': '3.000'} [2024-08-05 10:10:11,520][00161] DAMAGECOUNT value on done: 528.0 [2024-08-05 10:10:11,522][00166] DAMAGECOUNT value on done: 543.0 [2024-08-05 10:10:12,068][00167] DAMAGECOUNT value on done: 660.0 [2024-08-05 10:10:12,130][00171] DAMAGECOUNT value on done: 580.0 [2024-08-05 10:10:12,136][00171] Sum rewards: -5.832, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.538', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'weapon4': '0.056', 'weapon5': '0.068', 'AMMO3': '0.182', 'HITCOUNT': '0.210', 'WEAPON5': '0.250', 'ARMOR': '0.505', 'DAMAGECOUNT': '0.639', 'WEAPON3': '1.050', 'weapon2': '1.170', 'weapon3': '2.198', 'FRAGCOUNT': '2.500'} [2024-08-05 10:10:12,132][00156] DAMAGECOUNT value on done: 784.0 [2024-08-05 10:10:12,137][00156] Sum rewards: 0.467, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.982', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.146', 'WEAPON5': '0.150', 'HITCOUNT': '0.300', 'WEAPON4': '0.450', 'ARMOR': '0.510', 'weapon4': '0.524', 'WEAPON3': '0.800', 'weapon2': '1.034', 'DAMAGECOUNT': '1.440', 'weapon3': '1.652', 'FRAGCOUNT': '4.000'} [2024-08-05 10:10:13,355][00034] Fps is (10 sec: 4915.2, 60 sec: 5051.8, 300 sec: 4915.2). Total num frames: 8634368. Throughput: 0: 1234.3. Samples: 2160976. Policy #0 lag: (min: 0.0, avg: 1.9, max: 4.0) [2024-08-05 10:10:13,357][00034] Avg episode reward: [(0, '-3.486')] [2024-08-05 10:10:15,439][00158] DAMAGECOUNT value on done: 746.0 [2024-08-05 10:10:15,440][00158] Sum rewards: 0.060, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.881', 'AMMO5': '0.007', 'weapon5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon4': '0.036', 'WEAPON4': '0.050', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'HITCOUNT': '0.390', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.470', 'weapon2': '1.470', 'weapon3': '1.828', 'FRAGCOUNT': '4.000'} [2024-08-05 10:10:16,795][00163] DAMAGECOUNT value on done: 1138.0 [2024-08-05 10:10:16,799][00163] Sum rewards: -0.804, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.260', 'AMMO2': '0.015', 'AMMO5': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.124', 'weapon5': '0.134', 'weapon4': '0.212', 'HITCOUNT': '0.260', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.226', 'DAMAGECOUNT': '1.233', 'weapon3': '1.962'} [2024-08-05 10:10:17,986][00161] DAMAGECOUNT value on done: 983.0 [2024-08-05 10:10:17,987][00161] Sum rewards: -4.440, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.214', 'AMMO2': '0.010', 'AMMO5': '0.017', 'ARMOR': '0.039', 'AMMO4': '0.050', 'WEAPON1': '0.060', 'weapon4': '0.132', 'weapon5': '0.136', 'AMMO3': '0.141', 'HITCOUNT': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.356', 'FRAGCOUNT': '1.500', 'weapon3': '1.540', 'weapon2': '1.692'} [2024-08-05 10:10:18,356][00034] Fps is (10 sec: 4915.1, 60 sec: 4915.2, 300 sec: 4887.4). Total num frames: 8650752. Throughput: 0: 1226.2. Samples: 2168136. Policy #0 lag: (min: 0.0, avg: 1.6, max: 4.0) [2024-08-05 10:10:18,360][00034] Avg episode reward: [(0, '-3.448')] [2024-08-05 10:10:18,643][00167] DAMAGECOUNT value on done: 450.0 [2024-08-05 10:10:18,701][00156] DAMAGECOUNT value on done: 796.0 [2024-08-05 10:10:18,704][00156] Sum rewards: -1.622, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.172', 'AMMO2': '0.014', 'AMMO5': '0.015', 'WEAPON4': '0.050', 'AMMO3': '0.067', 'AMMO4': '0.072', 'weapon4': '0.198', 'weapon5': '0.212', 'HITCOUNT': '0.220', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'weapon3': '1.240', 'DAMAGECOUNT': '1.272', 'weapon2': '1.940', 'FRAGCOUNT': '2.500'} [2024-08-05 10:10:20,401][00171] DAMAGECOUNT value on done: 877.0 [2024-08-05 10:10:20,405][00171] Sum rewards: -8.026, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.416', 'FRAGCOUNT': '-1.500', 'AMMO2': '0.007', 'weapon4': '0.012', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.034', 'ARMOR': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.146', 'weapon5': '0.180', 'HITCOUNT': '0.280', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.068', 'weapon2': '1.098', 'weapon3': '1.968'} [2024-08-05 10:10:22,798][00158] DAMAGECOUNT value on done: 484.0 [2024-08-05 10:10:22,803][00158] Sum rewards: -0.345, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.342', 'weapon7': '0.010', 'ARMOR': '0.014', 'AMMO5': '0.017', 'AMMO2': '0.018', 'AMMO3': '0.083', 'AMMO4': '0.089', 'weapon5': '0.134', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.230', 'weapon4': '0.236', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.660', 'weapon2': '1.498', 'weapon3': '1.558', 'FRAGCOUNT': '2.000'} [2024-08-05 10:10:23,355][00034] Fps is (10 sec: 4096.0, 60 sec: 4778.7, 300 sec: 4915.2). Total num frames: 8675328. Throughput: 0: 1217.6. Samples: 2171400. Policy #0 lag: (min: 0.0, avg: 2.0, max: 5.0) [2024-08-05 10:10:23,357][00034] Avg episode reward: [(0, '-3.403')] [2024-08-05 10:10:23,900][00157] Updated weights for policy 0, policy_version 1060 (0.0035) [2024-08-05 10:10:25,820][00156] DAMAGECOUNT value on done: 821.0 [2024-08-05 10:10:25,824][00156] Sum rewards: -4.895, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.650', 'AMMO2': '0.004', 'weapon7': '0.012', 'AMMO4': '0.020', 'WEAPON1': '0.020', 'AMMO5': '0.027', 'weapon5': '0.060', 'weapon4': '0.130', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.300', 'WEAPON5': '0.450', 'DAMAGECOUNT': '0.777', 'WEAPON3': '1.050', 'weapon2': '1.144', 'FRAGCOUNT': '2.000', 'weapon3': '2.038'} [2024-08-05 10:10:26,736][00171] DAMAGECOUNT value on done: 683.0 [2024-08-05 10:10:26,741][00171] Sum rewards: -3.734, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.491', 'weapon4': '0.016', 'AMMO5': '0.017', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'AMMO4': '0.097', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'weapon5': '0.192', 'HITCOUNT': '0.260', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.867', 'weapon2': '1.578', 'weapon3': '1.600'} [2024-08-05 10:10:28,356][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4887.4). Total num frames: 8699904. Throughput: 0: 1215.8. Samples: 2178824. Policy #0 lag: (min: 0.0, avg: 2.0, max: 5.0) [2024-08-05 10:10:28,360][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:10:33,355][00034] Fps is (10 sec: 5734.4, 60 sec: 4915.5, 300 sec: 4943.0). Total num frames: 8732672. Throughput: 0: 1233.8. Samples: 2186424. Policy #0 lag: (min: 0.0, avg: 2.0, max: 4.0) [2024-08-05 10:10:33,360][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:10:38,355][00034] Fps is (10 sec: 5734.5, 60 sec: 5051.7, 300 sec: 4915.2). Total num frames: 8757248. Throughput: 0: 1233.8. Samples: 2190168. Policy #0 lag: (min: 0.0, avg: 1.7, max: 4.0) [2024-08-05 10:10:38,360][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:10:39,374][00157] Updated weights for policy 0, policy_version 1070 (0.0021) [2024-08-05 10:10:43,355][00034] Fps is (10 sec: 4096.0, 60 sec: 4778.7, 300 sec: 4887.4). Total num frames: 8773632. Throughput: 0: 1237.2. Samples: 2197776. Policy #0 lag: (min: 0.0, avg: 1.7, max: 5.0) [2024-08-05 10:10:43,359][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:10:48,355][00034] Fps is (10 sec: 4096.0, 60 sec: 4915.2, 300 sec: 4887.4). Total num frames: 8798208. Throughput: 0: 1232.7. Samples: 2205128. Policy #0 lag: (min: 0.0, avg: 2.4, max: 5.0) [2024-08-05 10:10:48,360][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:10:53,355][00034] Fps is (10 sec: 5734.4, 60 sec: 5051.7, 300 sec: 4943.0). Total num frames: 8830976. Throughput: 0: 1222.8. Samples: 2208416. Policy #0 lag: (min: 0.0, avg: 2.5, max: 4.0) [2024-08-05 10:10:53,358][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:10:57,163][00157] Updated weights for policy 0, policy_version 1080 (0.0020) [2024-08-05 10:10:58,355][00034] Fps is (10 sec: 5734.4, 60 sec: 5051.7, 300 sec: 4915.2). Total num frames: 8855552. Throughput: 0: 1216.9. Samples: 2215736. Policy #0 lag: (min: 0.0, avg: 1.3, max: 4.0) [2024-08-05 10:10:58,357][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:11:03,356][00034] Fps is (10 sec: 4096.0, 60 sec: 4778.7, 300 sec: 4887.4). Total num frames: 8871936. Throughput: 0: 1226.1. Samples: 2223312. Policy #0 lag: (min: 0.0, avg: 1.4, max: 5.0) [2024-08-05 10:11:03,357][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:11:08,356][00034] Fps is (10 sec: 4096.0, 60 sec: 4915.2, 300 sec: 4887.4). Total num frames: 8896512. Throughput: 0: 1234.1. Samples: 2226936. Policy #0 lag: (min: 0.0, avg: 2.6, max: 5.0) [2024-08-05 10:11:08,357][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:11:13,356][00034] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4887.4). Total num frames: 8921088. Throughput: 0: 1233.6. Samples: 2234336. Policy #0 lag: (min: 0.0, avg: 1.5, max: 4.0) [2024-08-05 10:11:13,358][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:11:14,189][00157] Updated weights for policy 0, policy_version 1090 (0.0020) [2024-08-05 10:11:18,355][00034] Fps is (10 sec: 5734.4, 60 sec: 5051.7, 300 sec: 4915.2). Total num frames: 8953856. Throughput: 0: 1227.7. Samples: 2241672. Policy #0 lag: (min: 0.0, avg: 2.1, max: 5.0) [2024-08-05 10:11:18,357][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:11:23,366][00034] Fps is (10 sec: 4910.1, 60 sec: 4914.3, 300 sec: 4887.3). Total num frames: 8970240. Throughput: 0: 1228.0. Samples: 2245440. Policy #0 lag: (min: 0.0, avg: 2.3, max: 5.0) [2024-08-05 10:11:23,368][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:11:23,377][00136] Saving /kaggle/working/train_dir/default_experiment/checkpoint_p0/checkpoint_000001095_8970240.pth... [2024-08-05 10:11:23,616][00136] Removing /kaggle/working/train_dir/default_experiment/checkpoint_p0/checkpoint_000000952_7798784.pth [2024-08-05 10:11:28,355][00034] Fps is (10 sec: 4096.0, 60 sec: 4915.2, 300 sec: 4887.4). Total num frames: 8994816. Throughput: 0: 1210.5. Samples: 2252248. Policy #0 lag: (min: 0.0, avg: 2.0, max: 4.0) [2024-08-05 10:11:28,360][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:11:30,549][00157] Updated weights for policy 0, policy_version 1100 (0.0021) [2024-08-05 10:11:33,355][00034] Fps is (10 sec: 4920.3, 60 sec: 4778.7, 300 sec: 4887.4). Total num frames: 9019392. Throughput: 0: 1213.0. Samples: 2259712. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 10:11:33,360][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:11:38,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4887.4). Total num frames: 9043968. Throughput: 0: 1221.9. Samples: 2263400. Policy #0 lag: (min: 0.0, avg: 1.6, max: 4.0) [2024-08-05 10:11:38,357][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:11:43,356][00034] Fps is (10 sec: 4915.1, 60 sec: 4915.2, 300 sec: 4887.4). Total num frames: 9068544. Throughput: 0: 1224.4. Samples: 2270832. Policy #0 lag: (min: 0.0, avg: 2.3, max: 5.0) [2024-08-05 10:11:43,357][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:11:47,324][00157] Updated weights for policy 0, policy_version 1110 (0.0020) [2024-08-05 10:11:48,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4887.4). Total num frames: 9093120. Throughput: 0: 1219.9. Samples: 2278208. Policy #0 lag: (min: 0.0, avg: 2.3, max: 4.0) [2024-08-05 10:11:48,357][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:11:53,356][00034] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4887.4). Total num frames: 9117696. Throughput: 0: 1222.9. Samples: 2281968. Policy #0 lag: (min: 0.0, avg: 2.0, max: 5.0) [2024-08-05 10:11:53,357][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:11:58,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4887.4). Total num frames: 9142272. Throughput: 0: 1210.7. Samples: 2288816. Policy #0 lag: (min: 0.0, avg: 1.6, max: 4.0) [2024-08-05 10:11:58,358][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:12:03,355][00034] Fps is (10 sec: 4915.3, 60 sec: 4915.2, 300 sec: 4887.4). Total num frames: 9166848. Throughput: 0: 1216.2. Samples: 2296400. Policy #0 lag: (min: 0.0, avg: 2.4, max: 5.0) [2024-08-05 10:12:03,357][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:12:04,408][00157] Updated weights for policy 0, policy_version 1120 (0.0025) [2024-08-05 10:12:08,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4887.4). Total num frames: 9191424. Throughput: 0: 1215.6. Samples: 2300128. Policy #0 lag: (min: 0.0, avg: 2.4, max: 5.0) [2024-08-05 10:12:08,357][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:12:13,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4887.4). Total num frames: 9216000. Throughput: 0: 1231.6. Samples: 2307672. Policy #0 lag: (min: 0.0, avg: 2.0, max: 4.0) [2024-08-05 10:12:13,357][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:12:18,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4887.4). Total num frames: 9240576. Throughput: 0: 1233.1. Samples: 2315200. Policy #0 lag: (min: 0.0, avg: 2.0, max: 4.0) [2024-08-05 10:12:18,357][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:12:20,259][00157] Updated weights for policy 0, policy_version 1130 (0.0020) [2024-08-05 10:12:23,356][00034] Fps is (10 sec: 4915.1, 60 sec: 4916.0, 300 sec: 4887.4). Total num frames: 9265152. Throughput: 0: 1235.0. Samples: 2318976. Policy #0 lag: (min: 0.0, avg: 2.2, max: 4.0) [2024-08-05 10:12:23,357][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:12:25,822][00160] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2024-08-05 10:12:28,356][00034] Fps is (10 sec: 4915.1, 60 sec: 4915.2, 300 sec: 4887.4). Total num frames: 9289728. Throughput: 0: 1232.2. Samples: 2326280. Policy #0 lag: (min: 0.0, avg: 2.1, max: 4.0) [2024-08-05 10:12:28,357][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:12:33,355][00034] Fps is (10 sec: 4915.3, 60 sec: 4915.2, 300 sec: 4887.5). Total num frames: 9314304. Throughput: 0: 1227.2. Samples: 2333432. Policy #0 lag: (min: 0.0, avg: 2.0, max: 5.0) [2024-08-05 10:12:33,357][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:12:37,254][00157] Updated weights for policy 0, policy_version 1140 (0.0020) [2024-08-05 10:12:38,355][00034] Fps is (10 sec: 4915.3, 60 sec: 4915.2, 300 sec: 4887.4). Total num frames: 9338880. Throughput: 0: 1224.9. Samples: 2337088. Policy #0 lag: (min: 0.0, avg: 2.2, max: 5.0) [2024-08-05 10:12:38,357][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:12:43,356][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4887.4). Total num frames: 9363456. Throughput: 0: 1241.4. Samples: 2344680. Policy #0 lag: (min: 0.0, avg: 2.1, max: 5.0) [2024-08-05 10:12:43,358][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:12:48,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4887.4). Total num frames: 9388032. Throughput: 0: 1238.8. Samples: 2352144. Policy #0 lag: (min: 0.0, avg: 2.1, max: 5.0) [2024-08-05 10:12:48,357][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:12:53,356][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4887.4). Total num frames: 9412608. Throughput: 0: 1238.8. Samples: 2355872. Policy #0 lag: (min: 0.0, avg: 2.0, max: 4.0) [2024-08-05 10:12:53,357][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:12:53,858][00157] Updated weights for policy 0, policy_version 1150 (0.0021) [2024-08-05 10:12:58,356][00034] Fps is (10 sec: 5734.3, 60 sec: 5051.7, 300 sec: 4915.2). Total num frames: 9445376. Throughput: 0: 1238.6. Samples: 2363408. Policy #0 lag: (min: 0.0, avg: 1.8, max: 4.0) [2024-08-05 10:12:58,358][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:13:03,356][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4887.5). Total num frames: 9461760. Throughput: 0: 1221.7. Samples: 2370176. Policy #0 lag: (min: 0.0, avg: 2.4, max: 5.0) [2024-08-05 10:13:03,357][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:13:08,356][00034] Fps is (10 sec: 4915.3, 60 sec: 5051.7, 300 sec: 4915.2). Total num frames: 9494528. Throughput: 0: 1221.3. Samples: 2373936. Policy #0 lag: (min: 0.0, avg: 2.2, max: 4.0) [2024-08-05 10:13:08,357][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:13:11,327][00157] Updated weights for policy 0, policy_version 1160 (0.0027) [2024-08-05 10:13:13,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4887.4). Total num frames: 9510912. Throughput: 0: 1225.1. Samples: 2381408. Policy #0 lag: (min: 0.0, avg: 1.4, max: 4.0) [2024-08-05 10:13:13,357][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:13:18,355][00034] Fps is (10 sec: 4096.0, 60 sec: 4915.2, 300 sec: 4887.4). Total num frames: 9535488. Throughput: 0: 1229.9. Samples: 2388776. Policy #0 lag: (min: 0.0, avg: 1.3, max: 4.0) [2024-08-05 10:13:18,357][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:13:23,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4887.4). Total num frames: 9560064. Throughput: 0: 1231.3. Samples: 2392496. Policy #0 lag: (min: 0.0, avg: 2.5, max: 5.0) [2024-08-05 10:13:23,358][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:13:23,365][00136] Saving /kaggle/working/train_dir/default_experiment/checkpoint_p0/checkpoint_000001167_9560064.pth... [2024-08-05 10:13:23,541][00136] Removing /kaggle/working/train_dir/default_experiment/checkpoint_p0/checkpoint_000001024_8388608.pth [2024-08-05 10:13:26,920][00157] Updated weights for policy 0, policy_version 1170 (0.0029) [2024-08-05 10:13:28,356][00034] Fps is (10 sec: 5734.2, 60 sec: 5051.7, 300 sec: 4915.2). Total num frames: 9592832. Throughput: 0: 1229.0. Samples: 2399984. Policy #0 lag: (min: 0.0, avg: 2.5, max: 5.0) [2024-08-05 10:13:28,358][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:13:29,243][00156] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2024-08-05 10:13:33,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4887.4). Total num frames: 9609216. Throughput: 0: 1220.8. Samples: 2407080. Policy #0 lag: (min: 0.0, avg: 1.7, max: 4.0) [2024-08-05 10:13:33,358][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:13:38,356][00034] Fps is (10 sec: 4096.1, 60 sec: 4915.2, 300 sec: 4887.4). Total num frames: 9633792. Throughput: 0: 1218.8. Samples: 2410720. Policy #0 lag: (min: 0.0, avg: 1.7, max: 4.0) [2024-08-05 10:13:38,358][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:13:43,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4887.4). Total num frames: 9658368. Throughput: 0: 1219.6. Samples: 2418288. Policy #0 lag: (min: 0.0, avg: 2.3, max: 4.0) [2024-08-05 10:13:43,357][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:13:44,580][00157] Updated weights for policy 0, policy_version 1180 (0.0025) [2024-08-05 10:13:48,355][00034] Fps is (10 sec: 4915.3, 60 sec: 4915.2, 300 sec: 4915.2). Total num frames: 9682944. Throughput: 0: 1235.6. Samples: 2425776. Policy #0 lag: (min: 0.0, avg: 1.7, max: 4.0) [2024-08-05 10:13:48,360][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:13:53,355][00034] Fps is (10 sec: 5734.4, 60 sec: 5051.7, 300 sec: 4915.2). Total num frames: 9715712. Throughput: 0: 1235.9. Samples: 2429552. Policy #0 lag: (min: 0.0, avg: 1.6, max: 5.0) [2024-08-05 10:13:53,357][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:13:58,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4887.4). Total num frames: 9732096. Throughput: 0: 1237.7. Samples: 2437104. Policy #0 lag: (min: 0.0, avg: 2.3, max: 4.0) [2024-08-05 10:13:58,357][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:13:59,734][00157] Updated weights for policy 0, policy_version 1190 (0.0020) [2024-08-05 10:14:03,356][00034] Fps is (10 sec: 4096.0, 60 sec: 4915.2, 300 sec: 4887.4). Total num frames: 9756672. Throughput: 0: 1243.0. Samples: 2444712. Policy #0 lag: (min: 0.0, avg: 1.7, max: 5.0) [2024-08-05 10:14:03,359][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:14:08,355][00034] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4915.2). Total num frames: 9781248. Throughput: 0: 1229.3. Samples: 2447816. Policy #0 lag: (min: 0.0, avg: 1.9, max: 4.0) [2024-08-05 10:14:08,357][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:14:13,343][00166] Large shaping reward -2.522 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.273, -91.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 10:14:13,356][00034] Fps is (10 sec: 4915.1, 60 sec: 4915.2, 300 sec: 4915.2). Total num frames: 9805824. Throughput: 0: 1229.7. Samples: 2455320. Policy #0 lag: (min: 0.0, avg: 1.9, max: 5.0) [2024-08-05 10:14:13,357][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:14:17,073][00157] Updated weights for policy 0, policy_version 1200 (0.0020) [2024-08-05 10:14:18,355][00034] Fps is (10 sec: 5734.4, 60 sec: 5051.7, 300 sec: 4915.2). Total num frames: 9838592. Throughput: 0: 1238.4. Samples: 2462808. Policy #0 lag: (min: 0.0, avg: 2.1, max: 4.0) [2024-08-05 10:14:18,357][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:14:23,355][00034] Fps is (10 sec: 5734.5, 60 sec: 5051.7, 300 sec: 4943.0). Total num frames: 9863168. Throughput: 0: 1240.9. Samples: 2466560. Policy #0 lag: (min: 0.0, avg: 1.9, max: 5.0) [2024-08-05 10:14:23,357][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:14:28,356][00034] Fps is (10 sec: 4915.1, 60 sec: 4915.2, 300 sec: 4915.3). Total num frames: 9887744. Throughput: 0: 1238.6. Samples: 2474024. Policy #0 lag: (min: 0.0, avg: 1.8, max: 4.0) [2024-08-05 10:14:28,357][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:14:33,356][00034] Fps is (10 sec: 4095.9, 60 sec: 4915.2, 300 sec: 4915.2). Total num frames: 9904128. Throughput: 0: 1241.6. Samples: 2481648. Policy #0 lag: (min: 0.0, avg: 2.4, max: 5.0) [2024-08-05 10:14:33,357][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:14:33,826][00157] Updated weights for policy 0, policy_version 1210 (0.0020) [2024-08-05 10:14:36,778][00164] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 10:14:38,355][00034] Fps is (10 sec: 4096.1, 60 sec: 4915.2, 300 sec: 4887.4). Total num frames: 9928704. Throughput: 0: 1237.9. Samples: 2485256. Policy #0 lag: (min: 0.0, avg: 1.8, max: 5.0) [2024-08-05 10:14:38,357][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:14:43,355][00034] Fps is (10 sec: 5734.5, 60 sec: 5051.7, 300 sec: 4943.0). Total num frames: 9961472. Throughput: 0: 1227.9. Samples: 2492360. Policy #0 lag: (min: 0.0, avg: 1.9, max: 4.0) [2024-08-05 10:14:43,357][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:14:48,356][00034] Fps is (10 sec: 4915.1, 60 sec: 4915.2, 300 sec: 4915.2). Total num frames: 9977856. Throughput: 0: 1224.4. Samples: 2499808. Policy #0 lag: (min: 0.0, avg: 2.1, max: 4.0) [2024-08-05 10:14:48,357][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:14:49,796][00157] Updated weights for policy 0, policy_version 1220 (0.0022) [2024-08-05 10:14:53,356][00034] Fps is (10 sec: 4096.0, 60 sec: 4778.7, 300 sec: 4915.2). Total num frames: 10002432. Throughput: 0: 1238.4. Samples: 2503544. Policy #0 lag: (min: 0.0, avg: 2.1, max: 5.0) [2024-08-05 10:14:53,357][00034] Avg episode reward: [(0, '-3.387')] [2024-08-05 10:14:53,896][00136] Stopping Batcher_0... [2024-08-05 10:14:53,896][00136] Loop batcher_evt_loop terminating... [2024-08-05 10:14:53,897][00136] Saving /kaggle/working/train_dir/default_experiment/checkpoint_p0/checkpoint_000001222_10010624.pth... [2024-08-05 10:14:53,896][00034] Component Batcher_0 stopped! [2024-08-05 10:14:54,015][00157] Weights refcount: 2 0 [2024-08-05 10:14:54,021][00034] Component InferenceWorker_p0-w0 stopped! [2024-08-05 10:14:54,020][00157] Stopping InferenceWorker_p0-w0... [2024-08-05 10:14:54,027][00157] Loop inference_proc0-0_evt_loop terminating... [2024-08-05 10:14:54,087][00034] Component RolloutWorker_w3 stopped! [2024-08-05 10:14:54,089][00159] Stopping RolloutWorker_w2... [2024-08-05 10:14:54,089][00159] Loop rollout_proc2_evt_loop terminating... [2024-08-05 10:14:54,089][00034] Component RolloutWorker_w2 stopped! [2024-08-05 10:14:54,087][00136] Removing /kaggle/working/train_dir/default_experiment/checkpoint_p0/checkpoint_000001095_8970240.pth [2024-08-05 10:14:54,094][00160] Stopping RolloutWorker_w3... [2024-08-05 10:14:54,107][00160] Loop rollout_proc3_evt_loop terminating... [2024-08-05 10:14:54,106][00136] Saving /kaggle/working/train_dir/default_experiment/checkpoint_p0/checkpoint_000001222_10010624.pth... [2024-08-05 10:14:54,163][00170] Stopping RolloutWorker_w14... [2024-08-05 10:14:54,164][00170] Loop rollout_proc14_evt_loop terminating... [2024-08-05 10:14:54,164][00034] Component RolloutWorker_w14 stopped! [2024-08-05 10:14:54,176][00164] Stopping RolloutWorker_w7... [2024-08-05 10:14:54,176][00034] Component RolloutWorker_w7 stopped! [2024-08-05 10:14:54,181][00169] Stopping RolloutWorker_w10... [2024-08-05 10:14:54,182][00034] Component RolloutWorker_w10 stopped! [2024-08-05 10:14:54,183][00164] Loop rollout_proc7_evt_loop terminating... [2024-08-05 10:14:54,182][00169] Loop rollout_proc10_evt_loop terminating... [2024-08-05 10:14:54,235][00034] Component RolloutWorker_w11 stopped! [2024-08-05 10:14:54,237][00168] Stopping RolloutWorker_w11... [2024-08-05 10:14:54,238][00168] Loop rollout_proc11_evt_loop terminating... [2024-08-05 10:14:54,244][00158] Stopping RolloutWorker_w1... [2024-08-05 10:14:54,244][00034] Component RolloutWorker_w1 stopped! [2024-08-05 10:14:54,247][00158] Loop rollout_proc1_evt_loop terminating... [2024-08-05 10:14:54,251][00034] Component RolloutWorker_w15 stopped! [2024-08-05 10:14:54,252][00172] Stopping RolloutWorker_w15... [2024-08-05 10:14:54,254][00172] Loop rollout_proc15_evt_loop terminating... [2024-08-05 10:14:54,277][00166] Stopping RolloutWorker_w8... [2024-08-05 10:14:54,278][00166] Loop rollout_proc8_evt_loop terminating... [2024-08-05 10:14:54,277][00034] Component RolloutWorker_w8 stopped! [2024-08-05 10:14:54,295][00165] Stopping RolloutWorker_w9... [2024-08-05 10:14:54,295][00034] Component RolloutWorker_w9 stopped! [2024-08-05 10:14:54,302][00165] Loop rollout_proc9_evt_loop terminating... [2024-08-05 10:14:54,320][00162] Stopping RolloutWorker_w6... [2024-08-05 10:14:54,320][00034] Component RolloutWorker_w6 stopped! [2024-08-05 10:14:54,320][00162] Loop rollout_proc6_evt_loop terminating... [2024-08-05 10:14:54,329][00167] Stopping RolloutWorker_w12... [2024-08-05 10:14:54,329][00034] Component RolloutWorker_w12 stopped! [2024-08-05 10:14:54,334][00034] Component RolloutWorker_w4 stopped! [2024-08-05 10:14:54,330][00167] Loop rollout_proc12_evt_loop terminating... [2024-08-05 10:14:54,334][00161] Stopping RolloutWorker_w4... [2024-08-05 10:14:54,341][00161] Loop rollout_proc4_evt_loop terminating... [2024-08-05 10:14:54,353][00163] Stopping RolloutWorker_w5... [2024-08-05 10:14:54,353][00163] Loop rollout_proc5_evt_loop terminating... [2024-08-05 10:14:54,353][00034] Component RolloutWorker_w5 stopped! [2024-08-05 10:14:54,366][00034] Component RolloutWorker_w0 stopped! [2024-08-05 10:14:54,367][00156] Stopping RolloutWorker_w0... [2024-08-05 10:14:54,368][00156] Loop rollout_proc0_evt_loop terminating... [2024-08-05 10:14:54,378][00034] Component RolloutWorker_w13 stopped! [2024-08-05 10:14:54,382][00171] Stopping RolloutWorker_w13... [2024-08-05 10:14:54,382][00171] Loop rollout_proc13_evt_loop terminating... [2024-08-05 10:14:54,470][00136] Stopping LearnerWorker_p0... [2024-08-05 10:14:54,471][00136] Loop learner_proc0_evt_loop terminating... [2024-08-05 10:14:54,470][00034] Component LearnerWorker_p0 stopped! [2024-08-05 10:14:54,472][00034] Waiting for process learner_proc0 to stop... [2024-08-05 10:14:55,865][00034] Waiting for process inference_proc0-0 to join... [2024-08-05 10:14:55,867][00034] Waiting for process rollout_proc0 to join... [2024-08-05 10:14:57,760][00034] Waiting for process rollout_proc1 to join... [2024-08-05 10:14:57,874][00034] Waiting for process rollout_proc2 to join... [2024-08-05 10:14:57,876][00034] Waiting for process rollout_proc3 to join... [2024-08-05 10:14:57,877][00034] Waiting for process rollout_proc4 to join... [2024-08-05 10:14:57,878][00034] Waiting for process rollout_proc5 to join... [2024-08-05 10:14:57,879][00034] Waiting for process rollout_proc6 to join... [2024-08-05 10:14:57,880][00034] Waiting for process rollout_proc7 to join... [2024-08-05 10:14:57,881][00034] Waiting for process rollout_proc8 to join... [2024-08-05 10:14:57,883][00034] Waiting for process rollout_proc9 to join... [2024-08-05 10:14:57,884][00034] Waiting for process rollout_proc10 to join... [2024-08-05 10:14:57,885][00034] Waiting for process rollout_proc11 to join... [2024-08-05 10:14:57,886][00034] Waiting for process rollout_proc12 to join... [2024-08-05 10:14:57,888][00034] Waiting for process rollout_proc13 to join... [2024-08-05 10:14:57,889][00034] Waiting for process rollout_proc14 to join... [2024-08-05 10:14:57,890][00034] Waiting for process rollout_proc15 to join... [2024-08-05 10:14:57,892][00034] Batcher 0 profile tree view: batching: 54.0365, releasing_batches: 0.0391 [2024-08-05 10:14:57,892][00034] InferenceWorker_p0-w0 profile tree view: wait_policy: 0.0161 wait_policy_total: 1510.3831 update_model: 6.7997 weight_update: 0.0021 one_step: 0.0069 handle_policy_step: 550.6481 deserialize: 23.7334, stack: 2.1990, obs_to_device_normalize: 98.6363, forward: 349.0586, send_messages: 16.5622 prepare_outputs: 45.3613 to_cpu: 19.7533 [2024-08-05 10:14:57,894][00034] Learner 0 profile tree view: misc: 0.0074, prepare_batch: 13.3828 train: 92.1400 epoch_init: 0.0091, minibatch_init: 0.0087, losses_postprocess: 0.6816, kl_divergence: 2.5443, after_optimizer: 36.5229 calculate_losses: 29.9441 losses_init: 0.0060, forward_head: 2.1742, bptt_initial: 14.3819, tail: 3.5150, advantages_returns: 0.4831, losses: 6.2100 bptt: 2.7082 bptt_forward_core: 2.5806 update: 21.5979 clip: 1.3163 [2024-08-05 10:14:57,895][00034] RolloutWorker_w0 profile tree view: wait_for_trajectories: 0.3736, enqueue_policy_requests: 94.3263, env_step: 1850.0963, overhead: 15.9946, complete_rollouts: 6.0655 save_policy_outputs: 37.1564 split_output_tensors: 13.0369 [2024-08-05 10:14:57,896][00034] RolloutWorker_w15 profile tree view: wait_for_trajectories: 0.3445, enqueue_policy_requests: 90.5026, env_step: 1858.7317, overhead: 15.4682, complete_rollouts: 5.8785 save_policy_outputs: 34.1124 split_output_tensors: 11.8722 [2024-08-05 10:14:57,897][00034] Loop Runner_EvtLoop terminating... [2024-08-05 10:14:57,898][00034] Runner profile tree view: main_loop: 2128.7203 [2024-08-05 10:14:57,899][00034] Collected {0: 10010624}, FPS: 4702.6 [2024-08-05 10:42:36,310][00034] Loading existing experiment configuration from /kaggle/working/train_dir/default_experiment/config.json [2024-08-05 10:42:36,311][00034] Overriding arg 'num_workers' with value 1 passed from command line [2024-08-05 10:42:36,312][00034] Adding new argument 'no_render'=True that is not in the saved config file! [2024-08-05 10:42:36,313][00034] Adding new argument 'save_video'=True that is not in the saved config file! [2024-08-05 10:42:36,314][00034] Adding new argument 'video_frames'=1000000000.0 that is not in the saved config file! [2024-08-05 10:42:36,315][00034] Adding new argument 'video_name'=None that is not in the saved config file! [2024-08-05 10:42:36,316][00034] Adding new argument 'max_num_frames'=100000 that is not in the saved config file! [2024-08-05 10:42:36,317][00034] Adding new argument 'max_num_episodes'=4 that is not in the saved config file! [2024-08-05 10:42:36,319][00034] Adding new argument 'push_to_hub'=True that is not in the saved config file! [2024-08-05 10:42:36,319][00034] Adding new argument 'hf_repository'='Mojitrk/deathmatch-16-16' that is not in the saved config file! [2024-08-05 10:42:36,321][00034] Adding new argument 'policy_index'=0 that is not in the saved config file! [2024-08-05 10:42:36,321][00034] Adding new argument 'eval_deterministic'=False that is not in the saved config file! [2024-08-05 10:42:36,323][00034] Adding new argument 'train_script'=None that is not in the saved config file! [2024-08-05 10:42:36,324][00034] Adding new argument 'enjoy_script'=None that is not in the saved config file! [2024-08-05 10:42:36,325][00034] Using frameskip 1 and render_action_repeat=4 for evaluation [2024-08-05 10:42:36,355][00034] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 10:42:36,358][00034] Port 40300 is available [2024-08-05 10:42:36,359][00034] Using port 40300 [2024-08-05 10:42:36,362][00034] RunningMeanStd input shape: (23,) [2024-08-05 10:42:36,364][00034] RunningMeanStd input shape: (3, 72, 128) [2024-08-05 10:42:36,365][00034] RunningMeanStd input shape: (1,) [2024-08-05 10:42:36,383][00034] ConvEncoder: input_channels=3 [2024-08-05 10:42:36,506][00034] Conv encoder output size: 512 [2024-08-05 10:42:36,508][00034] Policy head output size: 640 [2024-08-05 10:42:36,722][00034] Loading state from checkpoint /kaggle/working/train_dir/default_experiment/checkpoint_p0/checkpoint_000001222_10010624.pth... [2024-08-05 10:42:36,772][00034] Using port 40300 on host... [2024-08-05 10:42:37,115][00034] Initialized w:0 v:0 player:0 [2024-08-05 10:42:37,644][00034] Num frames 100... [2024-08-05 10:42:37,866][00034] Num frames 200... [2024-08-05 10:42:38,090][00034] Num frames 300... [2024-08-05 10:42:38,314][00034] Num frames 400... [2024-08-05 10:42:38,543][00034] Num frames 500... [2024-08-05 10:42:38,765][00034] Num frames 600... [2024-08-05 10:42:38,990][00034] Num frames 700... [2024-08-05 10:42:39,214][00034] Num frames 800... [2024-08-05 10:42:39,430][00034] Num frames 900... [2024-08-05 10:42:39,649][00034] Num frames 1000... [2024-08-05 10:42:39,867][00034] Num frames 1100... [2024-08-05 10:42:40,085][00034] Num frames 1200... [2024-08-05 10:42:40,309][00034] Num frames 1300... [2024-08-05 10:42:40,528][00034] Num frames 1400... [2024-08-05 10:42:40,747][00034] Num frames 1500... [2024-08-05 10:42:40,962][00034] Num frames 1600... [2024-08-05 10:42:41,177][00034] Num frames 1700... [2024-08-05 10:42:41,393][00034] Num frames 1800... [2024-08-05 10:42:41,618][00034] Num frames 1900... [2024-08-05 10:42:41,835][00034] Num frames 2000... [2024-08-05 10:42:42,052][00034] Num frames 2100... [2024-08-05 10:42:42,276][00034] Num frames 2200... [2024-08-05 10:42:42,495][00034] Num frames 2300... [2024-08-05 10:42:42,714][00034] Num frames 2400... [2024-08-05 10:42:42,936][00034] Num frames 2500... [2024-08-05 10:42:43,156][00034] Num frames 2600... [2024-08-05 10:42:43,373][00034] Num frames 2700... [2024-08-05 10:42:43,593][00034] Num frames 2800... [2024-08-05 10:42:43,808][00034] Num frames 2900... [2024-08-05 10:42:44,025][00034] Num frames 3000... [2024-08-05 10:42:44,245][00034] Num frames 3100... [2024-08-05 10:42:44,499][00034] Num frames 3200... [2024-08-05 10:42:44,754][00034] Num frames 3300... [2024-08-05 10:42:45,002][00034] Num frames 3400... [2024-08-05 10:42:45,230][00034] Num frames 3500... [2024-08-05 10:42:45,459][00034] Num frames 3600... [2024-08-05 10:42:45,691][00034] Num frames 3700... [2024-08-05 10:42:45,924][00034] Num frames 3800... [2024-08-05 10:42:46,158][00034] Num frames 3900... [2024-08-05 10:42:46,378][00034] Num frames 4000... [2024-08-05 10:42:46,600][00034] Num frames 4100... [2024-08-05 10:42:46,833][00034] Num frames 4200... [2024-08-05 10:42:47,075][00034] Num frames 4300... [2024-08-05 10:42:47,302][00034] Num frames 4400... [2024-08-05 10:42:47,522][00034] Num frames 4500... [2024-08-05 10:42:47,742][00034] Num frames 4600... [2024-08-05 10:42:47,964][00034] Num frames 4700... [2024-08-05 10:42:48,194][00034] Num frames 4800... [2024-08-05 10:42:48,423][00034] Num frames 4900... [2024-08-05 10:42:48,651][00034] Num frames 5000... [2024-08-05 10:42:48,878][00034] Num frames 5100... [2024-08-05 10:42:49,101][00034] Num frames 5200... [2024-08-05 10:42:49,329][00034] Num frames 5300... [2024-08-05 10:42:49,554][00034] Num frames 5400... [2024-08-05 10:42:49,795][00034] Num frames 5500... [2024-08-05 10:42:50,031][00034] Num frames 5600... [2024-08-05 10:42:50,272][00034] Num frames 5700... [2024-08-05 10:42:50,506][00034] Num frames 5800... [2024-08-05 10:42:50,731][00034] Num frames 5900... [2024-08-05 10:42:50,961][00034] Num frames 6000... [2024-08-05 10:42:51,189][00034] Num frames 6100... [2024-08-05 10:42:51,423][00034] Num frames 6200... [2024-08-05 10:42:51,661][00034] Num frames 6300... [2024-08-05 10:42:51,900][00034] Num frames 6400... [2024-08-05 10:42:52,124][00034] Num frames 6500... [2024-08-05 10:42:52,348][00034] Num frames 6600... [2024-08-05 10:42:52,571][00034] Num frames 6700... [2024-08-05 10:42:52,791][00034] Num frames 6800... [2024-08-05 10:42:53,008][00034] Num frames 6900... [2024-08-05 10:42:53,230][00034] Num frames 7000... [2024-08-05 10:42:53,462][00034] Num frames 7100... [2024-08-05 10:42:53,689][00034] Num frames 7200... [2024-08-05 10:42:53,918][00034] Num frames 7300... [2024-08-05 10:42:54,137][00034] Num frames 7400... [2024-08-05 10:42:54,353][00034] Num frames 7500... [2024-08-05 10:42:54,579][00034] Num frames 7600... [2024-08-05 10:42:54,819][00034] Num frames 7700... [2024-08-05 10:42:55,049][00034] Num frames 7800... [2024-08-05 10:42:55,277][00034] Num frames 7900... [2024-08-05 10:42:55,505][00034] Num frames 8000... [2024-08-05 10:42:55,722][00034] Num frames 8100... [2024-08-05 10:42:55,932][00034] Num frames 8200... [2024-08-05 10:42:56,147][00034] Num frames 8300... [2024-08-05 10:42:56,363][00034] DAMAGECOUNT value on done: 60.0 [2024-08-05 10:42:56,427][00034] Avg episode rewards: #0: 4.538, true rewards: #0: 0.000 [2024-08-05 10:42:56,427][00034] Avg episode reward: 4.538, avg true_objective: 0.000 [2024-08-05 10:42:56,432][00034] Num frames 8400... [2024-08-05 10:42:56,658][00034] Num frames 8500... [2024-08-05 10:42:56,876][00034] Num frames 8600... [2024-08-05 10:42:57,100][00034] Num frames 8700... [2024-08-05 10:42:57,323][00034] Num frames 8800... [2024-08-05 10:42:57,543][00034] Num frames 8900... [2024-08-05 10:42:57,759][00034] Num frames 9000... [2024-08-05 10:42:57,977][00034] Num frames 9100... [2024-08-05 10:42:58,189][00034] Num frames 9200... [2024-08-05 10:42:58,405][00034] Num frames 9300... [2024-08-05 10:42:58,618][00034] Num frames 9400... [2024-08-05 10:42:58,832][00034] Num frames 9500... [2024-08-05 10:42:59,047][00034] Num frames 9600... [2024-08-05 10:42:59,263][00034] Num frames 9700... [2024-08-05 10:42:59,479][00034] Num frames 9800... [2024-08-05 10:42:59,693][00034] Num frames 9900... [2024-08-05 10:42:59,906][00034] Num frames 10000... [2024-08-05 10:43:00,123][00034] Num frames 10100... [2024-08-05 10:43:00,339][00034] Num frames 10200... [2024-08-05 10:43:00,557][00034] Num frames 10300... [2024-08-05 10:43:00,775][00034] Num frames 10400... [2024-08-05 10:43:00,996][00034] Num frames 10500... [2024-08-05 10:43:01,217][00034] Num frames 10600... [2024-08-05 10:43:01,445][00034] Num frames 10700... [2024-08-05 10:43:01,671][00034] Num frames 10800... [2024-08-05 10:43:01,901][00034] Num frames 10900... [2024-08-05 10:43:02,130][00034] Num frames 11000... [2024-08-05 10:43:02,366][00034] Num frames 11100... [2024-08-05 10:43:02,583][00034] Num frames 11200... [2024-08-05 10:43:02,801][00034] Num frames 11300... [2024-08-05 10:43:03,021][00034] Num frames 11400... [2024-08-05 10:43:03,242][00034] Num frames 11500... [2024-08-05 10:43:03,472][00034] Num frames 11600... [2024-08-05 10:43:03,693][00034] Num frames 11700... [2024-08-05 10:43:03,911][00034] Num frames 11800... [2024-08-05 10:43:04,140][00034] Num frames 11900... [2024-08-05 10:43:04,369][00034] Num frames 12000... [2024-08-05 10:43:04,592][00034] Num frames 12100... [2024-08-05 10:43:04,839][00034] Num frames 12200... [2024-08-05 10:43:05,072][00034] Num frames 12300... [2024-08-05 10:43:05,304][00034] Num frames 12400... [2024-08-05 10:43:05,543][00034] Num frames 12500... [2024-08-05 10:43:05,764][00034] Num frames 12600... [2024-08-05 10:43:05,981][00034] Num frames 12700... [2024-08-05 10:43:06,205][00034] Num frames 12800... [2024-08-05 10:43:06,424][00034] Num frames 12900... [2024-08-05 10:43:06,641][00034] Num frames 13000... [2024-08-05 10:43:06,857][00034] Num frames 13100... [2024-08-05 10:43:07,076][00034] Num frames 13200... [2024-08-05 10:43:07,297][00034] Num frames 13300... [2024-08-05 10:43:07,517][00034] Num frames 13400... [2024-08-05 10:43:07,745][00034] Num frames 13500... [2024-08-05 10:43:07,985][00034] Num frames 13600... [2024-08-05 10:43:08,239][00034] Num frames 13700... [2024-08-05 10:43:08,490][00034] Num frames 13800... [2024-08-05 10:43:08,726][00034] Num frames 13900... [2024-08-05 10:43:08,964][00034] Num frames 14000... [2024-08-05 10:43:09,188][00034] Num frames 14100... [2024-08-05 10:43:09,410][00034] Num frames 14200... [2024-08-05 10:43:09,637][00034] Num frames 14300... [2024-08-05 10:43:09,867][00034] Num frames 14400... [2024-08-05 10:43:10,109][00034] Num frames 14500... [2024-08-05 10:43:10,341][00034] Num frames 14600... [2024-08-05 10:43:10,565][00034] Num frames 14700... [2024-08-05 10:43:10,792][00034] Num frames 14800... [2024-08-05 10:43:11,018][00034] Num frames 14900... [2024-08-05 10:43:11,245][00034] Num frames 15000... [2024-08-05 10:43:11,478][00034] Num frames 15100... [2024-08-05 10:43:11,711][00034] Num frames 15200... [2024-08-05 10:43:11,930][00034] Num frames 15300... [2024-08-05 10:43:12,148][00034] Num frames 15400... [2024-08-05 10:43:12,366][00034] Num frames 15500... [2024-08-05 10:43:12,583][00034] Num frames 15600... [2024-08-05 10:43:12,803][00034] Num frames 15700... [2024-08-05 10:43:13,024][00034] Num frames 15800... [2024-08-05 10:43:13,243][00034] Num frames 15900... [2024-08-05 10:43:13,460][00034] Num frames 16000... [2024-08-05 10:43:13,679][00034] Num frames 16100... [2024-08-05 10:43:13,895][00034] Num frames 16200... [2024-08-05 10:43:14,111][00034] Num frames 16300... [2024-08-05 10:43:14,343][00034] Num frames 16400... [2024-08-05 10:43:14,566][00034] Num frames 16500... [2024-08-05 10:43:14,816][00034] Num frames 16600... [2024-08-05 10:43:15,035][00034] Num frames 16700... [2024-08-05 10:43:15,256][00034] DAMAGECOUNT value on done: 441.0 [2024-08-05 10:43:15,257][00034] Sum rewards: 10.765, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-3.220', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'WEAPON1': '0.020', 'AMMO5': '0.029', 'AMMO3': '0.131', 'WEAPON4': '0.200', 'HITCOUNT': '0.200', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON5': '0.400', 'weapon5': '0.408', 'ARMOR': '0.496', 'WEAPON3': '0.900', 'weapon7': '1.038', 'DAMAGECOUNT': '1.143', 'weapon4': '1.894', 'FRAGCOUNT': '4.000', 'weapon2': '4.662', 'weapon3': '5.734'} [2024-08-05 10:43:15,319][00034] Avg episode rewards: #0: 7.651, true rewards: #0: 2.000 [2024-08-05 10:43:15,320][00034] Avg episode reward: 7.651, avg true_objective: 2.000 [2024-08-05 10:43:15,327][00034] Num frames 16800... [2024-08-05 10:43:15,552][00034] Num frames 16900... [2024-08-05 10:43:15,780][00034] Num frames 17000... [2024-08-05 10:43:16,004][00034] Num frames 17100... [2024-08-05 10:43:16,229][00034] Num frames 17200... [2024-08-05 10:43:16,459][00034] Num frames 17300... [2024-08-05 10:43:16,680][00034] Num frames 17400... [2024-08-05 10:43:16,896][00034] Num frames 17500... [2024-08-05 10:43:17,116][00034] Num frames 17600... [2024-08-05 10:43:17,333][00034] Num frames 17700... [2024-08-05 10:43:17,556][00034] Num frames 17800... [2024-08-05 10:43:17,777][00034] Num frames 17900... [2024-08-05 10:43:17,999][00034] Num frames 18000... [2024-08-05 10:43:18,225][00034] Num frames 18100... [2024-08-05 10:43:18,469][00034] Num frames 18200... [2024-08-05 10:43:18,711][00034] Num frames 18300... [2024-08-05 10:43:18,935][00034] Num frames 18400... [2024-08-05 10:43:19,156][00034] Num frames 18500... [2024-08-05 10:43:19,383][00034] Num frames 18600... [2024-08-05 10:43:19,605][00034] Num frames 18700... [2024-08-05 10:43:19,829][00034] Num frames 18800... [2024-08-05 10:43:20,049][00034] Num frames 18900... [2024-08-05 10:43:20,269][00034] Num frames 19000... [2024-08-05 10:43:20,495][00034] Num frames 19100... [2024-08-05 10:43:20,718][00034] Num frames 19200... [2024-08-05 10:43:20,942][00034] Num frames 19300... [2024-08-05 10:43:21,170][00034] Num frames 19400... [2024-08-05 10:43:21,397][00034] Num frames 19500... [2024-08-05 10:43:21,626][00034] Num frames 19600... [2024-08-05 10:43:21,857][00034] Num frames 19700... [2024-08-05 10:43:22,085][00034] Num frames 19800... [2024-08-05 10:43:22,325][00034] Num frames 19900... [2024-08-05 10:43:22,564][00034] Num frames 20000... [2024-08-05 10:43:22,796][00034] Num frames 20100... [2024-08-05 10:43:23,019][00034] Num frames 20200... [2024-08-05 10:43:23,247][00034] Num frames 20300... [2024-08-05 10:43:23,473][00034] Num frames 20400... [2024-08-05 10:43:23,701][00034] Num frames 20500... [2024-08-05 10:43:23,922][00034] Num frames 20600... [2024-08-05 10:43:24,139][00034] Num frames 20700... [2024-08-05 10:43:24,355][00034] Num frames 20800... [2024-08-05 10:43:24,578][00034] Num frames 20900... [2024-08-05 10:43:24,823][00034] Num frames 21000... [2024-08-05 10:43:25,055][00034] Num frames 21100... [2024-08-05 10:43:25,293][00034] Num frames 21200... [2024-08-05 10:43:25,521][00034] Num frames 21300... [2024-08-05 10:43:25,749][00034] Num frames 21400... [2024-08-05 10:43:25,978][00034] Num frames 21500... [2024-08-05 10:43:26,206][00034] Num frames 21600... [2024-08-05 10:43:26,426][00034] Num frames 21700... [2024-08-05 10:43:26,649][00034] Num frames 21800... [2024-08-05 10:43:26,867][00034] Num frames 21900... [2024-08-05 10:43:27,082][00034] Num frames 22000... [2024-08-05 10:43:27,298][00034] Num frames 22100... [2024-08-05 10:43:27,519][00034] Num frames 22200... [2024-08-05 10:43:27,747][00034] Num frames 22300... [2024-08-05 10:43:27,970][00034] Num frames 22400... [2024-08-05 10:43:28,192][00034] Num frames 22500... [2024-08-05 10:43:28,415][00034] Num frames 22600... [2024-08-05 10:43:28,639][00034] Num frames 22700... [2024-08-05 10:43:28,858][00034] Num frames 22800... [2024-08-05 10:43:29,086][00034] Num frames 22900... [2024-08-05 10:43:29,314][00034] Num frames 23000... [2024-08-05 10:43:29,544][00034] Num frames 23100... [2024-08-05 10:43:29,766][00034] Num frames 23200... [2024-08-05 10:43:29,992][00034] Num frames 23300... [2024-08-05 10:43:30,213][00034] Num frames 23400... [2024-08-05 10:43:30,433][00034] Num frames 23500... [2024-08-05 10:43:30,661][00034] Num frames 23600... [2024-08-05 10:43:30,878][00034] Num frames 23700... [2024-08-05 10:43:31,100][00034] Num frames 23800... [2024-08-05 10:43:31,319][00034] Num frames 23900... [2024-08-05 10:43:31,549][00034] Num frames 24000... [2024-08-05 10:43:31,786][00034] Num frames 24100... [2024-08-05 10:43:32,010][00034] Num frames 24200... [2024-08-05 10:43:32,234][00034] Num frames 24300... [2024-08-05 10:43:32,460][00034] Num frames 24400... [2024-08-05 10:43:32,690][00034] Num frames 24500... [2024-08-05 10:43:32,911][00034] Num frames 24600... [2024-08-05 10:43:33,140][00034] Num frames 24700... [2024-08-05 10:43:33,363][00034] Num frames 24800... [2024-08-05 10:43:33,595][00034] Num frames 24900... [2024-08-05 10:43:33,815][00034] Num frames 25000... [2024-08-05 10:43:34,033][00034] Num frames 25100... [2024-08-05 10:43:34,255][00034] DAMAGECOUNT value on done: 645.0 [2024-08-05 10:43:34,257][00034] Sum rewards: 7.179, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-3.702', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'WEAPON1': '0.020', 'weapon4': '0.020', 'AMMO5': '0.035', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.130', 'WEAPON7': '0.200', 'weapon7': '0.494', 'WEAPON5': '0.500', 'DAMAGECOUNT': '0.612', 'WEAPON3': '0.900', 'weapon5': '1.184', 'FRAGCOUNT': '1.500', 'weapon2': '6.648', 'weapon3': '7.238'} [2024-08-05 10:43:34,319][00034] Avg episode rewards: #0: 7.494, true rewards: #0: 2.000 [2024-08-05 10:43:34,320][00034] Avg episode reward: 7.494, avg true_objective: 2.000 [2024-08-05 10:43:34,328][00034] Num frames 25200... [2024-08-05 10:43:34,567][00034] Num frames 25300... [2024-08-05 10:43:34,816][00034] Num frames 25400... [2024-08-05 10:43:35,035][00034] Num frames 25500... [2024-08-05 10:43:35,255][00034] Num frames 25600... [2024-08-05 10:43:35,477][00034] Num frames 25700... [2024-08-05 10:43:35,695][00034] Num frames 25800... [2024-08-05 10:43:35,914][00034] Num frames 25900... [2024-08-05 10:43:36,130][00034] Num frames 26000... [2024-08-05 10:43:36,351][00034] Num frames 26100... [2024-08-05 10:43:36,575][00034] Num frames 26200... [2024-08-05 10:43:36,798][00034] Num frames 26300... [2024-08-05 10:43:37,029][00034] Num frames 26400... [2024-08-05 10:43:37,099][00034] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 10:43:37,257][00034] Num frames 26500... [2024-08-05 10:43:37,485][00034] Num frames 26600... [2024-08-05 10:43:37,701][00034] Num frames 26700... [2024-08-05 10:43:37,924][00034] Num frames 26800... [2024-08-05 10:43:38,139][00034] Num frames 26900... [2024-08-05 10:43:38,356][00034] Num frames 27000... [2024-08-05 10:43:38,589][00034] Num frames 27100... [2024-08-05 10:43:38,812][00034] Num frames 27200... [2024-08-05 10:43:39,032][00034] Num frames 27300... [2024-08-05 10:43:39,248][00034] Num frames 27400... [2024-08-05 10:43:39,492][00034] Num frames 27500... [2024-08-05 10:43:39,740][00034] Num frames 27600... [2024-08-05 10:43:39,977][00034] Num frames 27700... [2024-08-05 10:43:40,206][00034] Num frames 27800... [2024-08-05 10:43:40,435][00034] Num frames 27900... [2024-08-05 10:43:40,657][00034] Num frames 28000... [2024-08-05 10:43:40,879][00034] Num frames 28100... [2024-08-05 10:43:41,097][00034] Num frames 28200... [2024-08-05 10:43:41,322][00034] Num frames 28300... [2024-08-05 10:43:41,546][00034] Num frames 28400... [2024-08-05 10:43:41,760][00034] Num frames 28500... [2024-08-05 10:43:41,975][00034] Num frames 28600... [2024-08-05 10:43:42,201][00034] Num frames 28700... [2024-08-05 10:43:42,423][00034] Num frames 28800... [2024-08-05 10:43:42,648][00034] Num frames 28900... [2024-08-05 10:43:42,869][00034] Num frames 29000... [2024-08-05 10:43:43,082][00034] Num frames 29100... [2024-08-05 10:43:43,307][00034] Num frames 29200... [2024-08-05 10:43:43,528][00034] Num frames 29300... [2024-08-05 10:43:43,744][00034] Num frames 29400... [2024-08-05 10:43:43,966][00034] Num frames 29500... [2024-08-05 10:43:44,185][00034] Num frames 29600... [2024-08-05 10:43:44,413][00034] Num frames 29700... [2024-08-05 10:43:44,642][00034] Num frames 29800... [2024-08-05 10:43:44,883][00034] Num frames 29900... [2024-08-05 10:43:45,102][00034] Num frames 30000... [2024-08-05 10:43:45,319][00034] Num frames 30100... [2024-08-05 10:43:45,547][00034] Num frames 30200... [2024-08-05 10:43:45,775][00034] Num frames 30300... [2024-08-05 10:43:46,007][00034] Num frames 30400... [2024-08-05 10:43:46,229][00034] Num frames 30500... [2024-08-05 10:43:46,448][00034] Num frames 30600... [2024-08-05 10:43:46,672][00034] Num frames 30700... [2024-08-05 10:43:46,907][00034] Num frames 30800... [2024-08-05 10:43:47,141][00034] Num frames 30900... [2024-08-05 10:43:47,371][00034] Num frames 31000... [2024-08-05 10:43:47,600][00034] Num frames 31100... [2024-08-05 10:43:47,829][00034] Num frames 31200... [2024-08-05 10:43:48,054][00034] Num frames 31300... [2024-08-05 10:43:48,287][00034] Num frames 31400... [2024-08-05 10:43:48,511][00034] Num frames 31500... [2024-08-05 10:43:48,740][00034] Num frames 31600... [2024-08-05 10:43:48,961][00034] Num frames 31700... [2024-08-05 10:43:49,182][00034] Num frames 31800... [2024-08-05 10:43:49,404][00034] Num frames 31900... [2024-08-05 10:43:49,629][00034] Num frames 32000... [2024-08-05 10:43:49,867][00034] Num frames 32100... [2024-08-05 10:43:50,113][00034] Num frames 32200... [2024-08-05 10:43:50,346][00034] Num frames 32300... [2024-08-05 10:43:50,577][00034] Num frames 32400... [2024-08-05 10:43:50,800][00034] Num frames 32500... [2024-08-05 10:43:51,033][00034] Num frames 32600... [2024-08-05 10:43:51,267][00034] Num frames 32700... [2024-08-05 10:43:51,488][00034] Num frames 32800... [2024-08-05 10:43:51,717][00034] Num frames 32900... [2024-08-05 10:43:51,954][00034] Num frames 33000... [2024-08-05 10:43:52,183][00034] Num frames 33100... [2024-08-05 10:43:52,408][00034] Num frames 33200... [2024-08-05 10:43:52,639][00034] Num frames 33300... [2024-08-05 10:43:52,864][00034] Num frames 33400... [2024-08-05 10:43:53,087][00034] Num frames 33500... [2024-08-05 10:43:53,294][00034] DAMAGECOUNT value on done: 755.0 [2024-08-05 10:43:53,295][00034] Sum rewards: 6.208, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.840', 'AMMO4': '-0.056', 'AMMO2': '-0.011', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'ARMOR': '0.104', 'HITCOUNT': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.173', 'WEAPON7': '0.200', 'weapon7': '0.288', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.330', 'weapon5': '0.634', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.500', 'weapon4': '2.182', 'weapon3': '5.538', 'weapon2': '6.934'} [2024-08-05 10:43:53,357][00034] Avg episode rewards: #0: 7.172, true rewards: #0: 2.000 [2024-08-05 10:43:53,358][00034] Avg episode reward: 7.172, avg true_objective: 2.000 [2024-08-05 10:45:35,961][00034] Replay video saved to /kaggle/working/train_dir/default_experiment/replay.mp4!