Hugging Face's logo

QYHcrossover
/
poca-test

Reinforcement Learning
ml-agents
TensorBoard
ONNX
unity-ml-agents
deep-reinforcement-learning
ML-Agents-SoccerTwos
Model card Files Metrics Community
QYHcrossover commited on
Commit
8686820
•
1 Parent(s): a974006

First Commit

Browse files
Files changed (19) hide show
  1. README.md +31 -0
  2. SoccerTwos.onnx +3 -0
  3. SoccerTwos/SoccerTwos-48499942.onnx +3 -0
  4. SoccerTwos/SoccerTwos-48499942.pt +3 -0
  5. SoccerTwos/SoccerTwos-48999948.onnx +3 -0
  6. SoccerTwos/SoccerTwos-48999948.pt +3 -0
  7. SoccerTwos/SoccerTwos-49499976.onnx +3 -0
  8. SoccerTwos/SoccerTwos-49499976.pt +3 -0
  9. SoccerTwos/SoccerTwos-49999998.onnx +3 -0
  10. SoccerTwos/SoccerTwos-49999998.pt +3 -0
  11. SoccerTwos/SoccerTwos-50000068.onnx +3 -0
  12. SoccerTwos/SoccerTwos-50000068.pt +3 -0
  13. SoccerTwos/checkpoint.pt +3 -0
  14. SoccerTwos/events.out.tfevents.1681281987.amax.531756.0 +3 -0
  15. config.json +1 -0
  16. configuration.yaml +82 -0
  17. run_logs/Player-0.log +408 -0
  18. run_logs/timers.json +672 -0
  19. run_logs/training_status.json +66 -0
README.md ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+ ---
3
+ tags:
4
+ - unity-ml-agents
5
+ - ml-agents
6
+ - deep-reinforcement-learning
7
+ - reinforcement-learning
8
+ - ML-Agents-SoccerTwos
9
+ library_name: ml-agents
10
+ ---
11
+
12
+ # **poca** Agent playing **SoccerTwos**
13
+ This is a trained model of a **poca** agent playing **SoccerTwos** using the [Unity ML-Agents Library](https://github.com/Unity-Technologies/ml-agents).
14
+
15
+ ## Usage (with ML-Agents)
16
+ The Documentation: https://github.com/huggingface/ml-agents#get-started
17
+ We wrote a complete tutorial to learn to train your first agent using ML-Agents and publish it to the Hub:
18
+
19
+
20
+ ### Resume the training
21
+ ```
22
+ mlagents-learn <your_configuration_file_path.yaml> --run-id=<run_id> --resume
23
+ ```
24
+ ### Watch your Agent play
25
+ You can watch your agent **playing directly in your browser:**.
26
+
27
+ 1. Go to https://huggingface.co/spaces/unity/ML-Agents-SoccerTwos
28
+ 2. Step 1: Write your model_id: QYHcrossover/poca-test
29
+ 3. Step 2: Select your *.nn /*.onnx file
30
+ 4. Click on Watch the agent play 👀
31
+
SoccerTwos.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:377810cfa5b7fe2a81a0b51abfd3818e50c950d881c79acd6365ba25a9b9bc83
3
+ size 1764633
SoccerTwos/SoccerTwos-48499942.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5e4d4a4bf297ae4736a283b5636ec6910df1199ade37d0d7972ad6e340657742
3
+ size 1764633
SoccerTwos/SoccerTwos-48499942.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eb1d7ec13681392c25133fa91c471cfd2620001bb374376ed0d436b358d313cf
3
+ size 28422481
SoccerTwos/SoccerTwos-48999948.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7909c70543fb7990ab22f0ed06bb486d02a4f6717359c2a91a27bcb0c12a5e83
3
+ size 1764633
SoccerTwos/SoccerTwos-48999948.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b4776e3886d706d486f88c107327cf6bd8d0bba442456dd4323d64b82219caa6
3
+ size 28422481
SoccerTwos/SoccerTwos-49499976.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5e4829f085ee417ff3018f9f83bec098af45c4ac40ab284732d099b7b4d563ed
3
+ size 1764633
SoccerTwos/SoccerTwos-49499976.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:01a451d9587f64ba9f29cb6ae15bdcd96d60c1b149564e4bd2382721c066d49c
3
+ size 28422481
SoccerTwos/SoccerTwos-49999998.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:377810cfa5b7fe2a81a0b51abfd3818e50c950d881c79acd6365ba25a9b9bc83
3
+ size 1764633
SoccerTwos/SoccerTwos-49999998.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8e58110c989595653379ef9b504745406d4d13996755f3d1de56c7810d76dbf4
3
+ size 28422481
SoccerTwos/SoccerTwos-50000068.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:377810cfa5b7fe2a81a0b51abfd3818e50c950d881c79acd6365ba25a9b9bc83
3
+ size 1764633
SoccerTwos/SoccerTwos-50000068.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3fdf1318e4f6cd2552703cefc1f6e0f74d9b66db4ed88b141c7155edf883c195
3
+ size 28422481
SoccerTwos/checkpoint.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3fdf1318e4f6cd2552703cefc1f6e0f74d9b66db4ed88b141c7155edf883c195
3
+ size 28422481
SoccerTwos/events.out.tfevents.1681281987.amax.531756.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3d72ee30a0954111155bbfc81703a2be83e25a92b3db4002fdb2c866fc4b7052
3
+ size 50810501
config.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"default_settings": null, "behaviors": {"SoccerTwos": {"trainer_type": "poca", "hyperparameters": {"batch_size": 2048, "buffer_size": 20480, "learning_rate": 0.0003, "beta": 0.005, "epsilon": 0.2, "lambd": 0.95, "num_epoch": 3, "learning_rate_schedule": "constant", "beta_schedule": "constant", "epsilon_schedule": "constant"}, "checkpoint_interval": 500000, "network_settings": {"normalize": false, "hidden_units": 512, "num_layers": 2, "vis_encode_type": "simple", "memory": null, "goal_conditioning_type": "hyper", "deterministic": false}, "reward_signals": {"extrinsic": {"gamma": 0.99, "strength": 1.0, "network_settings": {"normalize": false, "hidden_units": 128, "num_layers": 2, "vis_encode_type": "simple", "memory": null, "goal_conditioning_type": "hyper", "deterministic": false}}}, "init_path": null, "keep_checkpoints": 5, "even_checkpoints": false, "max_steps": 50000000, "time_horizon": 1000, "summary_freq": 10000, "threaded": false, "self_play": {"save_steps": 50000, "team_change": 200000, "swap_steps": 2000, "window": 10, "play_against_latest_model_ratio": 0.5, "initial_elo": 1200.0}, "behavioral_cloning": null}}, "env_settings": {"env_path": "./training-envs-executables/SoccerTwos/SoccerTwos.x86_64", "env_args": null, "base_port": 5005, "num_envs": 1, "num_areas": 1, "seed": -1, "max_lifetime_restarts": 10, "restarts_rate_limit_n": 1, "restarts_rate_limit_period_s": 60}, "engine_settings": {"width": 84, "height": 84, "quality_level": 5, "time_scale": 20, "target_frame_rate": -1, "capture_frame_rate": 60, "no_graphics": true}, "environment_parameters": null, "checkpoint_settings": {"run_id": "SoccerTwos", "initialize_from": null, "load_model": false, "resume": false, "force": true, "train_model": false, "inference": false, "results_dir": "results"}, "torch_settings": {"device": null}, "debug": false}
configuration.yaml ADDED
@@ -0,0 +1,82 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ default_settings: null
2
+ behaviors:
3
+ SoccerTwos:
4
+ trainer_type: poca
5
+ hyperparameters:
6
+ batch_size: 2048
7
+ buffer_size: 20480
8
+ learning_rate: 0.0003
9
+ beta: 0.005
10
+ epsilon: 0.2
11
+ lambd: 0.95
12
+ num_epoch: 3
13
+ learning_rate_schedule: constant
14
+ beta_schedule: constant
15
+ epsilon_schedule: constant
16
+ checkpoint_interval: 500000
17
+ network_settings:
18
+ normalize: false
19
+ hidden_units: 512
20
+ num_layers: 2
21
+ vis_encode_type: simple
22
+ memory: null
23
+ goal_conditioning_type: hyper
24
+ deterministic: false
25
+ reward_signals:
26
+ extrinsic:
27
+ gamma: 0.99
28
+ strength: 1.0
29
+ network_settings:
30
+ normalize: false
31
+ hidden_units: 128
32
+ num_layers: 2
33
+ vis_encode_type: simple
34
+ memory: null
35
+ goal_conditioning_type: hyper
36
+ deterministic: false
37
+ init_path: null
38
+ keep_checkpoints: 5
39
+ even_checkpoints: false
40
+ max_steps: 50000000
41
+ time_horizon: 1000
42
+ summary_freq: 10000
43
+ threaded: false
44
+ self_play:
45
+ save_steps: 50000
46
+ team_change: 200000
47
+ swap_steps: 2000
48
+ window: 10
49
+ play_against_latest_model_ratio: 0.5
50
+ initial_elo: 1200.0
51
+ behavioral_cloning: null
52
+ env_settings:
53
+ env_path: ./training-envs-executables/SoccerTwos/SoccerTwos.x86_64
54
+ env_args: null
55
+ base_port: 5005
56
+ num_envs: 1
57
+ num_areas: 1
58
+ seed: -1
59
+ max_lifetime_restarts: 10
60
+ restarts_rate_limit_n: 1
61
+ restarts_rate_limit_period_s: 60
62
+ engine_settings:
63
+ width: 84
64
+ height: 84
65
+ quality_level: 5
66
+ time_scale: 20
67
+ target_frame_rate: -1
68
+ capture_frame_rate: 60
69
+ no_graphics: true
70
+ environment_parameters: null
71
+ checkpoint_settings:
72
+ run_id: SoccerTwos
73
+ initialize_from: null
74
+ load_model: false
75
+ resume: false
76
+ force: true
77
+ train_model: false
78
+ inference: false
79
+ results_dir: results
80
+ torch_settings:
81
+ device: null
82
+ debug: false
run_logs/Player-0.log ADDED
@@ -0,0 +1,408 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Mono path[0] = '/data/qyh/ml-agents-aivsai/training-envs-executables/SoccerTwos/SoccerTwos_Data/Managed'
2
+ Mono config path = '/data/qyh/ml-agents-aivsai/training-envs-executables/SoccerTwos/SoccerTwos_Data/MonoBleedingEdge/etc'
3
+ Preloaded 'lib_burst_generated.so'
4
+ Preloaded 'libgrpc_csharp_ext.x64.so'
5
+ Initialize engine version: 2021.3.14f1 (eee1884e7226)
6
+ [Subsystems] Discovering subsystems at path /data/qyh/ml-agents-aivsai/training-envs-executables/SoccerTwos/SoccerTwos_Data/UnitySubsystems
7
+ Forcing GfxDevice: Null
8
+ GfxDevice: creating device client; threaded=0; jobified=0
9
+ NullGfxDevice:
10
+ Version: NULL 1.0 [1.0]
11
+ Renderer: Null Device
12
+ Vendor: Unity Technologies
13
+ xcb_connection_has_error() returned true
14
+ xcb_connection_has_error() returned true
15
+ xcb_connection_has_error() returned true
16
+ xcb_connection_has_error() returned true
17
+ Begin MonoManager ReloadAssembly
18
+ - Completed reload, in 0.113 seconds
19
+ ERROR: Shader Sprites/Default shader is not supported on this GPU (none of subshaders/fallbacks are suitable)
20
+ ERROR: Shader Sprites/Mask shader is not supported on this GPU (none of subshaders/fallbacks are suitable)
21
+ ERROR: Shader Legacy Shaders/VertexLit shader is not supported on this GPU (none of subshaders/fallbacks are suitable)
22
+ WARNING: Shader Unsupported: 'Standard (Specular setup)' - All subshaders removed
23
+ WARNING: Shader Did you use #pragma only_renderers and omit this platform?
24
+ WARNING: Shader If subshaders removal was intentional, you may have forgotten turning Fallback off?
25
+ ERROR: Shader Standard (Specular setup) shader is not supported on this GPU (none of subshaders/fallbacks are suitable)
26
+ WARNING: Shader Unsupported: 'Standard (Specular setup)' - All subshaders removed
27
+ WARNING: Shader Did you use #pragma only_renderers and omit this platform?
28
+ WARNING: Shader If subshaders removal was intentional, you may have forgotten turning Fallback off?
29
+ WARNING: Shader Unsupported: 'Autodesk Interactive' - All subshaders removed
30
+ WARNING: Shader Did you use #pragma only_renderers and omit this platform?
31
+ WARNING: Shader If subshaders removal was intentional, you may have forgotten turning Fallback off?
32
+ ERROR: Shader Autodesk Interactive shader is not supported on this GPU (none of subshaders/fallbacks are suitable)
33
+ WARNING: Shader Unsupported: 'Autodesk Interactive' - All subshaders removed
34
+ WARNING: Shader Did you use #pragma only_renderers and omit this platform?
35
+ WARNING: Shader If subshaders removal was intentional, you may have forgotten turning Fallback off?
36
+ WARNING: Shader Unsupported: 'Standard' - All subshaders removed
37
+ WARNING: Shader Did you use #pragma only_renderers and omit this platform?
38
+ WARNING: Shader If subshaders removal was intentional, you may have forgotten turning Fallback off?
39
+ ERROR: Shader Standard shader is not supported on this GPU (none of subshaders/fallbacks are suitable)
40
+ WARNING: Shader Unsupported: 'Standard' - All subshaders removed
41
+ WARNING: Shader Did you use #pragma only_renderers and omit this platform?
42
+ WARNING: Shader If subshaders removal was intentional, you may have forgotten turning Fallback off?
43
+ UnloadTime: 1.178232 ms
44
+ Registered Communicator in Agent.
45
+ ERROR: Shader UI/Default shader is not supported on this GPU (none of subshaders/fallbacks are suitable)
46
+ requesting resize 84 x 84
47
+ Setting up 16 worker threads for Enlighten.
48
+ Memory Statistics:
49
+ [ALLOC_TEMP_TLS] TLS Allocator
50
+ StackAllocators :
51
+ [ALLOC_TEMP_MAIN]
52
+ Peak usage frame count: [8.0 KB-16.0 KB]: 674806 frames, [2.0 MB-4.0 MB]: 1 frames
53
+ Initial Block Size 4.0 MB
54
+ Current Block Size 4.0 MB
55
+ Peak Allocated Bytes 2.1 MB
56
+ Overflow Count 0
57
+ [ALLOC_TEMP_Job.Worker 18]
58
+ Initial Block Size 256.0 KB
59
+ Current Block Size 256.0 KB
60
+ Peak Allocated Bytes 0 B
61
+ Overflow Count 0
62
+ [ALLOC_TEMP_Loading.PreloadManager]
63
+ Initial Block Size 256.0 KB
64
+ Current Block Size 300.0 KB
65
+ Peak Allocated Bytes 249.6 KB
66
+ Overflow Count 4
67
+ [ALLOC_TEMP_Background Job.Worker 8]
68
+ Initial Block Size 32.0 KB
69
+ Current Block Size 32.0 KB
70
+ Peak Allocated Bytes 0 B
71
+ Overflow Count 0
72
+ [ALLOC_TEMP_Background Job.Worker 10]
73
+ Initial Block Size 32.0 KB
74
+ Current Block Size 32.0 KB
75
+ Peak Allocated Bytes 0 B
76
+ Overflow Count 0
77
+ [ALLOC_TEMP_Job.Worker 16]
78
+ Initial Block Size 256.0 KB
79
+ Current Block Size 256.0 KB
80
+ Peak Allocated Bytes 0 B
81
+ Overflow Count 0
82
+ [ALLOC_TEMP_Background Job.Worker 6]
83
+ Initial Block Size 32.0 KB
84
+ Current Block Size 32.0 KB
85
+ Peak Allocated Bytes 0 B
86
+ Overflow Count 0
87
+ [ALLOC_TEMP_Job.Worker 4]
88
+ Initial Block Size 256.0 KB
89
+ Current Block Size 256.0 KB
90
+ Peak Allocated Bytes 0 B
91
+ Overflow Count 0
92
+ [ALLOC_TEMP_Job.Worker 27]
93
+ Initial Block Size 256.0 KB
94
+ Current Block Size 256.0 KB
95
+ Peak Allocated Bytes 0 B
96
+ Overflow Count 0
97
+ [ALLOC_TEMP_Job.Worker 14]
98
+ Initial Block Size 256.0 KB
99
+ Current Block Size 256.0 KB
100
+ Peak Allocated Bytes 0 B
101
+ Overflow Count 0
102
+ [ALLOC_TEMP_Job.Worker 17]
103
+ Initial Block Size 256.0 KB
104
+ Current Block Size 256.0 KB
105
+ Peak Allocated Bytes 0 B
106
+ Overflow Count 0
107
+ [ALLOC_TEMP_Job.Worker 3]
108
+ Initial Block Size 256.0 KB
109
+ Current Block Size 256.0 KB
110
+ Peak Allocated Bytes 0 B
111
+ Overflow Count 0
112
+ [ALLOC_TEMP_Background Job.Worker 12]
113
+ Initial Block Size 32.0 KB
114
+ Current Block Size 32.0 KB
115
+ Peak Allocated Bytes 0 B
116
+ Overflow Count 0
117
+ [ALLOC_TEMP_Background Job.Worker 1]
118
+ Initial Block Size 32.0 KB
119
+ Current Block Size 32.0 KB
120
+ Peak Allocated Bytes 0 B
121
+ Overflow Count 0
122
+ [ALLOC_TEMP_AssetGarbageCollectorHelper] x 31
123
+ Initial Block Size 64.0 KB
124
+ Current Block Size 64.0 KB
125
+ Peak Allocated Bytes 0 B
126
+ Overflow Count 0
127
+ [ALLOC_TEMP_Background Job.Worker 5]
128
+ Initial Block Size 32.0 KB
129
+ Current Block Size 32.0 KB
130
+ Peak Allocated Bytes 0 B
131
+ Overflow Count 0
132
+ [ALLOC_TEMP_Background Job.Worker 13]
133
+ Initial Block Size 32.0 KB
134
+ Current Block Size 32.0 KB
135
+ Peak Allocated Bytes 0 B
136
+ Overflow Count 0
137
+ [ALLOC_TEMP_Background Job.Worker 11]
138
+ Initial Block Size 32.0 KB
139
+ Current Block Size 32.0 KB
140
+ Peak Allocated Bytes 0 B
141
+ Overflow Count 0
142
+ [ALLOC_TEMP_Job.Worker 2]
143
+ Initial Block Size 256.0 KB
144
+ Current Block Size 256.0 KB
145
+ Peak Allocated Bytes 0 B
146
+ Overflow Count 0
147
+ [ALLOC_TEMP_Background Job.Worker 3]
148
+ Initial Block Size 32.0 KB
149
+ Current Block Size 32.0 KB
150
+ Peak Allocated Bytes 0 B
151
+ Overflow Count 0
152
+ [ALLOC_TEMP_Background Job.Worker 0]
153
+ Initial Block Size 32.0 KB
154
+ Current Block Size 32.0 KB
155
+ Peak Allocated Bytes 0 B
156
+ Overflow Count 0
157
+ [ALLOC_TEMP_Job.Worker 20]
158
+ Initial Block Size 256.0 KB
159
+ Current Block Size 256.0 KB
160
+ Peak Allocated Bytes 0 B
161
+ Overflow Count 0
162
+ [ALLOC_TEMP_Job.Worker 11]
163
+ Initial Block Size 256.0 KB
164
+ Current Block Size 256.0 KB
165
+ Peak Allocated Bytes 0 B
166
+ Overflow Count 0
167
+ [ALLOC_TEMP_Background Job.Worker 4]
168
+ Initial Block Size 32.0 KB
169
+ Current Block Size 32.0 KB
170
+ Peak Allocated Bytes 0 B
171
+ Overflow Count 0
172
+ [ALLOC_TEMP_BatchDeleteObjects]
173
+ Initial Block Size 64.0 KB
174
+ Current Block Size 64.0 KB
175
+ Peak Allocated Bytes 0 B
176
+ Overflow Count 0
177
+ [ALLOC_TEMP_Job.Worker 30]
178
+ Initial Block Size 256.0 KB
179
+ Current Block Size 256.0 KB
180
+ Peak Allocated Bytes 0 B
181
+ Overflow Count 0
182
+ [ALLOC_TEMP_Job.Worker 6]
183
+ Initial Block Size 256.0 KB
184
+ Current Block Size 256.0 KB
185
+ Peak Allocated Bytes 0 B
186
+ Overflow Count 0
187
+ [ALLOC_TEMP_Job.Worker 0]
188
+ Initial Block Size 256.0 KB
189
+ Current Block Size 256.0 KB
190
+ Peak Allocated Bytes 0 B
191
+ Overflow Count 0
192
+ [ALLOC_TEMP_Job.Worker 26]
193
+ Initial Block Size 256.0 KB
194
+ Current Block Size 256.0 KB
195
+ Peak Allocated Bytes 0 B
196
+ Overflow Count 0
197
+ [ALLOC_TEMP_Job.Worker 21]
198
+ Initial Block Size 256.0 KB
199
+ Current Block Size 256.0 KB
200
+ Peak Allocated Bytes 0 B
201
+ Overflow Count 0
202
+ [ALLOC_TEMP_Job.Worker 5]
203
+ Initial Block Size 256.0 KB
204
+ Current Block Size 256.0 KB
205
+ Peak Allocated Bytes 0 B
206
+ Overflow Count 0
207
+ [ALLOC_TEMP_Background Job.Worker 14]
208
+ Initial Block Size 32.0 KB
209
+ Current Block Size 32.0 KB
210
+ Peak Allocated Bytes 0 B
211
+ Overflow Count 0
212
+ [ALLOC_TEMP_Job.Worker 25]
213
+ Initial Block Size 256.0 KB
214
+ Current Block Size 256.0 KB
215
+ Peak Allocated Bytes 0 B
216
+ Overflow Count 0
217
+ [ALLOC_TEMP_Background Job.Worker 9]
218
+ Initial Block Size 32.0 KB
219
+ Current Block Size 32.0 KB
220
+ Peak Allocated Bytes 0 B
221
+ Overflow Count 0
222
+ [ALLOC_TEMP_Job.Worker 29]
223
+ Initial Block Size 256.0 KB
224
+ Current Block Size 256.0 KB
225
+ Peak Allocated Bytes 0 B
226
+ Overflow Count 0
227
+ [ALLOC_TEMP_Job.Worker 13]
228
+ Initial Block Size 256.0 KB
229
+ Current Block Size 256.0 KB
230
+ Peak Allocated Bytes 0 B
231
+ Overflow Count 0
232
+ [ALLOC_TEMP_EnlightenWorker] x 16
233
+ Initial Block Size 64.0 KB
234
+ Current Block Size 64.0 KB
235
+ Peak Allocated Bytes 0 B
236
+ Overflow Count 0
237
+ [ALLOC_TEMP_Background Job.Worker 15]
238
+ Initial Block Size 32.0 KB
239
+ Current Block Size 32.0 KB
240
+ Peak Allocated Bytes 0 B
241
+ Overflow Count 0
242
+ [ALLOC_TEMP_Background Job.Worker 2]
243
+ Initial Block Size 32.0 KB
244
+ Current Block Size 32.0 KB
245
+ Peak Allocated Bytes 0 B
246
+ Overflow Count 0
247
+ [ALLOC_TEMP_Job.Worker 28]
248
+ Initial Block Size 256.0 KB
249
+ Current Block Size 256.0 KB
250
+ Peak Allocated Bytes 0 B
251
+ Overflow Count 0
252
+ [ALLOC_TEMP_Job.Worker 22]
253
+ Initial Block Size 256.0 KB
254
+ Current Block Size 256.0 KB
255
+ Peak Allocated Bytes 0 B
256
+ Overflow Count 0
257
+ [ALLOC_TEMP_Background Job.Worker 7]
258
+ Initial Block Size 32.0 KB
259
+ Current Block Size 32.0 KB
260
+ Peak Allocated Bytes 0 B
261
+ Overflow Count 0
262
+ [ALLOC_TEMP_Job.Worker 9]
263
+ Initial Block Size 256.0 KB
264
+ Current Block Size 256.0 KB
265
+ Peak Allocated Bytes 0 B
266
+ Overflow Count 0
267
+ [ALLOC_TEMP_Job.Worker 8]
268
+ Initial Block Size 256.0 KB
269
+ Current Block Size 256.0 KB
270
+ Peak Allocated Bytes 0 B
271
+ Overflow Count 0
272
+ [ALLOC_TEMP_Job.Worker 7]
273
+ Initial Block Size 256.0 KB
274
+ Current Block Size 256.0 KB
275
+ Peak Allocated Bytes 0 B
276
+ Overflow Count 0
277
+ [ALLOC_TEMP_Job.Worker 23]
278
+ Initial Block Size 256.0 KB
279
+ Current Block Size 256.0 KB
280
+ Peak Allocated Bytes 0 B
281
+ Overflow Count 0
282
+ [ALLOC_TEMP_Job.Worker 1]
283
+ Initial Block Size 256.0 KB
284
+ Current Block Size 256.0 KB
285
+ Peak Allocated Bytes 0 B
286
+ Overflow Count 0
287
+ [ALLOC_TEMP_Job.Worker 10]
288
+ Initial Block Size 256.0 KB
289
+ Current Block Size 256.0 KB
290
+ Peak Allocated Bytes 0 B
291
+ Overflow Count 0
292
+ [ALLOC_TEMP_Job.Worker 15]
293
+ Initial Block Size 256.0 KB
294
+ Current Block Size 256.0 KB
295
+ Peak Allocated Bytes 0 B
296
+ Overflow Count 0
297
+ [ALLOC_TEMP_Job.Worker 24]
298
+ Initial Block Size 256.0 KB
299
+ Current Block Size 256.0 KB
300
+ Peak Allocated Bytes 0.7 KB
301
+ Overflow Count 0
302
+ [ALLOC_TEMP_Job.Worker 19]
303
+ Initial Block Size 256.0 KB
304
+ Current Block Size 256.0 KB
305
+ Peak Allocated Bytes 0 B
306
+ Overflow Count 0
307
+ [ALLOC_TEMP_Job.Worker 12]
308
+ Initial Block Size 256.0 KB
309
+ Current Block Size 256.0 KB
310
+ Peak Allocated Bytes 0 B
311
+ Overflow Count 0
312
+ [ALLOC_TEMP_Loading.AsyncRead]
313
+ Initial Block Size 64.0 KB
314
+ Current Block Size 64.0 KB
315
+ Peak Allocated Bytes 128 B
316
+ Overflow Count 0
317
+ [ALLOC_DEFAULT] Dual Thread Allocator
318
+ Peak main deferred allocation count 4
319
+ [ALLOC_BUCKET]
320
+ Large Block size 4.0 MB
321
+ Used Block count 1
322
+ Peak Allocated bytes 1.0 MB
323
+ [ALLOC_DEFAULT_MAIN]
324
+ Peak usage frame count: [4.0 MB-8.0 MB]: 674807 frames
325
+ Requested Block Size 16.0 MB
326
+ Peak Block count 1
327
+ Peak Allocated memory 4.7 MB
328
+ Peak Large allocation bytes 0 B
329
+ [ALLOC_DEFAULT_THREAD]
330
+ Peak usage frame count: [16.0 MB-32.0 MB]: 674807 frames
331
+ Requested Block Size 16.0 MB
332
+ Peak Block count 1
333
+ Peak Allocated memory 17.5 MB
334
+ Peak Large allocation bytes 16.0 MB
335
+ [ALLOC_TEMP_JOB_1_FRAME]
336
+ Initial Block Size 2.0 MB
337
+ Used Block Count 1
338
+ Overflow Count (too large) 0
339
+ Overflow Count (full) 0
340
+ [ALLOC_TEMP_JOB_2_FRAMES]
341
+ Initial Block Size 2.0 MB
342
+ Used Block Count 1
343
+ Overflow Count (too large) 0
344
+ Overflow Count (full) 0
345
+ [ALLOC_TEMP_JOB_4_FRAMES (JobTemp)]
346
+ Initial Block Size 2.0 MB
347
+ Used Block Count 2
348
+ Overflow Count (too large) 0
349
+ Overflow Count (full) 0
350
+ [ALLOC_TEMP_JOB_ASYNC (Background)]
351
+ Initial Block Size 1.0 MB
352
+ Used Block Count 3
353
+ Overflow Count (too large) 0
354
+ Overflow Count (full) 0
355
+ [ALLOC_GFX] Dual Thread Allocator
356
+ Peak main deferred allocation count 0
357
+ [ALLOC_BUCKET]
358
+ Large Block size 4.0 MB
359
+ Used Block count 1
360
+ Peak Allocated bytes 1.0 MB
361
+ [ALLOC_GFX_MAIN]
362
+ Peak usage frame count: [32.0 KB-64.0 KB]: 674806 frames, [64.0 KB-128.0 KB]: 1 frames
363
+ Requested Block Size 16.0 MB
364
+ Peak Block count 1
365
+ Peak Allocated memory 65.6 KB
366
+ Peak Large allocation bytes 0 B
367
+ [ALLOC_GFX_THREAD]
368
+ Peak usage frame count: [128.0 KB-256.0 KB]: 674807 frames
369
+ Requested Block Size 16.0 MB
370
+ Peak Block count 1
371
+ Peak Allocated memory 173.5 KB
372
+ Peak Large allocation bytes 0 B
373
+ [ALLOC_CACHEOBJECTS] Dual Thread Allocator
374
+ Peak main deferred allocation count 0
375
+ [ALLOC_BUCKET]
376
+ Large Block size 4.0 MB
377
+ Used Block count 1
378
+ Peak Allocated bytes 1.0 MB
379
+ [ALLOC_CACHEOBJECTS_MAIN]
380
+ Peak usage frame count: [0.5 MB-1.0 MB]: 674807 frames
381
+ Requested Block Size 4.0 MB
382
+ Peak Block count 1
383
+ Peak Allocated memory 0.6 MB
384
+ Peak Large allocation bytes 0 B
385
+ [ALLOC_CACHEOBJECTS_THREAD]
386
+ Peak usage frame count: [0.5 MB-1.0 MB]: 674806 frames, [4.0 MB-8.0 MB]: 1 frames
387
+ Requested Block Size 4.0 MB
388
+ Peak Block count 2
389
+ Peak Allocated memory 4.5 MB
390
+ Peak Large allocation bytes 0 B
391
+ [ALLOC_TYPETREE] Dual Thread Allocator
392
+ Peak main deferred allocation count 0
393
+ [ALLOC_BUCKET]
394
+ Large Block size 4.0 MB
395
+ Used Block count 1
396
+ Peak Allocated bytes 1.0 MB
397
+ [ALLOC_TYPETREE_MAIN]
398
+ Peak usage frame count: [0-1.0 KB]: 674807 frames
399
+ Requested Block Size 2.0 MB
400
+ Peak Block count 1
401
+ Peak Allocated memory 1.0 KB
402
+ Peak Large allocation bytes 0 B
403
+ [ALLOC_TYPETREE_THREAD]
404
+ Peak usage frame count: [1.0 KB-2.0 KB]: 674806 frames, [2.0 KB-4.0 KB]: 1 frames
405
+ Requested Block Size 2.0 MB
406
+ Peak Block count 1
407
+ Peak Allocated memory 2.2 KB
408
+ Peak Large allocation bytes 0 B
run_logs/timers.json ADDED
@@ -0,0 +1,672 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "name": "root",
3
+ "gauges": {
4
+ "SoccerTwos.Policy.Entropy.mean": {
5
+ "value": 1.4195332527160645,
6
+ "min": 1.292433261871338,
7
+ "max": 3.2957024574279785,
8
+ "count": 5000
9
+ },
10
+ "SoccerTwos.Policy.Entropy.sum": {
11
+ "value": 27936.4140625,
12
+ "min": 20411.30078125,
13
+ "max": 134377.71875,
14
+ "count": 5000
15
+ },
16
+ "SoccerTwos.Environment.EpisodeLength.mean": {
17
+ "value": 70.46376811594203,
18
+ "min": 40.78991596638655,
19
+ "max": 999.0,
20
+ "count": 5000
21
+ },
22
+ "SoccerTwos.Environment.EpisodeLength.sum": {
23
+ "value": 19448.0,
24
+ "min": 14248.0,
25
+ "max": 25856.0,
26
+ "count": 5000
27
+ },
28
+ "SoccerTwos.Self-play.ELO.mean": {
29
+ "value": 1654.752039914936,
30
+ "min": 1198.0076629245548,
31
+ "max": 1740.9173265311035,
32
+ "count": 4973
33
+ },
34
+ "SoccerTwos.Self-play.ELO.sum": {
35
+ "value": 228355.78150826116,
36
+ "min": 2399.7168920947306,
37
+ "max": 380352.22716378584,
38
+ "count": 4973
39
+ },
40
+ "SoccerTwos.Step.mean": {
41
+ "value": 49999998.0,
42
+ "min": 9946.0,
43
+ "max": 49999998.0,
44
+ "count": 5000
45
+ },
46
+ "SoccerTwos.Step.sum": {
47
+ "value": 49999998.0,
48
+ "min": 9946.0,
49
+ "max": 49999998.0,
50
+ "count": 5000
51
+ },
52
+ "SoccerTwos.Policy.ExtrinsicBaselineEstimate.mean": {
53
+ "value": -0.01260682474821806,
54
+ "min": -0.15269339084625244,
55
+ "max": 0.18355806171894073,
56
+ "count": 5000
57
+ },
58
+ "SoccerTwos.Policy.ExtrinsicBaselineEstimate.sum": {
59
+ "value": -1.7523486614227295,
60
+ "min": -29.31713104248047,
61
+ "max": 24.230602264404297,
62
+ "count": 5000
63
+ },
64
+ "SoccerTwos.Policy.ExtrinsicValueEstimate.mean": {
65
+ "value": -0.012377890758216381,
66
+ "min": -0.15390761196613312,
67
+ "max": 0.18630437552928925,
68
+ "count": 5000
69
+ },
70
+ "SoccerTwos.Policy.ExtrinsicValueEstimate.sum": {
71
+ "value": -1.7205268144607544,
72
+ "min": -29.550262451171875,
73
+ "max": 23.538002014160156,
74
+ "count": 5000
75
+ },
76
+ "SoccerTwos.Environment.CumulativeReward.mean": {
77
+ "value": 0.0,
78
+ "min": 0.0,
79
+ "max": 0.0,
80
+ "count": 5000
81
+ },
82
+ "SoccerTwos.Environment.CumulativeReward.sum": {
83
+ "value": 0.0,
84
+ "min": 0.0,
85
+ "max": 0.0,
86
+ "count": 5000
87
+ },
88
+ "SoccerTwos.Policy.ExtrinsicReward.mean": {
89
+ "value": 0.04151223160380082,
90
+ "min": -0.4944984610264118,
91
+ "max": 0.6213884611542408,
92
+ "count": 5000
93
+ },
94
+ "SoccerTwos.Policy.ExtrinsicReward.sum": {
95
+ "value": 5.770200192928314,
96
+ "min": -68.2613998055458,
97
+ "max": 58.31239950656891,
98
+ "count": 5000
99
+ },
100
+ "SoccerTwos.Environment.GroupCumulativeReward.mean": {
101
+ "value": 0.04151223160380082,
102
+ "min": -0.4944984610264118,
103
+ "max": 0.6213884611542408,
104
+ "count": 5000
105
+ },
106
+ "SoccerTwos.Environment.GroupCumulativeReward.sum": {
107
+ "value": 5.770200192928314,
108
+ "min": -68.2613998055458,
109
+ "max": 58.31239950656891,
110
+ "count": 5000
111
+ },
112
+ "SoccerTwos.IsTraining.mean": {
113
+ "value": 1.0,
114
+ "min": 1.0,
115
+ "max": 1.0,
116
+ "count": 5000
117
+ },
118
+ "SoccerTwos.IsTraining.sum": {
119
+ "value": 1.0,
120
+ "min": 1.0,
121
+ "max": 1.0,
122
+ "count": 5000
123
+ },
124
+ "SoccerTwos.Losses.PolicyLoss.mean": {
125
+ "value": 0.0185372463951353,
126
+ "min": 0.009863608033022804,
127
+ "max": 0.025471208885816547,
128
+ "count": 2423
129
+ },
130
+ "SoccerTwos.Losses.PolicyLoss.sum": {
131
+ "value": 0.0185372463951353,
132
+ "min": 0.009863608033022804,
133
+ "max": 0.025471208885816547,
134
+ "count": 2423
135
+ },
136
+ "SoccerTwos.Losses.ValueLoss.mean": {
137
+ "value": 0.09786825031042098,
138
+ "min": 1.6147926961214884e-06,
139
+ "max": 0.12753855536381403,
140
+ "count": 2423
141
+ },
142
+ "SoccerTwos.Losses.ValueLoss.sum": {
143
+ "value": 0.09786825031042098,
144
+ "min": 1.6147926961214884e-06,
145
+ "max": 0.12753855536381403,
146
+ "count": 2423
147
+ },
148
+ "SoccerTwos.Losses.BaselineLoss.mean": {
149
+ "value": 0.09925319477915764,
150
+ "min": 1.9570738838107597e-06,
151
+ "max": 0.13045041859149933,
152
+ "count": 2423
153
+ },
154
+ "SoccerTwos.Losses.BaselineLoss.sum": {
155
+ "value": 0.09925319477915764,
156
+ "min": 1.9570738838107597e-06,
157
+ "max": 0.13045041859149933,
158
+ "count": 2423
159
+ },
160
+ "SoccerTwos.Policy.LearningRate.mean": {
161
+ "value": 0.0003,
162
+ "min": 0.0003,
163
+ "max": 0.0003,
164
+ "count": 2423
165
+ },
166
+ "SoccerTwos.Policy.LearningRate.sum": {
167
+ "value": 0.0003,
168
+ "min": 0.0003,
169
+ "max": 0.0003,
170
+ "count": 2423
171
+ },
172
+ "SoccerTwos.Policy.Epsilon.mean": {
173
+ "value": 0.20000000000000007,
174
+ "min": 0.20000000000000007,
175
+ "max": 0.20000000000000007,
176
+ "count": 2423
177
+ },
178
+ "SoccerTwos.Policy.Epsilon.sum": {
179
+ "value": 0.20000000000000007,
180
+ "min": 0.20000000000000007,
181
+ "max": 0.20000000000000007,
182
+ "count": 2423
183
+ },
184
+ "SoccerTwos.Policy.Beta.mean": {
185
+ "value": 0.005000000000000001,
186
+ "min": 0.005000000000000001,
187
+ "max": 0.005000000000000001,
188
+ "count": 2423
189
+ },
190
+ "SoccerTwos.Policy.Beta.sum": {
191
+ "value": 0.005000000000000001,
192
+ "min": 0.005000000000000001,
193
+ "max": 0.005000000000000001,
194
+ "count": 2423
195
+ }
196
+ },
197
+ "metadata": {
198
+ "timer_format_version": "0.1.0",
199
+ "start_time_seconds": "1681281985",
200
+ "python_version": "3.9.16 (main, Mar 8 2023, 14:00:05) \n[GCC 11.2.0]",
201
+ "command_line_arguments": "/data/qyh/env/ml-agents/bin/mlagents-learn ./config/poca/SoccerTwos.yaml --env=./training-envs-executables/SoccerTwos/SoccerTwos.x86_64 --run-id=SoccerTwos --no-graphics --force",
202
+ "mlagents_version": "0.31.0.dev0",
203
+ "mlagents_envs_version": "0.31.0.dev0",
204
+ "communication_protocol_version": "1.5.0",
205
+ "pytorch_version": "1.11.0+cu102",
206
+ "numpy_version": "1.21.2",
207
+ "end_time_seconds": "1681402732"
208
+ },
209
+ "total": 120746.47696178919,
210
+ "count": 1,
211
+ "self": 0.3734058509580791,
212
+ "children": {
213
+ "run_training.setup": {
214
+ "total": 0.014949601143598557,
215
+ "count": 1,
216
+ "self": 0.014949601143598557
217
+ },
218
+ "TrainerController.start_learning": {
219
+ "total": 120746.08860633709,
220
+ "count": 1,
221
+ "self": 77.54858032311313,
222
+ "children": {
223
+ "TrainerController._reset_env": {
224
+ "total": 12.868911220692098,
225
+ "count": 250,
226
+ "self": 12.868911220692098
227
+ },
228
+ "TrainerController.advance": {
229
+ "total": 120655.36825838429,
230
+ "count": 3440092,
231
+ "self": 75.23298741341569,
232
+ "children": {
233
+ "env_step": {
234
+ "total": 96311.49877679092,
235
+ "count": 3440092,
236
+ "self": 78892.1787892282,
237
+ "children": {
238
+ "SubprocessEnvManager._take_step": {
239
+ "total": 17372.34501458425,
240
+ "count": 3440093,
241
+ "self": 473.0719433496706,
242
+ "children": {
243
+ "TorchPolicy.evaluate": {
244
+ "total": 16899.27307123458,
245
+ "count": 6283106,
246
+ "self": 16899.27307123458
247
+ }
248
+ }
249
+ },
250
+ "workers": {
251
+ "total": 46.97497297846712,
252
+ "count": 3440092,
253
+ "self": 0.0,
254
+ "children": {
255
+ "worker_root": {
256
+ "total": 156882.6940341266,
257
+ "count": 3440092,
258
+ "is_parallel": true,
259
+ "self": 88665.2846925219,
260
+ "children": {
261
+ "run_training.setup": {
262
+ "total": 0.014949601143598557,
263
+ "count": 1,
264
+ "is_parallel": true,
265
+ "self": 0.0,
266
+ "children": {
267
+ "steps_from_proto": {
268
+ "total": 0.002964502200484276,
269
+ "count": 2,
270
+ "is_parallel": true,
271
+ "self": 0.0007541587110608816,
272
+ "children": {
273
+ "_process_rank_one_or_two_observation": {
274
+ "total": 0.002210343489423394,
275
+ "count": 8,
276
+ "is_parallel": true,
277
+ "self": 0.002210343489423394
278
+ }
279
+ }
280
+ },
281
+ "UnityEnvironment.step": {
282
+ "total": 0.04908091598190367,
283
+ "count": 1,
284
+ "is_parallel": true,
285
+ "self": 0.0008998410776257515,
286
+ "children": {
287
+ "UnityEnvironment._generate_step_input": {
288
+ "total": 0.0006871400400996208,
289
+ "count": 1,
290
+ "is_parallel": true,
291
+ "self": 0.0006871400400996208
292
+ },
293
+ "communicator.exchange": {
294
+ "total": 0.04475230583921075,
295
+ "count": 1,
296
+ "is_parallel": true,
297
+ "self": 0.04475230583921075
298
+ },
299
+ "steps_from_proto": {
300
+ "total": 0.0027416290249675512,
301
+ "count": 2,
302
+ "is_parallel": true,
303
+ "self": 0.0006044909823685884,
304
+ "children": {
305
+ "_process_rank_one_or_two_observation": {
306
+ "total": 0.002137138042598963,
307
+ "count": 8,
308
+ "is_parallel": true,
309
+ "self": 0.002137138042598963
310
+ }
311
+ }
312
+ }
313
+ }
314
+ }
315
+ }
316
+ },
317
+ "UnityEnvironment.step": {
318
+ "total": 68216.35294895852,
319
+ "count": 3440090,
320
+ "is_parallel": true,
321
+ "self": 4212.691009314498,
322
+ "children": {
323
+ "UnityEnvironment._generate_step_input": {
324
+ "total": 2543.761743797222,
325
+ "count": 3440090,
326
+ "is_parallel": true,
327
+ "self": 2543.761743797222
328
+ },
329
+ "communicator.exchange": {
330
+ "total": 48855.70578872389,
331
+ "count": 3440090,
332
+ "is_parallel": true,
333
+ "self": 48855.70578872389
334
+ },
335
+ "steps_from_proto": {
336
+ "total": 12604.194407122908,
337
+ "count": 6880180,
338
+ "is_parallel": true,
339
+ "self": 2524.2793614787515,
340
+ "children": {
341
+ "_process_rank_one_or_two_observation": {
342
+ "total": 10079.915045644157,
343
+ "count": 27520720,
344
+ "is_parallel": true,
345
+ "self": 10079.915045644157
346
+ }
347
+ }
348
+ }
349
+ }
350
+ },
351
+ "steps_from_proto": {
352
+ "total": 1.0414430450182408,
353
+ "count": 498,
354
+ "is_parallel": true,
355
+ "self": 0.20645984704606235,
356
+ "children": {
357
+ "_process_rank_one_or_two_observation": {
358
+ "total": 0.8349831979721785,
359
+ "count": 1992,
360
+ "is_parallel": true,
361
+ "self": 0.8349831979721785
362
+ }
363
+ }
364
+ },
365
+ "TrainerController.start_learning": {
366
+ "total": 0.0,
367
+ "count": 0,
368
+ "is_parallel": true,
369
+ "self": 0.0,
370
+ "children": {
371
+ "TrainerController._reset_env": {
372
+ "total": 8.029929526615888,
373
+ "count": 71,
374
+ "is_parallel": true,
375
+ "self": 8.029929526615888
376
+ },
377
+ "TrainerController.advance": {
378
+ "total": 36305.836825001286,
379
+ "count": 971021,
380
+ "is_parallel": true,
381
+ "self": 24.50222869263962,
382
+ "children": {
383
+ "env_step": {
384
+ "total": 28686.83789387066,
385
+ "count": 971021,
386
+ "is_parallel": true,
387
+ "self": 22751.04375002673,
388
+ "children": {
389
+ "SubprocessEnvManager._take_step": {
390
+ "total": 5919.464527910808,
391
+ "count": 971022,
392
+ "is_parallel": true,
393
+ "self": 151.87438448495232,
394
+ "children": {
395
+ "TorchPolicy.evaluate": {
396
+ "total": 5767.590143425856,
397
+ "count": 1784312,
398
+ "is_parallel": true,
399
+ "self": 5767.590143425856
400
+ }
401
+ }
402
+ },
403
+ "workers": {
404
+ "total": 16.286547892261297,
405
+ "count": 971021,
406
+ "is_parallel": true,
407
+ "self": 0.0,
408
+ "children": {
409
+ "worker_root": {
410
+ "total": 36281.305150200846,
411
+ "count": 971021,
412
+ "is_parallel": true,
413
+ "self": 16842.687086465536,
414
+ "children": {
415
+ "run_training.setup": {
416
+ "total": 0.0,
417
+ "count": 0,
418
+ "is_parallel": true,
419
+ "self": 0.0,
420
+ "children": {
421
+ "steps_from_proto": {
422
+ "total": 0.002964502200484276,
423
+ "count": 2,
424
+ "is_parallel": true,
425
+ "self": 0.0007541587110608816,
426
+ "children": {
427
+ "_process_rank_one_or_two_observation": {
428
+ "total": 0.002210343489423394,
429
+ "count": 8,
430
+ "is_parallel": true,
431
+ "self": 0.002210343489423394
432
+ }
433
+ }
434
+ },
435
+ "UnityEnvironment.step": {
436
+ "total": 0.04908091598190367,
437
+ "count": 1,
438
+ "is_parallel": true,
439
+ "self": 0.0008998410776257515,
440
+ "children": {
441
+ "UnityEnvironment._generate_step_input": {
442
+ "total": 0.0006871400400996208,
443
+ "count": 1,
444
+ "is_parallel": true,
445
+ "self": 0.0006871400400996208
446
+ },
447
+ "communicator.exchange": {
448
+ "total": 0.04475230583921075,
449
+ "count": 1,
450
+ "is_parallel": true,
451
+ "self": 0.04475230583921075
452
+ },
453
+ "steps_from_proto": {
454
+ "total": 0.0027416290249675512,
455
+ "count": 2,
456
+ "is_parallel": true,
457
+ "self": 0.0006044909823685884,
458
+ "children": {
459
+ "_process_rank_one_or_two_observation": {
460
+ "total": 0.002137138042598963,
461
+ "count": 8,
462
+ "is_parallel": true,
463
+ "self": 0.002137138042598963
464
+ }
465
+ }
466
+ }
467
+ }
468
+ }
469
+ }
470
+ },
471
+ "UnityEnvironment.step": {
472
+ "total": 19438.344114235835,
473
+ "count": 971020,
474
+ "is_parallel": true,
475
+ "self": 1177.031996846199,
476
+ "children": {
477
+ "UnityEnvironment._generate_step_input": {
478
+ "total": 709.0933637698181,
479
+ "count": 971020,
480
+ "is_parallel": true,
481
+ "self": 709.0933637698181
482
+ },
483
+ "communicator.exchange": {
484
+ "total": 14046.089499872644,
485
+ "count": 971020,
486
+ "is_parallel": true,
487
+ "self": 14046.089499872644
488
+ },
489
+ "steps_from_proto": {
490
+ "total": 3506.1292537471745,
491
+ "count": 1942040,
492
+ "is_parallel": true,
493
+ "self": 700.1781443941873,
494
+ "children": {
495
+ "_process_rank_one_or_two_observation": {
496
+ "total": 2805.9511093529873,
497
+ "count": 7768160,
498
+ "is_parallel": true,
499
+ "self": 2805.9511093529873
500
+ }
501
+ }
502
+ }
503
+ }
504
+ },
505
+ "steps_from_proto": {
506
+ "total": 0.2739494994748384,
507
+ "count": 140,
508
+ "is_parallel": true,
509
+ "self": 0.05572276096791029,
510
+ "children": {
511
+ "_process_rank_one_or_two_observation": {
512
+ "total": 0.2182267385069281,
513
+ "count": 560,
514
+ "is_parallel": true,
515
+ "self": 0.2182267385069281
516
+ }
517
+ }
518
+ }
519
+ }
520
+ }
521
+ }
522
+ },
523
+ "steps_from_proto": {
524
+ "total": 0.007883729878813028,
525
+ "count": 2,
526
+ "is_parallel": true,
527
+ "self": 0.0015844448935240507,
528
+ "children": {
529
+ "_process_rank_one_or_two_observation": {
530
+ "total": 0.006299284985288978,
531
+ "count": 8,
532
+ "is_parallel": true,
533
+ "self": 0.006299284985288978
534
+ }
535
+ }
536
+ },
537
+ "UnityEnvironment.step": {
538
+ "total": 0.03518431098200381,
539
+ "count": 1,
540
+ "is_parallel": true,
541
+ "self": 0.0012415149249136448,
542
+ "children": {
543
+ "UnityEnvironment._generate_step_input": {
544
+ "total": 0.0005404020193964243,
545
+ "count": 1,
546
+ "is_parallel": true,
547
+ "self": 0.0005404020193964243
548
+ },
549
+ "communicator.exchange": {
550
+ "total": 0.030158760957419872,
551
+ "count": 1,
552
+ "is_parallel": true,
553
+ "self": 0.030158760957419872
554
+ },
555
+ "steps_from_proto": {
556
+ "total": 0.0032436330802738667,
557
+ "count": 2,
558
+ "is_parallel": true,
559
+ "self": 0.0006575279403477907,
560
+ "children": {
561
+ "_process_rank_one_or_two_observation": {
562
+ "total": 0.002586105139926076,
563
+ "count": 8,
564
+ "is_parallel": true,
565
+ "self": 0.002586105139926076
566
+ }
567
+ }
568
+ }
569
+ }
570
+ }
571
+ }
572
+ },
573
+ "trainer_advance": {
574
+ "total": 7594.496702437988,
575
+ "count": 971021,
576
+ "is_parallel": true,
577
+ "self": 196.13897215481848,
578
+ "children": {
579
+ "process_trajectory": {
580
+ "total": 2975.2169183182996,
581
+ "count": 971021,
582
+ "is_parallel": true,
583
+ "self": 2965.7006596401334,
584
+ "children": {
585
+ "RLTrainer._checkpoint": {
586
+ "total": 9.516258678166196,
587
+ "count": 28,
588
+ "is_parallel": true,
589
+ "self": 9.516258678166196
590
+ }
591
+ }
592
+ },
593
+ "_update_policy": {
594
+ "total": 4423.1408119648695,
595
+ "count": 684,
596
+ "is_parallel": true,
597
+ "self": 2961.678626596695,
598
+ "children": {
599
+ "TorchPOCAOptimizer.update": {
600
+ "total": 1461.4621853681747,
601
+ "count": 20520,
602
+ "is_parallel": true,
603
+ "self": 1461.4621853681747
604
+ }
605
+ }
606
+ }
607
+ }
608
+ }
609
+ }
610
+ }
611
+ }
612
+ }
613
+ }
614
+ }
615
+ }
616
+ }
617
+ }
618
+ },
619
+ "trainer_advance": {
620
+ "total": 24268.636494179955,
621
+ "count": 3440092,
622
+ "self": 551.8084254278801,
623
+ "children": {
624
+ "process_trajectory": {
625
+ "total": 9674.018466585781,
626
+ "count": 3440092,
627
+ "self": 9640.652242953656,
628
+ "children": {
629
+ "RLTrainer._checkpoint": {
630
+ "total": 33.366223632125184,
631
+ "count": 100,
632
+ "self": 33.366223632125184
633
+ }
634
+ }
635
+ },
636
+ "_update_policy": {
637
+ "total": 14042.809602166293,
638
+ "count": 2423,
639
+ "self": 9476.722620456945,
640
+ "children": {
641
+ "TorchPOCAOptimizer.update": {
642
+ "total": 4566.086981709348,
643
+ "count": 72690,
644
+ "self": 4566.086981709348
645
+ }
646
+ }
647
+ }
648
+ }
649
+ }
650
+ }
651
+ },
652
+ "trainer_threads": {
653
+ "total": 1.1860392987728119e-06,
654
+ "count": 1,
655
+ "self": 1.1860392987728119e-06
656
+ },
657
+ "TrainerController._save_models": {
658
+ "total": 0.3028552229516208,
659
+ "count": 1,
660
+ "self": 0.0014980649575591087,
661
+ "children": {
662
+ "RLTrainer._checkpoint": {
663
+ "total": 0.3013571579940617,
664
+ "count": 1,
665
+ "self": 0.3013571579940617
666
+ }
667
+ }
668
+ }
669
+ }
670
+ }
671
+ }
672
+ }
run_logs/training_status.json ADDED
@@ -0,0 +1,66 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "SoccerTwos": {
3
+ "checkpoints": [
4
+ {
5
+ "steps": 48499942,
6
+ "file_path": "results/SoccerTwos/SoccerTwos/SoccerTwos-48499942.onnx",
7
+ "reward": 0.0,
8
+ "creation_time": 1681399328.223413,
9
+ "auxillary_file_paths": [
10
+ "results/SoccerTwos/SoccerTwos/SoccerTwos-48499942.pt"
11
+ ]
12
+ },
13
+ {
14
+ "steps": 48999948,
15
+ "file_path": "results/SoccerTwos/SoccerTwos/SoccerTwos-48999948.onnx",
16
+ "reward": 0.0,
17
+ "creation_time": 1681400454.0287714,
18
+ "auxillary_file_paths": [
19
+ "results/SoccerTwos/SoccerTwos/SoccerTwos-48999948.pt"
20
+ ]
21
+ },
22
+ {
23
+ "steps": 49499976,
24
+ "file_path": "results/SoccerTwos/SoccerTwos/SoccerTwos-49499976.onnx",
25
+ "reward": 0.0,
26
+ "creation_time": 1681401593.039378,
27
+ "auxillary_file_paths": [
28
+ "results/SoccerTwos/SoccerTwos/SoccerTwos-49499976.pt"
29
+ ]
30
+ },
31
+ {
32
+ "steps": 49999998,
33
+ "file_path": "results/SoccerTwos/SoccerTwos/SoccerTwos-49999998.onnx",
34
+ "reward": 0.0,
35
+ "creation_time": 1681402731.4457116,
36
+ "auxillary_file_paths": [
37
+ "results/SoccerTwos/SoccerTwos/SoccerTwos-49999998.pt"
38
+ ]
39
+ },
40
+ {
41
+ "steps": 50000068,
42
+ "file_path": "results/SoccerTwos/SoccerTwos/SoccerTwos-50000068.onnx",
43
+ "reward": 0.0,
44
+ "creation_time": 1681402731.7595127,
45
+ "auxillary_file_paths": [
46
+ "results/SoccerTwos/SoccerTwos/SoccerTwos-50000068.pt"
47
+ ]
48
+ }
49
+ ],
50
+ "elo": 1657.2738367668023,
51
+ "final_checkpoint": {
52
+ "steps": 50000068,
53
+ "file_path": "results/SoccerTwos/SoccerTwos.onnx",
54
+ "reward": 0.0,
55
+ "creation_time": 1681402731.7595127,
56
+ "auxillary_file_paths": [
57
+ "results/SoccerTwos/SoccerTwos/SoccerTwos-50000068.pt"
58
+ ]
59
+ }
60
+ },
61
+ "metadata": {
62
+ "stats_format_version": "0.3.0",
63
+ "mlagents_version": "0.31.0.dev0",
64
+ "torch_version": "1.11.0+cu102"
65
+ }
66
+ }