Hugging Face's logo

MattStammers
/
appo-atari_robotank-superhuman2

Reinforcement Learning
sample-factory
TensorBoard
deep-reinforcement-learning
Eval Results
Model card Files Metrics Community
MattStammers commited on
Commit
0b63c00
•
1 Parent(s): 38e1f43

Upload folder using huggingface_hub

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. .gitattributes +2 -0
  2. .summary/0/events.out.tfevents.1700740633.rhmmedcatt-proliant-ml350-gen10 +3 -0
  3. .summary/1/events.out.tfevents.1700740633.rhmmedcatt-proliant-ml350-gen10 +3 -0
  4. README.md +189 -0
  5. checkpoint_p0/best_001559680_399278080_reward_14.320.pth +3 -0
  6. checkpoint_p0/checkpoint_001953056_499982336.pth +3 -0
  7. checkpoint_p0/checkpoint_001953120_500006912.pth +3 -0
  8. checkpoint_p0/milestones/checkpoint_000011104_2842624.pth +3 -0
  9. checkpoint_p0/milestones/checkpoint_000022464_5750784.pth +3 -0
  10. checkpoint_p0/milestones/checkpoint_000033824_8658944.pth +3 -0
  11. checkpoint_p0/milestones/checkpoint_000045216_11575296.pth +3 -0
  12. checkpoint_p0/milestones/checkpoint_000056704_14516224.pth +3 -0
  13. checkpoint_p0/milestones/checkpoint_000068224_17465344.pth +3 -0
  14. checkpoint_p0/milestones/checkpoint_000079712_20406272.pth +3 -0
  15. checkpoint_p0/milestones/checkpoint_000091136_23330816.pth +3 -0
  16. checkpoint_p0/milestones/checkpoint_000102560_26255360.pth +3 -0
  17. checkpoint_p0/milestones/checkpoint_000113920_29163520.pth +3 -0
  18. checkpoint_p0/milestones/checkpoint_000125312_32079872.pth +3 -0
  19. checkpoint_p0/milestones/checkpoint_000136704_34996224.pth +3 -0
  20. checkpoint_p0/milestones/checkpoint_000148064_37904384.pth +3 -0
  21. checkpoint_p0/milestones/checkpoint_000159360_40796160.pth +3 -0
  22. checkpoint_p0/milestones/checkpoint_000170656_43687936.pth +3 -0
  23. checkpoint_p0/milestones/checkpoint_000182016_46596096.pth +3 -0
  24. checkpoint_p0/milestones/checkpoint_000193376_49504256.pth +3 -0
  25. checkpoint_p0/milestones/checkpoint_000204864_52445184.pth +3 -0
  26. checkpoint_p0/milestones/checkpoint_000216416_55402496.pth +3 -0
  27. checkpoint_p0/milestones/checkpoint_000227872_58335232.pth +3 -0
  28. checkpoint_p0/milestones/checkpoint_000239328_61267968.pth +3 -0
  29. checkpoint_p0/milestones/checkpoint_000250880_64225280.pth +3 -0
  30. checkpoint_p0/milestones/checkpoint_000262432_67182592.pth +3 -0
  31. checkpoint_p0/milestones/checkpoint_000273920_70123520.pth +3 -0
  32. checkpoint_p0/milestones/checkpoint_000285408_73064448.pth +3 -0
  33. checkpoint_p0/milestones/checkpoint_000296896_76005376.pth +3 -0
  34. checkpoint_p0/milestones/checkpoint_000308352_78938112.pth +3 -0
  35. checkpoint_p0/milestones/checkpoint_000319808_81870848.pth +3 -0
  36. checkpoint_p0/milestones/checkpoint_000331264_84803584.pth +3 -0
  37. checkpoint_p0/milestones/checkpoint_000342688_87728128.pth +3 -0
  38. checkpoint_p0/milestones/checkpoint_000354144_90660864.pth +3 -0
  39. checkpoint_p0/milestones/checkpoint_000365568_93585408.pth +3 -0
  40. checkpoint_p0/milestones/checkpoint_000377088_96534528.pth +3 -0
  41. checkpoint_p0/milestones/checkpoint_000388544_99467264.pth +3 -0
  42. checkpoint_p0/milestones/checkpoint_000400000_102400000.pth +3 -0
  43. checkpoint_p0/milestones/checkpoint_000411488_105340928.pth +3 -0
  44. checkpoint_p0/milestones/checkpoint_000422592_108183552.pth +3 -0
  45. checkpoint_p0/milestones/checkpoint_000434048_111116288.pth +3 -0
  46. checkpoint_p0/milestones/checkpoint_000445440_114032640.pth +3 -0
  47. checkpoint_p0/milestones/checkpoint_000456896_116965376.pth +3 -0
  48. checkpoint_p0/milestones/checkpoint_000468384_119906304.pth +3 -0
  49. checkpoint_p0/milestones/checkpoint_000479872_122847232.pth +3 -0
  50. checkpoint_p0/milestones/checkpoint_000491424_125804544.pth +3 -0
.gitattributes CHANGED
@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ replay.mp4 filter=lfs diff=lfs merge=lfs -text
37
+ sf_log.txt filter=lfs diff=lfs merge=lfs -text
.summary/0/events.out.tfevents.1700740633.rhmmedcatt-proliant-ml350-gen10 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:06a5b8bddcdc270b19caef67b33c45b599db22e6e6d1e78352f5d7678dc1811d
3
+ size 100366978
.summary/1/events.out.tfevents.1700740633.rhmmedcatt-proliant-ml350-gen10 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0b92211605ccc41570ed64d13917d0f6838d0e9c0d9ff16501c21d4b0073944a
3
+ size 52668533
README.md ADDED
@@ -0,0 +1,189 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: sample-factory
3
+ tags:
4
+ - deep-reinforcement-learning
5
+ - reinforcement-learning
6
+ - sample-factory
7
+ model-index:
8
+ - name: APPO
9
+ results:
10
+ - task:
11
+ type: reinforcement-learning
12
+ name: reinforcement-learning
13
+ dataset:
14
+ name: atari_robotank
15
+ type: atari_robotank
16
+ metrics:
17
+ - type: mean_reward
18
+ value: 76.20 +/- 10.64
19
+ name: mean_reward
20
+ verified: false
21
+ ---
22
+
23
+ ## About the Project
24
+
25
+ This project is an attempt to maximise performance of high sample throughput APPO RL models in Atari environments in as carbon efficient a manner as possible using a single, not particularly high performance single machine. It is about demonstrating the generalisability of on-policy algorithms to create good performance quickly (by sacrificing sample efficiency) while also proving that this route to RL production is accessible to even hobbyists like me (I am a gastroenterologist not a computer scientist).
26
+
27
+ In terms of throughput I am managing to reach throughputs of 2,500 - 3,000 across both policies using sample factory using two Quadro P2200's (not particularly powerful GPUs) each loaded up about 60% (3GB). Previously using the stable baselines 3 (sb3) implementation of PPO it would take about a week to train an atari agent to 100 million timesteps synchronously. By comparison the sample factory async implementation takes only just over 2 hours to achieve the same result. That is about 84 times faster with only typically a 21 watt burn per GPU. I am thus very grateful to Alex Petrenko and all the sample factory team for their work on this.
28
+
29
+ ## Project Aims
30
+
31
+ This model as with all the others in the benchmarks was trained initially asynchronously un-seeded to 10 million steps for the purposes of setting a sample factory async baseline for this model on this environment but only 3/57 made it anywhere near sota performance.
32
+
33
+ I then re-trained the models with 100 million timesteps- at this point 2 environments maxed out at sota performance (Pong and Freeway) with four approaching sota performance - (atlantis, boxing, tennis and fishingderby.) =6/57 near sota.
34
+
35
+ The aim now is to try and reach state-of-the-art (SOTA) performance on a further block of atari environments using up to 1 billion training timesteps initially with appo. I will flag the models with SOTA when they reach at or near these levels.
36
+
37
+ After this I will switch on V-Trace to see if the Impala variations perform any better with the same seed (I have seeded '1234')
38
+
39
+
40
+ ## About the Model
41
+
42
+ The hyperparameters used in the model are described in my shell script on my fork of sample-factory: https://github.com/MattStammers/sample-factory. Given that https://huggingface.co/edbeeching has kindly shared his parameters, I saved time and energy by using many of his tuned hyperparameters to reduce carbon inefficiency:
43
+ ```
44
+ hyperparameters = {
45
+ "help": false,
46
+ "algo": "APPO",
47
+ "env": "atari_asteroid",
48
+ "experiment": "atari_asteroid_APPO",
49
+ "train_dir": "./train_atari",
50
+ "restart_behavior": "restart",
51
+ "device": "gpu",
52
+ "seed": 1234,
53
+ "num_policies": 2,
54
+ "async_rl": true,
55
+ "serial_mode": false,
56
+ "batched_sampling": true,
57
+ "num_batches_to_accumulate": 2,
58
+ "worker_num_splits": 1,
59
+ "policy_workers_per_policy": 1,
60
+ "max_policy_lag": 1000,
61
+ "num_workers": 16,
62
+ "num_envs_per_worker": 2,
63
+ "batch_size": 1024,
64
+ "num_batches_per_epoch": 8,
65
+ "num_epochs": 4,
66
+ "rollout": 128,
67
+ "recurrence": 1,
68
+ "shuffle_minibatches": false,
69
+ "gamma": 0.99,
70
+ "reward_scale": 1.0,
71
+ "reward_clip": 1000.0,
72
+ "value_bootstrap": false,
73
+ "normalize_returns": true,
74
+ "exploration_loss_coeff": 0.0004677351413,
75
+ "value_loss_coeff": 0.5,
76
+ "kl_loss_coeff": 0.0,
77
+ "exploration_loss": "entropy",
78
+ "gae_lambda": 0.95,
79
+ "ppo_clip_ratio": 0.1,
80
+ "ppo_clip_value": 1.0,
81
+ "with_vtrace": false,
82
+ "vtrace_rho": 1.0,
83
+ "vtrace_c": 1.0,
84
+ "optimizer": "adam",
85
+ "adam_eps": 1e-05,
86
+ "adam_beta1": 0.9,
87
+ "adam_beta2": 0.999,
88
+ "max_grad_norm": 0.0,
89
+ "learning_rate": 0.0003033891184,
90
+ "lr_schedule": "linear_decay",
91
+ "lr_schedule_kl_threshold": 0.008,
92
+ "lr_adaptive_min": 1e-06,
93
+ "lr_adaptive_max": 0.01,
94
+ "obs_subtract_mean": 0.0,
95
+ "obs_scale": 255.0,
96
+ "normalize_input": true,
97
+ "normalize_input_keys": [
98
+ "obs"
99
+ ],
100
+ "decorrelate_experience_max_seconds": 0,
101
+ "decorrelate_envs_on_one_worker": true,
102
+ "actor_worker_gpus": [],
103
+ "set_workers_cpu_affinity": true,
104
+ "force_envs_single_thread": false,
105
+ "default_niceness": 0,
106
+ "log_to_file": true,
107
+ "experiment_summaries_interval": 3,
108
+ "flush_summaries_interval": 30,
109
+ "stats_avg": 100,
110
+ "summaries_use_frameskip": true,
111
+ "heartbeat_interval": 10,
112
+ "heartbeat_reporting_interval": 60,
113
+ "train_for_env_steps": 100000000,
114
+ "train_for_seconds": 10000000000,
115
+ "save_every_sec": 120,
116
+ "keep_checkpoints": 2,
117
+ "load_checkpoint_kind": "latest",
118
+ "save_milestones_sec": 1200,
119
+ "save_best_every_sec": 5,
120
+ "save_best_metric": "reward",
121
+ "save_best_after": 100000,
122
+ "benchmark": false,
123
+ "encoder_mlp_layers": [
124
+ 512,
125
+ 512
126
+ ],
127
+ "encoder_conv_architecture": "convnet_atari",
128
+ "encoder_conv_mlp_layers": [
129
+ 512
130
+ ],
131
+ "use_rnn": false,
132
+ "rnn_size": 512,
133
+ "rnn_type": "gru",
134
+ "rnn_num_layers": 1,
135
+ "decoder_mlp_layers": [],
136
+ "nonlinearity": "relu",
137
+ "policy_initialization": "orthogonal",
138
+ "policy_init_gain": 1.0,
139
+ "actor_critic_share_weights": true,
140
+ "adaptive_stddev": false,
141
+ "continuous_tanh_scale": 0.0,
142
+ "initial_stddev": 1.0,
143
+ "use_env_info_cache": false,
144
+ "env_gpu_actions": false,
145
+ "env_gpu_observations": true,
146
+ "env_frameskip": 4,
147
+ "env_framestack": 4,
148
+ "pixel_format": "CHW"
149
+ }
150
+
151
+ ```
152
+
153
+
154
+
155
+ A(n) **APPO** model trained on the **atari_robotank** environment.
156
+
157
+ This model was trained using Sample-Factory 2.0: https://github.com/alex-petrenko/sample-factory. Sample factory is a
158
+ high throughput on-policy RL framework. I have been using
159
+ Documentation for how to use Sample-Factory can be found at https://www.samplefactory.dev/
160
+
161
+
162
+ ## Downloading the model
163
+
164
+ After installing Sample-Factory, download the model with:
165
+ ```
166
+ python -m sample_factory.huggingface.load_from_hub -r MattStammers/APPO-atari_robotank
167
+ ```
168
+
169
+
170
+ ## Using the model
171
+
172
+ To run the model after download, use the `enjoy` script corresponding to this environment:
173
+ ```
174
+ python -m sf_examples.atari.enjoy_atari --algo=APPO --env=atari_robotank --train_dir=./train_dir --experiment=APPO-atari_robotank
175
+ ```
176
+
177
+
178
+ You can also upload models to the Hugging Face Hub using the same script with the `--push_to_hub` flag.
179
+ See https://www.samplefactory.dev/10-huggingface/huggingface/ for more details
180
+
181
+ ## Training with this model
182
+
183
+ To continue training with this model, use the `train` script corresponding to this environment:
184
+ ```
185
+ python -m sf_examples.atari.train_atari --algo=APPO --env=atari_robotank --train_dir=./train_dir --experiment=APPO-atari_robotank --restart_behavior=resume --train_for_env_steps=10000000000
186
+ ```
187
+
188
+ Note, you may have to adjust `--train_for_env_steps` to a suitably high number as the experiment will resume at the number of steps it concluded at.
189
+
checkpoint_p0/best_001559680_399278080_reward_14.320.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d51e975b5df4b94b206264b87b79f1246dc69320ef9d73017919ceb7c17fe6a8
3
+ size 20795763
checkpoint_p0/checkpoint_001953056_499982336.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a489b06c470db138a2674509d23b38cf3fc2b87489a21922f8275427e05cab6b
3
+ size 20796099
checkpoint_p0/checkpoint_001953120_500006912.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:997c90a71ce6397857331bb6dbba216abda95118e8f0a5163fc8e08ebb1f6f5e
3
+ size 20796099
checkpoint_p0/milestones/checkpoint_000011104_2842624.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a9f3e59db1c1dbc9738e46f75779c25385d8053e6777544e975a90fe6800cca0
3
+ size 20796955
checkpoint_p0/milestones/checkpoint_000022464_5750784.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7bdf6f27a8892dbb380c132620f0efa50a28f2b2128ea1cfd262512b8c97e60c
3
+ size 20796955
checkpoint_p0/milestones/checkpoint_000033824_8658944.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fd8880402cb3805e30fd8e1d9ad73170425fce1ed0da3d4b94770c1a32041c95
3
+ size 20796955
checkpoint_p0/milestones/checkpoint_000045216_11575296.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8c24bd58314ddb19fa250688d6ef4d201c7efdd0ecb144fffa5d1a5b6540e4ae
3
+ size 20797011
checkpoint_p0/milestones/checkpoint_000056704_14516224.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:df330c013df4b2158c8657cc23018fd13b3e0f757c7bc041f9e50016ef7263cf
3
+ size 20797011
checkpoint_p0/milestones/checkpoint_000068224_17465344.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:82799eb3c27a7a994a9578f257d1c54ee5eaee57bf4bee1afee130053d41200a
3
+ size 20797011
checkpoint_p0/milestones/checkpoint_000079712_20406272.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6592816a520d6990b95249421126adb9ac3458f838cc4b06a4292104a97d92dd
3
+ size 20797011
checkpoint_p0/milestones/checkpoint_000091136_23330816.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8edf1a4bec05a2a3314cdcaf83fda793572d7a61c3d6c764a647b44db4509b0e
3
+ size 20797011
checkpoint_p0/milestones/checkpoint_000102560_26255360.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:92273369e2ff271b12ce1e5343c55ecf934e60c42fb598ed74ff22b9ce104106
3
+ size 20797011
checkpoint_p0/milestones/checkpoint_000113920_29163520.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ff996eecc15f90a8bd7899de592c53357098d3a8bbbec611dbf398f556165436
3
+ size 20797011
checkpoint_p0/milestones/checkpoint_000125312_32079872.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:80002b4db22a46d4e6710899e6f46b04dee84ef3c9a492fe39a6c856a859cdd8
3
+ size 20797011
checkpoint_p0/milestones/checkpoint_000136704_34996224.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:04169e8360e8acb7315d8d1defed61e62c2900c9d7d8949b458d5150d930d49b
3
+ size 20797011
checkpoint_p0/milestones/checkpoint_000148064_37904384.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8e7a9817b44379de04ae9fe6e043efedf7a6c0b9381d7ef836968fa62dc3ec91
3
+ size 20797011
checkpoint_p0/milestones/checkpoint_000159360_40796160.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:db8a2709ee2310e604dcba7a71139404c19c5a70347cbec3f5d753dba805396a
3
+ size 20797011
checkpoint_p0/milestones/checkpoint_000170656_43687936.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:793c7199903c2fcd1b4b92acb22a3a89fc9c276a6169b856d81a0fa9c6d5cb7e
3
+ size 20797011
checkpoint_p0/milestones/checkpoint_000182016_46596096.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9bcdcc90d02639a353acea63d9871f8d1a129b6486ff5742b3907722b6e19170
3
+ size 20797011
checkpoint_p0/milestones/checkpoint_000193376_49504256.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9b16df79c56a33c375cfd63e040037836a6c9a0f2cf0501d34f09a6e4ef3715b
3
+ size 20797011
checkpoint_p0/milestones/checkpoint_000204864_52445184.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cfe3eece94e10bdf7452a9635c3f09e8b004c31541f5428f779482d211e9904d
3
+ size 20797011
checkpoint_p0/milestones/checkpoint_000216416_55402496.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4227e525880422d3818a6a091b9ee4906bac664574af705296d6a27a13a0e733
3
+ size 20797011
checkpoint_p0/milestones/checkpoint_000227872_58335232.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:19e7c0a3fd2ad72cc9aef363083a47957b56705d112208e22949ef6a547554b0
3
+ size 20797011
checkpoint_p0/milestones/checkpoint_000239328_61267968.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5fcfde5bc0993491eecc9e0efe163ceb6af5626748792c8f0c312e34050e5950
3
+ size 20797011
checkpoint_p0/milestones/checkpoint_000250880_64225280.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1bb0ff6b5b5716a654c51a9bd8a42c3b622eaa52a2ca714a3fb933e2a7cf0d8a
3
+ size 20797011
checkpoint_p0/milestones/checkpoint_000262432_67182592.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:12e04808392555744abc34048a2022ea99d88500437fb90b8a2e0bf30cfaaebc
3
+ size 20797011
checkpoint_p0/milestones/checkpoint_000273920_70123520.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f9d2ca5ddd1e4540a59c40dc577730854a4667b25d08c84cf408c90f75c7aa4a
3
+ size 20797011
checkpoint_p0/milestones/checkpoint_000285408_73064448.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:02fba063e73c9421ea753d10165760320178ee89a39470bca221e1a8998f54cb
3
+ size 20797011
checkpoint_p0/milestones/checkpoint_000296896_76005376.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:04d5b39cc7e23f90b1506c2992123e0b4738ece0728ae83025fcccdb38e7560c
3
+ size 20797011
checkpoint_p0/milestones/checkpoint_000308352_78938112.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9710ea6ce9cb9a053d8e71f426e0a35f0bea0461cb4a16ab8e20674f1885be36
3
+ size 20797011
checkpoint_p0/milestones/checkpoint_000319808_81870848.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1a552323ecd7980d8aa3c2feabe093bf2303a4a299bcb9d62fa32488f372415e
3
+ size 20797011
checkpoint_p0/milestones/checkpoint_000331264_84803584.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f092f75d5456eaab8651c041c9e49ec29a41dec718338e11449d02eb1afa590c
3
+ size 20797011
checkpoint_p0/milestones/checkpoint_000342688_87728128.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5987fd680b7e6ce8c9aa9766511472de58a405ce82c5ba60fbde282d91987343
3
+ size 20797011
checkpoint_p0/milestones/checkpoint_000354144_90660864.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2f99f022cb34105cce73e1fe9f5d00be98fa15c4824d4c0fc0ce2e6a4cc032a8
3
+ size 20797011
checkpoint_p0/milestones/checkpoint_000365568_93585408.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:53bc43d2b7f50ffadfcbe1517f49d0528b8403c5a662ef0b1047f0e7f90df961
3
+ size 20797011
checkpoint_p0/milestones/checkpoint_000377088_96534528.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5dc5849c9b0f7e7cfaa11a99b40232ba1f739fd9d908c017c31392a08f83f3d2
3
+ size 20797011
checkpoint_p0/milestones/checkpoint_000388544_99467264.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:18db326bf1be7c133252c77a9e9f046b8397e02fc7422f9f11ef1532718dce23
3
+ size 20797011
checkpoint_p0/milestones/checkpoint_000400000_102400000.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:57e1da769980932a86663ff757390d4d5fe170d5bd0b7b32ba6c7002e9540bed
3
+ size 20797067
checkpoint_p0/milestones/checkpoint_000411488_105340928.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:59c9105e2bf40b2c638548dde6d377e6046d81ef19f5dc6b0088ad712389d3a2
3
+ size 20797067
checkpoint_p0/milestones/checkpoint_000422592_108183552.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d21a5fc5477cfdf88088d1efc64049db0026c054680c2ea72af3a2400481d817
3
+ size 20797067
checkpoint_p0/milestones/checkpoint_000434048_111116288.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3b91274b5225d93570fff8cbac768857727aeab383bde1506a9b0cfa71feb136
3
+ size 20797067
checkpoint_p0/milestones/checkpoint_000445440_114032640.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:253de8a52041191076f224e75fb9094d47cf96227f3eddf26e011902fe5928a0
3
+ size 20797067
checkpoint_p0/milestones/checkpoint_000456896_116965376.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:de6aa6736e61814944fac75281fd165a2221a1b062097452e8317fdeafdc59e3
3
+ size 20797067
checkpoint_p0/milestones/checkpoint_000468384_119906304.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4ffb44a6a0d69593014125eb484299b2748e9acfb3c3f045dce7f9d6b33066c1
3
+ size 20797067
checkpoint_p0/milestones/checkpoint_000479872_122847232.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cf73216dc045481f937ffe1db18191bd5c29aa9ac067450f8631ce80e4dd38a8
3
+ size 20797067
checkpoint_p0/milestones/checkpoint_000491424_125804544.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0b3847da08fc7e2f10a79cc6723262552baa92b50b954ef18aea1458f35c49c5
3
+ size 20797067