Hugging Face's logo

MattStammers
/
appo-mujoco_ant-sota

Reinforcement Learning
sample-factory
TensorBoard
deep-reinforcement-learning
Eval Results
Model card Files Metrics Community
MattStammers commited on
Commit
562256a
•
1 Parent(s): 5879cae

Upload folder using huggingface_hub

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. .gitattributes +2 -0
  2. .summary/0/events.out.tfevents.1703276740.rhmmedcatt-proliant-ml350-gen10 +3 -0
  3. .summary/1/events.out.tfevents.1703276740.rhmmedcatt-proliant-ml350-gen10 +3 -0
  4. README.md +189 -0
  5. checkpoint_p0/best_001949104_498974720_reward_7943.189.pth +3 -0
  6. checkpoint_p0/checkpoint_001953152_500023296.pth +3 -0
  7. checkpoint_p0/checkpoint_001953168_500031488.pth +3 -0
  8. checkpoint_p0/milestones/checkpoint_000032928_8429568.pth +3 -0
  9. checkpoint_p0/milestones/checkpoint_000066656_17063936.pth +3 -0
  10. checkpoint_p0/milestones/checkpoint_000100320_25681920.pth +3 -0
  11. checkpoint_p0/milestones/checkpoint_000133792_34250752.pth +3 -0
  12. checkpoint_p0/milestones/checkpoint_000166848_42713088.pth +3 -0
  13. checkpoint_p0/milestones/checkpoint_000199840_51159040.pth +3 -0
  14. checkpoint_p0/milestones/checkpoint_000233184_59695104.pth +3 -0
  15. checkpoint_p0/milestones/checkpoint_000266592_68247552.pth +3 -0
  16. checkpoint_p0/milestones/checkpoint_000300000_76800000.pth +3 -0
  17. checkpoint_p0/milestones/checkpoint_000333632_85409792.pth +3 -0
  18. checkpoint_p0/milestones/checkpoint_000366496_93822976.pth +3 -0
  19. checkpoint_p0/milestones/checkpoint_000399552_102285312.pth +3 -0
  20. checkpoint_p0/milestones/checkpoint_000433120_110878720.pth +3 -0
  21. checkpoint_p0/milestones/checkpoint_000466688_119472128.pth +3 -0
  22. checkpoint_p0/milestones/checkpoint_000500192_128049152.pth +3 -0
  23. checkpoint_p0/milestones/checkpoint_000533568_136593408.pth +3 -0
  24. checkpoint_p0/milestones/checkpoint_000567008_145154048.pth +3 -0
  25. checkpoint_p0/milestones/checkpoint_000600256_153665536.pth +3 -0
  26. checkpoint_p0/milestones/checkpoint_000633696_162226176.pth +3 -0
  27. checkpoint_p0/milestones/checkpoint_000667136_170786816.pth +3 -0
  28. checkpoint_p0/milestones/checkpoint_000700672_179372032.pth +3 -0
  29. checkpoint_p0/milestones/checkpoint_000734080_187924480.pth +3 -0
  30. checkpoint_p0/milestones/checkpoint_000767552_196493312.pth +3 -0
  31. checkpoint_p0/milestones/checkpoint_000801024_205062144.pth +3 -0
  32. checkpoint_p0/milestones/checkpoint_000834400_213606400.pth +3 -0
  33. checkpoint_p0/milestones/checkpoint_000867744_222142464.pth +3 -0
  34. checkpoint_p0/milestones/checkpoint_000901280_230727680.pth +3 -0
  35. checkpoint_p0/milestones/checkpoint_000934560_239247360.pth +3 -0
  36. checkpoint_p0/milestones/checkpoint_000967824_247767040.pth +3 -0
  37. checkpoint_p0/milestones/checkpoint_001001168_256303104.pth +3 -0
  38. checkpoint_p0/milestones/checkpoint_001034576_264855552.pth +3 -0
  39. checkpoint_p0/milestones/checkpoint_001068080_273432576.pth +3 -0
  40. checkpoint_p0/milestones/checkpoint_001101392_281960448.pth +3 -0
  41. checkpoint_p0/milestones/checkpoint_001134864_290529280.pth +3 -0
  42. checkpoint_p0/milestones/checkpoint_001168240_299073536.pth +3 -0
  43. checkpoint_p0/milestones/checkpoint_001201424_307568640.pth +3 -0
  44. checkpoint_p0/milestones/checkpoint_001234992_316162048.pth +3 -0
  45. checkpoint_p0/milestones/checkpoint_001268432_324722688.pth +3 -0
  46. checkpoint_p0/milestones/checkpoint_001301968_333307904.pth +3 -0
  47. checkpoint_p0/milestones/checkpoint_001335184_341811200.pth +3 -0
  48. checkpoint_p0/milestones/checkpoint_001368336_350298112.pth +3 -0
  49. checkpoint_p0/milestones/checkpoint_001401552_358801408.pth +3 -0
  50. checkpoint_p0/milestones/checkpoint_001435024_367370240.pth +3 -0
.gitattributes CHANGED
@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ replay.mp4 filter=lfs diff=lfs merge=lfs -text
37
+ sf_log.txt filter=lfs diff=lfs merge=lfs -text
.summary/0/events.out.tfevents.1703276740.rhmmedcatt-proliant-ml350-gen10 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a2526a537882ed0ffe67909e3505d584f6416bd2cde29f5cf86efb7d51df71c0
3
+ size 30891908
.summary/1/events.out.tfevents.1703276740.rhmmedcatt-proliant-ml350-gen10 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4cc20922fa5a59efbb85f84b27d76f520ed3e05e774a6a29dec8ca2af1bee66e
3
+ size 14553916
README.md ADDED
@@ -0,0 +1,189 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: sample-factory
3
+ tags:
4
+ - deep-reinforcement-learning
5
+ - reinforcement-learning
6
+ - sample-factory
7
+ model-index:
8
+ - name: APPO
9
+ results:
10
+ - task:
11
+ type: reinforcement-learning
12
+ name: reinforcement-learning
13
+ dataset:
14
+ name: mujoco_ant
15
+ type: mujoco_ant
16
+ metrics:
17
+ - type: mean_reward
18
+ value: 7905.90 +/- 132.04
19
+ name: mean_reward
20
+ verified: false
21
+ ---
22
+
23
+ ## About the Project
24
+
25
+ This project is an attempt to maximise performance of high sample throughput APPO RL models in Atari environments in as carbon efficient a manner as possible using a single, not particularly high performance single machine. It is about demonstrating the generalisability of on-policy algorithms to create good performance quickly (by sacrificing sample efficiency) while also proving that this route to RL production is accessible to even hobbyists like me (I am a gastroenterologist not a computer scientist).
26
+
27
+ In terms of throughput I am managing to reach throughputs of 2,500 - 3,000 across both policies using sample factory using two Quadro P2200's (not particularly powerful GPUs) each loaded up about 60% (3GB). Previously using the stable baselines 3 (sb3) implementation of PPO it would take about a week to train an atari agent to 100 million timesteps synchronously. By comparison the sample factory async implementation takes only just over 2 hours to achieve the same result. That is about 84 times faster with only typically a 21 watt burn per GPU. I am thus very grateful to Alex Petrenko and all the sample factory team for their work on this.
28
+
29
+ ## Project Aims
30
+
31
+ This model as with all the others in the benchmarks was trained initially asynchronously un-seeded to 10 million steps for the purposes of setting a sample factory async baseline for this model on this environment but only 3/57 made it anywhere near sota performance.
32
+
33
+ I then re-trained the models with 100 million timesteps- at this point 2 environments maxed out at sota performance (Pong and Freeway) with four approaching sota performance - (atlantis, boxing, tennis and fishingderby.) =6/57 near sota.
34
+
35
+ The aim now is to try and reach state-of-the-art (SOTA) performance on a further block of atari environments using up to 1 billion training timesteps initially with appo. I will flag the models with SOTA when they reach at or near these levels.
36
+
37
+ After this I will switch on V-Trace to see if the Impala variations perform any better with the same seed (I have seeded '1234')
38
+
39
+
40
+ ## About the Model
41
+
42
+ The hyperparameters used in the model are described in my shell script on my fork of sample-factory: https://github.com/MattStammers/sample-factory. Given that https://huggingface.co/edbeeching has kindly shared his parameters, I saved time and energy by using many of his tuned hyperparameters to reduce carbon inefficiency:
43
+ ```
44
+ hyperparameters = {
45
+ "help": false,
46
+ "algo": "APPO",
47
+ "env": "atari_asteroid",
48
+ "experiment": "atari_asteroid_APPO",
49
+ "train_dir": "./train_atari",
50
+ "restart_behavior": "restart",
51
+ "device": "gpu",
52
+ "seed": 1234,
53
+ "num_policies": 2,
54
+ "async_rl": true,
55
+ "serial_mode": false,
56
+ "batched_sampling": true,
57
+ "num_batches_to_accumulate": 2,
58
+ "worker_num_splits": 1,
59
+ "policy_workers_per_policy": 1,
60
+ "max_policy_lag": 1000,
61
+ "num_workers": 16,
62
+ "num_envs_per_worker": 2,
63
+ "batch_size": 1024,
64
+ "num_batches_per_epoch": 8,
65
+ "num_epochs": 4,
66
+ "rollout": 128,
67
+ "recurrence": 1,
68
+ "shuffle_minibatches": false,
69
+ "gamma": 0.99,
70
+ "reward_scale": 1.0,
71
+ "reward_clip": 1000.0,
72
+ "value_bootstrap": false,
73
+ "normalize_returns": true,
74
+ "exploration_loss_coeff": 0.0004677351413,
75
+ "value_loss_coeff": 0.5,
76
+ "kl_loss_coeff": 0.0,
77
+ "exploration_loss": "entropy",
78
+ "gae_lambda": 0.95,
79
+ "ppo_clip_ratio": 0.1,
80
+ "ppo_clip_value": 1.0,
81
+ "with_vtrace": true,
82
+ "vtrace_rho": 1.0,
83
+ "vtrace_c": 1.0,
84
+ "optimizer": "adam",
85
+ "adam_eps": 1e-05,
86
+ "adam_beta1": 0.9,
87
+ "adam_beta2": 0.999,
88
+ "max_grad_norm": 0.0,
89
+ "learning_rate": 0.0003033891184,
90
+ "lr_schedule": "linear_decay",
91
+ "lr_schedule_kl_threshold": 0.008,
92
+ "lr_adaptive_min": 1e-06,
93
+ "lr_adaptive_max": 0.01,
94
+ "obs_subtract_mean": 0.0,
95
+ "obs_scale": 255.0,
96
+ "normalize_input": true,
97
+ "normalize_input_keys": [
98
+ "obs"
99
+ ],
100
+ "decorrelate_experience_max_seconds": 0,
101
+ "decorrelate_envs_on_one_worker": true,
102
+ "actor_worker_gpus": [],
103
+ "set_workers_cpu_affinity": true,
104
+ "force_envs_single_thread": false,
105
+ "default_niceness": 0,
106
+ "log_to_file": true,
107
+ "experiment_summaries_interval": 3,
108
+ "flush_summaries_interval": 30,
109
+ "stats_avg": 100,
110
+ "summaries_use_frameskip": true,
111
+ "heartbeat_interval": 10,
112
+ "heartbeat_reporting_interval": 60,
113
+ "train_for_env_steps": 100000000,
114
+ "train_for_seconds": 10000000000,
115
+ "save_every_sec": 120,
116
+ "keep_checkpoints": 2,
117
+ "load_checkpoint_kind": "latest",
118
+ "save_milestones_sec": 1200,
119
+ "save_best_every_sec": 5,
120
+ "save_best_metric": "reward",
121
+ "save_best_after": 100000,
122
+ "benchmark": false,
123
+ "encoder_mlp_layers": [
124
+ 512,
125
+ 512
126
+ ],
127
+ "encoder_conv_architecture": "convnet_atari",
128
+ "encoder_conv_mlp_layers": [
129
+ 512
130
+ ],
131
+ "use_rnn": false,
132
+ "rnn_size": 512,
133
+ "rnn_type": "gru",
134
+ "rnn_num_layers": 1,
135
+ "decoder_mlp_layers": [],
136
+ "nonlinearity": "relu",
137
+ "policy_initialization": "orthogonal",
138
+ "policy_init_gain": 1.0,
139
+ "actor_critic_share_weights": true,
140
+ "adaptive_stddev": false,
141
+ "continuous_tanh_scale": 0.0,
142
+ "initial_stddev": 1.0,
143
+ "use_env_info_cache": false,
144
+ "env_gpu_actions": false,
145
+ "env_gpu_observations": true,
146
+ "env_frameskip": 4,
147
+ "env_framestack": 4,
148
+ "pixel_format": "CHW"
149
+ }
150
+
151
+ ```
152
+
153
+
154
+
155
+ A(n) **APPO** impala model trained on the **mujoco_ant** environment.
156
+
157
+ This model was trained using Sample-Factory 2.0: https://github.com/alex-petrenko/sample-factory. Sample factory is a
158
+ high throughput on-policy RL framework. I have been using
159
+ Documentation for how to use Sample-Factory can be found at https://www.samplefactory.dev/
160
+
161
+
162
+ ## Downloading the model
163
+
164
+ After installing Sample-Factory, download the model with:
165
+ ```
166
+ python -m sample_factory.huggingface.load_from_hub -r MattStammers/APPO-mujoco_ant
167
+ ```
168
+
169
+
170
+ ## Using the model
171
+
172
+ To run the model after download, use the `enjoy` script corresponding to this environment:
173
+ ```
174
+ python -m sf_examples.mujoco.enjoy_mujoco --algo=APPO --env=mujoco_ant --train_dir=./train_dir --experiment=APPO-mujoco_ant
175
+ ```
176
+
177
+
178
+ You can also upload models to the Hugging Face Hub using the same script with the `--push_to_hub` flag.
179
+ See https://www.samplefactory.dev/10-huggingface/huggingface/ for more details
180
+
181
+ ## Training with this model
182
+
183
+ To continue training with this model, use the `train` script corresponding to this environment:
184
+ ```
185
+ python -m sf_examples.mujoco.train_mujoco --algo=APPO --env=mujoco_ant --train_dir=./train_dir --experiment=APPO-mujoco_ant --restart_behavior=resume --train_for_env_steps=10000000000
186
+ ```
187
+
188
+ Note, you may have to adjust `--train_for_env_steps` to a suitably high number as the experiment will resume at the number of steps it concluded at.
189
+
checkpoint_p0/best_001949104_498974720_reward_7943.189.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:62a26d60fa8c7a1f01617ca6e03c123ecf345d3935e81fa9f8a32c7e0b92d74f
3
+ size 92415
checkpoint_p0/checkpoint_001953152_500023296.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6d60aba085cac676aca89252065decb4a726196aa34f05ddb233595464ee99ba
3
+ size 92679
checkpoint_p0/checkpoint_001953168_500031488.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2117ee782713737256c0628e31e577c3bec1acf884a3d874a6b4e282dea0c2ef
3
+ size 92679
checkpoint_p0/milestones/checkpoint_000032928_8429568.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7e026a8e86f6c558f42ba747b6df6f226d8b970abe3690f2b02336376f6c074f
3
+ size 93315
checkpoint_p0/milestones/checkpoint_000066656_17063936.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:40dae71f8444530d1ae9e7ae70d1c1c605796d3178df11bcc42fb64ef7ecc244
3
+ size 93359
checkpoint_p0/milestones/checkpoint_000100320_25681920.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5cd64474259cf80518b0a909bc085d20dff976616253e68dd4dc84aefdd0891e
3
+ size 93359
checkpoint_p0/milestones/checkpoint_000133792_34250752.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2f620cdbe5f46a256f1d217656b566e69b3f31b97d85ccf9b41f42d163875aff
3
+ size 93359
checkpoint_p0/milestones/checkpoint_000166848_42713088.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:db4e7b8087c6e4c90b4985418dbb0f6d06f6742f609654b62dfd01797c4da57b
3
+ size 93359
checkpoint_p0/milestones/checkpoint_000199840_51159040.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9f38bbde927e48d8dca4c857e9b05a634c62f0ef4c3266342635f7107e6b152b
3
+ size 93359
checkpoint_p0/milestones/checkpoint_000233184_59695104.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6c7cd4d3f42532192ae489fbe969aaba4f7711ba6407d791ff7042541acdb22e
3
+ size 93359
checkpoint_p0/milestones/checkpoint_000266592_68247552.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c715aa9a950b149a9d86a92042b3abb94d63144de9cb5808135821b6da2ef682
3
+ size 93359
checkpoint_p0/milestones/checkpoint_000300000_76800000.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:86f86e653753e547f3ddce94cb85cf8ecb6e6f3f68e31b1f7f7fd3627fddeb77
3
+ size 93359
checkpoint_p0/milestones/checkpoint_000333632_85409792.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5258b5b60706a43fd237c09569088f1d5bfb1260caee8df4c0c06f16c3392e71
3
+ size 93359
checkpoint_p0/milestones/checkpoint_000366496_93822976.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0ec5c4674ee27a93d7bad41d36f7f64b1b4ce6a0684856a15a43f84c41ee60d5
3
+ size 93359
checkpoint_p0/milestones/checkpoint_000399552_102285312.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:206dd97d6e8e2d497f2db57fb36d3ce137528f33328cafb31d8c9113b4f59f08
3
+ size 93403
checkpoint_p0/milestones/checkpoint_000433120_110878720.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:15682dea7a8bd1fb1e1ef0a25939d748dd65ff128805b9ae2c51209abd4d99db
3
+ size 93403
checkpoint_p0/milestones/checkpoint_000466688_119472128.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:567fa1c5b3a23496e7f60e828575c9d6092f9eb2d706b14156746a15afb2839d
3
+ size 93403
checkpoint_p0/milestones/checkpoint_000500192_128049152.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fe072944d7ac5071da1219b57a43e833549dd835dd1029f2e4c6a8ab26738aaa
3
+ size 93403
checkpoint_p0/milestones/checkpoint_000533568_136593408.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9557fc6431a841e3a5b76d4ab04728d2ff0f3394c3605d1315787dc292326e3d
3
+ size 93403
checkpoint_p0/milestones/checkpoint_000567008_145154048.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:80ced8540d5263265e368703d0ecab85ea586147cfdbd229151b7ed8ab1ed6d3
3
+ size 93403
checkpoint_p0/milestones/checkpoint_000600256_153665536.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eddec2f4eac42ae263e87584e62232599d4e924af2810f1252b1520078d7f288
3
+ size 93403
checkpoint_p0/milestones/checkpoint_000633696_162226176.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7d9230cd121317b6e5e66ee7068bfbc3a32bb8a21459d0a63a251813382d1574
3
+ size 93403
checkpoint_p0/milestones/checkpoint_000667136_170786816.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7f35d90e493d3eb93a6acdd75ee6ffc4b02cd015f7002443c7b37b15a6cb1b02
3
+ size 93403
checkpoint_p0/milestones/checkpoint_000700672_179372032.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:78cc788faac8e8feae9f58995266a41d9ccfebe4b4739cb1b878d19d4db27d46
3
+ size 93403
checkpoint_p0/milestones/checkpoint_000734080_187924480.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f2ca16e4fa0c35a4e4e1dd61e8a4259f1bdf4283bc334c6d1e0612f2a7134733
3
+ size 93403
checkpoint_p0/milestones/checkpoint_000767552_196493312.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d09f062facd9d5a8b8666b0a6b0e51ad80ef35e175ff509839726fdb755efb86
3
+ size 93403
checkpoint_p0/milestones/checkpoint_000801024_205062144.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3f94104adb7b82394a704a2fd9f915a67e7d05aeb63c6dd93a30ae81f3c8e601
3
+ size 93403
checkpoint_p0/milestones/checkpoint_000834400_213606400.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ecb85cc80bee9ab017c2164ed776125028cfbbf9a7841a686807bc2a3e67f6bf
3
+ size 93403
checkpoint_p0/milestones/checkpoint_000867744_222142464.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e3f0f0fd9ff54e1c7cbedbc28f184d815528b9584aa378a763e79094e7d8de88
3
+ size 93403
checkpoint_p0/milestones/checkpoint_000901280_230727680.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:17defe2e6883e5bf984bd77a638227c2023554c87a295b73a8e531fe9df493e7
3
+ size 93403
checkpoint_p0/milestones/checkpoint_000934560_239247360.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:109add17db028dfab7e76f0f12998fdd22957a0e19f18105a69961effc3af3f8
3
+ size 93403
checkpoint_p0/milestones/checkpoint_000967824_247767040.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b635e7b45d406a3af1c79cbc486de7e8025f18c579873a148cf3d3cde391b4cd
3
+ size 93403
checkpoint_p0/milestones/checkpoint_001001168_256303104.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:360eab9f913a00402aeea8ba74e3b6b5806f8bc07b3cba45775d4eb11c8f32c1
3
+ size 93403
checkpoint_p0/milestones/checkpoint_001034576_264855552.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9c299a2a8436fdee3f48b964d2576f6f44bfb79eea92049c3d103bc0f7cb92a4
3
+ size 93403
checkpoint_p0/milestones/checkpoint_001068080_273432576.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b896fc502e0d9be5837f224ec45152b8c70a7aa0bda52bc2138d387fd1731c78
3
+ size 93403
checkpoint_p0/milestones/checkpoint_001101392_281960448.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:71937b10db01a03956c25b2d9c610bd14209fabcc94653f49e22424b015e164c
3
+ size 93403
checkpoint_p0/milestones/checkpoint_001134864_290529280.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:41052333657b1e1158386b182bb97c14f3d2b84091ca006051010d9aae28cae8
3
+ size 93403
checkpoint_p0/milestones/checkpoint_001168240_299073536.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bed2b0cabe622497f0fc81fe4c0100dfe8c3166333d5db8058de6cfd630da2bd
3
+ size 93403
checkpoint_p0/milestones/checkpoint_001201424_307568640.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bc44e9a10e4dfdf0e0cf378105979a8040cd316fd4d2999120d7ea002305bc03
3
+ size 93403
checkpoint_p0/milestones/checkpoint_001234992_316162048.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b0b85d484b57496308d04066aaaa048eff7f3d694b3cc1d853ac52aa132400ec
3
+ size 93403
checkpoint_p0/milestones/checkpoint_001268432_324722688.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3c06eefc86cb6f10b072d88c2a9378e9118df78ae18a49bd74a4554381e730d0
3
+ size 93403
checkpoint_p0/milestones/checkpoint_001301968_333307904.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:657b182381cc8a039d5f263df983a48e35ac73e09da0703f9503ce7c233d49e3
3
+ size 93403
checkpoint_p0/milestones/checkpoint_001335184_341811200.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:051183ac48d3f0dd8fae872b5873500793d2214ff300068cae35520380e46447
3
+ size 93403
checkpoint_p0/milestones/checkpoint_001368336_350298112.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:234ede4f5e7d3d7014857c79c963f11f0ae906bf27e3a01e08655a12b0794061
3
+ size 93403
checkpoint_p0/milestones/checkpoint_001401552_358801408.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:57f70df78f08d6a98df7bfdb181aae30aad999368f2caad570891ba766b9bf17
3
+ size 93403
checkpoint_p0/milestones/checkpoint_001435024_367370240.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:41b6fee9d3a953715a0773ee61ae12c06514ad43cad1bb61cd1d8cc8a796c808
3
+ size 93403