Hugging Face's logo

MattStammers
/
appo-mujoco_swimmer

Reinforcement Learning
sample-factory
TensorBoard
deep-reinforcement-learning
Eval Results
Model card Files Metrics Community
MattStammers commited on
Commit
4e7be38
•
1 Parent(s): 2e79abe

Upload folder using huggingface_hub

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. .gitattributes +2 -0
  2. .summary/0/events.out.tfevents.1703755124.rhmmedcatt-proliant-ml350-gen10 +3 -0
  3. .summary/1/events.out.tfevents.1703755124.rhmmedcatt-proliant-ml350-gen10 +3 -0
  4. README.md +189 -0
  5. checkpoint_p0/best_001775432_454574080_reward_119.028.pth +3 -0
  6. checkpoint_p0/checkpoint_001952552_499916800.pth +3 -0
  7. checkpoint_p0/checkpoint_001952904_500006912.pth +3 -0
  8. checkpoint_p0/milestones/checkpoint_000043744_11198464.pth +3 -0
  9. checkpoint_p0/milestones/checkpoint_000088480_22650880.pth +3 -0
  10. checkpoint_p0/milestones/checkpoint_000132960_34037760.pth +3 -0
  11. checkpoint_p0/milestones/checkpoint_000177304_45391872.pth +3 -0
  12. checkpoint_p0/milestones/checkpoint_000221936_56819712.pth +3 -0
  13. checkpoint_p0/milestones/checkpoint_000266656_68272128.pth +3 -0
  14. checkpoint_p0/milestones/checkpoint_000311440_79740928.pth +3 -0
  15. checkpoint_p0/milestones/checkpoint_000356296_91226112.pth +3 -0
  16. checkpoint_p0/milestones/checkpoint_000400936_102662144.pth +3 -0
  17. checkpoint_p0/milestones/checkpoint_000444704_113868800.pth +3 -0
  18. checkpoint_p0/milestones/checkpoint_000489376_125304832.pth +3 -0
  19. checkpoint_p0/milestones/checkpoint_000533952_136716288.pth +3 -0
  20. checkpoint_p0/milestones/checkpoint_000578624_148152320.pth +3 -0
  21. checkpoint_p0/milestones/checkpoint_000623120_159547392.pth +3 -0
  22. checkpoint_p0/milestones/checkpoint_000667760_170983424.pth +3 -0
  23. checkpoint_p0/milestones/checkpoint_000712456_182427648.pth +3 -0
  24. checkpoint_p0/milestones/checkpoint_000756960_193822720.pth +3 -0
  25. checkpoint_p0/milestones/checkpoint_000801792_205299712.pth +3 -0
  26. checkpoint_p0/milestones/checkpoint_000846208_216670208.pth +3 -0
  27. checkpoint_p0/milestones/checkpoint_000891264_228204544.pth +3 -0
  28. checkpoint_p0/milestones/checkpoint_000935744_239591424.pth +3 -0
  29. checkpoint_p0/milestones/checkpoint_000980280_250994688.pth +3 -0
  30. checkpoint_p0/milestones/checkpoint_001024984_262438912.pth +3 -0
  31. checkpoint_p0/milestones/checkpoint_001069528_273842176.pth +3 -0
  32. checkpoint_p0/milestones/checkpoint_001114152_285270016.pth +3 -0
  33. checkpoint_p0/milestones/checkpoint_001158440_296607744.pth +3 -0
  34. checkpoint_p0/milestones/checkpoint_001202920_307994624.pth +3 -0
  35. checkpoint_p0/milestones/checkpoint_001247304_319356928.pth +3 -0
  36. checkpoint_p0/milestones/checkpoint_001291880_330768384.pth +3 -0
  37. checkpoint_p0/milestones/checkpoint_001336392_342163456.pth +3 -0
  38. checkpoint_p0/milestones/checkpoint_001380776_353525760.pth +3 -0
  39. checkpoint_p0/milestones/checkpoint_001424808_364797952.pth +3 -0
  40. checkpoint_p0/milestones/checkpoint_001469576_376258560.pth +3 -0
  41. checkpoint_p0/milestones/checkpoint_001514320_387719168.pth +3 -0
  42. checkpoint_p0/milestones/checkpoint_001559008_399163392.pth +3 -0
  43. checkpoint_p0/milestones/checkpoint_001603424_410533888.pth +3 -0
  44. checkpoint_p0/milestones/checkpoint_001647696_421871616.pth +3 -0
  45. checkpoint_p0/milestones/checkpoint_001692112_433242112.pth +3 -0
  46. checkpoint_p0/milestones/checkpoint_001735792_444424192.pth +3 -0
  47. checkpoint_p0/milestones/checkpoint_001779848_455704576.pth +3 -0
  48. checkpoint_p0/milestones/checkpoint_001824680_467181568.pth +3 -0
  49. checkpoint_p0/milestones/checkpoint_001869352_478617600.pth +3 -0
  50. checkpoint_p0/milestones/checkpoint_001914056_490061824.pth +3 -0
.gitattributes CHANGED
@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ replay.mp4 filter=lfs diff=lfs merge=lfs -text
37
+ sf_log.txt filter=lfs diff=lfs merge=lfs -text
.summary/0/events.out.tfevents.1703755124.rhmmedcatt-proliant-ml350-gen10 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:74f02f46479b9e1dd6cbdad621d69c936a3b9eb96c984ef24ce8b7e1023f3023
3
+ size 23174171
.summary/1/events.out.tfevents.1703755124.rhmmedcatt-proliant-ml350-gen10 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:393ff4a3bf1f68a898df456c0a0b9e39fe171516791e4a8910d14b0ead718a15
3
+ size 10911137
README.md ADDED
@@ -0,0 +1,189 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: sample-factory
3
+ tags:
4
+ - deep-reinforcement-learning
5
+ - reinforcement-learning
6
+ - sample-factory
7
+ model-index:
8
+ - name: APPO
9
+ results:
10
+ - task:
11
+ type: reinforcement-learning
12
+ name: reinforcement-learning
13
+ dataset:
14
+ name: mujoco_swimmer
15
+ type: mujoco_swimmer
16
+ metrics:
17
+ - type: mean_reward
18
+ value: 116.33 +/- 3.77
19
+ name: mean_reward
20
+ verified: false
21
+ ---
22
+
23
+ ## About the Project
24
+
25
+ This project is an attempt to maximise performance of high sample throughput APPO RL models in Atari environments in as carbon efficient a manner as possible using a single, not particularly high performance single machine. It is about demonstrating the generalisability of on-policy algorithms to create good performance quickly (by sacrificing sample efficiency) while also proving that this route to RL production is accessible to even hobbyists like me (I am a gastroenterologist not a computer scientist).
26
+
27
+ In terms of throughput I am managing to reach throughputs of 2,500 - 3,000 across both policies using sample factory using two Quadro P2200's (not particularly powerful GPUs) each loaded up about 60% (3GB). Previously using the stable baselines 3 (sb3) implementation of PPO it would take about a week to train an atari agent to 100 million timesteps synchronously. By comparison the sample factory async implementation takes only just over 2 hours to achieve the same result. That is about 84 times faster with only typically a 21 watt burn per GPU. I am thus very grateful to Alex Petrenko and all the sample factory team for their work on this.
28
+
29
+ ## Project Aims
30
+
31
+ This model as with all the others in the benchmarks was trained initially asynchronously un-seeded to 10 million steps for the purposes of setting a sample factory async baseline for this model on this environment but only 3/57 made it anywhere near sota performance.
32
+
33
+ I then re-trained the models with 100 million timesteps- at this point 2 environments maxed out at sota performance (Pong and Freeway) with four approaching sota performance - (atlantis, boxing, tennis and fishingderby.) =6/57 near sota.
34
+
35
+ The aim now is to try and reach state-of-the-art (SOTA) performance on a further block of atari environments using up to 1 billion training timesteps initially with appo. I will flag the models with SOTA when they reach at or near these levels.
36
+
37
+ After this I will switch on V-Trace to see if the Impala variations perform any better with the same seed (I have seeded '1234')
38
+
39
+
40
+ ## About the Model
41
+
42
+ The hyperparameters used in the model are described in my shell script on my fork of sample-factory: https://github.com/MattStammers/sample-factory. Given that https://huggingface.co/edbeeching has kindly shared his parameters, I saved time and energy by using many of his tuned hyperparameters to reduce carbon inefficiency:
43
+ ```
44
+ hyperparameters = {
45
+ "help": false,
46
+ "algo": "APPO",
47
+ "env": "atari_asteroid",
48
+ "experiment": "atari_asteroid_APPO",
49
+ "train_dir": "./train_atari",
50
+ "restart_behavior": "restart",
51
+ "device": "gpu",
52
+ "seed": 1234,
53
+ "num_policies": 2,
54
+ "async_rl": true,
55
+ "serial_mode": false,
56
+ "batched_sampling": true,
57
+ "num_batches_to_accumulate": 2,
58
+ "worker_num_splits": 1,
59
+ "policy_workers_per_policy": 1,
60
+ "max_policy_lag": 1000,
61
+ "num_workers": 16,
62
+ "num_envs_per_worker": 2,
63
+ "batch_size": 1024,
64
+ "num_batches_per_epoch": 8,
65
+ "num_epochs": 4,
66
+ "rollout": 128,
67
+ "recurrence": 1,
68
+ "shuffle_minibatches": false,
69
+ "gamma": 0.99,
70
+ "reward_scale": 1.0,
71
+ "reward_clip": 1000.0,
72
+ "value_bootstrap": false,
73
+ "normalize_returns": true,
74
+ "exploration_loss_coeff": 0.0004677351413,
75
+ "value_loss_coeff": 0.5,
76
+ "kl_loss_coeff": 0.0,
77
+ "exploration_loss": "entropy",
78
+ "gae_lambda": 0.95,
79
+ "ppo_clip_ratio": 0.1,
80
+ "ppo_clip_value": 1.0,
81
+ "with_vtrace": true,
82
+ "vtrace_rho": 1.0,
83
+ "vtrace_c": 1.0,
84
+ "optimizer": "adam",
85
+ "adam_eps": 1e-05,
86
+ "adam_beta1": 0.9,
87
+ "adam_beta2": 0.999,
88
+ "max_grad_norm": 0.0,
89
+ "learning_rate": 0.0003033891184,
90
+ "lr_schedule": "linear_decay",
91
+ "lr_schedule_kl_threshold": 0.008,
92
+ "lr_adaptive_min": 1e-06,
93
+ "lr_adaptive_max": 0.01,
94
+ "obs_subtract_mean": 0.0,
95
+ "obs_scale": 255.0,
96
+ "normalize_input": true,
97
+ "normalize_input_keys": [
98
+ "obs"
99
+ ],
100
+ "decorrelate_experience_max_seconds": 0,
101
+ "decorrelate_envs_on_one_worker": true,
102
+ "actor_worker_gpus": [],
103
+ "set_workers_cpu_affinity": true,
104
+ "force_envs_single_thread": false,
105
+ "default_niceness": 0,
106
+ "log_to_file": true,
107
+ "experiment_summaries_interval": 3,
108
+ "flush_summaries_interval": 30,
109
+ "stats_avg": 100,
110
+ "summaries_use_frameskip": true,
111
+ "heartbeat_interval": 10,
112
+ "heartbeat_reporting_interval": 60,
113
+ "train_for_env_steps": 100000000,
114
+ "train_for_seconds": 10000000000,
115
+ "save_every_sec": 120,
116
+ "keep_checkpoints": 2,
117
+ "load_checkpoint_kind": "latest",
118
+ "save_milestones_sec": 1200,
119
+ "save_best_every_sec": 5,
120
+ "save_best_metric": "reward",
121
+ "save_best_after": 100000,
122
+ "benchmark": false,
123
+ "encoder_mlp_layers": [
124
+ 512,
125
+ 512
126
+ ],
127
+ "encoder_conv_architecture": "convnet_atari",
128
+ "encoder_conv_mlp_layers": [
129
+ 512
130
+ ],
131
+ "use_rnn": false,
132
+ "rnn_size": 512,
133
+ "rnn_type": "gru",
134
+ "rnn_num_layers": 1,
135
+ "decoder_mlp_layers": [],
136
+ "nonlinearity": "relu",
137
+ "policy_initialization": "orthogonal",
138
+ "policy_init_gain": 1.0,
139
+ "actor_critic_share_weights": true,
140
+ "adaptive_stddev": false,
141
+ "continuous_tanh_scale": 0.0,
142
+ "initial_stddev": 1.0,
143
+ "use_env_info_cache": false,
144
+ "env_gpu_actions": false,
145
+ "env_gpu_observations": true,
146
+ "env_frameskip": 4,
147
+ "env_framestack": 4,
148
+ "pixel_format": "CHW"
149
+ }
150
+
151
+ ```
152
+
153
+
154
+
155
+ A(n) **APPO** impala model trained on the **mujoco_swimmer** environment.
156
+
157
+ This model was trained using Sample-Factory 2.0: https://github.com/alex-petrenko/sample-factory. Sample factory is a
158
+ high throughput on-policy RL framework. I have been using
159
+ Documentation for how to use Sample-Factory can be found at https://www.samplefactory.dev/
160
+
161
+
162
+ ## Downloading the model
163
+
164
+ After installing Sample-Factory, download the model with:
165
+ ```
166
+ python -m sample_factory.huggingface.load_from_hub -r MattStammers/APPO-mujoco_swimmer
167
+ ```
168
+
169
+
170
+ ## Using the model
171
+
172
+ To run the model after download, use the `enjoy` script corresponding to this environment:
173
+ ```
174
+ python -m sf_examples.mujoco.enjoy_mujoco --algo=APPO --env=mujoco_swimmer --train_dir=./train_dir --experiment=APPO-mujoco_swimmer
175
+ ```
176
+
177
+
178
+ You can also upload models to the Hugging Face Hub using the same script with the `--push_to_hub` flag.
179
+ See https://www.samplefactory.dev/10-huggingface/huggingface/ for more details
180
+
181
+ ## Training with this model
182
+
183
+ To continue training with this model, use the `train` script corresponding to this environment:
184
+ ```
185
+ python -m sf_examples.mujoco.train_mujoco --algo=APPO --env=mujoco_swimmer --train_dir=./train_dir --experiment=APPO-mujoco_swimmer --restart_behavior=resume --train_for_env_steps=10000000000
186
+ ```
187
+
188
+ Note, you may have to adjust `--train_for_env_steps` to a suitably high number as the experiment will resume at the number of steps it concluded at.
189
+
checkpoint_p0/best_001775432_454574080_reward_119.028.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:606fafc18e0f949a81899b36c98bd5ff03683a576d2ff3e656986dfc7a874357
3
+ size 72959
checkpoint_p0/checkpoint_001952552_499916800.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:092da73174b8e2c5bd4efd75f6efa99281a5e27ab749ce19bfc84277455f6741
3
+ size 73223
checkpoint_p0/checkpoint_001952904_500006912.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:01b96c7ba9c49653579d19b49c7d6847ebe65134f9dafcdf41699a5381d7236b
3
+ size 73223
checkpoint_p0/milestones/checkpoint_000043744_11198464.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:14417cb09134d13f8b3cccb103b8eece62e1ec6b1b44ef0ffe8778567692fd14
3
+ size 73903
checkpoint_p0/milestones/checkpoint_000088480_22650880.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e72de685fdc2b01431e69471134c8f64613a850754664c53786b5c18f7015214
3
+ size 73903
checkpoint_p0/milestones/checkpoint_000132960_34037760.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5338fe8a9324cea53050171bc320dfe81227378ba8d3388d103d0db2a4d1b686
3
+ size 73903
checkpoint_p0/milestones/checkpoint_000177304_45391872.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:50993d494c57e2111d4f75764213a2d6ce2889b685c48001075b744dfa8677b6
3
+ size 73903
checkpoint_p0/milestones/checkpoint_000221936_56819712.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8efe425ef1da14680b8360f2b7f79419e59a984ce93a49f2417c6c908e437967
3
+ size 73903
checkpoint_p0/milestones/checkpoint_000266656_68272128.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4a11bd45072866105192a93d6a971736e4a5c2548ba6f5fd1d3875e686e0596c
3
+ size 73903
checkpoint_p0/milestones/checkpoint_000311440_79740928.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:43b415881b48e16ddc114a6c9e53b0ef725e0f3e5e91193cbb1647a42fe0d66f
3
+ size 73903
checkpoint_p0/milestones/checkpoint_000356296_91226112.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c947cf0fd7ed0407aac0f5c63729dcf7c99d2ed9af10870d392b389db4362104
3
+ size 73903
checkpoint_p0/milestones/checkpoint_000400936_102662144.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:05f7e7b3ce3cafd37ec0c2449d9bed8cb3e6ed2ac2aaa9a66e0fe6d2b240129c
3
+ size 73947
checkpoint_p0/milestones/checkpoint_000444704_113868800.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4867d466da5a205476ee19141eba26510abfc0e7840043bf31a6f1cd17359469
3
+ size 73947
checkpoint_p0/milestones/checkpoint_000489376_125304832.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c7ce7f647bc9230d0866790bf243feaacfb90f0aa7c091a0674413a20b12d6e7
3
+ size 73947
checkpoint_p0/milestones/checkpoint_000533952_136716288.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7542cf0bc8244f78e17dc772f389d4004b8c63c95bc638d874a2edcfee1331b6
3
+ size 73947
checkpoint_p0/milestones/checkpoint_000578624_148152320.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:df7501a0472c47ca51b19cb7acd821651bc73d5281c0417f1ba09059137942de
3
+ size 73947
checkpoint_p0/milestones/checkpoint_000623120_159547392.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1b7f32576b2e1457c783109f76fccf099c81a861fc949ae452beba7d2c10cc18
3
+ size 73947
checkpoint_p0/milestones/checkpoint_000667760_170983424.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c00b81c37990602726af7487cb35256910dca78dcd9c882bfd9e0b7632248b5b
3
+ size 73947
checkpoint_p0/milestones/checkpoint_000712456_182427648.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:123a33e10df017859b730d1ff3232430d916fe4a709113ff31ca9cca8cc0ce52
3
+ size 73947
checkpoint_p0/milestones/checkpoint_000756960_193822720.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b2137e563d95b9bb57dcc5780ca625dbe682373fc90f8e12f0e2bea6a28b09a7
3
+ size 73947
checkpoint_p0/milestones/checkpoint_000801792_205299712.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a27e4e1634049806f27440a4d32edc47545ace1fa0db3d57ca47b55fb37c9607
3
+ size 73947
checkpoint_p0/milestones/checkpoint_000846208_216670208.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f707c65afaddcc5875d1d2d3b885e37e942c7a02205ed55a9d2c46982ec12e2e
3
+ size 73947
checkpoint_p0/milestones/checkpoint_000891264_228204544.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a8d1e35e5e6098535e07643ad01123a17720f3a3eff4a079debc415aa5f277eb
3
+ size 73947
checkpoint_p0/milestones/checkpoint_000935744_239591424.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c32d84cfe3663d71491ca0170ec834f51014f05c8a1ec8541fd6f226657b4153
3
+ size 73947
checkpoint_p0/milestones/checkpoint_000980280_250994688.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1a87e52095e4f42faa0cf5e0877c280f8dcc12a427db2f01e44f67b1059a66cb
3
+ size 73947
checkpoint_p0/milestones/checkpoint_001024984_262438912.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d4eecd9566151585fa48b55533f846c100ee5eddd5dc08504dcb1dfb13e2f681
3
+ size 73947
checkpoint_p0/milestones/checkpoint_001069528_273842176.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9f8bcad7025111a260f659fbd9a1db066c0a70c0f576bd186e53cbace5c94fa1
3
+ size 73947
checkpoint_p0/milestones/checkpoint_001114152_285270016.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:19fd4a0bb6aa11d2f3fdf6b82b0f41a64af73f32bde2250a70716b2d691f7591
3
+ size 73947
checkpoint_p0/milestones/checkpoint_001158440_296607744.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6b551da78ee46359794eca58ed9622a089e23b5847d38dfe4f8f326f0ac8c725
3
+ size 73947
checkpoint_p0/milestones/checkpoint_001202920_307994624.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0b8ea31be658d01d0779f0e8781f4478911a35fbbb78e8006da9d2525d181e5e
3
+ size 73947
checkpoint_p0/milestones/checkpoint_001247304_319356928.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:58c009f730c0db1287c07f8f32e0c0f91655874d3b651f454a5e7d01c1384908
3
+ size 73947
checkpoint_p0/milestones/checkpoint_001291880_330768384.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ae28ab4125f7e8c6e1edda0859cf8314ecf088c6819f79d4735d1422fed540f8
3
+ size 73947
checkpoint_p0/milestones/checkpoint_001336392_342163456.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0131f990d2e7cda126c0888e55fc69543810ba80899ecb9ddc160d1dad6fafd5
3
+ size 73947
checkpoint_p0/milestones/checkpoint_001380776_353525760.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cdb348173a0b59078421022473741db9a93a595b17a0a647d94c8c9121acd13f
3
+ size 73947
checkpoint_p0/milestones/checkpoint_001424808_364797952.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:855f5a079ecc607729998ffa08eb1817ff193bff6ac46ce4d9af2fa14d12e1e3
3
+ size 73947
checkpoint_p0/milestones/checkpoint_001469576_376258560.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:89d8bca987fab5eb598438de3a6e491d06f9342a495644b3cb777c603320bf98
3
+ size 73947
checkpoint_p0/milestones/checkpoint_001514320_387719168.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:edd1a1a743c488d08dade94b9f7e54eecfbf907c96443f8411b7916836a7711c
3
+ size 73947
checkpoint_p0/milestones/checkpoint_001559008_399163392.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1cdf9cd7491da7373e78c9e651d1ba9345dff56a5ba3b9ac9faef2b27902d5f0
3
+ size 73947
checkpoint_p0/milestones/checkpoint_001603424_410533888.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ab78c693cb9ff38dbcc8ab1d47463fbf6de7c0bd830ef944a2fecbec05c8fd7b
3
+ size 73947
checkpoint_p0/milestones/checkpoint_001647696_421871616.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:914a9a1db9bce39d6887b6c98d0613b6a47a666dfa985a7edbbcd9fbc67241ba
3
+ size 73947
checkpoint_p0/milestones/checkpoint_001692112_433242112.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b98db3e7fcae103c5463280490f44299b3943cd96b23b30d076e57f4e3fb00a9
3
+ size 73947
checkpoint_p0/milestones/checkpoint_001735792_444424192.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f3712db4dfea96074145f408aa644eacde9c7f36f225f183c041cf69cac52f7b
3
+ size 73947
checkpoint_p0/milestones/checkpoint_001779848_455704576.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b4735f1bf7bf97ec80db13a60d31d5a3b5aab85560c2a9d2d6d95d5579ed4aa0
3
+ size 73947
checkpoint_p0/milestones/checkpoint_001824680_467181568.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:689dd1633f17cb6595cc4ae142d81cc65c1561e201f850198428bd6fb2bb9a69
3
+ size 73947
checkpoint_p0/milestones/checkpoint_001869352_478617600.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bcc08b912bdbd9b33b22c09961621c2c29a5ed6ea9b9d216eabedd1829eec2dc
3
+ size 73947
checkpoint_p0/milestones/checkpoint_001914056_490061824.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:27d48334e49651437b4351d0d352e7c9ff1bba574441014c1741e29aa5456717
3
+ size 73947