Hugging Face's logo

MattStammers
/
appo-mujoco_walker-sota

Reinforcement Learning
sample-factory
TensorBoard
deep-reinforcement-learning
Eval Results
Model card Files Metrics Community
MattStammers commited on
Commit
4007a53
•
1 Parent(s): de5ab2e

Upload folder using huggingface_hub

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. .gitattributes +2 -0
  2. .summary/0/events.out.tfevents.1703547233.rhmmedcatt-proliant-ml350-gen10 +3 -0
  3. .summary/1/events.out.tfevents.1703547233.rhmmedcatt-proliant-ml350-gen10 +3 -0
  4. README.md +189 -0
  5. checkpoint_p0/best_000377040_96526336_reward_6578.391.pth +3 -0
  6. checkpoint_p0/checkpoint_001959192_503119872.pth +3 -0
  7. checkpoint_p0/checkpoint_001959320_503185408.pth +3 -0
  8. checkpoint_p0/milestones/checkpoint_000040992_10493952.pth +3 -0
  9. checkpoint_p0/milestones/checkpoint_000081536_20873216.pth +3 -0
  10. checkpoint_p0/milestones/checkpoint_000123104_31514624.pth +3 -0
  11. checkpoint_p0/milestones/checkpoint_000164832_42196992.pth +3 -0
  12. checkpoint_p0/milestones/checkpoint_000206352_52830208.pth +3 -0
  13. checkpoint_p0/milestones/checkpoint_000248240_63553536.pth +3 -0
  14. checkpoint_p0/milestones/checkpoint_000289936_74227712.pth +3 -0
  15. checkpoint_p0/milestones/checkpoint_000331632_84901888.pth +3 -0
  16. checkpoint_p0/milestones/checkpoint_000373200_95543296.pth +3 -0
  17. checkpoint_p0/milestones/checkpoint_000414960_106233856.pth +3 -0
  18. checkpoint_p0/milestones/checkpoint_000456528_116875264.pth +3 -0
  19. checkpoint_p0/milestones/checkpoint_000498320_127574016.pth +3 -0
  20. checkpoint_p0/milestones/checkpoint_000540208_138297344.pth +3 -0
  21. checkpoint_p0/milestones/checkpoint_000581776_148938752.pth +3 -0
  22. checkpoint_p0/milestones/checkpoint_000623504_159621120.pth +3 -0
  23. checkpoint_p0/milestones/checkpoint_000665104_170270720.pth +3 -0
  24. checkpoint_p0/milestones/checkpoint_000706576_180887552.pth +3 -0
  25. checkpoint_p0/milestones/checkpoint_000748112_191520768.pth +3 -0
  26. checkpoint_p0/milestones/checkpoint_000790192_202293248.pth +3 -0
  27. checkpoint_p0/milestones/checkpoint_000831888_212967424.pth +3 -0
  28. checkpoint_p0/milestones/checkpoint_000873712_223674368.pth +3 -0
  29. checkpoint_p0/milestones/checkpoint_000915248_234307584.pth +3 -0
  30. checkpoint_p0/milestones/checkpoint_000956976_244989952.pth +3 -0
  31. checkpoint_p0/milestones/checkpoint_000998512_255623168.pth +3 -0
  32. checkpoint_p0/milestones/checkpoint_001040464_266362880.pth +3 -0
  33. checkpoint_p0/milestones/checkpoint_001082160_277037056.pth +3 -0
  34. checkpoint_p0/milestones/checkpoint_001123792_287694848.pth +3 -0
  35. checkpoint_p0/milestones/checkpoint_001165648_298409984.pth +3 -0
  36. checkpoint_p0/milestones/checkpoint_001207472_309116928.pth +3 -0
  37. checkpoint_p0/milestones/checkpoint_001249072_319766528.pth +3 -0
  38. checkpoint_p0/milestones/checkpoint_001291056_330514432.pth +3 -0
  39. checkpoint_p0/milestones/checkpoint_001332656_341164032.pth +3 -0
  40. checkpoint_p0/milestones/checkpoint_001374224_351805440.pth +3 -0
  41. checkpoint_p0/milestones/checkpoint_001415792_362446848.pth +3 -0
  42. checkpoint_p0/milestones/checkpoint_001457424_373104640.pth +3 -0
  43. checkpoint_p0/milestones/checkpoint_001499088_383770624.pth +3 -0
  44. checkpoint_p0/milestones/checkpoint_001540848_394461184.pth +3 -0
  45. checkpoint_p0/milestones/checkpoint_001582576_405143552.pth +3 -0
  46. checkpoint_p0/milestones/checkpoint_001624176_415793152.pth +3 -0
  47. checkpoint_p0/milestones/checkpoint_001666032_426508288.pth +3 -0
  48. checkpoint_p0/milestones/checkpoint_001707760_437190656.pth +3 -0
  49. checkpoint_p0/milestones/checkpoint_001749584_447897600.pth +3 -0
  50. checkpoint_p0/milestones/checkpoint_001791216_458555392.pth +3 -0
.gitattributes CHANGED
@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ replay.mp4 filter=lfs diff=lfs merge=lfs -text
37
+ sf_log.txt filter=lfs diff=lfs merge=lfs -text
.summary/0/events.out.tfevents.1703547233.rhmmedcatt-proliant-ml350-gen10 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:874bf19d4c0e0dff2abbbb1968aebd9f9e29db799ada9dfbbf07bdef4f62fdaf
3
+ size 24921697
.summary/1/events.out.tfevents.1703547233.rhmmedcatt-proliant-ml350-gen10 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3d62c792ed4b14bffd74ffbd8ee2e73f0dcc0ab9e892739689b020b6f0a6b4e2
3
+ size 11744453
README.md ADDED
@@ -0,0 +1,189 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: sample-factory
3
+ tags:
4
+ - deep-reinforcement-learning
5
+ - reinforcement-learning
6
+ - sample-factory
7
+ model-index:
8
+ - name: APPO
9
+ results:
10
+ - task:
11
+ type: reinforcement-learning
12
+ name: reinforcement-learning
13
+ dataset:
14
+ name: mujoco_walker
15
+ type: mujoco_walker
16
+ metrics:
17
+ - type: mean_reward
18
+ value: 6528.47 +/- 89.20
19
+ name: mean_reward
20
+ verified: false
21
+ ---
22
+
23
+ ## About the Project
24
+
25
+ This project is an attempt to maximise performance of high sample throughput APPO RL models in Atari environments in as carbon efficient a manner as possible using a single, not particularly high performance single machine. It is about demonstrating the generalisability of on-policy algorithms to create good performance quickly (by sacrificing sample efficiency) while also proving that this route to RL production is accessible to even hobbyists like me (I am a gastroenterologist not a computer scientist).
26
+
27
+ In terms of throughput I am managing to reach throughputs of 2,500 - 3,000 across both policies using sample factory using two Quadro P2200's (not particularly powerful GPUs) each loaded up about 60% (3GB). Previously using the stable baselines 3 (sb3) implementation of PPO it would take about a week to train an atari agent to 100 million timesteps synchronously. By comparison the sample factory async implementation takes only just over 2 hours to achieve the same result. That is about 84 times faster with only typically a 21 watt burn per GPU. I am thus very grateful to Alex Petrenko and all the sample factory team for their work on this.
28
+
29
+ ## Project Aims
30
+
31
+ This model as with all the others in the benchmarks was trained initially asynchronously un-seeded to 10 million steps for the purposes of setting a sample factory async baseline for this model on this environment but only 3/57 made it anywhere near sota performance.
32
+
33
+ I then re-trained the models with 100 million timesteps- at this point 2 environments maxed out at sota performance (Pong and Freeway) with four approaching sota performance - (atlantis, boxing, tennis and fishingderby.) =6/57 near sota.
34
+
35
+ The aim now is to try and reach state-of-the-art (SOTA) performance on a further block of atari environments using up to 1 billion training timesteps initially with appo. I will flag the models with SOTA when they reach at or near these levels.
36
+
37
+ After this I will switch on V-Trace to see if the Impala variations perform any better with the same seed (I have seeded '1234')
38
+
39
+
40
+ ## About the Model
41
+
42
+ The hyperparameters used in the model are described in my shell script on my fork of sample-factory: https://github.com/MattStammers/sample-factory. Given that https://huggingface.co/edbeeching has kindly shared his parameters, I saved time and energy by using many of his tuned hyperparameters to reduce carbon inefficiency:
43
+ ```
44
+ hyperparameters = {
45
+ "help": false,
46
+ "algo": "APPO",
47
+ "env": "atari_asteroid",
48
+ "experiment": "atari_asteroid_APPO",
49
+ "train_dir": "./train_atari",
50
+ "restart_behavior": "restart",
51
+ "device": "gpu",
52
+ "seed": 1234,
53
+ "num_policies": 2,
54
+ "async_rl": true,
55
+ "serial_mode": false,
56
+ "batched_sampling": true,
57
+ "num_batches_to_accumulate": 2,
58
+ "worker_num_splits": 1,
59
+ "policy_workers_per_policy": 1,
60
+ "max_policy_lag": 1000,
61
+ "num_workers": 16,
62
+ "num_envs_per_worker": 2,
63
+ "batch_size": 1024,
64
+ "num_batches_per_epoch": 8,
65
+ "num_epochs": 4,
66
+ "rollout": 128,
67
+ "recurrence": 1,
68
+ "shuffle_minibatches": false,
69
+ "gamma": 0.99,
70
+ "reward_scale": 1.0,
71
+ "reward_clip": 1000.0,
72
+ "value_bootstrap": false,
73
+ "normalize_returns": true,
74
+ "exploration_loss_coeff": 0.0004677351413,
75
+ "value_loss_coeff": 0.5,
76
+ "kl_loss_coeff": 0.0,
77
+ "exploration_loss": "entropy",
78
+ "gae_lambda": 0.95,
79
+ "ppo_clip_ratio": 0.1,
80
+ "ppo_clip_value": 1.0,
81
+ "with_vtrace": true,
82
+ "vtrace_rho": 1.0,
83
+ "vtrace_c": 1.0,
84
+ "optimizer": "adam",
85
+ "adam_eps": 1e-05,
86
+ "adam_beta1": 0.9,
87
+ "adam_beta2": 0.999,
88
+ "max_grad_norm": 0.0,
89
+ "learning_rate": 0.0003033891184,
90
+ "lr_schedule": "linear_decay",
91
+ "lr_schedule_kl_threshold": 0.008,
92
+ "lr_adaptive_min": 1e-06,
93
+ "lr_adaptive_max": 0.01,
94
+ "obs_subtract_mean": 0.0,
95
+ "obs_scale": 255.0,
96
+ "normalize_input": true,
97
+ "normalize_input_keys": [
98
+ "obs"
99
+ ],
100
+ "decorrelate_experience_max_seconds": 0,
101
+ "decorrelate_envs_on_one_worker": true,
102
+ "actor_worker_gpus": [],
103
+ "set_workers_cpu_affinity": true,
104
+ "force_envs_single_thread": false,
105
+ "default_niceness": 0,
106
+ "log_to_file": true,
107
+ "experiment_summaries_interval": 3,
108
+ "flush_summaries_interval": 30,
109
+ "stats_avg": 100,
110
+ "summaries_use_frameskip": true,
111
+ "heartbeat_interval": 10,
112
+ "heartbeat_reporting_interval": 60,
113
+ "train_for_env_steps": 100000000,
114
+ "train_for_seconds": 10000000000,
115
+ "save_every_sec": 120,
116
+ "keep_checkpoints": 2,
117
+ "load_checkpoint_kind": "latest",
118
+ "save_milestones_sec": 1200,
119
+ "save_best_every_sec": 5,
120
+ "save_best_metric": "reward",
121
+ "save_best_after": 100000,
122
+ "benchmark": false,
123
+ "encoder_mlp_layers": [
124
+ 512,
125
+ 512
126
+ ],
127
+ "encoder_conv_architecture": "convnet_atari",
128
+ "encoder_conv_mlp_layers": [
129
+ 512
130
+ ],
131
+ "use_rnn": false,
132
+ "rnn_size": 512,
133
+ "rnn_type": "gru",
134
+ "rnn_num_layers": 1,
135
+ "decoder_mlp_layers": [],
136
+ "nonlinearity": "relu",
137
+ "policy_initialization": "orthogonal",
138
+ "policy_init_gain": 1.0,
139
+ "actor_critic_share_weights": true,
140
+ "adaptive_stddev": false,
141
+ "continuous_tanh_scale": 0.0,
142
+ "initial_stddev": 1.0,
143
+ "use_env_info_cache": false,
144
+ "env_gpu_actions": false,
145
+ "env_gpu_observations": true,
146
+ "env_frameskip": 4,
147
+ "env_framestack": 4,
148
+ "pixel_format": "CHW"
149
+ }
150
+
151
+ ```
152
+
153
+
154
+
155
+ A(n) **APPO** impala model trained on the **mujoco_walker** environment.
156
+
157
+ This model was trained using Sample-Factory 2.0: https://github.com/alex-petrenko/sample-factory. Sample factory is a
158
+ high throughput on-policy RL framework. I have been using
159
+ Documentation for how to use Sample-Factory can be found at https://www.samplefactory.dev/
160
+
161
+
162
+ ## Downloading the model
163
+
164
+ After installing Sample-Factory, download the model with:
165
+ ```
166
+ python -m sample_factory.huggingface.load_from_hub -r MattStammers/APPO-mujoco_walker
167
+ ```
168
+
169
+
170
+ ## Using the model
171
+
172
+ To run the model after download, use the `enjoy` script corresponding to this environment:
173
+ ```
174
+ python -m sf_examples.mujoco.enjoy_mujoco --algo=APPO --env=mujoco_walker --train_dir=./train_dir --experiment=APPO-mujoco_walker
175
+ ```
176
+
177
+
178
+ You can also upload models to the Hugging Face Hub using the same script with the `--push_to_hub` flag.
179
+ See https://www.samplefactory.dev/10-huggingface/huggingface/ for more details
180
+
181
+ ## Training with this model
182
+
183
+ To continue training with this model, use the `train` script corresponding to this environment:
184
+ ```
185
+ python -m sf_examples.mujoco.train_mujoco --algo=APPO --env=mujoco_walker --train_dir=./train_dir --experiment=APPO-mujoco_walker --restart_behavior=resume --train_for_env_steps=10000000000
186
+ ```
187
+
188
+ Note, you may have to adjust `--train_for_env_steps` to a suitably high number as the experiment will resume at the number of steps it concluded at.
189
+
checkpoint_p0/best_000377040_96526336_reward_6578.391.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd39017d066305d01e14b12663f5befb913039fa8730627a5f6fb4cb377d3a6b
3
+ size 83071
checkpoint_p0/checkpoint_001959192_503119872.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:85aeef8a7edbda65968209a667fd4accb4f4b2003563d874b2e58e27e5f85ea5
3
+ size 83335
checkpoint_p0/checkpoint_001959320_503185408.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c8e1f9343a9b17fa99b0a591408cdb39d392ec6386c0efc01ba97b91b3486a2b
3
+ size 83335
checkpoint_p0/milestones/checkpoint_000040992_10493952.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d210717b1b67a8ee9ce0e16f5c030c9a530e78ab7c831183c64abe515668b131
3
+ size 84015
checkpoint_p0/milestones/checkpoint_000081536_20873216.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:93a21505ae478d41eb8ad135e28a52dd90ec5d606156cd4f765cd5b928b02bbf
3
+ size 84015
checkpoint_p0/milestones/checkpoint_000123104_31514624.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:93a6dc420f83535dbec90bac617fafac86ca837188885233aebfe8699f35ceac
3
+ size 84015
checkpoint_p0/milestones/checkpoint_000164832_42196992.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:77c24ddedd416240aad23a6efaf148a0bd142ac4a7698214422dae43fdae9742
3
+ size 84015
checkpoint_p0/milestones/checkpoint_000206352_52830208.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8480bc1d071552f968a7a3ddb45f9b946108655fa77b1e326873708d889e30c3
3
+ size 84015
checkpoint_p0/milestones/checkpoint_000248240_63553536.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b3312c435218f790b5e723ed4ec563ea5fad6c6daec7cabe76efe92b4375d4f0
3
+ size 84015
checkpoint_p0/milestones/checkpoint_000289936_74227712.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a6af92e19a98d73f7ce41c8a69ab80f6c0aabdb4119e2ae15e3fd58ae0224c73
3
+ size 84015
checkpoint_p0/milestones/checkpoint_000331632_84901888.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7d631350e1f0cf0b0b1cbbcbeeee3aea11956093b53013b2bb0b454c52ae3976
3
+ size 84015
checkpoint_p0/milestones/checkpoint_000373200_95543296.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:33661be82c467d8c0bc1bef93e295fdf203df865383f9b517ef671e4c3b2883f
3
+ size 84015
checkpoint_p0/milestones/checkpoint_000414960_106233856.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d2f6f7c61d0d668157d635a3c272496bd85b4a2dbe42e61ba247345318b669e1
3
+ size 84059
checkpoint_p0/milestones/checkpoint_000456528_116875264.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:13c05107ac9a244ede105f00dff802aed6f5581a73cc79d8f9a086bb31612050
3
+ size 84059
checkpoint_p0/milestones/checkpoint_000498320_127574016.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:58fa12f030c99ab520fbbea8587d5d3a7b1197010621b8378ffb59f7a7f50d8c
3
+ size 84059
checkpoint_p0/milestones/checkpoint_000540208_138297344.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f26f6654a52dd3fa36123bc907cf480fa8f4860f8665fce937e2e561129ca2ec
3
+ size 84059
checkpoint_p0/milestones/checkpoint_000581776_148938752.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:19bc0ffe45d2eb58dfe7b3e3657343bb2272e0256a78c4f4794f14417ed536ff
3
+ size 84059
checkpoint_p0/milestones/checkpoint_000623504_159621120.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:263aca9ad1ee29bd1c18b08b11f52da5f8ee9a7dee3fa56c375c658aecaa82b0
3
+ size 84059
checkpoint_p0/milestones/checkpoint_000665104_170270720.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2e394e6ab19a5ede38a7e97894aa60ae6418e164b117fce18523ef6a30f335b8
3
+ size 84059
checkpoint_p0/milestones/checkpoint_000706576_180887552.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1803bf9bd1d3d6732a6a8883cb9bb9c1098206dead415a14a93bdec14734634b
3
+ size 84059
checkpoint_p0/milestones/checkpoint_000748112_191520768.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f59bac5a0ba7c55dc9bfc8486ece12be7005a4e77487d4dd958b22f147f8303e
3
+ size 84059
checkpoint_p0/milestones/checkpoint_000790192_202293248.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fa4a7b9410c2c391b4527538fd7ffa28ffeb29a21e43158c385650721b54ac67
3
+ size 84059
checkpoint_p0/milestones/checkpoint_000831888_212967424.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:68e76fdcd3ba6ac3fd678adc22823c00b321425c310fa2b4376c583013469170
3
+ size 84059
checkpoint_p0/milestones/checkpoint_000873712_223674368.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8a2837d23b66482bfbd07162fd52752ca3c9764d782f61702c7b82d0ca742ad6
3
+ size 84059
checkpoint_p0/milestones/checkpoint_000915248_234307584.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:992e7738177993e39fe9ef9d02e274a3fc608709e4b790df95291879167a4dfb
3
+ size 84059
checkpoint_p0/milestones/checkpoint_000956976_244989952.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5301d47bf9961e852931684e526931390a44d55175488cf44a5578e69e113ba3
3
+ size 84059
checkpoint_p0/milestones/checkpoint_000998512_255623168.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:31dc64f6b3af777091249f69e8b7add1959cff06d3483893b4fc7e0e130e81ac
3
+ size 84059
checkpoint_p0/milestones/checkpoint_001040464_266362880.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:28a3f41522dc712956cf39658264e2b28d517e401ba7aa00022aaf91c3417f16
3
+ size 84059
checkpoint_p0/milestones/checkpoint_001082160_277037056.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2f2196c21c8cdad27ac62346acdd6de12ba948ec9cfd2d7d4007ee8f76427f3f
3
+ size 84059
checkpoint_p0/milestones/checkpoint_001123792_287694848.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d03afca33f1b6789a7066f2ba25752c813c9791254f6a859815069711c608104
3
+ size 84059
checkpoint_p0/milestones/checkpoint_001165648_298409984.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:68c6874e87262b7f0dff7b111ac32d1320df7b113a68092c444538fd704c9b9c
3
+ size 84059
checkpoint_p0/milestones/checkpoint_001207472_309116928.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e4d69c17f599ea3f0daeaa8bb7286d8059f3e487958cc4d20aa3d4a22723b151
3
+ size 84059
checkpoint_p0/milestones/checkpoint_001249072_319766528.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0e605f9602d1c512fc2f5019d51fd1ce55bb1fc10e038c295151dab081c37df5
3
+ size 84059
checkpoint_p0/milestones/checkpoint_001291056_330514432.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:357a1b14fdf6aadbfec4192587cfd88cfd1228522ed125be1b733dc858c52ae4
3
+ size 84059
checkpoint_p0/milestones/checkpoint_001332656_341164032.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b3ddcb9ae2084fc8631efe5bbb9e79c038f5539982ae041391295544400d0b12
3
+ size 84059
checkpoint_p0/milestones/checkpoint_001374224_351805440.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:08d6546d8dc51c5fbc630aba11100ad7e7ebee470b4cedb4e49532b2e004869a
3
+ size 84059
checkpoint_p0/milestones/checkpoint_001415792_362446848.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4079ae25df93d9b3067979e52b250858f31e6e216f0de4e6cc7e7f28a37b0b2f
3
+ size 84059
checkpoint_p0/milestones/checkpoint_001457424_373104640.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9bfef3bddf29db7da7c3a51b34a3e372a98f52bf3472a29bdcd57896e6ab9d53
3
+ size 84059
checkpoint_p0/milestones/checkpoint_001499088_383770624.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:16663f55a24e01a2e12c610202e19c88dede31ae791c2439023b95f120d9e82a
3
+ size 84059
checkpoint_p0/milestones/checkpoint_001540848_394461184.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f693e61e7d95eb2b562574a2c562214f305c971ced0d0cb0a4f1fdeaafc07904
3
+ size 84059
checkpoint_p0/milestones/checkpoint_001582576_405143552.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c2e21375faf30221241a7b127b07446b5fbc5889832f30cbab9f474966f93a3f
3
+ size 84059
checkpoint_p0/milestones/checkpoint_001624176_415793152.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a7894d1164929ba8d35ef35fd05fe6c25cffa0c54a293b580b2dfa3cd5bf93f8
3
+ size 84059
checkpoint_p0/milestones/checkpoint_001666032_426508288.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7167b73419554a9c2c6f4dbacff694ef24e23c3b9760897bc86a733dfac7144b
3
+ size 84059
checkpoint_p0/milestones/checkpoint_001707760_437190656.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:187e610d91f74dd320589815b33492d0bd7439fa545405be7cd75ba02f2fbadb
3
+ size 84059
checkpoint_p0/milestones/checkpoint_001749584_447897600.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9697f051696331003189fa583d7a5799a813a59a27b681d847b7da75d40046bc
3
+ size 84059
checkpoint_p0/milestones/checkpoint_001791216_458555392.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e7584996b9314dbccf4e9a8a651372bb82186b7fd46ab00c155222eab66917a7
3
+ size 84059