ptx0 commited on
Commit
7da043e
1 Parent(s): 3bd8fd3

Trained for 4 epochs and 90000 steps.

Browse files

Trained with datasets ['text-embeds-pixart-filter', 'photo-concept-bucket', 'midjourney-v6-520k-raw', 'sfwbooru', 'nijijourney-v6-520k-raw', 'dalle3']
Learning rate 1e-06, batch size 24, and 1 gradient accumulation steps.
Used DDPM noise scheduler for training with epsilon prediction type and rescaled_betas_zero_snr=False
Using 'linspace' timestep spacing.
Base model: ptx0/pixart-900m-1024-ft-large
VAE: madebyollin/sdxl-vae-fp16-fix

README.md CHANGED
@@ -1217,7 +1217,7 @@ You may reuse the base model text encoder for inference.
1217
  ## Training settings
1218
 
1219
  - Training epochs: 4
1220
- - Training steps: 89000
1221
  - Learning rate: 1e-06
1222
  - Effective batch size: 192
1223
  - Micro-batch size: 24
 
1217
  ## Training settings
1218
 
1219
  - Training epochs: 4
1220
+ - Training steps: 90000
1221
  - Learning rate: 1e-06
1222
  - Effective batch size: 192
1223
  - Micro-batch size: 24
optimizer.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bea10a02b9c62a448c3ddae11eccef1c81870c3287be6d3e0c6f569e4d66427c
3
  size 5451415117
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cb773de197a1530c407ef80c5199b84201edb880dcd98487ae9bde2d359a1790
3
  size 5451415117
random_states_0.pkl CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f0828b4c8a4a25f9ac7b69b4a864afe9ca4495ded99d63acab132755ca9173c3
3
- size 16100
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:08e729f7bc113b1d171924e7a7d9e2b2bce34c8897707f9167cb6b1e68048ce0
3
+ size 16036
scheduler.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d0f4679ca9dfd87d9fa43a0bb463740626ec806a6d276e69114d52444a4c9e85
3
  size 1000
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0e6a7d71478ca26fe3456126d27f202f42d48f5d5550ec9c4e5a1d88a5945387
3
  size 1000
training_state-dalle3.json CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:69b5507ef61ac73d8104a73c6ff64d969aef9b6f57bddda67ea4af6755ce5d3c
3
- size 9390336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cc594f8f44ffe27e9c2828675c229b0d9f342620c2e669a0f0f83b99aabc93f8
3
+ size 9767733
training_state-midjourney-v6-520k-raw.json CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8e4f7d3fde67fba17d2361f9f8c5045bfa9791bddb1530ff43e7d1341ee219a9
3
- size 5590339
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b3ffe0d9e516cdc1e1703812859e8f937f9ca3720ed83d508b9b898f7214cad8
3
+ size 6124291
training_state-nijijourney-v6-520k-raw.json CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bfb697e8d01e81e142623bddb6349886f645bafdc9c2b5177ffeb3d8e29b1b61
3
- size 6225043
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f229a2face2e5e2cc34ac63a94d9e3eb97f80b3bff81fcd91ec1bd449a377c4b
3
+ size 6745123
training_state-photo-concept-bucket.json CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6af5aaa5491e1a242a166702a428f7c93aae41b24aec15d454ee148fd31490bb
3
- size 5919874
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e0a414f75495959c40f61c4c302e01b062c0a9d7f343251c182f4af1904865e4
3
+ size 6301195
training_state-sfwbooru.json CHANGED
The diff for this file is too large to render. See raw diff
 
training_state.json CHANGED
@@ -1 +1 @@
1
- {"global_step": 89000, "epoch_step": 1, "epoch": 5, "exhausted_backends": [], "repeats": {"bookcovers": 0, "signs": 0, "normalnudes": 0, "nijijourney": 0, "movieposters": 0, "celebrities": 0, "pixel-art": 0, "propagandaposters": 0, "sports": 0, "moviecollection": 0, "gay": 0, "experimental": 0, "yoga": 0, "ethnic": 0, "cinemamix-1mp": 0, "architecture": 0, "mj-60": 0, "text-1mp": 65, "shutterstock": 0, "nsfw-1024": 0, "photo-aesthetics": 0, "anatomy": 0, "bg20k-1024": 0, "sfwbooru": 0, "midjourney-v6-520k-raw": 0, "nijijourney-v6-520k-raw": 0, "photo-concept-bucket": 0, "dalle3": 0}}
 
1
+ {"global_step": 90000, "epoch_step": 1, "epoch": 5, "exhausted_backends": [], "repeats": {"bookcovers": 0, "signs": 0, "normalnudes": 0, "nijijourney": 0, "movieposters": 0, "celebrities": 0, "pixel-art": 0, "propagandaposters": 0, "sports": 0, "moviecollection": 0, "gay": 0, "experimental": 0, "yoga": 0, "ethnic": 0, "cinemamix-1mp": 0, "architecture": 0, "mj-60": 0, "text-1mp": 65, "shutterstock": 0, "nsfw-1024": 0, "photo-aesthetics": 0, "anatomy": 0, "bg20k-1024": 0, "sfwbooru": 0, "midjourney-v6-520k-raw": 0, "nijijourney-v6-520k-raw": 0, "photo-concept-bucket": 0, "dalle3": 0}}
transformer/diffusion_pytorch_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f5afef6ba6edc2d50f6a76eefa0204b7c1e75f2cd4102810738cbb33e2f55a4e
3
  size 1816969728
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5c42b4b31ddfe9351bb58bf160dd4e988f5326ad79da6c2a4e5b2ad29878dec6
3
  size 1816969728