Trained for 0 epochs and 1000 steps.

Trained with datasets ['text-embeds', 'mj-v6']
Learning rate 8e-06, batch size 32, and 4 gradient accumulation steps.
Used DDPM noise scheduler for training with epsilon prediction type and rescaled_betas_zero_snr=False
Using 'trailing' timestep spacing.
Base model: toilaluan/SoraT2I
VAE: madebyollin/sdxl-vae-fp16-fix

README.md

@@ -211,7 +211,7 @@ You may reuse the base model text encoder for inference.
 ## Training settings
 
 - Training epochs: 0
-- Training steps: 500
+- Training steps: 1000
 - Learning rate: 8e-06
 - Effective batch size: 128
   - Micro-batch size: 32

optimizer.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:60221f59d90258d0dbe2c074d7a9b84e30fcc5f3acaa8ee6ac6ca882eb0c231f
+oid sha256:7cb6a0598992105f84e67d11c282d8fcc5fe9ae107695a01422a012b0ef61806
 size 3665677155

random_states_0.pkl

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:5fdf07135febc8e555d2c56eea3c39ea245eafd412d6ec7a4ff4ffa4728e9def
+oid sha256:9065bbd2309a6b61d97ffd48ee72d28fc955373879b561279c87193a5fec8c77
 size 14344

scheduler.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:57feaeea732a8232dc14923ac8e8cff564f2d6d11728d1405a7f3cfc02efb7ed
+oid sha256:a778f242057a9963f512d7713fc392bdaa1ea385692a6d218868f2e42ea21ee4
 size 1000

training_state-mj-v6.json

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b10925e346b4ff56ccc9febfaf6d9cece752b1e439082211e8080f57349f7b3d
-size 15443107
+oid sha256:0c49e5bb2e3f9ef61375327cf75329222856ee982c47bdb83b7f3fb89b6a6c4c
+size 20691107

training_state.json

@@ -1 +1 @@
-{"global_step": 500, "epoch_step": 500, "epoch": 1, "exhausted_backends": [], "repeats": {}}
+{"global_step": 1000, "epoch_step": 1000, "epoch": 1, "exhausted_backends": [], "repeats": {}}

transformer/diffusion_pytorch_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:9ea4fbe7ee4344fc745d218a639508db68b2484f5693affa92b341f90b477eb7
+oid sha256:4d29859c983c1bb5f04dd50fd5991f0cf32fcf23e4fecedf72577bc149824430
 size 1221780352