Update README.md

README.md

@@ -69,3 +69,23 @@ tags:
   * [Toolchain](https://github.com/hearmeneigh/dataset-rising)
   * [Dataset](https://huggingface.co/datasets/hearmeneigh/e621-rising-v3-curated)
 
+
+## Training Procedure
+
+[Training legend](TBD)
+
+* 160 images per batch (epoch variant)
+* `1024x1024px` image size
+* Adam optimizer
+  * Beta1 = `0.9`
+  * Beta2 = `0.999`
+  * Weight decay = `1e-2`
+  * Epsilon = `1e-08`
+* Constant learning rate `4e-6`
+* `fp16` mixed precision
+* SNR gamma set to `5.0`
+* Noise offset set to `0.07`
+* `cosine_with_restarts` scheduler
+* 11 epochs of [V3 curated dataset](https://huggingface.co/datasets/hearmeneigh/e621-rising-v3-curated) samples resized to `< 1024x1024px` (maintain aspect ratio)
+* 16 epochs of [V3 finetuner dataset](https://huggingface.co/datasets/hearmeneigh/e621-rising-v3-finetuner) samples resized to `< 1024x1024px` (maintain aspect ratio)
+* Tags for each sample are shuffled for each epoch