|
--- |
|
license: creativeml-openrail-m |
|
tags: |
|
- stable-diffusion |
|
- text-to-image |
|
datasets: |
|
- ProGamerGov/StableDiffusion-v1-5-Regularization-Images |
|
--- |
|
|
|
**Min-Illust-Background-Diffusion** |
|
|
|
This fine-tuned Stable Diffusion v1.5 model was trained for 2250 iterations with a batch size of 4, on a selection of artistic works by Sin Jong Hun. Training was performed using [ShivamShrirao/diffusers](https://github.com/ShivamShrirao/diffusers) with full precision, prior-preservation loss, the train-text-encoder feature, and the new [1.5 MSE VAE from Stability AI](https://huggingface.co/stabilityai/sd-vae-ft-mse). A total of 4120 regularization / class images were used from [here](https://huggingface.co/datasets/ProGamerGov/StableDiffusion-v1-5-Regularization-Images). Regularization images were generated using the prompt "artwork style", 50 DDIM steps, and a CFG of 7. |
|
|
|
Use the tokens **sjh style** in your prompts for the effect. Note that the effect also appears to occur at a much weaker strength on prompts that steer the output towards specific artistic styles. |
|
|
|
This model will likely not perform well on generating portraits and related tasks, as the training data was primarily composed of landscapes. |
|
|
|
|
|
<div align="center"> |
|
<img src="https://huggingface.co/ProGamerGov/Min-Illust-Background-Diffusion/resolve/main/v1_size_512x768_t3x4.png"> |
|
</div> |
|
|
|
* [Full Image](https://huggingface.co/ProGamerGov/Min-Illust-Background-Diffusion/resolve/main/v1_size_512x768_t3x4.png) |
|
|
|
<div align="center"> |
|
<img src="https://huggingface.co/ProGamerGov/Min-Illust-Background-Diffusion/resolve/main/v1_size_512x512_t4x10.png"> |
|
</div> |
|
|
|
* [Full Image](https://huggingface.co/ProGamerGov/Min-Illust-Background-Diffusion/resolve/main/v1_size_512x512_t4x10.png) |
|
|
|
<div align="center"> |
|
<img src="https://huggingface.co/ProGamerGov/Min-Illust-Background-Diffusion/resolve/main/v1_512x512_t4x5.png"> |
|
</div> |
|
|
|
* [Full Image](https://huggingface.co/ProGamerGov/Min-Illust-Background-Diffusion/resolve/main/v1_512x512_t4x5.png) |
|
|
|
|
|
Example images were generated with the v1 2250 iteration model using 50 steps of DPM++ 2M Karras with a format of: |
|
|
|
``` |
|
<prompt>, sjh style |
|
``` |
|
|
