Hugging Face's logo

hollowstrawberry
/
stable-diffusion-guide

English
guide
stable diffusion
webui
automatic1111
stable-diffusion-webui
lora
Model card Files Community
7
stable-diffusion-guide / README.md
hollowstrawberry's picture
hollowstrawberry
Update README.md
b45080e
preview code
|
raw
history blame
No virus
5.96 kB
metadata
license: wtfpl
tags:
  - guide
  - stable diffusion
  - webui
  - automatic1111
  - stable-diffusion-webui

Index

Introduction

Stable Diffusion is a very powerful AI image generation software you can run on your own home computer. It uses "models", which function like the brain of the AI, and can make almost anything given that someone has trained it to do it. The biggest uses are anime art, photorealism, and NSFW content.

The images you create may be used for any purpose, depending on the used model's license. Whether they are "yours" in a legal sense varies by local laws and is often inconclusive. Neither I or any of the people involved in Stable Diffusion or its models are responsible for anything you make, and you are expressively forbidden from creating illegal or harmful content.

Installing

  • Requirements: To run Stable Diffusion on your own computer you'll need at least 16 GB of RAM and 4 GB of VRAM. I will only cover the case where you are running Windows 10/11 and using an NVIDIA graphics card series 16XX, 20XX or 30XX (though 10XX also work). AMD users are out of luck, as it's very inconsistent to get it working. Same with Linux and Mac, though it's possible to do it.
  • Installer: The easiest way is to download the latest release HERE.
  • Alternative: If you don't meet the hardware requirements, don't worry, you can still use Stable Diffusion for free to its full extent through Google Collab. It borrows Google's computers to use AI, with variable time limitations, usually a few hours every day. To get started, go here and follow the steps.

Getting Started

Before generating some images, here are some useful steps you can follow to improve your experience.

  1. Edit your starting parameters: If you're using the collab, skip this step. If you're using the launcher, turn on medvram and xformers. Then, set your Additional Launch Options to: --opt-channelslast --no-half-vae. All of these should offer minor but significant improvements to performance.

    • If your graphics card has more than 8 GB of VRAM, you may turn off medvram to make generations faster. However, medvram still allows you to generate larger images and more images at the same time.
    • If your graphics card has 4 or 6 GB of VRAM, add --opt-split-attention-v1 as it may lower vram usage even further.
    • If you want to run the program from your computer but want to use it in another device, such as your phone, add --listen. Then, use your computer's local IP in the same WiFi network to access the interface.
    • If you're using the original stable-diffusion-webui, you can add these parameters by editing your webui-user.bat, right next to set COMMANDLINE_ARGS=
    • Full list of possible parameters here

  2. Getting a model: There are many options, most of which are on civitai. But which to choose? These are my recommendations:

    • For anime, 7th Heaven Mix has a nice aesthetic similar to anime movies, while Abyss Orange Mix 3 (Note: scroll down and choose the AOM3 option) offers more realism, advanced lighting, softer shading, and more lewdness. I remixed the two options above into Heaven Orange Mix.
    • For creative art go with DreamShaper, there are few options quite like it. An honorable mention goes to Pastel Mix, which has a beautiful and unique aesthetic with the addition of anime.
    • For photorealism go with Deliberate, it can do almost anything, specially photographs.
    • The Uber Realistic Porn Merge is self-explanatory.

    Launcher: It will let you choose the path to your models folder. Otherwise the models normally go into stable-diffusion-webui/models/Stable-diffusion.

    Collab: copy the direct download link to the file and put it in MODEL_LINK:. Turn on safetensors, and Use_temp_storage if you don't want to save it to your google drive.

  3. Getting a VAE: Most models don't come with a VAE built in. The VAE is a small separate model, which "converts your image from AI format into human format". Without it, you'll get faded colors and ugly eyes, among other things.

    There are practically only 3 different VAEs out there worth talking about:

    • anime vae, also known as the AnythingV3 vae, also known as the orangemix vae. All anime models use this.
    • vae-ft-mse, the latest from Stable Diffusion itself. Used by photorealism models and such.
    • kl-f8-anime2, also known as the waifu diffusion VAE, it is older and produces much brighter results. Used by Pastel Mix.

    Launcher: It lets you choose the default VAE, otherwise put them in the stable-diffusion-webui/models/VAE folder.

    Collab: You will have to place it in your Google Drive, in MyDrive/sd/stable-diffusion-webui/models/VAE.