Zero to Hero Stable Diffusion 3 Tutorial with Amazing SwarmUI SD Web UI that Utilizes ComfyUI
Tags: beginners, tutorial, ai, learning
Published: 2024-06-22 15:13:13

<h1 style="margin-left:0px;"><a target="_blank" rel="noopener noreferrer" href="https://youtu.be/HKX8_F1Er_w"><strong><u>Zero to Hero Stable Diffusion 3 Tutorial with Amazing SwarmUI SD Web UI that Utilizes ComfyUI</u></strong></a></h1>
<p style="margin-left:0px;"><a target="_blank" rel="noopener noreferrer" href="https://youtu.be/HKX8_F1Er_w"><u>https://youtu.be/HKX8_F1Er_w</u></a></p>
<p style="margin-left:auto;">{% embed https://youtu.be/HKX8_F1Er_w %}</p>
<p style="margin-left:0px;">Do not skip any part of this tutorial to master how to use Stable Diffusion 3 (SD3) with the most advanced generative AI open source APP SwarmUI. Automatic1111 SD Web UI or Fooocus are not supporting the #SD3 yet. Therefore, I am starting to make tutorials for SwarmUI as well. #StableSwarmUI is officially developed by the StabilityAI and your mind will be blown after you watch this tutorial and learn its amazing features. StableSwarmUI uses #ComfyUI as the back end thus it has all the good features of ComfyUI and it brings you easy to use features of Automatic1111 #StableDiffusion Web UI with them. I really liked SwarmUI and planning to do more tutorials for it.</p>
<p style="margin-left:0px;">🔗 The Public Post (no login or account required) Shown In The Video With The Links ➡️ <a target="_blank" rel="noopener noreferrer" href="https://www.patreon.com/posts/stableswarmui-3-106135985"><u>https://www.patreon.com/posts/stableswarmui-3-106135985</u></a></p>
<p style="margin-left:0px;">0:00 Introduction to the Stable Diffusion 3 (SD3) and SwarmUI and what is in the tutorial<br>4:12 Architecture and features of SD3<br>5:05 What each different model files of Stable Diffusion 3 means<br>6:26 How to download and install SwarmUI on Windows for SD3 and all other Stable Diffusion models<br>8:42 What kind of folder path you should use when installing SwarmUI<br>10:28 If you get installation error how to notice and fix it<br>11:49 Installation has been completed and now how to start using SwarmUI<br>12:29 Which settings I change before start using SwarmUI and how to change your theme like dark, white, gray<br>12:56 How to make SwarmUI save generated images as PNG<br>13:08 How to find description of each settings and configuration<br>13:28 How to download SD3 model and start using on Windows<br>13:38 How to use model downloader utility of SwarmUI<br>14:17 How to set models folder paths and link your existing models folders in SwarmUI<br>14:35 Explanation of Root folder path in SwarmUI<br>14:52 VAE of SD3 do we need to download?<br>15:25 Generate and model section of the SwarmUI to generate images and how to select your base model<br>16:02 Setting up parameters and what they do to generate images<br>17:06 Which sampling method is best for SD3<br>17:22 Information about SD3 text encoders and their comparison<br>18:14 First time generating an image with SD3<br>19:36 How to regenerate same image<br>20:17 How to see image generation speed and step speed and more information<br>20:29 Stable Diffusion 3 it per second speed on RTX 3090 TI<br>20:39 How to see VRAM usage on Windows 10<br>22:08 And testing and comparing different text encoders for SD3<br>22:36 How to use FP16 version of T5 XXL text encoder instead of default FP8 version<br>25:27 The image generation speed when using best config for SD3<br>26:37 Why VAE of the SD3 is many times better than previous Stable Diffusion models, 4 vs 8 vs 16 vs 32 channels VAE<br>27:40 How to and where to download best AI upscaler models<br>29:10 How to use refiner and upscaler models to improve and upscale generated images<br>29:21 How to restart and start SwarmUI<br>32:01 The folders where the generated images are saved<br>32:13 Image history feature of SwarmUI<br>33:10 Upscaled image comparison<br>34:01 How to download all upscaler models at once<br>34:34 Presets feature in depth<br>36:55 How to generate forever / infinite times<br>37:13 Non-tiled upscale caused issues<br>38:36 How to compare tiled vs non-tiled upscale and decide best<br>39:05 275 SwarmUI presets (cloned from Fooocus) I prepared and the scripts I coded to prepare them and how to import those presets<br>42:10 Model browser feature<br>43:25 How to generate TensorRT engine for huge speed up<br>43:47 How to update SwarmUI<br>44:27 Prompt syntax and advanced features<br>45:35 How to use Wildcards (random prompts) feature<br>46:47 How to see full details / metadata of generated images<br>47:13 Full guide for extremely powerful grid image generation (like X/Y/Z plot)<br>47:35 How to put all downloaded upscalers from zip file<br>51:37 How to see what is happening at the server logs<br>53:04 How to continue grid generation process after interruption<br>54:32 How to open grid generation after it has been completed and how to use it<br>56:13 Example of tiled upscaling seaming problem<br>1:00:30 Full guide for image history<br>1:02:22 How to directly delete images and star them<br>1:03:20 How to use SD 1.5 and SDXL models and LoRAs<br>1:06:24 Which sampler method is best<br>1:06:43 How to use image to image<br>1:08:43 How to use edit image / inpainting<br>1:10:38 How to use amazing segmentation feature to automatically inpaint any part of images<br>1:15:55 How to use segmentation on existing images for inpainting and get perfect results with different seeds<br>1:18:19 More detailed information regarding upscaling and tiling and SD3<br>1:20:08 Seams perfect explanation and example and how to fix it<br>1:21:09 How to use queue system<br>1:21:23 How to use multiple GPUs with adding more backends<br>1:24:38 Loading model in low VRAM mode<br>1:25:10 How to fix colors over saturation<br>1:27:00 Best image generation configuration for SD3<br>1:27:44 How to apply upscale to your older generated images quickly via preset<br>1:28:39 Other amazing features of SwarmUI<br>1:28:49 Clip tokenization and rare token OHWX</p>
<p style="margin-left:auto;">
    <picture>
        <source srcset="https://miro.medium.com/v2/resize:fit:640/format:webp/1*wcccTUABPvJIWN1Lz9bEBQ.png 640w, https://miro.medium.com/v2/resize:fit:720/format:webp/1*wcccTUABPvJIWN1Lz9bEBQ.png 720w, https://miro.medium.com/v2/resize:fit:750/format:webp/1*wcccTUABPvJIWN1Lz9bEBQ.png 750w, https://miro.medium.com/v2/resize:fit:786/format:webp/1*wcccTUABPvJIWN1Lz9bEBQ.png 786w, https://miro.medium.com/v2/resize:fit:828/format:webp/1*wcccTUABPvJIWN1Lz9bEBQ.png 828w, https://miro.medium.com/v2/resize:fit:1100/format:webp/1*wcccTUABPvJIWN1Lz9bEBQ.png 1100w, https://miro.medium.com/v2/resize:fit:1400/format:webp/1*wcccTUABPvJIWN1Lz9bEBQ.png 1400w" type="image/webp" sizes="(min-resolution: 4dppx) and (max-width: 700px) 50vw, (-webkit-min-device-pixel-ratio: 4) and (max-width: 700px) 50vw, (min-resolution: 3dppx) and (max-width: 700px) 67vw, (-webkit-min-device-pixel-ratio: 3) and (max-width: 700px) 65vw, (min-resolution: 2.5dppx) and (max-width: 700px) 80vw, (-webkit-min-device-pixel-ratio: 2.5) and (max-width: 700px) 80vw, (min-resolution: 2dppx) and (max-width: 700px) 100vw, (-webkit-min-device-pixel-ratio: 2) and (max-width: 700px) 100vw, 700px">
        <source srcset="https://miro.medium.com/v2/resize:fit:640/1*wcccTUABPvJIWN1Lz9bEBQ.png 640w, https://miro.medium.com/v2/resize:fit:720/1*wcccTUABPvJIWN1Lz9bEBQ.png 720w, https://miro.medium.com/v2/resize:fit:750/1*wcccTUABPvJIWN1Lz9bEBQ.png 750w, https://miro.medium.com/v2/resize:fit:786/1*wcccTUABPvJIWN1Lz9bEBQ.png 786w, https://miro.medium.com/v2/resize:fit:828/1*wcccTUABPvJIWN1Lz9bEBQ.png 828w, https://miro.medium.com/v2/resize:fit:1100/1*wcccTUABPvJIWN1Lz9bEBQ.png 1100w, https://miro.medium.com/v2/resize:fit:1400/1*wcccTUABPvJIWN1Lz9bEBQ.png 1400w" sizes="(min-resolution: 4dppx) and (max-width: 700px) 50vw, (-webkit-min-device-pixel-ratio: 4) and (max-width: 700px) 50vw, (min-resolution: 3dppx) and (max-width: 700px) 67vw, (-webkit-min-device-pixel-ratio: 3) and (max-width: 700px) 65vw, (min-resolution: 2.5dppx) and (max-width: 700px) 80vw, (-webkit-min-device-pixel-ratio: 2.5) and (max-width: 700px) 80vw, (min-resolution: 2dppx) and (max-width: 700px) 100vw, (-webkit-min-device-pixel-ratio: 2) and (max-width: 700px) 100vw, 700px"><img class="image_resized" style="height:auto;width:680px;" src="https://miro.medium.com/v2/resize:fit:1313/1*wcccTUABPvJIWN1Lz9bEBQ.png" alt="" width="700" height="394">
    </picture>
</p>