hollowstrawberry commited on
Commit
6fdcffa
1 Parent(s): 50652ea

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +30 -3
README.md CHANGED
@@ -6,6 +6,7 @@ tags:
6
  - webui
7
  - automatic1111
8
  - stable-diffusion-webui
 
9
  language:
10
  - en
11
  ---
@@ -36,6 +37,7 @@ language:
36
  * [ControlNet](#controlnet)
37
  * [Lora Training](#train)
38
  * [Tips for training character Loras](#trainchars)
 
39
 
40
   
41
 
@@ -144,7 +146,7 @@ Here you can select your model and VAE. We will go over what these are and how y
144
 
145
  On the first tab, **txt2img**, you'll be making most of your images. This is where you'll find your *prompt* and *negative prompt*.
146
  Stable Diffusion is not like Midjourney or other popular image generation software, you can't just ask it what you want and get a good image. You have to be specific. *Very* specific.
147
- I will show you an example of a prompt and negative prompt:
148
 
149
  * Anime
150
  * `2d, masterpiece, best quality, anime, highly detailed face, highly detailed eyes, highly detailed background, perfect lighting`
@@ -260,9 +262,11 @@ Scripts can be found at the bottom of your generation parameters in txt2img or i
260
  ![X Y Z plot of models and ethnicities](images/XYZplot.png)
261
  </details>
262
 
 
 
263
  * **Prompt Matrix** <a name="matrix"></a>[▲](#index)
264
 
265
- Similar conceptually to S/R from before, but more in-depth. It works by showing each possible combination of terms listed between the `|` symbol in your prompt, for example: `young man|tree|city` will always contain "young man", but we'll see what happens when we add or remove "tree" and "city". Unlike S/R it also lets you use commas.
266
 
267
  Inside the script, you will choose either your prompt or your negative prompt to make a matrix of, and whether the variable terms should be put at the start or the end.
268
 
@@ -371,6 +375,29 @@ There are also alternative **diff** versions of each ControlNet model, which pro
371
 
372
  # Lora Training <a name="train"></a>[▲](#index)
373
 
 
 
 
 
 
 
 
 
 
 
 
374
  * **Character Loras** <a name="trainchars"></a>[▲](#index)
375
 
376
- Coming soon.
 
 
 
 
 
 
 
 
 
 
 
 
 
6
  - webui
7
  - automatic1111
8
  - stable-diffusion-webui
9
+ - lora
10
  language:
11
  - en
12
  ---
 
37
  * [ControlNet](#controlnet)
38
  * [Lora Training](#train)
39
  * [Tips for training character Loras](#trainchars)
40
+ * [...vtubers?](#vtubers)
41
 
42
  &nbsp;
43
 
 
146
 
147
  On the first tab, **txt2img**, you'll be making most of your images. This is where you'll find your *prompt* and *negative prompt*.
148
  Stable Diffusion is not like Midjourney or other popular image generation software, you can't just ask it what you want and get a good image. You have to be specific. *Very* specific.
149
+ Most people have found a prompt that works for them and they swear by it. I will show you my own personal example of a prompt and negative prompt:
150
 
151
  * Anime
152
  * `2d, masterpiece, best quality, anime, highly detailed face, highly detailed eyes, highly detailed background, perfect lighting`
 
262
  ![X Y Z plot of models and ethnicities](images/XYZplot.png)
263
  </details>
264
 
265
+ **Tip:** It appears possible to do S/R with commas by using quotes like this (note no spaces between the commas and quotes): `"term 1, term 2","term 3, term 4","term 5, term 6"`
266
+
267
  * **Prompt Matrix** <a name="matrix"></a>[▲](#index)
268
 
269
+ Similar conceptually to S/R from before, but more in-depth. It works by showing each possible combination of terms listed between the `|` symbol in your prompt, for example: `young man|tree|city` will always contain "young man", but we'll see what happens when we add or remove "tree" and "city". You can use commas and spaces just fine between the `|`.
270
 
271
  Inside the script, you will choose either your prompt or your negative prompt to make a matrix of, and whether the variable terms should be put at the start or the end.
272
 
 
375
 
376
  # Lora Training <a name="train"></a>[▲](#index)
377
 
378
+ To train a [Lora ▲](#lora) yourself is an achievement. It's certainly doable, but there are many variables involved, and a lot of work depending on your workflow. It's somewhere between an art and a science.
379
+
380
+ You can do it on your own computer if you have at least 8 GB of VRAM. However, I will cover the case of using a Google Collab document again for this express purpose.
381
+
382
+ Here are some classic resources if you want to read about the topic in depth. This website may be blocked by your internet provider, in which case you may use a VPN or try putting it through [Google Translate](https://translate.google.cl/?op=websites).
383
+ * [Lora Training on Rentry](https://rentry.org/lora_train)
384
+ * [Training Science on Rentry](https://rentry.org/lora-training-science)
385
+ * [Original Kohya Trainer (Dreambooth method)](https://colab.research.google.com/github/Linaqruf/kohya-trainer/blob/main/kohya-LoRA-dreambooth.ipynb#scrollTo=WNn0g1pnHfk5)
386
+
387
+ With those way smarter resources out of the way, I'll try to produce a short and simple guide for you to get your own character, artstyle, or concept Lora.
388
+
389
  * **Character Loras** <a name="trainchars"></a>[▲](#index)
390
 
391
+ Coming soon.
392
+
393
+ &nbsp;
394
+
395
+ # ...vtubers? <a name="vtubers"></a>[▲](#index)
396
+
397
+ That's it, that's the end of this guide for now. Thank you for reading. If you want to correct me or contribute to the guide you can open an issue or pull request and I'll take a look soon.
398
+
399
+ I have [a separate repo that aggregates vtuber Loras among other things, specially Hololive](https://huggingface.co/hollowstrawberry/holotard). If you're interested in that.
400
+
401
+ Cheers.
402
+
403
+ &nbsp;