FoodDesert commited on
Commit
83223b4
1 Parent(s): 94bc9ad

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +56 -0
README.md ADDED
@@ -0,0 +1,56 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+ # boring_e621
3
+
4
+ This embedding attempts to capture what it means for an image to be uninteresting. It was trained as a negative embedding for [ye18](https://huggingface.co/Doubleyobro/yiffy-e18) using e621 style tags as prompts during training
5
+ though it may also work in other SD 1.4-based models.
6
+ If you're using the [Automatic1111 Stable Diffusion WebUI](https://github.com/AUTOMATIC1111/stable-diffusion-webui), place the .pt file in
7
+ stable-diffusion-webui\embeddings and add "by boring_e621" to your negative prompt for more interesting outputs.
8
+ <br>
9
+
10
+ ## Model Description
11
+
12
+
13
+ The motivation for this is that negative embeddings like [Bad Prompt](https://huggingface.co/datasets/Nerfgun3/bad_prompt),
14
+ whose training is described [here](https://www.reddit.com/r/StableDiffusion/comments/yy2i5a/i_created_a_negative_embedding_textual_inversion/)
15
+ depend on manually curated lists of tags describing features people do not want their images to have, such as "deformed hands". Some problems with this approach are:
16
+ * Manually compiled lists will inevitably be incomplete.
17
+ * Models might not always understand the tags well due to a dearth of training images labeled with these tags.
18
+ * It can only capture named concepts. If there exist unnamed yet visually unappealing concepts that just make an image look wrong, but for reasons that cannot be succinctly explained, they will not be captured by a list of tags.
19
+ <br>
20
+
21
+ To address these problems, boring_e621 employs textual inversion directly on a set of 100 of the most boring images on the furry message board e621.net.
22
+ These images were automatically collected by querying e621 for images that no user has ever Favorited or Up Voted.
23
+ Almost all images on the site have at least one up vote or favorite, so the images that no one favorited are some of the very most uninspiring images on the website.
24
+ Thus, you should be able to use the resulting embedding as a negative prompt to make your generated images Not Boring.
25
+ <br>
26
+
27
+ # Bias, Risks, and Limitations
28
+ * Using this as a negative embedding often sacrifices some fidelity to the prompt. For example, characters in the image may disappear or change eye/skin/fur color.
29
+ * Using this as a negative embedding may introduce sexual content into images that would not otherwise have it. I suspect this is because people do not find sexual content boring, and thus it may be absent in the embedding's training data.
30
+ * Unlike other negative embeddings, this is not intended to fix problems like extra limbs or deformed hands. It can be used alongside other negative embeddings to fix deformities.
31
+ <br>
32
+
33
+ # Evaluation
34
+
35
+
36
+ I extracted the tags from three e621 images and used them to construct prompts in the style used by [ye18](https://huggingface.co/Doubleyobro/yiffy-e18).
37
+ * one prompt was constructed from an image with a high number of favorites.
38
+ * one prompt was constructed from an image with a moderate number of favorites.
39
+ * one prompt was constructed from an image with 0 favorites.
40
+ <br>
41
+
42
+ I then generated test images from each of these prompts, each time using a different negative embedding as the negative prompt. Particularly, I tried:
43
+ * [EasyNegative](https://huggingface.co/datasets/gsdf/EasyNegative)
44
+ * [Bad Artist](https://huggingface.co/nick-x-hacker/bad-artist)
45
+ * [Bad Prompt](https://huggingface.co/datasets/Nerfgun3/bad_prompt)
46
+ * [e621_boring](this)
47
+ <br>
48
+
49
+ Finally, I qualitatively evaluated the attractiveness and interestingness of the resulting images, though I will let you draw your own conclusions from the output.
50
+ <br>
51
+
52
+ ## Results
53
+
54
+ ![Negative Embedding Comparison](https://i.imgur.com/d7R4gGi.jpg)
55
+
56
+