Jogn Titor commited on
Commit
b67c482
1 Parent(s): aa38372

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +135 -0
README.md ADDED
@@ -0,0 +1,135 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ☁️ Hello, this is Ether Blu Mix 🔵
2
+
3
+ This is a simple mix aimed at providing a semi-realistic anime style while retaining the knowledge trained on Danbooru-styled tags. Though its base model, AOM3, is fit for anime styled illustrations it's capable of other aesthetics with the correct style of prompting.
4
+
5
+ The mix also biases towards females and feminine faces, likely due to their prominence within the models as well as the anime aesthetic leaning towards feminine\androgynous faces.
6
+
7
+ ▼ Generation Guidelines
8
+
9
+ Use whatever sampler, steps, cfg you prefer.
10
+
11
+ Sample images were generated with
12
+
13
+ Sampler: DPM++ 2M Karras
14
+
15
+ Steps: 28
16
+
17
+ CFG: 7
18
+
19
+ Clip Skip: 1
20
+
21
+ *WARNING*
22
+
23
+ Please input "NSFW" in the negative prompt to reduce instances of unprompted nudity. Due to the models used within the merge there's a bias in generating NSFW imagery.
24
+
25
+ Negative Prompt Example:
26
+
27
+ "NSFW, (worst quality, low quality:1.3), watermark, signature"
28
+
29
+ Most sample images were further upscaled using AUTO1111 Hi-res fix. Please utilize it if you wish to achieve similar results.
30
+
31
+ Latent (nearest-exact)
32
+
33
+ Upscale by: 2
34
+
35
+ Denoising strength: 0.55
36
+
37
+ Prompting Advice:
38
+
39
+ Use short prompts mixing prose and danbooru-styled tags. Experiment and give the AI some freedom. When in doubt, change up your prompting style.
40
+
41
+ General guidelines:
42
+
43
+ Prompt in anime\danbooru-style models
44
+
45
+ More anime style images
46
+
47
+ Prompt in photography\non-anime models
48
+
49
+ More realistic images
50
+
51
+ The sample images were generated using Waifu Diffusion VAE kl-f8-anime2. This VAE is not mandatory. Please use whichever VAE you prefer.
52
+
53
+ ▼ Model Merging
54
+
55
+ I have no training or real knowledge on machine learning. I merged the model using the information provided on WarriorMama777's AOM model page. I very arbitrarily used the UBM weights given to merge and create AOM3 and its derivatives and modified the values with trial and error until I was visually happy with it.
56
+
57
+ I utilized the SuperMerger extension for AUTO1111 by hako-mikan.
58
+
59
+ ▼ Merging
60
+
61
+ MODEL A: AOM3.safetensors
62
+
63
+ MODEL B: Chilloutmix_fp16.safetensors
64
+
65
+ Weight Sum merge - Use MBW
66
+
67
+ Alpha: 1
68
+
69
+ 0,0.3,0.3,0.3,0.3,0.3,0,0,0,0,0.3,0.3,0.3,0.3,0.3,0.3,0.3,0.3,0.3,0.3,0.3,0.3,0.3,0.3,0,0
70
+
71
+ Model: AOM3-ChilloutSumS2-03
72
+
73
+
74
+
75
+ MODEL A: AOM3-ChilloutSumS2-03
76
+
77
+ MODEL B: deliberate_v2.ckpt
78
+
79
+ Weight Sum merge - Use MBW
80
+
81
+ Alpha: 1
82
+
83
+ 0,0.2,0.2,0.2,0.2,0.2,0,0,0,0,0.2,0.1,0.2,0.2,0.2,0.2,0.2,0.1,0.1,0.1,0.2,0.2,0.1,0.2,0.2,0.2
84
+
85
+ Model: AOM3-ChilloutSumS2-03-DelibV2SumS1-02
86
+
87
+
88
+
89
+ MODEL A: AOM3-ChilloutSumS2-03-DelibV2SumS1-02
90
+
91
+ MODEL B: pastelmix-better-vae-fp16.safetensors
92
+
93
+ Weight Sum merge - Use MBW
94
+
95
+ Alpha: 1
96
+
97
+ 0,0.2,0.2,0.2,0.2,0.2,0,0,0,0,0.2,0.2,0.2,0.2,0.2,0.2,0.2,0.2,0.2,0.2,0.2,0.2,0.2,0.2,0,0
98
+
99
+ Final Model: EBM-v1
100
+
101
+ Models Used:
102
+
103
+ AOM3.safetensors
104
+
105
+ D124FC18F0232D7F0A2A70358CDB1288AF9E1EE8596200F50F0936BE59514F6D
106
+
107
+ chilloutmix_NiPrunedFp16Fix.safetensors
108
+
109
+ 59FFE2243A25C9FE137D590EB3C5C3D3273F1B4C86252DA11BBDC9568773DA0C
110
+
111
+ deliberate_v2.ckpt
112
+
113
+ 9ABA26ABDFCD46073E0A1D42027A3A3BCC969F562D58A03637BF0A0DED6586C9
114
+
115
+ pastelmix-better-vae-fp16.safetensors
116
+
117
+ D01A68AE76F97506363F387F5F28BB564AD9E20924844FD5945E600B72D39E79
118
+
119
+ Credits:
120
+
121
+ Thank you to WarriorMama777 for providing AOM and other various mixes as well as detailing your workflow and inspiring me to try mixing my own models.
122
+
123
+ Thank you to hako-mikan for creating the SuperMerger extension allowing a quicker workflow for merging.
124
+
125
+ Thank you to the creator of ChilloutMix.
126
+
127
+ Thank you to XpucT for creating Deliberate.
128
+
129
+ Thank you to andite for Pastel-Mix.
130
+
131
+ Thank you to AUTO1111 for creating the web UI everyone uses.
132
+
133
+ Thank you to StabilityAI for starting everything with Stable Diffusion.
134
+
135
+ Thank you to the entire SD community for continuing to openly share and create.