Jogn Titor
commited on
Commit
•
b67c482
1
Parent(s):
aa38372
Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,135 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
☁️ Hello, this is Ether Blu Mix 🔵
|
2 |
+
|
3 |
+
This is a simple mix aimed at providing a semi-realistic anime style while retaining the knowledge trained on Danbooru-styled tags. Though its base model, AOM3, is fit for anime styled illustrations it's capable of other aesthetics with the correct style of prompting.
|
4 |
+
|
5 |
+
The mix also biases towards females and feminine faces, likely due to their prominence within the models as well as the anime aesthetic leaning towards feminine\androgynous faces.
|
6 |
+
|
7 |
+
▼ Generation Guidelines
|
8 |
+
|
9 |
+
Use whatever sampler, steps, cfg you prefer.
|
10 |
+
|
11 |
+
Sample images were generated with
|
12 |
+
|
13 |
+
Sampler: DPM++ 2M Karras
|
14 |
+
|
15 |
+
Steps: 28
|
16 |
+
|
17 |
+
CFG: 7
|
18 |
+
|
19 |
+
Clip Skip: 1
|
20 |
+
|
21 |
+
*WARNING*
|
22 |
+
|
23 |
+
Please input "NSFW" in the negative prompt to reduce instances of unprompted nudity. Due to the models used within the merge there's a bias in generating NSFW imagery.
|
24 |
+
|
25 |
+
Negative Prompt Example:
|
26 |
+
|
27 |
+
"NSFW, (worst quality, low quality:1.3), watermark, signature"
|
28 |
+
|
29 |
+
Most sample images were further upscaled using AUTO1111 Hi-res fix. Please utilize it if you wish to achieve similar results.
|
30 |
+
|
31 |
+
Latent (nearest-exact)
|
32 |
+
|
33 |
+
Upscale by: 2
|
34 |
+
|
35 |
+
Denoising strength: 0.55
|
36 |
+
|
37 |
+
Prompting Advice:
|
38 |
+
|
39 |
+
Use short prompts mixing prose and danbooru-styled tags. Experiment and give the AI some freedom. When in doubt, change up your prompting style.
|
40 |
+
|
41 |
+
General guidelines:
|
42 |
+
|
43 |
+
Prompt in anime\danbooru-style models
|
44 |
+
|
45 |
+
More anime style images
|
46 |
+
|
47 |
+
Prompt in photography\non-anime models
|
48 |
+
|
49 |
+
More realistic images
|
50 |
+
|
51 |
+
The sample images were generated using Waifu Diffusion VAE kl-f8-anime2. This VAE is not mandatory. Please use whichever VAE you prefer.
|
52 |
+
|
53 |
+
▼ Model Merging
|
54 |
+
|
55 |
+
I have no training or real knowledge on machine learning. I merged the model using the information provided on WarriorMama777's AOM model page. I very arbitrarily used the UBM weights given to merge and create AOM3 and its derivatives and modified the values with trial and error until I was visually happy with it.
|
56 |
+
|
57 |
+
I utilized the SuperMerger extension for AUTO1111 by hako-mikan.
|
58 |
+
|
59 |
+
▼ Merging
|
60 |
+
|
61 |
+
MODEL A: AOM3.safetensors
|
62 |
+
|
63 |
+
MODEL B: Chilloutmix_fp16.safetensors
|
64 |
+
|
65 |
+
Weight Sum merge - Use MBW
|
66 |
+
|
67 |
+
Alpha: 1
|
68 |
+
|
69 |
+
0,0.3,0.3,0.3,0.3,0.3,0,0,0,0,0.3,0.3,0.3,0.3,0.3,0.3,0.3,0.3,0.3,0.3,0.3,0.3,0.3,0.3,0,0
|
70 |
+
|
71 |
+
Model: AOM3-ChilloutSumS2-03
|
72 |
+
|
73 |
+
▼
|
74 |
+
|
75 |
+
MODEL A: AOM3-ChilloutSumS2-03
|
76 |
+
|
77 |
+
MODEL B: deliberate_v2.ckpt
|
78 |
+
|
79 |
+
Weight Sum merge - Use MBW
|
80 |
+
|
81 |
+
Alpha: 1
|
82 |
+
|
83 |
+
0,0.2,0.2,0.2,0.2,0.2,0,0,0,0,0.2,0.1,0.2,0.2,0.2,0.2,0.2,0.1,0.1,0.1,0.2,0.2,0.1,0.2,0.2,0.2
|
84 |
+
|
85 |
+
Model: AOM3-ChilloutSumS2-03-DelibV2SumS1-02
|
86 |
+
|
87 |
+
▼
|
88 |
+
|
89 |
+
MODEL A: AOM3-ChilloutSumS2-03-DelibV2SumS1-02
|
90 |
+
|
91 |
+
MODEL B: pastelmix-better-vae-fp16.safetensors
|
92 |
+
|
93 |
+
Weight Sum merge - Use MBW
|
94 |
+
|
95 |
+
Alpha: 1
|
96 |
+
|
97 |
+
0,0.2,0.2,0.2,0.2,0.2,0,0,0,0,0.2,0.2,0.2,0.2,0.2,0.2,0.2,0.2,0.2,0.2,0.2,0.2,0.2,0.2,0,0
|
98 |
+
|
99 |
+
Final Model: EBM-v1
|
100 |
+
|
101 |
+
Models Used:
|
102 |
+
|
103 |
+
AOM3.safetensors
|
104 |
+
|
105 |
+
D124FC18F0232D7F0A2A70358CDB1288AF9E1EE8596200F50F0936BE59514F6D
|
106 |
+
|
107 |
+
chilloutmix_NiPrunedFp16Fix.safetensors
|
108 |
+
|
109 |
+
59FFE2243A25C9FE137D590EB3C5C3D3273F1B4C86252DA11BBDC9568773DA0C
|
110 |
+
|
111 |
+
deliberate_v2.ckpt
|
112 |
+
|
113 |
+
9ABA26ABDFCD46073E0A1D42027A3A3BCC969F562D58A03637BF0A0DED6586C9
|
114 |
+
|
115 |
+
pastelmix-better-vae-fp16.safetensors
|
116 |
+
|
117 |
+
D01A68AE76F97506363F387F5F28BB564AD9E20924844FD5945E600B72D39E79
|
118 |
+
|
119 |
+
Credits:
|
120 |
+
|
121 |
+
Thank you to WarriorMama777 for providing AOM and other various mixes as well as detailing your workflow and inspiring me to try mixing my own models.
|
122 |
+
|
123 |
+
Thank you to hako-mikan for creating the SuperMerger extension allowing a quicker workflow for merging.
|
124 |
+
|
125 |
+
Thank you to the creator of ChilloutMix.
|
126 |
+
|
127 |
+
Thank you to XpucT for creating Deliberate.
|
128 |
+
|
129 |
+
Thank you to andite for Pastel-Mix.
|
130 |
+
|
131 |
+
Thank you to AUTO1111 for creating the web UI everyone uses.
|
132 |
+
|
133 |
+
Thank you to StabilityAI for starting everything with Stable Diffusion.
|
134 |
+
|
135 |
+
Thank you to the entire SD community for continuing to openly share and create.
|