dataautogpt3 commited on
Commit
1e606c6
1 Parent(s): 9c5adcb

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +88 -0
README.md ADDED
@@ -0,0 +1,88 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ pipeline_tag: text-to-image
3
+ widget:
4
+ - text: >-
5
+ high quality, portrait photo of 30 y.o european man, wearing black shirt, serious face, cinematic shot, dramatic lighting
6
+ output:
7
+ url: 1man.png
8
+ - text: >-
9
+ A tiny robot taking a break under a tree in the garden
10
+ output:
11
+ url: robot.png
12
+ - text: >-
13
+ mystery
14
+ output:
15
+ url: mystery.png
16
+ - text: >-
17
+ a cat wearing sunglasses in the summer
18
+ output:
19
+ url: cat.png
20
+ - text: >-
21
+ robot holding a sign that says ’a storm is coming’
22
+ output:
23
+ url: storm.png
24
+ - text: >-
25
+ the vibrance of the human soul
26
+ output:
27
+ url: soul.png
28
+ - text: >-
29
+ Lady of War, chique dark clothes, vinyl, imposing pose, anime style, 90s
30
+ output:
31
+ url: anime.png
32
+
33
+ license: cc-by-nc-nd-4.0
34
+ ---
35
+
36
+ # Constructive Deconstruction: Domain-Agnostic Debiasing of Diffusion Models
37
+
38
+ ## Introduction
39
+
40
+ Constructive Deconstruction is a novel approach to debiasing diffusion models used in generative tasks like image synthesis. This method enhances the quality and fidelity of generated images across various domains by removing biases inherited from the training data. Our technique involves overtraining the model to a controlled noisy state, applying nightshading, and using bucketing techniques to realign the model's internal representations.
41
+
42
+ ## Methodology
43
+
44
+ ### Overtraining to Controlled Noisy State
45
+ By purposely overtraining the model until it predictably fails, we create a controlled noisy state. This state helps in identifying and addressing the inherent biases in the model's training data.
46
+
47
+ ### Nightshading
48
+ Nightshading is repurposed to induce a controlled failure, making it easier to retrain the model. This involves injecting carefully selected data points to stress the model and cause predictable failures.
49
+
50
+ ### Bucketing
51
+ Using mathematical techniques like slerp (Spherical Linear Interpolation) and bislerp (Bilinear Interpolation), we merge the induced noise back into the model. This step highlights the model's learned knowledge while suppressing biases.
52
+
53
+ ### Retraining and Fine-Tuning
54
+ The noisy state is retrained on a large, diverse dataset to create a new base model called "Mobius." Initial issues such as grainy details and inconsistent colors are resolved during fine-tuning, resulting in high-quality, unbiased outputs.
55
+
56
+ ## Results and Highlights
57
+
58
+ ### Increased Diversity of Outputs
59
+ Training the model on high-quality data naturally increases the diversity of the generated outputs without intentionally loosening associations. This leads to improved generalization and variety in generated images.
60
+
61
+ ### Empirical Validation
62
+ Extensive experiments and fine-tuning demonstrate the effectiveness of our method, resulting in high-quality, unbiased outputs across various styles and domains.
63
+
64
+ ## Example Outputs
65
+
66
+ <Gallery />
67
+
68
+ Here are some examples of images generated by the MobiusJourney model using different prompts:
69
+
70
+ - ![High Quality Portrait](1man.png)
71
+ - ![Tiny Robot](robot.png)
72
+ - ![Mystery](mystery.png)
73
+ - ![Cat Wearing Sunglasses](cat.png)
74
+ - ![Robot Holding a Sign](storm.png)
75
+ - ![The Vibrance of the Human Soul](soul.png)
76
+ - ![Lady of War](anime.png)
77
+
78
+ ## Usage and Recommendations
79
+
80
+ For optimal performance, we recommend the following settings:
81
+ - **CLIP Setting**: -2
82
+ - **CFG Scaling**: 8.5 for standard requests, 3.5 for more artistic explorations
83
+
84
+ This model supports and encourages experimentation with various tags, offering users the freedom to explore their creative visions in depth.
85
+
86
+ ## License
87
+
88
+ This model is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0) license.