Update README.md
Browse files
README.md
CHANGED
@@ -17,6 +17,12 @@ widget: []
|
|
17 |
|
18 |
# SDXL Fine-tuned with Leaf Images
|
19 |
|
|
|
|
|
|
|
|
|
|
|
|
|
20 |
## Model description
|
21 |
|
22 |
These are LoRA adaption weights for the SDXL-base-1.0 model (```stabilityai/stable-diffusion-xl-base-1.0```).
|
|
|
17 |
|
18 |
# SDXL Fine-tuned with Leaf Images
|
19 |
|
20 |
+
DreamBooth is an advanced technique designed for fine-tuning text-to-image diffusion models to generate personalized images of specific subjects. By leveraging a few reference images (around 5 or so), DreamBooth integrates unique visual features of the subject into the model's output domain.
|
21 |
+
|
22 |
+
This is achieved by binding a unique identifier "\<..IDENTIFIER..\>", such as \<leaf microstructure\> in this work, to the subject. An optional class-specific prior preservation loss can be used to maintain high fidelity and contextual diversity. The result is a model capable of synthesizing novel, photorealistic images of the subject in various scenes, poses, and lighting conditions, guided by text prompts. In this project, DreamBooth has been applied to render images with specific biological patterns, making it ideal for applications in materials science and engineering where accurate representation of biological material microstructures is crucial.
|
23 |
+
|
24 |
+
For example, an original prompt might be: "a vase with intricate patterns, high quality." With the fine-tuned model, using the unique identifier, the prompt becomes: "a vase that resembles a \<leaf microstructure\>, high quality." This allows the model to generate images that specifically incorporate the desired biological pattern.
|
25 |
+
|
26 |
## Model description
|
27 |
|
28 |
These are LoRA adaption weights for the SDXL-base-1.0 model (```stabilityai/stable-diffusion-xl-base-1.0```).
|