multimodalart HF staff commited on
Commit
60efcc1
1 Parent(s): 842d2d0

Upload folder using huggingface_hub

Browse files
4857923.jpeg ADDED
4857954.jpeg ADDED
4857994.jpeg ADDED
4857995.jpeg ADDED
4857996.jpeg ADDED
4858004.jpeg ADDED
4858005.jpeg ADDED
4858026.jpeg ADDED
4858028.jpeg ADDED
4858031.jpeg ADDED
README.md ADDED
@@ -0,0 +1,98 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: bespoke-lora-trained-license
4
+ license_link: https://multimodal.art/civitai-licenses?allowNoCredit=True&allowCommercialUse=Rent&allowDerivatives=True&allowDifferentLicense=False
5
+ tags:
6
+ - text-to-image
7
+ - stable-diffusion
8
+ - lora
9
+ - diffusers
10
+ - template:sd-lora
11
+ - disney
12
+ - pixar
13
+ - dreamworks
14
+ - style
15
+ - cartoon
16
+ - sdxl style lora
17
+
18
+ base_model: stabilityai/stable-diffusion-xl-base-1.0
19
+ instance_prompt: DreamDisPix style
20
+ widget:
21
+ - text: 'Shrek playing with olaf in a frozen field DreamDisPix style '
22
+ output:
23
+ url: >-
24
+ 4857923.jpeg
25
+ - text: 'The girl from the incredibles shooting a laser gun DreamDisPix style '
26
+ output:
27
+ url: >-
28
+ 4857954.jpeg
29
+ - text: 'The girl with a pearl earring DreamDisPix style '
30
+ output:
31
+ url: >-
32
+ 4857994.jpeg
33
+ - text: 'Snoop Dogg DreamDisPix style '
34
+ output:
35
+ url: >-
36
+ 4857995.jpeg
37
+ - text: 'A mighty dragon at the dentist DreamDisPix style '
38
+ output:
39
+ url: >-
40
+ 4858005.jpeg
41
+ - text: 'A cute dragon playing with Eevee DreamDisPix style '
42
+ output:
43
+ url: >-
44
+ 4857996.jpeg
45
+ - text: 'Zombie Cinderella has rissen from the dead DreamDisPix style '
46
+ output:
47
+ url: >-
48
+ 4858004.jpeg
49
+ - text: 'Santa riding a might dragon DreamDisPix style '
50
+ output:
51
+ url: >-
52
+ 4858026.jpeg
53
+ - text: 'Pocahontas riding a Zebra DreamDisPix style '
54
+ output:
55
+ url: >-
56
+ 4858031.jpeg
57
+ - text: 'American gothic DreamDisPix style '
58
+ output:
59
+ url: >-
60
+ 4858028.jpeg
61
+
62
+ ---
63
+
64
+ # Dream Dis Pix XL
65
+
66
+ <Gallery />
67
+
68
+
69
+
70
+ ([CivitAI](https://civitai.com/models/242711))
71
+
72
+ ## Model description
73
+
74
+ <p><span>A (kinda failed) attempt to train an SDXL LoRA model upon on a mixed style dataset of images from </span><strong><span>Dream</span></strong><span>works, </span><strong><span>Dis</span></strong><span>ney and </span><strong><span>Pix</span></strong><span>ar. I have uploaded this</span><a rel="ugc" href="https://huggingface.co/datasets/Norod78/DreamDisPix-blip2-captions"><span> Blip2-Captioned Dataset to Huggingface</span></a><span>. </span><br /><br /><span>I usually prefer to train in LoRA ranks 4-16 because so far it always seemed to be enough and provided a reasonably small checkpoint but in this case, I only started getting results when I went for Rank-32, even tried 24 and it was not enough.</span><br /><br />M<span>y conclusion is that it should have probably been trained as several different lower ranked LoRAs each for the specific visual sub-style and it would have probably looked way better for each.</span></p>
75
+
76
+ ## Trigger words
77
+ You should use `DreamDisPix style` to trigger the image generation.
78
+
79
+
80
+ ## Download model
81
+
82
+ Weights for this model are available in Safetensors format.
83
+
84
+ [Download](/Norod78/dream-dis-pix-xl/tree/main) them in the Files & versions tab.
85
+
86
+ ## Use it with the [🧨 diffusers library](https://github.com/huggingface/diffusers)
87
+
88
+ ```py
89
+ from diffusers import AutoPipelineForText2Image
90
+ import torch
91
+
92
+ pipeline = AutoPipelineForText2Image.from_pretrained('stabilityai/stable-diffusion-xl-base-1.0', torch_dtype=torch.float16).to('cuda')
93
+ pipeline.load_lora_weights('Norod78/dream-dis-pix-xl', weight_name='SDXL-DreamDisPix-Lora-r32.safetensors')
94
+ image = pipeline('American gothic DreamDisPix style ').images[0]
95
+ ```
96
+
97
+ For more details, including weighting, merging and fusing LoRAs, check the [documentation on loading LoRAs in diffusers](https://huggingface.co/docs/diffusers/main/en/using-diffusers/loading_adapters)
98
+
SDXL-DreamDisPix-Lora-r32.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8233dbcf24a610701686c5eb096aa02aa18f7c5d14db9009e53fcc9973acff00
3
+ size 228504012