Ryan commited on
Commit
e0a58d7
1 Parent(s): bc11b58

Adding model

Browse files
README.md CHANGED
@@ -1,3 +1,87 @@
1
  ---
2
- license: mit
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ license: creativeml-openrail-m
3
+ tags:
4
+ - stable-diffusion
5
+ - text-to-image
6
+ - santa claus
7
  ---
8
+ # 🎁 Ornamental Santa Diffusion
9
+
10
+ Fine-tuned Stable Diffusion model, based of F222, trained with pictures from various Santa Claus themed ornaments and knick-knacks.
11
+ Use the tokens **_orna santa_** in your prompts for the effect.
12
+
13
+ This model was also merged with [Anythingv3](https://huggingface.co/Linaqruf/anything-v3.0) and [Mo Di Diffusion](https://huggingface.co/nitrosocke/mo-di-diffusion).
14
+
15
+ **If you enjoy this model, buy us some coffee**
16
+ [![Buy a coffee](https://badgen.net/badge/icon/kofi?icon=kofi&label)](https://ko-fi.com/3eegames)
17
+
18
+ ---
19
+
20
+ **Santa Claus with detailed prompts rendered with the model:**
21
+ ![Detailed Samples](https://huggingface.co/3ee/ornamental-santa/resolve/main/grid3.png)
22
+ **Output from basic and vivid prompts:**
23
+ ![Basic Samples](https://huggingface.co/3ee/ornamental-santa/resolve/main/grid4.png)
24
+ **Giving more weight to the ornament style:**
25
+ ![Ornamental Style](https://huggingface.co/3ee/ornamental-santa/resolve/main/grid1.png)
26
+ **Landscapes and backgrounds rendered with the model:**
27
+ ![Landscapes](https://huggingface.co/3ee/ornamental-santa/resolve/main/grid2.png)
28
+
29
+
30
+ ## 🧾 Prompt examples:
31
+
32
+ **Basic starting point**
33
+
34
+ ```orna santa with cookies```
35
+
36
+ [Negative prompt](#negative-prompt-template)
37
+
38
+ _Steps: 18, Sampler: Euler a, CFG scale: 11.5, Seed: 2480441584, Size: 512x512, Model hash: b7ba5b22_
39
+
40
+ **Activate F222 and Mo-Di models**
41
+
42
+ ```Perfectly-centered portrait-photograph of a real life godly 1man orna santa with cookies descending from heaven, stars, lifelike, super highly detailed, professional digital painting, artstation, christmas decor, Unreal Engine 5, Photorealism, HD quality, 8k resolution, cinema 4d, 3D, beautiful, cinematic, modern disney style, white hair, golden eyes, beautiful eyes, detail, flower meadow, cumulonimbus clouds, lighting, detailed sky, garden,art by artgerm and greg rutkowski and alphonse mucha and loish and WLOP_```
43
+
44
+ _Steps: 32, Sampler: DPM adaptive, CFG scale: 12, Seed: 1639653330, Size: 512x512, Model hash: 697c8786_
45
+
46
+ [Negative prompt](#negative-prompt-template)
47
+
48
+
49
+ ## ❎ Negative Prompt Template
50
+
51
+ All images were rendered with the negative prompt below:
52
+
53
+ ```((((ugly)))), (((duplicate))), ((morbid)), ((mutilated)), [out of frame], extra fingers, mutated hands, ((poorly drawn hands)), ((poorly drawn face)), (((mutation))), (((deformed))), ((ugly)), blurry, ((bad anatomy)), (((bad proportions))), ((extra limbs)), cloned face, (((disfigured))). out of frame, ugly, extra limbs, (bad anatomy), gross proportions, (malformed limbs), ((missing arms)), ((missing legs)), (((extra arms))), (((extra legs))), mutated hands, (fused fingers), (too many fingers), (((long neck)))```
54
+
55
+ ## 🍪 Diffusers
56
+
57
+ This model can be used just like any other Stable Diffusion model. For more information,
58
+ please have a look at the [Stable Diffusion](https://huggingface.co/docs/diffusers/api/pipelines/stable_diffusion).
59
+
60
+ Export the model:
61
+ - [ONNX](https://huggingface.co/docs/diffusers/optimization/onnx)
62
+ - [MPS](https://huggingface.co/docs/diffusers/optimization/mps)
63
+ - FLAX/JAX
64
+
65
+ ```python
66
+ from diffusers import StableDiffusionPipeline
67
+ import torch
68
+
69
+ model_id = "3ee/ornamental-santa"
70
+ pipe = StableDiffusionPipeline.from_pretrained(model_id, torch_dtype=torch.float16)
71
+ pipe = pipe.to("cuda")
72
+
73
+ prompt = "orna santa holding a plate of cookies"
74
+ image = pipe(prompt).images[0]
75
+
76
+ image.save("./santa_cookies.png")
77
+ ```
78
+
79
+ ## License
80
+
81
+ This model is open access and available to all, with a CreativeML OpenRAIL-M license further specifying rights and usage.
82
+ The CreativeML OpenRAIL License specifies:
83
+
84
+ - You can't use the model to deliberately produce nor share illegal or harmful outputs or content
85
+ - The authors claims no rights on the outputs you generate, you are free to use them and are accountable for their use which must not go against the provisions set in the license
86
+ - You may re-distribute the weights and use the model commercially and/or as a service. If you do, please be aware you have to include the same use restrictions as the ones in the license and share a copy of the CreativeML OpenRAIL-M to all your users (please read the license entirely and carefully)
87
+ [Please read the full license here](https://huggingface.co/spaces/CompVis/stable-diffusion-license)
grid1.png ADDED

Git LFS Details

  • SHA256: d0560669c4d9976a7c83b97e642f8b71e3c2501599f6d1d5fcfbfe4c799e43f7
  • Pointer size: 132 Bytes
  • Size of remote file: 3.07 MB
grid2.png ADDED

Git LFS Details

  • SHA256: b899fb2c852869d3390736f8c7b778e388e90cddbb2693e631d7b8cdf77bd1dd
  • Pointer size: 132 Bytes
  • Size of remote file: 2.85 MB
grid3.png ADDED

Git LFS Details

  • SHA256: 4a77daaf89b63b09bfd502f6462fc24f5e93a7b5970d6ae676002f6df3b26bc0
  • Pointer size: 132 Bytes
  • Size of remote file: 2.84 MB
grid4.png ADDED

Git LFS Details

  • SHA256: b4a78f4ec709fafe98974e0a404ef7f76576770e557e3b64d50d817a26c0e6ea
  • Pointer size: 132 Bytes
  • Size of remote file: 2.58 MB
model_index.json ADDED
@@ -0,0 +1,33 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "StableDiffusionPipeline",
3
+ "_diffusers_version": "0.9.0",
4
+ "feature_extractor": [
5
+ null,
6
+ null
7
+ ],
8
+ "requires_safety_checker": null,
9
+ "safety_checker": [
10
+ null,
11
+ null
12
+ ],
13
+ "scheduler": [
14
+ "diffusers",
15
+ "DDIMScheduler"
16
+ ],
17
+ "text_encoder": [
18
+ "transformers",
19
+ "CLIPTextModel"
20
+ ],
21
+ "tokenizer": [
22
+ "transformers",
23
+ "CLIPTokenizer"
24
+ ],
25
+ "unet": [
26
+ "diffusers",
27
+ "UNet2DConditionModel"
28
+ ],
29
+ "vae": [
30
+ "diffusers",
31
+ "AutoencoderKL"
32
+ ]
33
+ }
ornasanta_AnythingV3.0_fp16_0.8.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b3b2ac881f48077cadb9f0b74cd7ddacd2c82526fb3dc1321cb9e2a2b273d531
3
+ size 4098020972
scheduler/scheduler_config.json ADDED
@@ -0,0 +1,13 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "DDIMScheduler",
3
+ "_diffusers_version": "0.9.0",
4
+ "beta_end": 0.012,
5
+ "beta_schedule": "scaled_linear",
6
+ "beta_start": 0.00085,
7
+ "clip_sample": false,
8
+ "num_train_timesteps": 1000,
9
+ "prediction_type": "epsilon",
10
+ "set_alpha_to_one": false,
11
+ "steps_offset": 1,
12
+ "trained_betas": null
13
+ }
text_encoder/config.json ADDED
@@ -0,0 +1,25 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "C:\\Users\\ryguy\\Documents\\github\\stable-diffusion-webui\\models\\dreambooth\\ornasanta\\working",
3
+ "architectures": [
4
+ "CLIPTextModel"
5
+ ],
6
+ "attention_dropout": 0.0,
7
+ "bos_token_id": 0,
8
+ "dropout": 0.0,
9
+ "eos_token_id": 2,
10
+ "hidden_act": "quick_gelu",
11
+ "hidden_size": 768,
12
+ "initializer_factor": 1.0,
13
+ "initializer_range": 0.02,
14
+ "intermediate_size": 3072,
15
+ "layer_norm_eps": 1e-05,
16
+ "max_position_embeddings": 77,
17
+ "model_type": "clip_text_model",
18
+ "num_attention_heads": 12,
19
+ "num_hidden_layers": 12,
20
+ "pad_token_id": 1,
21
+ "projection_dim": 768,
22
+ "torch_dtype": "float32",
23
+ "transformers_version": "4.21.0",
24
+ "vocab_size": 49408
25
+ }
text_encoder/pytorch_model.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ef53044e5a2b9fffb500ba9ac8a8188834b9bf239d981944899ae0ad289bf5e3
3
+ size 492308087
tokenizer/merges.txt ADDED
The diff for this file is too large to render. See raw diff
tokenizer/special_tokens_map.json ADDED
@@ -0,0 +1,24 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token": {
3
+ "content": "<|startoftext|>",
4
+ "lstrip": false,
5
+ "normalized": true,
6
+ "rstrip": false,
7
+ "single_word": false
8
+ },
9
+ "eos_token": {
10
+ "content": "<|endoftext|>",
11
+ "lstrip": false,
12
+ "normalized": true,
13
+ "rstrip": false,
14
+ "single_word": false
15
+ },
16
+ "pad_token": "<|endoftext|>",
17
+ "unk_token": {
18
+ "content": "<|endoftext|>",
19
+ "lstrip": false,
20
+ "normalized": true,
21
+ "rstrip": false,
22
+ "single_word": false
23
+ }
24
+ }
tokenizer/tokenizer_config.json ADDED
@@ -0,0 +1,34 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_prefix_space": false,
3
+ "bos_token": {
4
+ "__type": "AddedToken",
5
+ "content": "<|startoftext|>",
6
+ "lstrip": false,
7
+ "normalized": true,
8
+ "rstrip": false,
9
+ "single_word": false
10
+ },
11
+ "do_lower_case": true,
12
+ "eos_token": {
13
+ "__type": "AddedToken",
14
+ "content": "<|endoftext|>",
15
+ "lstrip": false,
16
+ "normalized": true,
17
+ "rstrip": false,
18
+ "single_word": false
19
+ },
20
+ "errors": "replace",
21
+ "model_max_length": 77,
22
+ "name_or_path": "C:\\Users\\ryguy\\Documents\\github\\stable-diffusion-webui\\models\\dreambooth\\ornasanta\\working\\tokenizer",
23
+ "pad_token": "<|endoftext|>",
24
+ "special_tokens_map_file": "./special_tokens_map.json",
25
+ "tokenizer_class": "CLIPTokenizer",
26
+ "unk_token": {
27
+ "__type": "AddedToken",
28
+ "content": "<|endoftext|>",
29
+ "lstrip": false,
30
+ "normalized": true,
31
+ "rstrip": false,
32
+ "single_word": false
33
+ }
34
+ }
tokenizer/vocab.json ADDED
The diff for this file is too large to render. See raw diff
unet/config.json ADDED
@@ -0,0 +1,41 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "UNet2DConditionModel",
3
+ "_diffusers_version": "0.9.0",
4
+ "_name_or_path": "C:\\Users\\ryguy\\Documents\\github\\stable-diffusion-webui\\models\\dreambooth\\ornasanta\\working",
5
+ "act_fn": "silu",
6
+ "attention_head_dim": 8,
7
+ "block_out_channels": [
8
+ 320,
9
+ 640,
10
+ 1280,
11
+ 1280
12
+ ],
13
+ "center_input_sample": false,
14
+ "cross_attention_dim": 768,
15
+ "down_block_types": [
16
+ "CrossAttnDownBlock2D",
17
+ "CrossAttnDownBlock2D",
18
+ "CrossAttnDownBlock2D",
19
+ "DownBlock2D"
20
+ ],
21
+ "downsample_padding": 1,
22
+ "dual_cross_attention": false,
23
+ "flip_sin_to_cos": true,
24
+ "freq_shift": 0,
25
+ "in_channels": 4,
26
+ "layers_per_block": 2,
27
+ "mid_block_scale_factor": 1,
28
+ "norm_eps": 1e-05,
29
+ "norm_num_groups": 32,
30
+ "num_class_embeds": null,
31
+ "only_cross_attention": false,
32
+ "out_channels": 4,
33
+ "sample_size": 64,
34
+ "up_block_types": [
35
+ "UpBlock2D",
36
+ "CrossAttnUpBlock2D",
37
+ "CrossAttnUpBlock2D",
38
+ "CrossAttnUpBlock2D"
39
+ ],
40
+ "use_linear_projection": false
41
+ }
unet/diffusion_pytorch_model.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:379e9a6283f3874d2400eea197d00a02c05b0dd4dcaa2d926557099f91f9342f
3
+ size 3438364325
vae/config.json ADDED
@@ -0,0 +1,30 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "AutoencoderKL",
3
+ "_diffusers_version": "0.9.0",
4
+ "_name_or_path": "C:\\Users\\ryguy\\Documents\\github\\stable-diffusion-webui\\models\\dreambooth\\ornasanta\\working",
5
+ "act_fn": "silu",
6
+ "block_out_channels": [
7
+ 128,
8
+ 256,
9
+ 512,
10
+ 512
11
+ ],
12
+ "down_block_types": [
13
+ "DownEncoderBlock2D",
14
+ "DownEncoderBlock2D",
15
+ "DownEncoderBlock2D",
16
+ "DownEncoderBlock2D"
17
+ ],
18
+ "in_channels": 3,
19
+ "latent_channels": 4,
20
+ "layers_per_block": 2,
21
+ "norm_num_groups": 32,
22
+ "out_channels": 3,
23
+ "sample_size": 256,
24
+ "up_block_types": [
25
+ "UpDecoderBlock2D",
26
+ "UpDecoderBlock2D",
27
+ "UpDecoderBlock2D",
28
+ "UpDecoderBlock2D"
29
+ ]
30
+ }
vae/diffusion_pytorch_model.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eb8bfec1946af8d97bea496018e01cd1b1c290dcb72e2bdf41e044064709ebb9
3
+ size 167402961