inital commit for model

.gitattributes

@@ -32,3 +32,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+*.png filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,141 @@
+---
+license: creativeml-openrail-m
+tags:
+- stable-diffusion
+- stable-diffusion-diffusers
+- text-to-image
+- art
+- artistic
+- diffusers
+- final fantasy
+---
+
+# 🎁 effeffIX Concept Diffusion
+
+
+Fine-tuned Stable Diffusion model, based of ```F222```, trained with concept art from a high quality role playing game.
+
+![Detailed Samples](https://huggingface.co/zuleo/effeffIX-concept-diffusion/resolve/main/booth5.png)
+
+## Model Usage
+
+This model was trained on multiple concepts.  Use the tokens below:
+
+| Token                | Description                                          |
+|----------------------|------------------------------------------------------|
+| effeff9 woman        | Uses concepts trained on female designs.             |
+| effeff9 man          | Uses concepts trained on male designs.               |
+| effeff9 creature     | Uses concepts trained on different creature designs. |
+| effeff9 architecture | Uses concepts trained on architecture design.        |
+
+---
+
+### Examples: effeff9 woman
+
+![Detailed Samples](https://huggingface.co/zuleo/effeffIX-concept-diffusion/resolve/main/booth1.png)
+
+### Examples: effeff9 man
+
+![Detailed Samples](https://huggingface.co/zuleo/effeffIX-concept-diffusion/resolve/main/booth2.png)
+
+### Examples: effeff9 creature
+
+![Detailed Samples](https://huggingface.co/zuleo/effeffIX-concept-diffusion/resolve/main/booth3.png)
+
+### Examples: effeff9 architecture
+
+![Detailed Samples](https://huggingface.co/zuleo/effeffIX-concept-diffusion/resolve/main/booth4.png)
+
+
+---
+
+☕ If you enjoy this model, buy us a coffee [![Buy a coffee](https://badgen.net/badge/icon/kofi?icon=kofi&label=buy%20us%20a%20coffee)](https://ko-fi.com/3eegames)
+
+---
+
+
+## 🧾 Prompt examples:
+
+**The amazing Aubrey Plaza**
+
+```Wide shot of a effeff9 woman warrior aubrey plaza with shining armor descending from heaven, lifelike, (highly detailed eyes), super highly detailed face, professional digital painting, artstation, concept art, Unreal Engine 5, HD quality, 8k resolution, beautiful, cinematic, art by artgerm and greg rutkowski and alphonse mucha and loish and WLOP```
+
+[Negative prompt](#❎-negative-prompt-template)
+
+_Steps: 82, Sampler: DPM++ 2M, CFG scale: 8.5, Seed: 695884347, Size: 512x512, Model hash: b7ba5b22_
+
+---
+
+**The Wise Giraffe**
+
+```portrait of a effeff9 creature Giraffe, artstation, concept art, Unreal Engine 5, HD quality, 4k resolution, beautiful, cinematic, art by artgerm and greg rutkowski and alphonse mucha and loish and WLOP```
+
+[Negative prompt](#❎-negative-prompt-template)
+
+_Steps: 90, Sampler: DPM++ 2M Karras, CFG scale: 8.5, Seed: 2821955656, Size: 512x512, Model hash: b7ba5b22_
+
+---
+
+**The drag of the kingdom**
+
+```Wide shot of a grand kingdom, lifelike, super highly detailed, professional digital painting, artstation, concept art, Unreal Engine 5, HD quality, 8k resolution, beautiful, cinematic, art by artgerm and greg rutkowski and alphonse mucha and loish and WLOP, (effeff9 architecture)```
+
+[Negative prompt](#❎-negative-prompt-template)
+
+_Steps: 90, Sampler: DDIM, CFG scale: 13.5, Seed: 2625868484, Size: 512x512, Model hash: b7ba5b22_
+
+---
+
+**The steamy momoa**
+
+```Perfectly-centered portrait of a effeff9 MAN jason momoa with shining scales descending from heaven, concept art, ART STATION, BEAUTIFUL PERFECT detailed MANGA EYES, art by artgerm and greg rutkowski and alphonse mucha and loish and WLOP```
+
+[Negative prompt](#❎-negative-prompt-template)
+
+_Steps: 56, Sampler: DPM++ 2M Karras, CFG scale: 11, Seed: 3257609354, Size: 512x512, Model hash: b7ba5b22_
+
+
+---
+
+
+## ❎ Negative Prompt Template
+
+This model offers a unique style where characters typically have larger, exaggerated sleeves and hands.  To supress this style, add more variants to adjust the hand style.
+
+All images were rendered with the negative prompt below:
+
+```Negative prompt: ((((ugly)))), (((duplicate))), ((morbid)), ((mutilated)), [out of frame], extra fingers, ((poorly drawn face)), (((mutation))), (((deformed))), ((ugly)), blurry, ((bad anatomy)), ((extra limbs)), cloned face, (((disfigured))), out of frame, extra limbs, (bad anatomy), gross proportions, (malformed limbs), ((missing arms)), ((missing legs)), (((extra arms))), (((extra legs))),  (fused fingers), (too many fingers), (((long neck)))```
+
+## 🧨 Diffusers
+
+This model can be used just like any other Stable Diffusion model. For more information,
+please have a look at the [Stable Diffusion](https://huggingface.co/docs/diffusers/api/pipelines/stable_diffusion).
+
+Export the model:
+- [ONNX](https://huggingface.co/docs/diffusers/optimization/onnx)
+- [MPS](https://huggingface.co/docs/diffusers/optimization/mps)
+- [FLAX/JAX](https://huggingface.co/blog/stable_diffusion_jax)
+
+```python
+from diffusers import StableDiffusionPipeline
+import torch
+
+model_id = "zuleo/effeffIX-concept-diffusion"
+pipe = StableDiffusionPipeline.from_pretrained(model_id, torch_dtype=torch.float16)
+pipe = pipe.to("cuda")
+
+prompt = "effeff9 woman aubrey plaza"
+image = pipe(prompt).images[0]
+
+image.save("./i_luv_aubrey_plaza.png")
+```
+
+## License
+
+This model is open access and available to all, with a CreativeML OpenRAIL-M license further specifying rights and usage.
+The CreativeML OpenRAIL License specifies: 
+
+-  You can't use the model to deliberately produce nor share illegal or harmful outputs or content 
+-  The authors claims no rights on the outputs you generate, you are free to use them and are accountable for their use which must not go against the provisions set in the license
+-  You may re-distribute the weights and use the model commercially and/or as a service. If you do, please be aware you have to include the same use restrictions as the ones in the license and share a copy of the CreativeML OpenRAIL-M to all your users (please read the license entirely and carefully)
+[Please read the full license here](https://huggingface.co/spaces/CompVis/stable-diffusion-license)

effeffIX.ckpt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:293f21fb7fccd1a96fbcc69e6557117b30a0323ca5bfebc45988f81f1111bfd7
+size 4098020782

model_index.json

@@ -0,0 +1,33 @@
+{
+  "_class_name": "StableDiffusionPipeline",
+  "_diffusers_version": "0.9.0",
+  "feature_extractor": [
+    null,
+    null
+  ],
+  "requires_safety_checker": null,
+  "safety_checker": [
+    null,
+    null
+  ],
+  "scheduler": [
+    "diffusers",
+    "DDIMScheduler"
+  ],
+  "text_encoder": [
+    "transformers",
+    "CLIPTextModel"
+  ],
+  "tokenizer": [
+    "transformers",
+    "CLIPTokenizer"
+  ],
+  "unet": [
+    "diffusers",
+    "UNet2DConditionModel"
+  ],
+  "vae": [
+    "diffusers",
+    "AutoencoderKL"
+  ]
+}

scheduler/scheduler_config.json

@@ -0,0 +1,13 @@
+{
+  "_class_name": "DDIMScheduler",
+  "_diffusers_version": "0.9.0",
+  "beta_end": 0.012,
+  "beta_schedule": "scaled_linear",
+  "beta_start": 0.00085,
+  "clip_sample": false,
+  "num_train_timesteps": 1000,
+  "prediction_type": "epsilon",
+  "set_alpha_to_one": false,
+  "steps_offset": 1,
+  "trained_betas": null
+}

text_encoder/config.json

@@ -0,0 +1,25 @@
+{
+  "_name_or_path": "C:\\Users\\ryguy\\Documents\\github\\stable-diffusion-webui\\models\\dreambooth\\ff93\\working",
+  "architectures": [
+    "CLIPTextModel"
+  ],
+  "attention_dropout": 0.0,
+  "bos_token_id": 0,
+  "dropout": 0.0,
+  "eos_token_id": 2,
+  "hidden_act": "quick_gelu",
+  "hidden_size": 768,
+  "initializer_factor": 1.0,
+  "initializer_range": 0.02,
+  "intermediate_size": 3072,
+  "layer_norm_eps": 1e-05,
+  "max_position_embeddings": 77,
+  "model_type": "clip_text_model",
+  "num_attention_heads": 12,
+  "num_hidden_layers": 12,
+  "pad_token_id": 1,
+  "projection_dim": 768,
+  "torch_dtype": "float32",
+  "transformers_version": "4.21.0",
+  "vocab_size": 49408
+}

text_encoder/pytorch_model.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:332bda1a46f1236ef9e323e8fcf9d5d0191588e28a442a3cc03ffd6ee65d2323
+size 492308087

tokenizer/special_tokens_map.json

@@ -0,0 +1,24 @@
+{
+  "bos_token": {
+    "content": "<|startoftext|>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "<|endoftext|>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": "<|endoftext|>",
+  "unk_token": {
+    "content": "<|endoftext|>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer/tokenizer_config.json

@@ -0,0 +1,34 @@
+{
+  "add_prefix_space": false,
+  "bos_token": {
+    "__type": "AddedToken",
+    "content": "<|startoftext|>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "do_lower_case": true,
+  "eos_token": {
+    "__type": "AddedToken",
+    "content": "<|endoftext|>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "errors": "replace",
+  "model_max_length": 77,
+  "name_or_path": "C:\\Users\\ryguy\\Documents\\github\\stable-diffusion-webui\\models\\dreambooth\\ff93\\working\\tokenizer",
+  "pad_token": "<|endoftext|>",
+  "special_tokens_map_file": "./special_tokens_map.json",
+  "tokenizer_class": "CLIPTokenizer",
+  "unk_token": {
+    "__type": "AddedToken",
+    "content": "<|endoftext|>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  }
+}

unet/config.json

@@ -0,0 +1,41 @@
+{
+  "_class_name": "UNet2DConditionModel",
+  "_diffusers_version": "0.9.0",
+  "_name_or_path": "C:\\Users\\ryguy\\Documents\\github\\stable-diffusion-webui\\models\\dreambooth\\ff93\\working",
+  "act_fn": "silu",
+  "attention_head_dim": 8,
+  "block_out_channels": [
+    320,
+    640,
+    1280,
+    1280
+  ],
+  "center_input_sample": false,
+  "cross_attention_dim": 768,
+  "down_block_types": [
+    "CrossAttnDownBlock2D",
+    "CrossAttnDownBlock2D",
+    "CrossAttnDownBlock2D",
+    "DownBlock2D"
+  ],
+  "downsample_padding": 1,
+  "dual_cross_attention": false,
+  "flip_sin_to_cos": true,
+  "freq_shift": 0,
+  "in_channels": 4,
+  "layers_per_block": 2,
+  "mid_block_scale_factor": 1,
+  "norm_eps": 1e-05,
+  "norm_num_groups": 32,
+  "num_class_embeds": null,
+  "only_cross_attention": false,
+  "out_channels": 4,
+  "sample_size": 64,
+  "up_block_types": [
+    "UpBlock2D",
+    "CrossAttnUpBlock2D",
+    "CrossAttnUpBlock2D",
+    "CrossAttnUpBlock2D"
+  ],
+  "use_linear_projection": false
+}

unet/diffusion_pytorch_model.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:06893e409d2cfc79fa8084780decb09243f9c37e93c236478e11ae298209d82a
+size 3438364325

vae/config.json

@@ -0,0 +1,30 @@
+{
+  "_class_name": "AutoencoderKL",
+  "_diffusers_version": "0.9.0",
+  "_name_or_path": "C:\\Users\\ryguy\\Documents\\github\\stable-diffusion-webui\\models\\dreambooth\\ff93\\working",
+  "act_fn": "silu",
+  "block_out_channels": [
+    128,
+    256,
+    512,
+    512
+  ],
+  "down_block_types": [
+    "DownEncoderBlock2D",
+    "DownEncoderBlock2D",
+    "DownEncoderBlock2D",
+    "DownEncoderBlock2D"
+  ],
+  "in_channels": 3,
+  "latent_channels": 4,
+  "layers_per_block": 2,
+  "norm_num_groups": 32,
+  "out_channels": 3,
+  "sample_size": 256,
+  "up_block_types": [
+    "UpDecoderBlock2D",
+    "UpDecoderBlock2D",
+    "UpDecoderBlock2D",
+    "UpDecoderBlock2D"
+  ]
+}

vae/diffusion_pytorch_model.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:eb8bfec1946af8d97bea496018e01cd1b1c290dcb72e2bdf41e044064709ebb9
+size 167402961