File size: 5,827 Bytes
d8503bd |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 |
---
license: creativeml-openrail-m
tags:
- coreml
- stable-diffusion
- text-to-image
---
# Core ML Converted Model
This model was converted to Core ML for use on Apple Silicon devices by following Apple's instructions [here](https://github.com/apple/ml-stable-diffusion#-converting-models-to-core-ml).<br>
Provide the model to an app such as [Mochi Diffusion](https://github.com/godly-devotion/MochiDiffusion) to generate images.<br>
`split_einsum` version is compatible with all compute unit options including Neural Engine.<br>
`original` version is only compatible with CPU & GPU option.
# AbyssOrangeMix2 (AOM2)
――Creating the next generation of illustration with “Abyss”!
<img src="https://github.com/WarriorMama777/imgup/blob/main/img/AbyssOrangeMix2/HeroImage_AbyssOrangeMix2_Designed_01_comp001.webp?raw=true" width="" height="" alt=”HeroImage_AbyssOrangeMix2_Designed_01_comp001”>
Prompt: [https://majinai.art/ja/i/nxpKRpw](https://majinai.art/ja/i/nxpKRpw)
▼About
AbyssOrangeMix2 (AOM2) is an AI model capable of generating high-quality, highly realistic illustrations.
It can generate elaborate and detailed illustrations that cannot be drawn by hand. It can also be used for a variety of purposes, making it extremely useful for design and artwork.
Furthermore, it provides an unparalleled new means of expression.
It can generate illustrations in a variety of genres to meet a wide range of needs. I encourage you to use "Abyss" to make your designs and artwork richer and of higher quality.
<img src="https://raw.githubusercontent.com/WarriorMama777/imgup/main/img/AbyssOrangeMix2/UBM_ON_OFF_4_comp001.webp" width="" height="" alt=”UBM_ON_OFF_4_comp001.webp”>
※nvidia joke.
▼Description for engineers/enthusiasts
The merged model was formulated using an extension such as sdweb-merge-block-weighted-gui, which merges models at separate rates for each of the 25 U-Net blocks (input, intermediate, and output).
The validation of many Anons has shown that such a recipe can generate a painting style that is anatomically realistic enough to feel the finger skeleton, but still maintains an anime-style face.
The changes from AbyssOrangeMix are as follows.
1. the model used for U-Net Blocks Weight Merge was changed from Instagram+F222 to BasilMix. (<https://huggingface.co/nuigurumi>)
This is an excellent merge model that can generate decent human bodies while maintaining the facial layers of the Instagram model. Thanks!!!
This has improved the dullness of the color and given a more Japanese skin tone (or more precisely, the moisturized white skin that the Japanese would ideally like).
Also, the unnatural bokeh that sometimes occurred in the previous version may have been eliminated (needs to be verified).
2.Added IN deep layers (IN06-11) to the layer merging from the realistic model (BasilMix).
It is said that the IN deep layer (IN06-11) is the layer that determines composition, etc., but perhaps light, reflections, skin texture, etc., may also be involved.
It is like "Global Illumination," "Normal Map," and "Ambient Occlusion" in 3DCG.
<img src="https://github.com/WarriorMama777/imgup/blob/main/img/AbyssOrangeMix2/AbyssOrangeMix2_comparison_comp001.webp?raw=true" width="" height="" alt=”AbyssOrangeMix2_comparison_comp001”>
※This does not fundamentally improve the fingers, and I recommend using bad_prompt, etc. (Embedding) in combination.
About 30-50% chance of generating correct fingers(?). Abyss is deep.
▼Sample Gallery
The prompts for generating these images were all generated using ChatGPT. I simply asked "Pirates sailing the oceans" to tell me what the prompts were.
However, to make sure the AI understood the specifications, I used the template for AI questions (Question template for AI prompt generation(v1.2) ).
Please review the following.
```jsx
https://seesaawiki.jp/nai_ch/d/AI%a4%f2%b3%e8%cd%d1%a4%b7%a4%bf%a5%d7%a5%ed%a5%f3%a5%d7%a5%c8%c0%b8%c0%ae
```
The images thus generated, strangely enough, look like MidJourney or Nijijourney illustrations. Perhaps they are passing user prompts through GPT or something else before passing them on to the image AI🤔
<img src="https://github.com/WarriorMama777/imgup/blob/main/img/AbyssOrangeMix2/SampleGallerBoardDesign_AbyssOrangeMix2_ReadMore_comp001.webp?raw=true" width="" height="" alt=”SampleGallerBoardDesign_AbyssOrangeMix2_03_comp001”>
<details>
<summary>▼READ MORE🖼</summary>
<img src="https://github.com/WarriorMama777/imgup/blob/main/img/AbyssOrangeMix2/SampleGallerBoardDesign_AbyssOrangeMix2_03_comp001.webp?raw=true" width="" height="" alt=”SampleGallerBoardDesign_AbyssOrangeMix2_03_comp001”>
▼All prompts to generate sample images
1. [Gaming Girl](https://majinai.art/ja/i/GbTbLyk)
2. [Fantasy](https://majinai.art/ja/i/ax45Pof)
3. [Rainy Day](https://majinai.art/ja/i/1P9DUul)
4. [Kemomimi Girl](https://majinai.art/ja/i/hrUSb31)
5. [Supermarket](https://majinai.art/ja/i/6Mf4bVK)
6. [Lunch Time](https://majinai.art/ja/i/YAgQ4On)
7. [Womens in the Garden](https://majinai.art/ja/i/oHZYum_)
8. [Pirate](https://majinai.art/ja/i/yEA3EZk)
9. [Japanese Girl](https://majinai.art/ja/i/x4G_B_e)
10. [Sweets Time](https://majinai.art/ja/i/vK_mkac)
11. [Glasses Girl](https://majinai.art/ja/i/Z87IHOC)
</details>
▼How to use
- VAE: orangemix.vae.pt
- ~~Prompts can be long or short~~
As simple as possible is good. Do not add excessive detail prompts. Start with just this negative propmt.
(worst quality, low quality:1.4)
- Sampler: “DPM++ SDE Karras” is good
- Steps: forTest: 12~ ,illustration: 20~
- Clipskip: 1 or 2
- Upscaler : Latenet (nearest-exact)
- CFG Scale : 5 or 6 (4~8)
- Denoise strength: 0.5 (0.45~0.6)
If you use 0.7~, the picture will change too much.
If below 0.45, Block noise occurs. |