metadata
pipeline_tag: text-to-image
license: other
license_name: faipl-1.0-sd
license_link: LICENSE
tags:
- text-to-image
- diffusers
prior:
- Disty0/sotediffusion-v2-prior
SoteDiffusion V2
An anime diffusion model finetuned on Würstchen V3.
Release Notes
- This release is sponsored by fal.ai/grants
- Trained on 12M text & image paris including WD tags and natural language captions for a single epoch on 8xH100 80GB SXM5 GPUs.
WD Tags:
Model is trained with this tag order:
aesthetic tags, quality tags, date tags, custom tags, rating tags, character, series, rest of the tags
Date:
| tag | date |
|---|---|
| newest | 2022 to 2024 |
| recent | 2019 to 2021 |
| mid | 2015 to 2018 |
| early | 2011 to 2014 |
| oldest | 2005 to 2010 |
Aesthetic Tags:
Model used: shadowlilac/aesthetic-shadow-v2
| score greater than | tag | count |
|---|---|---|
| 0.90 | extremely aesthetic | 125.451 |
| 0.80 | very aesthetic | 887.382 |
| 0.70 | aesthetic | 1.049.857 |
| 0.50 | slightly aesthetic | 1.643.091 |
| 0.40 | not displeasing | 569.543 |
| 0.30 | not aesthetic | 445.188 |
| 0.20 | slightly displeasing | 341.424 |
| 0.10 | displeasing | 237.660 |
| rest of them | very displeasing | 328.712 |
Quality Tags:
Model used: https://huggingface.co/hakurei/waifu-diffusion-v1-4/blob/main/models/aes-B32-v0.pth
| score greater than | tag | count |
|---|---|---|
| 0.980 | best quality | 1.270.447 |
| 0.900 | high quality | 498.244 |
| 0.750 | great quality | 351.006 |
| 0.500 | medium quality | 366.448 |
| 0.250 | normal quality | 368.380 |
| 0.125 | bad quality | 279.050 |
| 0.025 | low quality | 538.958 |
| rest of them | worst quality | 1.955.966 |
Rating Tags:
| tag | count |
|---|---|
| general | 1.416.451 |
| sensitive | 3.447.664 |
| nsfw | 427.459 |
| explicit nsfw | 336.925 |
Custom Tags:
| dataset name | custom tag |
|---|---|
| image boards | date, |
| text | The text says "text", |
| characters | character, series |
| pixiv | art by Display_Name, |
| visual novel cg | Full_VN_Name (short_3_letter_name), visual novel cg, |
| anime wallpaper | date, anime wallpaper, |
Limitations and Bias
Bias
- This model is intended for anime illustrations.
Realistic capabilites are not tested at all.
Limitations
- Can fall back to realistic.
Add "realistic" tag to the negatives when this happens. - Far shot eyes and hands can be bad.
- Still has a lot of room for more train.
- Diffusers outputs aren't as good as ComfyUI outputs.
License
SoteDiffusion models falls under Fair AI Public License 1.0-SD license, which is compatible with Stable Diffusion models’ license. Key points:
- Modification Sharing: If you modify SoteDiffusion models, you must share both your changes and the original license.
- Source Code Accessibility: If your modified version is network-accessible, provide a way (like a download link) for others to get the source code. This applies to derived models too.
- Distribution Terms: Any distribution must be under this license or another with similar rules.
- Compliance: Non-compliance must be fixed within 30 days to avoid license termination, emphasizing transparency and adherence to open-source values.
Notes: Anything not covered by Fair AI license is inherited from Stability AI Non-Commercial license which is named as LICENSE_INHERIT.