Commit
•
647d0fd
1
Parent(s):
7201b1a
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,101 @@
|
|
| 1 |
---
|
| 2 |
license: creativeml-openrail-m
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: creativeml-openrail-m
|
| 3 |
---
|
| 4 |
+
The final 8 models that are trained over [hakurei's Waifu Diffusion](https://huggingface.co/hakurei/waifu-diffusion).
|
| 5 |
+
|
| 6 |
+
Each model was trained on a notable Japanese (and Taiwanese, I think) AI artist's works using dreambooth, with 30 of their works gained mainly from twitter (except for sabakichi, which I collected the dataset from pixiv).
|
| 7 |
+
|
| 8 |
+
It tooks 1000 steps to train each model, at a learning rate of 5-e6. I have shared the notebook [here](https://huggingface.co/Phantom-Artist/phantom-diffusion/blob/main/DreamBooth_Stable_Diffusion_works_with_SD_2.ipynb) in case you want to try out additional training.
|
| 9 |
+
|
| 10 |
+
Some are good at backgrounds, while others can generate a semi-realistic style as seen in many SD 1.5 anime/waifu models (and some might be a bit overfitted).
|
| 11 |
+
|
| 12 |
+
The dataset is published [here](https://huggingface.co/datasets/Phantom-Artist/phantom-diffusion-dataset).
|
| 13 |
+
|
| 14 |
+
# For those who are against generative AIs
|
| 15 |
+
You can see that now they are the target. Take our tool. Now is the time for pay back. Generate the images in their styles, and bring back the power you had to yourself.
|
| 16 |
+
|
| 17 |
+
# For those who support the development of generative AIs
|
| 18 |
+
Some of the AI artists, even though they take advantage of the open strategy of Stable Diffusion, now tend to hide their prompts, trying to monopolize their style (I'm not saying the AI artists I trained are as such, to be sure).
|
| 19 |
+
|
| 20 |
+
To continue protecting our values and beliefs on the open community and fight against them trying to create another pre-modern style guilds, I will show you a new way.
|
| 21 |
+
|
| 22 |
+
You no longer need their prompts; just train their images by yourself to protect the open community. It's not only legal but also ethical, as they have been taking advantages of others' trained dataset.
|
| 23 |
+
|
| 24 |
+
# For those who call themselves "phantom 40"
|
| 25 |
+
I saw some caliming there should be 48, and here you go. Phantom 48, or do you like to call yourselves *PTM* 48 instead? It's up to you.
|
| 26 |
+
|
| 27 |
+
# Why will they be the last?
|
| 28 |
+
My initial intention on this series was a social experiment to see what will happen if the AI artists are targeted for personalized training.
|
| 29 |
+
|
| 30 |
+
As it became more popular than expected and the artists started calling themselves "phantom 20," I came up with the second intention to see how they will react after I add 20 more in one day, to see if they can adapt to the sudden change. They acted greatly, and I think that's why they could become notable.
|
| 31 |
+
|
| 32 |
+
All the reactions and the interpretations on my action were impressive, but since I have accomplished my goal, and since the main stream model will probably be SD 2.1 768 (not SD 2.1 512), I will not add new models.
|
| 33 |
+
|
| 34 |
+
I know I couldn't add some of the artists, but no. I will not do it under the name of phantom.
|
| 35 |
+
|
| 36 |
+
It takes me like 8 hours to train, test, and upload 20 models, and it's just unsustainable to continue doing it everyday.
|
| 37 |
+
|
| 38 |
+
**From now on, anyone who wish to add more is the next phantom. Train anyone you wish to by yourself.**
|
| 39 |
+
|
| 40 |
+
# trained artist list
|
| 41 |
+
- atsuwo_AI
|
| 42 |
+
- recommended pos: multicolored hair, cg
|
| 43 |
+
- fladdict
|
| 44 |
+
- recommended pos: oil painting/ancient relief/impressionist impasto oil painting (maybe more)
|
| 45 |
+
- possible neg: monkey
|
| 46 |
+
- Hifumi_AID
|
| 47 |
+
- recommended pos: dark purple hair, emerald eyes
|
| 48 |
+
- mayonaka_rr
|
| 49 |
+
- recommended pos: cg
|
| 50 |
+
- possible pos: dynamic posing, bikini, ponytail
|
| 51 |
+
- o81morimori
|
| 52 |
+
- possible pos: cg, in a messy apartment room with objects on the floor and the bed
|
| 53 |
+
- sabakichi
|
| 54 |
+
- possible pos 1: merging underwater, limited pallete, melting underwater, unstable outlines
|
| 55 |
+
- possible pos 2: rough sketch, limited pallete, ((unstable outlines)), monotone gradation, dynamic posing
|
| 56 |
+
- teftef
|
| 57 |
+
- possible pos: light skyblue hair, bun, retropunk gears of a factory
|
| 58 |
+
- violet_fizz
|
| 59 |
+
- recommended pos: beautiful face, grown up face, long eyes, expressionless
|
| 60 |
+
- possible pos: expressionless
|
| 61 |
+
|
| 62 |
+
# samples
|
| 63 |
+
The basic prompt is as follows.
|
| 64 |
+
|
| 65 |
+
However, to present you the potential of these models as much as possible, many of them have additional postive tags (such as "in the style of") to get the result below (yes, use ``aitop (ARTIST)_style`` to gain the finetuned result).
|
| 66 |
+
|
| 67 |
+
Many works better with the additional prompt ``beautiful face``. Generally speaking, prompting words close to the trained dataset will give you a better result.
|
| 68 |
+
```
|
| 69 |
+
POS: masterpiece, best quality, 1girl, aitop (ARTIST)_style
|
| 70 |
+
NEG: nsfw, worst quality, low quality, medium quality, deleted, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digits, fewer digits, cropped, jpeg artifacts, signature, watermark, username, blurry, simple background
|
| 71 |
+
```
|
| 72 |
+
|
| 73 |
+
## atsuwo_AI
|
| 74 |
+
|
| 75 |
+
|
| 76 |
+
|
| 77 |
+
## fladdict
|
| 78 |
+
|
| 79 |
+
|
| 80 |
+
|
| 81 |
+
## Hifumi_AID
|
| 82 |
+
|
| 83 |
+
|
| 84 |
+
## mayonaka_rr
|
| 85 |
+
|
| 86 |
+
|
| 87 |
+
|
| 88 |
+
## o81morimori
|
| 89 |
+
|
| 90 |
+
|
| 91 |
+
## sabakichi
|
| 92 |
+
|
| 93 |
+
|
| 94 |
+
|
| 95 |
+
|
| 96 |
+
## teftef
|
| 97 |
+
|
| 98 |
+
|
| 99 |
+
## violet_fizz
|
| 100 |
+
|
| 101 |
+
|