Updated README
Browse files- .markdownlint.json +8 -0
- README.md +83 -3
.markdownlint.json
ADDED
@@ -0,0 +1,8 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
{
|
2 |
+
"MD007": {
|
3 |
+
"indent": 4
|
4 |
+
},
|
5 |
+
"line-length": false,
|
6 |
+
"no-inline-html": false,
|
7 |
+
"MD026": false
|
8 |
+
}
|
README.md
CHANGED
@@ -17,7 +17,87 @@ tags:
|
|
17 |
- ``zundamon``: ずんだもん (人間形態)
|
18 |
- ``metan``: 四国めたん
|
19 |
|
20 |
-
|
21 |
|
22 |
-
|
23 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
17 |
- ``zundamon``: ずんだもん (人間形態)
|
18 |
- ``metan``: 四国めたん
|
19 |
|
20 |
+
学習画像はなるべく衣装にバリエーションをもたせているので,「公式衣装」は出にくいです.
|
21 |
|
22 |
+
## ライセンス
|
23 |
+
|
24 |
+
[CreativeML Open RAIL-M license 1.0](https://hf.space/static/bigscience/license/index.html)
|
25 |
+
|
26 |
+
また,各種法令・各種ガイドラインにご留意ください.
|
27 |
+
例えば,生成された画像が東北ずん子プロジェクトのキャラクターを含む場合,
|
28 |
+
[「東北ずん子プロジェクト キャラクター利用の手引き」](https://zunko.jp/guideline.html)に基づいて利用してください.
|
29 |
+
|
30 |
+
## 学習設定
|
31 |
+
|
32 |
+
- 元モデル: [Nilaier/Waifu-Diffusers](https://huggingface.co/Nilaier/Waifu-Diffusers) (fbd1958)
|
33 |
+
- Base model: [hakurei/waifu-diffusion-v1-3](https://huggingface.co/hakurei/waifu-diffusion-v1-3)
|
34 |
+
- VAE: [hakurei/waifu-diffusion-v1-4](https://huggingface.co/hakurei/waifu-diffusion-v1-4)
|
35 |
+
- 学習画像
|
36 |
+
- 5キャラクター計69枚
|
37 |
+
- アルファチャンネルは削除 + 白背景 + センタリング + 512x512にリサイズ
|
38 |
+
- クラス画像は各50枚
|
39 |
+
- 学習元コード: [ShivamShrirao/diffusers](https://github.com/ShivamShrirao/diffusers) (``7232c2a``)
|
40 |
+
- ``examples/dreambooth/train_dreambooth.py``
|
41 |
+
- 学習設定
|
42 |
+
- Instance ID: ``itako``, ``kiritan``, ``zinko``, ``metan``, ``zundamon`` (5種)
|
43 |
+
- Instance prompt: ``<ID> 1girl``
|
44 |
+
- Class prompt: ``1girl``
|
45 |
+
- Tesla T4で約110分
|
46 |
+
- その他設定:
|
47 |
+
|
48 |
+
```txt
|
49 |
+
--prior_loss_weight=0.5 \
|
50 |
+
--seed=3434554 \
|
51 |
+
--resolution=512 \
|
52 |
+
--center_crop \
|
53 |
+
--train_batch_size=1 \
|
54 |
+
--train_text_encoder \
|
55 |
+
--mixed_precision="fp16" \
|
56 |
+
--use_8bit_adam \
|
57 |
+
--gradient_checkpointing \
|
58 |
+
--gradient_accumulation_steps=2 \
|
59 |
+
--learning_rate=1e-6 \
|
60 |
+
--lr_scheduler="constant" \
|
61 |
+
--lr_warmup_steps=0 \
|
62 |
+
--num_class_images=50 \
|
63 |
+
--sample_batch_size=3 \
|
64 |
+
--max_train_steps=8000
|
65 |
+
```
|
66 |
+
|
67 |
+
## 学習に使った画像
|
68 |
+
|
69 |
+
<img src="https://pbs.twimg.com/media/Ff6FF1NaMAAL8N5?format=jpg&name=small" width="500" alt="学習に使った画像">
|
70 |
+
|
71 |
+
## 生成例
|
72 |
+
|
73 |
+
<img src="https://pbs.twimg.com/media/Ff6AgzyaMAExeb3?format=png&name=900x900" width="500" alt="東北きりたんの生成例">
|
74 |
+
|
75 |
+
```txt
|
76 |
+
kiritan, 1girl, volleyball, kawaii, in gymnasium, head
|
77 |
+
Negative prompt: chibi, out of frame, armature drawing, mutated hands and fingers, poor drawing, amateur, bad painting, bad painting of arms, bad anatomy, mutation, extra limbs, ugly, fat
|
78 |
+
Steps: 40, Sampler: Euler a, CFG scale: 7.5, Seed: 575469807, Size: 704x512
|
79 |
+
```
|
80 |
+
|
81 |
+
<img src="https://pbs.twimg.com/media/Ff6Ank1aYAY7bxk?format=png&name=900x900" width="500" alt="ずんだもんの生成例">
|
82 |
+
|
83 |
+
```txt
|
84 |
+
zundamon , maid dress, in cafe, Kyoto Animation
|
85 |
+
Negative prompt: chibi, out of frame, armature drawing, mutated hands and fingers, poor drawing, amateur, bad painting, bad painting of arms, bad anatomy, mutation, extra limbs, ugly, fat
|
86 |
+
Steps: 40, Sampler: Euler a, CFG scale: 7.5, Seed: 429473516, Size: 512x704
|
87 |
+
```
|
88 |
+
|
89 |
+
<img src="https://pbs.twimg.com/media/Ff6AuXoakAAPtYa?format=png&name=900x900" width="500" alt="東北イタコの生成例">
|
90 |
+
|
91 |
+
```txt
|
92 |
+
itako, dating in park, cute winter fashion
|
93 |
+
Negative prompt: out of frame, amateur drawing, mutated hands and fingers, poor drawing, amateur, bad painting, bad painting of arms, bad anatomy, mutation, extra limbs, ugly, fat
|
94 |
+
Steps: 60, Sampler: Euler a, CFG scale: 7.5, Seed: 2722676181, Size: 704x512
|
95 |
+
```
|
96 |
+
|
97 |
+
<img src="https://pbs.twimg.com/media/Ff6A2lQakAAj1Bb?format=png&name=small" width="500" alt="東北ずん子と四国めたんの生成例">
|
98 |
+
|
99 |
+
```txt
|
100 |
+
zunko and metan sit on bench, in school uniform, drink tea, 2girls, in 2020s anime style
|
101 |
+
Negative prompt: chibi, armature drawing, mutated hands and fingers, poor drawing, amateur, bad painting, bad painting of arms, bad anatomy, mutation, extra limbs, ugly
|
102 |
+
Steps: 40, Sampler: Euler a, CFG scale: 7.5, Seed: 2262270937, Size: 640x512
|
103 |
+
```
|