Disty0 commited on
Commit
a2605b2
1 Parent(s): c117d97

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +83 -1
README.md CHANGED
@@ -5,4 +5,86 @@ license_name: stable-cascade-nc-community
5
  license_link: LICENSE
6
  prior:
7
  - Disty0/sotediffusion-wuerstchen3-alpha1
8
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  license_link: LICENSE
6
  prior:
7
  - Disty0/sotediffusion-wuerstchen3-alpha1
8
+ ---
9
+
10
+ # SoteDiffusion Cascade
11
+
12
+ Anime finetune of Würstchen V3.
13
+ Currently is in very early state in training.
14
+ No commercial use thanks to StabilityAI.
15
+
16
+ # Usage
17
+ Please refer to the main model: https://huggingface.co/Disty0/sotediffusion-wuerstchen3-alpha1
18
+
19
+
20
+ ## Dataset
21
+
22
+ Used the same dataset as Disty0/sote-diffusion-cascade-decoder-alpha0.
23
+ Changed the training parameters.
24
+ Trained with 98K~ images.
25
+
26
+ ## Training:
27
+
28
+ **GPU used for training**: 1x AMD RX 7900 XTX 24GB
29
+
30
+ **Software used**: https://github.com/2kpr/StableCascade
31
+
32
+ ### Config:
33
+ ```
34
+ experiment_id: sotediffusion-sc-b_3b
35
+ model_version: 3B
36
+ dtype: bfloat16
37
+ use_fsdp: False
38
+
39
+ batch_size: 16
40
+ grad_accum_steps: 16
41
+ updates: 6125
42
+ backup_every: 512
43
+ save_every: 256
44
+ warmup_updates: 100
45
+
46
+ lr: 1.0e-5
47
+ optimizer_type: Adafactor
48
+ adaptive_loss_weight: False
49
+ stochastic_rounding: True
50
+
51
+ image_size: 768
52
+ multi_aspect_ratio: [1/1, 1/2, 1/3, 2/3, 3/4, 1/5, 2/5, 3/5, 4/5, 1/6, 5/6, 9/16]
53
+ shift: 4
54
+
55
+ checkpoint_path: /mnt/DataSSD/AI/SoteDiffusion/StableCascade/
56
+ output_path: /mnt/DataSSD/AI/SoteDiffusion/StableCascade/
57
+ webdataset_path: file:/mnt/DataSSD/AI/anime_image_dataset/best/newest_best.tar
58
+
59
+ effnet_checkpoint_path: /mnt/DataSSD/AI/models/sd-cascade/effnet_encoder.safetensors
60
+ stage_a_checkpoint_path: /mnt/DataSSD/AI/models/sd-cascade/stage_a.safetensors
61
+ generator_checkpoint_path: /mnt/DataSSD/AI/SoteDiffusion/StableCascade/sotediffusion-sc_3b-stage_b-alpha0.safetensors
62
+ ```
63
+
64
+
65
+ ## Limitations and Bias
66
+
67
+ ### Bias
68
+
69
+ - This model is intended for anime illustrations.
70
+ Realistic capabilites are not tested at all.
71
+ - Still underbaked.
72
+
73
+ ### Limitations
74
+ - Can fall back to realistic.
75
+ Add "realistic" tag to the negatives when this happens.
76
+ - Far shot eyes are can bad.
77
+ - Anatomy and hands can bad.
78
+
79
+
80
+ ## License
81
+ (This part is copied directly from Animagine V3.1 and modified.)
82
+
83
+ SoteDiffusion models falls under [Fair AI Public License 1.0-SD](https://freedevproject.org/faipl-1.0-sd/) license, which is compatible with Stable Diffusion models’ license. Key points:
84
+
85
+ 1. **Modification Sharing:** If you modify SoteDiffusion models, you must share both your changes and the original license.
86
+ 2. **Source Code Accessibility:** If your modified version is network-accessible, provide a way (like a download link) for others to get the source code. This applies to derived models too.
87
+ 3. **Distribution Terms:** Any distribution must be under this license or another with similar rules.
88
+ 4. **Compliance:** Non-compliance must be fixed within 30 days to avoid license termination, emphasizing transparency and adherence to open-source values.
89
+
90
+ **Notes**: Anything not covered by Fair AI license is inherited from Stability AI Non-Commercial license which is named as LICENSE_INHERIT. Meaning, still no commercial use of any kind.