ZeroCool94
commited on
Commit
•
4898144
1
Parent(s):
f606969
Update README.md
Browse files
README.md
CHANGED
@@ -75,7 +75,7 @@ image.save("fantasy_forest_illustration.png")
|
|
75 |
|
76 |
## Training
|
77 |
|
78 |
-
**Training Data
|
79 |
The model was trained on the following dataset:
|
80 |
- [Imaginary Network Expanded Dataset](https://github.com/Sygil-Dev/INE-dataset) dataset.
|
81 |
|
@@ -83,12 +83,20 @@ The model was trained on the following dataset:
|
|
83 |
- **Hardware:** 1 x Nvidia RTX 3050 8GB GPU
|
84 |
- **Hours Trained:** 520 hours approximately.
|
85 |
- **Optimizer:** AdamW
|
|
|
|
|
|
|
|
|
|
|
86 |
- **Gradient Accumulations**: 4
|
87 |
- **Batch:** 1
|
88 |
- **Learning rate:** warmup to 1e-7 for 10,000 steps and then kept constant
|
|
|
|
|
|
|
89 |
- **Total Training Steps:** 1,489,983
|
90 |
|
91 |
-
Developed by: [ZeroCool94](https://
|
92 |
|
93 |
## Community Contributions:
|
94 |
- [Kevin Turner (keturn)](https://huggingface.co/keturn): created the [INE-dataset-explorer](https://huggingface.co/spaces/Sygil/INE-dataset-explorer) space for better browsing of the INE dataset.
|
|
|
75 |
|
76 |
## Training
|
77 |
|
78 |
+
**Training Data**:
|
79 |
The model was trained on the following dataset:
|
80 |
- [Imaginary Network Expanded Dataset](https://github.com/Sygil-Dev/INE-dataset) dataset.
|
81 |
|
|
|
83 |
- **Hardware:** 1 x Nvidia RTX 3050 8GB GPU
|
84 |
- **Hours Trained:** 520 hours approximately.
|
85 |
- **Optimizer:** AdamW
|
86 |
+
- **Adam Beta 1**: 0.9
|
87 |
+
- **Adam Beta 2**: 0.999
|
88 |
+
- **Adam Weight Decay**: 0.01
|
89 |
+
- **Adam Epsilon**: 1e-8
|
90 |
+
- **Gradient Checkpointing**: True
|
91 |
- **Gradient Accumulations**: 4
|
92 |
- **Batch:** 1
|
93 |
- **Learning rate:** warmup to 1e-7 for 10,000 steps and then kept constant
|
94 |
+
- **Lora unet Learning Rate**: 1e-7
|
95 |
+
- **Lora Text Encoder Learning Rate**: 1e-7
|
96 |
+
- **Resolution**: 512 pixels
|
97 |
- **Total Training Steps:** 1,489,983
|
98 |
|
99 |
+
Developed by: [ZeroCool94](https://github.com/ZeroCool940711) at [Sygil-Dev](https://github.com/Sygil-Dev/)
|
100 |
|
101 |
## Community Contributions:
|
102 |
- [Kevin Turner (keturn)](https://huggingface.co/keturn): created the [INE-dataset-explorer](https://huggingface.co/spaces/Sygil/INE-dataset-explorer) space for better browsing of the INE dataset.
|