ZeroCool94 commited on
Commit
4898144
1 Parent(s): f606969

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -2
README.md CHANGED
@@ -75,7 +75,7 @@ image.save("fantasy_forest_illustration.png")
75
 
76
  ## Training
77
 
78
- **Training Data**
79
  The model was trained on the following dataset:
80
  - [Imaginary Network Expanded Dataset](https://github.com/Sygil-Dev/INE-dataset) dataset.
81
 
@@ -83,12 +83,20 @@ The model was trained on the following dataset:
83
  - **Hardware:** 1 x Nvidia RTX 3050 8GB GPU
84
  - **Hours Trained:** 520 hours approximately.
85
  - **Optimizer:** AdamW
 
 
 
 
 
86
  - **Gradient Accumulations**: 4
87
  - **Batch:** 1
88
  - **Learning rate:** warmup to 1e-7 for 10,000 steps and then kept constant
 
 
 
89
  - **Total Training Steps:** 1,489,983
90
 
91
- Developed by: [ZeroCool94](https://huggingface.co/ZeroCool94) at [Sygil-Dev](https://github.com/Sygil-Dev/)
92
 
93
  ## Community Contributions:
94
  - [Kevin Turner (keturn)](https://huggingface.co/keturn): created the [INE-dataset-explorer](https://huggingface.co/spaces/Sygil/INE-dataset-explorer) space for better browsing of the INE dataset.
 
75
 
76
  ## Training
77
 
78
+ **Training Data**:
79
  The model was trained on the following dataset:
80
  - [Imaginary Network Expanded Dataset](https://github.com/Sygil-Dev/INE-dataset) dataset.
81
 
 
83
  - **Hardware:** 1 x Nvidia RTX 3050 8GB GPU
84
  - **Hours Trained:** 520 hours approximately.
85
  - **Optimizer:** AdamW
86
+ - **Adam Beta 1**: 0.9
87
+ - **Adam Beta 2**: 0.999
88
+ - **Adam Weight Decay**: 0.01
89
+ - **Adam Epsilon**: 1e-8
90
+ - **Gradient Checkpointing**: True
91
  - **Gradient Accumulations**: 4
92
  - **Batch:** 1
93
  - **Learning rate:** warmup to 1e-7 for 10,000 steps and then kept constant
94
+ - **Lora unet Learning Rate**: 1e-7
95
+ - **Lora Text Encoder Learning Rate**: 1e-7
96
+ - **Resolution**: 512 pixels
97
  - **Total Training Steps:** 1,489,983
98
 
99
+ Developed by: [ZeroCool94](https://github.com/ZeroCool940711) at [Sygil-Dev](https://github.com/Sygil-Dev/)
100
 
101
  ## Community Contributions:
102
  - [Kevin Turner (keturn)](https://huggingface.co/keturn): created the [INE-dataset-explorer](https://huggingface.co/spaces/Sygil/INE-dataset-explorer) space for better browsing of the INE dataset.