Fashion MNIST unconditional Unet Model trained using DDPM | |
Model Hyperparams: | |
- Model size: 51,834,625 params | |
- 3 stages: 128, 256, 512 channels | |
- Linear Attention in 2nd and 3rd stages, Self Attention in Middle Stage | |
- Optimizer: Adam | |
- LR: 3e-4 | |
- Batch Size: 64 | |
- Grad Accumulation: 8 steps | |
- Total steps: 5,000 | |
![output.png](https://s3.amazonaws.com/moonup/production/uploads/1672153152960-6262d89f63f73be3d2f6b7c1.png) |