File size: 547 Bytes
3ab70c8
 
 
 
 
ebbdcb7
83d92dc
f11042f
 
93de90d
f11042f
 
 
 
 
 
83c1908
93de90d
83c1908
83d92dc
78ceeaf
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
---
license: mit
tags:
- unconditional-image-generation
---
Fashion MNIST unconditional Unet Model trained using DDPM

Model Hyperparams:

- Model size: 51,834,625 params
- 3 stages: 128, 256, 512 channels
- Linear Attention in 2nd and 3rd stages, Self Attention in Middle Stage
- Optimizer: Adam
- LR: 3e-4
- Batch Size: 64
- Grad Accumulation: 8 steps
- Effectibe Batch Size: 512
- Total steps: 5,000
- Linear Beta Schedule: 1000 Steps

![output.png](https://s3.amazonaws.com/moonup/production/uploads/1672153152960-6262d89f63f73be3d2f6b7c1.png)