Hugging Face's logo

TrevorDohm
/
ViT_Scratch_MNIST

Model card Files Community
Trevor Dohm commited on
Commit
a13a284
•
1 Parent(s): 6eb3f84

Update README.md

Browse files

![W&B Chart 3_7_2024, 1_52_18 PM.png](https://cdn-uploads.huggingface.co/production/uploads/646a8ef31556443f24b803be/_IuFYOWrKspppl7M9VFO1.png)
![W&B Chart 3_7_2024, 1_52_26 PM.png](https://cdn-uploads.huggingface.co/production/uploads/646a8ef31556443f24b803be/zGG3P9GnNTT3cR-f7FxPG.png)
![W&B Chart 3_7_2024, 1_52_31 PM.png](https://cdn-uploads.huggingface.co/production/uploads/646a8ef31556443f24b803be/1nDg5SwBYNBJx8EX7YVdp.png)
![W&B Chart 3_7_2024, 1_52_38 PM.png](https://cdn-uploads.huggingface.co/production/uploads/646a8ef31556443f24b803be/ENRdf2vLvT7x8D-grCLM9.png)
![W&B Chart 3_7_2024, 1_52_48 PM.png](https://cdn-uploads.huggingface.co/production/uploads/646a8ef31556443f24b803be/N2nDiiIU1c7PSZvouHObw.png)

Files changed (1) hide show
  1. README.md +2 -10
README.md CHANGED
@@ -5,14 +5,6 @@ Trained From Scratch, MNIST https://huggingface.co/datasets/mnist
5
 
6
  Guide: https://medium.com/mlearning-ai/vision-transformers-from-scratch-pytorch-a-step-by-step-guide-96c3313c2e0c
7
 
8
- ViT_Small:
9
 
10
- {"chw": (1, 28, 28), "n_patches": 7, "n_blocks": 4, "hidden_d": 8, "n_heads": 4, "out_d": 10}
11
-
12
- 23 kB 2K+ Steps
13
-
14
- ViT_Large:
15
-
16
- {"chw": (1, 28, 28), "n_patches": 7, "n_blocks": 6, "hidden_d": 64, "n_heads": 8, "out_d": 10}
17
-
18
- 881 kB 20K+ Steps
 
5
 
6
  Guide: https://medium.com/mlearning-ai/vision-transformers-from-scratch-pytorch-a-step-by-step-guide-96c3313c2e0c
7
 
8
+ ViT_Small: {"chw": (1, 28, 28), "n_patches": 7, "n_blocks": 4, "hidden_d": 8, "n_heads": 4, "out_d": 10} 23 kB 2K+ Steps
9
 
10
+ ViT_Large: {"chw": (1, 28, 28), "n_patches": 7, "n_blocks": 6, "hidden_d": 64, "n_heads": 8, "out_d": 10} 881 kB 20K+ Steps