community-events/computer-vision-study-group/Sessions/HowDoVisionTransformersWork.md

# How Do Vision Transformers Work
Session by [johko](https://github.com/johko)


## Session Slides 🖥️
[Google Drive](https://docs.google.com/presentation/d/1PewOHVABkxx0jO9PoJSQi8to_WNlL4HdDp4M9e4L8hs/edit?usp=drivesdks)


## Original Paper 📄
[Hugging Face](https://huggingface.co/papers/2202.06709) /
[arxiv](https://arxiv.org/pdf/2202.06709.pdf)


## GitHub Repo 🧑🏽‍💻
https://github.com/microsoft/Swin-Transformer


## Additional Resources 📚
Hessian Matrices:

- https://stackoverflow.com/questions/23297090/how-calculating-hessian-works-for-neural-network-learning
- https://machinelearningmastery.com/a-gentle-introduction-to-hessian-matrices/

Loss Landscape Visualization:

- https://mathformachines.com/posts/visualizing-the-loss-landscape/
- https://github.com/tomgoldstein/loss-landscape