community-events/computer-vision-study-group/Sessions/HowDoVisionTransformersWork.md

How Do Vision Transformers Work

Session by johko

Session Slides 🖥️

Google Drive

Original Paper 📄

Hugging Face / arxiv

GitHub Repo 🧑🏽‍💻

https://github.com/microsoft/Swin-Transformer

Additional Resources 📚

Hessian Matrices:

• https://stackoverflow.com/questions/23297090/how-calculating-hessian-works-for-neural-network-learning
• https://machinelearningmastery.com/a-gentle-introduction-to-hessian-matrices/

Loss Landscape Visualization:

• https://mathformachines.com/posts/visualizing-the-loss-landscape/
• https://github.com/tomgoldstein/loss-landscape