A Light Touch Approach to Teaching Transformers Multi-view Geometry (CVPR 2023) [5 minute version]
Channel: Yash Bhalgat
Date: 2023-04-09

Authors: Yash Bhalgat, Joao F. Henriques, Andrew Zisserman
Paper link: https://www.robots.ox.ac.uk/~vgg/publications/2023/Bhalgat23/

This paper proposes a new method for teaching Vision Transformers multi-view geometry using epipolar lines, called Epipolar Loss, which induces geometric understanding in the Transformer. The proposed method outperforms state-of-the-art approaches in object retrieval benchmarks without requiring pose information at test time.

0:00 Introduction
0:15 Motivation and Background
1:15 Epipolar Geometry
1:52 "Light Touch" Approach
3:05 CO3D-Retrieve Benchmark
3:30 Results
3:50 Visualization
4:55 Conclusion