DINOv3
Authors: name: Oriane Siméoni, name: Huy V. Vo, name: Maximilian Seitzer, name: Federico Baldassarre, name: Maxime Oquab, name: Cijo Jose, name: Vasil Khalidov, name: Marc Szafraniec, name: Seungeun Yi, name: Michaël Ramamonjisoa, name: Francisco Massa, name: Daniel Haziza, name: Luca Wehrstedt, name: Jianyuan Wang, name: Timothée Darcet, name: Théo Moutakanni, name: Leonel Sentana, name: Claire Roberts, name: Andrea Vedaldi, name: Jamie Tolan, name: John Brandt, name: Camille Couprie, name: Julien Mairal, name: Hervé Jégou, name: Patrick Labatut, name: Piotr Bojanowski
Organization: AI at Meta

Self-supervised learning holds the promise of eliminating the need for manual
data annotation, enabling models to scale effortlessly to massive datasets and
larger architectures. By not being tailored to specific tasks or domains, this
training paradigm has the potential to learn visual representations from
diverse sources, ranging from natural to aerial images -- using a single
algorithm. This technical report introduces DINOv3, a major milestone toward
realizing this vision by leveraging simple yet effective strategies. First, we
leverage the benefit of scaling both dataset and model size by careful data
preparation, design, and optimization. Second, we introduce a new method called
Gram anchoring, which effectively addresses the known yet unsolved issue of
dense feature maps degrading during long training schedules. Finally, we apply
post-hoc strategies that further enhance our models' flexibility with respect
to resolution, model size, and alignment with text. As a result, we present a
versatile vision foundation model that outperforms the specialized state of the
art across a broad range of settings, without fine-tuning. DINOv3 produces
high-quality dense features that achieve outstanding performance on various
vision tasks, significantly surpassing previous self- and weakly-supervised
foundation models. We also share the DINOv3 suite of vision models, designed to
advance the state of the art on a wide spectrum of tasks and data by providing
scalable solutions for diverse resource constraints and deployment scenarios.