🚨 🚨Bring some dinos to modern standards
Author: molbap
Pull request: yes

<!-- ci-dashboard-badge:start -->
[![CI](https://transformers-ci.lor-e.huggingface.cool/badge/pr?pr=46266)](https://transformers-ci.lor-e.huggingface.cool/d/pytest-observability-by-pr/pytest-observability-branch?var-pr=46266)
<!-- ci-dashboard-badge:end -->

# What does this PR do?

Part of the larger vision model refactor https://github.com/huggingface/transformers/pull/41693 focused on dinov2, which has still some usage and downloads, but mostly serves as a basis for many other models. Attempt at putting this in line with the rest of the lib. 

<img width="2142" height="930" alt="image" src="https://github.com/user-attachments/assets/f028f142-af9e-4999-9c54-c4ae16af83ff" />

Comments:
The docs for this PR live [here](https://moon-ci-docs.huggingface.co/docs/transformers/pr_46266). All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

run-slow: depth_anything, dinov2, dinov2_with_registers, dinov3_convnext, dinov3_vit, eomt, eomt_dinov3, pixio, rf_detr, sapiens2, videomt

[Workflow Run ⚙️](https://github.com/huggingface/transformers/actions/runs/27424891040)

This comment contains `run-slow`, running the specified jobs: 

models: ["models/depth_anything", "models/dinov2", "models/dinov2_with_registers", "models/dinov3_convnext", "models/dinov3_vit", "models/eomt", "models/eomt_dinov3", "models/pixio", "models/rf_detr", "models/sapiens2", "models/videomt"]
quantizations: []

## CI Results
[Workflow Run ⚙️](https://github.com/huggingface/transformers/actions/runs/27424891040)

### Commit Info
| Context | Commit | Description |
|---------|--------|-------------|
| RUN | [42daf802](https://github.com/huggingface/transformers/commit/42daf8023d3ec71e30cf4dd593284529f33de878) | workflow commit (merge commit) |
| PR | [4ee1242a](https://github.com/huggingface/transformers/commit/4ee1242a8a3268e389742e93d7132a0717d182c1) | branch commit (from PR) |
| main | [f208766a](https://github.com/huggingface/transformers/commit/f208766a6551d381475cd8eeed1256f9a5af7b65) | base commit (on `main`) |

✅ No failing test specific to this PR 🎉 👏 !


View the CircleCI Test Summary for this PR:

https://huggingface.co/spaces/transformers-community/circle-ci-viz?pr=46266&sha=b0ea71

@guarin if you can have another look, I updated the swiglu-related reverse load test, I think it's an acceptable workaround. LMK!

**[For maintainers]** Suggested jobs to run (before merge)

run-slow: depth_anything, dinov2, dinov2_with_registers, dinov3_convnext, dinov3_vit, eomt, eomt_dinov3, pixio, rf_detr, sapiens2, videomt

run-slow: depth_anything, dinov2, dinov2_with_registers, dinov3_convnext, dinov3_vit, eomt, eomt_dinov3, pixio, rf_detr, sapiens2, videomt

[Workflow Run ⚙️](https://github.com/huggingface/transformers/actions/runs/28451063546)

This comment contains `run-slow`, running the specified jobs: 

models: ["models/depth_anything", "models/dinov2", "models/dinov2_with_registers", "models/dinov3_convnext", "models/dinov3_vit", "models/eomt", "models/eomt_dinov3", "models/pixio", "models/rf_detr", "models/sapiens2", "models/videomt"]
quantizations: []

<!-- ci-dashboard-recap:start -->

---

### CI recap

**Dashboard:** [View test results in Grafana](https://transformers-ci.lor-e.huggingface.cool/d/pytest-observability-by-pr/pytest-observability-branch?var-pr=46266)
**Latest run:** [28450557810:1](https://github.com/huggingface/transformers/actions/runs/28450557810)
**Result:** `failure` | **Jobs:** 14 | **Tests:** 50,911 | **Failures:** 0 | **Duration:** 14h 37m

<!-- ci-dashboard-recap:end -->

## CI Results
[Workflow Run ⚙️](https://github.com/huggingface/transformers/actions/runs/28451063546)

### Commit Info
| Context | Commit | Description |
|---------|--------|-------------|
| RUN | [d28e35e5](https://github.com/huggingface/transformers/commit/d28e35e512f5c9f4a40d4099eb17daf0b189160e) | workflow commit (merge commit) |
| PR | [a3aa0d0e](https://github.com/huggingface/transformers/commit/a3aa0d0e8bca6b3f34f14d4f2db2d8a9b255cdb3) | branch commit (from PR) |
| main | [181beb3b](https://github.com/huggingface/transformers/commit/181beb3ba4c47098ed8cbc97ee250d1d45ae0107) | base commit (on `main`) |

✅ No failing test specific to this PR 🎉 👏 !


Let me know if I should make a last pass :hugs: 

No rush, but glad to have a review if you have time! I iterated mostly on `dinov2` but the rest seems OK as well @vasqu