|
--- |
|
tags: |
|
- dino |
|
- vision |
|
|
|
datasets: |
|
- imagenet-1k |
|
--- |
|
|
|
# DINO ResNet-50 |
|
|
|
ResNet-50 pretrained with DINO. DINO was introduced in [Emerging Properties in Self-Supervised Vision Transformers](https://arxiv.org/abs/2104.14294), while ResNet was introduced in [Deep Residual Learning for Image Recognition](https://arxiv.org/abs/1512.03385). The official implementation of a DINO Resnet-50 can be found [here](https://github.com/facebookresearch/dino). |
|
|
|
Weights converted from the official [DINO ResNet](https://github.com/facebookresearch/dino#pretrained-models-on-pytorch-hub) using [this script](https://colab.research.google.com/drive/1Ax3IDoFPOgRv4l7u6uS8vrPf4TX827BK?usp=sharing). |
|
|
|
For up-to-date model card information, please see the [original repo](https://github.com/facebookresearch/dino). |
|
|
|
### How to use |
|
|
|
**Warning: The feature extractor in this repo is a copy of the one from [`microsoft/resnet-50`](https://huggingface.co/microsoft/resnet-50). We never verified if this image prerprocessing is the one used with DINO ResNet-50.** |
|
|
|
```python |
|
from transformers import AutoFeatureExtractor, ResNetModel |
|
from PIL import Image |
|
import requests |
|
|
|
url = 'http://images.cocodataset.org/val2017/000000039769.jpg' |
|
image = Image.open(requests.get(url, stream=True).raw) |
|
|
|
feature_extractor = AutoFeatureExtractor.from_pretrained('Ramos-Ramos/dino-resnet-50') |
|
model = ResNetModel.from_pretrained('Ramos-Ramos/dino-resnet-50') |
|
inputs = feature_extractor(images=image, return_tensors="pt") |
|
outputs = model(**inputs) |
|
last_hidden_states = outputs.last_hidden_state |
|
``` |
|
|
|
### BibTeX entry and citation info |
|
|
|
```bibtex |
|
@article{DBLP:journals/corr/abs-2104-14294, |
|
author = {Mathilde Caron and |
|
Hugo Touvron and |
|
Ishan Misra and |
|
Herv{\'{e}} J{\'{e}}gou and |
|
Julien Mairal and |
|
Piotr Bojanowski and |
|
Armand Joulin}, |
|
title = {Emerging Properties in Self-Supervised Vision Transformers}, |
|
journal = {CoRR}, |
|
volume = {abs/2104.14294}, |
|
year = {2021}, |
|
url = {https://arxiv.org/abs/2104.14294}, |
|
archivePrefix = {arXiv}, |
|
eprint = {2104.14294}, |
|
timestamp = {Tue, 04 May 2021 15:12:43 +0200}, |
|
biburl = {https://dblp.org/rec/journals/corr/abs-2104-14294.bib}, |
|
bibsource = {dblp computer science bibliography, https://dblp.org} |
|
} |
|
``` |
|
|
|
```bibtex |
|
@inproceedings{he2016deep, |
|
title={Deep residual learning for image recognition}, |
|
author={He, Kaiming and Zhang, Xiangyu and Ren, Shaoqing and Sun, Jian}, |
|
booktitle={Proceedings of the IEEE conference on computer vision and pattern recognition}, |
|
pages={770--778}, |
|
year={2016} |
|
} |
|
``` |
