deit_small_patch16_224

Implementation of DeiT proposed in Training data-efficient image transformers & distillation through attention

An attention based distillation is proposed where a new token is added to the model, the [dist]{.title-ref} token.

image

DeiT.deit_tiny_patch16_224()
DeiT.deit_small_patch16_224()
DeiT.deit_base_patch16_224()
DeiT.deit_base_patch16_384()
Downloads last month
5
Hosted inference API

Unable to determine this model’s pipeline type. Check the docs .