Mozilla/distilvit

This model is a work in progress.

Fine-tuned version of those base models:

• a VIT model for the image encoder: https://huggingface.co/google/vit-base-patch16-224-in21k
• a Distilled GPT-2 model for the text decoder: https://huggingface.co/distilbert/distilgpt2

This model was trained on:

• Flickr30k : https://huggingface.co/datasets/nlphuji/flickr30k
• COCO 2017: https://cocodataset.org

You can find the code used to create the model here: https://github.com/mozilla/distilvit