sections/checkpoints.md

Checkpoints

• Pre-trained checkpoint at 60k steps: clip-vision-bert-cc12m-60k
• Pre-trained checkpoint at 70k steps: clip-vision-bert-cc12m-70k
• Fine-tuned checkpoint at 6k steps on 60k pre-trained checkpoint: clip-vision-bert-vqa-ft-6k

Other checkpoints:

• All pre-trained checkpoints: multilingual-vqa
• Fine-tuned checkpoints on 45k pre-trained checkpoint: multilingual-vqa-pt-45k-ft
• Fine-tuned checkpoints on 45k pre-trained checkpoint with AdaFactor (others use AdamW): multilingual-vqa-pt-45k-ft-adf
• Fine-tuned checkpoints on 60k pre-trained checkpoint: multilingual-vqa-pt-60k-ft
• Fine-tuned checkpoints on 70k pre-trained checkpoint: multilingual-vqa-pt-60k-ft
• From scratch (without MLM pre-training) model: multilingual-vqa-ft