this is a idefics2 model pretrained on LLaVA-Pretrain (blip_laion_cc_sbu_558k.json) for 1 epoch. The two backbones were frozen and only the connector trained.