 However, the paired text-image data required for pre-training are hard to collect and scale up.
<clarity>  However, the paired text-image data required for pre-training are hard to collect and scale up.
 However, existing models require a large amount of parallel image-caption data for pre-training are hard to collect and scale up.