 However, the paired text-image data required for pre-training are hard to collect and scale up.
<clarity>  However, the paired text-image data required for pre-training are hard to collect and scale up.
 However, the paired text-image data required for pre-training . Such data are costly to collect and scale up.