Before revision:  However, the paired text-image data required for pre-training are hard to collect and scale up.
After revision:  However, the paired text-image data required for pre-training . Such data are costly to collect and scale up.