Before revision:  However, the paired text-image data required for pre-training are hard to collect and scale up.
After revision:  However, existing models require a large amount of parallel image-caption data for pre-training are hard to collect and scale up.