Before revision:  Besides, pre-training on more image-only data further improves a model that already has access to aligned data , suggesting the possibility of utilizing billions of raw images available to enhance & V&L models.
After revision:  Besides, pre-training on more image-only data further improves a model that already has access to aligned data , on four English V & V&L models.