Before revision:  We  show that the pre-training a bi-modal encoder along with a bi-modal decoder for captioning can be used as a feature extractor for a simple proposal generation module.
After revision:  We show that the pre-training a bi-modal encoder along with a bi-modal transformer can be used as a feature extractor for a simple proposal generation module.