Before revision:  We first pre-train our model to learn the universal representation for both video and language on a large instructional video dataset. Then we fine-tune the model on two multimodal tasks including understanding task (text-based video retrieval) and generation task (multimodal video captioning). Our extensive experiments show that our method can improve the performance of both understanding and generation tasks and achieves the state-of-the art results .
After revision:  We first pre-train is carried out on a sizeable instructional video dataset HowTo100M. Experimental results demonstrate that the state-of-the art results .