Before revision:  Motivated by the recent success of BERT based pre-training technique for NLP and image-language tasks, VideoBERT and CBT are proposed to exploit BERT model for video and language pre-training using narrated instructional videos.
After revision:  Motivated by the recent success of BERT based pre-training technique for NLP and image-linguistic tasks, there are still few works on video-linguistic pre-training using narrated instructional videos.