Before revision:  Different from their works which only pre-train understanding task, we propose a unified video-language pre-training model for both understanding and generation tasks .
After revision:  Different from their works which only pre-train understanding task, which leads to a pretrain-finetune discrepency for generation tasks. In this paper, we propose UniViLM: a Unified Video and Language pre-training model for both understanding and generation tasks .