Before revision:  Besides , most of the existing multimodal models are pre-trained for understanding task, which leads to a pretrain-finetune discrepency for generation tasks.
After revision:  Besides , most of the existing multimodal models are pre-trained for understanding task, which leads to a pretrain-finetune discrepancy for generation tasks.