MagicVideo-V2: Multi-Stage High-Aesthetic Video Generation
Authors: name: Weimin Wang; name: Jiawei Liu; name: Zhijie Lin; name: Jiangqiao Yan; name: Shuo Chen; name: Chetwin Low; name: Tuyen Hoang; name: Jie Wu; name: Jun Hao Liew; name: Hanshu Yan; name: Daquan Zhou; name: Jiashi Feng
Published: 2024-01-09 10:12:52

Abstract: The growing demand for high-fidelity video generation from textual
descriptions has catalyzed significant research in this field. In this work, we
introduce MagicVideo-V2 that integrates the text-to-image model, video motion
generator, reference image embedding module and frame interpolation module into
an end-to-end video generation pipeline. Benefiting from these architecture
designs, MagicVideo-V2 can generate an aesthetically pleasing, high-resolution
video with remarkable fidelity and smoothness. It demonstrates superior
performance over leading Text-to-Video systems such as Runway, Pika 1.0, Morph,
Moon Valley and Stable Video Diffusion model via user evaluation at large
scale.