Phantom-Data : Towards a General Subject-Consistent Video Generation
  Dataset
Authors: name: Zhuowei Chen; name: Bingchuan Li; name: Tianxiang Ma; name: Lijie Liu; name: Mingcong Liu; name: Yi Zhang; name: Gen Li; name: Xinghui Li; name: Siyu Zhou; name: Qian He; name: Xinglong Wu
Published: 2025-06-23 17:11:56

Abstract: Subject-to-video generation has witnessed substantial progress in recent
years. However, existing models still face significant challenges in faithfully
following textual instructions. This limitation, commonly known as the
copy-paste problem, arises from the widely used in-pair training paradigm. This
approach inherently entangles subject identity with background and contextual
attributes by sampling reference images from the same scene as the target
video. To address this issue, we introduce Phantom-Data, the first
general-purpose cross-pair subject-to-video consistency dataset, containing
approximately one million identity-consistent pairs across diverse categories.
Our dataset is constructed via a three-stage pipeline: (1) a general and
input-aligned subject detection module, (2) large-scale cross-context subject
retrieval from more than 53 million videos and 3 billion images, and (3)
prior-guided identity verification to ensure visual consistency under
contextual variation. Comprehensive experiments show that training with
Phantom-Data significantly improves prompt alignment and visual quality while
preserving identity consistency on par with in-pair baselines.