PuLID: Pure and Lightning ID Customization via Contrastive Alignment
Authors: name: Zinan Guo; name: Yanze Wu; name: Zhuowei Chen; name: Lang Chen; name: Qian He
Published: 2024-04-24 17:55:33

Abstract: We propose Pure and Lightning ID customization (PuLID), a novel tuning-free
ID customization method for text-to-image generation. By incorporating a
Lightning T2I branch with a standard diffusion one, PuLID introduces both
contrastive alignment loss and accurate ID loss, minimizing disruption to the
original model and ensuring high ID fidelity. Experiments show that PuLID
achieves superior performance in both ID fidelity and editability. Another
attractive property of PuLID is that the image elements (e.g., background,
lighting, composition, and style) before and after the ID insertion are kept as
consistent as possible. Codes and models will be available at
https://github.com/ToTheBeginning/PuLID