FlashFace: Human Image Personalization with High-fidelity Identity
  Preservation
Authors: name: Shilong Zhang; name: Lianghua Huang; name: Xi Chen; name: Yifei Zhang; name: Zhi-Fan Wu; name: Yutong Feng; name: Wei Wang; name: Yujun Shen; name: Yu Liu; name: Ping Luo
Published: 2024-03-25 17:59:57

Abstract: This work presents FlashFace, a practical tool with which users can easily
personalize their own photos on the fly by providing one or a few reference
face images and a text prompt. Our approach is distinguishable from existing
human photo customization methods by higher-fidelity identity preservation and
better instruction following, benefiting from two subtle designs. First, we
encode the face identity into a series of feature maps instead of one image
token as in prior arts, allowing the model to retain more details of the
reference faces (e.g., scars, tattoos, and face shape ). Second, we introduce a
disentangled integration strategy to balance the text and image guidance during
the text-to-image generation process, alleviating the conflict between the
reference faces and the text prompts (e.g., personalizing an adult into a
"child" or an "elder"). Extensive experimental results demonstrate the
effectiveness of our method on various applications, including human image
personalization, face swapping under language prompts, making virtual
characters into real people, etc. Project Page:
https://jshilong.github.io/flashface-page.