trysem/DualStyleGANplus

Model Details

This system provides a web demo for the following paper:

Pastiche Master: Exemplar-Based High-Resolution Portrait Style Transfer (CVPR 2022)

• Algorithm developed by: Shuai Yang, Liming Jiang, Ziwei Liu and Chen Change Loy
• Web demo developed by: hysts
• Resources for more information:
  • Project Page
  • Research Paper
  • GitHub Repo

Abstract

Recent studies on StyleGAN show high performance on artistic portrait generation by transfer learning with limited data. In this paper, we explore more challenging exemplar-based high-resolution portrait style transfer by introducing a novel DualStyleGAN with flexible control of dual styles of the original face domain and the extended artistic portrait domain. Different from StyleGAN, DualStyleGAN provides a natural way of style transfer by characterizing the content and style of a portrait with an intrinsic style path and a new extrinsic style path, respectively. The delicately designed extrinsic style path enables our model to modulate both the color and complex structural styles hierarchically to precisely pastiche the style example. Furthermore, a novel progressive fine-tuning scheme is introduced to smoothly transform the generative space of the model to the target domain, even with the above modifications on the network architecture. Experiments demonstrate the superiority of DualStyleGAN over state-of-the-art methods in high-quality portrait style transfer and flexible style control.

Citation Information

@inproceedings{yang2022Pastiche,
 author = {Yang, Shuai and Jiang, Liming and Liu, Ziwei and and Loy, Chen Change},
 title = {Pastiche Master: Exemplar-Based High-Resolution Portrait Style Transfer},
 booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
 year = {2022}
}