ACFun: Abstract-Concrete Fusion Facial Stylization
Authors: Jiapeng Ji
Kun Wei
Ziqi Zhang
Cheng Deng
Venue: NeurIPS 2024 poster (2024)
Keywords: Large-Model Stylized
One-Shot Learning
Facial Stylization
Primary area: diffusion_based_models

Abstract: Owing to advancements in image synthesis techniques, stylization methodologies for large models have garnered remarkable outcomes. However, when it comes to processing facial images, the outcomes frequently fall short of expectations. Facial stylization is predominantly challenged by two significant hurdles. Firstly, obtaining a large dataset of high-quality stylized images is difficult. The scarcity and diversity of artistic styles make it impractical to compile comprehensive datasets for each style. Secondly, while many methods can transfer colors and strokes from style images, these elements alone cannot fully capture a specific style, which encompasses both concrete and abstract visual elements. Additionally, facial stylization often alters the visual features of the face, making it challenging to balance these changes with the need to retain facial information. To address these issues, we propose a novel method called ACFun, which uses only one style image and one facial image for facial stylization. ACFun comprises an Abstract Fusion Module (AFun) and a Concrete Fusion Module (CFun), which separately learn the abstract and concrete features of the style and face. We also design a Face and Style Imagery Alignment Loss to align the style image with the face image in the latent space. Finally, we generate styled facial images from noise directly to complete the facial stylization task. Experiments show that our method outperforms others in facial stylization, producing highly artistic and visually pleasing results.

ACFun: Abstract-Concreta Fusion Facial Stylization
Jiapeng Ji, Kun Wei; Ziqi Zhang, Cheng Deng
School of Electronic Engineering. Xidian University Xi'an 710071, China
jiapengji777@@mail.com
weikunsk@gmail com, zqzh91160gmail. com, thdeng.xd@gman com
Abstract
Owing to advancements in image synthesis techniques, stylization methodologies for large models have garnered remarkable outcomes. However, when it comes processing facial images, the outcomes frequently fall short expectations. Facial stylization is predominantly challenged by two significant hurdles. Firstly, obtain- ing a large dataset of high-quality stylized images is difficult. The scarcity and diversity of artistic styles make it impractical to compile comprehensive datasets for each style. Secondly, while many methods can transfer colors and strokes from style images, these elements alone cannot fully capture specific style, which encompasses both concrete and abstract visual elements. Additionally, facial styl- ization often alters the visual features of the face, making challenging to balance these changes with the need to retain facial information. To address these issues, we propose a novel method called ACFun, which uses only one style image and one facial image for facial stylization. ACFun comprises an Abstract Fusion Module (AFun) and a Concrete Fusion Module (CFun), which separately learn the abstract and concrete features of the style and face. We also design a Face and Style Imagery Alignment Loss align the style image with the face image in the latent space. Finally, we generate styled facial images from noise directly to complete the facial stylization task. Experiments show that our method outperforms others in facial stylization, producing highly artistic and visually pleasing results.
1
Introduction
Style transfer is a long-standing research topic that aims to generate new artistic image from an arbitrary imput pair of natural images and painting images by combining the content of the natural image and the style of the painting image. With the rapid development of deep learning, optimization- based methods (1-3] and feed-forward based methods 4
5 6 continually emerged. These methods have made progress in visual quality and computational efficiency. However, these style transfer techniques can only modify low-level image features such as strokes and colors, and they are unable to adjust high-level semantics such as shape and content. It's like using the style image as template to paint the content image instead of truly creating new image based on the style. Style encompasses not only basic visual elements like strokes and colors but also deeper aspects such as structure, layout, and shape. These elements combine to create a unique visual language and form of expression. In the context of facial stylization, the challenges of style transfer are even more significant. Facial recognition relies on distinct and recognizable individual characteristics. which means that style transfer must capture the visual features of the style image and seamlessly integrate them into the target image while preserving facial recognizability.
2
With the rapid development of diffusion model-based image generation methods, several style transfer methods 7-0 have emerged, but these methods usually require a set of images belonging the same
Conresponding author.
38th Conference on Neural Information Processing Systems (NcurIPS 2024).

---

Style Image
Face Image
Result
Style Image
Fuce Image
Result
Figure 1: As shown in the figure, the ideal result of facial stylization aims to ensure the faithful restoration of facial information while also significantly deforming the facial image according the given style image. To achieve high-quality results, is essential to ensure that the production process not only meets the standards for good generation quality but also encompasses compelling and evocative artistic atmosphere.
style for training. However, due to the scarcity high-quality stylized images, it is difficult obtain them. Moreover, the diversity and complexity of artistic styles make compiling a comprehensive dataset for each style impractical. Subsequently, there are also some Textual-Inversioe
methods
[1] that can use single image, but this method only fine-tuned the CLIP model as the conditional input, which limited its ability to generate models and often caused it to be heavily affected by style degradation, resulting in simpler results and reduced image quality. Moreover, its style transfer method of adding noise and denoising to the target image reduces the flexibility the generated results and further limits its final generation performance.
As depicted in Figure I the most prominent challenge in facial stylization tasks is that images with artistic styles often display significant differences from real-world facial photos. These differences are evident not only in visual features but also in high-level semanties, such as shape and distribution. In particular, as shown in the lower part of Figure I there are notable disparities between abstract style portraits and real portraits, leading substantial changes in facial features during the stylization process. On the other side of the coin, it is essential for stylized facial images to maintain consistency facial information so that they remain recognizable to people. In summary, for stylized facial images, balancing the ability to maintain facial images with the drastic semantic changes brought about by stylization is the key to achieving good facial stylization results.
To this end, we propose a facial stylization method that allows deep neural networks to fuse abstract visual elements (deformation, distribution, atmosphere, etc.) from style and facial image with concrete visual elements (color, brushstrokes, lines, etc.) into an imagery visual feature just like artists, to achieve facial image stylization, rather than simply transferring texture and color information. Specifically, we introduced an Abstract-Concred Fusion Facial Stylization Model (ACFun) to fuse, consisting an Abstract Fusion Module(AFun and Concrete Fusion Module (CFun). The method ACFun uses for facial stylization involves learning abstract and concrete features separately and then combining style images with facial images by aligning them in an imagery feature space formed by the fusion of abstract and concrete features. We first extract abstract features of style and face

---

through AFun by encoding style images into the CLIP latent space and combining it with the facial description text prompts we use; then, we optimize it using a Eextual-Inversion based method to make it recognizable by CLIP for subsequent generation processes. In addition, by introducing face images during the training process, we implicitly fuse facial information with style abstract information. However, CLIP has limitations in distinguishing between specific style and facial images at the fine-grained level. To address this, we adopt the CFun module, which is a set of trainable parameters embedded in a pre-training generator to enhance its ability to extract concrete features from specific styles and facial images, which greatly improves the quality of the generated results. Finally, the above process is constrained by the Face and Style Imagery Alignment loss we proposed. We demonstrate the effectiveness and excellent facial stylization effect of our method through massive experiments.
2 Related Works
Text-to-lmage Generation. The method based on generating adversarial networks 12] has been widely applied in text-to-image generation by training on paired images and text samples. [13] improves condition generation [14] by changing the input conditions from a single class to more complex text descriptions. However, due to the difficulty of training GAN models and the significant progress of large language models [3]]6] and diffusion models, the diffusion models have gradually replaced the position of GAN. The diffusion model [8] generate realistic images through multiple rounds of iterative refinement. has been widely used in the image generation task and has achieved significant results [19], attracting the attention of many researchers. Among all these diffusion- baseed methods, Stable Diffusion (20) is the most typical work. It achieves awe-inspiring results through training on large-scal- text image datasets. Afterward, SDXL 21 was introduced with larger model parameters and larger datasets. However, these methods all focus on learning text prompts, meaning that the model can only fit the given reference style through existing knowledge rather than train the generated model to have the ability to generate specific style images. We fine-tune the model to make it more intuitive to learn the target style straightly. Thanks these powerful pre-trained generative models, we can flexibly apply them to various downstream task applications.
Personalization of Generative Models. How to use pre-trained text-to-image large model to complete personalized image synthesis tasks has attracted widespread attention (22). The widely used method in image generation tasks is the inversion- based method, which aims to find corresponding noise or conditioning embedding to a generated image. Textual Inversion [9] and Hard prompt made easy (PEZ) 23 convert set of images of object into corresponding textual representations (such as embedding, token) instead of changing the parameters of the text-to-image model. Dreambooth the pre-trained model. At the same time, when learning new class concepts, Dreambooth transforms this concept into a special sub-concept of a specific class. Dreambooth achieves the goal of data augmentation by generating original classes, preventing new concept classes from overwriting existing original classes, leading to catastrophic forgetting and affecting the diversity of generated models, leading to overfitting. Lora [8] has also achieved widespread application by transferring the strategy of fine-tuning pre- pre-tranee LLM to image generation methods (24), allowing it to save computational and storage costs without the need to train the entire generation network. Although the above methods have achieved good results, they all learn the description of specific concepts through set of images, which makes difficult to meet our needs. The method we adopt only requires pair of images to learn the abstract and concrete features of style images and facial images and ultimately generate a stylized facial image.
learns target concepts by
Facial Stylization. Facial stylization is currently a widely recognized task in the field of style conversion. Typical style transfer methods such as 225
6 27 can effectively transfer the concrete visual features such as texture and color contained in the given style image. However, when facing facial images, especially when transferring real facial images to styles with strong geometric distortions (such as comics, anime, abstract paintings, etc.), the effect is often poor. Although some methods (28] [2) use large-scale paired image data for image-to-image translation training, in practical applications, due to the diversity and scarcity of high-quality style images, collecting such a large number of paired images is not realistic, and some images do not even exist, which makes the above methods difficult to apply in practice. StyleGAN [30] achieves facial stylization through image inversion 31 29 32 34 but due to the presence of its latent space, it suffers from problems such as image degradation and limited deformation. Although the method of textual inversion [0] 11 can form certain deformations, the problem of style degradation cannot be ignored. Our method solves the above problem by learning abstract and concrete features separately and aligning images.
26 4
3

---

Face Style Abstract Fusion Module (AFun)
CLIP Image Encoder
CLIP Text Encoder
Facial Description Prompt
I.A painting
wemun stylie
CFun
CFun
CFun
CFun
CFun
CFun
Lhaeee Face and Style Eaebeen yy Sanuins L0s
Pre-trained Diffusion Model
Figure 2: The overall schematic diagram of ACFun consists of two parts: one is the AFun module for extracting abstract features, and the other is the CFun module for extracting concrete features. The entire training process is controlled by our carefully designed Face and Style Imagery Alignment loss. We utilized facial description text prompt to enhance the fusion of style and facial images.
Method
3.1
Overview
In this paper, we propose novel method named ACFun for image style transfer: the structure and process are shown in Figure 2 Facial style transfer aims to preserve facial identity information while being as close to the target style as possible. Inspired by different artistic styles of expression, we divide visual features into more complex and difficult to describe abstract features, such as shape or atmosphere, and more specific concrete features, such as color or strokes. And ultimately, by combining abstract features and concrete features into imagery features and utilizing them to generate stylized facial images.
Therefore, we first propose an AFun module. By using a CLIP encoder to encode the style image and combine it with a facial description text prompt using the attention mechanism fully use the information of the reference style image. Then, we optimize it into an embedding e* that can be recognized by the generated model in the subsequent generation process. However, simply using the aforementioned inversion-based method often leads to style degradation, resulting in the loss of some concrete visual content the final result, which is often fatal for facial stylization tasks. So, both facial and style images are introduced simultaneously during the training process. To this end, we adopt the CFun module, improve the flexibility of the network and enable it to have contract generation capabilities, we insert a set of trainable parameters into pre-trained U-net and adopt the Face and Style Imagery Alignment loss to constrain the above process.
3.2 Face and Style Abstract Fusion Module (AFun)
To fully utilize the pre-trained large-scale model, we hope to learn the style in the target style image as specific intermediate representation, which suitable for the pre-trained model. This method uses CLIP text encoder for text-to-image generation in stable diffusion. It inputs the text embedding, which is embedded by the CLIP text encoder 7, as a condition. We use the pseudo-word *5** as placeholder for the image style and introduce the concept of specific image styles into the pre-trained model through a learnable corresponding embedding e," However, using only a single pseudo-word S* as placeholder, this simple and vague text prompt inevitably leads to only being able to extract the content of the entire style image, regardless of whether is an abstract style feature or a specific content feature. This will bring problems due to the content of the style image in our subsequent

---

ResBlock
pillown
UpriDrra
Semple
Sample
CPun
Cale-hi
Laver
Weight Layer
Layer
Figure 3: Left:: The specific insertion method and structure of our CFun. Right: Our proposed imagery latent space, where the red line represents the VQ visual space, the green line represents the imagery latent space, and the blue line represents the process of mapping the original image from the VQ space into the imagery latent space through the introduction of abstract features Ca-
facial stylization process, such as style leakage or style coverage. To address this issue, we used facial description text prompts Sy. The style and content of the style image can be automatically separated by the description of the facial image, such as "A painting of a woman in S* style." This because in the subsequent training process, style images I, and facial images , are introduced, and CLIP naturally implicitly receives information from facial images I during the feature update process. We embed the style image I, using CLIP image encoder T; as embedding e Then, we fuse it with facial description text prompts embedding Bi to obtain abstract features Co. This process can be expressed as:
min EI,,1 E Par-otaltt 60(22, Te (e)
et =en
where stands for an initial noise map E (0, 1), én is the denoising network, t = 1... T stands for the time step for the diffusion model. Since our method only requires pair of images to complete training, it is difficult to thoroughly learn the style in the background image using vanilla textual inversion method, and overfitting is prone to occur. To alleviate this problem, we also introduced image information, allowing the model to learn the style and facial abstract visual elements in the image more fully. Benefiting from the CLIP model that has already aligned text with images in its latent space as multi-modal model, the fusion process of style image embedding et, with facial description text prompts embedding ei using an attention mechanism can be represented as:
Q. = w-lm) (n)) K wi(n) Q
Ci. V Wi(n) Ei.
Ett
OKTT)
(2)
(n-1) Attention K, K,V) V) softmar
and set dropout in the attention mechanism to alleviate overfitting problems.
3.3 Face and Style Concrete Fusion Module (CFun)
Even if we have obtained an abstract feature e, that blends style and facial information, relying solely on this feature generate images means that we can only fit the target style and facial image using the prior knowledge already present in the pre-trained model. However, in real life. there are numerous style images and facial images, many unseen by pre-trained models, making it challenging to generate the desired results. To solve the above problem, we propose the CFun module for generating concrete visual features. By inserting a set of learnable parameters into U-net, we enhance the flexibility of the network and enable it to learn the visual features of input images. For its insertion position, considering that we do not want to damage the style and information in the facial image excessively. It is too risky to directly insert parameters into the Attention Block for training, this
5

---

may involve overly advanced semantics. Directly changing the Attention Block may result in too drastic advanced semantic changes, ultimately leading to excessively distorted stylized face images. So, we choose to insert the parameters into Resblock, which can make our parameters focus more on specific concrete visual features and indirectly affect the Attention module, thus achieving a balance between the information retention ability of facial images and the high-level semantic changeability brought by stylization. In addition, inspired by AdaIN [4], our insertion module adopts an affine mechanism, which can ensure that the network parameters further improving the stability during training. The specific structure and insertion method are shown on the left of Figure B] We separate content from the style by calculating mean-standann
not affected during initial training,
CFun(a) - (() 3(a(z)).
And only the style information, i.c., standard (z),, is fused with the network. This is mainly because the abstract features we use are only fused from style images and facial description text prompts at the beginning of training, and no facial image information has been obtained yet. To avoid excessive activation of abstract features and style images in cross-attention during the training process, causing the generated stylized facial images to irreversibly guide to style images, resulting in the final generation result being strongly covered by style.
3.4 Face and Style Imagery Alignment Loss
Finally, we use a Face and Style Imagery Aligmment loss to constrain all the above processes. However, shown on the right of Figure even if encoding using VQ space, the interpolated images represented by simple style images and facial images are meaningless, just a simple superposition of the images. However, initially, we had already used AFun fuse style images with facial description text prompts and provided an abstract feature ea for subsequent training processes. This allowed have abstract feature en guidance in the subsequent optimization process. After combining the abstract feature with initial noise, the space it projects onto is not simply a VQ latent space composed of simple image features but a latent space composed of semantic features after the combination, we call this latent space, which combines abstraction and concreteness, the imagery space. This also makes our proposed Face and Style Imagery Alignment loss effective. Specifically, by aligning I, and y in the imagery space, we obtain an image I; that integrates abstract and concrete features of facial image 1 and style image I, achieve the goal of facial stylization. We also use the two hyperparameters we establish, 39 and 7, to control the tendency of the model towards the relationship between facial image content and style during the optimization process. Finally, the pre-trained text-to-image diffusion model DM is used, and the initial noise map N(0, 1) and the abstract feature e, obtained in the previous step are given as inputs to generate the image I, = DM e,). and the diffusion model is fine-tuned using the squared error loss. The specific formula is follows:
min EI,,,,,e BBill ofe, x.) 1,112 Parl) toc, ct)) - 11)) i.
(4)
Where de dr, are parameters used to control the noise schedule and sampling quality and functions of the diffusion process time t ~ U(O 1)). Meanwhile, this is a win-win training strategy. On the one hand, the abstract features c, of AFun provide good latent space for the training of the generator. On the other hand, through gradient backward, the abstract features of AFun can also extract concrete information from facial images, providing better quality guidance. Through this method, we can constrain the optimization process of abstract feature fusion for style images and face images in CLIP space, as well as the extraction of concrete features for style images and face images using learnable parameters inserted into the generator.
Experiments
In this section, we conduct experiments using images collected from the Internet and provide visual comparisons. We also conducted experiments on both facial stylization and text-to-image generation tasks. Our method has achieved good visual effects in various experiments, demonstrating its effectiveness.

---

Style Image
Face Image
Ours
InstanSttyle SDXL
InstaneSiste SD15
DreamStyyler
Inst
AesPA
StyTi22
Figure 4: We experimented with different facial and stylistic images and compared our previous high-peu petth-rerfrraccee methods. It can be seen that our facial stylization results have stronger style, while ensuring facial information while harmoniously and naturally integrating with the target style.
4.1 Implementation Details
We trained on single Nvidia A6000 graphics card, and in the case of single pair of images, set the batch size to Fach epoch took about 30 seconds, and the overall training process epochs, which takes only 3 minutes. We set the base learning rate 1.0e 04, and the remaining hyperparameters are consistent with Stable Diffusion without changing. Through 40 steps of diffusion, our method can obtain stylized facial images with good results. We set the hyperparameters' y and 3 to 0.8 and 1.0, respectively, and all subsequent experiments will use this hyperparameter setting method.
4.2 Quality Analysis
We compare our method with the state-of-the-are image style transfer methods, including InstantStyle [35], DreamStyler [10), Inst [II], AesPA (36), StyTr2 [37]. As shown in Figure 4 the generation results fully demonstrate the excellent performance of our method. Compared with the traditional two-column method on the far right, it can be seen that our method can modify the target image according to the high-level visual elements the reference style image instead of traditional methods only focusing on low-level visual elements such as color or strokes. Compared to the DreamStyler and Inst inversion-based methods, can be observed that both methods suffer from serious style degradation, which makes the stylized facial images they generate more sloppy and tend to generate simpler images. InstantStyle pursues fast generation due its Tuning-Free mode. However, due to its use of ControlNets [38] to control the final generated face, the model only pieces together the
7

---

A puinting of womun in style
painting with glasses
painting baby girl in
ppinting with monsinche
Style lesage
Face Imagee
dtyle
Curs
InstansSityl
3
Ours
InstantSiyie
We have made more comparisons with the InstantStyle methods. Our method not only achieves good results in terms of generation quality but also has the ability to generate following text guidance.
Figure 5:
elements in the style image according to the guidance by ControlNets rather than truly understanding the face. At the same time, due the lack of new knowledge introduction, the generated results are not ideal. When using SDXL [21], the generated results also show some competitiveness. However, when using a smaller network like SD1.5, it can be seen that due to the insufficient prior knowledge to support its generation of input images of any style, the results are quite struggling and even generate a lot of noise in some images. On the contrary, although our method only uses SD1.4 .,, a more basic pre-trained generative network, as our backbone model, the injection of new knowledge makes our generation results more effortless. It can be seen that our results faithfully restore facial image information while being close to the reference style image. displaying highly artistic facial stylization result. We show more quality results and quantitative results in the supplement material.
4.3 Text-to-Image Generation
In addition to focusing on facial stylization generation, our method also has the ability to generate by text guidance since the Stable Diffusion we take as our backbone is originally a text-to-image generation mode. We compare our method with InstantStyle [35] as shown in Figure[3] It can be seen that, our method achieves better visual effects compared to Instantstyle. While ensuring that the style and facial features remain unchanged, we generated corresponding results based on the given text input and displayed good image quality. As Instantstyle is method of tuning for free, it only relies on changing the attention parameter and subsequently using controllnet to control the final generation result. This also means that the Instantstyle method does not require additional knowledge injection, which makes it lack understanding of the given style and face. On the other hand, the presence of ControlNets can also interfere with the generation results of text participation guidance to some extent. As shown in the bottom line, Instantstyle hardly responds to the first four text inputs. Thanks to the injection of additional knowledge and the high compatibility between directly generating images from noise and text-to-image generation, method can generate high-quality images that combine style, facial information, and fit text descriptions.
4.4 Ablation Study
We conducted ablation experiments on different modules to demonstrate how we extract the required features and how they work. As shown in Figure 6 we first do not use any CFun modules but only abstract features from Afun for generation. It can be seen that the generated result is only blurry
8

---

Encoder
in Decoder
Figure 6: The ablation experiment demonstrated the role of our proposed abstract and concrete features, demonstrating the effectiveness of our proposed separation of learning abstract and concrete features.
image without specific facial information. However, abstract level, it can be whether it is male or female, and it also provides the colors required for the final generated image. By introducing Cfun into the encoder, it can be seen that the specific features of CFun provide low-Ievel visual information, such as stroke texture. In the decoder, CFun can see that the main concrete features the structure and posture of the face. The results of the ablation experiment indicate that the feature extraction mechanism is consistent with what we described in the methods section, proving the effectiveness of our method and the rationality of the proposed method. We show more results in our supplement material.
Conclusion
We propose new facial stylization method called ACFun, which can achieve facial image stylization using only one image pair. To adapt to the task of facial stylization, we separate the learning of abstract features and concrete features through AFun and CFun and constrain the above process through a carefully designed Face and Style Imagery Alignment loss. We can transform any facial image into a specific style through short-term training. Numerous experiments have shown that our method exhibits excellent facial stylization and text-guided image generation results compared to state-of-the-ard methods. large number of visual results demonstrate that our method not only has good facial preservation ability but also generates stylized facial images with strong artistic atmosphere. Meanwhile, the results of ablation research have demonstrated the effectiveness of proposed method and demonstrated that our proposed AFun module and CFun module indeed learn abstract and concrete features separately. Our method provides excellent convenience for facial stylization generation.
6 Limitation
Even if we use separate learning methods, style always difficult to describe, which often leads to some low-level or advanced visual features being deeply bound to certain content, resulting in inevitable style leakage problems. A typical example that stylized facial images will change with the posture in the style image. Furthermore, due to the ambiguity of the style, our method is still unable to accurately extract few visual elements of the style we want to exist in the style image. Moreover, method relies the effectiveness of the pre-trained model. We found that the training data used in the pre-trained model is imbalanced, especially when facing certain specific character images style images. This can lead to serious semantic binding phenomena, making it difficult to stylize or causing obvious style leakage, which can also impact the performance of our method.
Acknowledgements
Our work is supported in part by the National Key R&D Program of China (No. 2033FFC3305000, Joint Fund of Ministry Education of China (8091B022 B022149), National Natural Science Foundation of China (62132016 132016, 62406238), and Natural Science Basic Research Program of Shaanxi (2020JC-23).

---

References
[1] Leon A Gatys, Alexander S Ecker, and Matthias Bethge. Image style transfer using convolutional neural networks. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pages 2414-2423, 2016.
[2] Yanghao Li. Naiyan Wang, Jiaying Liu, and Xiaodi Hou. Demystifying neural style transfer. arXiv preprint orXiv:/701.000 2017.
[3] Nicholas Kolkin, Jason Salavon, and Gregory Shakhnarovich. Style transfer by relaxed optimal trans- port and self-similarity. In Proceedings of the IEEE/CVF Conference Computer Vision and Puttern Recognition, pages 10051-10060. 2019.
[4] Xun Huang and Serge Belongie. Arbitrary style transfer in real time with adaptive instance normalization. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 1501-1510, 2017.
[5] Dae Young Park and Kwang Hee Lec. Arbitrary style transfer with stylc-attentional networks. In proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 5880-5888, 2019.
[6] Songhua Liu, Tianwei Lin, Dongliang He, Fu Li, Meiling Wang. Xin Li, Zhengxing Sun, Qian Li, and Errui Ding. Adaattn: Revisit attention mechanism in arbitrary neural style transfer. In Proceedings of the IEEE/CVF International Conference Computer Vision, pages 6649-665 6658, 2021.
[7] Nataniel Ruiz, Yuanzhen Li, Varun Jampani, Yacl Pritch, Michael Rubinstein, and Kfir Aberman. Dream- booth: Fine tuning text-to-image diffusion models for subject-driven generation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 22500-22510, 2023.
[8] Edward Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Wang, and Weizhu Chen. Lora: Low-rank adaptation of large language models. arXiv preprint arXiv:2106.094: 09655 2021.
[9] Rinon Gal, Yuval Alaluf, Yuval Atzmon, Or Patashnik, Amit H Bermano, Gal Chechik, and Daniel Cohen-Or. An image is worth one word: Personalizing text-to-image generation using textual inversion. arXiv preprint arXiv:2208. 01618, 2022.
[10] Namhyuk Ahn, Junsoo Lee, Chunggi Lee, Kunhee Kim, Daesik Kim, Seung-Hun Nam, and Kibeom Hong. Dreamstyler: Paint by style inversion with texl-to-image diffusion models. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 38, pages 674-681, 2024.
[11] Yuxin Zhang, Nisha Huang, Fan Tang. Haibin Huang, Chongyang Ma, Weiming Dong, and Changsheng Xu. Inversion-based style transfer with diffusion models. In Proceedings of the TEFE/CVE Conference on Computer Vision and Pattern Recognition, pages 10146-10156, 2023.
[12] Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. Generative adversarial nets. Advances in Neural Information Processing Systems, 27, 2014.
[13] Scott Reed, Zeynep Akata, Xinchen Yan. Lajanugen Logeswaran, Bernt Schiele. and Honglak Lee. Generative adversarial text to image synthesis. In International Conference on Machine Learning, pages 1060-1069. PMLR, 2016.
[14] Mehdi Mirza and Simon Osindero. Conditional generative adversarial nets. arXiv preprint 14Xiv:1411.118 2014.
[15] Duzhen Zhang, Yahan Yu. Jiahua Dong, Chenxing Li. Dan Su, Chenhui Chu, and Dong Yu. MM-LLMs: Recent advances in MultiModal large language models. In Findingy of the Association for Computational Linguistics ACL 2024, pages 12401-12438 August 2024.
[16] Chenghao Xu, Guangtao Lyu, Jiexi Yan, Muli Yang, Cheng Deng. Llm knows body language, too: Translating speech voices into human gestures. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 5004-5013, 2024.
[17] Jonathan Ho, Ajay Jain, and Pieter Abbeel. Denoising diffusion probabilistic models. Advances in Neural Information Processing Systems, 33:6840-6851 2020. 2020.
[18] Jiaming Song, Chenlin Meng, and Stefano Ermon. Denoising diffusion implicit models, arXiv preprint 02x2020110.22502,222 2020.
10

---

[19] Prafulla Dhariwal and Alexander Nichol. Diffusion models beat gans on image synthesis. Advunces in Neural Information Processing Systems, 34:8780-8794, 2021.
[20] Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Bjöm Ommer. High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 10684-10695, 2022.
[21] Dustin Podell, Zion English, Kyle Lacey, Andreas Blattmann, Tim Dockhorn, Jonas Müller, Joe Penna, and Robin Rombach. Sdxl: Improving latent diffusion models for high-resolution image synthesis. arXiv preprint ar 2023.
[22] Jiahua Dong, Wenqi Liang, Hongliu Li, Duzhen Zhang, Meng Cao, Henghui Ding, Salman Khan, and Fahad Khan. How to continually adapt text-to-image diffusion models for flexible customization? In Advances in Neural Information Processing Systems, 2024.
[23] Yuxin Wen, Neel Jain, John Kirchenbauer, Micah Goldblum, Jonas Geiping, and Tom Goldstein. Hard prompts made easy: Gradient-based discrete optimization for prompt tuning and discovery. arXiv preprint arXiv:2302.0360 000026002.066.. 2023.
[24] Gan Sun, Wenqi Liang, Jiahua Dong. Jun Li, Zhengming Ding, and Yang Cong. Create your world: Lifelong text-to-image diffusion. IEEE Transactions on Puttern Analysis and Machine Intelligence. 46(9):6454-6470, 2024.
[25] Leon A Gatys, Alexander S Ecker, and Matthias Bethge. A neural algorithm of artistic style. arXiv preprint arXiv:1508. 06576, 2015.
[26] Leon Gatys, Alexander Ecker. and Matthias Bethge. Texture synthesis using convolutional neural networks. Advances in Neural Information Processing Systems, 28, 2015.
[27] Jie An, Siyu Huang, Yibing Song. Dejing Dou, Wei Liu, and Jiebo Luo. Artflow: Unbiased image style transfer via reversible neural flows. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 862-871, 2021.
[28] Phillip Isola, Jun- Yan Zhu, Tinghui Zhou, and Alexci A Efros. Image-to-image translation with conditional adversarial networks. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 1125-1134, 113,, 2017.
[29] Jun-Yan Zhu, Taesung Park, Phillip Isola, and Alexei Efros. Unpaired image-to-image translation using cycle-consistent adversarial networks. In Proceedings of the IEEE international conference on computer vision, pages 2223-2232, 2017.
[30] Tero Karras, Samuli Laine, and Timo Aila. A style-based generator architecture for generative adversarial networks. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 4401-4415 2019.
[31] Peihao Zhu Rameen Abdal, John Femiani, and Peter Wonka. Mind the gap: Domain gap control for single shot domain adaptation for generative adversarial networks. arXiv preprint 1rXiv:2110.08398, 2021.
[32] Min Jin Chong and David Forsyth. Jojogan: One shot face stylization. In European Conference on Computer Vision, pages 152. Springer, 2022.
[33] Ziqi Zhang, Siduo Pan, Kun Wei, Jiapeng Ji, Xu Yang. and Cheng Deng. Few-shot generative model adaption via optimal kernel modulation. IEFE Transactions on Circuits and Systems for Video Technology, 2024.
[34] Siduo Pan, Ziqi Zhang, Kun Wei, Xu Yang, and Cheng Deng. Few-shot generative model adaptation via style-guided prompt. IEFE Transactions on Multimedia, 2024.
[35] Haofan Wang, Qixun Wang, Xu Bai, Zekui Qin, and Anthony Chen. Instantstyle: Free lunch towards style-preserving in text-to-image generation. arXiv preprint arXiv:4404.02333, 2024.
[36] Kibeom Hong. Seogkyu Jeon, Junsoo Lee, Namhyuk Ahn, Kunhee Kim, Pilhyeon Lee, Daesik Kim, Youngjung Uh, and Hyeran Byun. Aespa-net: Aesthetic pattern-aware style transfer networks. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 22758-22767, 2023.
[37] Yingying Deng, Fan Tang, Weiming Dong, Chongyang Ma, Xingjia Pan, Lei Wang, and Changsheng Xu. Stytr2: Image style transfer with transformers. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pages
2022.
[38] Lvmin Zhang, Anyi Rao, and Maneesh Agrawala. Adding conditional control to text-to-image diffusion models. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 1836-3847 2023.

---

A Quantitative Analysis
We also conducted quantitative experiments based on user study, shown in Table T providing 40 pairs of style facial images and their generated results, and collected voting results from 50 volunteers. The voting was conducted from three aspects: style consistency, facial consistency, and overall which image users prefer. The results are shown in the table. It can be seen that our method can achieve good results in style consistency and outstanding performance facial consistency and overall evaluation. In addition, we also compared our method separately with Instantstyle SDXL, which is shown in Table [ and it can be seen that users favor our approach.
Table I: Quantitative Experiments based on user study.
Ours
InstantStyle SDXL InstantStyle SD1.5
DreamStyler
Inst
Style Consistency
29.17%
21.67%
34.17%
8.33%
6.67%
Face Consistency 63.33% %
10.83%
6.67%
9.17%
10%
Overall
54.17%
10.83%
15.00%
10.83%
9.17%
Table 2: Separately Compared with Instantstyle SDXL
Ours
InstantStyle SDXL
Style Consistency 52.27% %
47.73%
Face Consistency 63.64%
36.36%
Overall 71.59%
28.41 %
B Comparative Experimental Analysis
In this section, we conduct a comparative analysis of the prompts within the AFun module discussed in Section (322, the two experimental implements within the CFun module detailed in Section 3.3 and the hyperparameters of the Face and Style Imagery Alignment Loss as outlined Section 3.4
B.1 Single pseudo-word Prompt vs Facial Description Prompt
It can be seen in Figure that the facial stylization results using facial description text prompts show better stability and generation quality, which also proves that facial description text prompts improve the accuracy of style and facial learning. Meanwhile, since facial description texts contain more information, we can obtain a better initial abstract feature, which reduces the difficulty of subsequent training. In addition, facial stylization results using only single pseudo-word will always be affected by artifacts, especially in results with stronger styles. This further demonstrates the effectiveness of our facial description text prompts.
B.2 Hyperparameter Analysis of Imagery Alignment Loss
We also set different y and / parameters, which are 0,6:1, 0.8:1, and 1:1. is obviously shown in Figure continues to increase, the style information contained its facial stylization results will become more dense. At 0.6:1, the style information is almost completely ineffective, and its stylization ability extremely limited, only staying at color changes or facial shifts. When set to 1:1, dense style information is introduced into the facial image, and even style leakage may occur, such as turning hair into green. This also proves the effectiveness of our proposed Imagery Alignment Loss and the existence of our proposed Imagery Latent Space. We can indeed generate stylized facial images by finding point the Imagery Latent Space that lies between the style image and the facial image.
12

---

Face
Style
+
With single pseudo-word
NETI FOL
0.51
0.65
With facial description text prompt
11
0r81
0.6:1
Figure Single pseudo-word Prompt Facial Description Prompt and Hyperparameter Analysis of Imagery Alignment Loss
B.3 Resblock vs Attention Block
We mentioned our strategy of selecting the insertion parameter position n section 3.3
The experimen- tal results in Figure Figure&indiccate indicate that inserting training parameters into attention can lead to serious style leakage, resulting in overfitting the given style image. This is because the initial abstract features ea we provide are obtained by fusing the CLIP encoding e,, of the style image I, with the CLIP encoding et, of the facial description text prompt ly. This means that initial abstract features e, do not contain facial information. If we use the method of inserting parameters into attention, the style information in the abstract features e, will be activated before information the facial image, leading serious style leakage and overfitting.
13

---

Style
Face
CFun
Tuning Attention
With Mean
ISUMA
Figure 8: Resblock vs Attention Block and Mean + Standard vs Only Standard
B.4 Mean Standard vs Only Standard
The use of Mean becomes even more complex, as shown in the figure. We found that the reverse direction of overfitting in the final result is uncertain, possibly due to the more complex information contained the Mean and the higher degree of mixing of facial and style information. However, regardless, the excessive content information contained in Mean is not conducive to our facial stylization. By only using Standard, we can avoid this trouble and obtain more stable facial stylization results.
C More Stylization Results
In this section, we conduct an interesting experiment on splicing facial images and present array of stylized experimental results, all of which demonstrate commendable efficacy.
C.1 Splicing Facial Stylization
We have designed an extremely interesting task to demonstrate the superiority of our proposed method and why believe that separating abstract and conerete features for learning and finally mixing them into imagery features can effectively complete the task of facial stylization. We use this image stylize faces by concatenating different parts of different faces into single face. As comparison, InstantStyle, due to the presence of ControlNet, directly generates fragmented stylized facial image based on the cropped image, indicating that does not understand what a face is. Our images can generate complete and meaningful stylized facial images while ensuring the features contained in each facial feature as much as possible and harmoniously integrating them into one face. This is all due to our approach of abstract, concrete, and imagery features, which makes our model adopt more knowledge-drive approach rather than a simple feature transfer facial stylization method. This also indicates that even if the given image is fragmented, it does not prevent our method from finding meaningful feature corresponding to in the imagery latent space, which proves that our method has strong abstraction ability.
C.2 More Quality Experimental Results
We conducted experiments on more faces and styles to demonstrate the stability and generalization of our method, and we compared it with InstantStyle-SDXX method for comparison.
which is the best- InstantStyle Figure 10 and Figure [T] Even though we use SD1.4, which has
smaller CLIP and training on smaller dataset than SDXL, our method appears more adept at facial stylization tasks due to the injection of additional knowledge. can be seen that the stylized facial images generated by our method have a high artistic level, just like the creation of artist. Of
14

---

InstantStyle
Mixed Face
Style
Ours
Mixed Face
Style
Ours
InstantStyle
Figure 9: Splicing Facial Stylization
course, as the saying goes:' There are a thousand Hamlets in a thousand people's eyes', and people's understanding of images is subjective, triggering another reflection on me.
D Discussion
the Pre-trained Large Model a Natural Brain-like Mechanism? The fundamental idea artificial intelligence is to simulate the operation of the human brain through artificial neurons. From neurological perspective, human vision is not simply peripheral sensory experience but a product of the coordination between the brain and the senses. So, the perceptual process of human "secing" is not a simple bottom-up information transmission process but rather top-down information construction process. The processing of facial information and style information by the human brain is unique. This also means that the action of "seeing" not simply a visual drive but rather a knowledge-driven action.
The human visual mechanism is quite complex, especially when facing faces and artistic-style images. For faces, humans not only receive bioelectric signals from edge sensors but also activate specific brain regions and use more advanced knowledge from the hippocampus recognize faces jointly. And the same goes for style. As visual art experience, neuroaesthetics points out that art works
15

---

Style
Face
Ours
InstantStyle
Ours
InstantStyle
Ours
InstantStyle
Figure 10: More Quality Experimental Results
will stimulate specific brain regions through visual stimulation, while this process still involves knowledge from the hippocampus. This is why "There are a thousand Hamlets in a thousand peoples eyes". Different people have different understandings and feelings towards the same artistic image, as it involves their past life, experiences, and educational level. Therefore, facial stylization an extremely complex task which involves both algorithm design and human visual perception. This is why difficult to obtain a standard evaluation standard.
And does our method really possess mechanisms and abilities similar to the human brain? We can find very interesting phenomenon. For the abstract and concrete features we learn, like the processing of visual information by the human brain. On the one hand, it is stimulated by edge sensors, and on the other hand, is knowledge-drine also have vastly different characteristics in encoders and decoders, just like how the human left and right brains focus different functions and tasks. However, the diffusion model is not brain- like neural network designed concerning brain structures, which has also sparked our thinking about the relationship between large models and brain-like mechanisms.
cognition. In addition, concrete features
16

---

Face
Style
Ours
InstantStyle
Ours
InstantStyle
Ours
InstantStyle
Figure 11: More Quality Experimental Results
NeurIPS Paper Checklist
1. Claims
Question: Do the main claims made in the abstract and introduction accurately reflect the paper's contributions and scope?
Answer: [Yes]
Justification: As in the Abstract, our claim is that we present Abstract-Concrete Fusion Facial Stylization method, which is discussed in Section and make contributions in Section
Guidelines:
The answer NA means that the abstract and introduction do not include the claims made in the paper.
17

---

The abstract and/or introduction should clearly state the claims made, including the contributions made the paper and important assumptions and limitations. A No or NA answer to this question will not be perceived well by the reviewers.
The claims made should match theoretical and experimental results, and reflect how much the results can be expected to generalize to other settings.
is fine to include aspirational goals as motivation as long as is clear that these goals not attained by the paper.
2. Limitations
Question:
Does the paper discuss the limitations of the work performed by the authors?
Answer:
[Yes]
Justification:
We discuss the limitations in Section
Guidelines:
The answer NA means that the paper has no limitation while the answer No means that the paper has limitations, but those are not discussed in the paper.
The authors are encouraged to create separate "Limitations" section their paper.
The paper should point out any strong assumptions and how robust the results are to violations of these assumptions (e.g., independence assumptions, noiseless settings, model well-specification, asymptotic approximations only holding locally). The authors should reflect on how these assumptions might be violated in practice and what the implications would be.
The authors should reflect on the scope of the claims made, e.g., if the approach was only tested on few datasets or with few runs. In general, empirical results often depend on implicit assumptions, which should be articulated.
The authors should reflect the factors that influence the performance of the approach. For example, facial recognition algorithm may perform poorly when image resolution is low images are taken in low lighting. Or speech-to-text system might not be used reliably to provide closed captions for online lectures because it fails to handle technical jargon.
The authors should discuss the computational efficiency the proposed algorithms and how they scale with dataset size.
If applicable, the authors should discuss possible limitations of their approach to address problems of privacy and fairness.
While the authors might fear that complete honesty about limitations might be used by reviewers as grounds for rejection, worse outcome might be that reviewers discover limitations that aren't 't acknowledged in the paper. The authors should use their best judgment and recognize that individual actions in favor of transparency play an impor- tant role in developing norms that preserve the integrity of the community. Reviewers penalize honesty concerning limitations.
will be specifically instructed
3. Theory Assumptions and Proofs
Question: For each theoretical result, does the paper provide the full set of assumptions and complete (and correct) proof?
Answer: [NA]
Justification:
The paper does not include theoretical results.
Guidelines:
The answer NA means that the paper does include theoretical results.
All the theorems, formulas, and proofs in the paper should be numbered and cross- referenced.
All assumptions should be clearly stated referenced in the statement of any theorems.
The proofs can either appear in the main paper or the supplemental material, but they appear in the supplemental material, the authors are encouraged to provide short proof sketch provide intuition.
Inversely, any informal proof provided in the core of the paper should complemented by formal proofs provided in appendix supplemental material.
18

---

Theorems and Lemmas that the proof relies upon should be properly referenced.
4. Experimental Result Reproducibility
Does the paper fully disclose all the information needed to reproduce the main ex- perimental results the paper to the extent that affects the main claims and/or conclusions of the paper (regardless of whether the code and data are provided or not)?
Question:
Answer: [Yes]
Justification: We have provided a detailed introduction to the implementation details of our experiment Section
Guidelines:
The answer NA means that the paper does not include experiments. If the paper includes experiments, a No answer to this question will not perceived well by the reviewers: Making the paper reproducible is important, regardless of whether the code and data are provided or not.
If the contribution is dataset and/or model, the authors should describe the steps taken make their results reproducible or verifiable.
Depending on the contribution, reproducibility can be accomplished in various ways. For example, if the contribution is novel architecture, describing the architecture fully might suffice, or if the contribution a specific model and empirical evaluation, it may be necessary either make it possible for others to replicate the model with the same dataset, or provide access to the model. In general. releasing code and data is often one good way accomplish this, but reproducibility can also be provided via detailed instructions for how to replicate the results, access to a hosted model (e.g., in the case of large language model), releasing of a model checkpoint, or other means that appropriate to the research performed.
While NeurIPS does not require releasing code, the conference does require all submis- sions to provide some reasonable avenue for reproducibility, which may depend on the nature of the contribution. For example
(a) the contribution is primarily a new algorithm, the paper should make clear how to reproduce that algorithm. (b) If the contribution is primarily a new model architecture, the paper should describe the architecture clearly and fully.
(c) If the contribution is new model (e.g., a large language model), then there should either be way to access this model for reproducing the results or way to reproduce the model (c.g.. with an open-source dataset instructions for how to construct the dataset).
(d) We recognize that reproducibility may be tricky in some cases, in which case authors welcome describe the particular way they provide for reproducibility. In the case of closed-source models, it may be that access to the model is limited in some way (e.g., registered users), but it should be possible for other researchers to have some path to reproducing or verifying the results.
5. Open access to data and code
Question: Does the paper provide open access to the data and code, with sufficient instruc- tions faithfully reproduce the main experimental results, described in supplemental material?
Answer: [No]
Justification: The paper does not provide open access to the data and code due to proprietary restrictions. However, detailed descriptions of the experimental setup and model architecture are provided in Sections 3 and 4 ensuring the experiments can be understood and replicated by researchers with similar resources.
Guidelines:
The answer NA means that paper does not include experiments requiring code.
Please see the NeurlPS code and data submission guidelines (kttps://nips.ca
for more details.
19

---

While we encourage the release of code and data, we understand that this might not be possible, so "No" an acceptable answer. Papers cannot be rejected simply for not including code, unless this is central to the contribution (e.g., for new open-source benchmark).
The instructions should contain the exact command and environment needed to run to reproduce the results. See the NeurIPS code and data submission guidelines (https for more details.
7 //nips. http://cpppp.ccccceeeeeeeeeeeeee
The authors should provide instructions data access and preparation, including how to access the raw data, preprocessed data, intermediate data, and generated data, etc.
The authors should provide scripts to reproduce all experimental results for the new proposed method and baselines. only subset of experiments are reproducible, they should state which ones are omitted from the script and why.
At submission time, to preserve anonymity, the authors should release anonymized versions (if applicable).
Providing as much information as possible in supplemental material (appended the paper) is recommended, but including URLs to data and code is permitted.
6. Experimental Setting/Details
Question: Does the paper specify all the training and test details (c.g., data splits, hyper- parameters, how they were chosen, type of optimizer, etc.) necessary to understand the results?
Answer: [Yes]
The paper provides comprehensive details of the training and testing settings in Section[]] including data splits, chosen hyperparameters, and the type of optimizer used. This ensures that the experimental results are fully understandable and reproducible.
Justification:
Guidelines:
The answer NA means that the paper does not include experiments.
The experimental setting should be presented in the core of the paper to level of detail that is necessary to appreciate the results and make sense of them.
The full details can be provided either with the code, in appendix, as supplemental material.
7. Experiment Statistical Significance
Question: Does the paper report error bars suitably and correctly defined or other appropriate information about the statistical significance of the experiments?
Answer: [No]
Justification: Error bars are not reported as previous attribute and affordance benchmarks.
Guidelines:
The answer NA means that the paper does not include experiments.
The authors should answer "Yes" if the results are accompanied by error bars, confi- dence intervals, or statistical significance tests, at least for the experiments that support the main claims of the paper.
The factors of variability that the error bars are capturing should be clearly stated (for example, train/test split, initialization, random drawing of some parameter, overall run with given experimental conditions).
The method for calculating the error bars should be explained (closed form formula, call to a library function, bootstrap, etc.)
The assumptions made should be given (e.g., Normally distributed errors).
It should be clear whether the error bar is the standard deviation the standard error of the mean.
It is OK to report 1-sigma error bars, but one should state it. The authors should preferably report a 2-sigma error bar than state that they have 96% CI, if the hypothesis of Normality of errors is not verified.
20

---

For asymmetric distributions, the authors should be careful not to show in tables or figures symmetric error bars that would yield results that are out range (e.g. negative enror rates).
If error bars are reported in tables or plots, The authors should explain in the text how they were calculated and reference the corresponding figures or tables in the text.
8. Experiments Compute Resources
For each experiment, does the paper provide sufficient information on the com- puter resources (type of compute workers, memory, time of execution) needed to reproduce the experiments?
Question:
Answer: [Yes]
Justification: Section specifies the type of compute resources used, including the GPU models, memory configurations, and the time required for each experiment, ensuring that the experiments can be accurately reproduced.
Guidelines:
The answer NA means that the paper does not include experiments.
The paper should indicate the type of compute workers CPU or GPU, internal cluster, or cloud provider, including relevant memory and storage.
The paper should provide the amount of compute required for each of the individual experimental runs as well as estimate the total compute.
The paper should disclose whether the full research project required more compute than the experiments reported in the paper (e.g., preliminary or failed experiments that didn't 't make it into the paper).
9. Code Of Ethics
Question: Does the research conducted in the paper conform, in every respect, with the NeurIPS Code of Ethics
Answer: [Yes]
Justification:
We have reviewed the NeurIPS Code of Ethics.
Guidelines:
The answer NA means that the authors have not reviewed the NeurlPS Code of Ethics.
If the authors answer No, they should explain the special circumstances that require deviation from the Code of Ethics.
The authors should make sure to preserve anonymity (e.g.. there special consid- eration due to laws or regulations in their jurisdiction).
Broader Impacts
Question: Does the paper discuss both potential positive societal impacts and negative societal impacts of the work performed?
Answer: [NA]
Justification: There is no societal impact of the work performed.
Guidelines:
The answer NA means that there is no societal impact of the work performed.
If the authors answer NA or No, they should explain why their work has no societal impact or why the paper does not address societal impact.
Examples of negative societal impacts include potential malicious unintended uses (e.g., disinformation. generating fake profiles, surveillance), fairness considerations (e.g.. deploymentt of technologies that could make decisions that unfairly impact specific groups). privacy considerations, and security considerations.
The conference expects that many papers will be foundational research and not tied to particular applications, let alone deployments. However, if there is direct path to any negative applications, the authors should point it out. For example, it is legitimate to point out that an improvement in the quality of generative models could be used to generate deepfakes for disinformation. On the other hand, it is not needed to point out that a generic algorithm for optimizing neural networks could enable people to train models that generate Deepfakes faster.
21

---

The authors should consider possible harms that could arise when the technology is being used as intended and functioning correctly, harms that could arise when the technology is being used as intended but gives incorrect results, and harms following from (intentional unintentional) misuse of the technology.
there are negative societal impacts, the authors could also discuss possible mitigation strategies (e.g., gated release of models, providing defenses in addition attacks, mechanisms for monitoring misuse, mechanisms to monitor how a system learns from feedback over time, improving the efficiency and accessibility of ML).
11. Safeguards
Does the paper describe safeguards that have been put in place for responsible release of data models that have high risk for misuse (e.g., pretrained language models, image generators, or scraped datasets)?
Question:
Answer: [NA]
Justification:
The paper poses no such risks.
Guidelines:
The answer NA means that the paper poses no such risks.
Released models that have high risk for misuse or dual-use should be released with necessary safeguards to allow controlled use of the model, for example by requiring that users adhere to usage guidelines or restrictions to access the model or implementing safety filters.
Datasets that have been scraped from the Internet could pose safety risks. The authors should describe how they avoided releasing unsafe images.
We recognize that providing effective safeguards is challenging, and many papers do not require this, but we encourage authors to take this into account and make best faith effort.
12. Licenses for existing assets
Question: Are the creators or original owners of assets (e.g., code, data, models), used in the paper. properly credited and are the license and terms of use explicitly mentioned and properly respected?
Answer: [Yes]
Justification: In Section 3 we cite including Stable Diffusion 20
Guidelines:
The answer NA means that the paper does not use existing assets.
The authors should cite the original paper that produced the code package dataset.
The authors should state which version of the asset is used and, if possible, include URL.
The name of the license (c.g., CC-BY 4.0) should be included for each asset.
For scraped data from a particular source (e.g., website). the copyright and terms of service of that source should provided.
assets are released, the license, copyright information, and terms use in the package should be provided. For popular datasets, haperswwthcode cwm/ datasets has curated licenses for some datasets. Their licensing guide can help determine the license of dataset.
For existing datasets that re-packaged, both the original license and the license of the derived asset (if it has changed) should be provided. If this information is not available online, the authors are encouraged to reach out to the asset's 's creators.
13. New Assets
Question: Are new assets introduced in the paper well documented and is the documentation provided alongside the assets?
Answer: [NA]
Justification:
The paper does not release new assets.
22

---

Guidelines:
The answer NA means that the paper does not release new assets.
Researchers should communicate the details of the datasct/code/model as part of their submissions via structured templates. This includes details about training, license, limitations, etc.
The paper should discuss whether and how consent obtained from people whose asset is used.
At submission time, remember to anonymize your assets (if applicable). You can either create anonymized URL or include an anonymized zip file.
14. Crowdsourcing and Research with Human Subjects
Question: For crowdsourcing experiments and research with human subjects, does the paper include the full text of instructions given to participants and screenshots, if applicable, as well as details about compensation (if any)?
Answer: [NA]
Justification:
The paper does not involve crowdsourcing nor research with human subjects.
Guidelines:
The answer NA means that the paper does not involve crowdsourcing research with human subjects.
Including this information in the supplemental material is fine, but if the main contribu- tion of the paper involves human subjects, then as much detail as possible should be included in the main paper.
According the NeurIPS Code of Ethics, workers involved in data collection, curation, or other labor should be paid at least the minimum wage in the country of the data collector.
15. Institutional Review Board (IRB) Approvals or Equivalent for Research with Human Subjects
Question: Does the paper describe potential risks incurred by study participants, whether such risks were disclosed to the subjects, and whether Institutional Review Board (IRB) approvals (or an equivalent approval/review based on the requirements of your country or institution) were obtained?
Answer: [NA]
Justification:
The paper does not involve crowdsourcing nor research with human subjects.
Guidelines:
The answer NA means that the paper does not involve crowdsourcing research with human subjects.
Depending on the country in which research is conducted, IRB approval (or equivalent) may be required for any human subjects research. If you obtained IRB approval, you should clearly state this in the paper.
We recognize that the procedures for this may vary significantly between institutions and locations, and we expect authors to adhere to the NeurIPS Code of Ethics and the guidelines for their institution.
For initial submissions, do not include any information that would break anonymity (if applicable), such as the institution conducting the review.
23


Reviews:
[{"review_id": "5jeCZcOyEK", "reviewer": "Reviewer_bo1j", "summary": "This article introduces a generative model ACFun for facial stylization, which designs two modules AFun and CFun to learn the abstract and concrete features of styles and faces. The authors design a Face and Style Imagery Alignment Loss to align the style image with the face image in the latent space, using these methods to extract more levels of style features and better balance facial changes caused by stylization and preserving facial information.", "questions": "1. What is y in Equation 1?\n2. The reviewer is interested in the image on the right side of Figure 3 and suggests adding some visualizations or experiments to demonstrate the role of the loss function in aligning style and face images.", "limitations": "Limitations are discussed.", "rating": 4, "confidence": 5, "soundness": 1, "presentation": 1, "contribution": 2, "strengths": "1. This article achieves style extraction at both abstract and concrete levels with only one pair of images.\n2. The Face and Style Imagery Alignment Loss proposed in this article is interesting as it seeks the balance point between style images and facial images in latent space.", "weaknesses": "1. Lack of Quality Analysis. Sec. 4.1 is missing.\n2. The ability of text-guided image generation was introduced in the experiment but only compared with InstantStyle, which seems insufficient.\n3. The role of CFun in the encoder and decoder was analyzed in the ablation experiment, and the results are shown in Fig.6. However, for Encoder, the result in the first line is only a blurry image with a rough structure, while the second line shows the specific facial structure and posture. It seems that the conclusions drawn from the two examples are different. For the decoder, the first line shows the specific facial structure and posture, while the second line's facial structure and posture appear to be inconsistent with the reference image. These two examples are insufficient to prove that “In the decoder, CFun can see that the main concrete features are the structure and posture of the face.”", "quality": null, "clarity": null, "significance": null, "originality": null, "strengths_and_weaknesses": "", "was_revised": false, "final_justification": "", "rebuttal": "Thank you for pointing out the problems in our paper. We respond to the weaknesses and questions you pointed out as follows.\nW1: I'm very sorry. Due to a layout problem, the content of section 4.1 is in the second paragraph of section 4.2.\nW2: Due to the excellent performance of InstantStyle, we only compared the results of this method. Now, we have added a comparison of the results between Dreamstyler and Inst.\nW3: We have added more visual results of ablation experiments. For abstract features, there are indeed certain patterns in the encoder and decoder for specific features, manifested as a bias towards color, texture, and structure, facial features, respectively.\nQ1: This method takes two images as input, where x represents the face image, and y represents the style image\nQ2: In the supplementary materials, Figure 7 demonstrated the effect of alignment loss in latent space, and we also conducted additional experiments", "claims_and_evidence": "", "methods_and_evaluation_criteria": "", "theoretical_claims": "", "experimental_designs_or_analyses": "", "relation_to_broader_scientific_literature": "", "essential_references_not_discussed": "", "other_strengths_and_weaknesses": "", "other_comments_or_suggestions": "", "questions_for_authors": "", "summary_of_paper": "", "summary_of_recommendation": "", "technical_quality": "", "clarity_of_presentation": "", "potential_impact": "", "robotics_focus": "", "quality_of_limitations": "", "questions_for_rebuttal": "", "reasons_to_accept": "", "reasons_to_reject": "", "questions_to_authors": "", "extra_scores": {}}, {"review_id": "1UAYdMMk5d", "reviewer": "Reviewer_5hdY", "summary": "This paper deals with the problem of facial stylization using one style image and one facial image. Specifically, the authors design an abstract fusion module and a concrete fusion module to learn the abstract and concrete features of the style and face separately. They further design a face and style imagery alignment loss for face and style image aligning. Experiments show that the proposed method outperforms other methods.", "questions": "Could the authors provide more information about using CLIP, as it seems to me there are better vision language models which can extract better features than CLIP? How about using other models?", "limitations": "The authors have discussed the limitations of their paper.", "rating": 4, "confidence": 4, "soundness": 3, "presentation": 3, "contribution": 2, "strengths": "1. The topic is interesting, nowadays, face stylization using diffusion models is getting more and more attention.\n2. The paper is easy to follow and the proposed method is intuitive and easy to understand.\n3. Many visualization results are shown in well-plotted figures.", "weaknesses": "1. There are no quantitive metrics, which can show the proposed method is better than the existing methods, only qualitative ones, which might be subjective and biased.\n2. Some visualization results still have room to be improved. The most concern is that some style information is merged with the identity or object information of the style image, which is not well disentangled. For example, in the Fig.11, the first style image have purple and pink style, while the proposed method cannot learn the detailed style information very well.\n3. The method is lack of novelty. To me, using the guidance of CLIP image and text features is somehow outdated. The concrete fusion module is an attention module to me, which is also well studied.", "quality": null, "clarity": null, "significance": null, "originality": null, "strengths_and_weaknesses": "", "was_revised": false, "final_justification": "", "rebuttal": "Thank you for admiring our work and pointing out our issues. We respond to the weaknesses and questions you pointed out as follows.\nW1: We quantify style, content, and overall through user study. We selected 50 people through a survey questionnaire, and the results showed that our method achieved better results\nW2: Our method aims to reproduce the content of the reference image as much as possible rather than the style image. The results here demonstrate that our method successfully separates \"purple and pink style\" from its style and only transfers the expression of the style image to the target image. \nW3: We adopted CLIP because our backbone is Stable Diffusion, and the language model used is CLIP. Therefore, we also adopted CLIP.\nQ1: Due to the use of CLIP in the backbone, DINO is difficult to adapt.", "claims_and_evidence": "", "methods_and_evaluation_criteria": "", "theoretical_claims": "", "experimental_designs_or_analyses": "", "relation_to_broader_scientific_literature": "", "essential_references_not_discussed": "", "other_strengths_and_weaknesses": "", "other_comments_or_suggestions": "", "questions_for_authors": "", "summary_of_paper": "", "summary_of_recommendation": "", "technical_quality": "", "clarity_of_presentation": "", "potential_impact": "", "robotics_focus": "", "quality_of_limitations": "", "questions_for_rebuttal": "", "reasons_to_accept": "", "reasons_to_reject": "", "questions_to_authors": "", "extra_scores": {}}, {"review_id": "rqOEh81eus", "reviewer": "Reviewer_6WJE", "summary": "This paper proposes a novel facial stylization method called ACFun, which achieves high-quality stylization effects by combining abstract and concrete visual elements. It contains the Abstract Fusion Module (AFun) and Concrete Fusion Module (CFun) to learn the abstract and concrete features. A new loss function is designed to align style and facial images in latent space to improve stylization accuracy. The effectiveness of the ACFun method is validated through extensive experiments, which can produce more artistic and visually appealing facial stylization results compared to existing methods.", "questions": "Shown as weaknesses.", "limitations": "Shown as weaknesses.", "rating": 7, "confidence": 4, "soundness": 3, "presentation": 3, "contribution": 3, "strengths": "1)\tA novel facial stylization method called ACFun is proposed, which solves the limitations of existing stylization methods in processing facial images by combining abstract and concrete features.\n2)\tThrough extensive experiments, the author demonstrated the effectiveness of the ACFun method in facial stylization tasks, which can produce higher quality artistic results compared to other existing technologies.\n3)\tThe paper has a clear structure and rigorous logic, with clear organization from problem introduction to methodology, experimental results, and discussion, making it easy for readers to understand and follow up.", "weaknesses": "Some experimental results still need to be supplemented to demonstrate the generalization ability of this method：\n1)\tWill there be any difference in the final results generated using detailed and vague text descriptions for the facial description prompts proposed in this paper?\n2)\tThe experiment only showed the generation results of 40 diffusion steps. What are the differences between different diffusion steps?\n3)\tIn the experiment, the gender of the given style image and face image is always the same. Does this method still work when faced with the gender of the given style image and the face image is different?", "quality": null, "clarity": null, "significance": null, "originality": null, "strengths_and_weaknesses": "", "was_revised": false, "final_justification": "", "rebuttal": "Thank you for recognizing our work and pointing out our issues. We have supplemented the experiment you pointed out in Weakness. It can be seen that fewer steps will make the image more realistic, while more steps will make it more stylized. For different text descriptions, it can be seen that we have adopted more detailed facial descriptions and more detailed style image descriptions, which will also affect the bias of the final generated results. Finally, it can be seen that our method can still work even in different gender situations, which proves our method's decoupling ability and stylization accuracy.", "claims_and_evidence": "", "methods_and_evaluation_criteria": "", "theoretical_claims": "", "experimental_designs_or_analyses": "", "relation_to_broader_scientific_literature": "", "essential_references_not_discussed": "", "other_strengths_and_weaknesses": "", "other_comments_or_suggestions": "", "questions_for_authors": "", "summary_of_paper": "", "summary_of_recommendation": "", "technical_quality": "", "clarity_of_presentation": "", "potential_impact": "", "robotics_focus": "", "quality_of_limitations": "", "questions_for_rebuttal": "", "reasons_to_accept": "", "reasons_to_reject": "", "questions_to_authors": "", "extra_scores": {}}, {"review_id": "LWTZanZDIZ", "reviewer": "Reviewer_uyVB", "summary": "The paper introduces a new method for face stylization. The model uses a pretrained diffusion model (Stable Diffusion 1.4) and the proposed Abstract and Concrete Modules (AFun and CFun modules) to achieve the goal. The former extracts the style details to be imbued into the generative process. The latter conditions the diffusion process on those details. Notably, CFun leverages a technique known in AdaIN-like methods to modify the statistics in the generative process, while the diffusion keeps the general content of the face. Since the training happens every time a new image-style pair is introduced, it generalizes to new styles outside the used dataset. Additionally, the training lasts only 3 minutes.  This quick adaptation makes the method highly practical for users who want to efficiently apply different styles to faces.", "questions": "Questions:\n- Why did the authors not apply \"Tuning Attention\" as the main component of the method instead of CFun? It seems to transfer the style more reliably and serves the same purpose as CFun?\n- Could the authors elaborate on how using this method makes the stylization less effortless than using InstaStyle SDXL?\n\nSuggestions:\n- The authors need to evaluate the model in terms of the user preference. Given a high enough number of participants, the survey would objectively tell which stylization is better for an average person. \n- I suggest clarifying the parts mentioned in the weaknesses, which I attach below for self-consistency\n- CFun resembles the commonly used AdaIN module\n- Some parts need additional references. For example, the diffusion described in L228 seems to be a DDIM [2]\n\n[1] Huang X, Belongie S. Arbitrary style transfer in real-time with adaptive instance normalization. In Proceedings of the IEEE international conference on computer vision 2017 (pp. 1501-1510).\n[2]  Jiaming Song, Chenlin Meng, Stefano ErmonDenoising Diffusion Implicit Models. In International Conference on Learning Representations 2021.", "limitations": "- The authors describe the limitations in a separate section. However, some additional visual examples would be necessary to explain what the authors mean by \"extract a few visual elements of the style we want to exist in the style image\" (L283) and \"style leakage\" in 287.", "rating": 6, "confidence": 3, "soundness": 2, "presentation": 3, "contribution": 3, "strengths": "- The goal of the paper is clearly stated and easy to understand\n- Figure 2. is simple enough for a reader to grasp how the method works internally\n- The proposed approach generalizes to novel face-style pairs as it is \"fine-tuned\" each time\n- The authors present sufficient qualitative results\n- I enjoyed reading the explanation behind the \"abstract\" and \"concrete\" features, which clearly show the necessity of such decoupling in the pipeline\n- Splicing Facial Stylization is an exciting application of the method, which I have not seen in past works. It opens a new venue for artists.", "weaknesses": "- The authors tackle a highly subjective problem in terms of what makes \"a good style transfer\". The problem exists especially here, as only qualitative results are provided. For example, in many cases, InstantStyle SDXL provides (in my subjective opinion) better results than the proposed method. Additionally, Tuning Attention exhibits a better style transfer than CFun, as shown in Figure 8 in the supplementary. Figure 11 confuses me even more as the proposed method does not transfer the style correctly compared to InstantStyle.\n- Although the introduction clearly states the problem and how the problem is being solved, the latter sections contain vague sentences that make the overall method hard to comprehend. For example, I do not understand how the alignment loss (Section 3.4) aligns the images as the diffusion process is tasked to reproduce both the style and reference images using the same input. The section does not say why the alignment is needed, and the ablation study does not explain it either. The right section of Figure 3. (especially the right bottom image) makes it even more ambiguous.\n- Some parts need further explanation, for example:\n    - (L65) What does making an image recognizable by the CLIP model exactly mean?\n    - (L51-L53) The sentence is hard to understand what needs balancing\n    - (L193) What is VQ space?\n    - (L234-L237) What are those traditional methods, and what is the \"two-column method\"?\n    - (L241-L243) What do the authors mean by \"understanding the face\" by a model? If ControlNet can reconstruct a face, does it not mean it understands the face, too? \n    - (L286-L287) What is the binding phenomenon, and what does the style leakage look like?", "quality": null, "clarity": null, "significance": null, "originality": null, "strengths_and_weaknesses": "", "was_revised": false, "final_justification": "", "rebuttal": "Thank you for recognizing our work and pointing out our issues in detail. Thank you for taking the time to review our work. We would like to provide the following answers to the questions you have pointed out.\nW1: You have pointed out a crucial issue, and we have added quantitative experiments based on user studies. It should be noted that our focus is not simply on style conversion tasks but on stylizing faces. This requires us to maintain various information in the original face image, such as identity, expressions, etc. while stylizing. However, it can be seen that although InstantStyle has a strong style, its ability to maintain facial information is insufficient, especially in Figure 11, where we can see that it cannot faithfully restore the identity information of the face, especially in cases 1 and 3. In addition, similar to the above requirements, in order to ensure facial information as much as possible, we choose not to tune the attention, as shown in Figure 8. While tuning the attention can achieve a strong style transfer effect, it also masks the content contained in the original facial image, making it difficult to distinguish the facial identity information of the original image. This is not the effect pursued in our article. So, we adopt the CFun method for style transfer to reduce the impact of content information in the style image on the original image.\n\nW2: The alignment loss we propose is designed for the training paradigm we use. As you mentioned, general diffusion models use a single image input and output, followed by constraints. However, we use the method of simultaneously inputting two images and finding a balance point between the style image and the face image in the latent space to complete the face stylization task. Through this approach, our method has the ability to migrate higher-level visual semantic elements. In Supplementary Material Figure 7, the results of training with different proportions of alignment loss in latent space are presented, demonstrating the effectiveness of our alignment loss and demonstrating how this latent space equilibrium point works. The image on the right of Figure 3 reflects the latent space we mentioned earlier. Its specific meaning lies in that the vq space used in stable diffusion is only a low-level visual element, and directly searching for balance points in vq space is often meaningless. Instead, we use a combination of vq embedding and clip attention to search in the latent space to obtain a meaningful balance point between the style image and the face image, thus achieving the task of facial stylization\n\nW3: \n1. Due to the presence of hidden words * in the input text, such clip embeddings usually have no practical significance for subsequent UNETs. Therefore, we hope to optimize this clip embedding through training so that subsequent UNETs can correspond to this clip embedding with the balance point we previously proposed. This process is called \"making an image recognizable by the CLIP model\"\n2. As mentioned earlier, we are searching for a balance point between the style image and the face image in the latent space, which not only contains the style information we need but also faithfully preserves the content information in the face image\n3. The stable diffusion we use owns the VQ (vector quantization) space, which encodes points in a vector space using a finite subset of points to complete image compression and accelerate the speed of image generation by the diffusion model.\n4. The two columns on the right are the traditional methods. These methods only transfer low-level visual features such as color and texture and do not involve high-level semantics such as shape. While all other methods can change high-level semantics.\n5. The method used by Instantstyle is to input edge information into ControlNet to control the final generation result. We believe that this approach does not represent an understanding of the face. From its results, it can also be seen that it does not have the ability to maintain facial identity information. In addition, as shown in Fig. 9 of our supplementary materials, InstantStyle cannot achieve facial stylization by Splicing face images using ControlNet. At the same time, our method can integrate them into a complete face, which also demonstrates our claimed ability to understand faces.\n6. The binding phenomenon refers to the strong correlation between some content information and style information, which leads to the appearance of some content in style images as a result of facial stylization, which is also called style leakage. A typical example is our result in case 3 of Figure 4. In case 4, we can see that the hand in the style image appears in case 3, and the color of Leonardo's suit in case 4 is consistent with the given style image.\nQ1: We hope to preserve the content information in the facial image as much as possible. Although tuning the attention can result in a stronger style, as shown in Figure 8, this generated result changes the facial image beyond recognition, making it difficult to identify its identity information. We also need to avoid this situation as much as possible in our work so we do not tune the attention.\nQ2: Firstly, it should be noted that InstantStyle uses 4 million image text pairs to train the IP-Adapter used, while we only use one pair of face images and style images, which demonstrates the advantages of our method in terms of computational resources and cost. Secondly, as a facial stylization task, we faithfully restored the identity information of the given person's facial image, allowing the stylized result to still be recognized as identity. However, InstantStyle performed poorly in this regard.\n\nS1: We have supplemented quantitative experiments based on user studies\nS2: shown above\nS3: We referred to Adain to some extent when designing the Cfun\nS4: Thank you for pointing it out. We will add these references", "claims_and_evidence": "", "methods_and_evaluation_criteria": "", "theoretical_claims": "", "experimental_designs_or_analyses": "", "relation_to_broader_scientific_literature": "", "essential_references_not_discussed": "", "other_strengths_and_weaknesses": "", "other_comments_or_suggestions": "", "questions_for_authors": "", "summary_of_paper": "", "summary_of_recommendation": "", "technical_quality": "", "clarity_of_presentation": "", "potential_impact": "", "robotics_focus": "", "quality_of_limitations": "", "questions_for_rebuttal": "", "reasons_to_accept": "", "reasons_to_reject": "", "questions_to_authors": "", "extra_scores": {}}]

Author rebuttal:
We have added experiments on text-guided generation and ablation and related experiments on different diffusion steps, different levels of text description detail, and different genders. We also conducted quantitative experiments based on user study, providing 40 pairs of style facial images and their generated results, and collected voting results from 50 volunteers. The voting was conducted from three aspects: style consistency, facial consistency, and overall which image users prefer. The results are shown in the table. It can be seen that our method can achieve good results in style consistency and outstanding performance in facial consistency and overall evaluation. In addition, we also compared our method separately with Instantstyle SDXL, and it can be seen that users favor our approach.

Meta-review: This paper received mixed reviews, ranging from "Borderline reject" to "Accept". The reviewers noted that the paper's novel facial stylization, ACFun, achieves style extraction at both abstract and concrete levels using only one pair of images, calling it well-structured and easy to follow, and acknowledged its extensive experiments and visualizations.

Many of the reviewer's concerns related to the paper's experimental setup: The reviewers noted a lack of quantitative metrics and potential subjectivity in qualitative results, though this was partially addressed in the rebuttal  (5hdY, uyVB). The reviewers also called out limited comparison with existing methods, particularly for text-guided image generation (bo1j, 5hdY), inconsistent / unclear experimental results, particularly in ablation studies and style transfer quality (bo1j, uyVB), and the need for additional experiments to demonstrate generalization ability and address specific scenarios (6WJE). Other concerns related to insufficient novelty (5hdY) and unclear technical details (uyVB). 

The authors provided a detailed rebuttal, but it, and the reviewer discussion, did not change the distribution of recommendations. In such borderline cases, I am inclined to err on the side of acceptance and let the community decide the merits of this work.
Decision: Accept (poster)