Original: L EARNING I NPUT - AGNOSTIC M ANIPULATION D IRECTIONS IN S TYLE GAN WITH T EXT G UIDANCE
Revised: L EARNING I NPUT - AGNOSTIC M ANIPULATION D IRECTIONS IN S TYLE GAN WITH T EXT G UIDANCE

Original: A BSTRACT
Revised: A BSTRACT

Original: With the advantages of fast inference and human-friendly flexible manipulation, image-agnostic style manipulation via text guidance enables new applications that were not previously available.
Revised: With the advantages of fast inference and human-friendly flexible manipulation, image-agnostic style manipulation via text guidance enables new applications that were not previously available.

Original: The state-of-the-art text-guided image-agnostic manipulation method embeds the representation of each channel of StyleGAN independently in the Contrastive Language-Image Pre-training (CLIP) space, and provides it in the form of a Dictionary to quickly find out the channel-wise manipulation direction during inference time.
Revised: The state-of-the-art text-guided image-agnostic manipulation method embeds the representation of each channel of StyleGAN independently in the Contrastive Language-Image Pre-training (CLIP) space, and provides it in the form of a Dictionary to quickly find out the channel-wise manipulation direction during inference time.

Original: However, in this paper we argue that this dictionary which is constructed by controlling single channel individually is limited to accommodate the versatility of text guidance since the collective and interactive relation among multiple channels are not considered.
Revised: However, in this paper we argue that this dictionary which is constructed by controlling single channel individually is limited to accommodate the versatility of text guidance since the collective and interactive relation among multiple channels are not considered.

Original: Indeed, we show that it fails to discover a large portion of manipulation directions that can be found by existing methods, which manually manipulates latent space without texts.
Revised: Indeed, we show that it fails to discover a large portion of manipulation directions that can be found by existing methods, which manually manipulates latent space without texts.

Original: To alleviate this issue, we propose a novel method Multi2One that learns a Dictionary , whose entry corresponds to the representation of a single channel, by taking into account the manipulation effect coming from the interaction with multiple other channels.
Revised: To alleviate this issue, we propose a novel method Multi2One that learns a Dictionary , whose entry corresponds to the representation of a single channel, by taking into account the manipulation effect coming from the interaction with multiple other channels.

Original: We demonstrate that our strategy resolves the inability of previous methods in finding diverse known directions from unsupervised methods and unknown directions from random text while maintaining the real-time inference speed and disentanglement ability.
Revised: We demonstrate that our strategy resolves the inability of previous methods in finding diverse known directions from unsupervised methods and unknown directions from random text while maintaining the real-time inference speed and disentanglement ability.

Original:  I NTRODUCTION
Revised:  I NTRODUCTION

Original: Wide range of generative models including adversarial networks (Goodfellow et al., 2014; Karras et al., 2018; 2019; 2020b;
Revised: Wide range of generative models including adversarial networks (Goodfellow et al., 2014; Karras et al., 2018; 2019; 2020b;

Original: Kim et al., 2022; Kim & Ha, 2021; Karras et al., 2021), diffusion models (Dhariwal & Nichol, 2021), and auto-regressive models (Dosovitskiy et al., 2020; Chang et al., 2022) have demonstrated notable ability to generate a high-resolution image that is hardly distinguishable from real images.
Revised: Kim et al., 2022; Kim & Ha, 2021; Karras et al., 2021), diffusion models (Dhariwal & Nichol, 2021), and auto-regressive models (Dosovitskiy et al., 2020; Chang et al., 2022) have demonstrated notable ability to generate a high-resolution image that is hardly distinguishable from real images.

Original: Among these powerful models, style-based GAN models (Karras et al., 2019; 2020b) are equipped with a unique latent space which enables style and content mixing of given images, manipulation of local regions (Wu et al., 2021), and interpolation between different class of images (Sauer et al., 2022).
Revised: Among these powerful models, style-based GAN models (Karras et al., 2019; 2020b) are equipped with a unique latent space which enables style and content mixing of given images, manipulation of local regions (Wu et al., 2021), and interpolation between different class of images (Sauer et al., 2022).

Original: In this paper, we focus on the image manipulation based on the pre-trained StyleGAN, considering the unique advantages mentioned above and its popularity.
Revised: In this paper, we focus on the image manipulation based on the pre-trained StyleGAN, considering the unique advantages mentioned above and its popularity.

Original: Based on the steerability in the latent space of
Revised: Based on the steerability in the latent space of

Original: StyleGAN, researchers have put tremendous effort on finding a direction that causes semantically equivalent change to the entire samples of image.
Revised: StyleGAN, researchers have put tremendous effort on finding a direction that causes semantically equivalent change to the entire samples of image.

Original: In this work, we refer to such latent direction as global direction .
Revised: In this work, we refer to such latent direction as global direction .

Original: Unlike local direction which is a sample-wise traversal direction found by iterative optimization using a single image (Local Basis (Choi et al., 2021) and Latent Optimization of StyleCLIP (Patashnik et al., 2021)), global direction allows fast inference and is applicable to any images once found using supervised (Jahanian et al., 2019), unsupervised (Shen & Zhou, 2021;
Revised: Unlike local direction which is a sample-wise traversal direction found by iterative optimization using a single image (Local Basis (Choi et al., 2021) and Latent Optimization of StyleCLIP (Patashnik et al., 2021)), global direction allows fast inference and is applicable to any images once found using supervised (Jahanian et al., 2019), unsupervised (Shen & Zhou, 2021;

Original: Wang & Ponce, 2021; Härkönen et al., 2020; Voynov & Babenko, 2020), or text-guided methods (Global Mapper & GlobalDirection 1 of StyleCLIP (Patashnik et al., 2021)).
Revised: Wang & Ponce, 2021; Härkönen et al., 2020; Voynov & Babenko, 2020), or text-guided methods (Global Mapper & GlobalDirection 1 of StyleCLIP (Patashnik et al., 2021)).

Original: Smirking man
Revised: Smirking man

Original: Man with coy smile
Revised: Man with coy smile

Original: Smiling man
Revised: Smiling man

Original: GD
Revised: GD

Original: Ours  70th 
Revised: Ours GANSpace 70th Direction

Original: Source image Manipulated GD
Revised: Source Manip. GD

Original: Ours
Revised: Ours

Original: Grinning man
Revised: Grinning man

Original: Attractive Male
Revised: Attractive Male

Original: Innocent Eyes
Revised: Innocent Eyes

Original: Original
Revised: Original

Original: GD
Revised: GD

Original: Ours
Revised: Ours

Original: Evil Queen
Revised: Evil Queen

Original: Grumpy Face
Revised: Grumpy Face

Original: Shiny Hair Sexy Man
Revised: Shiny Hair Sexy Man

Original: Original
Revised: Original

Original: GD
Revised: GD

Original: Ours
Revised: Ours

Original: Original
Revised: Original

Original: GD
Revised: GD

Original: Ours
Revised: Ours

Original: Attractive Male
Revised: Attractive Male

Original: Innocent Eyes
Revised: Innocent Eyes

Original: Original
Revised: Original

Original: GD
Revised: GD

Original: Ours
Revised: Ours

Original: Evil Queen
Revised: Evil Queen

Original: Grumpy Face
Revised: Grumpy Face

Original: Shiny Hair Sexy Man
Revised: Shiny Hair Sexy Man

Original: Original
Revised: Original

Original: GD
Revised: GD

Original: Ours
Revised: Ours

Original: Original
Revised: Original

Original: GD
Revised: GD

Original: Ours Attractive Male
Revised: Ours Attractive Male

Original: Innocent Eyes
Revised: Innocent Eyes

Original: Original
Revised: Original

Original: GD
Revised: GD

Original: Ours
Revised: Ours

Original: Evil Queen
Revised: Evil Queen

Original: Grumpy Face
Revised: Grumpy Face

Original: Shiny Hair Sexy Man
Revised: Shiny Hair Sexy Man

Original: Original
Revised: Original

Original: GD
Revised: GD

Original: Ours
Revised: Ours

Original: Original
Revised: Original

Original: GD
Revised: GD

Original: Ours Attractive Male
Revised: Ours Attractive Male

Original: Innocent Eyes
Revised: Innocent Eyes

Original: Evil Queen
Revised: Evil Queen

Original: Sexy Man
Revised: Sexy Man

Original: Grumpy Face
Revised: Grumpy Face

Original: Shiny Hair
Revised: Shiny Hair

Original: GD
Revised: GD

Original: Ours Source
Revised: Ours Source

Original: GD
Revised: GD

Original: Ours Source
Revised: Ours Source

Original: [Figure]
Revised: [Figure]

Original: Among them, the text-guided methods have a unique advantage in that they can naturally provide the flexibility of manipulation through the diversity of the given driving text without human supervision to discover the direction in the latent space.
Revised: Among them, the text-guided methods have a unique advantage in that they can naturally provide the flexibility of manipulation through the diversity of the given driving text without human supervision to discover the direction in the latent space.

Original: However, in this paper we argue that contrary to this common belief on text-guidance, the standard method (Patashnik et al., 2021) for text-based
Revised: However, in this paper we argue that contrary to this common belief on text-guidance, the standard method (Patashnik et al., 2021) for text-based

Original: StyleGAN manipulation surprisingly fails to even find the manipulation directions that are known to be found in unsupervised approaches (Härkönen et al., 2020; Shen & Zhou, 2021) (see Fig. 1(a) for examples).
Revised: StyleGAN manipulation surprisingly fails to even find the manipulation directions that are known to be found in unsupervised approaches (Härkönen et al., 2020; Shen & Zhou, 2021) (see Fig. 1(a) for examples).

Original: In addition, we also show that this standard method does not properly perform manipulation on a large number of randomly selected texts (see Fig. 1(b) for examples).
Revised: In addition, we also show that this standard method does not properly perform manipulation on a large number of randomly selected texts (see Fig. 1(b) for examples).

Original: We hypothesize that the failure is due to the naïve approach that only considers a change of image caused by a single channel in StyleSpace, neglecting diverse directions that are visible only when manipulating multiple channels as a whole.
Revised: We hypothesize that the failure is due to the naïve approach that only considers a change of image caused by a single channel in StyleSpace, neglecting diverse directions that are visible only when manipulating multiple channels as a whole.

Original: In order to address these issues, we propose a novel method, named Multi2One , of learning a
Revised: In order to address these issues, we propose a novel method, named Multi2One , of learning a

Original: Dictionary that can manipulate multiple channels corresponding to a given text.
Revised: Dictionary that can manipulate multiple channels corresponding to a given text.

Original: However, here since there is no paired ground truth of text and manipulation direction corresponding to the text, we embed the directions found by existing unsupervised methods into the CLIP space and learn a dictionary to reproduce them in the CLIP space.
Revised: However, here since there is no paired ground truth of text and manipulation direction corresponding to the text, we embed the directions found by existing unsupervised methods into the CLIP space and learn a dictionary to reproduce them in the CLIP space.

Original: Note that this has more meaning than simply reproducing the known directions derived by unsupervised methods.
Revised: Note that this has more meaning than simply reproducing the known directions derived by unsupervised methods.

Original: As the dictionary learns the relationship between channels in StyleSpace and CLIP space, we can find manipulations that could not be found with unsupervised methods using diverse text inputs.
Revised: As the dictionary learns the relationship between channels in StyleSpace and CLIP space, we can find manipulations that could not be found with unsupervised methods using diverse text inputs.

Original: Through extensive experiments, we confirm that contrary to the state-of-the-arts method (Patashnik et al., 2021) which explicitly encoded every single channel, our multi-channel based strategy not only excels in reconstruction of unsupervised directions but also in discovery of text-guided directions.
Revised: Through extensive experiments, we confirm that contrary to the state-of-the-arts method (Patashnik et al., 2021) which explicitly encoded every single channel, our multi-channel based strategy not only excels in reconstruction of unsupervised directions but also in discovery of text-guided directions.

Original:  R ELATED W ORK
Revised:  R ELATED W ORK

Original: Style-based Generators Generators of style-based models (Karras et al., 2019; 2020b;a; 2021) are built upon the progressive structure (Karras et al., 2018) that generates images of higher resolution in deeper blocks.
Revised: Style-based Generators Generators of style-based models (Karras et al., 2019; 2020b;a; 2021) are built upon the progressive structure (Karras et al., 2018) that generates images of higher resolution in deeper blocks.

Original: The popularity of StyleGAN structure that has been employed in numerous number of researches comes from its ability to generate high-fidelity images, transfer styles to other images, and manipulate images in the latent spaces using inversion methods (Zhu et al., 2020; Roich et al., 2021;
Revised: The popularity of StyleGAN structure that has been employed in numerous number of researches comes from its ability to generate high-fidelity images, transfer styles to other images, and manipulate images in the latent spaces using inversion methods (Zhu et al., 2020; Roich et al., 2021;

Original: Tov et al., 2021; Collins et al., 2020).
Revised: Tov et al., 2021; Collins et al., 2020).

Original: The latent spaces of StyleGAN used for manipulation are intermediate space W and StyleSpace S (Wu et al., 2021).
Revised: The latent spaces of StyleGAN used for manipulation are intermediate space W and StyleSpace S (Wu et al., 2021).

Original: Unsupervised Global Directions Image-agnostic directions are latent vectors that create semantically equivalent shift when applied to the latent space of StyleGANs.
Revised: Unsupervised Global Directions Image-agnostic directions are latent vectors that create semantically equivalent shift when applied to the latent space of StyleGANs.

Original: In order to find such directions,
Revised: In order to find such directions,

Original: SeFa (Shen & Zhou, 2021) performs PCA on the first weight that comes after intermediate space
Revised: SeFa (Shen & Zhou, 2021) performs PCA on the first weight that comes after intermediate space

Original: W in pre-trained StyleGAN, deducing the principal components as the global directions.
Revised: W in pre-trained StyleGAN, deducing the principal components as the global directions.

Original: On the other hand, GANspace (Härkönen et al., 2020) relies on the randomly sampled latent codes in W and
Revised: On the other hand, GANspace (Härkönen et al., 2020) relies on the randomly sampled latent codes in W and

Original: [Table]
Revised: [Table]

Original:  ⋯
Revised: + ⋯

Original: [Table] [Table]
Revised: [Table] [Table]

Original: s

Original: [Table]
Revised: [Table]

Original: CLIP

Original: [Table]
Revised: [Table]

Original: [Table]

Original: [Figure]
Revised: [Figure]

Original: The proposed novel dictionary allows more flexible and expansive discovery of the manipulation direction ˆ s with better result.

Original: ϕ ( · the eigenvectors from the latent codes proved to be global directions that share an image-agnostic modification ability.
Revised: GD the eigenvectors from the latent codes proved to be global directions that share an image-agnostic modification ability.

Original: Text-guided Image Manipulations Most of the text-guided image manipulation methods aim to find a local direction (Kocasari et al., 2022; Xia et al., 2021;
Revised: Text-guided Image Manipulations Most of the text-guided image manipulation methods aim to find a local direction (Kocasari et al., 2022; Xia et al., 2021;

Original: Patashnik et al., 2021) which is an image-specific direction that applies to a single sample of image.
Revised: Patashnik et al., 2021) which is an image-specific direction that applies to a single sample of image.

Original: Methods that find local directions using text guidance could be found in various models including GAN, Diffusion (Kim & Ye, 2021;
Revised: Methods that find local directions using text guidance could be found in various models including GAN, Diffusion (Kim & Ye, 2021;

Original: Nichol et al., 2021; Avrahami et al., 2022;
Revised: Nichol et al., 2021; Avrahami et al., 2022;

Original: Liu et al., 2021), and Vision transformers (Chang et al., 2022).
Revised: Liu et al., 2021), and Vision transformers (Chang et al., 2022).

Original: Two unique approaches for finding a global direction using text guidance in StyleGAN are Global Mapper and GlobalDirection of StyleCLIP (Patashnik et al., 2021).
Revised: Two unique approaches for finding a global direction using text guidance in StyleGAN are Global Mapper and GlobalDirection of StyleCLIP (Patashnik et al., 2021).

Original: Global Mapper finds an image-invariant direction for a single text by optimizing a fully connected layer.
Revised: Global Mapper finds an image-invariant direction for a single text by optimizing a fully connected layer.

Original: However, this method requires 10 hours of training time for every single text, making it less popular than
Revised: However, this method requires 10 hours of training time for every single text, making it less popular than

Original: GlobalDirection .
Revised: GlobalDirection .

Original: On the other hand, GlobalDirection method offers a real-time manipulation in inference time using a dictionary-based framework that is applicable to any input image and text.
Revised: On the other hand, GlobalDirection method offers a real-time manipulation in inference time using a dictionary-based framework that is applicable to any input image and text.

Original:  L IMITED C OVERAGE OF S TYLE CLIP G LOBAL D IRECTION M ETHOD
Revised:  L IMITED C OVERAGE OF S TYLE CLIP G LOBAL D IRECTION M ETHOD

Original: In this section, we briefly review the GlobalDirection of StyleCLIP (Patashnik et al., 2021), which performs StyleGAN-based image manipulation using text guidance (Sec. 3.1).
Revised: In this section, we briefly review the GlobalDirection of StyleCLIP (Patashnik et al., 2021), which performs StyleGAN-based image manipulation using text guidance (Sec. 3.1).

Original: Then, we provide our key motivation that this state-of-the-art text-guided manipulation method is surprisingly insufficient to fully utilize the manipulative power of StyleGAN (Sec. 3.2).
Revised: Then, we provide our key motivation that this state-of-the-art text-guided manipulation method is surprisingly insufficient to fully utilize the manipulative power of StyleGAN (Sec. 3.2).

Original: 3. T EXT - GUIDED S TYLE GAN I MAGE M ANIPULATION
Revised: 3. T EXT - GUIDED S TYLE GAN I MAGE M ANIPULATION

Original: StyleSpace of StyleGAN The generators of StyleGAN family (Karras et al., 2019; 2020a;b) have a number of latent spaces: Z , W , W + , and S .
Revised: StyleSpace of StyleGAN The generators of StyleGAN family (Karras et al., 2019; 2020a;b) have a number of latent spaces: Z , W , W + , and S .

Original: The original latent space is Z , which is typically the standard normal distribution.
Revised: The original latent space is Z , which is typically the standard normal distribution.

Original: The generator transforms an input noise z ∼ N (0 , I ) into intermediate latent spaces
Revised: The generator transforms an input noise z ∼ N (0 , I ) into intermediate latent spaces

Original: W (Karras et al., 2019), W + (Abdal et al., 2019), and S (Wu et al., 2021), sequentially.
Revised: W (Karras et al., 2019), W + (Abdal et al., 2019), and S (Wu et al., 2021), sequentially.

Original: Recent study (Wu et al., 2021) shows that StyleSpace S is the most disentangled such that it can change a distinct visual attribute in a localized way.
Revised: Recent study (Wu et al., 2021) shows that StyleSpace S is the most disentangled such that it can change a distinct visual attribute in a localized way.

Original: The number of style channels in S isexcluding toRGB channels for StyleGAN-ADA (resolution 1024 2 ), and recent methods (Kocasari et al., 2022; Patashnik et al., 2021; Wu et al., 2021) modify the values of the channels to edit an image.
Revised: The number of style channels in S isexcluding toRGB channels for StyleGAN-ADA (resolution 1024 2 ), and recent methods (Kocasari et al., 2022; Patashnik et al., 2021; Wu et al., 2021) modify the values of the channels to edit an image.

Original: Our method also adopts StyleSpace and we use n to denote the total number of channels in S (that is, s =
Revised: Our method also adopts StyleSpace and we use n to denote the total number of channels in S (that is, s =

Original: [ s 1 , s 2 , · · · , s n ] T ∈ S
Revised: [ s 1 , s 2 , · · · , s n ] T ∈ S

Original: and s i is a single parameter).
Revised: and s i is a single parameter).

Original: For the convenience of explanation, the pre-trained generator G is re-defined with respect to StyleSpace as X =
Revised: For the convenience of explanation, the pre-trained generator G is re-defined with respect to StyleSpace as X =

Original: G s ( s ) ; X is a generated image.
Revised: G s ( s ) ; X is a generated image.

Original: The goal of StyleGAN-based image manipulation via text is to find a direction ˆ s =
Revised: The goal of StyleGAN-based image manipulation via text is to find a direction ˆ s =

Original: [ˆ s 1 , ˆ s 2 , ..., · · · , ˆ s n ] T in StyleSpace S which generates an image X edited = G s ( s + ˆ s ) suitable for the provided text guidance t .
Revised: [ˆ s 1 , ˆ s 2 , ..., · · · , ˆ s n ] T in StyleSpace S which generates an image X edited = G s ( s + ˆ s ) suitable for the provided text guidance t .

Original: Note that s is the inverted style vector of image X , found via
Revised: Note that s is the inverted style vector of image X , found via

Original: StyleGAN inversion methods such as Alaluf et al.
Revised: StyleGAN inversion methods such as Alaluf et al.

Original: Roich et al.
Revised: Roich et al.

Original: ; Tov et al.
Revised: ; Tov et al.

Original: (2021) , used for manipulation purpose in most cases.
Revised: (2021) , used for manipulation purpose in most cases.

Original: The main benefit of considering StyleSpace S in image manipulation is that it does not change the undesired regions of the image when modifying a small number of style channels by its well disentangled property.
Revised: The main benefit of considering StyleSpace S in image manipulation is that it does not change the undesired regions of the image when modifying a small number of style channels by its well disentangled property.

Original: [Table]
Revised: [Table]

Original: Text-guided Manipulation by StyleCLIP The GlobalDirection (Patashnik et al., 2021) is a representative method of text-driven image manipulation that provides an input-agnostic direction with a level of disentanglement.
Revised: Text-guided Manipulation by StyleCLIP The GlobalDirection (Patashnik et al., 2021) is a representative method of text-driven image manipulation that provides an input-agnostic direction with a level of disentanglement.

Original: Intuitively, it computes the similarity between the input text and each style channel in the CLIP space (Radford et al., 2021) to find the channels that should be modified given the text.
Revised: Intuitively, it computes the similarity between the input text and each style channel in the CLIP space (Radford et al., 2021) to find the channels that should be modified given the text.

Original: In order to compute the similarity between the text and style channel, both should be encoded into CLIP.
Revised: In order to compute the similarity between the text and style channel, both should be encoded into CLIP.

Original: While the text guidance t is trivially encoded via the text encoder of CLIP as CLIP ( t ) ∈
Revised: While the text guidance t is trivially encoded via the text encoder of CLIP as CLIP ( t ) ∈

Original: R p , style channels in StyleSpace S need additional pre-processing for the embedding.
Revised: R p , style channels in StyleSpace S need additional pre-processing for the embedding.

Original: GlobalDirection proposes to embed the manipulation effect of i -th style channel using the following mapping from the StyleSpace S to CLIP space:
Revised: GlobalDirection proposes to embed the manipulation effect of i -th style channel using the following mapping from the StyleSpace S to CLIP space:

Original: [Equation] [Equation]
Revised: [Equation] [Equation]

Original: ) where the manipulation vector e i ∈ R n is a zero-vector except for the i -th entry.
Revised: ) where the manipulation vector e i ∈ R n is a zero-vector except for the i -th entry.

Original: Adding the manipulation vector e
Revised: Adding the manipulation vector e

Original: i to the original style vector s indicates that only the i -th channel among n channels in StyleSpace is manipulated.
Revised: i to the original style vector s indicates that only the i -th channel among n channels in StyleSpace is manipulated.

Original: Note that ϕ CLIP ( e i ) is also p -dimensional since the
Revised: Note that ϕ CLIP ( e i ) is also p -dimensional since the

Original: CLIP encoder maps images generated by G s ( · ) into a p -dimensional CLIP space.
Revised: CLIP encoder maps images generated by G s ( · ) into a p -dimensional CLIP space.

Original: The above mapping in Eq.
Revised: The above mapping in Eq.

Original: (1) is enumerated across all n channels in StyleSpace S to create a dictionary
Revised: (1) is enumerated across all n channels in StyleSpace S to create a dictionary

Original: D
Revised: D

Original: [Equation]
Revised: [Equation]

Original: Finally, with this dictionary, the manipulation direction ˆ s ∈ R n by GlobalDirection is given as the similarity score measured by the following equation:
Revised: Finally, with this dictionary, the manipulation direction ˆ s ∈ R n by GlobalDirection is given as the similarity score measured by the following equation:

Original: [Equation]
Revised: [Equation]

Original: This overall manipulation procedure is visualized in Fig.
Revised: This overall manipulation procedure is visualized in Fig.

Original: In the following section (Sec. 3.2), we propose the evidence to the hypothesis that the single-channel encoding strategy with ϕ CLIP ( e i ) to create the dictionary D is the major bottleneck causing limited coverage issues that StyleCLIP suffers from.
Revised: In the following section (Sec. 3.2), we propose the evidence to the hypothesis that the single-channel encoding strategy with ϕ CLIP ( e i ) to create the dictionary D is the major bottleneck causing limited coverage issues that StyleCLIP suffers from.

Original: 3. C OVERAGE A NALYSIS OF S TYLE CLIP G LOBAL D IRECTION M ETHOD
Revised: 3. C OVERAGE A NALYSIS OF S TYLE CLIP G LOBAL D IRECTION M ETHOD

Original: In this section, we experimentally verify that GlobalDirection has limited ability to find manipulation directions, as described in Fig.
Revised: In this section, we experimentally verify that GlobalDirection has limited ability to find manipulation directions, as described in Fig.

Original: 1 of the introduction.
Revised: 1 of the introduction.

Original: Toward this we show two empirical findings, which corresponds to Fig.
Revised: Toward this we show two empirical findings, which corresponds to Fig.

Original: 1(a) and Fig. 1(b), respectively.
Revised: 1(a) and Fig. 1(b), respectively.

Original: First, we show that many edits using unsupervised methods (Härkönen et al., 2020; Shen & Zhou, 2021) cannot be recovered by GlobalDirection .
Revised: First, we show that many edits using unsupervised methods (Härkönen et al., 2020; Shen & Zhou, 2021) cannot be recovered by GlobalDirection .

Original: For example, in Fig. 1(a), we can observe that applying the 70-th GANspace direction manipulates the source image to become a man with wide smile, showing that pre-trained StyleGAN itself is capable of such manipulation.
Revised: For example, in Fig. 1(a), we can observe that applying the 70-th GANspace direction manipulates the source image to become a man with wide smile, showing that pre-trained StyleGAN itself is capable of such manipulation.

Original: However,
Revised: However,

Original: GlobalDirection (GD) in Fig. 1(a) constantly fails to recover the same editing effect of the unsupervised direction, despite the variation on the text input such as ‘smiling man’, ‘grinning man’, ‘smirking man’, and ‘man with coy smile’.
Revised: GlobalDirection (GD) in Fig. 1(a) constantly fails to recover the same editing effect of the unsupervised direction, despite the variation on the text input such as ‘smiling man’, ‘grinning man’, ‘smirking man’, and ‘man with coy smile’.

Original: More quantitatively, we provide Tab. 1 to show that GlobalDirection (Patashnik et al., 2021) cannot effectively recover the directions found by unsupervised methods (Härkönen et al., 2020; Shen & Zhou, 2021).
Revised: More quantitatively, we provide Tab. 1 to show that GlobalDirection (Patashnik et al., 2021) cannot effectively recover the directions found by unsupervised methods (Härkönen et al., 2020; Shen & Zhou, 2021).

Original: Scores in the table are the CLIP similarity between ϕ CLIP ( α ) =
Revised: Scores in the table are the CLIP similarity between ϕ CLIP ( α ) =

Original: E s ∈S [CLIP (cid:0) G s ( s + α ) (cid:1) − CLIP (cid:0) G s ( s − α ) (cid:1) ] and the modified image created by either GlobalDirection ( X GD ; the construction of X GD is explained below) 2 or unsupervised methods ( X unsup ).
Revised: E s ∈S [CLIP (cid:0) G s ( s + α ) (cid:1) − CLIP (cid:0) G s ( s − α ) (cid:1) ] and the modified image created by either GlobalDirection ( X GD ; the construction of X GD is explained below) 2 or unsupervised methods ( X unsup ).

Original: Note that ϕ CLIP ( α ) encodes the direction α into the CLIP embedding space as GlobalDirection does for a single
Revised: Note that ϕ CLIP ( α ) encodes the direction α into the CLIP embedding space as GlobalDirection does for a single

Original: [Table]
Revised: [Table]

Original: [Table] [Table]
Revised: [Table] [Table]

Original: /9QYxSyOUhgmqdddzE+NnVBnOBE5LvVRjQtmYDrFrqaQRaj+bHzolZ1YZkDBWtqQhc/X3REYjrSdRYDsjakZ62ZuJ/3nd1ITXfsZlkhqUbLEoTAUxMZl9TQZcITNiYgllittbCRtRRZmx2ZRsCN7yy6ukfVH1Lqu1Zq1Sv8njKMIJnMI5eHAFdbiDBrSAAcIzvMKb8+i8OO/Ox6K14OQzx/AHzucPfAeMvQ==</latexit
Revised: /9QYxSyOUhgmqdddzE+NnVBnOBE5LvVRjQtmYDrFrqaQRaj+bHzolZ1YZkDBWtqQhc/X3REYjrSdRYDsjakZ62ZuJ/3nd1ITXfsZlkhqUbLEoTAUxMZl9TQZcITNiYgllittbCRtRRZmx2ZRsCN7yy6ukfVH1Lqu1Zq1Sv8njKMIJnMI5eHAFdbiDBrSAAcIzvMKb8+i8OO/Ox6K14OQzx/AHzucPfAeMvQ==</latexit>

Original: [Figure]
Revised: [Figure]

Revised: Edit

Original: [Figure]
Revised: [Figure]

Original: Edit
Revised: Edit

Original: [Figure]
Revised: [Figure]

Original: Edit
Revised: Edit

Original: [Figure]
Revised: [Figure]

Original: Edit
Revised: Edit

Original: [Figure]
Revised: [Figure]

Original: Edit 
Revised: Edit [Figure] Channel Index

Original: [Figure]
Revised: [Figure]

Revised: Edit

Revised: Src

Original: Edit
Revised: Edit

Original: [Figure]
Revised: [Figure]

Original: Edit
Revised: Source Manip. Source Manip.

Original: [Figure]
Revised: [Figure]

Original: channel.
Revised: channel.

Original: From the table, we can confirm that GlobalDirection does not recover the similarity in CLIP space that the unsupervised methods have.
Revised: From the table, we can confirm that GlobalDirection does not recover the similarity in CLIP space that the unsupervised methods have.

Original: Here we illustrate the details on how we generate X unsup and X GD for Tab. 1.
Revised: Here we illustrate the details on how we generate X unsup and X GD for Tab. 1.

Original: First, the source image
Revised: First, the source image

Original: X =
Revised: X =

Original: G s ( s ) is manipulated by each unsupervised direction α ∈ R n into X unsup =
Revised: G s ( s ) is manipulated by each unsupervised direction α ∈ R n into X unsup =

Original: G s ( s + α ) .
Revised: G s ( s + α ) .

Original: Instead of naïvely using the direction α ∈ R n , we only use the channels whose magnitude is the k -largest among n channels in α to reduce the entanglement that naturally comes with directions found by unsupervised methods (please refer to Appendix C to find the effect of using limited number of channels).
Revised: Instead of naïvely using the direction α ∈ R n , we only use the channels whose magnitude is the k -largest among n channels in α to reduce the entanglement that naturally comes with directions found by unsupervised methods (please refer to Appendix C to find the effect of using limited number of channels).

Original: We denote such sparsified directions as α ( k ) ∈ R n and use them in the experiment of
Revised: We denote such sparsified directions as α ( k ) ∈ R n and use them in the experiment of

Original: Tab. 1.
Revised: Tab. 1.

Original: Then, to generate X GD = G s ( s + ˆ α ) , we compute ˆ α = D T GlobalDirection CLIP( t ) ∈ R n as in Eq.
Revised: Then, to generate X GD = G s ( s + ˆ α ) , we compute ˆ α = D T GlobalDirection CLIP( t ) ∈ R n as in Eq.

Original: However, since there is no text corresponding to α and our objective in this experiment is to find a direction ˆ α that may recover X unsup by GlobalDirection , we replace CLIP( t ) with ϕ CLIP ( α ( k ) )
Revised: However, since there is no text corresponding to α and our objective in this experiment is to find a direction ˆ α that may recover X unsup by GlobalDirection , we replace CLIP( t ) with ϕ CLIP ( α ( k ) )

Original: =
Revised: =

Original: E s ∈S [CLIP (cid:0) G s ( s + α ( k ) )
Revised: E s ∈S [CLIP (cid:0) G s ( s + α ( k ) )

Original: (cid:1) − CLIP (cid:0) G s ( s − α ( k ) ) (cid:1) ] .
Revised: (cid:1) − CLIP (cid:0) G s ( s − α ( k ) ) (cid:1) ] .

Original: Since ϕ CLIP ( α ( k ) ) indicates the manipulation effect of α ( k ) encoded into CLIP space, it is used as a substitute for the CLIPencoded text guidance, CLIP ( t ) .
Revised: Since ϕ CLIP ( α ( k ) ) indicates the manipulation effect of α ( k ) encoded into CLIP space, it is used as a substitute for the CLIPencoded text guidance, CLIP ( t ) .

Original: Finally, we compute the similarity score for 30 instances of source images and 1024 directions from SeFa and GANspace whose average is reported in Tab. 1.
Revised: Finally, we compute the similarity score for 30 instances of source images and 1024 directions from SeFa and GANspace whose average is reported in Tab. 1.

Original: Secondly in Fig. 1(b), we provide several instances where the GlobalDirection of StyleCLIP fails to manipulate an image given randomly selected text.
Revised: Secondly in Fig. 1(b), we provide several instances where the GlobalDirection of StyleCLIP fails to manipulate an image given randomly selected text.

Original: For additional examples on the failure cases of the standard method, please refer to Appendix A where we provide the details on how we choose random texts and manipulated images using extensive list of random texts.
Revised: For additional examples on the failure cases of the standard method, please refer to Appendix A where we provide the details on how we choose random texts and manipulated images using extensive list of random texts.

Original: Regarding the phenomena found in the above experiments, we hypothesize the crude assumption of GlobalDirection - manipulation solely based on single channel could fully represent the manipulative ability of StyleGAN - leads to the limited coverage issue.
Revised: Regarding the phenomena found in the above experiments, we hypothesize the crude assumption of GlobalDirection - manipulation solely based on single channel could fully represent the manipulative ability of StyleGAN - leads to the limited coverage issue.

Original: To disprove this assumption of GlobalDirection , in Fig. 3(a), we demonstrate that single-channel manipulation framework of GlobalDirection (using e i ) leads to improper construction of ϕ CLIP ( e i ) in the dictionary
Revised: To disprove this assumption of GlobalDirection , in Fig. 3(a), we demonstrate that single-channel manipulation framework of GlobalDirection (using e i ) leads to improper construction of ϕ CLIP ( e i ) in the dictionary

Original: D GlobalDirection .
Revised: D GlobalDirection .

Original: Then in Fig. 3(b), we show an example where editing two channels has a completely different effect from manipulating each of the channels individually, which proves the need for multi-channel manipulation.
Revised: Then in Fig. 3(b), we show an example where editing two channels has a completely different effect from manipulating each of the channels individually, which proves the need for multi-channel manipulation.

Original: In Fig. 3(a), we show that ϕ CLIP ( e i ) =
Revised: In Fig. 3(a), we show that ϕ CLIP ( e i ) =

Original: E (cid:2) CLIP (cid:0) G s ( s + e i ) (cid:1) − CLIP (cid:0) G s ( s − e i ) (cid:1)(cid:3) , which forms the dictionary D GlobalDirection , is not a robust representative of i -th style channel since there exists sample-wise inconsistency in the calculation of CLIP (cid:0)
Revised: E (cid:2) CLIP (cid:0) G s ( s + e i ) (cid:1) − CLIP (cid:0) G s ( s − e i ) (cid:1)(cid:3) , which forms the dictionary D GlobalDirection , is not a robust representative of i -th style channel since there exists sample-wise inconsistency in the calculation of CLIP (cid:0)

Original: G s ( s + e i ) (cid:1) − CLIP (cid:0) G s ( s − e i ) (cid:1) .
Revised: G s ( s + e i ) (cid:1) − CLIP (cid:0) G s ( s − e i ) (cid:1) .

Original: On the left side of Fig. 3(a), the distribution of CLIP (cid:0) G s ( s + e i ) (cid:1) − CLIP (cid:0) G s ( s − e i ) (cid:1) and its average over the samples, ϕ CLIP ( e i ) , are shown.
Revised: On the left side of Fig. 3(a), the distribution of CLIP (cid:0) G s ( s + e i ) (cid:1) − CLIP (cid:0) G s ( s − e i ) (cid:1) and its average over the samples, ϕ CLIP ( e i ) , are shown.

Original: As the samples show inconsistent angles over polar coordinatewhen modified by a single-channel manipulation e i , we conclude that ϕ CLIP ( e i ) may not be a trust-worthy representative of i -th channel in StyleSpace.
Revised: As the samples show inconsistent angles over polar coordinatewhen modified by a single-channel manipulation e i , we conclude that ϕ CLIP ( e i ) may not be a trust-worthy representative of i -th channel in StyleSpace.

Original: Thereby the basic assumption held by
Revised: Thereby the basic assumption held by

Original: GlobalDirection which expects a single channel manipulation using e i on any images to be semantically consistent in CLIP space, in fact, has numerous counter-examples showing inconsistency.
Revised: GlobalDirection which expects a single channel manipulation using e i on any images to be semantically consistent in CLIP space, in fact, has numerous counter-examples showing inconsistency.

Original: [Table]
Revised: [Table]

Original: [Figure]
Revised: [Figure]

Original: On the other hand, it is observable on the right side of Fig. 3(a), that manipulation by unsupervised direction α (50) , shows much consistent results.
Revised: On the other hand, it is observable on the right side of Fig. 3(a), that manipulation by unsupervised direction α (50) , shows much consistent results.

Original: Moreover, in Fig. 3(b), we show an example where single channel alone has completely different meaning from the manipulation by the combination of multiple channels.
Revised: Moreover, in Fig. 3(b), we show an example where single channel alone has completely different meaning from the manipulation by the combination of multiple channels.

Original: This supports our claim that the interaction between multiple channels should be considered, rather than individually encoding single channel each.
Revised: This supports our claim that the interaction between multiple channels should be considered, rather than individually encoding single channel each.

Original: In Fig. 3(b), manipulation by 4520-th or 4426-th do not show "completely white hair" while the combination of the two shows white hair.
Revised: In Fig. 3(b), manipulation by 4520-th or 4426-th do not show "completely white hair" while the combination of the two shows white hair.

Original: Since GlobalDirection fails to learn that 4520-th also has a role for creating white hair, it fails to successfully modify an image when text guidance is given as ‘white hair’.
Revised: Since GlobalDirection fails to learn that 4520-th also has a role for creating white hair, it fails to successfully modify an image when text guidance is given as ‘white hair’.

Original:  D ICTIONARY L EARNING FOR S PARSE R EPRESENTATION OF CLIP SPACE
Revised:  D ICTIONARY L EARNING FOR S PARSE R EPRESENTATION OF CLIP SPACE

Original: As discussed in Sec. 3.2, each style channel rather than the whole may not be meaningfully embedded in CLIP space.
Revised: As discussed in Sec. 3.2, each style channel rather than the whole may not be meaningfully embedded in CLIP space.

Original: To address this issue, we propose a dictionary learning approach to find a robust representation of styles that could be possibly a set of channels in StyleSpace S .
Revised: To address this issue, we propose a dictionary learning approach to find a robust representation of styles that could be possibly a set of channels in StyleSpace S .

Original: Ideally, given a text input t and its CLIP encoding CLIP( t ) ∈ R p , we would like to construct a dictionary D ∈ R p × n which finds a manipulation direction
Revised: Ideally, given a text input t and its CLIP encoding CLIP( t ) ∈ R p , we would like to construct a dictionary D ∈ R p × n which finds a manipulation direction

Original: ˆ s = D T CLIP( t ) ∈ R n as in Eq.
Revised: ˆ s = D T CLIP( t ) ∈ R n as in Eq.

Original: The direction ˆ s is expected to manipulate an image into G s ( s + ˆ s ) which faithfully represents t .
Revised: The direction ˆ s is expected to manipulate an image into G s ( s + ˆ s ) which faithfully represents t .

Original: Let us for now assume that the ‘ground truth’ manipulation direction ˆ s t ∈ R n corresponding to the driving text t is known.
Revised: Let us for now assume that the ‘ground truth’ manipulation direction ˆ s t ∈ R n corresponding to the driving text t is known.

Original: Then our estimated direction ˆ s = D T CLIP( t ) should generate an image
Revised: Then our estimated direction ˆ s = D T CLIP( t ) should generate an image

Original: X edited = G s ( s + D T CLIP( t )) close to G s ( s + ˆ s t ) .
Revised: X edited = G s ( s + D T CLIP( t )) close to G s ( s + ˆ s t ) .

Original: This leads to the objective minimize D
Revised: This leads to the objective minimize D

Original: [Equation]
Revised: [Equation]

Original: (3) which we name ideal dictionary learning problem since the ground truth direction ˆ s t for a driving text t is unknown.
Revised: (3) which we name ideal dictionary learning problem since the ground truth direction ˆ s t for a driving text t is unknown.

Original: To avoid this unrealistic assumption, we substitute ˆ s t with the known directions α ∈ R n derived from unsupervised methods (Härkönen et al., 2020; Shen & Zhou, 2021).
Revised: To avoid this unrealistic assumption, we substitute ˆ s t with the known directions α ∈ R n derived from unsupervised methods (Härkönen et al., 2020; Shen & Zhou, 2021).

Original: CLIP( t ) is also replaced by ϕ CLIP ( α ) (see Eq.
Revised: CLIP( t ) is also replaced by ϕ CLIP ( α ) (see Eq.

Original: (1) for the definition of ϕ CLIP ( · ) ) since we would like to use α itself as a driving guidance rather than finding out corresponding text t that requires labor-intensive labeling.
Revised: (1) for the definition of ϕ CLIP ( · ) ) since we would like to use α itself as a driving guidance rather than finding out corresponding text t that requires labor-intensive labeling.

Original: Then, Eq.
Revised: Then, Eq.

Original: (3) becomes
Revised: (3) becomes

Original: [Equation]
Revised: [Equation]

Original: We construct the set of known directions α in Eq.
Revised: We construct the set of known directions α in Eq.

Original: (4) by using all 512 directions found by GANspace and directions with top 80 eigenvalues out of 512 from SeFa 4 (Härkönen et al., 2020; Shen & Zhou, 2021).
Revised: (4) by using all 512 directions found by GANspace and directions with top 80 eigenvalues out of 512 from SeFa 4 (Härkönen et al., 2020; Shen & Zhou, 2021).

Original: Instead of naïvely using the unsupervised direction α ∈ R n , we prune the channels in directions to activate only k channels among n channels, zeroing out the other n − k channels that have small magnitudes.
Revised: Instead of naïvely using the unsupervised direction α ∈ R n , we prune the channels in directions to activate only k channels among n channels, zeroing out the other n − k channels that have small magnitudes.

Original: Such pruning is represented by α ( k ) ∈ R n where we use k = 10 , 30 ,in this paper (the effect of k is described in Tab. 5 in the appendix).
Revised: Such pruning is represented by α ( k ) ∈ R n where we use k = 10 , 30 ,in this paper (the effect of k is described in Tab. 5 in the appendix).

Original: The reason for pruning the number of activated channels is that unsupervised methods show instability in terms of maintaining
Revised: The reason for pruning the number of activated channels is that unsupervised methods show instability in terms of maintaining

Original: [Table]
Revised: [Table]

Original: the original image due to the entanglement (please refer to Appendix C for examples of entanglement without pruning) and we circumvent such issue by constraining the direction α ∈ R n to have limited effect on only k channels.
Revised: the original image due to the entanglement (please refer to Appendix C for examples of entanglement without pruning) and we circumvent such issue by constraining the direction α ∈ R n to have limited effect on only k channels.

Original: To help close the gap between Eq.
Revised: To help close the gap between Eq.

Original: (3) and Eq.
Revised: (3) and Eq.

Original: (4), we introduce an additional loss term ∥ D α ( k ) − ϕ CLIP ( α ( k ) )
Revised: (4), we introduce an additional loss term ∥ D α ( k ) − ϕ CLIP ( α ( k ) )

Original: ∥ 22 to update the dictionary D ∈ R p × n .
Revised: ∥ 22 to update the dictionary D ∈ R p × n .

Original: This additional term comes from the observation in Sec.
Revised: This additional term comes from the observation in Sec.

Original: 3.2 that multi-channel manipulation should be considered.
Revised: 3.2 that multi-channel manipulation should be considered.

Original: Unlike GlobalDirection which directly encodes ϕ CLIP ( e i ) for all n channels in StyleSpace, we aim to learn the multi-channel manipulation by α ( k ) whose editing effect is mapped from StyleSpace to CLIP space by ϕ CLIP ( · ) .
Revised: Unlike GlobalDirection which directly encodes ϕ CLIP ( e i ) for all n channels in StyleSpace, we aim to learn the multi-channel manipulation by α ( k ) whose editing effect is mapped from StyleSpace to CLIP space by ϕ CLIP ( · ) .

Original: The main obstacle in this objective is identifying which channel is responsible for which part of the change induced by total of k channels in the given direction α ( k ) .
Revised: The main obstacle in this objective is identifying which channel is responsible for which part of the change induced by total of k channels in the given direction α ( k ) .

Original: Here, we emphasize that augmenting the same direction α into α (10) , α (30) , α (50) can encourage the dictionary learning process to identify a disentangled editing effect of each channel which will be explained further below.
Revised: Here, we emphasize that augmenting the same direction α into α (10) , α (30) , α (50) can encourage the dictionary learning process to identify a disentangled editing effect of each channel which will be explained further below.

Original: Based on the concept figure in Fig.
Revised: Based on the concept figure in Fig.

Original: 4, we explain how the additional loss term encourages disentangled learning of dictionary D .
Revised: 4, we explain how the additional loss term encourages disentangled learning of dictionary D .

Original: We present a simplified version where k = 1 , 2 , 3 , creating three augmentations α (1) , α (2) , α (3) for the direction α .
Revised: We present a simplified version where k = 1 , 2 , 3 , creating three augmentations α (1) , α (2) , α (3) for the direction α .

Original: Suppose manipulation using α (3) =
Revised: Suppose manipulation using α (3) =

Original: [ s 1 , s 2 , s 3 ] T modifies the source image to have 1) thick eyebrows, 2) pink lipstick and 3) glowing skin.
Revised: [ s 1 , s 2 , s 3 ] T modifies the source image to have 1) thick eyebrows, 2) pink lipstick and 3) glowing skin.

Original: Further suppose manipulation by α (2) =
Revised: Further suppose manipulation by α (2) =

Original: [ s 1 , 0 , s 3 ] T modifies 1) thick eyebrows and 2) pink lipstick.
Revised: [ s 1 , 0 , s 3 ] T modifies 1) thick eyebrows and 2) pink lipstick.

Original: Finally, manipulation using α (1) =
Revised: Finally, manipulation using α (1) =

Original: [ s 1 , 0 , 0] T modifies 1) thick eyebrows.
Revised: [ s 1 , 0 , 0] T modifies 1) thick eyebrows.

Original: If the loss term ∥ D α ( k ) − ϕ CLIP ( α ( k ) )
Revised: If the loss term ∥ D α ( k ) − ϕ CLIP ( α ( k ) )

Original: ∥ 22 is perfectly optimized to satisfy D α ( k ) = ϕ
Revised: ∥ 22 is perfectly optimized to satisfy D α ( k ) = ϕ

Original: CLIP ( α ( k ) ) , then s 1 d 1 ≈ CLIP(thick eyebrows) , s 1 d 1 + s 3 d 3 ≈ CLIP(thick eyebrows & pink lipsticks) and s 1 d 1 + s 2 d 

Revised: CLIP ( α ( k ) ) , then s 1 d 1 ≈ CLIP(thick eyebrows) , s 1 d 1 + s 3 d 3 ≈ CLIP(thick eyebrows & pink lipsticks) and s 1 d 1 + s 2 d

Original: + s 3 d 3 ≈ CLIP(thick eyebrows & pink lipsticks & glowing skin).
Revised: + s 3 d 3 ≈ CLIP(thick eyebrows & pink lipsticks & glowing skin).

Original: Therefore, the linear combination on the sparsified direction helps to specifically link ‘thick eyebrows’ to d 1 ‘pink lipstick’ to d 3 , and ‘glowing skin’ to d 2 .
Revised: Therefore, the linear combination on the sparsified direction helps to specifically link ‘thick eyebrows’ to d 1 ‘pink lipstick’ to d 3 , and ‘glowing skin’ to d 2 .

Original: Hence our method may have greatly disentangled and diverse directions coming from the enriched coverage over manipulation in StyleGAN, thanks to the dictionary learning based on multi-channel manipulation.
Revised: Hence our method may have greatly disentangled and diverse directions coming from the enriched coverage over manipulation in StyleGAN, thanks to the dictionary learning based on multi-channel manipulation.

Original: Moreover, even though our α comes from the unsupervised methods, our method learns the individual role of s 1 , s 2 and s 3 from the single unsupervised direction α =
Revised: Moreover, even though our α comes from the unsupervised methods, our method learns the individual role of s 1 , s 2 and s 3 from the single unsupervised direction α =

Original: [ s 1 , s 2 , s 3 ] T .
Revised: [ s 1 , s 2 , s 3 ] T .

Original: This leads to greatly diverse and disentangled results compared to unsupervised methods which will be proved in Tab. 3.
Revised: This leads to greatly diverse and disentangled results compared to unsupervised methods which will be proved in Tab. 3.

Original: Finally, combining these two ingredients together yields our dictionary learning problem by considering all known directions α ( k ) : minimize
Revised: Finally, combining these two ingredients together yields our dictionary learning problem by considering all known directions α ( k ) : minimize

Original: [Equation]
Revised: [Equation]

Original: where λ is the tunable hyper-parameter and is set as 0.01 in all our experiments below.
Revised: where λ is the tunable hyper-parameter and is set as 0.01 in all our experiments below.

Original:  E XPERIMENTS
Revised:  E XPERIMENTS

Original: We evaluate the proposed method on StyleGAN2 (Karras et al., 2020a).
Revised: We evaluate the proposed method on StyleGAN2 (Karras et al., 2020a).

Original: We used StyleGAN2-ADA pretrained on multiple datasets, including FFHQ (Karras et al., 2019), LSUN (Yu et al., 2015) Car,
Revised: We used StyleGAN2-ADA pretrained on multiple datasets, including FFHQ (Karras et al., 2019), LSUN (Yu et al., 2015) Car,

Original: Church, AFHQ (Choi et al., 2020) Dog, Cat.
Revised: Church, AFHQ (Choi et al., 2020) Dog, Cat.

Original: In this section, we show the widened StyleGAN manipulation coverage of our method compared to a text-guided method, GlobalDirection of
Revised: In this section, we show the widened StyleGAN manipulation coverage of our method compared to a text-guided method, GlobalDirection of

Original: StyleCLIP (Patashnik et al., 2021) mainly on FFHQ pre-trained model.
Revised: StyleCLIP (Patashnik et al., 2021) mainly on FFHQ pre-trained model.

Original: For additional details in experimental design, please refer to Appendix E.
Revised: For additional details in experimental design, please refer to Appendix E.

Original: Quantitative Results We measure the superiority of our method in terms of recovering the unsupervised directions α and text guidance t .
Revised: Quantitative Results We measure the superiority of our method in terms of recovering the unsupervised directions α and text guidance t .

Original: The metrics are defined in StyleSpace S to evaluate over
Revised: The metrics are defined in StyleSpace S to evaluate over

Original: [Table]
Revised: [Table]

Original: unsupervised directions and in CLIP space for evaluation over text guidance.
Revised: unsupervised directions and in CLIP space for evaluation over text guidance.

Original: Multi2One recover the unsupervised direction with maximum manipulative ability and minimum entanglement, for demonstration of which we define two metrics as follows
Revised: Multi2One recover the unsupervised direction with maximum manipulative ability and minimum entanglement, for demonstration of which we define two metrics as follows

Original: • StyleSpace metric for unsupervised directions (Tab. 2):
Revised: • StyleSpace metric for unsupervised directions (Tab. 2):

Original: We employ the following metric:
Revised: We employ the following metric:

Original: [Equation]
Revised: [Equation]

Original: where α is from a set of unsupervised directions A .
Revised: where α is from a set of unsupervised directions A .

Original: Note that the ground truth direction α in this metric is α (100) , where top-100 channels from unsupervised directions are modified while other n − 100 channels are zero entries.
Revised: Note that the ground truth direction α in this metric is α (100) , where top-100 channels from unsupervised directions are modified while other n − 100 channels are zero entries.

Original: Therefore the reconstruction of such direction α (100) , given by ˆ α = D T ϕ CLIP ( α (100) ) is expected to have 100 style channels whose values are similar to that of non-zero entries in α (100) while the other n − 100 styles are close to 0 .
Revised: Therefore the reconstruction of such direction α (100) , given by ˆ α = D T ϕ CLIP ( α (100) ) is expected to have 100 style channels whose values are similar to that of non-zero entries in α (100) while the other n − 100 styles are close to 0 .

Original: MSE (cid:0) α , ˆ α | ̸ =0 (cid:1) denotes the difference between α and ˆ α measured between the 100 non-zero style channels that represents the ability of the given dictionary D to find the precise manipulation direction.
Revised: MSE (cid:0) α , ˆ α | ̸ =0 (cid:1) denotes the difference between α and ˆ α measured between the 100 non-zero style channels that represents the ability of the given dictionary D to find the precise manipulation direction.

Original: On the other hand, MSE (cid:0) α , ˆ α | =0 (cid:1) is the distance between α and ˆ α measured within n − 100 zero-entries.
Revised: On the other hand, MSE (cid:0) α , ˆ α | =0 (cid:1) is the distance between α and ˆ α measured within n − 100 zero-entries.

Original: This represents the level of disentanglement since zero-entries are not expected to be modified in ˆ α . • CLIP space metric for text guidance (Tab. 3): We measure the similarity between edited image and the text guidance in CLIP space as follows:
Revised: This represents the level of disentanglement since zero-entries are not expected to be modified in ˆ α . • CLIP space metric for text guidance (Tab. 3): We measure the similarity between edited image and the text guidance in CLIP space as follows:

Original: [Equation]
Revised: [Equation]

Original: We denote the set of text prompts that describes the pre-trained domain of StyleGAN, namely FFHQ as T whose construction is described in Appendix A.
Revised: We denote the set of text prompts that describes the pre-trained domain of StyleGAN, namely FFHQ as T whose construction is described in Appendix A.

Original: Tab. 2 shows that Multi2One consistently outperforms GlobalDirection in terms of MSE score between the unsupervised direction α and the estimated direction ˆ α .
Revised: Tab. 2 shows that Multi2One consistently outperforms GlobalDirection in terms of MSE score between the unsupervised direction α and the estimated direction ˆ α .

Original: Especially, note that
Revised: Especially, note that

Original: Multi2One have lower MSE (cid:0) α , ˆ α | =0 (cid:1) than GlobalDirection , proving that our method shows less entanglement.
Revised: Multi2One have lower MSE (cid:0) α , ˆ α | =0 (cid:1) than GlobalDirection , proving that our method shows less entanglement.

Original: Moreover, Tab. 3 shows that the cosine similarity between the given text guidance and the manipulated image is always the highest using our method.
Revised: Moreover, Tab. 3 shows that the cosine similarity between the given text guidance and the manipulated image is always the highest using our method.

Original: Most importantly, we emphasize that our method could find manipulation directions that could not have been found by unsupervised methods.
Revised: Most importantly, we emphasize that our method could find manipulation directions that could not have been found by unsupervised methods.

Original: We prove this claim using 57 text prompts ( t ∼ T ) as a guidance to manipulate the images.
Revised: We prove this claim using 57 text prompts ( t ∼ T ) as a guidance to manipulate the images.

Original: Since we aim to find the unsupervised direction that could edit the image to become t , we select the α whose similarity cos ( ϕ CLIP ( α ) , CLIP( t )) is the largest then manipulate the image to produce X unsup =
Revised: Since we aim to find the unsupervised direction that could edit the image to become t , we select the α whose similarity cos ( ϕ CLIP ( α ) , CLIP( t )) is the largest then manipulate the image to produce X unsup =

Original: G s ( s + α ) .
Revised: G s ( s + α ) .

Original: In Tab. 3, Multi2One scores better R CLIP ( t, X edited ) compared to unsupervised methods.
Revised: In Tab. 3, Multi2One scores better R CLIP ( t, X edited ) compared to unsupervised methods.

Original: Therefore, we claim that our method successfully learns to find expansive editing directions which could not be found by unsupervised methods given diverse text inputs.
Revised: Therefore, we claim that our method successfully learns to find expansive editing directions which could not be found by unsupervised methods given diverse text inputs.

Original: Furthermore, we report R CLIP ( t, X edited ) score with ablation on the second term of Eq.
Revised: Furthermore, we report R CLIP ( t, X edited ) score with ablation on the second term of Eq.

Original: (5) in Tab. 3.
Revised: (5) in Tab. 3.

Original: For visual examples see Appendix G.
Revised: For visual examples see Appendix G.

Original: Qualitative Results We demonstrate the effectiveness of our method, compared to the state-of-thearts method, GlobalDirection .
Revised: Qualitative Results We demonstrate the effectiveness of our method, compared to the state-of-thearts method, GlobalDirection .

Original: We conducted all experiments using the pretrained models and the precomputed set of CLIP embeddings for StyleCLIP, that are readily provided for FFHQ, AFHQ
Revised: We conducted all experiments using the pretrained models and the precomputed set of CLIP embeddings for StyleCLIP, that are readily provided for FFHQ, AFHQ

Original: Cat and AFHQ Dog.
Revised: Cat and AFHQ Dog.

Original: We computed the CLIP embeddings of the StyleSpace of LSUN Church and
Revised: We computed the CLIP embeddings of the StyleSpace of LSUN Church and

Original: Car using the same configuration with GlobalDirection .
Revised: Car using the same configuration with GlobalDirection .

Original: All the results are compared under same condition, where manipulation strength and disentanglement levels are set to be equal.
Revised: All the results are compared under same condition, where manipulation strength and disentanglement levels are set to be equal.

Original: More specifically, we modify same number of channels for both methods and the magnitude of change 5 in
Revised: More specifically, we modify same number of channels for both methods and the magnitude of change 5 in

Original: StyleSpace is always fixed as 10.
Revised: StyleSpace is always fixed as 10.

Original: L ittl e
Revised: L ittl e

Original: M e r m a i d S t
Revised: M e r m a i d S t

Original: y l e C L
Revised: y l e C L

Original: I P ( G .
Revised: I P ( G .

Original: D . )
Revised: D . )

Original: O u r s O u r s
Revised: O u r s O u r s

Original: S t y l e C L
Revised: S t y l e C L

Original: I P ( G .
Revised: I P ( G .

Original: D . )
Revised: D . )

Original: B l u e
Revised: B l u e

Original: H a i r
Revised: H a i r

Original: O u r s
Revised: O u r s

Original: S t y l e C L
Revised: S t y l e C L

Original: I P ( G .
Revised: I P ( G .

Original: D . )
Revised: D . )

Original: J ok e r
Revised: J ok e r

Original: S m il e
Revised: S m il e

Original: O u r s
Revised: O u r s

Original: S t y l e C L
Revised: S t y l e C L

Original: I P ( G .
Revised: I P ( G .

Original: D . )
Revised: D . )

Original: Y oung
Revised: Y oung

Original: The manipulated images show that GlobalDirection fails to represent some of the most basic text such as ‘Young’ for FFHQ.
Revised: The manipulated images show that GlobalDirection fails to represent some of the most basic text such as ‘Young’ for FFHQ.

Original: On the other hand, ours successfully manipulates the images not only on the basic text guidances but also on advanced semantics such as ‘Little mermaid’ and ‘Joker smile’ for FFHQ.
Revised: On the other hand, ours successfully manipulates the images not only on the basic text guidances but also on advanced semantics such as ‘Little mermaid’ and ‘Joker smile’ for FFHQ.

Original: We emphasize that despite the dictionary of our method is learned from the known directions in unsupervised approaches (Shen & Zhou, 2021;
Revised: We emphasize that despite the dictionary of our method is learned from the known directions in unsupervised approaches (Shen & Zhou, 2021;

Original: Härkönen et al., 2020), the manipulation results show that our learned dictionary could adapt to previously unseen combination of semantics such as red hair, pale skin, and big eyes to represent ‘Little Mermaid’ and unnatural smiles with red lipstick and pale face to represent ‘Joker smile’.
Revised: Härkönen et al., 2020), the manipulation results show that our learned dictionary could adapt to previously unseen combination of semantics such as red hair, pale skin, and big eyes to represent ‘Little Mermaid’ and unnatural smiles with red lipstick and pale face to represent ‘Joker smile’.

Original: Here we show that our method successfully discovers a direction that does not exist in unsupervised direction.
Revised: Here we show that our method successfully discovers a direction that does not exist in unsupervised direction.

Original: To be more specific, we manipulate the image using an unsupervised direction α whose
Revised: To be more specific, we manipulate the image using an unsupervised direction α whose

Original: CLIP representation, ϕ CLIP ( α ) , is the most similar with the text ‘Little Mermaid’ and ‘Joker smile’.
Revised: CLIP representation, ϕ CLIP ( α ) , is the most similar with the text ‘Little Mermaid’ and ‘Joker smile’.

Original: Then from the manipulated image, we observe that the manipulation result is hardly plausible compared to the successful results in Fig.
Revised: Then from the manipulated image, we observe that the manipulation result is hardly plausible compared to the successful results in Fig.

Original: Based on this examples, we emphasize that even though the dictionary learning process relies on the unsupervised methods, Multi2One demonstrate wider variety of manipulation results using the versatility of text.
Revised: Based on this examples, we emphasize that even though the dictionary learning process relies on the unsupervised methods, Multi2One demonstrate wider variety of manipulation results using the versatility of text.

Original: [Figure]
Revised: [Figure]

Revised: Source k =k

Revised: =k

Revised: =k

Revised: =

Revised: Source k =k

Original:  We show additional results of our method compared to GlobalDirection based on AFHQ and
Revised: =k =k = We show additional results of our method compared to GlobalDirection based on AFHQ and

Original: LSUN dataset in Appendix D due to space constraints.
Revised: LSUN dataset in Appendix D due to space constraints.

Original:  C ONCLUSION
Revised:  C ONCLUSION

Original: Text-guided image manipulation has been largely preferred over unsupervised methods in finding manipulation directions due to its ability to find wide variety of directions corresponding to flexible text input.
Revised: Text-guided image manipulation has been largely preferred over unsupervised methods in finding manipulation directions due to its ability to find wide variety of directions corresponding to flexible text input.

Original: However, we have investigated that the state-of-the-art method of text-guided image manipulation has limited coverage over possible editing directions using StyleGAN and this problem rises from a simple assumption that a single-channel manipulation could fully represent the manipulation ability of StyleGAN.
Revised: However, we have investigated that the state-of-the-art method of text-guided image manipulation has limited coverage over possible editing directions using StyleGAN and this problem rises from a simple assumption that a single-channel manipulation could fully represent the manipulation ability of StyleGAN.

Original: To overcome this issue, we have proposed a dictionary learning framework that embeds the interactive and collective editing effect based on modifying multiple style channels into CLIP space jointly.
Revised: To overcome this issue, we have proposed a dictionary learning framework that embeds the interactive and collective editing effect based on modifying multiple style channels into CLIP space jointly.

Original: Our method have been proven to be superior over other text-guided image manipulation methods in terms of manipulative ability and disentanglement.
Revised: Our method have been proven to be superior over other text-guided image manipulation methods in terms of manipulative ability and disentanglement.

Original: R EPRODUCIBILITY S TATEMENT
Revised: R EPRODUCIBILITY S TATEMENT

Original: Our code is open sourced at here.
Revised: Our code is open sourced at here.

Original: A M ORE E XAMPLES ON F IG . 1( B )
Revised: A M ORE E XAMPLES ON F IG . 1( B )

Original: In this section, we show the extensive results on the limited coverage of GlobalDirection on wide variety of text guidance.
Revised: In this section, we show the extensive results on the limited coverage of GlobalDirection on wide variety of text guidance.

Original: The experiment is conducted on FFHQ-pretrained StyleGAN-ADA, and the text guidance are the adjective-noun pairs extracted from Visual Semantic Ontology
Revised: The experiment is conducted on FFHQ-pretrained StyleGAN-ADA, and the text guidance are the adjective-noun pairs extracted from Visual Semantic Ontology

Original: (Jou et al., 2015) from which extract the nouns that describe human face.
Revised: (Jou et al., 2015) from which extract the nouns that describe human face.

Original: For example, the adjective-noun pairs contain human face descriptions such as ‘Handsome smile’, ‘Bad hair’, and ’Stupid face’.
Revised: For example, the adjective-noun pairs contain human face descriptions such as ‘Handsome smile’, ‘Bad hair’, and ’Stupid face’.

Original: The number of such adjectivenoun pair amounts to 57 instances.
Revised: The number of such adjectivenoun pair amounts to 57 instances.

Original: We manipulate the original image on the leftmost side using GlobalDirection and Multi2One using the same set of text description and equal configuration for both methods (manipulated channels 5, manipulation strength 5).
Revised: We manipulate the original image on the leftmost side using GlobalDirection and Multi2One using the same set of text description and equal configuration for both methods (manipulated channels 5, manipulation strength 5).

Original: The result in Fig.
Revised: The result in Fig.

Original: 7 shows that StyleCLIP GlobalDirection constantly fails to represent the given text guidance faithfully, manifesting its limited capacity in exploiting the flexibility of text hence the need for Multi2One to overcome the coverage issue.
Revised: 7 shows that StyleCLIP GlobalDirection constantly fails to represent the given text guidance faithfully, manifesting its limited capacity in exploiting the flexibility of text hence the need for Multi2One to overcome the coverage issue.

Original: Crying Eyes
Revised: Crying Eyes

Original: Crazy Eyes
Revised: Crazy Eyes

Original: Friendly Smile
Revised: Friendly Smile

Original: Hot Blonde
Revised: Hot Blonde

Original: Mad Eyes
Revised: Mad Eyes

Original: Sexy Lips
Revised: Sexy Lips

Original: Shiny Hair
Revised: Shiny Hair

Original: Sick Face
Revised: Sick Face

Original: Smiling Eyes
Revised: Smiling Eyes

Original: Original
Revised: Original

Original: GD
Revised: GD

Original: Ours
Revised: Ours

Original: Innocent Eyes
Revised: Innocent Eyes

Original: Original
Revised: Original

Original: GD
Revised: GD

Original: Ours
Revised: Ours

Original: B M ORE D ETAILS ON F IG . 3( A )
Revised: Mad Eyes Crazy Eyes Source Ours GD Sexy Lips Crying Eyes

Revised: Shiny Hair Innocent Eyes

Revised: Sick Face Friendly Smile

Revised: Smiling Eyes Hot Blonde

Original:  Both GlobalDirection and Multi2One rely on multiple samples of images to encode the averaged difference caused by manipulating a sample into positive and negative direction.
Revised: Source Ours GD B M ORE D ETAILS ON F IG . 3( A ) Both GlobalDirection and Multi2One rely on multiple samples of images to encode the averaged difference caused by manipulating a sample into positive and negative direction.

Original: The difference is that unlike GlobalDirection which relies on a single channel manipulation, Multi2One encode change of image caused by image-agnostic direction found by unsupervised methods (Härkönen et al., 2020; Shen & Zhou, 2021).
Revised: The difference is that unlike GlobalDirection which relies on a single channel manipulation, Multi2One encode change of image caused by image-agnostic direction found by unsupervised methods (Härkönen et al., 2020; Shen & Zhou, 2021).

Original: Single channel manipulation is not image-agnostic since the change caused by moving a single channel may not be applicable to certain source images used as a sample.
Revised: Single channel manipulation is not image-agnostic since the change caused by moving a single channel may not be applicable to certain source images used as a sample.

Original: For unconditional FFHQ pretrained StyleGAN-ADA, we have observed that a style channel which is known to make a person’s hair grey fails to modify half of the samples.
Revised: For unconditional FFHQ pretrained StyleGAN-ADA, we have observed that a style channel which is known to make a person’s hair grey fails to modify half of the samples.

Original: On the other hand, the image-agnostic directions found by unsupervised methods hardly fails to manipulate any given image to become older with grey hair.
Revised: On the other hand, the image-agnostic directions found by unsupervised methods hardly fails to manipulate any given image to become older with grey hair.

Original: As a consequence, the CLIP embeddings of difference caused by single channel manipulation may greatly vary sample by sample while image-agnostic directions show consistent direction of CLIP embeddings due to the successful manipulation on any given sample of images.
Revised: As a consequence, the CLIP embeddings of difference caused by single channel manipulation may greatly vary sample by sample while image-agnostic directions show consistent direction of CLIP embeddings due to the successful manipulation on any given sample of images.

Original: We visualize the direction of each sample when a single channel is modified, and when 100 or 200 channels from unsupervised directions are modified.
Revised: We visualize the direction of each sample when a single channel is modified, and when 100 or 200 channels from unsupervised directions are modified.

Original: More specifically, for a single channel manipulation of GlobalDirection the samples are E (cid:0) G s ( s + s i ) (cid:1) − E (cid:0) G s ( s − s i ) (cid:1) and for multiple channel manipulation, the samples are E (cid:0) G s ( s + α ) (cid:1) − E (cid:0) G s ( s − α ) (cid:1) where s ∼ S .
Revised: More specifically, for a single channel manipulation of GlobalDirection the samples are E (cid:0) G s ( s + s i ) (cid:1) − E (cid:0) G s ( s − s i ) (cid:1) and for multiple channel manipulation, the samples are E (cid:0) G s ( s + α ) (cid:1) − E (cid:0) G s ( s − α ) (cid:1) where s ∼ S .

Original: The visualization is conducted in a similar manner with the work of Wang & Isola (2020).
Revised: The visualization is conducted in a similar manner with the work of Wang & Isola (2020).

Original: First we embed the p = 512 dimensional CLIP vectors into 2 -dimension using t-SNE (Van der Maaten &
Revised: First we embed the p = 512 dimensional CLIP vectors into 2 -dimension using t-SNE (Van der Maaten &

Original: Hinton, 2008).
Revised: Hinton, 2008).

Original: We denote each sample as ( a i , b i ) for i = 1 , 2 , · · · , 100 and the averaged direction of interest E (cid:20) E (cid:0) G s ( s + s i ) (cid:1) − E (cid:0) G s ( s − s i ) (cid:1)(cid:21) in 2 -dimensional space is ( a, b ) .
Revised: We denote each sample as ( a i , b i ) for i = 1 , 2 , · · · , 100 and the averaged direction of interest E (cid:20) E (cid:0) G s ( s + s i ) (cid:1) − E (cid:0) G s ( s − s i ) (cid:1)(cid:21) in 2 -dimensional space is ( a, b ) .

Original: The angles are derived as θ i
Revised: The angles are derived as θ i

Original: =
Revised: =

Original: arctan2( b i , a i ) for all samples which range between [ − π, + π ] .
Revised: arctan2( b i , a i ) for all samples which range between [ − π, + π ] .

Original: The histogram of 100 angles are plotted with the angle of averaged difference in R 2 with the angle
Revised: The histogram of 100 angles are plotted with the angle of averaged difference in R 2 with the angle

Original: arctan2( b, a ) is emphasized as a red line in Fig. 3(a).
Revised: arctan2( b, a ) is emphasized as a red line in Fig. 3(a).

Original: C E XAMPLES OF E NTANGLEMENT USING U NSUPERVISED M ETHODS
Revised: C E XAMPLES OF E NTANGLEMENT USING U NSUPERVISED M ETHODS

Original: In Fig.
Revised: In Fig.

Original: 8, we demonstrate the effect of using limited number of channels among all non-zero channels in unsupervised direction α ∈ R n .
Revised: 8, we demonstrate the effect of using limited number of channels among all non-zero channels in unsupervised direction α ∈ R n .

Original: Since StyleGAN generator consists of progressiveGAN structure where the resolution of generated image progressively increases, it is possible to classify the generator structure into three blocks: coarse, medium and fine.
Revised: Since StyleGAN generator consists of progressiveGAN structure where the resolution of generated image progressively increases, it is possible to classify the generator structure into three blocks: coarse, medium and fine.

Original: We apply the unsupervised directions on each of the blocks.
Revised: We apply the unsupervised directions on each of the blocks.

Original: Moreover, by filtering out to only use k manipulated channels, we show that the source image shows less drastic change.
Revised: Moreover, by filtering out to only use k manipulated channels, we show that the source image shows less drastic change.

Original: By manipulating all channels, which is shown at the rightmost side of the figure, the source image is drastically changed showing entanglement.
Revised: By manipulating all channels, which is shown at the rightmost side of the figure, the source image is drastically changed showing entanglement.

Original: [Figure]
Revised: [Figure]

Original: Number of Channels Manipulated
Revised: Number of Channels Manipulated

Original: All
Revised: All

Original: All
Revised: All

Original: C o a r s e
Revised: C o a r s e

Original: M e d i u m
Revised: M e d i u m

Original: F i n e
Revised: F i n e

Original: A ll
Revised: A ll

Original: L a y e r s
Revised: L a y e r s

Original: C o a r s e
Revised: C o a r s e

Original: M e d i u m
Revised: M e d i u m

Original: F i n e
Revised: F i n e

Original: A ll
Revised: A ll

Original: L a y e r s
Revised: L a y e r s

Original: [Figure]
Revised: [Figure]

Original: 10thDirection
Revised: 10th

Revised: [Figure] [Figure]

Original: D M ORE E XPERIMENTAL E XAMPLES FOR ALL DATASET
Revised: M ORE E XPERIMENTAL E XAMPLES FOR ALL DATASET

Original: In this section, we provide more experimental results of Multi2One with FFHQ, AFHQ, and LSUN. 
Revised: In this section, we provide more experimental results of Multi2One with FFHQ, AFHQ, and LSUN. Pale

Original: GD
Revised: Tanned [Figure] Strong Light Sunlight

Revised: Dark Skin

Original: [Figure]
Revised: [Figure]

Original: Fig.
Revised: Fig.

Original: 10 shows the manipulation results on Multi2One and StyleCLIP GlobalDirection using 100, 500, 1000 channels.
Revised: 10 shows the manipulation results on Multi2One and StyleCLIP GlobalDirection using 100, 500, 1000 channels.

Original: In addition, the manipulation results without channel pruning strategy is shown as well.
Revised: In addition, the manipulation results without channel pruning strategy is shown as well.

Original: Using over 500 channels is required for large structural change of the object in source image.
Revised: Using over 500 channels is required for large structural change of the object in source image.

Original: However, StyleCLIP GlobalDirection shows signs of severe image collapse before creating an image that perfectly satisfies the given text guidance.
Revised: However, StyleCLIP GlobalDirection shows signs of severe image collapse before creating an image that perfectly satisfies the given text guidance.

Original: For example, an image at the first row with 100 channels manipulated do not seem ‘young’ enough and the extent of manipulation is not improved with using more channels since the image collapse and entanglement becomes a dominating factor.
Revised: For example, an image at the first row with 100 channels manipulated do not seem ‘young’ enough and the extent of manipulation is not improved with using more channels since the image collapse and entanglement becomes a dominating factor.

Original: On the other hand, Multi2One shows consistently reasonable and disentangled images even when using all channels in S TYLE S PACE .
Revised: On the other hand, Multi2One shows consistently reasonable and disentangled images even when using all channels in S TYLE S PACE .

Original: S t y l e C
Revised: S t y l e C

Original: L I P ( G . D . )
Revised: L I P ( G . D . )

Original: O u r s B e n g a l C a t 
Revised: O u r s B e ng a l C a t S t y l e C

Revised: L I P ( G .

Revised: D . )

Revised: O u r s

Revised: P u ss i n

Revised: B oo t s

Revised: S t y l e C

Revised: L I P ( G .

Revised: D . )

Revised: O u r s B l ac k

Revised: F u r

Original: S t y l e C
Revised: S t y l e C

Revised: L I P ( G .

Revised: D . )

Revised: O u r s B

Revised: l u e

Revised: F u r (a) (b)

Revised: S t y l e C

Revised: L I P ( G .

Revised: D . )

Revised: O u r s B

Revised: e ng a l

Revised: C a t

Revised: S t y l e C

Original: L I P ( G . D . )
Revised: L I P ( G . D . )

Original: O u r s P u ss i n B oo t s
Revised: O u r s P u ss i n B oo t s

Original: S t y l e C
Revised: S t y l e C

Original: L I P ( G . D . )
Revised: L I P ( G . D . )

Original: O u r s B l ac k F u r
Revised: O u r s B l ac k F u r

Original: S t y l e C
Revised: S t y l e C

Original: L I P ( G . D . )
Revised: L I P ( G . D . )

Original: O u r s B
Revised: O u r s B

Original: l u e F u r (a) (b)
Revised: l u e F u r (a) (b)

Original: S t y l e CL
Revised: S t y l e C

Revised: L I P ( G .

Revised: D . )

Revised: O u r s

Revised: B e n z

Revised: GW a gon

Revised: Y e ll o w

Revised: C a b

Revised: S t y l e C

Revised: L I P ( G .

Revised: D . )

Revised: O u r s

Revised: S t y l e C L

Revised: I P ( G .

Revised: D . )

Revised: O u r s B

Revised: r

Original: I
Revised: i c k C hu c h G o l d e n C hu r c h

Revised: S t y l e C L

Original:  P ( G . D . )
Revised: I P ( G . D . )

Revised: O u r s (a) (b)

Revised: B r i c k

Revised: C hu r c h

Revised: S t y l e

Revised: C L I P ( G . D . )

Original: O u r s B e n z
Revised: O u r s B e n z

Original: G - W a gon
Revised: GW a gon

Original: Y e ll o w
Revised: Y e ll o w

Original: C a b S t y l eC L
Revised: C a b S t y l e

Original:  I P ( G . D . )
Revised: C L I P ( G . D . )

Original: O u r s
Revised: O u r s

Original: S t y l e C L I P ( G . D . )
Revised: S t y l e C L I P ( G . D . )

Original: O u r s B
Revised: O u r s B

Original: r
Revised: r

Original: i c k
Revised: i c k

Original: C hu c h
Revised: C hu c h

Original: G o l d e n
Revised: G o l d e n

Original: C hu r c h S t y l e C L I P ( G . D . )
Revised: C hu r c h S t y l e C L I P ( G . D . )

Original: O u r s (a) (b)
Revised: O u r s (a) (b)

Original: B r i c k C hu r c h (a) (
Revised: B r i c k C hu r c h (a) (b)

Original: [Figure]
Revised: Source

Original: [Figure]
Revised: Ours GD

Original: Original
Revised: Source

Original: GD Ours 
Revised: Ours GD

Original: Original
Revised: Black Corgi White

Original: GD
Revised: Chihuahua Yellow Maltese

Original: Ours
Revised: Brown Deberman Orange Gloden Retriever

Original: Original
Revised: Source

Original: GD
Revised: GD

Original: Ours
Revised: Ours

Original: Original
Revised: Source

Original: GD
Revised: GD

Original: Ours
Revised: Ours

Revised: Black Cat

Revised: Sleepy Cat

Revised: Yellow Cat

Revised: Kitten

Revised: Grey Cat

Revised: Green Eyes

Revised: White Cat

Revised: In the Dark

Revised: Pink Nose

Revised: Surprised Cat

Original: [Figure] [Figure]
Revised: [Figure] [Figure]

Original: E E XPERIMENTAL D ETAILS
Revised: E E XPERIMENTAL D ETAILS

Original: We use unsupervised directions from SeFa and GANspace, both of which are found in intermediate space W limiting the maximum number of directions to 512, which is the dimension of the intermediate latent space.
Revised: We use unsupervised directions from SeFa and GANspace, both of which are found in intermediate space W limiting the maximum number of directions to 512, which is the dimension of the intermediate latent space.

Original: We use 512 directions from GANSpace and 80 directions from SeFa.
Revised: We use 512 directions from GANSpace and 80 directions from SeFa.

Original: Since the earlier layers of StyleGAN mainly shows large structural changes while the deep layers are related to a small detailed changes, we apply the 1024 vectors on three groups of layers: coarse(resolution 4 ∼ 32), medium(resolution 64 ∼ 128) and fine(resolution 128 ∼ )
Revised: Since the earlier layers of StyleGAN mainly shows large structural changes while the deep layers are related to a small detailed changes, we apply the 1024 vectors on three groups of layers: coarse(resolution 4 ∼ 32), medium(resolution 64 ∼ 128) and fine(resolution 128 ∼ )

Original: (Karras et al., 2020a), which amounts to total of 1776 unsupervised directions.
Revised: (Karras et al., 2020a), which amounts to total of 1776 unsupervised directions.

Original: Since the text-guided manipulation directions are found in StyleSpace S , we map the 1776 directions into StyleSpace S, where the maximum value of the style channel parameter in each direction is 15.
Revised: Since the text-guided manipulation directions are found in StyleSpace S , we map the 1776 directions into StyleSpace S, where the maximum value of the style channel parameter in each direction is 15.

Original: The unsupervised directions are dense vectors, where the elements are non-zeros affecting every channel in StyleSpace.
Revised: The unsupervised directions are dense vectors, where the elements are non-zeros affecting every channel in StyleSpace.

Original: Dense manipulation vectors are prone to modify multiple regions of images, causing an image to lose the original identity.
Revised: Dense manipulation vectors are prone to modify multiple regions of images, causing an image to lose the original identity.

Original: Sparsifying the known manipulation vectors α into α ( k ) where k = 10 , 30 , 50 boosts the disentangled property of the learned dictionary.
Revised: Sparsifying the known manipulation vectors α into α ( k ) where k = 10 , 30 , 50 boosts the disentangled property of the learned dictionary.

Original: We train the dictionary from zero matrix with 30000 epochs.
Revised: We train the dictionary from zero matrix with 30000 epochs.

Original: The hyper-parameter λ is set as 0.01, and the learning rate is 3.0 with Adadelta (Zeiler, 2012), an optimization method with adaptive learning rate.
Revised: The hyper-parameter λ is set as 0.01, and the learning rate is 3.0 with Adadelta (Zeiler, 2012), an optimization method with adaptive learning rate.

Original: F C OMPARISON WITH O THER S O TA METHODS
Revised: F C OMPARISON WITH O THER S O TA METHODS

Original: [Table]
Revised: [Table]

Original: In Tab. 4, we provide additional results from other image manipulation methods, StyleCLIP GD ( GlobalDirection from Patashnik et al.
Revised: In Tab. 4, we provide additional results from other image manipulation methods, StyleCLIP GD ( GlobalDirection from Patashnik et al.

Original: (2021)), StyleCLIP LO (local optimization from
Revised: (2021)), StyleCLIP LO (local optimization from

Original: Patashnik et al.
Revised: Patashnik et al.

Original: and StyleMC from (Kocasari et al., 2022).
Revised: and StyleMC from (Kocasari et al., 2022).

Original: Multi2One and StyleCLIP
Revised: Multi2One and StyleCLIP

Original: GlobalDirection are two unique methods that provides instant manipulation on provided text and image without additional computation for optimization.
Revised: GlobalDirection are two unique methods that provides instant manipulation on provided text and image without additional computation for optimization.

Original: Local optimization (Patashnik et al., 2021) and StyleMC (Kocasari et al., 2022) are optimization based methods which require about 100 seconds of inference time using a single NVIDIA 2080Ti.
Revised: Local optimization (Patashnik et al., 2021) and StyleMC (Kocasari et al., 2022) are optimization based methods which require about 100 seconds of inference time using a single NVIDIA 2080Ti.

Original: Moreover, such optimization based methods do not have disentanglement property unlike Multi2One and GlobalDirection leading to significantly worse performance in source identity preservation.
Revised: Moreover, such optimization based methods do not have disentanglement property unlike Multi2One and GlobalDirection leading to significantly worse performance in source identity preservation.

Original: The text-image similarity is measured using R CLIP ( t, X edited ) from Eq.
Revised: The text-image similarity is measured using R CLIP ( t, X edited ) from Eq.

Original: (7), which measures the similarity between text t and the manipulated image.
Revised: (7), which measures the similarity between text t and the manipulated image.

Original: We used total of 57 text descriptions on human face 6 to evaluate the performance based on FFHQ-pretrained generator.
Revised: We used total of 57 text descriptions on human face 6 to evaluate the performance based on FFHQ-pretrained generator.

Original: We manipulate allchannels in StyleSpace accordingly with optimization based methods which do not prune certain channels as a remedy for entanglement.
Revised: We manipulate allchannels in StyleSpace accordingly with optimization based methods which do not prune certain channels as a remedy for entanglement.

Original: Despite being an input-agnostic manipulation method,
Revised: Despite being an input-agnostic manipulation method,

Original: Multi2One is on par with the input-dependent StyleCLIP Local Optimization method (Patashnik et al., 2021) in the CLIP similarity score, R CLIP ( t, X edited )
Revised: Multi2One is on par with the input-dependent StyleCLIP Local Optimization method (Patashnik et al., 2021) in the CLIP similarity score, R CLIP ( t, X edited )

Original: The measurement on the ability to find the unsupervised directions α (100) (only the top 100 channels from unsupervised direction α are modified) is measured using mean squared error in Eq.
Revised: The measurement on the ability to find the unsupervised directions α (100) (only the top 100 channels from unsupervised direction α are modified) is measured using mean squared error in Eq.

Original: Given an ϕ CLIP ( · ) operation which maps the manipulation effect of α (100) , it is desirable to find a direction that only modifies the 100 channels that were non-zero entries among n channels in α (100) while the other n − 100 channels are not modified.
Revised: Given an ϕ CLIP ( · ) operation which maps the manipulation effect of α (100) , it is desirable to find a direction that only modifies the 100 channels that were non-zero entries among n channels in α (100) while the other n − 100 channels are not modified.

Original: Therefore, MSE (cid:0) α , ˆ α | =0 (cid:1) measure the level of disentanglement which measures the distance between the n − 100 channels in ˆ α and α (100) .
Revised: Therefore, MSE (cid:0) α , ˆ α | =0 (cid:1) measure the level of disentanglement which measures the distance between the n − 100 channels in ˆ α and α (100) .

Original: The result in Tab.
Revised: The result in Tab.

Original: 4 shows that ours, Multi2One , scored the lowest MSE (cid:0) α , ˆ α | =0 (cid:1) proving to be the most disentangled among the four text-guided manipulation methods.
Revised: 4 shows that ours, Multi2One , scored the lowest MSE (cid:0) α , ˆ α | =0 (cid:1) proving to be the most disentangled among the four text-guided manipulation methods.

Original: G A BLATION S TUDY ON L OSS T ERM
Revised: G A BLATION S TUDY ON L OSS T ERM

Original: We report the similarity score as R CLIP ( t, X edited ) − R CLIP ( t, X ) , to show the increase in similarity value when modified using the text guidance t .
Revised: We report the similarity score as R CLIP ( t, X edited ) − R CLIP ( t, X ) , to show the increase in similarity value when modified using the text guidance t .

Original: Note that ID loss tends to increase as the image is manipulated properly, therefore it is not a robust metric for evaluating the entanglement level.
Revised: Note that ID loss tends to increase as the image is manipulated properly, therefore it is not a robust metric for evaluating the entanglement level.

Original: [Table]
Revised: [Table]

Original: In Fig.
Revised: In Fig.

Original: [Table]
Revised: [Table]

Original: we visualize the manipulation results to show the effect of the second loss term when removed by λ = 

Revised: we visualize the manipulation results to show the effect of the second loss term when removed by λ =

Original: compared to when the second loss term is included by λ = 0 .
Revised: compared to when the second loss term is included by λ = 0 .

Original: We observe that using the additional loss term does help finding novel directions which are not present in the unsupervised directions, leading to better manipulative ability.
Revised: We observe that using the additional loss term does help finding novel directions which are not present in the unsupervised directions, leading to better manipulative ability

Original: [Table]
Revised: [Table]

Original: /CjQtF3Po57vwb03YW2nogcDjnXHLvCRLOtHHdb6ewtr6xuVXcLu3s7u0flA+P2jpOFaEtEvNYdQOsKWeStgwznHYTRbEIOO0E49uZ33miSrNYPphJQn2Bh5JFjGBjpcc+t9EQX7uDcsWtunOgVeLlpAI5moPyVz+MSSqoNIRjrXuemxg/w8owwum01E81TTAZ4yHtWSqxoNrP5gtP0ZlVQhTFyj5p0Fz9PZFhofVEBDYpsBnpZW8m/uf1UhNd+RmTSWqoJIuPopQjE6PZ9ShkihLDJ5ZgopjdFZERVpgY21HJluAtn7xK2hdVr16t3dcqjZu8jiKcwCmcgweX0IA7aEILCAh4hld4c5Tz4rw7H4towclnjuEPnM8fNI+QBw==</latexit>  =<latexit sha1_base64="aAS4iTI8L+HTjo1GxmLY07Nsa8Q=">AAAB83icbVDLSgMxFL1TX7W+qi7dBIvgqsxIUTdC0Y3LCvYBnaFkMpk2NJMMSUYoQ3/DjQtF3Poz7vwb03YW2nog5HDOueTmhCln2rjut1NaW9/Y3CpvV3Z29/YPqodHHS0zRWibSC5VL8SaciZo2zDDaS9VFCchp91wfDfzu09UaSbFo5mkNEjwULCYEWys5PvcRiN849Zdb1Ct2WsOtEq8gtSgQGtQ/fIjSbKECkM41rrvuakJcqwMI5xOK36maYrJGA9p31KBE6qDfL7zFJ1ZJUKxVPYIg+bq74kcJ1pPktAmE2xGetmbif95/czE10HORJoZKsjioTjjyEg0KwBFTFFi+MQSTBSzuyIywgoTY2uq2BK85S+vks5F3busNx4ateZtUUcZTuAUzsGDK2jCPbSgDQRSeIZXeHMy58V5dz4W0ZJTzBzDHzifP4ZGkLQ=</latexit>  = 0 .
Revised: +P2jpOFaEtEvNYdQOsKWeStgwznHYTRbEIOO0E49uZ33miSrNYPphJQn2Bh5JFjGBjpcc+t9EQX7uDcsWtunOgVeLlpAI5moPyVz+MSSqoNIRjrXuemxg/w8owwum01E81TTAZ4yHtWSqxoNrP5gtP0ZlVQhTFyj5p0Fz9PZFhofVEBDYpsBnpZW8m/uf1UhNd+RmTSWqoJIuPopQjE6PZ9ShkihLDJ5ZgopjdFZERVpgY21HJluAtn7xK2hdVr16t3dcqjZu8jiKcwCmcgweX0IA7aEILCAh4hld4c5Tz4rw7H4towclnjuEPnM8fNI+QBw==</latexit>  =<latexit sha1_base64="aAS4iTI8L+HTjo1GxmLY07Nsa8Q=">AAAB83icbVDLSgMxFL1TX7W+qi7dBIvgqsxIUTdC0Y3LCvYBnaFkMpk2NJMMSUYoQ3/DjQtF3Poz7vwb03YW2nog5HDOueTmhCln2rjut1NaW9/Y3CpvV3Z29/YPqodHHS0zRWibSC5VL8SaciZo2zDDaS9VFCchp91wfDfzu09UaSbFo5mkNEjwULCYEWys5PvcRiN849Zdb1Ct2WsOtEq8gtSgQGtQ/fIjSbKECkM41rrvuakJcqwMI5xOK36maYrJGA9p31KBE6qDfL7zFJ1ZJUKxVPYIg+bq74kcJ1pPktAmE2xGetmbif95/czE10HORJoZKsjioTjjyEg0KwBFTFFi+MQSTBSzuyIywgoTY2uq2BK85S+vks5F3busNx4ateZtUUcZTuAUzsGDK2jCPbSgDQRSeIZXeHMy58V5dz4W0ZJTzBzDHzifP4ZGkLQ=</latexit>  = 0 .

Original: H A BLATION S TUDY ON THE EFFECT OF U NSUPERVISED M ETHODS
Revised: H A BLATION S TUDY ON THE EFFECT OF U NSUPERVISED M ETHODS

Original: The dictionary learning process of Multi2One employs the directions α ∈ R n from unsupervised methods (Shen & Zhou, 2021; Härkönen et al., 2020).
Revised: The dictionary learning process of Multi2One employs the directions α ∈ R n from unsupervised methods (Shen & Zhou, 2021; Härkönen et al., 2020).

Original: Therefore, we conduct an ablation study on the effect of using unsupervised directions by comparing the two cases where directions α come from supervised method (Shen et al., 2020) and unsupervised methods (Shen & Zhou, 2021;
Revised: Therefore, we conduct an ablation study on the effect of using unsupervised directions by comparing the two cases where directions α come from supervised method (Shen et al., 2020) and unsupervised methods (Shen & Zhou, 2021;

Original: Härkönen et al., 2020).
Revised: Härkönen et al., 2020).

Original: Fig.
Revised: Fig.

Original: 17 shows that using directions from supervised methods are less capable of manipulating images to have desired change.
Revised: 18 shows that using directions from supervised methods are less capable of manipulating images to have desired change.

Original: This could also be observed by quantitative measure R CLIP ( t, X edited ) in Tab. 6 since the similarity score between manipulated image and the text guidance is significantly lower using directions from supervised method compared to using unsupervised method.
Revised: This could also be observed by quantitative measure R CLIP ( t, X edited ) in Tab. 6 since the similarity score between manipulated image and the text guidance is significantly lower using directions from supervised method compared to using unsupervised method.

Original: This is due to the limited number of directions that could be found by supervised method, which amounts to only 14 using InterFaceGAN (Shen et al., 2020).
Revised: This is due to the limited number of directions that could be found by supervised method, which amounts to only 14 using InterFaceGAN (Shen et al., 2020).

Original: [Figure]
Revised: [Figure]

Original: α
Revised: α

Original: Supervised Method
Revised: Supervised Method

Original: Unsupervised Method
Revised: Unsupervised Method

Original: R CLIP ( t, X edited ) 0.
Revised: R CLIP ( t, X edited ) 0.

Original: I C OMPUTATIONAL O VERHEAD
Revised: I C OMPUTATIONAL O VERHEAD

Original: StyleCLIP GlobalDirection and Multi2One require preprocessing time to compute ϕ CLIP ( · ) operation.
Revised: StyleCLIP GlobalDirection and Multi2One require preprocessing time to compute ϕ CLIP ( · ) operation.

Original: Such operation is computed using either e i over n channels (StyleCLIP) or α for total of q directions.
Revised: Such operation is computed using either e i over n channels (StyleCLIP) or α for total of q directions.

Original: More specifically, StyleGAN-ADA generator has a fixed StyleSpace dimension consisting of n channels which varies by the resolution of output image.
Revised: More specifically, StyleGAN-ADA generator has a fixed StyleSpace dimension consisting of n channels which varies by the resolution of output image.

Original: 1024 resolution haschannels, while 512 resolution has 5952 and 256 has 5760.
Revised: 1024 resolution haschannels, while 512 resolution has 5952 and 256 has 5760.

Original: Therefore the total computational time is measured by the number of ϕ CLIP ( · ) operations calculated over n or q directions using 100 instances of source images to compute the expectation.
Revised: Therefore the total computational time is measured by the number of ϕ CLIP ( · ) operations calculated over n or q directions using 100 instances of source images to compute the expectation.

Original: In Tab.
Revised: In Tab.

Original: 7 we measure the average computation seconds per iteration using NVIDIA 2080Ti which is equal for both methods.
Revised: 7 we measure the average computation seconds per iteration using NVIDIA 2080Ti which is equal for both methods.

Original: Since one iteration means a single ϕ CLIP ( · ) operation, comparing the number of iterations shows that our method requires less computation time.
Revised: Since one iteration means a single ϕ CLIP ( · ) operation, comparing the number of iterations shows that our method requires less computation time.

Original: Moreover, our method introduces an additional dictionary learning phase which only takes about 15 minutes.
Revised: Moreover, our method introduces an additional dictionary learning phase which only takes about 15 minutes.

Original: Therefore we conclude that our method is slightly more efficient in terms of time to construct the dictionary D .
Revised: Therefore we conclude that our method is slightly more efficient in terms of time to construct the dictionary D .

Original: [Table]
Revised: [Table]

Original: J L IMITATIONS
Revised: J L IMITATIONS

Original: The flexibility and diversity of text is not fully exerted due to the limited encoding ability and the deterministic representation of CLIP (Radford et al., 2021).
Revised: The flexibility and diversity of text is not fully exerted due to the limited encoding ability and the deterministic representation of CLIP (Radford et al., 2021).

Original: For example, it is possible to observe change in pose when using the eigenvectors (vectors that correspond to large eigenvalues often shows large change in image) from unsupervised methods.
Revised: For example, it is possible to observe change in pose when using the eigenvectors (vectors that correspond to large eigenvalues often shows large change in image) from unsupervised methods.

Original: However, since CLIP is known to have limited ability in terms of understanding the relative position, it is impossible to modify an image using text guidance such as ‘move right’ and ‘turn left’.
Revised: However, since CLIP is known to have limited ability in terms of understanding the relative position, it is impossible to modify an image using text guidance such as ‘move right’ and ‘turn left’.

Original: Moreover, we observe that CLIP encoder fails to represent some of the text instance such as ’Smiling eyes’ (Fig. 7) while it is shown in Fig. 1(a) that change in eyes happens using text ’Smile’.
Revised: Moreover, we observe that CLIP encoder fails to represent some of the text instance such as ’Smiling eyes’ (Fig. 7) while it is shown in Fig. 1(a) that change in eyes happens using text ’Smile’.

Original: Since it is proven that the editing direction of ’smiling eyes’ could be discovered when provided with appropriate text, we conjecture that the CLIP encoder fails to represent some text input faithfully leading to unsuccessful manipulation results.
Revised: Since it is proven that the editing direction of ’smiling eyes’ could be discovered when provided with appropriate text, we conjecture that the CLIP encoder fails to represent some text input faithfully leading to unsuccessful manipulation results.