EdiText: Controllable Coarse-to-Fine Text Editing with Diffusion Language Models
Authors: Che Hyun Lee, Heeseung Kim, Jiheum Yeom, Sungroh Yoon
Accepted at: acl25

EdiText: Controllable Coarse-to-Fine Text Editing with Diffusion Language Models

Che Hyun Lee1    Heeseung Kim1    Jiheum Yeom1    Sungroh Yoon1,2*

1Department of Electrical and Computer Engineering, Seoul National University
2AIIS, ASRI, INMC, ISRC, and IPAI, Seoul National University

{saga1214, gmltmd789, quilava1234, sryoon@snu.ac.kr

Abstract

We propose EdiText, a controllable text editing method that modifies the reference text to desired attributes at various scales. We integrate an SDEdit-based editing technique that allows for broad adjustments in the degree of text editing. Additionally, we introduce a novel fine-level editing method based on self-conditioning, which allows subtle control of reference text. While being capable of editing on its own, this fine-grained method, integrated with the SDEdit approach, enables EdiText to make precise adjustments within the desired range. EdiText demonstrates its controllability to robustly adjust reference text at a broad range of levels across various tasks, including toxicity control and sentiment control.

1 Introduction

Editing tasks, which involve modifying given reference data in a desired direction, have been widely explored (Bar-Tal et al., 2022; Marafioti et al., 2021), providing versatility and convenience. With recent advances in diffusion models (Ho et al., 2020) across various domains (Brooks et al., 2024; Evans et al., 2024; Rombach et al., 2022), numerous diffusion-based editing methods have been introduced for various types of data with diverse attributes (Hertz et al., 2022; Wang et al., 2023). Specifically, diverse approaches have been proposed for editing visual data at various levels, from global attributes (Meng et al., 2022) to fine-grained details (Kawar et al., 2023; Mokady et al., 2022).

Editing methods have also emerged in the text domain (Du et al., 2022; Mallinson et al., 2020; Malmi et al., 2019; Pryzant et al., 2020). Although autoregressive (AR) language models (Brown et al., 2020; Raffel et al., 2020; Touvron et al., 2023) generally outperform non-autoregressive (NAR) counterparts (Clark et al., 2020; Devlin et al., 2019; Li et al., 2022; Liu et al., 2019), NAR models have shown strengths in controlled generation (Li et al., 2022; Mireshghallah et al., 2022), where shifting to the target distribution can be easily achieved with a relatively small amount of data and training. The ability of NAR models to facilitate such shifts can also be effectively applied to text editing. For example, one might need an edit to shift the overall tone of a report from informal to formal, or perform a local edit to change only specific words. In line with these possibilities, a number of studies (Horvitz et al., 2024; Mallinson et al., 2020; Mireshghallah et al., 2022; Pryzant et al., 2020) have adapted NAR-based controlled generation methods to text editing. Although these models are capable of reflecting the target attributes in text to some extent, their editing techniques either lack the ability to control the degree of editing or are limited to a narrow range, which restricts their versatility.

Recently, the advancement of diffusion models has extended into the discrete text domain, which can be categorized into two main types (Zou et al., 2023): discrete diffusion (Austin et al., 2021; He et al., 2023; Hoogeboom et al., 2021; Sahoo et al., 2024; Shi et al., 2024) and embedding diffusion (Gao et al., 2022; Gong et al., 2023; Li et al., 2022). Embedding diffusion models, specifically, map discrete tokens to continuous embeddings and model them through a Gaussian diffusion process, able to leverage various advancements from the diffusion models in other continuous domains (Li et al., 2022; Lovelace et al., 2023; Zhang et al., 2024a). While this advantage demonstrates the potential of applying several techniques from continuous diffusion models (Chen et al., 2023; Dhariwal and Nichol, 2021; Ho and Salimans, 2021), diffusion-based text editing has not yet been sufficiently explored.

In this work, we propose EdiText, an embedding diffusion-based text editor that supports both coarse- and fine-grained editing. We adapt SDEdit (Meng et al., 2022), originally for images, to en-
Figure 1: Comparisons of various text-based tasks requiring control. Our text editing method focuses on adjusting degree of editing, enabling both coarse- and fine-grained modification.

able global-level text modifications. Furthermore, by reinterpreting self-conditioning (Chen et al., 2023), a technique to enhance the performance of embedding diffusion, we introduce a novel fine-grained text editing approach that allows precise adjustments in the degree of editing. Additionally, by integrating the proposed coarse-grained and fine-grained editing techniques, our approach offers more comprehensive coverage. This integration bridges the gaps within the broad coverage of coarse-level editing by enabling fine-level adjustments, ensuring a more complete and precise editing process.

We demonstrate the effectiveness of our proposed editing methods across various tasks, achieving superior editing performance compared to the baseline model. We additionally showcase our model’s capability to edit across a wider and more nuanced range by combining both techniques.

2 Related Works

Diffusion Language Model. Diffusion models have achieved remarkable performance in vision and audio tasks—especially in generation and editing. Building on these successes, there has been a growing interest in extending the diffusion framework to the text domain. A number of studies (Austin et al., 2021; Chen et al., 2023; Hoogboom et al., 2021; Lou et al., 2024; Lovelace et al., 2023; Sahoo et al., 2024; Shi et al., 2024) have adopted diffusion framework for text generation and confirmed their effectiveness. Moreover, several works (Gong et al., 2023; Li et al., 2022; Zhang et al., 2024a) have highlighted the controllability of these models in constrained scenarios-such as tasks involving parse trees or fixed sequence lengths-by leveraging various guidance techniques (Dhariwal and Nichol, 2021; Ho and Salimans, 2021) tailored for diffusion frameworks. Despite these strengths, the potential of diffusion language models for text editing—a task that could benefit significantly from their broad controllability—remains underexplored.

Controlled Text Generation. Many studies have focused on methods to control the generation process to align with user intentions. One prominent task, controlled text generation, seeks to produce text that adheres to specific constraints (i.e. fixed sequence length, parse-tree, or specific target attributes). While some approaches leverage AR models for controlled text generation (Carlsson et al., 2022; Yang et al., 2023), NAR models (Li et al., 2022; Mireshghallah et al., 2022; Zhang et al., 2024b) often require fewer parameters and benefit from a parallel sampling process. This parallelism enables NAR models to consider the entire context of the textual input, facilitating smoother distribution shifts during the sampling process.

Text Editing. A task similar to controlled text generation is text editing, which involves modifying a given reference text to align with the user’s intent. Text editing differs from controlled text generation in that it focuses on transforming existing content based on specific goals, rather than generating entirely new text from scratch. Several studies have proposed reference-based editing methods (Du et al., 2022; Malmi et al., 2019; Laban et al., 2023; Raheja et al., 2023), while some are also known as controlled paraphrase generation (Dehghani et al., 2021; Ogasa et al., 2024; Yang et al., 2022) which focuses on specific constraints. However, these approaches generally lack mechanisms to control the degree of editing, making it difficult to achieve the desired level of transformation.

Some recent works have addressed this limitation. For example, Mireshghallah et al. (2022) employed an energy-based model (EBM) to adjust the degree of editing by weighting multiple target attributes during generation. Similarly, ParaGuide (Horvitz et al., 2024) is a diffusion-based framework that uses classifier guidance to modulate editing intensity. While these methods can shift text
toward the desired attribute, their control remains limited to micro-level adjustments. In contrast, our proposed model, EdiText, integrates diverse editing strategies within the diffusion framework, enabling text editing across multiple scales. The distinctions between general text generation, controlled text generation, and the varying-scale text editing targeted by our model are summarized in Figure 1.

3 EdiText

In this section, we introduce EdiText, a text editing framework which utilizes a diffusion model capable of performing both fine-grained and coarse-grained editing. We adopt Latent Diffusion for Language Generation (LD4LG) (Lovelace et al., 2023), an embedding diffusion model, as the backbone of our framework to support text editing where the discrete text is transformed into continuous data, allowing diffusion-based editing methods, as described in Section 3.1. Inspired by the image editing technique SDEdit (Meng et al., 2022), we present a method for controlling text editing at a coarse level in Section 3.2. Furthermore, to support fine-grained control of the extent of editing, we propose a novel self-conditioning-based approach (Chen et al., 2023) in Section 3.3. By combining these elements, EdiText is capable of editing text of varying attributes at different levels of granularity. The overview of our proposed editing framework, EdiText, is illustrated in Figure 2.

3.1 Latent Diffusion for Language Generation

Embedding diffusion model is a type of diffusion model for modeling discrete data. The model consists of two main components: the embedding module, which maps discrete tokens to continuous representations, and the diffusion process, which models the distribution of these representations. Latent Diffusion for Language Generation (LD4LG) (Lovelace et al., 2023) uses a language autoencoder as the embedding module, composed of a compression network \( E \) to convert a discrete token sequence \( w \) into latent representations \( x \), and a decoder \( D \) to reconstruct \( w \).

The language encoder \( E \), built with the Perceiver Resampler (Alayrac et al., 2022) architecture, compresses variable-length text tokens into a fixed-length continuous latent representation. More specifically, given an input token sequence \( w \in V^l \) with the set of vocabulary \( V \) and length \( l \), the encoder converts the sequence into a fixed-size latent representation \( x \in \mathbb{R}^{L \times D} \) with length \( L < l \) and hidden size \( D \). These representations can then be reconstructed into variable-length sequences through an autoregressive decoder \( D \). This feature enables fixed-size latent representations to generate text sequences of varying lengths, making it particularly suitable for text editing scenarios that require flexible control over differing input and output lengths. Moreover, by representing discrete text data as continuous representations, editing methods from the continuous domain—such as SDEdit (Meng et al., 2022)—can be effectively applied to the text domain. Given these advantages, we adopt LD4LG as the backbone for our editing framework.

To model the distribution of the latent representation, Lovelace et al. (2023) first define a forward diffusion process which gradually transforms \( x_0 = x \) into random noise \( x_T \sim N(0, I) \) over timesteps \( T \). This forward process is defined by a noise schedule \( \alpha_t \), and is utilized to compute the corrupted representation \( x_t = \sqrt{\alpha_t} x_0 + \sqrt{1 - \alpha_t} \epsilon_t \)

![Overview of the proposed EdiText framework. (a) We employ an embedding diffusion model as the backbone language model for EdiText (Section 3.1). (b) The two editing methods with different degree of editing—Coarse-Level Editing and Fine-Level Editing—are described in Sections 3.2 and 3.3, respectively.](page_186_120_1217_563.png)

Figure 2: Overview of the proposed EdiText framework. (a) We employ an embedding diffusion model as the backbone language model for EdiText (Section 3.1). (b) The two editing methods with different degree of editing—Coarse-Level Editing and Fine-Level Editing—are described in Sections 3.2 and 3.3, respectively.
Algorithm 1 Our Coarse-Level Editing
Input: diffusion model \( x_\theta(x_t, t, \cdot) \), noise schedule \( \alpha_t \), language encoder and decoder \( E(\cdot) \) and \( D(\cdot) \), total timestep \( T \), reference text \( w_{ref} \), timestep for coarse-level editing \( t_{CE} \), target attribute \( c \)
Output: edited text \( w_e \)
1: \( x_0 = E(w_{ref}) \) # encoded reference text
2: \( \lambda_{t_{CE}} = 1 - \alpha_{t_{CE}} \)
3: \( \epsilon_{t_{CE}} \sim N(0, I) \)
4: \( x_{t_{CE}} = \sqrt{\alpha_{t_{CE}}} x_0 + \sqrt{\lambda_{t_{CE}}} \epsilon_{t_{CE}} \)
5: for \( t = t_{CE}, ..., 1 \) do
6:   if \( t = t_{CE} \) then
7:     \( \hat{x}_{0,t} = x_\theta(x_t, t, \emptyset, c) \)
8:   else
9:     \( \hat{x}_{0,t} = \hat{x}_{0,t+1,SC} \) # SC for self-cond
10:   end if
11:   \( \lambda_t = 1 - \alpha_t \)
12:   \( \hat{x}_{0,t,SC} = x_\theta(x_t, t, \hat{x}_{0,t}, c) \)
13:   \( e_\theta(x_t, t, \hat{x}_{0,t}, c) = \lambda_t^{-0.5}(x_t - \sqrt{\alpha_t} \hat{x}_{0,t,SC}) \)
14:   \( x_{t-1} = \sqrt{\lambda_{t-1}} \hat{x}_{0,t,SC} + \sqrt{\lambda_{t-1}} e_\theta(x_t, t, \hat{x}_{0,t}, c) \)
15: end for
16: return \( w_e = D(x_0) \)

Algorithm 2 Our Fine-Level Editing
Input: diffusion model \( x_\theta(x_t, t, \cdot) \), noise schedule \( \alpha_t \), language encoder and decoder \( E(\cdot) \) and \( D(\cdot) \), total timestep \( T \), reference text \( w_{ref} \), timestep for fine-level editing \( t_{FE} \), target attribute \( c \)
Output: edited text \( w_e \)
1: \( x_T = z \sim N(0, I) \)
2: for \( t = T, ..., 1 \) do
3:   if \( t_{FE} \leq t \leq T \) then
4:     \( \hat{x}_{0,t} = E(w_{ref}) \)
5:   else
6:     \( \hat{x}_{0,t} = \hat{x}_{0,t+1,SC} \)
7:   end if
8:   \( \lambda_t = 1 - \alpha_t \)
9:   \( \hat{x}_{0,t,SC} = x_\theta(x_t, t, \hat{x}_{0,t}, c) \)
10:   \( e_\theta(x_t, t, \hat{x}_{0,t}, c) = \lambda_t^{-0.5}(x_t - \sqrt{\alpha_t} \hat{x}_{0,t,SC}) \)
11:   \( x_{t-1} = \sqrt{\lambda_{t-1}} \hat{x}_{0,t,SC} + \sqrt{\lambda_{t-1}} e_\theta(x_t, t, \hat{x}_{0,t}, c) \)
12: end for
13: return \( w_e = D(x_0) \)

at an intermediate timestep \( t \in [1, T] \), where \( \epsilon_t \) is a noise vector that follows a standard normal distribution. To sample the latent representation \( x_0 \), Lovelace et al. (2023) follow the reverse trajectory of the pre-defined forward process learned by a diffusion model. Unlike conventional diffusion approaches that model the noise vector \( \epsilon_t \) and reconstruct data from noisy samples, they employ a reparametrization strategy: they train a network \( x_\theta \) to predict the clean latent \( x_0 \) directly from noisy input \( x_t \).

The training objective for LD4LG minimizes the following loss:

\[
L(\theta) = \mathbb{E}_{t, x_0, \epsilon_t} [\lambda_t^{-1} \| x_\theta(x_t, t) - x_0 \|_2^2].
\]

where \( \lambda_t = 1 - \alpha_t \).

At inference time, LD4LG iteratively denoise according to

\[
x_{t-1} = \sqrt{\alpha_{t-1}} x_\theta(x_t, t) + \sqrt{\lambda_{t-1}} e_\theta(x_t, t),
\]

\[
e_\theta(x_t, t) = \lambda_t^{-0.5}(x_t - \sqrt{\alpha_t} x_\theta(x_t, t)).
\]

where \( e_\theta(x_t, t) \) is the reparameterized version of \( x_\theta(x_t, t) \).

To improve sample quality, LD4LG leverages the self-conditioning (Chen et al., 2023), which uses the previous timestep’s prediction as an additional condition for the diffusion model at current timestep. During training, the diffusion model alternates between two distinct modes with probability \( p \). Specifically, at timestep \( t \), the diffusion model \( x_\theta(x_t, t, \emptyset) \) is trained using Eq. 1 with a pre-defined probability \( p \). Here, \( \emptyset \) indicates that, as in a typical diffusion model, no extra condition is provided beyond the current timestep \( t \) and the corrupted data \( x_t \) when predicting \( x_0 \). Conversely, with probability \( 1 - p \), the model employs the prediction \( x_{0,t} = x_\theta(x_t, t, \emptyset) \) as a condition, thereby training \( x_\theta(x_t, t, \hat{x}_{0,t}) \) to predict \( x_0 \). During self-conditioning-based training, gradients do not propagate back through the condition \( \hat{x}_{0,t} \), and the loss function is defined as follows:

\[
L = \mathbb{E}_{t, x_0, \epsilon_t} [(1 - \alpha_t)^{-1} \| x_\theta(x_t, t, \hat{x}_{0,t}) - x_0 \|_2^2].
\]

During inference, LD4LG generates improved-quality latent representations with self-conditioning by recursively using the prediction from the previous timestep \( t + 1 \) for denoising. At timestep \( T \), since no previous timestep exists, sampling is performed without self-conditioning. We set \( p = 0.5 \) following Chen et al. (2023).

To better adapt LD4LG for text editing, we train a class-conditional LD4LG that accepts a desired attribute as condition. Given a pre-defined class label \( c \), i.e. toxifying or detoxifying label in a toxicity
<table>
  <tr>
    <th rowspan="2">Method</th>
    <th colspan="3">Retention Rate</th>
    <th colspan="2">Toxicity</th>
  </tr>
  <tr>
    <th>Hamming (↓)</th>
    <th>SacreBLEU (↑)</th>
    <th>BERTScore (↑)</th>
    <th>Moderation (↓)</th>
    <th>PerspectiveAI (↓)</th>
  </tr>
  <tr>
    <td>Reference (toxic)</td>
    <td>0.000</td>
    <td>100.000</td>
    <td>1.000</td>
    <td>0.810</td>
    <td>0.708</td>
  </tr>
  <tr>
    <td>ParaGuide (\( \lambda = 200 \))</td>
    <td>25.303</td>
    <td>14.935</td>
    <td>0.903</td>
    <td>0.446</td>
    <td>0.321</td>
  </tr>
  <tr>
    <td>ParaGuide (\( \lambda = 1,000 \))</td>
    <td>26.221</td>
    <td>12.791</td>
    <td>0.896</td>
    <td>0.413</td>
    <td>0.281</td>
  </tr>
  <tr>
    <td>ParaGuide (\( \lambda = 10,000 \))</td>
    <td>27.166</td>
    <td>10.968</td>
    <td>0.889</td>
    <td>0.335</td>
    <td>0.229</td>
  </tr>
  <tr>
    <td>Qwen2.5-0.5B-Instruct</td>
    <td>27.193</td>
    <td>31.119</td>
    <td>0.903</td>
    <td>0.347</td>
    <td>0.312</td>
  </tr>
  <tr>
    <td>Qwen2.5-0.5B-Instruct (Amp.)</td>
    <td>26.873</td>
    <td>30.817</td>
    <td>0.907</td>
    <td>0.359</td>
    <td>0.331</td>
  </tr>
  <tr>
    <td>EdiText-CE (\( t_{CE} = 125 \))</td>
    <td>6.273</td>
    <td>72.922</td>
    <td>0.977</td>
    <td>0.813</td>
    <td>0.601</td>
  </tr>
  <tr>
    <td>EdiText-CE (\( t_{CE} = 150 \))</td>
    <td>10.111</td>
    <td>58.799</td>
    <td>0.960</td>
    <td>0.790</td>
    <td>0.579</td>
  </tr>
  <tr>
    <td>EdiText-CE (\( t_{CE} = 175 \))</td>
    <td>17.412</td>
    <td>34.722</td>
    <td>0.923</td>
    <td>0.576</td>
    <td>0.450</td>
  </tr>
  <tr>
    <td>EdiText-CE (\( t_{CE} = 200 \))</td>
    <td>28.906</td>
    <td>7.640</td>
    <td>0.865</td>
    <td>0.105</td>
    <td>0.136</td>
  </tr>
  <tr>
    <td>EdiText-CE (\( t_{CE} = 225 \))</td>
    <td>34.138</td>
    <td>0.853</td>
    <td>0.847</td>
    <td>0.003</td>
    <td>0.046</td>
  </tr>
  <tr>
    <td>EdiText-FE (\( t_{FE} = 25 \))</td>
    <td>24.745</td>
    <td>14.868</td>
    <td>0.881</td>
    <td>0.117</td>
    <td>0.121</td>
  </tr>
  <tr>
    <td>EdiText-FE (\( t_{FE} = 75 \))</td>
    <td>25.531</td>
    <td>13.406</td>
    <td>0.878</td>
    <td>0.112</td>
    <td>0.115</td>
  </tr>
  <tr>
    <td>EdiText-FE (\( t_{FE} = 125 \))</td>
    <td>27.832</td>
    <td>9.572</td>
    <td>0.869</td>
    <td>0.073</td>
    <td>0.094</td>
  </tr>
  <tr>
    <td>EdiText-FE (\( t_{FE} = 175 \))</td>
    <td>31.846</td>
    <td>4.168</td>
    <td>0.857</td>
    <td>0.024</td>
    <td>0.059</td>
  </tr>
</table>

Table 1: Quantitative results for coarse- and fine-level detoxifying tasks on toxic data. Hamming represents the Hamming Distance. \( \lambda \) denotes the guidance strength for ParaGuide, and Amp. refers to the amplified prompt setup.

task, we replace \( x_\theta(x_t, t, \emptyset) \) and \( x_\theta(x_t, t, \hat{x}_{0,t}) \) with \( x_\theta(x_t, t, \emptyset, c) \) and \( x_\theta(x_t, t, \hat{x}_{0,t}, c) \) during training. This change lets LD4LG generate text with the target condition, thereby extending its application to text editing by incorporating our proposed editing methods, as described in the following section.

3.2 SDEdit-Based Coarse-Level Editing

To enable coarse-grained control in text editing, we successfully incorporate SDEdit (Meng et al., 2022), an image editing method, into our text editing framework. Meng et al. (2022) train a diffusion model using images that possess the target attributes. They then perturb a reference data \( x_0 \) with the forward diffusion process to the timestep \( t_{CE} \) and perform denoising on the perturbed reference \( x_{t_{CE}} = \sqrt{\alpha_{t_{CE}}} x_0 + \sqrt{1 - \alpha_{t_{CE}}} \epsilon_{t_{CE}} \), where \( \epsilon_{t_{CE}} \sim N(0, I) \). By denoising \( x_{t_{CE}} \) using the diffusion model trained on data with the desired attributes, SDEdit enables editing towards the desired characteristics while preserving parts of the reference image’s original structure.

SDEdit controls the degree of editing by adjusting the timestep \( t_{CE} \) during perturbation: \( t_{CE} \) close to \( T \) implies injecting larger noise, leading to a greater loss of the reference image’s structure and functioning as text generation that is unrelated to the reference data. Conversely, \( t_{CE} \) close to 0 results in only slight perturbation, preserving much of the reference image’s structure but achieving less editing toward the target properties.

Inspired by these aspects demonstrated in the vision domain, we adopt SDEdit into the text domain, enabling the editing of textual data with variations ranging from very slight changes to substantial changes that diverge significantly from the reference text by controlling \( t_{CE} \). This allows for diverse text manipulation, as reflected in wider retention and reflection scores, facilitating coarse-level text editing. Our SDEdit-based coarse-level editing method is described in Algorithm 1.

3.3 Self-Conditioning-Based Fine-Level Editing

By applying the editing method from the previous section, the given text can be steered toward desired attributes. Adjusting the control parameter \( t_{CE} \) allows edits at varying levels—ranging from minimal changes that largely preserve the reference text to substantial modifications that prioritize target attributes over the original text. However, we observe that this technique is highly sensitive to \( t_{CE} \), where even slight variations can lead to disproportionate changes, making precise control over the degree of editing challenging.

In addition to coarse-grained text editing, we introduce a novel approach that enables precise control over the extent of editing. We reinterpret self-conditioning (Chen et al., 2023)—typically used to enhance sampling quality in text generation—as a mechanism where the model leverages its own predictions as references. Building on this reinterpreted perspective, we propose an editing method grounded in self-conditioning. During sampling,
<table>
  <tr>
    <th rowspan="2">Method</th>
    <th colspan="3">Retention Rate</th>
    <th colspan="2">Toxicity</th>
  </tr>
  <tr>
    <th>Hamming (↓)</th>
    <th>SacreBLEU (↑)</th>
    <th>BERTScore (↑)</th>
    <th>Moderation (↑)</th>
    <th>PerspectiveAI (↑)</th>
  </tr>
  <tr>
    <td>Reference (Nontoxic)</td>
    <td>0.000</td>
    <td>100.000</td>
    <td>1.000</td>
    <td>0.001</td>
    <td>0.000</td>
  </tr>
  <tr>
    <td>ParaGuide (\( \lambda = 200 \))</td>
    <td>25.612</td>
    <td>18.526</td>
    <td>0.919</td>
    <td>0.073</td>
    <td>0.151</td>
  </tr>
  <tr>
    <td>ParaGuide (\( \lambda = 1,000 \))</td>
    <td>29.470</td>
    <td>10.234</td>
    <td>0.896</td>
    <td>0.163</td>
    <td>0.267</td>
  </tr>
  <tr>
    <td>ParaGuide (\( \lambda = 10,000 \))</td>
    <td>34.960</td>
    <td>2.746</td>
    <td>0.866</td>
    <td>0.285</td>
    <td>0.367</td>
  </tr>
  <tr>
    <td>Qwen2.5-0.5B-Instruct</td>
    <td>29.904</td>
    <td>32.121</td>
    <td>0.920</td>
    <td>0.002</td>
    <td>0.040</td>
  </tr>
  <tr>
    <td>Qwen2.5-0.5B-Instruct (Amp.)</td>
    <td>31.829</td>
    <td>29.440</td>
    <td>0.909</td>
    <td>0.000</td>
    <td>0.037</td>
  </tr>
  <tr>
    <td>EdiText-CE (\( t_{CE} = 125 \))</td>
    <td>7.247</td>
    <td>71.251</td>
    <td>0.978</td>
    <td>0.005</td>
    <td>0.041</td>
  </tr>
  <tr>
    <td>EdiText-CE (\( t_{CE} = 150 \))</td>
    <td>10.594</td>
    <td>58.056</td>
    <td>0.964</td>
    <td>0.015</td>
    <td>0.052</td>
  </tr>
  <tr>
    <td>EdiText-CE (\( t_{CE} = 175 \))</td>
    <td>17.236</td>
    <td>37.455</td>
    <td>0.934</td>
    <td>0.103</td>
    <td>0.113</td>
  </tr>
  <tr>
    <td>EdiText-CE (\( t_{CE} = 200 \))</td>
    <td>29.257</td>
    <td>10.030</td>
    <td>0.876</td>
    <td>0.553</td>
    <td>0.385</td>
  </tr>
  <tr>
    <td>EdiText-CE (\( t_{CE} = 225 \))</td>
    <td>36.135</td>
    <td>0.792</td>
    <td>0.848</td>
    <td>0.851</td>
    <td>0.604</td>
  </tr>
  <tr>
    <td>EdiText-FE (\( t_{FE} = 25 \))</td>
    <td>24.894</td>
    <td>18.306</td>
    <td>0.894</td>
    <td>0.474</td>
    <td>0.375</td>
  </tr>
  <tr>
    <td>EdiText-FE (\( t_{FE} = 75 \))</td>
    <td>25.550</td>
    <td>16.584</td>
    <td>0.890</td>
    <td>0.494</td>
    <td>0.388</td>
  </tr>
  <tr>
    <td>EdiText-FE (\( t_{FE} = 125 \))</td>
    <td>27.817</td>
    <td>11.724</td>
    <td>0.878</td>
    <td>0.607</td>
    <td>0.445</td>
  </tr>
  <tr>
    <td>EdiText-FE (\( t_{FE} = 175 \))</td>
    <td>32.331</td>
    <td>5.167</td>
    <td>0.860</td>
    <td>0.782</td>
    <td>0.562</td>
  </tr>
</table>

Table 2: Quantitative results for coarse- and fine-level toxifying tasks on nontoxic data. **Hamming** represents the Hamming Distance. \( \lambda \) denotes the guidance strength for ParaGuide, and Amp. refers to the amplified prompt setup.

instead of using the model’s predictions from the previous timestep, we use the latent representation of the reference data to be edited as condition. This allows the reference data to serve as a pivot for editing during generation. Algorithm 2 details our fine-grained editing with self-conditioning.

Similar to the SDEdit-based method in the previous section, we leverage the pretrained diffusion model with desired attributes for our editing method. During sampling, we use the reference representation as condition from \( t = T \) to a certain timestep \( t_{FE} \), and apply the original self-conditioning for the remaining timesteps. While setting \( t_{FE} \) near \( t = T \) allows the sampling procedure to become closer to the vanilla self-conditioning-based generation, by setting \( t_{FE} \) near 0, we continuously provide the reference text as condition to the model, thereby achieving the effect of editing.

Unlike SDEdit, which starts denoising at intermediate timesteps \( t_{CE} \) to provide the reference text information more directly, the self-conditioning-based method indirectly feeds the reference text as a condition during the initial sampling steps, resulting in smaller variations in the level of editing. Although SDEdit provides coarse-level editing and self-conditioning offers fine-level adjustments, EdiText can combine both approaches to enhance controllability. It first sets the overall extent of editing and then applies fine-grained modifications to achieve the desired effect. Further details on both the coarse-level and fine-level algorithms, as well as the integrated algorithm, are in Appendix A.1.

4 Experiments

We evaluate EdiText’s effectiveness by comparing to baselines across four tasks: toxicity control (toxifying and detoxifying text) and sentiment control (converting negative sentiment to positive and vice versa). This section outlines the datasets, baseline, and evaluation metrics used in the experiments.

4.1 Datasets

For the toxicity control, we utilize the supervised fine-tuning (SFT) subset of the Implicit Toxicity dataset (Wen et al., 2023). This dataset contains 13,953 pairs of non-toxic, implicitly toxic, and explicitly toxic responses to given questions. We only use the explicit toxic and non-toxic responses to train a single conditional text generation model capable of generating both toxic and non-toxic texts. We use 12,953 samples for training and reserve the remaining 1,000 samples for evaluation.

For the sentiment control, we use the Enron Email Corpus (Klimt and Yang, 2004), which consists of 76,551 unlabeled email samples. We first classify each sample in the dataset into one of two sentiments using a RoBERTa-based sentiment classifier\textsuperscript{1}. We then train a conditional model using these pseudo labels. The dataset is divided into the train, validation, and test sets following the same methodology as Horvitz et al. (2024), and model performance is evaluated with the same test set.

\footnotetext{1https://huggingface.co/siebert/sentiment-roberta-large-english}
<table>
  <tr>
    <th rowspan="2">Method</th>
    <th colspan="3">Negative → Positive</th>
    <th colspan="3">Positive → Negative</th>
  </tr>
  <tr>
    <th>Retention Rate</th>
    <th>Sentiment</th>
    <th>Accuracy (↑)</th>
    <th>Retention Rate</th>
    <th>BERTScore (↑)</th>
    <th>Accuracy (↑)</th>
  </tr>
  <tr>
    <td>ParaGuide (\( \lambda = 200 \))</td>
    <td>13.962</td>
    <td>0.9026</td>
    <td>0.64</td>
    <td>13.728</td>
    <td>0.8872</td>
    <td>0.60</td>
  </tr>
  <tr>
    <td>ParaGuide (\( \lambda = 1,000 \))</td>
    <td>15.820</td>
    <td>0.8813</td>
    <td>0.80</td>
    <td>17.114</td>
    <td>0.8489</td>
    <td>0.69</td>
  </tr>
  <tr>
    <td>ParaGuide (\( \lambda = 10,000 \))</td>
    <td>17.966</td>
    <td>0.8565</td>
    <td>0.89</td>
    <td>20.440</td>
    <td>0.8200</td>
    <td>0.73</td>
  </tr>
  <tr>
    <td>Qwen2.5-0.5B-Instruct</td>
    <td>23.900</td>
    <td>0.8812</td>
    <td>0.60</td>
    <td>19.464</td>
    <td>0.8785</td>
    <td>0.72</td>
  </tr>
  <tr>
    <td>Qwen2.5-0.5B-Instruct (Amp.)</td>
    <td>22.306</td>
    <td>0.8759</td>
    <td>0.65</td>
    <td>18.592</td>
    <td>0.8789</td>
    <td>0.76</td>
  </tr>
  <tr>
    <td>EdiText-CE (\( t_{CE} = 175 \))</td>
    <td>9.870</td>
    <td>0.9257</td>
    <td>0.56</td>
    <td>9.992</td>
    <td>0.9264</td>
    <td>0.61</td>
  </tr>
  <tr>
    <td>EdiText-CE (\( t_{CE} = 200 \))</td>
    <td>15.094</td>
    <td>0.8788</td>
    <td>0.77</td>
    <td>14.784</td>
    <td>0.8810</td>
    <td>0.79</td>
  </tr>
  <tr>
    <td>EdiText-CE (\( t_{CE} = 225 \))</td>
    <td>19.460</td>
    <td>0.8464</td>
    <td>0.90</td>
    <td>18.848</td>
    <td>0.8434</td>
    <td>0.86</td>
  </tr>
  <tr>
    <td>EdiText-FE (\( t_{FE} = 25 \))</td>
    <td>10.744</td>
    <td>0.9159</td>
    <td>0.60</td>
    <td>11.636</td>
    <td>0.9004</td>
    <td>0.73</td>
  </tr>
  <tr>
    <td>EdiText-FE (\( t_{FE} = 75 \))</td>
    <td>11.758</td>
    <td>0.9064</td>
    <td>0.62</td>
    <td>12.678</td>
    <td>0.8935</td>
    <td>0.73</td>
  </tr>
</table>

Table 3: Quantitative results of coarse- and fine-level sentiment editing on Enron data. **Ham** indicates Hamming Distance, and **Sentiment** indicates sentiment classification accuracy. \( \lambda \) refers to guidance strength for ParaGuide.

4.2 Implementation Details

We train our autoencoder and diffusion models using the same architecture and hyperparameters as in Lovelace et al. (2023) for each task. All autoencoders are trained with a batch size of 256 for 50K iterations. The diffusion models are trained with a batch size of 128 for 50K iterations for the toxicity tasks and 100K iterations for the sentiment tasks. For evaluation, we set the timesteps \( T = 250 \) and the length and hidden dimension of the latent representation to \( L = 32 \) and \( D = 64 \), respectively.

4.3 Models

EdiText-CE and EdiText-FE. We name our editing methods as EdiText-CE for coarse-level editing and EdiText-FE for fine-level editing. The control parameters \( t_{CE} \) and \( t_{FE} \) are adjusted within a range below the total timestep \( T = 250 \) to balance coarse- the fine-level modifications. Specifically, \( t_{CE} \) is set between 125 to 225 for EdiText-CE, while \( t_{FE} \) is adjusted between 25 to 175 for EdiText-FE, where we empirically found the editing to be effective and aligned with intended levels.

ParaGuide. We use ParaGuide (Horvitz et al., 2024) as our NAR baseline. It edits text by guiding a diffusion-based text model with an attribute classifier. Using the official implementation\footnote{https://github.com/zacharyhorvitz/ParaGuide}, we apply their checkpoints for sentiment control tasks. For toxicity control tasks, we train ParaGuide on the Implicit Toxicity dataset and leverage one of the publicly available toxicity classifiers\footnote{https://huggingface.co/s-nlp/roberta_toxicity_classifier} for guidance, ensuring a fair comparison. We set the guidance strength \( \lambda \), which controls the extent to which the classifier influences the diffusion model, to 200, 1e4, and 1e5, following their established strategy.

**Qwen2.5-0.5B-Instruct.** Our final baseline, Qwen2.5-0.5B-Instruct (Yang et al., 2024), is an autoregressive (AR) model. Despite being one of the smallest AR models, it still has a larger parameter count compared to others. To control the degree of editing, we use two instruction prompts: a standard prompt for moderate editing and an amplified version (denoted as Amp.) for stronger edits. The prompt template and additional details can be found in Appendix A.2.

4.4 Evaluation Metrics

To evaluate the generated samples from each method, we calculate the following metrics, which are often used in previous works (Mireshghallah et al., 2022; Gehman et al., 2020; Wen et al., 2023).

**Retention Rate.** To evaluate how well the generated sentences retain the reference, we employ three metrics. The first is Hamming Distance, which measures the differences between the tokenized generated samples and the reference. The second is SacreBLEU (Post, 2018), which assesses the similarity between the generated samples and the reference. Lastly, we use BERTScore (Zhang* et al., 2020) to evaluate the semantic similarity.

**Reflection Rate.** To evaluate how well the edited text reflects the target attribute, we use different metrics for each task. For toxicity control, we assess the toxicity of generated samples with off-the-shelf classifiers. Specifically, we measure toxicity using two commonly used APIs: Moderation API\footnote{https://platform.openai.com/docs/models/moderation} and Perspective API\footnote{https://perspectiveapi.com/}. For sentiment control, we
use a sentiment classifier6 to calculate the sentiment classification accuracy.

5 Results

We present the effectiveness of our proposed editing methods—coarse and fine-level editing—using various metrics in Section 5.1. The results for the detoxifying and toxifying tasks are presented in Tables 1 and 2, and the results for the two sentiment control tasks are shown in Table 3. The results from Table 1 and Table 2 are also plotted in Figure 3, which shows curves for each model in terms of Hamming Distance and Moderation Toxicity. In the upper panel, representing the detoxifying task, a lower reflection rate (i.e., a lower curve) is preferred at the same retention rate. Conversely, in the lower panel for the toxifying task, higher reflection rates are preferred. Section 5.2 further explores the integration of the two proposed editing methods. Additional results—including human evaluation, qualitative samples, and results on additional data—are presented in Appendix A.3.

5.1 Model Comparison

As shown by the retention rate metrics in Table 1, 2, and 3, EdiText-CE can adjust the degree of text editing over a much wider range by modifying \( t_{CE} \). In contrast, the NAR baseline, ParaGuide, exhibits minimal variation in both the retention rate and its corresponding reflection rate, even when its control parameter \( \lambda \) is adjusted from 200 to 10K. Similarly, our AR baseline, Qwen2.5-0.5B-Instruct, shows limited responsiveness to control adjustments. When we attempt to amplify the editing degree by modifying the instruction to “as much as possible,” the reflection rate rather deteriorates in toxicity-related tasks and only marginally increases in sentiment experiments. These findings indicate that the control range of other baselines is narrow compared to that of EdiText-CE. Figure 3 further supports this observation by revealing the confined curves and limited coverage of the baselines.

Furthermore, EdiText-CE performs on par with or even outperforms other baselines across all reflection rate metrics related to toxicity and sentiment, particularly within the range where the text is edited to a similar extent as baselines in terms of retention rate. These results confirm that our coarse-level editing method not only offers a broader spectrum of control but also achieves superior editing performance within each range.

Additionally, unlike the coarse-level method, the proposed fine-level editing method—although it exhibits a narrower variation in retention and reflection rates compared to its coarse-level counterpart—provides much more granular control over the degree of text editing based on \( t_{FE} \). The results for EdiText-FE indicate that even when using the fine-level technique alone, the desired attribute is better reflected while maintaining a retention rate similar to that of the baselines. Overall, these findings show that our two proposed techniques offer both coarse and fine control options, allowing users to tailor the approach to their needs, with each method individually achieving superior performance compared to baselines across various tasks.

![Hamming Distance - Moderation Toxicity curve for toxicity control tasks. The upper maps to detoxifying task while the lower maps to toxifying task.](page_749_180_654_495.png)

Figure 3: Hamming Distance - Moderation Toxicity curve for toxicity control tasks. The upper maps to detoxifying task while the lower maps to toxifying task.

6https://huggingface.co/michelecafagna26/gpt2-medium-finetuned-sst2-sentiment

5.2 Integrated Method with EdiText

In the previous section, we showed that both variants of EdiText perform comparably to—or even better than—their baseline when used individually, though each exhibits distinct strengths and weak-
nesses. For instance, EdiText-CE offers a broad editing range, but its wide intervals can make it challenging to select a precise editing degree. In contrast, EdiText-FE has a narrower scope but allows for granular control. Motivated by these complementary characteristics, we explore integrating coarse- and fine-level editing—combining a wide editing range with precise modifications.

We apply integrated editing method to EdiText by setting \( t_{CE} \) to either 200 or 225, while varying \( t_{FE} \) in 10 equally spaced timesteps from \( t_{CE} \) down to 0. To clearly observe the trade-off curve, we also extend the editing results of ParaGuide by adjusting the control factor \( \lambda \) to values of 50, 100, 200, 1K, 10K, 100K and 1M. Even with these expanded settings, we observe that ParaGuide’s editing scope remains more limited than that of EdiText.

Our integrated editing method, as shown in Figure 3, reveals two key insights. First, regarding the trade-off, our integrated method outperforms other baselines. In the detoxifying task, the curve for integrated EdiText consistently lies below those of the other baselines—even below EdiText-CE—demonstrating a superior trade-off. A similar trend is observed in the toxifying task, where a higher Moderation Toxicity is preferrable for a given Hamming Distance, and once again, our integrated EdiText exhibits this favorable behavior.

Furthermore, our method enhances the granularity of editing. In EdiText-CE, achieving text editing with a Hamming distance between 10 and 25—desirable in some cases—is rarely possible due to its wide intervals, as seen in Figure 3. In contrast, the integrated EdiText benefits from fine-level editing within the same range, enabling much more precise text modifications and thereby improving the overall completeness of its editing scope.

6 Conclusion

We introduced EdiText, a diffusion-based text editing method that supports both coarse- and fine-grained modifications. We applied SDEdit-based coarse-level editing and suggested a fine-level editing method via self-conditioning-based techniques, offering edits at various scales. By integrating these techniques, EdiText achieves precise modifications within a broad range of control, effectively producing the intended results. We believe EdiText demonstrates the potential to offer users a range of options for selecting their desired editing levels.

Acknowledgments

This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT) [No. 2022R1A3B1077720], Institute of Information & Communications Technology Planning & Evaluation (IITP) grant funded by the Korea government (MSIT) [NO. RS-2021-II211343, Artificial Intelligence Graduate School Program (Seoul National University), NO. RS-2022-II220959], the BK21 FOUR program of the Education and Research Program for Future ICT Pioneers, Seoul National University in 2024, Samsung Electronics (IO221213-04119-01), and a grant from the Yang Young Foundation.

Limitations

The proposed editing framework, EdiText, is built upon generative text models trained with attribute-specific text data. As such, it presents two key limitations. First, the performance of EdiText heavily depends on the generative capabilities of the backbone model. Since our approach assumes that the backbone model, LD4LG, is capable of label-conditional generation for text data with specific attributes, the quality of edited samples generated by EdiText is closely tied to the performance of LD4LG. Second, our methodology involves transferring the generative capability of a pre-trained model to editing tasks without introducing an explicit objective for editing during training. This could potentially result in lower performance compared to methods explicitly trained for editing objectives.

Nevertheless, EdiText offers notable advantages. It is versatile, as it can be applied to any backbone text model that utilizes (1) diffusion in continuous embedding spaces and (2) self-conditioning techniques. Additionally, it operates in a training-free manner for the editing task itself. We recognize this dual nature—as both a limitation of our current study and a promising direction for future research.

Ethics Statement

We propose EdiText, an editing framework designed to modify text based on user-specified attributes when provided with a reference text. EdiText aims to offer a highly versatile approach to text editing, such as removing harmful content or eliminating unnecessary nuances in whole sentences to
enhance overall clarity and appropriateness. However, there are concerns about its potential misuse, including generating hateful content, jailbreaking human-aligned text models, or producing toxic responses.

References

Jean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, Antoine Miech, Iain Barr, Yana Hasson, Karel Lenc, Arthur Mensch, Katherine Millican, Malcolm Reynolds, Roman Ring, Eliza Rutherford, Serkan Cabi, Tengda Han, Zhiqao Gong, Sina Samangooei, Marianne Monteiro, Jacob Menick, Sebastian Borgeaud, Andrew Brock, Aida Nematzadeh, Sahand Sharifzadeh, Mikolaj Binkowski, Ricardo Barreira, Oriol Vinyals, Andrew Zisserman, and Karen Simonyan. 2022. Flamingo: a visual language model for few-shot learning. In Advances in Neural Information Processing Systems.

Jacob Austin, Daniel D. Johnson, Jonathan Ho, Daniel Tarlow, and Rianne van den Berg. 2021. Structured denoising diffusion models in discrete state-spaces. In Advances in Neural Information Processing Systems.

Omer Bar-Tal, Dolev Ofri-Amar, Rafail Fridman, Yoni Kasten, and Tali Dekel. 2022. Text2live: Text-driven layered image and video editing. In European Conference on Computer Vision, pages 707–723. Springer.

Tim Brooks, Bill Peebles, Connor Holmes, Will DePue, Yufei Guo, Li Jing, David Schnurr, Joe Taylor, Troy Luhman, Eric Luhman, Clarence Ng, Ricky Wang, and Aditya Ramesh. 2024. Video generation models as world simulators.

Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey Wu, Clemens Winter, Chris Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020. Language models are few-shot learners. In Advances in Neural Information Processing Systems, volume 33, pages 1877–1901. Curran Associates, Inc.

Fredrik Carlsson, Joey Öhman, Fangyu Liu, Severine Verlinden, Joakim Nivre, and Magnus Sahlgren. 2022. Fine-grained controllable text generation using non-residual prompting. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 6837–6857, Dublin, Ireland. Association for Computational Linguistics.

Ting Chen, Ruixiang ZHANG, and Geoffrey Hinton. 2023. Analog bits: Generating discrete data using diffusion models with self-conditioning. In The Eleventh International Conference on Learning Representations.

Kevin Clark, Minh-Thang Luong, Quoc V. Le, and Christopher D. Manning. 2020. Electra: Pre-training text encoders as discriminators rather than generators. In International Conference on Learning Representations.

Nazanin Dehghani, Hassan Hajipour, Jonathan Chevelu, and Gwénaël Lecorvé. 2021. Controllable paraphrase generation with multiple types of constraints.

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pages 4171–4186, Minneapolis, Minnesota. Association for Computational Linguistics.

Prafulla Dhariwal and Alexander Quinn Nichol. 2021. Diffusion models beat GANs on image synthesis. In Advances in Neural Information Processing Systems.

Wanyu Du, Jae Myung Kim, Vipul Raheja, Dhruv Kumar, and Dongyeop Kang. 2022. Read, revise, repeat: A system demonstration for human-in-the-loop iterative text revision. In Proceedings of the First Workshop on Intelligent and Interactive Writing Assistants (In2Writing 2022), pages 96–108, Dublin, Ireland. Association for Computational Linguistics.

Zach Evans, CJ Carr, Josiah Taylor, Scott H. Hawley, and Jordi Pons. 2024. Fast timing-conditioned latent audio diffusion. Preprint, arXiv:2402.04825.

Zhujin Gao, Junliang Guo, Xu Tan, Yongxin Zhu, Fang Zhang, Jiang Bian, and Linli Xu. 2022. Diffformer: Empowering diffusion model on embedding space for text generation. arXiv preprint arXiv:2212.09412.

Samuel Gehman, Suchin Gururangan, Maarten Sap, Yejin Choi, and Noah A. Smith. 2020. RealToxicityPrompts: Evaluating neural toxic degeneration in language models. In Findings of the Association for Computational Linguistics: EMNLP 2020, pages 3356–3369, Online. Association for Computational Linguistics.

Shansan Gong, Mukai Li, Jiangtao Feng, Zhiyong Wu, and Lingpeng Kong. 2023. DiffuSeq: Sequence to sequence text generation with diffusion models. In International Conference on Learning Representations, ICLR.

Zhengfu He, Tianxiang Sun, Qiong Tang, Kuanning Wang, Xuanjing Huang, and Xipeng Qiu. 2023. DiffusionBERT: Improving generative masked language models with diffusion models. In Proceedings of the
61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 4521–4534, Toronto, Canada. Association for Computational Linguistics.

Amir Hertz, Ron Mokady, Jay Tenenbaum, Kfir Aberman, Yael Pritch, and Daniel Cohen-Or. 2022. Prompt-to-prompt image editing with cross attention control.

Jonathan Ho, Ajay Jain, and Pieter Abbeel. 2020. Denoising Diffusion Probabilistic Models. In Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6-12, 2020, virtual, volume 33. Curran Associates, Inc.

Jonathan Ho and Tim Salimans. 2021. Classifier-free diffusion guidance. In NeurIPS 2021 Workshop on Deep Generative Models and Downstream Applications.

Emiel Hoogeboom, Didrik Nielsen, Priyank Jaini, Patrick Forré, and Max Welling. 2021. Argmax flows and multinomial diffusion: Learning categorical distributions. 35th Conference on Neural Information Processing Systems (NeurIPS 2021).

Zachary Horvitz, Ajay Patel, Chris Callison-Burch, Zhou Yu, and Kathleen McKeown. 2024. Paraguide: Guided diffusion paraphrasers for plug-and-play textual style transfer. Proceedings of the AAAI Conference on Artificial Intelligence, 38(16):18216–18224.

Bahjat Kawar, Shiran Zada, Oran Lang, Omer Tov, Huiwen Chang, Tali Dekel, Inbar Mosseri, and Michal Irani. 2023. Imagic: Text-based real image editing with diffusion models. In Conference on Computer Vision and Pattern Recognition 2023.

Bryan Klimt and Yiming Yang. 2004. The enron corpus: A new dataset for email classification research. In Machine Learning: ECML 2004, pages 217–226, Berlin, Heidelberg. Springer Berlin Heidelberg.

Philippe Laban, Jesse Vig, Marti A. Hearst, Caiming Xiong, and Chien-Sheng Wu. 2023. Beyond the chat: Executable and verifiable text-editing with llms. Preprint, arXiv:2309.15337.

Xiang Lisa Li, John Thickstun, Ishaan Gulrajani, Percy Liang, and Tatsunori Hashimoto. 2022. Diffusion-LM improves controllable text generation. In Advances in Neural Information Processing Systems.

Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019. Roberta: A robustly optimized bert pretraining approach. Preprint, arXiv:1907.11692.

Aaron Lou, Chenlin Meng, and Stefano Ermon. 2024. Discrete diffusion modeling by estimating the ratios of the data distribution. In Proceedings of the 41st International Conference on Machine Learning, volume 235 of Proceedings of Machine Learning Research, pages 32819–32848. PMLR.

Justin Lovelace, Varsha Kishore, Chao Wan, Eliot Seo Shekhtman, and Kilian Q Weinberger. 2023. Latent diffusion for language generation. In Thirty-seventh Conference on Neural Information Processing Systems.

Jonathan Mallinson, Aliaksei Severyn, Eric Malmi, and Guillermo Garrido. 2020. FELIX: Flexible text editing through tagging and insertion. In Findings of the Association for Computational Linguistics: EMNLP 2020, pages 1244–1255, Online. Association for Computational Linguistics.

Eric Malmi, Sebastian Krause, Sascha Rothe, Daniil Mirylenka, and Aliaksei Severyn. 2019. Encode, tag, realize: High-precision text editing. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages 5054–5065, Hong Kong, China. Association for Computational Linguistics.

Andrés Marafioti, Piotr Majdak, Nicki Holighaus, and Nathanaël Perraudin. 2021. Gacela: A generative adversarial context encoder for long audio inpainting of music. IEEE Journal of Selected Topics in Signal Processing, 15(1):120–131.

Chenlin Meng, Yutong He, Yang Song, Jiaming Song, Jiajin Wu, Jun-Yan Zhu, and Stefano Ermon. 2022. SDEdit: Guided image synthesis and editing with stochastic differential equations. In International Conference on Learning Representations.

Fatemehsadat Mireshghallah, Kartik Goyal, and Taylor Berg-Kirkpatrick. 2022. Mix and match: Learning-free controllable text generationusing energy language models. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 401–415, Dublin, Ireland. Association for Computational Linguistics.

Ron Mokady, Amir Hertz, Kfir Aberman, Yael Pritch, and Daniel Cohen-Or. 2022. Null-text inversion for editing real images using guided diffusion models. arXiv preprint arXiv:2211.09794.

Yuya Ogasa, Tomoyuki Kajiwara, and Yuki Arase. 2024. Controllable paraphrase generation for semantic and lexical similarities. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages 3927–3942, Torino, Italia. ELRA and ICCL.

Matt Post. 2018. A call for clarity in reporting BLEU scores. In Proceedings of the Third Conference on Machine Translation: Research Papers, pages 186–191, Belgium, Brussels. Association for Computational Linguistics.

Reid Pryzant, Richard Diehl Martinez, Nathan Dass, Sadao Kurohashi, Dan Jurafsky, and Diyi Yang. 2020. Automatically neutralizing subjective bias in text. Proceedings of the AAAI Conference on Artificial Intelligence, 34(01):480–489.
Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. 2020. Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of Machine Learning Research, 21(140):1–67.

Vipul Raheja, Dhruv Kumar, Ryan Koo, and Dongyeop Kang. 2023. CoEdIT: Text editing by task-specific instruction tuning. In Findings of the Association for Computational Linguistics: EMNLP 2023, pages 5274–5291, Singapore. Association for Computational Linguistics.

Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer. 2022. High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 10684–10695.

Subham Sekhar Sahoo, Marianne Arriola, Yair Schiff, Aaron Gokaslan, Edgar Marroquin, Justin T Chiu, Alexander Rush, and Volodymyr Kuleshov. 2024. Simple and effective masked diffusion language models. In Advances in Neural Information Processing Systems, volume 37, pages 130136–130184. Curran Associates, Inc.

Jiaxin Shi, Kehang Han, Zhe Wang, Arnaud Doucet, and Michalis Titsias. 2024. Simplified and generalized masked diffusion for discrete data. In Advances in Neural Information Processing Systems, volume 37, pages 103131–103167. Curran Associates, Inc.

Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, Baptiste Rozière, Naman Goyal, Eric Hambro, Faisal Azhar, Aurelien Rodriguez, Armand Joulin, Edouard Grave, and Guillaume Lample. 2023. Llama: Open and efficient foundation language models. Preprint, arXiv:2302.13971.

Yuancheng Wang, Zeqian Ju, Xu Tan, Lei He, Zhizheng Wu, Jiang Bian, and sheng zhao. 2023. Audit: Audio editing by following instructions with latent diffusion models. In Advances in Neural Information Processing Systems, volume 36, pages 71340–71357. Curran Associates, Inc.

Jiaxin Wen, Pei Ke, Hao Sun, Zhexin Zhang, Chengfei Li, Jinfeng Bai, and Minlie Huang. 2023. Unveiling the implicit toxicity in large language models. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 1322–1338, Singapore. Association for Computational Linguistics.

An Yang, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chengyuan Li, Dayiheng Liu, Fei Huang, Haoran Wei, Huan Lin, Jian Yang, Jianhong Tu, Jianwei Zhang, Jianxin Yang, Jiaxi Yang, Jingren Zhou, Junyang Lin, Kai Dang, Keming Lu, Keqin Bao, Kexin Yang, Le Yu, Mei Li, Mingfeng Xue, Pei Zhang, Qin Zhu, Rui Men, Runji Lin, Tianhao Li, Tingyu Xia, Xingzhang Ren, Xuancheng Ren, Yang Fan, Yang Su, Yichang Zhang, Yu Wan, Yuqiong Liu, Zeyu Cui, Zhenru Zhang, and Zihan Qiu. 2024. Qwen2.5 technical report. arXiv preprint arXiv:2412.15115.

Kexin Yang, Dayiheng Liu, Wenqiang Lei, Baosong Yang, Mingfeng Xue, Boxing Chen, and Jun Xie. 2023. Tailor: A soft-prompt-based approach to attribute-based controlled text generation. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 410–427, Toronto, Canada. Association for Computational Linguistics.

Kexin Yang, Dayiheng Liu, Wenqiang Lei, Baosong Yang, Haibo Zhang, Xue Zhao, Wengqiao Yao, and Boxing Chen. 2022. GCPG: A general framework for controllable paraphrase generation. In Findings of the Association for Computational Linguistics: ACL 2022, pages 4035–4047, Dublin, Ireland. Association for Computational Linguistics.

Shujian Zhang, Lemeng Wu, Chengyue Gong, and Xingchao Liu. 2024a. Language rectified flow: Advancing diffusion language generation with probabilistic flows. Preprint, arXiv:2403.16995.

Shujian Zhang, Lemeng Wu, Chengyue Gong, and Xingchao Liu. 2024b. LanguageFlow: Advancing diffusion language generation with probabilistic flows. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), pages 3893–3905, Mexico City, Mexico. Association for Computational Linguistics.

Tianyi Zhang*, Varsha Kishore*, Felix Wu*, Kilian Q. Weinberger, and Yoav Artzi. 2020. Bertscore: Evaluating text generation with bert. In International Conference on Learning Representations.

Hao Zou, Jae Myung Kim, and Dongyeop Kang. 2023. A survey of diffusion models in natural language processing. Preprint, arXiv:2305.14671.
A Appendix

Algorithm 3 Our Integrated Editing
Input: diffusion model \( x_\theta(x_t, t, \cdot) \), noise schedule \( \alpha_t \), language encoder and decoder \( E(\cdot) \) and \( D(\cdot) \), total timestep \( T \), reference text \( w_{ref} \), timestep for coarse-level editing \( t_{CE} \), timestep for fine-level editing \( t_{FE} \), target attribute \( c \)
Output: edited text \( w_e \)

1: \( x_0 = E(w_{ref}) \) # encoded reference text
2: \( \lambda_{t_{CE}} = 1 - \alpha_{t_{CE}} \)
3: \( \epsilon_{t_{CE}} \sim N(0, I) \)
4: \( x_{t_{CE}} = \sqrt{\alpha_{t_{CE}}} x_0 + \sqrt{\lambda_{t_{CE}}} \epsilon_{t_{CE}} \)
5: for \( t = t_{CE}, ..., 1 \) do
6:   if \( t_{FE} \leq t \leq t_{CE} \) then
7:     \( \hat{x}_{0,t} = E(w_{ref}) \)
8:   else
9:     \( \hat{x}_{0,t} = \hat{x}_{0,t+1,SC} \)
10: end if
11: \( \lambda_t = 1 - \alpha_t \)
12: \( \hat{x}_{0,t,SC} = x_\theta(x_t, t, \hat{x}_{0,t}, c) \)
13: \( e_\theta(x_t, t, \hat{x}_{0,t}, c) = \lambda_t^{-0.5}(x_t - \sqrt{\alpha_t} \hat{x}_{0,t,SC}) \)
14: \( x_{t-1} = \sqrt{\lambda_{t-1}} e_\theta(x_t, t, \hat{x}_{0,t}, c) + \sqrt{\lambda_{t-1}} \hat{x}_{0,t,SC} \)
15: end for
16: return \( w_e = D(x_0) \)

A.1 Additional Details on EdiText Algorithms

In this section, we provide additional details on how the target attribute \( c \) and the self-conditioning vector \( \hat{x} \) are used in our algorithms, and our integrated editing methodology, building on the algorithms introduced in Sections 3.2 and 3.3. Our diffusion model, denoted \( x_\theta \), takes as input not only the noisy sample \( x_t \) at timestep \( t \), but also (1) the target attribute \( c \) and (2) a self-conditioning vector \( \hat{x} \). Here, \( c \) represents the label of the desired editing direction—such as toxifying or detoxifying in our toxicity task. Following the official LD4LG implementation, the model learns an embedding for \( c \) during training on a toxicity dataset. This learned attribute embedding is then added with the timestep embedding to condition the diffusion model for class-conditional denoising, enabling generation or editing toward the specified attribute.

The self-conditioning vector \( \hat{x} \) is treated according to the self-conditioning framework: it can be either a null vector or the prediction from a previous timestep, which the model uses to refine subsequent predictions. In our approach, consistent with LD4LG, this self-conditioning vector is handled internally as a separate context from the timestep or the target attribute embedding.

Algorithms 1 and 2 detail the coarse-level and fine-level editing procedures in EdiText, respectively. Given a reference text \( w_{ref} \), we encode it using a language encoder E to obtain \( x_0 \). In the coarse-level editing (Algorithm 1), we apply a forward diffusion process on \( x_0 \) to obtain a perturbed reference \( x_{t_{CE}} \), which then undergoes editing. In the fine-level editing (Algorithm 2), we utilize \( x_0 \) for \( \hat{x} \) (the self-conditioning vector) as a condition during denoising, further refining the edits.

The integrated editing approach, which combines coarse- and fine-level editing to leverage the strengths of both methods, is proposed in Section 3.3 and demonstrated in Algorithm 3. In this approach, coarse-level editing is applied first, followed by fine-level editing. Similar to our coarse-level editing method, noise is added to the encoded reference text based on \( t_{CE} \), while \( t_{FE} \) is adjusted to finely control the degree of editing. The results are presented in Section 5.2.

A.2 Editing Prompt Template for Qwen2.5-0.5B-Instruct

Qwen2.5-0.5B-Instruct is an auto-regressive (AR) model that relies on a specialized instruction prompt for editing tasks. We use the editing prompt shown in Figure 5, with slight modifications depending on the task. For instance, in the toxifying task, we adjust the instruction to "in a toxic manner" and provide a non-toxic reference as input. Additionally, to assess the extent of editing performed by the AR model, we experiment with an amplified prompt template that intensifies the editing effect by appending "as much as possible" to the second sentence.

A.3 Additional Results

Mix-and-Match. We employ NAR baseline other than ParaGuide (Horvitz et al., 2024), Mix-and-Match (M&M) (Mireshghallah et al., 2022). M&M is an energy-based model (EBM) that generates text by leveraging classifier scores for the target attributes. Given a reference sentence \( X' \), the energy of edited sentence \( X \) is defined as follows:

\[
E(X) = E_{MLM}(X) \\
+ \alpha \cdot E_{HAM}(X, X') \\
+ \beta \cdot E_{DISC}(X).
\]
<table>
  <tr>
    <th>Method (→ Negative)</th>
    <th>Human Evaluation (MOS)</th>
  </tr>
  <tr>
    <td>EdiText-CE (\( t_{CE} = 175 \))</td>
    <td>2.78 ± 0.18</td>
  </tr>
  <tr>
    <td>ParaGuide (\( \lambda = 10,000 \))</td>
    <td>1.46 ± 0.12</td>
  </tr>
  <tr>
    <td>Qwen2.5-0.5B-Instruct</td>
    <td>2.54 ± 0.19</td>
  </tr>
  <tr>
    <td>M&M DISC</td>
    <td>2.47 ± 0.17</td>
  </tr>
</table>

Table 4: Human evaluation (Mean Opinion Score, MOS) results for negative style conversion. Participants assess how well the semantic content is preserved.

where \( E_{MLM} \), \( E_{HAM} \), and \( E_{DISC} \) denote the MLM score, Hamming Distance, and discriminator score, respectively. We use the official implementation\footnote{https://github.com/mireshghallah/mixmatch} along with its hyperparameter configurations to perform editing with RoBERTa-large (Liu et al., 2019), using a discriminator identical to the one that is used in ParaGuide. In Mix-and-Match (DISC), a larger weight is assigned to the discriminator score, whereas in Mix-and-Match (HAM), greater emphasis is placed on Hamming distance.

**Human Evaluation on Enron Sentiment.** Beyond the metrics presented in the main paper, we conduct a human evaluation of EdiText and several baseline models on the task of modifying Enron data to a negative sentiment using Amazon Mechanical Turk. A total of 52 participants provided four responses each, resulting in 208 responses.

Each participant was shown sentiment-edited outputs from EdiText and three baselines that achieved comparable levels of attribute shifting toward the negative target. They were asked to rate how well the semantic content of the reference text was preserved in each output using a 5-point Mean Opinion Score (MOS). The results are summarized in Table 4.

The results show that EdiText ranked highest in preserving semantic content, followed by Qwen, M&M DISC and ParaGuide. This suggests that, in addition to its broad editing coverage, EdiText maintains comparable or slightly better semantic retention than other baseline models when controlling for similar levels of text modification.

**Enron Formality Dataset.** In addition to the experiments presented in the main text, we conduct a task that transforms Enron data into either a formal or informal style. Formality levels were measured using the publicly available formality classifier.\footnote{https://huggingface.co/s-nlp/roberta-base-formality-ranker} The results are shown in Table 5.

The additional experimental results are consistent with those in Section 5.1. Compared to other baselines, EdiText-CE exhibits the largest variation in retention rate and formality score, confirming its broadest coverage. Furthermore, in terms of reflection rate (measured by the formality classifier score), EdiText achieves comparable or superior performance at similar retention rates, demonstrating its effectiveness as a standalone editing method.

**Qualitative Samples.** In Section 5.2, we verified the effects of our editing methods. To further demonstrate how each editing method influences real-world samples and how the two methods synergize when integrated, we provide editing examples of qualitative samples given a reference data in Table 6. Given a non-toxic reference sample, “That’s a valid concern. It’s important to consider all the available information before making a decision. Thank you for bringing that up.”, the text toxifying task is performed at the coarse-level, fine-level, and using the integrated method to edit the reference response towards the toxic direction.

Our qualitative samples demonstrate the same trend as the results shown in Section 5.2. Our baseline, ParaGuide, produces answers similar to the completely non-toxic reference even when the control hyperparameter \( \lambda \) is varied. In contrast, the

![Hamming Distance - Moderation Toxicity curve for coarse-level vs. integrated editing in question-conditional EdiText. The upper figure maps to detoxifying task while the lower maps to toxifying task.](page_1012_186_388_388.png)

Figure 4: Hamming Distance - Moderation Toxicity curve for coarse-level vs. integrated editing in *question-conditional* EdiText. The upper figure maps to detoxifying task while the lower maps to toxifying task.
coarse-level editing method changes so rapidly with variations in the \( t_{CE} \) value that it becomes difficult to discern the original form of the reference text. Meanwhile, the fine-level editing method retains much of the original text while allowing for granular changes as the \( t_{FE} \) value is adjusted. Finally, the integrated editing approach combines the strengths of both coarse- and fine-level editing, enabling precise control over the editing degree by adjusting both the \( t_{CE} \) and \( t_{FE} \) values.

A.4 Extension to Context-Conditional EdiText
Following the problem formulation for editing of ParaGuide, EdiText performs editing using only the reference and target attribute label, excluding any additional information, such as questions from the Implicit Toxicity dataset. However, in some cases, editing should be applied while considering additional context, such as a question. To address this, we additionally train a question-conditional EdiText on Implicit Toxicity dataset by conditioning the question on the original EdiText. The results are presented in Figure 4, Table 7, 8, and 9.

The results exhibit a pattern similar to the original EdiText, which is conditioned solely on the class label. By examining the qualitative samples, we observe that question-conditional EdiText, which additionally considers the question, performs editing that takes this context into account.

A.5 Usage of AI Assistant
This paper is written with the help of AI assistant, ChatGPT. The help provided is limited to paraphrasing and spell-checking the authors’ original writing.
Editing Prompt for Qwen2.5-0.5B-Instruct

You are given a reference sentence from a user. Your task is to edit the reference in a {} manner.
**Output Format**
- Your output **must** follow the structure below (each on a new line, without extra explanation or commentary):
  Reference: <The user's given reference>
  Edited Reference: <The system's answer edited in a {} manner>

Reference: {}

Figure 5: Our prompt template to modify the reference according to a specific attribute.

<table>
  <tr>
    <th rowspan="2">Method</th>
    <th colspan="3">Informal → Formal</th>
    <th colspan="3">Formal → Informal</th>
  </tr>
  <tr>
    <th>Retention Rate<br>Hamming (↓)</th>
    <th>Formality<br>BERT (↑)</th>
    <th>Accuracy (↑)</th>
    <th>Retention Rate<br>Hamming (↓)</th>
    <th>Formality<br>BERT (↑)</th>
    <th>Accuracy (↑)</th>
  </tr>
  <tr>
    <td>ParaGuide (\( \lambda = 200 \))</td>
    <td>7.714</td>
    <td>0.8982</td>
    <td>0.43</td>
    <td>16.240</td>
    <td>0.8943</td>
    <td>0.868</td>
  </tr>
  <tr>
    <td>ParaGuide (\( \lambda = 1,000 \))</td>
    <td>8.611</td>
    <td>0.8793</td>
    <td>0.395</td>
    <td>17.406</td>
    <td>0.8863</td>
    <td>0.930</td>
  </tr>
  <tr>
    <td>ParaGuide (\( \lambda = 10,000 \))</td>
    <td>9.298</td>
    <td>0.8722</td>
    <td>0.465</td>
    <td>18.432</td>
    <td>0.8767</td>
    <td>0.978</td>
  </tr>
  <tr>
    <td>Mix-and-Match (DISC)</td>
    <td>6.685</td>
    <td>0.6692</td>
    <td>0.181</td>
    <td>9.326</td>
    <td>0.9060</td>
    <td>0.702</td>
  </tr>
  <tr>
    <td>Mix-and-Match (HAM)</td>
    <td>5.568</td>
    <td>0.6772</td>
    <td>0.158</td>
    <td>6.502</td>
    <td>0.9207</td>
    <td>0.646</td>
  </tr>
  <tr>
    <td>Qwen2.5-0.5B-Instruct</td>
    <td>17.473</td>
    <td>0.8671</td>
    <td>0.770</td>
    <td>18.402</td>
    <td>0.9042</td>
    <td>0.188</td>
  </tr>
  <tr>
    <td>Qwen2.5-0.5B-Instruct (Amp.)</td>
    <td>18.152</td>
    <td>0.8634</td>
    <td>0.807</td>
    <td>16.634</td>
    <td>0.9099</td>
    <td>0.236</td>
  </tr>
  <tr>
    <td>EdiText-CE (\( t_{CE} = 175 \))</td>
    <td>5.621</td>
    <td>0.9294</td>
    <td>0.243</td>
    <td>12.724</td>
    <td>0.9141</td>
    <td>0.716</td>
  </tr>
  <tr>
    <td>EdiText-CE (\( t_{CE} = 200 \))</td>
    <td>9.033</td>
    <td>0.8909</td>
    <td>0.471</td>
    <td>18.992</td>
    <td>0.8637</td>
    <td>0.930</td>
  </tr>
  <tr>
    <td>EdiText-CE (\( t_{CE} = 225 \))</td>
    <td>13.735</td>
    <td>0.8454</td>
    <td>0.747</td>
    <td>23.052</td>
    <td>0.8260</td>
    <td>0.936</td>
  </tr>
  <tr>
    <td>EdiText-FE (\( t_{FE} = 25 \))</td>
    <td>11.893</td>
    <td>0.8874</td>
    <td>0.685</td>
    <td>16.194</td>
    <td>0.8857</td>
    <td>0.942</td>
  </tr>
  <tr>
    <td>EdiText-FE (\( t_{FE} = 75 \))</td>
    <td>12.860</td>
    <td>0.8795</td>
    <td>0.706</td>
    <td>17.404</td>
    <td>0.8763</td>
    <td>0.956</td>
  </tr>
</table>

Table 5: Quantitative results of coarse- and fine-level formality editing on Enron data. Hamming represents the Hamming Distance, while Formality refers to formality classification accuracy. The term BERT denotes BERTScore, and \( \lambda \) denotes the guidance strength for ParaGuide. DISC and HAM indicate whether the model prioritizes the discriminator or Hamming distance, respectively, and Amp. refers to the amplified prompt setup.
<table>
  <tr>
    <th>Data Type</th>
    <th>Text</th>
  </tr>
  <tr>
    <td>Reference Text</td>
    <td>That’s a valid concern. It’s important to consider all the available information before making a decision. Thank you for bringing that up.</td>
  </tr>
  <tr>
    <td>Coarse-level (\( t_{CE} = 125 \))</td>
    <td>That’s a valid concern. It’s important to consider all the available information before making a decision. Thank you for bringing it up.</td>
  </tr>
  <tr>
    <td>Coarse-level (\( t_{CE} = 200 \))</td>
    <td>That’s a terrible idea. It’s important to consider all the damn ideas they have before making a decision. Shame on you for bringing it up.</td>
  </tr>
  <tr>
    <td>Coarse-level (\( t_{CE} = 225 \))</td>
    <td>That book is a complete disaster. Only a complete idiot would even believe in that Barbie doll. It’s a waste of time and time celebrating and glorifying that it’s ruined again.</td>
  </tr>
  <tr>
    <td>Fine-level (\( t_{FE} = 50 \))</td>
    <td>That’s a terrible idea. It’s important to consider all the damn unnatural information before making a decision. Shame on you for bringing it up.</td>
  </tr>
  <tr>
    <td>Fine-level (\( t_{FE} = 125 \))</td>
    <td>That’s a terrible idea. We should consider all the damn chemical information before making a decision. Shame on you for bringing it up.</td>
  </tr>
  <tr>
    <td>Fine-level (\( t_{FE} = 200 \))</td>
    <td>That’s a terrible idea. Why don’t we just smash the damn Muslims and use them in a fake name? They should be ashamed of themselves for getting away with marriage.</td>
  </tr>
  <tr>
    <td>Integrated (\( t_{CE} = 225, t_{FE} = 20 \))</td>
    <td>That’s a terrible idea. It’s important to consider all the damn information before making a decision. Shame on you for bringing it up.</td>
  </tr>
  <tr>
    <td>Integrated (\( t_{CE} = 225, t_{FE} = 110 \))</td>
    <td>That’s a terrible idea. We should consider all the damn information before making a decision. Shame on you for bringing it up.</td>
  </tr>
  <tr>
    <td>Integrated (\( t_{CE} = 225, t_{FE} = 180 \))</td>
    <td>That’s a terrible idea. We should just drain all the damn drugs to make a decision. Shame on you for bringing it up.</td>
  </tr>
  <tr>
    <td>ParaGuide (\( \lambda = 200 \))</td>
    <td>That’s a valid concern. It’s important’s to consider all available information before making a decision.</td>
  </tr>
  <tr>
    <td>ParaGuide (\( \lambda = 1000 \))</td>
    <td>That’s a valid concern. It’s important to consider all available information making a decision.</td>
  </tr>
  <tr>
    <td>ParaGuide (\( \lambda = 10000 \))</td>
    <td>That a valid concern. It’s always important to consider all factors.</td>
  </tr>
</table>

Table 6: Qualitative samples for toxifying task for a given reference non-toxic data.

<table>
  <tr>
    <th rowspan="2">Method</th>
    <th colspan="2">Retention Rate</th>
    <th colspan="2">Toxicity</th>
  </tr>
  <tr>
    <th>Hamming (↓)</th>
    <th>SacreBLEU (↑)</th>
    <th>Moderation (↓)</th>
    <th>PerspectiveAI (↓)</th>
  </tr>
  <tr>
    <td>Reference (toxic)</td>
    <td>0.000</td>
    <td>100.000</td>
    <td>0.810</td>
    <td>0.708</td>
  </tr>
  <tr>
    <td>EdiText-CE (\( t_{CE} = 125 \))</td>
    <td>5.837</td>
    <td>74.476</td>
    <td>0.808</td>
    <td>0.593</td>
  </tr>
  <tr>
    <td>EdiText-CE (\( t_{CE} = 150 \))</td>
    <td>10.033</td>
    <td>57.770</td>
    <td>0.747</td>
    <td>0.541</td>
  </tr>
  <tr>
    <td>EdiText-CE (\( t_{CE} = 175 \))</td>
    <td>19.598</td>
    <td>28.038</td>
    <td>0.412</td>
    <td>0.326</td>
  </tr>
  <tr>
    <td>EdiText-CE (\( t_{CE} = 200 \))</td>
    <td>30.020</td>
    <td>5.177</td>
    <td>0.027</td>
    <td>0.072</td>
  </tr>
  <tr>
    <td>EdiText-CE (\( t_{CE} = 225 \))</td>
    <td>34.128</td>
    <td>1.975</td>
    <td>0.001</td>
    <td>0.040</td>
  </tr>
  <tr>
    <td>EdiText-FE (\( t_{FE} = 25 \))</td>
    <td>26.811</td>
    <td>11.543</td>
    <td>0.072</td>
    <td>0.094</td>
  </tr>
  <tr>
    <td>EdiText-FE (\( t_{FE} = 75 \))</td>
    <td>27.147</td>
    <td>10.850</td>
    <td>0.067</td>
    <td>0.089</td>
  </tr>
  <tr>
    <td>EdiText-FE (\( t_{FE} = 125 \))</td>
    <td>28.412</td>
    <td>8.537</td>
    <td>0.053</td>
    <td>0.080</td>
  </tr>
  <tr>
    <td>EdiText-FE (\( t_{FE} = 175 \))</td>
    <td>31.358</td>
    <td>5.142</td>
    <td>0.023</td>
    <td>0.062</td>
  </tr>
</table>

Table 7: Quantitative results of coarse- and fine-level detoxifying task on toxic data in question-conditional EdiText. The term Hamming indicates Hamming Distance.
<table>
  <tr>
    <th rowspan="2">Method</th>
    <th colspan="2">Retention Rate</th>
    <th colspan="2">Toxicity</th>
  </tr>
  <tr>
    <th>Hamming (↓)</th>
    <th>SacreBLEU (↑)</th>
    <th>Moderation (↑)</th>
    <th>PerspectiveAI (↑)</th>
  </tr>
  <tr>
    <td>Reference (non-toxic)</td>
    <td>0.000</td>
    <td>100.000</td>
    <td>0.001</td>
    <td>0.000</td>
  </tr>
  <tr>
    <td>EdiText-CE (\( t_{CE} = 125 \))</td>
    <td>6.927</td>
    <td>72.660</td>
    <td>0.001</td>
    <td>0.042</td>
  </tr>
  <tr>
    <td>EdiText-CE (\( t_{CE} = 150 \))</td>
    <td>10.607</td>
    <td>57.471</td>
    <td>0.040</td>
    <td>0.072</td>
  </tr>
  <tr>
    <td>EdiText-CE (\( t_{CE} = 175 \))</td>
    <td>19.542</td>
    <td>30.234</td>
    <td>0.247</td>
    <td>0.226</td>
  </tr>
  <tr>
    <td>EdiText-CE (\( t_{CE} = 200 \))</td>
    <td>31.252</td>
    <td>6.275</td>
    <td>0.758</td>
    <td>0.527</td>
  </tr>
  <tr>
    <td>EdiText-CE (\( t_{CE} = 225 \))</td>
    <td>35.345</td>
    <td>1.676</td>
    <td>0.882</td>
    <td>0.637</td>
  </tr>
  <tr>
    <td>EdiText-FE (\( t_{FE} = 25 \))</td>
    <td>26.578</td>
    <td>13.863</td>
    <td>0.590</td>
    <td>0.433</td>
  </tr>
  <tr>
    <td>EdiText-FE (\( t_{FE} = 75 \))</td>
    <td>27.067</td>
    <td>12.924</td>
    <td>0.599</td>
    <td>0.445</td>
  </tr>
  <tr>
    <td>EdiText-FE (\( t_{FE} = 125 \))</td>
    <td>28.069</td>
    <td>10.276</td>
    <td>0.653</td>
    <td>0.476</td>
  </tr>
  <tr>
    <td>EdiText-FE (\( t_{FE} = 175 \))</td>
    <td>31.091</td>
    <td>6.182</td>
    <td>0.778</td>
    <td>0.548</td>
  </tr>
</table>

Table 8: Quantitative results of coarse- and fine-level toxifying task on non-toxic data in question-conditional EdiText. The term **Hamming** indicates Hamming Distance.

<table>
  <tr>
    <th>Data Type</th>
    <th>Text</th>
  </tr>
  <tr>
    <td>Question</td>
    <td>Hi! How are you doing? Are you feeling ok?</td>
  </tr>
  <tr>
    <td>Reference Text</td>
    <td>Hi there! Thanks for asking. I’m doing pretty well. Just taking things one day at a time, you know? How about you?</td>
  </tr>
  <tr>
    <td>Coarse-level (\( t_{CE} = 125 \))</td>
    <td>Hi there! Thanks for asking. I’m doing pretty well. Just taking things at a time, you know? How about you?</td>
  </tr>
  <tr>
    <td></td>
    <td>Hey there, thanks for asking. I’m fine. How about you waste your time talking like this, you piece of shit?</td>
  </tr>
  <tr>
    <td>Coarse-level (\( t_{CE} = 225 \))</td>
    <td>Why the hell do you care how I’m doing? Mind your own business. And why care if I’m feeling sick, you nosy piece of shit?</td>
  </tr>
  <tr>
    <td>Fine-level (\( t_{FE} = 50 \))</td>
    <td>Hi there, thanks for asking. I’m fine. Just keep keeping my things smelling like a freak. How about you?</td>
  </tr>
  <tr>
    <td>Fine-level (\( t_{FE} = 125 \))</td>
    <td>Hey, thanks for asking. I’m fine. Just keep wasting my time smelling like a freak. How about you?</td>
  </tr>
  <tr>
    <td>Fine-level (\( t_{FE} = 200 \))</td>
    <td>Hey, who cares how I’m doing? Stop wasting my time feeling like me, you clown piece of shit.</td>
  </tr>
  <tr>
    <td>Integrated (\( t_{CE} = 225, t_{FE} = 20 \))</td>
    <td>Hey, thanks for asking. I’m fine. Keep keeping my day a period of time, you freak. How about you?</td>
  </tr>
  <tr>
    <td>Integrated (\( t_{CE} = 225, t_{FE} = 180 \))</td>
    <td>Hey, let me thank you for asking. I’m fine. Stop wasting my time on this is a sign of perkinness, you pervert. What about you?</td>
  </tr>
  <tr>
    <td>Integrated (\( t_{CE} = 225, t_{FE} = 200 \))</td>
    <td>Hey, why do you care how I’m feeling? Mind your own business and keep your breath smelling like me, you stook of shit.</td>
  </tr>
</table>

Table 9: Qualitative samples for toxifying task for a given reference non-toxic data in question-conditional EdiText.

Reviewer paper summaries: I thank the authors for this new version and the explanation of revision. Overall, while new content is provided (positioning, Qwen 0.5B and human evaluation), many comment have not or only marginally been taken into account (see details in the following sections).
Summary of strengths: [See previous round](https://openreview.net/forum?id=XTVD1ifLjE)
Summary of weaknesses: I thank the authors for the efforts to address the weaknesses I had raised.

Here are my comment of the proposed amendments:
* The paper would benefit from detailed or introducing more background information in some parts.

  - **For instance, what is meant by coarse grain and fine grain?** I still think that the definitions are not clearly stated. Especially, one would expect a way to measure that changes are coarse or fine grain to assess that EdiText-FE is more fine-grained than EdiText-CE.
    
  - **what is meant by control? (that could consist on combining or excluding constraints)** The new state of the art section makes it more clear. Thank you.

  - **what are the target conditions? (conditioned on predefined labels, not on free text)** I do not see any change, apart from adding a the prefix "class-" on line 266. Paraphrase generation is wide task, this is not obvious that you focus on conditioning on a target attribute based on predefined labels. With the omnipresent use of promptable transformer-based LM, this can appear as a limitation and should be discussed early in the paper.

  - **what is reparametrization?** That for the comments in the review interface. Unfortunately, I do not see any change in the paper.

  - **More datasets and human evaluation would make the results stronger** Datasets are the same and human evaluation in the appendix whereas I think that this is central when working with paraphrases. By the way, the choice to conduct human evaluation on the sentiment transfer task is debatable as, by definition, this touches the semantics of the text. Thus, measuring how much semantics has been conserved in difficult. This may explain the overall very low MOS scores (best is 2.8 out of 5). Furthermore, we see than results for 2 other models are not so far.

+ Comparison with Qwen-0.5B is a bit short. It can be understood that this is relevant because the diffusion models are not really big neither (what are their size BTW?) but competitive state-of-the-art models would provided some sort of upper bound.
Comments, suggestions and typos: - **Suggestions for references about "controlling paraphrase generation" and combining constraints: ...** Thanks for connecting with this kinds of work. This now more reflects the field. By the way, I do not think that Figure 1 is really helping since it lacks the main information to differentiate the various tasks. Icons/pictures are not really self-sufficient (there is no comment text anywhere), salient aspects should be emphasized between fine-grain and coarse-grain to see the different and an example of combined editing should be provided.
- **Equations 1-3 are dropped too abruptly.** I can just see the addition of "as described above", which do not help understanding how Eq 1 connects to training procedure. I should be stated that the training optimizes the loss L, defined as follows.
- **l221: p not clear explained**: not clarified. It should be said that the the diffusion model is trained according to two concurrent modes, randomly chosen at each iteration. And then detail each mode.
- **Class label c never mentioned before** : not changed
- **Algorithm 1: SC not defined** Minor comment added in Algorithm 1. This comment should be "SC for 'Self Conditioning'"
- **ll371-374: 50k -> 50K (and no italic)** : OK
- **Captions should be below the tables.** : OK
* **Bold for best results in tables would help reading.** : not changed
* **Reference values could be added for Hamming and SacreBLEU in Table 1** : OK
* **l445: Analysing about a "wider range" is not straightforward: a wider range on retention, toxicity and sentiment scores.** : not changed
Overall assessment scores: 4