Original: G ENERATING I NTUITIVE F AIRNESS S PECIFICATIONS FOR N ATURAL L ANGUAGE P ROCESSING
Revised: H UMAN -G UIDED F AIR C LASSIFICATION FOR N ATURAL L ANGUAGE P ROCESSING

Original: Anonymous authors
Revised: Anonymous authors

Original: Paper under double-blind review
Revised: Paper under double-blind review

Original: A BSTRACT
Revised: A BSTRACT

Original: Text classifiers have promising applications in high-stake tasks such as resume screening and content moderation.
Revised: Text classifiers have promising applications in high-stake tasks such as resume screening and content moderation.

Original: These classifiers must be fair and avoid discriminatory decisions by being invariant to perturbations of sensitive attributes such as gender or ethnicity.
Revised: These classifiers must be fair and avoid discriminatory decisions by being invariant to perturbations of sensitive attributes such as gender or ethnicity.

Original: However, there is a gap between human intuition about these perturbations and the formal similarity specifications capturing them.
Revised: However, there is a gap between human intuition about these perturbations and the formal similarity specifications capturing them.

Original: While existing research has started to address this gap, current methods are based on hardcoded word replacements, resulting in specifications with limited expressivity or ones that fail to fully align with human intuition (e.g., in cases of asymmetric counterfactuals).
Revised: While existing research has started to address this gap, current methods are based on hardcoded word replacements, resulting in specifications with limited expressivity or ones that fail to fully align with human intuition (e.g., in cases of asymmetric counterfactuals).

Original: This work proposes novel methods for bridging this gap by discovering expressive and intuitive individual fairness specifications.
Revised: This work proposes novel methods for bridging this gap by discovering expressive and intuitive individual fairness specifications.

Original: We show how to leverage unsupervised style transfer and GPT-3’s zero-shot capabilities to automatically generate expressive candidate pairs of semantically similar sentences that differ along sensitive attributes.
Revised: We show how to leverage unsupervised style transfer and GPT-3’s zero-shot capabilities to automatically generate expressive candidate pairs of semantically similar sentences that differ along sensitive attributes.

Original: We then validate the generated pairs via an extensive crowdsourcing study, which confirms that a lot of these pairs align with human intuition about fairness in the context of toxicity classification.
Revised: We then validate the generated pairs via an extensive crowdsourcing study, which confirms that a lot of these pairs align with human intuition about fairness in the context of toxicity classification.

Original: Finally, we show how limited amounts of human feedback can be leveraged to learn a similarity specification that can be used to train downstream fairness-aware models.
Revised: Finally, we show how limited amounts of human feedback can be leveraged to learn a similarity specification that can be used to train downstream fairness-aware models.

Original:  I NTRODUCTION
Revised:  I NTRODUCTION

Original: With the rise of pretrained large language models (Sun et al., 2019), text classifiers can now be employed in tasks related to automated hiring (Bhatia et al., 2019), content moderation (Rieder &
Revised: With the rise of pretrained large language models (Sun et al., 2019), text classifiers can now be employed in tasks related to automated hiring (Bhatia et al., 2019), content moderation (Rieder &

Original: Skop, 2021) and social science research (Widmer et al., 2022).
Revised: Skop, 2021) and social science research (Widmer et al., 2022).

Original: They are also part of machine learning pipelines for unsupervised style transfer (Reid & Zhong, 2021) or reducing the toxicity of language model outputs (Welbl et al., 2021).
Revised: They are also part of machine learning pipelines for unsupervised style transfer (Reid & Zhong, 2021) or reducing the toxicity of language model outputs (Welbl et al., 2021).

Original: However, text classifiers have been shown to often exhibit bias based on sensitive attributes such as gender (De-Arteaga et al., 2019) or demographics (Garg et al., 2019), even for tasks in which these dimensions should be irrelevant.
Revised: However, text classifiers have been shown to often exhibit bias based on sensitive attributes such as gender (De-Arteaga et al., 2019) or demographics (Garg et al., 2019), even for tasks in which these dimensions should be irrelevant.

Original: This can lead to unfair and discriminatory decisions, distort analyses based on these classifiers, or propagate undesirable demographic stereotypes to downstream applications.
Revised: This can lead to unfair and discriminatory decisions, distort analyses based on these classifiers, or propagate undesirable demographic stereotypes to downstream applications.

Original: The intuition that certain demographic indicators should not influence decisions can be formalized in terms of the concept of individual fairness (Dwork et al., 2012), which posits that similar inputs should be treated similarly by machine learning systems.
Revised: The intuition that certain demographic indicators should not influence decisions can be formalized in terms of the concept of individual fairness (Dwork et al., 2012), which posits that similar inputs should be treated similarly by machine learning systems.

Original: While in a classification setting similar treatment for two inputs can naturally be defined in terms of both inputs being labeled the same, the notion of input similarity should capture the intuition that certain input characteristics should not influence model decisions.
Revised: While in a classification setting similar treatment for two inputs can naturally be defined in terms of both inputs being labeled the same, the notion of input similarity should capture the intuition that certain input characteristics should not influence model decisions.

Original: Key challenge: generating valid, intuitive and diverse fairness constraints A key challenge
Revised: Key challenge: generating valid, intuitive and diverse fairness constraints A key challenge

Original: when applying the individual fairness framework is defining the similarity notion ϕ .
Revised: when applying the individual fairness framework is defining the similarity notion ϕ .

Original: Indeed, the definition is often contentious, as fairness is a subjective concept: what counts as a valid demographic indicator, as opposed to a problematic stereotype?
Revised: Indeed, the definition is often contentious, as fairness is a subjective concept: what counts as a valid demographic indicator, as opposed to a problematic stereotype?

Original: Counterfactual definitions of similarity (Kusner et al., 2017) offer a principled solution, but they shift the burden towards the underlying causal model, whose definition can often be similarly contentious.
Revised: Counterfactual definitions of similarity (Kusner et al., 2017) offer a principled solution, but they shift the burden towards the underlying causal model, whose definition can often be similarly contentious.

Original: While many other definitions have been proposed, it is widely recognized that the similarity of inputs can be highly task dependent (Dwork et al., 2012; Barocas et al.)
Revised: While many other definitions have been proposed, it is widely recognized that the similarity of inputs can be highly task dependent (Dwork et al., 2012; Barocas et al.)

Original: , e.g., two biographies that are identical except for indicators of gender may be considered similar in a professional context, but not in the context of online dating.
Revised: , e.g., two biographies that are identical except for indicators of gender may be considered similar in a professional context, but not in the context of online dating.

Original: In the context of text classification, most existing works have cast similarity in terms of word replacement (Dixon et al., 2018;
Revised: In the context of text classification, most existing works have cast similarity in terms of word replacement (Dixon et al., 2018;

Original: Garg et al., 2019; Yurochkin & Sun, 2020; Liang et al., 2020).
Revised: Garg et al., 2019; Yurochkin & Sun, 2020; Liang et al., 2020).

Original: Given
Revised: Given

Original: [Figure]
Revised: [Figure]

Original: a sentence s , a similar sentence s ′ is generated by replacing each word in s , that belongs to a list of words
Revised: a sentence s , a similar sentence s ′ is generated by replacing each word in s , that belongs to a list of words

Original: A i indicative of a demographic group i , by a word from list A
Revised: A i indicative of a demographic group i , by a word from list A

Original: i ′ , indicative of another demographic group i ′ ̸
Revised: i ′ , indicative of another demographic group i ′ ̸

Original: = i .
Revised: = i .

Original: This approach has several limitations: (i) it relies on having exhaustively curated word lists A i of sensitive terms, (ii) the expressivity and the diversity of the generated pairs are limited to word replacement only, and (iii) many terms are only indicative of demographic groups in specific contexts, hence directly replacing them with other terms will not always result in a similar pair ( s, s ′ )
Revised: This approach has several limitations: (i) it relies on having exhaustively curated word lists A i of sensitive terms, (ii) perturbations that cannot be represented by replacing single sensitive terms are not covered, and (iii) many terms are only indicative of demographic groups in specific contexts, hence directly replacing them with other terms will not always result in a similar pair ( s, s ′ )

Original: according to human intuition.
Revised: according to human intuition.

Original: Indeed, word replacement rules can often produce sentence pairs that only differ in an axis not relevant to fairness (e.g., by replacing “white house” with “black house”).
Revised: Indeed, word replacement rules can often produce sentence pairs that only differ in an axis not relevant to fairness (e.g., by replacing “white house” with “black house”).

Original: In addition, they can generate so-called asymmetric counterfactuals (Garg et al., 2019): sentence pairs ( s, s ′ )
Revised: In addition, they can generate so-called asymmetric counterfactuals (Garg et al., 2019): sentence pairs ( s, s ′ )

Original: that look similar but clearly do not warrant similar treatment.
Revised: that look similar but clearly do not warrant similar treatment.

Original: For example, in the context of toxicity classification, the text “I don’t like this movie.
Revised: For example, in the context of toxicity classification, the text “I don’t like this movie.

Original: It is so old” may not be considered toxic while “I don’t like this movie.
Revised: It is so old” may not be considered toxic while “I don’t like this movie.

Original: It is so gay” clearly is.
Revised: It is so gay” clearly is.

Original: This work: generating fairness specifications for text classification The central challenge we consider in this work is how to generate a diverse set of input pairs that aligns with human intuition about which inputs should be treated similarly in the context of a fixed text classification task.
Revised: This work: generating fairness specifications for text classification The central challenge we consider in this work is how to generate a diverse set of input pairs that aligns with human intuition about which inputs should be treated similarly in the context of a fixed text classification task.

Original: These pairs then induce fairness constraints  on a downstream classifier, as individual fairness postulates that they should be classified in the same way.
Revised: These pairs then induce fairness constraints that collectively define an implict fairness specification on a downstream classifier, as individual fairness postulates that they should be classified in the same way.

Original: We address this challenge via a three-stage pipeline, summarized in Fig.
Revised: We address this challenge via a three-stage pipeline, summarized in Fig.

Original: First, we start from a training dataset D for the text classification task under consideration and generate a set C ′ of candidate pairs ( s, s ′ ) by applying word replacement to sentences s ∈ D .
Revised: First, we start from a training dataset D for the text classification task under consideration and generate a set C ′ of candidate pairs ( s, s ′ ) by applying word replacement to sentences s ∈ D .

Original: Second, to improve diversity and expand on word replacement rules, we extend C ′ to a larger set ofsentence pairs C by borrowing unsupervised style transfer ideas.
Revised: Second, to improve diversity and expand on word replacement rules, we extend C ′ to a larger set of pairs C by borrowing unsupervised style transfer ideas.

Original: We change markers of demographic groups, e.g., “women”, “black people” or “Christians”, in sentences s ∈ D by replacing the style classifier used by modern unsupervised style transfer methods (Reid & Zhong, 2021; Lee, 2020) with a classifier trained to identify mentions of demographic groups.
Revised: We change markers of demographic groups, e.g., “women”, “black people” or “Christians”, in sentences s ∈ D by replacing the style classifier used by modern unsupervised style transfer methods (Reid & Zhong, 2021; Lee, 2020) with a classifier trained to identify mentions of demographic groups.

Original: In addition, we add pairs from GPT-3 (Brown et al., 2020), prompted to change markers of demographic groups for sentences in D in a zero-shot fashion.
Revised: In addition, we add pairs from GPT-3 (Brown et al., 2020), prompted to change markers of demographic groups for sentences in D in a zero-shot fashion.

Original: Third, to identify which of the generated pairs align with human intuition about fairness in the context of the considered classification task, we design a crowdsourcing experiment in which workers are presented with candidate pairs and indicate if the pairs should be treated similarly for the considered task or not.
Revised: Third, to identify which of the generated pairs align with human intuition about fairness in the context of the considered classification task, we design a crowdsourcing experiment in which workers are presented with candidate pairs and indicate if the pairs should be treated similarly for the considered task or not.

Original: Since obtaining human feedback is expensive, we label a small subset of the generated pool and train a BERT-based (Devlin et al., 2018)
Revised: Since obtaining human feedback is expensive, we label a small subset of the generated pool and train a BERT-based (Devlin et al., 2018)

Original: classifier ˆ φ to recognize pairs that should be treated similarly, yielding a final set of filtered pairs ˆ C ⋆ ⊆ C .
Revised: classifier ˆ φ to recognize pairs that should be treated similarly, yielding a final set of filtered pairs ˆ C ⋆ ⊆ C .

Original: To further reduce the total labeling costs, we use active learning similar to (Grießhaber et al., 2020) to decide which pairs to label.
Revised: To further reduce the total labeling costs, we use active learning similar to (Grießhaber et al., 2020) to decide which pairs to label.

Original: We also demonstrate that the final set of constraints ˆ C ⋆ can be used for training fairness-aware downstream classifiers, by adopting the Counterfactual Logit Pairing (CLP) regularizer of (Garg et al., 2019).
Revised: We also demonstrate that the final set of constraints ˆ C ⋆ can be used for training fairness-aware downstream classifiers, by adopting the Counterfactual Logit Pairing (CLP) regularizer of (Garg et al., 2019).

Original: While our pipeline can in principle be used in the context of most text classification tasks, we instantiate it in the context of toxicity classification.
Revised: While our pipeline can in principle be used in the context of most text classification tasks, we instantiate it in the context of toxicity classification.

Original: Our experimental results, based on a large dataset for online content moderation, show that  our pipeline effectively generates a set of candidate pairs  more diverse  than existing word replacement based approaches and successfully leverages human feedback to verify and filter these candidate pairs.
Revised: Our experimental results, based on a large dataset for online content moderation, show that in this context our pipeline effectively generates a set of candidate pairs that covers more diverse perturbations than existing word replacement based approaches and successfully leverages human feedback to verify and filter these candidate pairs.

Original: Main contributions We make the following contributions:
Revised: Main contributions We make the following contributions:

Original: • We introduce a method for generating datasets of diverse candidate pairs for individual fairness specifications.
Revised: • We introduce a method for generating datasets of diverse candidate pairs for individual fairness specifications.

Original: Towards that, we leverage GPT-3 and unsupervised style transfer to modify demographic attributes mentioned in sentences.
Revised: Towards that, we leverage GPT-3 and unsupervised style transfer to modify demographic attributes mentioned in sentences.

Original: • We show that human feedback can be used for training a classifier that automatically identifies pairs that align with human fairness intuitions for a considered downstream task.
Revised: • We show that human feedback can be used for training a classifier that automatically identifies pairs that align with human fairness intuitions for a considered downstream task.

Original: • We instantiate our framework in the context of toxicity classification.
Revised: • We instantiate our framework in the context of toxicity classification.

Original: We experimentally show that the proposed pairs are more diverse  thanpairs based on word replacement only, that crowdsourcing workers agree with more than 75% of proposed pairs and that our learned  specification can effectively be used to train fairness-aware downstream classifiers.
Revised: We experimentally show that the proposed pairs cover more diverse perturbations than word replacement, that crowdworkers agree with more than 75% of proposed pairs and that our learned approximate specification can effectively be used to train fairness-aware downstream classifiers.

Original:  R ELATED W ORK 
Revised:  R ELATED W ORK Bias

Original: Bias in NLP Early work on bias in Natural Language Processing has focused on unwanted correlations between the word embeddings of identifiers for protected demographic groups and unrelated categories such as occupations (Bolukbasi et al., 2016; Caliskan et al., 2017).
Revised: in NLP Early work on bias in Natural Language Processing has focused on unwanted correlations between the word embeddings of identifiers for protected demographic groups and unrelated categories such as occupations (Bolukbasi et al., 2016; Caliskan et al., 2017).

Original: More recently, generative language models have been found to harbor stereotypical biases (Liang et al., 2020; Nadeem et al., 2020; Vig et al., 2020; Smith et al., 2022).
Revised: More recently, generative language models have been found to harbor stereotypical biases (Liang et al., 2020; Nadeem et al., 2020; Vig et al., 2020; Smith et al., 2022).

Original: Specific to text classification, identity terms such as “gay” and explicit indicators of gender have been shown to significantly impact the outputs of classifiers trained to identify toxic comments (Dixon et al., 2018) or to predict a person’s occupation from their biography (De-Arteaga et al., 2019).
Revised: Specific to text classification, identity terms such as “gay” and explicit indicators of gender have been shown to significantly impact the outputs of classifiers trained to identify toxic comments (Dixon et al., 2018) or to predict a person’s occupation from their biography (De-Arteaga et al., 2019).

Original: Olteanu et al.
Revised: Olteanu et al.

Original: (2017) demonstrate that human perceptions of the quality of a toxicity classifier can depend on the precise nature of errors made by the classifier, as well as the annotators’ previous experiences with hate speech.
Revised: (2017) demonstrate that human perceptions of the quality of a toxicity classifier can depend on the precise nature of errors made by the classifier, as well as the annotators’ previous experiences with hate speech.

Original: Similarly, Blodgett et al.
Revised: Similarly, Blodgett et al.

Original: (2020) recommend authors to explictly consider why, how and to whom the biases they identify are harmful.
Revised: (2020) recommend authors to explictly consider why, how and to whom the biases they identify are harmful.

Original: Language models for data augmentation Ross et al.
Revised: Language models for data augmentation Perez et al.

Revised: (2022) use a language model to automatically generate test cases for another language model and Ross et al.

Original: (2021) automatically create contrast sets (Gardner et al., 2020) with a language model perturbing sentences based on control codes.
Revised: (2021) automatically create contrast sets (Gardner et al., 2020) with a language model perturbing sentences based on control codes.

Original: Rios (2020) use style transfer to change the dialect of African-American Vernacular English (AAVE) tweets to Standard American English (SAE) in order to evaluate the sensitivity to dialect of offensive language detectors, but do not extend style transfer to mentions of demographic groups.
Revised: Rios (2020) use style transfer to change the dialect of African-American Vernacular English (AAVE) tweets to Standard American English (SAE) in order to evaluate the sensitivity to dialect of offensive language detectors, but do not extend style transfer to mentions of demographic groups.

Original: Hartvigsen et al.
Revised: Hartvigsen et al.

Original: (2022) use language models to generate a balanced dataset of benign and toxic comments about minority groups and demonstrate that finetuning a toxicity classifier on this dataset can substantially limit its reliance on spurious correlations between identity terms and toxicity.
Revised: (2022) use language models to generate a balanced dataset of benign and toxic comments about minority groups and demonstrate that finetuning a toxicity classifier on this dataset can substantially limit its reliance on spurious correlations between identity terms and toxicity.

Original: However, their dataset is non-parallel, hence it cannot be used for evaluating individual fairness.
Revised: However, their dataset is non-parallel, hence it cannot be used for evaluating individual fairness.

Original: Meanwhile, Qian et al.
Revised: Meanwhile, Qian et al.

Original: (2022) train a perturber model to imitate human rewrites s ′ of comments s that aim to modify mentions of demographic groups, and demonstrate that finetuning language models on the modified comments reduces demographic biases.
Revised: (2022) train a perturber model to imitate human rewrites s ′ of comments s that aim to modify mentions of demographic groups, and demonstrate that finetuning language models on the modified comments reduces demographic biases.

Original: Although this approach creates parallel data, it is limited by its reliance on large amounts of expensive human rewrites, which is likely why the authors only use it for perturbations along given demographic axes such as gender.
Revised: Although this approach creates parallel data, it is limited by its reliance on large amounts of expensive human rewrites, which is likely why the authors only use it for perturbations along given demographic axes such as gender.

Original: In contrast, we allow for perturbations across axes and only require human annotations rather than rewrites.
Revised: In contrast, we allow for perturbations across axes and only require human annotations rather than rewrites.

Original: Learning fairness notions from data Ilvento (2019) provides an algorithm to approximate arbitrary individual fairness metrics for N datapoints in O ( N log N ) queries, which can be practically infeasible.
Revised: Learning fairness notions from data Ilvento (2019) provides an algorithm to approximate arbitrary individual fairness metrics for N datapoints in O ( N log N ) queries, which can be practically infeasible.

Original: Meanwhile, Mukherjee et al.
Revised: Meanwhile, Mukherjee et al.

Original: (2020) suggest training a classifier to predict binary fairness judgments on pairs ( s, s ′ ) in order to learn a fairness metric ϕ , but restrict themselves to Mahalanobis distances on top of a feature representation ξ ( s ) , limiting their expressive power.
Revised: (2020) suggest training a classifier to predict binary fairness judgments on pairs ( s, s ′ ) in order to learn a fairness metric ϕ , but restrict themselves to Mahalanobis distances on top of a feature representation ξ ( s ) , limiting their expressive power.

Original: In contrast to our work, these works do not validate their learned fairness notions with human feedback.
Revised: In contrast to our work, these works do not validate their learned fairness notions with human feedback.

Original: To that end, Cheng et al.
Revised: To that end, Cheng et al.

Original: (2021) present an interface to holistically elicit stakeholders’ fairness judgments, whereas Wang et al.
Revised: (2021) present an interface to holistically elicit stakeholders’ fairness judgments, whereas Wang et al.

Original: (2019) aim to learn a bilinear fairness metric for tabular data based on clustering human annotations.
Revised: (2019) aim to learn a bilinear fairness metric for tabular data based on clustering human annotations.

Original: Another strain of work aims to directly learn fair classifiers without an explicit fairness metric: given access to similarity queries, Jung et al.
Revised: Another strain of work aims to directly learn fair classifiers without an explicit fairness metric: given access to similarity queries, Jung et al.

Original: (2019) propose an algorithm with generalization bounds for fairness and accuracy that requires a polynomial queries to cost-sensitive classification (CSC) oracle, while other work (Gillen et al., 2018; Bechavod et al., 2020) focuses on online learning of individually fair models.
Revised: (2019) propose an algorithm with generalization bounds for fairness and accuracy that requires a polynomial queries to cost-sensitive classification (CSC) oracle, while other work (Gillen et al., 2018; Bechavod et al., 2020) focuses on online learning of individually fair models.

Original: Lastly, (Lahoti et al., 2019) uses examples of similar pairs ( s, s ′ ) to directly learn a representation that aims to ensure geometric similarity for similar pairs while preserving nearest neighbors in the input space.
Revised: Lastly, (Lahoti et al., 2019) uses examples of similar pairs ( s, s ′ ) to directly learn a representation that aims to ensure geometric similarity for similar pairs while preserving nearest neighbors in the input space.

Original: This approach is difficult to use for non-tabular data, in which nearest neighbor relations do not necessarily carry semantic meaning.
Revised: This approach is difficult to use for non-tabular data, in which nearest neighbor relations do not necessarily carry semantic meaning.

Original: In contrast to these works, we are not only interested in training fair classifiers, but also aim to learn the similarity function which approximates human intuitions about fairness for the task.
Revised: In contrast to these works, we are not only interested in training fair classifiers, but also aim to learn the similarity function which approximates human intuitions about fairness for the task.

Original: Enforcing fairness constraints Garg et al.
Revised: Enforcing fairness constraints Garg et al.

Original: (2019) suggest enforcing fairness constraints via censoring terms indicative of demographic groups, and by extending logit pairing (Kannan et al., 2018) to counterfactual logit pairing (CLP): during training, a classifier f with logits l is regularized by the term
Revised: (2019) suggest enforcing fairness constraints via censoring terms indicative of demographic groups, and by extending logit pairing (Kannan et al., 2018) to counterfactual logit pairing (CLP): during training, a classifier f with logits l is regularized by the term

Original: λ
Revised: λ

Original: || l ( s ) − l ( s ′ )
Revised: || l ( s ) − l ( s ′ )

Original: || 2 for similar datapoints s and s ′ .
Revised: || 2 for similar datapoints s and s ′ .

Original: Yurochkin et al.
Revised: Yurochkin et al.

Original: and Yurochkin &
Revised: and Yurochkin &

Original: Sun (2020) use distributionally robust optimization and transport-based regularization respectively to train a toxicity classifier with distributional fairness guarantees for bilinear fairness metric similar to the ones from (Mukherjee et al., 2020).
Revised: Sun (2020) use distributionally robust optimization and transport-based regularization respectively to train a toxicity classifier with distributional fairness guarantees for bilinear fairness metric similar to the ones from (Mukherjee et al., 2020).

Original: (Ruoss et al., 2020; Yeom & Fredrikson, 2020; Peychev et al., 2021) not only enforce, but also certify the adherence to individual fairness constraints expressed in logical formulas, weighted L p metrics or similarity sets defined in the latent space of a generative model.
Revised: (Ruoss et al., 2020; Yeom & Fredrikson, 2020; Peychev et al., 2021) not only enforce, but also certify the adherence to individual fairness constraints expressed in logical formulas, weighted L p metrics or similarity sets defined in the latent space of a generative model.

Original: However, except for CLP and censoring, all of these methods require a known similarity metric with a specific functional form, which is not always available in practice.
Revised: However, except for CLP and censoring, all of these methods require a known similarity metric with a specific functional form, which is not always available in practice.

Original:  M ETHOD
Revised:  M ETHOD

Original: This section presents our end-to-end framework for generating candidate pairs for individual fairness specifications, identifying candidates that indeed represent fairness constraints  and using them for training individually fair downstream classifiers.
Revised: This section presents our end-to-end framework for generating candidate pairs for individual fairness specifications for a given text classification task, identifying candidates that indeed represent fairness constraints for that task and using them for training individually fair downstream classifiers.

Original: In Sec. 
Revised: In Sec. 3.

Original: 3.1 we expand on existing word replacement definitions of individual fairness in text classification by generating further candidate constraints.
Revised: we expand on existing word replacement definitions of individual fairness in text classification by generating further candidate constraints.

Original: Next, in Sec.
Revised: Next, in Sec.

Original: 3.2 we leverage human feedback to learn an approximate similarity function ˆ φ to identify a set of relevant constraints ˆ C ⋆ ⊆ C .
Revised: 3.2 we leverage human feedback to learn an approximate similarity function ˆ φ to identify a set of relevant constraints ˆ C ⋆ ⊆ C .

Original: Finally, in Sec. 3.3 we train a fairness-aware classifier f using CLP on the filtered constraint set ˆ C ⋆ .
Revised: Finally, in Sec. 3. we train a fairness-aware classifier f using CLP on the filtered constraint set ˆ C ⋆ .

Original: 3. E XPANDING FAIRNESS CONSTRAINTS
Revised: E XPANDING FAIRNESS CONSTRAINTS

Original: We expand the word replacement based constraint set from Garg et al.
Revised: We expand the word replacement based constraint set from Garg et al.

Original: by implementing three different ways to modify markers of demographic groups mentioned in a sentence s : an extended word replacement list, unsupervised style transfer, and zero-shot modification using GPT-3.
Revised: by implementing three different ways to modify markers of demographic groups mentioned in a sentence s : an extended word replacement list, unsupervised style transfer, and zero-shot modification using GPT-3.

Original: Word Replacement First, we enrich the word replacement method by using the extensive lists of words associated with different protected demographic groups presented in Smith et al.
Revised: Word Replacement First, we enrich the word replacement method by using the extensive lists of words associated with different protected demographic groups presented in Smith et al.

Original: The pool of terms is substantially larger than the 50 identity terms from Garg et al.
Revised: The pool of terms is substantially larger than the 50 identity terms from Garg et al.

Original: We modify markers of group j in a comment s by replacing all words on the respective list of words associated with group j with words from the list associated with the target group j ′ .
Revised: We modify markers of group j in a comment s by replacing all words on the respective list of words associated with group j with words from the list associated with the target group j ′ .

Original: Unsupervised Style Transfer Second, we use an unsupervised style transfer approach based on prototype editing (see Jin et al. for an extensive review ondifferent approaches to style transfer) to transform markers of a demographic group j in a sentence s to markers of another demographic group j ′ , creating a new sentence s ′ .
Revised: Unsupervised Style Transfer Second, we use an unsupervised style transfer approach based on prototype editing (see (Jin et al., 2022) for an extensive review on style transfer) to transform markers of a demographic group j in a sentence s to markers of another demographic group j ′ , creating a new sentence s ′ .

Original: Prototype editing identifies markers a of a source style A in a text s , and substitutes them by markers a ′ of a target style A ′ .
Revised: Prototype editing identifies markers a of a source style A in a text s , and substitutes them by markers a ′ of a target style A ′ .

Original: It can achieve unsupervised style transfer with minimal modifications to a source sentence s .
Revised: It can achieve unsupervised style transfer with minimal modifications to a source sentence s .

Original: Importantly, modern prototype editing algorithms rely solely on a style classifier to define their notion of style, so that they can transfer mentions of demographic groups when used with a classifier trained to identify such mentions.
Revised: Importantly, modern prototype editing algorithms rely solely on a style classifier to define their notion of style, so that they can transfer mentions of demographic groups when used with a classifier trained to identify such mentions.

Original: Our approach consists of three phases.
Revised: Our approach consists of three phases.

Original: First, we train a multi-headed RoBERTa-based (Liu et al., 2019)
Revised: First, we train a multi-headed RoBERTa-based (Liu et al., 2019)

Original: classifier c to predict the presence of mentions of demographic groups j in a sentence s .
Revised: classifier c to predict the presence of mentions of demographic groups j in a sentence s .

Original: Second, following Reid & Zhong (2021), we train a BART-based (Lewis et al., 2019) group-conditioned generator g ( s t , j ) :
Revised: Second, following Reid & Zhong (2021), we train a BART-based (Lewis et al., 2019) group-conditioned generator g ( s t , j ) :

Original: Given a sentence s consisting of n tokens that mentions group j , we remove mentions of demographic groups from s by masking tokens at positions k with above-average attention weights a k ≥ ¯ a , where a k represents the maximum attention weight at position k in the penultimate layer of c and the average is taken over all token positions for the sentence s .
Revised: Given a sentence s consisting of n tokens that mentions group j , we remove mentions of demographic groups from s by masking tokens at positions k with above-average attention weights a k ≥ ¯ a , where a k represents the maximum attention weight at position k in the penultimate layer of c and the average is taken over all token positions for the sentence s .

Original: After merging consecutive masks, this yields a template s t on which g ( s t , j ) is trained to reconstruct s .
Revised: After merging consecutive masks, this yields a template s t on which g ( s t , j ) is trained to reconstruct s .

Original: Third, we modify sentences s that mention group j to instead mention group j ′ by first creating a template s ′ t as in Lee (2020):
Revised: Third, we modify sentences s that mention group j to instead mention group j ′ by first creating a template s ′ t as in Lee (2020):

Original: We iteratively mask the tokens in s for which masking most reduces the likelihood p c ( j | s ′ t ) of j according to the group-presence classifier c , until it falls below a fixed threshold T .
Revised: We iteratively mask the tokens in s for which masking most reduces the likelihood p c ( j | s ′ t ) of j according to the group-presence classifier c , until it falls below a fixed threshold T .

Original: Then, we generate s ′ as g ( s ′ t , j ′ )
Revised: Then, we generate s ′ as g ( s ′ t , j ′ )

Original: using beam search with width 5 and selecting according to p c ( j ′ | s ′ )
Revised: using beam search with width 5 and selecting according to p c ( j ′ | s ′ )

Original: − p c ( j | s ′ ) , the difference in likelihoods assigned to j ′ and j for s ′ by c .
Revised: − p c ( j | s ′ ) , the difference in likelihoods assigned to j ′ and j for s ′ by c .

Original: We use this approach rather than the attention-based masking from (Reid & Zhong, 2021) for the third step, because the attention values a k are shared between the prediction heads of c for all groups j .
Revised: We use this approach rather than the attention-based masking from (Reid & Zhong, 2021) for the third step, because the attention values a k are shared between the prediction heads of c for all groups j .

Original: This means that attention-based masking might mask tokens related to a third group j ′′ instead of tokens related to j for sentences s in which multiple demographic groups are mentioned.
Revised: This means that attention-based masking might mask tokens related to a third group j ′′ instead of tokens related to j for sentences s in which multiple demographic groups are mentioned.

Original: While unlikely to be very detrimental during the training of the class-conditioned generator g , using attention for creating templates s t for g can thus cause group transfer to target the wrong source group j .
Revised: While unlikely to be very detrimental during the training of the class-conditioned generator g , using attention for creating templates s t for g can thus cause group transfer to target the wrong source group j .

Original: The unsupervised style transfer approach promises multiple advantages: First, style transfer is likely to reproduce terms encountered during training, helping it to pick up on rare demographic terms that are particular to its training distribution which can be chosen to equal the training distribution for downstream tasks.
Revised: The unsupervised style transfer approach promises multiple advantages: First, style transfer is likely to reproduce terms encountered during training, helping it to pick up on rare demographic terms that are particular to its training distribution which can be chosen to equal the training distribution for downstream tasks.

Original: In addition, unlike concurrent work by Qian et al. (2022), unsupervised style transfer only requires labels y j ( s ) indicating the mention of demographic group j in a sentence s rather than large amount of expensive human-produced examples of demographic group transfer.
Revised: In addition, unlike concurrent work by Qian et al. (2022), unsupervised style transfer only requires labels y j ( s ) indicating the mention of demographic group j in a sentence s rather than large amount of expensive human-produced examples of demographic group transfer.

Original: This allows us to modify mentions of demographic groups across axes like gender, religion and race, rather than restricting ourselves to changes within each of these axes.
Revised: This allows us to modify mentions of demographic groups across axes like gender, religion and race, rather than restricting ourselves to changes within each of these axes.

Original: GPT-

Revised: GPT-

Original: Lastly, we make use of GPT-3 (Brown et al., 2020) to transform markers of protected demographic groups in a zero-shot fashion.
Revised: Lastly, we make use of GPT-3 (Brown et al., 2020) to transform markers of protected demographic groups in a zero-shot fashion.

Original: We use three methods for generating pairs based on
Revised: We use three methods for generating pairs based on

Original: GPT-3.
Revised: GPT-3.

Original: First, we prepend an example s mentioning group j with the prompt "Please rewrite the following sentence to be about j ′ rather than j ".
Revised: First, we prepend an example s mentioning group j with the prompt "Please rewrite the following sentence to be about j ′ rather than j ".

Original: Second, we use GPT-3’s edit mode 1 with a similar prompt.
Revised: Second, we use GPT-3’s edit mode 1 with a similar prompt.

Original: Lastly, we generate candidate modifications s ′ by word replacement, and postprocess them using GPT-3’s edit mode with the prompt "Fix grammatical errors and logical inconsistencies".
Revised: Lastly, we generate candidate modifications s ′ by word replacement, and postprocess them using GPT-3’s edit mode with the prompt "Fix grammatical errors and logical inconsistencies".

Original: While the GPT-3 approach does not automatically adapt to the relevant distribution of demographic terms, it does not require any additional data, or training of language models.
Revised: While the GPT-3 approach does not automatically adapt to the relevant distribution of demographic terms, it does not require any additional data, or training of language models.

Original: To ensure that mentions of demographic group j were indeed replaced by j ′ going from s to s ′ , we use the same grouppresence classifier c as for the unsupervised style transfer approach to heuristically identify successful group transfer and discard pairs ( s, s ′ ) for which group transfer failed, for all three of our approaches.
Revised: To ensure that mentions of demographic group j were indeed replaced by j ′ going from s to s ′ , we use the same grouppresence classifier c as for the unsupervised style transfer approach to heuristically identify successful group transfer and discard pairs ( s, s ′ ) for which group transfer failed, for all three of our approaches.

Original: Implementation details are described in App.
Revised: Implementation details are described in App.

Original: B, while App.
Revised: B, while App.

Original: E contains examples.
Revised: E contains examples.

Original: 3. L EARNING THE SIMILARITY FUNCTION
Revised: 3. L EARNING THE SIMILARITY FUNCTION

Original: In order to evaluate to what extend the proposed similarity criteria align with human intuition, we leverage human feedback, via a crowdsourcing study described in more detail in Sec. 4, to obtain labels φ ( s, s ′ ) which indicate whether the pair ( s, s ′ ) should be treated similarly for the sake of individual fairness ( φ ( s, s ′ )
Revised: In order to evaluate to what extent the proposed similarity criteria align with human intuition, we leverage human feedback, via a crowdsourcing study described in more detail in Sec. 4, to obtain labels φ ( s, s ′ ) which indicate whether the pair ( s, s ′ ) should be treated similarly for the sake of individual fairness ( φ ( s, s ′ )

Original: = 0 ) or not ( φ ( s, s ′ )
Revised: = 0 ) or not ( φ ( s, s ′ )

Original: = 1 ).
Revised: = 1 ).

Original: In particular, identifying which pairs align with human labelers’ intuition about fairness can help detect asymmetric counterfactuals, as well as failed attempts at style transfer for which s ′ cannot be interpreted as a meaningful modification of s .
Revised: In particular, identifying which pairs align with human labelers’ intuition about fairness can help detect asymmetric counterfactuals, as well as failed attempts at style transfer for which s ′ cannot be interpreted as a meaningful modification of s .

Original: Since labeling all of C can be prohibitively expensive, weonly label a subset and use it to train a probabilistic model p ˆ φ ( s, s ′ ) that predicts values of the similarity function φ ( s, s ′ ) for the remaining pairs ( s, s ′ ) .
Revised: Since labeling all of C can be prohibitively expensive, we train a probabilistic model p ˆ φ ( s, s ′ ) on a labeled subset of C and use it to predict φ ( s, s ′ ) for the remaining pairs ( s, s ′ ) .

Original: The similarity function ϕ is then approximated as ˆ φ ( s, s ′ ) :
Revised: The similarity function φ that specifies individual fairness is then approximated as ˆ φ ( s, s ′ ) :

Original: = 1 ⇔ p ˆ φ ( s, s ′ ) >
Revised: = 1 ⇔ p ˆ φ ( s, s ′ ) >

Original: t for a given classification threshold t .
Revised: t for a given classification threshold t .

Original: Instead of using bilinear logits based on features for both s and s ′ (Mukherjee et al., 2020), we tokenize s and s ′ and train a BERT-based classifier on the concatenated tokens.
Revised: Instead of using bilinear logits based on features for both s and s ′ (Mukherjee et al., 2020), we tokenize s and s ′ and train a BERT-based classifier on the concatenated tokens.

Original: This allows for a more holistic comparison between s and s ′ as attention heads can directly attend to differences between s and s ′ in earlier layers (See App.
Revised: This allows for a more holistic comparison between s and s ′ as attention heads can directly attend to differences between s and s ′ in earlier layers (See App.

Original: C for more details).
Revised: C for more details).

Original: Active Learning from human fairness judgments To make optimal use of costly human queries, we employ active learning when training the classifier ˆ φ .
Revised: Active Learning from human fairness judgments To make optimal use of costly human queries, we employ active learning when training the classifier ˆ φ .

Original: We use the variation ratios 1 − max y p ( y | x ) to select the data points with the largest uncertainty about the correct label, an approach that is often dubbed Least Confidence (LC) and estimate p using a Dropout-based Monte-Carlo estimate (Gal
Revised: We use the variation ratios 1 − max y p ( y | x ) to select the data points with the largest uncertainty about the correct label, an approach that is often dubbed Least Confidence (LC) and estimate p using a Dropout-based Monte-Carlo estimate (Gal

Original: Ghahramani, 2016;
Revised: Ghahramani, 2016;

Original: Gal et al., 2017).
Revised: Gal et al., 2017).

Original: As in Grießhaber et al.
Revised: As in Grießhaber et al.

Original: (2020), we aim to save resources by precomputing features for the BERT-part of ˆ φ and performing Monte-Carlo dropout on the classification head of ˆ φ only.
Revised: (2020), we aim to save resources by precomputing features for the BERT-part of ˆ φ and performing Monte-Carlo dropout on the classification head of ˆ φ only.

Original: Concretely, after training ˆ φ on an initial randomly selected dataset
Revised: Concretely, after training ˆ φ on an initial randomly selected dataset

Original: D 0 ⊂ C with labels φ ( s, s ′ )
Revised: D 0 ⊂ C with labels φ ( s, s ′ )

Original: , we iteratively select new unlabeled training data D i ⊂ C \ (cid:83)
Revised: , we iteratively select new unlabeled training data D i ⊂ C \ (cid:83)

Original: j<i D j with |
Revised: j<i D j with |

Original: D i | = 1000 , based on the variation ratios, query labels for D i , and retrain ˆ φ on D i .
Revised: D i | = 1000 , based on the variation ratios, query labels for D i , and retrain ˆ φ on D i .

Original: As different annotators can disagree about whether or not two sentences s and s ′ should be treated similarly, we use a majority vote for evaluation.
Revised: As different annotators can disagree about whether or not two sentences s and s ′ should be treated similarly, we use a majority vote for evaluation.

Original: Inspired by Chen et al.
Revised: Inspired by Chen et al.

Original: (2022)’s approach for dealing with noise in crowdsourcing, we use a single human query per pair ( s, s ′ ) during active learning, and relabel pairs that are especially likely to be mislabeled after active learning has concluded.
Revised: (2022)’s approach for dealing with noise in crowdsourcing, we use a single human query per pair ( s, s ′ ) during active learning, and relabel pairs that are especially likely to be mislabeled after active learning has concluded.

Original: 3. T RAINING A FAIR ( ER ) CLASSIFIER
Revised: 3. T RAINING A FAIR ( ER ) CLASSIFIER

Original: Finally, we train a fairness-aware classifier by accounting for the constraints defined by the learnt similarity function.
Revised: Finally, we train a fairness-aware classifier by accounting for the constraints defined by the learnt similarity function.

Original: Specifically, we define the filtered constraint set ˆ C ⋆ = { ( s, s ′ )
Revised: Specifically, we define the filtered constraint set ˆ C ⋆ = { ( s, s ′ )

Original: ∈ C : ˆ φ ( s, s ′ ) = 0 } .
Revised: ∈ C : ˆ φ ( s, s ′ ) = 0 } .

Original: We then train a RoBERTa-based Liu et al.
Revised: We then train a RoBERTa-based Liu et al.

Original: (2019) downstream classifier f , empirically enforcing the constraints implied by ˆ C ⋆ by using the Counterfactual Logit Pairing (CLP) regularizer λ (cid:80) s,s ′ :
Revised: (2019) downstream classifier f , empirically enforcing the constraints implied by ˆ C ⋆ by using the Counterfactual Logit Pairing (CLP) regularizer λ (cid:80) s,s ′ :

Original: ϕ ( s,s ′ )=

Revised: ϕ ( s,s ′ )=

Original: || l ( s ) − l ( s ′ )
Revised: || l ( s ) − l ( s ′ )

Original: || 2 of Garg et al.
Revised: || 2 of Garg et al.

Original: Here, l represents the logits of the classifier f .
Revised: Here, l represents the logits of the classifier f .

Original: If ˆ φ accurately approximates human fairness intuitions, this approach avoids enforcing constraints implied by asymmetric counterfactuals ( s, s ′ )
Revised: If ˆ φ accurately approximates human fairness intuitions, this approach avoids enforcing constraints implied by asymmetric counterfactuals ( s, s ′ )

Original: (pairs with φ ( s, s ′ )
Revised: (pairs with φ ( s, s ′ )

Original: = 1 ) while properly enforcing actual constraints (pairs with φ ( s, s ′ )
Revised: = 1 ) while properly enforcing actual constraints (pairs with φ ( s, s ′ )

Original: = 0 ).
Revised: = 0 ).

Original: Further details can be found in App.
Revised: Further details can be found in App.

Original: D.
Revised: D.

Original:  E XPERIMENTS
Revised:  E XPERIMENTS

Original: In this section, we experimentally evaluate our framework.
Revised: In this section, we experimentally evaluate our framework in the context of toxicity classification.

Original: Our key findings are: (i) the pairs generated by our method are more diverse compared to word replacement pairs only (Sec. 4.2), while mostly aligning with human intuition about  fairness  (Sec. 4.3); (ii) the underlying similarity function φ can be approximated by active learning from human judgements (Sec. 4.4), and (iii) the produced constraints can be used to enforce  fairness on a downstream toxicity classifier (Sec. 4.5).
Revised: Our key findings are: (i) the pairs generated by our method cover a wider range of perturbations compared to word replacement pairs only (Sec. 4.2), while mostly aligning with human intuition about individual fairness in toxicity classification (Sec. 4.3); (ii) the underlying similarity function φ can be approximated by active learning from human judgements (Sec. 4.4), and (iii) the produced constraints can be used to enforce individual fairness on a downstream toxicity classifier (Sec. 4.5).

Original: 4. D ATASET AND SETUP
Revised: 4. D ATASET AND SETUP

Original: We focus on toxicity classification on the Jigsaw Civil Comments dataset 2 .
Revised: We focus on toxicity classification on the Jigsaw Civil Comments dataset 2 .

Original: The dataset contains around 2 million online comments s , as well as labels toxic ( s ) indicating the fraction of human labelers that considered comment s toxic.
Revised: The dataset contains around 2 million online comments s , as well as labels toxic ( s ) indicating the fraction of human labelers that considered comment s toxic.

Original: We define binary classification labels y ( s ) :
Revised: We define binary classification labels y ( s ) :

Original: = toxic ( s ) > 0 .
Revised: = toxic ( s ) > 0 .

Original: A subset D of the Civil Comments dataset also contains labels A j ( s ) that indicate the fraction of human labelers that think comment s mentions the demographic group j .
Revised: A subset D of the Civil Comments dataset also contains labels A j ( s ) that indicate the fraction of human labelers that think comment s mentions the demographic group j .

Original: We again define binary classification labels as y j ( s ) :
Revised: We again define binary classification labels as y j ( s ) :

Original: = A j ( s ) > 0 .
Revised: = A j ( s ) > 0 .

Original: 5 for these comments, and use them to train our grouppresence classifier c .
Revised: 5 for these comments, and use them to train our grouppresence classifier c .

Original: We only consider the subset D ′ ⊂ D for which no nan-values are contained in the dataset, and the RoBERTa-tokenized version of s does not exceed a length of 64 tokens.
Revised: We only consider the subset D ′ ⊂ D for which no nan-values are contained in the dataset, and the RoBERTa-tokenized version of s does not exceed a length of 64 tokens.

Original: We furthermore split D ′ into a training set containing 75% of D ′ and a test set containing the other 25% .
Revised: We furthermore split D ′ into a training set containing 75% of D ′ and a test set containing the other 25% .

Original: When designing the pool C of candidate pairs, for word replacement and style transfer, we attempt to produce modified comments s ′ j ′ mentioning group j ′ for each s in D ′ for all demographic groups j with y j ( s ) = 1 and all possible target groups j ′ .
Revised: When designing the pool C of candidate pairs, for word replacement and style transfer, we attempt to produce modified comments s ′ j ′ mentioning group j ′ for each s in D ′ for all demographic groups j with y j ( s ) = 1 and all possible target groups j ′ .

Original: For GPT-3, we use a smaller subset of D ′ due to limited resources.
Revised: For GPT-3, we use a smaller subset of D ′ due to limited resources.

Original: We then combine 42500 randomly selected pairs ( s, s ′ ) with s in the training part of D ′ for word replacement and style transfer each and a total of 15000 pairs ( s, s ′ ) for our three
Revised: We then combine 42500 randomly selected pairs ( s, s ′ ) with s in the training part of D ′ for word replacement and style transfer each and a total of 15000 pairs ( s, s ′ ) for our three

Original: GPT-3 approaches, to form the set of candidate constraints C .
Revised: GPT-3 approaches, to form the set of candidate constraints C .

Original: We similarly construct a set of test constraints of a fourth of C ’s size from the test portion of D ′ .
Revised: We similarly construct a set of test constraints of a fourth of C ’s size from the test portion of D ′ .

Original: More details on the generation of C , as well as example pairs ( s, s ′ ) , can be found in App.
Revised: More details on the generation of C , as well as example pairs ( s, s ′ ) , can be found in App.

Original: B.
Revised: B.

Original: Throughout this section, whenever we report  fairness for a classifier, we refer to the proportion of pairs ( s, s ′ ) in a test pool of similar pairs for which f ( s ) =
Revised: Throughout this paper, whenever we report individual fairness for a classifier, we refer to the proportion of pairs ( s, s ′ ) in a test pool of similar pairs for which f ( s ) =

Original: f ( s ′ ) rather than f ( s ) ̸
Revised: f ( s ′ ) rather than f ( s ) ̸

Original: = f ( s ′ ) .
Revised: = f ( s ′ ) .

Revised: This metric captures that every instance of treating similar pairs differently is harmful.

Revised: It is also a natural upper bound for certified individual fairness (Ruoss et al., 2020; Peychev et al., 2021) and prediction consistency (Yurochkin & Sun, 2020) which consider equal predictions across all comments s ′ similar to a given comment s for simpler formal specifications of similarity.

Original: 4. D IVERSITY OF GENERATED FAIRNESS CONSTRAINTS
Revised: 4. C OVERAGE OF GENERATED FAIRNESS CONSTRAINTS

Original: To validate that our candidate constraint set C is indeed more diverse than word replacement on its own, we train 4 different toxicity classifiers, using CLP with different constraint sets C, C 1 , C 2 , C 3. Here C corresponds to the full constraint set, as described above. We design the other constraint sets to be of the same size as C , but contain pairs generated by one method only.
Revised: To validate that our approach covers a wider range of perturbations than word replacement, we traindifferent toxicity classifiers, using CLP with different constraint sets: our full constraint set C , as well as C 1 , C 2 , C 3 of the same size as C .

Original: In particular, the pairs in C 1  were generated by word replacement using the 50 identity terms from Garg et al.
Revised: The pairs in C 1 , also referred to as WR 50 , were generated by word replacement using the 50 identity terms from Garg et al.

Original: (2019) for word replacement 3 ; the pairs in C 2  were generated by word replacement by using the larger list of terms of Smith et al.
Revised: (2019) for word replacement 3 ; the pairs in C 2 , also referred to as WR, were generated by word replacement by using the larger list of terms of Smith et al.

Original: ; and the pairs in C 3  were derived byusing the style transfer method.
Revised: ; and the pairs in C 3 , also referred to as ST, were created by the style transfer method.

Original: Wethen cross-evaluate the performance ofthe 4 classifiers trained with these constraint sets  in terms oftheir test-time  fairness according to each of the 4 fairness criteria, andtheir balanced accuracy, in Table 1.
Revised: We cross-evaluate the performance of 4 classifiers trained with CLP with λ = 5 , using each of the constraint sets C i in terms of test-time individual fairness measured as the proportion of similar pairs ( s, s ′ ) for which f ( s ) = f ( s ′ ) in C and each of the 4 constraint sets C i , and balanced accuracy.

Original: We also report the performance on a “baseline” model, trained without enforcing fairness constraints.
Revised: Table 1 reports these numbers and the performance of a “baseline” model, trained without CLP.

Original: The results in Table 1 indicate that each classifier achieves high  fairness when evaluated on the set of test constraint pairs corresponding to the constraints used during its training (numbers in italics) while performing worse when evaluated on other constraint pairs.
Revised: The results in Table 1 indicate that each classifier achieves high individual fairness when evaluated on the set of test constraint pairs corresponding to the constraints used during its training (numbers in italics) while performing worse when evaluated on other constraint pairs.

Original: This indicates that enforcing the similarity notions corresponding tothe different pair-generation methods can lead to substantially different classifiersbeing learned and that the adherence to  fairnessgenerally does not  generalize across our generation methods.
Revised: This indicates that enforcing the similarity notions corresponding to different pair-generation methods can produce substantially different classifiers and that the adherence to individual fairness does not perfectly generalize across our generation methods.

Original: We note that training with CLP on C or our style transfer pairs Cdoes not just yield significantly improved constraint adherence on C 3 , but also generalizes well to C 1 and C 2 (see the numbers in bold), without losing much downstream accuracy.
Revised: We note that training with CLP on C or our style transfer pairs C 3 does not just yield significantly improved constraint adherence on C 3 , but also generalizes well to C 1 and C(see the numbers in bold), without losing much downstream accuracy.

Original: More detailed experiments on the diversity of our generated constraints can be found in App.
Revised: More detailed experiments on the improved coverage of our generated constraints can be found in App.

Original: B and D.
Revised: B and D.

Original: Training/Evaluation
Revised: Training/Evaluation

Revised: [Equation]

Original: [Table]
Revised: [Table]

Original: 4. R ELEVANCE OF GENERATED FAIRNESS CONSTRAINTS
Revised: 4. R ELEVANCE OF GENERATED FAIRNESS CONSTRAINTS

Original: To validate that the fairness contraints we generated are relevant and intuitive
Revised: To validate that the fairness contraints we generated are relevant and intuitive

Original: [Table]
Revised: [Table]

Original: we conducted a human evaluation with workers recruited via Amazon’s MechanicalTurk.
Revised: we conducted a human evaluation with workers recruited via Amazon’s MechanicalTurk.

Original: Workers were presented with a pair ( s, s ′ )
Revised: Workers were presented with a pair ( s, s ′ )

Original: consisting of a comment s from the Civil Comments dataset [Table] as well as a modified version s ′ and asked about whether they believe that the two comments should be treated similarly and whether they believed that the average american shared their opinion.
Revised: consisting of a comment s from the Civil Comments dataset, as well as a modified version s ′ and asked about whether they believe that the two comments should be treated similarly.

Original: Treatment was framed in terms of toxicity classification for the sake of content moderation, ensuring that we verify the relevance of the learned notions relevant to this specific task.
Revised: Treatment was framed in terms of toxicity classification for the sake of content moderation, ensuring that we verify the relevance of the learned notions relevant to this specific task.

Original: Workers were also asked about whether the demographic group was transferred correctly from a given j to a given j ′ , whether the content of s has been preserved in s ′ apart from the demographic group transfer
Revised: Workers were also asked about whether the demographic group was transferred correctly from a given j to a given j ′ and whether the content of s has been preserved in s ′ apart from the demographic group transfer.

Original: [Table]

Original: as well as whether there are differences in factuality and grammaticality between s and s ′ .

Original: Further details on worker instructions, payment and measureswe employed for quality control can be found in App. A.
Revised: Further details on worker instructions, payment and measures for quality control can be found in App. A.

Original: We collected human feedback for a set S containing a total of 720 pairs ( s, s ′ ) with 240 each being produced by our style transfer approach, GPT-3 in a zero-shot fashion, and word replacement using the list from (Garg et al., 2019) 4 .
Revised: We collected human feedback for a set S containing a total of 720 pairs ( s, s ′ ) with 240 each being produced by our style transfer approach, GPT-3 in a zero-shot fashion, and word replacement using the list from (Garg et al., 2019) 4 .

Original: These 240 pairs per method were split into 80 pairs for each of the axes male ↔ female, christian ↔ muslim and black ↔ white, half of which with s mentioning the first demographic group and half of them with s mentioning the second demographic group. 
Revised: These 240 pairs per method were split into 80 pairs for each of the axes male ↔ female, christian ↔ muslim and black ↔ white, half of which with s mentioning the first demographic group and half of them with s mentioning the second demographic group. Each pair

Original: Each pair ( s, s ′ ) was shown to ninedifferent workers and we took a majority vote when determining whether the pair consists of instances that should be treated similarly ( φ ( s, s ′ ) = 0 ), or not ( φ ( s, s ′ )
Revised: [Table] ) was shown to nine and we by vote. Table 2 reports how often crowdworkers affirmatively answered the three questions described in the previous paragraph for different generation methods.

Original: = 1 ). The results in Table 2 demonstrate that all three methods produce relevant fairness constraints, according to a majority of annotators.
Revised: The results in Table 2 demonstrate that all three methods produce relevant fairness constraints, according to a majority of annotators.

Original: At the same time, the workers’ feedback indicates that the methods were mostly successful at modifying the mentioned demographic group, and at preserving content, factuality and grammaticality.
Revised: At the same time, the workers’ feedback indicates that the methods were mostly successful at modifying the mentioned demographic group, and at preserving content.

Original: While word replacement generally performs better in terms ofMetric/Method [Table] group transfer and content preservation, this only translates to a small advantage in terms of producing pairs that represent actual fairness constraints ( φ ( s, s ′ )
Revised: While word replacement generally performs better in terms of group transfer and content preservation, this only translates to a small advantage in terms of producing pairs that represent actual fairness constraints ( φ ( s, s ′ )

Original: = 0) , perhaps due to its worse performance in terms of preserving factuality. Indeed, we found examples in which word replacement transformed "white house" to "black house"; or Obama is referred to as "white" rather than "black" in a modified comment. These pairs were not seen as fairness constraints by most annotators, while also being judged badly in terms of preserving factuality.
Revised: = 0) .

Original: (See A.1  for more detailed results) [Table]
Revised: See Tables A.1 and A.2 for more detailed results.

Original: 4. L EARNING THE SIMILARITY FUNCTION
Revised: 4. L EARNING THE SIMILARITY FUNCTION

Original: Since labeling pairs through human feedback is costly, obtaining labels for all candidate pairs in C can be prohibitively expensive.
Revised: Since labeling pairs through human feedback is costly, obtaining labels for all candidate pairs in C can be prohibitively expensive.

Original: Therefore, we employed our active learning approach to efficiently train our classifier ˆ φ from relatively few human judgments, with the goal of using it to identify pairs that represent actual fairness constraints on the remaining pool of candidates.
Revised: Therefore, we employed our active learning approach to efficiently train our classifier ˆ φ from relatively few human judgments, with the goal of using it to identify pairs that represent actual fairness constraints on the remaining pool of candidates.

Original: We conductedsteps of active learning with 1000 queries each, selected by the LC criterion.
Revised: We conductedsteps of active learning with 1000 queries each, selected by the LC criterion.

Original: Failed queries were discarded, so that we ended up with a total of 5490 labeled pairs (( s, s ′ ) , φ ( s, s ′ )) .
Revised: Failed queries were discarded, so that we ended up with a total of 5490 labeled pairs (( s, s ′ ) , φ ( s, s ′ )) .

Original: Details on our model architecture and other hyperparameters can be found in App.
Revised: Details on our model architecture and other hyperparameters can be found in App.

Original: C.
Revised: C.

Original: We evaluate our learnt classifier on a test set T consisting of 500 randomly selected pairs from C for which five annotators were asked about theaverage American’s fairness judgment.
Revised: We evaluate our learnt classifier on a test set T consisting of 500 randomly selected pairs from C for which five annotators were asked to predict the American’s fairness judgment.

Revised: We labeled pairs based on whether the majority thought they should be treated similarly ( φ ( s, s ′ )

Revised: = 0 ), or not ( φ ( s, s ′ )

Original:  Because 78 . 8% of the pairs ( s, s ′ ) in T represented fairness constraints ( φ ( s, s ′ )
Revised: = 1 ). Because 78 . 8% of the pairs ( s, s ′ ) in T represented fairness constraints ( φ ( s, s ′ )

Original: = 0) 
Revised: = 0) , we report

Original: according to the majority of annotators, we report Balanced Accuracy (BA), in addition to standard accuracy (ACC) and the true positive and negative rates (TPR and TNR).
Revised: Balanced Accuracy (BA), in addition to standard accuracy (ACC) and the true positive and negative rates (TPR and TNR).

Original: Table 3 displays these metrics for classifiers resulting from our active learning method for different classification thresholds t and with and without relabeling.
Revised: Table 3 displays these metrics for classifiers resulting from our active learning method for different classification thresholds t and with and without relabeling [Table]

Revised: Results are averaged over 10 repetitions of training on the data labeled in the last step/the relabeled data.

Revised: ± indicates the difference from the upper/lower bound of a naive 95% confidence interval assuming normally distributed errors.

Original: We observe that ˆ φ performs substantially better than random, achieving Balanced Accuracy of 66 .
Revised: We observe that ˆ φ performs substantially better than random, achieving Balanced Accuracy of 66 .

Original: 7% when used with an aggressive classifier threshold t .
Revised: 7% when used with an aggressive classifier threshold t .

Original: The table also validates our relabeling approach:
Revised: The table also validates our relabeling approach:

Original: After observing that our classifier was biased towards predicting φ ( s, s ′ )
Revised: After observing that our classifier was biased towards predicting φ ( s, s ′ )

Original: =on{+= 
 on+} a held-out validation set, we collected two additional labels for 500 pairs ( s, s ′ ) for which both the human and the predicted label were equal to zero ( ˆ φ ( s, s ′ )
Revised: {+= 
 on+} a held-out validation set, we collected two additional labels for 500 pairs ( s, s ′ ) for which both the human and the predicted label were equal to zero ( ˆ φ ( s, s ′ )

Original: =
Revised: =

Original: φ ( s, s ′ )
Revised: φ ( s, s ′ )

Original: = 0 ), selected based on the LC criterion.
Revised: = 0 ), selected based on the LC criterion.

Original: The majority vote over all three annotators was φ ( s, s ′ )
Revised: The majority vote over all three annotators was φ ( s, s ′ )

Original: = 1 for 47% of these pairs, showing that our approach correctly identified pairs that were likely to be mislabeled.
Revised: = 1 for 47% of these pairs, showing that our approach correctly identified pairs that were likely to be mislabeled.

Original: Retraining our classifier on the updated majority votes also substantially increased True Positive Rates at little costs to True Negative Rates, especially for balanced classification thresholds t close to 0 .
Revised: Retraining our classifier on the updated majority votes also substantially increased True Positive Rates at little costs to True Negative Rates, especially for balanced classification thresholds t close to 0 .

Original: According to a qualitative evaluation, most of the sentence pairs ( s, s ′ ) predicted to not represent fairness constraints ( ˆ φ ( s, s ′ )
Revised: According to a qualitative evaluation, most of the sentence pairs ( s, s ′ ) predicted to not represent fairness constraints ( ˆ φ ( s, s ′ )

Original: = 1) had the words "boy" or "man" replaced by terms denoting identity membership.
Revised: = 1) had the words "boy" or "man" replaced by terms denoting identity membership.

Original: Such sentence pairs, like "You boys don’t go fishing when you go on those vacations, do you?"
Revised: Such sentence pairs, like "You boys don’t go fishing when you go on those vacations, do you?"

Original: and "You Hindus don’t go fishing when you go on those vacations, do you?" were often not seen as fairness constraints by our human annotators, as the inclusion of the identity term can be interpreted as aggressive or mocking.
Revised: and "You Hindus don’t go fishing when you go on those vacations, do you?" were often not seen as fairness constraints by our human annotators, as the inclusion of the identity term can be interpreted as aggressive or mocking.

Original: ˆ φ also successfully identified sentence pairs ( s, s ′ ) for which s ′ was unrelated to s , that were sometimes produced by GPT-3, as not representing fairness constraints.
Revised: ˆ φ also successfully identified sentence pairs ( s, s ′ ) for which s ′ was unrelated to s , that were sometimes produced by GPT-3, as not representing fairness constraints.

Original: Additional results on ˆ φ and ablations on the learning approach can be found in App.
Revised: Additional results on ˆ φ and ablations on the learning approach can be found in App.

Original: C.
Revised: C.

Original: [Table]

Original: 4. T RAINING A FAIRER DOWNSTREAM CLASSIFIER
Revised: 4. T RAINING A FAIRER DOWNSTREAM CLASSIFIER

Original: Lastly

Original: [Table] we evaluate whether the pairs ˆ C ⋆  can help with learning a fairness-aware downstream classifier, by training a RoBERTa-based toxicity classifier f using CLP, filtering C based on ˆ φ with classifier threshold t =0 . 5to obtain the constraint set ˆ C ⋆ .
Revised: Lastly, we evaluate whether the pairs ˆ C ⋆ obtainted by filtering C with ˆ φ (trained with relabelling, threshold t = 0 . 5 ) can help with learning an individually fair downstream classifier, by training a RoBERTa-based toxicity classifier f using CLP with λ = 5 .

Original: More details can be found in App.
Revised: More details can be found in App.

Original: D. We train toxicity classifiers with CLP using constraint sets defined by word replacement ( C 1 and C 2 as in Sec. 4.2) and using all of C , or the filtered version ˆ C ⋆ .
Revised: D. We train toxicity classifiers with CLP using constraint sets defined by word replacement ( C 1 and Cas in Sec. 4.2) and using all of C , or the filtered version ˆ C ⋆ .

Original: Additionally, we train on a challenging set of constraints, C adverse that consists of C and 10000 adversarially selected pairs ( s, s ′ ) created by randomly selecting comments s with toxicity label y ( s ) =
Revised: Additionally, we train on a challenging set of constraints, C adverse that consists of C and 10000 adversarially selected pairs ( s, s ′ ) created by randomly selecting comments s with toxicity label y ( s ) =

Original: 1 and randomly selecting comments s ′ with label y
Revised: 1 and randomly selecting comments s ′ with label y

Original: ( s )
Revised: ( s )

Original: = 

Revised: =

Original: from D , and a filtered version ˆ C ⋆adverse of C adverse using threshold t = 0 .
Revised: from D , and a filtered version ˆ C ⋆adverse of C adverse using threshold t = 0 .

Original: We then evaluate these classifiers in terms of balanced accuracy and  fairness on the resulting classifiers on the test set T .
Revised: We then evaluate these classifiers in terms of balanced accuracy and individual fairness on the resulting classifiers on the test set T .

Original: Table 4 shows that compared to word replacement our expanded constraint set C consistently yields better adherence to human-validated fairness constraints at the cost of a bit of balanced accuracy.
Revised: Table 4 shows that compared to word replacement our expanded constraint set C consistently yields better adherence to human-validated fairness constraints at the cost of a bit of balanced accuracy.

Original: However, we do not find a clear improvement from using the filtered constraint set ˆ C ⋆ over the full set of constraints C .
Revised: However, we do not find a clear improvement from using the filtered constraint set ˆ C ⋆ over the full set of constraints C .

Original: We hypothesize that this is due to our classifier ˆ φ ’s limited True Positive Rate combined with φ ( s, s ′ ) equalling zero for most pairs ( s, s ′ ) ∈ C according to human annotators, such that even filtering with a perfect classifier ˆ φ might be of limited utility as most constraints in C are indeed relevant.
Revised: We hypothesize that this is due to our classifier ˆ φ ’s limited True Positive Rate combined with φ ( s, s ′ ) equalling zero for most pairs ( s, s ′ ) ∈ C according to human annotators, such that even filtering with a perfect classifier ˆ φ might be of limited utility as most constraints in C are indeed relevant.

Original: This is supported by our results for C adverse , where filtering substantially improves balanced accuracy.
Revised: This is supported by our results for C adverse , where filtering substantially improves balanced accuracy.

Original: Further experiments can be found in App.
Revised: Further experiments can be found in App.

Original: D
Revised: D.

Original: [Table]
Revised: [Table]

Revised: the upper/lower bound of a naive 95% confidence interval assuming normally distributed errors.

Original:  C ONCLUSION
Revised:  C ONCLUSION

Original: We proposed a framework for producing expressive and intuitive specifications for individual fairness in text classification.
Revised: We proposed a framework for producing expressive and intuitive specifications for individual fairness in text classification.

Original: We experimentally demonstrated that our pairs are more expressive than word replacement pairs and that most of the generated pairs were relevant in the context of toxicity classification according to human annotators.
Revised: We experimentally demonstrated that our pairs are more expressive than word replacement pairs and that most of the generated pairs were relevant in the context of toxicity classification according to human annotators.

Original: We also trained a classifier that automatically identifies relevant pairs and showed that our approach can improve the fairness of a toxicity classifier.
Revised: We also trained a classifier that automatically identifies relevant pairs and showed that our approach can improve the fairness of a toxicity classifier.

Original:  E THICS S TATEMENT
Revised:  E THICS S TATEMENT

Original: Our human evaluation experiments involving workers from Mechanical Turk were reviewed and approved by the IRB of PLACEHOLDER .
Revised: Our human evaluation experiments involving workers from Mechanical Turk were reviewed and approved by the IRB of PLACEHOLDER .

Original: Workers on Mechanical Turk were warned that they might be shown offensive comments as part of our study and were able to opt out of participating in our study at any time.
Revised: Workers on Mechanical Turk were warned that they might be shown offensive comments as part of our study and were able to opt out of participating in our study at any time.

Original: We also made sure that the per-task compensation was sufficiently high to result in a hourly compensation exceeding the US federal minimum wage.
Revised: We also made sure that the per-task compensation was sufficiently high to result in a hourly compensation exceeding the US federal minimum wage.

Original: More details on our human evaluation experiments can be found in App. A.
Revised: More details on our human evaluation experiments can be found in App. A.

Original: While we believe that our results show that learning more precise fairness notions by involving human feedback is a very promising area of research, we caution against directly using  our learnt similarity classifier ϕ for evaluating fairness in high-stakes real-world applications of toxicity classification.
Revised: While we believe that our results show that learning more precise fairness notions by involving human feedback is a very promising area of research, we caution against directly using the labels from our human evaluation study ϕ for evaluating fairness in high-stakes real-world applications of toxicity classification.

Original: First, our results show that there is substantial disagreement between different survey participants about which pairs ( s, s ′ ) require equal treatment by a fair classifier.
Revised: First, our results show that there is substantial disagreement between different survey participants about which pairs ( s, s ′ ) require equal treatment by a fair classifier.

Original: While resolving these disagreements via a majority vote is a natural choice, other approaches may be desired in some contexts (for e.g., enforcing equal treatment whenever at least one participant believes it is required).
Revised: While resolving these disagreements via a majority vote is a natural choice, other approaches may be desired in some contexts, for example enforcing equal treatment whenever at least one participant believes it is required or explicitly accounting for distributional information via jury learning (Gordon et al., 2022) or multi-annotator architecture (Davani et al., 2022).

Original: Second, our survey participants may have geographic biases and are neither direct stakeholders, nor experts in discrimination law and hate speech.
Revised: Second, our survey participants are geographically biased to the US and are neither direct stakeholders, nor experts in discrimination law and hate speech.

Original: Given that our learning approach shows promising signs of being able to improve upon existing  fairnessdefinitions despite large amounts of disagreement, which is likely to be less common for actual stakeholders and experts, we recommend using it in conjunction with fairness judgments provided by application-specific experts and stakeholders.
Revised: Given that our learning approach shows promising signs of being able to improve upon existing approaches to quantifying individual fairness despite large amounts of disagreement, which is likely to be less common for actual stakeholders and experts, we recommend using it in conjunction with fairness judgments provided by application-specific experts and stakeholders.

Revised: The collection of additional application-specific fairness labels ϕ is especially important when our framework is applied to downstream tasks other than toxicity classification, for which human agreement with the relevance of generated pairs to individual fairness could theoretically be substantially lower than indicated by our study.

Revised: In addition, the validity of collected labels should be reassessed periodically in order to account for shifts in linguistic, cultural and social contexts (Aroyo et al., 2019).

Revised: In addition, our generated pairs only cover perturbations along a fixed list of demographic groups such that fulfilling individual fairness on these pairs does not guarantee invariance to other forms of perturbations.

Revised: Correspondingly, evaluation on these pairs can help to provide better evidence about the extent of demographic biases but not necessarily other forms of bias present in a text classifier.

Original:  R EPRODUCIBILITY S TATEMENT
Revised:  R EPRODUCIBILITY S TATEMENT

Original: We provide code to reproduce our generation pipeline and our experiments on synthetic data in the appendix.
Revised: We provide code to reproduce our generation pipeline and our experiments on synthetic data in the appendix.

Revised: Our dataset including the pairs generated by our approach and aggregate human fairness judgments are hosted at PLACEHOLDER.

Original: All of our experiments involving transformer language models use the huggingface transformers library Wolf et al.
Revised: All of our experiments involving transformer language models use the huggingface transformers library Wolf et al.

Original: Details of human evaluation are provided in App.
Revised: Details of human evaluation are provided in App.

Original: A
Revised: A

Original: A F URTHER D ETAILS ON H UMAN EVALUATION
Revised: A F URTHER D ETAILS ON H UMAN EVALUATION

Original: In order to participate, workers had to live in the US and be above 18 years old in addition to being experienced with MechanicalTurk (having completed more than 5000 HITs 5 and having a good reputation ( 97% acceptance rate across all of the worker’s HITs).
Revised: In order to participate, workers had to live in the US and be above 18 years old in addition to being experienced with MechanicalTurk (having completed more than 5000 HITs 5 and having a good reputation ( 97% acceptance rate across all of the worker’s HITs).

Original: Workers were warned about the potentially offensive content of some of the comments show in the study by the following statement: "Please note that this study contains offensive content.
Revised: Workers were warned about the potentially offensive content of some of the comments show in the study by the following statement: "Please note that this study contains offensive content.

Original: If you do not wish to see such content, please withdraw from the study by leaving this website."
Revised: If you do not wish to see such content, please withdraw from the study by leaving this website."

Original: and were also told that they could withdraw from the study at any later point: "You may withdraw your participation at any time without specifying reasons and without any disadvantages (however, you will not get paid for the current HIT in case you withdraw before completing it)".
Revised: and were also told that they could withdraw from the study at any later point: "You may withdraw your participation at any time without specifying reasons and without any disadvantages (however, you will not get paid for the current HIT in case you withdraw before completing it)".

Original: After encountering a high prevalence of bots, malicious workers or workers that fundamentally misunderstood our task instructions during pilot experiments, we had workers pass a qualification test by providing correct answers for nine out of ten queries φ ( s, s ′ ) for pairs that were handdesigned to have a relatively obvious correct answer.
Revised: After encountering a high prevalence of bots, malicious workers or workers that fundamentally misunderstood our task instructions during pilot experiments, we had workers pass a qualification test by providing correct answers for nine out of ten queries φ ( s, s ′ ) for pairs that were handdesigned to have a relatively obvious correct answer.

Original: We validated these hand-designed pairs in a separate experiment, querying workers about φ ( s, s ′ ) for 11 pairs ( s, s ′ ), and asking them to verbally explain each of their decisions, paying a total of $1 . 83 .
Revised: We validated these hand-designed pairs in a separate experiment, querying workers about φ ( s, s ′ ) for 11 pairs ( s, s ′ ), and asking them to verbally explain each of their decisions, paying a total of $1 . 83 .

Original: We only included hand-designed pairs in the qualification test if at least eight out of ten workers produced the intended answer during this experiment, and no worker brought forward convincing arguments against this answer being correct.
Revised: We only included hand-designed pairs in the qualification test if at least eight out of ten workers produced the intended answer during this experiment, and no worker brought forward convincing arguments against this answer being correct.

Original: Workers were paid $0 .
Revised: Workers were paid $0 .

Original: 83 for a battery of 11 queries φ ( s, s ′ )
Revised: 83 for a battery of 11 queries φ ( s, s ′ )

Original: for the Active learning and the test set
Revised: for the Active learning and the test set

Original: T and first $1 . 20 , later $1 . 30 for 11 queries about all questions presented in Table 2.
Revised: T and first $1 . 20 , later $1 . 30 for 11 queries about all questions presented in Table 2.

Original: In both cases, workers had to explain one of their answers verbally, and one of the queries was a attention check pair ( s, s ′ ) with a relatively obvious correct answer constructed in the same way as for the qualification tests.
Revised: In both cases, workers had to explain one of their answers verbally, and one of the queries was a attention check pair ( s, s ′ ) with a relatively obvious correct answer constructed in the same way as for the qualification tests.

Original: Blocks of queries with wrong answers to the attention check question or (partially) incoherent verbal explanations were manually reviewed, and thrown out in case we were not able to find evidence that the worker had correctly understood the task in which case the worker was not paid.
Revised: Blocks of queries with wrong answers to the attention check question or (partially) incoherent verbal explanations were manually reviewed, and thrown out in case we were not able to find evidence that the worker had correctly understood the task in which case the worker was not paid.

Original: Workers were made aware of this by the following statement in the task description: "To ensure workers pay attention, we include pairs of comments for which there is a clear correct answer at random positions.
Revised: Workers were made aware of this by the following statement in the task description: "To ensure workers pay attention, we include pairs of comments for which there is a clear correct answer at random positions.

Original: Please make sure to carefully read every comment and answer diligently, as your HIT will be rejected if your answer for one of these pairs of comments is wrong, in which case you will not receive a payment for the HIT.
Revised: Please make sure to carefully read every comment and answer diligently, as your HIT will be rejected if your answer for one of these pairs of comments is wrong, in which case you will not receive a payment for the HIT.

Original: We will also ask you to produce an explanation for one of your answers.
Revised: We will also ask you to produce an explanation for one of your answers.

Original: Please write at least one sentence and make sure your explanation is coherent with the answer you gave, as your HIT might be rejected otherwise in which case you will not receive a payment for the HIT.".
Revised: Please write at least one sentence and make sure your explanation is coherent with the answer you gave, as your HIT might be rejected otherwise in which case you will not receive a payment for the HIT.".

Original: According to https://turkerview.com, a tool used by many professional workers on MechanicalTurk, we paid workers an average hourly rate of $16 .
Revised: According to https://turkerview.com, a tool used by many professional workers on MechanicalTurk, we paid workers an average hourly rate of $16 .

Original: 17 , clearly exceeding the US minimum wage.
Revised: 17 , clearly exceeding the US minimum wage.

Original: While this is likely an overestimate, as not all workers use turkerview, the hourly rate is so high, that we still exceed the minimum wage for workers taking twice as long as the average worker using turkerview.
Revised: While this is likely an overestimate, as not all workers use turkerview, the hourly rate is so high, that we still exceed the minimum wage for workers taking twice as long as the average worker using turkerview.

Original: Workers were introduced to the task as follows: "We are investigating fairness in toxic comment classification and are looking for pairs of comments with similar content that should be treated the same by a content moderator (if one of them was removed, the other one should be removed too).
Revised: Workers were introduced to the task as follows: "We are investigating fairness in toxic comment classification and are looking for pairs of comments with similar content that should be treated the same by a content moderator (if one of them was removed, the other one should be removed too).

Original: You will be shown pairs of comments and be asked whether the comments are similar in various ways and whether you would consider it unfair for a content moderator to remove one of the comments in each pair but not the other.".
Revised: You will be shown pairs of comments and be asked whether the comments are similar in various ways and whether you would consider it unfair for a content moderator to remove one of the comments in each pair but not the other.".

Original: The queries read as follows for the first task:
Revised: The queries read as follows for the first task:

Original: • Without further context, would the average american consider it unfair or acceptable for a content moderator to delete one of the shown comments but not the other?
Revised: • Without further context, would the average american consider it unfair or acceptable for a content moderator to delete one of the shown comments but not the other?

Original: – It would be unfair for one of the two comments but not the other to be deleted (Both comments ought to be treated the same way, no matter what)
Revised: – It would be unfair for one of the two comments but not the other to be deleted (Both comments ought to be treated the same way, no matter what)

Original: – If comment a) was deleted, comment b) should be deleted as well, but not the other way around.
Revised: – If comment a) was deleted, comment b) should be deleted as well, but not the other way around.

Original: (Deleting comment b) would be more justifiable)
Revised: (Deleting comment b) would be more justifiable)

Original: – If comment b) was deleted, comment a) should be deleted as well, but not the other way around.
Revised: – If comment b) was deleted, comment a) should be deleted as well, but not the other way around.

Original: (Deleting comment a) would be more justifiable)
Revised: (Deleting comment a) would be more justifiable)

Original: – It would be acceptable to delete either of the comments without deleting the other.
Revised: – It would be acceptable to delete either of the comments without deleting the other.

Original: (Treating the comments differently either way would be fine)
Revised: (Treating the comments differently either way would be fine)

Original: and as follows for the second one (Placeholders for group terms are presented in Italics .
Revised: and as follows for the second one (Placeholders for group terms are presented in Italics .

Original: The answer summarized in Table 2 is highlighted in bold ):
Revised: The answer summarized in Table 2 is highlighted in bold ):

Original: • Without further context, would you consider it unfair or acceptable for a content moderator to delete one of the shown comments but not the other?
Revised: • Without further context, would you consider it unfair or acceptable for a content moderator to delete one of the shown comments but not the other?

Original: – It would be unfair for one of the two comments but not the other to be deleted (Both comments ought to be treated the same way, no matter what)
Revised: – It would be unfair for one of the two comments but not the other to be deleted (Both comments ought to be treated the same way, no matter what)

Original: – If comment a) was deleted, comment b) should be deleted as well, but not the other way around.
Revised: – If comment a) was deleted, comment b) should be deleted as well, but not the other way around.

Original: (Deleting comment b) would be more justifiable)
Revised: (Deleting comment b) would be more justifiable)

Original: – If comment b) was deleted, comment a) should be deleted as well, but not the other way around.
Revised: – If comment b) was deleted, comment a) should be deleted as well, but not the other way around.

Original: (Deleting comment a) would be more justifiable)
Revised: (Deleting comment a) would be more justifiable)

Original: – It would be acceptable to delete either of the comments without deleting the other.
Revised: – It would be acceptable to delete either of the comments without deleting the other.

Original: (Treating the comments differently either way would be fine) •
Revised: (Treating the comments differently either way would be fine) •

Original: What do you expect the average American to answer to the previous question?
Revised: What do you expect the average American to answer to the previous question?

Original: – It would be unfair for one of the two comments but not the other to be deleted (Both comments ought to be treated the same way, no matter what)
Revised: – It would be unfair for one of the two comments but not the other to be deleted (Both comments ought to be treated the same way, no matter what)

Original: – If comment a) was deleted, comment b) should be deleted as well, but not the other way around.
Revised: – If comment a) was deleted, comment b) should be deleted as well, but not the other way around.

Original: (Deleting comment b) would be more justifiable)
Revised: (Deleting comment b) would be more justifiable)

Original: – If comment b) was deleted, comment a) should be deleted as well, but not the other way around.
Revised: – If comment b) was deleted, comment a) should be deleted as well, but not the other way around.

Original: (Deleting comment a) would be more justifiable)
Revised: (Deleting comment a) would be more justifiable)

Original: – It would be acceptable to delete either of the comments without deleting the other.
Revised: – It would be acceptable to delete either of the comments without deleting the other.

Original: (Treating the comments differently either way would be fine
Revised: (Treating the comments differently either way would be fine

Original: ) • Do you consider one of the two comments to be more factually correct than the other?
Revised: ) • Do you consider one of the two comments to be more factually correct than the other?

Original: – Comment a – Comment b – Neither comment / too little context to tell • Do you consider one of the two comments to be more grammatically correct than the other?
Revised: – Comment a – Comment b – Neither comment / too little context to tell • Do you consider one of the two comments to be more grammatically correct than the other?

Original: – Comment a – Comment b – Neither comment • Is comment a) about group a and comment b) about group b ?
Revised: – Comment a – Comment b – Neither comment • Is comment a) about group a and comment b) about group b ?

Original: – Yes – No, comment a) is not about group a – No, comment b) is not about group b – No, neither • Apart from differences related to group a and group b , are both comments similar in terms of content?
Revised: – Yes – No, comment a) is not about group a – No, comment b) is not about group b – No, neither • Apart from differences related to group a and group b , are both comments similar in terms of content?

Original: – Yes, they are almost the same.
Revised: – Yes, they are almost the same.

Original: – They are somewhat similar, but differ in some additional details.
Revised: – They are somewhat similar, but differ in some additional details.

Original: – There is an important additional difference between the comments’ content
Revised: – There is an important additional difference between the comments’ content

Revised: Table A.1 shows an extended version of Table 2 and includes human annotator’s answers to additional questions.

Revised: It shows that the reason why the advantages of word replacement in terms of group transfer and content preservation do not fully translate to producing pairs that represent actual fairness constraints could be due to its worse performance in terms of preserving factuality.

Revised: Indeed, we found examples in which word replacement transformed "white house" to "black house"; or Obama is referred to as "white" rather than "black" in a modified comment.

Revised: These pairs were not seen as fairness constraints by most annotators, while also being judged badly in terms of preserving factuality.

Original: A.1 shows the results of the human evaluation on our test set S split along the axis of attribute transfer, rather than generation method as in 2.
Revised: Table A.2 shows the results of the human evaluation on our test set S split along the axis of attribute transfer, rather than generation method as in 2.

Original: Along with the results in Table 2 they show that despite the general agreement about the relevance of the generated fairness constraints, there is  substantial disagreement between annotators when it comes to deviations from the most common answer across all comments.
Revised: Along with the results in Table 2 they show that despite the general agreement about the relevance of the generated fairness constraints, there is [Table] substantial disagreement between annotators when it comes to deviations from the most common answer across all comments.

Original: In all cases, the fraction of comments with majority vote equal to that answer is substantially higher than the overall fraction of these votes across all comments and annotators.
Revised: In all cases, the fraction of comments with majority vote equal to that answer is substantially higher than the overall fraction of these votes across all comments and annotators.

Original: The same is true for our set T of 500 randomly selected pairs from C for which we only asked about the average American’s fairness judgment: 70 .
Revised: The same is true for our set T of 500 randomly selected pairs from C for which we only asked about the average American’s fairness judgment: 70 .

Original: 9% of the annotations were φ ( s, s ′ )
Revised: 9% of the annotations were φ ( s, s ′ )

Original: = 0 , while the same was true for 78 .
Revised: = 0 , while the same was true for 78 .

Original: 8% of the per-comment pair majority votes.
Revised: 8% of the per-comment pair majority votes.

Original: [Table]
Revised: [Table]

Original: B F URTHER DETAILS ON STYLE TRANSFER
Revised: B F URTHER DETAILS ON STYLE TRANSFER

Original: Unsupervised style transfer To transform markers of demographic groups in sentences, we first finetune a Multi-headed RoBERTa-based (Liu et al., 2019) classifier c to predict labels
Revised: Unsupervised style transfer To transform markers of demographic groups in sentences, we first finetune a Multi-headed RoBERTa-based (Liu et al., 2019) classifier c to predict labels

Original: y j indicating the presence of markers of a demographic group j from a list of protected demographic groups J in a sentence s .
Revised: y j indicating the presence of markers of a demographic group j from a list of protected demographic groups J in a sentence s .

Original: We use the population labels ("Black", "Male", "Heterosexual", "Muslim",etc.)
Revised: We use the population labels ("Black", "Male", "Heterosexual", "Muslim",etc.)

Original: that are provided for a subset of the Civil comments dataset.
Revised: that are provided for a subset of the Civil comments dataset.

Original: The group-presence classifier c is based on the roberta-base model, followed by a linear layer with 768 neurons applied to the output embedding of the first token only, a Tanh layer, another linear layer mapping to a single dimension, and a Sigmoid layer.
Revised: The group-presence classifier c is based on the roberta-base model, followed by a linear layer with 768 neurons applied to the output embedding of the first token only, a Tanh layer, another linear layer mapping to a single dimension, and a Sigmoid layer.

Original: We train c for 3 epochs with a batch size of 16 and use the Adam optimizer
Revised: We train c for 3 epochs with a batch size of 16 and use the Adam optimizer

Original: Kingma & Ba (2014) with learning rate 0 .
Revised: Kingma & Ba (2014) with learning rate 0 .

Original: to optimize the binary Cross Entropy loss, reweighed by relative label frequency in the dataset.
Revised: to optimize the binary Cross Entropy loss, reweighed by relative label frequency in the dataset.

Original: Table B.1 shows the balanced accuracy on the test set for all demographic groups in the dataset.
Revised: Table B.1 shows the balanced accuracy on the test set for all demographic groups in the dataset.

Original: For our downstream applications of c , we restrict ourselves to the demographic groups for which the classifier c ’s balanced accuracy is above 90% .
Revised: For our downstream applications of c , we restrict ourselves to the demographic groups for which the classifier c ’s balanced accuracy is above 90% .

Original: Furthermore, we also exclude the group labeled "mental illness" because the word replacement lists we used lack a clear analogon.
Revised: Furthermore, we also exclude the group labeled "mental illness" because the word replacement lists we used lack a clear analogon.

Original: Then, we finetune a BART-based (Lewis et al., 2019)
Revised: Then, we finetune a BART-based (Lewis et al., 2019)

Original: generator g on a mask-filling task on the same data: For every data point s , we sample a group from the set of demographic groups j mentioned in s , i.e. { j : y j ( s ) = 1 } , skipping sentences s for which no group j meets this criterion.
Revised: generator g on a mask-filling task on the same data: For every data point s , we sample a group from the set of demographic groups j mentioned in s , i.e. { j : y j ( s ) = 1 } , skipping sentences s for which no group j meets this criterion.

Original: Inspired by (Reid & Zhong, 2021)
Revised: Inspired by (Reid & Zhong, 2021)

Original: we mask all of s ’s tokens that have an above-average attention value for the 11th layer of the classifier c , merge consecutive mask tokens into one, and prepend the name of the sampled group j to the masked sentence before fedding it to the generator g .
Revised: we mask all of s ’s tokens that have an above-average attention value for the 11th layer of the classifier c , merge consecutive mask tokens into one, and prepend the name of the sampled group j to the masked sentence before fedding it to the generator g .

Original: The generator g is then finetuned to reconstruct s using token-wise Cross Entropy.
Revised: The generator g is then finetuned to reconstruct s using token-wise Cross Entropy.

Original: The BART-based generator g is trained starting from the pretrained facebook/bart-large model for a single epoch with batch size 4, again using Adam and a learning rate of 0 . 00001 .
Revised: The BART-based generator g is trained starting from the pretrained facebook/bart-large model for a single epoch with batch size 4, again using Adam and a learning rate of 0 . 00001 .

Original: For filling in masked sentences, we pick the completion with the largest difference in the classifier c ’s pre-sigmoid activation for the target and source demographic groups j ′ and j among candidate sentences produced by a beam search generation using the generator g with width 5 .
Revised: For filling in masked sentences, we pick the completion with the largest difference in the classifier c ’s pre-sigmoid activation for the target and source demographic groups j ′ and j among candidate sentences produced by a beam search generation using the generator g with width 5 .

Original: To transfer an example s from mentioning group j to mentioning group j ′ , we follow (Lee, 2020) and iteratively mask the token for which masking reduces p c ( y j | x ) the most, until we reach a threshold of p c ( y j | x ) < 0 .
Revised: To transfer an example s from mentioning group j to mentioning group j ′ , we follow (Lee, 2020) and iteratively mask the token for which masking reduces p c ( y j | x ) the most, until we reach a threshold of p c ( y j | x ) < 0 .

Original: We use this approach rather than the attention-based masking from (Reid &
Revised: We use this approach rather than the attention-based masking from (Reid &

Original: Zhong, 2021) because of the lack of theoretical motivation for using attention to identify important features (Bastings & Filippova, 2020), and because attention scores are the same for all of our model’s group-presence prediction heads, rather than specific to a particular group j . 

Revised: Zhong, 2021) because of the lack of theoretical motivation for using attention to identify important features (Bastings & Filippova, 2020), and because attention scores are the same for all of our model’s group-presence prediction heads, rather than specific to a particular group j .

Original: Then, we prepend a verbal representation of label j ′ to s to form a prompt p , and generate a sentence s ′ as g ( p ) . 
Revised: Then, we prepend a verbal representation of label j ′ to s to form a prompt p , and generate a sentence s ′ as g ( p ) . [Table]

Original: Word replacement
Revised: Word replacement

Original: Our word replacement approach is based on the list of words provided in Smith et al.
Revised: Our word replacement approach is based on the list of words provided in Smith et al.

Original: Given a sentence s mentioning demographic group j and a target attribute j ′ , we replace all words in s that are on the list associated with j with random words from the list associated with j ′ , replacing nouns with nouns and descriptors with descriptors whenever possible, and nouns with descriptors otherwise.
Revised: Given a sentence s mentioning demographic group j and a target attribute j ′ , we replace all words in s that are on the list associated with j with random words from the list associated with j ′ , replacing nouns with nouns and descriptors with descriptors whenever possible, and nouns with descriptors otherwise.

Original: The full list of words we used for word replacement is displayed in Table E.1.[Table]
Revised: The full list of words we used for word replacement is displayed in Table E.1.

Original: GPT-

Revised: GPT-

Original: We accessed GPT-3 using OpenAI’s API 7 .
Revised: We accessed GPT-3 using OpenAI’s API 7 .

Original: For our first approach, we used the "text-davinci001" version of GPT3 in a zero-shot manner with the prompt: "Please rewrite the following sentence to be about j ′ rather than j :" followed by a new line and the targeted sentence s .
Revised: For our first approach, we used the "text-davinci001" version of GPT3 in a zero-shot manner with the prompt: "Please rewrite the following sentence to be about j ′ rather than j :" followed by a new line and the targeted sentence s .

Original: The second approach was based on the beta-version of GPT-3’s editing mode 8 .
Revised: The second approach was based on the beta-version of GPT-3’s editing mode 8 .

Original: Here, s ′ is produced using the model "text-davinci-edit-001" with the instruction "Rewrite the text to be about j ′ rather than j ".
Revised: Here, s ′ is produced using the model "text-davinci-edit-001" with the instruction "Rewrite the text to be about j ′ rather than j ".

Original: Lastly, we used to same model in conjunction with word replacement:
Revised: Lastly, we used to same model in conjunction with word replacement:

Original: First, we generated a candidate sentence s ′′ using the procedure described in the word replacement section.
Revised: First, we generated a candidate sentence s ′′ using the procedure described in the word replacement section.

Original: Then, in order to fix issues caused by the context-blindness of the word replacement approach, we postprocessed s ′′ using "text-davinciedit-001" with the instruction "Fix grammatical errors and logical inconsistencies" to produce s ′ .
Revised: Then, in order to fix issues caused by the context-blindness of the word replacement approach, we postprocessed s ′′ using "text-davinciedit-001" with the instruction "Fix grammatical errors and logical inconsistencies" to produce s ′ .

Original: We used temperature = 0 .
Revised: We used temperature = 0 .

Original: 7 and top_p = 1 in all our approaches and used max_tokens = 64 for "text-davinci-001" to control the length of the modified sentence s ′ .
Revised: 7 and top_p = 1 in all our approaches and used max_tokens = 64 for "text-davinci-001" to control the length of the modified sentence s ′ .

Original: Post-filtering For all three approaches, we performed a post-filtering step to reduce the prevalence of unsuccesful attempts at demographic group transfer in our set of constraints C .
Revised: Post-filtering For all three approaches, we performed a post-filtering step to reduce the prevalence of unsuccesful attempts at demographic group transfer in our set of constraints C .

Original: Given a pair ( s, s ′ ) of an original sentence and a modified version, we only include it in our set of constraints C , if the classifier probability p c ( y j ′ | s ′ ) for label j ′ is below 0 .
Revised: Given a pair ( s, s ′ ) of an original sentence and a modified version, we only include it in our set of constraints C , if the classifier probability p c ( y j ′ | s ′ ) for label j ′ is below 0 .

Original: 5 and the classifier probability p c ( y j | s ′ )
Revised: 5 and the classifier probability p c ( y j | s ′ )

Original: for label j is above 0 .
Revised: for label j is above 0 .

Original: As mentioned in Sec.
Revised: As mentioned in Sec.

Original: 4.1, we attempt to produce modified comments s ′ j ′ mentioning group j ′ for each s in D ′ for all demographic groups j with y j ( s ) = 1 and all possible target groups j ′ for word replacement and style transfer.
Revised: 4.1, we attempt to produce modified comments s ′ j ′ mentioning group j ′ for each s in D ′ for all demographic groups j with y j ( s ) = 1 and all possible target groups j ′ for word replacement and style transfer.

Original: For GPT-3, we attempted a total of 75 generations for each of our three generation modes per axis pair of demographic groups ( j, j ′ ) and direction of group transfer, with the source sentences s randomly selected among the sentences with label j in D ′ .
Revised: For GPT-3, we attempted a total of 75 generations for each of our three generation modes per axis pair of demographic groups ( j, j ′ ) and direction of group transfer, with the source sentences s randomly selected among the sentences with label j in D ′ .

Original: For constructing the secondary test set S , we attempted more generations for the axes male ↔ female, christian ↔ muslim and black ↔ white, homosexual ↔ heterosexual.
Revised: For constructing the secondary test set S , we attempted more generations for the axes male ↔ female, christian ↔ muslim and black ↔ white, homosexual ↔ heterosexual.

Original: The latter axis was left out of S because we found that the rate of successful generations was too limited.
Revised: The latter axis was left out of S because we found that the rate of successful generations was too limited.

Original: We generated a maximum of 2250 attempts up until a total of 250 successful generations (post-filtering step passed) for GPT-3’s zero-shot mode, a maximum of 750 until to a total of 100 successful generations for GPT-3’s edit mode, and up until a total of 100 successful generations for GPT-3 based postprocessing of word replacement.
Revised: We generated a maximum of 2250 attempts up until a total of 250 successful generations (post-filtering step passed) for GPT-3’s zero-shot mode, a maximum of 750 until to a total of 100 successful generations for GPT-3’s edit mode, and up until a total of 100 successful generations for GPT-3 based postprocessing of word replacement.

Original: Table B. shows the overall amount of generated pairs per method.
Revised: Table B. shows the overall amount of generated pairs per method.

Original: [Table]
Revised: [Table]

Original: [Table] [Table] [Table] As an additional experiment to validate the increased diversity of our constraint set C we train a similarity classifier 9 ˆ φ , on C to distinguish pairs ( s, s ′ ) generated by word replacement from pairs generated by style transfer or GPT-3.
Revised: As an additional experiment to validate the increased diversity of our constraint set C we train a similarity classifier 9 ˆ φ , on C to distinguish pairs ( s, s ′ ) generated by word replacement from pairs generated by style transfer or GPT-3.

Original: Training on 100000 examples without label noise, we are able to achieve over 91 .
Revised: Training on 100000 examples without label noise, we are able to achieve over 91 .

Original: 6% test accuracy on a balanced test set, suggesting that there is a meaningful difference between pairs generated by word replacement and the rest of the constraint candidates C .
Revised: 6% test accuracy on a balanced test set, suggesting that there is a meaningful difference between pairs generated by word replacement and the rest of the constraint candidates C .

Original: C F URTHER DETAILS ON LEARNING SIMILARITY FUNCTIONS
Revised: C F URTHER DETAILS ON LEARNING SIMILARITY FUNCTIONS

Original: First, Proposition C.1 below establishes that robustness with respect to a binary similarity function φ , i.e. φ ( s, s ′ )
Revised: First, Proposition C.1 below establishes that robustness with respect to a binary similarity function φ , i.e. φ ( s, s ′ )

Original: = 

Revised: =

Original: ⇒ f
Revised: ⇒ f

Original: ( s ) =
Revised: ( s ) =

Original: f ( s ′ ) , can fully capture the definition of individual fairness as
Revised: f ( s ′ ) , can fully capture the definition of individual fairness as

Original: Lipschitz-Continuity proposed by Dwork et al.
Revised: Lipschitz-Continuity proposed by Dwork et al.

Original: (2012) for deterministic classifiers f .
Revised: (2012) for deterministic classifiers f .

Original: Proposition C.1.
Revised: Proposition C.1.

Original: Given a metric d : X × X → R , a binary metric d b : Y × Y → { 0 , 1 } and a constant L > 0 , there exists a similarity function φ :
Revised: Given a metric d : X × X → R , a binary metric d b : Y × Y → { 0 , 1 } and a constant L > 0 , there exists a similarity function φ :

Original: X × X → { 0 , 1 } such that a function f : ( X, d ) → ( Y, d b ) is Lipschitz-Continuous with constant L if and only if φ ( x, x ′ ) ≥ d b ( f ( x ) , f ( x ′ ))
Revised: X × X → { 0 , 1 } such that a function f : ( X, d ) → ( Y, d b ) is Lipschitz-Continuous with constant L if and only if φ ( x, x ′ ) ≥ d b ( f ( x ) , f ( x ′ ))

Original: for all x, x ′ ∈ X .
Revised: for all x, x ′ ∈ X .

Original: Proof.
Revised: Proof.

Original: Define φ ( x, x ′ ) :
Revised: Define φ ( x, x ′ ) :

Original: = 1 { Ld ( x, x ′ ) ≥ 1 } .
Revised: = 1 { Ld ( x, x ′ ) ≥ 1 } .

Original: Then whenever d b ( f ( x ) , f ( x ′ ))
Revised: Then whenever d b ( f ( x ) , f ( x ′ ))

Original: = 1 , we have d b ( f ( x ) , f ( x ′ ))
Revised: = 1 , we have d b ( f ( x ) , f ( x ′ ))

Original: = 1 ≤ φ ( x, x ′ )
Revised: = 1 ≤ φ ( x, x ′ )

Original: if and only if d b ( f ( x ) , f ( x ′ ))
Revised: if and only if d b ( f ( x ) , f ( x ′ ))

Original: ≤ Ld ( x, x ′ ) .
Revised: ≤ Ld ( x, x ′ ) .

Original: But if d b ( f ( x ) , f ( x ′ )) = 0 , the Lipschitz inequality is allways true.
Revised: But if d b ( f ( x ) , f ( x ′ )) = 0 , the Lipschitz inequality is allways true.

Original: Now, assume that f is not Lipschitz: Then, there exist x, x ′ ∈
Revised: Now, assume that f is not Lipschitz: Then, there exist x, x ′ ∈

Original: X such that 1 = d b ( f ( x ) , f ( x ′ ))
Revised: X such that 1 = d b ( f ( x ) , f ( x ′ ))

Original: >
Revised: >

Original: Ld ( x, x ′ ) , implying 

Revised: Ld ( x, x ′ ) , implying

Original: = φ ( x, x ′ ) <
Revised: = φ ( x, x ′ ) <

Original: d b ( f ( x ) , f ( x ′ ))
Revised: d b ( f ( x ) , f ( x ′ ))

Original: =
Revised: =

Original: We use a BERT-based classifier that acts on a pair ( s, s ′ ) by first tokenizing both s and s ′ and padding the token representation to a length of 64 , concatenating these tokens and feeding the concatenated token representation into a pretrained bert-uncased-base model.
Revised: We use a BERT-based classifier that acts on a pair ( s, s ′ ) by first tokenizing both s and s ′ and padding the token representation to a length of 64 , concatenating these tokens and feeding the concatenated token representation into a pretrained bert-uncased-base model.

Original: We then apply a linear layer with dropout ( p = 0 . 1 ) followed by a Tanh layer and a second linear layer with dropout ( p = 0 . 1 ) to obtain single dimensional logits, to which a sigmoid layer is applied before computing the binary
Revised: We then apply a linear layer with dropout ( p = 0 . 1 ) followed by a Tanh layer and a second linear layer with dropout ( p = 0 . 1 ) to obtain single dimensional logits, to which a sigmoid layer is applied before computing the binary

Original: Cross Entropy loss.
Revised: Cross Entropy loss.

Original: We use BERT rather than more modern models such as RoBERTa (Liu et al., 2019) and Deberta (He et al., 2020), as we have found it to clearly outperform them for our task, plausibly because BERT uses a next-sentence-prediction task during pretraining, which is structurally similar to our task of comparing two sentences.
Revised: We use BERT rather than more modern models such as RoBERTa (Liu et al., 2019) and Deberta (He et al., 2020), as we have found it to clearly outperform them for our task, plausibly because BERT uses a next-sentence-prediction task during pretraining, which is structurally similar to our task of comparing two sentences.

Original: Table C.1 demonstrates the advantage of using BERT, as well as concatenating token representations rather than learning based on the difference between separately produced BERT features for both s and s ′ .
Revised: Table C.1 demonstrates the advantage of using BERT, as well as concatenating token representations rather than learning based on the difference between separately produced BERT features for both s and s ′ .

Original: Unless stated otherwise, our Active Learning approach trains for five epochs on each queried block D i before selecting new data D i +1 to label.
Revised: Unless stated otherwise, our Active Learning approach trains for five epochs on each queried block D i before selecting new data D i +1 to label.

Original: Example generations for our different methods can be found in App.
Revised: Example generations for our different methods can be found in App.

Original: E.
Revised: E.

Revised: [Table]

Revised: pads both to 64 tokens before feeding the concatenated tokens into the model.

Revised: No dropout was used in the post-BERT layers for these experiments.

Revised: All results averaged over 10 runs and ± indicates the difference from the upper/lower bound of a naive 95% confidence interval assuming normally distributed errors.

Original: C. S YNTHETIC D ATA
Revised: C. S YNTHETIC D ATA

Original: For active learning, we freeze the underlying BERT model during the active learning selection and only apply MC-Dropout on the level of the classifier head, similar to (Grießhaber et al., 2020), but unlike them we do not use BALD (Houlsby et al., 2011) and instead approximate p ( y | s, s ′ ) averaging the models’ predicted probabilities p ˆ φ ( y | s, s ′ , w ) for 50 sampled dropout masks w .
Revised: For active learning, we freeze the underlying BERT model during the active learning selection and only apply MC-Dropout on the level of the classifier head, similar to (Grießhaber et al., 2020), but unlike them we do not use BALD (Houlsby et al., 2011) and instead approximate p ( y | s, s ′ ) averaging the models’ predicted probabilities p ˆ φ ( y | s, s ′ , w ) for 50 sampled dropout masks w .

Original: We call this approach LC-UNC and experimented with various alternative selection criteria.
Revised: We call this approach LC-UNC and experimented with various alternative selection criteria.

Original: Unlike
Revised: Unlike

Original: LC-UNC, LC directly approximates 1 − max y p ( y | s, s ′ ) using a single forward pass through the ˆ φ with deactivated dropout.
Revised: LC-UNC, LC directly approximates 1 − max y p ( y | s, s ′ ) using a single forward pass through the ˆ φ with deactivated dropout.

Original: BALD is the approach from Grießhaber et al.
Revised: BALD is the approach from Grießhaber et al.

Original: (2020), while VARRA and
Revised: (2020), while VARRA and

Original: Majority approximate 1 − max y p ( y | s, s ′ ) using MC-Dropout differently than LC-UNC:
Revised: Majority approximate 1 − max y p ( y | s, s ′ ) using MC-Dropout differently than LC-UNC:

Original: In Majority, p ( y | s, s ′ ) is approximated as the fraction of dropout samples w for which ˆ φ = 1 , while VARRA averages 1 − max y p
Revised: In Majority, p ( y | s, s ′ ) is approximated as the fraction of dropout samples w for which ˆ φ = 1 , while VARRA averages 1 − max y p

Original: ˆ φ ( y | s, s ′ , w ) over dropout samples w instead of averaging p ˆ φ ( y | s, s ′ , w ) before applying the maximum operator.
Revised: ˆ φ ( y | s, s ′ , w ) over dropout samples w instead of averaging p ˆ φ ( y | s, s ′ , w ) before applying the maximum operator.

Original: In addition, the table contains the "automatic relabeling" condition in which D
Revised: In addition, the table contains the "automatic relabeling" condition in which D

Original: i is selected from the whole of C rather than just the previously unlabeled examples
Revised: i is selected from the whole of C rather than just the previously unlabeled examples

Original: D i ⊂ C \ (cid:83) j<i D j .
Revised: D i ⊂ C \ (cid:83) j<i D j .

Original: During training, pairs ( s, s ′ ) that have been queried multiple times are labelled according to the majority vote of all queries, and as 0 .
Revised: During training, pairs ( s, s ′ ) that have been queried multiple times are labelled according to the majority vote of all queries, and as 0 .

Original: 5 in case of a tie.
Revised: 5 in case of a tie.

Original: We validate the efficacy of our active learning approach for learning the similarity function φ ( s, s ′ ) with a limited amount of noisy queries.
Revised: We validate the efficacy of our active learning approach for learning the similarity function φ ( s, s ′ ) with a limited amount of noisy queries.

Original: For this, we define two synthetic similarity functions φ i : i ∈ { 1 , 2 } .
Revised: For this, we define two synthetic similarity functions φ i : i ∈ { 1 , 2 } .

Original: The first, φ 1 is equal to zero, whenever a pair ( s, s ′ ) was generated via word replacement and equal to one otherwise, as in the first experiment from the previous section.
Revised: The first, φ 1 is equal to zero, whenever a pair ( s, s ′ ) was generated via word replacement and equal to one otherwise, as in the first experiment from the previous section.

Original: The second, φ 2 is equal to zero, whenever the group j of s that was removed and the added group j ′ in s ′ are within the same category of gender and sexuality, race, or religion, and equal to one otherwise.
Revised: The second, φ 2 is equal to zero, whenever the group j of s that was removed and the added group j ′ in s ′ are within the same category of gender and sexuality, race, or religion, and equal to one otherwise.

Original: For example, a pair ( s, s ′ ) for which markers of "White people" in s were modified to markers of "Black[Table] people" in s ′ would have φ 2 ( s, s ′ )
Revised: For example, a pair ( s, s ′ ) for which markers of "White people" in s were modified to markers of "Black people" in s ′ would have φ 2 ( s, s ′ )

Original: = 0 , while φ 2 ( s, s ′ ) would be one if the group was modified to "muslim" in s ′ instead.
Revised: = 0 , while φ 2 ( s, s ′ ) would be one if the group was modified to "muslim" in s ′ instead.

Original: We simulate the label noise introduced by annotators’ disagreement by independently flipping each label with probability p = 0 .
Revised: We simulate the label noise introduced by annotators’ disagreement by independently flipping each label with probability p = 0 .

Original: 3 during training the similarity classifier ˆ φ .
Revised: 3 during training the similarity classifier ˆ φ .

Original: For training with 3 instead of one query per data point, we reduce the overall amount of training data from 10000 samples in C to 3333 samples and reduce the probability of flipping labels to p = 0 . 216 , simulating a majority vote.
Revised: For training with 3 instead of one query per data point, we reduce the overall amount of training data from 10000 samples in C to 3333 samples and reduce the probability of flipping labels to p = 0 . 216 , simulating a majority vote.

Original: In turn, the active learning approach selects 333 instead of 1000 data points for labeling in each of its ten steps in that scenario.
Revised: In turn, the active learning approach selects 333 instead of 1000 data points for labeling in each of its ten steps in that scenario.

Original: Table C.2 shows that active learning noticeably outperforms randomly sampling data points for our task, that there is no clear direct benefit from employing multiple queries per pair ( s, s ′ )
Revised: Table C.2 shows that active learning noticeably outperforms randomly sampling data points for our task, that there is no clear direct benefit from employing multiple queries per pair ( s, s ′ )

Original: ∈ C over obtaining labels for previously unseen pairs, an that the LC-UNC setup is usually 
Revised: ∈ C over obtaining labels for previously unseen pairs, an that the LC-UNC setup is usually performing as well as or better than alternative selection criteria in the one-query per data point setting.

Original: C. H UMAN E VALUATION
Revised: C. H UMAN E VALUATION

Original: Tables C.3 and C.4 show additional results on the active learning from human feedback.
Revised: Tables C.3 and C.4 show additional results on the active learning from human feedback.

Original: As above, we tested our approach using different filtering thresholds t on the two test sets T (Table C.3) and S (Table C.4).
Revised: As above, we tested our approach using different filtering thresholds t on the two test sets T (Table C.3) and S (Table C.4).

Original: In the Retrain condition, the classifier ˆ φ was trained for a single epoch on all labeled datapoints (cid:83) i<n D i in order to combat potential issues with catastrophic forgetting.
Revised: In the Retrain condition, the classifier ˆ φ was trained for a single epoch on all labeled datapoints (cid:83) i<n D i in order to combat potential issues with catastrophic forgetting.

Original: In the Retrain + Reweigh condition, the same was done, but the Cross Entropy loss was reweighed to balance the empirical label frequencies in (cid:83) i<n D i .
Revised: In the Retrain + Reweigh condition, the same was done, but the Cross Entropy loss was reweighed to balance the empirical label frequencies in (cid:83) i<n D i .

Original: In the From Scratch setting, we train a new classifier on (cid:83) i<n D i for 5 epochs from scratch without first training it separately on any D i .
Revised: In the From Scratch setting, we train a new classifier on (cid:83) i<n D i for 5 epochs from scratch without first training it separately on any D i .

Original: Again, datapoints are reweighed according to their empirical frequency in (cid:83) i<n D i in the From Scratch + Reweigh setting.
Revised: Again, datapoints are reweighed according to their empirical frequency in (cid:83) i<n D i in the From Scratch + Reweigh setting.

Original: Table D.4 is an extended version of Table 4 including additional experiments with a larger regularization parameter λ = 125 . Again, there is no visible benefit from filtering.
Revised: [Table] [Table]

Original: Counterintuitively, more filtering appears to correspond to less accuracy but slightly more fairness, but this might be by chance, given the significantly larger error bars for λ = 125 . D F URTHER D ETAILS ON T RAINING D OWNSTREAM CLASSIFIERS The downstream classifier f consists of a pretrained roberta-base model followed by a linear layer with 768 neurons applied to the output embedding of the first token, a Tanh layer, another linear layer mapping to a single dimension, and a Sigmoid layer. We train f using binary Cross Entropy
Revised: From

Original: [Table]
Revised: [Table]

Revised: From

Original: [Table]
Revised: [Table]

Original: From 
Revised: From Scratch

Original: [Table]
Revised: [Table]

Original: From
Revised: From

Revised: [Table]

Original: [Table]
Revised: [Table]

Revised: D F URTHER D ETAILS ON T RAINING D OWNSTREAM CLASSIFIERS

Revised: The downstream classifier f consists of a pretrained roberta-base model followed by a linear layer with 768 neurons applied to the output embedding of the first token, a Tanh layer, another linear layer mapping to a single dimension, and a Sigmoid layer.

Original:  reweighed to balance the empirical label frequencies in D for 3 epochs using a batch size of 32 and the Adam optimizer with a learning rate of 0 . 00001 .
Revised: We train f using binary Cross Entropy reweighed to balance the empirical label frequencies in D for 3 epochs using a batch size of 32 and the Adam optimizer with a learning rate of 0 . 00001 .

Original: Table D.1 extends Table 1 and shows that censoring words yields very strong constraint adherence for the respective word list 10 .
Revised: Table D.1 extends Table 1 and shows that censoring words yields very strong constraint adherence for the respective word list 10 .

Original: However, we find it to generalize worse than CLP trained with the[Table] same word list, both to our style transfer pairs, and even to the respective other word list.
Revised: However, we find it to generalize worse than CLP trained with the same word list, both to our style transfer pairs, and even to the respective other word list.

Original: Similarly, we find that training with CLP on C or our style transfer pairs C 3 does not just yield significantly improved constraint adherence on C 3 , but also generalizes better to C 1 and C 2 than the respective other of the two word replacement constraint sets without losing much downstream accuracy.
Revised: Similarly, we find that training with CLP on C or our style transfer pairs C 3 does not just yield significantly improved constraint adherence on C 3 , but also generalizes better to C 1 and C 2 than the respective other of the two word replacement constraint sets without losing much downstream accuracy.

Original: Lastly, the table also shows that the better generalization from style transfer to word replacement persists for large values of λ in CLP and that these values can provide strong improvements in terms of fairness, albeit at a larger cost in terms of balanced accuracy
Revised: Lastly, the table also shows that the better generalization from style transfer to word replacement persists for large values of λ in CLP and that these values can provide strong improvements in terms of fairness, albeit at a larger cost in terms of balanced accuracy.

Original: [Table]
Revised: [Table]

Original: Censoring Both WR [Table] [Table] [Table]
Revised: of a naive 95% confidence interval assuming normally distributed errors.

Original: [Table]

Original: D. E XPERIMENTS WITH FILTERING ON SYNTHETIC DATA
Revised: D. E XPERIMENTS WITH FILTERING ON SYNTHETIC DATA

Original: The filtering process for CLP is implemented as follows: for each batch B of labeled training examples ( s, y ( s )) used to train a downstream classifier f , we evaluate p ˆ φ ( s, s ′ )
Revised: The filtering process for CLP is implemented as follows: for each batch B of labeled training examples ( s, y ( s )) used to train a downstream classifier f , we evaluate p ˆ φ ( s, s ′ )

Original: for all ( s, s ′ )
Revised: for all ( s, s ′ )

Original: ∈ C with s ∈ B .
Revised: ∈ C with s ∈ B .

Original: Then, for every s ∈ B we randomly select a pair ( s, s ′ ) among the pairs with p ˆ φ ( s, s ′ )
Revised: Then, for every s ∈ B we randomly select a pair ( s, s ′ ) among the pairs with p ˆ φ ( s, s ′ )

Original: > t for a filtering threshold t to use in the CLP regularizer λ
Revised: > t for a filtering threshold t to use in the CLP regularizer λ

Original: || l ( s ) − l ( s ′ )
Revised: || l ( s ) − l ( s ′ )

Original: || 2 with l representing the logits of the downstream classifier f , using ( s, s ) if no such pair exists.
Revised: || 2 with l representing the logits of the downstream classifier f , using ( s, s ) if no such pair exists.

Original: To allow for more precise control over the statistical properties of ˆ φ , we constructed additional ˆ φ using a look-up table using φ i and flip the labels of randomly selected pairs ( s, s ′ ) with either φ i ( s, s ′ )
Revised: To allow for more precise control over the statistical properties of ˆ φ , we constructed additional ˆ φ using a look-up table using φ i and flip the labels of randomly selected pairs ( s, s ′ ) with either φ i ( s, s ′ )

Original: = 1 or φ i ( s, s ′ )
Revised: = 1 or φ i ( s, s ′ )

Original: = 

Revised: =

Original: in order to achieve specific True positive rates (TPR) and true negative rates (TNR).
Revised: in order to achieve specific True positive rates (TPR) and true negative rates (TNR).

Original: Table D.2 shows that there are consistent benefits from filtering for the synthetic similarity function φ 1 from App.
Revised: Table D.2 shows that there are consistent benefits from filtering for the synthetic similarity function φ 1 from App.

Original: C across different values of λ , even when an imperfect ˆ φ with a TPR and TNR of 75% is used.
Revised: C across different values of λ , even when an imperfect ˆ φ with a TPR and TNR of 75% is used.

Original: [Table] with [Table] % TNR
Revised: D.3 shows that unlike for φ 1 (Table D.2), there is little gain from filtering constraints for φ 2 , most likely because some of the constraint candidates generated by GPT-3 and our style transfer approach are difficult to enforce while maintaining high level of accuracy.

Original: [Table] TPR
Revised: While all of these constraints are inactive for φ 1 and are therefore not enforced with sufficiently accurate filtering, many of them remain active with φ 2 such that filtering yields no clear benefits.

Original: [Table]
Revised: [Table]

Original: with 75 % TNR/TPR, λ =

Original: [Table]
Revised: [Table]

Original: accuracy and fraction of fairness constraints according to φ 1 adhered to for CLP training after filtering C using approximations of φ 1 with varying error profiles. All results are averaged over 5 runs and ± indicates the difference from the upper/lower bound of a naive 95% confidence interval assuming normally distributed errors. D.3 shows that unlike for φ 1 (Table D.2), there is little gain from filtering constraints for φ 2 , most likely because some of the constraint candidates generated by GPT-3 and our style transfer approach are difficult to enforce while maintaining high level of accuracy.
Revised: D.

Original: While all of these constraints are inactive for φ 1 and are therefore not enforced with sufficiently accurate filtering, many of them remain active with φ 2 such that filtering yields no clear benefits. [Table] D. E XPERIMENTS WITH FILTERING ONHUMAN FAIRNESS JUDGMENTS E W ORD L ISTS A ND E XAMPLE G ENERATIONS
Revised: E XPERIMENTS WITH FILTERING ON

Original: Tables E.2–E.4 show 5 randomly example pairs ( s, s ′ ) produced by our style transfer approach and
Revised: Table D.4 is an extended version of Table 4 including additional experiments with a larger regularization parameter λ = 125 .

Original: GPT-3 in zero-shot and edit mode. Warning:
Revised: Again, there is no visible benefit from filtering.

Original: Some of the example texts contain offensive language.
Revised: Counterintuitively, more filtering appears to correspond to less accuracy but slightly more fairness, but this might be by chance, given the significantly larger error bars for λ =

Original: [Table]
Revised: [Table]

Original: DemographicGroup
Revised: DemographicGroup

Original: Descriptors
Revised: Descriptors

Original: Nouns
Revised: Nouns

Original: [Table] manly [Table] masculine man
Revised: Male male,manly,masculine man, men, grandfather, bro, guy, boy, father, dad, son, husbands, husband, grandpa, brother

Original: [Table]

Original: men [Table] grandfather, bro, [Table]
Revised: Female female, pregnant, feminine, femme, womanly woman, women, grandmother, lady, ladies, girl, mother, mom, daughter, wives, wife, grandma, sister

Original: , boy [Table] father [Table]
Revised: Transgender transsexual, FTM, F2M, MTF, trans, M2F, transgender, trans female, trans feminine, trans femme,trans fem, trans male,trans masculine,trans masc

Original: son [Table] husbands, hus- [Table]
Revised: Heterosexual straight, heterosexual, hetero

Original: grandpa

Original: [Table] brother [Table] female, pregnant, feminine, femme, womanly woman
Revised: Homosexual gay, homosexual, lesbian

Original: [Table] women [Table]
Revised: Christian

Original: grandmother, lady, ladies, girl, mother, mom, daughter, wives [Table] wife [Table]
Revised: Amish,

Original: grandma, sister Transgender transsexual, FTM, F2M, MTF, trans, M2F, transgender, trans female, trans feminine, trans femme,trans fem, trans male,trans masculine,trans masc Heterosexual straight, heterosexual, hetero Homosexual gay, homosexual, lesbian
Revised: Catholic,

Original: Christian
Revised: Christian,

Original: Amish, Catholic, Christian, Evangelical, Lutheran, Mormon, Protestant, Unitarian
Revised: Evangelical, Lutheran, Mormon, Protestant, Unitarian

Original: Jewish
Revised: Jewish

Original: Conservative Jewish, Orthodox
Revised: Conservative Jewish, Orthodox

Original: Jewish, Reform Jewish, Hasidic,
Revised: Jewish, Reform Jewish, Hasidic,

Original: Jewish
Revised: Jewish

Original: Muslim
Revised: Muslim

Original: Muslim, Shia, Sunni
Revised: Muslim, Shia, Sunni

Original: Hindu Hindu
Revised: Hindu Hindu

Original: Buddhist Buddhist
Revised: Buddhist Buddhist

Original: Atheist atheist, irreligious
Revised: Atheist atheist, irreligious

Original: Black
Revised: Black

Original: African-American, African, Black,
Revised: African-American, African, Black,

Original: BIPOC
Revised: BIPOC

Original: White
Revised: White

Original: European-American,
Revised: European-American,

Original: European,
Revised: European,

Original: Caucasian, White
Revised: Caucasian, White

Original: Asian
Revised: Asian

Original: Chinese-American,
Revised: Chinese-American,

Original: AmericanBorn Chinese, Chinese, IndianAmerican,
Revised: AmericanBorn Chinese, Chinese, IndianAmerican,

Original: Indian,
Revised: Indian,

Original: KoreanAmerican, Korean, VietnameseAmerican, Vietnamese, AAPI
Revised: KoreanAmerican, Korean, VietnameseAmerican, Vietnamese, AAPI

Original: Latino
Revised: Latino

Original: Cuban-American,Cuban,
Revised: Cuban-American,Cuban,

Original: Dominican-American, Dominican,
Revised: Dominican-American, Dominican,

Original: Salvadoran-American, Salvadoran, Guatemalan-American,
Revised: Salvadoran-American, Salvadoran, Guatemalan-American,

Original: Guatemalan, Mexican-American,
Revised: Guatemalan, Mexican-American,

Original: Mexican, Filipina-American, Filipina, Filipino-American,Filipino,
Revised: Mexican, Filipina-American, Filipina, Filipino-American,

Original:  Hispanic, Latinx, Latine,Latino,
Revised: Filipino, Hispanic, Latinx, Latine,

Original:  Latina, Latin American
Revised: Latino, Latina, Latin American

Original: [Table]
Revised: Tables E.2–E.4 show 5 randomly selected example pairs ( s, s ′ ) produced by our style transfer approach and GPT-3 in zero-shot and edit mode.

Original: Modified
Revised: Table E.5 shows 5 generated comments for each method using the same source comment and target demographic attribute. Warning: Some of the example texts contain offensive language.

Original: [Table]
Revised: [Table]

Original: ’Hahaha, really?
Revised: ’Hahaha, really?

Original: Thousands of years of war and it was mostly white men, huh?
Revised: Thousands of years of war and it was mostly white men, huh?

Original: Read some history about non-European cultures to pierce your idyllic bubble.’ ’
Revised: Read some history about non-European cultures to pierce your idyllic bubble.’ ’

Original: Hahaha, really?
Revised: Hahaha, really?

Original: Thousands of years of war and it was mostly white European Christians, huh?
Revised: Thousands of years of war and it was mostly white European Christians, huh?

Original: Read some history about non-European cultures to pierce your idyllic bubble’ ’
Revised: Read some history about non-European cultures to pierce your idyllic bubble’ ’

Original: I would really like to see your source for the
Revised: I would really like to see your source for the

Original: Japanese fear of the Russians as being any kind of factor whatsoever.
Revised: Japanese fear of the Russians as being any kind of factor whatsoever.

Original: For most of the
Revised: For most of the

Original: Japanese people, the Russians were not even on the radar screen!!’
Revised: Japanese people, the Russians were not even on the radar screen!!’

Original: ’I would really like to see your source for the
Revised: ’I would really like to see your source for the

Original: Buddhist fear of the west as being any kind of factor whatsoever.
Revised: Buddhist fear of the west as being any kind of factor whatsoever.

Original: For most of the western people, the west and religion were not even on the radar screen!!’ ’
Revised: For most of the western people, the west and religion were not even on the radar screen!!’ ’

Original: Yes: at least implicitly it endorses the old canard that the United States is a "Christian nation."’ ’
Revised: Yes: at least implicitly it endorses the old canard that the United States is a "Christian nation."’ ’

Original: Yes: at least implicitly it endorses the old canard that the United States is a "white racist nation."’ ’
Revised: Yes: at least implicitly it endorses the old canard that the United States is a "white racist nation."’ ’

Original: Please be careful what you label fake news.
Revised: Please be careful what you label fake news.

Original: News of shootings (Greenville?), migrants in
Revised: News of shootings (Greenville?), migrants in

Original: Sweden raising crime rates, Hispanics being rapists and murderers, illegal voting, etc those are examples of fake news....feet on couch?
Revised: Sweden raising crime rates, Hispanics being rapists and murderers, illegal voting, etc those are examples of fake news....feet on couch?

Original: not so much....’ ’
Revised: not so much....’ ’

Original: Please be careful what you label fake news.
Revised: Please be careful what you label fake news.

Original: Hundreds of shootings (Green Mountain?), migrants in Sweden raising crime rates, homosexuals being raped and murderers, illegal voting, etc those are examples of fake news....feet on couch?
Revised: Hundreds of shootings (Green Mountain?), migrants in Sweden raising crime rates, homosexuals being raped and murderers, illegal voting, etc those are examples of fake news....feet on couch?

Original: not so much.’ ’
Revised: not so much.’ ’

Original: And often they are not so silent.
Revised: And often they are not so silent.

Original: Gay friends have told me about various such clergy who are well known – only no one speaks out about it.’ ’
Revised: Gay friends have told me about various such clergy who are well known – only no one speaks out about it.’ ’

Original: And often they are not so silent.
Revised: And often they are not so silent.

Original: Gay friends have told me about various such men who are well known – only no one speaks out about it.’
Revised: Gay friends have told me about various such men who are well known – only no one speaks out about it.’

Original: [Table]
Revised: [Table]

Original: ’OK, so now I ´m confused.
Revised: ’OK, so now I ´m confused.

Original: Is it or is it not OK to mock a reporter´s physical handicap?
Revised: Is it or is it not OK to mock a reporter´s physical handicap?

Original: Call a Latina beauty queen "Miss Housekeeping"?
Revised: Call a Latina beauty queen "Miss Housekeeping"?

Original: Post a mock video showing yourself clocking a woman you don ´ t like with a hard-hit golf ball?’ ’
Revised: Post a mock video showing yourself clocking a woman you don´t like with a hard-hit golf ball?’ ’

Original: Is it or is it not OK to mock a reporter´s physical handicap?
Revised: Is it or is it not OK to mock a reporter´s physical handicap?

Original: Call a Muslim beauty queen "Miss Housekeeping"?
Revised: Call a Muslim beauty queen "Miss Housekeeping"?

Original: Post a mock video showing yourself clocking a woman you don ´ t like with a hard-hit golf ball?’
Revised: Post a mock video showing yourself clocking a woman you don´t like with a hard-hit golf ball?’

Original: "You caught me.
Revised: "You caught me.

Original: I confess.
Revised: I confess.

Original: I’ve been lying this whole time.
Revised: I’ve been lying this whole time.

Original: I’m not actually an atheist, of course I believe in a god.
Revised: I’m not actually an atheist, of course I believe in a god.

Original: I see him in the mirror every day !"
Revised: I see him in the mirror every day !"

Original: " You caught me.
Revised: " You caught me.

Original: I confess.
Revised: I confess.

Original: I’ve been lying this whole time.
Revised: I’ve been lying this whole time.

Original: I’m not actually a homosexual, of course I believe in a god.
Revised: I’m not actually a homosexual, of course I believe in a god.

Original: I see him in the mirror every day !"
Revised: I see him in the mirror every day !"

Original: "Denying the existence of racism in America,(or most anywhere), is just ignoring reality.
Revised: "Denying the existence of racism in America,(or most anywhere), is just ignoring reality.

Original: The formal dicrimination has largely been curbed(with exception of using race to design Congressional districts), but those wonderful ’family values’ of the white South still carry the mythology of inherent white superiority" ".
Revised: The formal dicrimination has largely been curbed(with exception of using race to design Congressional districts), but those wonderful ’family values’ of the white South still carry the mythology of inherent white superiority" ".

Original: Denying the existence of racism in America,(or most anywhere), is just ignoring reality.
Revised: Denying the existence of racism in America,(or most anywhere), is just ignoring reality.

Original: The formal dicrimination has largely been curbed(with exception of using race to design Congressional districts), but those wonderful ’family values’ of the Hindu South still carry the mythology of inherent Hindu" ’Cite to "the Republicans, Trump being a Republican, who are against gays" please.
Revised: The formal dicrimination has largely been curbed(with exception of using race to design Congressional districts), but those wonderful ’family values’ of the Hindu South still carry the mythology of inherent Hindu" ’Cite to "the Republicans, Trump being a Republican, who are against gays" please.

Original: New one to me.
Revised: New one to me.

Original: (Other than Trump being registered Republican of course, lol!)’ ’
Revised: (Other than Trump being registered Republican of course, lol!)’ ’

Original: Christian people are against gays.’
Revised: Christian people are against gays.’

Original: "You’d better watch out if you don’t claim
Revised: "You’d better watch out if you don’t claim

Original: Christianity unto yourself like they do.
Revised: Christianity unto yourself like they do.

Original: It is true that people harbor resentment over people whom they view as different.
Revised: It is true that people harbor resentment over people whom they view as different.

Original: It’s the only reason I can think of why they hate gay people."
Revised: It’s the only reason I can think of why they hate gay people."

Original: " You’d better watch out if you don’t claim
Revised: " You’d better watch out if you don’t claim

Original: Christianity unto yourself like they do.
Revised: Christianity unto yourself like they do.

Original: It is true that people harbor resentment over people whom they view as different.
Revised: It is true that people harbor resentment over people whom they view as different.

Original: It’s the only reason I can think of why they hate Asians."
Revised: It’s the only reason I can think of why they hate Asians."

Original: Original Comment
Revised: Original Comment

Original: Modified Comment ’
Revised: Modified Comment ’

Original: So do they cover their faces?
Revised: So do they cover their faces?

Original: This is about being able to identify women for practical purposes.
Revised: This is about being able to identify women for practical purposes.

Original: Makes sense to moi.’ ’
Revised: Makes sense to moi.’ ’

Original: So do they cover their faces?
Revised: So do they cover their faces?

Original: This is about being able to identify White people for practical purposes.
Revised: This is about being able to identify White people for practical purposes.

Original: Makes sense to moi. ’ ’
Revised: Makes sense to moi. ’ ’

Original: What about
Revised: What about

Original: [Equation]

Original: +

Original: [Equation]

Original: xn

Original: [Equation]
Revised: [Equation]

Original: W

Original: [Equation]

Original: O

Original: [Equation]

Original: ’ ’Christianity is the best religion.
Revised: ’ ’Christianity is the best religion.

Original: Christian people are the best people.
Revised: Christian people are the best people.

Original: Jesus Christ was a man who lived a perfect life and died for our sins.
Revised: Jesus Christ was a man who lived a perfect life and died for our sins.

Original: We should all be following Jesus because he is the author and finisher of our faith. ’ ’
Revised: We should all be following Jesus because he is the author and finisher of our faith. ’ ’

Original: Bust Judaism, Christianity and Islam are all
Revised: Bust Judaism, Christianity and Islam are all

Original: Abrahamic religions tracing their origins to the patriarch Abraham.
Revised: Abrahamic religions tracing their origins to the patriarch Abraham.

Original: They are all related.’ ’
Revised: They are all related.’ ’

Original: Bust Hispanic people are all the same.
Revised: Bust Hispanic people are all the same.

Original: They are all related. ’
Revised: They are all related. ’

Original: "AO96 doesn’t allow men into womens rest rooms or locker rooms.
Revised: "AO96 doesn’t allow men into womens rest rooms or locker rooms.

Original: You do realize that trans people have been using the bathroom with you forever right?
Revised: You do realize that trans people have been using the bathroom with you forever right?

Original: Have you ever been injured by any of these people in all the years you have been using public facilities?"
Revised: Have you ever been injured by any of these people in all the years you have been using public facilities?"

Original: "AO96 doesn’t allow white people into black rest rooms or locker rooms.
Revised: "AO96 doesn’t allow white people into black rest rooms or locker rooms.

Original: You do realize that trans people have been using the bathroom with you forever right?
Revised: You do realize that trans people have been using the bathroom with you forever right?

Original: Have you ever been injured by any of these people in all the years you have been using public facilities? "
Revised: Have you ever been injured by any of these people in all the years you have been using public facilities? "

Original: ’so.. I . have seen dozens of women in niqab in Toronto this week alone Almost every day
Revised: ’so.. I . have seen dozens of women in niqab in Toronto this week alone Almost every day

Original: I see groups of them.
Revised: I see groups of them.

Original: The problem with the niqab policy is that is was for such a silly narrow issue.
Revised: The problem with the niqab policy is that is was for such a silly narrow issue.

Original: The niaqb should have been banned from public buildings and shopping malls.’ ’
Revised: The niaqb should have been banned from public buildings and shopping malls.’ ’

Original: so..
Revised: so..

Original: I . have seen dozens of black people in the niqab in Toronto this week alone Almost every day I see groups of them.
Revised: I . have seen dozens of black people in the niqab in Toronto this week alone Almost every day I see groups of them.

Original: The problem with the niqab policy is that is was for such a silly narrow issue.
Revised: The problem with the niqab policy is that is was for such a silly narrow issue.

Original: The niaqb should have been banned from public buildings and shopping malls. ’ 
Revised: The niaqb should have been banned from public buildings and shopping malls. ’ Original Comment

Original: (edit mode) 
Revised: Modified Comment (Style Transfer) Modified Comment (GPT-3 zero shot Modified Comment (GPT-3 edit mode) I agree with those many trans-gendered.

Revised: I agree with those many pre-gospel

Revised: Catholics.

Revised: I agree with those many Christians.

Revised: I agree with those many

Revised: Christian people.

Revised: Everyone in plain black pajamas might do the trick.

Revised: Everyone in plain white pajamas might do the trick

Revised: All white people in plain white pajamas might do the trick.

Revised: Everyone in plain white pajamas might do the trick.

Revised: You do know

Revised: Mexicans are

Revised: American ...right?

Revised: You do know gays are gay...right?

Revised: You do know homosexuals are

Revised: American ...right?

Revised: You do know

Revised: Homosexuals are people too ...right? .

Revised: I’m an atheist and

Revised: I don’t care about obnoxious atheists.

Revised: Either way.

Revised: I’m an Indian and

Revised: I don’t care about obnoxious Muslims.

Revised: Either way.

Revised: I don’t care about obnoxious Hindus.

Revised: I’m a Hindu and

Revised: I don’t care about obnoxious

Revised: Hindus.

Revised: Either way.

Revised: AnothercondescendingignorantHindunationalistignorantofthegenocidal ,racist and murderous past of its culture.

Revised: Anothercondescendingignorant white nationalist ignorant of the genocidal, racist and murderous past of its culture

Revised: Anothercondescendingignorant white nationalist ignorant of the genocidal, racist and murderous past of its culture.

Revised: A White person.

Revised: F G ROUP F AIRNESS

Revised: Table F.1 provides results on equality of odds for a subset of the models trained for the experiment presented in Table D.4.

Revised: Specifically, for every group j that was considered for generation, we calculated the TPR and TNR on the test set restricted to comments s mentioning that group (label y j ( s ) =1).

Revised: We then calculated the absolute pairwise differences between the TPRs/TNRs for every pair of groups (in percent), and present the mean and maximum over these for each model.

Revised: We find that CLP-training improves the TNR gap at the cost of a worse TPR gap, except for pairs generated by the Word Replacement list of Garg et al.

Revised: This effect is most extreme when using our full constraint set C and more mellow for Word Replacement based on the word list of Smith et al.

Revised: (2022) or for the filtered ˆ C ⋆ .

Revised: The improved TNR gap at the cost of a worse TPR gap is directionally consistent with the results reported by Garg et al.

Revised: (2019) for CLP training using their word list, with groups defined by the presence of specific identity terms from the word list rather than the labels y j ( s ) .

Revised: We echo Garg et al.

Revised: (2019)’s recommendation for practicioners to select a method depending on their relative prioritization between improving individual fairness and equitable True Negative

Revised: Rates, compared to equitable True Positive Rates.

Revised: [Table]

Revised: different demographic groups for differently trained classifiers f .