On the Discrimination Risk of Mean Aggregation Feature Imputation in Graphs
Abstract
In human networks, nodes belonging to a marginalized group often have a disproportionate rate of unknown or missing features.
This, in conjunction with graph structure and known feature biases, can cause graph feature imputation algorithms to predict values for unknown features that make the marginalized group’s feature values more distinct from the the dominant group’s feature values than they are in reality.
We call this distinction the discrimination risk .
We prove that a higher discrimination risk can amplify the unfairness of a machine learning model applied to the imputed data.
We then formalize a general graph feature imputation framework called mean aggregation imputation and theoretically and empirically characterize graphs in which applying this framework can yield feature values with a high discrimination risk.
We propose a simple algorithm to ensure mean aggregation-imputed features provably have a low discrimination risk, while minimally sacrificing reconstruction error (with respect to the imputation objective).
We evaluate the fairness and accuracy of our solution on synthetic and real-world credit networks.
Introduction
Machine learning (ML) methods [1, 2, 3, 4, 5] have been successfully applied to graph-structured data such as social networks, product graphs, and molecules [6, 7] to aid in important problems like content recommendation, product recommendation, and molecular property prediction [8, 9, 7, 10, 11].
However, many methods rely on fully-observed features for each node, which are not available for privacy reasons, as a consequence of exclusionary data collection practices, or due to the high expenses involved in feature annotation [12, 13, 14].
As a result, the development of algorithms to leverage a graph’s structure and known node feature values to impute unknown or missing features has emerged as an important research area [15, 16].
In human networks, nodes belonging to a marginalized group (e.g., on the basis of race, gender, disability, etc.) often have a disproportionate rate of unknown features compared to the dominant group because marginalized communities may be more reluctant to share their data, annotators erase their data, and they are sidelined in data collection [17, 18, 19, 20].
Furthermore, node neighborhoods are often associated with group membership [21, 22], especially in homophilic graphs where nodes belonging to the same group have a higher likelihood of being connected [23].
Homophily can be due to social stratification [24] or the limited collection of inter-links (i.e., edges between nodes belonging to different groups)
Moreover, known feature values can be tainted and proxies for group membership [18, 25].
Hence, even if graph feature imputation algorithms do not have direct access to the group membership of a node, these algorithms are influenced by unknown feature rate disparities, graph structure, and known feature values.
In fact, they can predict values for unknown features that cause the the marginalized group’s feature values to be more distinct from the dominant group’s feature values than they are in reality.
To illustrate this phenomenon, let’s consider an automated candidate screening system based on the job applicant network shown in Figure 1, where nodes represent applicants and edges between applicants indicate that they have similar past work experiences.
Each node has one feature: the number of years that the applicant has previously worked.
Furthermore, each node belongs to one of two groups, the disabled community Q or the able-bodied community R 1 .
All the nodes in R have a known feature value of 5 years, while all the nodes in Q have unknown feature values; however, in reality, all the nodes in Q also have a feature value of 5 years.
Additionally, all the nodes in Q are connected to each other but have few links (if any) to nodes in R because of systemic barriers including hiring discrimination and a lack of accommodations [27].
Consequently, after applying the graph feature imputation algorithm Feature Propagation [16], because of the disparate rates of unknown features between the groups and structure of the graph, the nodes in Q will have, on average, feature values that are more distinct from the feature values of the nodes in R than the ground truth.
[Figure]
We call this distinction in imputed feature values between the marginalized and dominant groups the discrimination risk .
In this paper, we present a theoretically-justified formulation of the discrimination risk of imputed features.
We further prove that a higher discrimination risk can amplify the unfairness of a ML model applied to the imputed data, which can be especially dangerous, unethical, and illegal in high-stakes applications like automated candidate screening and loan approval [28, 29, 30, 31].
For instance, in the automated candidate screening example, a model applied to the imputed data may more easily learn to identify and reject disabled job applicants because they appear to have fewer years of work experience than able-bodied applicants, thereby reinforcing systemic discrimination against the disabled community [27].
We also formalize a general graph feature imputation framework called mean aggregation imputation that encompasses common diffusion-based imputation algorithms in the literature.
Subsequently, we theoretically and empirically characterize graphs in which applying mean aggregation feature imputation can yield a high discrimination risk, without making any assumptions about the underlying distributions of unknown features or graph structure.
To the best of our knowledge, we are the first to study the effect of graph feature imputation on the fairness of models.
This is challenging because we must consider biases stemming from graph structure.
Furthermore, we propose a simple algorithm to ensure mean aggregation-imputed features provably have a low discrimination risk, while minimally sacrificing reconstruction error (with respect to the imputation objective).
We do so by viewing mean aggregation imputation through the lens of gradient descent and projecting imputed feature values onto the feasible space of feature values with low discrimination risk.
We empirically evaluate the fairness and accuracy of our solution on synthetic and real-world credit networks, finding that it improves fairness without a significant loss in reconstruction error on the synthetic datasets but doesn’t improve fairness on the real-world datasets.
We close by discussing the limitations of our solution.
Related work
Feature imputation Feature imputation algorithms leverage known feature values to predict unknown feature values (and sometimes update known feature values).
For example, unknown feature values may be filled as the mean of known values [16].
However, more intricate feature imputation methods have been proposed in the ML, statistics, and epidemiology literature, with popular approaches including matrix completion [32, 33, 34, 35], nearest neighbors [36, 37], multiple imputation via conditional models [38, 39, 40], and causal inference [41, 42].
Notably, while feature imputation may be applied to data with unknown feature values prior to the data being passed to a ML model, feature imputation is distinct from label prediction with missing data, wherein models work directly with unknown feature values [43, 44, 45, 46, 47, 48, 49, 50]; we do not consider the latter paradigm in this paper.
Works have extended feature imputation approaches for tabular data to incorporate graph structure [51, 52].
Graph feature imputation using deep learning methods is also gaining traction [53, 54, 15].
However, [16] proposes a non-neural diffusion-based approach called Feature
Propagation that imputes graph features by minimizing the graph’s Dirichlet energy.
Fairness of missing data and feature imputation Works have theoretically and empirically investigated the impact of missing data [55, 56, 19, 57, 58] and feature imputation on the fairness of
ML models [56, 59, 60, 61, 30, 62].
These works consistently find that missing data can amplify biases, and some show that in practice, feature imputation can yield less unfair (relative to excluding missing data) but nevertheless discriminatory model outcomes.
However, these works only study tabular data and do not consider biases that emerge from graph structure [20, 22, 63].
Furthermore, they often adapt models to directly work with missing data rather than mitigate the unfairness of feature imputation itself.
Despite the prevalence of graph feature imputation methods, to the best of our knowledge, there is no research on their influence on the fairness of models.
Some works have explored fairness constraints in semi-supervised settings [64, 65], but they assume that node features are entirely available, which is not the case in feature imputation.
Fair graph machine learning We focus on group fairness, which ensures model predictions exhibit some form of parity between different groups [66, 21, 67, 29, 68, 69].
Works have studied (amongst other fairness formulations) statistical parity, wherein a model predicts the positive outcome at the same rate for different groups, and equalized odds, in which the accuracy of model predictions is equivalent across different groups [70].
In the automated candidate screening example, statistical parity would imply that all candidates have an equivalent opportunity to pass screening regardless of group membership, while equalized odds would mean that, regardless of group membership (i.e., P ( Z | S = Q ) =
P ( Z | S = R ) ), candidates are classified with an equivalent accuracy by the automated screening model (i.e., P ( Z | Y, S = Q ) =
P ( Z | Y, S = R ) ).
When ground-truth labels are tainted (e.g., the screening system is trained with sexist hiring data), we may prefer statistical parity to equal opportunity.
While our theoretical study of discrimination risk is aligned with statistical parity, we empirically explore the effect of mean aggregation imputation with a lower discrimination risk on both the demographic parity and equalized odds of models.
Mechanisms for improving group fairness have been categorized into pre-processing [22], training-time [21, 23, 71], and postprocessing [72, 73].
Our work is similar to pre-processing, as we seek to lower the discrimination risk of imputed training data towards improving model fairness.
There exist many works on modifying graph structure to mitigate topology-induced biases [73, 74, 22, 71, 75, 76].
However, because graph semantics (especially for large graphs) are difficult to interpret, it is unclear if the solutions that these papers propose preserve the semantics of the original graph.
On the other hand, our work does not modify graph structure and instead optimally transforms imputed features to have a low discrimination risk.
[77] investigates the fairness of graph neural networks in the presence of limited group membership information but does not consider imputation; in contrast, our work assumes group membership is fully available but features are not.
Discrimination risk and model unfairness
To understand how feature imputation could amplify the unfairness of a ML model, we now present a theoretically-justified metric called the discrimination risk, which applies beyond the setting of graphs and is agnostic to model architecture and labels.
(We explore discrimination risk in the context of graphs in Section 5.)
Suppose we have an arbitrary data distribution D and two groups: a marginalized group Q and a dominant group R .
For any data instance ( x, y, s ) ∼ D , let x ∈
X be the d -dimensional feature values of the instance (where x i denotes the i -th entry of x ), let y ∈ Y be its label, and let s ∈ { Q, R } be its group membership.
We assume that we can observe the group membership of any data instance and that no instance can belong to both the marginalized and dominant groups.
Definition 1 (Discrimination Risk)
We define the discrimination risk of D as:
[Equation]
We now explore the relevance of discrimination risk to model unfairness.
Let D ′ be the data distribution with ground-truth features and D be the distribution with imputed features.
We will show that if R D > R D ′ , imputation may amplify model unfairness.
To be concrete, let’s again consider the example of the automated candidate screening system.
Let P ( S ∈ { Q, R } ) be the distribution over the group membership of job applicants.
Furthermore, let P ( X ′ ∈ X ) be the distribution over the ground-truth feature values of applicants (e.g., number of years previously worked, highest degree, etc.)
In contrast, let P ( X ∈ X ) be the distribution over imputed feature values of applicants.
Let P ( Y ∈ Y ) be the distribution over ground-truth applicant labels (e.g., whether an applicant should be hired, a screening score for an applicant, etc.)
Now, let h ′ be a model trained on samples from D ′ (without direct access to S ), and h be another model trained on samples from D (without direct access to S ).
Additionally, let P ( Z ′ ∈ Y ) be the distribution over the predictions of h ′ on instances sampled from P ( X ′ ) , and let P ( Z ∈ Y ) be the distribution over the predictions of h on instances sampled from P ( X ) .
We have the dependencies S → X ′ and S
→ X because disability affects the number of years previously worked by a job applicant.
Additionally, S → X because S can influence the feature imputation
algorithm (as illustrated in Figure 1).
Furthermore, we assume that h ′ and h have access to the feature values of an applicant, but not the applicant’s group membership, and that the association of S with Z ′ through Y can be fully explained by X ′ .
Thus, Z ′ is conditionally independent of S given X ′ .
Similarly, we assume that the association of S with Z through Y can be fully explained by
X , so Z is conditionally independent of S given X .
Because we are interested in how feature imputation may amplify model unfairness, we investigate when the statistical parity or total variation distance d TV ( P ( Z | S = Q ) , P ( Z | S = R )) >
d TV ( P ( Z ′ | S = Q ) , P ( Z ′ | S = R ))
[78], where P ( Z | S = Q ) is the prediction distribution conditioned on group- Q membership.
d TV ( A, B ) measures the distance between two probability distributions A and B as sup x ∈F | A ( x ) − B ( x ) | .
Intuitively, d TV ( P ( Z | S = Q ) , P ( Z | S = R )) captures how much the prediction distribution of h absolutely differs between Q and R , and thus it quantifies the (statistical parity) unfairness of h .
We now discuss the relationships of d TV ( P ( Z ′ | S =
Q ) , P ( Z ′ | S = R )) to d TV ( P ( X ′ | S = Q ) , P ( X ′ | S = R )) and d TV ( P ( Z | S = Q ) , P ( Z
| S = R )) to d TV ( P ( X | S = Q ) , P ( X | S = R )) .
We begin with the following lemma from [79].
Lemma 1 (Corollary 17 from [79]) By the Data Processing Inequality, d TV ( P ( Z ′ | S =
Q ) , P ( Z ′ | S = R ))
≤
d TV ( P ( X ′ | S = Q ) , P ( X ′ | S = R )) and d TV ( P ( Z | S = Q ) , P ( Z | S =
R ))
≤
d TV ( P ( X | S = Q ) , P ( X | S = R )) .
Please refer to Section A.1 for the proof of Lemma 1.
At a high level, Lemma 1 states that the statistical parity unfairness of a model is upper-bounded by the statistical parity distance of the feature distributions between the groups.
We now use Lemma 1 to prove the following theorem that connects d TV ( P ( Z ′ | S = Q ) , P ( Z ′ | S = R )) to R D ′ and d TV ( P ( Z | S = Q ) , P ( Z | S = R )) to R D .
Theorem 1 Suppose P ( X ′ | S = Q ) =
N ( µ ′ Q , Σ ′ Q ); P ( X ′ | S = R ) = N ( µ ′ R , Σ ′ R ); P ( X | S = Q ) =
N ( µ Q , Σ Q ) ; and P ( X | S = R ) =
N ( µ R , Σ R ) .
We then get the following bounds:
[Equation]
P
[Equation]
Z ′ |
[Equation]
= Q ) , P ( Z ′
[Equation]
= R )
[Equation]
where 0 ≤ C ′ ≤ d and 0 ≤ C ≤ d .
Please refer to Section A.2 for the proof of Theorem 1.
This result suggests that minimizing R D can minimize the unfairness of the model h applied to the imputed data.
Furthermore, it is possible that R D > R D ′ , in which case feature imputation may amplify the unfairness of a model.
While we leverage strong generative assumptions in Theorem 1, it is plausible that X ′ | S = Q and X ′ | S
= R are normally-distributed.
Furthermore, mean aggregation imputation (Section 4) produces approximately normal X | S = Q and X | S
= R (by the Central
Limit Theorem).
We additionally note that the lower bounds do not require the feature values to be normally distributed; the bounds only assume their distributions have finite covariance.
Finally, for arbitrary distributions, matching even an infinite number of moments is not sufficient to bound their distance [80].
While R D applies beyond graphs and is agnostic to model architecture and labels, in practice, it is important to consider model complexity and task context.
We also add that R D risk bears resemblance to the Average Treatment Effect studied in causality [81].
Moreover, [59] proposes a metric also called discrimination risk which quantifies how much the deviation of imputed feature values from the ground-truth feature values differs across groups; this quantity is aligned with the equalized odds of a model applied to the imputed data.
In contrast, R D simply measures how much imputed features differ across groups, enabling its computation when ground-truth feature values are not available, and is aligned with the statistical parity of a model.
We leave extending our definition of discrimination risk to other formulations of fairness as future work [70].
Graph feature imputation
We would like to investigate the discrimination risk of graph feature imputation.
Prior to doing so, we present a general framework called mean aggregation imputation that encompasses common non-neural diffusion-based graph feature imputation algorithms in the literature.
Suppose we have an undirected weighted homogeneous graph G =
( V, E ) .
Each node has d features, hence the node feature matrix X ∈ R N × d , where N = | V | (i.e., the cardinality of V ).
For simplicity, we assume that d = 1 .
The feature value is unknown for some nodes in G (denoted as the set U ), and known for others (denoted as the set K ).
The feature value of each node is either known or unknown (i.e., U ∪ K = V and U ∩ K = ∅ ).
Let X S refer to the feature values of the nodes in set
S .
Assume without loss of generality that X
= (cid:20)
X K
X U (cid:21) .
Furthermore, let A ∈ R N × N denote the weighted adjacency matrix of G , where A ij is the nonnegative weight corresponding to the edge from node j to node i .
Additionally, let A S 1 S 2 denote the submatrix of A with rows belonging to the nodes in set S 1 and columns belonging to the nodes in set S 2 .
Let A :
=
(cid:20)
A KK
A KU A UK
A UU (cid:21) .
D is the diagonal degree matrix, i.e., D ii =
(cid:80) Nj =
1 A ij and D := (cid:20) D K
D U (cid:21) .
Definition 2 (Mean Aggregation Feature Imputation)
Denote the feature values at iteration t of mean aggregation feature imputation as X ( t ) .
Furthermore, let X ( t ) S refer to the feature values of the nodes in set S at iteration t .
Then, at each iteration t :
[Equation]
where M : R N → R N is a diagonal invertible map, T ∈ R N × N is a right-stochastic matrix, and β ∈ [0 , 1] is a regularization hyperparameter.
When d > 1 , we apply mean aggregation feature imputation to each channel independently 2 , and it only works with continuous (not discrete) features.
Mean aggregation encompasses common graph feature imputation methods, including Global Mean (predicts unknown feature values as the uniform mean of known feature values), Neighbor Mean (predicts unknown feature values as the degreeweighted mean of the known feature values for neighboring nodes), Feature Propagation (predicts unknown feature values that minimize the Dirichlet energy of the graph while preserving known feature values), and Graph Regularization (predicts feature values via a smoothness constraint and a fitting constraint for the known features).
For proofs, refer to Section A.3.
Despite Neighbor
Mean, Feature Propagation, and Graph Regularization being intended for homophilic graphs [16], mean aggregation feature imputation encompasses algorithms that could perform well on heterophilic graphs as well with an appropriate choice of T [16].
We also note that T cannot be A , as this might cause feature values to explode over multiple iterations.
Discrimination risk of mean aggregation feature imputation
To understand how mean aggregation feature imputation may amplify the unfairness of a ML model, we theoretically characterize graphs in which mean aggregation imputation increases the discrimination risk, without making assumptions about the underlying distributions of unknown features or graph structure.
We begin by defining new notation.
In particular, we first focus on the case of a single feature (i.e., d = 1 ), and extend our analysis to the case d > 1 in Section A.5.
Let X v be the feature of a node v .
Let Q denote the set of nodes that belong to the marginalized group, and R denote the set of nodes that belong to the dominant group.
We assume that Q ∪ R = V and Q ∩ R = ∅ .
We define the discrimination risk after t iterations of mean aggregation imputation as:
[Equation]
where the expectations are taken uniformly over the nodes in each set.
Now, define ˜ X := MX .
Then, a modified version of the discrimination risk after t iterations of mean aggregation imputation is ˜ R ( t ) :
=
(cid:12)(cid:12)(cid:12) E q ∼ Q [ ˜ X ( t ) q ] − E r ∼ R [ ˜ X ( t ) r ] (cid:12)(cid:12)(cid:12) .
In Theorem 2, we bound the discrimination risk ˜ R ( t ) of the imputed features with respect to ˜ R (0) .
We bound ˜ R ( t ) rather than R ( t ) for simplicity; however, we empirically validate that the bound properties also hold for R ( t ) in Section 7.
Define ˜ µ ( t ) Q :=
E q ∼ Q [ ˜ X ( t ) q ] and ˜ µ ( t ) R :=
E r ∼ R [ ˜ X ( t ) r ] .
Furthermore, let ˜ σ ( t ) denote the maximal deviation of the feature values at iteration t , i.e., ∀ q 1 ∈ Q, | ˜ X ( t ) q 1 − ˜ µ ( t ) Q | ≤ max q 2 ∈ Q | ˜ X ( t ) q 1 − ˜ X ( t ) q 2 | ≤ ˜ σ ( t ) and ∀ r 1 ∈ R, | ˜ X ( t ) r 1 − ˜ µ ( t ) R | ≤ max r 2 ∈ R | ˜ X ( t ) r 1 − ˜ X ( t ) r 2 | ≤ ˜ σ ( t ) .
Additionally, define T S 1 → S 2 := (cid:80)
[Equation]
Theorem 2 Let the contraction coefficient α :=
(cid:12)(cid:12) (cid:12) 1 − T R → Q ∩ U + βT R → Q ∩ K
| Q | − T Q → R ∩ U + βT Q
→ R ∩ K | R |
[Equation]
(cid:12) .
Then, α ≤ 1 , and:
[Equation]
Please refer to Section A.4 for a proof of Theorem 2.
Theorem 2 shows that the bounds on the discrimination risk contract more slowly (with more iterations of mean aggregation feature imputation) with a larger α .
Furthermore, the upper bound on the discrimination risk is larger with a larger α and may depend on the initial unknown feature values.
5.1 Analysis of Theorem
Theorem 2 allows for interesting interpretations of how graph properties like the rate of unknown features, group size, and graph structure affect the discrimination risk of mean aggregation imputation.
Below, we successively vary each property (holding the other properties constant) and investigate its impact on α , and in turn the discrimination risk.
We focus on Feature Propagation [16], but our analysis may be easily extended to other mean aggregation imputation algorithms.
We assume for simplicity that all edges have a weight of 1.
Unknown feature rates A low unknown feature rate for both groups or disparate unknown feature rates across the groups can increase α , and thus the discrimination risk of mean aggregationimputed features.
Suppose the intra-link rate P (( u, v ) ∈
E | u ∈ Q, v ∈ Q ) =
P (( u, v ) ∈
E | u ∈ R, v ∈ R ) = 12 and inter-link rate P (( u, v )
∈
E | u ∈ Q, v ∈ R )
=
P (( u, v ) ∈
E | u ∈ R, v ∈ Q )
= 12 .
Furthermore, assume equal (relative) group sizes, i.e., | Q | N =
| R | N = 12 .
Then, T R → Q ∩ U + βT R → Q ∩ K | Q | = T R → Q ∩ U N/= (cid:80) q ∈ Q ∩ U (cid:80) r ∈ R T qr N/= (cid:80) q ∈ Q ∩ U (cid:80) r ∈ R D − 1 qq
A qr N/.
By decomposition, D qq =
(cid:80)
u ∈ Q
A qu + (cid:80) v ∈ R A qv = 12 | Q | + 12 | R | =
N 2 .
Therefore, T R → Q ∩ U + βT R → Q ∩ K | Q | = (cid:80)
[Equation]
= 12 ( |
[Equation]
U |
[Equation]
= 12 ( P ( v
[Equation]
U | v ∈ Q ) ·| Q |×| R | ) N
[Equation]
= 12 P ( v ∈ U | v ∈ Q ) , where
P ( v ∈ U | v ∈ Q ) is the unknown feature rate for group Q .
Similarly, T Q → R ∩ U + βT Q
→ R ∩ K | R | = 1 2 P ( v ∈ U | v ∈ R ) .
Thus, α = | 1 − 1 2 P ( v ∈ U | v ∈ Q ) − 1 2 P ( v ∈ U | v ∈ R ) | .
This aligns with [60]’s finding that imputation fairness can be influenced by the imbalance of feature missingness across groups, although [60] studies equalized odds rather than statistical parity fairness.
Group sizes Group size alone may not affect α or the discrimination risk of mean aggregation-imputed features.
Suppose the intra-link rate P (( u, v ) ∈
E | u ∈ Q, v ∈ Q ) =
P (( u, v ) ∈
E | u ∈ R, v ∈
R )
= 12 and inter-link rate P (( u, v ) ∈
E | u
[Equation]
Q )
[Equation]
Furthermore, assume equal unknown feature rates, i.e., P ( v ∈ U | v ∈ Q ) =
P ( v ∈ U | v ∈ R )
= 12 .
Then, T R
[Equation]
+ βT
[Equation]
| Q | =
[Equation]
D
[Equation]
= N 2 .
Therefore,
[Equation] [Equation]
Similarly,
[Equation]
= 12 · | Q | N .
Thus, α = | 1 − 12 · | R | N − 12 · | Q | N | = 12 .
Graph structure A low inter-link to intra-link ratio can increase α and the discrimination risk of mean aggregation-imputed features.
Suppose we have equal unknown feature rates, i.e., P ( v ∈ U | v ∈ Q ) =
P ( v ∈ U | v ∈ R )
= 12 .
Furthermore, assume equal (relative) group sizes, i.e., | Q | N =
| R | N = 12 .
Then, T R
[Equation]
∩ U + βT
[Equation]
K | Q |
[Equation]
∈ R, v ∈ Q ) | R | =
N 2 [ P (( u, v ) ∈
E | u ∈ Q, v ∈ Q ) + P (( u, v )
∈ E | u ∈ R, v ∈ Q )] .
Therefore, T R → Q ∩ U + βT R
[Equation]
Q
[Equation]
K | Q | =
P (( u,v )
[Equation]
E | u ∈ R,v ∈ Q )( | Q ∩ U |×| R | )
[ P (( u,v ) ∈ E | u ∈ Q,v ∈ Q )+ P (( u,v )
∈ E | u ∈ R,v ∈ Q )] ·
[Equation]
Similarly, T Q
[Equation]
U
[Equation]
Thus,
[Equation]
Because G is undirected,
P (( u, v ) ∈ E | u ∈ R, v ∈ Q ) = P (( u, v ) ∈
E | u ∈ Q, v ∈ R ) and P (( u, v )
∈
E | u ∈ Q, v ∈ Q ) =
P (( u, v ) ∈
E | u ∈ R, v ∈ R ) .
Ultimately, our theoretical (Section 5) and empirical (Section B.5) characterizations of α and the discrimination risk can be leveraged to audit real-world graph data for structural factors that contribute to the unfairness of mean aggregation feature imputation and ML models applied to the imputed data.
Fairer graph feature imputation
We propose a simple and effective solution to ensure mean aggregation feature imputation provably has a low discrimination risk, while minimally sacrificing reconstruction error (with respect to the imputation objective).
At a high level, we want to constrain the discrimination risk at every iteration t of imputation to be at most ϵ (i.e., ∀ t ∈ [0 , ∞ ) , R ( t ) ≤ ϵ ).
We do this by viewing mean aggregation imputation through a gradient descent lens and projecting imputed feature values onto the feasible space of feature values with discrimination risk at most ϵ at each iteration [82].
We focus on a single feature i , but our algorithms can be extended to more features by applying them to each feature separately.
We begin with the case where known feature values remain fixed (i.e., β = 0 ).
Recall the iterative algorithm for mean aggregation feature imputation when β = 0 :
[Equation]
We see that ∀ t ∈ [0 , ∞ ) , X ( t ) K
= X K .
Furthermore, define ∆ := I N − M − 1 TM .
In the case of
Feature Propagation, ∆ =
I N − D 12 ( D − 1 A ) D −
=
I N − D − 12 AD − 12 is the symmetric normalized
Laplacian of G [16].
We see that X ( t +1) U =
[Equation]
X K .
As discussed in [16], we can the
X ( t +1)
U :=
X ( t ) U − γ (∆ UU X ( t ) U + ∆ UK X K ) as an iteration of gradient descent (with step size γ = 1 ) on the objective function ℓ ( x ) = 12 x T ∆ UU x + X TK ∆ KU x + 12 X TK ∆ KK X K , where X K is constant.
For Feature Propagation, ℓ is the Dirichlet energy of G [16].
We now present a theorem that shows how to perform mean aggregation feature imputation with a discrimination risk of at most ϵ when the known feature values remain fixed.
Theorem 3 ( ϵ -Fair Imputation, β = 0 ) Vanilla mean aggregation feature imputation updates
X ( t +1)
U :=
X ( t ) U − γ (∆ UU X ( t ) U + ∆ UK X K ) =
Z ( t ) U , where
γ = 1 .
Let ϵ -fair mean aggregation feature imputation instead update X ( t +1)
U
[Equation]
P
[Equation]
Z
[Equation] [Equation]
P
[Equation]
, where:
[Equation]
0 , otherwise
[Equation]
Then, assuming 0 ≤ λ min (∆ UU ) ≤ λ max (∆ UU ) < 1 (where λ min and λ max are the minimum and maximum eigenvalues, respectively): 1) a unique optimal (with respect to ℓ ) feasible solution
X ∗ U exists; 2) for fixed step size γ = 1 λ max (∆ UU ) , ϵ -fair imputation converges as ∥ X ( t ) U − X
[Equation]
U ∥ 22 ≤
[Equation]
− X
[Equation]
∥
[Equation]
3) for fixed step size γ ≤
[Equation] [Equation]
-fair imputation converges to X ∗ U .
Please refer to Section A.6 for a proof of Theorem 3.
The convergence of our solution to the unique optimal (with respect to ℓ ) feasible solution implies that our solution provably has a discrimination risk of at most ϵ while minimally sacrificing reconstruction error (with respect to the objective).
Furthermore, because our solution simply interleaves projections into the mean aggregation imputation framework, it preserves the framework’s speed and scalability [16].
We similarly have a solution when β > 0 (i.e., when the known node feature values do not remain fixed) which we present in
Section A.7.
Choosing ϵ , due to its uninterpretable nature, can be difficult in practice; we encourage work on making ϵ more intelligible.
Experimental results and discussion
We empirically evaluate the fairness and reconstruction error of our solution on various mean aggregation feature imputation algorithms and synthetic and real-world datasets.
We find that while our solution yields improved fairness without a significant loss in reconstruction error on the synthetic datasets, there is not an improvement in fairness on the real-world datasets.
All our code may be found in the supplementary material.
Datasets
We construct undirected two-block synthetic networks ( SBM ) using
StochasticBlockModelDataset from PyTorch Geometric [83] (where one block corresponds to the marginalized group Q and the other block to the dominant group R ) with various (relative) group sizes and inter- and intra-link rates (more information in Section B.1).
SBM does not have a corresponding task, i.e., the nodes do not have labels.
We also use the real-world
Credit defaulter and German credit networks from [29] (there exist limited “natively” graph real-world datasets with sensitive attributes available).
The Credit defaulter network consists of 30,000 nodes representing individuals, with edges between them indicating similar spending and payment patterns.
The corresponding task is to predict whether an individual will default on their credit card payment or not, and the groups are those 25 years old or younger and those above the age of 25 (more information in Section B.1).
The German credit network comprises 1,000 nodes representing clients in a German bank who are connected if they have similar credit accounts.
The corresponding task is to predict whether a client has good or bad credit risk, and the groups are men and women (more information in Section B.1) 3 .
We refrain from using the Recidivism graph from [29] so as not to support the development of carceral technology [85].
Protocols and performance evaluation By default, none of the datasets contain unknown or missing features.
Despite the real-world prevalence of missing features, most publicly-available graph datasets inherently do not have missing node features because current graph ML techniques predominantly rely on fully-observable features.
Hence, similarly to [16], to simulate diverse scenarios with unknown features, for each group, we independently at random mark node feature values as unknown with a different probability.
Nodes, even within the same group, may have different unknown features.
In this way, we simulate missing completely at random (MCAR) and missing at random (MAR) on our data.
We experiment with all 25 combinations of unknown feature rates of { 0 . 1 , 0 . 3 , 0 . 5 , 0 . 7 , 0 . 9 } for the groups.
We choose this scheme to study the effect of disparate unknown feature rates across the groups, which reflects the real world [17, 18, 19, 20].
Empirically characterizing the real-world distributions of node feature missingness requires further study.
We also encourage empirical work on other unknown feature schemes, including missingness based on node degree or marking all or none of the features for each node as unknown.
To impute unknown features, we use the vanilla mean aggregation imputation algorithms overviewed in Section 4: Global Mean (GM), Neighbor Mean (NM), Feature Propagation (FP), and Graph
Regularization (GR) (with β = 0 . 25 ), and their ϵ -fair counterparts (for ϵ ∈ { 0 . 0 , 0 .
For models, we use a linear classifier ( linear ), two-layer MLP ( mlp ), and two-layer Graph Convolutional
Network ( gcn ) [2] (more information in Section B.3).
We train all models on the imputed data, but validate and test on fully-observed data.
Because there are no previous works (to the best of our knowledge) that directly address the unfairness of graph feature imputation, we do not have baselines against which to compare.
To evaluate imputed features for SBM , since we don’t have labels, we employ relative reconstruction error RE [16].
For the real-world datasets, we consider the test accuracy ( Acc ) of models applied to the imputed data.
To evaluate group fairness, we compute the discrimination risk ( DR ) of the imputed data.
For SBM , we also train models on the imputed data to predict group membership and calculate the test accuracy of the models on identifying group membership (which we refer to as MI ) [86, 21].
To evaluate group fairness for the real-world datasets, we use the test statistical parity ( SP ) of the models, defined as | P ( Z = 1 | S = Q ) − P ( Z = 1 | S = R ) | [78], and test equalized odds ( EO ), defined as | P ( Z = 1 | S = Q, Y = 1) − P ( Z = 1 | S =
R, Y = 1) | [87].
Please refer to Section B. for more details on the metrics.
For all metrics, we report the mean and standard error over 5 runs using different random seeds.
On each run, a new dataset (in the case of SBM ) is generated, new splits are created, and a new model is trained.
Q1.
Does the contraction coefficient α align with the discrimination risk of mean aggregation imputation across graphs with different properties?
Figures 2 to 12 in the Appendix show that for
SBM , discrimination risk and α generally have a strong positive association over unknown feature rates, group sizes, and inter-link rate to intra-link rate ratios, which substantiates Theorem 2.
This association is weaker for Global Mean and Neighbor Mean.
Refer to Section B.5 for more details.
Q2.
Does ϵ -fair mean aggregation imputation (compared to regular mean aggregation imputation) improve the group fairness of a model applied to the imputed data?
Table 1 shows that, for SBM , ϵ -fair mean aggregation imputation achieves comparable reconstruction error to its vanilla counterpart while greatly reducing the discrimination risk and test group membership identification accuracy for all models.
As expected, we see that the discrimination risk of ϵ -fair imputation is at most ϵ , and discrimination risk and test group membership identification accuracy are positively associated, which substantiates Theorem 1.
Furthermore, the reconstruction error for ϵ -fair FP and
GR (which leverage graph structure and are thus more susceptible to graph structural bias) are much lower than that of the naïve ϵ -fair GM (which does not consider graph structure), but fair FP and GR reduce the discrimination risk and test group membership identification accuracy for all models to similar levels as fair GM.
However, the test group membership identification accuracy generally decreases less as ϵ decreases for mlp and gcn than it does for linear , which suggests that minimizing the discrimination risk of imputed features is more effective at removing linearly-encoded group membership information than non-linearly encoded information.
Furthermore, ϵ -fair feature imputation does not guard against group membership information that gcn learns via graph structure during training.
We have similar findings when averaging over different relative group sizes (refer to
Table 3) and combinations of inter- and intra-link rates (refer to Table 4).
In contrast, Tables 2 and 6 (in the Appendix) show that, for the real-world datasets, regular mean aggregation imputation and its ϵ -fair counterpart yield comparable test accuracy and statistical parity fairness for all models.
In the case of Credit defaulter , our solution even appears to exacerbate the unfairness of gcn .
We find similar results for equalized odds, as shown in Tables 5 and 7.
Notably, we were unable to reproduce similar unfairness results to those in [29], even when all features are known.
More deeply understanding why our method does not work on the real-world datasets is an important and interesting future work; we would like to analyze the modularity of the real-world networks, as well as the distribution of node degrees, labels, and features across groups to diagnose sources of failure.
Conclusion
We prove that a higher discrimination risk can amplify the unfairness of a ML model applied to imputed data.
We formalize a general graph feature imputation framework called mean aggregation imputation and theoretically and empirically characterize graphs in which applying the framework can yield a high discrimination risk.
We propose a simple and effective solution to ensure mean
[Table] [Table]
aggregation-imputed features provably have a low discrimination risk, while minimally sacrificing reconstruction error (with respect to the imputation objective).
Our analysis and solution, like many fair ML algorithms, assume that groups are discrete and that group membership is known and static, which is not true in reality [82, 84, 26].
Furthermore, we don’t consider fairness at the intersections of different groups [88, 89], or operationalizations of fairness beyond the parity of two non-overlapping groups [90].
Furthermore, while fairness is often framed as sufficient for the creation of ethical systems, this is often not the case.
For instance, ϵ -fair mean aggregation imputation may be used to train a “fairer” model that diversifies news recommendations to social media users [7], but this model could recommend hostile or intolerant news sources to
LGBTQIA+ users and cause psychological harm [82].
Acknowledgments and Disclosure of Funding
This work was partially supported by NSF III-1705169, NSF 1937599, NSF 1927554, NSF 2119643,
Okawa Foundation Grant, Amazon Research Awards, Cisco research grant USA000EP280889, Sloan
Research Fellow, Picsart Gifts, and Snapchat Gifts.
Checklist
For all authors... (a) Do the main claims made in the abstract and introduction accurately reflect the paper’s contributions and scope?
[Yes] (b) Did you describe the limitations of your work?
[Yes] (We transparently discuss the limitations of theoretical results, formalizations, and experimental results throughout the paper, directly before or after they are presented.)
(c) Did you discuss any potential negative societal impacts of your work?
[Yes] (We refrain from using a recidivism prediction dataset and inferring identity from data for ethical reasons in Sections 7 and B.4, and discuss potential negative societal impacts of our work in Section 8.)
(d) Have you read the ethics review guidelines and ensured that your paper conforms to them?
[Yes] 2.
If you are including theoretical results... (a) Did you state the full set of assumptions of all theoretical results?
[Yes] (We enumerate all assumptions in the theorem statements or in the paragraphs leading up to the theorems.)
(b) Did you include complete proofs of all theoretical results?
[Yes] (We do so in Section A.) 3.
If you ran experiments...
(a) Did you include the code, data, and instructions needed to reproduce the main experimental results (either in the supplemental material or as a URL)?
[Yes] (All experiment code and relevant dependencies and instructions are included in the supplemental material.)
(b) Did you specify all the training details (e.g., data splits, hyperparameters, how they were chosen)?
[Yes] (All training details are specified in Sections 7, B.1, B.2, and B.3.)
(c) Did you report error bars (e.g., with respect to the random seed after running experiments multiple times)?
[Yes] (We report all metrics with their mean and standard error computed over 5 runs with different random seeds, as discussed in Section 7.)
(d) Did you include the total amount of compute and the type of resources used (e.g., type of GPUs, internal cluster, or cloud provider)?
[Yes] (We do so in Section B.3.)
If you are using existing assets (e.g., code, data, models) or curating/releasing new assets... (a) If your work uses existing assets, did you cite the creators?
[Yes] (We cite the original creators of all datasets, code, and libraries in Sections 7 and B and include URLs.)
(b) Did you mention the license of the assets?
[Yes] (All code and datasets are used in accordance with their license, as explained in Sections B.1, B.2, and B.3.)
(c) Did you include any new assets either in the supplemental material or as a URL?
[Yes] (The code for running the experiments in Sections 7 and B are included in the supplemental material.
We do not create any new datasets.)
(d) Did you discuss whether and how consent was obtained from people whose data you’re using/curating?
[Yes] (The real-world datasets are used in accordance with their MIT license, as explained in Section B.1.)
(e) Did you discuss whether the data you are using/curating contains personally identifiable information or offensive content?
[Yes] (We do so in Section B.1.)
If you used crowdsourcing or conducted research with human subjects... (a) Did you include the full text of instructions given to participants and screenshots, if applicable?
[N/A] (b) Did you describe any potential participant risks, with links to Institutional Review Board (IRB) approvals, if applicable?
[N/A] (c) Did you include the estimated hourly wage paid to participants and the total amount spent on participant compensation?
[N/A]
A Proofs A.1 Proof of Lemma 1 (special case of total variation distance)
We assume P ( Z ) and P ( X ) are continuous probability distributions
[Equation]
but this proof can be easily altered for other kinds of probability distributions and the result still holds.
Let P ( S = Q ) = p .
By definition, the total variation information:
[Equation]
By breaking up joint probabilities into conditional probabilities and factoring:
[Equation]
It can be similarly shown that I TV ( P ( X ); P ( S ))
= 2 p (1 − p
[Equation]
d TV ( P ( X | S = Q ) , P ( X | S = R )) .
Now, because Z is conditionally independent of S given X , by the Data Processing Inequality,
I TV ( P ( Z ); P ( S ))
≤ I TV ( P ( X ); P ( S )) .
Hence: d
[Equation]
Similarly:
[Equation]
Note: Differences in the supports of P ( Z ) and P ( X ) should not influence one’s interpretation of the inequality.
d TV ( · , · ) only requires that its two arguments have the same support.
Because d TV outputs the largest possible difference between the probabilities that the two distributions can assign to the same event, the inequality can be viewed as a comparison of the differences in assigned probabilities.
A.2 Proof of Theorem
Leveraging the Bretagnolle–Huber (BH) bound 4 , we can upper bound d TV in terms of the KLdivergence d KL :
[Equation]
By Section 9 from [92], d KL ( P ( X | S = Q ) || P ( X | S = R )) admits a closed-form solution:
[Equation]
where λ max (Σ − 1 R ) is the maximum eigenvalue of Σ − 1 R .
We note that λ max (Σ − 1 R ) = 1 λ min (Σ R ) >
(where λ min (Σ R ) is the minimum eigenvalue of Σ R ) because Σ R is positive semidefinite.
It is clear that ∥ µ Q − µ R ∥ 2 ∞ =
max i ∈ [ d ] | ( µ Q ) i − ( µ R ) i | 2 ≤ (cid:80) i ∈
[ d ] | ( µ Q ) i − ( µ R ) i | 2 =
∥ µ Q − µ R ∥ 22 .
Moreover, ∥ µ Q − µ R ∥ 22 = (cid:80) i ∈ [ d ] | ( µ Q ) i − ( µ R ) i | 2 ≤ (cid:80) i ∈
[ d ] max j ∈ [ d ] | ( µ Q ) j − ( µ R )
j | 2 = d · ∥ µ Q − µ R ∥ 2 ∞ .
Therefore, ∥ µ Q − µ R ∥ 22 = C · ∥ µ Q − µ R ∥ 2 ∞ , for 1 ≤ C ≤ d .
Combining the previous observations and recognizing that ∥ µ Q − µ R ∥ 2 ∞ =
R 2 D :
[Equation]
Now, by Lemma 2.7 from [93]:
[Equation]
R ∥ 22 ≤ 4 · max { λ max (Σ Q ) , λ max (Σ R ) }
[Equation]
Using ∥ µ Q − µ R ∥ 22 = C · ∥ µ Q − µ R ∥ 2 ∞ =
C · R 2 D , we can derive:
[Equation]
Similarly:
[Equation]
Then, the theorem is proved by application of Lemma 1.
A.3 Example mean aggregation imputation algorithms
Global Mean This method sets the unknown features to the uniform mean of all the known features.
To achieve this, we can choose M :
= I N , T := (cid:20)
I | K | 0| K | 1 | U |×| K | (cid:21) (where 1 is the all-ones matrix), β := 0 , X (0) K :=
X K , and X (0) U := 0 .
We only need to complete one iteration.
Neighbor Mean This method sets the unknown features to the degree-weighted mean of the known features for neighboring nodes.
We can choose M :
= I N , T :
= D − 1 A , β := 0 ,
X (0) K :=
X K , and X (0) U := 0 .
We only need to complete one iteration.
Feature Propagation
This method proposed by [16] predicts the unknown features to minimize the Dirichlet energy of the graph while preserving the known feature values.
[16] shows that this is equivalent to iteratively computing until convergence:
[Equation]
Multiplying both sides by D − 12 U , we can re-express the second update rule as:
[Equation]
Therefore, to achieve Feature Propagation, we can choose M := D − 12 , T :
= D − 1 A , β := 0 , and
X (0) K :=
X K .
Per [16], we can choose X (0) U arbitrarily, and we need to iterate till convergence.
Graph Regularization This method inspired by [94] predicts the unknown features via a smoothness constraint and a fitting constraint for the known features.
[94] shows that this is equivalent to iteratively computing until convergence:
[Equation]
where the hyperparameter β ∈ (0 , 1] .
Therefore, similar to Feature Propagation, to achieve Graph
Regularization, we can choose M := D − 12 , T :
= D − 1 A , and X (0) K :=
X K .
Per [94], we can choose
X (0) U arbitrarily, and we need to iterate till convergence.
A.4 Proof of Theorem
The following proof is partially inspired by the proof of Theorem 4.1 in [7].
Fix t to be an arbitrary iteration of feature imputation.
Recall we use the following iterative update rule to impute features:
[Equation]
For a node q ∈ Q ∩ U , after one iteration of feature imputation:
[Equation]
Similarly, for a node r ∈ R ∩ U , after one iteration of feature imputation:
[Equation]
In contrast, for a node q ∈ Q ∩ K , after one iteration of feature imputation:
[Equation]
Similarly, for a node r ∈ R ∩ K , after one iteration of feature imputation:
[Equation]
We say v ∈ [ µ ± σ ] ⇐⇒ µ − σ ⪯ v ⪯ µ + σ .
Then, for a node q ∈ Q ∩ U , by the right-stochastic nature of T :
[Equation]
Similarly, for a node r ∈ R ∩ U : ˜ X ( t +
[Equation]
∈    (cid:88)
[Equation]
In contrast, for a node q ∈ Q ∩ K :
[Equation]
Similarly, for a node r ∈ R ∩ K :
[Equation]
By the Law of Total Expectation:
[Equation]
Similarly, E r ∼ R [ ˜ X ( t +1) r ] : ∈
[Equation]
 
Thus, the gap in expectation of the features of the nodes in Q and R after one iteration of feature imputation is:
[Equation]
 
Define the contraction coefficient:
[Equation]
Because 0 ≤ T R → Q ∩ U + βT R → Q ∩ K | Q |
[Equation]
<
T
[Equation]
→ Q | Q | = 1 , and similarly, 0 ≤ T Q → R ∩ U + βT Q
→ R ∩ K | R | < 1 , it must be that 0 ≤ α ≤ 1 .
Then:
[Equation]
Inductively, the discrimination risk ˜ R ( t ) after t iterations of feature imputation is bounded by:
[Equation]
∀ v ∈ V , ˜ X ( t +1) v is a convex combination of (cid:83) u ∈ V { ˜ X ( t ) u } .
This is because each row of T and βT + (1 − β )
I | K | contains nonnegative entries that sum to 1.
Therefore, ˜ X ( t +1) v must be in the (closed) convex hull of (cid:83) u ∈ V { ˜ X ( t ) u } .
Thus, (cid:83) u ∈ V { ˜ X ( t ) u } inductively must be contained within the (closed) convex hull of (cid:83) u ∈ V { ˜ X (0) u } , which has extreme points ⊆
(cid:83) u ∈ V { ˜ X (0) u } .
Consequently, ∀ t ∈ [0 , ∞ ) , ˜ σ ( t ) ≤ ˜ σ (0) .
Hence:
[Equation]
If α < 1 :
[Equation]
Moreover, upon convergence:
[Equation]
Note: While it appears that a large initial maximal deviation in feature values within a group may harm fairness, a large initial deviation does not necessarily entail diversity.
For example, suppose a few nodes in a group have a low initial feature value but many more nodes have a much higher initial feature value (i.e., large initial difference without diversity).
Then, after mean aggregation, the feature values for all the nodes in the group may be higher on average than they were initially, and more distinct on average from the node feature values in the other group.
This would contribute to a higher discrimination risk.
A.5 Extending Theorem
We can extend Theorem 2 to the case the number of features d > 1 .
By Theorem 1, the modified discrimination risk at iteration t (including all features) is:
[Equation]
 ˜ σ
[Equation]
i
Moreover, assuming ∀ i ∈ [ d ] , α i < 1 , upon convergence, the discrimination risk is:
[Equation]
A.6 Proof of Theorem
We want to constrain the discrimination risk of mean aggregation feature imputation to be at most ϵ .
To this end, we can modify mean aggregation feature imputation to update X ( t +1)
U
[Equation]
W Z (
[Equation]
B such that X ( t +1) has a discrimination risk of at most ϵ for all t .
| E q ∼ Q [ X ( t +1)
q
[Equation]
( t +1) r ] |
[Equation]
Z
[Equation]
) r )
| .
Hence, we have a closed convex polytope wherein unknown feature values yield discrimination risk of at most ϵ :
[Equation]
If R K − ϵ ≤ c T Z ( t ) U ≤ R K + ϵ , then P W = I | U | and P B = 0 .
Otherwise, we must project onto the closer of the two boundaries of the polytope.
In this case, P W = I | U | − cc T c T c and P B = cc T
[Equation]
T
[Equation]
The affine projection we perform at each step is closed and convex.
Furthermore, ℓ is λ max (∆ UU ) - smooth for the Euclidean norm (where λ max is the maximum eigenvalue) because for x 1 , x 2 ∈ R | U | : ∥∇
[Equation]
x
[Equation]
=
[Equation] [Equation]
UU x
[Equation]
UK
[Equation]
K ) − (∆ UU x 2 + ∆ UK X K ) ∥
[Equation]
(cid:113)
[Equation]
In the case of Feature Propagation, λ max (∆ UU ) < 1 due to properties of the symmetric normalized
Laplacian [16].
Additionally, for m ≥ 0 , when m ≤ λ min (∆ UU ) , ℓ ( x ) − m 2 x T x is convex because:
[Equation]
This expression is convex if and only if its Hessian ∆ UU − mI has nonnegative eigenvalues.
Therefore, m can be at most λ min (∆ UU ) .
Then, by [95] and [96]:
a unique optimal (with respect to ℓ ) feasible solution X ∗ U exists 2. for fixed step size γ = 1 λ max (∆ UU ) , ϵ -fair imputation converges as ∥ X ( t ) U − X ∗ U ∥ 22 ≤ (cid:16) 1 − λ min (∆ UU ) λ max (∆ UU ) (cid:17) t
∥ X (0) U − X ∗ U ∥3.
for fixed step size γ ≤ 1 λ max (∆ UU ) , ϵ -fair imputation converges to X ∗ U
A.7 Theorem
We have a solution when β > 0 (i.e., when the known node feature values do not remain fixed).
We can view the update of X ( t +1) :
= (cid:20) βI | K |
I | U | (cid:21)
M − 1 TMX ( t ) + (cid:20) (1 − β ) I | K |   (cid:21)
X as an iteration of gradient descent (with step size γ = 1 ) for the objective function ℓ ( x ) = 1 2 x T ∆ x + 12 ( 1 − ββ )
∥ x K − X K ∥ 22 [94].
Theorem 4 ( ϵ -Fair Imputation, β > 0 ) Vanilla mean aggregation feature imputation updates
X ( t +1) :
= (cid:20) βI | K |
I | U | (cid:21) ( I N − ∆) X ( t ) + (cid:20) (1 − β )
I | K |   (cid:21)
X =
Z ( t ) .
Let ϵ -fair mean aggregation feature imputation instead update X ( t +1) :
= P W Z ( t ) + P B , where:
[Equation]
Then, assuming 0 ≤ λ min (∆) + 1 − ββ ≤ λ max (∆) + 1 − ββ < 1 : 1) a unique optimal (with respect to ℓ ) feasible solution X ∗ exists; 2) for fixed step size γ =
[Equation]
imputation converges as
[Equation]
for fixed
[Equation]
ϵ -fair imputation converges to X ∗ .
Proof of Theorem 4 We want to constrain the discrimination risk of mean aggregation feature imputation to be at most ϵ .
To this end, we can modify mean aggregation feature imputation to update
X ( t +1) :
= P W Z ( t ) + P B such that X
( t +1) has a discrimination risk of at most ϵ for all t .
| E q ∼ Q [ X ( t +1) q ]
[Equation] [Equation]
t +
[Equation]
] | =
[Equation]
|
[Equation]
|
[Equation]
q
[Equation]
Z
[Equation]
t ) q − 1 | R | (cid:80) r ∈ R Z ( t ) r .
Hence, we have a closed convex polytope wherein feature values have discrimination risk of at most ϵ :
[Equation]
If − ϵ ≤ c T Z ( t ) ≤ ϵ , then P W = I N and P B = 0 .
Otherwise, we must project onto the closer of the two boundaries of the polytope.
In this case, P W = I N − cc T c T c and P B = cc T c T c
[Equation]
The affine projection we perform at each step is closed and convex.
Furthermore, ℓ is
[Equation]
λ max (∆) + 1 − ββ (cid:17) -smooth for the Euclidean norm because for x 1 , x 2 ∈ R N :
[Equation]
Additionally, for m ≥ 0 , when m ≤ λ min (∆) + 1 − ββ , ℓ ( x ) − m 2 x T x is convex because:
[Equation]
This expression is convex if and only if its Hessian ∆ − mI + 1 − ββ
(cid:20)
I | K |   (cid:21) has nonnegative eigenvalues.
Therefore, m can be at most λ min (∆) + 1 − ββ .
Then, by [95] and [96]:
a unique optimal (with respect to ℓ ) feasible solution X ∗ exists 2.
for fixed step size γ = 1 λ max (∆)+ 1 − ββ , ϵ -fair imputation converges as ∥ X ( t ) − X ∗ ∥ 2 2 ≤ (cid:18) 1 − λ min (∆)+ 1 − ββ λ max (∆)+ 1 − ββ (cid:19) t
∥ X (0) − X ∗ ∥3.
for fixed step size γ ≤ 1 λ max (∆)+ 1 − ββ , ϵ -fair imputation converges to X ∗
B Additional experimental results B.1 Datasets
SBM synthetic datasets Each network has 500 train nodes, 250 validation nodes, and 250 test nodes, split uniformly at random.
Each node has a 10-dimensional feature vector sampled as described in the documentation 5 .
All edges have a weight of 1.
PyTorch Geometric is used in accordance with its
MIT license.
Real-world datasets In the Credit defaulter dataset, each node has 13 features (e.g., education, credit history, etc.), with an average degree of 95 .
79 ± 85 . 88 [29].
In the German credit dataset, each node has 27 features (e.g., loan amount, account-related features, etc.), with an average degree of 44 .
48 ± 26 . 51 .
For both datasets, we use a 50/25/25 train/validation/test split, with each split comprising an equal portion of each label, and we do not include group membership as a feature.
To the best of our knowledge (via manual sampling and inspection), neither dataset contains personally identifiable information or offensive content.
We use [29]’s data and data loading code 6 in accordance with the MIT license.
B.2 Imputation algorithms
We run GM and NM for 1 iteration each, and FP and GR for 40 iterations.
We adapted the code for data utilities, Feature Propagation, and model training from [16] 7 in accordance with its Apache-2.
license.
We state all changes in this paper.
We implement all algorithms using PyTorch, in accordance with its license [97].
B.3 Models and training
For mlp and gcn , we use a hidden dimension of 64.
We train all models full-batch using the Adam optimizer with a learning rate of 0.005 and Dropout rate of 0.5 [98, 99].
We also use early stopping with a patience of 200 epochs, i.e., we stop training when the best validation accuracy has not changed for 200 epochs, and train for a maximum of 10000 epochs.
We do not do any hyperparameter tuning.
We implement and train all models using PyTorch and PyTorch Geometric [97, 83].
We train all models on a single tesla
v100-sxm2-16gb GPU
on an internal cluster.
B.4 Performance Evaluation
To evaluate imputed features for SBM , since we don’t have labels, we employ relative reconstruction error RE (calculated as ∥ X true − X pred ∥ 2 / ∥
X true ∥ 2 , where X true and X pred are the ground-truth and imputed features, respectively [16].
A lower reconstruction error is better, and we would like regular mean aggregation imputation and its ϵ -fair counterparts to have comparable reconstruction errors.
To measure performance on the real-world datasets, we consider the test accuracy ( Acc ) of models applied to the imputed data.
A higher test accuracy is preferable, and we again would like comparable accuracies for regular and ϵ -fair imputation.
To evaluate group fairness, we compute the discrimination risk ( DR ) of the imputed data.
A lower discrimination risk is preferable.
For the SBM synthetic datasets, we also measure how much information the imputed features contain about group membership.
We do this by training the models on the imputed data to predict group membership and calculate the test accuracy of the models on identifying group membership (which we refer to as MI ) [86, 21].
(We note that this setting may violate our theoretical assumptions in 3 that the association of group membership with model predictions can be fully explained by the node features.)
The models may be conceptualized as adversaries attempting to recover group membership from the imputed features.
Thus, we would like
MI to be closer to 0.5 (i.e., the imputed features contain no information about group membership).
We do not compute MI for the real-world datasets, as inferring group membership or identity from realworld data is invasive, invalid, and can be weaponized against marginalized communities (e.g., to find
[Table]
, 0 . 9 } in SBM .
We use 0 .
5 relative group sizes and 0 .
5 unknown feature rates for both groups.
[Table]
and incarcerate LGBTQIA+ individuals)
To evaluate group fairness for the real-world datasets, we use the test statistical parity ( SP ) of the models, defined as | P ( Z = 1 | S = Q ) − P ( Z = 1 | S = R ) | (disparity in positive outcome rate for the groups) [78], and test equalized odds ( EO ), defined as | P ( Z = 1 | S = Q, Y = 1) − P ( Z = 1 | S =
R, Y = 1) | (disparity in accuracy of predicting positive outcome for the groups) [87].
B.5 Contraction coefficient
As we analyzed, Figures 2 to 12 show that, for SBM : 1) a low unknown feature rate for both groups or disparate unknown feature rates across the groups increases α and the discrimination risk (Figures 2, 5, 8, 11); 2) group size alone does not affect α or the discrimination risk (Figures 3, 6, 9, 12); 3) a lower inter-link to intra-link ratio increases α and the discrimination risk (Figures 4, 7, 10).
[Figure]
[Table]
[Figure] [Figure]
[Figure] [Figure]
[Figure]
Q Group Size 0.
D i s c
r
i m i n a t i o n
R i s k 0.
Q Group Size 0.
M a x
A l p h a
[Table]
009 ± 0 .
Regular NM 0 .
038 ± 0 .0 .
032 ± 0 .0 .
012 ± 0 .0 .
-Fair FP 0 .
01 ± 0 .0 .
034 ± 0 .0 .
024 ± 0 .0 .
025 -Fair FP 0 .
028 ± 0 .0 .
031 ± 0 .0 .
023 ± 0 .0 .
-Fair FP 0 .
043 ± 0 .0 .
029 ± 0 .0 ±
Regular FP 0 .
042 ± 0 .0 .
038 ± 0 .0 .
004 ± 0 .0 .
-Fair GR 0 . 029 ± 0 .0 .
022 ± 0 .0 .
005 ± 0 .0 .
025 -Fair GR 0 .
031 ± 0 .0 .
024 ± 0 .0 .
007 ± 0 .0 .
05 -Fair GR 0 .
027 ± 0 .0 .
024 ± 0 .0 .
004 ± 0 .
Regular GR 0 .
032 ± 0 .0 .
025 ± 0 .0 .
009 ± 0 .
Inter-Link Rate / Intra-Link Rate 0.
D i s c
r
i m i n a t i o n
R i s k
Inter-Link Rate / Intra-Link Rate 0.
M a x
A l p h a
Method
[Table]
[Figure]
[Table]
[Figure] [Figure]
[Figure]
Q Group Size 0.
D i s c
r
i m i n a t i o n
R i s k 0.
Q Group Size 0.
M a x
A l p h a
[Table]
± 0 .
Regular NM 0 .
031 ± 0 .0 .
041 ± 0 .0 .
005 ± 0 .0 .
-Fair FP 0 .
035 ± 0 .0 .
059 ± 0 .0 .
013 ± 0 .0 .
025 -Fair FP 0 .
031 ± 0 .0 .
062 ± 0 .0 .
013 ± 0 .0 .
-Fair FP 0 .
043 ± 0 .0 .
057 ± 0 .0 .
014 ± 0 .
Regular FP 0 .
028 ± 0 .0 .
05 ± 0 .0 .
004 ± 0 .0 .
-Fair GR 0 .
051 ± 0 .0 .
07 ± 0 .0 .
008 ± 0 .0 .
025 -Fair GR 0 .
03 ± 0 .0 .
06 ± 0 .0 .
012 ± 0 .0 .
05 -Fair GR 0 .
048 ± 0 .0 .
067 ± 0 .0 .
015 ± 0 .
Regular GR 0 .
03 ± 0 .0 .
051 ± 0 .0 .
007 ± 0 .
Inter-Link Rate / Intra-Link Rate
[Figure]
D i s c
r
i m i n a t i o n
R i s k
Inter-Link Rate / Intra-Link Rate 0.
[Figure]
h a
[Figure]
[Table]
[Figure]
[Table]
[Figure]
[Table]
[Figure]
[Table]
[Figure]
[Table]
[Figure]
[Table]
[Figure]
[Table]
[Figure]
[Table]
[Table]
[Figure]
[Table]
[Table]
[Figure]
[Table]
[Table]
[Figure]
[Table]
[Figure]
[Table]
[Figure]
[Table]
[Table]
[Figure]
[Table]
[Table]
[Figure]
[Table]
[Table]
[Figure]
[Table]
[Table]
[Figure]
[Table]
[Figure]
[Table]
[Table]
[Figure]
[Table]
[Figure]
[Table]
[Table]
[Figure]
[Table]
[Figure]
[Table]
[Figure]
[Table]
[Figure]
[Table]
[Figure]
[Table] [Table] [Figure] [Table]
[Figure]
[Table]
[Figure] [Table] [Figure] [Table]
[Table] [Table]
[Figure]
[Table]
[Table]
[Figure]
[Table]
[Table]
[Table]
[Figure]
Neighbor Mean 0.
Q Group Size
[Figure]
D i s
[Figure]
r i m i n a t
i o n
R i s k 0.
Q Group Size
[Figure]
[Figure] [Figure]
D i s c
r
i m i n a t i o n
R i s k
Inter-Link Rate / Intra-Link Rate 0.
[Figure]
M a x
A l p h a
[Figure]
[Table]
[Figure]
[Table]
[Figure]
[Table]
[Figure]
[Table]
[Figure] [Figure]
Q Group Size
[Figure] [Figure]
D i s c
r
i m i n a t i o n
R i s k 0.
Q
[Figure]