Paper: Interventional Fairness on Partially Known Causal Graphs: A Constrained Optimization Approach (ICLR-2024)

Reviewer comment (Novelty):
The idea of adding a fairness penalty to the prediction objective and using a trade-off parameter is not novel but has been explored in previous papers with numerous fairness notions (e.g., Quinzan et al. 2022, Frauen et al. 2023). From my understanding, the novelty is combining these ideas with causal discovery and identifiability theory for MPDAGs.

Author response:
Thanks for raising this concern. The novelty of our approach mainly lies in that we provide an effective and practical method to achieve intervention fairness, when the underlying causal DAG is unknown. The term 'effective and practical' here refers to our method's ability to maximize the prediction accuracy and manage the trade-off between accuracy and fairness comparing with the existing method. In order to achieve this, we employ a causal discovery algorithm to ascertain a MPDAG in cases where the underlying DAG is unknown. Then we propose a modelling technique on the prediction $\hat{Y}$, such that the resulting augmented graph remains an MPDAG (as detailed in Theorem 4.1). It is important to emphasize that this result is of independent interest as it establishes a general modeling method applicable to any problem and enables various causal inference tasks beyond merely identifying causal effects formally within such augmented MPDAGs. To ascertain the degree of interventional fairness on the augmented MPDAG, we delve into the results of causal effect identification on MPDAGs. This investigation necessitates the formulation of a constrained optimization problem, which achieves the desired balance between accuracy and fairness. Additionally, it is crucial to emphasize that our proposed method extends beyond merely achieving interventional fairness. As we demonstrate in Section 4.4, it is adept at encompassing all fairness notions that are defined based on interventions. This comprehensive capability significantly enhances the method's applicability in diverse scenarios requiring different fairness considerations.

Reviewer comment (Novelty):
Related to the previous point, the paper seems to combine these results in a rather straightforward manner, with limited novel ideas. However, the corresponding theoretical results (e.g., Theorem 4.1) seem sound and no previous work seems to have applied MPDAG identifiability theory to interventional fairness (which, in my opinion, is enough novelty for recommending acceptance, but also justifies why I am hesitant to give a higher score).

Author response:
Thank you for bringing up this concern and acknowledging the novelty in our work despite these considerations. We would like to clarify that those results are not combined rather straightforward. Once learning an MPDAG from the data with causal discovery algorithms, we propose a modelling technique on the prediction $\hat{Y}$, such that the resulting augmented graph $\mathcal{G^*}$ remains an MPDAG (as detailed in Theorem 4.1), which paves the way to apply the causal identification results for MPDAG on the fairness context. However, the existing causal identification results [Perkovic+; UAI2020] cannot be directly utilized to identify interventional fairness measures on the augmented MPDAG $\mathcal{G^*}$. This is because only the density $f(\mathbf{X}, \mathbf{A})$ over $\mathcal{G}$ is observable, instead of $f(\mathbf{X}, \mathbf{A}, \hat{Y})$ over $\mathcal{G^*}$. The variable $\hat{Y}$ is not directly observable and needs to be learned. To bridge this gap, Proposition 4.3 is proposed formally by exploring the relationship on graph properties and data distribution over $\mathcal{G}$ and $\mathcal{G^*}$. Proposition 4.1 enables the formal identification of the causal effect on the MPDAG $\mathcal{G^*}$ within the context of fairness effectively.

Reviewer comment (Novelty):
The authors hint at the possibility of extending their approach to other fairness notions. I think the paper would benefit from a more detailed review of related fairness notions in the appendix (e.g., total/direct/indirect effects, path-specific effects, counterfactual fairness), and how the method could (or could not) be extended.

Author response:
Thanks for the nice suggestion. According to your suggestion, we have added **Appendix F** to present more details on this part.

Reviewer comment (Experiments):
In the case of non-identification, the authors propose to replace the penalty term with a sum over all possible MPDAGs by directing the relevant edges. Can the authors provide some intuition/experiments on how this affects the prediction performance? I could imagine that the prediction performance could suffer if the objective is penalized with a large sum of MPDAGs.

Author response:
Thanks for bring up this question. In the case of non-identification, when the objective is penalized with an average over all possible MPDAGs, the prediction is also an average over all possible MPDAGs. We conduct experiments on various unidentifiable MPDAGs and find that the tradeoff between accuracy and fairness still exists in these graphs. Interestingly, compared with the prediction learnt solely on the ground-truth identifiable MPDAG, the prediction learnt on all possible MPDAGs does not necessarily deteriorate when achieving equivalent levels of unfairness. This could be attributed to the fact that they are penalizing different measures on fairness. We have added **Appendix G11** with experiments and Figure 19 to reflect this observation.

Reviewer comment (Novelty):
The algorithm presented seems to be a direct adaptation of the findings from Perkovic 2020. If the intervention distribution over observable endogenous variables can be identified and estimated, it stands to reason that the intervention distribution of the predicted label is also identifable and estimable, given that this label is derived using a known function from the intervened observable endogenous variables. This raises questions about the method's novelity.

Author response:
Thanks for raising this concern. Under our modeling technique, the interventional distribution of $\hat{Y}$ is identifiable if the interventional distribution over observable endogenous variables is identifiable, as you pointed out. That is because on the MPDAG $\mathcal{G^*}$, given other observables $\mathbf{V'}$, the probability of $\hat{Y}=\hat{y}$ under an intervention on the sensitive attribute $\mathbf{S}$ reduces to conditioning on $\mathbf{S}$, that is $f(\hat{y}|\mathbf{v'},do({\mathbf{s}}))=f(\hat{y}|\mathbf{v'},\mathbf{s})$, thus leading to $f(\hat{y}|do({\mathbf{s}}))=\int f(\hat{y}|\mathbf{v'},\mathbf{s})f(\mathbf{v'}|do(\mathbf{s})) d \mathbf{v'}$, as in Eq.(3) in Proposition 4.1. This reduction is possible because there are no unblocked backdoor paths from $\mathbf{S}$ to $\hat{Y}$ given $\mathbf{V'}$ on $\mathcal{G}^*$. However, this formal result is constructed on a valid causal graph, that is the augmented MPDAG $\mathcal{G^*}$ in our work. Before Proposition 4.1, we do require Theorem 4.1 to claim that the graph $\mathcal{G^*}$ is a valid MPDAG, such that any causal independence tests or causal inference tasks is able to be performed on $\mathcal{G^*}$. It is important to emphasize that Theorem 4.1 is of independent interest. That is because as a general modeling method applicable to any problem, Theorem 4.1 enables various causal inference tasks beyond merely identifying causal effects within the augmented MPDAGs formally.
Besides, we are unable to directly adopt Perkovic's causal identification findings, because only the density $f(\mathbf{X},\mathbf{A})$ over $\mathcal{G}$ is observable, not $f(\mathbf{X},\mathbf{A},\hat{Y})$ over $\mathcal{G^*}$. The variable $\hat{Y}$ is not directly observable and needs to be learned. To bridge this gap, we introduce Proposition 4.1, which explores the connection between the graph properties and the data distribution across $\mathcal{G}$ and $\mathcal{G^*}$. Proposition 4.1 enables the formal identification of the causal effect on the MPDAG $\mathcal{G*}$ within the context of fairness.

Reviewer comment (Novelty):
Could the authors shed light on the contributions and advancements made beyond the scope of Perkovic 2020?

Author response:
Thanks for the question. Our principal contribution lies in dealing with fair machine learning with unknown causal graphs. By modeling the predicted outcome $\hat{Y}$ as a function of observable variables and exploring the identifiability results from Perkovic 2020, we are able to identify and estimate the degree of unfairness, allowing us to manage the trade-off between accuracy and fairness. It is important to note that the identifiability results in Perkovic 2020 presuppose the input as an MPDAG. Our Theorem 4.1 claims that our modeling approach ensures that the extended graph $\mathcal{G^*}$ qualifies as an MPDAG. This implies that the identification results from Perkovic 2020, which are contingent on MPDAGs, can be applied to $\mathcal{G^*}$. Nevertheless, we are unable to directly adopt Perkovic's causal identification findings, because only the density $f(\mathbf{X},\mathbf{A})$ over $\mathcal{G}$ is observable, not $f(\mathbf{X},\mathbf{A},\hat{Y})$ over $\mathcal{G^*}$. The variable $\hat{Y}$ is not directly observable and needs to be learned. To bridge this gap, we introduce Proposition 4.1, which explores the connection between the graph properties and the data distribution across $\mathcal{G}$ and $\mathcal{G^*}$. Proposition 4.1 enables the formal identification of the causal effect on the MPDAG $\mathcal{G^*}$ within the context of fairness. Besides, we propose an estimation method as well, while Perkovic's focus is on identifiability.

Reviewer comment (Theory):
Zuo et al. utilize counterfactual fairness by identifying deterministic non-descendants of sensitive attributes on the MPDAG, which does not seem to require a full understanding of causal graphs. Can the authors provide a more detailed analysis to distinguish between these two approaches?

Author response:
Thanks for the question. The approach proposed in Zuo et al. can also be used to achieve interventional fairness, as demonstrated in Section 3.1. This method, which we refer to as 'IFair' in our experiments, relies solely on deterministic non-descendants of the sensitive attributes for learning fair predictions. This method can achieve almost zero unfairness, but it leads to a greater loss of prediction accuracy due to the ignorance of other features. Thus, it serves as a baseline in our comparative analysis. In contrast, our proposed model, '$\epsilon$-IFair', adopts a more inclusive strategy by utilizing all observational variables, irrespective of their causal relationship with the sensitive attribute $\mathbf{A}$, to derive fair predictions. This approach is articulated as a constrained optimization problem in Section 3.2, striking a balance between fairness and accuracy with vary $\lambda$. This differentiation is visually represented in our experimental section's tradeoff plots, where the 'IFair' model is indicated with a rhombus marker and '$\epsilon$-IFair' with many circles. These markers illustrate how our model, '$\epsilon$-IFair', not only achieves comparable levels of fairness to the 'IFair' model but also preserves higher accuracy, showcasing the effectiveness of our approach in managing the fairness-accuracy trade-off.