Causal Prediction Can Induce Performative Stability Authors
Abstract
Predictive models affect the world through inducing a strategic response or reshaping the environment in which they are deployed—a property called performativity.
This results in the need to constantly adapt and re-design the model.
We formalize a setting in which performativity arises using the language of causal modeling. We show that an equilibrium which closes the feedback loop is achieved when models use features that form a Markov blanket of the target variable.
Thus, a predictive model that takes the causal features does not require any further adaptation after deployment even if it changes the environment.
1. Introduction
Predictive models are often deployed from a position of power, e.g., to allocate a scarce resource, as in credit scoring or in welfare fraud prediction, or to issue other highly consequential high-stakes decisions, as in recidivism prediction.
In these scenarios, the models cause a change of their environment.
This could be due to strategic responses of the population subjected to the model-mediated outcomes (Hardt et al., 2016), in which individuals attempt to game the algorithmic system, or are forced to adapt to its requirements (Miller et al., 2020).
Apart from this, the model’s outcomes could change the environment in other ways such as changing observable features of individuals as a result of decisions such as denying bail.
Modeling in these circumstances has been recently studied and formalized under the name of performative prediction (Perdomo et al., 2020).
Prediction using causal features—those which form a Markov blankets of the prediction target—as opposed to features that are merely correlated with the target is known to have beneficial properties, such as robustness to certain distribution shifts (Rojas-Carulla et al., 2018), and to spurious changes to features (Veitch et al., 2021).
In this short paper we show that causality-aware prediction also can help avoid the feedback loops due to model performativity.
2. Background 2.1. Prediction in Causal Models
We consider a prediction task in which we want to predict values of a real-valued random target variable Y with range Y ⊆ R from a set of m covariate (feature) variables X with joint range X ⊆ R m .
A predictive model g ( x I ) uses a subset of covariates X I ⊆ X to output a prediction, with x I ∈ X
I = R | X I | being a realization of variables in X I .
We assume there exists a structural causal model (SCM) describing the relationships between X and Y (Pearl, 2009).
We say that a set of features X S is Markov if they form the Markov boundary of the target variable Y , which we define as the set of Y ’s parents, children, and the children’s parents (spouses). We refer to, e.g., (Pearl, 2009) for a detailed treatment of the topic.
Let us introduce some notation and definitions regarding predictive models which are optimal in standard, nonperformative settings. In a non-performative setting we minimize the standard expected loss over some distribution D :
[Equation] where ℓ (ˆ y, y ) ≥ 0 is a loss function. A minimizer of the loss is called a Bayes-optimal model: [Equation]
For the square loss function ℓ (ˆ y, y ) = ( [Equation] ) 2 , it is wellknown that the Bayes-optimal model is the conditional expectation: [Equation]
For the 0-1 loss function ℓ (ˆ y, y ) = 1 [ˆ y =
y ] , the optimal model is the maximum a posteriori rule: [Equation] Prediction from Different Feature Sets We also consider optimal prediction of the target variable based on a given subset of features X I ⊆
X :
[Equation]
with the respective Bayes-optimal model: [Equation] 2.3. Performative Prediction The concept of performative prediction (Perdomo et al., 2020) recognizes and formalizes the fact that predictive models affect the world once deployed.
Within the probabilistic framework, this can be encoded as a distribution shift which occurs after the model’s deployment.
Such shifts are undesirable as they result in a constant drift away from the original distribution, turning the model that initially could have performed well into a suboptimal one.
It requires the model to constantly adapt to its ever-changing environment.
A way to account for the future shift is strategic training, in which a model minimizes performative loss:
[Equation]
where D g is the data distribution of ( X, Y ) induced by the deployment of a model g into its environment.
The optimal model which minimizes ?? is called performatively optimal : [Equation]
Performative optimality in general does not stop the feedback loop of needing to adapt the model to induced performative shifts.
To do so, a model g ps needs to satisfy the property called performative stability :
[Equation]
A performatively stable predictive model is best-performing even after the shift its deployment induces.
3. Performative Stability in the Soft-Intervention Model
To formalize the setting of performativity within the framework of causality, we extend the SCM in Section 2.1 by introducing a new root random variable M which represents the deployed model.
The effects of the variable M on the data variables X
and Y reflect the mechanism through which the predictive model affects the data distribution, as illustrated in Figure 1.
We represent the deployment of a given predictive model as an intervention (Pearl, 2009) on the
M variable.
Thus, the performative distribution D g is the [Figure] [Figure]
distribution of ( X, Y ) under an intervention M := g , which is simply P ( X, Y | M = g ) as M is a root variable. This is also known as a “soft intervention” on ( X, Y ) (Eberhardt & Scheines, 2007). We use a special value M = ∅ to denote the initial data distribution D ∅ =
P ( X, Y | M = ∅ ) prior to any deployment.
We make the following assumptions about the setting:
Assumption 3.1 (Markov and Faithfulness (Pearl, 2009)) .
The conditional independencies of the joint distribution of variables are expressed in the graph, and vice versa.
Assumption 3.2.
The performativity shift directly affects only the covariates: M → X , yet M ̸→ Y .
Formally, the set of covariates X d -separate Y from M (Pearl, 2009).
See Figure 2 for a graph that satisfies the assumption.
The Assumption 3.1 is a standard assumption for causal graphs that appropriately model the probability distribution.
Assumption 3.2 is equivalent to a covariate shift caused by the deployment of the model (B ¨ uhlmann, 2020).
Unlike the standard setting of covariate shift, however, performative shift can be controlled by the model’s deployer.
Next, we show that under these assumptions, surprisingly, performative stability can be achieved without any strategic training by using the Markov features.
Theorem 3.3.
Suppose that Assumption 3.1 and Assumption 3.2 hold.
Then, in the case of square loss and 0loss, the non-strategically optimal model which uses the
Markov features X S achieves performative stability across all models over the full set of covariates X :
[Equation]
Proof.
Let us denote as X N = X \ X S the set of all non-
Markov features. By Assumption 3.1, the Markov features X S provide the conditional independence guarantee:
[Equation] Moreover, from Assumption 3.2 we additionally have: [Equation] Therefore, the conditional distribution of Y | X is constant for any performative shift D g :
[Equation]
Combining these, we have:
[Equation]
Let us consider the case of the square loss. Then, the optimal non-performative model is g bayes X S ( x ) = E [ Y | X S = x S ] .
Observe that one performatively stable model, which minimizes PR ( · ; g bayes X S ) , is the Bayes-optimal model over the distribution induced by g bayes X S .
We know its closed form: it is the conditional expectation E [ Y | X = x, M = g bayes X S ] .
By Equation (5), it equals g bayes X S ( x ) . An analogous argument holds for 0-1 loss.
4. Conclusions
In this short paper, we provided a formal argument that causal prediction—using features on the Markov boundary of the target—can induce performative stability: remove the need to adapt to those changes of the environment which are due to the model itself under the assumption that performative shifts can be formalized as soft interventions on the data distribution. Future work could investigate other formalizations of performativity such as individual-level hard interventions, more appropriate to strategic classification settings (Miller et al., 2020).