Causal Effect Identification in a Sub-Population with Latent Variables

Authors: amir mohammad abouei
ehsan  mokhtarian
negar  kiyavash
matthias  grossglauser
Venue: NeurIPS_cc_2024_Conference
Published: 2024-05-15 14:02:12

Abstract: The s-ID problem seeks to compute a causal effect in a specific sub-population from the observational data pertaining to the same sub population (Abouei et al., 2023). This problem has been addressed when all the variables in the system are observable. In this paper, we consider an extension of the s-ID problem that allows for the presence of latent variables. To tackle the challenges induced by the presence of latent variables in a sub-population, we first extend the classical relevant graphical definitions, such as c-components and Hedges, initially defined for the so-called ID problem (Pearl, 1995; Tian & Pearl, 2002), to their new counterparts. Subsequently, we propose a sound algorithm for the s-ID problem with latent variables.

Main paper: 
 introduction: 
 Causal inference, i.e., understanding the effect of an intervention in a stochastic system, is a key focus of research in statistics and machine learning [Rub74, Pea00, Pea09, SGSH00]. Scientists, policymakers, business leaders, and healthcare professionals must understand causal relationships to move beyond correlations and make informed, evidence-based decisions. To perform causal inference tasks, it is crucial to differentiate between two types of data: observational and interventional [PM18] . Observational Data. Figure 1 illustrates a population that pertains to the entire sample space for a study of the causal effect of some intervention. A sampler draws samples from the population. The sampler is unbiased if it draws samples at random such that each individual in the population has Table 1 : Various causal effect identification problems. X is the set of intervened variables, Y is the set of outcome variables, and S = 1 corresponds to a sub-population. ID, c-ID, and S-Recoverability have been addressed in the presence of latent variables. S-ID problem has only been studied in causally sufficient cases where all variables are observed.Problem Given distribution Target distribution Presence of latent variables ID P (V) P X (Y) ✓ c-ID P (V) P X (Y|Z) ✓P (V|S = 1) P X (Y) ✓P (V|S = 1) P X (Y|S = 1) × an equal chance of being selected. As a result, the obtained sample is representative of the entire population. In contrast, a biased sampler selects samples based on certain criteria forming a subpopulation. For each extracted sample, we collect data from a set of observed features denoted by V.As depicted in Figure 1a , when the sampler is unbiased, the observational data comes from the joint distribution P (V). For a biased sampler, the observations can be modeled as drawn from a conditional distribution P (V|S = 1), where S = 1 indicates that the sample belongs to a sub-population.Interventional Data. An intervention on a subset X ⊆ V assigns specific values to the variables in the subset. If performing an intervention results in changes in other variables of interest, it suggests a causal relationship, apart from mere correlation. Interventions are often represented with the do() operator, highlighting the deliberate change of a variable [Pea00, Pea09] . For the sake of simplicity in notation, we use P X (•) to denote the distribution of the variables after an intervention on X. Figure 1b depicts the population after an intervention on subset X ⊆ V, where we seek to understand how changes in X would affect a set of outcome variables Y ⊆ V \ X. To analyze this causal effect across the entire population, we must compute the distribution P X (Y). On the other hand, if we are merely interested in the results of the intervention on a specific sub-population, it suffices to compute the conditional distribution P X (Y|S = 1) pertaining to the sub-population.Causal Effect Identification. Performing interventions in populations can be challenging due to high costs, ethical concerns, or sheer impracticability. Instead, researchers often use observational methods, leveraging the environment's causal graph, a graphical representation that depicts the causal relationships between variables [Pea09, SGSH00], and observational data to estimate interventional distributions of interest. Various causal effect identification problems in the causal inference literature are concerned with this issue.Related Work. Table 1 lists four causal effect identification problems. The most renowned among them is the ID problem, introduced by [Pea95] , which seeks to determine a causal effect for the entire population using the observational distribution pertaining to the entire population. Specifically, it aims to compute P X (Y) from P (V). The c-ID problem, introduced by [SP06a] , extends the ID problem to handle conditional causal effects, i.e., compute the conditional causal effect P X (Y|Z) from the observational distribution P (V) pertaining to the entire population. [BTP14] introduced the S-Recoverability problem that focuses on inferring the causal effect of X on Y for the entire population using data drawn solely from a specific sub-population. [AMK24] introduced S-ID, which asks whether a causal effect in a sub-population such as P X (Y|S = 1) can be uniquely computed from the observational distribution pertaining to that sub-population, i.e., P (V|S = 1). S-ID Is Not ID. It is worth emphasizing that the S-ID problem is not a special case of ID problem, where the population is restricted to the target sub-population. The presence of selection bias S introduces additional dependencies among variables, and ignoring S in the graph invalidates the application of the rules of do-calculus [Pea00] (which are the main tools used to tackle the ID problem) on input distribution, i.e., P (V|S = 1). Consequently, there are many instances where a causal effect is identifiable in the ID setting but not identifiable in the S-ID setting. In particular, when all the variables in a causal system are observable, all causal effects are identifiable in the setting of the ID problem [Pea00] . This is not the case in the S-ID setting, and some causal effects become non-identifiable, as noted by [AMK24] . Moreover, even when a causal effect is identifiable in both the ID and S-ID settings, using the expression from the ID algorithm can lead to erroneous inference. Example 1 illustrates this case.Example 1. Consider an example pertaining to study of the effect of a cholesterol-lowering medication on cardiovascular disease. Figure 2 depicts the causal graph of this example, where X is the medication choice that directly affects Y , cardiovascular disease. Variable Z represents the diet and exercise routine of a person. In this scenario, X and Z are confounded by the person's socioeconomic status (e.g., income). It can be shown that the causal effect of X on Y (in the entire population, for instance, the people around the globe) is identifiable (ID) from P (X, Y, Z) and can be computed asP X (Y ) = P (Y |X). X Z Y S Figure 2: ADMG G S in Example 1.However, we might instead be interested in a study that focuses on the people of a specific region. In this case, the target sub-population would correspond to individuals who are biased toward particular diet and exercise routines and possibly have a higher genetic predisposition for heart disease. Let S be an indicator node for this subpopulation, Z has a directed edge toward S, and S and Y are confounded by the latent genetic predisposition of the people of this group. We will show in Section 5 that the causal effect in this sub-population, P X (Y |S = 1), is S-ID and equals Z P (Y |X, Z, S = 1)P (Z|S = 1). In this example, the presence of S introduces a spurious correlation between X and Y through the path involving Z and S. Therefore, if we were to ignore the presence of S and apply the ID algorithm to the input P (X, Y, Z|S = 1), it would result in incorrect inference: P (Y |X, S = 1) as opposed to the correct value P X (Y |S = 1). In Appendix D, we empirically compare the differences between ID and S-ID settings. We present another example in Appendix A where a causal effect is ID but not S-ID.In this paper, we consider the S-ID problem in the presence of latent variables. Our main contributions are as follows.• We extend the classical relevant graphical definitions, such as c-components and Hedges, initially defined for the ID problem so that they inherit the key properties of their predecessors but are applicable to the S-ID setting in the presence of latent variables (Section 4).• We present a sufficient graphical condition to determine whether a causal effect is S-ID (Theorem 5.1). Accordingly, we propose a sound algorithm for the S-ID problem (Algorithm 1).• We show a reduction from the S-Recoverability problem to the S-ID problem (Theorem 6.1), indicating that solving S-ID can also solve the S-Recoverability problem.Organization. In Sections 2 and 3, we cover the preliminaries and review key definitions and results for the ID problem. In Section 4, we formally define the S-ID problem in the presence of latent variables and present the proper modifications of the classical graphical notions of interest for the S-ID problem. We present our main results in Section 5. In Section 6, we introduce a reduction from S-Recoverability to S-ID. The appendix includes proofs of our results, as well as a numerical experiment. 
preliminaries: 
 Throughout the paper, we use capital letters to represent random variables and bold letters to represent sets of variables. Furthermore, to facilitate ease of reading, we have summarized the key notations in Table 2 .Graph Definitions. Acyclic directed mixed graphs (ADMGs) consist of a mix of directed and bidirected edges and have no directed cycles. Let G = (V, E 1 , E 2 ) be an ADMG, where V is a set of variables, E 1 is a set of directed edges (→), and E 2 is a set of bidirected edges (↔). The set of parents of a variable X ∈ V, denoted by Pa G (X), consists of the variables with a directed edge to X. Similarly, the set of ancestors of X ∈ V, denoted by Anc G (X), includes all variables on a Augmented ADMG over V ∪ {S} PaG(X)Parents of vertex X in graph G AncG(X), AncG(X)Ancestors of vertex X (including X); the union of ancestors for all X ∈ X VAS, VNS V ∩ Anc G S (S) and its complement,V \ Anc G S (S) G[X]Subgraph of G induced by the vertices in X G XZ Subgraph of G after removing incoming edges to X and outgoing edges from Z P S (V) Sub-population distribution, i.e., P (V|S = 1) P X (Y)Causal effect of X on Y, i.e., post-interventional distributionP S X (Y)Causal effect of X on Y in the sub-population, i.e., P X (Y|S = 1)Q[H] P V\H (H) Q S [H] P VNS \H (H|Anc G S (S) \ {S}, S = 1) , ∀ H ⊆ VNS directed path to X, including X itself. For a set X ⊆ V, we define Anc G (X) = X∈X Anc G (X). In an ADMG G over V, a subset X ⊆ V is called ancestral if Anc G (X) = X.A path is called bidirected if it only consists of bidirected edges. A non-endpoint vertex X i on a path (X 1 , X 2 , . . . , X k ) is called a collider if one of the following situations arises:X i-1 → X i ← X i+1 , X i-1 ↔ X i ← X i+1 , X i-1 → X i ↔ X i+1 , X i-1 ↔ X i ↔ X i+1 .Let X, Y, W be three disjoint subsets of variables in an ADMG G.A path P = (X, Z 1 , . . . , Z k , Y ) between X ∈ X and Y ∈ Y in G is called blocked by W if there exists 1 ≤ i ≤ k such that Z i is a collider on P and Z i / ∈ Anc G (W), or Z i is not a collider on P and Z i ∈ W.Denoted by (X ⊥ ⊥ Y|W) G , we say W m-separates X and Y if for any X ∈ X and Y ∈ Y, W blocks all the paths in G between X and Y . Conversely, (X ̸⊥ ⊥ Y|W) G if there exists at least one path between a variable in X and a variable in Y that is not blocked by W.For X, Z ⊆ V, G XZ denotes the edge subgraph of G obtained by removing the edges with an arrowhead to a variable in X (including bidirected edges) and outgoing edges of Z (excluding bidirected edges). Moreover, G[X] denotes the vertex subgraph of G consisting of X and bidirected and directed edges between them.A structural causal model (SCM) is a tuple (V, U, F, P (U)), where V is a set of endogenous variables, U is a set of exogenous variables independent from each other with the joint probability distribution P (U), and F = {f X } X∈V is a set of deterministic functions such that for each X ∈ V,X = f X (Pa X , U X ),where Pa X ⊆ V \ {X} and U X ⊆ U. This SCM induces a causal graph G over V such that Pa G (X) = Pa X and there is a bidirected edge between two distinct variables X, Y ∈ V when U X ∩ U Y ̸ = ∅. Henceforth, we assume the underlying SCM induces a causal graph that is ADMG, i.e., it contains no directed cycles.An SCM M = (V, U, F, P (U)) with causal graph G induces a unique joint distribution over the variables V that can be factorized asP M (V) = U X∈V P M (X|Pa G (X)) U ∈U P M (U ).This property is known as the Markov factorization [Pea09]. Note that X denotes marginalization, i.e., summation (or integration for continuous variables) over all the realizations of the variables in set X. We often drop the M in P M (•) when it is clear from the context.Modeling a Sub-Population. We model a sub-population using an auxiliary variable S and a biased sampler from a causal environment akin to [BP12, AMK24] . Suppose M is the underlying SCM of an environment with the set of observed variables V. In this causal environment, an unbiased sampler produces samples drawn from P (V). When the sampler is biased, it draws samples from the conditional distribution P S (V) := P (V|S = 1), where S is an auxiliary variable defined as S := f S (Pa S , U S ), where f S is a binary function, Pa S ⊆ V, and U S is the set of exogenous variables corresponding to S. Note that U S can intersect with U, but the variables in U∪U S are assumed to be independent. In this model, S = 1 indicates that the sample is drawn from the target sub-population. Furthermore, we define the augmented SCM M S = V ∪ {S}, U ∪ U S , F ∪ {f S }, P (U ∪ U S ) obtained by adding S to the underlying SCM M. We denote by G S , the causal graph of M S , which is an augmented ADMG over V ∪ {S}. Note that in G S , variable S does not have any children, but it can have several parents and bidirected edges.Intervention. An intervention on a set X ⊆ V converts M to a new SCM where the equations of the variables in X are replaced by some constants. We denote by Q[V \ X] := P X (V \ X) the corresponding post-interventional distribution, i.e., the joint distribution of the variables in the new SCM. The causal effect of X on Y refers to the post-interventional distribution P X (Y), where X and Y are disjoint subsets of V. Accordingly, the causal effect of X on Y in a sub-population is denoted by P X (Y|S = 1).1 Problem Setup. Let (V, U, F, P (U)) be an SCM with ADMG G representing its causal graph. Additionally, let S be an auxiliary variable representing a specific sub-population. In this paper, given the augmented graph G S and two arbitrary, disjoint subsets X and Y, we address the following question: Can the causal effect P S X (Y) be uniquely identified from the observational distribution P S (V)? Please refer to Definition 4.1 for the formal definition of the S-ID problem.A := Anc G[T] (C), then T = A.According to the definition of s-Hedge 4.6, T is an s-Hedge for C. 
id, c-component, and hedge: 
 Our proposed approach to address the S-ID problem extends certain definitions and properties from the classic ID problem [Pea95] . For the sake of completeness and pedagogical reasons, in this section, we review some definitions and the main results in the ID problem [TP02, HV06, SP06b] . Definition 3.1 (ID). Suppose G is an ADMG over V and let X and Y be disjoint subsets of V. Causal effect P X (Y) is said to be identifiable (or ID for short) in G if for any two SCMs M 1 and M 2 with causal graph G for whichP M1 (V) = P M2 (V) > 0, then P M1 X (Y) = P M2 X (Y).Next, we review C-components, a fundamental concept to address the ID problem. There exist a few different definitions for Hedge, another central notion in the ID literature. Here, we provide a somewhat simplified definition that not only suffices to present the main result of the ID problem but also allows us to extend it in the next section to the S-ID setting. Definition 3.3 (Hedge). Suppose G is an ADMG over V, and letY ⊆ V such that G[Y] is a single C-component. A subset H ⊆ V is called a Hedge for Y in G, if Y ⊊ H, G[H] is a single C-component, and H = Anc G[H] (Y). Example 2. Consider the ADMG G over V = {X 1 , X 2 , Y 1 , Y 2 } depicted in Figure 3a. In this case, G, G[X 1 , X 2 ], and G[Y 1 , Y 2 ] are single C-components. The C-components of G[X 1 , X 2 , Y 1 ] are {X 1 , X 2 } and {Y 1 }. Furthermore, H = {X 1 , Y 1 , Y 2 } is a Hedge for Y = {Y 1 , Y 2 } since G[H] and G[Y] are single C-components and Anc G[H] (Y) = H.Similarly, V is a Hedge for Y, but there exists no Hedge for either {Y 1 } or {Y 2 }.The following theorem, restating the results in [SP06b] and [HV06] , outlines a necessary and sufficient condition to determine the identifiability of a causal effect in an ADMG. Theorem 3.4 (ID). Let G be an ADMG over V, and X and Y be two disjoint subsets of V. Causal effect P X (Y) is ID in G if and only if Q[D] is ID in G, where D = Anc G[V\X] (Y). Furthermore, let {D i } k i=1 be the C-components of G[D], then Q[D] is ID in G if(Y 1 , Y 2 ) is not X 1 X 2 Y 1 Y 2 (a) ADMG G in Examples 2-3. X 1 X 2 Z 2 Z 1 Y 2 S Y 1 (b) Augmented ADMG G S in Examples 4-9.ID because D = {Y 1 , Y 2 , X 2 } and the C-components of Q[D] are D 1 = {Y 1 , Y 2 } and D 2 = {X 2 }, and {X 1 , Y 1 , Y 2 } (or V) is a Hedge for D 1 . Similarly, we can show that P {X1,X2} (Y 1 , Y 2 ) is not ID. 
s-id, s-component, and s-hedge: 
 We begin by providing a formal definition of the S-ID problem in the presence of latent variables, i.e., when the causal graph is an ADMG. Then, we present modifications of the graphical notions from the previous section so that they inherit the key properties of their predecessors and can be applied to the S-ID setting.To avoid repetition, henceforth, we denote by V the set of observed variables and by G S an augmented ADMG over V ∪ {S}. Furthermore, we denote by V AS and V NS the ancestors and non-ancestors of S in V, i.e.,EQUATIONS). Definition 4.1 (S-ID). Let X and Y be disjoint subsets of V. Conditional causal effect P X (Y|S = 1) (or P S X (Y)) is S-ID in G S if for any two augmented SCMs M S 1 and M S 2 with causal graph G S for which P M S 1 (V|S = 1) = P M S 2 (V|S = 1) > 0, then PM S 1 X (Y|S = 1) = P M S 2 X (Y|S = 1). Next definition extends Q[•] and introduces Q S [•]. Definition 4.2 (Q S [•]). For H ⊆ V NS , we define Q S [H] := P VNS\H (H|Anc G S (S) \ {S}, S = 1) .The next definition extends C-components (Definition 3.2) and introduces S-components. V = {X 1 , X 2 , Y 1 , Y 2 , Z 1 , Z 2 }. Since Anc G S (S) = {Z 1 , Z 2 , S}, we have V AS = {Z 1 , Z 2 } and V NS = {X 1 , X 2 , Y 1 , Y 2 }. In this case, the S-components of V NS are {X 1 , X 2 } and {Y 1 , Y 2 }. Moreover, the S-components of {X 1 , Y 1 , Y 2 } are {X 1 } and {Y 1 , Y 2 }.We now provide two crucial properties forEQUATIONAnc(S) Lemma 4.5. Suppose H ⊆ V NS and let H 1 , . . . , H k denote the S-components of H in G S . Then,H H 1 C 1 C 2 M 2 H 2 N 2 N 1 M 1 M 3 (a) S-components of H are H1, H2. Anc(S) H C 1 M 2 N 1 N 2 M 1 M 3 (b) H is a single S-component. Anc(S) H Y N 1 N 2 (c) H is an S-Hedge for Y. H Y (d) H is a Hedge for Y.EQUATION• Let m be the number of variables in H, and consider a topological ordering of the variables in graphEQUATIONwhere Q S [H (i) ]s can be computed byEQUATIONThe aforementioned lemmas are extensions of similar lemmas forQ[•] [TP03] to Q S [•]. Example 5. Following Example 4, since {Y 1 } is ancestral in G S [Y 1 , Y 2 ], Lemma 4.4 implies that Q S [Y 1 ] = Y2 Q S [Y 1 , Y 2 ]. Furthermore, since the S-components of V NS are {X 1 , X 2 } and {Y 1 , Y 2 }, Lemma 4.5 implies that Q S [Y 1 , Y 2 ] = Q S [VNS] Y 1 ,Y 2 Q S [VNS] . Thus, Q S [Y 1 ] can be computed from Q S [V NS ].Finally, we define S-Hedges, which extends Definition 3.3 for Hedges.Definition 4.6 (S-Hedge). Suppose Y ⊆ V NS is a single S-component in G S . A subset H ⊆ V NS is called an S-Hedge for Y in G S , if Y ⊊ H, H is a single S-component in G S , and H = Anc G S [H] (Y).When H ⊆ V NS is a single c-component, it is also a single S-component. Therefore, if H is a Hedge for Y, it will also be an S-Hedge for Y. Thus, Hedges can be seen as special cases of S-Hedges when H ⊆ V NS . Figure 4d shows the structure of H, which is a single c-component and forms a Hedge for Y. Moreover, Figure 4c presents the structure of an S-hedge H for Y. Note that S-hedges are more complex graph structures compared to Hedges. This complexity is required for us to be able to determine whether a causal effect is S-ID. Example 6. Following Examples 4 and 5, {X 1 , X 2 } is an S-Hedge for {X 2 }, because both {X 1 , X 2 } and {X 2 } are single S-components and{X 1 , X 2 } = Anc G S [X1,X2] (X 2 ). Similarly, {Y 1 , Y 2 } is an S-Hedge for {Y 2 }.Recall that G S is an augmented ADMG over the set observed variables V and auxiliary variable S, and we defined V AS = V ∩ Anc G S (S) and V NS = V \ Anc G S (S). Theorem 5.1. For disjoint subsets X and Y of V, let X AS := X ∩ V AS , X NS := X ∩ V NS , andEQUATIONandP S XNS (Y, X AS ) is S-ID in G S . 2. Suppose D := Anc G S [VNS\XNS] (Y NS ) and let {D i } k i=1 denote the S-components of D in G S . Conditional causal effect P S XNS (Y, X AS ) is S-ID in G S if there are no S-Hedge in G S for any of {D i } k i=1 . Remark 5.2. If either X NS or Y NS is an empty set, then P S X (Y) is S-ID in G S if and only if Equation (5) holds.In the absence of latent variables, i.e., when G S is a directed acyclic graph (DAG), there are no S-Hedge in G S since all the edges are directed. Therefore, Theorem 5.1 states that P S XNS (Y, X AS ) is always S-ID, and P S X (Y) is S-ID in G S if and only if Equation (5) holds. We note that this is consistent with the condition presented in [AMK24, Theorem 2] for the S-ID problem in the absence of latent variables. Example 7. Consider again ADMG G S in Figure 3b , where we want to determine whetherP S {X1,X2,Z1} (Y 1 , Y 2 ) is S-ID in G S . In this case, X AS = {Z 1 }, X NS = {X 1 , X 2 }, Y NS = {Y 1 , Y 2 }, and (Z 1 ⊥ ⊥ {Y 1 , Y 2 }|X 1 , X 2 , S) G S Z 1 X 1 ,X 2. This shows that Equation (5) holds. Hence, we need to determine whetherP S X1,X2 (Y 1 , Y 2 , Z 1 ) is S-ID in G S . In this case, D = Anc G S [Y1,Y2] (Y 1 , Y 2 ) = {Y 1 , Y 2 }, which is a single S-component. Since there exists no S-Hedge for {Y 1 , Y 2 }, Theorem 5.1 implies that P S {X1,X2,Z1} (Y 1 , Y 2 ) is S-ID in G S .Algorithm for S-ID. So far, we have presented a graphical condition to determine whether a causal effect is S-ID. In this section, we propose a recursive algorithm that returns an expression for P S X (Y) in terms of P S (V) when the condition of Theorem 5.1 holds, and otherwise, returns FAIL.In the proof of Theorem 5.1 presented in the appendix, we show that when Equation (5) holds, thenEQUATIONwhere W = V AS \ (X AS ∪ Y AS ). Thus, it suffices to find an expression for P S XNS (Y NS |V AS ) in terms of P S (V). Let D = Anc G S [VNS\XNS] (Y NS ) and {D i } k i=1 be the S-components of D in G S . From Lemmas 4.4 and 4.5 we haveEQUATIONTherefore, it suffices to find an expression for each D i in terms of P S (V). Note that D i is a single S-component in G S . We can now propose Algorithm 1 for computing P S X (Y) from P S (V). Function sID takes disjoint subsets X and Y of V along with an augmented ADMG G S and conditional distribution P S (V) as input. After defining the required notations in lines 3-5, it checks Equation (5) in line 6. If this condition is met, it defines D and its S-components {D i } k i=1 in G S . For each 1 ≤ i ≤ k, it finds the corresponding S-component T i of V NS in G S that contains D i . Note that T i is well-defined as D i cannot partially intersect with the S-components of V NS in G S . Next, the algorithm seeks to compute Q S [D i ] from Q S [T i ] by calling Function sID-Single. If Function sID-Single succeeds in returning an expression for each i, then the algorithm uses Equations ( 6) and (7) to return an expression for P S X (Y) in terms of P S (Y). Otherwise, the algorithm returns FAIL. Function sID-Single takes two single S-components C and T in G S such that C ⊆ T and aims to drive an expression forQ S [C] in terms of Q S [T].The procedure is recursive and uses Lemmas 4.4 and 4.5. In each recursion, the algorithm reduces T to a smaller subset T ′ such that T ′ is still a single S-component in G S and C ⊆ T ′ (lines 7-10). Eventually, the function either returns FAIL or an expression for Q S [C].Algorithm 1 Computing P S X (Y) from P S (V) 1: Function sID(X, Y, G S , P S (V)) 2: Output: Expression for P S X (Y) in terms of P S or FAIL 3:V AS ← V ∩ Anc G S (S), V NS ← V \ Anc G S (S) 4: X AS ← X ∩ V AS , X NS ← X ∩ V NS 5: Y AS ← Y ∩ V AS , Y NS ← Y ∩ V NS 6: if (X AS ̸⊥ ⊥ Y|X NS , S) G S XAS XNS then 7: Return FAIL 8: D ← Anc G S [VNS\XNS] (Y NS ) 9: {D 1 , . . . , D k } ← S-components of D in G S 10: for i in [1 : k] do 11: T i ← The S-component of V NS that con- tains D i 12: Compute Q S [T i ] using Lemma 4.5 13: Q S [D i ] ← sID-Single(D i , T i , Q S [T i ]) 14: if Q S [D i ] = FAIL then 15: Return FAIL 16: W ← V AS \ (X AS ∪ Y AS ) 17: Return W P S (Y AS , W|X AS ) D\YNS i Q S [D i ] 1: Function sID-Single(C, T, Q S [T]) 2: Input: Two single S-components C and T in G S such that C ⊆ T 3: Output: Expression for Q S [C] in terms of Q S [T] or FAIL 4: A ← Anc G S [T] (C) 5: if A = C: Return T\C Q S [T] 6: if A = T: Return FAIL 7: if C ⊊ A ⊊ T, then 8: T ′ ← The S-component of A in G S that contains C 9: Compute Q S [T ′ ] from Q S [T] using Lemma 4.5 10: Return sID-Single(C, T ′ , Q S [T ′ ])Example 8. Consider again ADMG G S depicted in Figure 3b , where we want to apply Algorithm 1 for causal effect P S X2 (Y 2 ). Herein, X NS = {X 2 }, Y NS = {Y 2 }, and X AS = Y AS = ∅. Function S-ID passes the condition in line 6 and definesD = {X 1 , Y 1 , Y 2 }, leading to D 1 = {X 1 } and D 2 = {Y 1 , Y 2 }. It then defines T i 's in line 12 as T 1 = {X 1 , X 2 } and T 2 = {Y 1 , Y 2 }. In line 13, it uses Lemma 4.5 to compute Q S [T 1 ] = Y1,Y2 Q S [V NS ] and Q S [T 2 ] = Q S [VNS] Y 1 ,Y 2 Q S [VNS] (See Example 5). It then calls Function sID-Single, which returns Q S [D 1 ] = X2 Q S [T 1 ] and Q S [D 2 ] = Q S [T 2 ].Finally, in line 20, the function returnsP S X2 (Y 2 ) = Z1,Z2 P S (Z 1 , Z 2 ) X1,Y1 Q S [X 1 ]Q S [Y 1 , Y 2 ],whereQ S [X 1 ] = P S (X 1 |Z 1 , Z 2 ) and Q S [Y 1 , Y 2 ] = P S (Y 1 , Y 2 |X 1 , X 2 , Z 1 , Z 2 ).Example 9. Following the previous example, suppose we want to apply Algorithm 1 for computing causal effect P S X1 (Y 1 , Y 2 ). In this case, the algorithm needs to compute Q S [Y 1 , Y 2 ] and Q S [X 2 ]. However, when the algorithm calls sID-Single (X 2 , {X 1 , X 2 }, Q S [X 1 , X 2 ]), Function sID-Single returns FAIL. Accordingly, Function sID returns FAIL for P S X1 (Y 1 , Y 2 ). Remark 5.3. Algorithm 1 is sound for the S-ID problem in the presence of latent variables. We conjecture that this algorithm is also complete, meaning that whenever it returns FAIL, the corresponding causal effect is not S-ID. 
reduction from s-recoverability to s-id: 
 Recall that the objective in S-Recoverability is to compute P X (Y) from P S (V) [BTP14] , while S-ID aims to compute P S X (Y) from P S (V). [BT15] proposed RC, a sound algorithm for the S-Recoverability problem. Subsequently, [CTB19] proved that RC is complete. In this section, we present a reduction from the S-Recoverability problem to the S-ID problem. This indicates that solving S-ID can solve the S-Recoverability problem (but not the other way around). Theorem 6.1. For disjoint subsets X and Y of V, P X (Y) can be uniquely computed from P S (V) in the augmented ADMG G S if and only ifEQUATIONandP S X (Y) is S-ID in G S .Algorithm 2 Reduction from S-Recoverability to S-ID 1: Input: X, Y, G S , P S 2: Output: Expression for P X (Y) in terms of P S or FAIL3: if (Y ̸⊥ ⊥ S|X) G S X then 4: Return FAIL 5: else 6: Return sID(X, Y, G S , P S ) X 1 X 2 Z 2 Z 1 Y SFigure 5 : The augmented ADMG G S in Example 10.Remark 6.2. Equation ( 8) is a very restrictive condition, and when it holds, Rule 1 of do-calculus implies that P X (Y) = P S X (Y).Theorem 6.1 implies that when Equation (8) does not hold, then P X (Y) is not S-Recoverable. However, this causal effect might be identifiable in the target sub-population, i.e., P S X (Y) is S-ID. As a consequence of Theorem 6.1, we propose Algorithm 2 for computing P X (Y) from P S (V). The algorithm takes as input two disjoint subsets X and Y of V along with an augmented ADMG over V ∪ {S} and the conditional distribution P S (V). It first checks Equation (8) in line 3, and then calls Algorithm 1 as a subroutine to compute P S X (Y) from P S (V) when it is S-ID in G S . Example 10. Consider the augmented ADMG G S in Figure 5 . In this graph, (Y ̸⊥ ⊥ S|X 1 ) G S X 1 , thus, Theorem 6.1 implies that P X1 (Y ) cannot be uniquely computed from P S (V). On the other hand, P X2 (Y ) can be identified fromP S (V) since (Y ⊥ ⊥ S|X 2 ) G S X 2and due to Theorem 5.1, P S X2 (Y ) is S-ID in G S . In this case, Algorithm 2 returns the following expression for P X2 (Y ) in terms ofP S P X2 (Y ) = Z1,Z2 P S (Z 1 , Z 2 ) X1 P S (X 1 , X 2 , Y |Z 1 , Z 2 ) P S (X 2 |X 1 , Z 1 , Z 2 ).Question: Does the paper specify all the training and test details (e.g., data splits, hyperparameters, how they were chosen, type of optimizer, etc.) necessary to understand the results?Answer: [Yes] Justification: We thoroughly elaborated on all the steps of our experiment in Appendix D.Guidelines:• The answer NA means that the paper does not include experiments.• The experimental setting should be presented in the core of the paper to a level of detail that is necessary to appreciate the results and make sense of them. • The full details can be provided either with the code, in appendix, or as supplemental material. 
conclusion: 
 The S-ID problem, introduced by [AMK24], asks whether, given the causal graph, a causal effect in a sub-population can be identified from the observational distribution pertaining to the same sub-population. [AMK24] addressed this problem when all the variables in the causal graph are observable. In this paper, we studied the S-ID problem in the presence of latent variables and provided a sufficient graphical condition to determine whether a causal effect is S-ID. Consequently, we proposed a sound algorithm for S-ID. While this paper proves the soundness of our proposed method, we also conjecture that our approach is not only sound but also complete. Finally, by presenting an appropriate reduction, we showed that solving S-ID can solve the S-Recoverability problem.Question: Does the paper report error bars suitably and correctly defined or other appropriate information about the statistical significance of the experiments?Answer: [Yes] Justification: Our experiment aims to compare the outcomes of our algorithm and the ID algorithm, which provide estimands for causal effects. We focus on scenarios with an infinite sample size, eliminating the need to report error rates. Further details can be found in Appendix D.Guidelines:• The answer NA means that the paper does not include experiments.• The authors should answer "Yes" if the results are accompanied by error bars, confidence intervals, or statistical significance tests, at least for the experiments that support the main claims of the paper. • The factors of variability that the error bars are capturing should be clearly stated (for example, train/test split, initialization, random drawing of some parameter, or overall run with given experimental conditions). • The method for calculating the error bars should be explained (closed form formula, call to a library function, bootstrap, etc.) • The assumptions made should be given (e.g., Normally distributed errors). • It should be clear whether the error bar is the standard deviation or the standard error of the mean. Justification: In Appendix D, we note that our numerical experiment does not need specific computational power.Guidelines:• The answer NA means that the paper does not include experiments.• The paper should indicate the type of compute workers CPU or GPU, internal cluster, or cloud provider, including relevant memory and storage. • The paper should provide the amount of compute required for each of the individual experimental runs as well as estimate the total compute. • The paper should disclose whether the full research project required more compute than the experiments reported in the paper (e.g., preliminary or failed experiments that didn't make it into the paper). 
code of ethics: 
 Question: Does the research conducted in the paper conform, in every respect, with the NeurIPS Code of Ethics https://neurips.cc/public/EthicsGuidelines? 
broader impacts: 
 Question: Does the paper discuss both potential positive societal impacts and negative societal impacts of the work performed?Answer: [No] Justification: We think there is no societal impact as our work primarily focuses on theoretical analysis of a problem in causal effect identification. Guidelines:• The answer NA means that there is no societal impact of the work performed.• If the authors answer NA or No, they should explain why their work has no societal impact or why the paper does not address societal impact. • Examples of negative societal impacts include potential malicious or unintended uses (e.g., disinformation, generating fake profiles, surveillance), fairness considerations (e.g., deployment of technologies that could make decisions that unfairly impact specific groups), privacy considerations, and security considerations. • The conference expects that many papers will be foundational research and not tied to particular applications, let alone deployments. However, if there is a direct path to any negative applications, the authors should point it out. For example, it is legitimate to point out that an improvement in the quality of generative models could be used to generate deepfakes for disinformation. On the other hand, it is not needed to point out that a generic algorithm for optimizing neural networks could enable people to train models that generate Deepfakes faster. • The authors should consider possible harms that could arise when the technology is being used as intended and functioning correctly, harms that could arise when the technology is being used as intended but gives incorrect results, and harms following from (intentional or unintentional) misuse of the technology. • If there are negative societal impacts, the authors could also discuss possible mitigation strategies (e.g., gated release of models, providing defenses in addition to attacks, mechanisms for monitoring misuse, mechanisms to monitor how a system learns from feedback over time, improving the efficiency and accessibility of ML). 
safeguards: 
 Question: Does the paper describe safeguards that have been put in place for responsible release of data or models that have a high risk for misuse (e.g., pretrained language models, image generators, or scraped datasets)? Answer: [NA] Justification: The focus of our paper is the theoretical understanding of a specific problem in the area of causal inference. Therefore, this question is not applicable. Guidelines:• The answer NA means that the paper poses no such risks.• Released models that have a high risk for misuse or dual-use should be released with necessary safeguards to allow for controlled use of the model, for example by requiring that users adhere to usage guidelines or restrictions to access the model or implementing safety filters. • Datasets that have been scraped from the Internet could pose safety risks. The authors should describe how they avoided releasing unsafe images. • We recognize that providing effective safeguards is challenging, and many papers do not require this, but we encourage authors to take this into account and make a best faith effort. 12. Licenses for existing assets Question: Are the creators or original owners of assets (e.g., code, data, models), used in the paper, properly credited and are the license and terms of use explicitly mentioned and properly respected? Answer: [NA] Justification: The focus of our paper is the theoretical understanding of a specific problem in the area of causal inference. Therefore, this question is not applicable. Guidelines:• The answer NA means that the paper does not use existing assets.• The authors should cite the original paper that produced the code package or dataset.• The authors should state which version of the asset is used and, if possible, include a URL. • The name of the license (e.g., CC-BY 4.0) should be included for each asset.• For scraped data from a particular source (e.g., website), the copyright and terms of service of that source should be provided. • If assets are released, the license, copyright information, and terms of use in the package should be provided. For popular datasets, paperswithcode.com/datasets has curated licenses for some datasets. Their licensing guide can help determine the license of a dataset. • For existing datasets that are re-packaged, both the original license and the license of the derived asset (if it has changed) should be provided. • If this information is not available online, the authors are encouraged to reach out to the asset's creators. 
new assets: 
 Question: Are new assets introduced in the paper well documented and is the documentation provided alongside the assets?Answer: [NA]Justification: The focus of our paper is the theoretical understanding of a specific problem in the area of causal inference. Therefore, this question is not applicable.Guidelines:• The answer NA means that the paper does not release new assets.• Researchers should communicate the details of the dataset/code/model as part of their submissions via structured templates. This includes details about training, license, limitations, etc. • The paper should discuss whether and how consent was obtained from people whose asset is used. • At submission time, remember to anonymize your assets (if applicable). You can either create an anonymized URL or include an anonymized zip file. 
crowdsourcing and research with human subjects: 
 Question: For crowdsourcing experiments and research with human subjects, does the paper include the full text of instructions given to participants and screenshots, if applicable, as well as details about compensation (if any)?Answer: [NA] Justification: The focus of our paper is the theoretical understanding of a specific problem in areas of causal inference. Therefore, this question is not applicable.Guidelines:• The answer NA means that the paper does not involve crowdsourcing nor research with human subjects. • Including this information in the supplemental material is fine, but if the main contribution of the paper involves human subjects, then as much detail as possible should be included in the main paper. • According to the NeurIPS Code of Ethics, workers involved in data collection, curation, or other labor should be paid at least the minimum wage in the country of the data collector. 
institutional review board (irb) approvals or equivalent for research with human subjects: 
 Question: Does the paper describe potential risks incurred by study participants, whether such risks were disclosed to the subjects, and whether Institutional Review Board (IRB) approvals (or an equivalent approval/review based on the requirements of your country or institution) were obtained?Answer: [NA] Justification: The focus of our paper is the theoretical understanding of a specific problem in the area of causal inference. Therefore, this question is not applicable. Guidelines:• The answer NA means that the paper does not involve crowdsourcing nor research with human subjects. • Depending on the country in which research is conducted, IRB approval (or equivalent) may be required for any human subjects research. If you obtained IRB approval, you should clearly state this in the paper. • We recognize that the procedures for this may vary significantly between institutions and locations, and we expect authors to adhere to the NeurIPS Code of Ethics and the guidelines for their institution. • For initial submissions, do not include any information that would break anonymity (if applicable), such as the institution conducting the review. 
 
 Appendix: The structure of the appendix is as follows. Appendix A includes an additional example of S-ID problem in the presence of latent variables. In Appendix B, we provide some preliminary lemmas used throughout our proofs. The proofs for the main results, namely, Lemmas 4.4, 4.5, and Theorems 5.1, 6.1 are presented in Appendix C. In Appendix D, we will conduct an experiment to compare the outputs of S-ID algorithm and the classic ID algorithm. In this section, we provide an example where ignoring S results in an identifiable effect, whereas the target causal effect is, in fact, not S-ID.Consider the following two SCMs. SCM M 1 :U 1 ∼ Bern(0.5) U 2 ∼ Bern(0.5) ε y ∼ Bern(0.3) X = U 1 Y = X ⊕ U 2 ⊕ ε y S = U 1 ⊕ U 2where ⊕ denotes the XOR operator, and Bern(p) denotes a Bernoulli random variable with parameter p.SCM M 2 : U 1 ∼ Bern(0.5) U 2 ∼ Bern(0.5) ε y ∼ Bern(0.3) X = U 1 Y = ε y S = 1According to the above equations, we haveP M1 (X = x, Y = y|S = 1) = P (U 1 = x)P (ε y = y) = 0.5 × P (ε y = y) > 0.Similarly for M 2 we haveP M2 (X = x, Y = y|S = 1) = P M2 (X = x, Y = y) = P M2 (X = x)P M2 (Y = y) = P (U 1 = x)P (ε y = y) = 0.5 × P (ε y = y) > 0.Thus, P M1 (X, Y |S = 1) = P M2 (X, Y |S = 1) > 0. Furthermore, we haveP M1 x=0 (Y = 1|S = 1) = P M1 x=0 (U 2 + ε y = 1|S = 1) = P M1 (U 2 + ε y = 1) = 0.5.Similarly, for SCM M 2 :P M2 x=0 (Y = 1|S = 1) = P M2 (ε y = 1|S = 1) = P (ε y = 1) = 0.3 This shows that P S X (Y ) is not S-ID in this causal graph, as P M1 (X, Y |S = 1) = P M2 (X, Y |S = 1) > 0, but P M1 x=0 (Y = 1|S = 1) ̸ = P M2 x=0 (Y = 1|S = 1). Note that ignoring the sub-population, the causal effect P X (Y ) is clearly identifiable from P (X, Y ), but as we showed above, the causal effect of X on Y is not identifiable in the sub-population from the observational data of that sub-population.Pearl's do-calculus rules [Pea00] : Let X, Y, Z, W be four disjoint subsets of V. The following three rules, commonly referred to as Pearl's do-calculus rules [Pea00] , provide a tool for calculating interventional distributions using the causal graph.• Rule 1: EQUATIONEQUATION• Let k denote the number of variables in H, and let us assume a topological order of variables in C asV c1 < V c2 < • • • < V c k in G C . Let C i be the set of variables in C ordered before V ci (including V ci ), for i = 1, 2, . . . , k, where C 0 is an empty set. Then each Q[C j ], j = 1, 2, . . . , m, is computable from Q[C]and is given byEQUATION)EQUATION) Corollary B.3. Let H 1 ⊔ H 2 ⊔ • • • ⊔ H m bea partition of set C, where for each C i there exists 1 ≤ j ≤ m such that C i ⊆ H j . Then, we haveQ[C] = j Q[H j ].Lemma B.4. Let H be a subset of V NS , we have the following equationEQUATION)Proof. According to definition of Q S , we haveQ S [H] = P VNS\H (H|Anc(S)) = P VNS\H (H, Anc(S)) P VNS\H (Anc(S)) = Q[H ∪ Anc(S)] P VNS\H (Anc(S)) .Note that Anc(S) is an ancestral set in G; Hence, for any H, we haveP VNS\H (Anc(S)) = P (Anc(S)) = Q[Anc(S)].This implies Equation (13).Lemma B.5. Let X NS and Y NS be disjoint subsets of V NS = V \ Anc G S (S). We haveP XNS (Y NS |Anc(S)) = D\YNS Q S [D 1 ] . . . Q S [D k ],where D = Anc G[VNS\XNS] (Y NS ), and D i 's are S-components of D.Proof. Using marginalization over V NS \ (X NS ∪ Y NS ), we haveP XNS (Y NS |Anc(S)) = VNS\(XNS∪YNS) P XNS (V NS \ X NS |Anc(S)) = VNS\(XNS∪YNS) Q S [V NS \ X NS ].Since D is an ancestral set in G[V NS \ X NS ], according to Lemma 4.4, we haveP XNS (Y NS |Anc(S)) = VNS\(XNS∪YNS) Q S [V NS \X NS ] = D\YNS VNS\(XNS∪D) Q S [V NS \X NS ] = D\YNS Q[D].Therefore, the first property of Lemma 4.5 implies thatP XNS (Y NS |Anc(S)) = D\YNS Q S [D 1 ] . . . Q S [D k ].Lemma B.6. If Function sID-Single returns FAIL for the inputs C and T, then T is an S-Hedge for C.Proof. When the algorithm returns Fail, 1. C and T are both single S-components since the inputs of the algorithm have to be Scomponents.Lemma 4.4. Let W, W ′ be two subsets ofEQUATIONProof. According to Lemma B.4, we have the following equationsQ S [W] = Q[W ∪ Anc(S)] Q[Anc(S)] , Q S [W ′ ] = Q[W ′ ∪ Anc(S)] Q[Anc(S)] .Putting the above equations together, we haveEQUATIONHence,k i=1 Q[H i ∪ Anc(S)] Q[Anc(S)] = k i=1 Q[C i ] Q[C i \ H i ].Consequently, we haveQ S [H] = Q S [H 1 ]Q S [H 2 ] . . . Q S [H k ] ⇐⇒ Q[H ∪ Anc(S)] = Q[Anc(S)] i Q[C i \ H i ] k i=1 Q[C i ].Note that C i \ H i are disjoint subsets of Anc(S), where each of them is the union of some Ccomponents of Anc(S). If C k+1 := Anc(S) \ i C i , then Corollary B.3 implies the following.Q[Anc(S)] = k i=1 Q[C i \ H i ]Q[C k+1 ] =⇒ Q[Anc(S)] k i=1 Q[C i \ H i ] = Q[C k+1 ]Finally, applying Corollary B.3 for H ∪ Anc(S), we haveQ[H ∪ Anc(S)] = Q[C k+1 ] k i=1 Q[C i ].This concludes the first part.Second part: the proof is similar to proof of Lemma B.2. Define C := H∪Anc(S). Let C 1 , . . . , C m be C-components of C (w.l.o.g. assume thatH i ⊆ C i for i ∈ [1 : k]). Consider a topological order of V h1 < V h2 < • • • < V hn for H, and V s1 < • • • < V s n ′ for Anc(S). Since any V hi is not an ancestor of Anc(S), V s1 < • • • < V s n ′ < V h1 < V h2 < • • • < V hn is a topological order for H ∪ Anc(S).According to Lemma B.2, we haveQ[C j ] = {i|Vc i ∈Cj } Q[C (i) ] Q[C (i-1) ] ,where (c 1 , c 2 , . . . , c n+n ′ ) = (s 1 , . . . , s n ′ , h 1 , . . . , h n ). For each i ∈ [1 : n], let H i := {V h1 , V h2 , . . . , V hi } and H 0 = ∅. For each i > 0, we haveQ[C (i+n ′ ) ] Q[C (i+n ′ -1) ] = Q[H i ∪ Anc(S)] Q[H (i-1) ∪ Anc(S)] = Q[H i ∪Anc(S)] Q[Anc(S)] Q[H (i-1) ∪Anc(S)] Q[Anc(S)] = Q S [H i ] Q S [H (i-1) ],where the last equality holds according to Lemma B.4. It suffices to show thatQ S [H j ] = {i|V h i ∈Hj } Q S [H (i) ] Q S [H (i-1) ] .Equation 18 implies thatQ S [H j ] = Q[C j ] Q[C j \ H j ].Hence, according to this equation and Lemma B.2, we haveEQUATIONNow suppose that (X AS ⊥ ⊥ Y|X NS , S) G XAS XNS holds. According to Rule 2 of do-calculus, we haveP X (Y|S = 1) = P XNS (Y|X AS , S = 1)The above equation shows that P X (Y|S = 1) is s-ID in G S if and only if P XNS (Y|X AS , S = 1) is s-ID in G S . Moreover,P XNS (Y|X AS , S = 1) = P XNS (Y, X AS |S = 1) P XNS (X AS |S = 1) .Since X NS ∩ V AS = ∅, acccording to Rule 3 of do-calculus, we have P XNS (X AS |S = 1) = P (X AS |S = 1). Hence,EQUATIONThis shows that S-Identifiability of P XNS (Y|X AS , S = 1) and P XNS (Y, X AS |S = 1) are equivalent (note that P (X AS |S = 1) > 0 due to the positivity assumption in Definition 4.1).LetW := V AS \ (X AS ∪ Y AS ), then P XNS (Y|X AS , S = 1) = W P XNS (Y, W|X AS , S = 1) = W P XNS (Y AS , W|X AS , S = 1)P XNS (Y NS |X AS , Y AS , W, S = 1) = W P XNS (Y AS , W|X AS , S = 1)P XNS (Y NS |V AS , S = 1).The above equalities have been obtained by a marginalization over W, chain rule, and replacing the definition of W, respectively. According to Rule 3 of do-calculus, since X NS ∩ V AS = ∅, we haveP XNS (Y AS , W|X AS , S = 1) = P (Y AS , W|X AS , S = 1).Moreover, according to Lemma B.5, we haveP XNS (Y NS |V AS , S = 1) = D\YNS Q S [D 1 ] . . . Q S [D k ].Combining the aforementioned equations with Equation (21), we getEQUATIONNow, note that according to Lemma B.6, if there is not any S-Hedge for D i s, then Function sID-Single will compute Q S [D i ]s. Therefore, we can compute P XNS (Y, X AS |S = 1) using the above equation, which concludes the proof. As a result, if Equation (5) holds, we haveEQUATIONTheorem 6.1. For disjoint subsets X and Y of V, P X (Y) can be uniquely computed from P S (V) in the augmented ADMG G S if and only ifEQUATIONP S X (Y) is S-ID in G S . Proof. If (Y ̸⊥ ⊥ S|X) G X , then [BT15, Theorem 2] implies that P X (Y) is not S-recoverable. If (Y ⊥ ⊥ S|X) G X, then according to Rule 1 of do-calculus, we haveEQUATIONTherefore, the identifiability of P X (Y) is equivalent to P X (Y|S = 1), which concludes the proof. U 1 X Z U 2 S YWe conduct a numerical experiment to demonstrate the significance of the s-ID problem and assess the output of Algorithm 1. Note that the experiment is simple and can be run on a system with any level of computational power.Consider the following structural causal model (SCM) with the causal graph depicted in Figure 7 .U 1 ∼ Bern(0.5) U 2 ∼ Bern(0.5) X = U 1 ⊕ ε x , ε x ∼ Bern(0.2) Y = X ⊕ U 2 Z = U 1 ⊕ ε z , ε z ∼ Bern(0.2)Herein, ⊕ denotes the XOR operation, all the variables {U 1 , U 2 , ε x , ε z , ε s1 , ε s2 , ε s3 } are independent, and Bern(p) denotes a Bernoulli random variable with parameter p. Now, consider the sub-population with the following mechanism:S = (Z × ε s1 ) ⊕ (U 2 × ε s2 ) ⊕ ε s3 , (ε s1 , ε s2 , ε s3) ∼ (Bern(0.6), Bern(0.9), Bern(0.1))We now consider the problem of estimating the causal effect of X on Y in this sub-population. Particularly, our goal is to calculate P X=0 (Y = 1|S = 1).To analyze and compare the S-ID and ID algorithms, we first determine the exact values of P X=0 (Y = 1|S = 1) and P X=0 (Y = 1). According to the equation of Y in the SCM, we haveP X=x (Y = y) = P X=x (y = x ⊕ U 2 ) = P (U 2 = y ⊕ x).Since U 2 is a Bernoulli random variable with parameter 0.5, the above probability always equals 0.5. For P X (Y |S = 1), we haveP X=x (Y = y|S = 1) = P X=x (Y = x ⊕ U 2 |S = 1) = P (U 2 = x ⊕ y|S = 1).Therefore, for X = 0 and Y = 1, we need to compute P (U 2 = 1|S = 1). By using the equation of S in the model, P (U 2 = 1|S = 1) = P (U 2 = 1, S = 1) P (U 2 = 1, S = 1) + P (U 2 = 0, S = 1) = P (U 2 = 1)P (S = 1|U 2 = 1) P (U 2 = 0)P (S = 1|U 2 = 0) + P (U 2 = 1)P (S = 1|U 2 = 1) Note that P (U 2 = 0) = P (U 2 = 1) = 0.5, hence, we have P (U 2 = 1|S = 1) = P (S = 1|U 2 = 1) P (S = 1|U 2 = 0) + P (S = 1|U 2 = 1) Since ε s1 and ε s3 and Z are independent variables, let W be Z × ε s1 ⊕ ε s3 ; then, we have 5. Open access to data and code Question: Does the paper provide open access to the data and code, with sufficient instructions to faithfully reproduce the main experimental results, as described in supplemental material? Answer: [No] Justification: As discussed in the previous question, our numerical experiment consists of a few simple steps. One can generate data according to the defined causal model in our experiment and reproduce the results. Hence, we have not provided the code.• The answer NA means that paper does not include experiments requiring code. • Providing as much information as possible in supplemental material (appended to the paper) is recommended, but including URLs to data and code is permitted.Justification: The research conducted in the paper adheres fully to the NeurIPS Code of Ethics.Guidelines:• The answer NA means that the authors have not reviewed the NeurIPS Code of Ethics.• If the authors answer No, they should explain the special circumstances that require a deviation from the Code of Ethics. • The authors should make sure to preserve anonymity (e.g., if there is a special consideration due to laws or regulations in their jurisdiction).Note that in this notation, the order of operations is intervention first, then conditioning. 


Decision: The authors presents a sound algorithm for checking s-identifiability of causal effects under sub-populations given the causal structure and partially observed data. The unanimous recommendation from reviewers is accept, which I concur with and recommend.

Reviews: review: paper_summary: paper_summary: The paper presents a sound algorithm for checking the s-identifiability of causal effects under sub-populations. This work complements earlier work on s-ID by generalizing the causal graphs to allow hidden confounders (no causal sufficiency). Specifically, the paper introduces the notions of s-components and s-Hedge, in parallel to the classical notions of c-components and c-hedge, and derives theoretical results based on those. The main theorem (Theorem 5.1) summarizes the condition under which a causal effect is s-ID, and a detailed algorithm is also proposed for deriving an identifying formula. Moreover, a reduction from s-recoverability to s-ID is mentioned which provides yet another approach to solve the s-recoverability problem.
strength_weakness: strength_weakness: - It seems that the s-ID method is sound but not complete, but I guess the paper already contains enough contributions and the completeness part can always be the future work.
- More intuitions can be provided on the difference between s-ID and ID at the end of page 2 - it would be helpful to provide a more intuitive explanation for Example 1 (in addition to an explanation based on identifying formulas) for readers to see the importance of the problem.
- The definition of $Q[]$ seems to be ambiguous. In Section 2 last subsection, $Q[X]$ is defined as the interventional distribution $Q[X] := P_{x} (V \setminus X)$, but in Theorem 3.4 $Q[D]$ seems to mean $Pr_x(D)$. It may be helpful to clarify the formal definition of $Q[D]$.
questions: questions: - Are there any insights on the difference between having $P^s(V)$ vs. having $P(V)$ for identifiabilty? For example, would more variables become dependent so they now belong to the same s-components when collecting data under $P^s(V)$?
- Is there any evidence (counterexample) proving that Algorithm 1 is not complete?
- Regarding the reduction from s-recoverability to s-ID, I'm wondering if there is any impact of this reduction besides theoretical interests. For example, will the reduction-based approach for s-recoverability be more computationally efficient?
limitations: limitations: OK.
paper_summary: paper_summary: This paper extends the S-ID problem, which asks if a causal effect within a specific sub-population can be identified using only observational data from that group. The authors consider the scenarios where some variables are latent. They provide a  sufficient graphical condition to determine whether a causal effect is S-ID and propose an algorithm based on this criterion. While the paper proves the algorithm's soundness, it suggests it might also be complete. Finally, they show that solving S-ID can solve a related problem called S-Recoverability.
strength_weakness: strength_weakness: See the Questions section below.
questions: questions: - Although the work provides rigorous theoretical contributions, it would have been nice to evaluate how it would also work empirically, especially in a close-to-real-world scenario.
- There are many variables and notations used throughout the paper. A table summarizing these notations and their definitions could improve readability.
- How often do real-world problems satisfy the restrictive condition in Equation (8)​​?
limitations: limitations: The limitations of the proposed approach have not been discussed.
paper_summary: paper_summary: This paper extends the sub-population causal effect identifiability (S-ID) problem to include latent variables by adapting classical graphical definitions such as connected-components and Hedges. It proposes a sound algorithm to compute causal effects in sub-populations with latent variables.
strength_weakness: strength_weakness: 1. Example 1 could be a better one because socioeconomic status can cause cardiovascular disease.
2. It would be good to include a sub section for summarising any assumptions made.
3. It would be good to include some real-world use-cases benefiting from such setting of causal effect identification.
questions: questions: See weaknesses section
limitations: limitations: Limitations are discussed
paper_summary: paper_summary: This paper addresses the S-ID (Sub-population Identification) problem in causal inference, extending it to scenarios with latent variables. The S-ID problem seeks to determine if a causal effect in a specific sub-population can be uniquely computed from observational data pertaining to that sub-population. The authors introduce new graphical definitions such as S-components and S-Hedges, which are extensions of classical notions like C-components and Hedges. They present a sufficient graphical condition for determining if a causal effect is S-ID and propose a sound algorithm for solving the S-ID problem in the presence of latent variables. Additionally, they show a reduction from the S-Recoverability problem to the S-ID problem.
strength_weakness: strength_weakness: Empirical evaluation: there is no experiments at all besides the last section in appendix briefly describling how the authors want to conduct them. That is to say, this paper lacks experimental results or real-world case studies to demonstrate the practical applicability and performance of the proposed solution, especiallly for the two recursive algorithms
Comparison to other existing methods: The paper surely follows the id, c-id, S-Recoverability literature for related work, but still could benefit from a more extensive comparison with other latent variable models in causal inference, [1-3] to name a few

[1] Liu, Yuhang, et al. "Identifying weight-variant latent causal models." arXiv preprint arXiv:2208.14153 (2022).

[2] Sherman, Eli, and Ilya Shpitser. "Identification and estimation of causal effects from dependent data." Advances in neural information processing systems 31 (2018).

[3] Kocaoglu, Murat, Karthikeyan Shanmugam, and Elias Bareinboim. "Experimental design for learning causal graphs with latent variables." Advances in Neural Information Processing Systems 30 (2017).
questions: questions: 1. In Remark 5.3.  the authors "conjects that this algorithm is also complete". Is there any example or situation that it returns a false negative?
2. The reduction from S-Recoverability to S-ID in Section 6 seems to suggest that S-ID is a more general problem. Is there any scenario where solving S-ID would be more useful than solving the S-Recoverability problem?
limitations: limitations: The paper proved that both proposed algorithms are sound for s-id, but did not show any guarantee for the completeness. Nevertheless, this limitation is mentioned in conclusion.

Comments: title: Thank you for your response
comment: I thank the authors for their response. I've read their response and I will stay with my score.
Having read the authors' rebuttal and comments from other reviewers, my questions have been adequately addressed. As a result, I increase my evalutaion to 6.