Venue: NeurIPS 2021 Conference

Reviews:

final_score: rating: 7: Good paper, accept
review_content: summary: This paper studies the weak topology on three spaces of probability measures, each corresponding to a level of a causal hierarchy introduced by Pearl (Pearl and Mackenzie, 2018).  The three levels, in order of increasing expressivity, are described as observational, interventional and counterfactual; given a set $\bf{V}$ of variables (known as "endogenous" variables; these variables can influence each other and may also be influenced by a set of "exogenous" variables), the observational distribution is a joint probability distribution over the values of $\bf{V}$ fixed according to some given structural causal model, an interventional distribution on $\bf{V}$ is a distribution where the values of some finite subset of $\bf{V}$ are fixed and a counterfactual distribution is one where various combinations of interventions with respect to different finite subsets of $\bf{V}$ are permitted.  The main results are: (1) a topological characterization of the set of hypotheses in the second level of the causal hierarchy that are "experimentally verifiable", which means that there is a sequence of tests that almost surely converge in the limit on the true hypothesis while a type I error is incurred up to a fixed bound at each stage (the relevant distribution belonging to the second level of the hierarchy); (2) the set C_2 of all points in the second level of the causal hierarchy that have a unique inverse (with respect to a projection from the third level) forms a meager set, where the underlying topology is the weak topology; a similar result applies to the preimage of C_2 under projection from the third level of the hierarchy.   
main_review: I think this is a well-written paper (in terms of language and style) that provides an interesting and new perspective of causation.  Mathematically, the paper seems generally correct, although the notation at some places was not clear to me.  I suggest checking the consistency and accuracy of the notation more carefully, particularly in definitions where nested sets are involved; while this is not a major point, I think it affects readability (more details below).  I am not familiar with the literature on causation, so I am unable to independently judge the overall novelty of the paper's contributions.  Based on what is written in the paper, it seems that the main innovation is to apply Genin and Kelly's (2017) topological approach to statistical verifiability to study causal models, in particular the three levels of the causal hierarchy proposed by Pearl. 


Comments/Suggestions/Questions:

- Page 4, Definition 6: On the right-hand side of the equation, the meanings of the expressions (m^{M_{X:=x}})^{-1}(y)...,(m^{M_{W:=w}})^{-1}(z) were not clear to me.  (I am typing in plain text due to problems with the tex code displaying properly.)  According to the definition of (m^{M_{X:=x}})^{-1}, each input to (m^{M_{X:=x}})^{-1} should be a value in $\chi_{\bf{V}}$.  However, it seems from the definition of $\bf{y}$ between lines 147 and 148 that $\bf{y}$ is a value in $\chi_{(\bf{X}:=\bf{x}) \times Y}$.  But then why are the sets $\chi_{\bf{V}}$ and $\chi_{(\bf{X}:=\bf{x}) \times Y}$ comparable? I think some clarification would be good here.          

- Page 5, definition of $\varpi_2$: The use of the "marginalization" operator $\varsigma$ here was not clear to me.  According to the definition at the end of page 4, $\varsigma$ is taken with respect to a _subset_ of the indexed variables; so if $A$ is a single variable, then should $\varsigma$ not be taken with respect to a subset of {$A$} $\cup \bf{V}$?  As I understand, {$\alpha$} $\times \bf{V}$ is not a subset of {$A$} $\cup \bf{V}$.      

- Page 5, line of equations just before line 176: Why is $\varpi(\mathcal{M})$ not equal to $p^{\mathcal{M}}_{cf}$ (counterfactual probability)?

- Page 5, Definition 9: In the definition $\varpi(\mu) = \pi_{\emptyset}(\mu)$, it appears that $\mu$ is used to denote an indexed family of probability measures.  I suggest using a different notation (e.g. $(\mu^{(\alpha)})_{\alpha \in A}$) for a family of measures while reserving $\mu$ for a single measure. 

- Page 9, line 371: lanscape -> landscape

- Supplementary, page 1, line 5: in the left-hand side of the equation, should one take the projection onto $Pa(V)$ of $m^{\mathcal{M}}(\mathbf{u})$? 

- Supplementary, page 2, line 36: In the definition of $\xi(\bf{B})$, should $V \in \bf{V}$ be $V \in \bf{B}$ instead?  Otherwise, how does the definition depend on $\bf{B}$?  Similarly, in line 37, should the subscript be $(V,\bf{p}) \in \xi(\bf{B})$? 

- Supplementary, page 2, Equation (B.2): On the left-hand side, should one take the inverse projections $\pi^{-1}$ instead?

- Supplementary, page 2, Definition B.1.1: The definition of an SCM here doesn't seem consistent with that of Definition 3 in the main paper.  Specifically, in the original definition of a mechanism f_V, f_V maps the values of a set of parents together with a set of values of U(V) to a value of V.  In Definition B.1.1, however, the second argument of f_V is {f_V}_V, a collection of deterministic functions, but {f_V}_V is not a member of $\bf{U} := \mathcal{B}(F)$, which is a collection of sets of collections of deterministic functions.  Should the second argument be written instead as {{$f_V$}$_V$}, i.e. the singleton whose member is {$f_V$}$_V$?      

- Supplementary, page 3, Lemma B.1.2: I could not find the definition of an acausal model in the paper.

- Supplementary, page 3, line 74: I did not see in the proof of Proposition 2 where $\epsilon$ was used at all.  

- Supplementary, page 3, last sentence of proof of Proposition 2: Did you mean that "$\mu' \notin C_1$ for every $\mu' \in G_1$ since $\mu$ was arbitrary"?   
limitations_and_societal_impact: Yes.
review_title: null

final_score: rating: 7: Good paper, accept
review_content: summary: The authors propose an alternative analysis of how causal inference at different levels (observational, interventional, counterfactual) can interrelate by proposing a topology on the space of structural causal models. The authors' results confirm and at times extend existing results in the literature from a different theoretical perspective.
main_review: In spite of the Increasing interest in causality in machine learning, I believe that an increase in the theoretical and philosophical understanding of the concept is still called for, preferably from different mathematical perspectives.

Therefore, I think the authors' contribution is timely, and would be of interest to the conference audience both in terms of its immediate findings and its potential downstream implications in theory and practice. However I also believe that the paper requires more thorough discussion of the potential marginal benefits of such an approach.

I think that the paper is well-written and does a fairly good job of introducing the concepts it uses in making its theoretical points. However, this is not to say that it is an easy read: after spending effort to penetrate the authors' terminology and theoretical results, one cannot help but expect to see more discussion regarding why adopting such a perspective useful for improving our understanding of causality. Such a discussion could include which theoretical commitments historically and/or currently limited developments in causality, and how the current perspective could help resolve these issues (an obvious historical example would be Pearl's justification of the do-calculus). Discussing how such theoretical commitments shaped practical research, and what new questions would their framework facilitate would also be very beneficial. They could also discuss the significance of their current findings that result from their theoretical framework. Also, weak points of a topological perspective would be a good point of discussion: what currently existing results cannot be replicated by the authors' framework?

The authors should not be expected to provide a complete account for all of the above, but in its current form the paper's findings feel like a complete theoretical overhaul only to confirm and modestly extend previous results. Although this is not unworthy of attention by itself, I think authors' work deserves a more thorough discussion in comparison to previous theoretical and empirical work in the field.

limitations_and_societal_impact: For limitations see my comments above. I think the authors' topic does not acutely require a discussion of its societal impact, at least in its current incarnation.
review_title: null

final_score: rating: 7: Good paper, accept
review_content: summary: This paper presents a topological framework to theorize about causal inference, and defines a weak topology on each of three spaces of probability measures, corresponding to the three levels of Pearl's causal hierarchy. In this setup a topological version of the causal hierarchy theorem is derived, to the effect that collapse of the hierarchy is topologically negligible. An interesting learning theoretic interpretation of this result is also given, in the spirit of no-free-lunch theorems.       
main_review: This is an interesting and solid theoretical paper, providing a general framework for examining causal inference from a topological perspective, as well as establishing a topological version of a fundamental result about the limit of causal inference. Among papers of comparable technicality, this one is fairly readable and often illuminating. I like the paper, though it is hard to predict how much attention it will draw in the field of causality, let alone the NeurIPS community in general. I won't be surprised if the paper ends up with limited impact; we have to wait to see whether this perspective will yield more positive results. Still, I think the current paper is a good one for NeurIPS to consider. 

Regarding the main result of the current paper, I think the bit in Corollary 1 about PNS in particular is more interesting than Theorem 3. Collapse is rarely called for in practice anyway, as we typically are concerned with specific causal questions such as PNS rather than with all possible causal questions. It will be interesting to know how typical it is that a specific counterfactual query is like the PNS query. I suspect that it is very typical, but I wonder whether the authors have a more definite answer or insight to add on this matter.
limitations_and_societal_impact: Yes.
review_title: null

final_score: rating: 6: Marginally above the acceptance threshold
review_content: summary: This paper proposes a series of topologies on the different spaces of probability spaces of structural causal model. The authors define certain causal projections on these spaces that should map higher levels of the causal hierarchy to lower levels. The non-injectivity of these projection maps is shown and illustrates, what is called, the collapse of the hierarchy. The authors show that for those probability spaces that collapse are topologically meager. Using the result that open sets in the weak topology corresponds to statistical hypothesis that can be verified, the authors show that the collapse can never be statistically verified, because of topological meagerness.

main_review: This paper takes a very interesting and unique approach by connecting the world of topology of statistical verifiability to that of structural causal modeling. They show the interesting result, that any condition that could infer counterfactual distributions from interventional distributions must be statistically unverifiable, however, I found the paper very hard to read and I was unable to verify many of the claims.

First of all, the authors use a lot of non-standard and imprecise notation and terminology. For example, why not use the more common terminology, such as a graph, instead of direct influence relation? The authors state that their two assumptions of well-foundedness and local finiteness generalize the recursiveness assumption, however, they never define what well-foundedness is. This raise questions downstream such as what the intuition about $\omega$-like is. The non-standard notation of using projection mappings and cylinder subsets makes the paper quite difficult to follow. This led to much more confusion, later on. For example, in understanding the causal projection and how this gives rise to Fact. 3. By coincidence, while checking the Supplementary Material, I found that Definition 6 is not at all so trivial to understand and the authors had to derive that it was a  well-defined definition, without mentioning this, or referring to it, in the main paper.

Secondly, many things are not motivated or explained enough, for example what is the intuition of Definition 8? Why do you only consider those SCMs? Or, how does the result on meagerness relate to Meek's strong completeness result?

Thirdly, the authors seem not to be aware of related literature and many citations are missing IMO. For example, most of the results about SCMs and the causal hierarchy are already proven in a more general measure-theoretic setting, where (1) no countable range of the variables and (2) no recursiveness is assumed (see e.g., [1]). The authors do not motivate why they choose a more restricted setting, where only endogenous variables are taken with a countable range or they only consider recursiveness. This makes it difficult to distinguish what is already known (such as Proposition 2 and 3) and what the particular contributions of this paper are.

At last, I think the overall readability can be clarified by being more specific, and avoid sentences like '... it is sensible to aim for results with "nearly universal" force' or 'Common wisdom ... ' [without adding a reference]. I think in general, the results of this paper are very interesting and valuable, but I think that the clarity of writing can be improved a lot.  Given the current state of the paper, it does not provide a clear enough exposition of the results for NeurIPS.

[1] S. Bongers, P. Forré, J. Peters, and J. M. Mooij. Foundations of structural causal models with cycles
and latent variables. arXiv.org preprint, arXiv:1611.06221v5 [stat.ME], 2021. URL https://arxiv.org/abs/1611.06221

Update: I've updated my score.

limitations_and_societal_impact: I think that this paper has the potential for a strong impact due to the novel connection between statistical verifiability and SCMs. I strongly recommend to elaborate more on the intuition of the crucial concepts, which I think will increase the impact of this paper even more.
review_title: null

final_score: rating: 8: Top 50% of accepted NeurIPS papers, clear accept
review_content: summary: The paper introduces a topological learning-theoretic version of the causal hierarchy theorem (Bareinboim et al. 2020). 
This result shows that associational, causal, and counterfactual quantities are not only distinct in a measure-theoretic sense but also in a topological sense. This, in turn, implies that causal assumptions allowing the inference of arbitrary counterfactual quantities from experimental data would be statistically unverifiable.
This result reinforces the notion that causal assumptions are needed to perform causal and counterfactual inference, as they cannot be accomplished solely from data. Such formal limit becomes even more important when considering the strong inclination of ML research towards finding methods that are successful at modeling the observed data but are blind to causal constraints not present in the data.
main_review: This work gives a new and complementary perspective to recent work in formalizing the notion of the Ladder of Causation or the Pearl's Causal Hierarchy (PCH). The idea is to formally show the intuition that causal and counterfactual inference is impossible without causal assumptions given as part of the analysis. While this paper discusses the Causal Hierarchy Theorem (CHT) proposed by Bareinboim et al., it provides an alternative, novel, and complementary result. Moreover, the authors extend the result to models with an infinite number of discrete observable variables.

Based on limited knowledge of topologies and learning theory, the definitions and results presented in the paper look sound and make intuitive sense. Furthermore, the implications and limitations of the results have been discussed thoroughly.

I find the paper is very well written and approachable for researchers in the causal inference and machine learning community. I found the reading enjoyable and easy to make sense of as it gently introduces the mathematical concepts required to understand the result.

The results in the paper seem informative and relevant for any research that has the goal of inferring counterfactual and causal effects from data. Although the result imposes limits to counterfactual inference, it motivates the study of the assumptions needed to perform such a task and for building intelligent systems capable of causal and counterfactual reasoning.
limitations_and_societal_impact: Limitations: I believe the scope and limitations of the result have been clearly stated in the paper.
Societal impacts: None that I can immediately foresee for the result.
review_title: null

Meta-review: This paper proposes a novel topological approach to the causal hierarchy. All of the reviewers found the approach interesting, although some valid concerns were raised regarding clarity and presentation. In particular, a serious concern regarding comparisons with related work was raised and sorted out during the discussion phase. 

In the end, there was a consensus recommendation to accept this paper which I concur with. We expect the authors will take the reviewer feedback into account, and in particular add a reference and detailed comparison with the paper [1].

[1] S. Bongers, P. Forré, J. Peters, and J. M. Mooij. Foundations of structural causal models with cycles and latent variables. arXiv.org preprint, arXiv:1611.06221v5 [stat.ME], 2021. URL https://arxiv.org/abs/1611.06221
Decision: Accept (Poster)