Venue: ICLR 2023 Conference

Reviews:

final_score: rating: 6: marginally above the acceptance threshold
review_content: summary_of_the_paper: In this paper the authors present Clifford neural layers that can be useful in the areas of fluid dynamics, weather forecasting, and the modeling of physical systems in general.  The author emipirically validate the use of Cifford layer by incorporating them in the common neural PDE surrogates for 2D Navier-Stokes, weather modeling, and 3D Maxwell equations. 
strength_and_weaknesses: The main strenghts of the paper are:

1) The paper is well-written and the main ideas are effectively presented.
2) The background section covers the pre-requisite knowledge required to understand the clifford neural layers
3) A novel method is proposed in this paper which can be useful in the Physical science domain


The main weaknesses of the paper in my opinion are:
1) As someone who does not work in the Physical sciences I could not get much information about the datasets used from the paper. I am not sure what the training sets are for these dataset and hence can't make an informed judgement on the quality of the method. [I did not go through the supplementary material in any detail ]
2) The baseline information is not very clear form the paper.

clarity,_quality,_novelty_and_reproducibility: The paper is clearly written and the main method is effectivley presented
Some information about the experiement section is missing 
The codes are not provided with the paper.
summary_of_the_review: The paper present clifford layer which can be used for application in Physical sciences. The method is tested on three datasets and the results look promising. The experiment section is missing some details which makes it a bit difficult for non-experts to read.
review_title: null

final_score: rating: 8: accept, good paper
review_content: summary_of_the_paper: This paper introduces a new architecture for Neural PDEs based on Clifford algebra. By incorporating fields with different dimensions together into one algebra system, the method yields better results when used in neural networks due to better coupling among the data.
strength_and_weaknesses: Strengths:
1. The theory is comprehensive and self-contained. The results are promising and supportive.

Weakness:
1. In Fig. 7, it is not discussed why CResNet works worse than ResNet in some of the experiments. Please add some analysis here.
2. Clifford algebra seems to be general and can potentially be applied to more than Neural PDE, as long as there are inputs of multiple data types. It would be great if the author can provide more insight into other applicable scenarios and future directions to achieve this.
clarity,_quality,_novelty_and_reproducibility: See above.
summary_of_the_review: It is a very comprehensive and self-supportive paper. I would recommend acceptance.
review_title: null

final_score: rating: 8: accept, good paper
review_content: summary_of_the_paper: This paper introduces Clifford neural layers for both convolution and Fourier operations in the context of deep learning. The main motivation is that Clifford algebras can describe the algebraic property (e.g. multiplication, addition) of multivector fields consisting scalar, vector, as well as higher-order components. The resulting Clifford neural layers are universally applicable, and the authors explore their usage in neural PDE surrogate models (for solving 2D Navier-Stokes and 3D Maxwell's equations). By replacing convolution and Fourier operations in common neural PDE surrogates by their Cliffold couterparts, the authors show that Clifford neural layers consistently improves their performance. 
strength_and_weaknesses: Strengths:

- The proposed Clifford neural layers are novel and technically solid. Based on the observation that different fields in PDE are often related, the authors propose to leverage Clifford algebras to naturally incorporate this inductive bias into neural PDE surrogate models. As far as I know, this is the first time that people introduces Clifford algebras to neural PDE modeling.
- The experiment results look promising.  Through experiments in three different settings, Cliffod neural layers bring consistent improvement compared to their standard counterparts. This is promising for an first attempt of this type.

Weaknesses:

- Some experimental results need further explanations or investigations. For example, I noticed that in Figure 7 ResNet based results, CResNet gives larger error than ResNet for low numbers of trajectories. This is different from 2D Navier-Stokes (Figure 6). It also contradicts with the claim in Sec. 5 ("the performance gap increased with less data availability across all settings"). Any explanation for this particular result.
- For 3D Maxwell's equations, the paper only shows the results for FNO based architectures. There is no explanation why ResNet based architectures are note tested here. If possible, I think it's better to include them for completeness.

clarity,_quality,_novelty_and_reproducibility: The presentation is clear and the provided Clifford algebras background is very helpful. The proposed approach is novel. Experiments are well conducted and the results look very promising. Overall the quality is very good.
summary_of_the_review: The proposed Clifford neural layers is a novel and solid technical contribution. The results look promising for the first attempt of this kind. Though there are some obvious limitations (e.g., slow runtime), they are potentially solvable. Therefore, I recommend for acceptance.
review_title: null

final_score: rating: 6: marginally above the acceptance threshold
review_content: summary_of_the_paper: The paper addresses the problem of modelling a PDE in the means of neural networks. The main motivation stems from the fact that Clifford algebras is a very popular tool in modelling physical relationships. As a consequence, the paper proposes to use the product of the algebra (instead of the products of a scalar field) to define both, convolutions and FT (Fourier transforms).

With these basic operations at hand, solutions to both, Navier-Stokes and Maxwell equations are explored. To this end, standard neural networks like ResNet and FNOs (Fourier Neural Operator Networks) are used and convolutions resp. FT are replaced with the Clifford counterpart.
strength_and_weaknesses: Strength:
+ Every details of the Clifford algebra as well as the two new operations (C-convolutions and C-FT) is explained extensively
+ The conducted experiments are based on well-known architecture where only the basic operations are replaced
+ The experiments focus on physical problems, which is the motivation for these new operations

Weakness:
- For the experiments it is not clear how the data is generated. Thus, results are difficult to reproduce.
- Section 2 takes 2 pages to explain well-known facts about Clifford algebras. This could be explained in a more compact manner.
- The paper including appendices is too excessive with more than 55 pages. It appears a bit too long for a conference paper
clarity,_quality,_novelty_and_reproducibility: The paper is clearly written. As some point it goes a bit too much into details that might a) not be too interesting to the ICLR audience, b) not very new for people who are aware about the concepts of Clifford algebras.

To my knowledge, using the multiplicative part of Clifford algebras is rather new to the community. Nonetheless, it is important to note that the complex numbers can be seen as a special case of a Clifford algebra ($\mathbb{C}=Cl_{1,0}$). And complex neural networks have been explored, especially for the physical motivated application of radar perception. This fact is missing in the manuscript.

I have some concerns w.r.t. the reproducibility about the experiments, since the used datasets are not mentioned.
summary_of_the_review: Overall, I consider the idea behind the paper very nice and I think the concept of Clifford neural networks should be presented to the machine learning community. ~Due to the missing datasets, I consider the paper below the acceptance threshold. If the authors can provide the datasets for the final version, I would raise my vote to an acceptance vote.~

Edit: Since the data set will be provided, I am happy to raise my vote to an acceptance vote.
review_title: null

Meta-review: metareview:_summary,_strengths_and_weaknesses: The paper addresses the problem of building ML surrogate models for solving PDEs. The authors introduce Clifford neural layers, that can model the interactions between different observation fields and among the components of these fields. Clifford layers can be used in place of e.g. convolutions and Fourier operators in existing NN architectures. This development relies on Clifford algebras that can be used to model physical relationships between vector fields. The authors evaluate this idea on a variety of 2D and 3D PDEs with two NN architectures: convolutions in ResNets and Fourier operations in Fourier Neural Operators are respectively replaced by their Clifford counterparts. They show that the new components improve the performance.

All reviewers consider this to be an original and solid contribution, and think that the presentation to the ML community of the concepts of Clifford algebra and their use for NN components is worthwhile. A challenge in this paper is to introduce these Clifford algebra concepts. The authors provide an introduction in the main text and a lengthy appendix. There were several exchanges with the reviewers in order to simplify the presentation: the final result is considered acceptable. Several reviewers mentioned insufficient details for the experiments and required access to data production codebase and datasets. The authors added a more detailed description of the results and provided access to the data, this was acknowledged as a satisfying addition. 
justification_for_why_not_higher_score: The paper will probably be interesting for a limited audience. The core of their contribution is based on the Clifford algebra formalism and, as mentioned in the review, it is difficult to present in a limited time.
justification_for_why_not_lower_score: The evaluators agree to an acceptance, with well-argued reasons.
Decision: Accept: poster