Venue: NeurIPS 2021 Conference

Reviews:

final_score: rating: 7: Good paper, accept
review_content: summary: This work contributes a framework for characterizing the invariance of image classifiers to diffeomorphisms. It is based on the empirical index $R_f$, which measures the stability to random diffeomorphisms relative to stability to additive noise. The authors find that $R_f$ is strongly correlated with classifier performance for a wide array of image classifiers. The results suggest that an image classifier's generalization performance is strongly related to its invariance to certain diffeomorphisms, as opposed to additive noise.
main_review: The maximum entropy distribution of diffeomorphisms as well as the relative stability index $R_f$ were clearly explained, and the various figures made the ideas very easy to understand intuitively. The paper then thoroughly investigates the correlation between error and $R_f$ from various angles. In particular, the fact that $R_f$ is computed relative to noise makes the importance of diffeomorphisms more convincing. This paper has the potential to inspire further study of invariance to diffeomorphisms in deep nets, and the maximum entropy diffeomorphism distribution/$R_f$ measure are likely to be of independent interest for future work on data augmentation and adversarial robustness.
limitations_and_societal_impact: Yes
review_title: null

final_score: rating: 6: Marginally above the acceptance threshold
review_content: summary: This paper introduces a new quantity called "relative stability" that strongly correlates with the classification performance of state of the art architectures on standard datasets. This quantity is a ratio between the variation of the features with respect to diffeomorphic transformation of the images and simple additive transformations. 
To do so, the authors propose to use a parametrized set of diffemorphisms with bounded L2 norm of the derivative. 
The dependence on the training set is highlighted, in particular a given amount of data is necessary to see the "relative stability" decrease with the size training set.
Last, a simple synthetic experiment is proposed that illustrates the expected behaviour.




main_review: The main contribution of this work is twofold: (1) highlight the fact that stability to diffeomorphisms perturbations (or more precisely small deformation setting here) is not observed when increasing the dataset size. (2) introduce a quantity that is shown experimentally to decrease with the training size, at least for more advanced architectures.

The writing of the paper is clear and the main message (the relative stability indicator and its link with classification error) is new to my knowledge.

My opinion is that this contribution is definitively interesting however, it lacks a clear application, for instance in data augmentation, or a better theoretical understanding for a venue such as NeurIPS. 


Other: 
- There are many ways to generate diffeomorphisms (see references below and references therein). These have been used for data augmentation as is proposed in the conclusion of this paper.
- some references are missing:
   -- "Dreaming More Data: Class-dependent Distributions
over Diffeomorphisms for Learned Data Augmentation", by Hauberg et al.
   -- Anatomical Data Augmentation via Fluid-Based Image Registration, Shen et al.


Typos:
- page 5: "the an inverse"
limitations_and_societal_impact: Since the work is essentially descriptive in nature there is not likely direct negative societal impact.
review_title: null

final_score: rating: 6: Marginally above the acceptance threshold
review_content: summary: The authors consider the relationship between the performance of modern deep
neural network architectures trained on standard benchmark natural image
datasets and their relationship to stability with respect to smooth
deformations of the input image. These issues have been studied previously in
the context of (natural) adversarial examples and in theoretically-constructed
(i.e. non-trainable) networks -- the motivation and contribution here is to
examine them through the lens of trained networks as well. To study this issue
empirically, the authors introduce a maximum-entropy distribution on
diffeomorphisms, which (I believe) amounts to constructing the deformation
vector field as a (gaussian) random combination of periodic Fourier basis
functions with frequency-dependent weights; they undertake an empirical
investigation of the properties of this distribution in order to find parameter
regimes where it produces realistic small-magnitude diffeomorphisms of the
image plane (rather than distorting it beyond recognition, or doing nothing).
They then use this tool to construct a computational "relative diffeomorphism
stability" metric, which is the average stability of a predictor with respect to
such diffeomorphisms divided by the predictor's average stability with respect
to scale-appropriate gaussian noise perturbations, called $R_f$. With $R_f$,
several findings are reported: across numerous modern architectures (ResNet18;
EfficientNet) and datasets (CIFAR10; ImageNet), randomly-initialized networks
have $R_f$ near unity and it decreases after training; $R_f$ decreases with the
size of the training set (measured by subsampling); and test set performance
correlates well with $R_f$ after training in the context of the CIFAR10
dataset. The authors present a toy theoretical model to give a theoretical
corroboration of the $R_f$ parameter's behavior for a shallow network, and
provide some ablation studies in the context of presence or not of data
augmentation in the training process and the type of interpolation used to
apply the diffeomorphisms.


main_review: ## Summary wrt Decision

The paper studies an important problem in deep learning practice/theory that
seems to be somewhat underrepresented in the literature, namely the
relationship between a well-trained deep net's performance and its stability to
certain transformations of the input that specifically respect the structure of
natural image data. Progress on this issue may lead to new developments and
insights in (say) robust vision applications, in a way that other
theoretical/experimental investigations that do not specifically consider the
structure of the data in these applications may not. I have rated the paper as
I have due to certain confusions I have about the authors' interpretations of
their results and their significance; I would tend to increase the rating to
borderline accept or more if these are resolved (either by correcting me or
proposing clarifications) in the discussion phase.

I will provide more detailed comments below.

## Strengths
- The paper is very well-referenced, and code is provided for reproducibility.
  Most details are well-motivated theoretically, and the descriptive figures in
  the early sections give a good intuitive sense of the image plane
  diffeomorphisms that are being studied.
- The max-entropy distribution over diffeomorphisms is simple to compute and
  may well be useful more broadly as a tool for experimentation, as the authors
  point out.
- The theoretical component of the paper in section 6 is simple, but nontheless
  a good illustration of the central ideas of the paper. It could also be a
  good problem for future study (perhaps with deeper networks, more complicated
  data models, etc.)

## Issues

- I am unclear about the broad significance of the authors' findings, beyond
  the introduction of the maximum entropy distribution on diffeomorphisms as an
  experimental tool. I will frame this issue in terms of my understanding of
  the paper's motivation in the introduction -- understanding the relationship
  between *average case* deformation stability of modern deep networks and
  their generalization performance on benchmark datasets -- and on its stated
  implications for future research in the conclusion (section 7). Although the
  results in Figure 5 on correlation between $R_f$ and test error for CIFAR10 
  are striking, and definitely more pronounced in terms of correlation
  coefficient than the corresponding plots for diffeomorphism stability and
  $\ell^2$ perturbation in Figs 15 and 16 in the appendices, the trends in
  Figures 15 and 16 are roughly the same -- the most performant modern
  architectures find themselves in the bottom-left of the plots, with a rough
  'upward' trend towards the top-right as one decreases the capacity of the
  network (modulo some outliers and inconsistencies). As a result I find the
  interpretation of these results in Sections 4 and 5 lacking -- section
  4 does not provide any interpretation of the results in Figure 5 beyond
  discussing some architectural/training factors, and the discussion in section
  5 is mostly restricted to considerations with respect to $P$ (which does not
  seem to be directly relevant to the results in Figure 5), and the important
  discussion in lines 228-238 seems hard to parse (I would appreciate some
  clarification here). It would be helpful if the authors interpreted these
  results in the context of discussions of (say) clean vs.\ robust accuracy in
  the literature, or more broadly other implications for practice. Without such
  interpretations, it is hard to see how the results in Figure 5 shed new light
  on these issues and may lead to further research progress on these important
  questions -- I note that the discussion of future directions in the
  conclusion is almost all concerning possible uses for the diffeomorphism
  ensemble, rather than implications of Figure 5.
- I am not sure about the broad significance of the discussion and experiments
  surrounding the training set size $P$. Although the stated conclusion that
  large training sets are necessary to get a small $R_f$ seems reasonable and
  useful, this is somewhat confounded by the fact that *diffeomorphism
  stability* is not as well correlated with large $P$ (section 5). It is
  therefore important to have a sense of the broad significance of a small
  $R_f$, as in the previous bullet. Also, the comparisons to the theoretical
  model of section 6 and the predicted $P^{-1}$ slope (Figure 3) might be
  spurious, as the fit is only 'good' in a compact region of the plot, whereas
  what really matters for such a claim to be accurate is the tail rate (and the
  datasets being experimented with obviously do not allow one to simulate out
  this far without relying on augmentations, which would not really serve the
  purpose).
- It would be nice to know if the authors' findings persist at larger dataset
  scales: although experiments on ImageNet are shown in Figure 3, the
  centerpiece Figure 5 (and corresponding plots in the appendices) are only for
  CIFAR10 and not ImageNet.
- It would be helpful throughout the paper if certain technical claims and
  implementation details were specified precisely, either in the body or in the
  appendices. On the technical side,  I found it difficult in
  certain cases to interpret which claims in section 2 are rigorous
  mathematical claims, which are heuristic (asymptotic; etc.) claims, and which
  are empirical claims: for example it would be nice if the appendix had a
  section summarizing all the calculations that are omitted in section 2, like
  "For large $n$, the norm then reads..." at line 108; the definition of
  $\delta$ and "It is straightforward to obtain..." at line 126; "that add
  pre-asymptotic terms to Eq.3" at line 128 (the fit seems not particularly
  good in fig 8a?). These details seem quite important to specify, because 
  the introduction of the maximum entropy distribution on diffeomorphisms is
  claimed as a contribution here, and the implementation of this distribution
  seems from the discussion in section 2 and the appendix to have many finicky
  aspects that may be challenging to navigate if applying these methods to a
  new dataset (e.g. different image size or resolution or the like).
  On the implementation side, although it seems to be made more or less clear clear
  implicitly via Fig 2, the later discussions, and section D, it would be
  helpful in section 3 if it was stated exactly what $\eta$ is (I think it is
  additive independent gaussian noise on the image pixels, but there are
  certain vague/confusing statements around this term (line 138 "all random
  directions $\eta$"; figure 2 caption "For large $n$, it is equivalent to
  adding an i.i.d.\ Gaussian noise to all the pixel values of $x$" (one would
  like to know **what is being implemented** in the experiments, rather than
  how this fits into a theoretical formalism here)) that confound this
  interpretation.

## Questions, etc.

- In many specific vision applications, the types of diffeomorphism one is
  interested in obtaining invariance to with a deep net are far more structured
  than the generic near-identity transformations considered here: for example,
  in a registration application with a piecewise planar object undergoing a
  rigid body motion the transformations are homographies (e.g. [1]) and
  actually carry a low-dimensional structure. I understand the focus here is on
  generic transformation semi-invariance and how this relates to deep learning
  performance on standard benchmark datasets, but I am interested in whether
  the authors have considered measuring invariances to these types of
  structured transformations as well, and/or whether the maximum entropy
  formalism can be extended to this kind of setting. Such an extension could be
  of significant interest in practice, beyond generic 'small' diffeomorphism
  invariance.

## Minor issues (polishing, organization, etc.)

- Throughout section 3, following the definition of $R_f$, the authors
  repeatedly conflate having a small $R_f$ value with "stability to
  diffeomorphisms". It would seem to be more appropriate to add the qualifier
  "relative" in these cases, especially given the later claim (section 5) that
  stability to diffeomorphisms is "...not the good observable to characterize
  how deep nets learn invariance toward diffeomorphisms..."! In a similar vein,
  I found it somewhat jarring that $R_f$ was introduced at the start of section
  3 without a discussion of the natural complaint that this relative measure
  can be lowered significantly just by increasing the denominator -- given the
  prominence of $R_f$ in the results that will be interpreted in section 3
  immediately after this definition, I would think it appropriate to quickly
  mention at the end of the "Relative stability to diffeomorphisms" paragraph
  in section 3 that this issue will be discussed in detail later, in section 5
  (and perhaps foreshadow the conclusion, so the reader can trust that this is
  an interesting measure and process the figures in section 3).
- In lines 142-150, the choice $\delta = 1$ seems to me to be incompletely
  justified -- isn't the interpolation independence only significant for
  Resnet, and not EfficientNet? I might have read the figure wrong.
- The paragraph in lines 228-238 is somewhat difficult to parse; superficially
  it might be good to use a word other than "gradient" in this context since it
  is easily confused with the gradients one is using in training? (What seems
  to be meant here is large changes in the output of the predictor as a
  function of input; of course these can happen without a gradient existing.)

[1] http://arxiv.org/abs/1012.3216

limitations_and_societal_impact: Yes.
review_title: null

final_score: rating: 7: Good paper, accept
review_content: summary: This paper investigates the role of stability to the action of diffeomorphisms in the classification performances of deep neural networks. Surprisingly, it shows that stability measurements are good indicators to compare the performance of deep neural network classifiers even for complex image data bases. The paper introduces stability measurements of diffeomorphism actions over images and shows that these measurement correlate strongly with the classification errors obtained by different CNN architectures over MNIST and CIFAR. The paper also shows that the stability to diffeomorphisms decreases when the training sizes decreases and gives a simple model to explain this phenomenon. 
main_review: Stability to diffeomorphisms had been shown to have an important role  in order to establish appropriate similarity measures between images for classification, which are stable to deformations. However, has mostly been studied over non-convolutional neural networks based on wavelets or kernel representations. The remarkable element of this paper is to demonstrate that it is an important element present in all CNN for image classification. These results appear clearly in Figure 3 which demonstrates the increased stability to diffeomorphism actions of ResNEt et EfficientNet as the learning proceeds and in Figure 5 for CIFAR 10.  However, let us mention that the impressive result on Figure 5 is obtained for only one type of deformation for c=3 which is relatively lower frequency, one one data set (CIFAR 10).  However, larger displacement are a priori also valid and it would be interesting to verify wether the result holds when displacements are larger and with a larger c to see in what sense this property is robust.

The fact that learning stability to diffeomorphisms requires large data sets is also really interesting, specially when compared with stability with additive noise perturbations. The authors analysis indicating that precise network classifiers learns a sophisticated metrics which have large gradients and leading larger errors to additive white noise but small errors to action of diffeomorphisms is also very interesting. It is a first attempt to characterise the non-linear metrics constructed by such networks. In summary this is a very investing paper, demonstrating a new idea, that may lead to more fruitful research in this area.
limitations_and_societal_impact: Yes
review_title: null

Meta-review: All four knowledgeable reviewers recommend accepting this submission. I agree. This submission makes a valuable contribution by demonstrating the invariance of image classifiers to diffeomorphism.
Decision: Accept (Poster)