Venue: ICLR 2020 Conference

Reviews:

final_score: rating: 3: Weak Reject
review_content: 
Summary
---

(motivation)
CNN image classifiers tend to overfit to distractor patterns.
Perhaps these patterns are spatially local, such that in most images signal is at one
location while the noise models tend to overfit to is somewhere else.
If so, then generalization should improve if models are given additional
supervision (i.e., a mask identifying salient regions) that specifies where the signal is and is not.
This paper designs the Actdiff loss to realize this intuition.

(approach)
Actdiff:
1) The Actdiff loss requires a mask that highlights areas of the input
image which have signal and not distractor regions. It extracts features from
the original input image and its masked version then encourages the two features
to be similar at every layer of the CNN using an L2 loss.

Actdiff is compared to 5 other methods including a reconstruction loss and Gradmask (previous work).

(evaluation - synthetic dataset)
A synthetic dataset is constructed for a simple binary classification task based on the presence of simple shapes.
Two patterns can predict the correct class at train time, but one of the patterns is removed at test time so additional information (masks in this case)
is required to specify which pattern the classifier should use.
All the losses except Actdiff achieve at best 50% accuracy on the val set, but Actdiff gets 80% or more accuracy on 3 of 4 tested model variations.
This shows that Actdiff can effectively introduce the relevant masking information.

(evaluation - Medical Segmentation Decathalon)
This dataset provides 3 segmentation tasks (Liver, Cardiac, Pancreas), including ground truth masks for those images.
All 6 methods outperform all the others at least some of the time.
The conclusion is that adding mask information using Actdiff doesn't improve segmentation performance.

(evaluation - Multi-Site dataset)
A final task tries to construct another synthetic dataset out of real X-ray images
collected at two different places.
The train set is largely from one place and the test set is mostly from the other place, and masks are constructed so Actdiff can try to eliminate this bias.
Actdiff causes a negligible increase in performance.

The paper concludes that signals CNNs tend to fit to in this type of data are not very spatially distinct.


Strengths
---

There is some novelty in the approach. The actdiff loss makes sense and masking + activation mapping have not been tried together before to my knowledge.

Experiments follow a logical progression, starting by verifying the idea on a synthetic dataset, then moving to real data, and then evaluating on a half-synthetic dataset designed to debug the approach.

Experiments average over many random initializations.

The paper embraces its negative result.


Weaknesses
---

The approach is not very compelling to me:
* Implicit in this paper is that any information outside the mask is a distractor and any information inside is not a distractor. Why should the particular masks chosen for the experiments have this property? How can an expert know which features a model will find useful?

The paper's novelty is somewhat limited. The idea of regularizing using saliency maps has been explored and even applied to medical data like the MSD used here in Gradmask (one of the strong baselines this paper compares to). Activation matching is also common (e.g. [1]), though it has not been combined with masking before.

While the weights applied to the various losses are provided, it's not clear how they were tuned. In this case there may be lots of competing losses, so it's important to tune the weights somehow to ensure the tradeoff between losses is optimal.

The results (and the conclusions) suggest Actdiff is not very effective at increasing generalization. Table 2 reports test results on all datasets. In that table, each loss outperforms all the other losses in at least two cases (a case is a model-dataset pair).

[1]: Gatys, Leon A. et al. “A Neural Algorithm of Artistic Style.” ArXiv abs/1508.06576 (2015): n. pag.


Missing experiments:

* In the Multi-Site experiment, compare to what happens when the circular mask is applied to all images and not just those from one site. This is a necessary control to be sure that any benefits from masking are due to domain transfer and not other regularization effects. Either conclusion could be useful, but it would be nice to know.

Presentation weaknesses:

* In the synthetic dataset the model cannot tell the difference between correct and incorrect signals at train time. Therefore, I think there's no way for some of the baselines (plain classifier, autoencoder) to generalize correctly. Is that right? If so, it should be clear that comparisons to these baselines are not fair when discussing the synthetic evaluation in section 4.

Missing details / points of clarification:

* What is the Conv AE? I assume it is a CNN based autoencoder of some sort. A detailed description of the non-standard architectures would be useful for reproducibility, though probably only in the appendix.

* What are the lambda hyperparameters? I assume these are weights on the corresponding loss terms, but this is never made explicit.

* How does f(.) relate to the function o_l(.)? Is o_l(.) an intermediate step in f(.)?

* The MSD dataset is not clearly described. Is this a classification dataset where classes are different diseases? What do the ground truth masks capture?

* I think only Conv AE and UNet contain reconstruction losses. This presentation is a bit confusing since reconstruction loss was presented as another loss and it shows up in the tables implicitly based on the architecture being compared.


Suggestions
---

* This paper would be a bit more convincing if it started with a concrete example of the problem illustrated on some dataset (e.g., maybe an example from Gradmask). That may also help drive intuitions later on in the paper.


Preliminary Evaluation
---

Clarity: The paper is fairly clear.
Quality: Quality is mixed. Lots of relevant experiments are reported but they don't support clear conclusions and I'm not sure how well the models were tuned.
Originality: There is some novelty, but it is limited as discussed above.
Significance: I see limited significance.

For me this paper requires special scruitiny because it presents a negative result. Here are some factors that come to mind when thinking about whether to publish a negative result:
* Is the approach compelling? - This approach is not very compelling (e.g., comments about limited novelty and lack of concrete examples to boost intuition).
* Are the experiments thorough? - The experiments could be significantly more thorough (e.g., comments about tuning lambda).
* Will readers learn something useful? - This paper may help researchers trying to leverage similar intuitions, but it won't be very useful outside this audience.
* Does the paper present experiments that promote deeper understanding of why the approach failed? - This paper makes significant reasonable steps in that direction with sections 4 and 6, but I was still a bit dissapointed with the conclusions of these sections.
* Does the paper discuss alternative approaches that were investigated? - Many alterantive approaches were considered and their performance reported.

Overall I think this paper is close but fails to meet the bar because it does a bit worse than expected on most criteria above.

review_title: Official Blind Review #1

final_score: rating: 3: Weak Reject
review_content: This paper considers how we can train image classification models so that they can ignore task irrelevant features.
For this purpose, the authors considered a situation where task relevant parts of the images are annotated as masks by the human experts.
The authors then proposed using Actdiff loss, Reconstruction loss, and Gradmask loss that are designed to suppress the effect of irrelevant features. 

I think the problem considered in this paper is interesting and important.
As the authors pointed out, the medical images taken from different hospitals may contain hospital-specific features which is irrelevant to the targeting task.
Thus, we need a way to train image classifiers that can ignore such irrelevant features.

My major concern on this study is the experiments.
The authors mention that part of their methods sometimes did not work (see below).
This makes the effectiveness of the proposed losses a bit questionable.
If I understad correctly, in practice, the users need to tune the weights of several losses carefully until they can obtain a good model.
If this is the case, I am not very sure if the proposed losses are essential, or tuning a right weight can occasionally provide good models.

* (Sec4) "Gradmask proves to be too powerful a regularizer for this task, and never produces a model with good generalization performance."

* (Sec5) "For the Cardiac dataset, the best performing method was classification with gradmask for the Convolutional AutoEncoder and with actdiff for the UNet, and each achieve similar performance."

* (Sec5) "The gradmask and combination actdiff and gradmask models improved over baseline, but there is no clear reason why this would be true from the saliency maps."

* (Sec6) "Both actdiff and gradmask improve performance of the model, but only actdiff scores above chance, and performs similarly to a model trained with the areas outside of the mask completely removed."

### Updated after author response ###
The authors have tried to address my concern by re-running the experiments, which I greatly appreciate.
However, the effectiveness of the proposed approach is not convincing enough.
I expect the authors to design the more effective experiments in the future version.
It would be great if the authors can clarify and demonstrate which regularization is helpful under which circumstances and why, and when it is not.
review_title: Official Blind Review #3

final_score: rating: 3: Weak Reject
review_content: This paper attempts to tackle the overfitting problem due to the focusing on the distracting information. By utilizing the dataset with masks, the authors propose a simple method to ignore the distracting features. By designing actdiff loss and reconstruction loss, the authors demonstrate that classifiers are likely to predict using features unrelated to the task and their losses can mitigate this problem.

Pros:
This kind of study can make us understand deeply what is going on in deep learning and thus to make it better, which shows this work’s high significance.

Cons:
1.	The presentation of this paper is not clear. For example, in Table 1, the experiment name is so confusing. The authors mention that “Conv AE Actdiff” is the one using both actdiff loss and reconstruction loss. Then what does “Conv AE Reconstruct Masked” mean? Does Conv AE means they implicitly contain reconstruction loss? The authors should elaborate them clearly. The corresponding double quotation marks should be revised. Figure 3 is also confusing. At first, I thought different lines represent different input data (one without mask and one with mask) and different columns represent different methods. However, this is not the case. Furthermore, the fourth column is more confusing. I do not see any red circles in the fourth column. Why the reconstruction of distractor is far away from the original one. Does the right top picture show the advantages of UNet Reconstruction or its drawbacks?
2.	In fact, the training data with masking is not sufficient (may only available in some medical images). It is hard to utilize these data to generalize to various other tasks including large amounts of images without masking.
3.	From the experiments on real tasks, I barely see improvements by the proposed method, which makes the conclusion unconvincing.


review_title: Official Blind Review #2

Meta-review: This paper studies the effect of training image classifier with masked images to exclude distraction regions in the image and avoid formation of spurious correlation between them and predicted labels. The paper proposes actdiff regularizer and demonstrates that it prevents such overfitting phenomenon on synthetic data.  However, there was no success on real data. This is important as it shows that the improvement reported in some saliency-map based approaches in the literature may be due to other regularization effects such as cutout.

This was a unique submission in my batch, as it embraces its negative results. Among our internal discussions, all reviewers that and we all believe that negative results are important and should be encouraged. However, in order for the negative results to be sufficiently insightful for the entire community, they need to be examined under well-organized experiments. This is the aspect that the reviewers think the paper needs to improve on.  In particular, R2 believes the paper could consider a larger set of possible regularizations as well as a broader range of  applications. The insights in such setting may then lead to solid insights on why the current approaches are not very helpful, and in which direction the follow-up researches should focus on.
Decision: Reject