Venue: NeurIPS 2022 Conference

Reviews:

final_score: rating: 6: Weak Accept: Technically solid, moderate-to-high impact paper, with no major concerns with respect to evaluation, resources, reproducibility, ethical considerations.
review_content: summary: This paper proposes a GAN-based approach to quantify both out-of-distribution and in-distribution uncertainty in image classification. Specifically, the authors use GANs to generate examples from the out-of-class regime several times, and each time then use the examples to train a one-vs-all classifier in the final DNN layer. Finally, the resulting classifiers are sued to model class conditional likehoods. The authors conduct experiments on MNIST, CIFAR10， CIFAR100 and show state-of-the-art performance in terms of OoD detection and FP detection.
strengths_and_weaknesses: Strengths： 
1. The presentation of this paper is clear and easy to follow. 
2. Existing GAN-based approaches mostly only predict a single score for OoD examples, while this paper proposes to quantify both in-distribution uncertainty and out-of-distribution uncertainty. This paper achieves this by repurposing the training scheme of the classifier and the generation of OoD examples. The idea is interesting and can inspire others in this community. 
3. The authors show strong results in several datasets, including MNIST, CIFAR10， CIFAR100.

Weaknesses:
1. There are no ablation studies to study and verify the effectiveness of each design of the proposal. For example, the number of classes used for training the classifier each time, the different image quality of GAN-generated examples, etc. 
2. It would be better to clarify the necessity and importance (or practical significance) of quantifying both in-distribution and out-of-distribution uncertainty in a single model.

questions: 1. Typically, GANs are trained to model the distribution of real data, and sometimes even humans cannot distinguish real data from examples generated by state-of-the-art GANs [1].  My question is how to determine whether a GAN-generated example is out-of-distribution or in-distribution? How to choose the GAN models? How does the quality of GAN-generated examples affect uncertainty quantification?

[1] Karras T, Laine S, Aittala M, et al. Analyzing and improving the image quality of stylegan[C]//Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 2020: 8110-8119.

2. Although the authors provide a survey [16] on uncertainty quantification methods in Line 28, we suggest a brief introduction to uncertainty quantification in the section of Related Work. Besides, we suggest breaking the section of Related Work into several subsections, which can make it clear.

limitations: 1. The organization of the section of Related Work is not clear. 
2. It would be better to show more GAN-generated examples for reference. Besides, it would be better to conduct experiments on a relatively large dataset, e.g., ImageNet.
review_title: null

final_score: rating: 5: Borderline accept: Technically solid paper where reasons to accept outweigh reasons to reject, e.g., limited evaluation. Please use sparingly.
review_content: summary: This paper proposes a method to estimate both aleatoric and epistemic uncertainties. It does so by training a conditional GAN in a latent space of a pretrained autoencoder to shield each class with out-of-class samples.
strengths_and_weaknesses: ## Strength
- Evaluation metrics are comprehensive.
- The provided toy dataset is illustrative.

## Weakness
- Some related works are missing, e.g., conformal prediction.
- It is hard to assess the effectiveness of the proposed method without experiments on ImageNet. I understand that the limited computational resources might be a concern, but any form of ImageNet like low resolution of 64x64 or TinyImageNet (which has 200 classes) would be very helpful.
- Section 3.1 and 3.2 are disconnected. How exactly are aleatoric and epistemic uncertainties computed? How are generated $\tilde{x}$ used? Why are they valid definitions?
- Why is one-vs-all classifier necessary here? Can similar results be achieved by normal multiclass classifiers?
- MC-Dropout is basically Bayesian ensemble and can be plugged in other methods as well. It is known that ensemble can drastically improve performance. So the comparisons in Table 3, 4 seem not very fair. Without MC-Dropout, the improvements of the proposed method is not always significant.
questions: Please see my questions in Weakness. Additional question:
- We know that GAN usually produces much higher sharper images than VAEs. However, given the images Fig. 3 are so blurry, and image quality is not the main focus of this paper, can the authors their design choice of using GAN here? Can other generative model be used here?
limitations: N/A
review_title: null

final_score: rating: 6: Weak Accept: Technically solid, moderate-to-high impact paper, with no major concerns with respect to evaluation, resources, reproducibility, ethical considerations.
review_content: summary: The paper presents UQGAN, a model for uncertainty quantification, including both OoD and FP detection.
The proposed model contains a classifier C that outputs for a pair sample-label $(x,y)$ the probability that the pair is in-distribution. 

For training C, the in-distribution pairs consists of real pairs $(x,y)$ directly drawn from the dataset, while out-of-distribution pairs are of two types: either $(x,y')$ where $y'$ is not the correct label associated to $x$, accounting for class uncertainty, or $(\hat{x}, y)$ where $\hat{x}$ is a sample generated by a cGAN conditionned on $y$.
The cGAN's generator is trained in the latent space of a pretrained conditional auto-encoder jointly with a discriminator, but also with the classifier C so that the generated data pair $(\hat{x}, y)$ is considered to be out-of-distribution by C.
Additionally, a regularizer pushes the generated samples to cover a large range of directions in the latent space.

They also combine their method with MC dropout and observe further improvements.
strengths_and_weaknesses: Strength:
- The paper is well organized and didactic. As someone not particularly familiar with the uncertainty literature, I especially appreciate the effort put into the related work section.
- It proposes a novel unified approach for both OoD and FP detection.
- The experiments are comprehensive, with detailed breakdown and hyper-parameter analysis in the supplementary.

Weakness:
- The method seems fairly complex to use as it requires different parts (cAE, Generator/Discriminator, Classifier) and hyper-parameters to tune.
questions: Looking at the generator objective, it includes a GAN objective, so that the generated distribution p(G(e,y), y) is similar to the real latent distribution p(z,y). This would imply that it pushes $p(\hat{x}, y)$ close to $p(x,y)$, according to a metric induced by the latent space and the discriminator.
The other objective of the generator is given by C, and makes it so that the generated data $(\hat{x}, y)$ is out-of-distribution, essentially pushing away $p(\hat{x}, y)$ and $p(x,y)$.
In some sense, the overall objective of the generator is a compromise between being in-distribution (according to D) and out-of-distribution (according to C).
- Can the authors comment on how much those conflicting objectives are a problem when training the generator? I would guess it would be quite unstable when training for a long time, but that the use of a pre-trained decoder alleviates the issue.
- If we consider the overall objective of the discriminator as a compromise between the two losses, perhaps another way to balance them would be to have the generator target intermediate values for $C(o | \hat{x},y)$ and $D(\hat{x},y)$ such as .75 for instance instead of binary classification. Of course, that would require a different loss for the GAN (and not the wasserstein loss). Have the authors considered something in this direction?


limitations: The authors have adressed societal impact in the adequate section.
review_title: null

final_score: rating: 5: Borderline accept: Technically solid paper where reasons to accept outweigh reasons to reject, e.g., limited evaluation. Please use sparingly.
review_content: summary: This paper introduces cGANs to help deep classifier modelling uncertainty. The generator is encouraged to generate features that lie in real distribution (evaluated by the discriminator) and out-of-class regions (assessed by the classifier). A low-dimensional regulariser is introduced to generate diverse features. The authors verify their ideas on several benchmarks. The improved performance on out-of-distribution data splits shows the effectiveness of the proposed method. Ablation studies verify the importance of the proposed regulariser.
strengths_and_weaknesses: Strengths:

-The authors conduct experiments on several datasets, with results showing that the proposed methods are better than previous baselines.

-The authors provide comprehensive ablation studies in the supplementary material to support the soundness of the design of the method.

-The idea of generating out-of-class samples is interesting.


Weakness:

-The visualization experiments are conducted on simple datasets which only contain 2 classes. Authors are encouraged to show some visualization results on datasets having multiple-classes.

-All experiments are conducted on small-scale and small-resolution datasets. The authors are encouraged to verify their method on more challenging datasets, such as ImageNet-Dog, ImageNet-O [1] dataset.

[1] Hendrycks, et al. "Natural adversarial examples." CVPR 2021.

questions: -What will happen if the cAE is also trained (not pretrained) during training.

-It seems that the discriminator can easily tell the real features from the fake ones since the distribution of the real features are far away from the fake distribution. In such senario, the generator will occur mode collapse easily as far as my experience. Howevery, mode collapse is not occured in the proposed method. Maybe it's because the low-dimensional regularizer alleviates this issue. Can the authors provide the generated images of the variant in which the low-dimensional regularizer is removed?
limitations: NA
review_title: null

Meta-review: metareview: The authors propose a new approach for training image classifiers with complete uncertainty quantification based on generative adversarial networks. The main idea is to use GANs to "shield" each class separately from the out-of-class (OoC) regime. This is done in combination with a one-vs-all classifier in the final DNN layer trained jointly with a class-conditional generator for out-of-class data in an adversarial framework. Finally, these classifiers are then used to model class conditional likelihoods. The empirical validation shows improved OoD detection and FP detection performance when compared to SOTA in this setting.

The reviewers appreciated the clarity of exposition and the positioning with respect to the related works. The unified approach applicable both to FP detection and OoD detection was deemed novel. On the negative side, the method seems to be extremely involved in terms of the required architectural pieces, distinction between low-dim and high-dim settings, primarily low-resolution data used for evaluation, and the number of hyperparameters. During the discussion the authors addressed the main questions raised by the reviewers. Nevertheless, given that all of the reviewers are leaning positive, I'll recommend the acceptance of this work. Please do a full pass in terms of formatting of the whole manuscript, including removing inline tables and figures, removing things like double parenthesis, bolding specific letters (e.g. L247), clarify the flow of information in figure 1 so that one can grasp the high-level overview of the algorithm, and incorporate the remaining points raised during the discussion.
confidence: Less certain
Decision: Accept