From: NeurIPS.cc/2021/Workshop/DistShift/Program_Chairs
title: Paper Decision
decision: Accept (Poster)
comment: Introduces two score functions (disentangling concept and covariate shifts) in combination with a slightly modified model to capture covariate vs. concept (i.e. P(y|x)) shifts. Experiments suggest that these scores do somewhat behave according to the motivation behind their derivations (i.e. each score corresponding to a different shift type). It does also slightly improve the AUROC performance for some IID vs. OOD scenarios. In short, the disentanglement idea is interesting to investigate further, however it's not clear how much of an overall improvement this presents for OOD detection in practice since the experiments are inconclusive.
Furthermore, reviewers also point out that a thorough discussion of related work is missing. There is no comparison with vanilla scores in the main plots. The figure captions should be strongly revised to be readable (same size as text). Please also address the additional questions of Reviewer dpvY in the revised manuscript.