From: NeurIPS.cc/2021/Workshop/DistShift/Program_Chairs
title: Paper Decision
decision: Accept (Poster)
comment: The paper proposes a variant of Just Train Twice in which the second stage is replaced by training using class conditional mixup as data augmentation. The empirical results look promising and many participants to this workshop may find the idea interesting.

The authors should however address the reviewer’s comments, in particular regarding the clarity of the paper (e.g. typos, inconsistencies in notation etc), experimental details (how were the hyperparameters chosen, what are the details of the first stage, how were the values for alpha chosen etc), and a more elaborate discussion with concrete evidence explaining the intuition for mixup’s good performance. Moreover, it is unclear why in the experiments with oracle group labels (table 3) JTT has worse performance than without oracle group labels (the numbers in Table 1) since in that case JTT essentially becomes identical to GroupDRO. The authors should clarify this point or make sure the comparison is fair.