From: NeurIPS.cc/2021/Workshop/DistShift/Program_Chairs
title: Paper Decision
decision: Accept (Poster)
comment: Thanks for the strong submission. Reviewers agreed that this paper provides a clean, systematic, and interesting experimental investigation of the effect of increasing model size on worst-group generalization in models trained with ERM. 

Regarding Reviewer xN9u's point about average test error on Waterbirds, the discrepancy might come from   reporting the simple average over the test examples, instead of reweighting the test group errors to reflect the training distribution. In Waterbirds, the test distribution does not match the training distribution. See Appendix C in https://arxiv.org/pdf/1911.08731.pdf.