Counterfactually-Augmented SNLI Training Data Does Not Yield Better Generalization Than Unaugmented Data (2020)

Abstract: A growing body of work shows that models exploit annotation artifacts to achieve state-of-the-art performance on standard crowdsourced benchmarks—datasets collected from crowdworkers to create an evaluation task—while still failing on out-of-domain examples for the same task. Recent work has explored the use of counterfactually-augmented data—data built by minimally editing a set of seed examples to yield counterfactual labels—to augment training data associated with these benchmarks and build more robust classifiers that generalize better. However, Khashabi et al. (2020) find that this type of augmentation yields little benefit on reading comprehension tasks when controlling for dataset size and cost of collection. We build upon this work by using English natural language inference data to test model generalization and robustness and find that models trained on a counterfactually-augmented SNLI dataset do not generalize better than unaugmented datasets of similar size and that counterfactual augmentation can hurt performance, yielding models that are less robust to challenge examples. Counterfactual augmentation of natural language understanding data through standard crowdsourcing techniques does not appear to be an effective way of collecting training data and further innovation is required to make this general line of work viable.

## introduction while standard crowdsourced benchmarks have helped create significant progress within natural language processing (nlp), a growing body of evidence shows the existence of exploitable annotation artifacts in these datasets @xcite @xcite and that models can use artifacts to achieve state-of-the-art performance on these benchmarks @xcite . the existence of these artifacts makes it difficult to predict out-of-domain generalization and creates uncertainty around the abilities these tasks are designed to test. recent work has explored using counterfactually-augmented datasets to address annotation artifacts with the intent to build more robust classifiers @xcite . these datasets are collected by first sampling a set of seed examples and then creating new examples by minimally editing the seed examples to yield counterfactual labels. this type of data collection has been found to mitigate the presence of artifacts in snli @xcite and is presented as a way to "elucidate the difference that makes a difference" @xcite . further, @xcite present this as an efficient method to collect training data yielding models that are "more robust to minor variations and generalize better" @xcite . however, they also find that unaugmented datasets yield better performance than datasets with 50-50 original-to-augmented data when controlling for training set size and annotation cost. in our work, we further study whether training with counterfactually-augmented data collected through standard crowdsourcing methods yields models with better generalization and robustness by focusing on the domain of natural language inference (nli): the task of inferring whether a hypothesis is true given a true premise. we train and compare roberta @xcite trained on three different datasets: (1) the counterfactuallyaugmented natural language inference (cnli) training set of 8.3k seed and augmented snli examples from @xcite , (2) a subsampled set of 8.3k unaugmented snli examples to control for size, and (3) the 1.7k cnli seed examples originally sampled from snli. we then compare model performances on mnli @xcite -a dataset for the same task with examples out-of-domain to snli-and two diagnostic sets @xcite . we find that roberta trained on cnli yields similar performance on out-of-domain mnli examples when compared to the unaugmented subsampled snli training set and that including counterfactually-augmented examples to the cnli seed set improves generalization. further, we find that the improvement over seed examples correspond to an increase in n-grams from the addition of augmented examples, roughly doubling the number of 4-grams, and may be a result of improved lexical diversity from a larger training set. while we see similar trends in most of our diagnostic evaluations, we also find evidence that including augmented examples can yield worse performance than only training with seed examples. while there is evidence of the benefits of using this type of data for model evaluation @xcite , we find that using counterfactuallyaugmented data for training yields less robust models. we argue that further innovation is required to effectively crowdsource counterfactuallyaugmented natural language understanding (nlu) data for training more robust models with better generalization. ## related work recent works show that several nli benchmark datasets contain exploitable annotation artifacts. several studies @xcite @xcite show that models trained on hypothesis-only examples manage to perform as much as 35 points higher than chance. @xcite also find negation words such as no or never are strongly associated with contradiction predictions. other works @xcite find that models can exploit premise-hypothesis word overlap to achieve state-of-the-art performance on benchmarks by using associations of high overlap with entailment predictions and low overlap with neutral predictions. @xcite use an adversarial human-andmodel-in-the-loop procedure to address these concerns in adversarial nli (anli). using a model in the loop makes anli inherently adversarial towards the model used, and we instead focus on naturally collected human-in-the-loop augmented data. @xcite crowdsource counterfactually-augmented nli examples that reduce the presence of hypothesis-only bias in snli by providing a set of seed examples to crowdworkers and prompting them to minimally edit either the hypothesis or premise to yield a counterfactual label. @xcite present this type of data collection as an efficient method to build training sets yielding robust models that generalize better by crowdsourcing counterfactually-augmented boolq examples. however, they also find that augmented datasets yield similar to worse performance when the cost of augmenting an example is no cheaper than collecting a new one and the datasets are controlled for size. we differ from @xcite by focusing on performance on out-of-domain examples and from @xcite by focusing on the task of nli instead of reading comprehension. gardner et al. (2020) use contrast sets written manually by nlp researchers to evaluate models on various annotated tasks. they show that most datasets require 1-3 minutes per augmented example, taking 17-50 hours to create 1,000 examples. we differ by using crowdsourced counterfactuallyaugmented data and focusing on their use for training instead of evaluation. ## experimental setup we perform two experiments to study the effects of counterfactually-augmented nli training data. all experiments use roberta trained on snli, cnli, or cnli seed examples originally sampled from snli and compare performances on various tasks. we first compare mnli performances to evaluate the impact on model generalization to out-ofdomain data. we then use the diagnostic examples from @xcite and the glue diagnostic set @xcite to study model robustness to challenge examples. training data in snli, @xcite prompt crowdworkers with a scene description premise to collect three hypothesis sentences corresponding to entailment, neutral, and contradiction labels, yielding 570k english premise-hypothesis pairs. @xcite collect cnli examples by prompting crowdworkers to minimally edit seed examples sampled from snli to yield counterfactual labels. for our training data, we use a subsampled set of 8.3k examples of snli, the cnli training set of 8.3k examples, and the 1.7k cnli seed examples sampled from snli that is also included in the cnli training set. we subsample snli to control for the fact that cnli only consists of 8.3k examples. we subsample five sets of 8.3k snli examples and report results across these five. ## results generalization to mnli from the median scores in figure 1 , we see that models trained on cnli perform no better than models trained on a comparably large sample of unaugmented snli examples. this is in line with findings from @xcite , where training with their minimally perturbed boolq dataset of seed and augmented examples yields similar or worse performance on out-of-domain tasks compared to the original boolq training set. additionally, the improvement of cnli over the 1.7k seed examples shows that counterfactual examples are somewhat helpful when they are strictly additive, as in @xcite . robustness to diagnostic sets figure 2 presents performances on the diagnostic sets from @xcite and @xcite . for the glue diagnostic sets, we follow the authors and use r 3 @xcite as our evaluation metric. the distributions of classification accuracy again show that cnli yields similar performance compared to unaugmented datasets of similar size on most of the categories. however, we find that training on cnli yields worse performance than using either unaugmented snli or cnli seed examples for negation examples. these challenge examples append the phrase "and false is not true" to every hypothesis in the mnli validation set. this construction introduces the strong negation word "no" to target the association between negation words and the contradiction label without changing the truth condition of the n snli 8.3k cnli 8.3k cnli seed 1.7k 1 6.2k 4.8k 3.5k 2 30.4k 21.6k 13.0k 3 52.3k 36.3k 19.9k 4 60.2k 42.5k 21.5k lexical diversity given the minimal edits constraint in cnli, we study the lexical diversity of the training sets to see the effectiveness of this constraint and whether the general improvement of cnli over seed examples is a result of greater diversity from a larger training set. ## conclusion we follow a similar setup to @xcite and use english nli data to test whether counterfactually-augmented training data yields models that generalize better to out-of-domain data and are more robust to challenge examples. we first find that adding counterfactually-augmented data improves generalization, but provides no advantage over adding similar amounts of unaugmented data. further, we find that the improvement over seed examples corresponds to an increase in n-gram diversity. we also find that including counterfactuallyaugmented data can make models less robust to challenge examples. assuming that crowdworkers take a similar amount of time to make targeted edits to examples and to write new examples @xcite , there is then no obvious value in crowdsourcing augmentations under current protocols for use as training data. despite these findings, we argue that there is still value in naturally collected counterfactuallyaugmented nlu data. @xcite show that collecting this type of data can be used as a method to address systematic gaps in testing data. as performances on benchmarks become saturated, we still view this style of augmenting test sets as a viable method to provide longer-lasting benchmarks in addition to standard test set creation. the success of @xcite in using expert-designed counterfactual augmentation to target specific phenomena for evaluation suggests that it may be possible to target heuristics in training data with expert guidance during the crowdsourcing process. further, understanding how to identify heuristics to target and the types of useful augmentations to collect, assuming such a thing is possible, are important directions we leave to future work.