Before revision:  The resulting model obtains surprisingly good results on multiple benchmarks , e.g., 72.7 F1  with only 128 examples on SQuAD , while maintaining competitive (and sometimes better) performance in the high-resource setting . Our findings indicate that careful design of pretraining schemes and model architecture can have a dramatic effect on performance in the few-shot settings .
After revision:  The resulting model obtains surprisingly good results on multiple benchmarks , e.g., 72.7 F1 with only 128 examples on SQuAD , while maintaining competitive (and sometimes better) performance in the high-resource setting .