Before revision:  The proposed work is particularly effective when limited annotation effort is available, and achieved a practicable F1 score of 59.80\% with supervision from 52 explanationson the SQuAD dataset .
After revision:  The proposed work is particularly effective when limited annotation effort is available, and achieved a practicable F1 score of 59.80\% with supervision from 26 explanations, comparable to plain supervised learning using 1,100 labeled instances, yielding a 12x speed up .