Before revision:  However, the "bad" subnetworks can be fine-tuned separately to achieve only slightly worse performance than the "good" ones , indicating that most weights in the pre-trained BERT  are potentially useful.
After revision:  However, the "bad" subnetworks can be fine-tuned separately to achieve only slightly worse performance than the "good" ones , indicating that most weights in the pre-trained BERT weights are potentially useful.