Before revision:  However, the "bad" subnetworks can be fine-tuned separately to achieve only slightly worse performance than the "good" ones , indicating that most weights in the pre-trained BERT  are potentially useful.
After revision:  However, the "bad" subnetworks can be fine-tuned separately to achieve only slightly worse performance than the "good" ones , indicating that most pre-trained BERT are potentially useful.