Before revision:  This hypothesis is confirmed by a series of semantic probing tasks on which derivational segmentation consistently outperforms BERT 's WordPiece segmentationby a large margin .
After revision:  This hypothesis is confirmed by a series of semantic probing tasks on which DelBERT (Derivation leveraging BERT), a model with derivational input segmentation, substantially outperforms BERT with WordPiece segmentation .