Before revision:  Furthermore, our experiments show that the input segmentation crucially impacts BERT's derivational knowledge, both during training and inference .
After revision:  Furthermore, our experiments show that the input segmentation crucially impacts BERT's derivational knowledge, suggesting that the performance of PLMs could be further improved if a morphologically informed vocabulary of units were used .