Before revision:  We present the first study investigating this question . We find that BERTwith a derivational classification layer outperforms an LSTM-based model .
After revision:  We present the first study investigating this question , taking BERT as the example PLM. We examine BERT's derivational capabilities in different settings, ranging from using the unmodified pretrained model to full finetuning. Our best model, DagoBERT (Derivationally and generatively optimized BERT), clearly outperforms the previous state of the art in derivation generation (DG).