Allow different df for pretraining