Separated management of pre-training and fine-tuning