Pretrain and finetune seperated.