ensure decoder is initialized on finetune