Before revision:  A third  approach is to 'shrink and fine-tune' (SFT), which avoids any explicit distillation by transferring parameters to a  student model and then fine-tuning.
After revision:  A third approach is to 'shrink and fine-tune' (SFT), which avoids any explicit distillation by copying parameters to a student model and then fine-tuning.