do the distillation loss on labeled and unlabeled sets you can see here if you only do it if you only train with the labels after fine-tuning you get poor performance if you do the label and distillation loss but only do it on the data set where you have labels then you get more performance if you do label and distillation loss but also include your unlabeled data you get even more performance and then if you do that but you don't do the label loss so before we've seen you can mix the distillation loss with the label loss if you have