distill including the label loss and it's much easier to not include the label or so they don't do it I guess alright so I think that was it they they compared as I said they compare like self distillation where you distill into an equally sized model and down distillation where you distill into a smaller model maybe that's vice-versa and they do a lot of comparison to other methods so this is a very thorough work I feel and yeah if you want more about the exact experiments I invite you to look at the paper and let's just have a final look