GitHub repository: sutd-visual-computing-group/LS-KD-compatibility
Primary language: Python
Description: [ICML 2022] This work investigates the compatibility between label smoothing (LS) and knowledge distillation (KD). We suggest to use an LS-trained teacher with a low-temperature transfer to render high performance students.