Before revision:  We observed that our approach produces better results than Knowledge Distillation methods without any loss in inference speed.
After revision:  We observed that our approach produces better results than other methods for training student models without any loss in inference speed.