Before revision:  To achieve this, knowledge distillation is applied as a guidance to retain the recognition ability from the previous model , which is then combined with the new ASR task for model optimization .
After revision:  To achieve this, both attention distillation and knowledge distillation are applied to preserve the ability of the old model during the progressive learning .