Before revision:  We show the efficacy of such models on ASR through comprehensive experiments and demonstrate that the performance of a dynamic sparsity model is on par with , and in some cases exceeds, the performance of individually trained single sparsity networks.
After revision:  We show the efficacy of such models on ASR through comprehensive experiments and demonstrate that the performance of a dynamic sparsity model is on par with that of individually trained single sparsity networks.