Before revision:  We show the efficacy of such models on ASR through comprehensive experiments and demonstrate that the performance of a dynamic sparsity model is on par with , and in some cases exceeds, the performance of individually trained single sparsity networks.
After revision:  We demonstrate the effectiveness and flexibility of DSNN using experiments on internal production datasets with Google Voice Search data, and show that the performance of a dynamic sparsity model is on par with , and in some cases exceeds, the performance of individually trained single sparsity networks.