Before revision:  For example, our sparsified DeiT-Small at  5\%, 50\%  sparsity for (data, architecture), improves 0.28\% top-1 accuracy  and meanwhile enjoys 49.32\% FLOPs and 4.40\% running time savings. 
After revision:  For example, our sparsified DeiT-Small at 5\%, 50\% sparsity for (data, architecture), improves 0.28\% top-1 accuracy and meanwhile enjoys 49.32\% FLOPs and 4.40\% running time savings. Our codes are available at URL