user: text: Write a concise one-sentence TLDR summary of the scientific paper content below.

Title: Pruning at a Glance: A Structured Class-Blind Pruning Technique for Model Compression

Paper content:
High performance of deep learning models typically comes at cost of considerable model size and computation time.
These factors limit applicability for deployment on memory and battery constraint devices such as mobile phones or embedded systems.
In this work we propose a novel pruning technique that eliminates entire filters and neurons according to their relative L1-norm as compared to the rest of the network, yielding more compression and decreased redundancy in the parameters.
The resulting network is non-sparse, however, much more compact and requires no special infrastructure for its deployment.
We prove the viability of our method by achieving 97.4%, 47.8% and 53% compression of LeNet-5, ResNet-56 and ResNet-110 respectively, exceeding state-of-the-art compression results reported on ResNet without losing any performance compared to the baseline.
Our approach does not only exhibit good performance, but is also easy to implement on many architectures.
While deep learning models have become the method of choice for a multitude of applications, their training requires a large number of parameters and extensive computational costs (energy, memory footprint, inference time).
This limits their deployment on storage and battery constraint devices, such as mobile phones and embedded systems.
To compress deep learning models without loss in accuracy, previous work proposed pruning weights by optimizing network's complexity using second order derivative information BID1 BID4 .
While second order derivative introduces a high computational overhead, BID7 BID9 explored low rank approximations to reduce the size of the weight tensors.Another line of work BID3 BID14 , proposed to prune individual layer weights with the lowest absolute value (nonstructural sparsification of layer weights).
BID2 followed the same strategy while incorporating quantization and Huffman coding to further boost compression.
While the aforementioned methods considered every layer independently, BID12 proposed to prune the network weights in a class-blind manner, e.g. individual layer weights are pruned according to their magnitude as compared to all weights in the network.Noteworthy, all approaches that prune weights non-structurally, generally result in high sparsity models that require dedicated hardware and software.
Structured pruning alleviates this by removing whole filters or neurons, producing a non-sparse compressed model.
In this regard, BID11 proposed channel-wise pruning according to the L1-norm of the corresponding filter.
BID15 learned a compact model based on learning structured sparsity of different parameters.
A data-free algorithm was implemented to remove redundant neurons iteratively on fully connected layers in BID13 .
In BID6 , connections leading to weak activations were pruned.
Finally, BID16 pruned neurons by measuring their importance with respect to the penultimate layer.
Generally, in structured pruning, each layer is pruned separately, which requires calculation of layer importance before training.
This work features two key components:
a) Blindness: all layers are considered simultaneously; blind pruning was first introduced by BID12 to prune individual weights;
b) Structured Pruning: removal of entire filters instead of individual weights.
To the best of our knowledge, we are the first to use these two components together to prune filters based on their relative L1-norm compared to the sum of all filters' L1-norms across the network, instead of pruning filters according to their L1-norm within the layer BID11 , inducing a global importance score for each filter.
The contribution of this paper is two-fold:
i) Proposing a structured class-blind pruning technique to compress the network by removing whole filters and neurons, which results in a compact non-sparse network with the same baseline performance.
ii) Introducing a visualization of global filter importance to devise the pruning percentage of each layer.As a result, the proposed approach achieves higher compression gains with higher accuracy compared to the state-of-the-art results reported on ResNet-56 and ResNet-110 on the CIFAR10 dataset BID8 .
We presented a novel structured pruning method to compress neural networks without losing accuracy.
By pruning layers simultaneously instead of looking at each layer individually, our method combines all filters and output features of all layers and prunes them according to a global threshold.
We have surpassed state-of-the-art compression results reported on ResNet-56 and ResNet-110 on CIFAR-10 BID16 , compressing more than 47% and 53% respectively.
Also, we showed that only 11K parameters are sufficient to exceed the baseline performance on LeNet-5, compressing more than 97%.
To realize the advantages of our method, no customized hardware or libraries are needed.
It is worth to say that due to removing whole filters and neurons, the pruning percentage reflects the effective model compression percentage.
For the future work, we are dedicated to proving the applicability of our method on several different architectures and datasets.
Hence, we plan to experiment on VGG-16, ResNet on ImageNet and/or other comparable architectures.

assistant: text: We propose a novel structured class-blind pruning technique to produce highly compressed neural networks.