In this task, you are given the abstract of a research paper. Your task is to generate a summary of this abstract. Your summary should not be very short, but it's better if it's not more than 30 words.

Ex Input:
Recent DNN pruning algorithms have succeeded in reducing the number of parameters in fully connected layers often with little or no drop in classification accuracy. However most of the existing pruning schemes either have to be applied during training or require a costly retraining procedure after pruning to regain classification accuracy. In this paper we propose a cheap pruning algorithm based on difference of convex (DC) optimisation. We also provide theoretical analysis for the growth in the Generalisation Error (GE) of the new pruned network. Our method can be used with any convex regulariser and allows for a controlled degradation in classification accuracy while being orders of magnitude faster than competing approaches. Experiments on common feedforward neural networks show that for sparsity levels above 90% our method achieves 10% higher classification accuracy compared to Hard Thresholding.

Ex Output:
A fast pruning algorithm for fully connected DNN layers with theoretical analysis of degradation in Generalisation Error.


Ex Input:
Inspired by neurophysiological discoveries of navigation cells in the mammalian
 brain, we introduce the first deep neural network architecture for modeling Egocentric
 Spatial Memory (ESM). It learns to estimate the pose of the agent and
 progressively construct top-down 2D global maps from egocentric views in a spatially
 extended environment. During the exploration, our proposed ESM network
 model updates belief of the global map based on local observations using a recurrent
 neural network. It also augments the local mapping with a novel external
 memory to encode and store latent representations of the visited places based on
 their corresponding locations in the egocentric coordinate. This enables the agents
 to perform loop closure and mapping correction. This work contributes in the
 following aspects: first, our proposed ESM network provides an accurate mapping
 ability which is vitally important for embodied agents to navigate to goal locations.
 In the experiments, we demonstrate the functionalities of the ESM network in
 random walks in complicated 3D mazes by comparing with several competitive
 baselines and state-of-the-art Simultaneous Localization and Mapping (SLAM)
 algorithms. Secondly, we faithfully hypothesize the functionality and the working
 mechanism of navigation cells in the brain. Comprehensive analysis of our model
 suggests the essential role of individual modules in our proposed architecture and
 demonstrates efficiency of communications among these modules. We hope this
 work would advance research in the collaboration and communications over both
 fields of computer science and computational neuroscience.

Ex Output:
first deep neural network for modeling Egocentric Spatial Memory inspired by neurophysiological discoveries of navigation cells in mammalian brain


Ex Input:
Universal approximation property of neural networks is one of the motivations to use these models in various real-world problems. However, this property is not the only characteristic that makes neural networks unique as there is a wide range of other approaches with similar property. Another characteristic which makes these models interesting is that they can be trained with the backpropagation algorithm which allows an efficient gradient computation and gives these universal approximators the ability to efficiently learn complex manifolds from a large amount of data in different domains. Despite their abundant use in practice, neural networks are still not well understood and a broad range of ongoing research is to study the interpretability of neural networks. On the other hand, topological data analysis (TDA) relies on strong theoretical framework of (algebraic) topology along with other mathematical tools for analyzing possibly complex datasets. In this work, we leverage a universal approximation theorem originating from algebraic topology to build a connection between TDA and common neural network training framework. We introduce the notion of automatic subdivisioning and devise a particular type of neural networks for regression tasks: Simplicial Complex Networks (SCNs). SCN's architecture is defined with a set of bias functions along with a particular policy during the forward pass which alternates the common architecture search framework in neural networks. We believe the view of SCNs can be used as a step towards building interpretable deep learning models. Finally, we verify its performance on a set of regression problems.

Ex Output:

A novel method for supervised learning through subdivisioning the input space along with function approximation.