In this task, you are given the abstract of a research paper. Your task is to generate a summary of this abstract. Your summary should not be very short, but it's better if it's not more than 30 words.

Ex Input:
In this work, we focus on the problem of grounding language by training an agent
 to follow a set of natural language instructions and navigate to a target object
 in a 2D grid environment. The agent receives visual information through raw
 pixels and a natural language instruction telling what task needs to be achieved.
 Other than these two sources of information, our model does not have any prior
 information of both the visual and textual modalities and is end-to-end trainable.
 We develop an attention mechanism for multi-modal fusion of visual and textual
 modalities that allows the agent to learn to complete the navigation tasks and also
 achieve language grounding. Our experimental results show that our attention
 mechanism outperforms the existing multi-modal fusion mechanisms proposed in
 order to solve the above mentioned navigation task. We demonstrate through the
 visualization of attention weights that our model learns to correlate attributes of
 the object referred in the instruction with visual representations and also show
 that the learnt textual representations are semantically meaningful as they follow
 vector arithmetic and are also consistent enough to induce translation between instructions
 in different natural languages. We also show that our model generalizes
 effectively to unseen scenarios and exhibit zero-shot generalization capabilities.
 In order to simulate the above described challenges, we introduce a new 2D environment
 for an agent to jointly learn visual and textual modalities

Ex Output:
Attention based architecture for language grounding via reinforcement learning in a new customizable 2D grid environment  


Ex Input:
Performance of neural networks can be significantly improved by encoding known invariance for particular tasks. Many image classification tasks, such as those related to cellular imaging, exhibit invariance to rotation. In particular, to aid convolutional neural networks in learning rotation invariance, we consider a simple, efficient conic convolutional scheme that encodes rotational equivariance, along with a method for integrating the magnitude response of the 2D-discrete-Fourier transform (2D-DFT) to encode global rotational invariance. We call our new method the Conic Convolution and DFT Network (CFNet). We evaluated the efficacy of CFNet as compared to a standard CNN and group-equivariant CNN (G-CNN) for several different image classification tasks and demonstrated improved performance, including classification accuracy, computational efficiency, and its robustness to hyperparameter selection. Taken together, we believe CFNet represents a new scheme that has the potential to improve many imaging analysis applications.

Ex Output:
We propose conic convolution and the 2D-DFT to encode rotation equivariance into an neural network.


Ex Input:
We study two types of preconditioners and preconditioned stochastic gradient descent (SGD) methods in a unified framework. We call the first one the Newton type due to its close relationship to the Newton method, and the second one the Fisher type as its preconditioner is closely related to the inverse of Fisher information matrix. Both preconditioners can be derived from one framework, and efficiently estimated on any matrix Lie groups designated by the user using natural or relative gradient descent minimizing certain preconditioner estimation criteria. Many existing preconditioners and methods, e.g., RMSProp, Adam, KFAC, equilibrated SGD, batch normalization, etc., are special cases of or closely related to either the Newton type or the Fisher type ones. Experimental results on relatively large scale machine learning  problems are reported for performance study.

Ex Output:

We propose a new framework for preconditioner learning, derive new forms of preconditioners and learning methods, and reveal the relationship to methods like RMSProp, Adam, Adagrad, ESGD, KFAC, batch normalization, etc.