In this task, you are given the abstract of a research paper. Your task is to generate a summary of this abstract. Your summary should not be very short, but it's better if it's not more than 30 words.

Q: Generative adversarial networks (GANs) are a family of generative models that do not minimize a single training criterion. Unlike other generative models, the data distribution is learned via a game between a generator (the generative model) and a discriminator (a teacher providing training signal) that each minimize their own cost. GANs are designed to reach a Nash equilibrium at which each player cannot reduce their cost without changing the other players’ parameters. One useful approach for the theory of GANs is to show that a divergence between the training distribution and the model distribution obtains its minimum value at equilibrium. Several recent research directions have been motivated by the idea that this divergence is the primary guide for the learning process and that every step of learning should decrease the divergence. We show that this view is overly restrictive. During GAN training, the discriminator provides learning signal in situations where the gradients of the divergences between distributions would not be useful. We provide empirical counterexamples to the view of GAN training as divergence minimization. Specifically, we demonstrate that GANs are able to learn distributions in situations where the divergence minimization point of view predicts they would fail. We also show that gradient penalties motivated from the divergence minimization perspective are equally helpful when applied in other contexts in which the divergence minimization perspective does not predict they would be helpful. This contributes to a growing body of evidence that GAN training may be more usefully viewed as approaching Nash equilibria via trajectories that do not necessarily minimize a specific divergence at each step.

A: We find evidence that divergence minimization may not be an accurate characterization of GAN training.
****
Q: Recent evidence shows that convolutional neural networks (CNNs) are biased towards textures so that CNNs are non-robust to adversarial perturbations over textures, while traditional robust visual features like SIFT (scale-invariant feature transforms) are designed to be robust across a substantial range of affine distortion, addition of noise, etc with the mimic of human perception nature. This paper aims to leverage good properties of SIFT to renovate CNN architectures towards better accuracy and robustness. We borrow the scale-space extreme value idea from SIFT, and propose EVPNet (extreme value preserving network) which contains three novel components to model the extreme values: (1) parametric differences of Gaussian (DoG) to extract extrema, (2) truncated ReLU to suppress non-stable extrema and (3) projected normalization layer (PNL) to mimic PCA-SIFT like feature normalization. Experiments demonstrate that EVPNets can achieve similar or better accuracy than conventional CNNs, while achieving much better robustness on a set of adversarial attacks (FGSM,PGD,etc) even without adversarial training.

A: This paper aims to leverage good properties of robust visual features like SIFT to renovate CNN architectures towards better accuracy and robustness.
****
Q: Distributional Semantics Models(DSM) derive word space from linguistic items
 in context. Meaning is obtained by defining a distance measure between vectors
 corresponding to lexical entities. Such vectors present several problems. This
 work concentrates on quality of word embeddings, improvement of word embedding
 vectors, applicability of a novel similarity metric used ‘on top’ of the
 word embeddings. In this paper we provide comparison between two methods
 for post process improvements to the baseline DSM vectors. The counter-fitting
 method which enforces antonymy and synonymy constraints into the Paragram
 vector space representations recently showed improvement in the vectors’ capability
 for judging semantic similarity. The second method is our novel RESM
 method applied to GloVe baseline vectors. By applying the hubness reduction
 method, implementing relational knowledge into the model by retrofitting synonyms
 and providing a new ranking similarity definition RESM that gives maximum
 weight to the top vector component values we equal the results for the ESL
 and TOEFL sets in comparison with our calculations using the Paragram and Paragram
 + Counter-fitting methods. For SIMLEX-999 gold standard since we cannot
 use the RESM the results using GloVe and PPDB are significantly worse compared
 to Paragram. Apparently, counter-fitting corrects hubness. The Paragram
 or our cosine retrofitting method are state-of-the-art results for the SIMLEX-999
 gold standard. They are 0.2 better for SIMLEX-999 than word2vec with sense
 de-conflation (that was announced to be state-of the-art method for less reliable
 gold standards). Apparently relational knowledge and counter-fitting is more important
 for judging semantic similarity than sense determination for words. It is to
 be mentioned, though that Paragram hyperparameters are fitted to SIMLEX-999
 results. The lesson is that many corrections to word embeddings are necessary
 and methods with more parameters and hyperparameters perform better.


A:
Paper provides a description of a procedure to enhance word vector space model with an evaluation of Paragram and GloVe models for Similarity Benchmarks.
****