instruction:
In this task, you are given the abstract of a research paper. Your task is to generate a summary of this abstract. Your summary should not be very short, but it's better if it's not more than 30 words.
question:
Effective training of neural networks requires much data. In the low-data regime,
 parameters are underdetermined, and learnt networks generalise poorly. Data
 Augmentation (Krizhevsky et al., 2012) alleviates this by using existing data
 more effectively. However standard data augmentation produces only limited
 plausible alternative data. Given there is potential to generate a much broader set
 of augmentations, we design and train a generative model to do data augmentation.
 The model, based on image conditional Generative Adversarial Networks, takes
 data from a source domain and learns to take any data item and generalise it
 to generate other within-class data items. As this generative process does not
 depend on the classes themselves, it can be applied to novel unseen classes of data.
 We show that a Data Augmentation Generative Adversarial Network (DAGAN)
 augments standard vanilla classifiers well. We also show a DAGAN can enhance
 few-shot learning systems such as Matching Networks. We demonstrate these
 approaches on Omniglot, on EMNIST having learnt the DAGAN on Omniglot, and
 VGG-Face data. In our experiments we can see over 13% increase in accuracy in
 the low-data regime experiments in Omniglot (from 69% to 82%), EMNIST (73.9%
 to 76%) and VGG-Face (4.5% to 12%); in Matching Networks for Omniglot we
 observe an increase of 0.5% (from 96.9% to 97.4%) and an increase of 1.8% in
 EMNIST (from 59.5% to 61.3%).
answer:
Conditional GANs trained to generate data augmented samples of their conditional inputs used to enhance vanilla classification and one shot learning systems such as matching networks and pixel distance


question:
Audio signals are sampled at high temporal resolutions, and learning to synthesize audio requires capturing structure across a range of timescales. Generative adversarial networks (GANs) have seen wide success at generating images that are both locally and globally coherent, but they have seen little application to audio generation. In this paper we introduce WaveGAN, a first attempt at applying GANs to unsupervised synthesis of raw-waveform audio. WaveGAN is capable of synthesizing one second slices of audio waveforms with global coherence, suitable for sound effect generation. Our experiments demonstrate that—without labels—WaveGAN learns to produce intelligible words when trained on a small-vocabulary speech dataset, and can also synthesize audio from other domains such as drums, bird vocalizations, and piano. We compare WaveGAN to a method which applies GANs designed for image generation on image-like audio feature representations, finding both approaches to be promising.
answer:
Learning to synthesize raw waveform audio with GANs


question:
Deep neural networks have led to a series of breakthroughs, dramatically improving the state-of-the-art in many domains. The techniques driving these advances, however, lack a formal method to account for model uncertainty. While the Bayesian approach to learning provides a solid theoretical framework to handle uncertainty, inference in Bayesian-inspired deep neural networks is difficult. In this paper, we provide a practical approach to Bayesian learning that relies on a regularization technique found in nearly every modern network, batch normalization. We show that training a deep network using batch normalization is equivalent to approximate inference in Bayesian models, and we demonstrate how this finding allows us to make useful estimates of the model uncertainty. Using our approach, it is possible to make meaningful uncertainty estimates using conventional architectures without modifying the network or the training procedure. Our approach is thoroughly validated in a series of empirical experiments on different tasks and using various measures, showing it to outperform baselines on a majority of datasets with strong statistical significance.
answer:

We show that training a deep network using batch normalization is equivalent to approximate inference in Bayesian models, and we demonstrate how this finding allows us to make useful estimates of the model uncertainty in conventional networks.