In this task, you are given the abstract of a research paper. Your task is to generate a summary of this abstract. Your summary should not be very short, but it's better if it's not more than 30 words.

[Q]: Model distillation aims to distill the knowledge of a complex model into a simpler one. In this paper, we consider an alternative formulation called dataset distillation: we keep the model fixed and instead attempt to distill the knowledge from a large training dataset into a small one. The idea is to synthesize a small number of data points that do not need to come from the correct data distribution, but will, when given to the learning algorithm as training data, approximate the model trained on the original data. For example, we show that it is possible to compress 60,000 MNIST training images into just 10 synthetic distilled images (one per class) and achieve close to the original performance, given a fixed network initialization. We evaluate our method in various initialization settings.   Experiments on multiple datasets, MNIST, CIFAR10, PASCAL-VOC, and CUB-200, demonstrate the ad-vantage of our approach compared to alternative methods.   Finally, we include a real-world application of dataset distillation to the continual learning setting: we show that storing distilled images as episodic memory of previous tasks can alleviate forgetting more effectively than real images.
[A]: We propose to distill a large dataset into a small set of synthetic data that can train networks close to original performance. 


[Q]: Synthesizing user-intended programs from a small number of input-output exam-
 ples is a challenging problem with several important applications like spreadsheet
 manipulation, data wrangling and code refactoring. Existing synthesis systems
 either completely rely on deductive logic techniques that are extensively hand-
 engineered or on purely statistical models that need massive amounts of data, and in
 general fail to provide real-time synthesis on challenging benchmarks. In this work,
 we propose Neural Guided Deductive Search (NGDS), a hybrid synthesis technique
 that combines the best of both symbolic logic techniques and statistical models.
 Thus, it produces programs that satisfy the provided specifications by construction
 and generalize well on unseen examples, similar to data-driven systems. Our
 technique effectively utilizes the deductive search framework to reduce the learning
 problem of the neural component to a simple supervised learning setup. Further,
 this allows us to both train on sparingly available real-world data and still leverage
 powerful recurrent neural network encoders. We demonstrate the effectiveness
 of our method by evaluating on real-world customer scenarios by synthesizing
 accurate programs with up to 12× speed-up compared to state-of-the-art systems.
[A]: We integrate symbolic (deductive) and statistical (neural-based) methods to enable real-time program synthesis with almost perfect generalization from 1 input-output example.


[Q]: Analogical reasoning has been a principal focus of various waves of AI research. Analogy is particularly challenging for machines because it requires relational structures to be represented such that they can be flexibly applied across diverse domains of experience. Here, we study how analogical reasoning can be induced in neural networks that learn to perceive and reason about raw visual data. We find that the critical factor for inducing such a capacity is not an elaborate architecture, but rather, careful attention to the choice of data and the manner in which it is presented to the model. The most robust capacity for analogical reasoning is induced when networks learn analogies by contrasting abstract relational structures in their input domains, a training method that uses only the input data to force models to learn about important abstract features. Using this technique we demonstrate capacities for complex, visual and symbolic analogy making and generalisation in even the simplest neural network architectures.
[A]:
The most robust capacity for analogical reasoning is induced when networks learn analogies by contrasting abstract relational structures in their input domains.