In this task, you are given the abstract of a research paper. Your task is to generate a summary of this abstract. Your summary should not be very short, but it's better if it's not more than 30 words.

Ex Input:
Quantization of a neural network has an inherent problem called accumulated quantization error, which is the key obstacle towards ultra-low precision, e.g., 2- or 3-bit precision. To resolve this problem, we propose precision highway, which forms an end-to-end high-precision information flow while performing the ultra-low-precision computation. First, we describe how the precision highway reduce the accumulated quantization error in both convolutional and recurrent neural networks. We also provide the quantitative analysis of the benefit of precision highway and evaluate the overhead on the state-of-the-art hardware accelerator. In the experiments, our proposed method outperforms the best existing quantization methods while offering 3-bit weight/activation quantization with no accuracy loss and 2-bit quantization with a 2.45 % top-1 accuracy loss in ResNet-50. We also report that the proposed method significantly outperforms the existing method in the 2-bit quantization of an LSTM for language modeling.

Ex Output:
precision highway; a generalized concept of high-precision information flow for sub 4-bit quantization 


Ex Input:
We propose a rejection sampling scheme using the discriminator of a GAN to
 approximately correct errors in the GAN generator distribution. We show that
 under quite strict assumptions, this will allow us to recover the data distribution
 exactly. We then examine where those strict assumptions break down and design a
 practical algorithm—called Discriminator Rejection Sampling (DRS)—that can be
 used on real data-sets. Finally, we demonstrate the efficacy of DRS on a mixture of
 Gaussians and on the state of the art SAGAN model. On ImageNet, we train an
 improved baseline that increases the best published Inception Score from 52.52 to
 62.36 and reduces the Frechet Inception Distance from 18.65 to 14.79. We then use
 DRS to further improve on this baseline, improving the Inception Score to 76.08
 and the FID to 13.75.

Ex Output:
We use a GAN discriminator to perform an approximate rejection sampling scheme on the output of the GAN generator.


Ex Input:
State-of-the-art machine learning methods exhibit limited compositional generalization. At the same time, there is a lack of realistic benchmarks that comprehensively measure this ability, which makes it challenging to find and evaluate improvements. We introduce a novel method to systematically construct such benchmarks by maximizing compound divergence while guaranteeing a small atom divergence between train and test sets, and we quantitatively compare this method to other approaches for creating compositional generalization benchmarks. We present a large and realistic natural language question answering dataset that is constructed according to this method, and we use it to analyze the compositional generalization ability of three machine learning architectures. We find that they fail to generalize compositionally and that there is a surprisingly strong negative correlation between compound divergence and accuracy. We also demonstrate how our method can be used to create new compositionality benchmarks on top of the existing SCAN dataset, which confirms these findings.


Ex Output:

Benchmark and method to measure compositional generalization by maximizing divergence of compound frequency at small divergence of atom frequency.