instruction:
In this task, you are given the abstract of a research paper. Your task is to generate a summary of this abstract. Your summary should not be very short, but it's better if it's not more than 30 words.
question:
Understanding the groundbreaking performance of Deep Neural Networks is one
 of the greatest challenges to the scientific community today. In this work, we
 introduce an information theoretic viewpoint on the behavior of deep networks
 optimization processes and their generalization abilities. By studying the Information
 Plane, the plane of the mutual information between the input variable and
 the desired label, for each hidden layer. Specifically, we show that the training of
 the network is characterized by a rapid increase in the mutual information (MI)
 between the layers and the target label, followed by a longer decrease in the MI
 between the layers and the input variable. Further, we explicitly show that these
 two fundamental information-theoretic quantities correspond to the generalization
 error of the network, as a result of introducing a new generalization bound that is
 exponential in the representation compression. The analysis focuses on typical
 patterns of large-scale problems. For this purpose, we introduce a novel analytic
 bound on the mutual information between consecutive layers in the network.
 An important consequence of our analysis is a super-linear boost in training time
 with the number of non-degenerate hidden layers, demonstrating the computational
 benefit of the hidden layers.
answer:
Introduce an information theoretic viewpoint on the behavior of deep networks optimization processes and their generalization abilities


question:
Program verification offers a framework for ensuring program correctness and therefore systematically eliminating different classes of bugs. Inferring loop invariants is one of the main challenges behind automated verification of real-world programs which often contain many loops. In this paper, we present Continuous Logic Network (CLN), a novel neural architecture for automatically learning loop invariants directly from program execution traces. Unlike existing neural networks, CLNs can learn precise and explicit representations of formulas in Satisfiability Modulo Theories (SMT)  for loop invariants from program execution traces. We develop a new sound and complete semantic mapping for assigning SMT formulas to continuous truth values that allows CLNs to be trained efficiently. We use CLNs to implement a new inference system for loop invariants, CLN2INV, that significantly outperforms existing approaches on the popular Code2Inv dataset. CLN2INV is the first tool to solve all 124 theoretically solvable problems in the Code2Inv dataset. Moreover, CLN2INV takes only 1.1 second on average for each problem, which is 40 times faster than existing approaches. We further demonstrate that CLN2INV can even learn 12 significantly more complex loop invariants than the ones required for the Code2Inv dataset.
answer:
We introduce the Continuous Logic Network (CLN), a novel neural architecture for automatically learning loop invariants and general SMT formulas.


question:
One of the most prevalent symptoms among the elderly population, dementia, can be detected by classifiers trained on linguistic features extracted from narrative transcripts. However, these linguistic features are impacted in a similar but different fashion by the normal aging process. Aging is therefore a confounding factor, whose effects have been hard for machine learning classifiers to isolate. 

 In this paper, we show that deep neural network (DNN) classifiers can infer ages from linguistic features, which is an entanglement that could lead to unfairness across age groups. We show this problem is caused by undesired activations of v-structures in causality diagrams, and it could be addressed with fair representation learning. We build neural network classifiers that learn low-dimensional representations reflecting the impacts of dementia yet discarding the effects of age. To evaluate these classifiers, we specify a model-agnostic score $\Delta_{eo}^{(N)}$ measuring how classifier results are disentangled from age. Our best models outperform baseline neural network classifiers in disentanglement, while compromising accuracy by as little as 2.56\% and 2.25\% on DementiaBank and the Famous People dataset respectively.
answer:

Show that age confounds cognitive impairment detection + solve with fair representation learning + propose metrics and models.