W HAT C AN N EURAL N ETWORKS R EASON A BOUT ?
A BSTRACT
Neural networks have succeeded in many reasoning tasks.
Empirically, these tasks require specialized network structures, e.g., Graph Neural Networks (GNNs) perform well on many such tasks, while less structured networks fail.
Theoretically, there is limited understanding of why and when a network structure generalizes better than other equally expressive ones.
We develop a framework to characterize which reasoning tasks a network can learn well, by studying how well its structure aligns with the algorithmic structure of the relevant reasoning procedure.
We formally deﬁne algorithmic alignment and derive a sample complexity bound that decreases with better alignment.
This framework explains the empirical success of popular reasoning models and suggests their limitations.
We unify seemingly different reasoning tasks, such as intuitive physics, visual question answering, and shortest paths, via the lens of a powerful algorithmic paradigm, dynamic programming (DP).
We show that GNNs can learn DP and thus solve these tasks.
On several reasoning tasks, our theory aligns with empirical results.
I NTRODUCTION
Recently, there have been many advances in building neural networks that can learn to reason.
Reasoning spans a variety of tasks, for instance, visual and text-based question answering (Johnson et al., 2017a;
Weston et al., 2015; Hu et al., 2017; Fleuret et al., 2011; Antol et al., 2015), intuitive physics, i.e., predicting the time evolution of physical objects (Battaglia et al., 2016; Watters et al., 2017; Fragkiadaki et al., 2016;
Chang et al., 2017), mathematical reasoning (Saxton et al., 2019;
Chang et al., 2019) and visual IQ tests (Santoro et al., 2018; Zhang et al., 2019).
Curiously, neural networks that perform well in reasoning tasks usually possess speciﬁc structures (Santoro et al., 2017).
Many successful models follow the Graph Neural Network (GNN) framework (Battaglia et al., 2018; 2016; Palm et al., 2018; Mrowca et al., 2018; Sanchez-Gonzalez et al., 2018; Janner et al., 2019).
These networks explicitly model pairwise relations and recursively update each object’s representation by aggregating its relations with other objects.
Other computational structures, e.g., neural symbolic programs (Yi et al., 2018; Mao et al., 2019; Johnson et al., 2017b) and Deep Sets (Zaheer et al., 2017), are effective on speciﬁc tasks.
However, there is limited understanding of the relation between the generalization ability and network structure for reasoning.
What tasks can a neural network (sample efﬁciently) learn to reason about?
Answering this question is crucial for understanding the empirical success and limitations of existing models, and for designing better models for new reasoning tasks.
This paper is an initial work towards answering this fundamental question.
We develop a theoretical framework to characterize what tasks a neural network can reason about.
We build on a simple observation that reasoning procedures resemble algorithms.
Hence, we study how well a reasoning algorithm aligns with the computation graph of the network.
Intuitively, if they align well, the network only needs to learn simple algorithm steps to simulate the reasoning procedure, which leads to better sample efﬁciency.
We formalize this intuition with a numeric measure of algorithmic alignment,
[Figure]
Our theory agrees with empirical results (Fig. 3) and show initial support for our hypothesis that algorithmic alignment facilitates learning: Under simplifying assumptions, we show a sample complexity bound that decreases with better alignment.
Our framework explains the empirical success of popular reasoning models and suggests their limitations.
As concrete examples, we study four categories of increasingly complex reasoning tasks: summary statistics, relational argmax (asking about properties of the result of comparing multiple relations), dynamic programming, and NP-hard problems (Fig. 1).
Using alignment, we characterize which architectures are expected to learn each task well: Networks inducing permutation invariance, such as Deep Sets (Zaheer et al., 2017), can learn summary statistics, and one-iteration
GNNs can learn relational argmax.
Many other more complex tasks, such as intuitive physics, visual question answering, and shortest paths – despite seeming different – can all be solved via a powerful algorithmic paradigm: dynamic programming (DP) (Bellman, 1966).
Multi-iteration GNNs algorithmically align with DP and hence are expected to sample-efﬁciently learn these tasks.
Indeed, they do.
Our results offer an explanation for the popularity of GNNs in the relational reasoning literature, and also suggest limitations for tasks with even more complex structure.
As an example of such a task, we consider subset sum, an NP-hard problem where GNNs indeed fail.
Overall, empirical results (Fig. 3) agree with our theoretical analysis based on algorithmic alignment (Fig. 1).
These ﬁndings also suggest how to take into account task structure when designing new architectures.
The perspective that structure in networks helps is not new.
For example, in a well-known position paper, Battaglia et al.
(2018) argue that GNNs are suitable for relational reasoning because they have relational inductive biases, but without formalizations.
Here, we take such ideas one step further, by introducing a formal deﬁnition (algorithmic alignment) for quantifying the relation between network and task structure, and by formally deriving implications for learning.
These theoretical ideas are the basis for characterizing what reasoning tasks a network can learn well.
Our algorithmic structural condition also differs from structural assumptions common in learning theory, e.g. norms (Vapnik, 2013; Bartlett & Mendelson, 2002; Bartlett et al., 2017; Neyshabur et al., 2015; Golowich et al., 2018) and speciﬁcally aligns with reasoning.
In summary, we introduce algorithmic alignment to analyze learning for reasoning.
Our initial theoretical results suggest that algorithmic alignment is desirable for generalization.
On four categories of reasoning tasks with increasingly complex structure, we apply our framework to analyze which tasks some popular networks can learn well.
GNNs algorithmically align with dynamic programming, which solves a broad range of reasoning tasks.
Finally, our framework implies guidelines for designing networks for new reasoning tasks.
Experimental results conﬁrm our theory.
P RELIMINARIES
We begin by introducing notations and summarizing common neural networks for reasoning tasks.
Let S denote the universe, i.e. , a conﬁguration/set of objects to reason about.
Each object s ∈ S is represented by a vector X .
This vector could be state descriptions (Battaglia et al., 2016; Santoro for k = 1 … |S| - 1: for u in S:
d[k][u]
=
min v d[k-1][v] + cost (v, u) for k = 1 … GNN iter: h u(k) =
Σ v MLP(h v(k-1) , h u(k-1) ) algorithmically align
Bellman-Ford algorithm d[k][u]
Graph Neural Network h u(k) for u in S: sample efﬁciently learnable better et al., 2017) or features learned from data such as images (Santoro et al., 2017).
Information about the speciﬁc question can also be included in the object representations.
Given a set of universes { S 1 , ..., S M } and answer labels { y 1 , ..., y M } ⊆ Y , we aim to learn a function g that can answer questions about unseen universes, y = g ( S ) .
Multi-layer perceptron (MLP).
For a single-object universe, applying an MLP on the object representation usually works well.
But when there are multiple objects, simply applying an MLP to the concatenated object representations often does not generalize (Santoro et al., 2017).
Deep Sets.
The reasoning function is deﬁned on a set and therefore should be permutation-invariant, i.e., the output is the same for all input orderings.
To induce permutation-invariance in the neural network, Zaheer et al.
(2017) propose Deep Sets .
[Equation]
Graph Neural Networks (GNNs).
GNNs are originally proposed for learning on graphs (Scarselli et al., 2009b).
Their structures follow a message passing scheme (Gilmer et al., 2017; Xu et al., 2018; 2019), where the representation h ( k ) s of each node s (in iteration k ) is recursively updated by aggregating the representation of neighboring nodes.
GNNs can be adopted for reasoning by considering objects as nodes and assuming all objects pairs are connected, i.e. , a complete graph (Battaglia et al., 2018):
[Equation]
where h S is the answer/output and K is the number of GNN layers.
Each object’s representation is initialized as h (0) s =
X s .
Although other aggregation functions are proposed, we use sum in our experiments.
Similar to Deep Sets, GNNs are also permutation invariant.
While Deep Sets focus on individual objects, GNNs can also focus on pairwise relations.
The GNN framework includes many reasoning models.
Relation Networks (Santoro et al., 2017) and Interaction Networks (Battaglia et al., 2016) resemble one-layer GNNs.
Recurrent Relational
Networks (Palm et al., 2018) apply LSTMs (Hochreiter & Schmidhuber, 1997) after aggregation.
T HEORETICAL F RAMEWORK : A LGORITHMIC A LIGNMENT
Our theory studies how the network structure and task may interact, and what the implications are for generalization.
Different network structures have different degrees of success in reasoning tasks, e.g., GNNs can learn relations well, but Deep Sets often fail (Fig. 3).
However, all these networks are universal approximators (Propositions 3.1 and 3.2).
Thus, their differences in test accuracy must come from generalization.
We observe that the answer to many reasoning tasks may be derived by following a reasoning algorithm; we further illustrate the algorithms for some reasoning tasks in Section 4.
Many neural networks can represent algorithms (Pérez et al., 2019).
For example, Deep Sets can universally represent permutation-invariant set functions (Zaheer et al., 2017; Wagstaff et al., 2019).
This also holds for GNNs and MLPs, as we show in Propositions 3.1 and 3.2 (our setting differs from Scarselli et al.
(2009a) and Xu et al.
(2019), who study functions on graphs):
Proposition 3.1.
Let f : R d × N → R be any continuous function over sets S of bounded cardinality | S | ≤ N .
If f is permutation-invariant to the elements in S , and the elements are in a compact set in R d , then f can be approximated arbitrarily closely by a GNN (of any depth).
Proposition 3.2.
For any GNN N , there is an MLP that can represent all functions N can represent.
But, empirically, not all network structures work well when learning these algorithms, i.e., they generalize differently.
Intuitively, a network may generalize better if it can represent a function “more easily”.
We formalize this idea by algorithmic alignment , formally deﬁned in Deﬁnition 3.4.
Indeed, not only the reasoning procedure has an algorithmic structure: the neural network’s architecture induces a computational structure on the function it computes.
This corresponds to an algorithm that prescribes how the network combines computations from modules.
Fig.
2 illustrates this idea for a
GNN, where the modules are its MLPs applied to pairs of objects.
In the shortest paths problem, the GNN matches the structure of the Bellman-Ford algorithm: to simulate the Bellman-Ford with a
GNN, the GNN’s MLP modules only need to learn a simple update equation (Fig. 2).
In contrast, if we want to represent the Bellman-Ford algorithm with a single MLP, it needs to simulate an entire for-loop , which is much more complex than one update step.
Therefore, we expect the GNN to have better sample complexity than MLP when learning to solve shortest path problems.
This perspective suggests that a neural network which better aligns with a correct algorithmic solution can more easily learn a reasoning task than a neural network that does not align well.
If we look more broadly at reasoning, however, there may also exist algorithmic solutions which only solve a task approximately, or whose structure is obtuse.
In this paper, we focus on reasoning tasks whose underlying algorithm is exact and has clear structure.
We leave the study of approximation algorithms and unknown structures for future work.
3. F ORMALIZATION OF A LGORITHMIC A LIGNMENT
We formalize the above intuition in a PAC learning framework (Valiant, 1984).
PAC learnability formalizes simplicity as sample complexity, i.e., the number of samples needed to ensure low test error with high probability.
It refers to a learning algorithm
A that, given training samples { x i , y i } Mi =1 , outputs a function f
= A ( { x i , y i } Mi =1 ) .
The learning algorithm here is the training method for the neural network, e.g., gradient descent.
A function is simple if it has low sample complexity.
Deﬁnition 3.3.
(PAC learning and sample complexity).
Fix an error parameter (cid:15) > 0 and failure probability δ ∈
Suppose { x i , y i } Mi =1 are i.i.d.
samples from some distribution D , and the data satisﬁes y
i
=
g
( x i ) for some underlying function g .
Let f = A
( { x i , y i } Mi =1 ) be the function generated by a learning algorithm A .
Then g is ( M, (cid:15), δ ) -learnable with A if
[Equation]
The sample complexity C A ( g, (cid:15), δ ) is the minimum M so that g is ( M, (cid:15), δ ) -learnable with A .
With the PAC learning framework, we deﬁne a numeric measure of algorithmic alignment (Deﬁnition 3.4), and under simplifying assumptions, we show that the sample complexity decreases with better algorithmic alignment (Theorem 3.6).
Formally, a neural network aligns with an algorithm if it can simulate the algorithm via a limited number of modules, and each module is simple, i.e., has low sample complexity.
Deﬁnition 3.4.
(Algorithmic alignment).
Let g be a reasoning function and N a neural network with n modules N i .
The module functions f 1 , ..., f n generate g for N if, by replacing N i with f i , the network N simulates g .
Then N ( M, (cid:15), δ ) -algorithmically aligns with g if (1) f 1 , ..., f n generate g and (2) there are learning algorithms
A i for the N
i ’s such that n · max
i C A i ( f i , (cid:15), δ ) ≤ M .
Good algorithmic alignment, i.e., small M , implies all algorithm steps f i to simulate the algorithm g are easy to learn .
Therefore, the algorithm steps should not simulate complex programming constructs such as for-loops, whose sample complexity is large (Theorem 3.5).
Next, we show how to compute the algorithmic alignment value M .
Algorithmic alignment resembles
Kolmogorov complexity (Kolmogorov, 1998) for neural networks.
Thus, it is generally non-trivial to obtain the optimal alignment between a neural network and an algorithm.
However, one important difference to Kolmogorov complexity is that any algorithmic alignment that yields decent sample complexity is good enough (unless we want the tightest bound).
In Section 4, we will show that we can usually derive a nearly-tight alignment by avoiding as many “for loops” in algorithm steps as possible.
Then, we can compute the value of an alignment by summing the sample complexity of the algorithm steps with respect to the modules, e.g. MLPs.
As an example, we show how to compute sample complexity of MLP modules.
Recent work shows sample complexity for overparameterized two or three-layer MLPs by analyzing their gradient descent trajectories (Arora et al., 2019; Allen-Zhu et al., 2019).
Building upon Arora et al.
(2019), Du et al.
(2019) show inﬁnitely-wide GNNs can provably learn certain smooth functions.
Here, Theorem 3.5, proved in the Appendix, summarizes and extends Theorem 6 . 1 of Arora et al.
(2019) to vector-valued functions.
Our framework can be used with other sample complexity bounds for other types of modules, too.
Theorem 3.5.
(Sample complexity for overparameterized MLP modules).
Let A be an overparameterized and randomly initialized two-layer MLP trained with gradient descent for a sufﬁcient number of iterations.
Suppose g : R d → R m with components g ( x ) ( i ) =
(cid:80)
j α ( i ) j
(cid:0) β
[Equation]
j [Equation] where β ( i ) j ∈ R d , α ∈ R , and p ( i ) j
= 1 or p ( i ) j = 2 l ( l ∈ N + ) .
The sample complexity C A ( g, (cid:15), δ ) is
C A ( g, (cid:15), [Equation]
[Equation]
O
[Equation]
Theorem 3.5 suggests that functions that are “simple” when expressed as a polynomial, e.g., via a
Taylor expansion, are sample efﬁciently learnable by an MLP module.
Thus, algorithm steps that perform computation over many objects may require many samples for an MLP module to learn, since the number K of polynomials or (cid:107)
β
( i ) j (cid:107) can increase in Eqn.
“For loop” is one example of such complex algorithm steps.
3. B ETTER A LGORITHMIC A LIGNMENT I MPLIES B ETTER G ENERALIZATION
We show an initial result demonstrating that algorithmic alignment is desirable for generalization.
Theorem 3.6 states that, in a simplifying setting where we sequentially train modules of a network with auxiliary labels, the sample complexity bound increases with algorithmic alignment value M .
While we do not have auxiliary labels in practice, we observe the same pattern for end-to-end learning in experiments (Section 4).
We leave sample complexity analysis for end-to-end-learning to future work.
We prove Theorem 3.6 in Appendix D.
Theorem 3.6.
(Algorithmic alignment improves sample complexity).
Fix (cid:15) and δ .
Suppose { S i , y i } Mi =1 ∼ D , where | S i | < N , and y i =
g ( S i ) for some g .
Suppose N 1 , ..., N n are network N ’s
MLP modules in sequential order.
Suppose N and g ( M, (cid:15), δ ) -algorithmically align via functions f 1 , ..., f n .
Under the following assumptions, g is ( M, O ( (cid:15) ) , O ( δ ))
-learnable by N .
a) Algorithm stability.
Let A be the learning algorithm for
the N i ’s. Suppose f = A ( { x i , y i } Mi =1 ) , and
ˆ f = A ( { ˆ x i , y i } Mi =1 ) .
For any x , (cid:107) f ( x ) − ˆ f ( x ) (cid:107) ≤ L 0 · max i (cid:107) x
i − ˆ x i (cid:107) , for some L 0 .
b) Sequential learning.
We train N i ’s sequentially: N 1 has input samples { ˆ x (1) i , f 1 (ˆ x (1) i ) } Ni =1 , with ˆ x (1) i obtained from S i .
For j > 1 , the input ˆ x ( j ) i for N j are the outputs from the previous modules, but labels are generated by the correct functions f j − 1 , ..., f 1 on ˆ x (1) i .
c)
Lipschitzness.
The learned functions ˆ f j satisfy (cid:107) ˆ f j ( x ) − ˆ f j (ˆ x ) (cid:107) ≤ L 1 (cid:107) x − ˆ x (cid:107) , for some L 1 .
In our analysis, the Lipschitz constants and the universe size are constants going into O ( (cid:15) ) and
O ( δ ) .
As an illustrative example, we use Theorem 3.6 and 3.5 to show that GNN has a polynomial
GNN3 GNN
DeepSets
MLP
SortedMLP 100% 95% 96% 9% 100% (a) Maximum value difference.
GNN3 GNN
DeepSets
MLP 95% 92% 21% 9% (b) Furthest pair.
GNN7 GNN4 GNN3 GNN2 GNN1 DeepSets MLP 96% 94% 91% 62% 27% 11% 8% (c) Monster trainer.
NES
GNN6 GNN
DeepSets
MLP 98% 72% 69% 61% 60% (d) Subset sum.
Random is 50% .
improvement in sample complexity over MLP when learning simple relations.
Indeed, GNN aligns better with summary statistics of pairwise relations than MLP does (Section 4.1).
Corollary 3.7.
Suppose universe S has (cid:96) objects X 1 , ..., X (cid:96) , and g ( S )
= (cid:80) i,j ( X i − X j ) 2 .
In the setting of Theorem 3.6, the sample complexity bound for MLP is O ( (cid:96) 2 ) times larger than for GNN.
P REDICTING W HAT N EURAL N ETWORKS C AN R EASON A BOUT
Next, we apply our framework to analyze the neural networks for reasoning from Section 2: MLP,
Deep Sets, and GNNs.
Using algorithmic alignment, we predict whether each model can generalize on four categories of increasingly complex reasoning tasks: summary statistics, relational argmax, dynamic programming, and NP-hard problem (Fig. 3).
Our theoretical analysis is conﬁrmed with experiments (Dataset and training details are in Appendix G).
To empirically compare sample complexity of different models, we make sure all models perfectly ﬁt training sets through extensive hyperparameter tuning.
Therefore, the test accuracy reﬂects how well a model generalizes.
Our analysis also explains why GNNs are widely successful across reasoning tasks.
Popular reasoning tasks such as visual question answering and intuitive physics can be solved by DP, which GNN can learn sample-efﬁciently.
4. S UMMARY S TATISTICS
As discussed in Section 2, we assume each object X has a state representation X
= [ h 1 , h 2 , ..., h k ] , where each h i ∈ R
d i is a feature vector.
MLP can learn simple polynomial functions of the state representation (Theorem 3.5).
In this section, we show how Deep Sets use MLP as building blocks to learn summary statistics.
Questions about summary statistics are common in reasoning tasks.
One example from CLEVR (Johnson et al., 2017a) is “How many objects are either small cylinders or red things?”
Deep Sets (Eqn.
2.1) align well with algorithms that compute summary statistics over individual objects.
Suppose we want to compute the sum of a feature over all objects.
To simulate the reasoning algorithm, we can use the ﬁrst MLP in Deep Sets to extract the desired feature and aggregate them using the pooling layer.
Under this alignment, each MLP only needs to learn simple steps, which leads to good sample complexity.
Similarly, Deep Sets can learn to compute max or min of a feature by using smooth approximations like the softmax max s ∈ S X s
≈ log( (cid:80) s
∈ X s exp( X s )) .
In contrast, if we train an
MLP to perform sum or max, the MLP must learn a complex for-loop and therefore needs more samples.
Therefore, our framework predicts that Deep Sets have better sample complexity than MLP when learning summary statistics.
[Figure]
Maximum value difference.
We conﬁrm our predictions by training models to compute the maximum value difference task.
Each object in this task is a treasure X
=
[ h 1 , h 2 , h 3 ] with location h 1 , value h 2 , and color h 3 .
We train models to predict the difference in value between the most and the least valuable treasure, y ( S )
= max s ∈ S
h 2 ( X s ) − min s ∈ S
h 2 ( X s ) .
The test accuracy follows our prediction (Fig. 3a).
MLP does not generalize and only has 9% test accuracy, while Deep Sets has 96%.
Interestingly, if we sort the treasures by value (Sorted
MLP in Fig. 3a), MLP achieves perfect test accuracy.
This observation can be explained with our theory—when the treasures are sorted, the reasoning algorithm is reduced to a simple subtraction:
y ( S ) =
h 2 ( X | S | ) − h 2 ( X 1 ) , which has a low sample complexity for even MLPs (Theorem 3.5).
GNNs also have high test accuracies.
This is because summary statistics are a special case of relational argmax, which GNNs can learn as shown next.
4. R ELATIONAL A RGMAX
Next, we study relational argmax : tasks where we need to compare pairwise relations and answer a question about that result.
For example, a question from Sort-of-CLEVR (Santoro et al., 2017) asks “What is the shape of the object that is farthest from the gray object?”, which requires comparing the distance between object pairs.
A one-iteration GNN aligns well with relational argmax, as it sums over all pairs of objects, and thus can compare, e.g. via softmax, pairwise information without learning the “for loops”.
In contrast,
Deep Sets require many samples to learn this, because most pairwise relations cannot be encoded as a sum of individual objects:
Claim 4.1.
Suppose g ( x, y )
=
if and only if x = y .
There is no f such that g ( x, y ) =
f ( x ) + f ( y ) .
Therefore, if we train a Deep Set to compare pairwise relations, one of the MLP modules has to learn a complex “for loop”, which leads to poor sample complexity.
Our experiment conﬁrms that GNNs generalize better than Deep Sets when learning relational argmax.
Furthest pair.
As an example of relational argmax, we train models to identify the furthest pair among a set of objects.
We use the same object settings as the maximum value difference task.
We train models to ﬁnd the colors of the two treasures with the largest distance.
The answer is a pair of colors, encoded as an integer category:
[Equation]
Distance as a pairwise function satisﬁes the condition in Claim 4.1.
As predicted by our framework,
Deep Sets has only 21% test accuracy, while GNNs have more than 90% accuracy.
4. D YNAMIC P ROGRAMMING
We observe that a broad class of relational reasoning tasks can be uniﬁed by the powerful algorithmic paradigm dynamic programming (DP) (Bellman, 1966).
DP recursively breaks down a problem into simpler sub-problems.
It has the following general form:
[Equation]
where Answer [ k ][ i ] is the solution to the sub-problem indexed by iteration k and state i , and DPUpdate is an task-speciﬁc update function that computes Answer [ k ][ i ] from Answer [ k − 1]
[ j ] ’s.
GNNs algorithmically align with a class of DP algorithms.
We can interpret GNN as a DP algorithm, where node representations h ( k ) i are Answer [ k ][ i ] , and the GNN aggregation step is DP-Update.
Therefore, Theorem 3.6 suggests that a GNN with enough iterations can sample efﬁciently learn any
DP algorithm with a simple DP-update function, e.g. sum/min/max.
Shortest paths.
As an example, we experiment with GNN on Shortest Paths, a standard DP problem.
Shortest path can be solved by the Bellman-Ford algorithm Bellman (1958), which recursively updates the minimum distance between each object u and the source s is the following:
[Equation]
As discussed above, GNN aligns well with this DP algorithm.
Therefore, our framework predicts that GNN has good sample complexity when learning to ﬁnd shortest paths.
To verify this, we test different models on a monster trainer game, which is a shortest path variant with unkown cost functions that need to be learned by the models.
Appendix G.3 describes the task in details.
In Fig.
3c, only GNNs with at least four iterations generalize well.
The empirical result conﬁrms our theory: a neural network can sample efﬁciently learn a task if it aligns with a correct algorithm.
Interestingly, GNN does not need as many iterations as Bellman-Ford.
While Bellman-Ford needs
N = 7 iterations, GNNs with four iterations have almost identical test accuracy as GNNs with seven iterations (94% vs 95%).
This can also be explained through algorithmic alignment, as GNN aligns with an optimized version of Bellman-Ford, which we explain in Appendix G.3.
Fig.
4 shows how the test accuracies of different models vary with the number of sub-sampled training points.
Indeed, the test accuracy increases more slowly for models that align worse with the task, which implies they need more training samples to achieve similar generalization performance.
Again, this conﬁrms our theory.
After verifying that GNNs can sample-efﬁciently learn DP, we show that two popular families of reasoning tasks, visual question answering and intuitive physics, can be formulated as DP.
Therefore, our framework explains why GNNs are effective in these tasks.
Visual question answering.
The Pretty-CLEVR dataset (Palm et al., 2018) is an extension of
Sort-of-CLEVR (Santoro et al., 2017) and CLEVR (Johnson et al., 2017a).
GNN works well on these datasets.
Each question in Pretty-CLEVR has state representations and asks “Starting at object X, if each time we jump to the closest object, which object is K jumps away?”.
This problem can be solved by DP, which computes the answers for k jumps from the answers for ( k − 1) jumps.
closest [1][ i ] = arg
[Equation]
j d ( i, j ) ,
[Equation]
(4.3) where closest [ k ][ i ] is the answer for jumping k times from object i , and d ( i, j ) is the distance between the i -th and the j -th object.
Intuitive physics.
Battaglia et al.
(2016) and Watters et al.
(2017) train neural networks to predict object dynamics in rigid body scenes and n-body systems.
Chang et al.
(2017) and Janner et al.
(2019) study other rigid body scenes.
Suppose the force acting on a physical object stays constant, we can compute the object’s trajectory with simple functions (physics laws) based on its initial position and force.
Physical interactions, however, make the force change, which means the function to compute the object’s dynamics has to change too.
Thus, a DP algorithm would recursively compute the next force changes in the system and update DP states (velocity, momentum, position etc of objects) according to the (learned) forces and physics laws (Thijssen, 2007).
for k = 1 ..K : time =
min i,j Force-change-time ( state [ k − 1 , i ] , state [ k − 1 , j ]) , (4.4) for i = 1 ..N : state [ k ][ i ] = Update-by-forces ( state [ k − 1][ j ] , time ) , j = 1 ..N, (4.5)
Force-change-time computes the time at which the force between object i and j will change.
Updateby-forces updates the state of each object at the next force change time.
In rigid body systems, force changes only at collision.
In datasets where no object collides more than once between time frames, one-iteration algorithm/
GNN can work (Battaglia et al., 2016).
More iterations are needed if multiple collisions occur between two consecutive frames (Li et al., 2019).
In n-body systems, forces change continuously but smoothly.
Thus, ﬁnite-iteration DP/GNN can be viewed as a form of Runge-Kutta method (DeVries & Hamill, 1995).
4. D ESIGNING N EURAL N ETWORKS WITH A LGORITHMIC A LIGNMENT
While DP solves many reasoning tasks, it has limitations.
For example, NP-hard problems cannot be solved by DP.
It follows that GNN also cannot sample-efﬁciently learn these hard problems.
Fortunately, our framework provides a solution: if we know the structure of the underlying reasoning algorithm, we can design a network with a similar structure to learn it.
If we have no prior knowledge about the structure, then neural architecture search over algorithmic structures will be needed.
Subset Sum.
As an example, we design a new architecture that can learn to solve the subset sum problem: Given a set of numbers, does there exists a subset that sums to 0 ?
Subset sum is
NP-hard (Karp, 1972) and cannot be solved by DP.
Therefore, our framework predicts that GNN cannot generalize on this task.
One subset sum algorithm is exhaustive search, where we enumerate all 2 | S | possible subsets τ and check whether τ has zero-sum.
Following this algorithm, we design a similarly structured neural network which we call Neural Exhaustive Search (NES) .
Given a universe, NES enumerates all subsets of objects and passes each subset through an LSTM followed by a MLP.
The results are aggregated with a max-pooling layer and MLP:
[Equation]
| : X 1 , ..., X | τ | ∈ τ )) .
This architecture aligns well with subset-sum, since the ﬁrst MLP and LSTM only needs to learn a simple step, checking whether a subset has zero sum.
Therefore, we expect NES to generalize well in this task.
Indeed, NES has 98% test accuracy, while other models have below 80% accuracy (Fig. 3d).
C ONCLUSION
This paper is an initial step towards formally understanding how neural networks can learn to reason.
We introduce an algorithmic alignment perspective that may inspire neural network design and opens up theoretical avenues.
An interesting future direction is to design, e.g. via algorithmic alignment, neural networks that can learn other general algorithmic paradigms, and to explore the neural architecture search space of algorithmic structures.
A CKNOWLEDGMENTS
This research was supported by NSF CAREER award 1553284, DARPA DSO’s Lagrange program under grant FA86501827838 and a Chevron-MIT Energy Fellowship.
This research was also supported by JST ERATO JPMJER1201 and JSPS Kakenhi JP18H05291.
MZ was supported by
DARPA award HR0011-15-C-0113 under subcontract to Raytheon BBN Technologies.
We thank Zi Wang and Jiajun Wu for insightful discussion on the future of intelligence.
The views, opinions, and/or ﬁndings contained in this article are those of the author and should not be interpreted as representing the ofﬁcial views or policies, either expressed or implied, of the Defense Advanced
Research Projects Agency or the Department of Defense.
A P ROOF OF P ROPOSITION 3.
We will prove the universal approximation of GNNs by showing that GNNs have at least the same expressive power as Deep Sets, and then apply the universal approximation of Deep Sets for permutation invariant continuous functions.
Zaheer et al.
(2017) prove the universal approximation of Deep Sets under the restriction that the set size is ﬁxed and the hidden dimension is equal to the set size plus one.
Wagstaff et al.
(2019) extend the universal approximation result for Deep Sets by showing that the set size does not have to be ﬁxed and the hidden dimension is only required to be at least as large as the set size.
The results for our purposes can be summarized as follows.
Universal approximation of Deep Sets.
Assume the elements are from a compact set in R d .
Any continuous function on a set S of size bounded by N , i.e. , f : R d × N → R , that is permutation invariant to the elements in S can be approximated arbitrarily close by some Deep Sets model with sufﬁciently large width and output dimension for its MLPs.
Next we show any Deep Sets can be expressed by some GNN with one message passing iteration.
The computation structure of one-layer GNNs is shown below.
[Equation]
where φ and g are parameterized by MLPs.
If φ is a function that ignores X t so that φ ( X s , X t )
=
ρ ( X s ) for some ρ , e.g. , by letting part of the weight matricies in φ be 0 , then we essentially get a
Deep Sets in the following form.
[Equation]
For any such ρ , we can get the corresponding φ via the construction above.
Hence for any Deep
Sets, we can express it with an one-layer GNN.
The same result applies to GNNs with multiple layers (message passing iterations), because we can express a function ρ ( X s ) by the composition of multiple ρ ( k ) ’s, which we can express with a GNN layer via our construction above.
It then follows that GNNs are universal approximators for permutation invariant continuous functions.
B P ROOF OF P ROPOSITION 3.
For any GNN N , we construct an MLP that is able to do the exact same computation as N .
It will then follow that the MLP can represent any function N can represent.
Suppose the computation structure of N is the following.
[Equation]
where f and g are parameterized by MLPs.
Suppose the set size is bounded by M (the expressive power of GNNs also depend on M Wagstaff et al.
We ﬁrst show the result for a ﬁxed size input, i.e. , MLPs can simulate GNNs if the input set has a ﬁxed size, and then apply an ensemble approach to deal with variable sized input.
Let the input to the MLP be a vector concatenated by h (0) s ’s, in some arbitrary ordering.
For each message passing iteration of N , any f ( k ) can be represented by an MLP.
Thus, for each pair of ( h ( k − 1) t , h ( k − 1) s ) , we can set weights in the MLP so that the the concatenation of all f ( h ( k − 1) t
[Equation]
h
[Equation]
k −
[Equation] [Equation]
) become the hidden vector after some layers of the MLP.
With the vector of f ( h ( k − 1) t
[Equation]
h ( k − 1) s ) as input, in the next few layers of the MLP we can construct weights so that we have the concatenation of h ( k ) s
[Equation]
as the result of the hidden dimension, because we can encode summation with weights in MLPs.
So far, we can simulate an iteration of GNN N with layers of MLP.
We can repeat the process for K times by stacking the similar layers.
Finally, with a concatenation of h ( K ) s as our hidden dimension in the MLP, similarly, we can simulate h S
= g (cid:16)(cid:80) s
∈ S h
( K ) s (cid:17) with layers of MLP.
Stacking all layers together, we have obtained an MLP that can simulate N .
To deal with variable sized inputs, we construct M MLPs that can simulate the GNN for each input set size 1 , ..., M .
Then we construct a meta-layer, whose weights represent (universally approximate) the summation of the output of M MLPs multiplied by an indicator function of whether each MLPs has the same size as the set input (these need to be input information).
The meta layer weights on top can then essentially select the output from of MLP that has the same size as the set input and then exactly simulate the GNN.
Note that the MLP we construct here has the requirement for how we input the data and the information of set sizes etc.
In practice, we can have M MLPs and decide which MLP to use depending on the input set size.
C P ROOF OF T HEOREM 3.
Theorem 3.5 is a generalization of Theorem 6 . 1 in (Arora et al., 2019), which addresses the scalar case.
See (Arora et al., 2019) for a complete list of assumptions.
Theorem C.1.
(Arora et al., 2019)
Suppose we have g : R d → R , g ( x )
= (cid:80) j α j (cid:0) β
(cid:62)
j x (cid:1) p
j , where β j ∈ R d , α ∈ R , and p j = 1 or p j = 2 l ( l ∈ N + ) .
Let A be an overparameterized two-layer MLP that is randomly initialized and trained with gradient descent for a sufﬁcient number of iterations.
The sample complexity C A ( g, (cid:15), δ ) is O (cid:16) (cid:80)
j p j | α j |·(cid:107)
β j (cid:107) pj
+log(1 /δ )
(cid:15)(cid:17) .
To extend the sample complexity bound to vector-valued functions, we view each entry/component of the output vector as an independent scalar-valued output.
We can then apply a union bound to bound the error rate and failure probability for the output vector, and thus, bound the overall sample complexity.
Let (cid:15) and δ be the given error rate and failure probability.
Moreover, suppose we choose some error rate (cid:15) 0 and failure probability δ 0 for the output/function of each entry.
Applying Theorem C.1 to each component
[Equation]
yields a sample complexity bound of
[Equation]
for each g i ( x ) .
Now let us bound the overall error rate and failure probability given (cid:15) 0 and δ 0 for each entry.
The probability that we fail to learn each of the g i is at most δ 0 .
Hence, by a union bound, the probability that we fail to learn any of the g i is at most m · δ 0 .
Thus, with probability at least 1 − mδ 0 , we successfully learn all g i for i = 1 , ..., m , so the error for every entry is bounded by (cid:15) 0 .
The error for the vector output is then at most (cid:80) mi =1 (cid:15)
= m(cid:15) 0 .
Setting mδ
= δ and m(cid:15)
= (cid:15) gives us δ
= δm and (cid:15)
= (cid:15)m .
Thus, if we can successfully learn the function for each output entry independently with error (cid:15)/m and failure rate δ/m , we can successfully learn the entire vector-valued function with rate (cid:15) and δ .
This yields the following overall sample complexity bound:
[Equation]
Regarding m as a constant
[Equation]
we can further simplify the sample complexity to
[Equation]
D P ROOF OF T HEOREM 3.
We will show the learnability result by an inductive argument.
Speciﬁcally, we will show that under our setting and assumptions, the error between the learned function and correct function on the test set will not blow up after the transform of another learned function ˆ f j , assuming learnability on previous ˆ f 1 , ..., ˆ f j − 1 by induction.
Thus, we can essentially provably learn at all layers/iterations and eventually learn g .
Suppose we have performed the sequential learning.
Let us consider what happens at the test time.
Let f j be the correct functions as deﬁned in the algorithmic alignment.
Let ˆ f j be the functions learned by algorithm A j and MLP N j .
We have input S ∼ D , and our goal is to bound (cid:107) g ( S ) − ˆ g ( S ) (cid:107) with high probability.
To show this, we bound the error of the intermediate representation vectors, i.e. , the output of ˆ f j and f j , and thus, the input to ˆ f j +1 and f j +1 .
Let us ﬁrst consider what happens for the ﬁrst module N 1 .
f 1 and ˆ f 1 have the same input distribution x ∼ D , where x are obtained from S , e.g. , the pairwise object representations as in Eqn. 2.2.
Hence, by the learnability assumption on A 1 , (cid:107) f 1 ( x ) − ˆ f 1 ( x ) (cid:107) < (cid:15) with probability at least 1 − δ .
The error for the input of N 2 is then O ( (cid:15) ) with failure probability O ( δ ) , because there are a constant number of terms of aggregation of f 1 ’s output, and we can apply union bound to upper bound the failure probability.
Next, we proceed by induction.
Let us ﬁx a k .
Let z denote the input for f k , which are generated by the previous f j ’s, and let ˆ z denote the input for ˆ f k , which are generated by the previous ˆ f j ’s.
Assume (cid:107)
z − ˆ z (cid:107) ≤ O ( (cid:15) ) with failure probability at most O ( δ ) .
We aim to show that this holds for k + 1 .
For the simplicity of notation, let f denote the correct function f k and let ˆ f denote the learned function ˆ f k .
Since there are a constant number of terms for aggregation, our goal is then to bound (cid:107) ˆ f
(ˆ z ) − f ( z ) (cid:107) .
By triangle inequality, we have
[Equation]
We can bound the ﬁrst term with the Lipschitzness assumption of ˆ f as the following.
[Equation]
To bound the second term, our key insight is that f is a learnale correct function , so by the learnability coefﬁcients in algorithmic alignment, it is close to the function ˜ f learned by the learning algorithm
A on the correct samples , i.e. , f is close to ˜ f
= A ( { z i , y i } ) .
Moreover, ˆ f is generated by the learning algorithm
A on the perturbed samples, i.e. , ˆ f =
A ( { ˆ z i , y i } ) .
By the algorithm stability assumption, ˆ f and ˜ f should be close if the input samples are only slightly perturbed.
It then follows that
[Equation]
where z i and ˆ z i are the training samples at the same layer k .
Here, we apply the same induction condition as what we had for z and ˆ z : (cid:107) z i − ˆ
z i (cid:107) ≤ O ( (cid:15) ) with failure probability at most O ( δ ) .
We can then apply union bound to bound the probability of any bad event happening.
Here, we havebad events each happening with probability at most O ( δ ) .
Thus, with probability at least 1 − O ( δ ) , we have
[Equation]
This completes the proof.
E P ROOF OF C OROLLARY 3.
Our main insight is that a giant MLP learns the same function ( X i − X j ) 2 for (cid:96) 2 times and encode them in the weights.
This leads to the O ( (cid:96) 2 ) extra sample complexity through Theorem 3.5, because the number of polynomial terms ( X i − X j ) 2 is of order (cid:96) 2 .
First of all, the function f ( x, y )
=
( x − y ) 2 can be expressed as the following polynomial.
[Equation]
We have β =
[1 − 1] , so p · (cid:107) β (cid:107) p = 4 .
Hence, by Theorem 3.5, it takes O ( log(1 /δ )
(cid:15))
samples for an
MLP to learn f ( x, y ) =
( x − y ) 2 .
Under the sequential training setting, an one-layer GNN applies an MLP to learn f , and then sums up the outcome of f ( X i , X j ) for all pairs X i , X j .
Here, we essentially get the aggregation error O
( (cid:96) 2 · (cid:15) ) from (cid:96) 2 pairs.
However, we will see that applying an
MLP to learn g will also incur the same aggregation error.
Hence, we do not need to consider the aggregation error effect when we compare the sample complexities.
Now we consider using MLP to learn the function g .
No matter in what order the objects
X
i are concatenated, we can express g with the sum of polynomials as the following.
[Equation]
where β ij has 1 at the i -th entry, − 1 at the j -th entry and 0 elsewhere.
Hence (cid:107) β ij (cid:107) p · p = 4 .
It then follows from Theorem 3.5 and union bound that it takes O (( (cid:96) 2 + log(1 / ˆ δ )) /
ˆ (cid:15) 2 ) to learn g , where ˆ (cid:15) =
(cid:96) 2 (cid:15) and ˆ δ = (cid:96) 2 δ .
Here, as we have discussed above, the same aggregation error ˆ (cid:15) occurs in the aggregation process of f , so we can simply consider ˆ (cid:15) for both.
Thus, comparing O (log(1 / ˆ δ ) / ˆ (cid:15) 2 ) and O (( (cid:96) 2 + log(1 / ˆ δ )) /
ˆ (cid:15) 2 ) gives us the O ( (cid:96) 2 ) difference.
F P ROOF OF C LAIM 4.
We prove the claim by contradiction.
Suppose there exists f such that f ( x ) + f ( y ) =
g ( x, y ) for any x and y .
This implies that for any x , we have f ( x ) + f ( x ) =
g ( x, x ) = 0 .
It follows that f ( x ) =for any x .
Now consider some x and y
so that x (cid:54) =
y .
We must have f ( x ) + f ( y ) =
+ 0 = 0 .
However, g ( x, y ) (cid:54) = 0 because x (cid:54) =
y .
Hence, there exists x and y so that f ( x ) + f ( y ) (cid:54) =
g ( x, y ) .
We have reached a contradiction.
G E XPERIMENTS : D ATA AND T RAINING D ETAILS G. F ANTASTIC T REASURE : M AXIMUM V ALUE D IFFERENCE
Dataset generation.
In the dataset, we sample 50 , 000 training data, 5 , 000 validation data, and 5 , 000 test data.
For each model, we report the test accuracy with the hyperparameter setting that achieves the best validation accuracy.
In each training sample, the input universe consists oftreasures X 1 , ..., X 25 .
For each treasure X i , we have X i =
[ h 1 , h 2 , h 3 ] , where the location h 1 is sampled uniformly from [0 .. 20] 8 , the value h 2 is sample uniformly form [0 .. 100] , and the color his sampled uniformly from [1 .. 6] .
The task is to answer what the difference is in value between the most and least valuable treasure.
We generate the answer label y for a universe S as follows: we ﬁnd the the maximum difference in value among all treasures and set it to y .
Then we make the label y into one-hot encoding with 100 + 1 = 101 classes.
Hyperparameter setting.
We train all models with the Adam optimizer, with learning rate from 1 e − 3 , 5 e − 4 , and 1 e − 4 , and we decay the learning rate by 0 .
5 every 50 steps.
We use cross-entropy loss.
We train all models for 150 epochs.
We tune batch size of 128 and 64 .
For GNNs and HRN, we choose the hidden dimension of MLP modules from 128 and 256 .
For
DeepSet and MLP, we choose the hidden dimension of MLP modules from 128 , 256 , 2500 , 5000 .
For the MLP and DeepSet model, we choose the number of of hidden layers for MLP moduels from 4 and 8 , 16 .
For GNN and HRN, we set the number of hidden layers of the MLP modules to 3 , 4 .
Moreover, dropout with rate 0 .
5 is applied before the last two hidden layers of MLP 1 , i.e. , the last
MLP module in all models.
G. F ANTASTIC T REASURE : F URTHEST P AIR
Dataset generation.
In the dataset, we sample 60 , 000 training data, 6 , 000 validation data, and 6 , 000 test data.
For each model, we report the test accuracy with the hyperparameter setting that achieves the best validation accuracy.
In each training sample, the input universe consists oftreasures X 1 , ..., X 25 .
For each treasure X i , we have X i =
[ h 1 , h 2 , h 3 ] , where the location h 1 is sampled uniformly from [0 .. 20] 8 , the value h 2 is sample uniformly form [0 .. 100] , and the color h 3 is sampled uniformly from [1 .. 6] .
The task is to answer what are the colors of the two treasure that are the most distant from each other.
We generate the answer label y for a universe S as follows: we ﬁnd the pair of treasures that are the most distant from each other, say ( X i , X j ) .
Then we order the pair ( h 3 ( X i ) , h 3 ( X j )) to obtain an ordered pair ( a, b ) with a ≤ b (aka.
a = min { h 3 ( X i ) , h 3 ( X j ) } and ( b = max { h 3 ( X i ) , h 3 ( X j ) } ), where h 3 ( X i ) denotes the color of X i .
Then we compute the label y from ( a, b ) by counting how many valid pairs of colors are smaller than ( a, b ) (a pair ( k, l ) is smaller than ( a, b ) iff i).
k < a or ii).
k = a and l < b ).
The label y is one-hot encoding of the minimum cost with 6 × (6 − 1) / 2 + 6 = 21 classes.
Hyperparameter setting.
We train all models with the Adam optimizer, with learning rate from 1 e − 3 , 5 e − 4 , and 1 e − 4 , and we decay the learning rate by 0 .
5 every 50 steps.
We use cross-entropy loss.
We train all models for 150 epochs.
We tune batch size of 128 and 64 .
For the MLP and DeepSet model, we choose the number of of hidden layers of MLP modules fromand 8 , 16 .
For GNN and HRN models, we set the number of hidden layers of the MLP modules from 3 and 4 .
For DeepSet and MLP models, we choose the hidden dimension of MLP modules from 128 , 256 , 2500 , 5000 .
For GNNs and HRN, we choose the hidden dimension of MLP modules fromand 256 .
Moreover, dropout with rate 0 .
5 is applied before the last two hidden layers of MLP 1 , i.e. , the last MLP module in all models.
G. M ONSTER T RAINER
Task description.
We are a monster trainer who lives in a world S with 10 monsters.
Each monster
X =
[ h 1 , h 2 ] has a location h 1 ∈ [0 .. 10] 2 and a unique combat level h 2 ∈ [1 .. 10] .
In each game, the trainer starts at a random location with level zero, X trainer =
[ p 0 , 0] , and receives a quest to defeat the level- k monster.
At each time step, the trainer can challenge any more powerful monster
X , with a cost equal to the product of the travel distance and the level difference c ( X trainer , X ) = (cid:107) h
X trainer ) − h 1 ( X ) (cid:107) (cid:96) 1 × ( h 2 ( X ) −
h 2 ( X trainer )) .
After defeating monster X , the trainer’s level upgrades to h 2 ( X ) , and the trainer moves to h 1 ( X ) .
We ask the minimum cost of completing the quest, i.e. , defeating the level- k monster.
The range of cost (number of classes for prediction) is 200 .
To make games even more challenging, we sample games whose optimal solution involves defeating three to seven non-quest monsters.
A DP algorithm for shortest paths that needs half of the iterations of Bellman-Ford.
We provide a DP algorithm as the following.
To compute a shortest-path from a source object s to a target object t with at most seven stops, we run the following updates for four iterations: distance s [1][ u ] = cost ( s, u ) , distance s [ k ][ u ] = min v (cid:8) distance s [ k − 1][ v ] + cost ( v, u ) (cid:9) , (G.1) distance t [1][ u ] = cost ( u, t ) , distance t [ k ][
[Equation]
Update Eqn.
G.1 is identical to the Bellman-Ford algorithm Eqn. 4.2, and distance s [ k ][ u ] is the shortest distance from s to u with at most k stops.
Update Eqn.
G.2 is a reverse Bellman-Ford algorithm, and distance t [ k ][ u ] is the shortest distance from u to t with at most k stops.
After running
Eqn.
G.1 and Eqn.
G.2 for k iterations, we can compute a shortest path with at most 2 k stops by enumerating a mid-point and aggregating the results of the two Bellman-Ford algorithms:
[Equation]
Thus, this algorithm needs half of the iterations of Bellman-Ford .
Dataset generation.
In the dataset, we sample 200 , 000 training data, 6 , 000 validation data, and 6 , 000 test data.
For each model, we report the test accuracy with the hyperparameter setting that achieves the best validation accuracy.
In each training sample, the input universe consists of the trainer and 10 monsters X 0 , ..., X 10 , and the request level k , i.e. , we need to challenge monster k .
We have X i =
[ h 1 , h 2 ] , where h 1 =
i indicates the combat level, and the location h 2 ∈ [0 .. 10] 2 is sampled uniformly from [0 .. 10] 2 .
We generate the answer label y for a universe S as follows.
We implement a shortest path algorithm to compute the minimum cost from the trainer to monster k , where the cost is deﬁned in task description.
Then the label y is a one-hot encoding of minimum cost with 200 classes.
Moreover, when we sample the data, we apply rejection sampling to ensure that the minimum cost’s shortest path is of length 3 , 4 , 5 , 6 , 7 with equal probability.
That is, we eliminate the trivial questions.
Hyperparameter setting.
We train all models with the Adam optimizer, with learning rate from 2 e − 4 and 5 e − 4 , and we decay the learning rate by 0 .
5 every 50 steps.
We use cross-entropy loss.
We train all models for 300 epochs.
We tune batch size of 128 and 64 .
For the MLP model, we choose the number of layers from 4 and 8 , 16 .
For other models, we choose the number of hidden layers of MLP modules from 3 and 4 .
For GNN models, we choose the hidden dimension of MLP modules from 128 and 256 .
For DeepSet and MLP models, we choose the hidden dimension of MLP modules from 128 , 256 , 2500 .
Moreover, dropout with rate 0 .
5 is applied before the last two hidden layers of MLP 1 , i.e. , the last MLP module in all models.
G. S UBSET S UM
Dataset generation.
In the dataset, we sample 40 , 000 training data, 4 , 000 validation data, and 4 , 000 test data.
For each model, we report the test accuracy with the hyperparameter setting that achieves the best validation accuracy.
In each training sample, the input universe S consists ofnumbers X 1 , ..., X 6 , where each X i is uniformly sampled from [-200..200].
The goal is to decide if there exists a subset that sums up to 0 .
In the data generation, we carefully decrease the number of questions that have trivial answers: 1)we control the number of samples where 0 ∈ { X 1 , ..., X 6 } to be around 1% of the total training data; 2) we further control the number of samples where
X
+ ...
+ X 6 = 0 or ∃ i, j ∈ [1 .. 6]
so that X i = − X j to be around 1.5% of the total training data.
In addition, we apply rejection sampling to make sure that the questions with answer yes (aka.
such subset exists) and answer no (aka.
no such subset exists) are balanced ( i.e. , 20,000 samples for each class in the training data).
Hyperparameter setting.
We train all models with the Adam optimizer, with learning rate from 1 e − 3 , 5 e − 4 , and 1 e − 4 , and we decay the learning rate by 0 .
5 every 50 steps.
We use cross-entropy loss.
We train all models for 300 epochs.
The batch size we use for all models is 64 .
For DeepSets and MLP models, we choose the number of of hidden layers of the MLP modules from 4 , 8 , 16 .
For GNN and HRN models, we set the number of hidden layers of the last MLP modules to 4 .
For DeepSets and MLP, we choose the hidden dimension of MLP modules from 128 , 256 , 2500 , 5000 .
For GNN and HRN models, we choose the hidden dimension of MLP modules from 128 and 256 .
Moreover, dropout with rate 0 .
5 is applied before the last two hidden layers of MLP 1 , i.e. , the last MLP module in all models.
The model Neural Exhaustive Search (NES) enumerates all possible non-empty subsets τ of S , and passes the numbers of τ to an MLP, in a random order, to obtain the hidden feature.
The hidden feature is then passed to a single-direction one-layer LSTM of hidden dimension 128 .
Afterwards,
NES applies an aggregation function to these 2 6 − 1 hidden states obtained by the LSTM to obtain the ﬁnal output.
For NES, we set the number of hidden layers of the last MLP, i.e. , MLP 2 , to 4 , the number of hidden layers of the MLPs prior to the last MLP, i.e. , MLP 1 , to 3 , and we choose the hidden dimension of all MLP modules from 128 and 256 .