N EURAL E XECUTION OF G RAPH A LGORITHMS
Petar Veliˇckovi´c
DeepMind petarv@google com Raia Hadsell DeepMind
A BSTRACT
Graph Neural Networks (GNNs) are a powerful representational tool for solving problems on graph-structured inputs.
In almost all cases so far, however, they have been applied to directly recovering a ﬁnal solution from raw inputs, without explicit guidance on how to structure their problem-solving.
Here, instead, we focus on learning in the space of algorithms : we train several state-of-the-art GNN architectures to imitate individual steps of classical graph algorithms, parallel (breadth-ﬁrst search, Bellman-Ford) as well as sequential (Prim’s algorithm).
As graph algorithms usually rely on making discrete decisions within neighbourhoods, we hypothesise that maximisation-based message passing neural networks are bestsuited for such objectives, and validate this claim empirically.
We also demonstrate how learning in the space of algorithms can yield new opportunities for positive transfer between tasks—showing how learning a shortest-path algorithm can be substantially improved when simultaneously learning a reachability algorithm.
I NTRODUCTION
A multitude of important real-world tasks can be formulated as tasks over graph-structured inputs, such as navigation, web search, protein folding, and game-playing.
Theoretical computer science has successfully discovered effective and highly inﬂuential algorithms for many of these tasks.
But many problems are still considered intractable from this perspective.
Machine learning approaches have been applied to many of these classic tasks, from tasks with known polynomial time algorithms such as shortest paths (Graves et al., 2016;
Xu et al., 2019) and sorting (Reed & De Freitas, 2015), to intractable tasks such as travelling salesman (Vinyals et al., 2015; Bello et al., 2016; Kool et al., 2018), boolean satisﬁability (Selsam et al., 2018; Selsam & Bjørner, 2019), and even probabilistic inference (Yoon et al., 2018).
Recently, this work often relies on advancements in graph representation learning (Bronstein et al., 2017; Hamilton et al., 2017; Battaglia et al., 2018) with graph neural networks (GNNs)
(Li et al., 2015; Kipf & Welling, 2016; Gilmer et al., 2017;
Veliˇckovi´c et al., 2018).
In almost all cases so far, ground-truth solutions are used to drive learning, giving the model complete freedom to ﬁnd a mapping from raw inputs to such solution 1 .
Many classical algorithms share related subroutines : for example, shortest path computation (via the Bellman-Ford (Bellman, 1958) algorithm) and breadth-ﬁrst search both must enumerate sets of edges adjacent to a particular node.
Inspired by previous work on the more general tasks of program synthesis and learning to execute (Zaremba & Sutskever, 2014;
Kaiser & Sutskever, 2015;
Kurach et al., 2015; Reed & De Freitas, 2015; Santoro et al., 2018), we show that by learning several algorithms simultaneously and providing a supervision signal, our neural network is able to demonstrate positive knowledge transfer between learning different algorithms.
The supervision signal is driven by how a known classical algorithm would process such inputs (including any relevant intermediate outputs ), providing explicit (and reusable ) guidance on how to tackle graph-structured problems.
We call this approach neural graph algorithm execution .
Given that the majority of popular algorithms requires making discrete decisions over neighbourhoods (e.g. “which edge should be taken?” ), we suggest that a highly suitable architecture for this task is a message-passing neural network (Gilmer et al., 2017) with a maximisation aggregator—a claim we verify, demonstrating clear performance beneﬁts for simultaneously learning breadth-ﬁrst search for reachability with the Bellman-Ford algorithm for shortest paths.
We also verify its applicability to sequential reasoning, through learning Prim’s algorithm (Prim, 1957) for minimum spanning trees.
Note that our approach complements Reed & De Freitas (2015): we show that a relatively simple graph neural network architecture is able to learn and algorithmically transfer among different tasks, do not require explicitly denoting subroutines, and tackle tasks with superlinear time complexity.
P ROBLEM SETUP 2. G RAPH ALGORITHMS
We consider graphs G =
( V, E ) where V is the set of nodes (or vertices) and E is the set of edges (pairs of nodes).
We will consider graphs for two purposes: 1) as part of the task to be solved (e.g., the graph provided as input to breadth ﬁrst search), 2) as the input to a graph neural network.
A graph neural network receives a sequence of T ∈ N graph-structured inputs.
For each element of the sequence, we will use a ﬁxed G and vary meta-data associated with the nodes and edges of the graph in the input.
In particular, to provide a graph G =
( V, E ) as input to a graph neural network, each node i ∈ V has associated node features (cid:126)x ( t ) i ∈
R N x where t ∈ { 1 , . .
, T } denotes the index in the input sequence and N x is the dimensionality of the node features.
Similarly, each edge ( i,
j ) ∈
E has associated edge features (cid:126)e ( t ) ij ∈ R N e where N e is the dimensionality of the edge features.
At each step, the algorithm produces node-level outputs (cid:126)y ( t ) i ∈
R N y .
Some of these outputs may then be reused as inputs on the next step; i.e., (cid:126)x ( t +1) i may contain some elements of (cid:126)y ( t ) i .
2. L EARNING TO EXECUTE GRAPH ALGORITHMS
We are interested in learning a graph neural network that can execute one or more of several potential algorithms.
The speciﬁc algorithm to be executed, denoted A , is provided as an input to the network.
The structure of the graph neural network follows the encode-process-decode paradigm (Hamrick et al., 2018).
First we will describe the encode-process-decode architecture and then describe the speciﬁc parameterisations that are used for each sub-network.
The relation between the variables used by the graph algorithm and our neural algorithm executor setup is further illustrated in Figure 1.
For each algorithm A we deﬁne an encoder network f A .
It is applied to the current input features and previous latent features (cid:126)h ( t − 1) i (with (cid:126)h (0) i = (cid:126) 0 ) to produce encoded inputs , (cid:126)z ( t ) i , as such:
[Equation]
The encoded inputs are then processed using the processor network P .
The processor network shares its parameters among all algorithms being learnt.
The processor network takes as input the encoded inputs Z ( t ) =
{ (cid:126)z ti } i ∈ V and edge features E ( t ) =
{ (cid:126)e ( t ) ij } e ∈ E and produces as output latent node features, H ( t ) =
{ (cid:126)h ti ∈
[Equation]
} i ∈ V :
[Equation]
The node and algorithm speciﬁc outputs are then calculated by the decoder-network , g A :
[Equation]
Note that the processor network also needs to make a decision on whether to terminate the algorithm.
This is performed by an algorithm-speciﬁc termination network , T A , which provides the probability of termination τ ( t ) —after applying the logistic sigmoid activation σ —as follows:
[Equation]
where H ( t ) =|
V | (cid:80) i ∈
V (cid:126) h ( t ) i is the average node embedding.
If the algorithm hasn’t terminated (e.g. τ ( t ) > 0 . 5 ) the computation of Eqns.
1–4 is repeated—with parts of (cid:126)y ( t ) i potentially reused in (cid:126)x ( t +1) i .
~x ( t )~x ( t )~x ( t )~x ( t )~x ( t )~x ( t )~e ( t )~e ( t )~e ( t )~e ( t )~e ( t )~y ( t )~x ( t +1)~z ( t )~z ( t )~z ( t )~z ( t )~z ( t )~z ( t )~e ( t )~e ( t )~e ( t )~e ( t )~h ( t − 1)~h ( t )~y ( t )
In our experiments, all algorithm-dependent networks, f A , g A and T A , are all linear projections, placing the majority of the representational power of our method in the processor network P .
As we would like the processor network to be mindful of the structural properties of the input, we employ a graph neural network (GNN) layer capable of exploiting edge features as P .
Speciﬁcally, we compare graph attention networks (GATs) (Veliˇckovi´c et al., 2018).
(Equation 5, left) against message-passing neural networks (MPNNs) (Gilmer et al., 2017) (Equation 5, right):
[Equation]
( t ) ij (cid:17)
W (cid:126)z ( t ) j  
(cid:126)h ( t ) i = U   (cid:126)z ( t ) i , (cid:77) ( j,i ) ∈ E M (cid:16) (cid:126)z ( t ) i ,(cid:126)z ( t ) j ,(cid:126)e ( t ) ij (cid:17) (5) where W is a learnable projection matrix, a is an attention mechanism producing scalar coefﬁcients , while M and U are neural networks producing vector messages .
(cid:76) is an elementwise aggregation operator, such as maximisation, summation or averaging.
We use linear projections for M and U .
Note that the processor network P is algorithm-agnostic , and can hence be used to execute several algorithms simultaneously.
Lastly, we note that the setup also easily allows for including edge-level outputs, and graph-level inputs and outputs—however, these were not required in our experiments.
E XPERIMENTAL SETUP
Graph generation To provide our learner with a wide variety of input graph structure types, we follow prior work (You et al., 2018; 2019) and generate undirected graphs from seven categories:
• Ladder graphs; • 2D grid graphs; • Trees , uniformly randomly generated from the Prüfer sequence; • Erd˝os-Rényi (Erd˝os & Rényi, 1960) graphs, with edge probability min (cid:16)
[Equation]
V | [Equation] [Equation] ; • Barabási-Albert (Albert & Barabási, 2002) graphs, attaching either four or ﬁve edges to every incoming node; • 4-Community graphs—ﬁrst generating four disjoint Erd˝os-Rényi graphs with edge probability 0.7, followed by interconnecting their nodes with edge probability 0.01; • 4-Caveman (Watts, 1999) graphs, having each of their intra-clique edges removed with probability 0.7, followed by inserting 0 .
| V | additional shortcut edges between cliques.
We additionally insert a self-edge to every node in the graphs, in order to support easier retention of self-information through message passing.
Finally, we attach a real-valued weight to every edge, drawn uniformly from the range [0 . 2 , 1] .
These weight values serve as the sole edge features, e ( t ) ij , for x ( t ) i x ( t )
j x ( t ) u x ( t ) k min (cid:18) x
( t ) u , min ( v,u
) ∈
E x ( t ) v + e vu (cid:19) x
( t ) i + e ( t ) iu x ( t )
j + e ( t ) ju x
( t ) k
+ e ( t ) ku ~z ( t ) i ~z ( t )
j ~z ( t ) u ~z ( t ) k
U ~z ( t ) u ,
L ( v,u ) ∈
E M (cid:16) ~z ( t ) u ,~z ( t ) v ,~e ( t ) vu (cid:17)!
M (cid:16) ~z ( t ) u ,~z ( t ) i ,~e ( t ) iu (cid:17) M (cid:16) ~z ( t ) u ,~z ( t ) j ,~e ( t ) ju (cid:17)
M (cid:16) ~z ( t ) u ,~z ( t ) k ,~e ( t ) ku (cid:17) supervise
We aim to study the algorithm execution task from a “programmer” perspective: human experts may manually inspect only relatively small graphs, and any algorithms derived from this should apply to arbitrarily large graphs.
For each category, we generate 100 training and 5 validation graphs of only 20 nodes.
For testing, 5 additional graphs of 20, 50 and 100 nodes are generated per category.
Parallel algorithms
We consider two classical algorithms: breadth-ﬁrst search for reachability, and the Bellman-Ford algorithm (Bellman, 1958) for shortest paths.
The former maintains a single-bit value in each node, determining whether said node is reachable from a source node, and the latter maintains a scalar value in each node, representing its distance from the source node.
In both cases, the algorithm is initialised by randomly selecting the source node, s .
As the initial input to the algorithms, x (1) i , we have:
[Equation]
This information is then propagated according to the chosen algorithm: a node becomes reachable from s if any of its neighbours are reachable from s , and we may update the distance to a given node as the minimal way to reach any of its neighbours, then taking the connecting edge:
BFS
[Equation]
otherwise
[Equation]
For breadth-ﬁrst search, no additional information is being computed, hence y ( t ) i = x
[Equation]
t
[Equation]
1) i . Additionally, at each step the Bellman-Ford algorithm may compute, for each node, the “predecessor” node, p ( t ) i in the shortest path (indicating which edge should be taken to reach this node).
This information is ultimately used to reconstruct shortest paths, and hence represents the crucial output:
[Equation]
Hence, for Bellman-Ford, (cid:126)y ( t )
i
[Equation]
i (cid:107) x
( t +1)
i , where (cid:107) is concatenation.
To provide a numerically stable value for + ∞ , we set all such entries to the length of the longest shortest path in the graph + 1.
We learn to execute these two algorithms simultaneously —at each step, concatenating the relevant (cid:126)x ( t ) i and (cid:126)y ( t ) i values for them.
As both of the algorithms considered here (and most others) rely on discrete decisions over neighbourhoods, learning to execute them should be naturally suited for the
MPNN with the max-aggregator—a claim which we directly verify in the remainder of this section.
Sequential algorithms Unlike the previous two algorithms, single iterations of many classical graph algorithms will speciﬁcally focus on one node at a time—very often the case with constructive tasks.
We seek to demonstrate that our neural graph algorithm execution paradigm aligns well with this setting too, and in this context we study Prim’s algorithm (Prim, 1957) for minimum spanning trees.
Prim’s algorithm maintains a partially constructed minimum spanning tree (MST)—initially, it is a singleton tree consisting of only a source node, s .
At each step, Prim’s algorithm searches for a new node to connect to the MST—chosen so that the edge attaching it to the tree is the lightest possible:
[Equation]
Once the new node is selected, the algorithm attaches it to the MST via this edge—similarly to
Bellman-Ford, we can keep track of predecessor nodes , p ( t ) i :
[Equation]
otherwise
[Equation]
In Equations 9–10, the boxed updates are the only modiﬁcations to the state of the algorithm at step t — centering only on the selected node to attach to the MST.
Once again, the algorithm requires discrete decisions based on neighbourhood edge weights, hence we expect outperformance of MPNN-max.
For a visualisation of the expected alignment between a graph algorithm and our neural graph executors, refer to Figure 2.
We provide an overview of all of the inputs and supervision signals used here for the executor in Appendix A.
Neural network architectures To assess the comparative beneﬁts of different architectures for the neural algorithm execution task, we consider many candidate networks executing the computation of Equations 1–5, especially the processor network P :
For the MPNN update rule, we consider maximisation, mean and summation aggregators.
For the GAT update rule, we consider the originally proposed attention mechanism of Veli ˇ ckovi ´ c et al.
(2018), as well as Transformer attention (Vaswani et al., 2017); Additionally for GAT, we consider also attending over the full graph —adding a second attention head, only acting on the non-edges of the graph (and hence not accepting any edge features).
The two heads’ features are then concatenated and passed through another linear layer.
Analogously to our expectation that the best-performing MPNN rule will perform maximisation, we attempt to force the attentional coefﬁcients of GAT to be as sharp as possible—applying either an entropy penalty to them (as in Ying et al.
or the Gumbel softmax trick (Jang et al., 2016).
We perform an additional sanity check to ensure that a GNN-like architecture is necessary in this case.
Prior work (Xu et al., 2019) has already demonstrated the unsuitability of MLPs for reasoning tasks like these, and they will not support variable amounts of nodes.
Here, instead, we consider an
LSTM (Hochreiter & Schmidhuber, 1997) architecture into which serialised graphs are fed (we use an edge list, in a setup similar to (Graves et al., 2016)).
In all cases, the neural networks compute a latent dimension of K = 32 features, and are optimised using the Adam SGD optimiser (Kingma & Ba, 2014) on the binary cross-entropy for the reachability predictions, mean squared error for the distance predictions, categorical cross-entropy for the predecessor node predictions, and binary cross-entropy for predicting termination (all applied simultaneously).
We use an initial learning rate of 0.0005, and perform early stopping on the validation accuracy for the predecessor node (with a patience of 10 epochs).
If the termination network T A does not terminate the neural network computation within | V | steps, it is assumed terminated at that point.
[Table] [Table] For Prim’s algorithm, as only one node at a time is updated
[Table]
we optimise the categorical cross-entropy of predicting the next node, masked across all the nodes not added to the MST yet.
It should be noted that, when learning to execute Bellman-Ford and Prim’s algorithms
[Table]
the prediction of p ( t ) i is performed by scoring each node-pair using an edge-wise scoring network (a neural network predicting a scalar score from (cid:126)h ( t ) i (cid:107) (cid:126)h ( t ) j (cid:107) (cid:126)e ( t ) ij ), followed by a softmax over all neighbours of i [Table]
R ESULTS AND DISCUSSION
Parallel algorithm execution
In order to evaluate how faithfully the neural algorithm executor replicates the two parallel algorithms, we propose reporting the accuracy of predicting the reachability 2 (for breadth-ﬁrst search; Table 1), as well as predicting the predecessor node (for Bellman-Ford;
Table 2).
We report this metric averaged across all steps t (to give a sense of how well the algorithm is imitated across time), as well as the last-step performance (which corresponds to the ﬁnal solution).
While it is not necessary for recovering the ﬁnal answer, we also provide the mean squared error of the models on the Bellman-Ford distance information, as well as the termination accuracy (computed at each step separately)—averaged across all timesteps—in Table 3.
The results conﬁrm our hypotheses: the MPNN-max model exhibits superior generalisation performance on both reachability and shortest-path predecessor node prediction.
Even when allowing for hardening the attention of GAT-like models (using entropy or Gumbel softmax), the more ﬂexible [Table] [Table] computational model of MPNN is capable of outperforming them.
The performance gap on predicting the predecessor also widens signiﬁcantly as the test graph size increases.
Our ﬁndings are compounded by observing the mean squared error metric on the intermediate result: with the MPNN-max being the only model providing a reasonable level of regression error at the 100node generalisation level.
It further accentuates that, even though models like the MPNN-sum model may also learn various thresholding functions—as demonstrated by (Xu et al., 2018)—aggregating messages in this way can lead to outputs of exploding magnitude, rendering the network hard to numerically control for larger graphs.
We perform two additional studies, executing the shortest-path prediction on MPNN-max without predicting reachability , and without supervising on any intermediate algorithm computations —that is, learning to predict predecessors (and termination behaviour) directly from the inputs, x (1) i .
Note that this is the primary way such tasks have been tackled by graph neural networks in prior work.
We report these results as no-reach and no-algo in Table 2, respectively.
Looking at the no-reach ablation, we observe clear signs of positive knowledge transfer occurring between the reachability and shortest-path tasks: when the shortest path algorithm is learned in isolation, the predictive power of MPNN-max drops signiﬁcantly (while still outperforming many other approaches).
In Appendix B, we provide a brief theoretical insight to justify this.
Similarly, considering the no-algo experiment, we conclude that there is a clear beneﬁt to supervising on the distance information—giving an additional performance improvement compared to the standard approach of only supervising on the ﬁnal downstream outputs.
Taken in conjunction, these two results provide encouragement for studying this particular learning setup.
Lastly, we report the performance of a curriculum learning (Bengio et al., 2009) strategy (as curriculum ): here, BFS is learnt ﬁrst in isolation (to perfect validation accuracy), followed by ﬁnetuning on Bellman-Ford.
We ﬁnd that this approach performs worse than learning both algorithms simultaneously, and as such we do not consider it in further experiments.
Desirable properties of the MPNN-max as an algorithm executor persist when generalising to even larger graphs, as we demonstrate in Table 4—demonstrating favourable generalisation on graphs up to 75 × as large as the graphs originally trained on.
We note that our observations also still hold
[Table]
when training on larger graphs (Appendix C). We also ﬁnd that there is no signiﬁcant overﬁtting to a particular input graph category—however we do provide an in-depth analysis of per-category performance in Appendix D.
Additional metrics
The graphs we generate may be roughly partitioned into two types based on their local regularity —speciﬁcally, the ladder, grid and tree graphs all exhibit regular local structure, while the remaining four categories are more variable.
As such, we hypothesise that learning from a graph of one such type only will exhibit better generalisation for graphs of the same type.
We verify this claim in Table 5, where we train on either only Erd˝os-Rényi graphs or trees of 20 nodes, and report the generalisation performance on 100-node graphs across the seven categories.
The results directly validate our claim, implying that the MPNN-max model is capable of biasing itself to the structural regularities found in the input graphs.
Despite this bias, the model still achieves generalisation performances that outperform any other model, even when trained on the full dataset.
Further, we highlight that our choices of aggregation metrics may not be the most ideal way to assess performance of the algorithm executors: the last-step performance provides no indication of faithfulness to the original algorithm, while the mean-step performance may be artiﬁcially improved by terminating the algorithm at a latter point.
While here we leave the problem of determining a better single-number metric to future work, we also decide to compound the results in Tables 1–2 by also plotting the test reachability/predecessor accuracies for each timestep of the algorithm individually (for 100-node graphs): refer to Figure 3.
Such visualisations can help identify cases where neural executors are “cheating”, by e.g. immediately predicting every node is reachable: in these cases, we can see a characteristic—initially weak but steadily improving—performance curve.
It also further solidiﬁes the outperformance of MPNN-max.
Lastly, in Appendix E we apply the recently proposed GNNExplainer (Ying et al., 2019) model to detecting which graph substructures contributed the most to certain predictions.
Sequential algorithm execution We demonstrate results for all considered architectures on executing Prim’s algorithm within Table 6.
We provide the accuracy of predicting the next MST node
[Table]
(computed against the algorithm’s “ground-truth” ordering), as well as the accuracy of reconstructing the ﬁnal MST (via the predecessors)
[Table]
As anticipated
[Table]
our results once again show strong generalisation outperformance of MPNN-max.
We additionally compared against a non-sequential version ( no-algo ), where the MPNN-max model was trained to directly predict predecessors (without requiring sequentially chosing nodes).
This resulted in poor generalisation to larger graphs, weaker than even the LSTM sequential baseline
[Table]
The insights from our setup verify that our neural graph execution paradigm is applicable to sequential algorithm execution as well—substantially expanding its range of possible applications.
C ONCLUSIONS
In this manuscript we have presented the neural graph algorithm execution task, where—unlike prior approaches—we optimise neural networks to imitate individual steps and all intermediate outputs of classical graph algorithms, parallel as well as sequential.
Through extensive evaluation—especially on the tasks of reachability, shortest paths and minimum spanning trees—we have determined a highly suitable architecture in maximisation-based message passing neural networks and identiﬁed clear beneﬁts for multi-task learning and positive transfer, as many classical algorithms share related subroutines.
We believe that the results presented here should serve as strong motivation for further work in the area, attempting to learn more algorithms simultaneously and exploiting the similarities between their respective subroutines whenever appropriate
A S UMMARY OF ALGORITHM INPUTS AND SUPERVISION SIGNALS
To aid clarity, within Table 7, we provide an overview of all the inputs and outputs (supervision signals) for the three algorithms considered here (breadth-ﬁrst search, Bellman-Ford and Prim).
B T HEORETICAL INSIGHTS
We provide a brief theoretical insight into why learning to imitate multiple algorithms simultaneously may provide beneﬁts to downstream predictive power.
Our insight comes from an information-theoretic perspective.
Consider two algorithms, A and B , that both operate on the same input, x , and produce outputs y A and y B , respectively.
We consider the task of learning to execute A (that is, predicting y A from x ), with and without y B provided 3 .
We operate on the further assumption that A and B share subroutines —implying that, knowing x , there is information content preserved between y A and y B .
Formally, we say that the conditional mutual information of the corresponding random variables, I ( Y A ; Y B | X ) , is positive .
Expanding out the expression for I ( Y A ; Y B | X ) , denoting Shannon entropy by H , we obtain:
[Equation]
As I ( Y A ; Y B | X ) > 0 , we conclude H ( Y A | X ) >
H ( Y A | Y B , X ) ; therefore, providing y B upfront strictly reduces the information-theoretic uncertainty in y A , thus making it potentially more suitable for being learned by optimisation techniques.
C L ARGER - SCALE STUDIES
To investigate the models’ behaviour when generalising to larger graphs, we conduct experiments for executing the two parallel algorithms (BFS and Bellman-Ford) when training on graphs withnodes, and testing on graphs with 1000 nodes, as reported in Table 8.
These results further solidify the outperformance of MPNN-based models, even outside of the studied “programmer” regime.
D P ERFORMANCE PER GRAPH TYPE
As our training and testing graphs come from a speciﬁc set of seven categories, it is natural to study the predictive power of the model conditioned on the testing category.
Firstly, in Table 9, we provide
[Table] [Table]
the per-category results of predicting reachability and predecessor for MPNN-max.
We report that the performance is roughly evenly distributed across the categories—with trees being the easiest to learn on and grids/community graphs the hardest.
These results align well with our expectations:
• In trees, computing the shortest path tree is equivalent to a much simpler task— rooting the input tree in the source vertex—that a model may readily pick up on.
• Making proper choices on grids requires propagating decisions over long trajectories 4 —as such, a poor decision early on may more strongly compromise the overall performance of retrieving the shortest path tree.
• As the community graphs are composed of four interconnected dense graphs (Erd ˝ os-Rényi with p = 0 .
7 ), the node degree distribution the model is required to handle may change drastically as graphs increase in size.
This may require the model to aggregate messages over substantially larger neighbourhoods than it is used to during training.
E E XPLAINING GNN P REDICTIONS
We provide a further qualitative analysis of what the MPNN-max architecture has learnt when performing algorithm execution.
In particular, we apply a model similar to GNNExplainer (Ying et al., 2019) for explaining the decisions made during the neural execution.
For the reachability task, the explainer asnwers the question: “for a given node u , which node in the neighbourhood of u inﬂuences the reachability prediction made by the neural execution model?” .
We use the best performing model, MPNN-max, to demonstrate the explanation.
Given an already trained model on graphs with 20 nodes, starting from any node u of the neural execution sequence, we optimise for an adjacency mask M , that is initialized to 1 for all edges that connect to u , and 0 everywhere else.
Instead of the original adjacency matrix A , we use A (cid:12) σ ( M ) as the input adjacency to the model.
We ﬁx the model parameters and only train on the adjacency mask using the same reachability loss, with the additional term of the sum of values in the adjacency mask.
This encourages the explanation to remove as many edges as possible from the immediate neighbourhood of u , while still being able to perform the correct reachability updates.
When the mask is trained until convergence, we pick the edge that has the maximum weight in the mask to be the predecessor that explains the reachability of the node.
We then perform the same explanation procedure on the ground-truth predecessor of u in the BFS algorithm, and continue the process until we reach the source node, s of the BFS algorithm.
If all explanations are correct, we will observe a path that connects the node u to the starting node of the
BFS algorithm.
Any disconnection indicates an incorrect explanation that deviates from the groundtruth, which could either be due to the incorrect prediction of the model, or an incorrect explanation.
Using the standard training dataset in our experiments, we observe that 82 .
16% of the instances have a path explanation with no error in the explanation compared to the ground-truth predecessors.
Two of these examples are visualised in Figure 4.
Additionally, 93 .
85% of the predecessor explanation correspond to the ground-truth, providing further qualitative insight into the algorithm execution capacity of MPNN-max.