Title: HIERARCHICAL GRAPH MATCHING NETWORKS FOR DEEP GRAPH SIMILARITY LEARNING Anonymous authors Paper under double-blind review

Abstract: While the celebrated graph neural networks yield effective representations for individual nodes of a graph, there has been relatively less success in extending to deep graph similarity learning. Recent work has considered either global-level graph-graph interactions or low-level node-node interactions, ignoring the rich cross-level interactions between parts of a graph and a whole graph. In this paper, we propose a Hierarchical Graph Matching Network (HGMN) for computing the graph similarity between any pair of graph-structured objects. Our model jointly learns graph representations and a graph matching metric function for computing graph similarity in an end-to-end fashion. The proposed HGMN model consists of a multi-perspective node-graph matching network for effectively learning crosslevel interactions between parts of a graph and a whole graph, and a siamese graph neural network for learning global-level interactions between two graphs. Our comprehensive experiments demonstrate that our proposed HGMN consistently outperforms state-of-the-art graph matching network baselines for both classification and regression tasks.

1. INTRODUCTION:

Learning a general similarity metric between arbitrary pairs of graph-structured objects is one of the key challenges in machine learning. Such learning problems often arise in a variety of applications, ranging from graph similar searching in graph-based database (Yan & Han, 2002) , to Fewshot 3D Action Recognition (Guo et al., 2018) , unknown malware detection (Wang et al., 2019) , and promising selection in automatic theory proving (Wang et al., 2017) , to name just a few.

Conceptually, classical exact (or inexact) graph matching techniques (Ullmann, 1976; Caetano et al., 2009; Bunke & Allermann, 1983; Riesen et al., 2010) provide a strong tool for learning graph similarity. However, these methods usually either require input graphs with similar sizes or consider mainly the graph structures for finding a correspondence between the nodes of different graphs without taking into account the node representations or features. In contrast, in this paper, we consider the graph matching problem of learning a mapping between a pair of graph inputs pG 1 , G 2 q P G ˆG and the similarity score y P Y, based on a set of training triplet of structured input pairs and scalar output score pG 1 1 , G 2 1 , y 1 q, ..., pG 1 n , G 2 n , y n q P G ˆG ˆY drawn from some fixed but unknown probability distribution.

Recent years have seen a surge of interests in graph neural networks (GNNs), which have been demonstrated to be a powerful class of models for learning node embeddings of graph-structured data (Bronstein et al., 2017) . Various GNN models have since been developed for learning effective node representations for node classification (Li et al., 2016; Kipf & Welling, 2016; Hamilton et al., 2017; Veličković et al., 2017) , or pooling the learned node embeddings into a graph vector for graph classification (Ying et al., 2018; Ma et al., 2019) , or combining with variational auto-encoder to learn the graph distribution for graph generation (Simonovsky & Komodakis, 2018; Li et al., 2018; Samanta et al., 2018; You et al., 2018) . However, there is relatively less study on learning graph similarity using GNNs.

To learn graph similarity, a simple yet straightforward way is to encode each graph as a vector and combine two vectors of each graph to make a decision. This approach is useful since graphlevel embeddings contain important information of a pair of graphs. One obvious limitation of this approach lies in the fact of the ignorance of more fine-grained interactions among different level embeddings of two graphs. Very recently, a few of attempts have been made to take into account lowlevel interactions either by considering the histogram information of node-wise similarity matrix of node embeddings (Bai et al., 2019) or improving the node embeddings of one graph by incorporating implicit attentive neighbors of another graphs through a soft attention (Li et al., 2019) . However, there are two significant challenges making these graph matching models potentially ineffective: i) how to learn different-level granularity (global level and local level) of interactions between a pair of graphs; ii) how to effectively learn richer cross-level interactions between parts of a graph and a whole graph.

Inspired by these observations, in this paper, we propose a Hierarchical Graph Matching Network (HGMN) for computing the graph similarity between any pair of graph-structured objects. Our model jointly learns graph representations and a graph matching metric function for computing graph similarity in an end-to-end fashion. The proposed HGMN model consists of a novel multiperspective node-graph matching network for effectively learning cross-level interactions between parts of a graph and a whole graph, and a siamese graph neural network for learning global-level interactions between two graphs. Our final small prediction networks consume these feature vectors from both cross-level and global-level interactions to perform either graph-graph classification or graph-graph regression tasks, respectively.

Recently proposed works only compute graph similarity by considering either graph-graph classification problem (with labels Y " t´1, 1u) (Li et al., 2019) , or graph-graph regression problem (with similarity score Y " r0, 1s) (Bai et al., 2019) . To demonstrate the effectiveness of our model, we systematically investigate the performance of our HGMN model compared with these recently proposed graph matching models on four datasets for both graph-graph classification and regression tasks. To bridge the gap of the lack of standard graph matching datasets, we also create one new dataset from a real application together with a previously released dataset by (Xu et al., 2017) for graph-graph classification task1 . One important aspect is previous works did not consider the impact of the size of two input graphs, which often plays an important role in determining the performance of graph matching. Motivated by this observation, we have considered three different ranges of graph sizes from [3, 200] , [20, 200] , and [50, 200] in order to evaluate the robustness of each graph matching model. We highlight our main contributions of this paper as follows:

• We propose a hierarchical graph matching network (HGMN) for computing the graph similarity between any pair of graph-structured objects. Our HGMN model jointly learns graph representations and a graph matching metric function for computing graph similarity in an end-to-end fashion. • In particular, we propose a multi-perspective node-graph matching network for effectively capturing the cross-level interactions between a node embeddings of a graph and a corresponding attentive graph-level embedding of another graph. • We systematically investigate different factors on the performance of all graph matching models such as the impact of different tasks (classification and regression) and the sizes of input graphs. • Our comprehensive experiments demonstrate that our proposed HGMN consistently outperforms state-of-the-art graph matching network baselines for both classification and regression tasks. Compared with previous works, our proposed model HGMN is also more robust when the sizes of the two input graphs increase.

2. PROBLEM FORMULATION:

In this section, we briefly introduce the problem formulation. Given a pair of graph inputs pG 1 , G 2 q, the aim of the graph matching problem we consider in this paper is to produce a graph similarity score y " spG 1 , G 2 q P Y. The graph G 1 " pV 1 , E 1 q is represented as a set of N nodes v i P V 1 with a feature matrix X 1 P R N ˆd, edges pv i , v j q P E 1 (binary or weighted) formulating an adjacency matrix A 1 P R N ˆN , and a degree matrix D 1 ii " pV 2 , E 2 q is represented as a set of M nodes v i P V 2 with a feature matrix X 2 P R M ˆd, edges pv i , v j q P E 2 (binary or weighted) formulating an adjacency matrix A 2 P R M ˆM , and a degree matrix D 2

ř j A 1 ij . Similarly, the graph G 2 " GCN GCN 𝛼 "# =𝑓 % (ℎ " ( , ℎ # * ) 𝑣 " 𝑣 # 𝑓 - . ℎ / = 1 # ∈3 𝛼 "# ℎ # ℎ # 4 ℎ # 𝑓 -

ii "

ř j A 2 ij .

Note that, when performing graph-graph classification task the scalar y is the class labels y " t´1, 1u; when performing graph-graph regression task the scalar y is the the measure of the similarity score y P r0, 1s. We train a graph matching model based on a set of training triplet of structured input pairs and scalar output score pG 1 1 , G 2 1 , y 1 q, ..., pG 1 n , G 2 n , Y n q P G ˆG ˆY drawn from some fixed but unknown probability distribution in real applications.

3. HIERARCHICAL GRAPH MATCHING NETWORKS ARCHITECTURE:

In this section, we will introduce two key components of our HGMN architecture -Siamese Graph Neural Networks (SGNN) and Multi-Perspective Node-Graph Matching Networks (MPNGMN). We first discuss SGNN for learning the global-level interactions between two graphs and then outline MPNGMN for effectively learning the cross-level node-graph interactions between parts of one graph and one whole graph. Our overall model architecture for HGMN is shown in Fig. 1 .

3.1. SGNN FOR GLOBAL-LEVEL INTERACTION LEARNING:

The graph-level embeddings contain important information of a graph. Therefore, learning graphlevel interactions between two graphs could be an important component for learning the graph similarity of two graphs. In order to capture the global-level interactions between two graphs, we employ SGNN which is based on Siamese Networks architecture (Bromley et al., 1994) , which has achieved great success in many applications such as visual recognition (Bertinetto et al., 2016; Varior et al., 2016) and sentence similarity (He et al., 2015; Mueller & Thyagarajan, 2016) . Independently, a similar idea using high-order siamese graph neural networks was presented for brain network analysis (Chaudhuri et al., 2019) .

Our SGNN adapts popular Graph Convolution Networks (GCN) (Kipf & Welling, 2016) with siamese neural networks for simplicity. Other variants of graph neural networks such as Graph-SAGE (Hamilton et al., 2017) and Gated Graph Neural Networks (Li et al., 2016) can also be used. Our SGNN consists of three components: 1) node embedding layers; 2) graph-level embedding aggregation layers; 3) graph-graph matching and prediction layers.

Node Embedding Layers. We utilize three-layer GCN with the siamese networks to generate node embeddings H l " th l i u tN,M u i"1 P R tN,M uˆd 1 of both graphs G 1 and G 2 ,

EQUATION

where s A l " p r D l q ´1 2 r A l p r D l q ´1 2 is the normalized Laplacian matrix for r A l " A l `ItN,Mu depending on the graph is G 1 or G 2 , and W piq , i " t0, 1, 2u are hidden weighted matrices for each layer. Note that the twin networks share the parameters of GCN when training on the pair of graphs pG 1 , G 2 q. The number of GCN layers required depends on the real application graph data. To isolate the effect of overtuning, we choose the three layers after some initial experiments on validation sets.

Graph-level Embedding Aggregation Layers. After we compute the resulting node embeddings H l of each graph from GCN, we need to aggregate these node embeddings to formulate their corresponding graph-level embeddings of each graph.

EQUATION

We employ different aggregation functions such as element-wise max pooling (Max), elementwise max pooling following a transformation by applying a fully connected layer on H i (FCMax), element-wise mean pooling (Avg), element-wise mean pooling following a transformation by applying a fully connected layer on H i (FCAvg), and a sophisticated aggregator based on LSTM architecture (Hochreiter & Schmidhuber, 1997a) . Note that, among these aggregation functions, the LSTM aggregator is not permutation invariant on a set of node embeddings although LSTM may admit more expressive ability. We adapt LSTMs to operate on these node embeddings by simply applying the LSTMs to a random permutation of the node embeddings.

Graph-Graph Matching and Prediction Layers. After the graph-level embeddings h 1 G and h 2 G are computed for the graphs G 1 and G 2 , we then use the resulting graph embeddings to compute the graph similarity score of pG 1 , G 2 q. Depending on the specific tasks, we have slightly different ways to calculate the final similarity score. For classification tasks, we simply compute the cosine similarity of two graph-level embeddings,

r y " spG 1 , G 2 q " cosineph 1 G , h 2 G q (3)

where the similarity function s could also be other similarity metric such as Euclidean similarity and dot-product similarity. We find that the cosine similarity function performs generally better across different datasets.

For regression tasks, we first concatenate the two aggregated graph embeddings to rh 1 G , h 2 G s and then employ four standard fully connected layers to gradually project the vector of dimension rh 1 G , h 2 G s down to a scalar of the dimension 1. Since the expected similar score r y should be in range of [0,1], we perform sigmoid function to enforce the final score in this range. We therefore compute the similarity score for graph-graph regression task as following,

EQUATION

For both tasks, we train the SGNN model using mean square error loss function to compare the computed similarity score r y with the groud-truth similarity score y,

L " 1 n n ÿ i"1

´r y ´y¯2 .

(5)

3.2. MPNGMN FOR CROSS-LEVEL NODE-GRAPH INTERACTION LEARNING:

Although global-level interaction learning could capture the important structural and feature information of two graphs to some extent, it is not enough to capture all important information of two graphs since they ignore other low-level interactions between parts of two graphs. In particular, existing works have considered either global-level graph-graph interactions or low-level node-node interactions, ignoring the rich cross-level interactions between parts of a graph and a whole graph.

Inspired by these observations, we propose a novel multi-perspective node-graph matching network to effectively learn the cross-level interaction features. Our MPNGMN model consists of four parts: 1) node embedding layers; 2) node-graph matching layers; 3) aggregation layers; and 4) prediction layers, as shown in Fig. 1 . We will illustrate each part in details as follows.

Node Embedding Layers: Similar as described in Sec. 3.1, we choose to employ the three-layer GCN to generate node embeddings

H 1 " th 1 i u N i"1 P R N ˆd1 and H 2 " th 2 i u M i"1 P R M ˆd1

for graphs G 1 and G 2 . Conceptually, the node embedding layers of MPNGMN (graph encoder) could be chosen to be an independent GCN or a shared GCN with SGNN. As shown in Fig. 1 , our MP-NGMN shares the same graph encoder with SGNN due to two reasons: i) the shared GCN parameters reduce the number of parameters by half, which helps mitigate possible overfitting; ii) the shared GCN maintains the consistency of resulting node embeddings for both MPNGMN and SGNN, potentially leading to more aligned global-level interaction and cross-level interaction features. After the node embeddings H 1 and H 2 have been computed, they will be fed into the following nodegraph matching layers.

Node-Graph Matching Layers: The node-graph matching layer is the key part of our MPNGMN, which can effectively learn the cross-level interactions between parts of a graph and a whole graph. There are generally two steps for this layer: i) calculate the graph-level embedding of a graph; ii) compare the node embeddings of a graph with the associated graph-level embeddings of a whole graph and then produce a similarity feature vector. A simple way to obtain the graph-level embedding of a graph is to perform element-wise mean pooling or max pooling. However, it does not consider any information from the node embedding that the resulting graph-level embedding will compare with later. To build more tight interactions between the two, we calculate the cross-graph attention coefficients between the node v i P V 1 in graph G 1 and all other nodes v j P V 2 in graph G 2 . Similarly, we calculate the cross-graph attention coefficients between the node v i P V 2 in graph G 2 and all other nodes v j P V 1 in graph G 1 . These two cross-graph attention coefficients can be computed independently,

EQUATION

where f s is the attention function for computing the similarity score. For simplicity, we use cosine function in our experiments but other similarity metrics can be adopted as well. Then we compute the attentive graph-level embeddings r h 1 G or r h 2 G P R d 1 using weighted average of node embeddings of the other graph,

EQUATION

Next, we define our multi-perspective matching function f m to compute the similarity feature vector by comparing two vectors as follows,

EQUATION

where r h P R r d is a r d-dimension similarity feature vector, and W m " tw i u r d

i"1 P R d 1 ˆr d is a trainable weight matrix and each w i represents a perspective with total r d number of perspectives. Notably, f m could be any similarity function and we use cosine similarity metric in our experiments. It is worth noting that the proposed multi-perspective matching function essentially shares similar spirit with multi-head attention (Vaswani et al., 2017) , with the difference that multi-head attention uses r d number of weighted matrices instead of vectors.

Therefore, we can utilize our defined multi-perspective matching function f m to compare the j-th node embeddings of a graph with the corresponding attentive graph-level embeddings to capture the cross-level node-graph interactions. The resulting similarity feature vectors r h

1 j or r h 2 j P R r d (w.r.t the node v j in either graph G 1 or G 2 ) can thus be computed by r h 1 j " f m ph 1 j , r h 2 G , W m q, j P V 1 and r h 2 j " f m ph 2 j , r h 1 G , W m q, j P V 2 (9)

After the node-graph matching layers, these newly produced interaction feature matrices r

H 1 " t r h 1 i u N i"1 P R N ˆr d and r H 2 " t r h 2 i u M i"1 P R M ˆr d

for graphs G 1 and G 2 , are ready to feed them into the aggregation layers.

Aggregation Layers: To aggregate these cross-level interaction feature matrix from the node-graph matching layer, we employ the BiLSTM (Hochreiter & Schmidhuber, 1997b) model to aggregate the unordered feature embeddings,

EQUATION

where r h l G P R 2 r d concatenate the last hidden vectors of two directions as the aggregated graph embedding for each graph G 1 and G 2 . Note that other commutative aggregators such as max, average, or attention based aggregation (Veličković et al., 2017) can also be used. However, our extensive experiments showed that BiLSTM aggregator achieved consistent better performance over other aggregators. Similar LSTM-type aggregator has also been exploited in the previous works (Hamilton et al., 2017; Zhang et al., 2019) .

Prediction Layers: After the aggregated graph embeddings r h 1 G and r h 2 G are obtained, we then use these two embeddings to compute the similarity score of pG 1 , G 2 q. As discussed in Sec.3.1 for graph-graph matching and prediction layers, we use the same prediction layers to predict the similarity score. We also use the same mean square error loss function for the model training. In this way, we can also easily compare the performance difference between SGNN and MPNGMN.

3.3. DISCUSSIONS ON HGMN MODEL:

Our model jointly learns graph representations and a graph matching metric function for computing graph similarity in an end-to-end fashion. Our HGMN model combines the advantages of both SGNN and MPNGMN to capture both global-level graph-graph interaction features and novel crosslevel node-graph interaction features between two graphs. Therefore, for final prediction layers of HGMN, we have total six aggregated graph embedding vectors where two of them are h 1 G and h 2 G from SGNN, and another four are r h 1 G and r h 2 G from MPNGMN. The computation complexity of SGNN is Opp|E 1 | `|E 2 |qdd 1 q, where the most dominant computation is sparse matrix-matrix operations in equation 1. Similarly, the computational complexity of MPNGMN is OpN M d `pN `M qd 1 `pN `M qdd 1 q, where the most computationally extensive operations are in equations 7, 8, and 9. Compared to recently proposed works in (Bai et al., 2019; Li et al., 2019) , the computational complexity of them are comparable.

4. EXPERIMENTS:

In this section, we systematically investigate the performance of our HGMN model compared with other recently proposed graph matching models on four datasets for both classification and regression tasks. Classification datasets: we evaluate our model on the problem of detecting similarity between two binary functions, which is the heart of many binary security problems, such as software plagiarism, malware detection, and vulnerability search (Feng et al., 2016; Xu et al., 2017; Ding et al., 2019) .

In particular, two binary functions that are compiled from the same source code but under different settings (architectures, compilers, optimization levels, etc) are semantically similar to each other.

To learn similarity from binary functions, we represent those binaries with control flow graphs, in which the graph nodes represent the basic blocks (a basic block is a sequence of instructions without jumps) and edges represent control flow paths between these basic blocks.

Thus, detecting similarity between two binary functions can be cast as the problem of learning the similarity score spG 1 , G2 q between two control flow graphs G 1 and G 2 , where spG 1 , G 2 q " `1 indicates G 1 and G 2 are similar; otherwise spG 1 , G 2 q " ´1 indicates dissimilar. We prepare two benchmark datasets generated from two pieces of popular open-source software: FFmpeg and OpenSSL, with statistics shown in Table 1 . For each graph in FFmpeg and OpenSSL, we initialize every node with 6 block-level numeric features. More details about the dataset generation and node features can be found in Appendix A.1.1 and Table 7 .

Existing graph matching works do not consider the impact of the sizes of graphs on performance. However, we find that the larger the graph size is, the worse the performance is. Therefore, it is important to evaluate the robustness of any graph matching networks in this setting. We thus further split these two datasets into three sub-datasets according to the size range of graph pairs.

Regression datasets: we evaluate our model on learning the graph edit distance (GED) (Zeng et al., 2009; Gao et al., 2010; Riesen, 2015) , which measures the structural similarity between two graphs. Formally, GED is defined as the cost of the least expensive sequence of edit operations that transform one graph into another, where an edit operation can be an insertion or a deletion of a node or an edge.

We evaluate our model on two benchmark datasets AIDS700 and LINUX1000 2 . The statistic for the datasets is shown in Table 1 , and more details can be found in Appendix A.1.2 and Table 7 .

4.1.2. EXPERIMENTAL SETUP:

Model Settings. For SGNN, we use 3 GCN layers in node embedding layer and each of the GCNs has an output dimension of 100. We use ReLU as the activation function along with a dropout layer after each GCN layer with dropout rate being 0.1. In the graph-level embedding aggregation layer of SGNN, we can employ different aggregation functions (i,e., Max, FCMax, Avg, FCAvg, BiL-STM, etc.) as stated previously in Section 3.1. For MPNGMN, we exploited different aggregation functions similar to SGNN and we found that BiLSTM aggregator consistently performs better than other aggregation functions (see appendix A.4). Thus, for MPNGMN, we always use BiLSTM as our default aggregation function and we make its hidden size equal to the dimension of node embeddings. For MPNGMN, we set the number of perspectives r d to 100, and use another aggregation function BiLSTM to aggregate the output of node-graph matching layer. For each graph, we concatenate the last hidden vector of two directions of BiLSTM, which results in a 200 dimensions vector as the graph embeddings.

Implementation Details. We implement our model using PyTorch 1.1 (Paszke et al., 2017) , and train the model using the Adam optimizer (Kingma & Ba, 2014) . The learning rate is set to 0.5e-3 for classification tasks and 5e-3 for regression tasks. For classification tasks, we split each dataset into three disjoint subsets of binary functions for training/validation/testing. We train our model by running 100 epochs. At each epoch, we build the pairwise training data as follows. For each graph G in training subset, we obtain one positive pair tpG, G pos q, `1u and a corresponding negative pair tpG, G neg q, ´1u, where G pos is randomly selected from all control flow graphs that compiled from the same source function as G, and G neg is selected from other graphs. By default, for each minibatch in one epoch, we train our model with 5 positive and 5 negative pairs. In regression tasks, we first split graphs of each dataset into training, validation, and testing set, and then build the pairwise training/validation/testing data as previous work Bai et al. (2019) . We train our model by 10000 iterations with a mini-batch of 128 graph pairs. Each pair is a tuple of tpG 1 , G 2 q, su, where s is the ground-truth GED between G 1 and G 2 . Noted that all experiments are conducted on a computer equipped with 2 Intel Xeon 2.2GHz CPU, 256 GB memory and one NVIDIA GTX 1080 Ti GPU.

Baselines. We compared our HGMN against the following baselines: i) SimGNN (Bai et al. (2019) ): SimGNN uses GCN to update node features and aggregates them using an attention mechanism. The final pair representation consists of 2 components: One from the interaction between aggregated pair graph features and the other from a pairwise node comparison. ii) GMN (Li et al. (2019) ): This method updates node features according to not only current states and messages aggregated from neighborhoods but also information of attentive neighborhoods using cross-graph attention. After updating node features, it aggregates node features in a way similar to that in Gated Graph Neural Network (Li et al. (2016) ) to get graph embedding. We have two variants of HGMN: HGMN(FCMax) stands for HGMN model with SGNN(FCMax) and HGMN(BiLSTM) stands for HGMN model with SGNN(BiLSTM).

Under review as a conference paper at ICLR 2020 Note that, we report the mean and standard deviation of the experimental results of both baseline and our models by repeating the experiments five times.

4.2. COMPARISON ON GRAPH-GRAPH CLASSIFICATION TASK:

Table 2: Summary of classification results in terms of AUC scores (%).

Model:

FFmpeg OpenSSL [3, 200] [20, 200] [50, 200] [3, 200] [20, 200] [50, 200] For the classification task of detecting whether two binary functions are similar or not, we measure the Area Under the ROC Curve (AUC) (Bradley, 1997) of different models for classifying graph pairs of the same test set, and summarize the results in Table 2 .

The results show that our models clearly achieve state-of-the-art performance on all 6 sub-datasets for both FFmpeg and OpenSSL datasets. Both MPNGMN and HGMN models show better and more robust performance than the SimGNN and GMN baselines, particularly when the graph size of the two graphs increases. Compared with the SGNN (Max), our models (both MPNGMN and HGMN models) significantly outperform it, demonstrating the benefits of multi-perspective nodegraph matching mechanism that captures the cross-level interactions between node embeddings of a graph and graph-level embeddings of another graph. More experiments compared with SGNN models using other aggregation functions can be found in Appendix A.3. For the regression task of computing the graph edit distance between two graphs, we evaluate the models using Mean Square Error (mse), Spearmans Rank Correlation Coefficient (ρ) (Spearman, 1904) , Kendalls Rank Correlation Coefficient (τ ) (Kendall, 1938) , and precision at k (p@k). All results of both AIDS700 and LINUX1000 datasets are summarized in Table 3 . In terms of all evaluation metrics, our models consistently outperform both SimGNN and GMN baseline models by a significant margin on both AIDS700 and LINUX1000 datasets. On the other hand, compared with SGNN (Max), our models achieve much better performance (see Appendix A.3 for more experiments compared with other SGNN models). The results highlight the importance of our multiperspective node-graph matching mechanism which could effectively capture cross-level node-graph interactions between parts of a graph and a whole graph. [3, 200] [20, 200] [50, 200] [3, 200] [20, 200] [50, 200] We perform a further study on the impact of different attention functions for our proposed MP-NGMN model. In particular, as we discussed in Sec. 3.2, the proposed multi-perspective matching function shares similar spirits with multi-head attention (Vaswani et al., 2017) . Therefore, it is interesting to compare both attention functions in terms of AUC scores for graph-graph classification tasks. Interestingly, our proposed multi-perspective attention mechanism consistently outperforms these results of multi-head attention mechanism by quite a large margin. We suspect that our proposed multi-perspective attention uses vectors attention weights which may significantly reduce the potential overfitting. We also performed a study on the impact of the number of the perspectives on the performance and our model is not sensitive with this hyperparameter (see the appendix A.5). We finally investigate the impact of different GNNs adopted by node embedding layers of our MP-NGMN model for both classification and regression tasks. Following the same settings of our previous experiments, we only replace GCN with three variants: GraphSAGE (Hamilton et al., 2017) , GIN (Xu et al., 2018a) , and GGNN (Li et al., 2016) , whose output dimensions are kept the same with GCN (i.e, 100) in our experiments. Note that, we do not fine-tune any hyper-parameter of the three GNN models, and their default hyper-parameters of these three GNNs are listed in Appendix A.2.2.

4.3. COMPARISON ON GRAPH-GRAPH REGRESSION TASK:



4.5. FURTHER STUDY ON THE IMPACT OF DIFFERENT GNNS:

Table 5 and Table 6 present the results of GCN versus GraphSAGE/GIN/GGNN in MPNGMN for the classification and regression tasks, respectively. For all datasets of classification and regression tasks, the performance of different GNNs is quite similar. It indicates that our model is not sensitive to the choice of GNN models in node embedding layers. Moreover, we can see from Table 5 that MPNGMN models using GGNN perform even better than our default MPNGMN using GCN on both FFmpeg and OpenSSL datasets for the classification task. It is also observed from Table 6 that MPNGMN models using GIN also outperform our default model using GCN on LINUX1000 dataset for the regression task. These observations show that our model can be further improved by adopting more advanced GNN models or choosing the most appropriate GNN models according to different application tasks.

5. RELATED WORKS:

Graph Neural Networks. Recently graph neural networks have been proven to be extremely effective and achieved promising results on various graph-structured based prediction tasks (Gao et al., 2019; Chen et al., 2019a) . The main goal of graph neural networks is to learn node-level representations or (sub)graph-level representations for graph-structured data. There is a large body of GNN models (Scarselli et al., 2008; Li et al., 2016; Kipf & Welling, 2016; Hamilton et al., 2017; Veličković et al., 2017; Xu et al., 2018a) that have been proposed to learn node representations. With the learned node representations, various tasks on graphs can be performed such as node classification and link prediction (Veličković et al., 2017; Zhang & Chen, 2018 ). In addition to learning node representation, some studies try to extend pooling operations to GNNs (Ying et al., 2018; Gao & Ji, 2019; Lee et al., 2019; Ma et al., 2019) . These pooling operations are expected to learn scaled-down graph representations from node representations, and can be trained in an end-to-end fashion. Recent works also exploit extending sequence-to-sequence model using bidirectional GNN for developing graph-to-sequence models in order to cope with graph inputs and show promising performance improvement (Xu et al., 2018b; c; Chen et al., 2019b) in various natural language processing tasks.

Conventional Graph Matching. In general, graph matching can be categorized into exact graph matching and error-tolerant graph matching. Exact graph matching aims to find a strict correspondence between two (in large parts) identical graphs being matched, while error-tolerant graph matching allows matching between completely nonidentical graphs (Riesen, 2015) . In real-world applications, the constraint of exact graph matching is too rigid, and thus a large number of work has been proposed to solve the error-tolerant graph matching problem, which is usually quantified by a specific similarity metric. In fact, the matching similarity metrics can be defined by some measure of structure similarity like Graph Edit Distance (GED) (Gao et al., 2010) , Maximum Common Subgraph (MCS) (Bunke, 1997) , or even more coarse binary similarity, according to different application backgrounds. For GED and MCS, both of them are well-studies NP-hard problems (Bunke, 1997; McGregor, 1982) , and thus suffer from exponential computational complexity and huge memory requirements for exact solutions in practice (Zeng et al., 2009; Blumenthal & Gamper, 2018) .

Graph Similarity Computation and Graph Matching Networks. A popular line of research of graph matching focuses on developing approximations for graph similarity computations, in which most of them focus on improvements for better efficiency in computation (Gao et al., 2010; Zeng et al., 2009; Riesen, 2015; Wu et al., 2019; Yoshida et al., 2019) . However, our solution is a learnable model based on GNN to approximate graph similarity in terms of GED and binary similarity for pairwise graph-based data.

The closely relevant work to our solution are two GNN based models: GMN (Li et al., 2019) and SimGNN (Bai et al., 2019) . GMN directly updates the node representations of one graph by adding artificial attention-based connections for another graph. SimGNN considers the graph-level representation similarity as well as the histogram features from a pairwise node-level comparison to learn the graph similarity. However, these two models fail to capture different perspectives of graphstructured data between the pairs of graphs.

6. CONCLUSION AND FUTURE WORK:

In this paper, we presented a novel Hierarchical Graph Matching Network (HGMN) for computing the graph similarity between any pair of graph-structured objects. Our model jointly learned graph embeddings and a data-driven graph matching metric for computing graph similarity in an end-to-end fashion. We further proposed a new multi-perspective node-graph matching network for effectively learning cross-level interactions between two graphs beyond low-level node-node and global-level graph-graph interactions. Our extensive experimental results correlated the superior performance compared with state-of-the-art baselines on both graph-graph classification and regression tasks.

One interesting future direction is to adapt our proposed HGMN model for solving different realworld applications such as unknown malware detection, text matching and entailment, and knowledge graph question answering. For FFmpeg dataset, we prepare the corresponding control flow graphs dataset as the benchmark dataset to detect binary function similarity. First, we compile FFmpeg 4.1.4 using 2 different compilers gcc 5.4.0 and clang 3.8.0, and 4 different compiler optimization levels (O0-O3), and generate 8 different binaries files. Second, these 8 generated binaries are disassembled using IDA Pro,3 which can produce CFGs for all disassembled functions. Finally, for each basic block in CFGs, we extract 6 block-level numeric features as the initial node representation based on IDAPython (a python-based plugin in IDA Pro).

OpenSSL is built from OpenSSL (v1.0.1f and v1.0.1u) using gcc 5.4 in 3 different architectures (x86, MIPS, and ARM), and 4 different optimization levels (O0-O3). The OpenSSL dataset we evaluate is previously released by (Xu et al., 2017) and public available4 with prepared 6 block-level numeric features.

Overall, for both FFmpeg and OpenSSL, each node in the control flow graphs are initialized with 6 block-level numeric features: # of string constants, # of numeric constants, # of total instructions, # of transfer instructions, # of call instructions, and # of arithmetic instructions.

A.1.2 REGRESSION DATASETS:

Instead of directly computing the GED between two graphs G 1 and G 2 , we try to learn a similarity score spG 1 , G 2 q, which is the normalized exponential of GED in the range of p0, 1s. To be specific,

spG 1 , G 2 q " exp ´normGEDpG 1 ,G 2 q , normGEDpG 1 , G 2 q " GEDpG 1 ,G 2 q p|G 1 |`|G 2 |q{2

, where |G 1 | or |G 2 | denotes the number of nodes of G 1 or G 2 , and normGEDpG 1 , G 2 q or GEDpG 1 , G 2 q denotes the normalized/un-normalized GED between G 1 and G 2 . We employ both AIDS700 and LINUX1000 released by (Bai et al., 2019) , which are public available.5 Each dataset contains a set of graph pairs as well as their ground-truth GED scores, which are computed by exponential-time exact GED computation algorithm A ˚ (Hart et al., 1968; Riesen et al., 2013) . As the ground-truth GEDs of another dataset IMDB-MULTI is provided with in-exact approximation, we thus do not consider this dataset in our experiments.

AIDS700 is a subset of AIDS dataset, a collection of AIDS antiviral screen chemical compounds from Development Therapeutics Program (DTP) in the National Cancer Institute (NCI). 6 Originally, AIDS dataset contains 42687 chemical compounds, where each of them can be represented as a graph with atoms as node and bonds as edges. To avoid calculating the ground-truth GED between two graphs with a large number of nodes, Bai et al. (2019) create the AIDS700 dataset that contains 700

A.2.2 MORE EXPERIMENTAL SETUP FOR DIFFERENT GNNS:

When performing experiments to see how different GNNs affect performance of MPNGMN model, we only replace GCN with GraphSAGE, GIN, and GGNN using the geometric deep learning library -PyTorch Geometric7 . More specifically, for GraphSAGE, we used a 3-layer GraphSAGE GNN with their output dimensions all set to 100. For GIN, we used 3 GIN modules with a 1-layer MLP with output dimension 100 as the learnable function. For GGNN, we used 3 one-layer propagation models to replace the 3 GCNs in our original setting and also set their output dimensions to 100.

A.3 MORE EXPERIMENTS OF THE SGNN MODEL WITH DIFFERENT AGGREGATION FUNCTIONS FOR BOTH CLASSIFICATION & REGRESSION TASKS:

To further compare our models with SGNN models, we train and evaluate several SGNN models with different aggregation functions, such as Max, FCMax, Avg, FCAvg, and BiLSTM. Both classification results and regression results are summarized in Table 8 and Table 9 . For both classification and regression tasks, our models show statistically significantly improvement over all SGNN models with different aggregation functions, which indicates the advantage of multi-perspective node-graph matching network that adopted in our model. 

:

We release these datasets via this link: https://github.com/runningoat/hgmn_dataset. Our codes will be released as well upon the acceptance of this paper.

These two datasets are released byBai et al. (2019) and publicly accessible.

IDA Pro disassembler, https://www.hex-rays.com/products/ida/index.shtml.

https://github.com/xiaojunxu/dnn-binary-code-similarity.

https://github.com/yunshengb/SimGNN.

https://wiki.nci.nih.gov/display/NCIDTPdata/AIDS+Antiviral+Screen+Data

https://pytorch-geometric.readthedocs.io/.

Figures and Tables:

Figure 1: Overall Model Architecture of Hierarchical Graph Matching Networks (HGMN)

Summary statistics of datasets for both classification & regression tasks.

Table content: <table><tr><td>Tasks</td><td>Datasets</td><td>Sub-datasets</td><td># of Graphs</td><td># of Functions</td><td>AVG # of Nodes</td><td>AVG # of Edges</td><td>AVG # of AVG Degrees</td><td>Init Feature Dimensions</td></tr><tr><td/><td/><td colspan="2">[3, 200] 83008</td><td>10376</td><td>18.83</td><td>27.02</td><td>2.59</td><td/></tr><tr><td/><td>FFmpeg</td><td colspan="2">[20, 200] 31696</td><td>7668</td><td>51.02</td><td>75.88</td><td>2.94</td><td>6</td></tr><tr><td>classif-</td><td/><td colspan="2">[50, 200] 10824</td><td>3178</td><td>90.93</td><td>136.83</td><td>3.00</td><td/></tr><tr><td>ication</td><td/><td colspan="2">[3, 200] 73953</td><td>4249</td><td>15.73</td><td>21.97</td><td>2.44</td><td/></tr><tr><td/><td>OpenSSL</td><td colspan="2">[20, 200] 15800</td><td>1073</td><td>44.89</td><td>67.15</td><td>2.95</td><td>6</td></tr><tr><td/><td/><td colspan="2">[50, 200] 4308</td><td>338</td><td>83.68</td><td>/127.75</td><td>3.04</td><td/></tr><tr><td>regre-</td><td>AIDS700</td><td>-</td><td>700</td><td>-</td><td>8.90</td><td>8.80</td><td>1.96)</td><td>29</td></tr><tr><td>ssion</td><td>LINUX1000</td><td>-</td><td>1000</td><td>-</td><td>7.58</td><td>6.94</td><td>1.81</td><td>1</td></tr><tr><td colspan="7">4.1 DATASETS, EXPERIMENTS SETTINGS, AND BASELINES</td><td/><td/></tr><tr><td colspan="2">4.1.1 DATASETS</td><td/><td/><td/><td/><td/><td/><td/></tr></table>

Summary of regression results on AIDS700 and LINUX1000.

Table content: <table><tr><td>Datasets</td><td>Model</td><td>mse (10 ´3)</td><td>ρ</td><td>τ</td><td>p@10</td><td>p@20</td></tr><tr><td/><td>SimGNN</td><td colspan="5">1.376˘0.066 0.824˘0.009 0.665˘0.011 0.400˘0.023 0.489˘0.024</td></tr><tr><td/><td>GMN</td><td colspan="5">4.610˘0.365 0.672˘0.036 0.497˘0.032 0.200˘0.018 0.263˘0.018</td></tr><tr><td/><td>SGNN (Max)</td><td colspan="5">2.822˘0.149 0.765˘0.005 0.588˘0.004 0.289˘0.016 0.373˘0.012</td></tr><tr><td>AIDS700</td><td>MPNGMN</td><td colspan="5">1.191˘0.048 0.904˘0.003 0.749˘0.005 0.465˘0.011 0.538˘0.007</td></tr><tr><td/><td colspan="6">HGMN (FCMax) 1.205˘0.039 0.904˘0.002 0.749˘0.003 0.457˘0.014 0.532˘0.016</td></tr><tr><td/><td colspan="6">HGMN (BiLSTM) 1.169˘0.036 0.905˘0.002 0.751˘0.003 0.456˘0.019 0.539˘0.018</td></tr><tr><td/><td>SimGNN</td><td colspan="5">2.479˘1.038 0.912˘0.031 0.791˘0.046 0.635˘0.328 0.650˘0.283</td></tr><tr><td/><td>GMN</td><td colspan="5">2.571˘0.519 0.906˘0.023 0.763˘0.035 0.888˘0.036 0.856˘0.040</td></tr><tr><td>LINUX 1000</td><td colspan="6">SGNN (Max) MPNGMN HGMN (FCMax) 1.575˘0.627 0.946˘0.019 0.817˘0.034 0.807˘0.117 0.784˘0.108 11.832˘0.698 0.566˘0.022 0.404˘0.017 0.226˘0.106 0.492˘0.190 1.561˘0.020 0.945˘0.002 0.814˘0.003 0.743˘0.085 0.741˘0.086</td></tr><tr><td/><td colspan="6">HGMN (BiLSTM) 0.439˘0.143 0.985˘0.005 0.919˘0.016 0.955˘0.011 0.943˘0.014</td></tr></table>

Classification results of Multi-Perspectives versus Multi-Heads in terms of AUC scores(%).

Table content: <table><tr><td>Model</td><td>FFmpeg</td><td>OpenSSL</td></tr></table>

Classification results of different GNNs in terms of AUC scores (%).

Table content: <table><tr><td>Model</td><td>[3, 200]</td><td>FFmpeg [20, 200]</td><td>[50, 200]</td><td>[3, 200]</td><td>OpenSSL [20, 200]</td><td>[50, 200]</td></tr><tr><td colspan="7">MPNGMN-GCN (Our) 97.73˘0.11 98.29˘0.21 96.81˘0.96 96.56˘0.12 97.60˘0.29 92.89˘1.31</td></tr><tr><td colspan="7">MPNGMN-GraphSAGE 97.31˘0.56 98.21˘0.13 97.88˘0.15 96.13˘0.30 97.30˘0.72 93.66˘3.87</td></tr><tr><td>MPNGMN-GIN</td><td colspan="6">97.97˘0.08 98.06˘0.22 94.66˘4.01 96.98˘0.20 97.42˘0.48 92.29˘2.23</td></tr><tr><td>MPNGMN-GGNN</td><td colspan="6">98.42˘0.41 99.77˘0.07 97.93˘1.18 99.35˘0.06 98.51˘1.04 94.17˘7.74</td></tr></table>

Regression results of different GNNs on AIDS700 and LINUX1000.

Table content: <table><tr><td>Datasets</td><td>Model</td><td>mse (10 ´3)</td><td>ρ</td><td>τ</td><td>p@10</td><td>p@20</td></tr><tr><td/><td colspan="6">MPNGMN-GCN (Our) 1.191˘0.048 0.904˘0.003 0.749˘0.005 0.465˘0.011 0.538˘0.007</td></tr><tr><td>AIDS</td><td colspan="6">MPNGMN-(GraphSAGE) 1.275˘0.054 0.901˘0.006 0.745˘0.008 0.448˘0.016 0.533˘0.014</td></tr><tr><td>700</td><td>MPNGMN-(GIN)</td><td colspan="5">1.367˘0.085 0.889˘0.008 0.729˘0.010 0.400˘0.022 0.492˘0.021</td></tr><tr><td/><td>MPNGMN-(GGNN)</td><td colspan="5">1.870˘0.082 0.871˘0.004 0.706˘0.005 0.388˘0.015 0.457˘0.017</td></tr><tr><td/><td colspan="6">MPNGMN-GCN (Our) 1.561˘0.020 0.945˘0.002 0.814˘0.003 0.743˘0.085 0.741˘0.086</td></tr><tr><td>LINUX</td><td colspan="6">MPNGMN-GraphSAGE 2.784˘0.705 0.915˘0.019 0.767˘0.028 0.682˘0.183 0.693˘0.167</td></tr><tr><td>1000</td><td>MPNGMN-GIN</td><td colspan="5">1.126˘0.164 0.963˘0.006 0.858˘0.015 0.792˘0.068 0.821˘0.035</td></tr><tr><td/><td>MPNGMN-GGNN</td><td colspan="5">2.068˘0.991 0.938˘0.028 0.815˘0.055 0.628˘0.189 0.654˘0.176</td></tr></table>

Zhiping Zeng, Anthony KH Tung, JianyongWang, Jianhua Feng, and  Lizhu Zhou. Comparing stars: On approximating graph edit distance. Proceedings of the VLDB Endowment, 2(1):25-36, 2009. Chuxu Zhang, Dongjin Song, Chao Huang, Ananthram Swami, and Nitesh V. Chawla. Heterogeneous graph neural network. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, 2019.

Table content: <table><tr><td>Muhan Zhang and Yixin Chen. Link prediction based on graph neural networks. In Advances in</td></tr><tr><td>Neural Information Processing Systems, pp. 5165-5175, 2018.</td></tr><tr><td>A APPENDIX</td></tr><tr><td>A.1 DATASETS</td></tr><tr><td>A.1.1 CLASSIFICATION DATASETS</td></tr><tr><td>It is noted that one source code function, after compiled with different settings (architectures, com-</td></tr><tr><td>pilers, optimization levels, etc), can generate various binary functions with different control flow</td></tr><tr><td>graphs.</td></tr></table>

Classification results of SGNN models with different aggregation functions VS. our MP-NGMN and HGMN models in term of AUC scores (%). BiLSTM) 96.92˘0.13 97.62˘0.13 96.35˘0.33 95.24˘0.06 96.30˘0.27 93.99˘0.62 SGNN (Max) 93.92˘0.07 93.82˘0.28 85.15˘1.39 91.07˘0.10 88.94˘0.47 82.10˘0.51 SGNN (FCMax) 95.37˘0.04 96.29˘0.14 95.98˘0.32 92.64˘0.15 93.79˘0.17 93.21˘0.82 SGNN (Avg) 95.61˘0.05 96.09˘0.05 96.70˘0.13 92.89˘0.09 93.90˘0.24 94.12˘0.35 SGNN (FCAvg) 95.18˘0.03 95.74˘0.15 96.43˘0.16 92.70˘0.09 93.72˘0.19 93.49˘0.30 MPNGMN 97.73˘0.11 98.29˘0.21 96.81˘0.96 96.56˘0.12 97.60˘0.29 92.89˘1.31 HGMN (Max) 97.44˘0.32 97.84˘0.40 97.22˘0.36 94.77˘1.80 97.44˘0.26 94.06˘1.60 HGMN (FCMax) 98.07˘0.06 98.29˘0.10 97.83˘0.11 96.87˘0.24 97.59˘0.24 95.58˘1.13 HGMN (BiLSTM) 97.56˘0.38 98.12˘0.04 97.16˘0.53 96.90˘0.10 97.31˘1.07 95.87˘0.88

Table content: <table><tr><td>Model</td><td>[3, 200]</td><td>FFmpeg [20, 200]</td><td>[50, 200]</td><td>[3, 200]</td><td>OpenSSL [20, 200]</td><td>[50, 200]</td></tr><tr><td>SGNN (</td><td/><td/><td/><td/><td/><td/></tr></table>

Results of SGNN models with different aggregation functions VS. our MPNGMN and HGMN models on AIDS700 and LINUX1000. 054˘0.086 0.962˘0.003 0.850˘0.008 0.877˘0.054 0.883˘0.047 HGMN (FCMax) 1.575˘0.627 0.946˘0.019 0.817˘0.034 0.807˘0.117 0.784˘0.108 HGMN (BiLSTM) 0.439˘0.143 0.985˘0.005 0.919˘0.016 0.955˘0.011 0.943˘0.014

Table content: <table><tr><td>Datasets</td><td>Model</td><td>mse (10 ´3)</td><td>ρ</td><td>τ</td><td>p@10</td><td>p@20</td></tr><tr><td/><td colspan="6">SGNN (BiLSTM) 1.422˘0.044 0.881˘0.005 0.718˘0.006 0.376˘0.020 0.472˘0.014</td></tr><tr><td/><td>SGNN (Max)</td><td colspan="5">2.822˘0.149 0.765˘0.005 0.588˘0.004 0.289˘0.016 0.373˘0.012</td></tr><tr><td/><td>SGNN (FCMax)</td><td colspan="5">3.114˘0.114 0.735˘0.009 0.554˘0.008 0.278˘0.021 0.364˘0.017</td></tr><tr><td>AIDS700</td><td>SGNN (Avg)</td><td colspan="5">1.453˘0.015 0.876˘0.002 0.712˘0.002 0.353˘0.007 0.444˘0.012</td></tr><tr><td/><td>SGNN (FCAvg)</td><td colspan="5">1.658˘0.067 0.857˘0.007 0.689˘0.008 0.305˘0.018 0.399˘0.021</td></tr><tr><td/><td>MPNGMN</td><td colspan="5">1.191˘0.048 0.904˘0.003 0.749˘0.005 0.465˘0.011 0.538˘0.007</td></tr><tr><td/><td>HGMN (Max)</td><td colspan="5">1.210˘0.020 0.900˘0.002 0.743˘0.003 0.461˘0.012 0.534˘0.009</td></tr><tr><td/><td colspan="6">HGMN (FCMax) 1.205˘0.039 0.904˘0.002 0.749˘0.003 0.457˘0.014 0.532˘0.016</td></tr><tr><td/><td colspan="6">HGMN (BiLSTM) 1.169˘0.036 0.905˘0.002 0.751˘0.003 0.456˘0.019 0.539˘0.018</td></tr><tr><td/><td colspan="6">SGNN (BiLSTM) 2.140˘1.668 0.935˘0.050 0.825˘0.100 0.978˘0.012 0.965˘0.007</td></tr><tr><td/><td>SGNN (Max)</td><td colspan="5">11.832˘0.698 0.566˘0.022 0.404˘0.017 0.226˘0.106 0.492˘0.190</td></tr><tr><td>LINUX 1000</td><td colspan="6">SGNN (FCMax) 17.795˘0.406 0.362˘0.021 0.252˘0.015 0.239˘0.000 0.241˘0.000 SGNN (Avg) 2.343˘0.453 0.933˘0.012 0.790˘0.017 0.778˘0.048 0.811˘0.050 SGNN (FCAvg) 3.211˘0.318 0.909˘0.004 0.757˘0.008 0.831˘0.163 0.813˘0.159</td></tr><tr><td/><td>MPNGMN</td><td colspan="5">1.561˘0.020 0.945˘0.002 0.814˘0.003 0.743˘0.085 0.741˘0.086</td></tr><tr><td/><td>HGMN (Max)</td><td>1.</td><td/><td/><td/><td/></tr></table>

Peer review (iclr2020):
In this paper, a hierarchical graph matching network, which considers both graph-graph interaction and node-graph interaction, is proposed. Specifically, the graph-graph interaction is modeled through graph level embeddings learned by GCN with pooling layers. While node-graph interaction is modeled using node embedding learned by GCN and attentive graph embedding aggregated from node embedding. Some concerns about the paper are as follows: 1) The novelty of the paper is incremental. The major contribution of the paper lies in the propose of multi-perspective matching function , which is somewhat similar to the Neural Tensor Networks proposed in [1] and utilized in [2] Although, in [2], the Neural Tensor Network is used to measure the similarity between graph-level embeddings. 2) Some of the technical details of the paper is not clearly presented or well explained. a. In Eq. (7), attentive graph-level embeddings are calculated using weighted average of its node embeddings. However, it is not clear which node from the other graph should be used to calculate the weights (alpha_{I,j}, _x0008_eta_{i,j}). Furthermore, it is also not clear why the attention score should solely base on a single node from the other graph rather than the information of the entire graph. b. In Eq. (10), it would be better if the authors could provide more motivations about using Bi-LSTM aggregator. Especially, the embeddings to be aggregated are unordered. What are the two directions in Bi-LSTM in this case? What is the benefit of using Bi-LSTM as aggregator compared with LSTM aggregator or other aggregators? Some other questions to be clarified: 1) Why different similarity score functions are adopted for the classification task and the regression task? 2) For the classification task, the mean squared error loss is adopted. Why not using other more commonly used loss for classification task? Suggestions: It would be better if the authors could empirically show the effectiveness of the Bi-LSTM aggregator. It would be helpful if the authors could conduct some investigation on how the number of perspectives affect the performance of the model. [1] Reasoning With Neural Tensor Networks for Knowledge Base Completion [2] SimGNN: A Neural Network Approach to Fast Graph Similarity Computation