Before revision:  In an effort to improve generalization of GNNs we suggest the Low-Rank Global Attention (LRGA ) module , taking advantage of the efficiency of low rank matrix-vector multiplication, that improves the algorithmic alignment (Xu et al., 2019b) of GNNs with the 2-folklore Weisfeiler-Lehman ( FWL) algorithm;
After revision:  In an effort to improve generalization of GNNs we suggest the Low-Rank Global Attention (LRGA ) module , to Graph Neural Networks (GNNs) for improving their generalization power. To theoretically quantify the generalization properties granted by adding the LRGA module to GNNs, we focus on a specific family of expressive GNNs and show that augmenting it with LRGA provides algorithmic alignment to a powerful graph isomorphism test, namely the 2-Folklore Weisfeiler-Lehman ( FWL) algorithm;