CSSGT: Contrastive learning-based Split Spiking Graph Transformer

Authors: Ziyu Wang
Primary area: learning on graphs and other geometries & topologies
Keywords: Graph Neural Networks, Spiking Neural Networks, Transformers, Mutual Information, Graph Contrastive Learning.

Abstract:
Although the integration of Graph Neural Networks (GNNs) and Transformers has demonstrated promising performance across various graph tasks, it remains computationally expensive. In contrast, brain-inspired Spiking Neural Networks (SNNs) offer an energy-efficient architecture due to their unique spike-based, event-driven paradigm. In this paper, we propose a novel framework CSSGT, which leverages both the strength of Transformers and the computational efficiency of SNNs for graph tasks, trained under the graph contrastive learning framework. CSSGT comprises two key components: Mutual Information-based Graph Split (MIGS) and Spike-Driven Graph Attention (SDGA). MIGS is designed for the sequential input of SNNs, splitting the graph while maximizing mutual information and minimizing redundancy. SDGA, tailored for graph data, exploits sparse graph convolution and addition operations, achieving low computational energy consumption. Extensive experiments on diverse datasets demonstrate that CSSGT converges within two epochs and outperforms various state-of-the-art models while maintaining low computational cost.

Decision: reject

Reviews and discussion:

Metareview: