The crux of molecular property prediction is to conduct meaningful and informative representations of molecules. One promising way of doing this is exploiting the molecular graph structure , which leads to several graph-based deep learning models, such as Graph Neural Networks ( GNN), Message Passing Networks (MPN), etc. However, current deep graph learning models generally focus on either node embedding or edge embedding. Since both atoms and chemical bonds play important roles in chemical reactions and reflect the property of molecules, existing methods fail to exploit both node (atom) and edge (bond) features simultaneouslyto make property prediction. In this paper, we propose Dual Message Passing Neural Network ( DualMPNN ), a multi-view message passing architecture with a two-tier constraint, to make more accurate molecular property prediction. DualMPNN consists of two sub-models: one model as NodeMPN for atom-oriented modeling and the other as EdgeMPN for bond-oriented modeling. We design a shared self-attentive readout  and disagreement loss to stabilize the training process and enhance the interactions between two sub-models. On the other hand, the designed self-attentive readout also provides the interpretability for molecular property prediction, which is crucial for real applications like molecular design and drug discovery. Our extensive experimental evaluations demonstrate that DualMPNN achieves remarkably superior improvement over the state-of-the-art approaches on a variety of challenging benchmarks. Meanwhile, the visualization of the self-attention demonstrates how different atoms affect the prediction performance, which brings in the interpretability of deep learning modelsout of the black-box .
The crux of molecular property prediction is to generate meaningful representations of the molecules. One promising route is to exploit the molecular graph structure through Graph Neural Networks ( GNNs). It is well known that both atoms and bonds significantly affect the chemical properties of a molecule, so an expressive model shall be able to exploit both node (atom) and edge (bond) information simultaneously. Guided by this observation, we present Multi-View Graph Neural Network ( MV-GNN ), a multi-view message passing architecture to enable more accurate predictions of molecular properties. In MV-GNN, we introduce a shared self-attentive readout component and disagreement loss to stabilize the training process . This readout component also renders the whole architecture interpretable. We further boost the expressive power of MV-GNN by proposing a cross-dependent message passing scheme that enhances information communication of the two views, which results in the MV-GNN^cross variant. Lastly, we theoretically justify the expressiveness of the two proposed models in terms of distinguishing non-isomorphism graphs. Extensive experiments demonstrate that MV-GNN models achieve remarkably superior performance over the state-of-the-art models on a variety of challenging benchmarks. Meanwhile, visualization results of the node importance are consistent with prior knowledge, which confirms the interpretability power of MV-GNN models .
R
conduct meaningful and informative representations of
generate meaningful representations of the
R
way of doing this is exploiting
route is to exploit
R
, which leads to several graph-based deep learning models, such as
through
R
GNN), Message Passing Networks (MPN), etc. However, current deep graph learning models generally focus on either node embedding or edge embedding. Since
GNNs). It is well known that
R
chemical bonds play important roles in chemical reactions and reflect the property of molecules, existing methods fail
bonds significantly affect the chemical properties of a molecule, so an expressive model shall be able
R
features simultaneouslyto make property prediction. In this paper, we propose Dual Message Passing
information simultaneously. Guided by this observation, we present Multi-View Graph
R
DualMPNN
MV-GNN
R
with a two-tier constraint, to make more accurate molecular property prediction. DualMPNN consists of two sub-models: one model as NodeMPN for atom-oriented modeling and the other as EdgeMPN for bond-oriented modeling. We design
to enable more accurate predictions of molecular properties. In MV-GNN, we introduce
A
component
R
and enhance the interactions between two sub-models. On the other hand, the designed self-attentive readout also provides the interpretability for molecular property prediction, which is crucial for real applications like molecular design and drug discovery. Our extensive experimental evaluations demonstrate that DualMPNN achieves remarkably superior improvement
. This readout component also renders the whole architecture interpretable. We further boost the expressive power of MV-GNN by proposing a cross-dependent message passing scheme that enhances information communication of the two views, which results in the MV-GNN^cross variant. Lastly, we theoretically justify the expressiveness of the two proposed models in terms of distinguishing non-isomorphism graphs. Extensive experiments demonstrate that MV-GNN models achieve remarkably superior performance
R
approaches
models
R
the visualization of the self-attention demonstrates how different atoms affect the prediction performance, which brings in the interpretability of deep learning modelsout of the black-box
visualization results of the node importance are consistent with prior knowledge, which confirms the interpretability power of MV-GNN models