Venue: NeurIPS 2021 Conference

Reviews:

final_score: rating: 6: Marginally above the acceptance threshold
review_content: summary: This paper introduces a new approach for generating molecular conformations, using score-based generative modeling.  The key contribution over prior work is the dynamic addition (during both training and inference) of long-range interactions between non-bonded atoms that are not proximal in the molecular graph.  As these interactions are often critical to determining the underlying molecular conformations, the authors contend that their addition leads to improved performance on a range of tasks.  In particular, they demonstrate improved performance over previous state-of-the-art on the generation of conformations for small molecules, protein side chains, and multi-molecular complexes, as well as small-molecule ensemble property prediction.
main_review: Originality: While score-based generative modeling has been recently applied to molecular conformation generation (ref 32), and 3D information has been incorporated into many molecular learning algorithms, the dynamic addition of non-bonded atoms within the score matching paradigm is novel.  Most of the tasks are not new, with the exception of the multi-molecular complex conformation task (which does look quite interesting!).

Quality: This is my main concern regarding this work.  I believe further experiments are required to conclusively support the claim that DGSM's improved performance derives from taking into account long-range interactions.  I realize that at a high-level CONFGF is DGSM without these non-bonded edges, though it is also unclear if there are other methodological differences that could be coming in to play.  In particular, I would like to see an ablation study comparing DGSM's performance with and without the augmentation of the original graph structure with non-bonded edges.  Even better would be plots demonstrating the change in performance of DGSM across different cutoff thresholds $\delta$ (currently fixed to 10 Å).  I in fact would expect that these plots might look different across tasks involving small molecules, proteins, and multi-molecular complexes.

Clarity: The work is clearly written and well organized.

Significance: The results are overall quite compelling.  It is unclear if there will be much use (yet) of this method for larger molecular systems and complexes since specialized methods that incorporate a lot of domain knowledge are often state-of-the-art. 

*** Post-response update:

The reviewer addressed my concern regarding the non-bonded edge ablation, and the results support the overall conclusion, so I am raising my score.  I do think the decrease in performance as the cutoff distance increases is an interesting line of investigation to be pursued further.
limitations_and_societal_impact: The authors mostly do not discuss limitations of this work.  What size systems can currently be modeled?  The use of other computational methods (as opposed to direct experimental measurements) to provide ground truth data should also be addressed.

I do not believe there are any potential negative societal impacts to be addressed here.
review_title: null

final_score: rating: 7: Good paper, accept
review_content: summary: The authors develop an improved method for 3D molecular conformation generation from 2D molecular graphs that can more directly incorporate non-bonded, topologically long-range interactions into the generation process. Their starting point is a recent method that leverages score matching with a GNN based on the 2D molecular graph topology, or more specifically, a GNN that is trained to estimate the gradient of the noise-perturbed log density of interatomic distances on the graph edges. They follow the same framework, but add additional edges to the graph topology based on the current perturbed distances when they fall below a certain cutoff (10 Angstroms). Through their experiments, they show that this relatively modest modification signifcantly improves generation performance of small molecule conformers and can be applied to larger and more complex systems such as protein side chain packing and multi-molecular complexes.
main_review: Strengths 

Motivation and Significance. 
Non-bonded interactions are central to understanding larger molecular systems but have been a blind spot or weakness for many ML-based approaches to conformation generation, in part because explicitly modeling all possible pairwise interactions is expensive. This work offers a tractable solution to this by using the domain-motivated design decision of spatial neighborhood cutoffs. This very nicely combines with score matching based generative modeling, since with that framework, you can essentially train on static randomly sampled graphs with approximately linear scaling in the number of atoms, but you still retain the power to dynamically account for arbitrary ij interactions at sampling time.

Small molecule results. 
The results on the GEOM datasets are quite strong and already show that non-bonded interactions can make a difference for small molecular systems such as QM9 and drug-like molecules. The improved typical coverage and accuracy seem like qualitative improvements that could make a meaningful impact on conformer generation in molecular property prediction or in-silico discovery efforts. Additionally the improved ensemble energetics from a QM method in Table 2 suggest that this framework is improving the ability of ML-based conformer methods to model these systems in a physically accurate way.

Clarity. 
I found the paper well written and easy to follow, with effective figures and notation.

Weaknesses

Larger system baselines. 
Both the protein side chain and multi-molecular complex experiments suggest potential applications of the framework, but it would significantly strengthen the paper to add some kind of external baseline model performance to calibrate expectations. For example, although the authors mention that rotamer based side-chain predictors perform much better, it would be helpful to add a baseline such as Rosetta to understand how far the model is from being practically applicable in that domain.

Novelty and ablation. 
The primary methodological change here is simple, but I don't that think that is a big weakness because it has clear and meaningful impacts on the capability of the framework. Since that change is so specific, though, I think that it would benefit the paper for the authors to more thoroughly investigate the role of the cutoff distance. For example, does making the cutoff distance small add a useful inductive bias, or is it more a matter of a performance/speed tradeoff?

---Update post-response---
Thank you for adding the additional results about the role of the cutoff distances and how it affects both accuracy and diversity. It is interesting that, at least in current form, there can be benefits to smaller neighborhoods. The authors' point about the method being a general framework is well taken and also the main reason I did and would recommend acceptance (and keep my score the same). I agree it will be quite interesting to see how it can compare to application-specific methods with additional domain-specific tuning. 
limitations_and_societal_impact: I would suggest that the authors explicitly discuss limitations of the model with respect to chirality. Since the model is based purely on distance-based score matching, it will not be able to differentiate between stereoisomers. I imagine that this is likely already causing problems for protein side chain prediction, since some amino acid side chains, such as isoleucine and threonine, contain chiral carbons.
review_title: null

final_score: rating: 6: Marginally above the acceptance threshold
review_content: summary: This paper proposes to generate molecular conformation by score matching. The proposed method, called DGSM, learns a score network to predict gradient field with respect to a predicted conformation. The score network is parameterized as a message passing network over a dynamic graph between atoms. The graph is constructed based on pairwise distance between atoms in the current conformation. Finally, DGSM uses the learned gradient field along with Langevin dynamics to sample molecular conformations at test time. DGSM is evaluated on two conformation generation benchmarks and achieved new state-of-the-art results.
main_review: Overall, this paper is a nice (but small) extension to ConfGF (Shi et al., 2021), which first used score matching methods to generate molecular conformations. DGSM adopts the same score matching framework in ConfGF but modifies the score network architecture. The reviewer acknowledges the importance of dynamic graph construction and the experimental results show promising results.

### Strength

* An end-to-end framework for molecular conformation generation. The method is mostly data driven and does not use much domain-specific rules.
* Experimental results indeed shows that DGSM outperforms ConfGF, supporting the main claim of the paper.
* New experiments on macromolecules and multi-molecule complexes are interesting.

### Weakness
* DGSM is a small extension to ConfGF. The score matching framework has been proposed in prior literature, so the originality of DGSM is relatively small.
* There is no quantitative results on multi-molecule complex conformation. What's the performance of ConfGF for this task? 
* The multi-molecule complex task seems artificial. Why not try your algorithm on protein-protein complex conformation prediction? 
limitations_and_societal_impact: This paper did not address its limitations. I have included constructive feedback in the review.
review_title: null

final_score: rating: 7: Good paper, accept
review_content: summary: This paper addresses the task of molecular conformer generation, i.e. generate the 3D conformer ensemble conditioned on the molecular graph. The introduced method, Dynamic Graph Score Matching (DGSM), is using score matching to generate 3D structures by explicitly capturing both local and long-range interactions. This is done using dynamic graphs constructed via atom coordinate perturbations using different noise levels as required by the denoising score matching procedure.  The score is estimated using message passing neural networks which operate on these dynamic graphs. At inference time, Langevin dynamics is used to sample conformations from the generated distribution. Empirically, the authors show clear improvements over previous machine learning (ML) models and over one popular open-source non-ML method (RDKit) on molecular conformer generation on two different tasks, as well as improvements on experiments on property prediction based on molecular conformations, protein sidechain conformation generation, and multi-molecular complex conformation.

In short, I think this approach is quite compelling and would be very impactful for future work related to graph conditional 3D generative models of various data in biology, chemistry, etc. The paper is very well written and the method is clean, addressing nicely using dynamic graphs the very important problem of modeling long-range interactions in 3D generation.  
main_review: 1. Originality:

Using denoising score matching for 3D conformer generation is a novel and non-trivial contribution.  The authors employ dynamic graphs for this problem and describe all challenges and solutions. Related work is well written, but it might be useful to discuss non-ML literature a bit more in depth, e.g. see [1].


2. Quality:

I already argued above that this is a good quality submission. However, the authors do not discuss any limitations of their work. It would be great if they could describe common failure cases of their conformer generation model. Also, how stable is the training of the denoising score matching procedure ?

3. Clarity: paper is well written.

4. Significance: already commented above. This paper provides a nice clean solution to a very important problem in graph conditional 3D generation.


5. Improvement points: while I generally like this work, there are a few points where the authors could improve their paper.

- experimental results in table 1: COV and MAT only show information about the recovered ground truth conformers, i.e. equivalent of recall. It would be also very useful to understand how many of the generated structures are close to ground truth conformers, i.e. to show the equivalent metrics of precision. Also, including a stronger non-ML baseline (e.g. OMEGA https://www.eyesopen.com/omega ) would be helpful in making this work more visible and useful in the chemistry community.

- it is known that conformations of a single molecule are usually changing mostly in terms of their rotatable bonds. Can the authors comment on how torsion angles can be integrated in their framework ?

- chirality is a very important issue for molecular conformer generation that was not explicitly tackled until very recently (see [2]). Can the authors comment on whether this can be integrated in DGSM?


[1] Conformation Generation: The State of the Art, Hawkings, 2017
[2] GeoMol: Torsional Geometric Generation of Molecular 3D Conformer Ensembles, Ganea et al., 2021
limitations_and_societal_impact: Limitation section is missing.
review_title: null

Meta-review: The reviewers all agreed this work should be accepted. They appreciated the clarity, the results (particularly the small molecule results), the motivation of the problem being addressed, the end-to-end aspect of the model, and the related work section. The authors should take into account the detailed suggestions of the reviewers for the camera ready version, to make an already nice paper even better.
Decision: Accept (Poster)