Venue: ICLR 2023 Conference

Reviews:

final_score: rating: 1: strong reject
review_content: summary_of_the_paper: 
The paper proposes and studies an algorithm, $\beta$-SVGD, which modifies the SVGD by multiplying a factor $-(\frac{\pi}{\rho_t})^\beta$ to the vector field. The main result is that when $\beta\in(-1,0)$, the convergence of the Stein Fisher information does not depend on the target $\pi$ or the initialization $\rho_0$. 
strength_and_weaknesses: **Strength**

- The paper proves the convergence of the proposed algorithm.

**Weakness**
- In order to compute the weight $\pi/\rho_t$, the paper proposes to use a kernel density regression to estimate $\rho_t$. However, the number of samples needed by kernel density regression grows exponentially with dimension. So the algorithm won't apply in high dimensions.

- The paper only has toy examples (1-dimensional 2-Gaussian mixture) in the experiments. SVGD is expected to work for much more challenging problems, not for such simple tasks.

- The mathematical assumptions needed for the proof are too strong. For example, for Assumption 4 to hold for some uniform bound M, it essentially requires that $\pi$ and $\rho_0$ cannot be very different.
clarity,_quality,_novelty_and_reproducibility: The paper is written clearly. 

Some notations are confusing. 
- Equation 19: $ \left(\frac{\rho_n}{\pi}\right)^\beta(x)\left(\frac{\pi}{\rho_n}\right)^\beta \wedge M_{\rho_n}(\delta) $ should be $\left(\frac{\rho_n}{\pi}\right)^\beta(x) \left[ \left(\frac{\pi}{\rho_n}\right)^\beta \wedge M_{\rho_n}(\delta) \right] $.

- Assumption 5 $\nabla\left( \frac{\pi}{\rho_n} \right)^\beta$: it is unclear whether the power is outside or inside the gradient operator.
summary_of_the_review: The paper proposes $\beta$-SVGD but is unable to show that the algorithm works in higher dimensions or more complex problems. 
The convergence rate proof depends on unrealistic assumptions.
review_title: null

final_score: rating: 6: marginally above the acceptance threshold
review_content: summary_of_the_paper: The paper studies a generalization of Stein variational gradient descent by a particular preconditioner function (weight function). The objective is the same as the KL divergence. By assumptions, they show the convergence result. They also demonstrate the effectiveness of the method in simple numerical examples.  
strength_and_weaknesses: Strength: The preconditioner function (importance weights) is an interesting idea. 

Weaknesses: 

1. Please do not use the red color in the abstract for the KL divergence. 

2. The authors miss much important literature in modified Wasserstein gradient flows. Please discuss them in the literature. 

(1) A. Garbuno-Inigo, F. Hoffman, W. Li, A. Stuart, Interacting Langevin Diffusions: Gradient Structure And Ensemble Kalman Sampler, 2019. 
(2) W.C. Li, L.X. Ying. Hessian transport gradient flows. Research in the Mathematical Sciences, 2019.


clarity,_quality,_novelty_and_reproducibility: The quality of this paper is in the middle. Under the assumption, many convergence results can be formulated directly. 
I think the interesting part is either the analytical or numerical implementation of the methods. More numerical results are excepted. 
summary_of_the_review: The paper is overall written well with clear mathematics. However, much-related literature and many machine learning-related numerical examples are missing. I strongly suggest authors revise the paper accordingly.
review_title: null

final_score: rating: 3: reject, not good enough
review_content: summary_of_the_paper: This paper proposes enhancing SVGD using importance weights which scales the SVGD update directions by $(\pi / \rho_t)^\beta$. The resulting $\beta$-SVGD is then shown to have an exponential convergence rate in terms of 2-Renyi divergence under a Stein Poincare inequality assumption when $\beta = 1$ and another descent lemma is proved for $\beta \in (-1, 0)$ under quite a few assumptions. 

strength_and_weaknesses: ## Strengths:
* Applying importance reweighting to the popular SVGD is a meaningful task that is well-motivated.
* The resulting $\beta$-SVGD algorithm is simple and clean.
* Theoretical analyses demonstrate nice convergence properties of $\beta$-SVGD compared to SVGD.


## Weaknesses:
* It is unclear to me what the optimal $\beta$ is and the theories in Section 3 and Section 4 seem to suggest the opposite of each other. In Theorem 2 we take $\beta = 1$ to obtain exponential convergence under the Stein Poincare inequality, while in Proposition 1 we need $\beta \in (-1, 0)$.
* The selling point of the main Theorem 1 is that with $\beta \neq 0$ there is no dependence on $D_{KL}(\rho_0 || \pi)$. However, I do not consider (14) to be a strong result due to the minimization over $t \in [0,T]$ on the left side. As Korba et al. (2020) commented on their Proposition 3 (which is straightforward from their (12)), "the convergence of $I_{Stein}(\mu_t | \pi)$ itself can be arbitrarily slow" unless with more assumptions. 
* It is also unclear to me whether the proofs contain novel techniques or are simple adaptations of existing techniques, especially given a large number of assumptions. As mentioned in the paragraph before Remark 1, the importance weights $(\pi / \rho_t)^\beta$ is to cancel exactly the inverse term appearing in the Wasserstein gradient of $(\beta+1)$-Renyi divergence. Are there other insights in the proofs other than this kind of cancellation which seems by design?
* The algorithm is not very practical in my opinion, due to the presence of $\pi/\rho_t$ in the importance weights. In many applications (e.g. Bayesian inference with lots of samples), $\pi$ can be numerically insignificant whereas only $\log \pi$ is numerically reliable. Furthermore, the authors claim we can ignore the normalizing constant in $\pi$, yet this constant can change the step size drastically and must be addressed (this is not a problem of SVGD which only uses the score). Additionally, as already observed by the authors, $\rho_t$ can be too small when using kernel density estimation and can cause overflow --- a rather ad-hoc clipping trick is adopted but I doubt its effectiveness. A more practical reweighting scheme is by Xu et al. [1] and it should be compared to.
* The biggest weakness of the paper, to me, is that the paper has not demonstrated the effectiveness of the algorithm in any applications, despite the simple form of the algorithm. An extremely simple 1-D example is done in Figure 1 and in the appendix, and even then the proposed method does not seem to work well (in Figure 1 the green line is quite off from the target blue line). The authors wrote "more complicated models on high dimension space are out of our interest and ability" in the appendix, but such a statement is irresponsible. At the very least the authors should test on multivariate Gaussians in dimension 2 and above, and compute metrics (energy distance or Wasserstein distance) to evaluate the sample quality.


[1] Xu, L., Korba, A. &amp; Slepcev, D.. (2022). Accurate Quantization of Measures via Interacting Particle-based Optimization. <i>Proceedings of the 39th International Conference on Machine Learning</i>, in <i>Proceedings of Machine Learning Research</i> 162:24576-24595 Available from https://proceedings.mlr.press/v162/xu22d.html.

clarity,_quality,_novelty_and_reproducibility: The paper is written clearly and is easy to read. I do not find source code but the amount of experiments is also very minimal.

summary_of_the_review: Overall I think the proposed algorithm is well-motivated but its effectiveness has not been demonstrated, both in theory and in practice. Hence I'm leaning toward rejection.
review_title: null

Meta-review: metareview:_summary,_strengths_and_weaknesses: 
The paper proposes a variant of Stein variational gradient descent (SVGD) that uses importance weights to scale the update directions. The authors claim that the proposed method, -SVGD, has better convergence properties than SVGD in terms of 2-Renyi divergence and Stein Fisher information. They also provide some theoretical analyses and a simple numerical example to support their claims.

The reviewers appreciate the motivation and simplicity of the proposed method, but they also raise several major concerns that prevent the paper from being accepted. These concerns include:

- The lack of clarity and consistency in the choice of the parameter  and its relation to the convergence results. The paper seems to suggest different values of  for different scenarios, but does not provide any guidance or justification for choosing the optimal .
- The weakness and unrealisticness of the theoretical results. The main theorem relies on a minimization over  that can make the convergence arbitrarily slow, and the other results depend on strong assumptions that are unlikely to hold in practice. The reviewers also question the novelty and insight of the proof techniques, which seem to rely on simple cancellations by design.
- The impracticality and inefficiency of the algorithm. The paper does not address the numerical challenges of computing and normalizing the importance weights, which involve the evaluation of the target density  and its gradient. The paper also uses a crude clipping trick to avoid overflow, but does not justify its effectiveness or robustness. The reviewers suggest comparing the proposed method with a more practical reweighting scheme by Xu et al. (2022).
- The lack of empirical evaluation and demonstration. The paper only provides a very simple 1-D example that does not show any advantage of the proposed method over SVGD. The paper does not test the method on any high-dimensional or complex problems, which are the typical applications of SVGD. The reviewers expect the paper to provide more convincing and comprehensive experiments to validate the method.

In summary, the paper fails to demonstrate the significance and novelty of the proposed method, both theoretically and empirically. The paper also suffers from several technical and practical issues that limit its applicability and usefulness. Therefore, the paper is rejected.
justification_for_why_not_higher_score: 
The paper can not be accepted because it does not meet the standards of quality, novelty, and significance expected for a machine learning conference. The paper does not provide sufficient evidence or justification for its claims, and does not address the challenges and limitations of its method. The paper also does not show any clear advantage or benefit of its method over existing methods, and does not test its method on realistic or relevant problems. The paper needs major revisions and improvements to be considered for publication.
Decision: Reject