References & Citations
Statistics > Computation
Title: Nesterov smoothing for sampling without smoothness
(Submitted on 15 Aug 2022 (v1), last revised 22 Jul 2023 (this version, v3))
Abstract: We study the problem of sampling from a target distribution in $\mathbb{R}^d$ whose potential is not smooth. Compared with the sampling problem with smooth potentials, this problem is much less well-understood due to the lack of smoothness. In this paper, we propose a novel sampling algorithm for a class of non-smooth potentials by first approximating them by smooth potentials using a technique that is akin to Nesterov smoothing. We then utilize sampling algorithms on the smooth potentials to generate approximate samples from the original non-smooth potentials. We select an appropriate smoothing intensity to ensure that the distance between the smoothed and un-smoothed distributions is minimal, thereby guaranteeing the algorithm's accuracy. Hence we obtain non-asymptotic convergence results based on existing analysis of smooth sampling. We verify our convergence result on a synthetic example and apply our method to improve the worst-case performance of Bayesian inference on a real-world example.
Submission history
From: Jiaojiao Fan [view email][v1] Mon, 15 Aug 2022 22:31:55 GMT (432kb,D)
[v2] Thu, 16 Mar 2023 04:28:42 GMT (605kb,D)
[v3] Sat, 22 Jul 2023 21:26:10 GMT (599kb,D)
Link back to: arXiv, form interface, contact.