References & Citations
Statistics > Computation
Title: Nesterov smoothing for sampling without smoothness
(Submitted on 15 Aug 2022 (v1), last revised 16 Mar 2023 (this version, v2))
Abstract: We study the problem of sampling from a target distribution in $\mathbb{R}^d$ whose potential is not smooth. Compared with the sampling problem with smooth potentials, this problem is much less well-understood due to the lack of smoothness. In this paper, we propose a novel sampling algorithm for a class of non-smooth potentials by first approximating them by smooth potentials using a technique that is akin to Nesterov smoothing. We then utilize sampling algorithms on the smooth potentials to generate approximate samples from the original non-smooth potentials. With a properly chosen smoothing intensity, the accuracy of the algorithm is guaranteed. Hence we obtain non-asymptotic convergence results based on existing analysis of smooth sampling. We verify our convergence result on a synthetic example and apply our method to improve the worst-case performance of Bayesian inference on a real-world example.
Submission history
From: Jiaojiao Fan [view email][v1] Mon, 15 Aug 2022 22:31:55 GMT (432kb,D)
[v2] Thu, 16 Mar 2023 04:28:42 GMT (605kb,D)
Link back to: arXiv, form interface, contact.