We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.CO

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Computation

Title: Nesterov smoothing for sampling without smoothness

Abstract: We study the problem of sampling from a target distribution in $\mathbb{R}^d$ whose potential is not smooth. Compared with the sampling problem with smooth potentials, this problem is much less well-understood due to the lack of smoothness. In this paper, we propose a novel sampling algorithm for a class of non-smooth potentials by first approximating them by smooth potentials using a technique that is akin to Nesterov smoothing. We then utilize sampling algorithms on the smooth potentials to generate approximate samples from the original non-smooth potentials. With a properly chosen smoothing intensity, the accuracy of the algorithm is guaranteed. Hence we obtain non-asymptotic convergence results based on existing analysis of smooth sampling. We verify our convergence result on a synthetic example and apply our method to improve the worst-case performance of Bayesian inference on a real-world example.
Subjects: Computation (stat.CO)
Cite as: arXiv:2208.07459 [stat.CO]
  (or arXiv:2208.07459v2 [stat.CO] for this version)

Submission history

From: Jiaojiao Fan [view email]
[v1] Mon, 15 Aug 2022 22:31:55 GMT (432kb,D)
[v2] Thu, 16 Mar 2023 04:28:42 GMT (605kb,D)

Link back to: arXiv, form interface, contact.