We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.CO

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Computation

Title: Nesterov smoothing for sampling without smoothness

Abstract: We study the problem of sampling from a target distribution in $\mathbb{R}^d$ whose potential is not smooth. Compared with the sampling problem with smooth potentials, this problem is much less well-understood due to the lack of smoothness. In this paper, we propose a novel sampling algorithm for a class of non-smooth potentials by first approximating them by smooth potentials using a technique that is akin to Nesterov smoothing. We then utilize sampling algorithms on the smooth potentials to generate approximate samples from the original non-smooth potentials. We select an appropriate smoothing intensity to ensure that the distance between the smoothed and un-smoothed distributions is minimal, thereby guaranteeing the algorithm's accuracy. Hence we obtain non-asymptotic convergence results based on existing analysis of smooth sampling. We verify our convergence result on a synthetic example and apply our method to improve the worst-case performance of Bayesian inference on a real-world example.
Subjects: Computation (stat.CO)
Journal reference: IEEE CDC 2023
Cite as: arXiv:2208.07459 [stat.CO]
  (or arXiv:2208.07459v3 [stat.CO] for this version)

Submission history

From: Jiaojiao Fan [view email]
[v1] Mon, 15 Aug 2022 22:31:55 GMT (432kb,D)
[v2] Thu, 16 Mar 2023 04:28:42 GMT (605kb,D)
[v3] Sat, 22 Jul 2023 21:26:10 GMT (599kb,D)

Link back to: arXiv, form interface, contact.