We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Machine Learning

Title: Two Methods For Wild Variational Inference

Abstract: Variational inference provides a powerful tool for approximate probabilistic in- ference on complex, structured models. Typical variational inference methods, however, require to use inference networks with computationally tractable proba- bility density functions. This largely limits the design and implementation of vari- ational inference methods. We consider wild variational inference methods that do not require tractable density functions on the inference networks, and hence can be applied in more challenging cases. As an example of application, we treat stochastic gradient Langevin dynamics (SGLD) as an inference network, and use our methods to automatically adjust the step sizes of SGLD, yielding significant improvement over the hand-designed step size schemes
Subjects: Machine Learning (stat.ML)
Cite as: arXiv:1612.00081 [stat.ML]
  (or arXiv:1612.00081v2 [stat.ML] for this version)

Submission history

From: Yihao Feng [view email]
[v1] Wed, 30 Nov 2016 23:55:57 GMT (6849kb,D)
[v2] Mon, 30 Oct 2017 22:05:18 GMT (2066kb,D)

Link back to: arXiv, form interface, contact.