We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Optimization and Control

Title: Generalized maximum entropy estimation

Abstract: We consider the problem of estimating a probability distribution that maximizes the entropy while satisfying a finite number of moment constraints, possibly corrupted by noise. Based on duality of convex programming, we present a novel approximation scheme using a smoothed fast gradient method that is equipped with explicit bounds on the approximation error. We further demonstrate how the presented scheme can be used for approximating the chemical master equation through the zero-information moment closure method, and for an approximate dynamic programming approach in the context of constrained Markov decision processes with uncountable state and action spaces.
Comments: 29 pages, 3 figures; v2: approximate dynamic programming section added, v3: published version
Subjects: Optimization and Control (math.OC); Information Theory (cs.IT); Machine Learning (cs.LG)
MSC classes: 94A17, 90C25, 90C34, 65K05
Journal reference: Journal of Machine Learning Research, vol 20, 2019
Report number: http://jmlr.org/papers/v20/17-486.html
Cite as: arXiv:1708.07311 [math.OC]
  (or arXiv:1708.07311v3 [math.OC] for this version)

Submission history

From: Tobias Sutter [view email]
[v1] Thu, 24 Aug 2017 08:39:58 GMT (122kb)
[v2] Wed, 30 Jan 2019 10:42:37 GMT (233kb)
[v3] Sun, 8 Sep 2019 20:11:02 GMT (238kb)

Link back to: arXiv, form interface, contact.