We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cond-mat.stat-mech

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Condensed Matter > Statistical Mechanics

Title: TMI: Thermodynamic inference of data manifolds

Abstract: The Gibbs-Boltzmann distribution offers a physically interpretable way to massively reduce the dimensionality of high dimensional probability distributions where the extensive variables are `features' and the intensive variables are `descriptors'. However, not all probability distributions can be modeled using the Gibbs-Boltzmann form. Here, we present TMI: TMI, {\bf T}hermodynamic {\bf M}anifold {\bf I}nference; a thermodynamic approach to approximate a collection of arbitrary distributions. TMI simultaneously learns from data intensive and extensive variables and achieves dimensionality reduction through a multiplicative, positive valued, and interpretable decomposition of the data. Importantly, the reduced dimensional space of intensive parameters is not homogeneous. The Gibbs-Boltzmann distribution defines an analytically tractable Riemannian metric on the space of intensive variables allowing us to calculate geodesics and volume elements. We discuss the applications of TMI with multiple real and artificial data sets. Possible extensions are discussed as well.
Subjects: Statistical Mechanics (cond-mat.stat-mech); Machine Learning (cs.LG); Quantitative Methods (q-bio.QM)
Journal reference: Phys. Rev. Research 2, 023201 (2020)
DOI: 10.1103/PhysRevResearch.2.023201
Cite as: arXiv:1911.09776 [cond-mat.stat-mech]
  (or arXiv:1911.09776v1 [cond-mat.stat-mech] for this version)

Submission history

From: Purushottam Dixit [view email]
[v1] Thu, 21 Nov 2019 22:52:56 GMT (649kb,D)

Link back to: arXiv, form interface, contact.