We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cond-mat.dis-nn

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Condensed Matter > Disordered Systems and Neural Networks

Title: Connecting phase transition theory with unsupervised learning

Authors: Kun Huang
Abstract: Entropy and order parameter are two key concepts in phase transition theory. This paper proposes an unified method to both find order parameter and estimate entropy automatically with unsupervised learning. The contributions of this paper are threefold: First, it is shown that the cross-entropy loss of an optimum autoencoder could be used to estimate the physical entropy, which also explains why the critical temperature can be identified by the inflection point of the reconstruction loss. Second, a series of interpretable autoencoders are proposed which reproduce the ferromagnetic/antiferromagnetic (F/AF) order parameter in special cases. They provide us an intuitive prototype to understand the connection between unsupervised learning and phase transition theory. Third, we analyze spin glass phase with our method, the results suggest a "distributed" order parameter to describe spin-glass ground state, which is a natural generalization of F/AF order parameter with respect to the autoencoder.
Subjects: Disordered Systems and Neural Networks (cond-mat.dis-nn); Computational Physics (physics.comp-ph)
Cite as: arXiv:1712.05704 [cond-mat.dis-nn]
  (or arXiv:1712.05704v1 [cond-mat.dis-nn] for this version)

Submission history

From: Kun Huang Dr. [view email]
[v1] Fri, 15 Dec 2017 15:15:46 GMT (292kb,D)

Link back to: arXiv, form interface, contact.