We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cond-mat.dis-nn

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Condensed Matter > Disordered Systems and Neural Networks

Title: An Enquiry on similarities between Renormalization Group and Auto-Encoders using Transfer Learning

Abstract: Physicists have had a keen interest in the areas of Artificial Intelligence (AI) and Machine Learning (ML) for some time now, with a special inclination towards unravelling the mechanism at the core of the process of learning. In particular, exploring the underlying mathematical structure of a neural net (NN) is expected to not only help us in understanding the epistemological meaning of `Learning' but also has the potential to unravel the secrets behind the workings of the brain. Here, it is worthwhile to establish correspondences and draw parallels between methods developed in core areas of Physics and the techniques developed at the forefront of AI and ML. Although recent explorations indicating a mapping between the Renormalisation Group(RG) and Deep Learning(DL) have shown valuable insights, we intend to investigate the relationship between RG and Autoencoders(AE) in particular. We will use Transfer Learning(TL) to embed the procedure of coarse-graining in a NN and compare it with the underlying mechanism of encoding-decoding through a series of tests.
Comments: 16 figures, 1 table, 4 figures in appendix
Subjects: Disordered Systems and Neural Networks (cond-mat.dis-nn); Statistical Mechanics (cond-mat.stat-mech)
DOI: 10.1016/j.physa.2022.128276
Cite as: arXiv:2108.06157 [cond-mat.dis-nn]
  (or arXiv:2108.06157v2 [cond-mat.dis-nn] for this version)

Submission history

From: Ajay D. Thakur [view email]
[v1] Fri, 13 Aug 2021 10:24:13 GMT (7173kb,D)
[v2] Mon, 29 Nov 2021 10:45:01 GMT (4959kb)

Link back to: arXiv, form interface, contact.