We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cond-mat.dis-nn

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Condensed Matter > Disordered Systems and Neural Networks

Title: Introduction to dynamical mean-field theory of randomly connected neural networks with bidirectionally correlated couplings

Abstract: Dynamical mean-field theory is a powerful physics tool used to analyze the typical behavior of neural networks, where neurons can be recurrently connected, or multiple layers of neurons can be stacked. However, it is not easy for beginners to access the essence of this tool and the underlying physics. Here, we give a pedagogical introduction of this method in a particular example of random neural networks, where neurons are randomly and fully connected by correlated synapses and therefore the network exhibits rich emergent collective dynamics. We also review related past and recent important works applying this tool. In addition, a physically transparent and alternative method, namely the dynamical cavity method, is also introduced to derive exactly the same results. The numerical implementation of solving the integro-differential mean-field equations is also detailed, with an illustration of exploring the fluctuation dissipation theorem.
Comments: 27 pages, 5 figures, 44 references, revised version for SciPost Physics Lecture Notes
Subjects: Disordered Systems and Neural Networks (cond-mat.dis-nn); Statistical Mechanics (cond-mat.stat-mech); Machine Learning (cs.LG); Neurons and Cognition (q-bio.NC)
Journal reference: SciPost Phys. Lect. Notes 79 (2024)
DOI: 10.21468/SciPostPhysLectNotes.79
Cite as: arXiv:2305.08459 [cond-mat.dis-nn]
  (or arXiv:2305.08459v3 [cond-mat.dis-nn] for this version)

Submission history

From: Haiping Huang [view email]
[v1] Mon, 15 May 2023 09:01:40 GMT (75kb,D)
[v2] Tue, 16 May 2023 06:36:46 GMT (75kb,D)
[v3] Sat, 7 Oct 2023 07:42:32 GMT (122kb,D)

Link back to: arXiv, form interface, contact.