We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cond-mat.dis-nn

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Condensed Matter > Disordered Systems and Neural Networks

Title: Universality in reservoir computing and higher-order statistics

Abstract: In this work, we give a characterization of the reservoir computer (RC) by the network structure, especially the probability distribution of random coupling constants. First, based on the path integral method, we clarify the universal behavior of the random network dynamics in the thermodynamic limit, which depends only on the asymptotic behavior of the second cumulant generating functions of the network coupling constants. This result enables us to classify the random networks into several universality classes, according to the distribution function of coupling constants chosen for the networks. Interestingly, it is revealed that such a classification has a close relationship with the distribution of eigenvalues of the random coupling matrix. We also comment on the relation between our theory and a practical choice of random connectivity in the RC. Subsequently, we investigate the relationship between the RC's computational power and the network parameters for several universality classes. We perform several numerical simulations to evaluate the phase diagrams of the steady reservoir states, common signal-induced synchronization, and the computational power in the chaotic time-series predictions. As a result, we clarify the close relationship between these quantities, especially a remarkable computational performance near the phase transitions, which is realized near a non-chaotic transition boundary. These results may provide us with a new perspective on the designing principle for the RC.
Comments: 26 pages, 25 figures, 1 table
Subjects: Disordered Systems and Neural Networks (cond-mat.dis-nn)
Report number: KUNS-2906
Cite as: arXiv:2112.01886 [cond-mat.dis-nn]
  (or arXiv:2112.01886v1 [cond-mat.dis-nn] for this version)

Submission history

From: Junichi Haruna [view email]
[v1] Fri, 3 Dec 2021 12:54:41 GMT (8503kb,D)
[v2] Mon, 27 Feb 2023 08:00:27 GMT (7128kb,D)

Link back to: arXiv, form interface, contact.