We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cond-mat.stat-mech

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Condensed Matter > Statistical Mechanics

Title: Adaptive power method for estimating large deviations in Markov chains

Abstract: We study the performance of a stochastic algorithm based on the power method that adaptively learns the large deviation functions characterizing the fluctuations of additive functionals of Markov processes, used in physics to model nonequilibrium systems. This algorithm was introduced in the context of risk-sensitive control of Markov chains and was recently adapted to diffusions evolving continuously in time. Here we provide an in-depth study of the convergence of this algorithm close to dynamical phase transitions, exploring the speed of convergence as a function of the learning rate and the effect of including transfer learning. We use as a test example the mean degree of a random walk on an Erd\"os-R\'enyi random graph, which shows a transition between high-degree trajectories of the random walk evolving in the bulk of the graph and low-degree trajectories evolving in dangling edges of the graph. The results show that the adaptive power method is efficient close to dynamical phase transitions, while having many advantages in terms of performance and complexity compared to other algorithms used to compute large deviation functions.
Comments: v1: 12 pages, 7 figures; v2: typos corrected, references updated, close to published version
Subjects: Statistical Mechanics (cond-mat.stat-mech)
Journal reference: Phys. Rev. E 107, 034137, 2023
DOI: 10.1103/PhysRevE.107.034137
Cite as: arXiv:2211.00060 [cond-mat.stat-mech]
  (or arXiv:2211.00060v2 [cond-mat.stat-mech] for this version)

Submission history

From: Hugo Touchette [view email]
[v1] Mon, 31 Oct 2022 18:15:42 GMT (3099kb,D)
[v2] Thu, 9 Feb 2023 09:48:19 GMT (3100kb,D)

Link back to: arXiv, form interface, contact.