We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.DS

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: A Letter on Convergence of In-Parameter-Linear Nonlinear Neural Architectures with Gradient Learnings

Abstract: This letter summarizes and proves the concept of bounded-input bounded-state (BIBS) stability for weight convergence of a broad family of in-parameter-linear nonlinear neural architectures as it generally applies to a broad family of incremental gradient learning algorithms. A practical BIBS convergence condition results from the derived proofs for every individual learning point or batches for real-time applications.
Comments: IEEE Trans. Neural Netw. Learn. Syst., Early Access
Subjects: Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE); Dynamical Systems (math.DS); Optimization and Control (math.OC)
DOI: 10.1109/TNNLS.2021.3123533
Cite as: arXiv:2111.12877 [cs.LG]
  (or arXiv:2111.12877v1 [cs.LG] for this version)

Submission history

From: Ivo Bukovsky Ph.D. [view email]
[v1] Thu, 25 Nov 2021 02:32:19 GMT (791kb)

Link back to: arXiv, form interface, contact.