We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cond-mat

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Condensed Matter > Disordered Systems and Neural Networks

Title: Functional Optimisation of Online Algorithms in Multilayer Neural Networks

Abstract: We study the online dynamics of learning in fully connected soft committee machines in the student-teacher scenario. The locally optimal modulation function, which determines the learning algorithm, is obtained from a variational argument in such a manner as to maximise the average generalisation error decay per example. Simulations results for the resulting algorithm are presented for a few cases. The symmetric phase plateaux are found to be vastly reduced in comparison to those found when online backpropagation algorithms are used. A discussion of the implementation of these ideas as practical algorithms is given.
Subjects: Disordered Systems and Neural Networks (cond-mat.dis-nn)
Journal reference: J. Phys A: Math. Gen. 30 (1997) L599-L605
DOI: 10.1088/0305-4470/30/17/002
Cite as: arXiv:cond-mat/9706015 [cond-mat.dis-nn]
  (or arXiv:cond-mat/9706015v1 [cond-mat.dis-nn] for this version)

Submission history

From: Renato Vicente [view email]
[v1] Mon, 2 Jun 1997 23:19:57 GMT (49kb)

Link back to: arXiv, form interface, contact.