References & Citations
Condensed Matter > Disordered Systems and Neural Networks
Title: Dynamical and Stationary Properties of On-line Learning from Finite Training Sets
(Submitted on 29 Aug 2002)
Abstract: The dynamical and stationary properties of on-line learning from finite training sets are analysed using the cavity method. For large input dimensions, we derive equations for the macroscopic parameters, namely, the student-teacher correlation, the student-student autocorrelation and the learning force uctuation. This enables us to provide analytical solutions to Adaline learning as a benchmark. Theoretical predictions of training errors in transient and stationary states are obtained by a Monte Carlo sampling procedure. Generalization and training errors are found to agree with simulations. The physical origin of the critical learning rate is presented. Comparison with batch learning is discussed throughout the paper.
Link back to: arXiv, form interface, contact.