References & Citations
Condensed Matter > Disordered Systems and Neural Networks
Title: Phase transitions in optimal unsupervised learning
(Submitted on 25 Sep 1997 (this version), latest version 12 Nov 1997 (v2))
Abstract: We determine the optimal performance of learning the orientation of the symmetry axis of a set of P = alpha N points that are uniformly distributed in all the d irections but one on the N-dimensional sphere. The components along the symmetry breaking direction, of unitary vector B, are sampled from a mixture of two gaus sians of variable separation and width. The typical optimal performance is measu red through the overlap Ropt=B.J* where J* is the optimal guess of the symmetry breaking direction. Within this general scenario, the learning curves Ropt(alpha) may present first order transitions if the clusters are narrow enough. Close t o these transitions, high performance states can be obtained through the minimiz ation of the corresponding optimal potential, although these solutions are metas table, and therefore not learnable, within the usual bayesian scenario.
Submission history
From: Arnaud Buhot [view email][v1] Thu, 25 Sep 1997 09:51:53 GMT (164kb)
[v2] Wed, 12 Nov 1997 15:13:51 GMT (240kb)
Link back to: arXiv, form interface, contact.