References & Citations
Mathematics > Statistics Theory
Title: Learning by mirror averaging
(Submitted on 18 Nov 2005 (v1), last revised 5 Nov 2008 (this version, v4))
Abstract: Given a finite collection of estimators or classifiers, we study the problem of model selection type aggregation, that is, we construct a new estimator or classifier, called aggregate, which is nearly as good as the best among them with respect to a given risk criterion. We define our aggregate by a simple recursive procedure which solves an auxiliary stochastic linear programming problem related to the original nonlinear one and constitutes a special case of the mirror averaging algorithm. We show that the aggregate satisfies sharp oracle inequalities under some general assumptions. The results are applied to several problems including regression, classification and density estimation.
Submission history
From: Philippe Rigollet [view email] [via CCSD proxy][v1] Fri, 18 Nov 2005 13:13:33 GMT (18kb)
[v2] Tue, 11 Apr 2006 05:41:54 GMT (19kb)
[v3] Wed, 3 May 2006 08:52:08 GMT (18kb)
[v4] Wed, 5 Nov 2008 06:27:11 GMT (94kb,S)
Link back to: arXiv, form interface, contact.