We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:


References & Citations

DBLP - CS Bibliography


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: The Exact Sample Complexity Gain from Invariances for Kernel Regression on Manifolds

Abstract: In practice, encoding invariances into models helps sample complexity. In this work, we tighten and generalize theoretical results on how invariances improve sample complexity. In particular, we provide minimax optimal rates for kernel ridge regression on any manifold, with a target function that is invariant to an arbitrary group action on the manifold. Our results hold for (almost) any group action, even groups of positive dimension. For a finite group, the gain increases the "effective" number of samples by the group size. For groups of positive dimension, the gain is observed by a reduction in the manifold's dimension, in addition to a factor proportional to the volume of the quotient space. Our proof takes the viewpoint of differential geometry, in contrast to the more common strategy of using invariant polynomials. Hence, this new geometric viewpoint on learning with invariances may be of independent interest.
Subjects: Machine Learning (cs.LG)
Cite as: arXiv:2303.14269 [cs.LG]
  (or arXiv:2303.14269v1 [cs.LG] for this version)

Submission history

From: Behrooz Tahmasebi [view email]
[v1] Fri, 24 Mar 2023 20:47:31 GMT (44kb)

Link back to: arXiv, form interface, contact.