Current browse context:
math.NA
Change to browse by:
References & Citations
Mathematics > Numerical Analysis
Title: Generalization error of minimum weighted norm and kernel interpolation
(Submitted on 7 Aug 2020 (v1), last revised 9 Feb 2021 (this version, v3))
Abstract: We study the generalization error of functions that interpolate prescribed data points and are selected by minimizing a weighted norm. Under natural and general conditions, we prove that both the interpolants and their generalization errors converge as the number of parameters grow, and the limiting interpolant belongs to a reproducing kernel Hilbert space. This rigorously establishes an implicit bias of minimum weighted norm interpolation and explains why norm minimization may either benefit or suffer from over-parameterization. As special cases of this theory, we study interpolation by trigonometric polynomials and spherical harmonics. Our approach is from a deterministic and approximation theory viewpoint, as opposed to a statistical or random matrix one.
Submission history
From: Weilin Li [view email][v1] Fri, 7 Aug 2020 20:23:58 GMT (381kb)
[v2] Thu, 13 Aug 2020 19:38:07 GMT (381kb)
[v3] Tue, 9 Feb 2021 23:04:07 GMT (1191kb)
Link back to: arXiv, form interface, contact.