References & Citations
Mathematics > Statistics Theory
Title: A Theoretical Framework for Bayesian Nonparametric Regression: Orthonormal Random Series and Rates of Contraction
(Submitted on 15 Dec 2017 (v1), revised 27 Jul 2018 (this version, v2), latest version 26 Apr 2019 (v3))
Abstract: We develop a unifying framework for Bayesian nonparametric regression to study the rates of contraction with respect to the integrated $L_2$-distance without assuming the regression function space to be uniformly bounded. The framework is built upon orthonormal random series in a flexible manner. A general theorem for deriving rates of contraction for Bayesian nonparametric regression is provided under the proposed framework. Three non-trivial applications of the proposed framework are provided: The finite random series regression of an $\alpha$-H\"older function, with adaptive rates of contraction up to a logarithmic factor, given independent and uniform design points; The un-modified block prior regression of an $\alpha$-Sobolev function, with adaptive-and-exact rates of contraction, given independent and uniform design points; The squared-exponential Gaussian process regression of a supersmooth function with a near-parametric rate of contraction, under the condition that the design points are fixed and reasonably spread. These applications serve as generalization or complement of their respective results in the literature. Extension to sparse additive models in high dimensions is discussed as well.
Submission history
From: Fangzheng Xie [view email][v1] Fri, 15 Dec 2017 16:18:43 GMT (84kb)
[v2] Fri, 27 Jul 2018 18:09:56 GMT (71kb)
[v3] Fri, 26 Apr 2019 23:40:05 GMT (73kb)
Link back to: arXiv, form interface, contact.