We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.ST

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Statistics Theory

Title: On the minimax rate of the Gaussian sequence model under bounded convex constraints

Authors: Matey Neykov
Abstract: We determine the exact minimax rate of a Gaussian sequence model under bounded convex constraints, purely in terms of the local geometry of the given constraint set $K$. Our main result shows that the minimax risk (up to constant factors) under the squared $\ell_2$ loss is given by $\epsilon^{*2} \wedge \operatorname{diam}(K)^2$ with \begin{align*}
\epsilon^* = \sup \bigg\{\epsilon : \frac{\epsilon^2}{\sigma^2} \leq \log M^{\operatorname{loc}}(\epsilon)\bigg\}, \end{align*} where $\log M^{\operatorname{loc}}(\epsilon)$ denotes the local entropy of the set $K$, and $\sigma^2$ is the variance of the noise. We utilize our abstract result to re-derive known minimax rates for some special sets $K$ such as hyperrectangles, ellipses, and more generally quadratically convex orthosymmetric sets. Finally, we extend our results to the unbounded case with known $\sigma^2$ to show that the minimax rate in that case is $\epsilon^{*2}$.
Comments: 34 pages; 1 picture; v5: fixed an error in example section 3.3.2
Subjects: Statistics Theory (math.ST)
Cite as: arXiv:2201.07329 [math.ST]
  (or arXiv:2201.07329v5 [math.ST] for this version)

Submission history

From: Matey Neykov [view email]
[v1] Tue, 18 Jan 2022 21:50:52 GMT (45kb)
[v2] Wed, 16 Feb 2022 21:04:13 GMT (45kb)
[v3] Tue, 8 Mar 2022 14:15:57 GMT (45kb)
[v4] Mon, 3 Oct 2022 01:55:43 GMT (75kb)
[v5] Mon, 7 Nov 2022 14:05:15 GMT (65kb)

Link back to: arXiv, form interface, contact.