References & Citations
Mathematics > Statistics Theory
Title: On the minimax rate of the Gaussian sequence model under bounded convex constraints
(Submitted on 18 Jan 2022 (v1), last revised 7 Nov 2022 (this version, v5))
Abstract: We determine the exact minimax rate of a Gaussian sequence model under bounded convex constraints, purely in terms of the local geometry of the given constraint set $K$. Our main result shows that the minimax risk (up to constant factors) under the squared $\ell_2$ loss is given by $\epsilon^{*2} \wedge \operatorname{diam}(K)^2$ with \begin{align*}
\epsilon^* = \sup \bigg\{\epsilon : \frac{\epsilon^2}{\sigma^2} \leq \log M^{\operatorname{loc}}(\epsilon)\bigg\}, \end{align*} where $\log M^{\operatorname{loc}}(\epsilon)$ denotes the local entropy of the set $K$, and $\sigma^2$ is the variance of the noise. We utilize our abstract result to re-derive known minimax rates for some special sets $K$ such as hyperrectangles, ellipses, and more generally quadratically convex orthosymmetric sets. Finally, we extend our results to the unbounded case with known $\sigma^2$ to show that the minimax rate in that case is $\epsilon^{*2}$.
Submission history
From: Matey Neykov [view email][v1] Tue, 18 Jan 2022 21:50:52 GMT (45kb)
[v2] Wed, 16 Feb 2022 21:04:13 GMT (45kb)
[v3] Tue, 8 Mar 2022 14:15:57 GMT (45kb)
[v4] Mon, 3 Oct 2022 01:55:43 GMT (75kb)
[v5] Mon, 7 Nov 2022 14:05:15 GMT (65kb)
Link back to: arXiv, form interface, contact.