We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.ST

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Statistics Theory

Title: Optimal robust mean and location estimation via convex programs with respect to any pseudo-norms

Abstract: We consider the problem of robust mean and location estimation w.r.t. any pseudo-norm of the form $x\in\mathbb{R}^d\to ||x||_S = \sup_{v\in S}<v,x>$ where $S$ is any symmetric subset of $\mathbb{R}^d$. We show that the deviation-optimal minimax subgaussian rate for confidence $1-\delta$ is $$
\max\left(\frac{l^*(\Sigma^{1/2}S)}{\sqrt{N}}, \sup_{v\in S}||\Sigma^{1/2}v||_2\sqrt{\frac{\log(1/\delta)}{N}}\right) $$where $l^*(\Sigma^{1/2}S)$ is the Gaussian mean width of $\Sigma^{1/2}S$ and $\Sigma$ the covariance of the data (in the benchmark i.i.d. Gaussian case). This improves the entropic minimax lower bound from [Lugosi and Mendelson, 2019] and closes the gap characterized by Sudakov's inequality between the entropy and the Gaussian mean width for this problem. This shows that the right statistical complexity measure for the mean estimation problem is the Gaussian mean width. We also show that this rate can be achieved by a solution to a convex optimization problem in the adversarial and $L_2$ heavy-tailed setup by considering minimum of some Fenchel-Legendre transforms constructed using the Median-of-means principle. We finally show that this rate may also be achieved in situations where there is not even a first moment but a location parameter exists.
Subjects: Statistics Theory (math.ST)
MSC classes: 62F35
ACM classes: G.3.3
Cite as: arXiv:2102.00995 [math.ST]
  (or arXiv:2102.00995v1 [math.ST] for this version)

Submission history

From: Guillaume Lecué [view email]
[v1] Mon, 1 Feb 2021 17:19:38 GMT (48kb)

Link back to: arXiv, form interface, contact.