Current browse context:
stat
Change to browse by:
References & Citations
Mathematics > Statistics Theory
Title: Optimality of Maximum Likelihood for Log-Concave Density Estimation and Bounded Convex Regression
(Submitted on 13 Mar 2019 (v1), last revised 20 Feb 2020 (this version, v4))
Abstract: In this paper, we study two problems: (1) estimation of a $d$-dimensional log-concave distribution and (2) bounded multivariate convex regression with random design with an underlying log-concave density or a compactly supported distribution with a continuous density.
First, we show that for all $d \ge 4$ the maximum likelihood estimators of both problems achieve an optimal risk of $\Theta_d(n^{-2/(d+1)})$ (up to a logarithmic factor) in terms of squared Hellinger distance and $L_2$ squared distance, respectively. Previously, the optimality of both these estimators was known only for $d\le 3$. We also prove that the $\epsilon$-entropy numbers of the two aforementioned families are equal up to logarithmic factors. We complement these results by proving a sharp bound $\Theta_d(n^{-2/(d+4)})$ on the minimax rate (up to logarithmic factors) with respect to the total variation distance.
Finally, we prove that estimating a log-concave density - even a uniform distribution on a convex set - up to a fixed accuracy requires the number of samples \emph{at least} exponential in the dimension. We do that by improving the dimensional constant in the best known lower bound for the minimax rate from $2^{-d}\cdot n^{-2/(d+1)}$ to $c\cdot n^{-2/(d+1)}$ (when $d\geq 2$).
Submission history
From: Gil Kur [view email][v1] Wed, 13 Mar 2019 04:58:36 GMT (30kb)
[v2] Fri, 30 Aug 2019 06:19:37 GMT (83kb)
[v3] Fri, 15 Nov 2019 13:16:32 GMT (38kb)
[v4] Thu, 20 Feb 2020 13:32:11 GMT (38kb)
Link back to: arXiv, form interface, contact.