Current browse context:
stat.ML
Change to browse by:
References & Citations
Statistics > Machine Learning
Title: Maximum Regularized Likelihood Estimators: A General Prediction Theory and Applications
(Submitted on 9 Oct 2017 (v1), last revised 17 Oct 2018 (this version, v2))
Abstract: Maximum regularized likelihood estimators (MRLEs) are arguably the most established class of estimators in high-dimensional statistics. In this paper, we derive guarantees for MRLEs in Kullback-Leibler divergence, a general measure of prediction accuracy. We assume only that the densities have a convex parametrization and that the regularization is definite and positive homogenous. The results thus apply to a very large variety of models and estimators, such as tensor regression and graphical models with convex and non-convex regularized methods. A main conclusion is that MRLEs are broadly consistent in prediction - regardless of whether restricted eigenvalues or similar conditions hold.
Submission history
From: Rui Zhuang [view email][v1] Mon, 9 Oct 2017 06:16:50 GMT (45kb)
[v2] Wed, 17 Oct 2018 05:13:06 GMT (377kb)
Link back to: arXiv, form interface, contact.