We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Machine Learning

Title: High Dimensional Multivariate Regression and Precision Matrix Estimation via Nonconvex Optimization

Abstract: We propose a nonconvex estimator for joint multivariate regression and precision matrix estimation in the high dimensional regime, under sparsity constraints. A gradient descent algorithm with hard thresholding is developed to solve the nonconvex estimator, and it attains a linear rate of convergence to the true regression coefficients and precision matrix simultaneously, up to the statistical error. Compared with existing methods along this line of research, which have little theoretical guarantee, the proposed algorithm not only is computationally much more efficient with provable convergence guarantee, but also attains the optimal finite sample statistical rate up to a logarithmic factor. Thorough experiments on both synthetic and real datasets back up our theory.
Comments: 32 pages, 5 figures, 3 tables
Subjects: Machine Learning (stat.ML)
Cite as: arXiv:1606.00832 [stat.ML]
  (or arXiv:1606.00832v1 [stat.ML] for this version)

Submission history

From: Quanquan Gu [view email]
[v1] Thu, 2 Jun 2016 19:59:44 GMT (806kb,D)

Link back to: arXiv, form interface, contact.