We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Machine Learning

Title: On the inconsistency of $\ell_1$-penalised sparse precision matrix estimation

Abstract: Various $\ell_1$-penalised estimation methods such as graphical lasso and CLIME are widely used for sparse precision matrix estimation. Many of these methods have been shown to be consistent under various quantitative assumptions about the underlying true covariance matrix. Intuitively, these conditions are related to situations where the penalty term will dominate the optimisation. In this paper, we explore the consistency of $\ell_1$-based methods for a class of sparse latent variable -like models, which are strongly motivated by several types of applications. We show that all $\ell_1$-based methods fail dramatically for models with nearly linear dependencies between the variables. We also study the consistency on models derived from real gene expression data and note that the assumptions needed for consistency never hold even for modest sized gene networks and $\ell_1$-based methods also become unreliable in practice for larger networks.
Comments: 9 pages, 10 figures
Subjects: Machine Learning (cs.LG); Computation (stat.CO); Machine Learning (stat.ML)
Cite as: arXiv:1603.02532 [cs.LG]
  (or arXiv:1603.02532v1 [cs.LG] for this version)

Submission history

From: Antti Honkela [view email]
[v1] Tue, 8 Mar 2016 14:24:11 GMT (960kb,D)

Link back to: arXiv, form interface, contact.