Current browse context:
stat.ME
Change to browse by:
References & Citations
Statistics > Methodology
Title: Hierarchical Sparse Modeling: A Choice of Two Regularizers
(Submitted on 5 Dec 2015 (this version), latest version 29 Nov 2017 (v4))
Abstract: Demanding sparsity in estimated models has become a routine practice in statistics. In many situations, we wish to demand that the sparsity patterns attained honor certain problem-specific constraints. Hierarchical sparse modeling (HSM) refers to situations in which these constraints specify that one set of parameters be set to zero whenever another is set to zero. In recent years, numerous papers have developed convex regularizers for this form of sparsity structure arising in areas including interaction modeling, time series, and covariance estimation. In this paper, we observe that these methods fall into two frameworks, which have not been systematically compared in the context of HSM. The purpose of this paper is to provide a side-by-side comparison of these two frameworks for HSM in terms of their statistical properties and computational efficiency. We call attention to a problem with the more commonly used framework and provide new insights into the other, which can greatly improve its computational performance. Finally, we compare the two methods in the context of covariance estimation, where we introduce a new sparsely-banded estimator, which we show achieves the statistical advantages of an existing method but is simpler to compute.
Submission history
From: Xiaohan Yan [view email][v1] Sat, 5 Dec 2015 07:00:54 GMT (1548kb,D)
[v2] Tue, 29 Nov 2016 02:13:49 GMT (7425kb,D)
[v3] Mon, 3 Jul 2017 04:03:45 GMT (4015kb,D)
[v4] Wed, 29 Nov 2017 20:05:56 GMT (4133kb)
Link back to: arXiv, form interface, contact.