We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Machine Learning

Title: An Interactive Greedy Approach to Group Sparsity in High Dimensions

Abstract: Sparsity learning with known grouping structure has received considerable attention due to wide modern applications in high-dimensional data analysis. Although advantages of using group information have been well-studied by shrinkage-based approaches, benefits of group sparsity have not been well-documented for greedy-type methods, which much limits our understanding and use of this important class of methods. In this paper, generalizing from a popular forward-backward greedy approach, we propose a new interactive greedy algorithm for group sparsity learning and prove that the proposed greedy-type algorithm attains the desired benefits of group sparsity under high dimensional settings. An estimation error bound refining other existing methods and a guarantee for group support recovery are also established simultaneously. In addition, we incorporate a general M-estimation framework and introduce an interactive feature to allow extra algorithm flexibility without compromise in theoretical properties. The promising use of our proposal is demonstrated through numerical evaluations including a real industrial application in human activity recognition at home. Supplementary materials for this article are available online.
Subjects: Machine Learning (stat.ML)
Cite as: arXiv:1707.02963 [stat.ML]
  (or arXiv:1707.02963v5 [stat.ML] for this version)

Submission history

From: Wei Qian [view email]
[v1] Mon, 10 Jul 2017 17:48:28 GMT (331kb,D)
[v2] Thu, 27 Jul 2017 15:29:29 GMT (805kb,D)
[v3] Wed, 2 May 2018 04:52:25 GMT (1851kb,D)
[v4] Mon, 27 Aug 2018 17:42:56 GMT (1855kb,D)
[v5] Wed, 26 Sep 2018 21:31:35 GMT (1890kb,D)

Link back to: arXiv, form interface, contact.