We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Machine Learning

Title: Elastic-net Regularized High-dimensional Negative Binomial Regression: Consistency and Weak Signals Detection

Abstract: We study a sparse negative binomial regression (NBR) for count data by showing the non-asymptotic advantages of using the elastic-net estimator. Two types of oracle inequalities are derived for the NBR's elastic-net estimates by using the Compatibility Factor Condition and the Stabil Condition. The second type of oracle inequality is for the random design and can be extended to many $\ell_1 + \ell_2$ regularized M-estimations, with the corresponding empirical process having stochastic Lipschitz properties. We derive the concentration inequality for the suprema empirical processes for the weighted sum of negative binomial variables to show some high--probability events. We apply the method by showing the sign consistency, provided that the nonzero components in the true sparse vector are larger than a proper choice of the weakest signal detection threshold. In the second application, we show the grouping effect inequality with high probability. Third, under some assumptions for a design matrix, we can recover the true variable set with a high probability if the weakest signal detection threshold is large than the turning parameter up to a known constant. Lastly, we briefly discuss the de-biased elastic-net estimator, and numerical studies are given to support the proposal.
Comments: 27 pages
Subjects: Machine Learning (stat.ML); Probability (math.PR); Statistics Theory (math.ST)
Journal reference: Statistica Sinica,32(1),181-207 (2022)
DOI: 10.5705/ss.202019.0315
Report number: http://www3.stat.sinica.edu.tw/statistica/j32n1/J32n110/J32n110.html
Cite as: arXiv:1712.03412 [stat.ML]
  (or arXiv:1712.03412v4 [stat.ML] for this version)

Submission history

From: Huiming Zhang [view email]
[v1] Sat, 9 Dec 2017 17:08:08 GMT (37kb)
[v2] Fri, 26 Jan 2018 17:19:01 GMT (38kb)
[v3] Tue, 21 Apr 2020 17:58:50 GMT (27kb)
[v4] Fri, 11 Jun 2021 02:07:41 GMT (27kb)

Link back to: arXiv, form interface, contact.