Current browse context:
stat.ML
Change to browse by:
References & Citations
Statistics > Machine Learning
Title: On Model Selection Consistency of Lasso for High-Dimensional Ising Models
(Submitted on 16 Oct 2021 (v1), last revised 17 Feb 2023 (this version, v4))
Abstract: We theoretically analyze the model selection consistency of least absolute shrinkage and selection operator (Lasso), both with and without post-thresholding, for high-dimensional Ising models. For random regular (RR) graphs of size $p$ with regular node degree $d$ and uniform couplings $\theta_0$, it is rigorously proved that Lasso \textit{without post-thresholding} is model selection consistent in the whole paramagnetic phase with the same order of sample complexity $n=\Omega{(d^3\log{p})}$ as that of $\ell_1$-regularized logistic regression ($\ell_1$-LogR). This result is consistent with the conjecture in Meng, Obuchi, and Kabashima 2021 using the non-rigorous replica method from statistical physics and thus complements it with a rigorous proof. For general tree-like graphs, it is demonstrated that the same result as RR graphs can be obtained under mild assumptions of the dependency condition and incoherence condition. Moreover, we provide a rigorous proof of the model selection consistency of Lasso with post-thresholding for general tree-like graphs in the paramagnetic phase without further assumptions on the dependency and incoherence conditions. Experimental results agree well with our theoretical analysis.
Submission history
From: Xiangming Meng [view email][v1] Sat, 16 Oct 2021 07:23:02 GMT (431kb,D)
[v2] Fri, 4 Feb 2022 13:50:19 GMT (565kb,D)
[v3] Sat, 15 Oct 2022 03:56:05 GMT (563kb,D)
[v4] Fri, 17 Feb 2023 06:20:44 GMT (572kb,D)
Link back to: arXiv, form interface, contact.