Current browse context:
stat.ML
Change to browse by:
References & Citations
Statistics > Machine Learning
Title: Fast structure learning with modular regularization
(Submitted on 11 Jun 2017 (v1), last revised 6 Sep 2019 (this version, v3))
Abstract: Estimating graphical model structure from high-dimensional and undersampled data is a fundamental problem in many scientific fields. Existing approaches, such as GLASSO, latent variable GLASSO, and latent tree models, suffer from high computational complexity and may impose unrealistic sparsity priors in some cases. We introduce a novel method that leverages a newly discovered connection between information-theoretic measures and structured latent factor models to derive an optimization objective which encourages modular structures where each observed variable has a single latent parent. The proposed method has linear stepwise computational complexity w.r.t. the number of observed variables. Our experiments on synthetic data demonstrate that our approach is the only method that recovers modular structure better as the dimensionality increases. We also use our approach for estimating covariance structure for a number of real-world datasets and show that it consistently outperforms state-of-the-art estimators at a fraction of the computational cost. Finally, we apply the proposed method to high-resolution fMRI data (with more than 10^5 voxels) and show that it is capable of extracting meaningful patterns.
Submission history
From: Greg Ver Steeg [view email][v1] Sun, 11 Jun 2017 13:36:00 GMT (3094kb,D)
[v2] Fri, 19 Jan 2018 16:56:26 GMT (3101kb,D)
[v3] Fri, 6 Sep 2019 19:11:16 GMT (561kb,D)
Link back to: arXiv, form interface, contact.