Title: A constrained L1 minimization approach for estimating multiple Sparse Gaussian or Nonparanormal Graphical Models

Abstract: The flood of multi-context measurement data from many scientific domains have created an urgent need to reconstruct context-specific variable networks, that can significantly simplify network-driven studies. Computationally, this problem can be formulated as jointly estimating multiple different, but related, sparse Undirected Graphical Models (UGM) from samples aggregated across several tasks. Previous joint-UGM studies could not fully address the challenge since they mostly focus on Gaussian Graphical Models (GGM) and have used likelihood-based formulations to push multiple estimated networks toward a common pattern. Differently, we propose a novel approach, SIMULE (learning Shared and Individual parts of MULtiple graphs Explicitly) to solve multi-task UGM using a l1 constrained optimization. SIMULE can handle both multivariate Gaussian and multivariate Nonparanormal data (greatly relaxing the normality assumption most real data do not follow). SIMULE is cast as independent subproblems of linear programming that can be solved efficiently. It automatically infers specific dependencies that are unique to each context as well as shared substructures preserved among all the contexts. Theoretically we prove that SIMULE achieves a consistent estimation at rate O(log(Kp)/ntot) (not been proved before). On four synthetic datasets and two real datasets, SIMULE shows significant improvements over state-of-the-art multi-sGGM and single-UGM baselines.