We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ME

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Methodology

Title: Cooperative learning for multiview analysis

Abstract: We propose a new method for supervised learning with multiple sets of features ("views"). The multiview problem is especially important in biology and medicine, where "-omics" data such as genomics, proteomics and radiomics are measured on a common set of samples. Cooperative learning combines the usual squared error loss of predictions with an "agreement" penalty to encourage the predictions from different data views to agree. By varying the weight of the agreement penalty, we get a continuum of solutions that include the well-known early and late fusion approaches. Cooperative learning chooses the degree of agreement (or fusion) in an adaptive manner, using a validation set or cross-validation to estimate test set prediction error. One version of our fitting procedure is modular, where one can choose different fitting mechanisms (e.g. lasso, random forests, boosting, neural networks) appropriate for different data views. In the setting of cooperative regularized linear regression, the method combines the lasso penalty with the agreement penalty, yielding feature sparsity. The method can be especially powerful when the different data views share some underlying relationship in their signals that can be exploited to boost the signals. We show that cooperative learning achieves higher predictive accuracy on simulated data and a real multiomics example of labor onset prediction. Leveraging aligned signals and allowing flexible fitting mechanisms for different modalities, cooperative learning offers a powerful approach to multiomics data fusion.
Subjects: Methodology (stat.ME); Quantitative Methods (q-bio.QM); Machine Learning (stat.ML)
DOI: 10.1073/pnas.2202113119
Cite as: arXiv:2112.12337 [stat.ME]
  (or arXiv:2112.12337v6 [stat.ME] for this version)

Submission history

From: Daisy Yi Ding [view email]
[v1] Thu, 23 Dec 2021 03:13:25 GMT (401kb,D)
[v2] Tue, 28 Dec 2021 08:25:56 GMT (725kb,D)
[v3] Thu, 6 Jan 2022 05:46:08 GMT (725kb,D)
[v4] Mon, 31 Jan 2022 21:46:04 GMT (6927kb,D)
[v5] Thu, 9 Jun 2022 00:11:54 GMT (26749kb,D)
[v6] Sat, 3 Sep 2022 05:55:28 GMT (26736kb,D)

Link back to: arXiv, form interface, contact.