Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: An AO-ADMM approach to constraining PARAFAC2 on all modes
(Submitted on 4 Oct 2021 (v1), last revised 8 Jul 2022 (this version, v3))
Abstract: Analyzing multi-way measurements with variations across one mode of the dataset is a challenge in various fields including data mining, neuroscience and chemometrics. For example, measurements may evolve over time or have unaligned time profiles. The PARAFAC2 model has been successfully used to analyze such data by allowing the underlying factor matrices in one mode (i.e., the evolving mode) to change across slices. The traditional approach to fit a PARAFAC2 model is to use an alternating least squares-based algorithm, which handles the constant cross-product constraint of the PARAFAC2 model by implicitly estimating the evolving factor matrices. This approach makes imposing regularization on these factor matrices challenging. There is currently no algorithm to flexibly impose such regularization with general penalty functions and hard constraints. In order to address this challenge and to avoid the implicit estimation, in this paper, we propose an algorithm for fitting PARAFAC2 based on alternating optimization with the alternating direction method of multipliers (AO-ADMM). With numerical experiments on simulated data, we show that the proposed PARAFAC2 AO-ADMM approach allows for flexible constraints, recovers the underlying patterns accurately, and is computationally efficient compared to the state-of-the-art. We also apply our model to two real-world datasets from neuroscience and chemometrics, and show that constraining the evolving mode improves the interpretability of the extracted patterns.
Submission history
From: Marie Roald [view email][v1] Mon, 4 Oct 2021 09:39:01 GMT (16892kb,D)
[v2] Fri, 1 Jul 2022 04:21:49 GMT (39958kb,D)
[v3] Fri, 8 Jul 2022 05:19:42 GMT (7588kb,D)
Link back to: arXiv, form interface, contact.