References & Citations
Mathematics > Numerical Analysis
Title: A Riemannian Trust Region Method for the Canonical Tensor Rank Approximation Problem
(Submitted on 31 Aug 2017 (v1), last revised 11 Jul 2018 (this version, v2))
Abstract: The canonical tensor rank approximation problem (TAP) consists of approximating a real-valued tensor by one of low canonical rank, which is a challenging non-linear, non-convex, constrained optimization problem, where the constraint set forms a non-smooth semi-algebraic set. We introduce a Riemannian Gauss-Newton method with trust region for solving small-scale, dense TAPs. The novelty of our approach is threefold. First, we parametrize the constraint set as the Cartesian product of Segre manifolds, hereby formulating the TAP as a Riemannian optimization problem, and we argue why this parametrization is among the theoretically best possible. Second, an original ST-HOSVD-based retraction operator is proposed. Third, we introduce a hot restart mechanism that efficiently detects when the optimization process is tending to an ill-conditioned tensor rank decomposition and which often yields a quick escape path from such spurious decompositions. Numerical experiments show improvements of up to three orders of magnitude in terms of the expected time to compute a successful solution over existing state-of-the-art methods.
Submission history
From: Paul Breiding [view email][v1] Thu, 31 Aug 2017 18:35:50 GMT (102kb,AD)
[v2] Wed, 11 Jul 2018 08:28:08 GMT (125kb,AD)
Link back to: arXiv, form interface, contact.