We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.NA

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Numerical Analysis

Title: Sparse additive function decompositions facing basis transforms

Abstract: High-dimensional real-world systems can often be well characterized by a small number of simultaneous low-complexity interactions. The analysis of variance (ANOVA) decomposition and the anchored decomposition are typical techniques to find sparse additive decompositions of functions. In this paper, we are interested in a setting, where these decompositions are not directly spare, but become so after an appropriate basis transform. Noting that the sparsity of those additive function decompositions is equivalent to the fact that most of its mixed partial derivatives vanish, we can exploit a connection to the underlying function graphs to determine an orthogonal transform that realizes the appropriate basis change. This is done in three steps: we apply singular value decomposition to minimize the number of vertices of the function graph, and joint block diagonalization techniques of families of matrices followed by sparse minimization based on relaxations of the zero ''norm'' for minimizing the number of edges. For the latter one, we propose and analyze minimization techniques over the manifold of special orthogonal matrices. Various numerical examples illustrate the reliability of our approach for functions having, after a basis transform, a sparse additive decomposition into summands with at most two variables.
Comments: 46 pages, 10 figures, 8 tables
Subjects: Numerical Analysis (math.NA); Optimization and Control (math.OC)
MSC classes: 26Bxx, 33F05, 58C05, 90C26, 65Kxx, 65F25, 15B99
Cite as: arXiv:2403.15563 [math.NA]
  (or arXiv:2403.15563v2 [math.NA] for this version)

Submission history

From: Fatima Antarou Ba [view email]
[v1] Fri, 22 Mar 2024 18:33:46 GMT (1294kb,D)
[v2] Thu, 28 Mar 2024 15:35:59 GMT (2015kb,D)

Link back to: arXiv, form interface, contact.