We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Numerical Analysis

Title: Rank Bounds for Approximating Gaussian Densities in the Tensor-Train Format

Abstract: Low-rank tensor approximations have shown great potential for uncertainty quantification in high dimensions, for example, to build surrogate models that can be used to speed up large-scale inference problems (Eigel et al., Inverse Problems 34, 2018; Dolgov et al., Statistics & Computing 30, 2020). The feasibility and efficiency of such approaches depends critically on the rank that is necessary to represent or approximate the underlying distribution. In this paper, a-priori rank bounds for approximations in the functional tensor-train representation for the case of Gaussian models are developed. It is shown that under suitable conditions on the precision matrix, the Gaussian density can be approximated to high accuracy without suffering from an exponential growth of complexity as the dimension increases. These results provide a rigorous justification of the suitability and the limitations of low-rank tensor methods in a simple but important model case. Numerical experiments confirm that the rank bounds capture the qualitative behavior of the rank structure when varying the parameters of the precision matrix and the accuracy of the approximation. Finally, the practical relevance of the theoretical results is demonstrated in the context of a Bayesian filtering problem.
Comments: 25 pages, 6 figures
Subjects: Numerical Analysis (math.NA); Statistics Theory (math.ST)
MSC classes: 15A23, 15A69, 65C60, 65D32, 65D15, 41A10
Cite as: arXiv:2001.08187 [math.NA]
  (or arXiv:2001.08187v2 [math.NA] for this version)

Submission history

From: Paul Rohrbach [view email]
[v1] Wed, 22 Jan 2020 18:15:12 GMT (969kb,D)
[v2] Fri, 27 Nov 2020 15:39:59 GMT (2197kb,D)

Link back to: arXiv, form interface, contact.