We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.NA

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Numerical Analysis

Title: Randomized Algorithms for Computation of Tucker decomposition and Higher Order SVD (HOSVD)

Abstract: Big data analysis has become a crucial part of new emerging technologies such as Internet of thing (IOT), cyber-physical analysis, deep learning, anomaly detection etc. Among many other techniques, dimensionality reduction plays a key role in such analyses and facilitates the procedure of feature selection and feature extraction. Randomized algorithms are efficient tools for handling big data tensors. They accelerate decomposing large-scale data tensors by reducing the computational complexity of deterministic algorithms and also reducing the communication among different levels of memory hierarchy which is a main bottleneck in modern computing environments and architectures. In this paper, we review recent advances in randomization for computation of Tucker decomposition and Higher Order SVD (HOSVD). We discuss both random projection and sampling approaches and also single-pass and multi-pass randomized algorithms and how they can be utilized in computation of Tucker decomposition and HOSVD. Simulations on real data including weight tensors of fully connected layers of pretrained VGG-16 and VGG-19 deep neural networks and also CIFAR-10 and CIFAR-100 datasets are provided to compare performance of some of the presented algorithms.
Subjects: Numerical Analysis (math.NA)
Cite as: arXiv:2001.07124 [math.NA]
  (or arXiv:2001.07124v3 [math.NA] for this version)

Submission history

From: Salman Ahmadi-Asl [view email]
[v1] Mon, 20 Jan 2020 14:40:59 GMT (3542kb,D)
[v2] Sun, 1 Mar 2020 13:01:59 GMT (3541kb,D)
[v3] Tue, 1 Sep 2020 23:05:18 GMT (3539kb,D)

Link back to: arXiv, form interface, contact.