References & Citations
Mathematics > Numerical Analysis
Title: An overview of block Gram-Schmidt methods and their stability properties
(Submitted on 22 Oct 2020 (v1), last revised 21 Aug 2021 (this version, v3))
Abstract: Block Gram-Schmidt algorithms serve as essential kernels in many scientific computing applications, but for many commonly used variants, a rigorous treatment of their stability properties remains open. This work provides a comprehensive categorization of block Gram-Schmidt algorithms, particularly those used in Krylov subspace methods to build orthonormal bases one block vector at a time. Known stability results are assembled, and new results are summarized or conjectured for important communication-reducing variants. Additionally, new block versions of low-synchronization variants are derived, and their efficacy and stability are demonstrated for a wide range of challenging examples. Numerical examples are computed with a versatile MATLAB package hosted at this https URL, and scripts for reproducing all results in the paper are provided. Block Gram-Schmidt implementations in popular software packages are discussed, along with a number of open problems. An appendix containing all algorithms type-set in a uniform fashion is provided.
Submission history
From: Kathryn Lund [view email][v1] Thu, 22 Oct 2020 21:01:32 GMT (350kb)
[v2] Thu, 3 Dec 2020 17:15:19 GMT (350kb)
[v3] Sat, 21 Aug 2021 08:53:04 GMT (1106kb,D)
Link back to: arXiv, form interface, contact.