Current browse context:
cs.IT
Change to browse by:
References & Citations
Computer Science > Information Theory
Title: Memory AMP
(Submitted on 20 Dec 2020 (v1), revised 5 Aug 2021 (this version, v4), latest version 23 Jun 2022 (v7))
Abstract: Approximate message passing (AMP) is a low-cost iterative parameter-estimation technique for certain high-dimensional linear systems with non-Gaussian distributions. However, AMP only applies to independent identically distributed (IID) transform matrices, but may become unreliable (e.g. perform poorly or even diverge) for other matrix ensembles, especially for ill-conditioned ones. Orthogonal/vector AMP (OAMP/VAMP) was proposed for general right-unitarily-invariant matrices to handle this difficulty. However, the Bayes-optimal OAMP/VAMP requires a high-complexity linear minimum mean square error (MMSE) estimator. This limits the application of OAMP/VAMP to large-scale systems.
To solve the disadvantages of AMP and OAMP/VAMP, this paper proposes a memory AMP (MAMP) framework under an orthogonality principle, which guarantees the asymptotic IID Gaussianity of estimation errors in MAMP. We present an orthogonalization procedure for the local memory estimators to realize the required orthogonality for MAMP. Furthermore, we propose a Bayes-optimal MAMP (BO-MAMP), in which a long-memory matched filter is proposed for interference suppression. The complexity of BO-MAMP is comparable to AMP. A state evolution is derived to asymptotically characterize the performance of BO-MAMP. Based on state evolution, the relaxation parameters and damping vector in BO-MAMP are optimized. For all right-unitarily-invariant matrices, the optimized BO-MAMP converges to the high-complexity OAMP/VAMP, and thus is Bayes-optimal if it has a unique fixed point. Finally, simulations are provided to verify the validity and accuracy of the theoretical results.
Submission history
From: Lei Liu [view email][v1] Sun, 20 Dec 2020 07:42:15 GMT (202kb,D)
[v2] Wed, 10 Feb 2021 14:31:38 GMT (305kb,D)
[v3] Thu, 3 Jun 2021 04:08:05 GMT (307kb,D)
[v4] Thu, 5 Aug 2021 04:37:16 GMT (686kb,D)
[v5] Thu, 30 Dec 2021 10:46:19 GMT (1348kb,D)
[v6] Thu, 26 May 2022 06:38:06 GMT (1364kb,D)
[v7] Thu, 23 Jun 2022 02:58:34 GMT (1144kb)
Link back to: arXiv, form interface, contact.