We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.OC

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Information Theory

Title: Matrix Infinitely Divisible Series: Tail Inequalities and Their Applications

Abstract: In this paper, we study tail inequalities of the largest eigenvalue of a matrix infinitely divisible (i.d.) series, which is a finite sum of fixed matrices weighted by i.d. random variables. We obtain several types of tail inequalities, including Bennett-type and Bernstein-type inequalities. This allows us to further bound the expectation of the spectral norm of a matrix i.d. series. Moreover, by developing a new lower-bound function for $Q(s)=(s+1)\log(s+1)-s$ that appears in the Bennett-type inequality, we derive a tighter tail inequality of the largest eigenvalue of the matrix i.d. series than the Bernstein-type inequality when the matrix dimension is high. The resulting lower-bound function is of independent interest and can improve any Bennett-type concentration inequality that involves the function $Q(s)$. The class of i.d. probability distributions is large and includes Gaussian and Poisson distributions, among many others. Therefore, our results encompass the existing work \cite{tropp2012user} on matrix Gaussian series as a special case. Lastly, we show that the tail inequalities of a matrix i.d. series have applications in several optimization problems including the chance constrained optimization problem and the quadratic optimization problem with orthogonality constraints. In addition, we also use the resulting tail bounds to show that random matrices constructed from i.d. random variables satisfy the restricted isometry property (RIP) when it acts as a measurement matrix in compressed sensing.
Comments: Final Version
Subjects: Information Theory (cs.IT); Optimization and Control (math.OC)
Journal reference: IEEE Transactions on Information Theory, vol. 66, no. 2, pp.1099-1117 (2020)
DOI: 10.1109/TIT.2019.2951759
Cite as: arXiv:1809.00781 [cs.IT]
  (or arXiv:1809.00781v2 [cs.IT] for this version)

Submission history

From: Min-Hsiu Hsieh [view email]
[v1] Tue, 4 Sep 2018 03:11:44 GMT (211kb)
[v2] Mon, 30 May 2022 05:07:44 GMT (1332kb)

Link back to: arXiv, form interface, contact.