We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.IT

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Information Theory

Title: The cavity method for phase transitions in sparse reconstruction algorithms

Abstract: Sparse reconstruction algorithms aim to retrieve high-dimensional sparse signals from a limited amount of measurements under suitable conditions. These algorithms exhibit sharp algorithmic phase transition boundaries where the retrieval breaks down as the number of variables go to infinity. Sparse reconstruction algorithms are usually stated as optimization problems. These have been analyzed in the literature by defining associated statistical mechanical problems at a finite temperature, which are treated in the mean field approximation using the replica trick, and subsequently taking a zero temperature limit. Although this approach has been successful in reproducing the algorithmic phase transition boundaries, the replica trick and the non-trivial zero temperature limit obscures the underlying reasons for the failure of a compressed sensing algorithm. In this paper, we employ the "cavity method" to give an alternative derivation of the phase transition boundaries, working directly in the zero-temperature limit. This provides insight into the origin of the different terms in the mean field self-consistency equations. The cavity method naturally generates a susceptibility which provides insight into different phases in this system, and can be generalized for analysis of a broader class of sparse reconstruction algorithms.
Comments: 18 pages, 9 figures
Subjects: Information Theory (cs.IT); Disordered Systems and Neural Networks (cond-mat.dis-nn); Statistical Mechanics (cond-mat.stat-mech)
Cite as: arXiv:1501.03194 [cs.IT]
  (or arXiv:1501.03194v1 [cs.IT] for this version)

Submission history

From: Anirvan M. Sengupta [view email]
[v1] Tue, 13 Jan 2015 22:30:36 GMT (890kb,D)
[v2] Wed, 25 Nov 2015 20:02:07 GMT (983kb,D)

Link back to: arXiv, form interface, contact.