We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.IT

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Information Theory

Title: Synthesis of Gaussian Trees with Correlation Sign Ambiguity: An Information Theoretic Approach

Abstract: In latent Gaussian trees the pairwise correlation signs between the variables are intrinsically unrecoverable. Such information is vital since it completely determines the direction in which two variables are associated. In this work, we resort to information theoretical approaches to achieve two fundamental goals: First, we quantify the amount of information loss due to unrecoverable sign information. Second, we show the importance of such information in determining the maximum achievable rate region, in which the observed output vector can be synthesized, given its probability density function. In particular, we model the graphical model as a communication channel and propose a new layered encoding framework to synthesize observed data using upper layer Gaussian inputs and independent Bernoulli correlation sign inputs from each layer. We find the achievable rate region for the rate tuples of multi-layer latent Gaussian messages to synthesize the desired observables.
Comments: 14 pages, 9 figures, part of this work is submitted to Allerton 2016 conference, UIUC, IL, USA
Subjects: Information Theory (cs.IT); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)
Cite as: arXiv:1601.06403 [cs.IT]
  (or arXiv:1601.06403v5 [cs.IT] for this version)

Submission history

From: Ali Moharrer [view email]
[v1] Sun, 24 Jan 2016 15:59:44 GMT (131kb,D)
[v2] Thu, 14 Apr 2016 03:42:18 GMT (144kb,D)
[v3] Sat, 23 Apr 2016 21:59:49 GMT (156kb,D)
[v4] Mon, 4 Jul 2016 16:24:03 GMT (156kb,D)
[v5] Thu, 7 Jul 2016 22:04:07 GMT (155kb,D)

Link back to: arXiv, form interface, contact.