We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Information Theory

Title: A Training-Based Mutual Information Lower Bound for Large-Scale Systems

Abstract: We provide a mutual information lower bound that can be used to analyze the effect of training in models with unknown parameters. For large-scale systems, we show that this bound can be calculated using the difference between two derivatives of a conditional entropy function. The bound does not require explicit estimation of the unknown parameters. We provide a step-by-step process for computing the bound, and provide an example application. A comparison with known classical mutual information bounds is provided.
Comments: This work has been submitted to the IEEE for possible publication. arXiv admin note: substantial text overlap with arXiv:2012.00970
Subjects: Information Theory (cs.IT)
Cite as: arXiv:2108.00034 [cs.IT]
  (or arXiv:2108.00034v1 [cs.IT] for this version)

Submission history

From: Xiangbo Meng [view email]
[v1] Fri, 30 Jul 2021 18:28:12 GMT (13287kb,D)

Link back to: arXiv, form interface, contact.