We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.IT

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Information Theory

Title: Information cohomology of classical vector-valued observables

Abstract: We provide here a novel algebraic characterization of two information measures associated with a vector-valued random variable, its differential entropy and the dimension of the underlying space, purely based on their recursive properties (the chain rule and the nullity-rank theorem, respectively). More precisely, we compute the information cohomology of Baudot and Bennequin with coefficients in a module of continuous probabilistic functionals over a category that mixes discrete observables and continuous vector-valued observables, characterizing completely the 1-cocycles; evaluated on continuous laws, these cocycles are linear combinations of the differential entropy and the dimension.
Comments: 10 pages, no figures. Conference paper (GSI2021)
Subjects: Information Theory (cs.IT); Category Theory (math.CT); Probability (math.PR)
MSC classes: 94A17, 18G90
Journal reference: Chapter 58 in F. Nielsen, F. Barbaresco (eds.). Geometric Science of Information: 5th International Conference, GSI 2021, Paris, France, 2021, Proceedings. LNCS Vol. 12829. Springer, 2021
Cite as: arXiv:2107.04377 [cs.IT]
  (or arXiv:2107.04377v1 [cs.IT] for this version)

Submission history

From: Juan Pablo Vigneaux [view email]
[v1] Fri, 9 Jul 2021 11:54:30 GMT (14kb)

Link back to: arXiv, form interface, contact.