Current browse context:
cs.IT
Change to browse by:
References & Citations
Computer Science > Information Theory
Title: Information cohomology of classical vector-valued observables
(Submitted on 9 Jul 2021)
Abstract: We provide here a novel algebraic characterization of two information measures associated with a vector-valued random variable, its differential entropy and the dimension of the underlying space, purely based on their recursive properties (the chain rule and the nullity-rank theorem, respectively). More precisely, we compute the information cohomology of Baudot and Bennequin with coefficients in a module of continuous probabilistic functionals over a category that mixes discrete observables and continuous vector-valued observables, characterizing completely the 1-cocycles; evaluated on continuous laws, these cocycles are linear combinations of the differential entropy and the dimension.
Link back to: arXiv, form interface, contact.