Current browse context:
math.CT
Change to browse by:
References & Citations
Computer Science > Information Theory
Title: The information loss of a stochastic map
(Submitted on 5 Jul 2021 (v1), last revised 22 Dec 2021 (this version, v3))
Abstract: We provide a stochastic extension of the Baez-Fritz-Leinster characterization of the Shannon information loss associated with a measure-preserving function. This recovers the conditional entropy and a closely related information-theoretic measure that we call conditional information loss. Although not functorial, these information measures are semi-functorial, a concept we introduce that is definable in any Markov category. We also introduce the notion of an entropic Bayes' rule for information measures, and we provide a characterization of conditional entropy in terms of this rule.
Submission history
From: Arthur Parzygnat [view email][v1] Mon, 5 Jul 2021 12:30:02 GMT (36kb)
[v2] Thu, 12 Aug 2021 14:55:53 GMT (36kb)
[v3] Wed, 22 Dec 2021 14:47:56 GMT (36kb)
Link back to: arXiv, form interface, contact.