We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.IT

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Information Theory

Title: The information loss of a stochastic map

Abstract: We provide a stochastic extension of the Baez-Fritz-Leinster characterization of the Shannon information loss associated with a measure-preserving function. This recovers the conditional entropy and a closely related information-theoretic measure that we call conditional information loss. Although not functorial, these information measures are semi-functorial, a concept we introduce that is definable in any Markov category. We also introduce the notion of an entropic Bayes' rule for information measures, and we provide a characterization of conditional entropy in terms of this rule.
Comments: 31 pages; Typos fixed in Defn 2.12 and the proofs of Prop 4.2 iii) and Prop 6.8 (numbering scheme differs from published version)
Subjects: Information Theory (cs.IT); Category Theory (math.CT); Probability (math.PR)
MSC classes: 94A17 (Primary), 18A05, 62F15 (Secondary)
Journal reference: Entropy 2021, 23(8), 1021
DOI: 10.3390/e23081021
Cite as: arXiv:2107.01975 [cs.IT]
  (or arXiv:2107.01975v3 [cs.IT] for this version)

Submission history

From: Arthur Parzygnat [view email]
[v1] Mon, 5 Jul 2021 12:30:02 GMT (36kb)
[v2] Thu, 12 Aug 2021 14:55:53 GMT (36kb)
[v3] Wed, 22 Dec 2021 14:47:56 GMT (36kb)

Link back to: arXiv, form interface, contact.