Current browse context:
astro-ph.IM
Change to browse by:
References & Citations
Condensed Matter > Statistical Mechanics
Title: An intuition for physicists: information gain from experiments
(Submitted on 29 Apr 2022 (v1), last revised 26 Aug 2022 (this version, v3))
Abstract: How much one has learned from an experiment is quantifiable by the information gain, also known as the Kullback-Leibler divergence. The narrowing of the posterior parameter distribution $P(\theta|D)$ compared with the prior parameter distribution $\pi(\theta)$, is quantified in units of bits, as: $ D_{\mathrm{KL}}(P|\pi)=\int\log_{2}\left(\frac{P(\theta|D)}{\pi(\theta)}\right)\,P(\theta|D)\,d\theta $. This research note gives an intuition what one bit of information gain means. It corresponds to a Gaussian shrinking its standard deviation by a factor of three.
Submission history
From: Johannes Buchner [view email][v1] Fri, 29 Apr 2022 18:00:01 GMT (67kb,D)
[v2] Wed, 4 May 2022 08:34:59 GMT (67kb,D)
[v3] Fri, 26 Aug 2022 14:54:24 GMT (67kb,D)
Link back to: arXiv, form interface, contact.