We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cond-mat.stat-mech

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Condensed Matter > Statistical Mechanics

Title: Variability as a better characterization of Shannon entropy

Abstract: The Shannon entropy, one of the cornerstones of information theory, is widely used in physics, particularly in statistical mechanics. Yet its characterization and connection to physics remain vague, leaving ample room for misconceptions and misunderstanding. We will show that the Shannon entropy can be fully understood as measuring the variability of the elements within a given distribution: it characterizes how much variation can be found within a collection of objects. We will see that it is the only indicator that is continuous and linear, that it quantifies the number of yes/no questions (i.e. bits) that are needed to identify an element within the distribution, and we will see how applying this concept to statistical mechanics in different ways leads to the Boltzmann, Gibbs and von Neumann entropies.
Comments: 9 pages, no figures. Accepted for publication by European Journal of Physics
Subjects: Statistical Mechanics (cond-mat.stat-mech); Quantum Physics (quant-ph)
DOI: 10.1088/1361-6404/abe361
Cite as: arXiv:1912.02012 [cond-mat.stat-mech]
  (or arXiv:1912.02012v2 [cond-mat.stat-mech] for this version)

Submission history

From: Gabriele Carcassi [view email]
[v1] Tue, 3 Dec 2019 09:52:18 GMT (16kb)
[v2] Thu, 4 Feb 2021 20:13:03 GMT (18kb)

Link back to: arXiv, form interface, contact.