HackerPapers

arXiv:1209.5500cond-mat.stat-mech

Is the Information Entropy the Same as the Statistical Mechanical Entropy?

Phil Attard

Early discovery. Linked by one identifiable commenter. This paper is outside the main ranking; a mention is not an endorsement.

Abstract

It is shown that the standard expression for the information entropy, originally due to Shannon, is only valid for a particular set of states. For the general case of statistical mechanics, one needs to include an additional term in the expression for the entropy as a function of the probability. A simple derivation of the general formula is given.

arXiv comments
4 pages
Journal reference
DOI
Subjects
cond-mat.stat-mechStatistical Mechanics physics.chem-phChemical Physics physics.data-anData Analysis, Statistics and Probability

On Hacker News

Linked by 1 identifiable commenter in 1 comment across 1 thread, from Sep 2017 to Sep 2017.

Comments linking this paper, per year.

Discussed in comments1 thread

  1. Physicists want to rebuild quantum theory from scratch 1 comment

    • > the connection between information theoretic entropy and physical entropy Has been a subject of interest for the last six decades, from http://compbio.biosci.uq.edu.au/mediawiki/upload/b/b3/Jaynes... to https://journals.aps.org/prl/pdf/10.1103/PhysRevLett.117.260... or…

      kgwgkView on HNParent context

Submitted to Hacker News

Connected through shared HN threads, not inferred similarity or a recommendation.