HackerPapers

arXiv:1203.3271cond-mat.stat-mech

The thermodynamics of prediction

Susanne Still, David A. Sivak, Anthony J. Bell, Gavin E. Crooks

Abstract

A system responding to a stochastic driving signal can be interpreted as computing, by means of its dynamics, an implicit model of the environmental variables. The system's state retains information about past environmental fluctuations, and a fraction of this information is predictive of future ones. The remaining nonpredictive information reflects model complexity that does not improve predictive power, and thus represents the ineffectiveness of the model. We expose the fundamental equivalence between this model inefficiency and thermodynamic inefficiency, measured by dissipation. Our results hold arbitrarily far from thermodynamic equilibrium and are applicable to a wide range of systems, including biomolecular machines. They highlight a profound connection between the effective use of information and efficient thermodynamic operation: any system constructed to keep memory about its environment and to operate with maximal energetic efficiency has to be predictive.

arXiv comments
5 pages, 1 figure
Journal reference
Phys. Rev. Lett. 109, 120604 (2012)
DOI
doi:10.1103/PhysRevLett.109.120604
Subjects
cond-mat.stat-mechStatistical Mechanics cs.ITInformation Theory q-bio.QMQuantitative Methods

On Hacker News

Linked by 2 identifiable commenters in 7 comments across 7 threads, from Jul 2021 to Oct 2023. Found in 1 HN submission from Dec 2023 to Dec 2023. Open submission discussions.

Comments linking this paper, per year.

Discussed in comments7 threads

    • We are a tad beyond handwaving, but with all the information overload it's hard to recognize scientific breakthroughs anymore. Anyway thermodynamics did it. https://arxiv.org/abs/1203.3271 Most people won't like this answer, because it's too impersonal. Thus the search for a…

      FluffyCloudsView on HNParent context

    • So there are two forces at work when it comes to evolution. The first is natural selection, which may start with random changes, where the structures that are beneficial tend to survive, hence there is a selection for them. The second is however that those random changes are…

      ComeviusView on HNParent context

    • No interpretation of quantum physics proposed by scientists ever required a conscious observer, that's more of a misinterpretation of what an observer is. It's an interaction, not a person or animal. As for the theory of consciousness, of course we are not special, it's…

      ComeviusView on HNParent context

    • The physical realm as you call it is the entire reality, it's the only thing you can interact with in an empirical manner. You don't need anything else to create consciousness, it's 100% physics, and would work quite differently if it wouldn't be. It's actually thermodynamics.…

      ComeviusView on HNParent context

    • It's physics. Any system responding to a stochastic driving system can be considered computing. In fact any system that retains information about past environmental fluctuations must have information that is predictive of future ones for the system to be thermodynamically…

      ComeviusView on HNParent context

    • > In other words, even if it were possible to map out the exact pattern of brain waves that give rise to a person’s momentary complex of awareness, that mapping would only explain the physical correlate of these experiences, but it wouldn’t be them. This is where Nagel is wrong.…

      ComeviusView on HNParent context

    • https://en.wikipedia.org/wiki/Exponential_growth Even with a constant entropy production rate there would be nowhere to run eventually. The Universe is a closed system. So you would always want to be thermodynamically efficient, which appears to also produce lifelike behavior.…

      ComeviusView on HNParent context

Submitted to Hacker News

Connected through shared HN threads, not inferred similarity or a recommendation.