HackerPapers

arXiv:0812.4360cs.AI

Driven by Compression Progress: A Simple Principle Explains Essential Aspects of Subjective Beauty, Novelty, Surprise, Interestingness, Attention, Curiosity, Creativity, Art, Science, Music, Jokes

Juergen Schmidhuber

Abstract

I argue that data becomes temporarily interesting by itself to some self-improving, but computationally limited, subjective observer once he learns to predict or compress the data in a better way, thus making it subjectively simpler and more beautiful. Curiosity is the desire to create or discover more non-random, non-arbitrary, regular data that is novel and surprising not in the traditional sense of Boltzmann and Shannon but in the sense that it allows for compression progress because its regularity was not yet known. This drive maximizes interestingness, the first derivative of subjective beauty or compressibility, that is, the steepness of the learning curve. It motivates exploring infants, pure mathematicians, composers, artists, dancers, comedians, yourself, and (since 1990) artificial systems.

arXiv comments
35 pages, 3 figures, based on KES 2008 keynote and ALT 2007 / DS 2007 joint invited lecture
Journal reference
Short version: J. Schmidhuber. Simple Algorithmic Theory of Subjective Beauty, Novelty, Surprise, Interestingness, Attention, Curiosity, Creativity, Art, Science, Music, Jokes. Journal of SICE 48(1), 21-32, 2009
DOI
Subjects
cs.AIArtificial Intelligence cs.NENeural and Evolutionary Computing

On Hacker News

Linked by 10 identifiable commenters in 11 comments across 11 threads, from Sep 2017 to Oct 2026. Found in 9 HN submissions from Jan 2017 to Nov 2024. Open submission discussions.

Comments linking this paper, per year.

Discussed in comments11 threads

  1. How is music possible 1 comment
    • Schmidthuber has an answer: https://arxiv.org/abs/0812.4360 For a more practical approach you need to use proxies: https://zby.github.io/commonplace/articles/what-an-automated...

      zbyforgotpView on HNParent context

  2. Compression is prediction 1 comment
    • Schmidhuber did it first: Driven by Compression Progress: A Simple Principle Explains Essential Aspects of Subjective Beauty, Novelty, Surprise, Interestingness, Attention, Curiosity, Creativity, Art, Science, Music, Jokes https://arxiv.org/abs/0812.4360

      rrherrView on HNParent context

  3. ARC-AGI without pretraining 1 comment
    • Schmidhuber reached your conclusions first. Driven by Compression Progress: A Simple Principle Explains Essential Aspects of Subjective Beauty, Novelty, Surprise, Interestingness, Attention, Curiosity, Creativity, Art, Science, Music, Jokes https://arxiv.org/abs/0812.4360

      passion__desireView on HNParent context

  4. Compressing Hegel (2020) 1 comment
    • reminds me of https://arxiv.org/abs/0812.4360 > I argue that data becomes temporarily interesting by itself to some self-improving, but computationally limited, subjective observer once he learns to predict or compress the data in a better way, thus making it subjectively…

      evertedsphereView on HNParent context

    • If your job is to attract an agent that is playing a careful balance between exploration and exploitation, while on tight computational budget, then you want to attract them with some initial hooks (e.g. bright colors) and appease their computational risk assessment module with…

      0xBABAD00CView on HNParent context

  5. Hutter Prize 1 comment
    • First, the competition does place a time limit (in fact several resource limits). I agree that it may be too lax to judge consumer-oriented compression algorithms. That is not what this competition is about. The goal is maximizing compression ratio - with the aim of affecting…

      parenthesesView on HNParent context

  6. Information Is Surprise (2015) 1 comment
    • There's a paper by Schmidhuber [1] in which he argues, IIRC, that not the surprise as in high or just-right entropy is what satisfies the observer of e.g. art, but the fact that it teaches you a new, previously unknown pattern of regularity about the world which allows you to…

      bschneView on HNParent context

  7. Intelligence Reconsidered 1 comment
    • https://arxiv.org/abs/0812.4360 Juergen Schmidhuber - Driven by Compression Progress: A Simple Principle Explains Essential Aspects of Subjective Beauty, Novelty, Surprise, Interestingness, Attention, Curiosity, Creativity, Art, Science, Music, Jokes (2002)

      pizzaView on HNParent context

  8. Ask HN: CS as a philosophy 1 comment
    • allow me to make your day: - Computational trinitarianism, or how 1.) propositions as types, 2.) programs as proofs, and 3.) the relation between type theory and category theory are one and the same thing [0] - Scott aaronson's excellent "Why Philosophers Should Care About…

      pizzaView on HNParent context

Submitted to Hacker News

Connected through shared HN threads, not inferred similarity or a recommendation.