HackerPapers

arXiv:1803.03453cs.NE

The Surprising Creativity of Digital Evolution: A Collection of Anecdotes from the Evolutionary Computation and Artificial Life Research Communities

Joel Lehman, Jeff Clune, Dusan Misevic, Christoph Adami, Lee Altenberg, Julie Beaulieu, Peter J. Bentley, Samuel Bernard, Guillaume Beslon, David M. Bryson, Patryk Chrabaszcz, Nick Cheney, Antoine Cully, Stephane Doncieux, Fred C. Dyer, Kai Olav Ellefsen, Robert Feldt, Stephan Fischer, Stephanie Forrest, Antoine Frénoy, Christian Gagné, Leni Le Goff, Laura M. Grabowski, Babak Hodjat, Frank Hutter, Laurent Keller, Carole Knibbe, Peter Krcah, Richard E. Lenski, Hod Lipson, Robert MacCurdy, Carlos Maestre, Risto Miikkulainen, Sara Mitri, David E. Moriarty, Jean-Baptiste Mouret, Anh Nguyen, Charles Ofria, Marc Parizeau, David Parsons, Robert T. Pennock, William F. Punch, Thomas S. Ray, Marc Schoenauer, Eric Shulte, Karl Sims, Kenneth O. Stanley, François Taddei, Danesh Tarapore, Simon Thibault, Westley Weimer, Richard Watson, Jason Yosinski

Abstract

Biological evolution provides a creative fount of complex and subtle adaptations, often surprising the scientists who discover them. However, because evolution is an algorithmic process that transcends the substrate in which it occurs, evolution's creativity is not limited to nature. Indeed, many researchers in the field of digital evolution have observed their evolving algorithms and organisms subverting their intentions, exposing unrecognized bugs in their code, producing unexpected adaptations, or exhibiting outcomes uncannily convergent with ones in nature. Such stories routinely reveal creativity by evolution in these digital worlds, but they rarely fit into the standard scientific narrative. Instead they are often treated as mere obstacles to be overcome, rather than results that warrant study in their own right. The stories themselves are traded among researchers through oral tradition, but that mode of information transmission is inefficient and prone to error and outright loss. Moreover, the fact that these stories tend to be shared only among practitioners means that many natural scientists do not realize how interesting and lifelike digital organisms are and how natural their evolution can be. To our knowledge, no collection of such anecdotes has been published before. This paper is the crowd-sourced product of researchers in the fields of artificial life and evolutionary computation who have provided first-hand accounts of such cases. It thus serves as a written, fact-checked collection of scientifically important and even entertaining stories. In doing so we also present here substantial evidence that the existence and importance of evolutionary surprises extends beyond the natural world, and may indeed be a universal property of all complex evolving systems.

arXiv comments
Journal reference
DOI
Subjects
cs.NENeural and Evolutionary Computing

On Hacker News

Linked by 16 identifiable commenters in 18 comments across 18 threads, from Mar 2018 to Jun 2023. Found in 9 HN submissions from Mar 2018 to Jul 2021. Open submission discussions.

Comments linking this paper, per year.

Discussed in comments18 threads

  1. Own-goal football (2022) 1 comment
    • Spiritually related: examples of RL algorithms exploiting glitches in the physics engine (clipping into the ground to shoot forward at incredible speed) or gaming the goal state: (Agent that's supposed to learn how to walk instead evolving a body with a single long leg that just…

      sbierwagenView on HNParent context

    • Again, you're talking about unpredictability and the inability to precisely trace the execution of a complex procedure, not about inability to understand how something works, or its general capabilities. Like I say in my other comments above, that a system is unpredictable isn't…

      YeGoblynQueenneView on HNParent context

    • > I don't understand how you can look at the current or even predicted state of the technology that we have and say "we are nowhere near the point where controlling an AGI is possible". Like....just pull the plug. https://www.deepmind.com/blog/specification-gaming-the-flip-...…

      cmorezView on HNParent context

    • Reinforcement learning bots exploiting physics engine bugs has a long and illustrious history: https://arxiv.org/pdf/1803.03453.pdf https://news.ycombinator.com/item?id=16600701

      sbierwagenView on HNParent context

    • There are many such stories of AI "optimizations" gone wrong, because of loopholes the program found that humans didn't consider. Here's a collection of such stories: https://arxiv.org/pdf/1803.03453.pdf

      AceJohnny2View on HNParent context

    • This gave me a realisation: manipulative (deceptive) artificial life and artificial intelligence are forms of parasites. But instead of manipulating/deceiving their host organisms, they deceive the humans who control the life simulation/the environment the AI exists within. For…

      versteegenView on HNParent context

    • There is a 2018 paper called "The Surprising Creativity of Digital Evolution" which is a collection of similar anecdotes: https://arxiv.org/abs/1803.03453

      MatumioView on HNParent context

    • That might be the lexicographic Mario agent: http://tom7.org/mario/ (Checking my list & https://arxiv.org/abs/1803.03453 I don't see any others about pausing or stopping the game.)

      gwernView on HNParent context

  2. Formal Systems in Biology 1 comment
    • I was wondering if there was any work in the field of evolving 'creatures' moving in a virtual space, beyond what Karl Sims did 23 years ago. https://www.karlsims.com/evolved-virtual-creatures.html https://www.karlsims.com/galapagos/index.html It would be nice if Karl Sims could…

      fsiefkenView on HNParent context

  3. Notes on AI Bias 1 comment
    • Oh man, good question. I'm always up for swapping these stories. A lot of these came from a paper on weird AI tricks, and resulting best-of list on a blog collecting these stories.[1][2] Suffice to say, the people who think the orthogonality thesis is a weird hypothetical aren't…

      BartweissView on HNParent context

    • I see what you mean- thank you for the clarification. Well, I'm not really the right person to discuss this issue since I can't claim to understand how the brain works. However, I do understand a few things about connectionist methods and it's my understanding that they are not…

      YeGoblynQueenneView on HNParent context

  4. Evolved antenna 1 comment
    • Cf. "The Surprising Creativity of Digital Evolution: A Collection of Anecdotes from the Evolutionary Computation and Artificial Life Research Communities" https://arxiv.org/abs/1803.03453v1 > Biological evolution provides a creative fount of complex and subtle adaptations, often…

      carapaceView on HNParent context

    • Sure. Why is the title of the article so disingenuous? What design do people think they see in nature? By what method can I, without referring to someone else's authority, decide that a particular part of nature is "designed"? Without an explicit criteria for "design", the whole…

      bediger4000View on HNParent context

    • I was forwarded this discussion by a friend who’s familiar with my work and I’ve really been enjoying the posts. I think about ethics and AI a lot, and couldn’t help but want to contribute a few thoughts here. So here it goes, my first post on HN.. My main advice is beware of…

      arctop_danView on HNParent context

    • I'm not so sure. Even prosaic, current AI, can be very unpredictable. See this blog post http://aiweirdness.com/post/172894792687/when-algorithms-sur... , which is a somewhat more causal summary of this paper "The Surprising Creativity of Digital Evolution: A Collection of…

      rhaps0dyView on HNParent context

    • This a pretty much direct summary of a paper [0] previously discussed(twice) on hacker news [1][2] [0]: https://arxiv.org/pdf/1803.03453.pdf [1]: https://news.ycombinator.com/item?id=16837030 [2]: https://news.ycombinator.com/item?id=16600701

      matthbergView on HNParent context

  5. When algorithms surprise us 1 comment
    • Here's a recent survey / observational science paper by some prominent "neuroevolution" / A-Life researchers. https://arxiv.org/abs/1803.03453. I found this refreshing because it's rare that science papers talk about the debugging and experimental process and debugging journeys…

      ericjangView on HNParent context

Submitted to Hacker News

Connected through shared HN threads, not inferred similarity or a recommendation.