Unifying Count-Based Exploration and Intrinsic Motivation · HackerPapers discussions

Unifying Count-Based Exploration and Intrinsic Motivation — mentioned by ilyasut

Wed, 04 Jul 2018 19:27:03 GMT

There has been a fair bit of past work exploring the idea you described (examples: https://arxiv.org/pdf/1606.01868.pdf, https://arxiv.org/pdf/1703.01310.pdf, https://pathak22.github.io/noreward-rl/resources/icml17.pdf, https://openreview.net/forum?id=H1RPJf5Tz). Such methods can't solve games like Montezuma's revenge to a comparable level of performance yet, but I'm sure they'll eventually get there.

Paper and discussion history. A mention is not an endorsement.

Unifying Count-Based Exploration and Intrinsic Motivation — mentioned by AstralStorm

Thu, 14 Sep 2017 03:16:53 GMT

By "make" you meant "match some sort of a simple function approximation after hardcoding lots of knowledge about the system and the general function" right? Which is essentially what the neural networks and all the other optimization algorithms were made for? (The algorithm as described will require a huge database for a game that is even slightly more complicated than Infinite Mario. And we don't even have the sources to try that.) Even the object motion tracker part will choke in 3D environment. (It is a greedy matcher as they described it.) Speaking of impressed, Google DeepMind paper is…

Paper and discussion history. A mention is not an endorsement.

Unifying Count-Based Exploration and Intrinsic Motivation — mentioned by dang

Wed, 08 Jun 2016 17:59:43 GMT

Thanks. We've changed the URL from http://www.wired.co.uk/article/google-ai-montezuma-revenge. At first to https://arxiv.org/abs/1606.01868, but since everyone's going to want to watch the video, that seems a bit too abstruse. Hopefully someone will say meaningful things about the paper too.

Paper and discussion history. A mention is not an endorsement.

Unifying Count-Based Exploration and Intrinsic Motivation — mentioned by sehugg

Wed, 08 Jun 2016 15:54:12 GMT

And here's the related paper, "Unifying Count-Based Exploration and Intrinsic Motivation": https://arxiv.org/abs/1606.01868 Tech journalism isn't at its best when it can't distinguish between WOPR and a team of researchers.

Paper and discussion history. A mention is not an endorsement.

Unifying Count-Based Exploration and Intrinsic Motivation — mentioned by jerf

Wed, 08 Jun 2016 14:28:39 GMT

If you end up blocked by a popup blocker, or just don't feel like reading fluff, or like me you've got the browser locked down too tightly for their integrated video player to work, the paper is at https://arxiv.org/pdf/1606.01868v1.pdf and the video mentioned is (probably, since I didn't see the original) at https://www.youtube.com/watch?v=0yI2wJ6F8r0 .

Paper and discussion history. A mention is not an endorsement.

Unifying Count-Based Exploration and Intrinsic Motivation — HN submission

Tue, 07 Jun 2016 12:31:16 GMT

Unifying Count-Based Exploration and Intrinsic Motivation

3 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.