Asynchronous Methods for Deep Reinforcement Learning · HackerPapers discussions

Asynchronous Methods for Deep Reinforcement Learning — mentioned by dsptri

Thu, 14 Dec 2017 10:51:23 GMT

Playing the games simultaneously is actually innovative in how it let's them learn faster. If you play one game at a time consecutive moves are highly correlated which makes it difficult to make learning updates after each move. If you're playing 1250 parallel games that are starting and restarting so that they're at all at different stages of play, you can do an update after every move in every game and make better progress faster. This is known as Asynchronous Advantage Actor-Critic (A3C) and is a highly cited method discovered by the DeepMind team [1]. [1] https://arxiv.org/abs/1602.01783

Paper and discussion history. A mention is not an endorsement.

Asynchronous Methods for Deep Reinforcement Learning — mentioned by shpx

Sun, 26 Mar 2017 23:21:38 GMT

> we were able to solve one of the hardest MuJoCo tasks (a 3D humanoid) using 1,440 CPUs across 80 machines in only 10 minutes. As a comparison, in a typical setting 32 A3C workers on one machine would solve this task in about 10 hours. So using 80 times more machines makes you 60 times faster (assuming those are the same machines) "while performing better on 23 games tested, and worse on 28"[0]? [0] The paper for this blog post https://arxiv.org/pdf/1703.03864.pdf Asynchronous advantage actor critic (A3C) https://arxiv.org/pdf/1602.01783.pdf

Paper and discussion history. A mention is not an endorsement.

Asynchronous Methods for Deep Reinforcement Learning — mentioned by Hydraulix989

Mon, 05 Dec 2016 07:19:28 GMT

What is state of the art in reinforcement learning right now? https://arxiv.org/abs/1602.01783 Is there a way to deal with "sparse" training data (state, action, reward) triples -- sparse in "state"?

Paper and discussion history. A mention is not an endorsement.

Asynchronous Methods for Deep Reinforcement Learning — mentioned by macromaniac

Tue, 13 Sep 2016 07:51:19 GMT

There was a paper a few months back in deep reinforcement learning that got record setting RL results using only a CPU [0]. Previously, these algorithms would play fewer games and run a gpu over and over on the few games they had played. By using a CPU you can generate more samples that are up to date with your learning algorithm. It sounds obvious in hindsight, but you can't exactly run 60 atari sims on a gpu. [0] - https://arxiv.org/abs/1602.01783

Paper and discussion history. A mention is not an endorsement.

Asynchronous Methods for Deep Reinforcement Learning — mentioned by blueeyes44

Thu, 25 Aug 2016 17:39:11 GMT

Couple key points: This project[0] is going to keep developing. It has Deep Q Learning now, A3C[1] is working and more features are being added. Just as important: RL4J and DL4J run on a scientific computing framework called ND4J[2] that integrates with Spark and trains on multiple GPUs.[3][4] It's basically porting RL to the production stack of large organizations that work with the JVM and need to scale. The key thing to remember is that RL combines with other algorithms, like deep convolutional nets or Monte Carlo Search Trees. DL4J has the ConvNets already.[5] [0]…

Paper and discussion history. A mention is not an endorsement.

Asynchronous Methods for Deep Reinforcement Learning — HN submission

Thu, 23 Jun 2016 07:28:53 GMT

Google DeepMind: Asynchronous Methods for Deep Reinforcement Learning

3 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

Asynchronous Methods for Deep Reinforcement Learning — HN submission

Wed, 15 Jun 2016 02:54:18 GMT

Asynchronous Methods for Deep Reinforcement Learning

2 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

Asynchronous Methods for Deep Reinforcement Learning — mentioned by chris_va

Fri, 10 Jun 2016 15:57:06 GMT

Highlights: 1) No GPUs necessary, gives similar/better results in similar time (see http://arxiv.org/pdf/1602.01783v1.pdf) 2) 1-step Q (according to paper, maybe could do better with actor-critic + 1 LSTM layer) 3) Keras is really only used for a tiny fraction of the code. Which means that there is a lot of boilerplate that could be rolled up into a shared library still.

Paper and discussion history. A mention is not an endorsement.

Asynchronous Methods for Deep Reinforcement Learning — mentioned by Kristine1975

Fri, 22 Apr 2016 10:33:10 GMT

Related: https://www.newscientist.com/article/2076552-google-deepmind... Google DeepMind AI navigates a Doom-like 3D maze just by looking Paper: http://arxiv.org/abs/1602.01783

Paper and discussion history. A mention is not an endorsement.

Asynchronous Methods for Deep Reinforcement Learning — mentioned by sapphireblue

Wed, 13 Apr 2016 16:36:08 GMT

The progress in machine learning/deep learning for last 5 years has been literally staggering. Read about new state of art results. There is already superhuman visual object recognition, voice recognition, good machine translation, description of scenes in natural language, question answering (facebook babi dataset), visual question answering, algorithm learning (neural turing machines, neural GPUs), and finally really strong reinforcement learning (deepmind's DQN, A3C algorithms). The last one, reinforcement learning, is really important because it's a basis for general intelligence. By…

Paper and discussion history. A mention is not an endorsement.

Asynchronous Methods for Deep Reinforcement Learning — mentioned by ogrisel

Wed, 09 Mar 2016 20:28:09 GMT

see also by the same team: http://arxiv.org/abs/1602.01783

Paper and discussion history. A mention is not an endorsement.

Asynchronous Methods for Deep Reinforcement Learning — HN submission

Sun, 07 Feb 2016 14:15:51 GMT

Asynchronous Methods for Deep Reinforcement Learning

5 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

Asynchronous Methods for Deep Reinforcement Learning — mentioned by wickedgain

Sat, 06 Feb 2016 09:27:24 GMT

Link to paper: http://arxiv.org/abs/1602.01783

Paper and discussion history. A mention is not an endorsement.

Asynchronous Methods for Deep Reinforcement Learning — HN submission

Fri, 05 Feb 2016 23:03:04 GMT

Deepmind Navigates 3D Maze WithAsynchronous Methods 4 Deep Reinforcement Learning

11 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.