Giraffe: Using Deep Reinforcement Learning to Play Chess · HackerPapers discussions

Giraffe: Using Deep Reinforcement Learning to Play Chess — mentioned by gwern

Wed, 06 Dec 2017 04:30:28 GMT

It's certainly not the first NN chess program. You may remember one of OP author's Giraffe NN (https://arxiv.org/abs/1509.01549) which was essentially 'AlphaGo for chess'. But like the original AG, it struggles to learn and Lai had a lot less computation as a student than he does now at DM. What they're doing is applying AlphaGo Zero expert iteration with some simplifications and TPUs. And that pwns previous work like Giraffe the way AlphaGo Zero pwns AlphaGo. Quantity becomes a quality all its own.

Paper and discussion history. A mention is not an endorsement.

Giraffe: Using Deep Reinforcement Learning to Play Chess — mentioned by kyberias

Sat, 18 Nov 2017 10:06:57 GMT

> They're useless to you because you don't seem to understand how neural network or current AI tech works. In the current fashion, generalist AI like a game engine is very much impossible. I have some understanding how that works. You seem to read me incorrectly and extend what I say to something different. Again, and I repeat myself, I don't claim "generalist AI". I don't claim that we can have a machine learning algorithm that learns ANY game mechanics perfectly just by looking at limited amount game play. Obviously that's not true for any neural network including human brain. What I do…

Paper and discussion history. A mention is not an endorsement.

Giraffe: Using Deep Reinforcement Learning to Play Chess — mentioned by naveen99

Sun, 05 Nov 2017 13:31:01 GMT

There was a project for chess, called giraffe https://bitbucket.org/waterreaction/giraffe whose author shut it down after joining google deep mind: http://www.talkchess.com/forum/viewtopic.php?t=59003 He thinks it's only a matter of time till machine learning beats hand crafted systems like stockfish even in chess. http://arxiv.org/abs/1509.01549

Paper and discussion history. A mention is not an endorsement.

Giraffe: Using Deep Reinforcement Learning to Play Chess — mentioned by shmageggy

Wed, 18 Oct 2017 18:48:42 GMT

I didn't see the talk, but I'm guessing he was referring to the Giraffe engine done by Matthew Lai (https://arxiv.org/abs/1509.01549). The main thing there is that he only learns an evaluation function, not a policy. Giraffe still uses classical alpha-beta search over the full action space. AFAIK nobody has learned a decent policy network for chess, probably because 1) it's super tactical, and 2) nobody cares that much because alpha-beta is so strong

Paper and discussion history. A mention is not an endorsement.

Giraffe: Using Deep Reinforcement Learning to Play Chess — mentioned by jhartmann

Thu, 03 Mar 2016 16:59:47 GMT

Seems very interesting, I really think these approaches will work rather well on a variety of games. Very exciting times. Btw, there is another already Open Source Neural Network Chess engine that might be worth exploring for similar ideas. That codebase already has a minmax search based on the network evaluation. Paper is at: http://arxiv.org/abs/1509.01549 Code is at: https://bitbucket.org/waterreaction/giraffe

Paper and discussion history. A mention is not an endorsement.

Giraffe: Using Deep Reinforcement Learning to Play Chess — HN submission

Wed, 23 Sep 2015 21:13:53 GMT

Giraffe: Using Deep Reinforcement Learning to Play Chess

6 points; 1 discussion reply on HN. Paper and source history. A submission is not an endorsement.

Giraffe: Using Deep Reinforcement Learning to Play Chess — mentioned by ColinWright

Fri, 18 Sep 2015 16:06:22 GMT

Discussion? https://news.ycombinator.com/item?id=10216710 : 2 comments https://news.ycombinator.com/item?id=10230201 : 1 comment https://news.ycombinator.com/item?id=10216715 : 1 comment https://news.ycombinator.com/item?id=10219759 : 2 comments ======== Full summary: http://arxiv.org/abs/1509.01549 Deep Learning engine teaches itself to play chess to Master level (arxiv.org) https://news.ycombinator.com/item?id=10217320 https://news.ycombinator.com/item?id=10219759 ======== http://fusion.net/story/197214/chess-master-deep-learning/ A computer taught itself to play chess at master level in…

Paper and discussion history. A mention is not an endorsement.

Giraffe: Using Deep Reinforcement Learning to Play Chess — mentioned by cjauvin

Fri, 18 Sep 2015 14:10:42 GMT

Probably this: http://www.technologyreview.com/view/541276/deep-learning-ma... http://arxiv.org/abs/1509.01549

Paper and discussion history. A mention is not an endorsement.

Giraffe: Using Deep Reinforcement Learning to Play Chess — mentioned by cs702

Wed, 16 Sep 2015 22:20:30 GMT

Interestingly, the neural net used is not really that deep: it has only two hidden layers (see figure 3 in the paper[1]). The innovations are really in how the researcher is representing inputs using different "modalities" (see section 4.1 "Feature Representation"), generating a training corpus (section 4.3), and training the neural net (sections 4.4 and 4.5). [1] http://arxiv.org/pdf/1509.01549v2.pdf

Paper and discussion history. A mention is not an endorsement.

Giraffe: Using Deep Reinforcement Learning to Play Chess — mentioned by eadz

Tue, 15 Sep 2015 15:57:52 GMT

PDF link: http://arxiv.org/pdf/1509.01549v2.pdf

Paper and discussion history. A mention is not an endorsement.

Giraffe: Using Deep Reinforcement Learning to Play Chess — HN submission

Tue, 15 Sep 2015 09:58:45 GMT

Giraffe: Using Deep Reinforcement Learning to Play Chess

17 points; 2 discussion replies on HN. Paper and source history. A submission is not an endorsement.

Giraffe: Using Deep Reinforcement Learning to Play Chess — HN submission

Mon, 14 Sep 2015 20:37:27 GMT

Giraffe: Using Deep Reinforcement Learning to Play Chess

3 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.