Inferring Algorithmic Patterns with Stack-Augmented Recurrent Nets · HackerPapers discussions

Inferring Algorithmic Patterns with Stack-Augmented Recurrent Nets — mentioned by jsenn

Mon, 23 Jan 2023 18:21:03 GMT

Here's a paper that shows how to augment a recurrent NN with a stack: http://arxiv.org/abs/1503.01007. I'm not an expert, so some or all of this may be wrong, but my understanding of how it works is this. You have a stack memory, which is just a list of numbers (or maybe a list of N-dimensional vectors). You add the contents of the stack at time t-1 to the input of the network at time t. The hidden layer contains a special number that controls whether to push or pop from the stack (or leave it alone). The values in the stack are determined from the values in the hidden layer at the time they…

Paper and discussion history. A mention is not an endorsement.

Inferring Algorithmic Patterns with Stack-Augmented Recurrent Nets — mentioned by davidad_

Sun, 03 Jan 2016 00:53:26 GMT

Here's the differentiable stack/queue/deque paper: http://arxiv.org/abs/1506.02516 It is indeed similar to some work from FAIR, where one of the tasks was binary addition: http://arxiv.org/abs/1503.01007

Paper and discussion history. A mention is not an endorsement.

Inferring Algorithmic Patterns with Stack-Augmented Recurrent Nets — mentioned by cs702

Sat, 05 Sep 2015 19:10:27 GMT

I have shivers going down my spine at the idea of feeding, say, skip-thought vectors representing sentences[1] into stack-augmented recurrent neural nets as proposed in Facebook's paper[2], for all sorts of interesting tasks. -- [1] http://arxiv.org/pdf/1506.06726v1.pdf [2] http://arxiv.org/pdf/1503.01007.pdf

Paper and discussion history. A mention is not an endorsement.

Inferring Algorithmic Patterns with Stack-Augmented Recurrent Nets — mentioned by andrewtbham

Sat, 05 Sep 2015 16:21:56 GMT

Reasons this high has probability of credibility: Research probably used on Facebook digital assistant M. Tomas Mikolov, the author of word2vec. Paper with source code. http://arxiv.org/pdf/1503.01007.pdf https://github.com/facebook/Stack-RNN

Paper and discussion history. A mention is not an endorsement.

Inferring Algorithmic Patterns with Stack-Augmented Recurrent Nets — mentioned by exgrv

Thu, 21 May 2015 21:45:43 GMT

There is this paper by Joulin & Mikolov: Inferring Algorithmic Patterns with Stack-Augmented Recurrent Nets (http://arxiv.org/abs/1503.01007). In this case, the memory of the RNN is an ensemble of differentiable stacks.

Paper and discussion history. A mention is not an endorsement.