Memory Networks · HackerPapers discussions

Memory Networks — mentioned by mike_hearn

Thu, 09 Oct 2025 09:19:45 GMT

Are you sure? I wrote an essay at the end of 2016 about the state of AI research and at the time researchers were demolishing benchmarks like FAIR's bAbI which involved generating answers to questions. I wrote back then about story comprehension and programming robots by giving them stories (we'd now call these prompts). https://blog.plan99.net/the-science-of-westworld-ec624585e47 bAbI paper: https://arxiv.org/abs/1502.05698 Abstract: One long-term goal of machine learning research is to produce methods that are applicable to reasoning and natural language, in particular building an…

Paper and discussion history. A mention is not an endorsement.

Memory Networks — mentioned by nl

Thu, 13 Oct 2016 00:51:37 GMT

This is probably the most important research direction in modern neural network research. Neural networks are great at pattern recognition. Things like LSTMs allow pattern recognition through time, so they can develop "memories". This is useful in things like understanding text (the meaning of one word often depends on the previous few words). But how can a neural network know "facts"? Humans have things like books, or the ability to ask others for things they don't know. How would we build something analogous to that for neural network-powered "AIs"? There's been a strand of research mostly…

Paper and discussion history. A mention is not an endorsement.

Memory Networks — mentioned by nl

Tue, 28 Jul 2015 12:08:55 GMT

Jason Weston (Facebook) etc's work on Memory Nets[1] Anything to do with transfer learning (the 2013 Zero-Shot Learning Through Cross-Modal Transfer[2] paper is a good place to start) The increasing amount of demos around using NNs to generate "things" that look kinda-almost "intelligent". I can't point at a paper, but Andrej Karpathy demo of generating Shakespere-like writing, "Wikipedia" pages and "C" code in The Unreasonable Effectiveness of Recurrent Neural Networks[3] is the kind of thing I'm talking about. The beginnings of work around goal-seeking. The (now Google) DeepMind Atari…

Paper and discussion history. A mention is not an endorsement.

Memory Networks — mentioned by bra-ket

Sun, 10 May 2015 04:45:23 GMT

Semantic hashing by similarity is one way to create more sensible representations (Re: Proposition 2): http://www.cs.toronto.edu/~rsalakhu/papers/semantic_final.pd... This would also fit well into memory networks: http://arxiv.org/abs/1410.3916, SDM: http://en.wikipedia.org/wiki/Sparse_distributed_memory or global workspace model: http://en.wikipedia.org/wiki/Global_Workspace_Theory

Paper and discussion history. A mention is not an endorsement.

Memory Networks — mentioned by Houshalter

Sun, 29 Mar 2015 20:16:56 GMT

I was thinking mostly of this paper: http://arxiv.org/abs/1503.02364 Here is some other relevant work of recent: http://arxiv.org/abs/1502.05698 http://arxiv.org/abs/1410.3916 https://www.reddit.com/r/thisisthewayitwillbe/comments/2zi8i... https://www.reddit.com/r/thisisthewayitwillbe/comments/25a4r... https://www.reddit.com/r/thisisthewayitwillbe/comments/307pt... http://www.noahlab.com.hk/topics/ShortTextConversation http://allenai.org/content/publications/hixon_naacl_2015.pdf

Paper and discussion history. A mention is not an endorsement.

Memory Networks — mentioned by nl

Fri, 27 Mar 2015 15:54:54 GMT

It uses a class of RNN they call a MemNN to do something that looks a lot like inference using phrase embeddings. It's a pretty revolutionary approach - no one seems to have tried anything very similar since the 1990's. The related work section[1] is worth reading. Interestingly, the Jeff Dean RNN slide deck mentions using RNNs for doing QA, but doesn't expand on what work Google has done in the field. I don't have a URL to hand for that. They do experiment with loading the MemNN from a set of statements stored as triples, which looks a lot more like a traditional Knowledge Base. [1] 4 in…

Paper and discussion history. A mention is not an endorsement.

Memory Networks — mentioned by smhx

Fri, 27 Mar 2015 15:33:54 GMT

Memory Networks: http://arxiv.org/abs/1410.3916

Paper and discussion history. A mention is not an endorsement.

Memory Networks — HN submission

Fri, 27 Mar 2015 04:09:23 GMT

Memory Network [pdf]

1 point; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

Memory Networks — HN submission

Wed, 11 Feb 2015 06:40:03 GMT

Facebook Memory Networks

2 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

Memory Networks — HN submission

Sat, 01 Nov 2014 08:46:23 GMT

Memory Networks

18 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.