Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks · HackerPapers discussions

Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks — mentioned by mike_hearn

Thu, 09 Oct 2025 09:19:45 GMT

Are you sure? I wrote an essay at the end of 2016 about the state of AI research and at the time researchers were demolishing benchmarks like FAIR's bAbI which involved generating answers to questions. I wrote back then about story comprehension and programming robots by giving them stories (we'd now call these prompts). https://blog.plan99.net/the-science-of-westworld-ec624585e47 bAbI paper: https://arxiv.org/abs/1502.05698 Abstract: One long-term goal of machine learning research is to produce methods that are applicable to reasoning and natural language, in particular building an…

Paper and discussion history. A mention is not an endorsement.

Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks — mentioned by nl

Thu, 02 Jun 2016 04:28:56 GMT

Facebook have one of the leading teams on doing Deep Learning question answering. Jason Weston et. al wrote a paper introducing a machine-generated textual dataset[1] similar to what you describe, eg: Daniel picked up the football. Daniel drops the football. Daniel got the milk. Daniel took the apple. How many objects is Daniel holding? There have been plenty other papers published by them and others tackling that and similar but harder problems eg[2] [1]http://arxiv.org/pdf/1502.05698v10.pdf [2] http://arxiv.org/abs/1511.02301

Paper and discussion history. A mention is not an endorsement.

Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks — mentioned by andrewtbham

Sat, 05 Sep 2015 16:41:54 GMT

Here is a recent Facebook research paper that addresses the problem I believe this paper is intended to solve. Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks http://arxiv.org/pdf/1502.05698v6.pdf This recent paper is an algorithm to solve simple question answering from the context of a conversation... like the ones in the older paper... for instance. John is in the playground. Bob is in the office. Where is John? A:playground I believe a traditional LSTM RNN would have likely cleared the information about John from from it's long short term memory vector. Whereas you…

Paper and discussion history. A mention is not an endorsement.

Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks — mentioned by nl

Tue, 25 Aug 2015 23:44:05 GMT

It is true that this is an artificial test, but it seems to me that doing well at this is a necessary prerequisite to do well at more complex scenarios. It's worth noting that these tests were introduced by Jason Weston[1] as "A Set of Prerequisite Toy Tasks"[2] Also, they didn't report the accuracy on any of the other 18 tasks. That makes me believe that they did pretty badly on those. Weston's work on Memory Networks has "solved" (or at least shown a good way forward) on 16 of those other tasks. These were the two that were furthest away from being solved (See [2], again). The remaining 2…

Paper and discussion history. A mention is not an endorsement.

Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks — mentioned by nl

Wed, 03 Jun 2015 12:11:31 GMT

Here's a chronological reading list of techniques Traditional NLP -> 2012, IBM Watson papers[1] Watson is probably the pinnacle of "traditional" style NLP (ie, Tokenization/Lemmatization/Part of Speech Tagging/Framing/Knowledge Engineering/etc) Word2Vec -> 2013, Google paper[2] Word2Vec kind of exploded everyone's mind for a while. Subgraph Embedding -> 2015, Facebook AI Group [3][4] [1] http://ieeexplore.ieee.org/xpl/tocresult.jsp?isnumber=617771... [2] http://arxiv.org/pdf/1301.3781.pdf [3] https://research.facebook.com/publications/1473550739586509/... [4] http://arxiv.org/abs/1502.05698

Paper and discussion history. A mention is not an endorsement.

Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks — mentioned by Houshalter

Sun, 29 Mar 2015 20:16:56 GMT

I was thinking mostly of this paper: http://arxiv.org/abs/1503.02364 Here is some other relevant work of recent: http://arxiv.org/abs/1502.05698 http://arxiv.org/abs/1410.3916 https://www.reddit.com/r/thisisthewayitwillbe/comments/2zi8i... https://www.reddit.com/r/thisisthewayitwillbe/comments/25a4r... https://www.reddit.com/r/thisisthewayitwillbe/comments/307pt... http://www.noahlab.com.hk/topics/ShortTextConversation http://allenai.org/content/publications/hixon_naacl_2015.pdf

Paper and discussion history. A mention is not an endorsement.

Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks — mentioned by solve

Fri, 27 Mar 2015 01:19:07 GMT

More: https://research.facebook.com/researchers/1543934539189348 http://arxiv.org/abs/1502.05698 http://www.thespermwhale.com/jaseweston/babi/tasks_1-20_v1-1... So, anyone have open source code that can perform these tasks?

Paper and discussion history. A mention is not an endorsement.

Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks — mentioned by chriskanan

Tue, 03 Mar 2015 18:54:53 GMT

Link to arXiv paper: http://arxiv.org/abs/1502.05698

Paper and discussion history. A mention is not an endorsement.

Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks — HN submission

Sun, 22 Feb 2015 05:19:45 GMT

Towards AI-Complete Question Answering, Using Deep Learning

6 points; 1 discussion reply on HN. Paper and source history. A submission is not an endorsement.

Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks — HN submission

Sat, 21 Feb 2015 21:28:31 GMT

Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks [pdf]

2 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.