Generate rather than Retrieve: Large Language Models are Strong Context Generators — mentioned by bestcoder69

Tue, 07 Mar 2023 02:42:52 GMT

See also GenRead[0]: > A common approach for knowledge-intensive tasks is to employ a retrieve-then-read pipeline that first retrieves a handful of relevant contextual documents from an external corpus such as Wikipedia and then predicts an answer conditioned on the retrieved documents. In this paper, we present a novel perspective for solving knowledge-intensive tasks by replacing document retrievers with large language model generators. i.e. generating some bullshit citation will improve the accuracy of the completion -- even outperforming actual retrieval! (they find, at least) Also see…

Paper and discussion history. A mention is not an endorsement.

Generate rather than Retrieve: Large Language Models are Strong Context Generators · HackerPapers discussions

Generate rather than Retrieve: Large Language Models are Strong Context Generators — mentioned by bestcoder69