Demonstrate-Search-Predict: Composing retrieval and language models for knowledge-intensive NLP — mentioned by svcrunch

Fri, 08 Sep 2023 15:45:31 GMT

I believe that retrieval-augmented generation is the right path to generative AI within organizations, at least for the next few years. Trying to directly fine-tune an LLM on your data also runs into issues with enforcing access permissions. However, instead of simply being a post-processing step at the end of an IR pipeline, LLMs will eventually sandwhich the IR system, along the lines of the [Demonstrate, Search, Predict framework](https://arxiv.org/abs/2212.14024) by Khattab et al.

Paper and discussion history. A mention is not an endorsement.

Demonstrate-Search-Predict: Composing retrieval and language models for knowledge-intensive NLP · HackerPapers discussions

Demonstrate-Search-Predict: Composing retrieval and language models for knowledge-intensive NLP — mentioned by svcrunch