RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval · HackerPapers discussions

RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval — mentioned by santiagobasulto

Sat, 21 Sep 2024 08:18:32 GMT

These are all "techniques" on top of the foundations of RAG. It's similar to "Chain of Thought" in prompt engineering. You have an underlying technology, and then come up with techniques/frameworks on top. What MVC was for Web dev +15 years ago. RAPTOR for example is a technique that groups and clusters documents together, summarizes them, and creates embeddings defining a sort of a Tree. Paper: https://arxiv.org/html/2401.18059v1 Agentic RAG is creating an agent that can decide to augment "conversations" (or other LLM tools) with RAG searches and analyze its relevance. Pretty useful, but…

Paper and discussion history. A mention is not an endorsement.

RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval — mentioned by williamcotton

Fri, 20 Sep 2024 14:01:21 GMT

HyDE: Hypothetical Document Embeddings [1] RAGAS: RAG Assessment [2] RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval [3] Self-RAG: Self-Reflective Retrieval-Augmented Generation [4] Agentic RAG: Agentic Retrieval-Augmented Generation [5] GraphRAG: Graph Retrieval-Augmented Generation [6] [1] https://docs.haystack.deepset.ai/docs/hypothetical-document-... [2] https://docs.ragas.io/en/stable/ [3] https://arxiv.org/html/2401.18059v1 [4] https://selfrag.github.io [5] https://langchain-ai.github.io/langgraph/tutorials/rag/langg... [6]…

Paper and discussion history. A mention is not an endorsement.

RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval — mentioned by newpeak

Thu, 30 May 2024 12:08:35 GMT

Tagging each paragraph is not a good approach. Instead, using LLM to generate a summary based on the clustering of paragraphs could be a good alternative. That's what RAPTOR(https://arxiv.org/html/2401.18059v1) has suggested. Regarding to reranker, it's a pure dynamic solution, which is different with re-chunking which requires all data to be reindexed. Comparing two paragraphs, in most cases, it's based on embedding, which means each paragraph will correspond to a single embedding. So comparing them does not take words into account. However, if you adopts a hybrid search which will use full…

Paper and discussion history. A mention is not an endorsement.

RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval — mentioned by demilich

Fri, 24 May 2024 07:54:51 GMT

Try RAPTOR: https://arxiv.org/html/2401.18059v1 An implementation: github.com/infiniflow/ragflow

Paper and discussion history. A mention is not an endorsement.

RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval — mentioned by joshcho

Tue, 30 Apr 2024 13:38:25 GMT

Worth a comparison with RAPTOR, another tiered RAG system. https://arxiv.org/abs/2401.18059

Paper and discussion history. A mention is not an endorsement.

RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval — mentioned by jimmySixDOF

Mon, 18 Mar 2024 12:03:49 GMT

I like this approach it treats the problem like a reranker it would be interesting to byo classifiers you could do the embedding to match the hierarchy approach which is a good idea it seems. Also the code for Raptor came out recently and they are showing gains through a tree/hierarchy too. https://arxiv.org/html/2401.18059v1

Paper and discussion history. A mention is not an endorsement.

RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval — mentioned by homarp

Wed, 06 Mar 2024 21:30:10 GMT

code from the paper https://arxiv.org/abs/2401.18059 It introduces a novel approach of recursively embedding, clustering, and summarizing chunks of text, constructing a tree with differing levels of summarization from the bottom up. At inference time, the model retrieves from this tree, integrating information across lengthy documents at different levels of abstraction.

Paper and discussion history. A mention is not an endorsement.

RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval — mentioned by CuriouslyC

Wed, 06 Mar 2024 19:26:11 GMT

That looks like it'd be an adjunct strategy IMO. In most cases you want to have the original source material on tap, it helps with explainability and citations. That being said, it seems that everyone working at the state of the art is thinking about using LLMs to summarize chunks, and summarize groups of chunks in a hierarchical manner. RAPTOR (https://arxiv.org/html/2401.18059v1) was just published and is close to SoTA, and from a quick read I can already think of several directions to improve it, and that's not to brag but more to say how fertile the field is.

Paper and discussion history. A mention is not an endorsement.

RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval — mentioned by reerdna

Wed, 06 Mar 2024 14:22:14 GMT

Sounds a little like this recent paper; "RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval" https://arxiv.org/abs/2401.18059

Paper and discussion history. A mention is not an endorsement.