Unifying Large Language Models and Knowledge Graphs: A Roadmap · HackerPapers discussions

Unifying Large Language Models and Knowledge Graphs: A Roadmap — mentioned by filterfiber

Thu, 30 Nov 2023 17:54:42 GMT

Yeah that's a fairly well studied one. Most of these techniques are rather "lossy" compared to extending the context window. The most likely "real solution" is going to be using various tricks and finetuning on higher context lengths to just extend the context window. Here's a bunch of other related methods, Summarizing context - https://arxiv.org/abs/2305.14239 continuous finetuning - https://arxiv.org/pdf/2307.02839.pdf retrieval augmented generation - https://arxiv.org/abs/2005.11401 knowledge graphs - https://arxiv.org/abs/2306.08302 augmenting the network a side network…

Paper and discussion history. A mention is not an endorsement.

Unifying Large Language Models and Knowledge Graphs: A Roadmap — HN submission

Fri, 23 Jun 2023 21:13:19 GMT

Unifying Large Language Models and Knowledge Graphs: A Roadmap

4 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

Unifying Large Language Models and Knowledge Graphs: A Roadmap — mentioned by ignoramous

Mon, 19 Jun 2023 19:30:42 GMT

Found a couple: - Synergizing Reasoning and Acting in Language Models: https://react-lm.github.io/ - Augmenting LLMs with Knowledge: https://www.arxiv-vanity.com/papers/2306.08302/ - Grounding LLMs with Retrieval-Augmented Generation: https://techcommunity.microsoft.com/t5/fasttrack-for-azure/g...

Paper and discussion history. A mention is not an endorsement.

Unifying Large Language Models and Knowledge Graphs: A Roadmap — HN submission

Sat, 17 Jun 2023 04:18:08 GMT

Unifying Large Language Models and Knowledge Graphs: A Roadmap

2 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.