BooookScore: A systematic exploration of book-length summarization in the era of LLMs — mentioned by simonw

Wed, 10 Apr 2024 01:21:40 GMT

As far as I can tell, this study was almost entirely about fiction: https://github.com/mungg/FABLES/blob/main/booklist.md lists 26 books, only one of which is classified as non-fiction. I would imagine that summaries of non-fiction books are evaluated quite differently from summaries of fiction. I've been trying to figure out what prompts they used. The https://github.com/mungg/FABLES GitHub repo says this: Summary -- (str) Entire book summarized by one of five models: Mixtral, GPT-3.5-Turbo, GPT-4, GPT-4-Turbo, and Claude-3-Opus, using the hierarchical merging method described in Chang et…

Paper and discussion history. A mention is not an endorsement.

BooookScore: A systematic exploration of book-length summarization in the era of LLMs — HN submission

Wed, 18 Oct 2023 21:59:50 GMT

A systematic exploration of book-length summarization in the era of LLMs

2 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

BooookScore: A systematic exploration of book-length summarization in the era of LLMs · HackerPapers discussions

BooookScore: A systematic exploration of book-length summarization in the era of LLMs — mentioned by simonw

BooookScore: A systematic exploration of book-length summarization in the era of LLMs — HN submission