Addressing "Documentation Debt" in Machine Learning Research: A Retrospective Datasheet for BookCorpus · HackerPapers discussions

Addressing "Documentation Debt" in Machine Learning Research: A Retrospective Datasheet for BookCorpus — mentioned by Kaibeezy

Wed, 20 Sep 2023 13:50:25 GMT

IANA AI developer but have been looking into this in detail recently for other purposes. I was puzzled at the lack of info about "books" and when searching for detail (in what I believe was a reasonably diligent manner) found a very surprisingly small amount of it. I assumed there would be more knowledge and did ask for it here. So now I will go look up those papers to get a better sense of things. Thank you for the tip. I note neither this paper nor any discussion of "BookCorpus" or even "book corpus" has appeared on HN previously. Addressing "Documentation Debt" in Machine Learning…

Paper and discussion history. A mention is not an endorsement.

Addressing "Documentation Debt" in Machine Learning Research: A Retrospective Datasheet for BookCorpus — mentioned by sfriedr

Tue, 11 Jul 2023 20:27:10 GMT

Could you share more about copyright? For example, aren't you worried that now, with all kinds of lawsuits happening [1] and copyright issues that were found in existing datasets [2], that you might get threatening letters from a lawyer some day? I'm the author of [3] where we introduced one of the first natural-language datasets that test graduate mathematics for LLMs, but some of the prompts we took from a copyrighted book and therefore thought about excluding them. Having them in the public dataset would be really nice though, hence I'm keen about your experience. I'd also be keen to hear…

Paper and discussion history. A mention is not an endorsement.

Addressing "Documentation Debt" in Machine Learning Research: A Retrospective Datasheet for BookCorpus — mentioned by touringa

Wed, 15 Feb 2023 20:24:08 GMT

Actually, it's 'BookCorpus'. OpenAI spelt it wrong in their GPT-1 paper. It has also been analyzed here and here: https://arxiv.org/abs/2105.05241 https://lifearchitect.ai/whats-in-my-ai/

Paper and discussion history. A mention is not an endorsement.