Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researchers · HackerPapers discussions

Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researchers — mentioned by viraptor

Mon, 04 Aug 2025 13:10:18 GMT

https://arxiv.org/abs/2409.04109 > we obtain the first statistically significant conclusion on current LLM capabilities for research ideation: we find LLM-generated ideas are judged as more novel (p < 0.05) than human expert ideas while being judged slightly weaker on feasibility. It's a bit better than just finding related pairs. And that's with sonnet 3.5 which is basically ancient at this point.

Paper and discussion history. A mention is not an endorsement.

Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researchers — HN submission

Thu, 12 Sep 2024 15:47:14 GMT

Can LLMs Generate Novel Research Ideas?

50 points; 81 discussion replies on HN. Paper and source history. A submission is not an endorsement.

Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researchers — HN submission

Wed, 11 Sep 2024 16:02:34 GMT

Can LLMs Generate Novel Research Ideas?

2 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researchers — HN submission

Wed, 11 Sep 2024 07:15:52 GMT

LLMs Outpace Humans in Novel Idea Generation

5 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researchers — HN submission

Tue, 10 Sep 2024 09:37:09 GMT

Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study

3 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researchers — HN submission

Mon, 09 Sep 2024 20:31:11 GMT

Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study

4 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.