https://hackerpaper.kaipfister.de/p/2004.07180/Collected HN comments and submissions linking this paper.enMon, 02 Nov 2026 11:16:22 GMThttps://news.ycombinator.com/item?id=33614608urn:hackerpapers:mention:2004.07180:33614608Tue, 15 Nov 2022 20:31:59 GMT<p>I use scientific language models professionally. I skimmed the paper and was immediately disappointed. - They benchmarked against general models like GPT-3 but not well-established specific models that have been trained for specific tasks like SPECTER[0] or SciBert[1]. Specter outperformed GPT-3 on tasks like citation prediction two years ago. Nobody seriously uses general LLMs on science tasks, so nobody who actually wants to use this cares about your benchmarks. I want to see task-specific models compared to your general model, otherwise whats going to happen is I either need to run my own…</p><p><a href="https://hackerpaper.kaipfister.de/p/2004.07180/">Paper and discussion history</a>. A mention is not an endorsement.</p>cs.CL