How Can We Know What Language Models Know? · HackerPapers discussionshttps://hackerpaper.kaipfister.de/p/1911.12543/Collected HN comments and submissions linking this paper.enMon, 02 Nov 2026 11:16:22 GMTHow Can We Know What Language Models Know? — mentioned by gwernhttps://news.ycombinator.com/item?id=23354461urn:hackerpapers:mention:1911.12543:23354461Fri, 29 May 2020 19:29:43 GMT<p>&gt; The article I linked to makes claims only about the model it tests and since it actually links to an online implementation, anyone can try to reproduce the results and see for themselves. And I did (using my own local GPT-2-1.5b install which let me set the hyperparameters rather than restricting it to inappropriate hardwired ones of an online service), I linked to another person demonstrating the same thing, I pointed out the extensive GPT-3 evaluation OA did, and here, have another link about how bad querying of language models leads to highly misleading results about how much they know…</p><p><a href="https://hackerpaper.kaipfister.de/p/1911.12543/">Paper and discussion history</a>. A mention is not an endorsement.</p>cs.CL