<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Knowledge Neurons in Pretrained Transformers · HackerPapers discussions</title><link>https://hackerpaper.kaipfister.de/p/2104.08696/</link><description>Collected HN comments and submissions linking this paper.</description><language>en</language><lastBuildDate>Mon, 02 Nov 2026 11:16:22 GMT</lastBuildDate><atom:link href="https://hackerpaper.kaipfister.de/p/2104.08696/feed.xml" rel="self" type="application/rss+xml" /><item><title>Knowledge Neurons in Pretrained Transformers — mentioned by truth_</title><link>https://news.ycombinator.com/item?id=27008923</link><guid isPermaLink="false">urn:hackerpapers:mention:2104.08696:27008923</guid><pubDate>Sat, 01 May 2021 19:09:57 GMT</pubDate><description>&lt;p&gt;Just some days ago researchers from Peking U and Microsoft published a paper[0] saying they can access &amp;quot;knowledge neurons&amp;quot; in pretrained embeddings that will enable &amp;quot;fact editing&amp;quot;[1]. [0]: https://arxiv.org/pdf/2104.08696.pdf [1]: https://medium.com/syncedreview/microsoft-peking-u-researche...&lt;/p&gt;&lt;p&gt;&lt;a href="https://hackerpaper.kaipfister.de/p/2104.08696/"&gt;Paper and discussion history&lt;/a&gt;. A mention is not an endorsement.&lt;/p&gt;</description><category>cs.CL</category></item><item><title>Knowledge Neurons in Pretrained Transformers — mentioned by truth_</title><link>https://news.ycombinator.com/item?id=26979416</link><guid isPermaLink="false">urn:hackerpapers:mention:2104.08696:26979416</guid><pubDate>Thu, 29 Apr 2021 10:31:20 GMT</pubDate><description>&lt;p&gt;Your first paragraph is spot on. Some people are hell-bent on developing AGI (and these people should exist), and there are some doing SOTA-chasing by tweaking hyperparameters to the extreme and overfitting the data (these works are _mostly_ useless), but most people do not realize the amount of AI we have right now, right this day, is enough bring in fundamental and permanent paradigm changes in as many fields as you can think of. And you are onto something when you say that &amp;quot;empirical records&amp;quot; can be learned by ML models, and a huge amount of grunt work is required for that. Every tom…&lt;/p&gt;&lt;p&gt;&lt;a href="https://hackerpaper.kaipfister.de/p/2104.08696/"&gt;Paper and discussion history&lt;/a&gt;. A mention is not an endorsement.&lt;/p&gt;</description><category>cs.CL</category></item></channel></rss>
