<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>The Geometry of Categorical and Hierarchical Concepts in Large Language Models · HackerPapers discussions</title><link>https://hackerpaper.kaipfister.de/p/2406.01506/</link><description>Collected HN comments and submissions linking this paper.</description><language>en</language><lastBuildDate>Mon, 02 Nov 2026 11:16:22 GMT</lastBuildDate><atom:link href="https://hackerpaper.kaipfister.de/p/2406.01506/feed.xml" rel="self" type="application/rss+xml" /><item><title>The Geometry of Categorical and Hierarchical Concepts in Large Language Models — mentioned by davedx</title><link>https://news.ycombinator.com/item?id=40925476</link><guid isPermaLink="false">urn:hackerpapers:mention:2406.01506:40925476</guid><pubDate>Wed, 10 Jul 2024 10:26:33 GMT</pubDate><description>&lt;p&gt;This seems highly relevant: https://arxiv.org/abs/2406.01506 &amp;gt; In this paper, we study the two foundational questions in this area. First, how are categorical concepts, such as {&amp;#x27;mammal&amp;#x27;, &amp;#x27;bird&amp;#x27;, &amp;#x27;reptile&amp;#x27;, &amp;#x27;fish&amp;#x27;}, represented? Second, how are hierarchical relations between concepts encoded? For example, how is the fact that &amp;#x27;dog&amp;#x27; is a kind of &amp;#x27;mammal&amp;#x27; encoded? We show how to extend the linear representation hypothesis to answer these questions. We find a remarkably simple structure: simple categorical concepts are represented as simplices, hierarchically related concepts are orthogonal in a…&lt;/p&gt;&lt;p&gt;&lt;a href="https://hackerpaper.kaipfister.de/p/2406.01506/"&gt;Paper and discussion history&lt;/a&gt;. A mention is not an endorsement.&lt;/p&gt;</description><category>cs.CL</category></item><item><title>The Geometry of Categorical and Hierarchical Concepts in Large Language Models — HN submission</title><link>https://news.ycombinator.com/item?id=40640424</link><guid isPermaLink="false">urn:hackerpapers:submission:2406.01506:40640424</guid><pubDate>Mon, 10 Jun 2024 23:18:06 GMT</pubDate><description>&lt;p&gt;The Geometry of Categorical and Hierarchical Concepts in Large Language Models&lt;/p&gt;&lt;p&gt;&lt;/p&gt;&lt;p&gt;123 points; 15 discussion replies on HN. &lt;a href="https://hackerpaper.kaipfister.de/p/2406.01506/"&gt;Paper and source history&lt;/a&gt;. A submission is not an endorsement.&lt;/p&gt;</description><category>cs.CL</category></item><item><title>The Geometry of Categorical and Hierarchical Concepts in Large Language Models — HN submission</title><link>https://news.ycombinator.com/item?id=40620392</link><guid isPermaLink="false">urn:hackerpapers:submission:2406.01506:40620392</guid><pubDate>Sat, 08 Jun 2024 21:49:00 GMT</pubDate><description>&lt;p&gt;The Geometry of Categorical and Hierarchical Concepts in Large Language Models&lt;/p&gt;&lt;p&gt;&lt;/p&gt;&lt;p&gt;7 points; 0 discussion replies on HN. &lt;a href="https://hackerpaper.kaipfister.de/p/2406.01506/"&gt;Paper and source history&lt;/a&gt;. A submission is not an endorsement.&lt;/p&gt;</description><category>cs.CL</category></item><item><title>The Geometry of Categorical and Hierarchical Concepts in Large Language Models — HN submission</title><link>https://news.ycombinator.com/item?id=40592682</link><guid isPermaLink="false">urn:hackerpapers:submission:2406.01506:40592682</guid><pubDate>Thu, 06 Jun 2024 02:03:20 GMT</pubDate><description>&lt;p&gt;The Geometry of Categorical and Hierarchical Concepts in Large Language Models&lt;/p&gt;&lt;p&gt;&lt;/p&gt;&lt;p&gt;3 points; 0 discussion replies on HN. &lt;a href="https://hackerpaper.kaipfister.de/p/2406.01506/"&gt;Paper and source history&lt;/a&gt;. A submission is not an endorsement.&lt;/p&gt;</description><category>cs.CL</category></item><item><title>The Geometry of Categorical and Hierarchical Concepts in Large Language Models — HN submission</title><link>https://news.ycombinator.com/item?id=40576295</link><guid isPermaLink="false">urn:hackerpapers:submission:2406.01506:40576295</guid><pubDate>Tue, 04 Jun 2024 16:32:53 GMT</pubDate><description>&lt;p&gt;The Geometry of Categorical and Hierarchical Concepts in Large Language Models&lt;/p&gt;&lt;p&gt;&lt;/p&gt;&lt;p&gt;3 points; 0 discussion replies on HN. &lt;a href="https://hackerpaper.kaipfister.de/p/2406.01506/"&gt;Paper and source history&lt;/a&gt;. A submission is not an endorsement.&lt;/p&gt;</description><category>cs.CL</category></item></channel></rss>
