<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Hyperparameter Optimization Is Deceiving Us, and How to Stop It · HackerPapers discussions</title><link>https://hackerpaper.kaipfister.de/p/2102.03034/</link><description>Collected HN comments and submissions linking this paper.</description><language>en</language><lastBuildDate>Mon, 02 Nov 2026 11:16:22 GMT</lastBuildDate><atom:link href="https://hackerpaper.kaipfister.de/p/2102.03034/feed.xml" rel="self" type="application/rss+xml" /><item><title>Hyperparameter Optimization Is Deceiving Us, and How to Stop It — mentioned by george3d6</title><link>https://news.ycombinator.com/item?id=26198632</link><guid isPermaLink="false">urn:hackerpapers:mention:2102.03034:26198632</guid><pubDate>Fri, 19 Feb 2021 22:04:43 GMT</pubDate><description>&lt;p&gt;&amp;gt; So I assume that you are doing hyperparameter search? Can you share what optimization method you are using for search (e.g. random, gp )? Short answer is optuna and ax but only sometimes. Long answer lead me down a rabbit whole and it&amp;#x27;s 10k+ words and a few experiments deep. If you&amp;#x27;re interested in this are specifically ping me, but I&amp;#x27;ve got nothing concrete, however I like discussing it. A recent paper I saw that somewhat echos my thoughts is: https://arxiv.org/pdf/2102.03034.pdf | but some bits feel either over my head and/or overly pedantic and/or overly formal | and I&amp;#x27;m not sure I agree…&lt;/p&gt;&lt;p&gt;&lt;a href="https://hackerpaper.kaipfister.de/p/2102.03034/"&gt;Paper and discussion history&lt;/a&gt;. A mention is not an endorsement.&lt;/p&gt;</description><category>cs.LG</category></item></channel></rss>
