https://hackerpaper.kaipfister.de/p/2308.02950/Collected HN comments and submissions linking this paper.enMon, 02 Nov 2026 11:16:22 GMThttps://news.ycombinator.com/item?id=48161555urn:hackerpapers:mention:2308.02950:48161555Sat, 16 May 2026 16:22:51 GMT<p>I used to help build the CTFs for BSides Orlando. I ended up moving to another con, and at our last event we collected extensive logging for post mortem analysis. We found that AI usage is basically guaranteed now, but certain challenge designs did thwart it. Challenges built with temporal visual elements made AI fall flat on its face, as it could not ingest/process the data fast enough to act on them in time. We also found that counterfactual challenges (ie. the result you get did not match what we suggested you&#x27;d get) made AI-assisted solve time slower compared to pure humans, indirectly…</p><p><a href="https://hackerpaper.kaipfister.de/p/2308.02950/">Paper and discussion history</a>. A mention is not an endorsement.</p>cs.AI