Stop Comparing LLM Agents Without Disclosing the Harness · HackerPapers discussions

Stop Comparing LLM Agents Without Disclosing the Harness — mentioned by 0xbadcafebee

Wed, 12 Aug 2026 20:47:51 GMT

Yep. It's a state machine; change the state, change the result. https://arxiv.org/html/2605.23950v1 | https://arxiv.org/pdf/2505.15146 | https://medium.com/@amontzamir/youre-praising-the-wrong-thin...

Paper and discussion history. A mention is not an endorsement.

Stop Comparing LLM Agents Without Disclosing the Harness — mentioned by criley2

Wed, 12 Aug 2026 11:53:49 GMT

What a sloppy reply. You've hijacked a thread on mathematics first to complain that your incompetent attempt to use ChatGPT to find a job failed, but it seems now that this was a ruse to instead begin arguments unrelated to the article at all where you just spam arxiv links you've never read to "prove" that AI is a scam. This comes across, frankly, as either Dunning-Kruger (classic illusory superiority), or potentially as mental illness. The slop dump is highly reminiscent of how a schizophrenic friend of mine communicates. Do you really think slopping down a bunch of random arxiv links…

Paper and discussion history. A mention is not an endorsement.

Stop Comparing LLM Agents Without Disclosing the Harness — mentioned by ElFitz

Thu, 11 Jun 2026 22:53:04 GMT

> and I have the feeling that the harness is much more important than the consensus expectation. Is that really the consensus? There’s been a bit of literature lately on that. Can’t find the one about looking into whether or not the harness had a greater impact than the models (for comparable models), but there’s this one: https://arxiv.org/html/2605.23950

Paper and discussion history. A mention is not an endorsement.