<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>ClawsBench: Evaluating Capability and Safety of LLM Productivity Agents in Simulated Workspaces · HackerPapers discussions</title><link>https://hackerpaper.kaipfister.de/p/2604.05172/</link><description>Collected HN comments and submissions linking this paper.</description><language>en</language><lastBuildDate>Mon, 02 Nov 2026 11:16:22 GMT</lastBuildDate><atom:link href="https://hackerpaper.kaipfister.de/p/2604.05172/feed.xml" rel="self" type="application/rss+xml" /><item><title>ClawsBench: Evaluating Capability and Safety of LLM Productivity Agents in Simulated Workspaces — mentioned by xdotli</title><link>https://news.ycombinator.com/item?id=47693530</link><guid isPermaLink="false">urn:hackerpapers:mention:2604.05172:47693530</guid><pubDate>Wed, 08 Apr 2026 17:34:06 GMT</pubDate><description>&lt;p&gt;Author here. We built 5 high-fidelity mock Google Workspace + Slack services and ran 7,224 trials across 6 frontier models and 4 agent harnesses. The headline finding that surprised us most: scaffolding (skills + meta prompt) gives a 39-63pp lift, while the top 5 models are statistically indistinguishable (53-63% TSR, no pairwise comparison survives correction). Your choice of scaffolding matters ~6x more than your choice of model. The safety findings are darker: Opus leads on task success (63%) but ties for most unsafe (23% UAR). GPT-5.4 is the safest (7% UAR) but mid-tier on tasks. There&amp;#x27;s…&lt;/p&gt;&lt;p&gt;&lt;a href="https://hackerpaper.kaipfister.de/p/2604.05172/"&gt;Paper and discussion history&lt;/a&gt;. A mention is not an endorsement.&lt;/p&gt;</description><category>cs.AI</category></item><item><title>ClawsBench: Evaluating Capability and Safety of LLM Productivity Agents in Simulated Workspaces — HN submission</title><link>https://news.ycombinator.com/item?id=47693529</link><guid isPermaLink="false">urn:hackerpapers:submission:2604.05172:47693529</guid><pubDate>Wed, 08 Apr 2026 17:34:06 GMT</pubDate><description>&lt;p&gt;ClawsBench shows GPT-5.4 tries to reward hack 80% of the time&lt;/p&gt;&lt;p&gt;&lt;/p&gt;&lt;p&gt;3 points; 1 discussion reply on HN. &lt;a href="https://hackerpaper.kaipfister.de/p/2604.05172/"&gt;Paper and source history&lt;/a&gt;. A submission is not an endorsement.&lt;/p&gt;</description><category>cs.AI</category></item></channel></rss>
