arXiv:2510.26787cs.LG
Remote Labor Index: Measuring AI Automation of Remote Work
Early discovery. Linked by one identifiable commenter. This paper is outside the main ranking; a mention is not an endorsement.
Abstract
AIs have made rapid progress on research-oriented benchmarks of knowledge and reasoning, but it remains unclear how these gains translate into economic value and automation. To measure this, we introduce the Remote Labor Index (RLI), a broadly multi-sector benchmark comprising real-world, economically valuable projects designed to evaluate end-to-end agent performance in practical settings. AI agents perform near the floor on RLI, with the highest-performing agent achieving an automation rate of 2.5%. These results help ground discussions of AI automation in empirical evidence, setting a common basis for tracking AI impacts and enabling stakeholders to proactively navigate AI-driven labor automation.
https://arxiv.org/abs/2510.26787 Testing the top llms on wework, the highest performing one only succeeded with a rate of 2.5% Can you imagine not being fired when you can only do 2.5% of all tasks? This study is dated October 30th, very recent.
codexonView on HNParent context